Está en la página 1de 44

5/19/2011

Picking Winners and Losers in the Big Data Market g


Michael E. Driscoll, CTO, Metamarkets @medriscoll

Open Source Business Conference | May 16, 2011

5/19/2011

I. The Winning Opportunity

5/19/2011

Information is the oil of the 21st century.

5/19/2011

Big Data Force #1: The Attack of the Exponentials

5/19/2011

Big Data Force #1: The Attack of the Exponentials

5/19/2011

Big Data Force #2: The Growth of Sensor Networks

5/19/2011

Big Data Force #3: The Rise of Cloud Computing

5/19/2011

The Intersection of these Three Forces Yields An Explosion of Data

exponentialeconomics sensornetworks k cloudcomputing

5/19/2011

5/19/2011

II. Winning Skills

10

5/19/2011

Thesexyjobinthenexttenyearswillbestatisticians HalVarian

11

5/19/2011

12

5/19/2011

13

5/19/2011

=suffering

14

5/19/2011

15

5/19/2011

if ($foo =~ /\n {2,3}([A-Z]{5,7}) {2,5}/) /\ {2 3}([ ]{ }) {2 }/)

16

5/19/2011

=statistics

17

5/19/2011

data

model

1000bytes

2bytes

18

5/19/2011

The Promise of Predictive Analytics

extract
DATA FEATURES

learn
MODELS

predict

19

5/19/2011

Recommend a movie

20

5/19/2011

Prevent P t fraud

21

5/19/2011

22

5/19/2011

=storytelling

23

5/19/2011

24

5/19/2011

credit:MiguelRios,Twitter

25

5/19/2011

credit:PaulButler,Facebook

26

5/19/2011

credit:JoeReisinger,Metamarkets

27

5/19/2011

III. Winning Technologies

28

5/19/2011

The Emerging Big Data Stack


Actions

Apps&Services Apps & Services


(FraudDetection,RecEngines)

Analytics
(R,SPSS,SAS,SAP)

Insights

Data
RDBMS,Hadoop,CEP Data

29

5/19/2011

The Emerging Big Data Stack


CompetitiveMatrix Kdb Esper speed Vertica Netezza InfoBright MySQL Aster MapR Hadoop datascale

Apps&Services Apps & Services

Analytics Data
Postgres

Greenplum

30

5/19/2011

The Emerging Big Data Stack


CompetitiveMatrix custom(GPU) custom (GPU) speed

Apps&Services Apps & Services

Analytics
R

Matlab RevolutionR SAP SPSS S SS SAS datascale custom distributed

Data

SciPy Excel

31

5/19/2011

The Emerging Big Data Stack


CompetitiveMatrix

Apps&Services Apps & Services


cost

consultancies (McKinsey,BCG) frauddetection services

Analytics Data

focus

32

5/19/2011

Winners: Focused, Big, and Fast

Apps&Services Analytics Data D t

focusedapplications&services

biggeranalytics bi l i

fasterdataplatforms f d l f

33

5/19/2011

Thank You. Questions?


Michael E Driscoll CTO, Metamarkets E. Driscoll, CTO @medriscoll

Open Source Business Conference | May 16, 2011

34

5/19/2011

35

5/19/2011

The Promise of Predictive Analytics

extract
DATA FEATURES

learn
MODELS

predict

36

5/19/2011

Recommend a movie

37

5/19/2011

Prevent P t fraud

38

5/19/2011

39

5/19/2011

I. Data Privacy & Ownership

40

5/19/2011

II. Scalability of Algorithms

41

5/19/2011

III. User Data & Analytics

42

5/19/2011

IV. Data Exchanges & Ecosystems

43

5/19/2011

Predictive Analytics: The Consumer Crystal Ball


Omar Tawakol, Chief Executive Officer, Bluekai Matthew J. Barkoff Vice President Badgeville J Barkoff, President, Scott Burke, Senior Vice President, Yahoo! Theresia Gouw Ranzetta, Partner, Accel Partners , ,
Moderator: Michael E. Driscoll, Metamarkets

MIT/Stanford Venture Lab | February 15, 2011

44