Contenu connexe
Similaire à Stefan Groschupf of Datameer Gives Lightning Tallk at BigDataCamp (20)
Stefan Groschupf of Datameer Gives Lightning Tallk at BigDataCamp
- 2. Street Cred
Long time open source contributor
Zkclient
Aws-tasks
2 © Datameer, Inc. 2010
- 3. Who are we?
Big data analytics leveraging the power and scale of Hadoop
Started working on idea in 2008, formed company in 2009
Headquartered in San Mateo, CA with office in Halle, Germany
Funded by
Management team from Yahoo!, Sun, Apple, Borland
3 © Datameer, Inc. 2010
- 4. Data grows rapidly
Unstructured
Structured
Enterprise data doubles every three years (Forrester)
Unstructured data grows at 61.7% CAGR (IDC)
Structured data grows at 21.8%. (IDC)
4 © Datameer, Inc. 2010
- 5. Big Data Analytics Stack
Infrastructure Platform Data Analytics
5 © Datameer, Inc. 2010
- 6. Big Data for Anyone
EMR, S3 < $100 to process TB
Tools getting easier to use
• Cascading / Pig vs MapReduce
• Spreadsheets vs SQL
6 © Datameer, Inc. 2010
- 7. Discover Influencers for < $100
Basic Auth
S3
TwitterClient Compression Upload
Thread Thread Thread
EC2 Server
256 MB 50 MB
7 © Datameer, Inc. 2010