Recommandé
Recommandé
Contenu connexe
Similaire à 2011.06.13 hotstorage-panel
Similaire à 2011.06.13 hotstorage-panel (20)
Plus de Acunu
Plus de Acunu (20)
Dernier
Dernier (20)
2011.06.13 hotstorage-panel
- 1. What is Big Data? Andy Twigg Acunu and Oxford HotStorage11 Panel
- 2. Claim: “Big Data” is not: scale-out, web-scale, nosql, etc... Some of the biggest big data problems involve mysql. Some of the best-known NoSQL DBs don’t scale out.
- 5. Storage is changing: 3 fundamental shifts
- 6. 1: storage technology $100 $100 60 GB 2000 GB 40,000 IOPS 100 IOPS 150 MB/s 130 MB/s
- 7. Can we remain here? The B-tree operates here (even with a LFS) ~device capacity
- 8. 2: know your workloads! Ingest Analyze Serve High-entropy update Range queries Random reads • small entries (e.g. cookies, ticks) • little value (you don’t care losing 1%) • high-entropy, high rate updates (>100,000/s) • range queries (analytics)
- 9. 3: commodity h/w Lots of people rely on EC2. How do you get reliability there? Enterprises like support and reliability. But what is the easiest way to get 5 9’s reliability, assuming s/w works? Scale-out is unavoidable. The challenge is getting to grips with the problems scale-out brings - CAP, Vector clocks, etc. Read the literature! Don’t reinvent the wheel!
- 10. bitbucket.org/acunu www.acunu.com/download Apache, Apache Cassandra, Cassandra, Hadoop, and the eye and elephant logos are trademarks of the Apache Software Foundation.
Notes de l'éditeur
- \n
- Some of the biggest big data problems involve mysql.\nSome of the well-known NoSQL DBs don’t scale out.\n
- To ride a huge wave, you have to finely balance, and understand, several unstoppable forces. Dealing with Big Data is like riding this technology wave.\n
- If you try to work against it, it can hurt you.\n
- \n
- \n
- \n
- \n
- startup prob valued at $100s m \n
- \n