Apache Cassandra at Videoplaza — Stockholm Cassandra Users — September 2013
•Télécharger en tant que PPT, PDF•
0 j'aime•1,555 vues
Josh Glover, Software Engineer at Videoplaza, will introduce you to the domain of video advertising and show how Videoplaza uses Apache Cassandra as part of a system that solves the difficult problem of allowing clients to analyse the performance of their advertising campaigns in real-time. Videoplaza needs to aggregate data for tens of thousands of combinations of dimensions and metrics for hundreds of clients from an incoming stream of thousands of requests per second, and do it fast enough so that clients can see trends as they happen.
Recommandé
Recommandé
Contenu connexe
Tendances
Tendances (20)
En vedette
En vedette (10)
Similaire à Apache Cassandra at Videoplaza — Stockholm Cassandra Users — September 2013
Similaire à Apache Cassandra at Videoplaza — Stockholm Cassandra Users — September 2013 (20)
Plus de DataStax Academy
Plus de DataStax Academy (20)
Dernier
Dernier (20)
Apache Cassandra at Videoplaza — Stockholm Cassandra Users — September 2013
- 1. Karbon Insight: Realtime Reporting
- 2. Introduction to ad serving Video player Ad player Distributor Tracker
- 3. Event tracking •View (event ID 127) •Click (event ID 128) •and many more
- 4. What do our customers want? •Any report they can dream up •Right away!
- 5. Simple report: hour by ad and event
- 6. Realtime reporting Multidimensional OLAP cube Ad Event Time
- 7. ROLAP with star schema
- 8. Disadvantages of ROLAP •Slow queries •Lots of joins •Expensive to scale •SQL limitations
- 9. MOLAP to the rescue!
- 10. What is a counter?
- 11. You can’t always get what you want...
- 12. • Time • Event • Ad • Device • Category • Location • Tag • Demography Possible report dimensions
- 13. Many counters 8 dimensions average size of 50 508 counters! (39 trillion)
- 14. Average campaign length: 21 days (504 hours)
- 15. Time flies like a banana 21 days = 39 trillion counters 42 days -> 78 trillion 84 days -> 156 trillion 365 days -> 677 trillion
- 16. 5 years down the road 3.39 quadrillion
- 17. 3.39 quadrillion is a rather large number indeed Number of stars in 7500 galaxies like the Milky way. 15% of the surveyed universe!
- 20. Fake it till you can make it Don’t aggregate anything until they ask for it!
- 21. •Time period •By hour •And ad •Views •Clicks
- 22. Counter Storage
- 23. Why Cassandra? •Fast writes •Linear scaling •Battle-hardened •(Relatively) simple operations •Great community!
- 24. Cassandra TrackerTracker FlusherFlusher AggregatorAggregator MergerMerger live00 ... live31 RabbitMQ flush00 ... flush31counter00 ... counter31
- 25. Our setup •DataStax CE 1.1.9 •18 node cluster •1 datacentre
- 26. Data model •1 keyspace (RF: 3) •1 column family •Leveled compaction
- 27. Row keys aggregate definition ID dimension values time granularity
- 29. Columns time value -> counter transaction ID -> id
- 30. 2013-09-10.18 -> 6348 txID -> 876219102 Example columns 2013-09-10.19 -> 9784
- 31. total -> 6348 txID -> 876219102 Columns for rows with no time aggregation
- 32. Reading counters
- 37. Get column value First byte is counter type (long, double, Hyper LogLog)
- 38. Writing counters
- 39. Flush shards ... Flusher 1 shards 00-08 Flusher 4 shards 24-32 Cassandra
- 40. Merge increment rows with read cache Skip rows with the same transaction ID
- 41. Write rows in mutation batches (of 400)
- 42. Things we got wrong
- 43. Each CF has 1M heap overhead Too many column families Multi-tenancy FTW! FAIL #1
- 44. CLI defaults to replication factor of 1! Manual operations Tools and automation FTW! FAIL #2
- 45. No way to undo data loading No snapshots Automated snapshots FTW! FAIL #3
- 46. Post-processing of queried data Timezones Store data in customer timezone FAIL #4
- 47. 10 TB of data 1500 wps 40,000 rps
- 48. Q&A
Notes de l'éditeur
- OnLine Analytical Processing
- Relational OnLine Analytical Processing
- Multidimensional / Materialised OnLine Analytical Processing
- Time: hours, months, years, etc. Event: views, clicks Device: iPhone, PC, PS3 Demo: age, gender, income, interests Location
- Create report template -> aggregate ID
- Tracker publishes to message broker (we use RabbitMQ). If you don’t know anything about messaging, definitely talk to me afterwards! For each event, you will increment a bunch of counters (e.g. ad and event, ad and time and event, etc.)
- Upgrading to 1.2 this week!
- 10mb sstables
- Scala-style; key -> value Explain transaction ID here
- Adef tells us which combinations of dimensions are necessary Dimensions repository contains dimension values
- Read rows one at a time due to Thrift max message size After we upgrade, we can use binary CQL client for better performance
- Java futures
- Shard by hashing values of all dimensions except time
- We can replay data, but we can’t unplay it. No way to decrement a Hyper LogLog counter.