This document discusses scaling NoSQL databases and describes how Google BigTable and Amazon Dynamo influenced the development of NoSQL databases. It explains BigTable's column family data model and how it allows for multi-dimensional scaling and schema-free sparse columns. The document also notes that BigTable and Dynamo helped drive the need to consider data modeling and query requirements when designing NoSQL databases.

1. A Highly Scalable NoSQL Database
Jared Winick
DOSUG Ignite
10.05.2010

4. Palo Alto, CA. 2008
Mr. Google BigTable Ms. Amazon Dynamo

5. The Next Morning…
Mr. Google BigTable Ms. Amazon Dynamo

6. 9 Months Later. It’s a girl!!!

7. 2010

8. One NoSQL database to rule them all?
(One NoSQL database to rule them all?)

10. BigTable’s ColumnFamily Data Model
UserColumnFamily = {
‘userid00000': { Column Family
'id': ‘userid00000', Key
'username': jaredwinick', Column Name
‘name’: ‘Jared Winick’ Column Value
},
‘userid00001’: {
‘id’: ‘userid00001’,
‘username’ : ‘barackobama’,
‘name’ : ‘Barack Obama’,
‘location’ : ‘Washington, D.C.’,
‘bio’ : ‘44th President of the United States’
}, …
}
Multi-dimensional Hash O(1)
Schema-Free
Sparse Columns

11. Find row In UserColumnFamily Where username = ‘jaredwinick’

12. No Key, No Row

13. Solution
UserNameColumnFamily = {
‘jaredwinick': {
'id': ‘userid00000'
},
‘barackobama’: {
‘id’: ‘userid00001’
}, …
}
Think about query Model Data
Start
requirements Appropriately

16. Rack Aware
Datacenter Aware

20. #irc

21. (2) http://upload.wikimedia.org/wikipedia/commons/3/30/Furniture_installation_tools.jpg
(3) http://en.wikipedia.org/wiki/File:Waldburg_Ahnentafel.jpg
(6) http://www.oscarmaximus.com/stork_boy.JPG
(8) http://media.monstersandcritics.com/articles/1206051/article_images/theeyeofsauronwithmountdoominthebackground.jpg
(8) http://home.student.uu.se/j/jowi4905/fonts/annatar.html
(8) http://www.thehutt.de/tolkien/fonts.html
(9) http://kimdy.gri.re.kr/others/entertainment/the_lord_of_the_ring/stills_1/dvd_fellowship_1280.jpg
(14) http://www.flickr.com/photos/32623546@N05/3639560735/
(15) http://s3.amazonaws.com/AllThingsDistributed/sosp/amazon-dynamo-sosp2007.pdf
(16) http://upload.wikimedia.org/wikipedia/commons/9/9d/Blank_map_of_the_United_States.PNG
(17) http://www.flickr.com/photos/mskogly/3258771132/
(19) http://www.flickr.com/photos/srudy/4679621144/
(20) http://www.flickr.com/photos/gcoupe/20972113/