Charlotte.rb - "Comics" Is Hard
•Télécharger en tant que KEY, PDF•
2 j'aime•989 vues
The document discusses different data modeling approaches for complex domains like biology and comics. It notes that relational databases struggle with hierarchical data, while graph databases are well-suited for modeling relationships and connectivity. Document databases allow embedding related data and working with semi-structured documents. The document recommends using the database approach that best matches each domain's data structure and access patterns.
Recommandé
Recommandé
Contenu connexe
En vedette
Plus de Ben Scofield
Plus de Ben Scofield (20)
Dernier
Dernier (20)
Charlotte.rb - "Comics" Is Hard
- 1. “Comics” Is Hard: On Domains and Databases Ben Sco eld – Viget Labs
- 2. domains
- 3. biology
- 4. Kingdom Animalia Phylum Chordata Class Mammalia Order Carnivora Family Felidae Genus Panthera Species tigris ickr: pandiyan
- 5. Animalia Chordata Mammalia Carnivora Felidae Panthera tigris ickr: pandiyan
- 6. kingdoms phyla classes orders families genera species
- 7. Problem The levels are imaginary
- 8. kingdoms subphyla phyla superclasses subclasses classes superorders suborders orders superfamilies subfamilies families subgenera genera subspecies species varieties
- 9. kingdoms subphyla phyla superclasses subclasses ? classes superorders suborders orders superfamilies subfamilies families subgenera genera subspecies species varieties
- 10. taxa subspecies species varieties
- 15. ickr: chiotsrun
- 16. ickr: niznoz
- 18. Cladistics
- 19. clades organisms
- 20. Problem Cladistics is historical and counter-intuitive
- 21. ickr: goellnitz
- 22. ickr: goellnitz pcoin
- 25. The Challenge Unclear, imprecise domain
- 26. comics
- 27. publishers titles issues
- 29. publishers imprints titles issues
- 31. publishers imprints titles volumes issues
- 34. publishers imprints titles volumes trades issues reprints
- 41. publishers imprints titles volumes trades issues reprints variants
- 45. publishers imprints titles names volumes trades issues reprints variants
- 52. publishers imprints ? titles names volumes trades issues reprints nested set? variants
- 54. publishers imprints ?!?! titles names volumes trades issues reprints nested set? variants
- 55. science fiction noir horror genres? independent Martial Arts historical superhero Pirate
- 56. publishers imprints #&*! titles names volumes trades genres issues reprints nested set? variants
- 60. key-value stores
- 62. require "rubygems" require "tokyocabinet" include TokyoCabinet bdb = BDB::new # B-Tree database; keys may have multiple values bdb.open("casket.bdb", BDB::OWRITER | BDB::OCREAT) # store records in the database, allowing duplicates bdb.putdup("key1", "value1") bdb.putdup("key1", "value2") bdb.put("key2", "value3") bdb.put("key3", "value4") # retrieve all values p bdb.getlist("key1") # => ["value1", "value2"] # range query, find all matching keys p bdb.range("key1", true, "key3", true) # => ["key1", "key2", "key3"] http://www.igvita.com/2009/02/13/tokyo-cabinet-beyond-key-value-store/
- 63. Biology x Comics x
- 64. Configuration ✓ Caching ✓ Translations ✓
- 68. { 'name':'Ben Scofield', 'twitter':'@bscofield' } { 'name':'Jim Van Fleet', 'adjective':'awesomesauce' }
- 69. class Question include MongoMapper::Document key :number, Integer, :required => true key :text, String, :required => true many :choices end class Choice include MongoMapper::EmbeddedDocument key :text, String, :required => true end
- 71. Biology ✓ Comics x
- 72. { ‘kingdom’:‘Animalia’, ‘phylum’:‘Chordata’, ‘subphylum’:‘Vertebrata’, ‘class’:‘Mammalia’, ‘subclass’:‘Eutheria’, ‘order’:‘Carnivora’, ‘family’:‘Felidae’, ‘subfamily’:‘Panthernae’, ‘genus’:‘Pantera’, ‘species’:‘tigris’, ‘name’:‘Wanda’ }
- 73. { ‘kingdom’:‘Animalia’, ‘subkingdom’:‘Eumetazoa’, ‘phylum’:‘Chordata’, ‘subphylum’:‘Vertebrata’, ‘class’:‘Mammalia’, ‘subclass’:‘Theria’, ‘order’:‘Carnivora’, ‘suborder’: ‘Caniformia’, ‘family’:‘Canidae’, ‘subfamily’:‘Caninae’, ‘tribe’:‘Canini’, ‘genus’:‘Canis’, ‘species’:‘lupus’, ‘subspecies’:‘familiaris’, ‘name’:‘Daisy’ }
- 75. graph databases
- 80. Biology ✓ Comics ✓
- 81. Animalia ... Felidae subfamilyof genusof Panthernae genusof Panthera speciesof tigris member 001 age name weight 3 Wanda 300
- 82. Animalia ... Felidae subfamilyof genusof Panthernae genusof Panthera species speciesof type tigris 010 name tigris member 001 age name weight 3 Wanda 300
- 83. Group IV orderof Picornavirales familyof Picornaviridae genusof Rhinovirus speciesof human rhinovirus A member 002
- 84. class Mammalia Group IV group orderof orderof Carnivora Picornavirales familyof familyof Felidae Picornaviridae subfamilyof Panthernae genusof genusof genusof Panthera Rhinovirus speciesof speciesof human tigris rhinovirus A member member 001 002
- 85. DC imprintof titleof DC Universe Green titleof 001 Lantern nameof genreof volumeof genreof Volume 1 Sci Fi Superhero genreof issueof genreof 002 precedes Issue #2 number coverof #1 003
- 86. require 'neo4j' Neo4j::Transaction.run do dc = Neo4j::Node.new dc[:name] = 'DC' dc_universe = Neo4j::Node.new dc_universe[:name] = 'DC Universe' dc.relationships.outgoing(:imprints) << dc_universe rel = dc.relationships.outgoing(:imprints).first rel[:started] = 1980 vol1 = Neo4j::Node.new vol1[:started] = 1941 vol1[:ended] = 1949 vol1[:name] = 'Green Lantern' dc.relationships.outgoing(:titles) << vol1 dc_universe.relationships.outgoing(:titles) << vol1 # ... end
- 89. selection
- 90. None Key-Value Many-One Document-Oriented Many-Many Relational Many-Many ++ Graph
- 92. { ‘title’:‘I Love Cheese’ ‘content’:‘Cheese is...’ ‘posted’:’24 Sept 2009’ ‘comments’:[{ ‘author’:‘Joe Schmoe’ ‘posted’:’24 Sept 2009’ ‘content’:‘First!’ }, {...}] }
- 93. Tag Tag Post General Life 1ec8264 Work Food 1ec8264 Fitness Writing bae294a Life Food Writing { ‘title’:‘I Love Cheese’ Family ‘content’:‘Cheese is...’ ‘posted’:’24 Sept 2009’ ‘comments’:[{ ‘author’:‘Joe Schmoe’ ‘posted’:’24 Sept 2009’ ‘content’:‘First!’ }, {...}] }
- 94. HTTP application application
- 95. HTTP application
- 96. application
- 97. application
- 98. Thank You ben sco eld - @bsco eld http://bensco eld.com http://www.viget.com/extend http://www.speakerrate.com/bsco eld
Notes de l'éditeur
- bad diagram - self-referential join in taxon table
- TIGON - Tiger + Lioness Ernst Mayr: &#x201C;groups of actually or potentially interbreeding natural populations, which are reproductively isolated from other such groups&#x201D;
- tomatoes - hybrids & heirlooms
- PLUOT Plum + Apricot
- Caminalcules (from Camin and animalcule) are a group of animal-like life forms invented by Professor Joseph H. Camin (University of Kansas) as a tool for understanding phylogenetics. Interested in how taxonomists group species, he designed these creatures to show an evolutionary pattern of divergence and diversification in morphology. There are 29 recent 'species' of Caminalcules and 48 fossil forms.
- bad diagram - self-referential join in taxon table
- problems with cladistics: historical change is hard to see, and cladistics gives you CRAZY counter-intuitive results
- this is a little naive - titles can change imprints; in some cases, retroactively
- ISSUES collected in diff trades
- volume has-many trades trade has-many issues issue has-many trades
- diff covers, and sometimes internal art
- favorite variant cover of all time...
- issue has-many variants (incl covers, writing, art)
- issue has-many variants (incl covers, writing, art)
- call attention to the title change (ala Aquaman) numbering changes: CAC started with #1 in 1941
- call attention to the title change (ala Aquaman) numbering changes: CAC started with #1 in 1941
- most recent volume of Cap started in 2005 -> #50 then renumbered #600
- most recent volume of Cap started in 2005 -> #50 then renumbered #600
- Fallen Angel -- DC => IDW
- could be implemented as tagging
- just because you can model relationships in these alt DBs, doesn&#x2019;t mean you should. YOU SHOULDN&#x2019;T!
- Cassandra inherits from Amazon&#x2019;s Dynamo and Google&#x2019;s BigTable - eventual consistency, rich data model
- for more information
- CouchDB - HTTP Mongo - socket???
- both use JSON
- MongoMapper from John Nunemaker
- for more information
- Perfect use for document DB: CMS with custom fields
- RDF / Web 2.0 30 years old, finally coming into its own
- back to the blog example
- tags don&#x2019;t fit in the document model
- baby steps: polyglotting applications and/or web services
- step two: connect to couch via HTTP directly (couch application)
- step three: polyglot away!
- step three: polyglot away!