SlideShare une entreprise Scribd logo
1  sur  32
Télécharger pour lire hors ligne
CSS LABS




           Distributed Key-Value Stores
                    Featuring Riak
CSS LABS
                       Hi, i am qiak   Hi, i am riak   Hi, i am siak




     Hi, i am piak




                                                                       Hi, i am tiak



                     Story of a 5 Node Cluster


          Once upon time there were five nodes...
                                           ... and they formed a Ring
CSS LABS
                   Qiak, I will
                                  All is well!   I am hit!
                   Take care.



     Too drunk!




                                                             Siak! I amthere!




                  Story of a 5 Node Cluster


        They together kept a lot of data...
                   ... some shared, some not ...
                         ... they were always willing to cover up
CSS LABS                                                                          Hi, i am viak!
                                                                  Guys! This is
                                         Great to   Ah! did you
                    Well, hello!                                     viak.
                                        have you!     know?




       Hi Viak!




                  Story of a 5 Node Cluster

       They were welcoming...

                                   ... they were together called Riak!
CSS LABS




                     Riak Cluster
                        The Features



       * Decentralized        * Erlang Advantage
       * Key-Value Store      * RESTful API: jiak
       * Document Oriented    * Map-Reduce
CSS LABS




                     Riak Cluster
                        The Features



       * Decentralized        * No master
                              * Node Independence
                              * Failure Tranperancy
CSS LABS




                     Riak Cluster
                        The Features



                              * NoSQL
       * Key-Value Store      * Memory Footprint
                              * Logical data
CSS LABS




                    Riak Cluster
                       The Features



                             * No Tables
                             * Field Flexibilty
       * Document Oriented
                             * Extensible
CSS LABS




                      Riak Cluster
                         The Features



       * Designed to Distribute   * Erlang Advantage

       * Concurrent Processes
       * No Shared State
CSS LABS




                      Riak Cluster
                         The Features



       * In Thing
       * Small Learning Curve   * RESTful API: jiak

       * Web 2.0
CSS LABS




                      Riak Cluster
                         The Features



       * Already Key-Value
       * Huge Data
                               * Map-Reduce
       * Clustered
CSS LABS




                            Riak Cluster
                               The Concepts

                A.C.I.D.*                     C.A.P.+




* Atomicity
  Consistency                                           +
                                                            Consistency
  Isolation                                                 Availability
  Durability                                                Partition Tolerance
CSS LABS




           Riak Cluster
              The Concepts
CSS LABS
Keys map onto points, on                     E           B's Key range:
 the ring, determined by                                    RangeEB
   some hash function




                    C

                                                     B



                           Riak Cluster
                              The Concepts


                                                         A's Key range:
                                                            RangeBA

                                                 A
                           D
CSS LABS
Keys map onto points, on                     E           B's Key range.
 the ring, determined by                                    RangeEB
   some hash function


                                B Crashes, now
                                  the range?
                                   RangeEA
                    C

                                                     B



                           Riak Cluster
                              The Concepts


                                                         A's Key range.
                                                            RangeBA

                                                 A
                           D
CSS LABS
Keys map onto points, on                           E            B's Key range:
 the ring, determined by                                           RangeEB
   some hash function




                    C

                                                            B



 Replicas of the           Riak Cluster
                              The Concepts
   data are                The Key is hashed onto the
  maintained.                   ring, in RangeBA                A's Key range:
                             Hence data stored in A                RangeBA

                                                        A
                           D
CSS LABS
Keys map onto points, on                            E           B's Key range:
 the ring, determined by                                           RangeEB
   some hash function




                    C      New Node F, Splits the
                                 range.
                            RangeDF & RangeFC               B
  Drops the
  replica of
   RangeBA
                           Riak Cluster
                              The Concepts

                    F      The Key is hashed onto the
                                ring, in RangeBA                A's Key range:
                             Hence data stored in A                RangeBA
  Replica of
 RangeBA is                                             A
 moved here                D
CSS LABS
N=3                              E




           C

                                         B



               Riak Cluster
                  The Concepts

           F



                                     A
               D
CSS LABS
W=2                              E




           C

                                         B



               Riak Cluster
                  The Concepts

           F



                                     A
               D
CSS LABS
R=2                              E




           C

                                         B



               Riak Cluster
                  The Concepts

           F



                                     A
               D
CSS LABS




           DocV0

                   Riak Cluster
                      The Concepts
CSS LABS




           DocV0                     DocV0

                   Riak Cluster
                      The Concepts
CSS LABS




           DocV1
            DocV1                     DocV0

                    Riak Cluster
                       The Concepts
CSS LABS




           DocV1                     DocV1
                                      DocV0

                   Riak Cluster
                      The Concepts
CSS LABS




       DocV1a
        DocV0                     DocV1b
                                   DocV0

                Riak Cluster
                   The Concepts
CSS LABS




   DocV1b   DocV1a

                     Riak Cluster
                        The Concepts
CSS LABS




           Riak Cluster
              Operating on it.
CSS LABS




                                 ?
           Riak Cluster
              The Competition.
CSS LABS




                       Riak Cluster
                          The Competition.




           Cassandra                         CouchDB

           Voldemort                         Scalaris
CSS LABS




                          ?
           Riak Cluster
              Use cases
CSS LABS




                         Riak Cluster
                            Use cases




       Log Aggregation                  Session Store

           Photo Store                   Tag Clouds
CSS LABS




           Thank You!

Contenu connexe

En vedette (6)

Introducing Riak
Introducing RiakIntroducing Riak
Introducing Riak
 
Introduction to Riak - Red Dirt Ruby Conf Training
Introduction to Riak - Red Dirt Ruby Conf TrainingIntroduction to Riak - Red Dirt Ruby Conf Training
Introduction to Riak - Red Dirt Ruby Conf Training
 
Riak Operations
Riak OperationsRiak Operations
Riak Operations
 
Riak in Ten Minutes
Riak in Ten MinutesRiak in Ten Minutes
Riak in Ten Minutes
 
Riak (Øredev nosql day)
Riak (Øredev nosql day)Riak (Øredev nosql day)
Riak (Øredev nosql day)
 
Riak Training Session — Surge 2011
Riak Training Session — Surge 2011Riak Training Session — Surge 2011
Riak Training Session — Surge 2011
 

Similaire à Distributed Key-Value Stores- Featuring Riak

Philly DB MapR M7 - March 2013
Philly DB MapR M7 - March 2013Philly DB MapR M7 - March 2013
Philly DB MapR M7 - March 2013
MapR Technologies
 
Polyglot Plugin Programming
Polyglot Plugin ProgrammingPolyglot Plugin Programming
Polyglot Plugin Programming
Atlassian
 
Reducing Cache Misses in Hash Join Probing Phase by Pre-sorting Strategy
Reducing Cache Misses in Hash Join Probing Phase by Pre-sorting StrategyReducing Cache Misses in Hash Join Probing Phase by Pre-sorting Strategy
Reducing Cache Misses in Hash Join Probing Phase by Pre-sorting Strategy
Jaemyung Kim
 

Similaire à Distributed Key-Value Stores- Featuring Riak (12)

NoSQL @ Qbranch -2010-04-15
NoSQL @ Qbranch -2010-04-15NoSQL @ Qbranch -2010-04-15
NoSQL @ Qbranch -2010-04-15
 
Philly DB MapR M7 - March 2013
Philly DB MapR M7 - March 2013Philly DB MapR M7 - March 2013
Philly DB MapR M7 - March 2013
 
PhillyDB Hbase and MapR M7 - March 2013
PhillyDB Hbase and MapR M7 - March 2013PhillyDB Hbase and MapR M7 - March 2013
PhillyDB Hbase and MapR M7 - March 2013
 
Spring one2gx2010 spring-nonrelational_data
Spring one2gx2010 spring-nonrelational_dataSpring one2gx2010 spring-nonrelational_data
Spring one2gx2010 spring-nonrelational_data
 
Accelerating NoSQL
Accelerating NoSQLAccelerating NoSQL
Accelerating NoSQL
 
MyCassandra (Full English Version)
MyCassandra (Full English Version)MyCassandra (Full English Version)
MyCassandra (Full English Version)
 
Adding Riak to your NoSQL Bag of Tricks
Adding Riak to your NoSQL Bag of TricksAdding Riak to your NoSQL Bag of Tricks
Adding Riak to your NoSQL Bag of Tricks
 
Yes sql08 inmemorydb
Yes sql08 inmemorydbYes sql08 inmemorydb
Yes sql08 inmemorydb
 
Polyglot Plugin Programming
Polyglot Plugin ProgrammingPolyglot Plugin Programming
Polyglot Plugin Programming
 
Riak CS in Cloudstack
Riak CS in CloudstackRiak CS in Cloudstack
Riak CS in Cloudstack
 
Reducing Cache Misses in Hash Join Probing Phase by Pre-sorting Strategy
Reducing Cache Misses in Hash Join Probing Phase by Pre-sorting StrategyReducing Cache Misses in Hash Join Probing Phase by Pre-sorting Strategy
Reducing Cache Misses in Hash Join Probing Phase by Pre-sorting Strategy
 
第17回Cassandra勉強会: MyCassandra
第17回Cassandra勉強会: MyCassandra第17回Cassandra勉強会: MyCassandra
第17回Cassandra勉強会: MyCassandra
 

Plus de samof76

Plus de samof76 (10)

Supervisord, The Process Manager
Supervisord, The Process ManagerSupervisord, The Process Manager
Supervisord, The Process Manager
 
Python Subprocess
Python SubprocessPython Subprocess
Python Subprocess
 
Proces
ProcesProces
Proces
 
Process Management using Circus
Process Management using CircusProcess Management using Circus
Process Management using Circus
 
Lxc- Linux Containers
Lxc- Linux ContainersLxc- Linux Containers
Lxc- Linux Containers
 
Git.intro
Git.introGit.intro
Git.intro
 
AWS Use Cases
AWS Use CasesAWS Use Cases
AWS Use Cases
 
Cloud
CloudCloud
Cloud
 
Cloud- IaaS in Perspective AWS
Cloud- IaaS in Perspective AWSCloud- IaaS in Perspective AWS
Cloud- IaaS in Perspective AWS
 
Open Source 2.0
Open Source 2.0Open Source 2.0
Open Source 2.0
 

Dernier

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Dernier (20)

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdf
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 

Distributed Key-Value Stores- Featuring Riak

  • 1. CSS LABS Distributed Key-Value Stores Featuring Riak
  • 2. CSS LABS Hi, i am qiak Hi, i am riak Hi, i am siak Hi, i am piak Hi, i am tiak Story of a 5 Node Cluster Once upon time there were five nodes... ... and they formed a Ring
  • 3. CSS LABS Qiak, I will All is well! I am hit! Take care. Too drunk! Siak! I amthere! Story of a 5 Node Cluster They together kept a lot of data... ... some shared, some not ... ... they were always willing to cover up
  • 4. CSS LABS Hi, i am viak! Guys! This is Great to Ah! did you Well, hello! viak. have you! know? Hi Viak! Story of a 5 Node Cluster They were welcoming... ... they were together called Riak!
  • 5. CSS LABS Riak Cluster The Features * Decentralized * Erlang Advantage * Key-Value Store * RESTful API: jiak * Document Oriented * Map-Reduce
  • 6. CSS LABS Riak Cluster The Features * Decentralized * No master * Node Independence * Failure Tranperancy
  • 7. CSS LABS Riak Cluster The Features * NoSQL * Key-Value Store * Memory Footprint * Logical data
  • 8. CSS LABS Riak Cluster The Features * No Tables * Field Flexibilty * Document Oriented * Extensible
  • 9. CSS LABS Riak Cluster The Features * Designed to Distribute * Erlang Advantage * Concurrent Processes * No Shared State
  • 10. CSS LABS Riak Cluster The Features * In Thing * Small Learning Curve * RESTful API: jiak * Web 2.0
  • 11. CSS LABS Riak Cluster The Features * Already Key-Value * Huge Data * Map-Reduce * Clustered
  • 12. CSS LABS Riak Cluster The Concepts A.C.I.D.* C.A.P.+ * Atomicity Consistency + Consistency Isolation Availability Durability Partition Tolerance
  • 13. CSS LABS Riak Cluster The Concepts
  • 14. CSS LABS Keys map onto points, on E B's Key range: the ring, determined by RangeEB some hash function C B Riak Cluster The Concepts A's Key range: RangeBA A D
  • 15. CSS LABS Keys map onto points, on E B's Key range. the ring, determined by RangeEB some hash function B Crashes, now the range? RangeEA C B Riak Cluster The Concepts A's Key range. RangeBA A D
  • 16. CSS LABS Keys map onto points, on E B's Key range: the ring, determined by RangeEB some hash function C B Replicas of the Riak Cluster The Concepts data are The Key is hashed onto the maintained. ring, in RangeBA A's Key range: Hence data stored in A RangeBA A D
  • 17. CSS LABS Keys map onto points, on E B's Key range: the ring, determined by RangeEB some hash function C New Node F, Splits the range. RangeDF & RangeFC B Drops the replica of RangeBA Riak Cluster The Concepts F The Key is hashed onto the ring, in RangeBA A's Key range: Hence data stored in A RangeBA Replica of RangeBA is A moved here D
  • 18. CSS LABS N=3 E C B Riak Cluster The Concepts F A D
  • 19. CSS LABS W=2 E C B Riak Cluster The Concepts F A D
  • 20. CSS LABS R=2 E C B Riak Cluster The Concepts F A D
  • 21. CSS LABS DocV0 Riak Cluster The Concepts
  • 22. CSS LABS DocV0 DocV0 Riak Cluster The Concepts
  • 23. CSS LABS DocV1 DocV1 DocV0 Riak Cluster The Concepts
  • 24. CSS LABS DocV1 DocV1 DocV0 Riak Cluster The Concepts
  • 25. CSS LABS DocV1a DocV0 DocV1b DocV0 Riak Cluster The Concepts
  • 26. CSS LABS DocV1b DocV1a Riak Cluster The Concepts
  • 27. CSS LABS Riak Cluster Operating on it.
  • 28. CSS LABS ? Riak Cluster The Competition.
  • 29. CSS LABS Riak Cluster The Competition. Cassandra CouchDB Voldemort Scalaris
  • 30. CSS LABS ? Riak Cluster Use cases
  • 31. CSS LABS Riak Cluster Use cases Log Aggregation Session Store Photo Store Tag Clouds
  • 32. CSS LABS Thank You!