SlideShare une entreprise Scribd logo
1  sur  35
Télécharger pour lire hors ligne
Virtualizing and Scaling
                          for the Future




Tuesday, March 29, 2011
Who am I?
                          Was Director of Architecture for MySQL


                          Founder/CTO Data Differential




                                            Drizzle
                                           Gearman
                                         Memcached
Tuesday, March 29, 2011
In the beginning...



Tuesday, March 29, 2011
• 2008 Sun buys MySQL
                    • 2008 Drizzle forks from MySQL
                    • 2009 Oracle buys Sun
                    • 2010 Drizzle Developers split from Oracle
                    • 2011 First GA Release, Drizzle7

Tuesday, March 29, 2011
Drizzle

                    • Entirely Open Source RDBMS
                    • C++, with a MicroKernel Design
                    • No Gotchas


Tuesday, March 29, 2011
Drizzle7
                          (Quick Update)




Tuesday, March 29, 2011
Today’s Pluggable
                             Interfaces
                    • Replication      • Table Functions
                    • Storage Engine   • Functions
                    • Logging          • Protocol
                    • Authentication   • Query Rewrite
                    • Authorization    • XA

Tuesday, March 29, 2011
HTTP                       Replication
                                         Client            Client
     Cloud Service            Client



                             HTTP Blob          MySQL         Drizzle
                             Streaming
                                                        SQL



                                 Listener
                                                              Logging
         Query Memcached           Parser
              Cache

                                 Optimizer
                Memcached                               Error Reporting
                                Executioner

                   Gearman     Storage System
                                                        MicroKernel

Tuesday, March 29, 2011
Replication

                    • Google Protocol Buffer Based
                    • Replicates row transformations.
                    • Integrates today with RabbitMQ, Casandra.
                          Memcached, Gearman




Tuesday, March 29, 2011
INSERT


                          INSERT
       Stored
   Transactionally
                          UPDATE


                          INSERT



Tuesday, March 29, 2011
Slave




                          Master   Slave




                                   Slave

Tuesday, March 29, 2011
Slave




                          Master   Slave




                                   Slave

Tuesday, March 29, 2011
Master




                          Master   Master




                                   Master


Tuesday, March 29, 2011
What group commit
                              problem?



Tuesday, March 29, 2011
Group Commit?
                                     Transaction
                                         Log

                          Database
                           Kernel


                                       Binlog


Tuesday, March 29, 2011
No Group Commit
                              Required

                          Database   Transaction
                           Kernel        Log




Tuesday, March 29, 2011
libDrizzle

                    • Supports Drizzle (and MySQL, and SQLite)
                    • Asynchronous
                    • BSD
                    • Lawyer free

Tuesday, March 29, 2011
NoSQL Stream Access
             Amazon S3      Client




                           Instance



                            Storage

Tuesday, March 29, 2011
Is there more?



Tuesday, March 29, 2011
No Gotchas

                    • No NULL when you don’t want NULL
                    • No ALTER TABLES that fake’ it
                    • Real datetime (64bit), with microseconds
                    • IPV6
                    • No updates that “half complete”

Tuesday, March 29, 2011
Authentication/
                          Authorization

                    • No Cost Authentication
                    • PAM, LDAP, HTTP


Tuesday, March 29, 2011
Table Functions

                   • TABLE_CACHE
                   • TABLE_DEFINITION_CACHE
                   • SHOW TEMPORARY TABLES
                   • All new SQL compliant information_schema

Tuesday, March 29, 2011
Data Dictionay

                    • Separate Information Schema for ANSI SQL
                          access.
                    • All based on Table Functions
                    • No Materialization
                    • Single Execution Path

Tuesday, March 29, 2011
Интернет является UTF-8.

                               Web UTF - 8

                            The Web is UTF-8.


Tuesday, March 29, 2011
How about locks?



Tuesday, March 29, 2011
SHOW PROCESSLIST
                          (now based on table functions)




Tuesday, March 29, 2011
--skip-grants
                          (none of the current GRANTs require LOCKS
                                            actually…)




Tuesday, March 29, 2011
store_lock()
                          (all engines are not created equally)




Tuesday, March 29, 2011
120+ Developers Since
                        Day One
                          26/36 on average each month




Tuesday, March 29, 2011
Drizzle 7+



Tuesday, March 29, 2011
Table                       Table

                 Schema   Table              Schema   Table

                          Table                       Table
                                   Users
                          Table                       Table

                 Schema   Table              Schema   Table

                          Table                       Table


                                  Instance
Tuesday, March 29, 2011
Users                         Users


                            Table                       Table

                   Schema   Table              Schema   Table

                            Table                       Table




                                    Instance
Tuesday, March 29, 2011
• Cuts the 30/40% hit from virtualizing
                    • Single instance maintenance
                    • Still allows for IO spread on San/NAS


Tuesday, March 29, 2011
Hot Backup

                    • Supports Partial Backup
                    • No locking
                    • Single solution, point-in-time recovery in a
                          single solution.
                    • Comes with the database.

Tuesday, March 29, 2011
http://drizzle.org
                          http://planetdrizzle.org
                          Freenode #drizzle


Tuesday, March 29, 2011

Contenu connexe

Similaire à Drizzle 7.0, Future of Virtualizing

P90 X Your Database!!
P90 X Your Database!!P90 X Your Database!!
P90 X Your Database!!
Denish Patel
 
GR8Conf 2011: Tuning Grails Applications by Peter Ledbrook
GR8Conf 2011: Tuning Grails Applications by Peter LedbrookGR8Conf 2011: Tuning Grails Applications by Peter Ledbrook
GR8Conf 2011: Tuning Grails Applications by Peter Ledbrook
GR8Conf
 
CMS Expo 2011 - Social Drupal
CMS Expo 2011 - Social DrupalCMS Expo 2011 - Social Drupal
CMS Expo 2011 - Social Drupal
Blake Hall
 
GR8Conf 2011: Grails 1.4 Update by Peter Ledbrook
GR8Conf 2011: Grails 1.4 Update by Peter LedbrookGR8Conf 2011: Grails 1.4 Update by Peter Ledbrook
GR8Conf 2011: Grails 1.4 Update by Peter Ledbrook
GR8Conf
 

Similaire à Drizzle 7.0, Future of Virtualizing (20)

JavaScript Secrets
JavaScript SecretsJavaScript Secrets
JavaScript Secrets
 
NoSQL
NoSQLNoSQL
NoSQL
 
P90 X Your Database!!
P90 X Your Database!!P90 X Your Database!!
P90 X Your Database!!
 
Глеб Калинин. Инструменты прототипирования
Глеб Калинин. Инструменты прототипированияГлеб Калинин. Инструменты прототипирования
Глеб Калинин. Инструменты прототипирования
 
The State of Front End Web Development 2011
The State of Front End Web Development 2011The State of Front End Web Development 2011
The State of Front End Web Development 2011
 
The Essential PostgreSQL.conf
The Essential PostgreSQL.confThe Essential PostgreSQL.conf
The Essential PostgreSQL.conf
 
GR8Conf 2011: Tuning Grails Applications by Peter Ledbrook
GR8Conf 2011: Tuning Grails Applications by Peter LedbrookGR8Conf 2011: Tuning Grails Applications by Peter Ledbrook
GR8Conf 2011: Tuning Grails Applications by Peter Ledbrook
 
Distribute the workload, PHPTek, Amsterdam, 2011
Distribute the workload, PHPTek, Amsterdam, 2011Distribute the workload, PHPTek, Amsterdam, 2011
Distribute the workload, PHPTek, Amsterdam, 2011
 
Stackbox CMS: Next-Generation Content Management
Stackbox CMS: Next-Generation Content ManagementStackbox CMS: Next-Generation Content Management
Stackbox CMS: Next-Generation Content Management
 
How I stopped worrying about and loved DumpRenderTree
How I stopped worrying about and loved DumpRenderTreeHow I stopped worrying about and loved DumpRenderTree
How I stopped worrying about and loved DumpRenderTree
 
Frontend Caching, PHPTek 2011, Chicago
Frontend Caching, PHPTek 2011, ChicagoFrontend Caching, PHPTek 2011, Chicago
Frontend Caching, PHPTek 2011, Chicago
 
clrh56
clrh56clrh56
clrh56
 
CMS Expo 2011 - Social Drupal
CMS Expo 2011 - Social DrupalCMS Expo 2011 - Social Drupal
CMS Expo 2011 - Social Drupal
 
GR8Conf 2011: Grails 1.4 Update by Peter Ledbrook
GR8Conf 2011: Grails 1.4 Update by Peter LedbrookGR8Conf 2011: Grails 1.4 Update by Peter Ledbrook
GR8Conf 2011: Grails 1.4 Update by Peter Ledbrook
 
Что нового в CSS3
Что нового в CSS3Что нового в CSS3
Что нового в CSS3
 
Blogs micro
Blogs microBlogs micro
Blogs micro
 
Membase Meetup - San Diego
Membase Meetup - San DiegoMembase Meetup - San Diego
Membase Meetup - San Diego
 
High performance app in ruby
High performance app in rubyHigh performance app in ruby
High performance app in ruby
 
Building an experimentation framework
Building an experimentation frameworkBuilding an experimentation framework
Building an experimentation framework
 
MSR Talk
MSR TalkMSR Talk
MSR Talk
 

Plus de Brian Aker (7)

Gearmam, from the_worker's_perspective copy
Gearmam, from the_worker's_perspective copyGearmam, from the_worker's_perspective copy
Gearmam, from the_worker's_perspective copy
 
Gearman, from the worker's perspective
Gearman, from the worker's perspectiveGearman, from the worker's perspective
Gearman, from the worker's perspective
 
Tricking out your Memcached Setup
Tricking out your Memcached SetupTricking out your Memcached Setup
Tricking out your Memcached Setup
 
Drizzle Keynote at the MySQL User's Conference
Drizzle Keynote at the MySQL User's ConferenceDrizzle Keynote at the MySQL User's Conference
Drizzle Keynote at the MySQL User's Conference
 
Drizzle @OpenSQL Camp
Drizzle @OpenSQL CampDrizzle @OpenSQL Camp
Drizzle @OpenSQL Camp
 
No SQL Talk
No SQL TalkNo SQL Talk
No SQL Talk
 
Drizzle Talk
Drizzle TalkDrizzle Talk
Drizzle Talk
 

Dernier

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Dernier (20)

[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 

Drizzle 7.0, Future of Virtualizing

  • 1. Virtualizing and Scaling for the Future Tuesday, March 29, 2011
  • 2. Who am I? Was Director of Architecture for MySQL Founder/CTO Data Differential Drizzle Gearman Memcached Tuesday, March 29, 2011
  • 4. • 2008 Sun buys MySQL • 2008 Drizzle forks from MySQL • 2009 Oracle buys Sun • 2010 Drizzle Developers split from Oracle • 2011 First GA Release, Drizzle7 Tuesday, March 29, 2011
  • 5. Drizzle • Entirely Open Source RDBMS • C++, with a MicroKernel Design • No Gotchas Tuesday, March 29, 2011
  • 6. Drizzle7 (Quick Update) Tuesday, March 29, 2011
  • 7. Today’s Pluggable Interfaces • Replication • Table Functions • Storage Engine • Functions • Logging • Protocol • Authentication • Query Rewrite • Authorization • XA Tuesday, March 29, 2011
  • 8. HTTP Replication Client Client Cloud Service Client HTTP Blob MySQL Drizzle Streaming SQL Listener Logging Query Memcached Parser Cache Optimizer Memcached Error Reporting Executioner Gearman Storage System MicroKernel Tuesday, March 29, 2011
  • 9. Replication • Google Protocol Buffer Based • Replicates row transformations. • Integrates today with RabbitMQ, Casandra. Memcached, Gearman Tuesday, March 29, 2011
  • 10. INSERT INSERT Stored Transactionally UPDATE INSERT Tuesday, March 29, 2011
  • 11. Slave Master Slave Slave Tuesday, March 29, 2011
  • 12. Slave Master Slave Slave Tuesday, March 29, 2011
  • 13. Master Master Master Master Tuesday, March 29, 2011
  • 14. What group commit problem? Tuesday, March 29, 2011
  • 15. Group Commit? Transaction Log Database Kernel Binlog Tuesday, March 29, 2011
  • 16. No Group Commit Required Database Transaction Kernel Log Tuesday, March 29, 2011
  • 17. libDrizzle • Supports Drizzle (and MySQL, and SQLite) • Asynchronous • BSD • Lawyer free Tuesday, March 29, 2011
  • 18. NoSQL Stream Access Amazon S3 Client Instance Storage Tuesday, March 29, 2011
  • 19. Is there more? Tuesday, March 29, 2011
  • 20. No Gotchas • No NULL when you don’t want NULL • No ALTER TABLES that fake’ it • Real datetime (64bit), with microseconds • IPV6 • No updates that “half complete” Tuesday, March 29, 2011
  • 21. Authentication/ Authorization • No Cost Authentication • PAM, LDAP, HTTP Tuesday, March 29, 2011
  • 22. Table Functions • TABLE_CACHE • TABLE_DEFINITION_CACHE • SHOW TEMPORARY TABLES • All new SQL compliant information_schema Tuesday, March 29, 2011
  • 23. Data Dictionay • Separate Information Schema for ANSI SQL access. • All based on Table Functions • No Materialization • Single Execution Path Tuesday, March 29, 2011
  • 24. Интернет является UTF-8. Web UTF - 8 The Web is UTF-8. Tuesday, March 29, 2011
  • 25. How about locks? Tuesday, March 29, 2011
  • 26. SHOW PROCESSLIST (now based on table functions) Tuesday, March 29, 2011
  • 27. --skip-grants (none of the current GRANTs require LOCKS actually…) Tuesday, March 29, 2011
  • 28. store_lock() (all engines are not created equally) Tuesday, March 29, 2011
  • 29. 120+ Developers Since Day One 26/36 on average each month Tuesday, March 29, 2011
  • 31. Table Table Schema Table Schema Table Table Table Users Table Table Schema Table Schema Table Table Table Instance Tuesday, March 29, 2011
  • 32. Users Users Table Table Schema Table Schema Table Table Table Instance Tuesday, March 29, 2011
  • 33. • Cuts the 30/40% hit from virtualizing • Single instance maintenance • Still allows for IO spread on San/NAS Tuesday, March 29, 2011
  • 34. Hot Backup • Supports Partial Backup • No locking • Single solution, point-in-time recovery in a single solution. • Comes with the database. Tuesday, March 29, 2011
  • 35. http://drizzle.org http://planetdrizzle.org Freenode #drizzle Tuesday, March 29, 2011