Scaling MySQL using Fabric

•Télécharger en tant que PPT, PDF•

1 j'aime•3,686 vues

This is my presentation on MySQL Fabric in LSPE meet up ( Large Scale Production Engineering ) held at Yahoo! India on 13-09-2014.

Technologie

Scaling Persistent Store Using
MySQL FABRIC
P.R.KARTHIK
MySQL DBA

About US
Karthik.P.R
• 4 + years of Industry experience as MySQL DBA.
• 1+ year at Yahoo! Administrating MySQL servers.
• Area of Focus MySQL HA and MySQL Sharding
• Student : M.Sc ( FOSS)
• Blogger : remotemysqldba.blogspot.in

PROGRAM AGENDA
• Scaling MySQL
• Available Sharding Tools
• MySQL Fabric

Scaling MySQL
• Scaling MySQL
• Available Sharding Tools
• MySQL Fabric
• Handling Shards

Scaling MySQL
• Starts with a single node

Scaling MySQL
• As reads and writes grows
Scale Vertically.
• Increase system resources
• Memory
• CPU
• Hard Disk

Scaling MySQL
Scaling reads using replication.
• Replication is the best solution.
• Replication is Async.
• Failover has to be set.
• Single writer
Write Queries Read Queries

Scaling MySQL
Scaling reads using Galera
• Read/ Write on any node
• Synchronous Replication
• A good HA solution.
• Easy to add nodes.
Write / Read
Queries

Scaling MySQL
Scaling Writes
• Replication can’t scale writes
• Partitioning is needed.
• Distributes the writes
• Horizontal scaling or Sharding.
ID 1 - 1000 ID 1001 - 2000

Scaling MySQL
Components .
•Shard Key
– Range
– Hash
– List
•Meta data store
•Managing data set
•High Availability of shards.
•Database and schema changes.

Scaling MySQL
Sharding Architecture
Proxy layer
State Store
Shard A
Shard B
Shard C
Application

Scaling MySQL
Advantages of Sharding
•Improved Performance
•Smaller Data set on local node.
•Handling large data set
•Scale well horizontally.
•Only small data set is affected on a node failure.
Disadvantages of Sharding
•Managing the shards
•Code change is need at some cases.
•Splitting Shards
•Maintaining the HA

Available Sharding Tools
• Sharding is used widely in Large Scale MySQL Deployments.
• Large organization built their own tools for sharding.
Popular MySQL Shards,
 Facebook
• Twitter
• Tumblr
• Flickr
• Youtube
• Dropbox

Available Sharding Tools
Sharding Tools.
1) Saclebase ( Closed Source)
2) Jetpants (Tumblr )
3) Vitess ( Youtube )
4) MySQL Fabric ( Oracle MySQL )

MySQL FABRIC
• MySQL Fabric is the frame work to maintain shards and High Availability.
• Downloaded from MySQL Utilities.
• Good CLI commands.
• Works on MySQL > 5.6.10
• XML RPC for Python , php and Java.
• Minimized downtime of shard.

MySQL FABRIC ARCHITECTURE
Application XML-RPC
Connector
XML-RPC
FABRIC
NODE
Global Group
Group 1 Group 2 Group 3 Group 4
Back Store

MySQL FABRIC
FABRIC Components.
• Fabric node.
• Fabric aware connectors ( XML RPC )
• Server Groups.
– Global Group
– Shard Group
• Back Store

MySQL FABRIC
Fabric node
• Stores Fabric Config
• Shard Moving
• Shard splitting
• High Availability monitoring
Back Store
• Global tables info
• Shard key info and mapping
• Shard monitoring
Fabric Node Back store

MySQL FABRIC
Fabric aware connectors
• Supports Python/ php / Java Connectors
• Fetch Shard info
• Local cache
• Avoids the proxy hop.
Application XML-RPC
Connector

MySQL FABRIC
Server Groups
• Stores actual data
– Global Group
– Shard Group
• Primary – Read / Write
• Secondary – Reads ( failover)
• Spare ( On request )
Server Group
Primary Node Secondary Node
Spare Node

MySQL FABRIC
Server Groups ( Global Group )
• Stores Global Tables and schema
• Schema changes
• Replicates to Shard groups
Global Group Shard Group
Global Writes
Fabric Node

MySQL FABRIC ARCHITECTURE ( Again )
Application XML-RPC
Connector
XML-RPC
FABRIC
NODE
Global Group
Group 1 Group 2 Group 3 Group 4
Back Store

MySQL FABRIC
Advantages:
• Ease of Failover with GTID.
• Shard Split is easy
• RPC avoid network hops.
Dis Advantages
• Fabric node will be single point of failure
• No Cross Shard . ( Shard query can help here)
• Limited Connectors.

Contenu connexe

Tendances

Backup and Recovery in MySQL Cluster

priyanka_sangam

Scalablity and benchmark in mysql performance

Amrendra Kumar

MySQL: From Single Instance to Big Data

Morgan Tocker

Best practices for MySQL/MariaDB Server/Percona Server High Availability - presented at Percona Live Amsterdam 2016. The focus is on picking the right High Availability solution, discussing replication, handling failure (yes, you can achieve a quick automatic failover), proxies (there are plenty), HA in the cloud/geographical redundancy, sharding solutions, how newer versions of MySQL help you, and what to watch for next.

Best practices for MySQL/MariaDB Server/Percona Server High Availability

Colin Charles

You’ve got your Hadoop cluster, you’ve got your petabytes of unstructured data, you run mapreduce jobs and SQL-on-Hadoop queries. Something is still missing though. After all, we are not expected to enter SQL queries while looking for information on the web. Altavista and Google solved it for us ages ago. Why are we still requiring SQL or Java certification from our enterprise bigdata users? In this talk, we will look into how integration of SolrCloud into Apache Bigtop is now enabling building bigdata indexing solutions and ingest pipelines. We will dive into the details of integrating full-text search into the lifecycle of your bigdata management applications and exposing the power of Google-in-a-box to all enterprise users, not just a chosen few data scientists.

Building Google-in-a-box: using Apache SolrCloud and Bigtop to index your big...

rhatr

Ansible for large scale deployment

Karthik .P.R

Percona tool kit for MySQL DBA's

Karthik .P.R

Capacity planning for your data stores

Colin Charles

Today you can use hosted MySQL/MariaDB/Percona Server in several "cloud providers" in what is considered using it as a service, a database as a service (DBaaS). You can also use hosted PostgreSQL and MongoDB thru various service providers. Learn the differences, the access methods, and the level of control you have for the various public cloud offerings: - Amazon RDS for MySQL and PostgreSQL - Google Cloud SQL - Rackspace OpenStack DBaaS - The likes of compose.io, MongoLab and Rackspace's offerings around MongoDB The administration tools and ideologies behind it are completely different, and you are in a "locked-down" environment. Some considerations include: * Different backup strategies * Planning for multiple data centres for availability * Where do you host your application? * How do you get the most performance out of the solution? * What does this all cost? Growth topics include: * How do you move from one DBaaS to another? * How do you move all this from DBaaS to your own hosted platform? Questions like this will be demystified in the talk. This talk will benefit experienced database administrators (DBAs) who now also have to deal with cloud deployments as well as application developers in startups that have to rely on "managed services" without the ability of a DBA.

Databases in the hosted cloud

Colin Charles

MySQL 5.6 - Operations and Diagnostics Improvements

Morgan Tocker

MySQL in the Hosted Cloud - Percona Live 2015

Colin Charles

Abstract:- Tracking user events as they happen can challenge anyone providing real time user interaction. It can demand both huge scale and a lot of processing to support dynamic adjustment to targeting products and services. As the operational data store Couchbase data services are capable of processing tens of millions of updates a day. Streaming through systems such as Apache Spark and Kafka into Hadoop, information about these key events can be turned into deeper knowledge. We will review Lambda architectures deployed at sites like PayPal, Live Person and LinkedIn that leverage a Couchbase Data Pipeline. Bio:- Justin Michaels. With over 20 years experience in deploying mission critical systems, Justin Michaels industry experience covers capacity planning, architecture and industry vertical experience. Justin brings his passion for architecting, implementing and improving Couchbase to the community as a Solution Architect. His expertise involves both conventional application platforms as well as distributed data management systems. He regularly engages with existing and new Couchbase customers in performance reviews, architecture planning and best practice guidance.

Stream your Operational Data with Apache Spark & Kafka into Hadoop using Couc...

Data Con LA

MHA: Getting started & moving past quirks percona live santa clara 2013

Colin Charles

Scaling MySQL in Amazon Web Services

Laine Campbell

MySQL Live Migration - Common Scenarios

Mydbops

Apache Kafka at LinkedIn

Guozhang Wang

MariaDB 10.1 what's new and what's coming in 10.2 - Tokyo MariaDB Meetup

Colin Charles

Cassandra Introduction & Features

Phil Peace

Tendances (18)

Backup and Recovery in MySQL Cluster

Scalablity and benchmark in mysql performance

MySQL: From Single Instance to Big Data

Best practices for MySQL/MariaDB Server/Percona Server High Availability

Building Google-in-a-box: using Apache SolrCloud and Bigtop to index your big...

Ansible for large scale deployment

Percona tool kit for MySQL DBA's

Capacity planning for your data stores

Databases in the hosted cloud

MySQL 5.6 - Operations and Diagnostics Improvements

MySQL in the Hosted Cloud - Percona Live 2015

Stream your Operational Data with Apache Spark & Kafka into Hadoop using Couc...

MHA: Getting started & moving past quirks percona live santa clara 2013

Scaling MySQL in Amazon Web Services

MySQL Live Migration - Common Scenarios

Apache Kafka at LinkedIn

MariaDB 10.1 what's new and what's coming in 10.2 - Tokyo MariaDB Meetup

Cassandra Introduction & Features

Similaire à Scaling MySQL using Fabric

MySQL HA Sharding-Fabric

Abdul Manaf

Using MySQL Fabric for High Availability and Scaling Out

OSSCube

MariaDB 10: The Complete Tutorial

Colin Charles

Oracle’s InnoDB Cluster vs. Continuent Tungsten Clusters for MySQL Building a Geo-Distributed, Multi-Region and Highly Available MySQL Cloud Back-End This is the fifth of our High Noon series covering MySQL clustering solutions for high availability (HA), disaster recovery (DR), and geographic distribution. InnoDB Cluster uses MySQL’s group replication to handle the replication. It’s also known as semi-synchronous replication. Learn about this and more in this webinar! You may use Tungsten Clustering with native MySQL, MariaDB or Percona Server for MySQL in GCP, AWS, Azure, and/or on-premises data centers for better technological capabilities, control, and flexibility. But learn about the pros and cons! AGENDA - Goals for the High Noon Webinar Series - High Noon Series: Tungsten Clustering vs Others - Oracle InnoDB Cluster - Key Characteristics - Certification-based Replication - InnoDB Cluster Multi-Site Requirements - Limitations Using InnoDB Cluster - How to do better MySQL HA / DR / Geo-Distribution? - InnoDB Cluster vs Tungsten Clustering - About Continuent & Its Solutions PRESENTER Matthew Lang - Customer Success Director – Americas, Continuent - has over 25 years of experience in database administration, database programming, and system architecture, including the creation of a database replication product that is still in use today. He has designed highly available, scaleable systems that have allowed startups to quickly become enterprise organizations, utilizing a variety of technologies including open source projects, virtualization and cloud.

Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #5: Oracle’s InnoDB Cluster

Continuent

The Complete MariaDB Server tutorial

Colin Charles

Massively sharded my sql at tumblr presentation

kriptonium

Evan Ellis "Tumblr. Massively Sharded MySQL"

Alexey Mahotkin

Scaling with sync_replication using Galera and EC2

Marco Tusa

The Complete MariaDB Server Tutorial - Percona Live 2015

Colin Charles

Getting started with Riak in the Cloud

Ines Sombra

MySQL Options in OpenStack

Tesora

Optimizing MySQL for Cascade Server

hannonhill

MySQL NDB Cluster 8.0

Ted Wennmark

MariaDB: in-depth (hands on training in Seoul)

Colin Charles

In most production OpenStack installations, you want the backing metadata store to be highly available. For this, the de facto standard has become MySQL+Galera. In order to help you meet this basic use case even better, I will introduce you to the brand new native MySQL HA solution called MySQL Group Replication. This allows you to easily go from a single instance of MySQL to a MySQL service that's natively distributed and highly available, while eliminating the need for any third party library and implementations. If you have an extremely large OpenStack installation in production, then you are likely to eventually run into write scaling issues and the metadata store itself can become a bottleneck. For this use case, MySQL NDB Cluster can allow you to linearly scale the metadata store as your needs grow. I will introduce you to the core features of MySQL NDB Cluster--which include in-memory OLTP, transparent sharding, and support for active/active multi-datacenter clusters--that will allow you to meet even the most demanding of use cases with ease.

OpenStack Days East -- MySQL Options in OpenStack

Matt Lord

MySQL: Scale Through Consolidation Webinar

NetApp

Maria db 10 and the mariadb foundation(colin)

kayokogoto

How does Apache Pegasus (incubating) community develop at SensorsData

acelyc1112009

MS Azure Database for MySQL vs. Continuent Tungsten Clusters Building a Geo-Scale, Multi-Region and Highly Available MySQL Cloud Back-End This is the third of our High Noon series covering MySQL clustering solutions for high availability (HA), disaster recovery (DR), and geographic distribution. Azure Database for MySQL is a managed database cluster within Microsoft Azure Cloud that runs MySQL community edition. There are really two deployment options: “Single Server” and “Flexible Server (Preview).” We will look at the Flexible Server version, even though it is still preview, because most enterprise applications require failover, so this is the relevant comparison for Tungsten Clustering. You may use Tungsten Clustering with native MySQL, MariaDB or Percona Server for MySQL in GCP, AWS, Azure, and/or on-premises data centers for better technological capabilities, control, and flexibility. But learn about the pros and cons! Enjoy the webinar! AGENDA - Goals for the High Noon Webinar Series - High Noon Series: Tungsten Clustering vs Others - Microsoft Azure Database for MySQL - Key Characteristics - Certification-based Replication - Azure MySQL Multi-Site Requirements - Limitations Using Azure MySQL - How to do better MySQL HA / DR / Geo-Scale? - Azure MySQL vs Tungsten Clustering - About Continuent & Its Solutions PRESENTER Matthew Lang - Customer Success Director – Americas, Continuent - has over 25 years of experience in database administration, database programming, and system architecture, including the creation of a database replication product that is still in use today. He has designed highly available, scaleable systems that have allowed startups to quickly become enterprise organizations, utilizing a variety of technologies including open source projects, virtualization and cloud.

Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #4: MS Azure Database MySQL

Continuent

The MySQL Server ecosystem in 2016

sys army

Similaire à Scaling MySQL using Fabric (20)

MySQL HA Sharding-Fabric

Using MySQL Fabric for High Availability and Scaling Out

MariaDB 10: The Complete Tutorial

Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #5: Oracle’s InnoDB Cluster

The Complete MariaDB Server tutorial

Massively sharded my sql at tumblr presentation

Evan Ellis "Tumblr. Massively Sharded MySQL"

Scaling with sync_replication using Galera and EC2

The Complete MariaDB Server Tutorial - Percona Live 2015

Getting started with Riak in the Cloud

MySQL Options in OpenStack

Optimizing MySQL for Cascade Server

MySQL NDB Cluster 8.0

MariaDB: in-depth (hands on training in Seoul)

OpenStack Days East -- MySQL Options in OpenStack

MySQL: Scale Through Consolidation Webinar

Maria db 10 and the mariadb foundation(colin)

How does Apache Pegasus (incubating) community develop at SensorsData

Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #4: MS Azure Database MySQL

The MySQL Server ecosystem in 2016

Dernier

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

A Domino Admins Adventures (Engage 2024)

Gabriella Davis

BooK Now Call us at +918448380779 to hire a gorgeous and seductive call girl for sex. Take a Delhi Escort Service. The help of our escort agency is mostly meant for men who want sexual Indian Escorts In Delhi NCR. It should be noted that any impersonator will get 100 attention from our Young Girls Escorts in Delhi. They will assume the position of reliable allies. VIP Call Girl With Original Photos Book Tonight +918448380779 Our Cheap Price 1 Hour not available 2 Hours 5000 Full Night 8000 TAG: Call Girls in Delhi, Noida, Gurgaon, Ghaziabad, Connaught Place, Greater Kailash Delhi, Lajpat Nagar Delhi, Mayur Vihar Delhi, Chanakyapuri Delhi, New Friends Colony Delhi, Majnu Ka Tilla, Karol Bagh, Malviya Nagar, Saket, Khan Market, Noida Sector 18, Noida Sector 76, Noida Sector 51, Gurgaon Mg Road, Iffco Chowk Gurgaon, Rajiv Chowk Gurgaon All Delhi Ncr Free Home Deliver

08448380779 Call Girls In Friends Colony Women Seeking Men

Delhi Call girls

The presentation explores the development and application of artificial intelligence (AI) from its inception to its current status in the modern world. The term "artificial intelligence" was first coined by John McCarthy in 1956 to describe efforts to develop computer programs capable of performing tasks that typically require human intelligence. This concept was first introduced at a conference held at Dartmouth College, where programs demonstrated capabilities such as playing chess, proving theorems, and interpreting texts. In the early stages, Alan Turing contributed to the field by defining intelligence as the ability of a being to respond to certain questions intelligently, proposing what is now known as the Turing Test to evaluate the presence of intelligent behavior in machines. As the decades progressed, AI evolved significantly. The 1980s focused on machine learning, teaching computers to learn from data, leading to the development of models that could improve their performance based on their experiences. The 1990s and 2000s saw further advances in algorithms and computational power, which allowed for more sophisticated data analysis techniques, including data mining. By the 2010s, the proliferation of big data and the refinement of deep learning techniques enabled AI to become mainstream. Notable milestones included the success of Google's AlphaGo and advancements in autonomous vehicles by companies like Tesla and Waymo. A major theme of the presentation is the application of generative AI, which has been used for tasks such as natural language text generation, translation, and question answering. Generative AI uses large datasets to train models that can then produce new, coherent pieces of text or other media. The presentation also discusses the ethical implications and the need for regulation in AI, highlighting issues such as privacy, bias, and the potential for misuse. These concerns have prompted calls for comprehensive regulations to ensure the safe and equitable use of AI technologies. Artificial intelligence has also played a significant role in healthcare, particularly highlighted during the COVID-19 pandemic, where it was used in drug discovery, vaccine development, and analyzing the spread of the virus. The capabilities of AI in healthcare are vast, ranging from medical diagnostics to personalized medicine, demonstrating the technology's potential to revolutionize fields beyond just technical or consumer applications. In conclusion, AI continues to be a rapidly evolving field with significant implications for various aspects of society. The development from theoretical concepts to real-world applications illustrates both the potential benefits and the challenges that come with integrating advanced technologies into everyday life. The ongoing discussion about AI ethics and regulation underscores the importance of managing these technologies responsibly to maximize their their benefits while minimizing potential harms.

Artificial Intelligence: Facts and Myths

Joaquim Jorge

Imagine a world where information flows as swiftly as thought itself, making decision-making as fluid as the data driving it. Every moment is critical, and the right tools can significantly boost your organization’s performance. The power of real-time data automation through FME can turn this vision into reality. Aimed at professionals eager to leverage real-time data for enhanced decision-making and efficiency, this webinar will cover the essentials of real-time data and its significance. We’ll explore: FME’s role in real-time event processing, from data intake and analysis to transformation and reporting An overview of leveraging streams vs. automations FME’s impact across various industries highlighted by real-life case studies Live demonstrations on setting up FME workflows for real-time data Practical advice on getting started, best practices, and tips for effective implementation Join us to enhance your skills in real-time data automation with FME, and take your operational capabilities to the next level.

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Safe Software

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Neo4j

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

debabhi2

What are drone anti-jamming systems? The drone anti-jamming systems and anti-spoof technology protect against interference, jamming, and spoofing of the UAVs. To protect their security, countries are beginning to research drone anti-jamming systems, also known as drone strike weapons. The anti-jam and anti-spoof technology protects against interference, jamming and spoofing. A drone strike weapon is a drone attack weapon that can attack and destroy enemy drones. So what is so unique about this amazing system?

What Are The Drone Anti-jamming Systems Technology?

Antenna Manufacturer Coco

Evaluating the top large language models.pdf

ChristopherTHyatt

Discord is a free app offering voice, video, and text chat functionalities, primarily catering to the gaming community. It serves as a hub for users to create and join servers tailored to their interests. Discord’s ecosystem comprises servers, each functioning as a distinct online community with its own channels dedicated to specific topics or activities. Users can engage in text-based discussions, voice calls, or video chats within these channels. Understanding Discord Servers Discord servers are virtual spaces where users congregate to interact, share content, and build communities. Servers may revolve around gaming, hobbies, interests, or fandoms, providing a platform for like-minded individuals to connect. Communication Features Discord offers a range of communication tools, including text channels for messaging, voice channels for real-time audio conversations, and video channels for face-to-face interactions. These features facilitate seamless communication and collaboration. What Does NSFW Mean? The acronym NSFW stands for “Not Safe For Work,” indicating content that may be inappropriate for professional or public settings. NSFW Content NSFW content encompasses material that is sexually explicit, violent, or otherwise graphic in nature. It often includes nudity, profanity, or depictions of sensitive topics.

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

UK Journal

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Scaling API-first – The story of a global engineering organization

Radu Cotescu

Enterprise Knowledge’s Urmi Majumder, Principal Data Architecture Consultant, and Fernando Aguilar Islas, Senior Data Science Consultant, presented "Driving Behavioral Change for Information Management through Data-Driven Green Strategy" on March 27, 2024 at Enterprise Data World (EDW) in Orlando, Florida. In this presentation, Urmi and Fernando discussed a case study describing how the information management division in a large supply chain organization drove user behavior change through awareness of the carbon footprint of their duplicated and near-duplicated content, identified via advanced data analytics. Check out their presentation to gain valuable perspectives on utilizing data-driven strategies to influence positive behavioral shifts and support sustainability initiatives within your organization. In this session, participants gained answers to the following questions: - What is a Green Information Management (IM) Strategy, and why should you have one? - How can Artificial Intelligence (AI) and Machine Learning (ML) support your Green IM Strategy through content deduplication? - How can an organization use insights into their data to influence employee behavior for IM? - How can you reap additional benefits from content reduction that go beyond Green IM?

Driving Behavioral Change for Information Management through Data-Driven Gree...

Enterprise Knowledge

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Martijn de Jong

[2024]Digital Global Overview Report 2024 Meltwater.pdf

hans926745

With more memory available, system performance of three Dell devices increased, which can translate to a better user experience Conclusion When your system has plenty of RAM to meet your needs, you can efficiently access the applications and data you need to finish projects and to-do lists without sacrificing time and focus. Our test results show that with more memory available, three Dell PCs delivered better performance and took less time to complete the Procyon Office Productivity benchmark. These advantages translate to users being able to complete workflows more quickly and multitask more easily. Whether you need the mobility of the Latitude 5440, the creative capabilities of the Precision 3470, or the high performance of the OptiPlex Tower Plus 7010, configuring your system with more RAM can help keep processes running smoothly, enabling you to do more without compromising performance.

Boost PC performance: How more available memory can improve productivity

Principled Technologies

The Raspberry Pi 5 was announced on October 2023. This new version of the popular embedded device comes with a new iteration of Broadcom’s VideoCore GPU platform, and was released with a fully open source driver stack, developed by Igalia. The presentation will discuss some of the major changes required to support this new Video Core iteration, the challenges we faced in the process and the solutions we provided in order to deliver conformant OpenGL ES and Vulkan drivers. The talk will also cover the next steps for the open source Raspberry Pi 5 graphics stack. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://eoss24.sched.com/event/1aBEx

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Igalia

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Heather Hedden, Senior Consultant at Enterprise Knowledge, presented “The Role of Taxonomy and Ontology in Semantic Layers” at a webinar hosted by Progress Semaphore on April 16, 2024. Taxonomies at their core enable effective tagging and retrieval of content, and combined with ontologies they extend to the management and understanding of related data. There are even greater benefits of taxonomies and ontologies to enhance your enterprise information architecture when applying them to a semantic layer. A survey by DBP-Institute found that enterprises using a semantic layer see their business outcomes improve by four times, while reducing their data and analytics costs. Extending taxonomies to a semantic layer can be a game-changing solution, allowing you to connect information silos, alleviate knowledge gaps, and derive new insights. Hedden, who specializes in taxonomy design and implementation, presented how the value of taxonomies shouldn’t reside in silos but be integrated with ontologies into a semantic layer. Learn about: - The essence and purpose of taxonomies and ontologies in information and knowledge management; - Advantages of semantic layers leveraging organizational taxonomies; and - Components and approaches to creating a semantic layer, including the integration of taxonomies and ontologies

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

Enterprise Knowledge

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Rafal Los

Dernier (20)

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

A Domino Admins Adventures (Engage 2024)

08448380779 Call Girls In Friends Colony Women Seeking Men

Artificial Intelligence: Facts and Myths

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Exploring the Future Potential of AI-Enabled Smartphone Processors

What Are The Drone Anti-jamming Systems Technology?

Evaluating the top large language models.pdf

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

How to Troubleshoot Apps for the Modern Connected Worker

Scaling API-first – The story of a global engineering organization

Driving Behavioral Change for Information Management through Data-Driven Gree...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

[2024]Digital Global Overview Report 2024 Meltwater.pdf

Boost PC performance: How more available memory can improve productivity

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Scaling MySQL using Fabric

1. Scaling Persistent Store Using MySQL FABRIC P.R.KARTHIK MySQL DBA

2. About US Karthik.P.R • 4 + years of Industry experience as MySQL DBA. • 1+ year at Yahoo! Administrating MySQL servers. • Area of Focus MySQL HA and MySQL Sharding • Student : M.Sc ( FOSS) • Blogger : remotemysqldba.blogspot.in

3. PROGRAM AGENDA • Scaling MySQL • Available Sharding Tools • MySQL Fabric

4. Scaling MySQL • Scaling MySQL • Available Sharding Tools • MySQL Fabric • Handling Shards

5. Scaling MySQL • Starts with a single node

6. Scaling MySQL • As reads and writes grows Scale Vertically. • Increase system resources • Memory • CPU • Hard Disk

7. Scaling MySQL Scaling reads using replication. • Replication is the best solution. • Replication is Async. • Failover has to be set. • Single writer Write Queries Read Queries

8. Scaling MySQL Scaling reads using Galera • Read/ Write on any node • Synchronous Replication • A good HA solution. • Easy to add nodes. Write / Read Queries

9. Scaling MySQL Scaling Writes • Replication can’t scale writes • Partitioning is needed. • Distributes the writes • Horizontal scaling or Sharding. ID 1 - 1000 ID 1001 - 2000

10. Scaling MySQL Components . •Shard Key – Range – Hash – List •Meta data store •Managing data set •High Availability of shards. •Database and schema changes.

11. Scaling MySQL Sharding Architecture Proxy layer State Store Shard A Shard B Shard C Application

12. Scaling MySQL Advantages of Sharding •Improved Performance •Smaller Data set on local node. •Handling large data set •Scale well horizontally. •Only small data set is affected on a node failure. Disadvantages of Sharding •Managing the shards •Code change is need at some cases. •Splitting Shards •Maintaining the HA

13. Available Sharding Tools • Sharding is used widely in Large Scale MySQL Deployments. • Large organization built their own tools for sharding. Popular MySQL Shards,  Facebook • Twitter • Tumblr • Flickr • Youtube • Dropbox

14. Available Sharding Tools Sharding Tools. 1) Saclebase ( Closed Source) 2) Jetpants (Tumblr ) 3) Vitess ( Youtube ) 4) MySQL Fabric ( Oracle MySQL )

15. MySQL FABRIC

16. MySQL FABRIC • MySQL Fabric is the frame work to maintain shards and High Availability. • Downloaded from MySQL Utilities. • Good CLI commands. • Works on MySQL > 5.6.10 • XML RPC for Python , php and Java. • Minimized downtime of shard.

17. MySQL FABRIC ARCHITECTURE Application XML-RPC Connector XML-RPC FABRIC NODE Global Group Group 1 Group 2 Group 3 Group 4 Back Store

18. MySQL FABRIC FABRIC Components. • Fabric node. • Fabric aware connectors ( XML RPC ) • Server Groups. – Global Group – Shard Group • Back Store

19. MySQL FABRIC Fabric node • Stores Fabric Config • Shard Moving • Shard splitting • High Availability monitoring Back Store • Global tables info • Shard key info and mapping • Shard monitoring Fabric Node Back store

20. MySQL FABRIC Fabric aware connectors • Supports Python/ php / Java Connectors • Fetch Shard info • Local cache • Avoids the proxy hop. Application XML-RPC Connector

21. MySQL FABRIC Server Groups • Stores actual data – Global Group – Shard Group • Primary – Read / Write • Secondary – Reads ( failover) • Spare ( On request ) Server Group Primary Node Secondary Node Spare Node

22. MySQL FABRIC Server Groups ( Global Group ) • Stores Global Tables and schema • Schema changes • Replicates to Shard groups Global Group Shard Group Global Writes Fabric Node

23. MySQL FABRIC ARCHITECTURE ( Again ) Application XML-RPC Connector XML-RPC FABRIC NODE Global Group Group 1 Group 2 Group 3 Group 4 Back Store

24. MySQL FABRIC Advantages: • Ease of Failover with GTID. • Shard Split is easy • RPC avoid network hops. Dis Advantages • Fabric node will be single point of failure • No Cross Shard . ( Shard query can help here) • Limited Connectors.

25. THANK YOU

Scaling MySQL using Fabric

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (18)

Similaire à Scaling MySQL using Fabric

Similaire à Scaling MySQL using Fabric (20)

Dernier

Dernier (20)

Scaling MySQL using Fabric