Flexible heterogenous replication

•

0 j'aime•509 vues

Jeff Mace

Technologie

Flexible Heterogenous
Replication
Je! Mace

©Continuent 2012.

Thursday, June 28, 12

Overview

• Introducing Tungsten Replicator

• Installation

• Demo

• Next Steps

©Continuent 2012 2

Thursday, June 28, 12

Introducing Tungsten Replicator

• Alternative to MySQL replication

• Still requires binary logs

• Crash-safe with ACID storage engines

• Compatible across branches and versions

• Provides heterogenous replication

• 100% GPL v2

©Continuent 2012 3

Thursday, June 28, 12

Break speed limits

©Continuent 2012 4

Thursday, June 28, 12

Replicate from many masters

©Continuent 2012 5

Thursday, June 28, 12

Replication Pipeline

Pipeline
Stage Stage Stage
Extract Filter Apply Extract Filter Apply Extract Filter Apply

Master Transaction In-Memory Slave
DBMS History Log Queue DBMS

©Continuent 2012 6

Thursday, June 28, 12

Heterogenous Replication

• Row replication

• DDL must be compatible

• Create schema ahead of time on the slave

• Primary Keys on every table

©Continuent 2012 7

Thursday, June 28, 12

Installing Tungsten

• tungsten-installer

• Written in Ruby

• Simple installation using SSH between
database servers

• Validates prior to installation

©Continuent 2012 8

Thursday, June 28, 12

Installing a MySQL Master
tools/tungsten-installer --master-slave -a
--cluster-hosts=my1
--home-directory=/opt/continuent
--datasource-type=mysql
--master-host=my1
--datasource-user=tungsten
--datasource-password=secret
--service-name=mongodb
--mysql-use-bytes-for-string=false
--svc-extractor-filters=colnames,pkey
--datasource-log-directory=/var/lib/mysql
--datasource-log-pattern=mysql-bin
--datasource-mysql-conf=/etc/mysql/my.cnf
--start-and-report

©Continuent 2012 9

Thursday, June 28, 12

Installing a MongoDB Slave
tools/tungsten-installer --master-slave -a
--cluster-hosts=mon2
--home-directory=/opt/continuent
--datasource-type=mongodb
--master-host=my1
--datasource-user=tungsten
--datasource-password=secret
--service-name=mongodb
--property=replicator.pipeline.slave.services=""
--skip-validation-check=InstallerMasterSlaveCheck
--start-and-report

©Continuent 2012 10

Thursday, June 28, 12

Installing a PostgreSQL Slave
tools/tungsten-installer --master-slave -a
--cluster-hosts=pg3
--home-directory=/var/lib/postgresql/continuent
--datasource-type=postgresql
--master-host=my1
--datasource-user=postgres
--datasource-password=secret
--service-name=mongodb
--skip-validation-check=InstallerMasterSlaveCheck
--user=postgres
--postgresql-dbname=postgres
--start-and-report

©Continuent 2012 11

Thursday, June 28, 12

Demo

©Continuent 2012 12

Thursday, June 28, 12

Supported slave databases

• MySQL

• PostgreSQL

• Oracle

• MongoDB

• Vertica

©Continuent 2012 13

Thursday, June 28, 12

Supported master databases

• MySQL

• PostgreSQL (Experimental)

• Oracle (Commercial)

©Continuent 2012 14

Thursday, June 28, 12

Next Steps

• Test in your environment

• Sponsor support for new database types

• Looking for sponsorship to build out a
provisioning framework

• Contact us with questions

©Continuent 2012 15

Thursday, June 28, 12

We’re Hiring

• Cluster Implementation Engineer

• QA Engineer

• Technical Writer

©Continuent 2012 16

Thursday, June 28, 12

Jeff Mace
jeff.mace@continuent.com
sales@continuent.com
560 S. Winchester Blvd. Suite 500
San Jose, CA 95128
Tel (866) 998-3642
Fax (408) 668-1009

http://www.continuent.com
http://code.google.com/p/tungsten-replicator

©Continuent 2012 17

Thursday, June 28, 12

Contenu connexe

Tendances

MySQL Cluster 8.0 tutorial text

Frazer Clement

GlassFish v2.1

Alexis Moussine-Pouchkine

Netbackup training-course-navi-mumbai-netbackup-course-provider-navi-mumbai

VibrantGroup

They told you that using Java with containers was great, but they never mentioned that it wouldn't be that easy, right? You have all the advantages of containers like isolation, scalability, ease of deployment, and version management, but what about the pitfalls when using it with Java? Memory management, image size, initialization time … sometimes they can be tricky. But there's a way out. Luckily, there are some best practices that will rescue your application from failing. From the Dockerfile to the Java updates (from 9 to 14 and beyond), you can have the best of both worlds right in your hands. Join this practical session to transform the way you deal with Java and containers today.

Java & containers: What I wish I knew before I used it | DevNation Tech Talk

Red Hat Developers

Cassandra at scale

Patrick McFadin

mysql 5.5.25 用户安装备忘

YUCHENG HU

Tendances (6)

MySQL Cluster 8.0 tutorial text

GlassFish v2.1

Netbackup training-course-navi-mumbai-netbackup-course-provider-navi-mumbai

Java & containers: What I wish I knew before I used it | DevNation Tech Talk

Cassandra at scale

mysql 5.5.25 用户安装备忘

Similaire à Flexible heterogenous replication

Solving MySQL replication problems with Tungsten

Giuseppe Maxia

State of the art of MySQL replication and clustering

Giuseppe Maxia

Presentation at SVForum Cloud SIG June 26, 2012. I described the MetaZeta.com cluster provisioning service and went into detail about how multiple clusters are coordinated despite Amazon Web Service EC2 request throttling. Techniques for fast spin-up are discussed. The MetaZeta clusters system was created to spawn clusters for big data, Hadoop, Hive, and HBase training classes where each student gets a dedicated cluster. Screenshots of the clusters are also included.

MetaZeta Clusters Overview

Paul Baclace

Disaster Recovery with MySQL and Tungsten

Jeff Mace

Robert Hodges Users have traditionally used database clusters to solve database availability and performance requirements. However, clustering requirements are changing as hardware improvements make performance concerns obsolete for many users. In this talk I will discuss how the Tungsten project uses master/slave replication, group communications, and rules processing to develop easy-to-manage database clusters that solve database availability, protect data, and address hardware utilization. Our implementation is based on existing PostgreSQL capabilities like Londiste and WAL shipping, which we eventually plan to replace with our own log-based replication. Come see the future of database clustering with Tungsten!

Implementing the Future of PostgreSQL Clustering with Tungsten

Command Prompt., Inc

Into the Wild with Node.js and Web Apps

Christopher Bumgardner

Tungsten Replicator tutorial

Giuseppe Maxia

Sqlsat154 maintain your dbs with help from ola hallengren

Andy Galbraith

Fast and consistent testing is an essential part of any modern development process. In this talk we would like to share the experience we gained in DSE on our journey towards more effective testing. Introducing Gradle as the build tools allowed us to execute tests in parallel, shortening the test round times, and enable them an integral part of the pre-merge checks. On the other hand, Docker helped us to run functional and integration tests safely in parallel on a single machine requiring no changes to the production code. Equally important, Dockerized environment added repeatability to our workflows. Tests are executed within the very same environment everywhere, from engineers laptops to our CI servers. At the moment, we squeeze 15+ hours of testing time into test rounds shorter than an hour. Our future work will be focused on exploring Docker Swarms. The implemented approach is based fully on other open-source projects, and could be applied to any project and/or organization. About the Speaker Predrag Knezevic DSE Engineer, Datastax Tech lead, engineer, open-source contributor. Years of experience in performing research and leading research/development teams both local and nearshore. Currently DSE Developer advocate at DataStax. PhD from TU Darmstadt, Germany for the work in area of distributed/decentralized/p2p data management.

DataStax | Effective Testing in DSE (Lessons Learned) (Predrag Knezevic) | Ca...

DataStax

Effective Testing in DSE

pedjak

PoPostgreSQL Web Projects: From Start to FinishStart To Finish

elliando dias

In last few years, technology has seen a major drift in the dominance of traditional / RDMBS databases across different domains. Expeditious adoption of NoSQL databases especially Cassandra in the industry opens up a lot more discussions on what are the major challenges that are faced during implementation of Cassandra and how to mitigate it. Many a times we conclude that migration or POC (proof of concept) is not successful; however the real flaw might be in the data modeling, identifying the right hardware configurations, database parameters, right consistency level and so on. There's no one good model or configuration which fits all use cases and all applications. Performance tuning an application is truly an art and requires perseverance. This paper delve into different performance tuning considerations and anti-patterns that need to be considered during Cassandra migration / implementation to make sure we are able to reap the benefits of Cassandra, what makes it a ‘Visionary’ in 2014 Gartner’s Magic Quadrant for Operational Database Management Systems.

Infosys Ltd: Performance Tuning - A Key to Successful Cassandra Migration

DataStax Academy

Replication features, technologies and 3rd party Extinction

Ben Mildren

Database Performance With Proxy Architectures

PerconaPerformance

MySQL high availability power and usability

Giuseppe Maxia

Consolidated shared indexes in real time

Jeff Mace

Building infrastructure for Big Data

PromptCloud

An Introduction to Cassandra on Linux

nickmbailey

WillMicroserviceDie.pdf

EmilyJiang23

Memcachedb: The Complete Guide

elliando dias

Similaire à Flexible heterogenous replication (20)

Solving MySQL replication problems with Tungsten

State of the art of MySQL replication and clustering

MetaZeta Clusters Overview

Disaster Recovery with MySQL and Tungsten

Implementing the Future of PostgreSQL Clustering with Tungsten

Into the Wild with Node.js and Web Apps

Tungsten Replicator tutorial

Sqlsat154 maintain your dbs with help from ola hallengren

DataStax | Effective Testing in DSE (Lessons Learned) (Predrag Knezevic) | Ca...

Effective Testing in DSE

PoPostgreSQL Web Projects: From Start to FinishStart To Finish

Infosys Ltd: Performance Tuning - A Key to Successful Cassandra Migration

Replication features, technologies and 3rd party Extinction

Database Performance With Proxy Architectures

MySQL high availability power and usability

Consolidated shared indexes in real time

Building infrastructure for Big Data

An Introduction to Cassandra on Linux

WillMicroserviceDie.pdf

Memcachedb: The Complete Guide

Dernier

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Drew Madelung

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

Tata AIG General Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Neo4j

As privacy and data protection regulations evolve rapidly, organizations operating in multiple jurisdictions face mounting challenges to ensure compliance and safeguard customer data. With state-specific privacy laws coming up in multiple states this year, it is essential to understand what their unique data protection regulations will require clearly. How will data privacy evolve in the US in 2024? How to stay compliant? Our panellists will guide you through the intricacies of these states' specific data privacy laws, clarifying complex legal frameworks and compliance requirements. This webinar will review: - The essential aspects of each state's privacy landscape and the latest updates - Common compliance challenges faced by organizations operating in multiple states and best practices to achieve regulatory adherence - Valuable insights into potential changes to existing regulations and prepare your organization for the evolving landscape

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Discord is a free app offering voice, video, and text chat functionalities, primarily catering to the gaming community. It serves as a hub for users to create and join servers tailored to their interests. Discord’s ecosystem comprises servers, each functioning as a distinct online community with its own channels dedicated to specific topics or activities. Users can engage in text-based discussions, voice calls, or video chats within these channels. Understanding Discord Servers Discord servers are virtual spaces where users congregate to interact, share content, and build communities. Servers may revolve around gaming, hobbies, interests, or fandoms, providing a platform for like-minded individuals to connect. Communication Features Discord offers a range of communication tools, including text channels for messaging, voice channels for real-time audio conversations, and video channels for face-to-face interactions. These features facilitate seamless communication and collaboration. What Does NSFW Mean? The acronym NSFW stands for “Not Safe For Work,” indicating content that may be inappropriate for professional or public settings. NSFW Content NSFW content encompasses material that is sexually explicit, violent, or otherwise graphic in nature. It often includes nudity, profanity, or depictions of sensitive topics.

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

UK Journal

A Domino Admins Adventures (Engage 2024)

Gabriella Davis

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

This presentation explores the impact of HTML injection attacks on web applications, detailing how attackers exploit vulnerabilities to inject malicious code into web pages. Learn about the potential consequences of such attacks and discover effective mitigation strategies to protect your web applications from HTML injection vulnerabilities. for more information visit https://bostoninstituteofanalytics.org/category/cyber-security-ethical-hacking/

HTML Injection Attacks: Impact and Mitigation Strategies

Boston Institute of Analytics

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Miguel Araújo

Axa Assurance Maroc - Insurer Innovation Award 2024

The Digital Insurer

Automating Google Workspace (GWS) & more with Apps Script

wesley chun

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

Imagine a world where information flows as swiftly as thought itself, making decision-making as fluid as the data driving it. Every moment is critical, and the right tools can significantly boost your organization’s performance. The power of real-time data automation through FME can turn this vision into reality. Aimed at professionals eager to leverage real-time data for enhanced decision-making and efficiency, this webinar will cover the essentials of real-time data and its significance. We’ll explore: FME’s role in real-time event processing, from data intake and analysis to transformation and reporting An overview of leveraging streams vs. automations FME’s impact across various industries highlighted by real-life case studies Live demonstrations on setting up FME workflows for real-time data Practical advice on getting started, best practices, and tips for effective implementation Join us to enhance your skills in real-time data automation with FME, and take your operational capabilities to the next level.

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Safe Software

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

Dernier (20)