An High Available Database for OpenStack Cloud Production by Pacemaker, Corosync & DRBD

•

0 likes•758 views

Jeff Yang

The video is captured from an OpenStack production environment from an IBM customer.

Technology

An High Available Database
for OpenStack Cloud Production
by Pacemaker, Corosync & DRBD
@j3ffyang, Jeffrey Yang, OpenStack Dev, IBM
OpenStack Summit, Atlanta, 2014

Technical Objective
●
Database high availability (active - passive)
●
Data persistence (drbd)
●
MySQLd monitored (corosync)
●
IP address floating when failure occurs
(pacemaker)

High Level Architecture
DRBD
MySQL
Corosync
Pacemaker
DRBD
MySQL
sync
Compute
Other OpenStack components

$Sample Configurations [root@host10 corosync]# cat corosync.conf ... totem { version: 2 token: 10000 # 10 seconds token_retransmits_before_loss_const: 10 secauth: on threads: 0 interface { ringnumber: 0 bindnetaddr:10.10.203.0 mcastaddr: 226.94.1.1 mcastport: 5405 ttl: 1 } } logging { fileline: off to_stderr: no to_logfile: yes to_syslog: yes logfile: /var/log/cluster/corosync.log debug: off timestamp: on logger_subsys { subsys: AMF debug: off } } ... service { ver: 0 name: pacemaker use_mgmtd: yes } [root@host10 corosync]# crm configure edit node host10 attributes standby="off" node host20 attributes standby="off" primitive drbd_mysql ocf:linbit:drbd params drbd_resource="mysql" op monitor interval="29s" role="Master" op monitor interval="31s" role="Slave" primitive fs_mysql ocf:heartbeat:Filesystem params device="/dev/drbd1" directory="/opt/drbd/" fstype="ext4" primitive ip_mysql ocf:heartbeat:IPaddr2 params ip="10.10.203.19" nic="eth3" primitive mysqld lsb:mysqld group mysql fs_mysql ip_mysql mysqld ms ms_drbd_mysql drbd_mysql meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true" colocation mysql_on_drbd inf: mysql ms_drbd_mysql:Master order mysql_after_drbd inf: ms_drbd_mysql:promote mysql:start property $id="cib-bootstrap-options" dc-version="1.1.7-6.el6-148fccfd5985c5590cc601123c6c16e966b85d14" cluster-infrastructure="openais" expected-quorum-votes="2" stonith-enabled="false"$

Demo
●
Captured from a production environment at
one of IBM customers
●
https://www.youtube.com/watch?v=UEln0TUU
aH8

To- do
●
Enhance cookbook for automatic deployment
(DevOps)
●
Move to Galera Cluster for multi- nodes (all
active)

What's hot

Installation of application server 10g in red hat 4

uzzzle

Запускаем сервер (БД, Web-сервер или что-то свое собственное) и не получаем желаемый RPS. Запускаем top и видим, что 100% выедается CPU. Что дальше, на что расходуется процессорное время? Можно ли подкрутить какие-то ручки, чтобы улучшить производительность? А если параметр CPU не высокий, то куда смотреть дальше? Мы рассмотрим несколько сценариев проблем производительности, рассмотрим доступные инструменты анализа производительности и разберемся в методологии оптимизации производительности Linux, ответим на вопрос за какие ручки и как крутить.

Как понять, что происходит на сервере? / Александр Крижановский (NatSys Lab.,...

Ontico

Gnocchi v4 - past and present

Gordon Chung

はじめてのGlusterFS

Takahiro Inoue

An Introduction to Priam

Jason Brown

Presenters: Don Marti, Glauber Costa, and Dor Laor of Cloudius Systems The need for performance tuning of the JVM and OS is making administrators the bottleneck for Cassandra deployments--especially in virtual environments. Over the past two years, the OSv project has profiled tuning-sensitive applications with a special focus on Cassandra. Today, many of the important bottlenecks for NoSQL applications are tunable on a conventional OS, but do not require tuning in the OSv environment. OSv gives Cassandra a simpler environment, set up to run one application in a single address space. This talk will cover how to use OSv to improve performance in key areas such as JVM memory allocation and network throughput--without loading up your to-do list with difficult tuning tasks.

Cassandra Summit 2014: Down with Tweaking! Removing Tunable Complexity for Ca...

DataStax Academy

HBaseCon 2013: OpenTSDB at Box

Cloudera, Inc.

Масштабируемая конфигурация Nginx, Игорь Сысоев (Nginx)

Ontico

Your 1st Ceph cluster

Mirantis

A solid backup strategy is a DBA's bread and butter. Cassandra's nodetool snapshot makes it easy to back up the SSTable files, but there remains the question of where to put them and how. Knewton's backup strategy uses Ansible for distributed backups and stores them in S3. Unfortunately, it's all too easy to store backups that are essentially useless due to the absence of a coherent restoration strategy. This problem proved much more difficult and nuanced than taking the backups themselves. I will discuss Knewton's restoration strategy, which again leverages Ansible, yet I will focus on general principles and pitfalls to be avoided. In particular, restores necessitated modifying our backup strategy to generate cluster-wide metadata that is critical for a smooth automated restoration. Such pitfalls indicate that a restore-focused backup design leads to faster and more deterministic recovery. About the Speaker Joshua Wickman Database Engineer, Knewton Dr. Joshua Wickman is currently part of the database team at Knewton, a NYC tech company focused on adaptive learning. He earned his PhD at the University of Delaware in 2012, where he studied particle physics models of the early universe. After a brief stint teaching college physics, he entered the New York tech industry in 2014 working with NoSQL, first with MongoDB and then Cassandra. He was certified in Cassandra at his first Cassandra Summit in 2015.

Cassandra Backups and Restorations Using Ansible (Joshua Wickman, Knewton) | ...

DataStax

Gnocchi v3

Gordon Chung

- Что такое SDS (общие места для (почти) всех решений — масштабирование, абстрагирование от аппаратных ресурсов, управление с помощью политик, кластерные ФС); - Почему мы решили использовать SDS (нужно было объектное хранилище); - Почему решили использовать именно Ceph, а не другие открытые (GlusterFS, Swift...) или проприетарные (IBM Elastic Storage, Huawei OceanStor) решения; - Что еще умеет Ceph, кроме object storage (RBD, CephFS); - Как работает Ceph (со стороны сервера); - Что нового дает BlueStore по сравнению с классическим (поверх ФС); - Сравнение производительности (метрики тестов); - BlueStore — все еще tech preview; - Заключение. Ссылки, литература.

Ceph BlueStore - новый тип хранилища в Ceph / Максим Воронцов, (Redsys)

Ontico

Intorduce to Ceph

kao kuo-tung

File recovery with ShareFile on NetApp

NetApp

opentsdb in a real enviroment

Chen Robert

InfraKit is a toolkit for infrastructure orchestration. With an emphasis on immutable infrastructure, it breaks down infrastructure automation and management processes into small, pluggable components. These components work together to actively ensure the infrastructure state matches the user's specifications. InfraKit therefore provides infrastructure support for higher-level container orchestration systems and can make your infrastructure self-managing and self-healing.

Declare your infrastructure: InfraKit, LinuxKit and Moby

Moby Project

Zero to 1 Billion+ Records: A True Story of Learning & Scaling GameChanger

MongoDB

Ceph Object Storage Performance Secrets and Ceph Data Lake Solution

Karan Singh

MongoDB Shard Cluster

Anuchit Chalothorn

Presented at LISA18: https://www.usenix.org/conference/lisa18/presentation/huynh While there are plenty of readily available metrics for monitoring Linux kernel, many gems remain hidden. With the help of recent developments in eBPF, it is now possible to run safe programs in the kernel to collect arbitrary information with little to no overhead. A few examples include: * Disk latency and io size histograms * Run queue (scheduler) latency * Page cache efficiency * Directory cache efficiency * LLC (aka L3 cache) efficiency * Kernel timer counters * System-wide TCP retransmits Practically any event from "perf list" output and any kernel function can be traced, analyzed and turned into a Prometheus metric with almost arbitrary labels attached to it. If you are already familiar with BCC tools, you may think if ebpf_exporter as bcc tools turned into prometheus metrics. In this tutorial we’ll go over eBPF basics, how to write programs and get insights into a running system.

LISA18: Hidden Linux Metrics with Prometheus eBPF Exporter

Ivan Babrou

What's hot (20)

Installation of application server 10g in red hat 4

Как понять, что происходит на сервере? / Александр Крижановский (NatSys Lab.,...

Gnocchi v4 - past and present

はじめてのGlusterFS

An Introduction to Priam

Cassandra Summit 2014: Down with Tweaking! Removing Tunable Complexity for Ca...

HBaseCon 2013: OpenTSDB at Box

Масштабируемая конфигурация Nginx, Игорь Сысоев (Nginx)

Your 1st Ceph cluster

Cassandra Backups and Restorations Using Ansible (Joshua Wickman, Knewton) | ...

Gnocchi v3

Ceph BlueStore - новый тип хранилища в Ceph / Максим Воронцов, (Redsys)

Intorduce to Ceph

File recovery with ShareFile on NetApp

opentsdb in a real enviroment

Declare your infrastructure: InfraKit, LinuxKit and Moby

Zero to 1 Billion+ Records: A True Story of Learning & Scaling GameChanger

Ceph Object Storage Performance Secrets and Ceph Data Lake Solution

MongoDB Shard Cluster

LISA18: Hidden Linux Metrics with Prometheus eBPF Exporter

Similar to An High Available Database for OpenStack Cloud Production by Pacemaker, Corosync & DRBD

End to End Processing of 3.7 Million Telemetry Events per Second using Lambda...

DataWorks Summit/Hadoop Summit

SaltStack is a new System Management Platform that provides various automations for the lifecycle of systems (HW/VMs). This makes it possible to trigger routines based on specific events using Salt Reactor. The event-based orchestration component of SaltStack recognizes f.e. the adding of new Salt minions (agents) in the Salt host inventory/database, the start of minions after the first system booting, the execution of any (distributed) commands (local or master-triggered) and much more. You can use this framework to provision newly created hosts/VMs with packages and configuration files, or to fully automate the rollout/deployment of new software releases and pre/post actions (DB backup, schema update, removal von temporary files, etc.). Event: inovex Meetup Köln, 08.06.2016 Speaker: Arnold Bechtoldt weitere Tech-Vorträge: https://www.inovex.de/de/content-pool/vortraege/

Automated Application Management with SaltStack

inovex GmbH

Are your Oracle databases highly available? You have deployed Real Application Clusters (RAC), Data Guard, or Failover Clusters and are well protected against server failures? Great – the prerequisites for a highly available environment are given. However, to assure that backend infrastructure failures also remain transparent to the client, an appropriate configuration is a prerequisite. This lecture will discuss the Oracle technologies that can be used to achieve automatic client failover functionality. What are the advantages, but also the limitations of these technologies?

Oracle Client Failover - Under The Hood

Ludovico Caldara

Scalable Socket Server by Aryo

Agate Studio

Vous avez récemment commencé à travailler sur Spark et vos jobs prennent une éternité pour se terminer ? Cette présentation est faite pour vous. Himanshu Arora et Nitya Nand YADAV ont rassemblé de nombreuses bonnes pratiques, optimisations et ajustements qu'ils ont appliqué au fil des années en production pour rendre leurs jobs plus rapides et moins consommateurs de ressources. Dans cette présentation, ils nous apprennent les techniques avancées d'optimisation de Spark, les formats de sérialisation des données, les formats de stockage, les optimisations hardware, contrôle sur la parallélisme, paramétrages de resource manager, meilleur data localité et l'optimisation du GC etc. Ils nous font découvrir également l'utilisation appropriée de RDD, DataFrame et Dataset afin de bénéficier pleinement des optimisations internes apportées par Spark.

10 things i wish i'd known before using spark in production

Paris Data Engineers !

Data Grids with Oracle Coherence

Ben Stopford

Python twisted

Mahendra M

Oracle RAC Presentation at Oracle Open World

Paul Marden

In the world of big data we need to build services that will be able to collect massive data, save it and pass it to processing and analysis. However, building manageable, reliable services that are scalable and cost effective is not an easy task. The choice of eco-system, frameworks and programming language, as well as using solid engineering principles is also crucial for achieving this goal. I will share our journey and insights from rebuilding a cloud service in Linux eco-system using Scala, Akka Actors and Aerospike DB, at the end of which we gained 10 folds improvement of server usage with a much lighter, stable and reliable system that handles tens of millions of requests per hour.

Scale and Throughput @ Clicktale with Akka

Yuval Itzchakov

iguazio - nuclio overview to CNCF (Sep 25th 2017)

Eran Duchan

M2M/IoT is rapidly growing and since its early days different “standard” protocols have emerged (e.g. OMA-DM, TR-069, MQTT, …) or are emerging (e.g. CoAP or Lightweight M2M). Understanding which protocol to use for which application can be intimidating, therefore we propose to give an overview of these protocols to help you understand their goals and characteristics. We’ll present common M2M use cases and why they usually require more than just one protocol ; we will also see whether CoAP associated with Lightweight M2M allows to forge “one protocol to rule them all”.

Iot Conference Berlin M2M,IoT, device management: one protocol to rule them all?

Julien Vermillard

Scaling Docker Containers using Kubernetes and Azure Container Service

Ben Hall

nuclio Overview October 2017

iguazio

Securing Millions of Devices

Kai Hudalla

Building Hopsworks, a cloud-native managed feature store for machine learning

Jim Dowling

Kerberizing spark. Spark Summit east

Jorge Lopez-Malla

The overall evolution towards microservices has caused a lot of IT leaders to radically rethink architectures and platforms. One can hardly keep up with the rapid onslaught on new distributed technologies. The same people who just asked yesterday "how can we deploy Docker containers?", are now asking "how can we operate Kubernetes-as-a-Service on-premise?", and are about to start asking "how can we operate the open source frameworks of our choice, such as Spark, TensorFlow, HDFS, and more, as a service across hybrid clouds?”. This session will discuss: Challenges of orchestrating and operating.

Jörg Schad - Hybrid Cloud (Kubernetes, Spark, HDFS, …)-as-a-Service - Codemot...

Codemotion

Jörg Schad - Hybrid Cloud (Kubernetes, Spark, HDFS, …)-as-a-Service - Codemot...

Codemotion

FPC for the Masses - CoRIIN 2018

Xavier Mertens

HBaseConAsia2018 Track1-7: HDFS optimizations for HBase at Xiaomi

Michael Stack

Similar to An High Available Database for OpenStack Cloud Production by Pacemaker, Corosync & DRBD (20)

End to End Processing of 3.7 Million Telemetry Events per Second using Lambda...

Automated Application Management with SaltStack

Oracle Client Failover - Under The Hood

Scalable Socket Server by Aryo

10 things i wish i'd known before using spark in production

Data Grids with Oracle Coherence

Python twisted

Oracle RAC Presentation at Oracle Open World

Scale and Throughput @ Clicktale with Akka

iguazio - nuclio overview to CNCF (Sep 25th 2017)

Iot Conference Berlin M2M,IoT, device management: one protocol to rule them all?

Scaling Docker Containers using Kubernetes and Azure Container Service

nuclio Overview October 2017

Securing Millions of Devices

Building Hopsworks, a cloud-native managed feature store for machine learning

Kerberizing spark. Spark Summit east

Jörg Schad - Hybrid Cloud (Kubernetes, Spark, HDFS, …)-as-a-Service - Codemot...

FPC for the Masses - CoRIIN 2018

HBaseConAsia2018 Track1-7: HDFS optimizations for HBase at Xiaomi

Recently uploaded

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

Angeliki Cooney has spent over twenty years at the forefront of the life sciences industry, working out of Wynantskill, NY. She is highly regarded for her dedication to advancing the development and accessibility of innovative treatments for chronic diseases, rare disorders, and cancer. Her professional journey has centered on strategic consulting for biopharmaceutical companies, facilitating digital transformation, enhancing omnichannel engagement, and refining strategic commercial practices. Angeliki's innovative contributions include pioneering several software-as-a-service (SaaS) products for the life sciences sector, earning her three patents. As the Senior Vice President of Life Sciences at Avenga, Angeliki orchestrated the firm's strategic entry into the U.S. market. Avenga, a renowned digital engineering and consulting firm, partners with significant entities in the pharmaceutical and biotechnology fields. Her leadership was instrumental in expanding Avenga's client base and establishing its presence in the competitive U.S. market.

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...

Angeliki Cooney

Keynote 2: APIs in 2030: The Risk of Technological Sleepwalk Paolo Malinverno, Growth Advisor - The Business of Technology Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

apidays

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

Dubai, known for its towering skyscrapers, luxurious lifestyle, and relentless pursuit of innovation, often finds itself in the global spotlight. However, amidst the glitz and glamour, the emirate faces its own set of challenges, including the occasional threat of flooding. In recent years, Dubai has experienced sporadic but significant floods, disrupting normalcy and posing unique challenges to its infrastructure. Among the critical nodes in this bustling metropolis is the Dubai International Airport, a vital hub connecting the world. This article delves into the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Orbitshub

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

Dubai, often portrayed as a shimmering oasis in the desert, faces its own set of challenges, including the occasional threat of flooding. Despite its reputation for opulence and modernity, the emirate is not immune to the forces of nature. In recent years, Dubai has experienced sporadic but significant floods, testing the resilience of its infrastructure and communities. Among the critical lifelines in this bustling metropolis is the Dubai International Airport, a bustling hub that connects the city to the world. This article explores the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Orbitshub

Six Myths about Ontologies: The Basics of Formal Ontology

johnbeverley2021

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

CNIC Information System with Pakdata Cf In Pakistan

danishmna97

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Passkeys: Developing APIs to enable passwordless authentication Cody Salas, Sr Developer Advocate | Solutions Architect - Yubico Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

apidays

Vector Search -An Introduction in Oracle Database 23ai.pptx

Remote DBA Services

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Bhuvaneswari Subramani

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Edi Saputra

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

Retrieval augmented generation (RAG) is the most popular style of large language model application to emerge from 2023. The most basic style of RAG works by vectorizing your data and injecting it into a vector database like Milvus for retrieval to augment the text output generated by an LLM. This is just the beginning. One of the ways that we can extend RAG, and extend AI, is through multilingual use cases. Typical RAG is done in English using embedding models that are trained in English. In this talk, we’ll explore how RAG could work in languages other than English. We’ll explore French, Chinese, and Polish.

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Zilliz

Recently uploaded (20)

Corporate and higher education May webinar.pptx

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

presentation ICT roal in 21st century education

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Six Myths about Ontologies: The Basics of Formal Ontology

Artificial Intelligence Chap.5 : Uncertainty

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

CNIC Information System with Pakdata Cf In Pakistan

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Vector Search -An Introduction in Oracle Database 23ai.pptx

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

How to Troubleshoot Apps for the Modern Connected Worker

Why Teams call analytics are critical to your entire business

Introduction to Multilingual Retrieval Augmented Generation (RAG)

An High Available Database for OpenStack Cloud Production by Pacemaker, Corosync & DRBD

1. An High Available Database for OpenStack Cloud Production by Pacemaker, Corosync & DRBD @j3ffyang, Jeffrey Yang, OpenStack Dev, IBM OpenStack Summit, Atlanta, 2014

2. Technical Objective ● Database high availability (active - passive) ● Data persistence (drbd) ● MySQLd monitored (corosync) ● IP address floating when failure occurs (pacemaker)

3. High Level Architecture DRBD MySQL Corosync Pacemaker DRBD MySQL sync Compute Other OpenStack components

4. Sample Configurations [root@host10 corosync]# cat corosync.conf ... totem { version: 2 token: 10000 # 10 seconds token_retransmits_before_loss_const: 10 secauth: on threads: 0 interface { ringnumber: 0 bindnetaddr:10.10.203.0 mcastaddr: 226.94.1.1 mcastport: 5405 ttl: 1 } } logging { fileline: off to_stderr: no to_logfile: yes to_syslog: yes logfile: /var/log/cluster/corosync.log debug: off timestamp: on logger_subsys { subsys: AMF debug: off } } ... service { ver: 0 name: pacemaker use_mgmtd: yes } [root@host10 corosync]# crm configure edit node host10 attributes standby="off" node host20 attributes standby="off" primitive drbd_mysql ocf:linbit:drbd params drbd_resource="mysql" op monitor interval="29s" role="Master" op monitor interval="31s" role="Slave" primitive fs_mysql ocf:heartbeat:Filesystem params device="/dev/drbd1" directory="/opt/drbd/" fstype="ext4" primitive ip_mysql ocf:heartbeat:IPaddr2 params ip="10.10.203.19" nic="eth3" primitive mysqld lsb:mysqld group mysql fs_mysql ip_mysql mysqld ms ms_drbd_mysql drbd_mysql meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true" colocation mysql_on_drbd inf: mysql ms_drbd_mysql:Master order mysql_after_drbd inf: ms_drbd_mysql:promote mysql:start property $id="cib-bootstrap-options" dc-version="1.1.7-6.el6-148fccfd5985c5590cc601123c6c16e966b85d14" cluster-infrastructure="openais" expected-quorum-votes="2" stonith-enabled="false"

5. Demo ● Captured from a production environment at one of IBM customers ● https://www.youtube.com/watch?v=UEln0TUU aH8

6. To- do ● Enhance cookbook for automatic deployment (DevOps) ● Move to Galera Cluster for multi- nodes (all active)

An High Available Database for OpenStack Cloud Production by Pacemaker, Corosync & DRBD

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to An High Available Database for OpenStack Cloud Production by Pacemaker, Corosync & DRBD

Similar to An High Available Database for OpenStack Cloud Production by Pacemaker, Corosync & DRBD (20)

More from Jeff Yang

More from Jeff Yang (11)

Recently uploaded

Recently uploaded (20)

An High Available Database for OpenStack Cloud Production by Pacemaker, Corosync & DRBD