OSA Con 2022 - State of Open Source Databases - Peter Zaitsev - Percona.pdf

•

0 j'aime•20 vues

OSA Con 2022 - State of Open Source Databases Peter Zaitsev - Percona It has been an exciting year in the open-source database industry, with more choices, more cloud, and key changes in the industry. We will dive into the key developments over 2022, including the most important open-source database software releases in general, the significance of cloud-native solutions in a multi-vendor multi-cloud world, the new criticality of security challenges, and the evolution of the open-source software industry.

Données & analyses

State of Open Source
Databases
Peter Zaitsev,
Founder,
Percona
Nov 15th
, 2022

Separation of
Storage and
Compute
© Percona 4

HTAP – Hybrid
Transactional
Analytical Processing
© Percona 6

Multiple
Databases
© Percona 8
Microservices
Developers Authority
Cloud

Different Models
© Percona 9
Not just Relational
Any More
Time Series Graph Data Structures

Multi-Model
Some Databases Support Multiple Data Models, Some even Talk Different Languages/Protocols
© Percona 10

Shapechangers
© Percona 11
Clickhouse can speak PostgreSQL and
MySQL Protocols
VictoriaMetrics has InfluxDB and
Graphite API
FerretDB allows to use PostgreSQL as if it
were MongoDB
Babelfish turns PostgreSQL in MS SQL
Compatible Database

What Is the Biggest
Factor Impacting
Open Source Now?
© Percona
12

Really ?
14
https://db-engines.com/en/blog_post/93

Cloud Impact
© Percona
Maximize and
Simplify
Adoption
Change
Opportunities
for Monetization
15

Remember…
Marten Mickos: ”Open
Source Is Not a Business
Model”
© Percona
16

Open Source
Ownership and
Governance
• Foundation Driven (Multiple
Vendors)
• Single Vendor Driven
© Percona
17

Foundation Based Open Source
© Percona
CLOUD HELPS TO
ACCELERATE ADOPTION
CLOUD CHANGES WHO
CAPTURES THE VALUE
18

Single Vendor
• Tend to Be Venture Funded or
Public Companies
• Feared of Competition with
Cloud Vendors
© Percona
19

Fully or Partially
Abandoning
Open Source
Licenses
© Percona
20

Elastic vs
OpenSearch
after Licence
Change
21

Primary Goal of the License Change?
- Creating Monopoly on DBaaS Market
23

Why DBaaS?
© Percona
STATE OF ART SIMPLICITY HIGH LEVEL OF
AUTOMATION
MAXIMIZES DEVELOPERS
FOCUS ON APPLICATION
24

What Is the
Problem with
Monopoly on
DBaaS?
© Percona
25

No Different
from
Proprietary
Software
Using DBaaS is a very different
skill compared to rolling your
own database setup
© Percona
26

DBaaS Vendor Lock-In
It may not be so painful now, but it is going to be painful in the future
27

History Lesson Oracle used to Save its customer from IBM
Hardware Lock-in with Mainframe computers
28

Why Data is Special
Moving Data is Expensive. Moving Lots of Data is Very
Expensive
29

Have We Been
Here Before?
2000s 2020s
31

• Lock-in with Cloud Vendor
• Use Proprietary Solutions
• Highly Differentiated Cloud
• Hostage
• No Vendor Choice
• Freedom to Run Anywhere
• Use Open Source
• Cloud Is Commodity
• Customer
• Choice of Vendors
Open Source
Catches Up
Again
33

Cloud Native is
Going Strong
34
https://landscape.cncf.io/

Giving Cloud Its
Originally
Intended Role of
Commodity
Infrastructure
35

Kubernetes
• Kubernetes is universally
available
• Kubernetes is getting better for
stateful applications
• Kubernetes Operators are
available for most popular Open
Source Databases
© Percona
36

What’s Up with Kubernetes Operators?
© Percona
Day 1 and Day 2 Automation,
Toil Reduction Similar to DBaaS
UX is Different, Requires
Kubernetes Expertise
37

Can We Build
DBaaS on
Kubernetes?
© Percona
38

Many Modern
DBaaS Are Built
This Way
© Percona
39

Keep Control of
your Data!
40
https://altinity.com/altinity-cloud-anywhere/

Completely
Open Source
DBaaS
• Percona is building Open Source
Database as a Service in
Percona Monitoring and
Management (PMM)
© Percona
41

Work in
Progress…
© Percona
https://www.percona.com/doc/percona-monitoring-and-management/2.x/setting-up/server/dbaas.html
42

Summary
Fantastic Change
of Innovation
Evolving Open
Source Models
Great Future
43

Thank you, Let’s Connect!
https://www.linkedin.com/in/peterzaitsev/
https://twitter.com/PeterZaitsev
http://www.peterzaitsev.com

Contenu connexe

Similaire à OSA Con 2022 - State of Open Source Databases - Peter Zaitsev - Percona.pdf

Presented at: Open Source 101 2020 - Columbia Presented by: Peter Zaitsev, Percona Abstract: Most applications use databases, yet many fail to follow even the most basic best practices causing poor performance, downtime and security incidents. In this presentation, we will look into the foundational best practices you as a Developer should know about databases, with particular focus on the most popular Open Source Databases – MySQL, PostgreSQL, and MongoDB.

17 Things Developers Should Know About Databases

All Things Open

Introduction to Apache Mesos and DC/OS

Steve Wong

The talk will go through the following topics and experiences. 1. Container Strategy and Implementation for HBase. 2. Resource Management inside a containerized environment. 3. Network Isolation and Policy Management (Project Calico) 4. Orchestration Structure using DCOS Commons 5. Internal and External Load Balancing using Marathon Load Balancer. 6. Auto-scaling of HBase 7. AWS Deployment learnings. This talk will be interesting to developers and administrators who are attempting to automate the deployment of HBase and HDFS in containers. by John Leach and Daniel Gomez Ferro of Splice Machine

HBaseCon2017 Splice Machine as a Service: Multi-tenant HBase using DCOS (Meso...

HBaseCon

Watch full webinar here: https://bit.ly/3mPLIlo A shift to the cloud is a common element of any current data strategy. However, a successful transition to the cloud is not easy and can take years. It comes with security challenges, changes in downstream and upstream applications, and new ways to operate and deploy software. An abstraction layer that decouples data access from storage and processing can be a key element to enable a smooth journey to the cloud. Attend this webinar to learn more about: - How to use Data Virtualization to gradually change data systems without impacting business operations - How Denodo integrates with the larger cloud ecosystems to enable security - How simple it is to create and manage a Denodo cloud deployment

A Successful Journey to the Cloud with Data Virtualization

Denodo

ABSTRACT OF THE TALK Kubernetes has hit a home run for stateless workloads, but can it do the same for stateful services such as distributed databases? Before we can answer that question, we need to understand the challenges of running stateful workloads on, well anything. In this talk, we will first look at which stateful workloads, specifically databases, are ideal for running inside Kubernetes. Secondly, we will explore the various concerns around running databases in Kubernetes for production environments, such as: - The production-readiness of Kubernetes for stateful workloads in general - The pros and cons of the various deployment architectures - The failure characteristics of a distributed database inside containers In this session, we will demonstrate what Kubernetes brings to the table for stateful workloads and what database servers must provide to fit the Kubernetes model. This talk will also highlight some of the modern databases that take full advantage of Kubernetes and offer a peek into what’s possible if stateful services can meet Kubernetes halfway. We will go into the details of deployment choices, how the different cloud-vendor managed container offerings differ in what they offer, as well as compare performance and failure characteristics of a Kubernetes-based deployment with an equivalent VM-based deployment. BIO Amey is a VP of Data Engineering at Yugabyte with a deep passion for Data Analytics and Cloud-Native technologies. In his current role, he collaborates with Fortune 500 enterprises to architect their business applications with scalable microservices and geo-distributed, fault-tolerant data backend using YugabyteDB. Prior to joining Yugabyte, he spent 5 years at Pivotal as Platform Data Architect and has helped enterprise customers across multiple industry verticals to extend their analytical capabilities using Pivotal & OSS Big Data platforms. He is originally from Mumbai, India, and has a Master's degree in Computer Science from the University of Pennsylvania(UPenn), Philadelphia. Twitter: @ameybanarse LinkedIn: linkedin.com/in/ameybanarse/

YugabyteDB - Distributed SQL Database on Kubernetes

DoKC

IBM - Introduction to Cloudant

Francisco González Jiménez

0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2

Raul Chong

Webinar Session - https://youtu.be/_5MfGMf8PG4 In this webinar, we share how the Container Attached Storage pattern makes performance tuning more tractable, by giving each workload its own storage system, thereby decreasing the variables needed to understand and tune performance. We then introduce MayaStor, a breakthrough in the use of containers and Kubernetes as a data plane. MayaStor is the first containerized data engine available that delivers near the theoretical maximum performance of underlying systems. MayaStor performance scales with the underlying hardware and has been shown, for example, to deliver in excess of 10 million IOPS in a particular environment.

Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storage

MayaData Inc

"Unlike just a few years ago, today the lakehouse architecture is an established data platform embraced by all major cloud data companies such as AWS, Azure, Google, Oracle, Microsoft, Snowflake and Databricks. This session kicks off with a technical, no-nonsense introduction to the lakehouse concept, dives deep into the lakehouse architecture and recaps how a data lakehouse is built from the ground up with streaming as a first-class citizen. Then we focus on serverless for streaming use cases. Serverless concepts are well-known from developers triggering hundreds of thousands of AWS Lambda functions at a negligible cost. However, the same concept becomes more interesting when looking at data platforms. We have all heard about the principle ""It runs best on Powerpoint"", so I decided to skip slides here and bring a serverless demo instead: A hands-on, fun, and interactive serverless streaming use case example where we ingest live events from hundreds of mobile devices (don't miss out - bring your phone and be part of it!!). Based on this use case I will critically explore how much of a modern lakehouse is serverless and how we implemented that at Databricks (spoiler alert: serverless is everywhere from data pipelines, workflows, optimized Spark APIs, to ML). TL;DR benefits for the Data Practitioners: -Recap the OSS foundation of the Lakehouse architecture and understand its appeal - Understand the benefits of leveraging a lakehouse for streaming and what's there beyond Spark Structured Streaming. - Meat of the talk: The Serverless Lakehouse. I give you the tech bits beyond the hype. How does a serverless lakehouse differ from other serverless offers? - Live, hands-on, interactive demo to explore serverless data engineering data end-to-end. For each step we have a critical look and I explain what it means, e.g for you saving costs and removing operational overhead."

Standing on the Shoulders of Open-Source Giants: The Serverless Realtime Lake...

HostedbyConfluent

What’s New in Documentum 7.3

Michael Mohen

A Novel Use of Openflow and Its Applications in Connecting Docker and Dummify...

DaoliCloud Ltd

Mysql ecosystem in 2019

Alkin Tezuysal

eFolder Webinar — Special eFolder Announcement: StorageCraft Agreement and CE...

eFolder

Agencies of all sizes are struggling to keep pace with rapidly changing mission needs and regulations. Their success is more dependent than ever on their ability to increase agility and take advantage of cloud and cloud-native architectures. This webinar will cover how public sector agencies are working with Red Hat and NuoDB to: Seamlessly deploy and manage applications in a modern architecture; Maintain the benefits of SQL and gain on-demand, horizontal scalability; Deploy a technology stack that facilitates efficiency and a DevOps structure.

Building Cloud-Native Applications with a Container-Native SQL Database in th...

NuoDB

The combination of StackPointCloud with NetApp creates NetApp Kubernetes Service, the industry’s first complete Kubernetes platform for multi-cloud deployments and a complete cloud-based stack for Azure, Google Cloud, AWS, and NetApp HCI. Further, Trident is a fully supported open source project maintained by NetApp, designed from the ground up to help meet the sophisticated persistence demands of containerized applications.

Containers and Kubernetes

Altoros

#CCevent Cloud is awesome but not as flexible as you think

Pete Johnson

Virtualization and Containers

Kellyn Pot'Vin-Gorman

PostgreSQL is versatile and used for a wide range of applications and use cases in the enterprise. It is more than just database technology, it is an accelerator for innovation. Much innovation today is happening in new application development, application modernization, and re-platforming to the cloud across the information architecture landscape. In this webinar, you will learn how EDB supercharges PostgreSQL to re-platform to cloud and containers more efficiently and develop new applications that are more scalable and secure.

PostgreSQL to Accelerate Innovation

EDB

Vmware Serengeti - Based on Infochimps Ironfan

Jim Kaskade

Stl meetup cloudera platform - january 2020

Adam Doyle

Similaire à OSA Con 2022 - State of Open Source Databases - Peter Zaitsev - Percona.pdf (20)

17 Things Developers Should Know About Databases

Introduction to Apache Mesos and DC/OS

HBaseCon2017 Splice Machine as a Service: Multi-tenant HBase using DCOS (Meso...

A Successful Journey to the Cloud with Data Virtualization

YugabyteDB - Distributed SQL Database on Kubernetes

IBM - Introduction to Cloudant

0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2

Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storage

Standing on the Shoulders of Open-Source Giants: The Serverless Realtime Lake...

What’s New in Documentum 7.3

A Novel Use of Openflow and Its Applications in Connecting Docker and Dummify...

Mysql ecosystem in 2019

eFolder Webinar — Special eFolder Announcement: StorageCraft Agreement and CE...

Building Cloud-Native Applications with a Container-Native SQL Database in th...

Containers and Kubernetes

#CCevent Cloud is awesome but not as flexible as you think

Virtualization and Containers

PostgreSQL to Accelerate Innovation

Vmware Serengeti - Based on Infochimps Ironfan

Stl meetup cloudera platform - january 2020

Plus de Altinity Ltd

Building an Analytic Extension to MySQL with ClickHouse and Open Source In this webinar Percona and Altinity offer suggestions and tips on how to recognize when MySQL is overburdened with analytics and can benefit from ClickHouse’s unique capabilities. Also, they will walk you through important patterns for integrating MySQL and ClickHouse which will enable the building of powerful and cost-efficient applications that leverage the strengths of both databases.

Building an Analytic Extension to MySQL with ClickHouse and Open Source.pptx

Altinity Ltd

Over the last few years Kubernetes has transitioned from an object of curiosity and fear to a robust platform for big data. Watch this webinar and you will learn how the Altinity Kubernetes Operator for ClickHouse enables users to run high performance analytics on ClickHouse. You will see a simple installation and teach you how to scale it into a cluster that can analyze 100s of terabytes of data. Along the way we’ll share our lessons for ClickHouse on Kubernetes in Altinity.Cloud. We built it on Kubernetes using the Altinity Operator and now run hundreds of clusters in the cloud. You can too!

Cloud Native ClickHouse at Scale--Using the Altinity Kubernetes Operator-2022...

Altinity Ltd

This is a joint webinar Percona - Altinity. In this webinar we will discuss suggestions and tips on how to recognize when MySQL is overburdened with analytics and can benefit from ClickHouse’s unique capabilities. We will then walk through important patterns for integrating MySQL and ClickHouse which will enable the building of powerful and cost-efficient applications that leverage the strengths of both databases.

Building an Analytic Extension to MySQL with ClickHouse and Open Source

Altinity Ltd

Fun with ClickHouse Window Functions | Altinity Webinar Window functions have arrived in ClickHouse! Our webinar will start with an introduction to standard window function syntax and show how it is implemented in ClickHouse. We’ll next show you problems that you can now solve easily using window functions. Finally, we’ll compare window functions to arrays, another powerful ClickHouse feature. There will be time for questions with our SQL experts. Join us for a complete overview of this long-awaited feature! Speakers: Robert Hodges, CEO @Altinity Vitaliy Zakaznikov, QA Manager and Architect @Altinity

Fun with ClickHouse Window Functions-2021-08-19.pdf

Altinity Ltd

Cloud Native Data Warehouses: A Gentle Introduction to Running ClickHouse on Kubernetes | Altinity Webinar Kubernetes is a powerful platform for big data and is particularly well-suited for ClickHouse. If you have been wondering about trying Kubernetes, this webinar is for you. The first half introduces Kubernetes basics, building up to operators, which manage cloud-native applications. The second half focuses on ClickHouse and shows how to deploy data warehouses using the ClickHouse Operator. You’ll learn everything you need to start grappling with big data on Kubernetes. Speaker: Robert Hodges, CEO @Altinity

Cloud Native Data Warehouses - Intro to ClickHouse on Kubernetes-2021-07.pdf

Altinity Ltd

Altinity Stable Builds offer a ClickHouse distribution that is ready for production use and with 3 years of maintenance. Our webinar introduces the special features of Stable Builds and describes how we build them from ClickHouse Long-Term Support (LTS) releases. We’ll show you how to find them and install them yourself, then guide you through the important topic of upgrading. We’ll also walk through how to use Altinity Stable Builds in Altinity.Cloud, our managed ClickHouse platform for high-performance analytics.

Building High Performance Apps with Altinity Stable Builds for ClickHouse | A...

Altinity Ltd

Application Monitoring using Open Source - VictoriaMetrics & Altinity ClickHouse Webinar Slides Monitoring is the key to the successful operation of any software service, but commercial solutions are complex, expensive, and slow. Let us show you how to build monitoring that is simple, cost-effective, and fast using open-source stacks easily accessible to any developer. We’ll start with the elements of monitoring systems: data ingest, query engine, visualization, and alerting. We’ll then explain and contrast two implementation approaches. The first uses VictoriaMetrics, a fast-growing, high-performance time series database that uses PromQL for queries. The second is based on ClickHouse, a popular real-time analytics database that speaks SQL. Fast, affordable monitoring is within reach. This webinar provides designs and working code to get you there. Presented by: Roman Khavronenko, Co-Founder at VictoriaMetrics Robert Hodges, CEO at Altinity

Application Monitoring using Open Source - VictoriaMetrics & Altinity ClickHo...

Altinity Ltd

Altinity.Cloud is a managed ClickHouse platform for high-performance analytics. But what if you want to run ClickHouse in your own cloud account? Altinity.Cloud Anywhere does exactly that. In this webinar, we’ll explain how Altinity.Cloud Anywhere works, then walk through the simple setup procedure to get full cloud management of ClickHouse clusters in your VPCs. This webinar teaches you how to have cloud management for your real-time analytic stack while meeting requirements for compliance, control of data, and freedom from lock-in. Have your cake and eat it too!

Own your ClickHouse data with Altinity.Cloud Anywhere-2023-01-17.pdf

Altinity Ltd

ClickHouse ReplacingMergeTree in Telecom Apps

Altinity Ltd

Adventures with the ClickHouse ReplacingMergeTree Engine

Altinity Ltd

Building a Real-Time Analytics Application with Apache Pulsar and Apache Pinot While the demands for real-time analytics are growing in leaps and bounds, the analytics software must rely on streaming platforms for ingesting high volumes of data that's traveling in lightning speed down the pipeline. We will take a look at 2 powerful open source Apache platforms: Pulsar and Pinot, that work hand-in-hand together to deliver the analytical results which bring great value to your systems. Presenters: Mary Grygleski - Streaming Developer Advocate & Mark Needham - Developer Relations Engineer at StarTree Note: This webinar will be recorded and later posted on our Webinar page (https://altinity.com/webinarspage/) or Altinity official Youtube channel (https://www.youtube.com/@Altinity).

Building a Real-Time Analytics Application with Apache Pulsar and Apache Pinot

Altinity Ltd

Altinity Webinar: Introduction to Altinity.Cloud-Platform for Real-Time Data - Presentation Slides Altinity.Cloud is a fully automated cloud service for ClickHouse that is optimized for real-time analytics. In this webinar, we’ll explain how Altinity.Cloud works, then show how to set up your first ClickHouse cluster. We’ll then tour important features like scale-up, scale-out, uptime schedules, and DBA tools to analyze your tables. You’ll learn everything necessary to start working on real-time analytics today. Bring your questions! Presenters: Robert Hodges & Alexander Zaitsev Note: This webinar will be recorded and later posted on our Webinar page (https://altinity.com/webinarspage/) or Altinity official Youtube channel (https://www.youtube.com/@Altinity).

Altinity Webinar: Introduction to Altinity.Cloud-Platform for Real-Time Data.pdf

Altinity Ltd

OSA Con 2022 - What Data Engineering Can Learn from Frontend Engineering - Pe...

Altinity Ltd

OSA Con 2022 - Welcome to OSA CON Version 2022 - Robert Hodges - Altinity.pdf

Altinity Ltd

OSA Con 2022: Using ClickHouse Database to Power Analytics and Customer Engagement Platform Prafulla Gupta - Times Internet This talk covers how we empowered Product Managers and Editors at Times Internet by developing an in-house product, GrowthRx, using Clickhouse Open Source Database to track and analyze user behavior to increase user retention and customer engagement. Times Internet is India's largest digital news publisher, which manages leading brands like Times of India, Economic Times, Navbharat Times, etc, where we are tracking more than 10 billion events per month in the ClickHouse Database.

OSA Con 2022 - Using ClickHouse Database to Power Analytics and Customer Enga...

Altinity Ltd

OSA Con 2022 - Tips and Tricks to Keep Your Queries under 100ms with ClickHou...

Altinity Ltd

OSA Con 2022 - The Open Source Analytic Universe, Version 2022 - Robert Hodge...

Altinity Ltd

OSA Con 2022: Switching Jaeger Distributed Tracing to ClickHouse to Enable Advanced Performance Management Satbir Chahal - OpsVerse Our team switched our Jaeger (open source project used for distributed tracing) storage backend to ClickHouse (from Cassandra), which opened the door to a world of advanced analytics that we can run and provide our users. This talk will describe the journey from the switch, the learning curve, the challenges, and the eventual wins.

OSA Con 2022 - Switching Jaeger Distributed Tracing to ClickHouse to Enable A...

Altinity Ltd

OSA Con 2022 - Streaming Data Made Easy - Tim Spann & David Kjerrumgaard - St...

Altinity Ltd

OSA Con 2022 - Specifics of data analysis in Time Series Databases - Roman Kh...

Altinity Ltd

Plus de Altinity Ltd (20)