More Related Content Similar to apidays LIVE Singapore 2022_Redesigning Data Architecture.pdf (20) apidays LIVE Singapore 2022_Redesigning Data Architecture.pdf1. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved.
Redesigning Data Architecture
For Better, Modern Application Development
Jeff Morris
VP Product, Solutions & Customer Marketing
April 2022
2. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 2
2022 SERIES OF EVENTS
New York
JULY
(HYBRID)
Australia
SEPTEMBER
(HYBRID)
Singapore
APRIL
(VIRTUAL)
Helsinki & North
MARCH
(VIRTUAL)
Paris
DECEMBER
(HYBRID)
London
OCTOBER
(HYBRID)
Hong Kong
AUGUST
(VIRTUAL)
JUNE (VIRTUAL)
India
MAY
(VIRTUAL)
APRIL (VIRTUAL)
Dubai & Middle East
JUNE
(VIRTUAL)
Check out our API Conferences
www.apidays.global
Want to talk at one of our conferences?
apidays.typeform.com/to/ILJeAaV8
3. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved.
1
2
3
4
5
Requirements for Modern DBMS
Microservices need Speed and Flexibility
Familiar as SQL including ACID Transactions
Distributed Cloud Deployment
Introducing Couchbase Capella
4. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2022. All rights reserved. 4
1Requirements for
Modern DBMS
5. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 5
Develop Efficiently
• Simplify & accelerate development
• Tap my skills (SDKs & SQL)
• Support best practices
• Avoid data sprawl
Deliver Great Experiences
• Personalized & responsive
• Anywhere & everywhere
• Real time info & inventory
• Ensuring dependable
transactions
Deploy Effectively
• Support hybrid clouds, Edge, 5G
• 100% uptime & global scale
• Flexible management options
• Cost effective
What Our Customers Tell Us: Modern Application Requirements
6. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 6
Why Do Customers Need Help Now?
Databases are failing modern performance demands
Drive down cloud cost of ownership
Significantly improve flexibility
Deliver distributed and mobile experiences
7. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 7
What Modern Applications are Starting to Look Like
8. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 8
Helping Customers - Enterprise Applications
15k
mobile sensors per voyage
100’s M
operations per/day
City-at-sea experience via IoT
& edge-based mobile devices
Global fraud detection and
prevention
3B+
payment accounts protected
65%
of world’s card accounts
Product catalog, pricing,
shopping cart, daily deals,
inventory management
4,000
stores worldwide
1.6B
rules applied in real-time
High performance
caching for social
network
10M+
requests / second
575M
users
9. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2022. All rights reserved. 9
2
Microservices need
Speed AND
Flexibility
10. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 10
JSON is Flexible, its Structure can be Changed by the App
JSON makes changing dynamic user profiles and complex catalog entries very easy
Store data in logical ways:
• Denormalized single document
• Normalized with references
• Add new values when needed
• Support for binary values
Access Data in multiple ways:
• Direct Key-Value
• SQL++ querying
• Full-Text Search
• Parallel processing analytics
Unlike relational databases, the application developer dictates the structure of the data,
rather than the relational schema dictating the application’s structure
{
“ UserID ”: “1”,
“ firstName ”:”Jeffrey”,
“ lastName ”: “Mackay”,
“skills”: [”SQL”, “JavaScript”, “NoSQL”]
“experience”: [
{
“role”: “Solutions Architect”,
“company”: “ AppMax Inc”,
},
{
“role”: “Solutions Engineer”,
“company”: “Couchbase”,
}
]
}
JSON Document
Relational Tables
ID First Last
USERS
1 Jeffrey Mackay
1 JavaScript
1 NoSQL
1 SQL
USER_SKILLS
UserID Skill Name
ID Role Company
USER_EXPERIENCE
1 Solutions Architect AppMax Inc
1 Solutions Engineer Couchbase
1
1
11. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 11
Modern Application Architectures
Microservices Architectures
Cache JSON
Documents
Query Search Analytics
Eventing
Transactions Security
MICROSERVICES
Stream
Analyze
Search
Cache
Save Transactions Auth
USER INTERFACE
12. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 12
Developers Seek Optionality
Cache JSON
Documents
Query Analytics
Eventing
Transactions Security
LAMP
Linux
Apache
MySQL
PHP
JAM
JavaScript
API
Markup
JAVA
Spring Boot
Angular
React
MEAN
MongoDB
Express
Angular
Node.JS
.NET
Visual Studio
ASP.NET
CosmosDB
Entity Framework
AWS Stack
Lambda
API Gateway
Eventbridge
Glue
DynamoDB
Search
Microservices
Mobility
13. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 13
Modern, Distributed Multimodel Architectures Must Be…
Cloud Deployment
Data Storage & Processing
JSON
Documents
Key/Value
Dynamic
Data Model
Auto-
Backup
Cost-based
Optimization
Indexing
Data Access &
Manipulation
ACID SQL
Transaction
s
SQL++
Query
User-Defined
Functions
Operational
Analytics
Full Text
Search
Eventing
Cluster Management
Managed
Cache
Auto-
Sharding
High-
Density
Storage
Multi-
dimensional
Scaling
Geographic
Replication
HA, DR &
Auto-
Failover
Fully Managed DBaaS Bare Metal Instance
Self-Managed
Kubernetes
Virtual Machine
Enterprise
Security
Mobile
Edge
Embeddable
Mobile Lite
Mesh Edge
Syncing
SDKs
&
API
Multimodel SQL++
Data Access
Distributed Cluster Management
Cloud Deployment
Mobile
Edge
JSON Data Organization &
Processing
In-Memory Processing
Fast Flexible Familiar Affordable
14. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 14
Memory-First, Multimodel Architecture
Cloud Deployment
Data Organization & Processing
JSON
Documents
Key/Value
Dynamic
Data Model
Auto-Backup
Cost-based
Optimization
Indexing
Multimodel Data Access & SQL++
ACID SQL
Transactions
SQL++ Query
User-Defined
Functions
Operational
Analytics
Full Text
Search
Eventing
Cluster Management
Managed
Cache
Auto-
Sharding
High-Density
Storage
Multi-dimensional
Scaling
Geographic
Replication
HA, DR &
Auto-Failover
Fully Managed DBaaS Bare Metal Instance
Self-Managed Kubernetes Virtual Machine
Enterprise
Security
Mobile
Edge
Embeddable
Mobile Lite
Mesh Edge
Syncing
SDKs
&
API
Distributed Cluster Management
Cloud Deployment
Mobile
Edge
15. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 15
Modern Database Capabilities that Address these Issues
No ETL, SQL++, MPP
Workload Isolation
Real-time Insights, Fraud
detection, AI,
Recommendation engines
Compare with:
Snowflake, Redshift,
Athena, Hadoop
Full-text Search
Inverted Index
Locations, Log analysis,
Collaboration, Website
Search
Compare with:
Elasticsearch, Solr,
Lucene
Real-Time Analytics
Search Engine
Distributed Locations
& Search
Analytic
Processing
Flexible JSON
SQL for JSON
Content Management,
Catalog, Metadata,
Customer 360
Compare with:
DynamoDB, MongoDB,
CosmosDB
Logical RDBMS Structures
SQL Transactions, UDFs
Retail purchases, Inventory
updates, Shipping
confirmations
Compare with:
Oracle,
Berkeley DB
Document Database Relational Database
Data Model
Flexibilty
SQL, Schema &
Transactions
Flexible Familiar
Sub-millisecond performance
Simplicity & Scalability
Caching, Cart, IOT,
User Profiles & Sessions
Compare with:
Redis, Elasticache,
Aerospike
Key-Value Store
In-memory
Performance
Fast Full-Featured Affordable
16. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 16
High Density Storage Engine | Massive TCO Reduction
Pre Couchbase 7.1 Couchbase 7.1 (High-Density Storage)
STORAGE: 3x more data per node; COMPUTE: 10x Fewer Servers Required, 4x Higher Throughput
Example: 100 TB data, with Couchbase Servers deployed
on m5d.8xlarge (128GB RAM) with storage on EBS
3TB per node
min 10% memory ratio
10 TB per node
min 1% memory ratio
4x faster throughput
100
# of servers required
10
# of servers required
$3 million per year
Annual server cost
$300K per year
Annual server cost
Savings: $2.7M
17. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 17
Advantages for Microservices & CI/CD
Contain the data sprawl first
Cache Documents Query Analytics
Eventing
Transactions Security
LAMP
JAM JAVA MEAN .NET
AWS Stack
Sync
SQL
Search
Mobile
Apps
Cloud & Edge
Zones
Less duplication Easier maintenance Faster release cycles
18. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2022. All rights reserved. 18
3
Familiar as SQL
including ACID
Transactions
19. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 19
Familiar Relational Capabilities such as SQL++
Familiarity of SQL, leveraging skillsets: Developers, Architects, DBAs, Analysts, IT
• Known SQL syntax
• Supporting
• SQL Transactions
• ANSI standards
• JOINs
• Sub-queries
• Nested objects
• Arrays
• User-Defined Functions
• Cost-based optimization
• Common across Query & Analytics Services
20. Confidential and Proprietary. Do not distribute without
Couchbase consent. © Couchbase 2022. All rights reserved. 20
Familiar Structure:
Scopes &
Collections
Multi-level dynamic
data container model
that maps clearly to
RDBMS schema
models, pervasively
incorporated across
Couchbase security,
query, data access
and replication
services.
Collections and Scopes are dynamic,
logical containers within a bucket.
Developers use them to organize
data, map RDBMS models and
isolate schemas.
Administrators use them to
consolidate tenants, and control
access or replication.
• Buckets
• Scopes
• Collections
• Documents
Architects design for replication,
microservices delivery, & enjoy high-
performance indexes, granular
security and improved resource control.
Buckets = Database
Scopes = Schema
Collections = Table
Documents = Rows
21. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2022. All rights reserved. 21
4Distributed Cloud
Deployment
22. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 22
Cloud-Native Database Automation Requirements
Increasing the speed of delivery
of database changes and freeing
developers up to do more value
added work are the key drivers
for automating the delivery of
database changes.
Standardization of Development
and Production Environment.
Standardization of Cloud
Infrastructure. Elastic Scalability and
Cost Effective.
Reduce your DevOps workload by
running an autonomous, fully
managed stateful database
application.
Run manage and scale database
next to microservices applications
as a data service on the same
Kubernetes platform.
DATABASE AUTOMATION
24. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 24
Deploy Everywhere: a Fleet of networked distributed databases
Put data and processing where it needs to be... globally, to the edge and in devices
YOUR
Data
Center
EDGE
Data
Center
• Deploy to the Edge
• Fully offline data access
• Peer–to-peer syncing
Cross Data Center Replication Edge & Mobile
ACTIVE
STAND
-BY
All
data
Data
Subset
All
data
ACTIVE
25. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2022. All rights reserved. 25
5Introducing
Couchbase Capella
26. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 26
Couchbase is An Architecturally Differentiated Platform
Couchbase Managed and Customer-Self Managed Cloud Deployments
Fast Flexible Familiar Affordable Future-proof
• Memory-first design
• Cloud-native scale
• Asynchronous clusters
• HA, DR & backup
• Low latency Cloud 2 Edge
• JSON Document
• Multimodel Services
• Deploy Anywhere
• Multidimensional scaling
• Mobile & Edge ready
• SQL++ query language
• Dynamic Schema
• ACID SQL Transactions
• Cost-based query optimizer
• SDKs for 12+ languages,
including mobile
• Networks of distributed &
mobile databases
• Elastic cluster scaling,
sharding & rebalancing
• Geo-replication via XDCR
• High-density storage
• Fully-managed DBaaS,
w/o cloud lock-in
• Self-managed
Kubernetes
Autonomous Operator
• Predictable
price/performance
27. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 27
Couchbase Capella on AWS
Develop With
Agility Across
Your Use Cases
As Easy
as SQL
Blazing Fast;
the Lowest
TCO at Scale
28. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 28
Free, Easy Self-Service Trial
Be up and running in under 5 minutes
1. Create Account 2. Deploy in Our Cloud 3. Step-by-Step Tutorial
Or we can help you get started if needed
29. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 29
How Databases Compare
FUSION of RDBMS & NoSQL
Flexible:
Flexible Data Model (JSON)
LIMITED
(data type only)
YES YES
Structure on Demand:
Dynamic Containment Model (Scopes & Collections)
LIMITED LIMITED YES
Declarative Query Language:
Complete SQL Capability
YES NO YES
Trustworthy:
ACID Transactions in SQL
YES NO YES
Fast:
Sub-Millisecond Latency
LIMITED NO YES
Scalable:
Elastic Scaling in Clusters
LIMITED LIMITED YES
Price Performance:
How does performance translate into cost of ownership
Expensive Expensive Competitive
Multi-Purpose, Multimodel:
Cache / Key-Value / Relational / Document / Search / Analytics
LIMITED LIMITED YES
Data Locality:
Geo-Replication / XDCR
LIMITED LIMITED YES
Mobility:
Local / Offline / Hierarchal & P2P Sync
NO LIMITED YES
Relational Couchbase
30. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 30
Technical Value
Skills & Resources
• SQL++ imposes no learning curve for most developers, and our dynamic schema with Collections makes for
easy model mapping from old relational to new Couchbase.
• Developer gain efficiencies from Index Advisor and other optimizations like CBO
• Accelerated time to market with CI/CD processes and Kubernetes Automation
Multimodel functional improvements for richer applications
• Better features like geo-search, data streaming and analytic queries within the applications.
High performance and low TCO
• Distributed, Asynchronous Clustering is both very fast, and pushes high availability closer to where the data is
consumed, in the case of geo-distributed clusters.
• Price performance of Couchbase vs. all cloud competitors, is outstanding. From 2 to 5 times faster for
benchmark workloads.
Technical Benefits
Development teams do not need extensive training nor re-tooling, helping accelerate time to market
31. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 31
Couchbase Creates Business Value
Faster Development
• Faster time to market – more efficient development using current resources
• Reduced complexity, and higher quality
• Exceptional node-for-node performance
Customer Satisfaction & Loyalty improvements
• Better features
• Exceptional reliability and availability
• Better personalization
Low Total Cost of Ownership
• No cloud provider lock-in
• Predictable consumption-based pricing model
• Significant savings on database software & infrastructure costs
Business Benefits
Businesses enjoy both Revenue & Cost Savings
32. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2021. All rights reserved. 32
Every Industry will Build Their Own Interconnected Apps
Application Landscape of the Future