SlideShare une entreprise Scribd logo
1  sur  10
Scylla DB on GCP:
2 ½ years in production
Steeve Morin, software engineer
Jean-Baptiste Dalido, head of infrastructure
Presenters
Steeve Morin, software engineer
Hacking since the 90’s. Skydiver.
Jean-Baptiste Dalido, head of infrastructure
Hacking since the 00’s. Motorcycle enthusiast.
Meet
Zenly makes it fun & easy to know what
friends & family are up to.
We believe that making maps more
social and personalized is an
opportunity to improve the way people
live, communicate and spend time
together.
50+ team members based in Paris.
ScyllaDB usage at Zenly
In 2 years:
■ 10x more ops/s: 300k/s to 3.3M/s
● 1.9M reads/s
● 1.4M writes/s
■ 2x more nodes: 27 to 50 nodes
● But from 10 to 32 cores/node
● 270 to 1600 cores
■ 4x more storage: 15TB to 59TB
Google Kubernetes Engine: why not
Wanna stick with default setup:
Pros:
■ GKE nodes auto repair/upgrade
■ Default GKE setup is nice
● Network
● Logs
■ Rolling updates
Google Kubernetes Engine: why not
Cons:
■ Auto upgrade means losing nodes every day
● Which means repairs...
■ Network is expensive because Docker
■ Not leveraging autoscaling
● HPA, VPA
■ Auto upgrade means losing
■ CPU pinning is not easy to manage with “classical” neighbours
→ Not worth it in the end
GCP Network
Very happy so far:
■ Only two problems in the last 2 ½ years
● One was a Google software update gone wrong, took down lots of big players
■ Inter-zone network is very expensive
● Careful when considering multi-DC clusters
Evolution of instance types
We went from custom-standard-10 (10 cores) to n1-standard-32 (32 cores):
■ More shards per node
■ Sweet spot for good disk efficiency
■ Considering moving to c2 or n2 instances
● c2: 40% more performance
● n2: 10-15% more performance
● No cost analysis yet
Instance configuration
Instances are configured with:
■ 3 local NVMe SSDs in RAID 0
■ Ubuntu 18.04 LTS
■ Kernel linux-gcp 4.15.0.1029
● Major issues with NVMe on more recent ones
● Stay on =< 1029 for now
● THANK YOU GLAUBER AND SUPPORT TEAM <3
Thank you Stay in touch
Any questions?
Steeve Morin
steeve@zen.ly
@steeve
Jean-Baptiste Dalido
jb@zen.ly
@jbaptistedalido

Contenu connexe

Plus de ScyllaDB

Plus de ScyllaDB (20)

Database Performance at Scale Masterclass: Driver Strategies by Piotr Sarna
Database Performance at Scale Masterclass: Driver Strategies by Piotr SarnaDatabase Performance at Scale Masterclass: Driver Strategies by Piotr Sarna
Database Performance at Scale Masterclass: Driver Strategies by Piotr Sarna
 
Replacing Your Cache with ScyllaDB
Replacing Your Cache with ScyllaDBReplacing Your Cache with ScyllaDB
Replacing Your Cache with ScyllaDB
 
Powering Real-Time Apps with ScyllaDB_ Low Latency & Linear Scalability
Powering Real-Time Apps with ScyllaDB_ Low Latency & Linear ScalabilityPowering Real-Time Apps with ScyllaDB_ Low Latency & Linear Scalability
Powering Real-Time Apps with ScyllaDB_ Low Latency & Linear Scalability
 
7 Reasons Not to Put an External Cache in Front of Your Database.pptx
7 Reasons Not to Put an External Cache in Front of Your Database.pptx7 Reasons Not to Put an External Cache in Front of Your Database.pptx
7 Reasons Not to Put an External Cache in Front of Your Database.pptx
 
Getting the most out of ScyllaDB
Getting the most out of ScyllaDBGetting the most out of ScyllaDB
Getting the most out of ScyllaDB
 
NoSQL Database Migration Masterclass - Session 2: The Anatomy of a Migration
NoSQL Database Migration Masterclass - Session 2: The Anatomy of a MigrationNoSQL Database Migration Masterclass - Session 2: The Anatomy of a Migration
NoSQL Database Migration Masterclass - Session 2: The Anatomy of a Migration
 
NoSQL Database Migration Masterclass - Session 3: Migration Logistics
NoSQL Database Migration Masterclass - Session 3: Migration LogisticsNoSQL Database Migration Masterclass - Session 3: Migration Logistics
NoSQL Database Migration Masterclass - Session 3: Migration Logistics
 
NoSQL Data Migration Masterclass - Session 1 Migration Strategies and Challenges
NoSQL Data Migration Masterclass - Session 1 Migration Strategies and ChallengesNoSQL Data Migration Masterclass - Session 1 Migration Strategies and Challenges
NoSQL Data Migration Masterclass - Session 1 Migration Strategies and Challenges
 
ScyllaDB Virtual Workshop
ScyllaDB Virtual WorkshopScyllaDB Virtual Workshop
ScyllaDB Virtual Workshop
 
DBaaS in the Real World: Risks, Rewards & Tradeoffs
DBaaS in the Real World: Risks, Rewards & TradeoffsDBaaS in the Real World: Risks, Rewards & Tradeoffs
DBaaS in the Real World: Risks, Rewards & Tradeoffs
 
Build Low-Latency Applications in Rust on ScyllaDB
Build Low-Latency Applications in Rust on ScyllaDBBuild Low-Latency Applications in Rust on ScyllaDB
Build Low-Latency Applications in Rust on ScyllaDB
 
NoSQL Data Modeling 101
NoSQL Data Modeling 101NoSQL Data Modeling 101
NoSQL Data Modeling 101
 
Top NoSQL Data Modeling Mistakes
Top NoSQL Data Modeling MistakesTop NoSQL Data Modeling Mistakes
Top NoSQL Data Modeling Mistakes
 
NoSQL Data Modeling Foundations — Introducing Concepts & Principles
NoSQL Data Modeling Foundations — Introducing Concepts & PrinciplesNoSQL Data Modeling Foundations — Introducing Concepts & Principles
NoSQL Data Modeling Foundations — Introducing Concepts & Principles
 
Optimizing Performance in Rust for Low-Latency Database Drivers
Optimizing Performance in Rust for Low-Latency Database DriversOptimizing Performance in Rust for Low-Latency Database Drivers
Optimizing Performance in Rust for Low-Latency Database Drivers
 
Overcoming Media Streaming Challenges with NoSQL
Overcoming Media Streaming Challenges with NoSQLOvercoming Media Streaming Challenges with NoSQL
Overcoming Media Streaming Challenges with NoSQL
 
How Optimizely (Safely) Maximizes Database Concurrency.pdf
How Optimizely (Safely) Maximizes Database Concurrency.pdfHow Optimizely (Safely) Maximizes Database Concurrency.pdf
How Optimizely (Safely) Maximizes Database Concurrency.pdf
 
How Development Teams Cut Costs with ScyllaDB.pdf
How Development Teams Cut Costs with ScyllaDB.pdfHow Development Teams Cut Costs with ScyllaDB.pdf
How Development Teams Cut Costs with ScyllaDB.pdf
 
Learning Rust the Hard Way for a Production Kafka + ScyllaDB Pipeline
Learning Rust the Hard Way for a Production Kafka + ScyllaDB PipelineLearning Rust the Hard Way for a Production Kafka + ScyllaDB Pipeline
Learning Rust the Hard Way for a Production Kafka + ScyllaDB Pipeline
 
NoSQL at Scale: Proven Practices & Pitfalls
NoSQL at Scale: Proven Practices & PitfallsNoSQL at Scale: Proven Practices & Pitfalls
NoSQL at Scale: Proven Practices & Pitfalls
 

Dernier

Dernier (20)

The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 

Zenly Shares Best Practices for Running ScyllaDB on GCP

  • 1. Scylla DB on GCP: 2 ½ years in production Steeve Morin, software engineer Jean-Baptiste Dalido, head of infrastructure
  • 2. Presenters Steeve Morin, software engineer Hacking since the 90’s. Skydiver. Jean-Baptiste Dalido, head of infrastructure Hacking since the 00’s. Motorcycle enthusiast.
  • 3. Meet Zenly makes it fun & easy to know what friends & family are up to. We believe that making maps more social and personalized is an opportunity to improve the way people live, communicate and spend time together. 50+ team members based in Paris.
  • 4. ScyllaDB usage at Zenly In 2 years: ■ 10x more ops/s: 300k/s to 3.3M/s ● 1.9M reads/s ● 1.4M writes/s ■ 2x more nodes: 27 to 50 nodes ● But from 10 to 32 cores/node ● 270 to 1600 cores ■ 4x more storage: 15TB to 59TB
  • 5. Google Kubernetes Engine: why not Wanna stick with default setup: Pros: ■ GKE nodes auto repair/upgrade ■ Default GKE setup is nice ● Network ● Logs ■ Rolling updates
  • 6. Google Kubernetes Engine: why not Cons: ■ Auto upgrade means losing nodes every day ● Which means repairs... ■ Network is expensive because Docker ■ Not leveraging autoscaling ● HPA, VPA ■ Auto upgrade means losing ■ CPU pinning is not easy to manage with “classical” neighbours → Not worth it in the end
  • 7. GCP Network Very happy so far: ■ Only two problems in the last 2 ½ years ● One was a Google software update gone wrong, took down lots of big players ■ Inter-zone network is very expensive ● Careful when considering multi-DC clusters
  • 8. Evolution of instance types We went from custom-standard-10 (10 cores) to n1-standard-32 (32 cores): ■ More shards per node ■ Sweet spot for good disk efficiency ■ Considering moving to c2 or n2 instances ● c2: 40% more performance ● n2: 10-15% more performance ● No cost analysis yet
  • 9. Instance configuration Instances are configured with: ■ 3 local NVMe SSDs in RAID 0 ■ Ubuntu 18.04 LTS ■ Kernel linux-gcp 4.15.0.1029 ● Major issues with NVMe on more recent ones ● Stay on =< 1029 for now ● THANK YOU GLAUBER AND SUPPORT TEAM <3
  • 10. Thank you Stay in touch Any questions? Steeve Morin steeve@zen.ly @steeve Jean-Baptiste Dalido jb@zen.ly @jbaptistedalido