Mastering MongoDB in Kubernetes - Amadeus
•
0 j'aime•305 vues
Amadeus recognizes ‘MongoDB Enterprise Operator for Kubernetes’ as valuable integrator Kubernetes and MongoDB Ops Manager
Recommandé
Recommandé
Contenu connexe
Similaire à Mastering MongoDB in Kubernetes - Amadeus
Similaire à Mastering MongoDB in Kubernetes - Amadeus (20)
Plus de MongoDB
Plus de MongoDB (20)
Dernier
Dernier (20)
Mastering MongoDB in Kubernetes - Amadeus
- 1. ©AmadeusITGroupanditsaffiliatesandsubsidiaries Mastering the right K8s Infrastructure to run MongoDB @ Scale Paul Hubert Arkadiusz Boruki
- 3. ©AmadeusITGroupanditsaffiliatesandsubsidiaries Amadeus in a few words 3 _ We are the leading technology company dedicated to the global travel industry _ We are present in 190+ countries and employ 17,000+ people worldwide _ Our solutions enrich travel for billions of people every year _ We work together with our customers, partners and other players in the industry to improve business performance and shape the future of travel 7th consecutive year included in the DJSI Recognized as world leader in the Software & Services industry sector in the Dow Jones Sustainability Index in 2018 In world’s top 10 Software companies Forbes 2018 global rankings 1.6+ billion Passengers boarded in 2017 with Amadeus and Navitaire solutions 630+ million Total bookings processed in 2017 using the Amadeus distribution platform Euro Stoxx 50 Entry in 2018 Recognition as one of the largest/ best performing public companies in Europe
- 4. Enriching every step of the traveler’s journey ©AmadeusITGroupanditsaffiliatesandsubsidiaries 4 On-trip Post-trip Inspire Shop Book Pre-trip
- 5. 300+ Our customers ©AmadeusITGroupanditsaffiliatesandsubsidiaries airport operators ground handlers hotel chains travel agencies, online travel agencies, tour operators and corporations worldwide car rental companies rail operators insurance provider groups cruise and ferry lines airlines 5 90 43 29 53 128 112770
- 6. How travel will grow in the future ©AmadeusITGroupanditsaffiliatesandsubsidiaries 6 WTTC Economic Impact World 2017 Projected growth in global air travel Domestic and international air passengers growth Total contribution of travel & tourism to global GDP (in USD billions) 11,512.9 4.1 in 2017 billion air passenger segments* 7.8 in 2036 billion air passenger segments** 2013 2014 2015 2016 2017 2027 3.9% annual growth *IATA Press Release No.: 70: READ MORE **IATA Press Release No.: 55: READ MORE
- 7. 7 ©AmadeusITGroupanditsaffiliatesandsubsidiaries Airline disruption - soon to be a problem of the past
- 8. ©AmadeusITGroupanditsaffiliatesandsubsidiaries 2. MongoDB and K8s – Infrastructure side
- 9. _System of engagement vs system of records • Shopping experience is key but I need consistency for my booking _Left hand needs to talk to right hand • End to end consistency between my MongoDB instance and the media supporting the persistency _From pets to cattle • Need high level of automation 9 MongoDB and K8s – Drivers for a new Infrastructure
- 10. 10 Chopping Experience! Over 1T availability Request/day 10M availability per sec May 2011 >50B 500K availability request for one booking! years2011 2018 AvailabilityRequests
- 11. _Used to be about (low level details): • LUN size, type of RAID protection, amount of CPU cores … _Nowadays Infrastructure expectation (contract on a service): • HA through Availability Zones and Regions • Contract with SLA and SLO • IO performance and data durability • Charge back • Reporting • Maintenance notification • Self Service Kiosk 11 Left hand needs to talk to right hand – be clear on the Contract
- 12. _The Availability Zone is the smallest ‘Failure Domain’ entity of your service contract but too large entity for infrastructure resiliency unites like clusters (scalability problem and too big to fail) _Data locality is key to control performance and network traffic _Align your db storage engine with the one of your Flash media 12 Left hand needs to talk to right hand – Failure Domain and Performance Cases SDS Abstraction Layers SDN
- 13. _The Availability Zone is the smallest ‘Failure Domain’ entity of your service contract but too large entity for infrastructure resiliency unites like clusters (scalability problem and too big to fail) _Data locality is key to control performance and network traffic _Align your db storage engine with the one of your Flash media 13 Left hand needs to talk to right hand – Failure Domain and Performance Cases SDS Abstraction Layers SDN
- 14. 14 ©AmadeusITGroupanditsaffiliatesandsubsidiaries Infrastructure Workflow – Provisioning Example High level building block perspective Blue print 1 mongo cluster 1 shard 2 replicas
- 15. 15 ©AmadeusITGroupanditsaffiliatesandsubsidiaries Infrastructure Workflow – Provisioning Example High level building block perspective Blue print 1 mongo cluster 1 shard 2 replicas Availability Zone 1 Infrastructure Pod
- 16. Availability Zone 3 Availability Zone 2 16 ©AmadeusITGroupanditsaffiliatesandsubsidiaries Infrastructure Workflow – Provisioning Example High level building block perspective Blue print 1 mongo cluster 1 shard 2 replicas Availability Zone 1 Infrastructure Pod Compute tenant Storage tenant VolumeContainerized App K8s Pod 10.10.10.1
- 17. _As seen the Infrastructure provides through Kiosk or APIs all the means to automate the deployment of your MongoDB cluster following the End User Blue Print and under K8s supervision _Next level of automation is to tackle DBA Management activities: Cluster creation, upgrade, HA/resiliency, Scale-out, backup _Now why we used to develop such an automation through a set of scripts leveraging OPS manager, why don’t Mongo would provide them directly to us via now the de facto industry standard orchestrator K8s 17 Pets to Cattle – Management @ Scale
- 18. ©AmadeusITGroupanditsaffiliatesandsubsidiaries 3. MongoDB and K8s – Enterprise Operators
- 19. _Stateless containers are not good for database! _Since K8s version 1.5 – StatefulSets API object. _StatefulSets are perfect for applications that require the following: Stable, unique network identifiers. Stable, persistent storage. Ordered, automated rolling updates. Ordered, graceful deployment and scaling. 19 Stateful Containers Management @ Scale
- 20. _Controller that extends the Kubernetes API. _K8s and MongoDB Ops Manager integration. _Ops Managers features on K8s cluster! Backup, Automation and Pod’s Monitoring _ Automates the provisioning of StatefulSets for the MongoDB replica set. _ Creates a deployment in MongoDB Ops Manager project. _Automates common tasks, to achieve the desired state. 20 K8S MongoDB Enterprise Operator – Management @ Scale
- 22. 22
- 23. _MongoDbStandalone, _MongoDbReplicaSet, _MongoDbShardedCluster, 23 MongoDB Objects @ K8S MongoDB Enterprise Operator --- apiVersion: mongodb.com/v1 kind: MongoDbShardedCluster metadata: name: London2018 namespace: mongodb spec: shardCount: 2 mongodPerShardCount: 3 mongosCount: 2 configServerCount: 3
- 24. 24
Notes de l'éditeur
- This is a technical presentation but to understand the size and criticality of the case I need to spend like 10 minutes explaining the business Amadeus. We then first go through an overview of the infrastructure principles being used and finally will showcase how we can leverage MongoDB with K8s to execute at the expected scale.
- Amadeus is a technology company dedicated to the world’s travel industry. We offer cutting-edge technology solutions that help key players in the travel industry succeed in their business, and shape the future of travel moving forward. And we do it on a truly global scale. In 2017 Amadeus processed more than 630 million bookings. Together with Navitaire, our systems boarded 1.6 billion passengers. In 2017, Forbes magazine recognized us as one of the world’s top 15 software companies, and Amadeus has been included to the Dow Jones Sustainability Index for five years in a row. We are the only travel technology company in the 2017 DJSI - a key recognition of our commitment to business sustainability, environmental and social practices in all of our operations.
- We design our solutions around not only our customers’ needs but also their customers’ needs. Right from the first moment of the traveller life-cycle from looking for inspiration for travel possibilities through to shopping, booking and then pre, on and post-trip. At all stages of the travel experience our solutions help our customers deliver better service to travellers. We continuously conduct extensive research to better understand traveller trends in the future. We recently worked with the Future Foundation to develop the Future Traveller Tribes study, which identifies the traveller segments that will shape the future of travel, and advises travel businesses on how to meet their needs. We are also conducting research into accessible travel, to explore how travel businesses can meet the needs of growing numbers of people traveling with specialized requirements. (HERE YOU CAN MENTION SOME OF OUR SOLUTIONS BY THE CATEGORIES IN THE TRAVELLER LIFE CYCLE ILLUSTRATION - AS APPROPRIATE TO YOUR AUDIENCE)
- We serve every part of the global travel ecosystem. Amadeus’ customers include travel agencies, both online and offline, focused on leisure travel and business travel, and corporations themselves; airlines, airports, ground handlers, hospitality businesses, railway and car rental companies, tour operators, insurance provider groups, insurance companies, ferry & cruise lines and other businesses involved in global travel.
- And all of this is still just the beginning. Travel is a high-growth industry, driven by three key factors: an increasing world population, the emerging middle class in growing countries and overall GDP growth. Historically these are the factors that have driven global travel industry growth, and leading industry associations project significant growth in travel volume and in the impact of the travel & tourism industry on the global economy.
- A detailed perspective on how K8s and MongoDB coordinate themselves is provided few slides later
- A detailed perspective on how K8s and MongoDB coordinate themselves is provided few slides later
- A detailed perspective on how K8s and MongoDB coordinate themselves is provided few slides later
- So we encourage you to come and shape the future of travel with us. We want to engage with you in dialogue around how we can advance travel together and make the future of travel better for everyone. Thanks for joining us today and we look forward to working with you to move travel forward.