Kubernetes & Redis: Aparna Sinha
9 May 2019•0 j'aime•131 vues
Télécharger pour lire hors ligne
Signaler
Technologie
RedisConf19
Redis LabsSuivre
Recommandé
Securing APIs for ultimate security and privacy with Azure | Codit WebinarCodit
Next Generation of Data Integration with Azure Data Factory by Tom KerkhoveCodit
Extending Operations from On-premises Solutions Towards Hybrid and Cloud - Da...Codit
Getting started with IoTCodit
Application Autoscaling Made Easy with Kubernetes Event-Driven Autoscaling (K...Codit
IBM Tivoli - Security Solutions for the CloudVincent Kwon
Contenu connexe
Tendances
Infrastructure monitoring made easy, from ingest to insightElasticsearch
The role of integration in your cloud-native transformation (Richard Seroter ...Codit
Bandwidth: Use Cases for Elastic Cloud on Kubernetes Elasticsearch
Microsoft Azure - the worlds computerLee Welch
Microsoft azure - Building the worlds computerLee Welch
KeynoteElasticsearch
Similaire à Kubernetes & Redis: Aparna Sinha
Microsoft: Enterprise search for cloud native applicationsElasticsearch
Cloud for Kubernetes : Session4WhaTap Labs
Codemotion DevCast: App Modernization in the CloudLorenzo Barbieri
CI and CD with SpinnakerVMware Tanzu
Moving Beyond Migration: Reinventing Process in the CloudPeter Coffee
OpsRamp Spring Release Webinar | May 2021OpsRamp
![[2017년 5월 정기세미나] IBM에서 바라보는 OpenStack 이야기](https://cdn.slidesharecdn.com/ss_thumbnails/ibmbmxprivatecloudopenstackcommunity0524final-170530050505-thumbnail.jpg?width=1600&height=908&fit=bounds)
![[OpenInfra Days Vietnam 2019] Innovation with open sources and app modernizat...](https://cdn.slidesharecdn.com/ss_thumbnails/innovationwithopensourcesandappmodernizationfordevelopers-dist-190824044544-thumbnail.jpg?width=1600&height=908&fit=bounds)
Plus de Redis Labs
Redis Day Bangalore 2020 - Session state caching with redisRedis Labs
Protecting Your API with Redis by Jane Paek - Redis Day Seattle 2020Redis Labs
The Happy Marriage of Redis and Protobuf by Scott Haines of Twilio - Redis Da...Redis Labs
SQL, Redis and Kubernetes by Paul Stanton of Windocks - Redis Day Seattle 2020Redis Labs
Rust and Redis - Solving Problems for Kubernetes by Ravi Jagannathan of VMwar...Redis Labs
Redis for Data Science and Engineering by Dmitry Polyakovsky of OracleRedis Labs
Dernier
How to reduce expenses on monitoringRomanKhavronenko
Understanding Wireguard, TLS and Workload IdentityChristian Posta
Webhook Testing StrategyDimpy Adhikary
Chandrayaan 3.pptxPrasunJha12
"The Intersection of architecture and implementation", Mark RichardsFwdays
Product Listing Presentation-Maidy Veloso.pptxMaidyVeloso
Kubernetes & Redis: Aparna Sinha
- 2. Redis is the most loved database Kubernetes is the Linux of the cloud
- 3. 5,000 Projects based on Kubernetes 1,250 Contributors <0.01% Top GitHub project 54% Fortune 100 companies use Kubernetes Kubernetes job postings increase (Sep’17-’18) 230% 108 companies dedicated to training and distributing Source: landscape.cncf.io https://www.theregister.co.uk/2018/11/29/kubernetes_verilog_job_seekers/
- 5. Over 40% of GKE clusters run stateful applications Machine Learning Redis is one of the most heavily used datastore on Kubernetes Engine in Google Cloud Postgres MySQL Redis Batch Web Services
- 8. On Premises Hybrid Cloud Portability
- 9. Versatility Leaderboard, Gaming Read-heavy dashboard Real-time transactions, sensor analytics Chat, News feed Sorted set Lists, SetsStreamsLists, Sorted sets and hashes
- 10. Retail BankingMedia IoT/Industrial Manufacturing Versatility
- 11. Extending Kubernetes Deploy Scale Upgrade Defines a custom resource Custom controller Deploys in your cluster and extends Kubernetes API
- 12. Kubectl yam l Kubernetes Control Plane Kubernetes Operator Persistent Volume Claim Persistent Volume Claim Persistent Volume Claim Pod Pod Pod Persistent Disk Persistent Disk Persistent Disk Automating Redis Cluster Operations Get started with Redis Cluster in <10 mins!
- 13. Demo Redis operator on Google Kubernetes Engine
- 14. Do more with Redis on Google Kubernetes
- 15. To learn more go to: Cloud Memorystore Memorystore is now supporting Redis version 4.0 and manual failover API Talks / Google Cloud booth
- 16. Thank you
Notes de l'éditeur
- Good morning everybody! I’m really excited to talk to you about two of the most popular technologies in use today: Redis and Kubernetes.
- You all know that Redis was voted the most loved database on Stack Overflow surveys consecutively for the last two years, and it is ranked the most popular key-value database by DB-Engines and others. Kubernetes is not looking too shabby either. Some are calling it the ‘Linux of the Cloud’, as a sort of operating system for distributed computing. At Google we’ve used predecessors of this technology for decades so it is natural
- But externally too Kubernetes is seeing strong momentum. It’s in the top 0.01% of GitHub projects, 54% of Fortune 100 companies appear to be using it, and jobs, training and contributions are all growing.
- To be honest, developers don’t really choose their tools based on statistics. So I asked GKE users why do they use Kubernetes, and they tell me it does a few things unexpectedly well. #1. Kubernetes improves resource utilization, through efficient bin packing and auto-scaling. This saves you money. In fact on GKE, Google’s hosted Kubernetes offering, the majority of large clusters use cluster autoscaling saving upto 40% in costs over static placement. And we have recently added new dimensions and greater automation. #2. Kubernetes increases reliability. This saves your sanity. Again through a combination of monitoring, remediation, and a host of security features. On GKE for example we provide auto-repair and SRE monitoring for a more secure and reliable experience. #3. Kubernetes improves developer productivity. Developers are able to release many times a day. This is a top line benefit. Lastly it provides a consistent environment for running applications across any infrastructure
- Kubernetes does these things so well that people want to run more and more applications on Kubernetes across industries. Containers and GKE started with stateless web services and were found to be really good also for batch applications On GKE, we have seen rapid growth in a larger variety of applications. For example ML usage on GKE has exploded since we automated provisioning and scaling of GPUs And over 40% of clusters on GKE are stateful (slide 7). This includes Redis, Elastic, Postgres, MySQL, Cassandra and many other databases. Infact, Redis is the MOST commonly used data-store on K8S.
- So why are people using Redis with their Kubernetes applications on Google Cloud? Well, both have a few things in common Speed Portability Versatility
- Speed Both Redis and Kubernetes are cloud native, they enable fast scaling and rapid iteration Developers deploy 100s of times a day with Kubernetes and you need a datastore that complements this WIth Redis you can change the way you use your data and its contents as fast as you change your application because data is in memory
- Redis is portable because its a simple C application running on linux. Anywhere you turn up linux you can you can run Redis. Google is the open cloud. We have a long history of building and contributing to open source software. So its no surprise that Kubernetes is a management stack that can go anywhere containers can. The freedom to deploy apps on-prem, in hybrid or multi-cloud environments lets you choose based on the merits of the underlying cloud and also make changes as your business evolves. Perhaps the salient point is that Redis is frequently run on K8S e.g., on GKE. This lets users manage it easily and consistently anywhere.
- Versatility: Redis [can build so much with it] Redis is known as the Swiss army knife of the internet: messaging, caching, queuing.
- Versatility: Today Kubernetes is used across industries and for a variety of applications eBay for shopbot and Google Assistant NYT for ML article recommendations Philips HUE with Redis cache for IoT lights HSBC for mobile banking Also frequently for gaming and social media applications It is easy to see the overlap in types of applications that Kubernetes is used for and those that Redis is best for. Given this overlap it’s no wonder there is strong interest in making Redis easier to manage on Kubernetes.
- Kubernetes extensibility is very much a conscious decision: We are moving away from built-in types to resource definitions that are extensible. They develop CRDs and controllers that are application specific those describe the resources the cluster needs to talk about the application. CR = declarative intent of what you want the infra to be. CRD = what’s permissible; the metadata for the CR Controller = you write to realize the declarative intent to realize the user intent The combination of a CR + CRD is called an operator. Kubernetes extensibility allows various applications to be run using Operators. Normally an ‘operator’ is a person who operates your application. They deploy, scale, upgrade and manage the app. Kubernetes Operators do the same thing. Now lets look at a Redis Operator and how it helps you.
- What does Redis operator do? Turning up a Redis cluster takes time - start Redis, modify config to form cluster, deploy Sentinel, modify clients OR install Redis cluster and setup config to form a cluster. Won’t autoscale… On K8S scaling is trivial, process remediation is trivial. It does all the provisioning of compute, networking and storage for the cluster dynamically. If nodes / pods fail it keeps the infrastructure highly available. The operator stands up a Redis cluster quickly, without much manual effort.. Don’t have to provision infra or storage all based on declared intent. If I kill one, it just comes back. Attached to same storage and data is still there. Makes redis more production ready so you can use it for a broader set of use cases.
- Let’s see a demo Here we have a Kubernetes cluster in Google cloud through our hosted service GKE I’m connected to it. Now I’m going to create a CRD Now I’m going to create the operator that uses the CRD Now any developer that wants to can create their own redis cluster using Kubectl on GKE Then I’ll create a redis cluster directly from Kubectl Now the redis cluster is being created.
- As you saw, K8S makes Redis more reliable, scalable, and easier to manage, and because users are using Kubernetes for many different applications, I think we will all be doing more with Redis on K8S.
- You all know that Redis was voted the most loved database on Stack Overflow surveys for consecutively for the last two years, and it is ranked the most popular key-value database by DB-Engines and others. Kubernetes is not looking too shabby either. (Which is partly why I’m here). Some are calling it the ‘Linux of the Cloud’.
- But developers don’t really choose their tools based on statistics. Users tell me Kubernetes is useful because it does a few things unexpectedly well. #1. Kubernetes improves resource utilization, through efficient bin packing and auto-scaling. This saves you money. In fact on GKE, Google’s hosted Kubernetes offering, the majority of large clusters use cluster autoscaling saving upto 40% in costs over static placement. And we have recently added new dimensions and greater automation. #2. Kubernetes increase reliability. This saves your sanity. Again through a combination of monitoring, remediation, and a host of security features. On GKE for example #3. Kubernetes improves developer productivity. Developers are able to release many times a day. ANd this is a top line benefit. Lastly it provides a consistent environment for running applications across any infrastructure
- Versatility: Today Kubernetes is used across industries and for a variety of applications NYT / Bloomberg for ML article recommendations Philips HUE with Redis cache for IoT lights eBay for shopbot and Google Assistant HSBC for mobile banking Also frequently for gaming and social media applications Niantic gaming Snap for social / elastic search It is easy to see the overlap in types of applications that Kubernetes is used for and those that Redis is best for. Given this overlap its no wonder there is strong interest in making Redis easier to manage on Kubernetes.
- Versatility: Today Kubernetes is used across industries and for a variety of applications NYT / Bloomberg for ML article recommendations Philips HUE with Redis cache for IoT lights eBay for shopbot and Google Assistant HSBC for mobile banking Also frequently for gaming and social media applications Niantic gaming Snap for social / elastic search It is easy to see the overlap in types of applications that Kubernetes is used for and those that Redis is best for. Given this overlap its no wonder there is strong interest in making Redis easier to manage on Kubernetes.
- What does Redis operator do? Turning up a Redis cluster takes time - start Redis, modify config to form cluster, deploy Sentinel, modify clients OR install Redis cluster and setup config to form a cluster. Won’t autoscale… On K8S scaling is trivial, process remediation is trivial. The operator stands up a Redis cluster quickly, without much manual effort.. Don’t have to provision infra or storage all based on declared intent. If I kill one, it just comes back. Attached to same storage and data is still there. Makes redis more production ready so you can use it for a broader set of use cases.