SlideShare une entreprise Scribd logo

Scaling hotstar.com for 10 million concurrent viewers

•Télécharger en tant que PPTX, PDF•
•
AWS User Group Bengaluru
AWS User Group Bengaluru

Talk by Gaurav Kamboj, Cloud Architect at Hotstar on the topic "Scaling hotstar.com for 10 million concurrent viewers - challenges & learnings" at AWS Community Day Bengaluru 2018

Technologie
1  sur  10
Scaling Hotstar.com for 10Mn concurrency CHALLENGES & LEARNINGS Gaurav Kamboj Cloud Architect at Hotstar
Let’s talk about Scale! 10Mn+ PEAK CONCURRENCY DURING VIVO IPL FINAL 5.7 Tbps PEAK BANDWIDTH CONSUMPTION 1Mn PEAK REQUESTS PER SECOND 10Bn+ CLICKSTREAM MESSAGES 100+ HOURS OF LIVE TRANSCODING EVERYDAY
Game Day FACE THE REAL GAME BEFORE THE ACTUAL GAME 36,000 CPUs 80 Gbps NETWORK OUT 72 TB RAM 8 REGIONS GEO DISTRIBUTED Project HULK ● Load Generation ● Performance & Tsunami Tests ● Chaos Engineering ● Traffic Pattern using ML
Race against time! + 500K GROWTH RATE PER MINUTE (CONCURRENCY) FULLY BAKED AMIs 4 mins APPLICATION BOOT-UP TIME 90 SECONDS REACTION TIME PUSH NOTIFICATIONS
Why we don’t use autoscaling INSUFFICIENT CAPACITY ERRORS GAME OF (AVAILABILITY) ZONES STEP SIZE AUTOSCALING GROUPS
Others challenges.. SINGLE INSTANCE TYPE PER AUTO SCALING GROUP API THROTTLING RETRIES & EXPONENTIAL BACKOFF
PREWARM INFRA BEFORE MATCH TIME PROACTIVE SCALE UP WITH BUFFER FOR SPIKES SECONDARY AUTO SCALING GROUP SPOT FLEET DIVERSIFIED INSTANCE TYPES Battle tested scaling strategy!
MACHINE LEARNING BASED AUTO SCALING Future.. IPL 2019 onwards INTELLIGENT SCALE UP DECISIONS RUN IPL & WORLD CUP 2019 ON AUTO PILOT MODE
tech.hotstar.com

Recommandé

OpenSim の使い方 （動作確認編）
OpenSim の使い方 （動作確認編）OpenSim の使い方 （動作確認編）
OpenSim の使い方 （動作確認編）Yuichi Kurita
 
Techman ros package
Techman ros package Techman ros package
Techman ros package KoheiMoriguchi
 
100年先につながる新しい価値を目指して、パナソニックが100BANCHをつくった理由
100年先につながる新しい価値を目指して、パナソニックが100BANCHをつくった理由100年先につながる新しい価値を目指して、パナソニックが100BANCHをつくった理由
100年先につながる新しい価値を目指して、パナソニックが100BANCHをつくった理由loftwork
 
オープンデータとオープンソースGisを用いたweb上でのインタラクティブ可視化手法について
オープンデータとオープンソースGisを用いたweb上でのインタラクティブ可視化手法についてオープンデータとオープンソースGisを用いたweb上でのインタラクティブ可視化手法について
オープンデータとオープンソースGisを用いたweb上でのインタラクティブ可視化手法についてRyousuke Wayama
 
技術を本にして売る、という仕事
技術を本にして売る、という仕事技術を本にして売る、という仕事
技術を本にして売る、という仕事Keiichiro Shikano
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial IntelligenceMegha Jain
 
OpenSim の 使い方 （IK 編）
OpenSim の 使い方 （IK 編）OpenSim の 使い方 （IK 編）
OpenSim の 使い方 （IK 編）Yuichi Kurita
 
Autonomic Computing: Vision or Reality - Presentation
Autonomic Computing: Vision or Reality - PresentationAutonomic Computing: Vision or Reality - Presentation
Autonomic Computing: Vision or Reality - PresentationIvo Neskovic
 

Recommandé

OpenSim の使い方 （動作確認編）
OpenSim の使い方 （動作確認編）OpenSim の使い方 （動作確認編）
OpenSim の使い方 （動作確認編）Yuichi Kurita
 
Techman ros package
Techman ros package Techman ros package
Techman ros package KoheiMoriguchi
 
100年先につながる新しい価値を目指して、パナソニックが100BANCHをつくった理由
100年先につながる新しい価値を目指して、パナソニックが100BANCHをつくった理由100年先につながる新しい価値を目指して、パナソニックが100BANCHをつくった理由
100年先につながる新しい価値を目指して、パナソニックが100BANCHをつくった理由loftwork
 
オープンデータとオープンソースGisを用いたweb上でのインタラクティブ可視化手法について
オープンデータとオープンソースGisを用いたweb上でのインタラクティブ可視化手法についてオープンデータとオープンソースGisを用いたweb上でのインタラクティブ可視化手法について
オープンデータとオープンソースGisを用いたweb上でのインタラクティブ可視化手法についてRyousuke Wayama
 
技術を本にして売る、という仕事
技術を本にして売る、という仕事技術を本にして売る、という仕事
技術を本にして売る、という仕事Keiichiro Shikano
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial IntelligenceMegha Jain
 
OpenSim の 使い方 （IK 編）
OpenSim の 使い方 （IK 編）OpenSim の 使い方 （IK 編）
OpenSim の 使い方 （IK 編）Yuichi Kurita
 
Autonomic Computing: Vision or Reality - Presentation
Autonomic Computing: Vision or Reality - PresentationAutonomic Computing: Vision or Reality - Presentation
Autonomic Computing: Vision or Reality - PresentationIvo Neskovic
 
OpenSim の 使い方 （Static optimization 編）
OpenSim の 使い方 （Static optimization 編） OpenSim の 使い方 （Static optimization 編）
OpenSim の 使い方 （Static optimization 編） Yuichi Kurita
 
古典プログラマ向け量子プログラミング入門 [フル版]
古典プログラマ向け量子プログラミング入門 [フル版]古典プログラマ向け量子プログラミング入門 [フル版]
古典プログラマ向け量子プログラミング入門 [フル版]OsSAL
 
Artificial Intelligence (AI) in media applications and services
Artificial Intelligence (AI) in media applications and servicesArtificial Intelligence (AI) in media applications and services
Artificial Intelligence (AI) in media applications and servicesFörderverein Technische Fakultät
 
Lecture 8 Introduction to Augmented Reality
Lecture 8 Introduction to Augmented RealityLecture 8 Introduction to Augmented Reality
Lecture 8 Introduction to Augmented RealityMark Billinghurst
 
The스프라이트
The스프라이트The스프라이트
The스프라이트Hong-Gi Joe
 
会社に Github導入した話
会社に Github導入した話会社に Github導入した話
会社に Github導入した話Yutaka Kinjyo
 
すだちハッカソン発表資料
すだちハッカソン発表資料すだちハッカソン発表資料
すだちハッカソン発表資料Eigoro Yamamura
 
Applying AI in Games (GDC2019)
Applying AI in Games (GDC2019)Applying AI in Games (GDC2019)
Applying AI in Games (GDC2019)Jun Okumura
 
Scaling Deep Learning
Scaling Deep LearningScaling Deep Learning
Scaling Deep LearningIntel® Software
 
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...OdessaJS Conf
 
Mining crypto in browser as a bleeding edge performance challenge for the Web...
Mining crypto in browser as a bleeding edge performance challenge for the Web...Mining crypto in browser as a bleeding edge performance challenge for the Web...
Mining crypto in browser as a bleeding edge performance challenge for the Web...Denis Radin
 
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...Maria Kuneva
 
BGF 2012 (Browsergames Forum)
BGF 2012 (Browsergames Forum)BGF 2012 (Browsergames Forum)
BGF 2012 (Browsergames Forum)Christof Wegmann
 
GPU Technology Conference 2014 Keynote
GPU Technology Conference 2014 KeynoteGPU Technology Conference 2014 Keynote
GPU Technology Conference 2014 KeynoteNVIDIA
 
JITServerTalk-OSS-2023.pdf
JITServerTalk-OSS-2023.pdfJITServerTalk-OSS-2023.pdf
JITServerTalk-OSS-2023.pdfRichHagarty
 
GTC 2022 Keynote
GTC 2022 KeynoteGTC 2022 Keynote
GTC 2022 KeynoteAlison B. Lowndes
 
Rollup-as-a-service and why it matters to the next-gen of dApps
Rollup-as-a-service and why it matters to the next-gen of dAppsRollup-as-a-service and why it matters to the next-gen of dApps
Rollup-as-a-service and why it matters to the next-gen of dAppsTinaBregovi
 
Gluecon 2013 netflix api crash course
Gluecon 2013 netflix api crash courseGluecon 2013 netflix api crash course
Gluecon 2013 netflix api crash courseBenjamin Schmaus
 
GDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas Trudel
GDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas TrudelGDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas Trudel
GDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas TrudelUmbra Software
 
Advanced #4 GPU & Animations
Advanced #4 GPU & AnimationsAdvanced #4 GPU & Animations
Advanced #4 GPU & AnimationsVitali Pekelis
 
Gömülü Sistemlerde Derin Öğrenme Uygulamaları
Gömülü Sistemlerde Derin Öğrenme UygulamalarıGömülü Sistemlerde Derin Öğrenme Uygulamaları
Gömülü Sistemlerde Derin Öğrenme UygulamalarıFerhat Kurt
 
Getting The Most Out of VR | Sinjin Bain
Getting The Most Out of VR | Sinjin BainGetting The Most Out of VR | Sinjin Bain
Getting The Most Out of VR | Sinjin BainJessica Tams
 

Contenu connexe

Tendances

OpenSim の 使い方 （Static optimization 編）
OpenSim の 使い方 （Static optimization 編） OpenSim の 使い方 （Static optimization 編）
OpenSim の 使い方 （Static optimization 編） Yuichi Kurita
 
古典プログラマ向け量子プログラミング入門 [フル版]
古典プログラマ向け量子プログラミング入門 [フル版]古典プログラマ向け量子プログラミング入門 [フル版]
古典プログラマ向け量子プログラミング入門 [フル版]OsSAL
 
Artificial Intelligence (AI) in media applications and services
Artificial Intelligence (AI) in media applications and servicesArtificial Intelligence (AI) in media applications and services
Artificial Intelligence (AI) in media applications and servicesFörderverein Technische Fakultät
 
Lecture 8 Introduction to Augmented Reality
Lecture 8 Introduction to Augmented RealityLecture 8 Introduction to Augmented Reality
Lecture 8 Introduction to Augmented RealityMark Billinghurst
 
The스프라이트
The스프라이트The스프라이트
The스프라이트Hong-Gi Joe
 
会社に Github導入した話
会社に Github導入した話会社に Github導入した話
会社に Github導入した話Yutaka Kinjyo
 
すだちハッカソン発表資料
すだちハッカソン発表資料すだちハッカソン発表資料
すだちハッカソン発表資料Eigoro Yamamura
 

Tendances (7)

OpenSim の 使い方 （Static optimization 編）
OpenSim の 使い方 （Static optimization 編） OpenSim の 使い方 （Static optimization 編）
OpenSim の 使い方 （Static optimization 編）
 
古典プログラマ向け量子プログラミング入門 [フル版]
古典プログラマ向け量子プログラミング入門 [フル版]古典プログラマ向け量子プログラミング入門 [フル版]
古典プログラマ向け量子プログラミング入門 [フル版]
 
Artificial Intelligence (AI) in media applications and services
Artificial Intelligence (AI) in media applications and servicesArtificial Intelligence (AI) in media applications and services
Artificial Intelligence (AI) in media applications and services
 
Lecture 8 Introduction to Augmented Reality
Lecture 8 Introduction to Augmented RealityLecture 8 Introduction to Augmented Reality
Lecture 8 Introduction to Augmented Reality
 
The스프라이트
The스프라이트The스프라이트
The스프라이트
 
会社に Github導入した話
会社に Github導入した話会社に Github導入した話
会社に Github導入した話
 
すだちハッカソン発表資料
すだちハッカソン発表資料すだちハッカソン発表資料
すだちハッカソン発表資料
 

Similaire à Scaling hotstar.com for 10 million concurrent viewers

Applying AI in Games (GDC2019)
Applying AI in Games (GDC2019)Applying AI in Games (GDC2019)
Applying AI in Games (GDC2019)Jun Okumura
 
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...OdessaJS Conf
 
Mining crypto in browser as a bleeding edge performance challenge for the Web...
Mining crypto in browser as a bleeding edge performance challenge for the Web...Mining crypto in browser as a bleeding edge performance challenge for the Web...
Mining crypto in browser as a bleeding edge performance challenge for the Web...Denis Radin
 
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...Maria Kuneva
 
BGF 2012 (Browsergames Forum)
BGF 2012 (Browsergames Forum)BGF 2012 (Browsergames Forum)
BGF 2012 (Browsergames Forum)Christof Wegmann
 
GPU Technology Conference 2014 Keynote
GPU Technology Conference 2014 KeynoteGPU Technology Conference 2014 Keynote
GPU Technology Conference 2014 KeynoteNVIDIA
 
JITServerTalk-OSS-2023.pdf
JITServerTalk-OSS-2023.pdfJITServerTalk-OSS-2023.pdf
JITServerTalk-OSS-2023.pdfRichHagarty
 
Rollup-as-a-service and why it matters to the next-gen of dApps
Rollup-as-a-service and why it matters to the next-gen of dAppsRollup-as-a-service and why it matters to the next-gen of dApps
Rollup-as-a-service and why it matters to the next-gen of dAppsTinaBregovi
 
Gluecon 2013 netflix api crash course
Gluecon 2013 netflix api crash courseGluecon 2013 netflix api crash course
Gluecon 2013 netflix api crash courseBenjamin Schmaus
 
GDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas Trudel
GDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas TrudelGDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas Trudel
GDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas TrudelUmbra Software
 
Advanced #4 GPU & Animations
Advanced #4 GPU & AnimationsAdvanced #4 GPU & Animations
Advanced #4 GPU & AnimationsVitali Pekelis
 
Gömülü Sistemlerde Derin Öğrenme Uygulamaları
Gömülü Sistemlerde Derin Öğrenme UygulamalarıGömülü Sistemlerde Derin Öğrenme Uygulamaları
Gömülü Sistemlerde Derin Öğrenme UygulamalarıFerhat Kurt
 
Getting The Most Out of VR | Sinjin Bain
Getting The Most Out of VR | Sinjin BainGetting The Most Out of VR | Sinjin Bain
Getting The Most Out of VR | Sinjin BainJessica Tams
 
FGS 2011: Making A Game With Molehill: Zombie Tycoon
FGS 2011: Making A Game With Molehill: Zombie TycoonFGS 2011: Making A Game With Molehill: Zombie Tycoon
FGS 2011: Making A Game With Molehill: Zombie Tycoonmochimedia
 
Killzone Shadow Fall Demo Postmortem
Killzone Shadow Fall Demo PostmortemKillzone Shadow Fall Demo Postmortem
Killzone Shadow Fall Demo PostmortemGuerrilla
 
High Performance Cloud Computing
High Performance Cloud ComputingHigh Performance Cloud Computing
High Performance Cloud ComputingAmazon Web Services
 
High Performance Cloud Computing
High Performance Cloud ComputingHigh Performance Cloud Computing
High Performance Cloud ComputingAmazon Web Services
 
The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...
The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...
The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...Johan Andersson
 

Similaire à Scaling hotstar.com for 10 million concurrent viewers (20)

Applying AI in Games (GDC2019)
Applying AI in Games (GDC2019)Applying AI in Games (GDC2019)
Applying AI in Games (GDC2019)
 
Scaling Deep Learning
Scaling Deep LearningScaling Deep Learning
Scaling Deep Learning
 
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...
 
Mining crypto in browser as a bleeding edge performance challenge for the Web...
Mining crypto in browser as a bleeding edge performance challenge for the Web...Mining crypto in browser as a bleeding edge performance challenge for the Web...
Mining crypto in browser as a bleeding edge performance challenge for the Web...
 
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...
Denis Radin - Mining crypto in browser_ GPU, WebAssembly and all the good thi...
 
BGF 2012 (Browsergames Forum)
BGF 2012 (Browsergames Forum)BGF 2012 (Browsergames Forum)
BGF 2012 (Browsergames Forum)
 
GPU Technology Conference 2014 Keynote
GPU Technology Conference 2014 KeynoteGPU Technology Conference 2014 Keynote
GPU Technology Conference 2014 Keynote
 
JITServerTalk-OSS-2023.pdf
JITServerTalk-OSS-2023.pdfJITServerTalk-OSS-2023.pdf
JITServerTalk-OSS-2023.pdf
 
GTC 2022 Keynote
GTC 2022 KeynoteGTC 2022 Keynote
GTC 2022 Keynote
 
Rollup-as-a-service and why it matters to the next-gen of dApps
Rollup-as-a-service and why it matters to the next-gen of dAppsRollup-as-a-service and why it matters to the next-gen of dApps
Rollup-as-a-service and why it matters to the next-gen of dApps
 
Gluecon 2013 netflix api crash course
Gluecon 2013 netflix api crash courseGluecon 2013 netflix api crash course
Gluecon 2013 netflix api crash course
 
GDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas Trudel
GDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas TrudelGDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas Trudel
GDC16: Improving geometry culling for Deus Ex: Mankind Divided by Nicolas Trudel
 
Advanced #4 GPU & Animations
Advanced #4 GPU & AnimationsAdvanced #4 GPU & Animations
Advanced #4 GPU & Animations
 
Gömülü Sistemlerde Derin Öğrenme Uygulamaları
Gömülü Sistemlerde Derin Öğrenme UygulamalarıGömülü Sistemlerde Derin Öğrenme Uygulamaları
Gömülü Sistemlerde Derin Öğrenme Uygulamaları
 
Getting The Most Out of VR | Sinjin Bain
Getting The Most Out of VR | Sinjin BainGetting The Most Out of VR | Sinjin Bain
Getting The Most Out of VR | Sinjin Bain
 
FGS 2011: Making A Game With Molehill: Zombie Tycoon
FGS 2011: Making A Game With Molehill: Zombie TycoonFGS 2011: Making A Game With Molehill: Zombie Tycoon
FGS 2011: Making A Game With Molehill: Zombie Tycoon
 
Killzone Shadow Fall Demo Postmortem
Killzone Shadow Fall Demo PostmortemKillzone Shadow Fall Demo Postmortem
Killzone Shadow Fall Demo Postmortem
 
High Performance Cloud Computing
High Performance Cloud ComputingHigh Performance Cloud Computing
High Performance Cloud Computing
 
High Performance Cloud Computing
High Performance Cloud ComputingHigh Performance Cloud Computing
High Performance Cloud Computing
 
The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...
The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...
The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...
 

Plus de AWS User Group Bengaluru

Lessons learnt building a Distributed Linked List on S3
Lessons learnt building a Distributed Linked List on S3Lessons learnt building a Distributed Linked List on S3
Lessons learnt building a Distributed Linked List on S3AWS User Group Bengaluru
 
Building Efficient, Scalable and Resilient Front-end logging service with AWS
Building Efficient, Scalable and Resilient Front-end logging service with AWSBuilding Efficient, Scalable and Resilient Front-end logging service with AWS
Building Efficient, Scalable and Resilient Front-end logging service with AWSAWS User Group Bengaluru
 
Exploring opportunities with communities for a successful career
Exploring opportunities with communities for a successful careerExploring opportunities with communities for a successful career
Exploring opportunities with communities for a successful careerAWS User Group Bengaluru
 
Slack's transition away from a single AWS account
Slack's transition away from a single AWS accountSlack's transition away from a single AWS account
Slack's transition away from a single AWS accountAWS User Group Bengaluru
 
Building Efficient, Scalable and Resilient Front-end logging service with AWS
Building Efficient, Scalable and Resilient Front-end logging service with AWSBuilding Efficient, Scalable and Resilient Front-end logging service with AWS
Building Efficient, Scalable and Resilient Front-end logging service with AWSAWS User Group Bengaluru
 
Medlife's journey with AWS from 0(zero) orders to 6 digit mark
Medlife's journey with AWS from 0(zero) orders to 6 digit markMedlife's journey with AWS from 0(zero) orders to 6 digit mark
Medlife's journey with AWS from 0(zero) orders to 6 digit markAWS User Group Bengaluru
 
Exploring opportunities with communities for a successful career
Exploring opportunities with communities for a successful careerExploring opportunities with communities for a successful career
Exploring opportunities with communities for a successful careerAWS User Group Bengaluru
 
Lessons learnt building a Distributed Linked List on S3
Lessons learnt building a Distributed Linked List on S3Lessons learnt building a Distributed Linked List on S3
Lessons learnt building a Distributed Linked List on S3AWS User Group Bengaluru
 

Plus de AWS User Group Bengaluru (20)

Demystifying identity on AWS
Demystifying identity on AWSDemystifying identity on AWS
Demystifying identity on AWS
 
AWS Secrets for Best Practices
AWS Secrets for Best PracticesAWS Secrets for Best Practices
AWS Secrets for Best Practices
 
Cloud Security
Cloud SecurityCloud Security
Cloud Security
 
Lessons learnt building a Distributed Linked List on S3
Lessons learnt building a Distributed Linked List on S3Lessons learnt building a Distributed Linked List on S3
Lessons learnt building a Distributed Linked List on S3
 
Medlife journey with AWS
Medlife journey with AWSMedlife journey with AWS
Medlife journey with AWS
 
Building Efficient, Scalable and Resilient Front-end logging service with AWS
Building Efficient, Scalable and Resilient Front-end logging service with AWSBuilding Efficient, Scalable and Resilient Front-end logging service with AWS
Building Efficient, Scalable and Resilient Front-end logging service with AWS
 
Exploring opportunities with communities for a successful career
Exploring opportunities with communities for a successful careerExploring opportunities with communities for a successful career
Exploring opportunities with communities for a successful career
 
Slack's transition away from a single AWS account
Slack's transition away from a single AWS accountSlack's transition away from a single AWS account
Slack's transition away from a single AWS account
 
Log analytics with ELK stack
Log analytics with ELK stackLog analytics with ELK stack
Log analytics with ELK stack
 
Serverless Culture
Serverless CultureServerless Culture
Serverless Culture
 
Refactoring to serverless
Refactoring to serverlessRefactoring to serverless
Refactoring to serverless
 
Amazon EC2 Spot Instances Workshop
Amazon EC2 Spot Instances WorkshopAmazon EC2 Spot Instances Workshop
Amazon EC2 Spot Instances Workshop
 
Building Efficient, Scalable and Resilient Front-end logging service with AWS
Building Efficient, Scalable and Resilient Front-end logging service with AWSBuilding Efficient, Scalable and Resilient Front-end logging service with AWS
Building Efficient, Scalable and Resilient Front-end logging service with AWS
 
Medlife's journey with AWS from 0(zero) orders to 6 digit mark
Medlife's journey with AWS from 0(zero) orders to 6 digit markMedlife's journey with AWS from 0(zero) orders to 6 digit mark
Medlife's journey with AWS from 0(zero) orders to 6 digit mark
 
AWS Secrets for Best Practices
AWS Secrets for Best PracticesAWS Secrets for Best Practices
AWS Secrets for Best Practices
 
Exploring opportunities with communities for a successful career
Exploring opportunities with communities for a successful careerExploring opportunities with communities for a successful career
Exploring opportunities with communities for a successful career
 
Lessons learnt building a Distributed Linked List on S3
Lessons learnt building a Distributed Linked List on S3Lessons learnt building a Distributed Linked List on S3
Lessons learnt building a Distributed Linked List on S3
 
Cloud Security
Cloud SecurityCloud Security
Cloud Security
 
Amazon EC2 Spot Instances
Amazon EC2 Spot InstancesAmazon EC2 Spot Instances
Amazon EC2 Spot Instances
 
Cost Optimization in AWS
Cost Optimization in AWSCost Optimization in AWS
Cost Optimization in AWS
 

Dernier

Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 

Dernier (20)

Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 

Scaling hotstar.com for 10 million concurrent viewers

  • 1. Scaling Hotstar.com for 10Mn concurrency CHALLENGES & LEARNINGS Gaurav Kamboj Cloud Architect at Hotstar
  • 2. Let’s talk about Scale! 10Mn+ PEAK CONCURRENCY DURING VIVO IPL FINAL 5.7 Tbps PEAK BANDWIDTH CONSUMPTION 1Mn PEAK REQUESTS PER SECOND 10Bn+ CLICKSTREAM MESSAGES 100+ HOURS OF LIVE TRANSCODING EVERYDAY
  • 3.
  • 4. Game Day FACE THE REAL GAME BEFORE THE ACTUAL GAME 36,000 CPUs 80 Gbps NETWORK OUT 72 TB RAM 8 REGIONS GEO DISTRIBUTED Project HULK ● Load Generation ● Performance & Tsunami Tests ● Chaos Engineering ● Traffic Pattern using ML
  • 5. Race against time! + 500K GROWTH RATE PER MINUTE (CONCURRENCY) FULLY BAKED AMIs 4 mins APPLICATION BOOT-UP TIME 90 SECONDS REACTION TIME PUSH NOTIFICATIONS
  • 6. Why we don’t use autoscaling INSUFFICIENT CAPACITY ERRORS GAME OF (AVAILABILITY) ZONES STEP SIZE AUTOSCALING GROUPS
  • 7. Others challenges.. SINGLE INSTANCE TYPE PER AUTO SCALING GROUP API THROTTLING RETRIES & EXPONENTIAL BACKOFF
  • 8. PREWARM INFRA BEFORE MATCH TIME PROACTIVE SCALE UP WITH BUFFER FOR SPIKES SECONDARY AUTO SCALING GROUP SPOT FLEET DIVERSIFIED INSTANCE TYPES Battle tested scaling strategy!
  • 9. MACHINE LEARNING BASED AUTO SCALING Future.. IPL 2019 onwards INTELLIGENT SCALE UP DECISIONS RUN IPL & WORLD CUP 2019 ON AUTO PILOT MODE