SlideShare une entreprise Scribd logo
1  sur  21
Live Podcasting on AWS




                          marco pracucci
                       Follow me on Twitter @pracucci



giovedì 8 marzo 2012
Why AWS



                           Scalability
                         Handle peaks smoothly
                       and keep focus on business




giovedì 8 marzo 2012
AWS Usage
                                      The slide of acronyms




          EC2          Servers   web, api, db, streaming, ...   20 - 30 instances




giovedì 8 marzo 2012
AWS Usage
                                      The slide of acronyms




          EC2          Servers   web, api, db, streaming, ...   20 - 30 instances

          ELB          Balance HTTP traffic                          3 ELB




giovedì 8 marzo 2012
AWS Usage
                                      The slide of acronyms




          EC2          Servers   web, api, db, streaming, ...             20 - 30 instances

          ELB          Balance HTTP traffic                                    3 ELB

          EBS          Dynamic data storage              pg, mongo, ...       500 GB




giovedì 8 marzo 2012
AWS Usage
                                      The slide of acronyms




          EC2          Servers   web, api, db, streaming, ...             20 - 30 instances

          ELB          Balance HTTP traffic                                    3 ELB

          EBS          Dynamic data storage              pg, mongo, ...       500 GB

          S3           Static data storage          mp3, images, ...           15 TB




giovedì 8 marzo 2012
AWS Usage
                                      The slide of acronyms




          EC2          Servers   web, api, db, streaming, ...             20 - 30 instances

          ELB          Balance HTTP traffic                                    3 ELB

          EBS          Dynamic data storage              pg, mongo, ...       500 GB

          S3           Static data storage          mp3, images, ...           15 TB

          CF           Static data CDN                                    50M req / month




giovedì 8 marzo 2012
AWS Usage
                                      The slide of acronyms




          EC2          Servers   web, api, db, streaming, ...             20 - 30 instances

          ELB          Balance HTTP traffic                                    3 ELB

          EBS          Dynamic data storage              pg, mongo, ...       500 GB

          S3           Static data storage          mp3, images, ...           15 TB

          CF           Static data CDN                                    50M req / month

          R53          Authoritative DNS                                  15M req / month




giovedì 8 marzo 2012
Scaling Spreaker
                          with AWS
                          a real day example




giovedì 8 marzo 2012
giovedì 8 marzo 2012
                                         Requests / sec




                                0
                                    40
                                           80
                                                  120
                                                          160
                                                                200
                       00:0
                            0
                       01:0
                            0
                       02:0
                            0
                       03:0
                            0
                       04:0
                            0
                       05:0
                            0
                       06:0
                            0
                       07:0
                            0
                       08:0
                            0
                       09:0
                            0
                       10:0
                            0
                       11:0
                            0
                       12:0
                            0
                       13:0
                            0
                       14:0
                            0
                                                                      Scaling Spreaker




                       15:0
                            0
                       16:0
                            0
                       17:0
                            0
                                                                                         The ideal traffic




                       18:0
                            0
                       19:0
                            0
                       20:0
                            0
                       21:0
                            0
                       22:0
                            0
                       23:0
                            0
giovedì 8 marzo 2012
                                         Requests / sec




                                0
                                    70
                                           140
                                                  210
                                                          280
                                                                350
                       00:0
                            0
                       01:0
                            0
                       02:0
                            0
                       03:0
                            0
                       04:0
                            0
                       05:0
                            0
                       06:0
                            0
                       07:0
                            0
                       08:0
                            0
                       09:0
                            0
                       10:0
                            0
                       11:0
                            0
                       12:0
                            0
                       13:0
                            0
                       14:0
                            0
                                                                      Scaling Spreaker




                       15:0
                            0
                       16:0
                            0
                       17:0
                            0
                       18:0
                            0
                       19:0
                            0
                       20:0
                            0
                                                                                         The almost real traffic




                       21:0
                            0
                       22:0
                            0
                       23:0
                            0
giovedì 8 marzo 2012
                                         Requests / sec




                                0
                                    70
                                           140
                                                  210
                                                          280
                                                                                350
                       00:0
                            0
                       01:0
                            0
                       02:0
                            0
                       03:0
                            0
                       04:0
                            0
                       05:0
                            0
                       06:0
                            0
                       07:0
                            0
                       08:0
                            0
                       09:0
                            0
                       10:0
                            0
                       11:0
                            0
                       12:0
                            0
                       13:0
                            0
                       14:0
                            0
                                                                                      Scaling Spreaker




                       15:0
                            0
                       16:0
                                                                Unpredictable




                            0
                       17:0
                            0
                                                                                                         The real traffic




                       18:0
                            0
                       19:0
                            0
                       20:0
                            0
                       21:0
                            0
                       22:0
                            0
                       23:0
                            0
Requirements
                                     Scaling Spreaker




             Fast                                 Automatized
             New instances up and                 No human intervention
             running in less then 5 mins




giovedì 8 marzo 2012
Auto-Scaling
                         Scaling Spreaker




             TRACK                          UP / DOWN
                          ANALYZE
             METRICS                          SCALE




giovedì 8 marzo 2012
Auto-Scaling
                           Scaling Spreaker




             TRACK                             UP / DOWN
                            ANALYZE
             METRICS                             SCALE
     Zenoss + Logstash         Skynet         Spreaker + EC2 API




giovedì 8 marzo 2012
Auto-Scaling
                           Scaling Spreaker




             TRACK                             UP / DOWN
                            ANALYZE
             METRICS                             SCALE
     Zenoss + Logstash         Skynet         Spreaker + EC2 API



                         {
                         You can also use
                           CloudWatch

giovedì 8 marzo 2012
Auto-Scaling
                                    Scaling Spreaker



                       1. Split the infrastructure into roles


                                    web
                                              streaming

                                  api




giovedì 8 marzo 2012
Auto-Scaling
                                         Scaling Spreaker



                          1. Split the infrastructure into roles

                                                              db-master
                                         web
                       gearman
                                                   streaming
                                                                          db-slave
                          redis
                                       api
                                                  recording         search

                         memcache
                                             encoder
                                                              mongo
                                    web worker



giovedì 8 marzo 2012
Auto-Scaling
                                         Scaling Spreaker



                       2. Assign roles to each instance (using EC2 tags)


                            Instance 1    Instance 2        Instance 3

                              web            web            streaming
                              api            api




giovedì 8 marzo 2012
Auto-Scaling
                                 Scaling Spreaker



                       3. Start roles at instance boot


                             a script fetch roles,
                          install code (latest build),
                         configure and start services




giovedì 8 marzo 2012
Auto-Scaling
                                  Scaling Spreaker



                           4. Ready to auto-scale


                           To add another web server,
                       turn on a new instance with web role




giovedì 8 marzo 2012

Contenu connexe

Plus de Amazon Web Services

Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 

Plus de Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Dernier

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Dernier (20)

Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 

Spreaker - Live Podcasting on AWS - AWS Case Study

  • 1. Live Podcasting on AWS marco pracucci Follow me on Twitter @pracucci giovedì 8 marzo 2012
  • 2. Why AWS Scalability Handle peaks smoothly and keep focus on business giovedì 8 marzo 2012
  • 3. AWS Usage The slide of acronyms EC2 Servers web, api, db, streaming, ... 20 - 30 instances giovedì 8 marzo 2012
  • 4. AWS Usage The slide of acronyms EC2 Servers web, api, db, streaming, ... 20 - 30 instances ELB Balance HTTP traffic 3 ELB giovedì 8 marzo 2012
  • 5. AWS Usage The slide of acronyms EC2 Servers web, api, db, streaming, ... 20 - 30 instances ELB Balance HTTP traffic 3 ELB EBS Dynamic data storage pg, mongo, ... 500 GB giovedì 8 marzo 2012
  • 6. AWS Usage The slide of acronyms EC2 Servers web, api, db, streaming, ... 20 - 30 instances ELB Balance HTTP traffic 3 ELB EBS Dynamic data storage pg, mongo, ... 500 GB S3 Static data storage mp3, images, ... 15 TB giovedì 8 marzo 2012
  • 7. AWS Usage The slide of acronyms EC2 Servers web, api, db, streaming, ... 20 - 30 instances ELB Balance HTTP traffic 3 ELB EBS Dynamic data storage pg, mongo, ... 500 GB S3 Static data storage mp3, images, ... 15 TB CF Static data CDN 50M req / month giovedì 8 marzo 2012
  • 8. AWS Usage The slide of acronyms EC2 Servers web, api, db, streaming, ... 20 - 30 instances ELB Balance HTTP traffic 3 ELB EBS Dynamic data storage pg, mongo, ... 500 GB S3 Static data storage mp3, images, ... 15 TB CF Static data CDN 50M req / month R53 Authoritative DNS 15M req / month giovedì 8 marzo 2012
  • 9. Scaling Spreaker with AWS a real day example giovedì 8 marzo 2012
  • 10. giovedì 8 marzo 2012 Requests / sec 0 40 80 120 160 200 00:0 0 01:0 0 02:0 0 03:0 0 04:0 0 05:0 0 06:0 0 07:0 0 08:0 0 09:0 0 10:0 0 11:0 0 12:0 0 13:0 0 14:0 0 Scaling Spreaker 15:0 0 16:0 0 17:0 0 The ideal traffic 18:0 0 19:0 0 20:0 0 21:0 0 22:0 0 23:0 0
  • 11. giovedì 8 marzo 2012 Requests / sec 0 70 140 210 280 350 00:0 0 01:0 0 02:0 0 03:0 0 04:0 0 05:0 0 06:0 0 07:0 0 08:0 0 09:0 0 10:0 0 11:0 0 12:0 0 13:0 0 14:0 0 Scaling Spreaker 15:0 0 16:0 0 17:0 0 18:0 0 19:0 0 20:0 0 The almost real traffic 21:0 0 22:0 0 23:0 0
  • 12. giovedì 8 marzo 2012 Requests / sec 0 70 140 210 280 350 00:0 0 01:0 0 02:0 0 03:0 0 04:0 0 05:0 0 06:0 0 07:0 0 08:0 0 09:0 0 10:0 0 11:0 0 12:0 0 13:0 0 14:0 0 Scaling Spreaker 15:0 0 16:0 Unpredictable 0 17:0 0 The real traffic 18:0 0 19:0 0 20:0 0 21:0 0 22:0 0 23:0 0
  • 13. Requirements Scaling Spreaker Fast Automatized New instances up and No human intervention running in less then 5 mins giovedì 8 marzo 2012
  • 14. Auto-Scaling Scaling Spreaker TRACK UP / DOWN ANALYZE METRICS SCALE giovedì 8 marzo 2012
  • 15. Auto-Scaling Scaling Spreaker TRACK UP / DOWN ANALYZE METRICS SCALE Zenoss + Logstash Skynet Spreaker + EC2 API giovedì 8 marzo 2012
  • 16. Auto-Scaling Scaling Spreaker TRACK UP / DOWN ANALYZE METRICS SCALE Zenoss + Logstash Skynet Spreaker + EC2 API { You can also use CloudWatch giovedì 8 marzo 2012
  • 17. Auto-Scaling Scaling Spreaker 1. Split the infrastructure into roles web streaming api giovedì 8 marzo 2012
  • 18. Auto-Scaling Scaling Spreaker 1. Split the infrastructure into roles db-master web gearman streaming db-slave redis api recording search memcache encoder mongo web worker giovedì 8 marzo 2012
  • 19. Auto-Scaling Scaling Spreaker 2. Assign roles to each instance (using EC2 tags) Instance 1 Instance 2 Instance 3 web web streaming api api giovedì 8 marzo 2012
  • 20. Auto-Scaling Scaling Spreaker 3. Start roles at instance boot a script fetch roles, install code (latest build), configure and start services giovedì 8 marzo 2012
  • 21. Auto-Scaling Scaling Spreaker 4. Ready to auto-scale To add another web server, turn on a new instance with web role giovedì 8 marzo 2012