Soumettre la recherche
Mettre en ligne
Gluecon 2013 netflix api crash course
•
12 j'aime
•
3,239 vues
Benjamin Schmaus
Suivre
Presentation from Gluecon 2013 on building and running the Netflix API.
Lire moins
Lire la suite
Technologie
Actualités & Politique
Signaler
Partager
Signaler
Partager
1 sur 60
Télécharger maintenant
Télécharger pour lire hors ligne
Recommandé
Autospoting - an automated EC2 spot market bidder
Autospoting - an automated EC2 spot market bidder
Cristian Măgherușan-Stanciu
Cloud Campus(仮称)提案書
Cloud Campus(仮称)提案書
Akihiko Kodama
Mateusz Zając - Continuous Integration i jej skalowalność w oparciu o TeamCit...
Mateusz Zając - Continuous Integration i jej skalowalność w oparciu o TeamCit...
Trójmiejska Grupa Testerska
API World 2013 - Transforming the Netflix API
API World 2013 - Transforming the Netflix API
Benjamin Schmaus
Migrate a on-prem platform to the public cloud with Java - SpringBoot and PCF
Migrate a on-prem platform to the public cloud with Java - SpringBoot and PCF
Roy Braam
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...
Adrian Cockcroft
Pros and Cons of a MicroServices Architecture talk at AWS ReInvent
Pros and Cons of a MicroServices Architecture talk at AWS ReInvent
Sudhir Tonse
From nothing to production in 1 hour
From nothing to production in 1 hour
Roy Braam
Recommandé
Autospoting - an automated EC2 spot market bidder
Autospoting - an automated EC2 spot market bidder
Cristian Măgherușan-Stanciu
Cloud Campus(仮称)提案書
Cloud Campus(仮称)提案書
Akihiko Kodama
Mateusz Zając - Continuous Integration i jej skalowalność w oparciu o TeamCit...
Mateusz Zając - Continuous Integration i jej skalowalność w oparciu o TeamCit...
Trójmiejska Grupa Testerska
API World 2013 - Transforming the Netflix API
API World 2013 - Transforming the Netflix API
Benjamin Schmaus
Migrate a on-prem platform to the public cloud with Java - SpringBoot and PCF
Migrate a on-prem platform to the public cloud with Java - SpringBoot and PCF
Roy Braam
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...
Adrian Cockcroft
Pros and Cons of a MicroServices Architecture talk at AWS ReInvent
Pros and Cons of a MicroServices Architecture talk at AWS ReInvent
Sudhir Tonse
From nothing to production in 1 hour
From nothing to production in 1 hour
Roy Braam
5 Years Of Building SaaS On AWS
5 Years Of Building SaaS On AWS
Christian Beedgen
The present and future of serverless observability (QCon London)
The present and future of serverless observability (QCon London)
Yan Cui
The present and future of Serverless observability
The present and future of Serverless observability
Yan Cui
The present and future of Serverless observability
The present and future of Serverless observability
Yan Cui
Making Microservices work at Netflix
Making Microservices work at Netflix
Sangeeta Narayanan
APIdays Barcelona 2019 - How to build a social network on Serverless with Yan...
APIdays Barcelona 2019 - How to build a social network on Serverless with Yan...
apidays
How to build a social network on serverless
How to build a social network on serverless
Yan Cui
Building Serverless Web Applications - DevDay Austin 2017
Building Serverless Web Applications - DevDay Austin 2017
Amazon Web Services
Maintaining the Front Door to Netflix : The Netflix API
Maintaining the Front Door to Netflix : The Netflix API
Daniel Jacobson
A lap around API Management
A lap around API Management
Wagner Silveira
Amazon Web Service Sales Role Play - Case Study
Amazon Web Service Sales Role Play - Case Study
Vineet Sood
Troubleshooting serverless applications
Troubleshooting serverless applications
Yan Cui
OpenShift Meetup - Tokyo - Service Mesh and Serverless Overview
OpenShift Meetup - Tokyo - Service Mesh and Serverless Overview
María Angélica Bracho
Building Serverless Web Applications - DevDay Los Angeles 2017
Building Serverless Web Applications - DevDay Los Angeles 2017
Amazon Web Services
Introduction To Cloud Computing
Introduction To Cloud Computing
Rinat Shagisultanov
Building Event Driven (Micro)services with Apache Kafka
Building Event Driven (Micro)services with Apache Kafka
Guido Schmutz
AWS re:Invent 2016: Serverless IoT Back Ends (IOT401)
AWS re:Invent 2016: Serverless IoT Back Ends (IOT401)
Amazon Web Services
KFServing Payload Logging for Trusted AI
KFServing Payload Logging for Trusted AI
Animesh Singh
Towards Benchmaking Modern Distruibuted Systems-(Grace Huang, Intel)
Towards Benchmaking Modern Distruibuted Systems-(Grace Huang, Intel)
Spark Summit
Building Advanced Serverless Workflows with AWS Step Functions | AWS Floor28
Building Advanced Serverless Workflows with AWS Step Functions | AWS Floor28
Amazon Web Services
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
iSEO AI
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
Srushith Repakula
Contenu connexe
Similaire à Gluecon 2013 netflix api crash course
5 Years Of Building SaaS On AWS
5 Years Of Building SaaS On AWS
Christian Beedgen
The present and future of serverless observability (QCon London)
The present and future of serverless observability (QCon London)
Yan Cui
The present and future of Serverless observability
The present and future of Serverless observability
Yan Cui
The present and future of Serverless observability
The present and future of Serverless observability
Yan Cui
Making Microservices work at Netflix
Making Microservices work at Netflix
Sangeeta Narayanan
APIdays Barcelona 2019 - How to build a social network on Serverless with Yan...
APIdays Barcelona 2019 - How to build a social network on Serverless with Yan...
apidays
How to build a social network on serverless
How to build a social network on serverless
Yan Cui
Building Serverless Web Applications - DevDay Austin 2017
Building Serverless Web Applications - DevDay Austin 2017
Amazon Web Services
Maintaining the Front Door to Netflix : The Netflix API
Maintaining the Front Door to Netflix : The Netflix API
Daniel Jacobson
A lap around API Management
A lap around API Management
Wagner Silveira
Amazon Web Service Sales Role Play - Case Study
Amazon Web Service Sales Role Play - Case Study
Vineet Sood
Troubleshooting serverless applications
Troubleshooting serverless applications
Yan Cui
OpenShift Meetup - Tokyo - Service Mesh and Serverless Overview
OpenShift Meetup - Tokyo - Service Mesh and Serverless Overview
María Angélica Bracho
Building Serverless Web Applications - DevDay Los Angeles 2017
Building Serverless Web Applications - DevDay Los Angeles 2017
Amazon Web Services
Introduction To Cloud Computing
Introduction To Cloud Computing
Rinat Shagisultanov
Building Event Driven (Micro)services with Apache Kafka
Building Event Driven (Micro)services with Apache Kafka
Guido Schmutz
AWS re:Invent 2016: Serverless IoT Back Ends (IOT401)
AWS re:Invent 2016: Serverless IoT Back Ends (IOT401)
Amazon Web Services
KFServing Payload Logging for Trusted AI
KFServing Payload Logging for Trusted AI
Animesh Singh
Towards Benchmaking Modern Distruibuted Systems-(Grace Huang, Intel)
Towards Benchmaking Modern Distruibuted Systems-(Grace Huang, Intel)
Spark Summit
Building Advanced Serverless Workflows with AWS Step Functions | AWS Floor28
Building Advanced Serverless Workflows with AWS Step Functions | AWS Floor28
Amazon Web Services
Similaire à Gluecon 2013 netflix api crash course
(20)
5 Years Of Building SaaS On AWS
5 Years Of Building SaaS On AWS
The present and future of serverless observability (QCon London)
The present and future of serverless observability (QCon London)
The present and future of Serverless observability
The present and future of Serverless observability
The present and future of Serverless observability
The present and future of Serverless observability
Making Microservices work at Netflix
Making Microservices work at Netflix
APIdays Barcelona 2019 - How to build a social network on Serverless with Yan...
APIdays Barcelona 2019 - How to build a social network on Serverless with Yan...
How to build a social network on serverless
How to build a social network on serverless
Building Serverless Web Applications - DevDay Austin 2017
Building Serverless Web Applications - DevDay Austin 2017
Maintaining the Front Door to Netflix : The Netflix API
Maintaining the Front Door to Netflix : The Netflix API
A lap around API Management
A lap around API Management
Amazon Web Service Sales Role Play - Case Study
Amazon Web Service Sales Role Play - Case Study
Troubleshooting serverless applications
Troubleshooting serverless applications
OpenShift Meetup - Tokyo - Service Mesh and Serverless Overview
OpenShift Meetup - Tokyo - Service Mesh and Serverless Overview
Building Serverless Web Applications - DevDay Los Angeles 2017
Building Serverless Web Applications - DevDay Los Angeles 2017
Introduction To Cloud Computing
Introduction To Cloud Computing
Building Event Driven (Micro)services with Apache Kafka
Building Event Driven (Micro)services with Apache Kafka
AWS re:Invent 2016: Serverless IoT Back Ends (IOT401)
AWS re:Invent 2016: Serverless IoT Back Ends (IOT401)
KFServing Payload Logging for Trusted AI
KFServing Payload Logging for Trusted AI
Towards Benchmaking Modern Distruibuted Systems-(Grace Huang, Intel)
Towards Benchmaking Modern Distruibuted Systems-(Grace Huang, Intel)
Building Advanced Serverless Workflows with AWS Step Functions | AWS Floor28
Building Advanced Serverless Workflows with AWS Step Functions | AWS Floor28
Dernier
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
iSEO AI
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
Srushith Repakula
IESVE for Early Stage Design and Planning
IESVE for Early Stage Design and Planning
IES VE
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
marcuskenyatta275
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
Patrick Viafore
Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe
中 央社
TopCryptoSupers 12thReport OrionX May2024
TopCryptoSupers 12thReport OrionX May2024
Stephen Perrenod
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
FIDO Alliance
What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024
Stephanie Beckett
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Peter Udo Diehl
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
confluent
Breaking Down the Flutterwave Scandal What You Need to Know.pdf
Breaking Down the Flutterwave Scandal What You Need to Know.pdf
UK Journal
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
FIDO Alliance
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
Jennifer Lim
Overview of Hyperledger Foundation
Overview of Hyperledger Foundation
Hyperleger Tokyo Meetup
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
GDSC PJATK
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
FIDO Alliance
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
FIDO Alliance
AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101
vincent683379
Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & Ireland
IES VE
Dernier
(20)
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
IESVE for Early Stage Design and Planning
IESVE for Early Stage Design and Planning
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe
TopCryptoSupers 12thReport OrionX May2024
TopCryptoSupers 12thReport OrionX May2024
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
Breaking Down the Flutterwave Scandal What You Need to Know.pdf
Breaking Down the Flutterwave Scandal What You Need to Know.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
Overview of Hyperledger Foundation
Overview of Hyperledger Foundation
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101
Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & Ireland
Gluecon 2013 netflix api crash course
1.
Netflix API Crash
Course Building & Running the API in 30 minutes Ben Schmaus, Netflix May 2013, Gluecon bschmaus@netflix.com @schmaus
2.
Streaming TV Shows
& Movies Globally
3.
> 1000 Devices
4.
1/3 of Internet at peak
5.
Programmer not Distributor
6.
More than 36
million subscribers in over 40 countries
7.
How does the
API fit into the picture?
8.
Personalization Engine User Info Movie Metadata Ratings Similar Movies Instant Queue A/B Test Engine API
9.
Personalization Engine User Info Movie Metadata Ratings Similar Movies Instant Queue A/B Test Engine API Enable
UX Innovation Insulate from Failure
10.
> 2 Billion
Requests per Day
11.
Growth Over Time
12.
13.
14.
15.
16.
17.
18.
19.
20.
21.
22.
23.
Automation Visibility Operational awareness Balance speed &
quality
24.
How's the API put
together?
25.
ELB Routing Cluster Mid-tier Services Backend App Cluster Backend App Cluster + API Layer
26.
ELB Routing Cluster Mid-tier Services Backend App Cluster Backend App Cluster + API Layer
27.
Inside an API App Server RxJava Hystrix Service
Client 1 Service Client 2 Service Client N
28.
HystrixRx+Java Service Layer Service Client (provided JAR) Application Service /device/endpoint (provided
script) Service UI Teams Mid-tier Service Teams API Team
29.
Continually changing UI
scripts and mid-tier services Functionality, resiliency and performance drifts over time
30.
Deployment & Ops
31.
REMOVE MANUAL WORK
pushing code to multiple AWS regions/clusters ENABLE RAPID DEPLOYMENT of code despite limited visibility into how it's changed KEEP TEAM INFORMED about what's happening in prod MITIGATE RISK of systemic failure
32.
Tools
33.
End-to-end Traceability Using Python/Java
Glue
34.
Code Flow
35.
Run 1% of
your traffic on the new code and see how it does
36.
API ami-123 API
ami-456 2xx 4xx 5xx latency busy threads load ...
37.
Manually looking at
graphs and SSH- ing into servers and grep-ing logs doesn't scale (although we used to do that)
38.
Confidence score for
each AMI based on comparison of 1000+ metrics
39.
Scannable visualization of
metric space More important Less important
40.
Cross-reference Jira, Link
to code diffs
41.
Track lib changes
42.
Easy to access
report artifacts for each AMI
43.
Your basic red/black
push
44.
45.
46.
47.
48.
Doing red/black by
hand for multiple clusters across multiple regions is not fun
49.
Automate multi-cluster/region pushes
50.
Automate multi-cluster/region pushes Don't forget
to automate rollbacks, too!
51.
$Who, $What, $Where,
$When e.g., "bschmaus, ami-123, Sandbox Canary, 2013-05-06 19:05" Latest prod change in chat topic
52.
Quickly see status
of all clusters in a region
53.
What the #%*!
just happened!?
54.
Historical & realtime
metrics, sort realtime by error/request rate
55.
Distributed grep +
tail 2013-05-09.20:38:54 MX 200 us-east-1c i-1824cb73 i-1c61b77f prod NFPS3-001-8G50FJCX... 288404769389848058 90ms api-global. netflix.com GET /tvui/release/470/plus/pathEvaluator - amazon.ami-id: ami-502eb039 amazon.availability-zone: us-east-1c amazon.instance-id: i-1824cb73 amazon.instance-type: m2.2xlarge amazon.local-ipv4: 10.6.213.112 amazon.public-hostname: ec2-54-243-4-69.compute-1.amazonaws. com amazon.public-ipv4: 54.243.4.69 cookie_esn: NFPS3-001-8G50FJCX... country: MX currentTime: 1368131934468 duration-millis: 90 esn: NFPS3-001-8G50FJCX... geo.city: CIUDADOBREGON ... $ ./simple_stream.py -f -q 'e["country"]=="MX" && e["esn"] ==~/NFPS3.*/' -r us
56.
Go for haystack
handing you the needle
57.
Or at least
be able to make smaller haystacks
58.
Continuously experiment to
make hard things easier
59.
Even with the
best tools, building software is hard work. Great engineers build great software.
60.
Want to help
us build the API? bschmaus@netflix.com @schmaus
Télécharger maintenant