eBay's private cloud journey and business impact

1. Copyright © 1995 – 2016 eBay Inc. Confidential and proprietary. All Rights Reserved.
Suneet Nandwani
March 23, 2016
Developing OpenStack at Scale
eBay’s Connected Commerce Cloud

2. Agenda
2
2
3
4
?
Introduction1
eBay Private Cloud
Challenges and Learning
Future Directions
Q&A

3. BOOSTED
INNOVATION
AUTOMATION
OPERATIONAL
EFFICIENCY
PRIVATE
CLOUD
eBay Private Cloud
Our Vision
3
AGILITY
for
TOP LINE REVENUE
GROWTH

4. eBay Private Cloud
Our Journey
4
6 Years
3 Cloud
Generations
2011
Bare Metal
Cloud
Front End
Traffic to
Cloud
eBay eBox
Application
Provisioning2010
2012
eBay Search to
Cloud
30% eBay
Traffic on
Cloud
1st GENERATION
Hadoop to
Internal Cloud
Launched
OpenStack
Cloud
90% eBay
Traffic on
Cloud
Kubernetes
Journey Starts
Availability &
Reliability
2013
SW Defined
Network
capability
OpenStack
Manageability
Scale Progr.
70% eBay
Traffic on
Cloud
2014
2015 2016
2nd GENERATION
Kubernetes
Investment
…
3rd GENERATION

5. eBay Private Cloud
Developer Agility
5
DIMENSION 2012 NOW
PROVISIONING
FLEXIBILITY
DEPLOYMENT
APP DEPLOYMENT
CONTINUOUS INTEGRATION
APP PROVISIONING
SELF
SERVICE
CAPABILITIES
TIME
1 6 0 0. hours
4 0. hours
0 5. hours
0 2. hours

6. eBay Private Cloud
Our Cloud Scale
6
IaaS PaaS Frameworks Monitoring
4 PB
Managed Storage
Managed VMs
2 1 0 0 0 0,
Managed BMs
5 9 0 0 0,
Deployments per Month
5 0 0 0 0 0,
Pools
1 2 0 0 0,
Pools
2 7 0 0,
8 8 B
Hits per Day
VMs
6 0 0 0 0,
4 M
Metrics per Second
7 B
URL Logs per Day
7 0 0 TB
Logs per Day
Applications
4 0 0 0,

7. Challenges and Learning
From OpenStack to a Cloud Service able to support our needs
7
Network
Design
Net/Info
Sec
Infra. On
boarding
CI
Builds
Config.
Mgmt.
High
Availability
Cloud
Monitoring
Metrics
Log
Processing
Alerting
Incident
Resolution
Customer
Support
SLA
Upgrades
Capacity
Planning
Remediation
Auto-
Scaling
Scale Out
Metering
and
Chargeback
Monitoring
and
Alerting
CLOUD IS
A
SERVICE!
User
Experience
OpenStack
APIs
OpenStack native
components
Required eBay
developments

8. Operating Principles
8
Customer oriented Open source first
Simplify,
simplify, simplify
Automate everything,
minimize manual work
Obsess over
operational metrics
Engineered systems
with automation
patterns – no one offs

9. Lessons Learned
9
Hard part is turning OpenStack into
a Cloud with ecosystem of tools
and processes
Upgrades
Debugging
Tech Difficulties
OpenStack for an enterprise
requires long term journey and
committment
Infrastructure programmability can
hold you back
Reliability at scale is low without a
lot of work
Complexities
Ramp up time is high
Requires top notch engineers who
are tuned into open source and
community
More engineers & dev. ops, less
tradtional ops teams
Personnel

10. Future Directions
10
Consistent create-build-
ship-run experience
Enable Containers, Micro-
Services
Scalable XaaS interfaces
Declarative intent
Lights Out Management:
auto everything
Efficient scheduling
Enforce policy on each
interaction of an app
Adaptive to dynamic app
changes
Distributed policy
enforcement points
Self contained and
independent
Fully automated
infrastructure (last mile)
Software defined networks
Enable Cloud
Native Stack
Enable Cluster
Management
Programmable
Application
Security
Enable SW
Defined
Data Center
Agile & Efficient Available & Efficient Secure & Efficient Available & Efficient

11. Q&A
11

12. Copyright © 1995 – 2016 eBay Inc. Confidential and proprietary. All Rights Reserved.
Suneet Nandwani
Thank you