Overview of Challanges and Solutions of a high performance shop (at the example of Angrybirds) - E-HandelsSnack in Stockholm 2013

1. Challenges for a
high performance Shop
Angrybirds in the Cloud
September 12 | E-HandelsSnack | Stockholm
Donnerstag, 19. September 13

2. @
aoepeople
@
danpoetz
Daniel
Pötzinger
Donnerstag, 19. September 13

3. @
aoepeople
@
danpoetz
Daniel
Pötzinger
Donnerstag, 19. September 13

4. Donnerstag, 19. September 13

5. 2.5 billion internet users
Donnerstag, 19. September 13

6. 360 495
677 785 914 1022
1150
1364
1560
1764
2013
2265
2000 2001 2002 2003 2004 2005 2006 2007 2008
2009 2010
2011
2.5 billion internet users
Donnerstag, 19. September 13

7. 360 495
677 785 914 1022
1150
1364
1560
1764
2013
2265
2000 2001 2002 2003 2004 2005 2006 2007 2008
2009 2010
2011
2.5 billion internet users
Donnerstag, 19. September 13

8. Donnerstag, 19. September 13

9. Donnerstag, 19. September 13

10. Donnerstag, 19. September 13

11. 152,2 Million €
68,5 Million € Consumer Products
Donnerstag, 19. September 13

12. Donnerstag, 19. September 13

13. Donnerstag, 19. September 13

14. > 24.000.000 likes > 500.000 followers
Social Media
Impact
Donnerstag, 19. September 13

15. Donnerstag, 19. September 13

16. Irregular Traffic Behaviour
Donnerstag, 19. September 13

17. Angrybirds frequent Releases
Donnerstag, 19. September 13

18. Angrybirds frequent Releases
2012 2013
Donnerstag, 19. September 13

19. Angrybirds frequent Releases
2012 2013
Donnerstag, 19. September 13

20. Angrybirds frequent Releases
2012 2013
G
iftcards
G
eo
IP
Async
Reports
Search
Targeting
ProductsDonnerstag, 19. September 13

21. The DevOps Conflict
Donnerstag, 19. September 13

22. The DevOps Conflict
Frequent development
and releasing of new
features
Donnerstag, 19. September 13

23. The DevOps Conflict
Frequent development
and releasing of new
features
Scalable and stable
Operation
Donnerstag, 19. September 13

24. Biggest Problems
Donnerstag, 19. September 13

25. Biggest Problems
Donnerstag, 19. September 13

26. Biggest Problems
Challenges
Donnerstag, 19. September 13

27. Biggest Problems
Challenges
1. Handling the tremendous peaks
Donnerstag, 19. September 13

28. Biggest Problems
Challenges
1. Handling the tremendous peaks
2. Quick Handling and deployment
of Changes and new Features
Donnerstag, 19. September 13

29. Donnerstag, 19. September 13

30. Handling the peaks...
Donnerstag, 19. September 13

31. How to deal with peaks
Donnerstag, 19. September 13

32. How to deal with peaks
Donnerstag, 19. September 13

33. How to deal with peaks
Donnerstag, 19. September 13

34. How to deal with peaks
Donnerstag, 19. September 13

35. ✓ quick scale on demand
✓ pay only for what you use
Donnerstag, 19. September 13

36. How to deal with peaks
Donnerstag, 19. September 13

37. How to deal with peaks
Donnerstag, 19. September 13

38. „
Global Cloud Infrastructure
Donnerstag, 19. September 13

39. Think cleanly about your operation infrastructure
Donnerstag, 19. September 13

40. Setting up a new environment
should always be faster
than fixing an existing one
Donnerstag, 19. September 13

41. What you should do
Donnerstag, 19. September 13

42. What you should do
Automate the setup of new servers
Donnerstag, 19. September 13

43. What you should do
Automate the setup of new servers
Automate failover
Donnerstag, 19. September 13

44. What you should do
Automate the setup of new servers
Automate failover
Automate scaling
Donnerstag, 19. September 13

45. What you should do
Automate the setup of new servers
Automate failover
Automate scaling
Save work by using AWS concepts
Donnerstag, 19. September 13

46. Donnerstag, 19. September 13

47. Backend
Array
Frontend
Array
Worker Array
Varnish Array
Donnerstag, 19. September 13

48. Backend
Array
Frontend
Array
Worker Array
Varnish Array
Loadbalancer
Donnerstag, 19. September 13

49. Deployment X
Backend
Array
Frontend
Array
Worker Array
Varnish Array
Loadbalancer
Donnerstag, 19. September 13

50. Deployment X
Backend
Array
Frontend
Array
Worker Array
Varnish Array
DNS
shop.angrybirds.com
Loadbalancer
Donnerstag, 19. September 13

51. Deployment X
Backend
Array
Frontend
Array
Worker Array
Varnish Array
DNS
shop.angrybirds.com
File Storage
File Storage DatabaseCache
CDN CDN
Braintree
MailDRM
Giftcards
Loadbalancer
Donnerstag, 19. September 13

52. Load Balancer
Backend
Array
Frontend
Array
Worker Array
Varnish Array
Deployment X
DNS
Donnerstag, 19. September 13

53. r Array
nt X
DNS
Donnerstag, 19. September 13

54. r Array
nt X
DNS
Donnerstag, 19. September 13

55. r Array
nt X
DNS
Deployment X+1
Donnerstag, 19. September 13

56. r Array
nt X
DNS
Deployment X+1
Loadbalancer
Backend
Array
Frontend
Array
Worker
Varnish Array
Donnerstag, 19. September 13

57. r Array
nt X
DNS
Backend
Array
Frontend
Array
Worker
Varnish Array
Deployment X+1
Loadbalancer
Donnerstag, 19. September 13

58. Frontend
Array
Worker Array
Varnish Array
Deployment X
DNS
Backend
Array
Deployment X+1
Loadbalancer Loadbalancer
Donnerstag, 19. September 13

59. DNS
Backend
Array
Deployment X+1
Frontend
Array
Worker Array
Varnish Array
Deployment X
Loadbalancer Loadbalancer
Donnerstag, 19. September 13

60. DNS
Backend
Array
Deployment X+1
Frontend
Array
Worker Array
Varnish Array
Deployment X
Loadbalancer Loadbalancer
Donnerstag, 19. September 13

61. DNS
Backend
Array
Deployment X+1
Loadbalancer
Donnerstag, 19. September 13

62. 0Donnerstag, 19. September 13

63. 0
Downtime
Donnerstag, 19. September 13

64. 0
Downtime
Number of lost
carts
Donnerstag, 19. September 13

65. 0
Downtime
Number of lost
carts
Number of lost
sessions and
logins
Donnerstag, 19. September 13

66. Scaling is about
finding the bottleneck
Donnerstag, 19. September 13

67. The fastest HTTP
Request is..
Donnerstag, 19. September 13

68. The fastest HTTP
Request is..
the one- never made!
Donnerstag, 19. September 13

69. Traffic
HTTP Cacheing
Donnerstag, 19. September 13

70. Application
Traffic
HTTP Cacheing
Donnerstag, 19. September 13

71. Application
Traffic
Browser
Traffic
HTTP Cacheing
Donnerstag, 19. September 13

72. Application
Traffic
CDN
Browser
Traffic
HTTP Cacheing
Donnerstag, 19. September 13

73. Application
Varnish
(Reverse Proxy) Traffic
Traffic
CDN
Browser
Traffic
HTTP Cacheing
Donnerstag, 19. September 13

74. Application
Varnish
(Reverse Proxy) Traffic
Traffic
CDN
Browser
Traffic
Purging
HTTP Cacheing
Donnerstag, 19. September 13

75. Caches
„protect“ your
application
Donnerstag, 19. September 13

76. Caches
„protect“ your
application
Donnerstag, 19. September 13

77. Caches
„protect“ your
application
Donnerstag, 19. September 13

78. 10.000+Possible Pages / Seconde
from ELB &Varnish
Donnerstag, 19. September 13

79. Traffic
Autoscaling
Donnerstag, 19. September 13

80. Traffic
FrontendArray
EC2EC2EC2
Autoscaling
Donnerstag, 19. September 13

81. Traffic
FrontendArray
EC2EC2EC2
Autoscaling
Donnerstag, 19. September 13

82. Traffic
FrontendArray
EC2EC2EC2
EC2EC2EC2
Autoscaling
Donnerstag, 19. September 13

83. 10.000possible Orders / Hour
Donnerstag, 19. September 13

84. Search and Layered Nav
Donnerstag, 19. September 13

85. Browser
Enterprise Search
Magento
Donnerstag, 19. September 13

86. Browser
Enterprise Search
Magento
Donnerstag, 19. September 13

87. Browser
Enterprise Search
Magento
Donnerstag, 19. September 13

88. Be prepared for changes
Donnerstag, 19. September 13

89. Donnerstag, 19. September 13

90. Continuous Deployment
Donnerstag, 19. September 13

91. Don‘t be scared of
releasing to
production
Donnerstag, 19. September 13

92. Late night bugfixing?
Donnerstag, 19. September 13

93. That’s how a deployment should look like
Donnerstag, 19. September 13

94. Continuous Deployment
Donnerstag, 19. September 13

95. We want on-demand deployment
Continuous Deployment
Donnerstag, 19. September 13

96. We want on-demand deployment
of tested features and fixes
Continuous Deployment
Donnerstag, 19. September 13

97. We want on-demand deployment
of tested features and fixes
in a quick and reliable way
Continuous Deployment
Donnerstag, 19. September 13

98. We reach this by
Donnerstag, 19. September 13

99. We reach this by
Automating everything
Donnerstag, 19. September 13

100. We reach this by
Build
Automating everything
Donnerstag, 19. September 13

101. We reach this by
Build
Testing
Automating everything
Donnerstag, 19. September 13

102. We reach this by
Build
Testing
Deployment
Automating everything
Donnerstag, 19. September 13

103. ..and
Donnerstag, 19. September 13

104. ..and
doing it frequently
Donnerstag, 19. September 13

105. ..and
flickr deploys 3
times a day...
doing it frequently
Donnerstag, 19. September 13

106. ContentMaster
Backup
Version
Deployment Pipeline
Donnerstag, 19. September 13

107. ContentMaster
Backup
Version
Build
Deployment Pipeline
Donnerstag, 19. September 13

108. ContentMaster
Backup
Version
Build
Unit Tests
Deployment Pipeline
Donnerstag, 19. September 13

109. ContentMaster
Backup
Version
Build
Unit Tests
Automatic
Deploy on
„Latest“
Deployment Pipeline
Donnerstag, 19. September 13

110. ContentMaster
Backup
Version
Build
Unit Tests
Automatic
Deploy on
„Latest“ Acceptance
Tests
Deployment Pipeline
Donnerstag, 19. September 13

111. ContentMaster
Backup
Version
Build
Unit Tests
Automatic
Deploy on
„Latest“ Acceptance
Tests
Deploy
on
„Deploy“
Deployment Pipeline
Donnerstag, 19. September 13

112. ContentMaster
Backup
Version
Build
Unit Tests
Automatic
Deploy on
„Latest“ Acceptance
Tests Deploy to
Staging
+ Test
Deploy
on
„Deploy“
Deployment Pipeline
Donnerstag, 19. September 13

113. ContentMaster
Live
Backup
Version
Build
Unit Tests
Automatic
Deploy on
„Latest“ Acceptance
Tests Deploy to
Staging
+ Test
Deploy
on
„Deploy“
Deployment Pipeline
Donnerstag, 19. September 13

114. ContentMaster
Live
Backup
Version
Build
Unit Tests
Automatic
Deploy on
„Latest“ Acceptance
Tests Deploy to
Staging
+ Test
Deploy
on
„Deploy“
Deployment Pipeline
Test Strategy
Donnerstag, 19. September 13

115. ContentMaster
Live
Backup
Version
Build
Unit Tests
Automatic
Deploy on
„Latest“ Acceptance
Tests Deploy to
Staging
+ Test
Deploy
on
„Deploy“
Deployment Pipeline
Test Strategy
Feedback for the Team
Donnerstag, 19. September 13

116. Donnerstag, 19. September 13

117. The real live
Donnerstag, 19. September 13

118. Day 1 - Release 1
Donnerstag, 19. September 13

119. Day 2 - Release 2 - “Get ready for Space”
Donnerstag, 19. September 13

120. Day 3 - „People want it so badly“
Donnerstag, 19. September 13

121. New release
deployed
Day 3 - „People want it so badly“
Donnerstag, 19. September 13

122. New release
deployed
Space game
launched
Array scales up
Day 3 - „People want it so badly“
Donnerstag, 19. September 13

123. New release
deployed
Space game
launched
Array scales up
USA wakes up
Day 3 - „People want it so badly“
Donnerstag, 19. September 13

124. Day 4 - Release 3 „Performance Improvement“
Donnerstag, 19. September 13

125. 40% average
CPU usage.
1-2 FE Servers are
enough for normal
operations
Day 4 - Release 3 „Performance Improvement“
Donnerstag, 19. September 13

126. Thanks!
Follow us on Twitter:
AOE: @aoemedia
Daniel P: @danpoetz
Flickr photo contributions in the slide:
http://www.flickr.com/photos/the-wanderers-eye/4494147652/sizes/l/
http://www.flickr.com/photos/51293088@N05/8195327886/sizes/l/
http://www.flickr.com/photos/k1rsch/3818553037/sizes/l/
Donnerstag, 19. September 13