DevOpsDays Tel Aviv 2017

1. BUILDING HIGH SCALE SYSTEM
USING SERVERLESS ARCHITECTURE
FOR A BURNING MAN EVENT
Jonathann Zenou
DevOps DaysTel Aviv 2017

2. DISCLAIMER
• This is not a serverless introduction
• This is about replacing
• This is a not a complicated solution

3. HELLO WORLD
• Jonathann Zenou
• Tel Aviv
• DevOps Engineer @ Oracle

12. MIDBURN.ORG

13. NUMBERS
• Since 2014
• 3rd biggest
• 11000 participants
• 2500 volunteers
• 30 departments

14. MIDBURNTECH
• 50 yearly volunteers
• Perks of being a Non-Profit organisation
• Open source
• Crucial

15. TECHNOLOGY
• Production and Rnd in AWS
• SCM in Github (Open source !)
• Ruby, NodeJS and Java

16. SYSTEMS
• volunteers system
• profile system
• gate system
• …
• ticket selling queue system

17. PROBLEMATIC

18. TICKETS SELLING SYSTEM
• Sold out
• Very high demand in very short time
• Lottery ?
• 2 flash events
• FIFS

19. 1ST ITERATION
• 2014
• Drupal + php + MySQL
• Management of the whole tickets process from
Drupal

20. BUT

22. 1 ST OUTAGE
• ~5000 concurrent users
• ~20 sessions by user

24. REMODELLING

27. REMODELLING
• One queuing system
• One selling system

28. 2ND ITERATION
• 2015
• Backend : Heroku + Reddis + Ruby
• Frontend : Javascript + S3

29. Frontend
CSV

33. 2015

35. 2016

38. 2ND OUTAGE

44. • a lot of users enter the system
• Backend is swamped
• Users hit “refresh”
• Backend is even more swamped

45. WHAT WE UNDERSTOOD ?

48. REMODELLING

49. 3RD ITERATION
• 2017
• Frontend : still Javascript + S3
• Backend : …

51. CREATE AN API GATEWAY API
AS AN AMAZON KINESIS
PROXY
http://docs.aws.amazon.com/apigateway/latest/developerguide/
integrating-api-with-aws-services-kinesis.html

53. Amazon API Getaway

54. Amazon Kinesis Firehose

57. S3 STATIC SITE LOGIC
is the opened
queue page up
?
No
wait 5 seconds
and retry

60. TESTING

61. CROSSING FINGERS
2nd sale of the year

65. NUMBERS
• 15 minutes
• 3315 users
• 300 lucky users
• 4 seconds
• 3 000 000 requests
• 0 errors

66. –Itamar Cohen, Midburn's COO
The Midburn community is composed of thousands of
people.Not everyone can get a ticket and people can
get angry and frustrated from it .With this new
system we ensure that at least if someone does not
get a ticket it’s not because of a technical issue .

69. TECH@MIDBURN.ORG
MIDBURNTECH @ FB

70. QUESTIONS ?