Tiles Under Heavy Artillery - Serving One Billion Maps Per Month
•Download as PPTX, PDF•
1 like•241 views
Tiles Under Heavy Artillery - Serving One Billion Maps Per Month by Löic Ortola of Jawg Maps Presented on 23/09/16 at State Of The Map 2016 in Brussels, Belgium Presentation Description: Some people wonder whether Open Street Map (OSM) can be a great fit for their business. In this talk, we are not going to discuss the documentation, maintainability, updates, and robustness issues of OSM-based maps. Neither will we try convincing you that going for OSM is an easy task. In this talk, we decided to save our breath, take out our heaviest Gatling weaponry and start shooting instead. Can serving maps with OSM be an efficient, distributed, business-grade system? Bring your bulletproof vest and come find out Slide 11 video: https://youtu.be/ApnECVw66u0 Slide 15 video: https://youtu.be/GPLJYreFZhI Slide 18 video: https://youtu.be/ceROljqkLVs
Recommended
Recommended
More Related Content
Similar to Tiles Under Heavy Artillery - Serving One Billion Maps Per Month
Similar to Tiles Under Heavy Artillery - Serving One Billion Maps Per Month (20)
Recently uploaded
Recently uploaded (20)
Tiles Under Heavy Artillery - Serving One Billion Maps Per Month
- 1. © Copyright 2016 Jawg 1 Tiles under heavy Artillery Loïc Ortola http://jawg.io
- 2. © Copyright 2016 Jawg 2 Maps before Maps have changed
- 3. © Copyright 2016 Jawg 3 Maps today
- 4. © Copyright 2016 Jawg 4 Is OpenStreetMap business-grade?
- 5. © Copyright 2016 Jawg 5 What does business-grade mean? Efficient Scalable Available Elastic Support
- 6. © Copyright 2016 Jawg 6 OpenStreetMap • Community-driven • Experienced• Independent
- 7. © Copyright 2016 Jawg 7 https://github.com/openstreetmap/ osm2pgsql/blob/master/README .md http://wiki.openstreetmap.org/wiki/Osmosis/Replication OpenStreetMap… map servers?
- 8. © Copyright 2016 Jawg 8 Entry cost to OpenStreetMap
- 9. © Copyright 2016 Jawg 9 OpenStreetMap for business 1. Introduction 2. The market of maps 3. Map services 1. Definition 2. Geocoding 3. Routing 4. Tiles 5. GIS 4. Constraints / architecture 5. Case study : mapping platforms 1. Primitives 2. KPIs 3. Bottlenecks 4. Market Solutions 6. Analysis 1. Scenario 2. Documentation 3. Support services 4. Scalability 5. Service-discovery compatibility 6. Cloud integration 7. Assuming people are paying attention 6. I am pretty sure No one will ever read this line 7. If you did though, I guess I owe you a beer 8. A real beer. You know, since we’re in Brussels… 8. It’s been a long day don’t you think? 6. About that beer… My twitter is @loicortola 9. Results 10. I - need - pizza 11. Raw data 12. Conclusion
- 10. © Copyright 2016 Jawg 10 OpenStreetMap for business 1. Introduction 2. The market of maps 3. Map services 1. Definition 2. Geocoding 3. Routing 4. Tiles 5. GIS 4. Constraints / architecture 5. Case study : mapping platforms 1. Primitives 2. KPIs 3. Bottlenecks 4. Market Solutions 6. Analysis 1. Scenario 2. Documentation 3. Support services 4. Scalability 5. Service-discovery compatibility 6. Cloud integration 7. Assuming people are paying attention 6. I am pretty sure No one will ever read this line 7. If you did though, I guess I owe you a beer 8. A real beer. You know, since we’re in Brussels… 8. It’s been a long day don’t you think? 6. About that beer… My twitter is @loicortola 9. Results 10. I - need - pizza 11. Raw data 12. Conclusion
- 11. © Copyright 2016 Jawg 11 Can OSM services sustain a worldwide zombie infection?
- 12. © Copyright 2016 Jawg 12 The Zombie Pandemic Virus = ZOMBIES Most services down
- 13. © Copyright 2016 Jawg 13 The Zombie Pandemic • OSM app launched: WAZE World Against the Zombie Epidemic • Localizes Safe Zones and resources
- 14. © Copyright 2016 Jawg 14 The Zombie Pandemic Scenario 200,000 potential users @ 8pm local release 1.12 billion 16% of population uninfected 1.12 million 0.1% of remaining pop. w/ access
- 15. © Copyright 2016 Jawg 15 The Zombie Pandemic Scenario Main.mp4
- 16. © Copyright 2016 Jawg 16 Load testing tool • Cluster mode • Proper metrics • Live reporting
- 17. © Copyright 2016 Jawg 17 Architecture Injectors Caches Load-balancer Renderers CPU: 32RAM: 120GB BW: 2Gb/s Software: mod_tile, renderd, postgresql CPU: 8RAM: 30 GB BW: 2 Gb/s Software: squid3 CPU: 8RAM: 30 GB BW: 2 Gb/s Software: HAProxy CPU: 16RAM: 60 GB BW: 2 Gb/s Software: Gatling Internet
- 18. © Copyright 2016 Jawg 18
- 19. © Copyright 2016 Jawg 19 YES Objective: 1 billion maps Reached: 56 billion maps WAZE successfully saved the planet Can OSM services sustain a worldwide zombie infection?
- 20. © Copyright 2016 Jawg 20 Load testsNew bottlenecks In reality Tuning storm • > 50 Gbps BW • Saturation of Cloud’s internal switch infrastructures • Kernel • Configuration • Load-balancing +50 load tests to find the most adequate simulation
- 21. © Copyright 2016 Jawg 21 The Bottleneck Podium
- 22. © Copyright 2016 Jawg 22 The State Of The Map (Server) Efficient Scalable Available Elastic Support
- 23. © Copyright 2016 Jawg 23 White Papers 1. Map services: from theory to implementation • Available now @ jawg.io 2. Map services: Benchmarks & high-scale profiles • To be released in November 2016
- 24. © Copyright 2016 Jawg 24 Thank You Loïc Ortola @LoicOrtola @jawgio
Editor's Notes
- Hello, My name is Loïc Ortola, and I am part of the Jawg maps family
- 20 Years ago, when most people were hearing the word “maps”, this is what they’d imagine. That little piece of paper you’d see in your glove compartment, lying under an old melted chocolate bar from last year Back then, making a trip was something you planned in advance, at home.
- Today, maps have completely reshaped our vision of transit In fact, maps are now everywhere. In your mall, in your building, integrated within your car. Now, maps are in your pocket 24 hours a day, You don’t only use them before but also in real-time. When you exit the metro, to catch the nearest Pokemon, to be driven home at night More importantly, every single one of you are here in this room because of a map. There isn’t a single person here which has not seen or used a map in the last 24 hours. (Alright, maybe the odds are a little bigger than usual in this room, but whatever) When digital maps started to appear, a whole new world of services started popping out. But someone had to provide those maps. Great mapping leaders started to emerge. With their awesome features, and their limitations.
- When maps become critical assets for a service … new matters come into play. Independence Data Governance / Intellectual Property Custom needs OpenStreetMap = most open option Is it business grade?
- What does business-grade even mean? Among other things, a business grade service usually means that it is: @Antoine Efficient, Scalable, Available, (and that you might get some support out of it.>> Ne pas oublier d’en parler à la fin)
- OSM is a great solution: Its licensing model is awesome, community-driven, etc… 12 years of experience -> it’s a sure thing
- It gets trickier the second you open the pandora’s box to setup your first map server. A few years ago, when we started working with OSM, someone told me “don’t worry, OSM is like a stairway, you’d rather take the elevator, but once you reach the first step, you just forget about the rest and move up” It took me years to understand what he meant. But I finally got it. Ladies and gentleman, I am proud to share with you
- I know you gave me 30 minutes, and such a question would require a decent amount of explanation. If we had all day, this is what we would be covering You know what? That’s boring”
- If we get back to our original question “Is OpenStreetMap business-grade?” We could probably find some better way to assert that than going over the big picture. We thought : wouldn’t it be better to try to show a real-world example proving that an OSM application is business-grade? So tonight, instead, we wanted to answer a really important question. A question that keeps everyone up at night. A question you may not even have dared to ask yourself:
- TODO: rajouter un zombie, changer la carte
- Zombies have infected earth
- A community of OpenStreetMap contributors
- 84% contaminated Thanks
- Description scénario gatling
- 3 things: In terms of architecture, we wanted to stick to the classic OpenStreetMap stack: ImpOSM, mod_tile, renderd, squid. What changed is that we tried to do an elastic scenario: when the demand gets higher, new servers get spawned until it reaches the pool limit.
- 99th percentile: 2.1s
- 99th percentile: 2.1s
- We are running out of time so I wont get into much details For instance, two nights ago, we went so high on activity that we triggered OVH’s internal Anti-DDoS system Which pretty much quarantined all our servers in a blink of an eye.
- 3 – CPU & I/O Cache / proxy servers (Squid, nginx, …) with disk cache need some memory caching strategy to avoid making too much disk reads Rendering & PostGIS DB heavy on CPU & I/O Consider mounting your whole DB on SSD or in-memory Consider buffy rendering machines 2 – Tile Overdraw Different rendering servers can work on rendering the same meta-tiles Lack of renderer orchestration Lack of meta-tile aware load balancers 1 – Network Network bandwidth Most cloud providers provide between 100mbps – 1Gbps of bandwidth. 1 uncompressed tile 15kB 10k tiles/s 1 Gbps Network connections On buffy caches / load balancers with high throughput (~40k tiles/s) network IRQ and socket use can impact performance