On our way to transition our private cloud from small to larger scale, we @ Runtastic hit the limits of our classic enterprise storage infrastructure. The next step was quite obvious for us: Ceph. Author Biography Armin Deliomini works as linux / virtualization / database engineer at Runtastic that startet his way on the very commercial side with mainly VMware and Oracle and over time evolved to use opensource products only. In the beginning of 2013 he started to plan and implement a private infrastructure for the Runtastic ecosystem with more than 60 000 000 registered users.

1. Take the next step …
Armin Deliomini
Senior Infrastructure Architect

2. To add a picture:
Insert → Image…
Runtastic
Runtastic is a leader in the digital
health and fitness space and provides
a comprehensive ecosystem for
tracking and
managing health and fitness data. Our
goal is to reach as many people as
possible and help them become more
aware of their current daily habits and
improve their overall life.

3. To add a picture:
Insert → Image…
Runtastic
✓ founded 2009
✓ located in Pasching (Austria)
✓ part of Adidas group
✓ 160 000 000 app downloads
✓ 75 000 000 registered users
✓ 140 employees

4. Infrastructure
Linux Firewalls
NFS (Netapp)
Chef
...
Data
Cassandra cluster
used as simple key -
value store
Opennebulaphysical DB
2800 cores
12 TB memory
Technologies
VMs
400x different
purpose virtual
machines
physical DBs
Percona

5. ● scale out
● higher resilience
● consolidation
Why changing?

6. NetApp
✓ Enterprise storage
✓ NFS
✓ 10G network
✓ 24x SAS disks
✓ good IOPS performance

7. Ceph cluster
✓ Scale out
✓ distributed storage
✓ office cluster
○ 5 Hosts
○ 15 Journal SSDs
○ 60 OSDs (SATA)
○ 20TB replicated net space
✓ production cluster in prep.
○ 20 Hosts
○ 120 OSDs (SAS)
○ 20 TB replicated net space

8. Integration in Opennebula
● quite easy
● create ceph keyring and roll out to all client nodes
● create ceph pool(s)
● create datastore using the pool
● create images and fire up machines

9. Ceph Learnings
● Use appropriate hardware
○ SSDs
○ Network
● Ceph is not the answer to everything
● try understanding how ceph really works

10. ● we dropped our LXC integration plan
○ we have a LXD integration plan now
● network has to be redesigned
● use Opennebula how it should be used
○ let users manage their machines for development, staging and preproduction
○ set up marketplace
● pets vs cattle
○ treat more services like cattle and not pets
What else?

11. Questions?

12. runtastic.com
@Runtastic
runtastic
+runtastic
Thx!