OpenIO's presentation at the A3TechLive event.
Not only storage but also back-ends for scale-out applications:
- full text indexation
- transcoding
- analytics
Thanks to Grid for Apps!
5. 2006
Idea &
1st concept
2007
Design
dev starts
2009
1st massive
production
above 1PB
2015
OpenIO
fork
2012
Open
sourced
2014
10+ PB
managed
Technology created for 2 large European telcos
60M emails accounts - 2.5M cloud accounts
9. Consistent hashing
Each node owns a part
of the key space
New nodes get parts of the key
space from the older ones
Never rebalance
DIFFERENT
Recalculate key space
Scaling
11. OpenIO
New nodes automatically
discovered and
immediately available
Scaling
Immediate benefits
in terms of performance
from the new nodes
Never rebalance
DIFFERENT
12. 1. Collects metrics from the services of
each node
2. Computes a score for each service
3. Distributes scores to every nodes and
clients
4. On the fly best match making for each
request
Conscience
UNIQUE DESIGN
Realtime load balancing
for optimal data placement
The score is computed with a configurable formula
usually based on: capacity, io performance, CPU
13. >_
Amazon S3® OpenStack
Swift®
Optimized
native APIs
• C
• Python
• Java
• Go
Command line
interface
APIs
INTEROPERABILITY
14. Storage Email Video
Connectors
INTEROPERABILITY
• File System (NFS)
• OpenStack SWIFT
• Amazon S3
• Cyrus Imap
• Zimbra
• Mail Object
• Dovecot
• HTTP connector
• Adaptive streaming connector
• Event based transcoding
15. 2.
No data
rebalancing
when scaling
Full software
solution with
support for
heterogeneous
hardware
3.
We are unique
1.
Open Source
Open core
Business Model
4.
0TB >
1000+PB
Easy to start
with and scale
later
5.
Grid for Apps
and specific app
connectors
16. At OpenIO, we go beyond scale-out storage
benefits and to provide a new way to build
backend services for applications.
Full text indexation. Transcoding. Analytics.
17. 2009
Major European Telco
2012
Major European Telco
STORAGE
BANDWIDTH
OBJECTS
10 PB
20 Gbps IN+OUT
10 billion
2 PB
4 Gbps IN+OUT
500 million
Strict SLAs on response times
650 nodes
16 million mailboxes 44 million mailboxes
2.5 million cloud accounts
References
120 nodes
20. Deploy in Production
20
Available Puppet templates
for every OpenIO service
Automation toolPackage repositories
Redhat Enterprise Linux 7 / CentOS 7
Fedora 21 / 22 / 23
Ubuntu 14.04 / 15.10 - Debian 8 Jessie
1 2 3
21.
22. Grid Viewer
•Helps visualize the complexity of large clusters
•Map of the "grid of nodes"
•Gaming approach "Build your infrastructure!"
Ease of deployment
•Drag’n’Drop services
WebUI
25. Legacy Application aware
Data services
Software
Hardware
pure software for any HW
grid for apps
tailored for vertical markets
Object stores
Swifstack
Ceph
Scality
OpenIO
Cleversafe
Cloudian
DDN
NetApp
26.
27. #1
helping us with the US launch
Former VP Marketing VMware,
Cumulus Networks, Nimbula,
etc.
Reza Malekzadeh
28. New release 16.04 in beta
• WebUI to manage the cluster
• COSBench connector
• Ready for better OpenStack integration (more than Swift):
Keystone, Manilla, etc.
• New "Grid for Apps" use cases (see next slide)
#2
29. New "Grid for Apps" use cases
• For a worldwide anti-spam company
• Ingest, store, index and search inside years of spam samples
• For a major French telco
• Ingest, store, transcode UGC (User Generated Content) videos
#2
30. Next Shows
NAB Show in Las Vegas, NV - April 18 - 21
OpenStack Summit in Austin, TX - April 25 - 29
#3
31. #4
UBI I/O 2016
• Acceleration program in San Francisco
• Competition between 200 startups
• Helps startups to settle in the US
• Achieve in 10 weeks what normally takes 10 months