3. Manifests
express
intent
K8S used with special care for apps requiring
persistence because they require brittle tight
coupling.
Container 1 Container 2 Container 2
Hard wired connections via plug-in
stateless stateful
NAS SAN S3 NAS SAN S3
Without OpenEBS DevOps workflow broken
4. Manifests
express
intent
stateless stateful
No changes to DevOps workflow even for containers requiring
persistence. Users manifest their intent and the storage and
storage controllers adjust automatically as needed.
OpenEBS
Policy engine
Remote Storage
Local Storage
OpenEBS Storage
Hosts
OpenEBS VSMs
OpenEBS Storage Cluster
APIs
Containers and underlying storage,
local on host or dedicated storage
pods OR remote S3 or EBS storage
all grouped into a storage cloud that
just works. Billing by AWS.
Manifests
express
intent
With OpenEBS the workflow works
5. OpenEBS 0.2 ( Ready For Trials! )
https://github.com/openebs/openebs/releases/tag/v0.2
(Beta) Integrated with Kubernetes
(Beta)High Availability via Sync Replication
(Beta) Block Storage (available via iSCSI)
(Alpha) Data Protection ( Local Snapshots )
(Alpha) Data Backup with Amazon S3
6. OpenEBS 0.2 ( Ready For Trials! )
https://github.com/openebs/openebs/releases/tag/v0.2
(Beta) Integrated with Kubernetes
(Beta)High Availability via Sync Replication
(Beta) Block Storage (available via iSCSI)
(Alpha) Data Protection ( Local Snapshots )
(Alpha) Data Backup with Amazon S3
7. OpenEBS - Word of mouth
Containerized storage for containers
Calico / Flannel owns networking for K8S. OpenEBS owns
storage.
The only open source solution built for this. CEPH is not built
to be containerized.
I run (use) OpenEBS just like I run (use) K8S (EBS).
OpenEBS got the storage ops off my back! Because of OpenEBS
we are rolling into production.
18. But where is my Data Stored?
PVC
StorageClass
DynamicProvisioners(TPR)
PV
Volume Stats Monitoring
Volume Snapshots Scheduling(?)
Enterprise Storage Servers! ( SAN/NAS )
19. Enterprise Storage Servers!
PVC
StorageClass
DynamicProvisioners(TPR)
PV
Volume Stats Monitoring
Volume Snapshots Scheduling(?)
Disk Management Layer
Core Storage Features
HA/Multipath Layer
Provisioning/SDS
S
C
A
L
E
P
E
R
F
O
R
M
A
N
C
E
MultiTenancy/RBAC
Monitoring/Alerting
Enterprise Storage Servers! ( SAN/NAS )
20. Enterprise Storage Servers!
PVC
StorageClass
DynamicProvisioners(TPR)
PV
Volume Stats Monitoring
Volume Snapshots Scheduling(?)
Disk Management Layer
Core Storage Features
HA/Multipath Layer
Provisioning/SDS
S
C
A
L
E
P
E
R
F
O
R
M
A
N
C
E
MultiTenancy/RBAC
Monitoring/Alerting
Another Monolithic Software!
Enterprise Storage Servers! ( SAN/NAS )
21. Enterprise Storage Servers!
PVC
StorageClass
DynamicProvisioners(TPR)
PV
Volume Stats Monitoring
Volume Snapshots Scheduling(?)
Disk Management Layer
Core Storage Features
HA/Multipath Layer
Provisioning/SDS
S
C
A
L
E
P
E
R
F
O
R
M
A
N
C
E
MultiTenancy/RBAC
Monitoring/Alerting
http://www.cloudbyte.com/
Enterprise Storage Servers! ( SAN/NAS )
22. Enterprise Storage Servers!
PVC
StorageClass
DynamicProvisioners(TPR)
PV
Volume Stats Monitoring
Volume Snapshots Scheduling(?)
Disk Management Layer
Core Storage Features
HA/Multipath Layer
Provisioning/SDS
S
C
A
L
E
P
E
R
F
O
R
M
A
N
C
E
MultiTenancy/RBAC
Monitoring/Alerting
Can this benefit from moving
to Docker Containers ??
Enterprise Storage Servers! ( SAN/NAS )
23. Enterprise Storage Servers!
PVC
StorageClass
DynamicProvisioners(TPR)
PV
Volume Stats Monitoring
Volume Snapshots Scheduling(?)
Disk Management Layer
Core Storage Features
HA/Multipath Layer
Provisioning/SDS
S
C
A
L
E
P
E
R
F
O
R
M
A
N
C
E
MultiTenancy/RBAC
Monitoring/Alerting
Can this benefit from moving
to Docker Containers ??
Enterprise Storage Servers! ( SAN/NAS )
24. Powered By Kubernetes
Scheduling/Managing/Monitoring Volumes at Scale
Rolling Upgrades of Volumes ( No more Storage controller maintenance Windows)
Federated Clusters ( Hybrid Clouds Deployments - Mobility)
Focus on the Core Storage Features - Delivered Via Containers!
- Smart Capacity Management
- Volume Latency Monitoring and Auto-healing
- Adapt to varying workloads - Application Aware Storage (Zones)
- In tune with the latest in the Storage Hardware Advancements
- Storage Analytics!
25. Collaborating with Rancher (Jiva)
fapi-server
qorum-net
fe-iscsi fe-tcmu
IO Processor
meta-cacheReplication/Multiplex
snap
control
monitor
key-vault
Front-end Container
Backend Container
Container Image: https://hub.docker.com/r/openebs/jiva/
stats-db IO Store
Backend Store
snap r/w
snap-s3 snap-local
Storage Features (Caching, Compression)syncer
bapi-server
key-vault
26. Deeper Integration with Orchestration (Maya)
mStorageManage
r
OpenEBS Maya Master
OpenEBS Storage Host
mAPI
mOperator
mConnect
mAnalytics
27. VSM - Containerized Storage Stack
(5) NVMe Flash or
Storage Backends
attached to Docker Hosts
(3) Backend Containers
to Persist Data
[Cached, Protected]
(1) Frontend Containers
[N/w Storage Service
iSCSI/NFS]
(2) Sync Replication
[Replicated to
different locations]
Local
Disks
NAS
or
SAN
Cloud
Storage
(4) Persistence Disk
Partitions from local
hosts.
Frontend Containers and Backend Containers
encapsulate the storage functionality in docker
images. These containers are scheduled using
orchestration engines like Kubernetes.
OpenEBS Maya Orchestration layer will manage
different types of storage and helps in carving
out the required persistent disks / cache for
Backend Containers.
Maya Orchestration Services can be deployed as
containers in K8s.
28. Network
Data
(Maya API Server)
(Maya Operator)
(maya cli)
OpenEBS 0.3
K8s master
K8s minions
VSM or Storage PodApplication Pod
TCMU/iSCSI
(Maya Storage Manager(D))
(maya cli)
Application ( yaml )
Containerized Storage for Containers!
32. Where does OpenEBS fit?
DevOps and containers are the future
Which is already here, but unevenly distributed
Real computing needs persistence
But - persistence for DevOps & containers is broken