Open vSwitch Fall Conference 2017

1. Experiences with OVN on Kelda
Ethan J. Jackson
Kelda

2. About Me
• Open vSwitch Committer
• UC Berkeley PhD Student
• Advised by Scott Shenker
• Founder, CEO of Kelda
• kelda.io

3. Kelda

4. Rise of Complex Distributed Systems
• Spark
• Hadoop
• Elastic Search
• Logstash
• Kibana
• Redis
• Etcd, Zookeeper, Consul
• …

5. …
Spark
HDFS
Elastic
Search
Ideal
cloud.deploy()

6. Spark
HDFS
Elastic
Search
…
…
Spark
Elastic
Search
…
Spark
HDFS
Elastic
Search

7. Spark
HDFS
Elastic
Search
…
…
Spark
Elastic
Search
…
Spark
HDFS
Elastic
Search
Running in the cloud requires expertise
Acquiring expertise is hard

8. Spark
“I want persistent storage”
Mongo
Acquiring code is easy
$ git clone github.com/mongodb/mongo.git

9. Distributed systems require expertise to operate
Acquiring expertise is hard
Acquiring code is easy
Kelda:
Package expertise in code

10. Encode expertise in JavaScript
$ npm install kelda/spark
const spark = require(‘@kelda/spark’);
let sparkCluster = new spark.Spark(64);

11. Kelda
• JavaScript Blueprint Library
• Everything necessary to operate an
application
• Code, Network, Configuration, etc.
• Deployment Engine
• Consumes Blueprints
• Deploys them to the cloud
new spark.Spark(64);
kelda run sparkRun.js

12. Kelda Deployment Engine

13. Deployment Engine
• Simple deployment of blueprints anywhere
• Amazon, Google, Digital Ocean
• Soon: Azure, Kubernetes, Mesos, OpenStack, VMware, …
• Portability
• Easily change cloud providers
• Key design goal of the system
new Machine({
provider: ‘Amazon’,
cpus: 2,
ram: 16,
})
google

14. Portability
• Platforms have wildly different APIs and abstractions
• Supporting everything, everywhere, consistently, is not tractable
• … except for x86
• Ubuntu VMs are basically the same everywhere
• OVN provides consistent network experience

15. Architecture
Master Master
WorkerWorkerWorker
Kelda Controller
OVN Northd
Etcd
Application Containers
Open vSwitch
STT Overlay

16. OVN Virtual Network Architecture
LLogical Switch
Load Balancer
Container Container Container Container

17. Kelda OVN Customizations
• OVS Docker containers
• docker pull keldaio/ovs
• STT
• kelda-int bridge
• Intercepts packets before OVN
Container kelda-int br-int

18. General Impressions of OVN
Good things

19. Extremely Stable
• By far the most stable part of the project
• We’ve had more Linux Kernel panics than OVN crashes …
• Even back in the early releases …

20. Performance
Kelda

21. Roadmap
• Features we need magically appear …
• Address Sets
• IPAM
• DNS
• Localnet

22. General Impressions of OVN
Opportunities for improvement

23. ACL Scaling
• Kelda does micro-segmentation
• ACLS tend to grow at O(N^2)
• Before address sets this was catastrophic
• OpenFlow rules still a problem

24. OVSDB API Language Support
• OVSDB has a great C API
• Hard to interact with from go
• Go is the de-facto standard for container infrastructure
• Docker, Kubernetes, Etcd, …
• A GRPC front-end would go a long way …

25. Marketing
• Networking for containers is crowded
• Calico, Contiv, Contrail, Flannel, Cilium, Weave, Envoy, Istio …
• OVN compares favorably with these systems
• ... yet is not as well known in this community
• Small improvements could help a lot
• Dedicated OVN Website
• Getting Started Guide
• Tutorials

26. Wrapping up
• Kelda encodes operational expertise in JavaScript
• Deploys that expertise portably across cloud providers
• Makes heavy use of OVN to achieve this
• Try it out at kelda.io
• Simple way to play around with OVN

27. Thanks
kelda.io