Mark McClain - OpenStack Quantum Networking

•

4 likes•2,132 views

Cloud Native Day Tel Aviv

Technology

OpenStack Networking
Mark McClain
OpenStack Networking Project Technical Lead
mark.mcclain@dreamhost.com

Challenges in the Cloud
• High-density multi-tenancy
–ButVLANs have trouble scaling
• On-demand provisioning
–But traditional network solutions
have interfaces designed for manual
configuration.
• Need to place / move
workloads were capacity
exists
–But network state (e.g., IP address)
is tied to a particular location
© Malcolm Leman | Dreamstime.com

Tackling these challenges
–Network virtualization
–Overlay tunneling:
VXLAN, NVGRE, STT
–Software-defined
Networking (SDN) /
OpenFlow
–L2 Fabric solutions:
FabricPath, Qfabric, etc.
–???

Basic Abstractions
Net1
10.0.0.0/24
Nova
Quantum
L2 virtual network
virtual port
virtual server
virtual interface (VIF)
virtual subnet
VM1VM1
10.0.0.210.0.0.2
VM2VM2
10.0.0.210.0.0.2

Using the API...
VM1VM1
10.0.0.210.0.0.2
VM1VM1
10.0.0.210.0.0.2
VM2VM2
10.0.0.2/172.16.77.210.0.0.2/172.16.77.2
VM2VM2
10.0.0.2/172.16.77.210.0.0.2/172.16.77.2
VM3VM3
172.16.77.1172.16.77.1
VM3VM3
172.16.77.1172.16.77.1
Tenant Net1
192.168.0.0/24
Tenant Net2
172.16.77.0/24
Public Net
10.0.0.0/8
RouterRouterRouterRouter

Architecture
A generic tenant API to
create and configure
“virtual networks”
A “plugin” architecture with
different back-end “engines”
An eco-system of tools
that leverage the
Network API.
Tenant Tools
(GUI, CLI, API
code)
Compute APICompute APICompute APICompute API
Network APINetwork APINetwork APINetwork API
Storage APIStorage APIStorage APIStorage API
Generic OpenStack APIs Operator Selected Backends
KVMKVMKVMKVM
OVS pluginOVS pluginOVS pluginOVS plugin
CephCephCephCeph

Quantum Architecture
Tenant Scripts
Horizon GUI
Orchestration Code
Quantum API
Create-net
.
.
.
Create-port
Uniform API for all
clients
API Extensions
Plugin
X
Nova Compute
virtual switch
Physical Network
Quantum Server BackendsAPI Client

Metadata
• Simplified Configuration
• Supports Overlapping IPs
Non-routed networks

Security Groups
• Supports Overlapping IPs
• HandlesVMs with multiple
NICs
• Ingress / Egress rules
• IPv6 matching
• Plugins can offload
http://www.flickr.com/photos/mikebaird/2354116406/

Load Balancing
• Load Balancing API Model
• Pluggable Framework
• Reference Implementation with HAProxy

New Plugins
•Big Switch /Floodlight
•Brocade
•Hyper-V
•Midokura
•PlumGrid

Quantum Plugins
Open vSwitch / Linux Bridge
Ryu OpenFlow
Controller

Grizzly Horizon
•Manage Routers
•Graphical view of network
topology
•Specifying multiple NICs when
booting aVM
•Load Balancer Control

Grizzly Horizon
•Select NICs when booting

Other Features
• Multiple Network Node Support
• XML API
• Seamless Upgrade from Folsom to Grizzly

• Improved IPv6 support
• Improved Bare Metal Support
• Updated Client Library
• MoreVendor Plugins

Community Initiatives
• Modular L2 and L3
• Database profiling
• Improving Testing
• Exploring Nova-Net Migration Paths

More Information
• Installation and Admin Manual
•http://docs.openstack.org/trunk/openstack
-network/admin/content/

Questions?
Mark McClain
OpenStack Networking Core Developer and PTL
mark.mcclain@dreamhost.com

What's hot

Witness the enablement of a true integration of a virtual network platform and an underlay physical network for a scalable data center orchestration, automation and multi-tenancy solution over high-capacity IP fabrics. With the integration of VMware NSX Layer 2 gateway services on networking hardware running Cumulus Linux, customers can now connect virtual workloads to physical workloads with no performance impact.

VMware NSX + Cumulus Networks: Software Defined Networking

Cumulus Networks

NSX-MH

sethuraman ramanathan

OpenStack Quantum: Cloud Carrier Summit 2012

Dan Wendlandt

Evolution of Network Virtualization

Pavan Hasabnis

VMware NSX 101: What, Why & How

Aniekan Akpaffiong

An Introduction to VMware NSX

Scott Lowe

Slides from the SFBay OpenStack Meetup TOPIC: Unified Underlay and Overlay SDNs for OpenStack Clouds ABSTRACT: With unified underlay and overlay SDNs, IT and operators can leverage best of both technologies to build service-rich SDNs for OpenStack clouds. At this meet up, PLUMgrid will discuss an overlay SDN architecture for service rich SDNs with service function chaining for 3rd party VNFs and demonstrate how to build that using Cisco Nexus 9K as the underlay to leverage the power and throughput of the Nexus fabric.

Unified Underlay and Overlay SDNs for OpenStack Clouds

PLUMgrid

Architecting data center networks in the era of big data and cloud

bradhedlund

CloudStack + SDN

Chiradeep Vittal

ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now,...

OpenNebula Project

The Vision for the Future of Network Virtualization with VMware NSX

Scott Lowe

Open stack journey from folsom to grizzly

openstackindia

CloudStack Networking

CloudStack - Open Source Cloud Computing Project

Nova for Physicalization and Virtualization compute models

openstackindia

MidoNet Future -ミドネットの未来-

Midokura

SDN and network virtualization connecting Docker containers to provide truly large scale and elastic cloud IaaS services. By eliminating network boundaries among Docker hosts, worldwide distributed containers over Docker orchestrators can be connected in Tenant SDN Controller (TSC). Docker platform's network thus become virtualized so that this great platform now no longer has to be limited to PaaS use (unlike IaaS use, PaaS uses are user specific and hence do not demand scalability.)

Connecting Docker for Cloud IaaS (Speech at CSDN-Oct18

DaoliCloud Ltd

Here is the presentation I gave during Synergy 2012 in SFO on our performance tuning efforts in the AOL production network. The presentation gives details on the various tcpprofile options, examples of our custom profiles and the impact these had on the service. At the end is a section on troubleshooting and what snmp oids we watch for early problem detection. Feel free to ask questions or make comments.

NetScaler TCP Performance Tuning

Kevin Mason

OpenStack deployments for public or private clouds require overlay networking. Due to the scale and rate of change of virtual resources, it isn't practical to rely on traditional network constructs and isolation mechanims. Today's deployments require performance, resilience, and high availability to be considered truly production-ready. In this session, we deep dive into the MidoNet architecture, and process of sending a data packet across an OpenStack environment through a network overlay. A distributed architecture implements logical constructs that are used to build networks without a single point of failure, all while adding network functionality in a highly-scalable manner. Network functions are applied in a single virtual hop. By applying network services right at the ingress host, the network is free from unnecessary clogging and bottlenecks by avoiding additional hops. Packets reach their destination more efficiently with the single virtual hop. After this session, the audience will understand how distributed architectures allow efficient networking with routing decisions and network services applied at the edge. Also, the audience will understand how it is easier to scale clouds when the network intelligence is distributed.

Midokura OpenStack Day Korea Talk: MidoNet Open Source Network Virtualization...

Dan Mihai Dumitriu

Demystifying OpenStack for NFV

Trinath Somanchi

Bringing Private Cloud computing to HPC and Science - EGI TF tf 2013

Ignacio M. Llorente

What's hot (20)

VMware NSX + Cumulus Networks: Software Defined Networking

NSX-MH

OpenStack Quantum: Cloud Carrier Summit 2012

Evolution of Network Virtualization

VMware NSX 101: What, Why & How

An Introduction to VMware NSX

Unified Underlay and Overlay SDNs for OpenStack Clouds

Architecting data center networks in the era of big data and cloud

CloudStack + SDN

ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now,...

The Vision for the Future of Network Virtualization with VMware NSX

Open stack journey from folsom to grizzly

CloudStack Networking

Nova for Physicalization and Virtualization compute models

MidoNet Future -ミドネットの未来-

Connecting Docker for Cloud IaaS (Speech at CSDN-Oct18

NetScaler TCP Performance Tuning

Midokura OpenStack Day Korea Talk: MidoNet Open Source Network Virtualization...

Demystifying OpenStack for NFV

Bringing Private Cloud computing to HPC and Science - EGI TF tf 2013

Viewers also liked

E northeastaward2013 nic mizoram

pramaniksandip

Project Blueprint Networking

Jennifer Wilson

AD-CONNECT SMS Presentation

ADCONNECT

Smart School Blueprint

Maria Ting

Jbptunikompp gdl-rudiramlan-28836-16-sistemi-

Karin Novilda

Harvard Student Information System Implementation Update

kevin_donovan

Pemodelan 2 dimensi

Heruzulkifli Heruzulkifli

Graduation Project Proposal October 2014

ahmed gamal

Perkiraan Biaya Proyek

Muhammad Amri

Contoh proposal-proyek

Nighter Faris

Pelayanan publik & e-government

ajengparamuditha

Website Proposal for Demure Dental Clinic

PakStockPhoto

KEBIJAKAN DAN STRATEGI PENGEMBANGAN E-GOVERNMENT DI INDONESIA

Awang ANWARUDDIN

Desain sistem aplikasi e government berbasis free and open source software

e-government Kaltim

Proposal Proyek Aplikasi Web Percetakan

subhan

Membangun e-Government di Indonesia

Mohamad Adriyanto

Contoh Proposal Portofolio Penawaran Aplikasi e-PublicInfo by Edi Ismanto

eddie Ismantoe

Proposal aplikasi pariwisata berbasis web

Ihsan Nurhalim

Viewers also liked (18)

E northeastaward2013 nic mizoram

Project Blueprint Networking

AD-CONNECT SMS Presentation

Smart School Blueprint

Jbptunikompp gdl-rudiramlan-28836-16-sistemi-

Harvard Student Information System Implementation Update

Pemodelan 2 dimensi

Graduation Project Proposal October 2014

Perkiraan Biaya Proyek

Contoh proposal-proyek

Pelayanan publik & e-government

Website Proposal for Demure Dental Clinic

KEBIJAKAN DAN STRATEGI PENGEMBANGAN E-GOVERNMENT DI INDONESIA

Desain sistem aplikasi e government berbasis free and open source software

Proposal Proyek Aplikasi Web Percetakan

Membangun e-Government di Indonesia

Contoh Proposal Portofolio Penawaran Aplikasi e-PublicInfo by Edi Ismanto

Proposal aplikasi pariwisata berbasis web

Similar to Mark McClain - OpenStack Quantum Networking

Network virtualization with open stack quantum

Miguel Lavalle

Open stack networking_101_update_2014-os-meetups

yfauser

Quantum - Virtual networks for Openstack

salv_orlando

Network Virtualization for Cloud Services Infrastructure

Shahryar Ali

PLNOG 8: Ivan Pepelnjak - Cloud Networking - From Theory to Practice

PROIDEA

Cloudstack networking2

Hiroaki Kawai

OpenStack Networking and Automation

Adam Johnson

VXLAN Practice Guide

Prasenjit Sarkar

OpenStack 2012 fall summit observation - Quantum/SDN

Te-Yen Liu

OpenStack Paris Summit: Bridges and Tunnels: A Drive Through OpenStack Networ...

markmcclain

An in-depth critique of the existing OpenStack networking approach, with a focus on how the Nova network controller is more of a hindrance than a help. Discusses the gap in Quantum's functionality required to close the gap, and alternative solutions. How can we make networking in OpenStack robust, high performance, and fault tolerant? What do typical large scale networks look like and what lessons can we learn from them? Is there an approach to networking we can take that is the same with a handful of servers as it is with hundreds of racks?

Networking is NOT Free: Lessons in Network Design

Randy Bias

Am 04 track1--salvatore orlando--openstack-apac-2012-final

OpenCity Community

Navigating OpenStack Networking

PLUMgrid

Openstack Basic with Neutron

KwonSun Bae

Network and Service Virtualization tutorial at ONUG Spring 2015

SDN Hub

Abstract OpenStack and OpenContrail network virtualization solution form a complete suite able to successfully handle orchestration of resources and services of a contemporary cloud installations. These projects, however, have been only available for Linux hosted platforms by now. This talk is about a work underway that brings them into the FreeBSD world. It explains in greater details an architecture of an OpenStack system and shows how support for the FreeBSD bhyve hypervisor was brought up using the libvirt library. Details of the OpenContrail network virtualization solution is also provided, with special emphasis on the lower level system entities like a vRouter kernel module, which required most of the work while developing the FreeBSD version. Speaker bio Michal Dubiel, M.Sc. Eng., born 17th of September 1983 in Kraków, Poland. He graduated in 2009 from the faculty of Electrical Engineering, Automatics, Computer Science and Electronics of AGH University of Science and Technology in Kraków. Throughout his career he worked for ACK Cyfronet AGH on hardware-accelerated data mining systems and later for Motorola Electronics on DSP software for LTE base stations. Currently he is working for Semihalf on various software projects ranging from low level kernel development to Software Defined Networking systems. He is mainly interested in the computer science, especially the operating systems, programming languages, networks, and digital signal processing.

OpenStack and OpenContrail for FreeBSD platform by Michał Dubiel

eurobsdcon

Understanding network and service virtualization

SDN Hub

Quantum PTL Update - Grizzly Summit.pptx

OpenStack Foundation

Networking is the barrier to Cloud

Somik Behera

VMworld 2013: Advanced VMware NSX Architecture

VMworld

Similar to Mark McClain - OpenStack Quantum Networking (20)

Network virtualization with open stack quantum

Open stack networking_101_update_2014-os-meetups

Quantum - Virtual networks for Openstack

Network Virtualization for Cloud Services Infrastructure

PLNOG 8: Ivan Pepelnjak - Cloud Networking - From Theory to Practice

Cloudstack networking2

OpenStack Networking and Automation

VXLAN Practice Guide

OpenStack 2012 fall summit observation - Quantum/SDN

OpenStack Paris Summit: Bridges and Tunnels: A Drive Through OpenStack Networ...

Networking is NOT Free: Lessons in Network Design

Am 04 track1--salvatore orlando--openstack-apac-2012-final

Navigating OpenStack Networking

Openstack Basic with Neutron

Network and Service Virtualization tutorial at ONUG Spring 2015

OpenStack and OpenContrail for FreeBSD platform by Michał Dubiel

Understanding network and service virtualization

Quantum PTL Update - Grizzly Summit.pptx

Networking is the barrier to Cloud

VMworld 2013: Advanced VMware NSX Architecture

More from Cloud Native Day Tel Aviv

Cloud Native is a Cultural Decision. By Reshef Mann

Cloud Native Day Tel Aviv

In any Cloud Native architecture there’s a seemingly endless stream of events that happen at each layer. These events can be used to detect abnormal activity and possible security incidents, as well as providing an audit trail of activity. In this talk we’ll cover how we extended Falco to ingest events beyond just host system calls, such as Kubernetes audit events or even application level events. We will also show how to create Falco rules to detect behaviors in these new event streams. We show how we implemented Kubernetes audit events in Falco, and how to configure the event stream.

Container Runtime Security with Falco, by Néstor Salceda

Cloud Native Day Tel Aviv

Kafka Mirror Tester: Go and Kubernetes Powered Test Suite for Kafka Replicati...

Cloud Native Day Tel Aviv

Running I/O intensive workloads on Kubernetes, by Nati Shalom

Cloud Native Day Tel Aviv

Service meshes are all the buzz in cloud-native world. How come only yesterday we didn't know such a thing existed and now everybody seems to want one? If you're already running a microservice-based system or only starting out with one, you may be asking yourself : "Do I also need a mesh?" In this session we'll try to answer what the mesh is good for, what problem it solves, what new questions it poses.

WTF Do We Need a Service Mesh? By Anton Weiss.

Cloud Native Day Tel Aviv

Update Strategies for the Edge, by Kat Cosgrove

Cloud Native Day Tel Aviv

Building a Cloud-Native SaaS Product The Hard Way. By Arthur Berezin

Cloud Native Day Tel Aviv

If you are interested in monitoring, and successfully set up a system (whether home-grown or custom-off-the-shelf) for your own use, there comes a moment when you go from monitoring only the systems you care about, to monitoring systems that other people care about. Monitoring for yourself is all about having the best data for the least effort. Monitoring for others? That's when your job becomes a game of "what just happened" whack-a-mole.

The Four Questions (Every Monitoring Engineer gets asked), by Leon Adato

Cloud Native Day Tel Aviv

K8s Pod Scheduling - Deep Dive. By Tsahi Duek.

Cloud Native Day Tel Aviv

Cloud Native: The Cattle, the Pets, and the Germs, by Avishai Ish-Shalom

Cloud Native Day Tel Aviv

MySQL shell is the MySQL client of the future. It will help you in your daily operations, whatever they are. It doesn't matter if you are a developer or an administrator, if you want to work with relational or non relational data, if you want to setup or monitor your cluster, if you want to work with SQL language or javascript or python. Discover how MySQL shell will help you, no matter what you want to do with MySQL!

MySQL Shell: the daily tool for devs and admins. By Vittorio Cioe.

Cloud Native Day Tel Aviv

Cloud native transformation patterns, by Pini Reznik

Cloud Native Day Tel Aviv

Cloud and Edge: price, performance and privacy considerations in IOT, by Tsvi...

Cloud Native Day Tel Aviv

Running Highly Available Large Scale Systems is a lot of work. For the past 2.5 years, we've been running 100% serverless on a full production environment, serving customers worldwide. No VMs, no containers, no Kubernetes. Just code. In this session I will present why we decided to go fully serverless at Torii, how it helped us move faster than our competitors, where did serverless computing worked best and where there's more work to be done.

Two Years, Zero servers: Lessons learned from running a startup 100% on Serve...

Cloud Native Day Tel Aviv

The “Twelve-Factor” application model has come to represent twelve best practices for building modern, cloud-native applications. With guidance on things like configuration, deployment, runtime, and multiple service communication, the Twelve-Factor model prescribes best practices that apply to everything from web applications to APIs to data processing applications. Although Serverless computing and AWS Lambda have changed how application development is done, the “Twelve-Factor” best practices remain relevant and applicable in a Serverless world. In this talk, we’ll apply the “Twelve-Factor” model to Serverless application development with AWS Lambda and Amazon API Gateway and show you how these services enable you to build scalable, low cost, and low administration applications.

12 Factor Serverless Applications - Mike Morain, AWS - Cloud Native Day Tel A...

Cloud Native Day Tel Aviv

When creating a new Microservice you typically need to add a lot of boilerplate to the code, such as logging, metrics, authentication, SSL, secrets/credentials, etc... All this ends up overshadowing the actual logic of the service itself and results in a lot of dependencies and code. Because of this, we at Soluto created a template for the boilerplate, which worked great... Until we had to upgrade one of the dependencies which resulted in huge effort of code upgrades and deployment across each and every service that uses the template. And that’s besides the fact we needed to make a separate template for each language we used (and over the years, the number of programming languages we use at production increased dramatically). We needed a way to simplify all this. We wanted to get rid of the boilerplate while maintaining the functions listed above. So we decided to delegate the entire responsibility to the Kubernetes infrastructure. In this lecture, I will do a live coding session and show you how to remove the boilerplate from your code and move it to the infrastructure, and discuss the benefits and limitations of this approach.

Not my problem! Delegating responsibilities to the infrastructure - Yshay Yaa...

Cloud Native Day Tel Aviv

Machine Learning is no doubt the hottest trend in IT nowadays. Deep Neural Network (DNN), a subfield of Machine Learning with mode of operation loosely inspired by the brain, allows us to solve complex problems such as image recognition that has been very difficult to solve using standard programming paradigms. DNN concepts are not new. However, and until recently, applying them in practice could not be realized due to their high computational demands. With the recent development in parallel computing, especially around GPU acceleration and high speed and efficient networking, DNN has become a reality in modern data centers. In this talk we will describe the system requirements to effectively run a machine learning cluster with popular frameworks such as TensorFlow. We will discuss how such a system can be deployed in an OpenStack-based cloud without compromises, enjoying high-performance DNN programming paradigm as well as the benefits of cloud and software-defined data centers.

Brain in the Cloud: Machine Learning on OpenStack & Kubernetes Done Right - E...

Cloud Native Day Tel Aviv

Cloud native applications are commonly thought as stateless, horizontally scalable workloads that you can scale-up and down on-demand. Kubernetes, as the commodity cloud native orchestrator, was originally designed for such workloads. A lot has evolved since Kubernetes’ inception, and nowadays many of the stateful applications are migrating to Kubernetes. While not everything is perfect, more and more features are added to support complex stateful use-cases. In this session Arthur will cover the following topics: - Breakdown of a stateful application - Planning a stateful application on Kubernetes - The state of Kubernetes StatefulSets, Persistent Volumes, DNS, Networking, operators and High Availability - A practical use-case and DEMO of a stateful application with Kubernetes

A stateful application walks into a Kubernetes bar - Arthur Berezin, JovianX ...

Cloud Native Day Tel Aviv

The story of how KubeMQ was born - Oz Golan, KubeMQ - Cloud Native Day Tel Av...

Cloud Native Day Tel Aviv

I want it all: go hybrid - Orit Yaron, Outbrain - Cloud Native Day Tel Aviv 2018

Cloud Native Day Tel Aviv

More from Cloud Native Day Tel Aviv (20)