OpenStack on the Fabric - OpenStack Korea January Seminar 2014

1. Jun Lee 이 준희
코위버 (주) | 솔루션 사업부
jun.lee@coweaver.co.kr
AMD/SEAMICRO
OPENSTACK ON THE FABRIC
JANUARY 2014

2. OpenStack on the Fabric
A use case study into deploying OpenStack on a Fabric Compute Architecture
A Vendor and End-User Perspective
• What is Fabric Compute?
• What is the use case for Cloud?
• Our experience from deploying OpenStack on a Fabric
• Bare Metal Provisioning
• Speed of Deployment
• Power and Space
2 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014

3. OpenStack Interest
WHAT CLOUD SOLUTIONS ARE IT ORGANIZATIONS LOOKING AT?
3 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014

4. What is Fabric Computing?
• Severs with with Laser Beams?
No. At least not yet….
• Is it a new proprietary architecture?
No. Runs the same off the shelf OS and software.
No special drivers needed.
• Do they cost a Million dollars?
No. Similar economics to rackmounts, but saves
you a lot in TCO.
4 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014

5. What is Fabric Computing?
SeaMicro Fabric Compute System
Traditional Rackmount Server
Disaggregate
CPU/Memory, Storage,
and Networking into pools
of shared resources!
Compute and Memory
CPU
CPU
CPU
CPU
CPU
Captive Resources!
CPU
CPU
Fabric Interconnect
Networking
Top of Rack Switches
5 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014
Storage

6. What is Fabric Computing?
Rethinking the Server…
Core Components
Traditional Rackmount Server
6 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014
CPU & Memory, Networking, Storage

7. What is Fabric Computing?
How servers are provisioned…
SeaMicro Fabric Compute System
Bare Metal Server
Compute and Memory
CPU
Provision specific resources
needed for the application
CPU
CPU
CPU
CPU
Example of provisioning a server using SeaMicro Restful API
CPU
CPU
Fabric Interconnect
Curl –X PUT https//chassis-ip/v0.2/storage/volume/1/myPool/Volume1?’action=create&size=200
Curl –X PUT https//chassis-ip/v0.2/storage/volume/1/myPool/Volume1?’action=assign&server=1/0&vdisk=2&read-only=false
Curl –X PUT https//chassis-ip/v0.2/servers/1/0?’action=assign&nic=0&taggedvlan=true&vlan-range=1-1
Curl –X PUT https//chassis-ip/v0.2/servers/1/0?’action=assign&nic=1&taggedvlan=true&vlan-range=1000-1999
Curl –X PUT https//chassis-ip/v0.2/servers/1/0?’action=power-on&using-pxe=true
7 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014
Networking
Storage

8. What does a Fabric Compute System look like?
SM15000 Fabric Compute Server
Power Efficient Servers (64 to 256)
•
•
Provides storage to any server
Up to 64 internal 2.5” disks per system.
•
•
•
10 RU
Storage Controllers (up to x8)
Up to 512 CPU cores per system
Up to 4 TB of memory.
Choice of CPUs:
• 64 AMD Opterons
• 64 Intel Xeons – Ivy Bridge or Haswell
• 256 Intel Atoms
5.4 Petabyte of External Storage Expansion
•
•
Connect up to 16 Fabric Storage Enclosures.
1344 external 3.5” disks.
Fabric Interconnect
•
•
8 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014
1.28 Tbps high performance fabric
Integrated L2 switching
Network Uplinks Cards (up to x8)
•
•
•
Up to 160 Gbps Uplink capacity
Choice of 10Gb and 1GB interfaces
Integrate 100Gb NPU

9. The Fabric Computing Use Case
Today’s Workloads have Heterogeneous Requirements
“Provide the right server
for the workload”
“Maintain a minimal set
of server configs”
Compute
Throughput
Web Applications
Hadoop
Object Storage
VDI
CDN
Memcache
Database
Cold Storage
Memory
Capacity
Network
Bandwidth
Storage
IOPS
Storage
Capacity
Storage
Bandwidth
Medium/High
Medium
Low
Medium
Low
Low
Low/Medium/High
Medium
Medium
Low
Medium/High
High
Medium/Low
Low
High
Medium
High
Medium
Medium
High
Medium
High
Medium
Medium
Low
Medium
High
Medium
High
High
High
High
Medium
High
Low
Medium
High
High
Medium
High
Medium
Medium
Low
Low
Low
Low
High
Low
9 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014

10. The Fabric Computing Use Case
Provide customers with the service they need….
Bare Metal Hosts
10 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014
VM Hosts

11. The Fabric Computing Use Case
Let’s apply this to OpenStack
Controller Nodes
SeaMicro Fabric Compute System
Compute and Memory
CPU
1TB HDD
Mgt NIC
CPU
CPU
CPU
20 TB SSD
Data+Mgt NIC
CPU
CPU
Block Storage Node (Cinder)
CPU
CPU
Fabric Interconnect
Object Storage Node (Swift)
CPU
40TB HDD
Data+Mgt NIC
Nova Node
Nova Node
Nova Node
Networking
CPU
500GB SSD
Data+Mgt NIC
11 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014
Storage

12. OpenStack and Fabric Computing
Why Fabric Architectures are great for OpenStack…?
more importantly…
Why OpenStack is great for the
Fabric Compute Architectures
12 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014

13. Bare Metal Provisioning
Isn’t it going to be complicated?
Ironic?
13 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014

14. Bare Metal Provisioning
SeaMicro Fabric Compute System
How servers are provisioned?
Flexible – Bare Metal Server
Compute and Memory
512 Cores
4TB RAM
CPU
What is OpenStack?
“OpenStack is a cloud operating system that
controls large pools of compute, storage, and
networking resources throughout a datacenter,
all managed through a dashboard that gives
administrators control while empowering their
users to provision resources through a web
interface.”
14 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014
CPU
CPU
CPU
CPU
CPU
CPU
Fabric Interconnect
160Gbps Uplinks
Networking
Switching
128TB Internal
5PB External
Storage

15. Bare Metal Provisioning
Nova Bare Metal:
• The genesis of Bare Metal in Open Stack.
• Available starting in Grizzly release.
• Provides the ability to enroll machines in Nova, and deploy images on
them using PXE/IPMI.
• Overloaded libvert driver model to manage bare metal machines.
Ironic Bare Metal :
• Splits Bare Metal from Nova into it’s own project.
• Available starting in Havana release. (basic capabilities)
• Bare Metal servers are now first class citizens.
• Designed to support capabilities that are unique to hardware (not VMs)
• Database/API – HW oriented (i.e. firmware, RAID config, etc)
15 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014

16. Bare Metal Provisioning
The Difference Between Standard Servers and Fabric Servers
Traditional Rackmount Server
Traditional Servers – Rackmounts
• Storage and Network are fixed resources.
• You get whatever is in the box
Fabric Servers
• Provision only the storage and networking
resources needed for the application
• Right sized for workloads
CPU
Flexible - Bare Metal Server
Supporting this with OpenStack….
• Basic Bare Metal is available today with Nova Bare Metal
• Work with Ironic Bare Metal project to enable flexible provisioning
• Eager to work with other Hardware Vendors with similar needs
16 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014
CPU

17. Deploying OpenStack – Speed, Efficiency, Repeatability
How quickly, and correctly, can I deploy this?
17 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014

18. Deploying OpenStack – Speed, Efficiency, Repeatability
At least not at production scale… yet
What goes into deploying OpenStack?
• How many Controller, Swift, Cinder, instances do I need?
• What kind of Disks, NICs, etc should I use?
• Design Network (and possibly storage network)
• Rack, Plug, and Power up many servers and switches.
• Update system firmware and drivers.
• Learn about OpenStack
• Select and installer or build your own workflow.
(repeat when more capacity needed)
18 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014

19. Deploying OpenStack – Speed, Efficiency, Repeatability
Provisioning Process Today:
- For SeaMicro’s OpenStack Reference Architecture
20 min
Rack and Plug Chassis
•
64-256 servers, switch (TOR), shared storage
Zero Touch Provisioning
~40 min
•
•
Fetches config via DHCP/TFTP
Automatically configures servers, network, and storage for
OpenStack use case
SM15000
Storage
Install OpenStack components
~3 hrs
•
•
Use an OpenStack installation tool to provision OpenStack
Today we use Mirantis Fuel – Made it easy to get started.
Storage
Uplink
Storage
Storage
Storage
Uplink
Total Time:
~ 4 hrs
Legend:
Nova Compute
Swift Object
OpenStack Controller
Cinder Volume
Neutron Network
Storage
Storage
Storage
19 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014
External
Storage
Expansion
External
Storage
Expansion

20. Deploying OpenStack – Speed, Efficiency, Repeatability
~15 min to unbox, rack, and plug
20 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014
Couple Hours
(Automated Provisioning)

21. Deploying OpenStack – Speed, Efficiency, Repeatability
Triple”O” – OpenStack-On-OpenStack
Rack and Plug Chassis
•
64-256 servers, switch (TOR), shared storage
Triple“0” - Provision the Under Cloud
•
Let’s get the industry behind one way of
provisioning things. The Distro-SW and
Hardware Vendors must collaborate
VM
VM
VM
VM
VM
BM
Undercloud Heat template
Over Cloud
OpenStack Deployments
Triple”O” – Provision the OpenStack Cluster
•
Overcloud Heat template
Over Cloud
OpenStack Deployments
Under Cloud
(Bare Metal Infrastructure)
Infrastructure
21 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014

22. Power and Space – Reducing TCO
How much of a reduction can be realized with a Fabric Architecture ????
Approximate Power Savings?
How Fabric Architectures reduce Space and Power
• Disaggregate storage from servers
• Only provision the needed storage.
• Share disks amongst servers.
• Integrated Switching (Eliminate the TOR)
• Enable energy efficient processors (Atom, ARM)
How OpenStack can help reduce Space and Power
• Automate Powering On/Off of resources when needed.
• BareMetal makes this possible.
• Need some from of DRS to move and consolidate workloads when
demand decreases.
22 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014
We’ve measured
20-50% Savings

23. Power and Space
How Dense Can it be?
OpenStack IaaS Rack
256 Opteron/Xeon Servers
or
1024 Atom Servers
OpenStack Swift Rack
5.4 Petabytes Raw
~20 KW Average
(less for cold storage)
16 TB Memory
2x 46 RU Racks
~13KW Average
40 RU Total
23 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014

24. SeaMicro OpenStack Blueprint
To Access
Switch
RELEASE 1.0
 Capabilities - What can I do with it?
 Cloud-in-a-Box: Fully integrated solution in a single SM15K
 Rapid Deployment: Install and ready to deploy VMs in a few hours
 Up to 3500 VMs per SM15K system
 Multi Tenant Support
 High Availability of OpenStack Management and Networking
 Storage (Cinder/Swift) Capacity scalable to over 1 PB (Pay as you grow)
VM Size
Description
VMs per SM15000
tiny
1vCPU, 1GB mem, 15GB disk
3600VMs
small
1vCPU, 2GB mem, 30GB disk
1800 VMs
medium
2vCPU, 4GB mem, 60GB disk
900 VMs
large
4vCPU, 8GB mem, 120GB disk
450 VMs
xtra-large
8vCPU, 16GB mem, 240GB disk
225 VMs
•
Flavors can be adjusted to meet your specific use case. Defaults are shown.
 Included Services:
 OpenStack Grizzly based
 Nova Compute – virtual machines
 Nova Network – VLAN based
 Cinder Volume – shared block storage
 Swift Storage –Object storage for images and snapshots
 Other: Keystone (authentication), Glance (image mgt)
24 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014

25. OpenStack Blueprint Roadmap
2014 – Q1
Blueprint
Major Releases
Key Features
1.0 - Oct 2013
OpenStack Grizzly Release
IaaS Compute (Nova), Block Store (Cinder), Swift
Single Chassis Design
2.0 - Feb 2014
OpenStack Havana Release
+ Bare Metal Provisioning
+ Neutron
+ Multi-Chassis Design
+ Improved HA and Load Balancing
+ Improved installation automation
2014 – Q2
3.0 – Q2 2014
OpenStack Icehouse Release
Additional SeaMicro value added capabilities
2014 – Q3
Minor release will be delivered to add incremental features.
Dates are approximate
Need a customized design?
SeaMicro and its partners can work with you to design an OpenStack architecture that
meets your business needs.
25 | OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014
Disclaimer: Roadmap is forward looking and subject to change.