Cloud Power - The Early OpenStack Architecture

•

2 likes•988 views

The document describes Nebula, a cloud computing platform built in 2010. It has several types of nodes - cloud, compute, volume, object, and network - that work together using standard protocols and automation. The architecture aims for reliability, availability, and low cost. Key components include Puppet for configuration management, Nova for orchestration, and Ubuntu OS. The roadmap outlines upcoming features like auditing, PaaS, and IPv6 support. Lessons learned stress automating everything, thorough testing, and monitoring all aspects of the platform.

Technology Business

NEBULA Cloud Computing Platform 2010
How we built Nebula
Cloud Power

NEBULA Cloud Computing Platform 2010
Architecture

NEBULA Cloud Computing Platform 2010
Architecture Drivers
• Reliability
• Availability
• Cost

NEBULA Cloud Computing Platform 2010
Shared Nothing
• Messaging Queue
• State Discovery
• Standard Protocols
Automated
• IPMI
• PXEBoot
• Puppet

NEBULA Cloud Computing Platform 2010
Components
• Cloud Node
• Network Node
• Compute Node
• Volume Node
• Object Node
• (Monitoring / Metering / Logging / Scanning)

NEBULA Cloud Computing Platform 2010
LDAP Data
Store
Ubuntu OS
Puppet
Nova
Cloud
Node
PXE
Cloud Node
RabbitMQ
Redis KVS

NEBULA Cloud Computing Platform 2010
Ubuntu OS
Puppet
KVM
LibVirt
Nova
Compute
Node
802.1(q)
Brctl
PXE
Project VLAN
Running Instance
Compute Node

NEBULA Cloud Computing Platform 2010
Ubuntu OS
Puppet
LVM
AoE
Nova
Volume
Node
PXE
Exported Volume
Volume Node

NEBULA Cloud Computing Platform 2010
Ubuntu OS
Puppet
Nova
Object
Node
PXE
Object Node
Nginx

NEBULA Cloud Computing Platform 2010
Ubuntu OS
Puppet
Nova
Network
Node
802.1(q)
Brctl
PXE
Project
VLAN
Network Node
IPTables
Public
Internet

NEBULA Cloud Computing Platform 2010
Security Groups
• Combination of VLANs and Subnetting
• Can be extended to use physical
network/node separation as well (future)

NEBULA Cloud Computing Platform 2010
Scheduling
• Mixed model (selection + auction)
• Supports instance-type optimizations
• Supports FIPS 199-based selection (future)

NEBULA Cloud Computing Platform 2010
Roadmap (What’s Coming)

NEBULA Cloud Computing Platform 2010
What’s Coming
• SAML authentication and RBAC (Beta)
• Computable Object Store (OS^2) (Beta)
• Auditable Usage Metering (Sept 2010)
• Platform-as-a-Service Prototype (Sept 2010)
• FIPS 199 CIA: Moderate w/ CloudAudit (2011)
• IPv6 and Jumbo Frame support (Late 2011)

NEBULA Cloud Computing Platform 2010
Lessons Learned

NEBULA Cloud Computing Platform 2010
Automate Everything
• No SysAdmin is perfect
• 99% is not good enough
• NEVER make direct system changes
• When in doubt, PXEBoot

NEBULA Cloud Computing Platform 2010
Test Everything
• KVM + Jumbo Frames
• Grinder
• Unit Tests / Cyclometric Complexity
• TransactionID Insertion (Universal Proxy)

NEBULA Cloud Computing Platform 2010
Monitor Everything
• Ganglia
• Munin
• Syslog-NG + PHPSyslog-NG
• Nagios
• Custom Log Parsing (Instance-centric)

NEBULA Cloud Computing Platform 2010
Discussion Points

NEBULA Cloud Computing Platform 2010
SPoF == Availability
• Network Layer
 BGP / DNS LB
 Linux-HA Network Nodes
• Volumes
 DRBD / SAN
• RAID Class
 RAID 6 / RAID 1+0

NEBULA Cloud Computing Platform 2010
What ARC Did
• Train users to embrace cloud model,
• Take advantage of commodity hardware

What's hot

oVirt Introduction

Roozbeh Shafiee

tcp cloud & AVG User Story. Does your IT department’s left hand talk to the right hand? Finally ours does at http://www.avg.com/eu-en/homepage! This is the story of OpenStack as our salvation, and important lessons learned in technology and IT politics. Our appsdev team’s devops abilities were being held ransom on vCenter, so we wanted public cloud agility for dev/test/staging. With the help of our IT partner…Full session details here: http://awe.sm/r9Ekr

OpenStack Ousts vCenter for DevOps and Unites IT Silos at AVG Technologies

Jakub Pavlik

Openstack CPI cloudfoundry

Yitao Jiang

The platform currently runs several solutions for Earth Sciences Researchers: Developer Cloud Sandboxes for scalable scientific processors integration, Virtual Archives federating distributed data repositories, Data Challenges for Earth Observation contests, and Digital Marketplaces for reproducible scientific experiments. OpenNebula is also powering our Cloud development environment, that has been enhanced during the past year. Terradue’s Cloud development environment is both our laboratory to test the latest developments from OpenNebula, especially for the integration of our own OpenNebula extensions, and our Engineering team facility to provision servers supporting project-based software developments. OpenNebula provides the virtualization and management of hardware clusters, that we rent from commercial ‘bare-metal’ providers. We have recently further developed several specific drivers for Multi-Cloud bursting, in order to provision virtual machines over public commercial clouds. When their processor integration and validation phase concludes, our researcher users can seamlessly burst their applications at scale, leveraging OpenNebula drivers for on-demand processing tasks.

OpenNebula Conf 2014: Expanding OpenNebula´s support for Cloud Bursting - Emm...

NETWAYS

OpenNebulaConf2017EU: Hyper converged infrastructure with OpenNebula and Ceph...

OpenNebula Project

NTS: What We Do With OpenNebula - and Why We Do It

OpenNebula Project

Cloud Architecture

tcp cloud

OpenContrail Experience tcp cloud OpenStack Summit Tokyo

Jakub Pavlik

OpenNebulaConf 2016 - Network automation with VR by Karsten Nielsen, Unity Te...

OpenNebula Project

Deploy TOSCA Network Functions Virtualization (NFV) Workloads in OpenStack

Sahdev Zala

OpenNebulaconf2017US: OpenNebula hybrid clouds with Amazon and Azure by Ruben...

OpenNebula Project

Creating an open source load balancer for S3

Anders Bruvik

Deploying CloudStack and Ceph with flexible VXLAN and BGP networking

ShapeBlue

Akamai Technologies’ CDN platform is a complex, highly-integrated distributed system consisting of over 200,000 servers in over 120 countries.. Processing over 3 Trillion web requests per day, the Akamai platform regularly serves over 30Tbps of traffic to end users around the world. Setup and maintenance of Akamai integration test environments involves a significant investment of hardware, time and subject matter expertise. As a result, these environments are a scarce resource. Using Opennebula, Akamai has developed a system for saving and cloning multi-node integration test environments on-demand. The system is succeeding and has the potential to revolutionize Akamai’s approach to software development and testing. After exploring Akamai’s platform architecture and testing challenges, we will describe the key innovations that enabled the Vtastic solution, challenges we faced in implementing a reliable system, and future capabilities the system can offer.

OpenNebulaconf2017US: Vtastic:Akamai innovations for distributed system testi...

OpenNebula Project

OpenNebulaconf2017US: Software defined networking with OpenNebula by Roy Keen...

OpenNebula Project

[OpenInfra Days Korea 2018] Day 2 - E6: "SONA: ONOS SDN Controller 기반 OpenSta...

OpenStack Korea Community

Whats new in Havana--Neutron

Mirantis

Routed Fabrics For Ceph

ShapeBlue

NFV Orchestration for Telcos using OpenStack Tacker

Sridhar Ramaswamy

OpenStack is an Infrastructure as a Service offering that provides a powerful abstraction layer for interacting with your datacenter infrastructure, supported by a wide array of pluggable drivers for existing physical and virtual infrastructure investments. In this session, you’ll learn how OpenStack is evolving to integrate with the Linux, Docker, Kubernetes stack to provide the ideal infrastructure platform for modern containerized applications. You’ll learn how you can modernize application delivery using the Linux, Docker, Kubernetes stack provided by Red Hat while seamlessly using the authentication, network, and storage infrastructure services provided by an underlying OpenStack cloud.

A Container Stack for Openstack - OpenStack Silicon Valley

Stephen Gordon

What's hot (20)

oVirt Introduction

OpenStack Ousts vCenter for DevOps and Unites IT Silos at AVG Technologies

Openstack CPI cloudfoundry

OpenNebula Conf 2014: Expanding OpenNebula´s support for Cloud Bursting - Emm...

OpenNebulaConf2017EU: Hyper converged infrastructure with OpenNebula and Ceph...

NTS: What We Do With OpenNebula - and Why We Do It

Cloud Architecture

OpenContrail Experience tcp cloud OpenStack Summit Tokyo

OpenNebulaConf 2016 - Network automation with VR by Karsten Nielsen, Unity Te...

Deploy TOSCA Network Functions Virtualization (NFV) Workloads in OpenStack

OpenNebulaconf2017US: OpenNebula hybrid clouds with Amazon and Azure by Ruben...

Creating an open source load balancer for S3

Deploying CloudStack and Ceph with flexible VXLAN and BGP networking

OpenNebulaconf2017US: Vtastic:Akamai innovations for distributed system testi...

OpenNebulaconf2017US: Software defined networking with OpenNebula by Roy Keen...

[OpenInfra Days Korea 2018] Day 2 - E6: "SONA: ONOS SDN Controller 기반 OpenSta...

Whats new in Havana--Neutron

Routed Fabrics For Ceph

NFV Orchestration for Telcos using OpenStack Tacker

A Container Stack for Openstack - OpenStack Silicon Valley

Viewers also liked

Nebula james Williams

Open Stack

Progress of the Helix Nebula Science Cloud PCP Project

Helix Nebula The Science Cloud

Pre-Commercial Procurement - HNSciCloud

Helix Nebula The Science Cloud

Open Stack DC

Joshua McKenty

The Tectonic Plates And Volcanoes

theorgil

Xen 4.3 Roadmap

The Linux Foundation

Tectonic Plates

Rathnavel Ponnuswami

13 - Plate Tectonic Theory

Ecumene

Tectonic Plates

Central University University

Privacy is an Illusion and you’re all losers! - Cryptocow - Infosecurity 2013

Cain Ransbottyn

Viewers also liked (10)

Nebula james Williams

Progress of the Helix Nebula Science Cloud PCP Project

Pre-Commercial Procurement - HNSciCloud

Open Stack DC

The Tectonic Plates And Volcanoes

Xen 4.3 Roadmap

Tectonic Plates

13 - Plate Tectonic Theory

Tectonic Plates

Privacy is an Illusion and you’re all losers! - Cryptocow - Infosecurity 2013

Similar to Cloud Power - The Early OpenStack Architecture

OpenStack cloud for ConoHa, Z.com and GMO AppsCloud in okinawa opendays 2015 ...

Naoto Gohko

OpenStackのモデルの最適化とConoHa, Z.comとGMOアプリクラウドへの適用郷古直仁 (GMOインターネット株式会社) アジェンダ： - Using OpenStack at GMO Internet --- OpenStack Diablo cluster: Onamae.com VPS --- OpenStack Grizzly cluster: ConoHa --- OpenStack Havana cluster: GMO AppsCloud --- OpenStack Juno cluster: ConoHa (2), GMO AppsCloud (2) ------ OpenStack Authentication in Juno (V2 keystone domains) - How to using OpenStack at GMO Internet --- OpenStack Designate DNSaaS: ConoHa, Z.com(OEM) --- OpenStack Cinder Block storage: ConoHa: NexentaStor(SDS), AppsCloud: NetApp --- OpenStack Ironic: Only AppsCloud: Undercloud Ironic deploy, Multi-tenant Ironic deploy --- OpenStack Swift: shared cluster

GMOインターネット様発表「OpenStackのモデルの最適化とConoHa, Z.comとGMOアプリクラウドへの適用」 - OpenStack最新情...

VirtualTech Japan Inc.

Kubernetes vs Dockers Swarm supporting ONAP-OOM on multi-cloud multi-stack environment Description: ONAP was set originally to support multiple container platform and cloud through TOSCA. In R1 ONAP and OOM is dependent completely on Kubernetes. As there are other container platforms such as Docker Swarm that are gaining more wider adoption as a simple alternative to Kubernetes. In addition operator may need the flexibility to choose their own container platform and be open for future platform. We need to weight the alternatives and avoid using package managers as Helm that makes K8s mandatory. The use of TOSCA in conjunction with Kubernetes provides that "happy medium" where on one hand we can leverage Kubernetes to a full extent while at the same time be open to other alternative. In this workshop, we will compare Kubernetes with Docker Swarm and walk through an example of how ONAP can be set to support both platforms using TOSCA.

Kubernetes vs dockers swarm supporting onap oom on multi-cloud multi-stack en...

Arthur Berezin

What_s_New_in_OpenShift_Container_Platform_4.6.pdf

chalermpany

Openstack Cactus Survey

Pjack Chen

Lisa Caywood and Colin Dixon's presentation at the 2017 Open Networking Summit. OpenDaylight has become a nexus for open source integration, creating a new open networking stack and enabling a new generation of open source, agile IT infrastructure. The fifth “Boron” release provides new tooling and documentation to support application developers, as well as greater integration with industry frameworks from OPNFV and OpenStack to CORD and Atrium. Boron also brings a practical focus on two leading types of deployments: (1) direct control of virtual switches to provide network virtualization and NFV and (2) management and orchestration of existing networks to provide new features and automation. This talk will cover trends in open SDN and cloud networking, with a focus on Boron milestones. In particular, it dives into the architecture across OpenStack and OpenDaylight to enable OpenStack service function chaining support in OpenDaylight.

State of the OpenDaylight Union

Open Networking Summit

WebLogic and GraalVM

Michel Schildmeijer

Cloud standards interoperability: status update on OCCI and CDMI implementations

Florian Feldhaus

Sven Vogel: Running CloudStack and OpenShift with NetApp on KVM

ShapeBlue

Support of containerized workloads in ONAP

Victor Morales

Networking in Openstack - Neutron 101

Mochamad Taufik Romdony

Mobile edge computing delivers cloud computing at the edge of the cellular network to drive services quality and innovation. The ability for CSPs and ISVs to effectively develop, deliver, and deploy MEC services on a given platform directly correlates with the availability and maturity of associated tools and test environment. Dronava is a hyper-connected, web-scale network reference design for the 5G mobile network, suitable for use as a test and development socket for cloud applications developed for MEC platforms with tools such as the Intel NEV SDK. With Dronava, developers can drive the application with real traffics from the network edge to the EPC core, and if need be, connect with services in the core network in order to fully characterize the functionalities, latency, and throughput of the platform and application.Teranium is an integrated development environment that simplifies the development, packaging, and deployment/management of cloud applications. Teranium can be utilized to develop and deploy MEC applications on a number of platforms. Together with Dronava, Teranium helps to reduce complexity and improve efficiency in the ability of CSPs and ISVs to adopt and deploy MEC-base services.

Development, test, and characterization of MEC platforms with Teranium and Dr...

Michelle Holley

Ansible is one of the newer and more exciting automation toolsets for networking. Ansible (unlike Puppet and Chef) is agentless, which makes it significantly easier to automate existing devices that may not have an agent installed – such as many networking devices. Networks are evolving from hundreds or thousands of individual devices to the Software-Defined Network paradigm of a single fabric under a central controller. The GUI on top of an SDN controller isn’t sufficient and will still need automation. This presentation describes how Ansible can add value to configuration management of a Cisco Application Centric Infrastructure (ACI) infrastructure.

RTP NPUG: Ansible Intro and Integration with ACI

Joel W. King

OpenNebula - New Features

OpenNebula Project

Oracle Fusion Middleware provisioning with Puppet

Edwin Biemond

EGI TF 2013 / Cloud Interoperability Week – Hands-On Tutorial

OpenNebula Project

Workday has built one of the largest OpenStack-based private clouds in the world, hosting a workload of over a million physical cores on over 16,000 compute nodes in 5 data centers for over ten years. However, there was a growing need for a newer, more maintainable deployment model that would closely follow the upstream community. We would like to share our new architecture and deployment approach as well as lessons learned from our experience. We’ve converted many of our technologies in the process, from… Migrating from Mitaka, to Victoria Converting from OpenContrail, to pure L3 Calico with BGP on the host Deploying with Chef, to deploying with Ansible Building home-grown container images, to Kolla Monitoring with Sensu and Wavefront, to Prometheus and Grafana CI/CD in Jenkins, to Zuul CentOS 7, to CentOS 8 Stream We'll also talk about some internal tools we wrote that, while Workday-specific, may inspire you to see what value-add you can make for your customers.

Workday's Next Generation Private Cloud

Silvano Buback

Webinar- Tea for the Tillerman

Cumulus Networks

Le SDN et NFV sont très à la mode en ce moment car en passant des appliance physiques aux équipement réseau massivement logiciel, celà devrait offrir une grande flexibilité et agilité aux entreprises (et telco en particulier). Néanmoins chainer des services réseau est un exercice encore très complexe et ce document vous explique ce qu'il est déjà possible de faire sur OpenStack en couplant par exemple : un load balancer (BigIP), un Firewall (BigIP), un réseau virtuel WAN (RiverBed) ou encore un routeur virtuel (Brocade).

SDN/NFV: Service Chaining

Odinot Stanislas

Net Devops Overview

Joel W. King

Similar to Cloud Power - The Early OpenStack Architecture (20)

OpenStack cloud for ConoHa, Z.com and GMO AppsCloud in okinawa opendays 2015 ...

GMOインターネット様発表「OpenStackのモデルの最適化とConoHa, Z.comとGMOアプリクラウドへの適用」 - OpenStack最新情...

Kubernetes vs dockers swarm supporting onap oom on multi-cloud multi-stack en...

What_s_New_in_OpenShift_Container_Platform_4.6.pdf

Openstack Cactus Survey

State of the OpenDaylight Union

WebLogic and GraalVM

Cloud standards interoperability: status update on OCCI and CDMI implementations

Sven Vogel: Running CloudStack and OpenShift with NetApp on KVM

Support of containerized workloads in ONAP

Networking in Openstack - Neutron 101

Development, test, and characterization of MEC platforms with Teranium and Dr...

RTP NPUG: Ansible Intro and Integration with ACI

OpenNebula - New Features

Oracle Fusion Middleware provisioning with Puppet

EGI TF 2013 / Cloud Interoperability Week – Hands-On Tutorial

Workday's Next Generation Private Cloud

Webinar- Tea for the Tillerman

SDN/NFV: Service Chaining

Net Devops Overview

Recently uploaded

Working together SRE & Platform Engineering

Marcus Vechiato

Portal Kombat : extension du réseau de propagande russe

中央社

Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf

FIDO Alliance

IESVE for Early Stage Design and Planning

IES VE

Syngulon’s technology expands the capacity for selection of microorganisms. The ability to select individual microbes with a behavior of interest is essential, whether for simple cloning at the bench, or for industry-scale production. Synthetic biology uses the concept of “bioengineering” to improve or modify existing genetic systems to create microbes with desired behaviors, and Syngulon uses this approach to develop its selection technologies. This selection technology is based on bacteriocins, ribosomally-produced peptides naturally made by most bacteria to kill competitive microbial species. These bacteriocins can have a limited or wide target range against other microbial species. This technology offers advantageous over antibiotic selection for several reasons: it avoids the use of antibiotics in the first place, helping to reduce the spread of antibiotic resistant microbes. The technology also increases product yield; as bacteriocins are generally smaller peptides, they do not impose a heavy metabolic burden on the producing cell. They can have a wide target specificity, helping to avoid genetic drift. Finally, our system is 100% plasmid-based (e.g. without chromosomal mutations), making it applicable for use in any E. coli strains.

Syngulon - Selection technology May 2024.pdf

Syngulon

What's New in Teams Calling, Meetings and Devices April 2024

Stephanie Beckett

ERP Contender Series: Acumatica vs. Sage Intacct

BrainSell Technologies

The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf

FIDO Alliance

Intro in Product Management - Коротко про професію продакт менеджера

Mark Opanasiuk

AI presentation and introduction - Retrieval Augmented Generation RAG 101

vincent683379

Google I/O Extended 2024 Warsaw

GDSC PJATK

WebAssembly is Key to Better LLM Performance

Samy Fodil

PLAI - Acceleration Program for Generative A.I. Startups

Stefano

Overview of Hyperledger Foundation

Hyperleger Tokyo Meetup

Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf

FIDO Alliance

Unlock the mysteries of successful Salesforce interviews in this insightful session hosted by Hugo Rosario (Salesforce Customer), a seasoned hiring manager that leads the Salesforce Department of multinational company with over 100 interviews under their belt. Step into the manager's chair and gain exclusive behind-the-scenes insights into what makes a Salesforce consultant stand out during the interview process. From deciphering the unspoken cues to mastering key strategies, we'll explore the intricacies of the interview process and provide practical tips for consultants looking to not only pass interviews but also thrive in their roles. Whether you're a seasoned professional or just starting your Salesforce journey, this session is your backstage pass to the secrets that hiring managers wish you knew.

Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...

CzechDreamin

WSO2CONMay2024OpenSourceConferenceDebrief.pptx

Jennifer Lim

Designing inclusive products is not only a social responsibility but also a business imperative. This talk delves into the journey of creating accessible hardware products that cater to diverse user needs. Key Topics Covered: 1. Introduction to Inclusive Design - Importance of accessibility in product design - Overview of Comcast's commitment to making products accessible to a wide audience 2. Case Study: Xfinity Large Button Voice Remote - Initial challenges and the evolution of the product - User research and feedback that shaped the design - Key features of the final product and their benefits 3. Designing for Diverse Needs - Understanding human-centered design and its historical context - The impact of designing for people with disabilities on overall product quality - Examples from other industries, such as architecture and industrial design 4. Integrating Accessibility from the Beginning - The cost and efficiency benefits of designing for accessibility from the start - The process of embedding accessibility as a core trait rather than an optional feature 5. Real-World Impact and Continuous Improvement - Insights from in-home studies with users having assistive needs - How continuous feedback and iterative design lead to better products - The role of inclusive research and development practices

Designing for Hardware Accessibility at Comcast

UXDXConf

State of the Smart Building Startup Landscape 2024!

Memoori

Heather Hedden, Senior Consultant at Enterprise Knowledge, presented “Enterprise Knowledge Graphs: The Importance of Semantics” on May 9, 2024, at the annual Data Summit in Boston. In her presentation, Hedden describes the components of an enterprise knowledge graph and provides further insight into the semantic layer – or knowledge model – component, which includes an ontology and controlled vocabularies, such as taxonomies, for controlled metadata. While data experts tend to focus on the graph database components (RDF triple store or a label property graph), Hedden emphasizes they should not overlook the importance of the semantic layer.

Enterprise Knowledge Graphs - Data Summit 2024

Enterprise Knowledge

Recently uploaded (20)

Working together SRE & Platform Engineering

Portal Kombat : extension du réseau de propagande russe

Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf

IESVE for Early Stage Design and Planning

Syngulon - Selection technology May 2024.pdf

What's New in Teams Calling, Meetings and Devices April 2024

ERP Contender Series: Acumatica vs. Sage Intacct

The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf

Intro in Product Management - Коротко про професію продакт менеджера

AI presentation and introduction - Retrieval Augmented Generation RAG 101

Google I/O Extended 2024 Warsaw

WebAssembly is Key to Better LLM Performance

PLAI - Acceleration Program for Generative A.I. Startups

Overview of Hyperledger Foundation

Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf

Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...

WSO2CONMay2024OpenSourceConferenceDebrief.pptx

Designing for Hardware Accessibility at Comcast

State of the Smart Building Startup Landscape 2024!

Enterprise Knowledge Graphs - Data Summit 2024

Cloud Power - The Early OpenStack Architecture

1. NEBULA Cloud Computing Platform 2010 How we built Nebula Cloud Power

2. NEBULA Cloud Computing Platform 2010 Architecture

3. NEBULA Cloud Computing Platform 2010 Architecture Drivers • Reliability • Availability • Cost

4. NEBULA Cloud Computing Platform 2010 Shared Nothing • Messaging Queue • State Discovery • Standard Protocols Automated • IPMI • PXEBoot • Puppet

5. NEBULA Cloud Computing Platform 2010 Components • Cloud Node • Network Node • Compute Node • Volume Node • Object Node • (Monitoring / Metering / Logging / Scanning)

6. NEBULA Cloud Computing Platform 2010 LDAP Data Store Ubuntu OS Puppet Nova Cloud Node PXE Cloud Node RabbitMQ Redis KVS

7. NEBULA Cloud Computing Platform 2010 Ubuntu OS Puppet KVM LibVirt Nova Compute Node 802.1(q) Brctl PXE Project VLAN Running Instance Compute Node

8. NEBULA Cloud Computing Platform 2010 Ubuntu OS Puppet LVM AoE Nova Volume Node PXE Exported Volume Volume Node

9. NEBULA Cloud Computing Platform 2010 Ubuntu OS Puppet Nova Object Node PXE Object Node Nginx

10. NEBULA Cloud Computing Platform 2010 Ubuntu OS Puppet Nova Network Node 802.1(q) Brctl PXE Project VLAN Network Node IPTables Public Internet

11. NEBULA Cloud Computing Platform 2010 Security Groups • Combination of VLANs and Subnetting • Can be extended to use physical network/node separation as well (future)

12. NEBULA Cloud Computing Platform 2010 Scheduling • Mixed model (selection + auction) • Supports instance-type optimizations • Supports FIPS 199-based selection (future)

13. NEBULA Cloud Computing Platform 2010 Roadmap (What’s Coming)

14. NEBULA Cloud Computing Platform 2010 What’s Coming • SAML authentication and RBAC (Beta) • Computable Object Store (OS^2) (Beta) • Auditable Usage Metering (Sept 2010) • Platform-as-a-Service Prototype (Sept 2010) • FIPS 199 CIA: Moderate w/ CloudAudit (2011) • IPv6 and Jumbo Frame support (Late 2011)

15. NEBULA Cloud Computing Platform 2010 Lessons Learned

16. NEBULA Cloud Computing Platform 2010 Automate Everything • No SysAdmin is perfect • 99% is not good enough • NEVER make direct system changes • When in doubt, PXEBoot

17. NEBULA Cloud Computing Platform 2010 Test Everything • KVM + Jumbo Frames • Grinder • Unit Tests / Cyclometric Complexity • TransactionID Insertion (Universal Proxy)

18. NEBULA Cloud Computing Platform 2010 Monitor Everything • Ganglia • Munin • Syslog-NG + PHPSyslog-NG • Nagios • Custom Log Parsing (Instance-centric)

19. NEBULA Cloud Computing Platform 2010 Discussion Points

20. NEBULA Cloud Computing Platform 2010 SPoF == Availability • Network Layer  BGP / DNS LB  Linux-HA Network Nodes • Volumes  DRBD / SAN • RAID Class  RAID 6 / RAID 1+0

21. NEBULA Cloud Computing Platform 2010 What ARC Did • Train users to embrace cloud model, • Take advantage of commodity hardware

Cloud Power - The Early OpenStack Architecture

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (10)

Similar to Cloud Power - The Early OpenStack Architecture

Similar to Cloud Power - The Early OpenStack Architecture (20)

More from Joshua McKenty

More from Joshua McKenty (18)

Recently uploaded

Recently uploaded (20)

Cloud Power - The Early OpenStack Architecture