Future of Apache CloudStack: modular, distributed, and hackable

•Télécharger en tant que ODP, PDF•

4 j'aime•1,552 vues

CloudStack has been often critiqued because of its architecture. This session is to talk about the efforts that have been done and are in progress to move CloudStack's architecture forward. How we can achieve the simplicity of a monolithic system, but scalability of a distributed architecture. How we can keep the speed and reliability of Java, but leverage scripting languages for easier integrations. How can we get CloudStack to be the best and easiest system to deploy and maintain for clouds from 10s to 100s of thousands of hypervisors.

Technologie Formation

Future of Apache CloudStack: modular,
distributed, and hackable
Darren Shepherd
Citrix

CCCEU 2013

About Me
●

Apache CloudStack Committer

●

Previously - Cloud Architect @ GoDaddy.com
–

Built three generations of clouds
●
●

●

2nd – Custom “CloudStack Compatible”

●

–

1st – CloudStack 2.x, custom storage framework
3rd – 100% from scratch

Been developing IaaS orchestration systems full time for the last 4
years

Currently – Do something @ Citrix
–

Focus on open source

–

I care about architecture and design

What's This About
●

My opinions

●

What I think we should focus on architecturally

●

What I'm trying to accomplish

General Comments
●

Do more with less
–

Identify patterns in code and create frameworks
●

–
●

For example, make Abstract base classes

Copy and paste is bad

Need to leverage more open source frameworks
–

jOOQ, Spring TX, Netflix Archaius/Servo, Jackson, Apache jclouds,
Flyway/Liquibase, Apache Commons

●

Past/Current – ACS adds cloudiness to legacy technologies

●

Current/Future – ACS orchestrates cloudy technologies

●

Always provide a way for Apache CloudStack to do nothing and
delegate to something else

Modular – Why?
●

Enforce design and architectural boundaries

●

Better pluggability

●

Quality/Testing

●

Lays the foundation for distributed architecture

Modular – What's been done
●

4.3 - Spring Modularization
–

META-INF/cloudstack/mycomponent/module.properties

–

META-INF/cloudstack/mycomponent/*context.xml

–

Over 50 Modules

Stats
●

~400k lines of Java (not 1.2m)
–
–

32% - engine, framework, services, usage, util

–
●

42% - agent, api, core, server
26% - plugins

We still have big blobs of code
–

74% “Core Code”

“Core Code” is not really core. Includes VR, CP,
SSVM, XenServer, others

What needs to be done
●

Package plug-ins in separate RPM/DEBs

●

Break out more code from /server/src

●

Break apart *ManagerImpl classes
–

●

Implement too many interfaces that belong in
different architectural layers

Modularize VR and VPC code

Distributed Architecture
●

Maybe you don't care
–

Many don't – Monolithic deployment is simple and
scalable enough for most use case

●

Support multiple deployment models

●

Scalability
–

●

Scale tiers according to load characteristics

Reliability
–

Put certain components closer to resources

Fully Distributed
●

System Services
–
–

●

Event Bus
Lock Manager

Servers
–

API

–

Back end Jobs

–

Host Manager

How
●

Event Bus
–

Hazelcast or Redis

–

Do not use “reliable messaging”
●

●

Lock Manager
–

●

Works more like UDP multicast

Hazelcast or ZooKeeper

Same binary on all servers
–

“Profiles” used to determine which Spring modules are
activated on start

Hackability
●

Should be relatively simple to add one off
functionality
–

●

●

Every cloud deployment is slightly different

Need to stay relevant with upcoming
technologies
Want people to integrate first with ACS because
–

It works

–

It's easy

Totally scientific observation
●

Two types of sys admins
–

Those who hate Java for no good reason

–

Those who hate Java for a good reason

Those that
will tolerate developing
in Java

Those who
love systems
(admins/engineers)

Dynamic languages can be good

Those that
Those who
will tolerate developing
love systems
in a dynamic
(admins/engineers)
language

Hackability
●

Move systems related code to python

●

No Java on the hypervisor!

●

Need a new ServerResource architecture that
delegates to agents in any language
–

Work for Hyper-V is a step in the right direction

●

Decouple VR from HypervisorResource

●

Community help needed
–

Good work, GCE API and hopefully new AWS API

Contenu connexe

Tendances

State of the Container Ecosystem

Vinay Rao

Interoperable OpenStack guest provisioning with Cloudbase-Init

Alessandro Pilotti

În această sesiune Mihai Tătăran vorbește despre cum puteți îmbunătăți procesul de dezvoltare, permițând echipei de dezvoltare software / QA să își creeze propriile medii de dezvoltare, testare, staging, înloc să le aștepte să le creeze departamentul IT. De asemenea, veți vedea cum puteți măriți viteza de deployment și să reduceți totodată costurile IT pentru mediile Dev / Test.

Mihai Tataran - Dev/Test Continuous Delivery Automation cu Microsoft Azure

Avaelgo

Apache Stratos is a highly-extensible Platform-as-a-Service (PaaS) framework that helps run Apache Tomcat, PHP, and MySQL applications. The PaaS environment can be extended to support any additional language, framework, or server. For developers, Stratos provides a cloud-based environment for developing, testing, and running scalable applications. IT providers benefit from high utilization rates, automated resource management, and platform-wide insights, including monitoring and billing. In this session, we will discuss key features in Apache Stratos and choosing the right solution for your business needs. Topics to be covered: True community ecosystem Open extensible architecture True flexibility for custom services and infrastructure Multi-factored auto scaling Multi-tenancy Scalable dynamic load balancing Capability of controlling PaaS resources Logging, metering and monitoring Cloud bursting

Java PaaS Apache Stratos

Chris Haddad

Wso2 con 2014-us-talk-deep dive into apache stratos & private paas

Lakmal Warusawithana

Sven Vogel: Running CloudStack and OpenShift with NetApp on KVM

ShapeBlue

În această sesiune vom vorbi despre modul în care utilizatorii pot aborda protecția datelor într-un cloud hibrid. Vom explora opțiunile de recuperare și disponibilitate a datelor, vom discuta principalele motive și preocupările majore cu privire la cloud computing și modul în care ar trebui abordate provocările formulate, precum și strategii privind modul în care poate fi obținută disponibilitatea datelor.

Cornel Popescu - Protectia datelor in cloud: de ce si cum se face

Avaelgo

Presented at JAX London 2013 Vert.x is a lightweight, high performance, application platform for the JVM that's designed for modern mobile, web, and enterprise applications. The recent Vert.x 2.0 release marks a coming of age for Vert.x, as it progresses to a fully independent project. We'll dive into the Vert.x 2.0 release and show how the powerful new module system enables a Vert.x ecosystem by allowing modules to be re-used via Maven and Bintray repositories. You'll also learn about how better build tool and IDE integration makes developing applications with Vert.x a breeze.

Introducing Vert.x 2.0 - Taking polyglot application development to the next ...

jaxLondonConference

The OpenNebula Approach to Bring Open-Source to the Enterprise

OpenNebula Project

În această sesiune se intră în detalii despre ceea ce înseamnă cu adevărat continuitatea afacerii și recuperarea în caz de catastrofe. Dacă v-ați confruntat cu întreruperi de funcționare sau momente în care soluția Dvs. nu a fost online, dacă aveți o soluție ERP / CRM / altă soluție de LOB care trebuie neapărat să ruleze în timpul orelor de program, dar uneori nu pornește, dacă vă este teamă de o posibilă pierdere a datelor companiei Dvs. și de tot timpul pe care va trebui să-l pierdeți încercând recuperarea lor, cu siguranță veți găsi această sesiune extrem de interesantă.

Tudor Damian - Microsoft Azure ca si solutie pentru backup sau disaster recovery

Avaelgo

Mihai Tataran - Definirea unei strategii pentru migrarea solutiilor si a orga...

Avaelgo

OpenNebulaconf2017US: OpenNebula hybrid clouds with Amazon and Azure by Ruben...

OpenNebula Project

We’re moving into a world of open cloud — where each organization can find the right cloud for its unique needs. A single cloud management platform can not be all things to all people, there will be a cloud space with several offerings focused on different environments and/or industries. The OpenNebula commitment to the open cloud flows directly out of its mission — to become the simplest cloud enabling platform — and its purpose — to bring simplicity to the private and hybrid enterprise cloud. OpenNebula exists to help companies build simple, cost-effective, reliable, open enterprise clouds on existing IT infrastructure. The OpenNebula Conference will be a great opportunity to remind our vision, vision and commitment, to look back at how the project has grown in the last 8 years, and to give a peek at what to expect from the project in the near future.

OpenNebulaConf2017US: Welcome and project update by Ignacio M. Llorente and R...

OpenNebula Project

Building a dev ops paas with puppet, docker, openstack and apache stratos

Lakmal Warusawithana

Cloudstack is an open source Infrastructure-as-a-Service (IaaS) software platform available under the GPLv3 license, which enables users to build, manage and deploy compute cloud environments. The community edition is based on the latest, leading edge features and bits that the Cloud.com team of engineers are working on and is supported by our open source community. Using CloudStack a free and open source cloud computing software to build a private cloud. During the training attendees will be instructed on how to install Cloudstack to manage virtual infrastructure in a private cloud computing configuration. At the conclusion of the Build a Private Cloud section users will have the knowledge needed to create a simple private cloud computing environment.

vBACD - Deploying Infrastructure-as-a-Service with CloudStack - 2/28

CloudStack - Open Source Cloud Computing Project

Besuchen Sie Nicos Vortrag um zu erfahren wie Sie Ihre eigene Private Cloud on-premises aufbauen können. Ziel dieser Session ist es, dass Sie einen Überblick erhalten, wie man eine Private Cloud Umgebung auf Basis von Kubernetes, unter Berücksichtigung notwendiger Anforderungen, aufbaut. Nico wird mit Ihnen über das Cluster Provisioning selbst sowie die benötigte Toolchain sprechen, die Sie benötigen um die eigene Umgebung erfolgreich zu betreiben. Im Vordergrund stehen dabei Themen wie Infrastructure as Code, CI/CD, Storage, Monitoring, Hochverfügbarkeit und Sicherheit. Erhalten Sie das notwendige Wissen sowie Best Practices, die Ihnen beim Aufbau Ihrer eigenen Private Cloud-Umgebung helfen.

Build your own private Cloud environment

Nico Meisenzahl

Microservices Architecture and Containers.

imjacobclark

OpenNebula 5.4 Enhancements vCenter Integration

OpenNebula Project

A description of a few CloudStack projects proposed for the 2013 Google Summer of Code. The Apache Software Foundation (ASF) is a mentoring organization for the google summer of code 2013. Apache CloudStack being a top level project at the ASF has proposed several projects for GSOC. Interested students should review those projects, engage on the CloudStack mailing list and submit a proposal. The best proposals could get awarded and the students would join the GSOC program from ~June till the end of september.

Apache CloudStack Google Summer of Code

Sebastien Goasguen

Arash Kaffamanesh presents a lightning talk during Build A Cloud Day on Platform as a Service. While most open source solution in the Cloud as focused on the IaaS layer, the Platform layer is starting to see some increase development and testing. RedHat OpenShift is seeing great traction but software like Appscale, Stackato and Cloud Fundry are also being used. In this presentation Arash presented several protoypes of deploying a Platform as a Service solution on top of a CloudStack based cloud. Not shon in the slides is the fact that Stratos from WS02 is being voted as an Apache project in the incubator. the PaaS area is heating up.

PaaS on top of CloudStack

buildacloud

Tendances (20)