Giles will talk about all that's new and happening within the Apache CloudStack community, and about new and future releases, exciting features, upcoming events and more!
How AI, OpenAI, and ChatGPT impact business and software.
Giles Sirett: Introduction and CloudStack news
1. CloudStack European User Group
27 February 2020 -Berlin
Giles Sirett
Chairman - CEUG
Twitter:@Cloudstack
2. Collaborative environment for:
All thingsApache CloudStack
Related tech: ecosystemproducts, hypervisors, storage, etc.
Technical deep-dives, issues & best practice
Case studies & user stories
To showcase complementary technologies
To share ideas & problems with other users
Meet quarterly, usually in London
LinkedIn group is only “membership database”
The aims of the CloudStack EUG
4. 13:00 Welcome and CloudStack news – Giles Sirett
13:15 Importing VMware infrastructures into CloudStack - Andre
Paul, Itelligence
14:00 CloudStack and Terraform – Robert Sander, Heinlein-
Support
14:45-15:15 Break
15:15 Primate, a new CloudStack UI - Paul Angus, ShapeBlue
16:00 Running Cloudstack and OpenShift with NetApp on KVM-
Sven Vogel, Ewerk
17:00 Drinks
Today’s Agenda
5. • CloudStack European User Group
• CloudStack User Group Germany
• Geneva CloudStack User Group
• CloudStack - Romania
• Australian CloudStack User Group
• CloudStack Brazil User Group
• Vancouver CloudStack Meetup
• Japan CloudStack User Group
• CloudStack India Bangalore Chapter
• CloudStack India Hyderabad Chapter
• CloudStack Pune Meetup
• CloudStack SF Bay Area Users Group
• CloudStack NYC User Group
• CloudStack Boston User Group
• CloudStack DC and NoVA User Group
This group is one of many…
6. C l i c k t o e d i t
CloudStack Collaboration Conferences
http://Cloudstackcollab.org
9. C l i c k t o e d i t
@CloudStack @GilesSirett
W h at i s C l ou d S t ac k ?
Apache CloudStackis a scalable, multi-
tenant, open-source, purpose-built,
cloud orchestration platform for
delivering turnkeyInfrastructure-as-a-
Service clouds
10. C l i c k t o e d i t
@CloudStack @GilesSirett
Cl o u d st ack “ k n o w n u s e r s ”
11. C l i c k t o e d i t
@CloudStack @GilesSirett
Cl ou d s t ac k *k n own u s er s ”
12. C l i c k t o e d i t
@CloudStack @GilesSirett
C l ou d S t ac k * k n ow n * u s er s
13. C l i c k t o e d i t
@CloudStack @GilesSirett
H ow t o b u i l d an IaaS c l ou d
compute StorageNetworking
Hypervisor
CMP - Orchestration layer
orchestrationAPI
eCommerce Platform
Choice of Hypervisor (KVM, VMWare,
Xen, hyper-V, OVM, XCP-ng)
Apache CloudStack
Cloudstack UI
CloudStack API
CaaS ecommercce
Networking compute Storage
PaaS
Developer
tooling
Multi-cloud
management
Cloud Monkey
14. C l i c k t o e d i t
@CloudStack @GilesSirett
K ey c l ou d S t ac k f eat u r es
• Broad & deep Hypervisor support
• XenServer, KVM, VMware, OracleVM, Hyper-V, XCP-ng
• Enterprisegrade tenant Virtual Networking model
• Scalable architecture
• Support thousands of hosts and virtual machine
guests
• Largest known production cloud 35k+ physical hosts
• High availability
• Configurations that provide automatic failover for
virtualmachines
• Choice of interfaces
• Web UI, command line, REST-based API
16. C l i c k t o e d i t
AP I exam p l es
Examples of Cloudstack Rest API:
List VMs for all users: http://10.2.3.183:8096/client/api?command=listVirtualMachines&listall=true
List all my templates: http://10.2.3.183:8096/client/api?command=listTemplates&templatefilter=all
Create new network "RootNet2"
http://10.2.3.183:8096/client/api?command=createNetwork&zoneId=ea2edb5f-2fbd-4390-a731-
b4e252d2f5c7&name=RootNet2&displayText=RootNet2&networkOfferingId=d323caa4-976b-4cd3-b57c-
58864b842a40&domainid=d30d22bf-6afd-11e8-aa6b-06227e0108af&account=admin
Create a new VM attached to RootNet1
http://10.2.3.183:8096/client/api?command=deployVirtualMachine&response=json&zoneid=ea2edb5f-2fbd-4390-
a731-b4e252d2f5c7&templateid=d3121fc3-6afd-11e8-aa6b-
06227e0108af&hypervisor=VMware&serviceofferingid=89e3afd9-3ed6-4975-a9a9-
58953f94a9f2&iptonetworklist%5B0%5D.networkid=af048a31-f140-4907-b2ac-
85ae67767ff9&displayname=RootVM2&name=RootVM2&keyboard=uk&domainid=d30d22bf-6afd-11e8-aa6b-
06227e0108af&account=admin
Note: for simplicity, thesecommands are beingrunover an unauthenticatedport (8096) - this is
not recommendedfor productionuse andwould usually be disabled
17. C l i c k t o e d i t
C l ou d m on k ey C L I
18. C l i c k t o e d i t
C l ou d S t ac k t od ay
• 3-4 releases per year
• Widespread production deployment
• Public cloud providers
• Private cloud use-cases
• LTS releases
• Diverse user driven developer community…..
19. C l i c k t o e d i t
C l ou d S t ac k t od ay
• Governed by Apache Software
Foundation
• C.200 project committers
• Diverse PMC
• Last 4 weeks (to 25 February)
• 450 mailing list msgs
• 69 mailing list contributors
• 57 Commits
• 1520 package downloads
• Lots of meetups & events
21. 4.13.0 released (September 2019)
4.13.x is an LTS branch
c. 200 new features, enhancements and fixes since 4.12
4.14.0 Release in process (as in right now!)
4.14 will be an LTS branch
Should be in March
Releases
22. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
• CloudStack Backup and Recovery Framework
• CloudStack KubernetesService andCloudStack KubernetesProvider
• KVM Rolling Maintenance
• KVM DRS
• VR Health-checks
• SystemVM Management API
• VM Ingestion
• Direct Download for systemVM template (KVM)
• Primary Storage AgnosticDirect Downloads(KVM)
• Oh, and finally…….
CloudStack 4.14 Release – Headline features
23. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
...a new User Interface for
Apache Cloudstack!
C l ou d S t a c k 4 . 1 4 R e l e a s e – H e a d l i n e f e a t u r e s
24. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
KVM Rolling Maintenance
• Select a zone, pod or cluster
• Supply upgrade/patching scripts to KVM hosts
• Instruct CloudStack to run scripts on the hosts one by one in a
cluster, evacuating a host and putting it into maintenance
mode where necessary
C l ou d S t a c k 4 . 1 4 R e l e a s e – H e a d l i n e f e a t u r e s
25. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
KVM DRS
(an enterprise feature, without the enterprise price tag ☺)
• Iterative migration of guest instances to either:
• Balance host
• Pack hosts
• DRS process simplified by
• Calculating the most effect guest instance to move*
• Live migrating it
• Checking to see if DRS threshold has be satisfied
• If not, calculate the most effect guest instance to move now
C l ou d S t a c k 4 . 1 4 R e l e a s e – H e a d l i n e f e a t u r e s
26. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
VR Health-Checks
• Router periodically running self checks
• Management servers periodically polling to ensure checks have
run and receive results
• Configurable thresholds set to avoid false positives
• Alerts raised when checks fail
• Automatic VR restarts when specified checks fail (optional)
C l ou d S t a c k 4 . 1 4 R e l e a s e – H e a d l i n e f e a t u r e s
27. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
VR Health-Checks
• Basic connectivity from management server to virtual router
• Basic connectivity to virtual router interfaces' gateways
• Free disk space on virtual router's disk
• CPU and memory usage
• Basic VR Sanity checks:
• dnsmasq/strongswan/haproxy/etc service running
• DHCP/DNS config sanity check
• Advanced VR Sanity checks:
• DHCP/DNS configuration matches mgmt server DB
• IPtables rules match mgmt server DB records
• HAproxy config matches mgmt server DB records
• VM network sanity checks
C l ou d S t a c k 4 . 1 4 R e l e a s e – H e a d l i n e f e a t u r e s
28. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
System VM Management API
• Enables granular management over systemVM templates
Register many, change the “active” one at any time
• Define systemVM template during zone deployment
no more pre-seeding of the template required
• Decouple ACS upgrades from systemVM upgrade
• Allow for easy setup of new/customized systemVM template
Security patches, port opening, other customizations
C l ou d S t a c k 4 . 1 4 R e l e a s e – H e a d l i n e f e a t u r e s
29. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
System VM Management API
C l ou d S t a c k 4 . 1 4 R e l e a s e – H e a d l i n e f e a t u r e s
30. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
VM ingestion
• Take existing VMs from vSphere and “import” them into CloudStack
• More in Andre’s talk
C l ou d S t a c k 4 . 1 4 R e l e a s e – H e a d l i n e f e a t u r e s
31. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
• CloudStack Kubernetes Service
Allows easy creation of CaaS service on top of Cloudstack
A plugin to create and manage Kubernetes cluster
• CoreOS templatesfor nodes, kubeadm for cluster
provisioning
• Offline installation of k8s and docker binarieson
cluster nodes for selected k8s version via ISO
(uploaded by admin)
• Gracefully scale up or scale down
• Access kube.config for cluster for accessing k8s
dashboard
• Delete cluster while removing nodesand k8s service
C l ou d S t a c k 4 . 1 4 R e l e a s e – H e a d l i n e f e a t u r e s
32. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
• Cloudstack Backup and Recovery Framework
• Modular framework
• Can exploit any 3rd party backup platform
• Provider created for Veeam
C l ou d s t a c k B a c k u p a n d R e c ov e r y F r a m e wor k
33. C l i c k t o e d i t
The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists
Specifically:
• Support for:
• Operator created ‘policy based’ backups (RPOs)
• Scheduled backups (similar to snapshot scheduling)
• Ad hoc backups
• Backups as first class citizens
• ‘In-place’ restoration of entire VM including data disks
• Restoration of VM backup after original VM is destroyed
• Restoration of individual VM volumes (can then be attached to another VM)
• Full integration into the CloudStack API, UI, usage service (recording both
protected and on-disk data metrics)
C l ou d s t a c k B a c k u p a n d R e c ov e r y F r a m e wor k
34. C l i c k t o e d i t
The Cloud Specialists
@ShapeBlueShapeBlue.comThe Cloud Specialists
C l ou d s t a c k B a c k u p a n d R e c ov e r y F r a m e wor k
‘Policy Based’ Backups
• listBackupPolices external=true
Returns ‘template’ jobs.
• importBackupPolicy Creates a policy (with
a name and description) in CloudStack
and maps it to a Veeam template job.
ie.
GOLD – 6hr RPO
SILVER – 24hr RPO
BRONZE – 7 day RPO
35. C l i c k t o e d i t
The Cloud Specialists
@ShapeBlueShapeBlue.comThe Cloud Specialists
C l ou d s t a c k B a c k u p a n d R e c ov e r y F r a m e wor k
‘Ad-hoc’ & Scheduled Backups
• CloudStack will send command to carry
out an ad-hoc run of the policy based job
or create one as required.
• Ad-hoc and scheduled jobs will be driven
by CloudStack
• One VM to one Veeam job mapping allows
for simpler accounting and unified
incremental backups
37. C l i c k t o e d i t
C om m u n i t y n ew s
• Special Interest Group (SIG) created for Primate UI
Provided effective way of accelerating development
Has proved successful, although lessons learnt
• Sig currently being setup for SDN
• New VP/Chair of Apache Cloudstack
Currently being selected by PMC
39. Next meeting of CSEUG:
4 June 2020 – Ticketmaster, London
Registration open soon - Eventbrite
European Cloud Infrastructure Day
2020
14 June 2020, Sofia
Hosted by Storpool
Upcoming events
40. CloudStack CollaborationConference2020
New Orleans
28 September – 2 October
2 x Cloudstack talk tracks
Cloudstack Hackathon
Co-located with Apachecon
More Information
http://cloudstackcollab.org
http://apachecon.org
41. If you’re new: join the Users@ mailing list
Get your organisation to be public about
their use of ACS
Get on the “known user” list*
Offer to do a case study with PMC/ASF
Go and talk about it !
*Known user list: http://cloudstack.apache.org/survey.html
Specific calls to action