IT infrastructure rigidity has emerged as one of the leading barriers to achieving the cost efficiency and operational agility required to drive growth. While public cloud such as Amazon Web Services and Rackspace provide this agility, many organizations are precluded from utilizing them due to regulatory, security, performance, and/or existing investments. For these organizations to realize these agility benefits, they must transform their private infrastructures to embrace public cloud principles.
During this session, we will explore cloud system architecture principles and best practices. Using the Apache CloudStack cloud orchestration platform and Basho’s Riak CS object store, a complete, open source private cloud will be realized that creates the operational agility and cost-reduction benefits of public clouds.
Nell’iperspazio con Rocket: il Framework Web di Rust!
Building Complete Private Clouds with Apache CloudStack and Riak CS
1. BUILDING COMPLETE PRIVATE
CLOUDS WITH APACHE
CLOUDSTACK + RIAK CS
John Burwell
(jburwell@basho.com | @john_burwell)
Wednesday, October 23, 13
2. Who Am I
•
Consulting Engineer @ Basho Technologies
•
Member, Apache CloudStack PMC
•
Ran operations and designed automated provisioning for hybrid
analytic/virtualization clouds
•
Led architectural design and server-side development of a SaaS
physical security platform
Wednesday, October 23, 13
3. ... but I submitted a ticket.
Wednesday, October 23, 13
4. Shifting Role Of IT
From Cost Center
To Business Opportunity
Wednesday, October 23, 13
7. Agility
Exploitation Requires Rapid Execution
Infrastructure management must be delegated
Infrastructure Must Become Boring
Wednesday, October 23, 13
9. Got It ... Why Go Private?
•
Leverage existing infrastructure investment
•
Customization and Control
•
Regulatory/Security Requirements
•
Cost
Wednesday, October 23, 13
15. Software Is Eating Hardware
•
Moore’s Law has pulled fault tolerance up the stack
•
Commodity Hardware
•
•
•
Reduced cost
Services more workload types
Dynamic resource allocation
Wednesday, October 23, 13
16. Software Is Eating Hardware
•
Moore’s Law has pulled fault tolerance up the stack
•
Commodity Hardware
•
•
•
Reduced cost
Services more workload types
Dynamic resource allocation
Specialized Hardware Reduces Agility
Wednesday, October 23, 13
23. What Is Apache CloudStack?
§Open source software that deploys
and manages large networks of
virtual machines, as a highly
available, highly scalable
Infrastructure as a Service (IaaS)
cloud computing platform.
§CloudStack is a Top-Level Project at
the Apache Software Foundation.
Wednesday, October 23, 13
24. What Is Apache CloudStack?
§Open source software that deploys
and manages large networks of
virtual machines, as a highly
available, highly scalable
Infrastructure as a Service (IaaS)
cloud computing platform.
§CloudStack is a Top-Level Project at
the Apache Software Foundation.
Wednesday, October 23, 13
26. Anatomy Of CloudStack
•
Management Server Farm
•
•
VM
Network
Host
Collection of clusters in the same failure boundary
Primary
Storage
A grouping of hosts and their associated storage
Hosts
•
•
Collection of pods, network offerings and secondary storage
Cluster
•
•
Host
Pod
•
•
VM
Zone
•
•
Management and provisioning tasks
Cluster
Secondary
Storage
Cluster
Servers onto which services will be provisioned
Primary Storage
CloudStack Pod
•
•
VM disk storage
Network
•
CloudStack Pod
Logical network associated with service offerings
Zone
•
Secondary Storage
•
Template, snapshot and ISO storage
Wednesday, October 23, 13
27. Primary Vs Secondary Storage
•
Random access read/write
•
Write once/read many
•
Changes often
•
Append only
•
Zone Scoped
•
Zone or Region Scoped
•
Focused on throughput
•
Focused on reliability
Wednesday, October 23, 13
28. Primary Vs Secondary Storage
•
Random access read/write
•
Write once/read many
•
Changes often
•
Append only
•
Zone Scoped
•
Zone or Region Scoped
•
Focused on throughput
•
Focused on reliability
Secondary Storage is the lifeboat.
Wednesday, October 23, 13
29. What Is Riak CS?
•
Simple, reliable storage of large objects accessed using the S3 or Swift
API
•
Objects are stored in buckets with a unique key
•
Multi-tenant security model with per object ACLs
•
Usage Accounting and Reporting
•
Open Source (Apache2 Licensed)
Wednesday, October 23, 13
30. What Is Riak CS?
•
Simple, reliable storage of large objects accessed using the S3 or Swift
API
•
Objects are stored in buckets with a unique key
•
Multi-tenant security model with per object ACLs
•
Usage Accounting and Reporting
•
Open Source (Apache2 Licensed)
Your Own Private S3
Wednesday, October 23, 13
31. Anatomy Of Riak CS
•
S3/Swift API Proxy + Riak key-value store
•
Peer-to-Peer Design: Any node can service any read or accept
any write request
•
Maintains multiple replicas (default 3) spread across multiple
nodes
•
Ops Friendly
Wednesday, October 23, 13
32. Anatomy Of Riak CS
•
S3/Swift API Proxy + Riak key-value store
•
Peer-to-Peer Design: Any node can service any read or accept
any write request
•
Maintains multiple replicas (default 3) spread across multiple
nodes
•
Ops Friendly
Horizontally scaleable storage on
commodity hardware
Wednesday, October 23, 13
33. Riak CS Use Cases
•
Secondary Storage for VM snapshot and template data
•
Database Backup Storage
•
Serving Static Content
•
Application Log Storage
Wednesday, October 23, 13
34. Achieving Commodity Reliability
•
Create a zone per power source/backbone network connection
•
Establish independent primary storage in each zone
•
Utilize intra-datacenter block-level replication between zones
•
Distribute Riak CS nodes evenly across zones
Wednesday, October 23, 13
40. Up And Running With Riak CS
•
Learn more @ http://basho.com/riak-cloud-storage
•
Grab it @ http://docs.basho.com/riakcs/latest/riakcsdownloads/
•
Follow us @basho
•
Help from the riak-users@lists.basho.com mailing list or on
FreeNode @ #riak
•
Contribute @ http://github.com/basho/riak_cs
Wednesday, October 23, 13
41. Join Our Community
•
Learn more @ http://cloudstack.apache.org
•
Grab it @ http://cloudstack.apache.org/downloads.html
•
Follow us @cloudstack
•
Help from the cloudstack-users@cloudstack.apache.org mailing
list or on Freenode @ #cloudstack
•
Contribute on the cloudstack-dev@cloudstack.apache.org
mailing list or on Freenode @ #cloudstack-dev
Wednesday, October 23, 13