Enterprise rails hosting 3 ways to scale - 2011-10

Enterprise Hosting
for Ruby on Rails

Julian Fischer
fischer@enterprise-rails.de
http://www.enterprise-rails.de
Samstag, 15. Oktober 11

Introduction


Introduction
About me


About me
Julian Fischer
‣Twitter: http://www.twitter.com/railshoster
‣E-Mail: fischer@enterprise-rails.de


About me
Julian Fischer

‣ CEO of Avarteq GmbH


About me
Julian Fischer

‣ Lecturer „Ruby on Rails“ @ HTWdS


About me
Julian Fischer

‣ Ruby und Ruby on Rails programmer


About me
Julian Fischer

‣ Ruby und Ruby on Rails programmer
‣ Entperise-Rails.de - Head of Hosting


Introduction
About Avarteq GmbH


About Avarteq GmbH

@railshoster


About Avarteq GmbH

‣ Founded in Nov. 2008
from two existing companies.

@railshoster


About Avarteq GmbH


‣ Involvment of Key-Systems GmbH
manages ~2,5 * 10^6 domains for customers of 200+ countries.

@railshoster


About Avarteq GmbH


‣ Involvment of Key-Systems GmbH
manages ~2,5 * 10^6 domains for customers of 200+ countries.

‣ Team size: ~20 people
>16 full-time

@railshoster


Introduction
Assumptions for this talk



@railshoster



‣ Ruby and Ruby on Rails architectures to be hosted.

@railshoster



‣ Hosting basics you know what a LB is and what it does.

@railshoster



‣ Hosting basics you know what a LB is and what it does.
‣ You aresuitable hosting solution a methodology toto see
determine a
interested in
for you. And you don‘t need
Ruby code in a presentation to like it :-)

@railshoster


Hosting today
and in the near future


The future of hosting
can be found in the cloud.


But not on EC2.


US Cloud providers do to hosting
what Starbucks did to coffee.

From $1 with free refill to ...


More and more
free or achievable cloud
technologies emerge.


Hosting today and in the future

@railshoster



‣ Eucalyptus

@railshoster



‣ Eucalyptus
‣ OpenStack

@railshoster



‣ Eucalyptus
‣ OpenStack
‣ vCloud

@railshoster



‣ Eucalyptus
‣ OpenStack
‣ vCloud
‣ ...

@railshoster


Many „smaller“ clouds
will become available
within the next few years.


Additional abstraction layers
will be established.
Helping to stay independent
or even mash up existing clouds.


Abstraction via services


„Start an instance on an internal cloud, then with the same code
start another on EC2 or Rackspace.

Deltacloud protects your apps from cloud API changes and
incompatibilities, so you can concentrate on managing cloud
instances the way you want.“
http://incubator.apache.org/deltacloud/

Client side abstraction


Fog

„Collections provide a
simplified interface, making clouds easier
to work with and switch between.“

https://github.com/geemus/fog

So be prepared for the cloud.
Design your app scalable.


BUT


For now
Consider your options.
Pick carefully.


Making a decision requires
options to choose from.


Know your options!


3 Hosting Scenarios
Overview


3 Hosting Scenarios

@railshoster


3 Hosting Scenarios

‣ Cloud Hosting

@railshoster


3 Hosting Scenarios

‣ Cloud Hosting
‣ Commodity Hardware Cluster

@railshoster


3 Hosting Scenarios

‣ Cloud Hosting
‣ Commodity Hardware Cluster
‣ High End Hardware Cluster

@railshoster


3 Hosting Scenarios
Cloud Hosting


Cloud Hosting
Urban Legends


Urban Legends

@railshoster


Urban Legends

‣ Cloud technologies are wonderful

@railshoster


Urban Legends

‣ People become euphoric

@railshoster


Urban Legends

‣ Marketing people oversimplify
advantages

@railshoster


Urban Legends

‣ Marketing people oversimplify
advantages

‣ People want do believe

@railshoster


#1
Go to the cloud
and get rid of sys ops.


Urban Legends

‣ The hole decision process should be
accompanied by an experienced sys op.
You don‘t need plenty of workhours here but you definitely want to have
advice here and there.

@railshoster


Urban Legends

‣ The hole decision process should be
accompanied by an experienced sys op.
You don‘t need plenty of workhours here but you definitely want to have
advice here and there.

‣ You‘re still running will needservices. Depending
on how custom your system is you
unix
sys ops helping to configure
your services accordingly. Template configs from the community might
not fit your scenario. How much memory do you got? You have to adapt
cache sizes, number of Passenger processes to be spawned, ...

@railshoster


Urban Legends

‣ Whoconfigurationyour chef recipies? Who writes your
service
writes
templates? Who tweaks your database?

@railshoster


Urban Legends

service
writes

‣ Everyactuallya mistery failure? sporadic networkbe
there but
got
is. Library dependency issues,
Which shouldn‘t

problems, spontenously failing processes, ...

@railshoster


Urban Legends

service
writes

‣ Everyactuallya mistery failure? sporadic networkbe
there but
got
is. Library dependency issues,
Which shouldn‘t

problems, spontenously failing processes, ...

‣ Who recovers production databases. failures? Taking
your backups and refills
from serious

@railshoster


Who gets up at night?


Not having a sys op means ...


Urban Legends

‣ Makingaa mistakes potentially causing aroles have different
so hard to be sys op and programmer at once. These
lot of trouble. It‘s

perspectives, by nature.

@railshoster


Urban Legends



‣ Accpeting drawbacks by not focusing on service
configurations, ...

@railshoster


Urban Legends



‣ Accpeting drawbacks by not focusing on service
configurations, ...

‣ Havingsys op tasks can be considered a sys op. opsifsbd. looks
performing
people acting like sys
Even he/she
like a programmer :-)

@railshoster


#2
Go to the cloud and
have no outages any more.


Urban Legends

‣ Data center issues can‘t caused by switches, routes,
experience, there will be network outages
be avoided From
broken wires, whatever. http://rh.gd/nMNSUK as an example.

@railshoster


Urban Legends

be avoided From

‣ Self healing can‘t recover it‘s a good issue it does
Resetting your computer often helps. Hence
every
guess. But
not help all the time. Do you really want to distract your programmers to
dig through unix service logs? Ineffective.

@railshoster


Urban Legends

be avoided From

‣ Self healing can‘t recover it‘s a good issue it does
Resetting your computer often helps. Hence
every
guess. But
not help all the time. Do you really want to distract your programmers to
dig through unix service logs? Ineffective.

‣ Autoscaling won‘t keepautoscale settings eitherup
unless you set it up correctly AND your
your service
match
the situation or be very aggressive (wasting money). Do you really want
to scale out on a DDoS attack?

@railshoster


#3
Go to the cloud and
save money.


Urban Legends

‣ Not true for every case. You have to do the math.

@railshoster


Urban Legends

‣ Not true for every case. You have to do the math.
‣ Actually it‘s pretty expensive.

@railshoster


#4
Go to the cloud
it‘s safe.


Urban Legends

‣ It‘s simply not There are serious legal issues being discussed.

@railshoster


Urban Legends

‣ It‘s simply not There are serious legal issues being discussed.
‣ Infrastructure non-transparency Dobe sure about
understand the infrastructure topology? If not how can you
you really

your data being kept private?

@railshoster


Again.
Cloud is a future technology.
But don‘t be blind.


Cloud Hosting
Pro


Cloud Hosting

@railshoster


Cloud Hosting

‣ Maximal flexibility with Auto Scaling

@railshoster


Cloud Hosting

‣ Grow & Shrink start and stop (app/server) instances. Shut
down what you don‘t need and pay per use.

@railshoster


Cloud Hosting


‣ Robustness with auto healing.

@railshoster


Cloud Hosting


‣ Robustness with auto healing.
‣ Kill and restart misbehaving components.

@railshoster


Cloud Hosting
Contra


Cloud Hosting

‣ Scaletocarefullyresulting into a FDoS - tofinancial denial of
requests DDoS attack
or do you really want scale out to serve
a
service by spending all your money? Setup your scaleout rules carefully.

@railshoster


Cloud Hosting

‣ Scaletocarefullyresulting into a FDoS - tofinancial denial of
requests DDoS attack
or do you really want scale out to serve
a
service by spending all your money? Setup your scaleout rules carefully.

‣ Autohealing withinNothing replaces anoff - switch onsysop!
always a suitable repair strategy.
limits switch
experienced
it not

It‘s just reducing his workload taking away no brainer tasks.

@railshoster


Cloud Hosting

‣ Causes legal issues for EU companies putting data to a US
providers. http://rh.gd/p6l26y (german). In certain scenarios
virtualizatin is completely forbidden (e.g. certain levels of pci
compliance).

@railshoster


Cloud Hosting

compliance).

‣ Unreasonable expensive compared Depending on your
hardware. 4 - 20 times more for similar performance.
to physical

cloud provider and instance/resource type.

@railshoster


Cloud Hosting

compliance).

‣ Unreasonable expensive compared Depending on your
hardware. 4 - 20 times more for similar performance.
to physical

cloud provider and instance/resource type.

‣ You are a number by being one in a million customers. Don‘t
expect reasonable help when needed.

@railshoster


Did you know?


3 Hosting Scenarios
Commodity Hardware


Commodity Hardware
Pro


Commodity Hardware

@railshoster


Commodity Hardware

‣ „Cheap“ hardware in huge datacenters.

@railshoster


Commodity Hardware

‣ Traffic included.

@railshoster


Commodity Hardware

‣ Private GBit backnet available. Physically dedicated

@railshoster


Commodity Hardware

‣ Maximum performance from your budget. Get a E3 Xenion
Quad Core 1245, 16 GB ECC RAM, 2*3TB HDD for 69 € / month.

@railshoster


Commodity Hardware

‣ Why would you scale out if you already have
plenty of workforce for your money? That‘s a simple
thought. A very good option especially if you know your load and grow
rate.

@railshoster


Commodity Hardware

‣ Why would you scale out if you already have
plenty of workforce for your money? That‘s a simple
thought. A very good option especially if you know your load and grow
rate.

‣ No legal issues for EU companies.

@railshoster


Commodity Hardware
Contra


Commodity Hardware

‣ You are a number by being one in a couple of thousand
customers. Expect response and repair times within 30 min to 24h.

@railshoster


Commodity Hardware


‣ Scaling less flexible. Server relocation might be necessary.
Server setup fees make shrink operations expensive.

@railshoster


Commodity Hardware


‣ Scaling less flexible. Server relocation might be necessary.
Server setup fees make shrink operations expensive.

‣ Hardware is not high end. Smart system design needed to
compensate eventual hardware failures.

@railshoster


3 Hosting Scenarios
High End Hardware


High End Hardware
Pro


High End Hardware

@railshoster


High End Hardware

‣ High end hardware in well staffed datacenters. Close contact to
data center technicians. Quick responses. Fast failure recovery.

@railshoster


High End Hardware


‣ Very realiable hardware. Hardware RAID, hot swappable
hdds, redundant power supplies, ...

@railshoster


High End Hardware




@railshoster


High End Hardware



‣ Maximum performance. Get multi cpu servers with 2 x 6
XENON Cores, up to 192 GB RAM, SAS and SDD hdds, ...

@railshoster


High End Hardware

‣ Custom equipped servers can be built specific for their
individual purposes. A server with fast cpus and SSD disks will boost
your DB service, for example.

@railshoster


High End Hardware


‣ Vertical scale outs Servers can be upgraded by adding more
memory, better CPUs, more hdds, ...

@railshoster


High End Hardware


‣ Vertical scale outs Servers can be upgraded by adding more
memory, better CPUs, more hdds, ...

‣ Hybdrid solutions with private clouds. If there‘s a
private cloud co-located in the datacenter you can have physical
machines to encounter ground loads and use a cloud workforce to serve
peaks.

@railshoster


High End Hardware

‣ Scale outs New servers can be added. High end data centers usually
provide advanced switching technologies with vlan capabilities.

@railshoster


High End Hardware

‣ Scale outs New servers can be added. High end data centers usually
provide advanced switching technologies with vlan capabilities.

‣ No legal issues for EU companies.

@railshoster


High End Hardware
Contra


High End Hardware

‣ More expensive than cheap hw Still much cheaper than
cloud resources for a comparable performance.

@railshoster


High End Hardware

‣ More expensive than cheap hw Still much cheaper than
cloud resources for a comparable performance.

‣ Contract durations Due to financial write offs contract lifetimes
are usually longer than for commodity servers or cloud resources.

@railshoster


Proceed systematically.

Think. Evaluate. Think again.


How to build a hosting
An exemplary process


Requirements Analysis



@railshoster



‣ Budget Calculate roughly 2.5 to 5% of your overall project costs.

@railshoster



‣ Expected Load

@railshoster



‣ Expected Load
‣ Ground load Present on a daily basis.

@railshoster



‣ Expected Load
‣ Ground load Present on a daily basis.

‣ Peak load Triggered by (external) events.

@railshoster



‣ Desired Response Time How many ms to serve.

@railshoster



‣ Desired Availability Uptime / Downtime ratio.

@railshoster



‣ Geographic Targeting Where are your users located?

@railshoster



‣ Geographic Targeting Where are your users located?
‣ Estimated Growth 1 month, 6 month, 12 months.

@railshoster



‣ Legal constraints Be aware of privacy law issues.

@railshoster



‣ Technical constraints e.g. ugly Windows legacy stuff.

@railshoster



‣ Technical constraints e.g. ugly Windows legacy stuff.
‣ Competence Know how to run an app in production?

@railshoster


Identify System Components



@railshoster



‣ Which components store, replicating rdbms, ... server,
background processing, key/value
are present? search

@railshoster



‣ Which components store, replicating rdbms, ... server,
background processing, key/value
are present? search

‣ Eliminate SPOFs Try to have everything crucial twice+.

@railshoster


Choose Platform


Choose Platform

@railshoster


Choose Platform

‣ Which platform matches your
requirements best? Shrink/Scale, cheap workforce or rock
solid?

@railshoster


Choose Platform

solid?

‣ (Really) needIfresources on shrink, cloud providersit
just for the case that ... you need to grow and
demand? Or is
will to the trick.

@railshoster


Choose Platform

solid?

‣ (Really) needIfresources on shrink, cloud providersit
just for the case that ... you need to grow and
demand? Or is
will to the trick.

‣ Want to have the maximum performance
from your budget? Then hardware might be your choice.

@railshoster


Choose Platform

‣ Geographic location Where are your users.

@railshoster


Choose Platform

‣ You andyou have access to technical staff? you a number or a
customer? Do
the supply chain Are

@railshoster


Choose Platform

‣ You andyou have access to technical staff? you a number or a
customer? Do
the supply chain Are

‣ Quality of Service What are the response times? How fast do
they repair?

@railshoster


Initial Dimension


Initial Dimension

@railshoster


Initial Dimension

‣ Know yourapp‘s resource consumption. Atresponse time you‘ll
need to know your
app To match your desired
least roughly.

@railshoster


Initial Dimension

need to know your
least roughly.

‣ Create acomponent. The smaller your building blockswhere to run
which system
system design draft. Decide
are the
better.

@railshoster


Initial Dimension

need to know your
least roughly.

which system
are the
better.

‣ Estimatesettings #you‘re on a cloud plattform. And decide
about scaleout
the servers you need.
if

@railshoster


Initial Dimension

need to know your
least roughly.

which system
are the
better.

‣ Estimatesettings #you‘re on a cloud plattform. And decide
about scaleout
the servers you need.
if

‣ Order servers or whatever you rely on.

@railshoster


System Design


System Design

@railshoster


System Design

‣ Detailed System Design How what where to runtowhat.
How to use what resource when and how.
Describes
to connects what.

@railshoster


System Design

Describes
to connects what.

‣ Monitoring plan. Monitor everything need appSo planon.
This will give you diagnosis information when you
your
it.
relies
what
to monitor how.

@railshoster


System Design

Describes
to connects what.

‣ Monitoring plan. Monitor everything need appSo planon.
This will give you diagnosis information when you
your
it.
relies
what
to monitor how.

‣ Backup plan. Data can bedata to beprepared and think about
where your app produces valuable
lost. Be
backuped.

@railshoster


Installation(automation)



@railshoster



‣ Get a bluprint of your hosting Use Chef.

@railshoster



‣ Describe how to setup every system
component. Keep your recipies small and simple.

@railshoster



‣ Describe how to setup every system
component. Keep your recipies small and simple.

‣ Be ready for a deployment.run cap deploy afterwards.
automated your installation process if you can
You have successfully

@railshoster


Strengthen your system.


Strengthen your system

@railshoster



‣ Yourmonitor such as kickstart, monit or god to keep them alive. a
process
app need dependent processes? Use
Double check with nagios for a system health status.

@railshoster



process

‣ Makeget back toserversa black out automatically.Your system
needs to
your
normal on
reboot proof.

@railshoster



process

needs to
your
normal on
reboot proof.

‣ Desaster and Recovery planning. What is the
most likely error event? What is the impact? How to fix it?

@railshoster



process

needs to
your
normal on
reboot proof.

‣ Desaster and Recovery planning. What is the
most likely error event? What is the impact? How to fix it?

‣ Simulate disasters. Test your recovery plans.

@railshoster


Deployment



‣ Use a deployment tool. Not really worth mentioning
but just to be complete. Do I have to mention capistrano?

@railshoster



‣ Use a deployment tool. Not really worth mentioning
but just to be complete. Do I have to mention capistrano?

‣ Setup Capistrano. CapwhateverShouldn‘t Make more than
that for the average case. Automate
deploy.
you can.
need
it foolproof.

@railshoster


Test && Launch


Test && Launch

@railshoster


Test && Launch

‣ Test your setup. Perform acceptance tests. Partly covered by
your desaster simulations. Also test with your customer, your users, ...

@railshoster


Test && Launch

‣ Test your setup. Perform acceptance tests. Partly covered by
your desaster simulations. Also test with your customer, your users, ...

‣ Go live! Cover your eyes and pray :-)

@railshoster


Lessons Learned
Key Statements to remember


Lessons Learned

@railshoster


Lessons Learned

‣ Creating a hosting. Should be considered to be a project.
Process it systematically.

@railshoster


Lessons Learned


‣ Be aware ofhammer everything you see a ahammer.
Because if you got a
people holding
is nail.

@railshoster


Lessons Learned


people holding
is nail.

‣ Make decisions. No decision without choices. Know your
options.

@railshoster


Lessons Learned


people holding
is nail.

‣ Make decisions. No decision without choices. Know your
options.

‣ Reduce sysop work. But running an app is a pain and
burdon for most developers.

@railshoster


Focus on adding value to your
business.


Focus on your app.


Thank you
for your
attention!

Headquarter: Rails Enterprise Hosting:
http://www.avarteq.de http://www.enterprise-
rails.com
Blog:
http://ww.treibstofff.de Rails Hosting:
http://www.railshoster.com

Enterprise rails hosting 3 ways to scale - 2011-10

Recommandé

Recommandé

Contenu connexe

Similaire à Enterprise rails hosting 3 ways to scale - 2011-10

Similaire à Enterprise rails hosting 3 ways to scale - 2011-10 (20)

Plus de Avarteq

Plus de Avarteq (15)

Dernier

Dernier (20)

Enterprise rails hosting 3 ways to scale - 2011-10