SlideShare une entreprise Scribd logo
1  sur  27
Télécharger pour lire hors ligne
Living in the Cloud
            Conor O'Neill
CEO LouderVoice & Co-Founder HushVine
Introduction
 1.   Me
 2.   History of LouderVoice
 3.   Transition to Cloud
 4.   Current Model
 5.   Scaling
 6.   Issues
 7.   Outline of HushVine
 8.   Node.js + MongoDB
 9.   Iaas vs PaaS
10.   What's Next?
11.   Q&A
Me - 20 yrs Technology Management
○ 1990s : S3/Philips, Integral Design
  ○ Telecoms and then Digital TV
○ 2002 : Advanticus
  ○ Digital Convergence
○ 2003 - 2006 : EMC
  ○ Prof Services around SRM
○ 2006-2006 : McAfee
  ○ Localisation
○ 2006 -Now : LouderVoice
  ○ Customer Reviews SaaS
○ 2011-Now : HushVine
  ○ Social TV on a Second Screen
History of LouderVoice
2005 - We should do a startup
2006 - Build blog reviews aggregation platform
2007 - Expand to non-blogs and Twitter
2008 - Build first API for Business Customer
2009 - Build Widget-based solution
2010 - Move entirely to B2B Model
2011 - Scale
2012 - Grow via Channel and L10N
What it Looks Like 1
What it Looks Like 2
What it Looks Like 3
LAMP
Linux + Apache + MySQL + PHP/Perl/Python

LouderVoice =
  NGINX
  Apache mod_wsgi
  MySQL
  Python
  Django
  Memcached
LouderVoice Architecture
                  NGINX Simple Load Balancer

                                                                 Content Distribution
                                                                      Network


  Application            Application             Application
Server = Apache        Server = Apache         Server = Apache
  + Django +             + Django +              + Django +
    Python                 Python                  Python




           MySQL                         Solr Search                Memcached
Transition to Cloud
Pre-Launch = Simple Shared Hosting
2006 - 2007 = Low-end VPS
2007 - 2009 = Dedicated Softlayer Servers
2009 - Now = 99% Amazon AWS
2011 - Now = Some CloudFoundry, Heroku
and Nodejitsu
Current AWS Setup
A number of generic small EC2 Instances
   1.7GB Memory
   1 Compute Unit
All running Ubuntu 10.04LTS Linux
EBS for all live data
RDS for MySQL
Cloudfront for CDN
S3 for backup
Elastic IP for easy switchover
LouderVoice on AWS
                      Elastic IP


                                                                All Static Content on
                NGINX on EC2 instance
                                                                      Cloudfront




 Application          Application               Application
Server on EC2        Server on EC2             Server on EC2
 with Data on         with Data on              with Data on
     EBS                  EBS                       EBS            Backups on S3




                                   Solr Search on EC2 with     Memcached on EC2 with
      MySQL on RDS
                                         Data on EBS               Data on EBS
How it all Works
 Client site with
  LouderVoice        Widget code, CSS,     Content searched usingSolr
Code running on     images delivered by
 one or more of      Cloudfront CDN for
their web-pages          geographic
                        performance



 Client site with                                Data cached
  LouderVoice                                        using
Code running on                                 Memcached for
 one or more of                                  performance
their web-pages


                    Required content etc
 Client site with    retrieved from App
  LouderVoice              Servers            Reviews/Users/etc
Code running on                              stored/retrieved from
 one or more of                                     MySQL
their web-pages
Other Services
 1.   DNSMadeEasy
 2.   AuthSMTP
 3.   Pingdom
 4.   Google Apps for my Domain
 5.   WordPress
 6.   GitHub
 7.   Redmine
 8.   Bit.ly
 9.   Facebook APIs
10.   Twitter APIs
Management Tools
1.   AWS Console
2.   Elasticfox
3.   Cloudberry Explorer
4.   Digital Mines + Cloud Vertical
5.   Cloudkick
6.   Boto
7.   Putty SSH and CLIs
Scaling
1.   Pre-Optimisation is root of all evil
2.   Think about best/worst case scenario
3.   But do not build it day 1
4.   Don't re-invent wheel
5.   Avoid lock-in technologies
6.   Use Open Source as much as possible
7.   You probably won't be Facebook
8.   Scale vs Time vs Skills vs Money
9.   How fast is fast enough?
Words of Warning
1. Build to your budget not perfection
2. Do you have the skills or can you pay for
   them?
3. It's not cheaper than traditional hosting
4. You get Enterprise Functionality for Small
   Biz
5. Servers disappear, DBs get corrupted,
   backups fail, Amazon has outages. Plan?
6. How mission critical is your service/site?
7. How much downtime can you accept?
Costs
1.   Basic Server costs
2.   Reserved Instances
3.   Database, CDN, EIP, Multi-AZ etc etc
4.   All those other services
5.   People cost - who will manage?
Outline of HushVine
1. Original idea
   a. A power-user filtering Twitter client
   b. Show you all the Tweets you want, hide all the noise
2. Target market narrowed to Social TV
   watching e.g. #xfactor #apprentice
3. Creating unique second screen Social TV
   Platform for Tablet and Smartphone
4. Initially Twitter, then Facebook
5. Back-end = Cloud
6. Front-end = Cross-Platform Mobile
HushVine Outline 2
HushVine Outline 3
HushVine Architecture

  HushVine Tablet, Mobile and Web Apps. Cross-platform using HTML5+CSS3+JS and
                               FeedHenry (or similar)




              HushVine API                         HushVine Dashboards and Analytics



  Node.js + Express = Filtering and Data
           Crunching Platform
                                                        MongoDB NoSQL Database

  Hadoop Non-realtime Data Processing




               Twitter Streaming API delivering realtime sub-set of firehose
Node.js and MongoDB
1. Hot Tech
2. Node.js
  a.   Server Side JavaScript
  b.   Uses Google Chrome V8 Engine
  c.   Massive performance
  d.   Widely understood programming language
3. MongoDB
  a. NoSQL
  b. Document-based DB
  c. Massive performance and scalability
4. 3000 X-Factor Tweets per minute
  a. CPU barely ticking over
IaaS vs PaaS
● IaaS
    ○   Infrastruture as a Service
    ○   e.g. Amazon AWS, Rackspace
    ○   You design you architecture
    ○   No hand-holding, it's all on you
    ○   Ultimate in flexibility
●   PaaS
    ○   Platform as a Service
    ○   e.g. Cloud Foundry, Heroku etc
    ○   You fit within a particular architecture
    ○   Get best-practices built-in
    ○   Reduces your management overheads
CloudFoundry PaaS
● No lock-in, multiple
  Clouds
● Partnered with
  FeedHenry
● VMware
● Spring, Ruby on
  Rails, Ruby and
  Sinatra, Node.js,
  Grails
What's Next
1.   More automation and tools built-in to AWS
2.   Look at more automatic scaling
3.   Re-evaluate cost-benefit of more robustness
4.   Ever-reducing prices
5.   Cost Analysis and tuning
6.   Proper evaluation of Microsoft Azure
7.   Move some aspects to CloudFoundry
8.   Small Business friendly Cloud Offerings
Q&A




      Questions?

Contenu connexe

Tendances

DAT340_Hands-On Journey for Migrating Oracle Databases to the Amazon Aurora P...
DAT340_Hands-On Journey for Migrating Oracle Databases to the Amazon Aurora P...DAT340_Hands-On Journey for Migrating Oracle Databases to the Amazon Aurora P...
DAT340_Hands-On Journey for Migrating Oracle Databases to the Amazon Aurora P...
Amazon Web Services
 
일본 시골 개발자의 AWS 활용기 - AWS Summit Seoul 2017
일본 시골 개발자의 AWS 활용기 - AWS Summit Seoul 2017일본 시골 개발자의 AWS 활용기 - AWS Summit Seoul 2017
일본 시골 개발자의 AWS 활용기 - AWS Summit Seoul 2017
Amazon Web Services Korea
 

Tendances (20)

STG203_Get Rid of Tape and Modernize Backup with AWS
STG203_Get Rid of Tape and Modernize Backup with AWSSTG203_Get Rid of Tape and Modernize Backup with AWS
STG203_Get Rid of Tape and Modernize Backup with AWS
 
Deep Learning for Developers (Advanced Workshop)
Deep Learning for Developers (Advanced Workshop)Deep Learning for Developers (Advanced Workshop)
Deep Learning for Developers (Advanced Workshop)
 
Development Workflows on AWS
Development Workflows on AWSDevelopment Workflows on AWS
Development Workflows on AWS
 
Amazon ECS Deep Dive
Amazon ECS Deep DiveAmazon ECS Deep Dive
Amazon ECS Deep Dive
 
Amazon EC2 Foundations - CMP203 - re:Invent 2017
Amazon EC2 Foundations - CMP203 - re:Invent 2017Amazon EC2 Foundations - CMP203 - re:Invent 2017
Amazon EC2 Foundations - CMP203 - re:Invent 2017
 
AWS tech summit - Berlin 2011 - keynote
AWS tech summit - Berlin 2011 - keynoteAWS tech summit - Berlin 2011 - keynote
AWS tech summit - Berlin 2011 - keynote
 
CON213_Hands-on Kubernetes on AWS
CON213_Hands-on Kubernetes on AWSCON213_Hands-on Kubernetes on AWS
CON213_Hands-on Kubernetes on AWS
 
Dive deep into technical enhancements - re:Invent Come to London 2.0
Dive deep into technical enhancements - re:Invent Come to London 2.0Dive deep into technical enhancements - re:Invent Come to London 2.0
Dive deep into technical enhancements - re:Invent Come to London 2.0
 
DAT340_Hands-On Journey for Migrating Oracle Databases to the Amazon Aurora P...
DAT340_Hands-On Journey for Migrating Oracle Databases to the Amazon Aurora P...DAT340_Hands-On Journey for Migrating Oracle Databases to the Amazon Aurora P...
DAT340_Hands-On Journey for Migrating Oracle Databases to the Amazon Aurora P...
 
일본 시골 개발자의 AWS 활용기 - AWS Summit Seoul 2017
일본 시골 개발자의 AWS 활용기 - AWS Summit Seoul 2017일본 시골 개발자의 AWS 활용기 - AWS Summit Seoul 2017
일본 시골 개발자의 AWS 활용기 - AWS Summit Seoul 2017
 
NET201_Creating Your Virtual Data Center
NET201_Creating Your Virtual Data CenterNET201_Creating Your Virtual Data Center
NET201_Creating Your Virtual Data Center
 
사물 인터넷을 위한 AWS FreeRTOS 소개 - 트랙1, Community Day 2018 re:Invent 특집
사물 인터넷을 위한 AWS FreeRTOS 소개 - 트랙1, Community Day 2018 re:Invent 특집사물 인터넷을 위한 AWS FreeRTOS 소개 - 트랙1, Community Day 2018 re:Invent 특집
사물 인터넷을 위한 AWS FreeRTOS 소개 - 트랙1, Community Day 2018 re:Invent 특집
 
AWS ECS vs EKS
AWS ECS vs EKSAWS ECS vs EKS
AWS ECS vs EKS
 
STG306_Deep Dive on Amazon EBS
STG306_Deep Dive on Amazon EBSSTG306_Deep Dive on Amazon EBS
STG306_Deep Dive on Amazon EBS
 
DAT302_Deep Dive on Amazon Relational Database Service (RDS)
DAT302_Deep Dive on Amazon Relational Database Service (RDS)DAT302_Deep Dive on Amazon Relational Database Service (RDS)
DAT302_Deep Dive on Amazon Relational Database Service (RDS)
 
STG320_Storage
STG320_StorageSTG320_Storage
STG320_Storage
 
CON307_Building Effective Container Images
CON307_Building Effective Container ImagesCON307_Building Effective Container Images
CON307_Building Effective Container Images
 
Containers on AWS - re:Invent Comes to London 2.0
Containers on AWS - re:Invent Comes to London 2.0Containers on AWS - re:Invent Comes to London 2.0
Containers on AWS - re:Invent Comes to London 2.0
 
CTD405_Building Serverless Video Workflows
CTD405_Building Serverless Video WorkflowsCTD405_Building Serverless Video Workflows
CTD405_Building Serverless Video Workflows
 
Introduction to Google Cloud Platform
Introduction to Google Cloud PlatformIntroduction to Google Cloud Platform
Introduction to Google Cloud Platform
 

En vedette (18)

Invoqueu Maria So Automatic S U P E R
Invoqueu  Maria So Automatic  S U P E RInvoqueu  Maria So Automatic  S U P E R
Invoqueu Maria So Automatic S U P E R
 
Programafiestastijola2011
Programafiestastijola2011Programafiestastijola2011
Programafiestastijola2011
 
Recita e repete
Recita e repeteRecita e repete
Recita e repete
 
800 Infants
800 Infants800 Infants
800 Infants
 
Conor O'Neill at IWTC 2008
Conor O'Neill at IWTC 2008Conor O'Neill at IWTC 2008
Conor O'Neill at IWTC 2008
 
Amagatall Perfecte
Amagatall PerfecteAmagatall Perfecte
Amagatall Perfecte
 
A T U R A Corregit
A T U R A  CorregitA T U R A  Corregit
A T U R A Corregit
 
new raxwal
new raxwalnew raxwal
new raxwal
 
Belleses Nocturnes Salfor
Belleses Nocturnes SalforBelleses Nocturnes Salfor
Belleses Nocturnes Salfor
 
Joia De L Alba
Joia De L AlbaJoia De L Alba
Joia De L Alba
 
800 Infants
800 Infants800 Infants
800 Infants
 
Boletin1
Boletin1Boletin1
Boletin1
 
Fiestastijola2011
Fiestastijola2011Fiestastijola2011
Fiestastijola2011
 
hello pinnacle rinkinew
hello pinnacle  rinkinewhello pinnacle  rinkinew
hello pinnacle rinkinew
 
Reflexionesconsuiza
ReflexionesconsuizaReflexionesconsuiza
Reflexionesconsuiza
 
The famine!
The famine!The famine!
The famine!
 
Online Security and Safety
Online Security and SafetyOnline Security and Safety
Online Security and Safety
 
E-biz 2.0
E-biz 2.0E-biz 2.0
E-biz 2.0
 

Similaire à Running a business in the Cloud with AWS

Windows Azure & How to Deploy Wordress
Windows Azure & How to Deploy WordressWindows Azure & How to Deploy Wordress
Windows Azure & How to Deploy Wordress
George Kanellopoulos
 
AWS Cloud Kata | Manila - Getting to Scale on AWS
AWS Cloud Kata | Manila - Getting to Scale on AWSAWS Cloud Kata | Manila - Getting to Scale on AWS
AWS Cloud Kata | Manila - Getting to Scale on AWS
Amazon Web Services
 

Similaire à Running a business in the Cloud with AWS (20)

Aws-What You Need to Know_Simon Elisha
Aws-What You Need to Know_Simon ElishaAws-What You Need to Know_Simon Elisha
Aws-What You Need to Know_Simon Elisha
 
AWS re:Invent 2016: Deploying Scalable SAP Hybris Clusters using Docker (CON312)
AWS re:Invent 2016: Deploying Scalable SAP Hybris Clusters using Docker (CON312)AWS re:Invent 2016: Deploying Scalable SAP Hybris Clusters using Docker (CON312)
AWS re:Invent 2016: Deploying Scalable SAP Hybris Clusters using Docker (CON312)
 
AWS 201 - A Walk through the AWS Cloud: App Hosting on AWS - Games, Apps and ...
AWS 201 - A Walk through the AWS Cloud: App Hosting on AWS - Games, Apps and ...AWS 201 - A Walk through the AWS Cloud: App Hosting on AWS - Games, Apps and ...
AWS 201 - A Walk through the AWS Cloud: App Hosting on AWS - Games, Apps and ...
 
C# Client to Cloud
C# Client to CloudC# Client to Cloud
C# Client to Cloud
 
Cloud Has Become the New Normal: TCS
Cloud Has Become the New Normal: TCS Cloud Has Become the New Normal: TCS
Cloud Has Become the New Normal: TCS
 
WIN401_Migrating Microsoft Applications to AWS
WIN401_Migrating Microsoft Applications to AWSWIN401_Migrating Microsoft Applications to AWS
WIN401_Migrating Microsoft Applications to AWS
 
Windows Azure & How to Deploy Wordress
Windows Azure & How to Deploy WordressWindows Azure & How to Deploy Wordress
Windows Azure & How to Deploy Wordress
 
Cloud based infrastructure for massive scale, without massive costs
Cloud based infrastructure for massive scale, without massive costsCloud based infrastructure for massive scale, without massive costs
Cloud based infrastructure for massive scale, without massive costs
 
DevOps, Continuous Integration and Deployment on AWS: Putting Money Back into...
DevOps, Continuous Integration and Deployment on AWS: Putting Money Back into...DevOps, Continuous Integration and Deployment on AWS: Putting Money Back into...
DevOps, Continuous Integration and Deployment on AWS: Putting Money Back into...
 
Devops continuousintegration and deployment onaws puttingmoneybackintoyourmis...
Devops continuousintegration and deployment onaws puttingmoneybackintoyourmis...Devops continuousintegration and deployment onaws puttingmoneybackintoyourmis...
Devops continuousintegration and deployment onaws puttingmoneybackintoyourmis...
 
Continuous Deployment @ AWS Re:Invent
Continuous Deployment @ AWS Re:InventContinuous Deployment @ AWS Re:Invent
Continuous Deployment @ AWS Re:Invent
 
Continuous Integration and Deployment Best Practices on AWS (ARC307) | AWS re...
Continuous Integration and Deployment Best Practices on AWS (ARC307) | AWS re...Continuous Integration and Deployment Best Practices on AWS (ARC307) | AWS re...
Continuous Integration and Deployment Best Practices on AWS (ARC307) | AWS re...
 
What is Amazon Web Services & How to Start to deploy your apps ?
What is Amazon Web Services & How to Start to deploy your apps ?What is Amazon Web Services & How to Start to deploy your apps ?
What is Amazon Web Services & How to Start to deploy your apps ?
 
Build a Website on AWS for Your First 10 Million Users
Build a Website on AWS for Your First 10 Million UsersBuild a Website on AWS for Your First 10 Million Users
Build a Website on AWS for Your First 10 Million Users
 
10 Pro Tips for Scaling Your Startup from 0-10M Users
10 Pro Tips for Scaling Your Startup from 0-10M Users10 Pro Tips for Scaling Your Startup from 0-10M Users
10 Pro Tips for Scaling Your Startup from 0-10M Users
 
10 Pro Tips for scaling your startup from 0-10M users
10 Pro Tips for scaling your startup from 0-10M users10 Pro Tips for scaling your startup from 0-10M users
10 Pro Tips for scaling your startup from 0-10M users
 
AWS Webcast - Build Agile Applications in AWS Cloud for Government
AWS Webcast - Build Agile Applications in AWS Cloud for GovernmentAWS Webcast - Build Agile Applications in AWS Cloud for Government
AWS Webcast - Build Agile Applications in AWS Cloud for Government
 
Introduction to Cloudify for OpenStack users
Introduction to Cloudify for OpenStack users Introduction to Cloudify for OpenStack users
Introduction to Cloudify for OpenStack users
 
Move Your .NET Apps to AWS Without Betting the House - WIN303 - re:Invent 2017
Move Your .NET Apps to AWS Without Betting the House - WIN303 - re:Invent 2017Move Your .NET Apps to AWS Without Betting the House - WIN303 - re:Invent 2017
Move Your .NET Apps to AWS Without Betting the House - WIN303 - re:Invent 2017
 
AWS Cloud Kata | Manila - Getting to Scale on AWS
AWS Cloud Kata | Manila - Getting to Scale on AWSAWS Cloud Kata | Manila - Getting to Scale on AWS
AWS Cloud Kata | Manila - Getting to Scale on AWS
 

Dernier

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 

Dernier (20)

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 

Running a business in the Cloud with AWS

  • 1. Living in the Cloud Conor O'Neill CEO LouderVoice & Co-Founder HushVine
  • 2. Introduction 1. Me 2. History of LouderVoice 3. Transition to Cloud 4. Current Model 5. Scaling 6. Issues 7. Outline of HushVine 8. Node.js + MongoDB 9. Iaas vs PaaS 10. What's Next? 11. Q&A
  • 3. Me - 20 yrs Technology Management ○ 1990s : S3/Philips, Integral Design ○ Telecoms and then Digital TV ○ 2002 : Advanticus ○ Digital Convergence ○ 2003 - 2006 : EMC ○ Prof Services around SRM ○ 2006-2006 : McAfee ○ Localisation ○ 2006 -Now : LouderVoice ○ Customer Reviews SaaS ○ 2011-Now : HushVine ○ Social TV on a Second Screen
  • 4. History of LouderVoice 2005 - We should do a startup 2006 - Build blog reviews aggregation platform 2007 - Expand to non-blogs and Twitter 2008 - Build first API for Business Customer 2009 - Build Widget-based solution 2010 - Move entirely to B2B Model 2011 - Scale 2012 - Grow via Channel and L10N
  • 5. What it Looks Like 1
  • 6. What it Looks Like 2
  • 7. What it Looks Like 3
  • 8. LAMP Linux + Apache + MySQL + PHP/Perl/Python LouderVoice = NGINX Apache mod_wsgi MySQL Python Django Memcached
  • 9. LouderVoice Architecture NGINX Simple Load Balancer Content Distribution Network Application Application Application Server = Apache Server = Apache Server = Apache + Django + + Django + + Django + Python Python Python MySQL Solr Search Memcached
  • 10. Transition to Cloud Pre-Launch = Simple Shared Hosting 2006 - 2007 = Low-end VPS 2007 - 2009 = Dedicated Softlayer Servers 2009 - Now = 99% Amazon AWS 2011 - Now = Some CloudFoundry, Heroku and Nodejitsu
  • 11. Current AWS Setup A number of generic small EC2 Instances 1.7GB Memory 1 Compute Unit All running Ubuntu 10.04LTS Linux EBS for all live data RDS for MySQL Cloudfront for CDN S3 for backup Elastic IP for easy switchover
  • 12. LouderVoice on AWS Elastic IP All Static Content on NGINX on EC2 instance Cloudfront Application Application Application Server on EC2 Server on EC2 Server on EC2 with Data on with Data on with Data on EBS EBS EBS Backups on S3 Solr Search on EC2 with Memcached on EC2 with MySQL on RDS Data on EBS Data on EBS
  • 13. How it all Works Client site with LouderVoice Widget code, CSS, Content searched usingSolr Code running on images delivered by one or more of Cloudfront CDN for their web-pages geographic performance Client site with Data cached LouderVoice using Code running on Memcached for one or more of performance their web-pages Required content etc Client site with retrieved from App LouderVoice Servers Reviews/Users/etc Code running on stored/retrieved from one or more of MySQL their web-pages
  • 14. Other Services 1. DNSMadeEasy 2. AuthSMTP 3. Pingdom 4. Google Apps for my Domain 5. WordPress 6. GitHub 7. Redmine 8. Bit.ly 9. Facebook APIs 10. Twitter APIs
  • 15. Management Tools 1. AWS Console 2. Elasticfox 3. Cloudberry Explorer 4. Digital Mines + Cloud Vertical 5. Cloudkick 6. Boto 7. Putty SSH and CLIs
  • 16. Scaling 1. Pre-Optimisation is root of all evil 2. Think about best/worst case scenario 3. But do not build it day 1 4. Don't re-invent wheel 5. Avoid lock-in technologies 6. Use Open Source as much as possible 7. You probably won't be Facebook 8. Scale vs Time vs Skills vs Money 9. How fast is fast enough?
  • 17. Words of Warning 1. Build to your budget not perfection 2. Do you have the skills or can you pay for them? 3. It's not cheaper than traditional hosting 4. You get Enterprise Functionality for Small Biz 5. Servers disappear, DBs get corrupted, backups fail, Amazon has outages. Plan? 6. How mission critical is your service/site? 7. How much downtime can you accept?
  • 18. Costs 1. Basic Server costs 2. Reserved Instances 3. Database, CDN, EIP, Multi-AZ etc etc 4. All those other services 5. People cost - who will manage?
  • 19. Outline of HushVine 1. Original idea a. A power-user filtering Twitter client b. Show you all the Tweets you want, hide all the noise 2. Target market narrowed to Social TV watching e.g. #xfactor #apprentice 3. Creating unique second screen Social TV Platform for Tablet and Smartphone 4. Initially Twitter, then Facebook 5. Back-end = Cloud 6. Front-end = Cross-Platform Mobile
  • 22. HushVine Architecture HushVine Tablet, Mobile and Web Apps. Cross-platform using HTML5+CSS3+JS and FeedHenry (or similar) HushVine API HushVine Dashboards and Analytics Node.js + Express = Filtering and Data Crunching Platform MongoDB NoSQL Database Hadoop Non-realtime Data Processing Twitter Streaming API delivering realtime sub-set of firehose
  • 23. Node.js and MongoDB 1. Hot Tech 2. Node.js a. Server Side JavaScript b. Uses Google Chrome V8 Engine c. Massive performance d. Widely understood programming language 3. MongoDB a. NoSQL b. Document-based DB c. Massive performance and scalability 4. 3000 X-Factor Tweets per minute a. CPU barely ticking over
  • 24. IaaS vs PaaS ● IaaS ○ Infrastruture as a Service ○ e.g. Amazon AWS, Rackspace ○ You design you architecture ○ No hand-holding, it's all on you ○ Ultimate in flexibility ● PaaS ○ Platform as a Service ○ e.g. Cloud Foundry, Heroku etc ○ You fit within a particular architecture ○ Get best-practices built-in ○ Reduces your management overheads
  • 25. CloudFoundry PaaS ● No lock-in, multiple Clouds ● Partnered with FeedHenry ● VMware ● Spring, Ruby on Rails, Ruby and Sinatra, Node.js, Grails
  • 26. What's Next 1. More automation and tools built-in to AWS 2. Look at more automatic scaling 3. Re-evaluate cost-benefit of more robustness 4. Ever-reducing prices 5. Cost Analysis and tuning 6. Proper evaluation of Microsoft Azure 7. Move some aspects to CloudFoundry 8. Small Business friendly Cloud Offerings
  • 27. Q&A Questions?