SlideShare une entreprise Scribd logo
1  sur  15
Télécharger pour lire hors ligne
Introduction to Cloud Computing

J Singh
President, Early Stage IT

Sept 17, 2009
Emulating a Previous Megatrend
• An on-site power plant…
                                …replaced by an off-site
                                 power plant




                                                           2
                            2
Characteristics of Cloud Computing

   • On-demand self-service

   • Ubiquitous network access

   • Resource pooling
     – Location independence
     – Homogeneity

   • Rapid elasticity

   • Measured service
                                     Source: NIST
                                                    3
                          3
Where it makes sense
• Need to get started and test out business concepts
   – No Capital Expenditures
   – Elasticity – buy for average use, not for peak
   – Outsource server administration


• Open Source Software
   – Free Open Source Software licenses restrict resale
       • FOSS licenses do not restrict service


• The economics make it possible to start LILO companies
   – A little in, a lot out




                                                           4
                                       4
Players in the MarketPlace
• Some established players                     • Some new players
   – Amazon                                       – Cloud Administration Services
       • Simple Storage Service, Elastic              • Rightscale
         Compute Cloud, SimpleDB,                     • Scalr
         Simple Queuing Service
                                                  – Virtualized Data Centers
       • FPS, FWS, MTurk
                                                      • Rackspace
   – Google                                           • Mosso
       • Google App Engine
                                                  – Private Clouds
       • Google Apps
                                                      • Eucalyptus
   – Microsoft
                                                  – Transition Products
       • Azure
                                                      • TwinStrata
   – EMC                                              • CloudSwitch
       • Atmos
   – IBM
       • Collaboration w/ AMZN, GOOG           • Confession:
   – Salesforce.com                               – I don’t follow the
                                                    Entrepreneurial Landscape
   – Facebook.com
                                                    closely

                                                                                    5
                                           5
Cloud Computing Nuts and Bolts
• Amazon / Google Clouds

• S3 Programming
• Introduction to EC2

• Google App Engine Virtual OS

• Woven Clouds




                                     6
                                 6
Amazon / Google Clouds
                                                   • Amazon EC2
                                                      – Flexible and configurable
                                                      – Interact with the machine at the
                                                        OS level

                                                      – Good for hosting existing
                                                        programs in the cloud


                                                   • Google App Engine
                                                      – Interact with the machine at the
                                                        ‘virtual OS’ level
                                                      – Tightly controlled, not possible
                                                        to break out of the virtual OS

                                                      – Good for new development



  Source: Dion Hinchcliff, ZDNet, April 2008
                                                                                           7
                                               7
Using S3
• Just two concepts
   – Bucket
        • Max 100 per account
        • Unique name system wide
   – Object
        • If public, addressable as
            http://s3.amazonaws.com/bucket-name/object-name
        • Access controlled by ACL
        • Atomic access. Read, write but no update, no rename
        • Replicated storage but with latency
• Access methods
   – APIs: SOAP and REST (preferred)
   – Every request must be signed with ID and Secret Key
• Applications available
   – Explorers, e.g., S3Fox, JungleDisk
   – Backup solutions
   – Used by storage-based businesses, e.g., SmugMug, Pixily, SlideShare


                                                                           8
                                                 8
Using EC2 (pg 1)
• Concepts
  – EC2 Instance: a machine running in Amazon’s cloud
      • Regions: 3 locations in the US, 2 in Europe
      • Make an API call to get one, another API call to return it
      • Need an AMI (Amazon Machine Image) when requesting an Instance
         – Provided by many vendors, some free, others for a price
             » MSFT, ORCL, SUNW, IBM, RHT, Rightscale, Scalr, Cloud in Code
         – You can make your own private AMI
         – You can offer your own special AMI for sale to others
  – Elastic Block Storage (EBS)
      • Storage block, attached using mnt
      • Can be backed up to S3
  – Static IP address
      • Reachable from the domain registrar


                                                                              9
                                          9
Using EC2 (pg 2)
  – Access Methods
      • APIs: SOAP and REST
      • Every request must be signed with ID and Secret Key
      • Once you have an instance, you can open a ssh window.
  – Applications available
      • ElasticFox, Amazon EC2 Console, Eclipse plugin


  – Other facilities
      • Load balancing
      • Auto-scaling




                                                                10
                                    10
Google App Engine (pg 1)

• Programming Languages                       • SSL constraint
   – Python, Django-like Web                      – Supported:
     Application Framework                            • http://abc.appspot.com
        • Templates, CSS, HTML                        • https://abc.appspot.com
   – Java                                             • http://www.abc.com
        • I’m not up to speed on this, but        – Not supported
          it uses the same virtual OS                 • https://www.abc.com
• Client-side facilities
   – Javascript, AJAX, YUI, GWT,
     jQuery, Flash
• Development Environment
   – Can be any, I like Eclipse
   – Local Sandbox
   – Upload to Google



                                                                                  11
                                             11
Google App Engine (pg 2)
• Virtual OS facilities
   – Datastore, an object database based on Goggle’s BigTable
       •   Designed for massive parallelism for serving web content
       •   Transaction atomicity handled differently from normal databases
       •   Multiple copies of each table replicated across Google’s servers
       •   No local file system
            – If you need to store something, put it in the Datastore as a blob
   – User API (provides authentication based on Google IDs)
   – MemCache, ability to keep certain data in memory
   – UrlFetch, ability to invoke any http request
       • Examples: Google Docs, OpenID, Captcha, Amazon AWS
   – Email, Chat APIs




                                                                                  12
                                           12
Extending the Paradigms
• Heterogeneous Clouds                     • Massive Parallelism
   – Combining multiple clouds can             – Paradigms that exploit the
     help you leverate their                     available redundancy
     individual strengths                      – Were not economically feasible
   – But overall availability may be             before
     compromised                               – Examples:
   – Examples:                                     • Hadoop. An open framework
       • Google App Engine for web                   for parallelizing intensive data
         server, AWS for specialized                 mining tasks
         processing                                • BrowserMob / LoadStorm. Load
       • Facebook front ends for Google              testing. Unleash hundreds of
         App Engine-based applications               browsers at an application
       • Google App                                • Search / Indexing Applications.
         Engine/Salesforce.com                       Divide up the task among
         interfaces                                  thousands of machines




                                                                                        13
                                          13
Summary
• Cloud computing is changing the paradigm for how
  computing gets done

• It is a multi-year change,
    – Accelerated by current cost pressures

• Advantages go to the early adopters
   – So do the risks

• It’s uncharted waters
• It’s fun!

                                                     14
                              14
Thank You
   J Singh
   j.singh@EarlyStageIT.com
   (978) 760-2055


                              15

Contenu connexe

Tendances

Developing Social Games in the Cloud
Developing Social Games in the CloudDeveloping Social Games in the Cloud
Developing Social Games in the CloudJurriaan Persyn
 
CloudStack-Development-Story
CloudStack-Development-StoryCloudStack-Development-Story
CloudStack-Development-StoryKimihiko Kitase
 
Architecting an Highly Available and Scalable WordPress Site in AWS
Architecting an Highly Available and Scalable WordPress Site in AWS Architecting an Highly Available and Scalable WordPress Site in AWS
Architecting an Highly Available and Scalable WordPress Site in AWS Harish Ganesan
 
ARC302 AWS Cloud Design Patterns - AWS re: Invent 2012
ARC302 AWS Cloud Design Patterns - AWS re: Invent 2012ARC302 AWS Cloud Design Patterns - AWS re: Invent 2012
ARC302 AWS Cloud Design Patterns - AWS re: Invent 2012Amazon Web Services
 
AWS 101: Cloud Computing Seminar (2012)
AWS 101: Cloud Computing Seminar (2012)AWS 101: Cloud Computing Seminar (2012)
AWS 101: Cloud Computing Seminar (2012)Amazon Web Services
 
Overview of Amazon Web Services
Overview of Amazon Web ServicesOverview of Amazon Web Services
Overview of Amazon Web ServicesHarish Ganesan
 
NHGRI Cloud Computing talk
NHGRI Cloud Computing talkNHGRI Cloud Computing talk
NHGRI Cloud Computing talkDeepak Singh
 
GPU Renderfarm with Integrated Asset Management & Production System (AMPS)
GPU Renderfarm with Integrated Asset Management & Production System (AMPS)GPU Renderfarm with Integrated Asset Management & Production System (AMPS)
GPU Renderfarm with Integrated Asset Management & Production System (AMPS)Budianto Tandianus
 
Gaelyk - Groovy Grails eXchange 2010 - Guillaume Laforge
Gaelyk - Groovy Grails eXchange 2010 - Guillaume LaforgeGaelyk - Groovy Grails eXchange 2010 - Guillaume Laforge
Gaelyk - Groovy Grails eXchange 2010 - Guillaume LaforgeGuillaume Laforge
 
AWS Webcast - Build Agile Applications in AWS Cloud
AWS Webcast - Build Agile Applications in AWS CloudAWS Webcast - Build Agile Applications in AWS Cloud
AWS Webcast - Build Agile Applications in AWS CloudAmazon Web Services
 
Cloud Computing With AWS
Cloud Computing With AWSCloud Computing With AWS
Cloud Computing With AWSMunish Gupta
 
Amazon Ec2 Application Design
Amazon Ec2 Application DesignAmazon Ec2 Application Design
Amazon Ec2 Application Designguestd0b61e
 
Aws 201:Advanced Breakout Track on HA and DR
Aws 201:Advanced Breakout Track on HA and DRAws 201:Advanced Breakout Track on HA and DR
Aws 201:Advanced Breakout Track on HA and DRHarish Ganesan
 
A Step By Step Guide To Put DB2 On Amazon Cloud
A Step By Step Guide To Put DB2 On Amazon CloudA Step By Step Guide To Put DB2 On Amazon Cloud
A Step By Step Guide To Put DB2 On Amazon CloudDeepak Rao
 
Scale new business peaks with Amazon auto scaling
Scale new business peaks with Amazon auto scalingScale new business peaks with Amazon auto scaling
Scale new business peaks with Amazon auto scalingHarish Ganesan
 
Auto scaling websites in the cloud
Auto scaling websites in the cloudAuto scaling websites in the cloud
Auto scaling websites in the cloudDavid Veksler
 

Tendances (20)

Developing Social Games in the Cloud
Developing Social Games in the CloudDeveloping Social Games in the Cloud
Developing Social Games in the Cloud
 
CloudStack-Development-Story
CloudStack-Development-StoryCloudStack-Development-Story
CloudStack-Development-Story
 
Architecting an Highly Available and Scalable WordPress Site in AWS
Architecting an Highly Available and Scalable WordPress Site in AWS Architecting an Highly Available and Scalable WordPress Site in AWS
Architecting an Highly Available and Scalable WordPress Site in AWS
 
Introduction to AWS tools
Introduction to AWS toolsIntroduction to AWS tools
Introduction to AWS tools
 
ARC302 AWS Cloud Design Patterns - AWS re: Invent 2012
ARC302 AWS Cloud Design Patterns - AWS re: Invent 2012ARC302 AWS Cloud Design Patterns - AWS re: Invent 2012
ARC302 AWS Cloud Design Patterns - AWS re: Invent 2012
 
AWS 101: Cloud Computing Seminar (2012)
AWS 101: Cloud Computing Seminar (2012)AWS 101: Cloud Computing Seminar (2012)
AWS 101: Cloud Computing Seminar (2012)
 
Overview of Amazon Web Services
Overview of Amazon Web ServicesOverview of Amazon Web Services
Overview of Amazon Web Services
 
NHGRI Cloud Computing talk
NHGRI Cloud Computing talkNHGRI Cloud Computing talk
NHGRI Cloud Computing talk
 
GPU Renderfarm with Integrated Asset Management & Production System (AMPS)
GPU Renderfarm with Integrated Asset Management & Production System (AMPS)GPU Renderfarm with Integrated Asset Management & Production System (AMPS)
GPU Renderfarm with Integrated Asset Management & Production System (AMPS)
 
AWS Case Study
AWS Case StudyAWS Case Study
AWS Case Study
 
Cloud PaaS with Java
Cloud PaaS with JavaCloud PaaS with Java
Cloud PaaS with Java
 
Gaelyk - Groovy Grails eXchange 2010 - Guillaume Laforge
Gaelyk - Groovy Grails eXchange 2010 - Guillaume LaforgeGaelyk - Groovy Grails eXchange 2010 - Guillaume Laforge
Gaelyk - Groovy Grails eXchange 2010 - Guillaume Laforge
 
AWS Webcast - Build Agile Applications in AWS Cloud
AWS Webcast - Build Agile Applications in AWS CloudAWS Webcast - Build Agile Applications in AWS Cloud
AWS Webcast - Build Agile Applications in AWS Cloud
 
Cloud Computing With AWS
Cloud Computing With AWSCloud Computing With AWS
Cloud Computing With AWS
 
Amazon Ec2 Application Design
Amazon Ec2 Application DesignAmazon Ec2 Application Design
Amazon Ec2 Application Design
 
Aws 201:Advanced Breakout Track on HA and DR
Aws 201:Advanced Breakout Track on HA and DRAws 201:Advanced Breakout Track on HA and DR
Aws 201:Advanced Breakout Track on HA and DR
 
1st Eucalyptus Bay Area Meet Up
1st Eucalyptus Bay Area Meet Up1st Eucalyptus Bay Area Meet Up
1st Eucalyptus Bay Area Meet Up
 
A Step By Step Guide To Put DB2 On Amazon Cloud
A Step By Step Guide To Put DB2 On Amazon CloudA Step By Step Guide To Put DB2 On Amazon Cloud
A Step By Step Guide To Put DB2 On Amazon Cloud
 
Scale new business peaks with Amazon auto scaling
Scale new business peaks with Amazon auto scalingScale new business peaks with Amazon auto scaling
Scale new business peaks with Amazon auto scaling
 
Auto scaling websites in the cloud
Auto scaling websites in the cloudAuto scaling websites in the cloud
Auto scaling websites in the cloud
 

En vedette

Cloud Computing - Conceitos e Aplicações Práticas
Cloud Computing - Conceitos e Aplicações PráticasCloud Computing - Conceitos e Aplicações Práticas
Cloud Computing - Conceitos e Aplicações PráticasRafael Bandeira
 
Cloud computing notes unit 2 RGPV BHOPAL
Cloud computing notes unit 2 RGPV BHOPALCloud computing notes unit 2 RGPV BHOPAL
Cloud computing notes unit 2 RGPV BHOPALDr Md. Ilyas Khan
 
Cloud computing notes RGPV unit 3
Cloud computing notes RGPV unit 3Cloud computing notes RGPV unit 3
Cloud computing notes RGPV unit 3Dr Md. Ilyas Khan
 
Cloud Computing notes RGPV unit 4
Cloud Computing notes RGPV unit 4Cloud Computing notes RGPV unit 4
Cloud Computing notes RGPV unit 4Dr Md. Ilyas Khan
 
Cloud computing notes rgpv unit 5
Cloud computing notes rgpv unit 5Cloud computing notes rgpv unit 5
Cloud computing notes rgpv unit 5Dr Md. Ilyas Khan
 
Seminar on cloud computing by Prashant Gupta
Seminar on cloud computing by Prashant GuptaSeminar on cloud computing by Prashant Gupta
Seminar on cloud computing by Prashant GuptaPrashant Gupta
 
Introduction of Cloud computing
Introduction of Cloud computingIntroduction of Cloud computing
Introduction of Cloud computingRkrishna Mishra
 
Farming Unicorns: Building Startup & Investor Ecosystems
Farming Unicorns: Building Startup & Investor EcosystemsFarming Unicorns: Building Startup & Investor Ecosystems
Farming Unicorns: Building Startup & Investor EcosystemsDave McClure
 

En vedette (10)

Cloud Computing - Conceitos e Aplicações Práticas
Cloud Computing - Conceitos e Aplicações PráticasCloud Computing - Conceitos e Aplicações Práticas
Cloud Computing - Conceitos e Aplicações Práticas
 
Cloud computing notes unit 2 RGPV BHOPAL
Cloud computing notes unit 2 RGPV BHOPALCloud computing notes unit 2 RGPV BHOPAL
Cloud computing notes unit 2 RGPV BHOPAL
 
Cloud computing notes RGPV unit 3
Cloud computing notes RGPV unit 3Cloud computing notes RGPV unit 3
Cloud computing notes RGPV unit 3
 
Cloud Computing notes RGPV unit 4
Cloud Computing notes RGPV unit 4Cloud Computing notes RGPV unit 4
Cloud Computing notes RGPV unit 4
 
Cloud computing notes rgpv unit 5
Cloud computing notes rgpv unit 5Cloud computing notes rgpv unit 5
Cloud computing notes rgpv unit 5
 
Adicción
AdicciónAdicción
Adicción
 
Seminar on cloud computing by Prashant Gupta
Seminar on cloud computing by Prashant GuptaSeminar on cloud computing by Prashant Gupta
Seminar on cloud computing by Prashant Gupta
 
cloud computing ppt
cloud computing pptcloud computing ppt
cloud computing ppt
 
Introduction of Cloud computing
Introduction of Cloud computingIntroduction of Cloud computing
Introduction of Cloud computing
 
Farming Unicorns: Building Startup & Investor Ecosystems
Farming Unicorns: Building Startup & Investor EcosystemsFarming Unicorns: Building Startup & Investor Ecosystems
Farming Unicorns: Building Startup & Investor Ecosystems
 

Similaire à Cloud Computing from an Entrpreneur's Viewpoint

Cloud computing by amazon
Cloud computing by amazonCloud computing by amazon
Cloud computing by amazon8neutron8
 
Clould Computing and its application in Libraries
Clould Computing and its application in LibrariesClould Computing and its application in Libraries
Clould Computing and its application in LibrariesAmit Shaw
 
Cloud computing by prabhunath sharma
Cloud computing by prabhunath sharmaCloud computing by prabhunath sharma
Cloud computing by prabhunath sharmaPrabhunath Sharma
 
O'Reilly Webcast: Architecting Applications For The Cloud
O'Reilly Webcast: Architecting Applications For The CloudO'Reilly Webcast: Architecting Applications For The Cloud
O'Reilly Webcast: Architecting Applications For The CloudO'Reilly Media
 
What's New for the Windows Azure Developer? Lots!!
What's New for the Windows Azure Developer?  Lots!!What's New for the Windows Azure Developer?  Lots!!
What's New for the Windows Azure Developer? Lots!!Michael Collier
 
Netflix web-adrian-qcon
Netflix web-adrian-qconNetflix web-adrian-qcon
Netflix web-adrian-qconYiwei Ma
 
(CMP404) Cloud Rendering at Walt Disney Animation Studios
(CMP404) Cloud Rendering at Walt Disney Animation Studios(CMP404) Cloud Rendering at Walt Disney Animation Studios
(CMP404) Cloud Rendering at Walt Disney Animation StudiosAmazon Web Services
 
Sameer Mitter | Introduction to Cloud computing
Sameer Mitter | Introduction to Cloud computingSameer Mitter | Introduction to Cloud computing
Sameer Mitter | Introduction to Cloud computingSameer Mitter
 
Cloud Computing with .Net
Cloud Computing with .NetCloud Computing with .Net
Cloud Computing with .NetWesley Faler
 
Current State of Affairs – Cloud Computing - Indicthreads Cloud Computing Con...
Current State of Affairs – Cloud Computing - Indicthreads Cloud Computing Con...Current State of Affairs – Cloud Computing - Indicthreads Cloud Computing Con...
Current State of Affairs – Cloud Computing - Indicthreads Cloud Computing Con...IndicThreads
 
Cloud Computing 101
Cloud Computing 101Cloud Computing 101
Cloud Computing 101Kamal Arora
 
AWS September Webinar Series - Visual Effects Rendering in the AWS Cloud with...
AWS September Webinar Series - Visual Effects Rendering in the AWS Cloud with...AWS September Webinar Series - Visual Effects Rendering in the AWS Cloud with...
AWS September Webinar Series - Visual Effects Rendering in the AWS Cloud with...Amazon Web Services
 
Gaelyk - Paris GGUG 2011 - Guillaume Laforge
Gaelyk - Paris GGUG 2011 - Guillaume LaforgeGaelyk - Paris GGUG 2011 - Guillaume Laforge
Gaelyk - Paris GGUG 2011 - Guillaume LaforgeGuillaume Laforge
 
Oracle in the Cloud
Oracle in the CloudOracle in the Cloud
Oracle in the Cloudzain1425
 
Amazon Web Services Building Blocks for Drupal Applications and Hosting
Amazon Web Services Building Blocks for Drupal Applications and HostingAmazon Web Services Building Blocks for Drupal Applications and Hosting
Amazon Web Services Building Blocks for Drupal Applications and HostingAcquia
 

Similaire à Cloud Computing from an Entrpreneur's Viewpoint (20)

Cloud computing by amazon
Cloud computing by amazonCloud computing by amazon
Cloud computing by amazon
 
Clould Computing and its application in Libraries
Clould Computing and its application in LibrariesClould Computing and its application in Libraries
Clould Computing and its application in Libraries
 
Cloud computing by prabhunath sharma
Cloud computing by prabhunath sharmaCloud computing by prabhunath sharma
Cloud computing by prabhunath sharma
 
O'Reilly Webcast: Architecting Applications For The Cloud
O'Reilly Webcast: Architecting Applications For The CloudO'Reilly Webcast: Architecting Applications For The Cloud
O'Reilly Webcast: Architecting Applications For The Cloud
 
What's New for the Windows Azure Developer? Lots!!
What's New for the Windows Azure Developer?  Lots!!What's New for the Windows Azure Developer?  Lots!!
What's New for the Windows Azure Developer? Lots!!
 
John Willis Cc Use Cases
John Willis Cc Use CasesJohn Willis Cc Use Cases
John Willis Cc Use Cases
 
Netflix web-adrian-qcon
Netflix web-adrian-qconNetflix web-adrian-qcon
Netflix web-adrian-qcon
 
cloud computing
cloud computingcloud computing
cloud computing
 
(CMP404) Cloud Rendering at Walt Disney Animation Studios
(CMP404) Cloud Rendering at Walt Disney Animation Studios(CMP404) Cloud Rendering at Walt Disney Animation Studios
(CMP404) Cloud Rendering at Walt Disney Animation Studios
 
Sameer Mitter | Introduction to Cloud computing
Sameer Mitter | Introduction to Cloud computingSameer Mitter | Introduction to Cloud computing
Sameer Mitter | Introduction to Cloud computing
 
Cloud Computing with .Net
Cloud Computing with .NetCloud Computing with .Net
Cloud Computing with .Net
 
Cloud Computing 101
Cloud Computing 101Cloud Computing 101
Cloud Computing 101
 
Current State of Affairs – Cloud Computing - Indicthreads Cloud Computing Con...
Current State of Affairs – Cloud Computing - Indicthreads Cloud Computing Con...Current State of Affairs – Cloud Computing - Indicthreads Cloud Computing Con...
Current State of Affairs – Cloud Computing - Indicthreads Cloud Computing Con...
 
Cloud Computing 101
Cloud Computing 101Cloud Computing 101
Cloud Computing 101
 
AWS September Webinar Series - Visual Effects Rendering in the AWS Cloud with...
AWS September Webinar Series - Visual Effects Rendering in the AWS Cloud with...AWS September Webinar Series - Visual Effects Rendering in the AWS Cloud with...
AWS September Webinar Series - Visual Effects Rendering in the AWS Cloud with...
 
PaaS with Java
PaaS with JavaPaaS with Java
PaaS with Java
 
Gaelyk - Paris GGUG 2011 - Guillaume Laforge
Gaelyk - Paris GGUG 2011 - Guillaume LaforgeGaelyk - Paris GGUG 2011 - Guillaume Laforge
Gaelyk - Paris GGUG 2011 - Guillaume Laforge
 
Oracle in the Cloud
Oracle in the CloudOracle in the Cloud
Oracle in the Cloud
 
Global Netflix Platform
Global Netflix PlatformGlobal Netflix Platform
Global Netflix Platform
 
Amazon Web Services Building Blocks for Drupal Applications and Hosting
Amazon Web Services Building Blocks for Drupal Applications and HostingAmazon Web Services Building Blocks for Drupal Applications and Hosting
Amazon Web Services Building Blocks for Drupal Applications and Hosting
 

Plus de J Singh

OpenLSH - a framework for locality sensitive hashing
OpenLSH  - a framework for locality sensitive hashingOpenLSH  - a framework for locality sensitive hashing
OpenLSH - a framework for locality sensitive hashingJ Singh
 
Designing analytics for big data
Designing analytics for big dataDesigning analytics for big data
Designing analytics for big dataJ Singh
 
Open LSH - september 2014 update
Open LSH  - september 2014 updateOpen LSH  - september 2014 update
Open LSH - september 2014 updateJ Singh
 
PaaS - google app engine
PaaS  - google app enginePaaS  - google app engine
PaaS - google app engineJ Singh
 
Mining of massive datasets using locality sensitive hashing (LSH)
Mining of massive datasets using locality sensitive hashing (LSH)Mining of massive datasets using locality sensitive hashing (LSH)
Mining of massive datasets using locality sensitive hashing (LSH)J Singh
 
Data Analytic Technology Platforms: Options and Tradeoffs
Data Analytic Technology Platforms: Options and TradeoffsData Analytic Technology Platforms: Options and Tradeoffs
Data Analytic Technology Platforms: Options and TradeoffsJ Singh
 
Facebook Analytics with Elastic Map/Reduce
Facebook Analytics with Elastic Map/ReduceFacebook Analytics with Elastic Map/Reduce
Facebook Analytics with Elastic Map/ReduceJ Singh
 
Big Data Laboratory
Big Data LaboratoryBig Data Laboratory
Big Data LaboratoryJ Singh
 
The Hadoop Ecosystem
The Hadoop EcosystemThe Hadoop Ecosystem
The Hadoop EcosystemJ Singh
 
Social Media Mining using GAE Map Reduce
Social Media Mining using GAE Map ReduceSocial Media Mining using GAE Map Reduce
Social Media Mining using GAE Map ReduceJ Singh
 
High Throughput Data Analysis
High Throughput Data AnalysisHigh Throughput Data Analysis
High Throughput Data AnalysisJ Singh
 
NoSQL and MapReduce
NoSQL and MapReduceNoSQL and MapReduce
NoSQL and MapReduceJ Singh
 
CS 542 -- Concurrency Control, Distributed Commit
CS 542 -- Concurrency Control, Distributed CommitCS 542 -- Concurrency Control, Distributed Commit
CS 542 -- Concurrency Control, Distributed CommitJ Singh
 
CS 542 -- Failure Recovery, Concurrency Control
CS 542 -- Failure Recovery, Concurrency ControlCS 542 -- Failure Recovery, Concurrency Control
CS 542 -- Failure Recovery, Concurrency ControlJ Singh
 
CS 542 -- Query Optimization
CS 542 -- Query OptimizationCS 542 -- Query Optimization
CS 542 -- Query OptimizationJ Singh
 
CS 542 -- Query Execution
CS 542 -- Query ExecutionCS 542 -- Query Execution
CS 542 -- Query ExecutionJ Singh
 
CS 542 Putting it all together -- Storage Management
CS 542 Putting it all together -- Storage ManagementCS 542 Putting it all together -- Storage Management
CS 542 Putting it all together -- Storage ManagementJ Singh
 
CS 542 Parallel DBs, NoSQL, MapReduce
CS 542 Parallel DBs, NoSQL, MapReduceCS 542 Parallel DBs, NoSQL, MapReduce
CS 542 Parallel DBs, NoSQL, MapReduceJ Singh
 
CS 542 Database Index Structures
CS 542 Database Index StructuresCS 542 Database Index Structures
CS 542 Database Index StructuresJ Singh
 
CS 542 Controlling Database Integrity and Performance
CS 542 Controlling Database Integrity and PerformanceCS 542 Controlling Database Integrity and Performance
CS 542 Controlling Database Integrity and PerformanceJ Singh
 

Plus de J Singh (20)

OpenLSH - a framework for locality sensitive hashing
OpenLSH  - a framework for locality sensitive hashingOpenLSH  - a framework for locality sensitive hashing
OpenLSH - a framework for locality sensitive hashing
 
Designing analytics for big data
Designing analytics for big dataDesigning analytics for big data
Designing analytics for big data
 
Open LSH - september 2014 update
Open LSH  - september 2014 updateOpen LSH  - september 2014 update
Open LSH - september 2014 update
 
PaaS - google app engine
PaaS  - google app enginePaaS  - google app engine
PaaS - google app engine
 
Mining of massive datasets using locality sensitive hashing (LSH)
Mining of massive datasets using locality sensitive hashing (LSH)Mining of massive datasets using locality sensitive hashing (LSH)
Mining of massive datasets using locality sensitive hashing (LSH)
 
Data Analytic Technology Platforms: Options and Tradeoffs
Data Analytic Technology Platforms: Options and TradeoffsData Analytic Technology Platforms: Options and Tradeoffs
Data Analytic Technology Platforms: Options and Tradeoffs
 
Facebook Analytics with Elastic Map/Reduce
Facebook Analytics with Elastic Map/ReduceFacebook Analytics with Elastic Map/Reduce
Facebook Analytics with Elastic Map/Reduce
 
Big Data Laboratory
Big Data LaboratoryBig Data Laboratory
Big Data Laboratory
 
The Hadoop Ecosystem
The Hadoop EcosystemThe Hadoop Ecosystem
The Hadoop Ecosystem
 
Social Media Mining using GAE Map Reduce
Social Media Mining using GAE Map ReduceSocial Media Mining using GAE Map Reduce
Social Media Mining using GAE Map Reduce
 
High Throughput Data Analysis
High Throughput Data AnalysisHigh Throughput Data Analysis
High Throughput Data Analysis
 
NoSQL and MapReduce
NoSQL and MapReduceNoSQL and MapReduce
NoSQL and MapReduce
 
CS 542 -- Concurrency Control, Distributed Commit
CS 542 -- Concurrency Control, Distributed CommitCS 542 -- Concurrency Control, Distributed Commit
CS 542 -- Concurrency Control, Distributed Commit
 
CS 542 -- Failure Recovery, Concurrency Control
CS 542 -- Failure Recovery, Concurrency ControlCS 542 -- Failure Recovery, Concurrency Control
CS 542 -- Failure Recovery, Concurrency Control
 
CS 542 -- Query Optimization
CS 542 -- Query OptimizationCS 542 -- Query Optimization
CS 542 -- Query Optimization
 
CS 542 -- Query Execution
CS 542 -- Query ExecutionCS 542 -- Query Execution
CS 542 -- Query Execution
 
CS 542 Putting it all together -- Storage Management
CS 542 Putting it all together -- Storage ManagementCS 542 Putting it all together -- Storage Management
CS 542 Putting it all together -- Storage Management
 
CS 542 Parallel DBs, NoSQL, MapReduce
CS 542 Parallel DBs, NoSQL, MapReduceCS 542 Parallel DBs, NoSQL, MapReduce
CS 542 Parallel DBs, NoSQL, MapReduce
 
CS 542 Database Index Structures
CS 542 Database Index StructuresCS 542 Database Index Structures
CS 542 Database Index Structures
 
CS 542 Controlling Database Integrity and Performance
CS 542 Controlling Database Integrity and PerformanceCS 542 Controlling Database Integrity and Performance
CS 542 Controlling Database Integrity and Performance
 

Cloud Computing from an Entrpreneur's Viewpoint

  • 1. Introduction to Cloud Computing J Singh President, Early Stage IT Sept 17, 2009
  • 2. Emulating a Previous Megatrend • An on-site power plant… …replaced by an off-site power plant 2 2
  • 3. Characteristics of Cloud Computing • On-demand self-service • Ubiquitous network access • Resource pooling – Location independence – Homogeneity • Rapid elasticity • Measured service Source: NIST 3 3
  • 4. Where it makes sense • Need to get started and test out business concepts – No Capital Expenditures – Elasticity – buy for average use, not for peak – Outsource server administration • Open Source Software – Free Open Source Software licenses restrict resale • FOSS licenses do not restrict service • The economics make it possible to start LILO companies – A little in, a lot out 4 4
  • 5. Players in the MarketPlace • Some established players • Some new players – Amazon – Cloud Administration Services • Simple Storage Service, Elastic • Rightscale Compute Cloud, SimpleDB, • Scalr Simple Queuing Service – Virtualized Data Centers • FPS, FWS, MTurk • Rackspace – Google • Mosso • Google App Engine – Private Clouds • Google Apps • Eucalyptus – Microsoft – Transition Products • Azure • TwinStrata – EMC • CloudSwitch • Atmos – IBM • Collaboration w/ AMZN, GOOG • Confession: – Salesforce.com – I don’t follow the Entrepreneurial Landscape – Facebook.com closely 5 5
  • 6. Cloud Computing Nuts and Bolts • Amazon / Google Clouds • S3 Programming • Introduction to EC2 • Google App Engine Virtual OS • Woven Clouds 6 6
  • 7. Amazon / Google Clouds • Amazon EC2 – Flexible and configurable – Interact with the machine at the OS level – Good for hosting existing programs in the cloud • Google App Engine – Interact with the machine at the ‘virtual OS’ level – Tightly controlled, not possible to break out of the virtual OS – Good for new development Source: Dion Hinchcliff, ZDNet, April 2008 7 7
  • 8. Using S3 • Just two concepts – Bucket • Max 100 per account • Unique name system wide – Object • If public, addressable as http://s3.amazonaws.com/bucket-name/object-name • Access controlled by ACL • Atomic access. Read, write but no update, no rename • Replicated storage but with latency • Access methods – APIs: SOAP and REST (preferred) – Every request must be signed with ID and Secret Key • Applications available – Explorers, e.g., S3Fox, JungleDisk – Backup solutions – Used by storage-based businesses, e.g., SmugMug, Pixily, SlideShare 8 8
  • 9. Using EC2 (pg 1) • Concepts – EC2 Instance: a machine running in Amazon’s cloud • Regions: 3 locations in the US, 2 in Europe • Make an API call to get one, another API call to return it • Need an AMI (Amazon Machine Image) when requesting an Instance – Provided by many vendors, some free, others for a price » MSFT, ORCL, SUNW, IBM, RHT, Rightscale, Scalr, Cloud in Code – You can make your own private AMI – You can offer your own special AMI for sale to others – Elastic Block Storage (EBS) • Storage block, attached using mnt • Can be backed up to S3 – Static IP address • Reachable from the domain registrar 9 9
  • 10. Using EC2 (pg 2) – Access Methods • APIs: SOAP and REST • Every request must be signed with ID and Secret Key • Once you have an instance, you can open a ssh window. – Applications available • ElasticFox, Amazon EC2 Console, Eclipse plugin – Other facilities • Load balancing • Auto-scaling 10 10
  • 11. Google App Engine (pg 1) • Programming Languages • SSL constraint – Python, Django-like Web – Supported: Application Framework • http://abc.appspot.com • Templates, CSS, HTML • https://abc.appspot.com – Java • http://www.abc.com • I’m not up to speed on this, but – Not supported it uses the same virtual OS • https://www.abc.com • Client-side facilities – Javascript, AJAX, YUI, GWT, jQuery, Flash • Development Environment – Can be any, I like Eclipse – Local Sandbox – Upload to Google 11 11
  • 12. Google App Engine (pg 2) • Virtual OS facilities – Datastore, an object database based on Goggle’s BigTable • Designed for massive parallelism for serving web content • Transaction atomicity handled differently from normal databases • Multiple copies of each table replicated across Google’s servers • No local file system – If you need to store something, put it in the Datastore as a blob – User API (provides authentication based on Google IDs) – MemCache, ability to keep certain data in memory – UrlFetch, ability to invoke any http request • Examples: Google Docs, OpenID, Captcha, Amazon AWS – Email, Chat APIs 12 12
  • 13. Extending the Paradigms • Heterogeneous Clouds • Massive Parallelism – Combining multiple clouds can – Paradigms that exploit the help you leverate their available redundancy individual strengths – Were not economically feasible – But overall availability may be before compromised – Examples: – Examples: • Hadoop. An open framework • Google App Engine for web for parallelizing intensive data server, AWS for specialized mining tasks processing • BrowserMob / LoadStorm. Load • Facebook front ends for Google testing. Unleash hundreds of App Engine-based applications browsers at an application • Google App • Search / Indexing Applications. Engine/Salesforce.com Divide up the task among interfaces thousands of machines 13 13
  • 14. Summary • Cloud computing is changing the paradigm for how computing gets done • It is a multi-year change, – Accelerated by current cost pressures • Advantages go to the early adopters – So do the risks • It’s uncharted waters • It’s fun! 14 14
  • 15. Thank You J Singh j.singh@EarlyStageIT.com (978) 760-2055 15