Successfully reported this slideshow.
Measuring the Clouds<br />Guy Rosen – Jack of all Clouds<br />Image credit: flickr/mugley<br />
Agenda<br />Introductions<br />Part I<br />Website Enumeration<br />Q&A<br />Part II<br />Resource ID Analysis<br />Rumors...
@guyro<br /><ul><li>Co-founder, cloud startup
Blogger, JackOfAllClouds.com</li></ul>You can take the guy out of development, but…<br />Image credit: flickr/helico<br />
What is Cloud Computing?<br />Image credit: flickr/ferran-jorda<br />
Part I: Website Enumeration<br />Image credit: flickr/skibler<br />
Is it in the cloud?<br />Given a site…<br />Reverse DNS<br />IP block / WHOIS<br />Image credit: flickr/pagedooley<br />
Reverse DNS<br />&gt; host mydrifts.com<br />mydrifts.com has address 75.101.155.188<br />&gt; host 75.101.155.188<br />18...
WHOIS<br />&gt; host ohmygov.com<br />ohmygov.com has address 173.1.162.2<br />&gt; whois 173.1.162.2<br />GoGrid NET-173-...
Now we just need…<br />… a big list of sites!<br /> Quantcast top 500,000<br />Not covered:<br />WWW site not in the clou...
And the winner is…<br />Image credit: flickr/adelvinphotography<br />
And the winner is…<br />Image credit: flickr/adelvinphotography<br />
And the winner is…<br />Image credit: flickr/adelvinphotography<br />
So what’s next?<br />More providers<br />vCloud Express<br />Regional<br />More data sets<br />Global base<br />Definition...
@guyro<br />guy@guyrosen.com<br />JackOfAllClouds.com<br />Image credit: flickr/laurakgibbs<br />
Part II: Resource ID Analysis<br />Image credit: Wikimedia/Galen Parks Smith<br />
Amazon EC2 Resource IDs<br />Instance		i-31a74258<br />Reservation	r-01764c79<br />Volume		vol-d62bddbf<br />Snapshot	snap...
Is there a pattern?<br />Image credit: flickr/auntiep<br />
Is there a pattern?<br />Image credit: flickr/auntiep<br />
Is there a pattern?<br />Image credit: flickr/auntiep<br />
A few sleepless nights later…<br />Image credit: flickr/aaronjacobs<br />
Anatomy of an EC2 Resource ID<br />Image credit: Wikimedia / Lienhard Schulz<br />
Anatomy of an EC2 Resource ID<br />i-31a74258<br />Image credit: Wikimedia / Lienhard Schulz<br />
Anatomy of an EC2 Resource ID<br />Type						Instance<br />i – instance<br />r – reservation<br />vol – EBS volume<br />sn...
Anatomy of an EC2 Resource ID<br />Type						Instance<br />Inner Marker			Inner  ID:	0258<br />XOR with 4000<br />i-31a74...
Anatomy of an EC2 Resource ID<br />Type						Instance<br />Inner Marker			Inner  ID:	0258<br />Series Marker			Series ID...
Anatomy of an EC2 Resource ID<br />Type						Instance<br />Inner Marker			Inner  ID:	0258<br />Series Marker			Series ID...
Anatomy of an EC2 Resource ID<br />Type						Instance<br />Inner Marker			Inner  ID:	0258<br />Series Marker			Series ID...
Quirks, Notes & Caveats<br />Instance IDs are always sometimes even<br />Reservation IDs too<br />Each EC2 region is entir...
Show us the results already!<br />Image credit: flickr/photocapy<br />
Show us the results already!<br />Image credit: flickr/photocapy<br />
Show us the results already!<br />Image credit: flickr/photocapy<br />
What do Amazon say?<br />Officially:<br />		Nothing.<br />Off the record:<br />		Plausible<br />Image credit: flickr/markg...
EC2 Rumors & Revelations<br />From Randy Bias (CloudScaling.com)<br />40,000 servers<br />16.25MW total power (servers onl...
EC2 Rumors & Revelations<br />Inferred Revenues:<br />$220M / year<br />Amazon Other Revenue for 6mo: $260M (+10% Y/Y)<br ...
Conclusions?<br />Cloud infrastructure is growing – fast!<br />Amazon Web Services leads the pack<br />This is only the be...
Conclusions?<br />Image credit: flickr/jphillipson<br />
Prochain SlideShare
Chargement dans…5
×

Measuring The Clouds

2 555 vues

Publié le

Presentation initially delivered to an IGT workshop, summarizing cloud infrastructure research as conducted and published on www.jackofallclouds.com.

  • Soyez le premier à commenter

Measuring The Clouds

  1. 1. Measuring the Clouds<br />Guy Rosen – Jack of all Clouds<br />Image credit: flickr/mugley<br />
  2. 2. Agenda<br />Introductions<br />Part I<br />Website Enumeration<br />Q&A<br />Part II<br />Resource ID Analysis<br />Rumors and Revelations<br />Q&A<br />Image credit: filckr/childofwar<br />
  3. 3. @guyro<br /><ul><li>Co-founder, cloud startup
  4. 4. Blogger, JackOfAllClouds.com</li></ul>You can take the guy out of development, but…<br />Image credit: flickr/helico<br />
  5. 5. What is Cloud Computing?<br />Image credit: flickr/ferran-jorda<br />
  6. 6. Part I: Website Enumeration<br />Image credit: flickr/skibler<br />
  7. 7. Is it in the cloud?<br />Given a site…<br />Reverse DNS<br />IP block / WHOIS<br />Image credit: flickr/pagedooley<br />
  8. 8. Reverse DNS<br />&gt; host mydrifts.com<br />mydrifts.com has address 75.101.155.188<br />&gt; host 75.101.155.188<br />188.155.101.75.in-addr.arpadomain name pointer ec2-75-101-155-188.compute-1.amazonaws.com.<br />Image credit: flickr/nico_<br />
  9. 9. WHOIS<br />&gt; host ohmygov.com<br />ohmygov.com has address 173.1.162.2<br />&gt; whois 173.1.162.2<br />GoGrid NET-173-1-160-0-1173.1.160.0 - 173.1.175.255<br />Image credit: flickr/brownspan<br />
  10. 10. Now we just need…<br />… a big list of sites!<br /> Quantcast top 500,000<br />Not covered:<br />WWW site not in the cloud<br />Backend / back office<br />Research & Development<br />etc.<br />
  11. 11. And the winner is…<br />Image credit: flickr/adelvinphotography<br />
  12. 12. And the winner is…<br />Image credit: flickr/adelvinphotography<br />
  13. 13. And the winner is…<br />Image credit: flickr/adelvinphotography<br />
  14. 14. So what’s next?<br />More providers<br />vCloud Express<br />Regional<br />More data sets<br />Global base<br />Definition of cloud?<br />
  15. 15. @guyro<br />guy@guyrosen.com<br />JackOfAllClouds.com<br />Image credit: flickr/laurakgibbs<br />
  16. 16. Part II: Resource ID Analysis<br />Image credit: Wikimedia/Galen Parks Smith<br />
  17. 17. Amazon EC2 Resource IDs<br />Instance i-31a74258<br />Reservation r-01764c79<br />Volume vol-d62bddbf<br />Snapshot snap-b9ab03d0<br />Image ami-11ca2d78<br />Image credit: flickr/malingering<br />
  18. 18. Is there a pattern?<br />Image credit: flickr/auntiep<br />
  19. 19. Is there a pattern?<br />Image credit: flickr/auntiep<br />
  20. 20. Is there a pattern?<br />Image credit: flickr/auntiep<br />
  21. 21. A few sleepless nights later…<br />Image credit: flickr/aaronjacobs<br />
  22. 22. Anatomy of an EC2 Resource ID<br />Image credit: Wikimedia / Lienhard Schulz<br />
  23. 23. Anatomy of an EC2 Resource ID<br />i-31a74258<br />Image credit: Wikimedia / Lienhard Schulz<br />
  24. 24. Anatomy of an EC2 Resource ID<br />Type Instance<br />i – instance<br />r – reservation<br />vol – EBS volume<br />snap – EBS snapshot<br />ami – Amazon machine image<br />i-31a74258<br />Image credit: Wikimedia / Lienhard Schulz<br />
  25. 25. Anatomy of an EC2 Resource ID<br />Type Instance<br />Inner Marker  Inner ID: 0258<br />XOR with 4000<br />i-31a74258<br />Image credit: Wikimedia / Lienhard Schulz<br />
  26. 26. Anatomy of an EC2 Resource ID<br />Type Instance<br />Inner Marker  Inner ID: 0258<br />Series Marker  Series ID: 00<br /> XOR with leftmost digits of Inner Marker<br /> (42) then XOR with e5<br />i-31a74258<br />Image credit: Wikimedia / Lienhard Schulz<br />
  27. 27. Anatomy of an EC2 Resource ID<br />Type Instance<br />Inner Marker  Inner ID: 0258<br />Series Marker  Series ID: 00<br />SuperseriesMarkerSuperseries ID: 00<br /> XOR with rightmost digits of Inner Marker<br /> (58) then XOR with 69<br />i-31a74258<br />Image credit: Wikimedia / Lienhard Schulz<br />
  28. 28. Anatomy of an EC2 Resource ID<br />Type Instance<br />Inner Marker  Inner ID: 0258<br />Series Marker  Series ID: 00<br />SuperseriesMarkerSuperseriesID: 00<br />Instance 00-00-0258<br />i-31a74258<br />Image credit: Wikimedia / Lienhard Schulz<br />
  29. 29. Quirks, Notes & Caveats<br />Instance IDs are always sometimes even<br />Reservation IDs too<br />Each EC2 region is entirely separate<br />Different constants<br />It’s all circumstantial!<br />Image credit: flickr/kubina<br />
  30. 30. Show us the results already!<br />Image credit: flickr/photocapy<br />
  31. 31. Show us the results already!<br />Image credit: flickr/photocapy<br />
  32. 32. Show us the results already!<br />Image credit: flickr/photocapy<br />
  33. 33. What do Amazon say?<br />Officially:<br /> Nothing.<br />Off the record:<br /> Plausible<br />Image credit: flickr/markgee6<br />
  34. 34. EC2 Rumors & Revelations<br />From Randy Bias (CloudScaling.com)<br />40,000 servers<br />16.25MW total power (servers only)<br />95,000 sq ft (servers only)<br />Target cost/server: $2,000-$2,500<br />Utilization rate was 70-75%<br />Image credit: flickr/takomabibelot<br />
  35. 35. EC2 Rumors & Revelations<br />Inferred Revenues:<br />$220M / year<br />Amazon Other Revenue for 6mo: $260M (+10% Y/Y)<br />Est. Cloud IaaS market:$400-600M, 10-20% Y/Y growth (during a downturn!)<br />Image credit: flickr/takomabibelot<br />
  36. 36. Conclusions?<br />Cloud infrastructure is growing – fast!<br />Amazon Web Services leads the pack<br />This is only the beginning…<br />Image credit: flickr/jphillipson<br />
  37. 37. Conclusions?<br />Image credit: flickr/jphillipson<br />
  38. 38. @guyro<br />guy@guyrosen.com<br />JackOfAllClouds.com<br />Image credit: flickr/kimberlyfaye<br />

×