This document summarizes a presentation about analyzing cloud infrastructure. It discusses using techniques like reverse DNS lookups and WHOIS queries to determine if a website is hosted in the cloud. The presentation then analyzes patterns in Amazon EC2 resource IDs to understand the structure and identify different components. It reveals rumors about the scale of Amazon's cloud, with estimates of thousands of servers generating hundreds of millions in annual revenue. The conclusion is that cloud infrastructure is growing rapidly and this is just the beginning.

1. Measuring the Clouds Guy Rosen – Jack of all Clouds Image credit: flickr/mugley

2. Agenda Introductions Part I Website Enumeration Q&A Part II Resource ID Analysis Rumors and Revelations Q&A Image credit: filckr/childofwar

4. Blogger, JackOfAllClouds.comYou can take the guy out of development, but… Image credit: flickr/helico

5. What is Cloud Computing? Image credit: flickr/ferran-jorda

6. Part I: Website Enumeration Image credit: flickr/skibler

7. Is it in the cloud? Given a site… Reverse DNS IP block / WHOIS Image credit: flickr/pagedooley

8. Reverse DNS > host mydrifts.com mydrifts.com has address 75.101.155.188 > host 75.101.155.188 188.155.101.75.in-addr.arpadomain name pointer ec2-75-101-155-188.compute-1.amazonaws.com. Image credit: flickr/nico_

9. WHOIS > host ohmygov.com ohmygov.com has address 173.1.162.2 > whois 173.1.162.2 GoGrid NET-173-1-160-0-1173.1.160.0 - 173.1.175.255 Image credit: flickr/brownspan

10. Now we just need… … a big list of sites!  Quantcast top 500,000 Not covered: WWW site not in the cloud Backend / back office Research & Development etc.

11. And the winner is… Image credit: flickr/adelvinphotography

12. And the winner is… Image credit: flickr/adelvinphotography

13. And the winner is… Image credit: flickr/adelvinphotography

14. So what’s next? More providers vCloud Express Regional More data sets Global base Definition of cloud?

15. @guyro guy@guyrosen.com JackOfAllClouds.com Image credit: flickr/laurakgibbs

16. Part II: Resource ID Analysis Image credit: Wikimedia/Galen Parks Smith

17. Amazon EC2 Resource IDs Instance i-31a74258 Reservation r-01764c79 Volume vol-d62bddbf Snapshot snap-b9ab03d0 Image ami-11ca2d78 Image credit: flickr/malingering

18. Is there a pattern? Image credit: flickr/auntiep

19. Is there a pattern? Image credit: flickr/auntiep

20. Is there a pattern? Image credit: flickr/auntiep

21. A few sleepless nights later… Image credit: flickr/aaronjacobs

22. Anatomy of an EC2 Resource ID Image credit: Wikimedia / Lienhard Schulz

23. Anatomy of an EC2 Resource ID i-31a74258 Image credit: Wikimedia / Lienhard Schulz

24. Anatomy of an EC2 Resource ID Type Instance i – instance r – reservation vol – EBS volume snap – EBS snapshot ami – Amazon machine image i-31a74258 Image credit: Wikimedia / Lienhard Schulz

25. Anatomy of an EC2 Resource ID Type Instance Inner Marker  Inner ID: 0258 XOR with 4000 i-31a74258 Image credit: Wikimedia / Lienhard Schulz

26. Anatomy of an EC2 Resource ID Type Instance Inner Marker  Inner ID: 0258 Series Marker  Series ID: 00 XOR with leftmost digits of Inner Marker (42) then XOR with e5 i-31a74258 Image credit: Wikimedia / Lienhard Schulz

27. Anatomy of an EC2 Resource ID Type Instance Inner Marker  Inner ID: 0258 Series Marker  Series ID: 00 SuperseriesMarkerSuperseries ID: 00 XOR with rightmost digits of Inner Marker (58) then XOR with 69 i-31a74258 Image credit: Wikimedia / Lienhard Schulz

28. Anatomy of an EC2 Resource ID Type Instance Inner Marker  Inner ID: 0258 Series Marker  Series ID: 00 SuperseriesMarkerSuperseriesID: 00 Instance 00-00-0258 i-31a74258 Image credit: Wikimedia / Lienhard Schulz

29. Quirks, Notes & Caveats Instance IDs are always sometimes even Reservation IDs too Each EC2 region is entirely separate Different constants It’s all circumstantial! Image credit: flickr/kubina

30. Show us the results already! Image credit: flickr/photocapy

31. Show us the results already! Image credit: flickr/photocapy

32. Show us the results already! Image credit: flickr/photocapy

33. What do Amazon say? Officially: Nothing. Off the record: Plausible Image credit: flickr/markgee6

34. EC2 Rumors & Revelations From Randy Bias (CloudScaling.com) 40,000 servers 16.25MW total power (servers only) 95,000 sq ft (servers only) Target cost/server: $2,000-$2,500 Utilization rate was 70-75% Image credit: flickr/takomabibelot

35. EC2 Rumors & Revelations Inferred Revenues: $220M / year Amazon Other Revenue for 6mo: $260M (+10% Y/Y) Est. Cloud IaaS market:$400-600M, 10-20% Y/Y growth (during a downturn!) Image credit: flickr/takomabibelot

36. Conclusions? Cloud infrastructure is growing – fast! Amazon Web Services leads the pack This is only the beginning… Image credit: flickr/jphillipson

37. Conclusions? Image credit: flickr/jphillipson

38. @guyro guy@guyrosen.com JackOfAllClouds.com Image credit: flickr/kimberlyfaye