1. Making it Rain
Condensing 4 Years of Cloud Usage
Charles Moad – Acting CIO; Director IMA Lab
Gray Bowman – Application Developer
Indianapolis Museum of Art
4. Usage by the numbers
From April 2008 – Sept 2012
• EC2 = $14,882 (78k instance hours ~ 9
years)
• S3 = $3,838 (1.05 TB last month)
• CloudFront = $1,176 (10TB video
streamed since 2009)
• Grand Total = $22,780
5.
6. Advantages
• Scalability
• Pay-as-you-go
• Energy efficiency
• No hardware admin
• Uptime
7. Disadvantages
• Slower access to remote storage
• Charged for frequent access
• Bandwidth competition
• Possible portability issues
• Integration with existing archival
backup systems
8. Preparing for Catastrophe
…The day Skynet became self-aware
• Take periodic snapshots
• Cross region redundancy
• Integrate with in-house backup solutions
• Part of Disaster Recovery
• AWS Support
9. Lessons learned
• Don’t make 3 year commitments
• Integrate with internal backup solution
• Make frequent backups
• You are still responsible for failover
10. Change is the rule
• Glacier introduction brought storage from
$0.125/GB to $0.01/GB = 8%!
– IMA DAM 16TB ~= $160/month
– Insanely complicated retrieval fees
• Instance price reductions
• New round of instance sizes announced
• http://aws.amazon.com/tco-calculator/
Only IMA websitePaid hosting ~$500/monthVery limited resources (30GB)No software controlFrequent downtime
IMAmuseum.orgBlogDashboardExhibition MicrositesCollection ImagesArtBabble.org Video TranscodingVideo StorageVideo Streaming
Explain what EC2 isExplain what S3 isExplain what CloudFront is (used to use Wowza)
Online monitoring and management tools have grownSO EASY to stage sites and move around IP addressesVMware import / export support
- April 21, 2011talk about ebs outage:- artbabble had to rebuildima (rebuild) did come back eventuallyCross region – mention netflix as exampleIn house backup Make these virtual machines part of the disaster recoverySupport is available, it can be pricey
Prices for on demand instances fell faster than the savings associated with a 3 year commitmentTalk about rsync to athena: synchronizes files and directories from one location to another while minimizing data transfer by using delta encodingRun them nightly
Big things that have changed since we’ve started using itInsane glacier retrieval cost?New instance caveats