The document provides an overview of Amazon Web Services (AWS) and demonstrates several key AWS services. It discusses compute options like EC2 virtual machines and container services. It covers storage services like S3, Glacier and EBS volumes. It demonstrates database services like RDS, Redshift and DynamoDB. It also shows big data services like EMR for Hadoop and data pipelines for transferring data. The document concludes that EC2 is good for testing, training and production, while S3 and Glacier are better for archiving, and services like RDS, Redshift and DynamoDB provide specialized database functionality in the cloud.

1. AWS for the SQL Server Pro
@LynnLangit
Nov 2013

2. Data Expertise / Lynn Langit
Practicing Architect
• Cloud Deployments (Azure, AWS, Google)
Technical author / trainer
•
•
•
•
Google Cloud Developer Series
SQL Server 2012 Developer Series
Cloudera Certified Developer
2 books on SQL Server BI
Industry awards
•
•
•
Microsoft – MVP for SQL Server
Google – GDE for Cloud Platform
10Gen – Master for MongoDB
Former MSFT FTE
•
4 years

3. What and Why AWS?
Market leader
AWS
Amazon’s cloud
Large Set of
services
• Compute
• Data
• More
• In market longest
• Usually cheapest
• Most often used
in production

4. Amazon Web Services

5. How to Work with AWS
• Web Console
• Command
Line Tools
• AWS SDK and
IDE Tools
5

6. EC2 – Virtual Machines (AMIs)

7. EC2 – VMs (AMIs) from AWS Marketplace

8. Demo - EC2
Virtual Machines
8
April 2013

9. Understanding EC2 storage options

10. S3 -- Storage

11. S3 – bucket properties

12. Demo – S3
Storage
12
April 2013

13. Glacier -- storage & archiving

14. Demo – Glacier
Archival Storage
14
April 2013

15. RDS – partially managed SQL Server and
more…

16. Demo – RDS
SQL Server as a service
16
April 2013

17. RDS vs. EC2 for SQL Server
Why RDS
costs more
• Provisioned IO –
performance guarantees
• Scheduled backups
• Point in time restores
• Scheduled maintenance
windows
• Full use of all SQL tools,
SSMS, Profiler, DTA, etc…
• Supports Availability Groups
(requires 2012 Enterprise)
• Cross-regional snapshots

18. Redshift – Warehouse as a Service

19. Demo – Redshift
Data Warehousing as a Service
19
April 2013

20. DynamoDB
for fast NoSQL with SSDs

21. Demo – DynamoDB
NoSQL on SSD
21
April 2013

22. Elastic MapReduce
for easy Hadoop

23. Demo – MapReduce
Hadoop on AWS
23
April 2013

24. Data Pipelines – automated data transfer

25. Demo – Data Pipeline
Build data flows on AWS
25
April 2013

26. Elastic Beanstalk
for application scalability

27. Demo – Beanstalk
PaaS on AWS
27
April 2013

28. AWS SDK for Visual Studio
28

29. Demo – AWS SDK
Add-in for Visual Studio and .NET
29
April 2013

30. Cloud Database Services by Vendor
AWS
Google
Microsoft
Virtual Machines
EC2 w/SQL Server
GCE – Linux only
Azure VM – W/SQL
Server
Cloud RDBMS
RDS - SQL Server
Redshift -Postgres
mySQL
MariaDB
SQL Azure
NoSQL buckets
Key-Value stores
S3, EBS, Glacier,
DynamoDB
Cloud Storage
HR Datastore on GAE
Azure Blobs
Azure Tables
Pipelines
Data Pipelines
Via APIs only
SSIS (on-premises)
Streaming
Machine Learning
Custom EC2
Prospective Search &
Prediction API
StreamInsight
Document
MongoDB on EC2
None
MongoDB on Windows
Azure
Hadoop MapReduce
or Dremel
MapReduce on EC2
using S3
Big Query
HDInsight (HDFS) on
Azure
Data sets & other
EBS volumes w/datasets
Freebase
Translation API
Full-text search
Azure Marketplace

31. Costs - Free Tier – EC2

32. Costs - Free Tier SQL and Dynamo

33. How much does it cost?

34. Creative Financing
Regular Pricing
• Use what you need and no more, i.e. instance size, storage size…
• Watch for price drops – RDS price decrease this week
Smart EC2 Instance Usage
• Pause EC2 instances to reduce compute charges
• Delete EC2 instances to reduce storage charges
Vanity Pricing
• Set pricing alerts
• Use spot pricing
• Re-selling compute / storage

35. Example: EC2 Spot Pricing
35

36. Example: EC2 Reserved Pricing
36

37. Tip: Use Pricing Calculators
Example – from RightScale ‘PlanForCloud’
37

38. Conclusions
EC2 for testing, training and production (IaaS)
S3 for archiving R/W
Glacier for archiving W fast & cheap, R slow & expensive
RDS for HA SQL Server
Redshift for Data Warehousing on demand
DynamoDB for fast NoSQL – on SSDs
Elastic Map Reduce for easy Hadoop MapReduce

39. • recipes)
www.TeachingKidsProgramming.org
•
•
•
Free Courseware (Java, SmallBasic or C# / Pluralsight)
Do a Recipe  Teach a Kid (Ages 10 ++)
Dec 2013 – Code.org – ‘Hour of Code’ education partner

40. Keep Learning
Twitter: @LynnLangit
YouTube:
http://www.youtube.com/user/SoCalDevGal
Hire me
• To help build your BI/Big Data solution
• To teach your team next gen BI
• To learn more about using NoSQL
solutions