Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2rSET5n. Rafal Gancarz provides the overview of monitoring capabilities required by system built on the Serverless stack, discusses various AWS services that can be used to deliver such capabilities. He covers everything from metering, logging to tracing, auditing, alerting, and shares tips on how to monitor the spend on the cloud infrastructure, control and adjust provisioned capacity for the resources. Filmed at qconlondon.com. Rafal Gancarz is a Lead Consultant for OpenCredo. He is an experienced technologist with expertise in architecting and delivering large-scale distributed systems. Rafal is also an experienced Agile practitioner and a Certified Scrum Master, and is always interested in improving project delivery.

1. MONITORING
SERVERLESS
ARCHITECTURES

2. InfoQ.com: News & Community Site
Watch the video with slide
synchronization on InfoQ.com!
https://www.infoq.com/presentations/
aws-monitor-serverless
• Over 1,000,000 software developers, architects and CTOs read the site world-
wide every month
• 250,000 senior developers subscribe to our weekly newsletter
• Published in 4 languages (English, Chinese, Japanese and Brazilian
Portuguese)
• Post content from our QCon conferences
• 2 dedicated podcast channels: The InfoQ Podcast, with a focus on
Architecture and The Engineering Culture Podcast, with a focus on building
• 96 deep dives on innovative topics packed as downloadable emags and
minibooks
• Over 40 new content items per week

3. Purpose of QCon
- to empower software development by facilitating the spread of
knowledge and innovation
Strategy
- practitioner-driven conference designed for YOU: influencers of
change and innovation in your teams
- speakers and topics driving the evolution and innovation
- connecting and catalyzing the influencers and innovators
Highlights
- attended by more than 12,000 delegates since 2007
- held in 9 cities worldwide
Presented at QCon London
www.qconlondon.com

4. @RafalGancarz
Your Manager
CAN YOU HELP WITH SOME PRODUCTION PROBLEMS?

5. (CC) Rachel Gardner

6. Rafal Gancarz
Lead Consultant @ OpenCredo
@RafalGancarz

7. @RafalGancarz
WHAT IS
SERVERLESS?

8. (CC) theaucitron

9. @RafalGancarz
Cloud-native

10. @RafalGancarz
PaaS?

11. @RafalGancarz
Serverless ≠ FaaS
FaasServerless

12. @RafalGancarz
Managed runtime

13. @RafalGancarz
WHY
SERVERLESS?

14. (CC) snapp3r

15. @RafalGancarz
Availability

16. @RafalGancarz
Scalability

17. @RafalGancarz
Economy

18. @RafalGancarz
Time to market

19. @RafalGancarz
Security

20. @RafalGancarz
Operability

21. @RafalGancarz
SERVERLESS
BUILDING BLOCKS

22. @RafalGancarz
AWS Lambda
Java, C#, NodeJS, Python
sync & async invocation
1 million invocations and 400k GB-s
free per month
$0.20 per 1 million requests and
~$6.65 for 400k GB-s thereafter

23. @RafalGancarz
AWS API Gateway
security, caching, throttling
functions as API implementations
1 million requests free per month
$3.50 per 1 million requests and
$0.09/GB (for the first 10 TB, then
cheaper)

24. @RafalGancarz
AWS DynamoDB
document and key-value
function as triggered procedures
25 GB of storage and 25 units of read
capacity each month for free (~200k
requests per month)
$0.25 per GB/month and $0.0065 per
hour for 10 units of write capacity (36k
writes/hour) or 50 units of read capacity
(180k reads/hour)

25. @RafalGancarz
AWS S3
durable, available and scalable
functions as content processors
5 GB of storage and 15 GB of data
transfer out to Internet each month
for free
$0.03 per TB/month and $0.09 per
GB data transfer out to Internet

26. @RafalGancarz
AWS SNS
pub-sub, push notifications
functions as destinations
1m publishes, 1m mobile push
notifications, 1k emails, 100k HTTP
notifications and 1 GB of data transfer out
each month for free
$0.50 per 1m publishes, $0.60 per 1m
HTTP notifications and $0.09 per GB data
transfer out to the Internet

27. @RafalGancarz
AWS Kinesis Streams
pub-sub, persistent
functions as consumers
no free tier
$0.015 per shard/hour, $0.014 per
1m PUT payload units (25KB) +
extended retention charges
data transfer is free

28. @RafalGancarz
Other AWS services
SQS
Redshift
IoT
ElastiCache
CognitoSES
RDS
ElasticSearch
EMR
Batch
Route53CloudFront
Greengrass Button
Step Functions

29. (CC) Grégoire Lannoy
MONITORING

30. @RafalGancarz
AWS CloudWatch
scalable, managed
real-time monitoring
metrics, logs, alarms, events

31. (CC) Jérôme S
METRICS

32. @RafalGancarz
CloudWatch Metrics
retention: 1m (15 days), 5m (63 days),
1h (15 months)
basic monitoring (1m/5m) is free
10 metrics and 1 million API requests for
free each month
$0.30 per metric/month for the first 10k
metrics ($0.02 for metrics over 1M)
$0.01 for 1000 API requests

33. @RafalGancarz
AWS Lambda
Invocations
Errors
Dead Letter Errors
Duration
Throttles

34. @RafalGancarz
AWS API Gateway
4XX Error
5XX Error
Cache Hit Count
Cache Miss Count
Count
Integration Latency
Latency

35. @RafalGancarz
AWS DynamoDB
Provisioned Capacity Units Read/Write
Consumed Capacity Units Read/Write
Online Index Consumed Capacity/Progress/Throttling
Returned Bytes
Returned Item Count
Returned Records Count (Streams)
Successful Request Latency
Errors System/User
Conditional Check Failed Requests
Throttled Events Read/Write/Requests

36. @RafalGancarz
AWS S3
Bucket Size Bytes (daily)
Number Of Objects (daily)
All Requests
Get/Put/Delete/Head/Post/List Requests
Bytes Downloaded/Uploaded
Errors 4XX/5XX
First Byte Latency
Total Request Latency

37. @RafalGancarz
AWS SNS
Number Of Messages Published
Publish Size
Number Of Notifications Delivered
Number Of Notifications Failed
SMS Success Rate

38. @RafalGancarz
Custom Metrics
function
Lambda
CloudWatch
SDK

39. @RafalGancarz
Estimated Billing
Total Estimated Charges
Estimated Charges (per service)

40. (CC) Kevin Dooley
DASHBOARDS

41. @RafalGancarz
CloudWatch Dashboards
metrics, alarms, static text
3 dashboards (up to 50 metrics) per
month for free
$3 per dashboard per month

42. ALERTING
(CC) Martin Abegglen

43. @RafalGancarz
CloudWatch Alarms
watches metrics over time
can trigger a function via SNS
10 alarms per month for free
$0.10 per alarm per month

44. @RafalGancarz
Serverless Alerting
function
alarm topic
email
SMS
channel
metric
condition

45. LOGGING
(CC) Mari Smith

46. @RafalGancarz
CloudWatch Logs
ingests and stores application logs
configurable retention period
5 GB data ingestion and 5 GB
archived storage per month for free
$0.5985 per GB ingested per month
$0.0315 per GB archived per month

47. @RafalGancarz
Log Collection
log groupLambda
stdout
function
stderr

48. @RafalGancarz
Log Filtering
log group metric alarm
filter condition

49. @RafalGancarz
Log Streaming
log group
function Elastic
Search
stream function

50. @RafalGancarz
Log Browsing
log group
Elastic
Search
function
JSON
Kibana
+
Bunyan CLI
Bunyan

51. EVENTS
(CC) JD Hancock

52. @RafalGancarz
CloudWatch Events
stores & streams application events
$1 per 1 million custom events

53. @RafalGancarz
Custom Events
function
SDK
event rule function

54. @RafalGancarz
DynamoDB dynamic capacity
function
SDK
event
metrics
table

55. HEALTH CHECKS
(CC) Rosmarie Voegtli

56. @RafalGancarz
Route53 Health Checks
monitors HTTP(S) endpoints
50 AWS endpoint checks per month
for free
$0.50 per health check per month
$1 per feature (HTTPS, string
matching, fast interval, latency) per
month

57. @RafalGancarz
Health Checks
health
check
metric alarm
api function table

58. TRACING
(CC) Ozzy Delaney

59. @RafalGancarz
AWS X-Ray
collects transaction traces
support for Lambda coming soon
100k traces recorded and 1 million
traces retrieved/scanned free per
month
$5 per 1 million traces recorded and
$0.50 per 1 million traces retrieved/
scanned per month

60. AUDITING
(CC) The Steve

61. @RafalGancarz
AWS CloudTrail
audits all console, API, SDK activity
first copy of management event free
additional copies $2 per 100k
events
$0.10 per 100k data events

62. THE FUTURE
(CC) matt northam

63. @RafalGancarz
Total Visibility

64. @RafalGancarz
Monitoring as a Service

65. @RafalGancarz
Monitoring not only
for Operations

66. @RafalGancarz
Application <-> Monitoring
metrics
events
logs
feedback
Application
Services
Monitoring
Services

67. @RafalGancarz
Monitoring as the enabler
for the new functionality

68. (CC) Alan Turkus
QUESTIONS?
@RafalGancarz

69. Watch the video with slide
synchronization on InfoQ.com!
https://www.infoq.com/presentations/
aws-monitor-serverless