Serveless Design Patterns (Serverless Computing London)
•
0 likes•2,429 views
Serverless technologies like AWS Lambda has drastically simplified the task of building reactive systems - drop a file into S3 and a Lambda function would be triggered to process it, push an event into a Kinesis stream and magically it'll be processed by a Lambda function in real-time, you can even use Lambda to automate the process of auditing and securing your account by automatically reacting to rule violations to your security policy. Join us in this talk to see some architectural design patterns that have emerged with Lambda, and how to pick the right event source based on the tradeoffs you want. Here are a few patterns that we'll cover in the talk: pub-sub, cron, push-pull, saga and decoupled invocation.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Serveless Design Patterns (Serverless Computing London)
Similar to Serveless Design Patterns (Serverless Computing London) (20)
More from Yan Cui
More from Yan Cui (20)
Recently uploaded
Recently uploaded (20)
Serveless Design Patterns (Serverless Computing London)
- 1. @theburningmonk#aws #awslambda #serverless Serverless Design Patterns Yan Cui @theburningmonk
- 2. “Serverless”
- 3. 2014
- 10. Gojko Adzic It is serverless the same way WiFi is wireless. http://bit.ly/2yQgwwb
- 11. Serverless means… don’t pay for it if no-one uses it don’t need to worry about scaling don’t need to provision and manage servers
- 12. “Function-as-a-Service” AWS Lambda Azure Functions Google Cloud Functions Auth0 Webtask Spotinst Functions Kubeless IBM Cloud Functions
- 13. AWS Lambda
- 14. AWS Lambda API Gateway IOT SNS Kinesis CloudWatch
- 18. SERVERLESS WILL FUNDAMENTALLY CHANGE HOW WE BUILD BUSINESS AROUND TECHNOLOGY AND HOW YOU CODE. Simon Wardley
- 19. more Scalable (and scales faster!)
- 20. Cheaper (don’t pay for idle servers)
- 21. Resilience (built-in redundancy and multi-AZ)
- 22. idea production choose language + framework master language + framework figure out deployment configure AMI configure ELB configure autoscaling capacity planning over-provision for launch are we doing microservices? configure CI/CD
- 23. idea production choose language + framework master language + framework figure out deployment configure AMI configure ELB configure autoscaling capacity planning over-provision for launch are we doing microservices? configure CI/CD
- 24. idea production greater Velocity from idea to product
- 26. Less ops responsibility on your shoulders
- 29. events are an enabler for COMPOSABILITY
- 32. PATTERNS
- 33. WARNING!!
- 34. DESIGN PATTERNS DO NOT GUARANTEE SUCCESS
- 35. Pattern /pat(ə)n/ A pattern is the repeated or regular way in which something happens or is done.
- 37. there are no silver bullets
- 38. UNDERSTAND YOUR PROBLEMS AND CONSTRAINTS OVER FOLLOWING A PATTERN. me
- 39. Pattern /pat(ə)n/ A pattern is the repeated or regular way in which something happens or is done.
- 45. available in Austria, Switzerland, Germany, Japan, Canada, Italy and US
- 46. available on 30+ platforms
- 48. We’re hiring! Visit engineering.dazn.com to learn more. follow @dazneng for updates about the engineering team
- 49. follow @dazneng for updates about the engineering team We’re hiring! Visit engineering.dazn.com to learn more. WE’RE HIRING!
- 50. AWS user since 2009
- 51. AWS user since 2009
- 56. CRON
- 61. OPS AUTOMATION
- 62. AWS Lambda CloudWatch Logs
- 63. CloudWatch Logs
- 64. AWS Lambda CloudWatch Logs AWS Lambda
- 65. CloudWatch Logs
- 66. AWS Lambda CloudWatch Logs CloudTrail
- 70. AWS Lambda CloudWatch Logs CloudWatch Events CloudTrail AWS Lambda
- 71. AWS Lambda CloudWatch Logs CloudWatch Events CloudTrail AWS Lambda AWS Lambda
- 72. AWS Lambda CloudWatch Logs CloudWatch Events CloudTrail AWS Lambda AWS Lambda
- 73. auto-update CloudWatch retention policy auto-create alarms for new APIs auto-create dashboards for new APIs alert on suspicious console logins alert on EC2 activities in unused regions …
- 74. WEB APPS
- 76. API Gateway AWS Lambda DynamoDBRoute53 CloudFront S3 Browser
- 77. API Gateway AWS Lambda DynamoDBRoute53 CloudFront S3 Browser Cognito
- 78. Federated Identities Sync User Flows Registration Verify email/phone Secure sign-in Forgotten password Change password Sign out Cognito User Pools
- 79. Federated Identities Sync Leading Practices Secure password handling with SRP protocol Encrypt all data server-side Password policies Token-based authentication MFA Support CAPTCHA Cognito User Pools
- 80. Cognito Federated Identities Cognito User Pools Facebook TwitterGoogle … identity providers authenticate
- 81. Cognito Federated Identities Cognito User Pools Facebook TwitterGoogle … identity providers authenticate token
- 82. Cognito Federated Identities Cognito User Pools Facebook TwitterGoogle … identity providers authenticate token token
- 83. validate Cognito Federated Identities Cognito User Pools Facebook TwitterGoogle … identity providers authenticate token token
- 84. validate Cognito Federated Identities Cognito User Pools Facebook TwitterGoogle … identity providers authenticate token token IAM credential
- 85. validate Cognito Federated Identities Cognito User Pools Facebook TwitterGoogle … identity providers API Gateway S3 DynamoDB SNSIOT Kinesis authenticate token token IAM credential IAM credential
- 86. what about Multi-Region support?
- 89. API Gateway AWS Lambda DynamoDB Route53 CloudFront S3 Browser API Gateway AWS Lambda eu-west-1 us-east-1
- 91. DATA LAKES
- 92. S3 Buckets
- 93. S3 Buckets IAM
- 96. S3 BucketsKinesis Streams Kinesis Firehose KMS MacieIAM
- 97. S3 BucketsKinesis Streams AWS Lambda KMS MacieIAM Kinesis Firehose
- 98. S3 BucketsKinesis Streams AWS Lambda KMS MacieIAM AWS Lambda Kinesis Firehose
- 99. S3 BucketsKinesis Streams AWS Lambda AWS Lambda KMS MacieIAM AWS Lambda Kinesis Firehose
- 100. S3 BucketsKinesis Streams AWS Lambda AWS Lambda KMS MacieIAM AWS Lambda DynamoDB ElasticSearch Kinesis Firehose
- 101. S3 BucketsKinesis Streams AWS Lambda AWS Lambda KMS MacieIAM AWS Lambda Google BigQuery Kinesis Firehose
- 102. S3 BucketsKinesis Streams AWS Lambda AWS Lambda Athena QuickSight KMS MacieIAM AWS Lambda Kinesis Firehose
- 103. S3 BucketsKinesis Streams AWS Lambda AWS Lambda Athena QuickSight KMS MacieIAM AWS Lambda Kinesis Firehose
- 104. EVENT DRIVEN
- 106. Kinesis
- 107. Kinesis API Gateway AWS Lambda API GatewayAWS Lambda service-A service-B
- 108. Kinesis API Gateway AWS Lambda API GatewayAWS Lambda service-A service-B
- 109. Kinesis API Gateway AWS Lambda API GatewayAWS Lambda service-A service-B AWS Lambda AWS Lambda AWS Lambda
- 110. Kinesis API Gateway AWS Lambda API GatewayAWS Lambda service-A service-B AWS Lambda AWS Lambda AWS Lambda DynamoDBIOT
- 111. Kinesis API Gateway AWS Lambda API GatewayAWS Lambda service-A service-B AWS Lambda AWS Lambda AWS Lambda DynamoDBIOT
- 112. Kinesis API Gateway AWS Lambda API GatewayAWS Lambda service-A service-B AWS Lambda AWS Lambda AWS Lambda DynamoDBIOT AWS Lambda AWS Lambda
- 113. build loosely-coupled system through events
- 114. service A service B service C service D bounded context bounded context
- 115. service A service B service C service D bounded context bounded context
- 116. service A service B service C service D
- 118. service A service B service C service D
- 119. service A service B service C service D
- 121. service A service B service C service Dbackward-compatible?
- 123. bounded context DON’T use events to orchestrate workflows within the same bounded context
- 124. bounded context adds unnecessary complexity to logging, tracing, and end-to-end reporting
- 125. bounded context the workflow doesn’t exist as a standalone concept, but as the sum of a series of loosely connected parts
- 126. Step Functions use Step Functions instead
- 127. Step Functions don’t forget to emit events from the workflow
- 128. Step Functions so others can react to state changes that happened as part of the workflow
- 129. DECOUPLED INVOCATION
- 130. Decoupled Invocation How can a service handle normal request loads, peak request loads, and a continuous period of high load without failing?
- 131. business logic requires expensive processing
- 132. API Gateway max integration timeout is 29 seconds http://amzn.to/2BwW5Bx
- 133. downstream systems not as scalable
- 135. decouple reply from the initial request
- 138. workerAPIClient POST /do_something 202 /result_location GET /result_location 202 /result_location do work
- 139. workerAPIClient POST /do_something 202 /result_location GET /result_location 202 /result_location do work work done
- 140. workerAPIClient POST /do_something 202 /result_location GET /result_location 202 /result_location do work work done GET /result_location 200 OK
- 141. amortises spikes in load
- 143. allows fast response back to caller whilst promises to finish work later
- 145. allows flexible retry strategies by removing the urgency of having to reply to caller right away
- 146. DynamoDB API Gateway POST task id created at result xxx xxx <null> xxx xxx <null> … … … task results not ready PutItem
- 147. DynamoDB API Gateway POST task id created at result xxx xxx <null> xxx xxx <null> … … … task results not ready SQS
- 148. DynamoDB API Gateway 202 task id created at result xxx xxx <null> xxx xxx <null> … … … task results not ready SQS
- 149. use “created at” timestamp to timeout polling requests and avoid infinite retry
- 150. DynamoDBAPI Gateway GET task id created at result xxx xxx <null> xxx xxx <null> … … … task results not ready SQS
- 151. DynamoDBAPI Gateway 202 task id created at result xxx xxx <null> xxx xxx <null> … … … task results not ready SQS
- 152. DynamoDB task id created at result xxx { … } xxx <null> … … task results done UpdateItem xxx xxx … SQS
- 153. DynamoDBAPI Gateway GET task id created at result xxx xxx { … } xxx xxx <null> … … … task results done
- 154. DynamoDBAPI Gateway 200 { … }
- 155. control parallelism with Lambda reserved concurrency setting
- 156. also consider using Kinesis Streams or DynamoDB Streams as queue
- 157. if you use SNS, make sure to enable maxReceivesPerSecond delivery policy (otherwise, invocation-per-message means no amortisation)
- 158. PUB-SUB
- 160. one message, many consumers
- 161. good for decoupling data processing
- 162. independent failures partial failures are easier to manage
- 163. SNS, Kinesis Streams, DynamoDB Streams, etc…
- 164. SNS
- 165. 2 retries then DLQ SNS
- 166. 2 retries then DLQ invocation per msg SNS
- 167. 2 retries then DLQ invocation per msg might run into throttling limits consider impact on downstream SNS
- 168. suffers from temporary issues
- 169. msg/s time max throughput erred and retried
- 170. msg/s time max throughput erred and retried
- 172. Kinesis
- 174. retried until success invocation per shard Kinesis
- 175. better handling of temporary issues
- 179. Kinesis Streams or DynamoDB Streams?
- 180. what is your source of truth?
- 181. limited to events from one table
- 182. records describe DynamoDB events, not events from your domain
- 183. auto-scales no. of shards
- 184. cannot extend data retention beyond 24 hours
- 185. charged based on no. of requests ($0.02 per 100,000 read request units)
- 187. 1 msg/s for a month, 1KB per msg $0.47 1 x 60s x 60m x 24hr x 30days @ $0.014 per mil + 24hrs x 30days @ $0.015 per hr $10.836 1 x 60s x 60m x 24hr x 30days @ $0.5 per mil $1.296 DynamoDB StreamsSNSKinesis Streams 1 Write Capacity Unit @ $0.47 per unit
- 188. 1k msg/s for a month, 1KB per msg 1k x 60s x 60m x 24hr x 30days @ $0.014 per mil + 24hrs x 30days @ $0.015 per hr $47.088 1k x 60s x 60m x 24hr x 30days @ $0.5 per mil $1296.00 DynamoDB StreamsSNSKinesis Streams $470.00 1k Write Capacity Unit @ $0.47 per unit
- 189. DON’T take these projections at face value!
- 190. SNS
- 191. no restriction on destination target SNS
- 192. no restriction on destination target need to handle partial failures & retries SNS
- 193. SAGA
- 194. pattern for managing failures where each action has a compensating action for rollback
- 196. Begin transaction Start book hotel request End book hotel request Start book flight request End book flight request Start book car rental request End book car rental request End transaction
- 197. model actions and compensating actions as Lambda functions
- 198. actions
- 199. compensating actions
- 200. state machine in AWS Step Functions as the coordinator for the saga
- 202. input
- 206. source code available here: https://github.com/theburningmonk/lambda-saga-pattern
- 207. API Gateway and Kinesis Authentication & authorisation (IAM, Cognito) Testing Running & Debugging functions locally Log aggregation Monitoring & Alerting X-Ray Correlation IDs CI/CD Performance and Cost optimisation Error Handling Configuration management VPC Security Leading practices (API Gateway, Kinesis, Lambda) Canary deployments http://bit.ly/prod-ready-serverless get 40% off with: ytcui
- 208. @theburningmonk theburningmonk.com github.com/theburningmonk API Gateway and Kinesis Authentication & authorisation (IAM, Cognito) Testing Running & Debugging functions locally Log aggregation Monitoring & Alerting X-Ray Correlation IDs CI/CD Performance and Cost optimisation Error Handling Configuration management VPC Security Leading practices (API Gateway, Kinesis, Lambda) Canary deployments http://bit.ly/prod-ready-serverless get 40% off with: ytcui