Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.

What’s New in AWS Database Services

What’s New in AWS Database Services
亞馬遜 AWS 於 2018 年 11 月底在美國拉斯維加斯所舉辦的第七屆 AWS re:Invent 2018 大會,在 AWS 客戶、合作夥伴、媒體人士、產業分析師及 AWS 員工共襄盛舉下,與會人數再創新高,超過 5 萬人。會中 AWS 發布超過 20 款雲端方案,且一半以上專攻雲端 AI、機器學習、物聯網,包括對 SageMaker 強化更多進階功能,推出第一款專用的機器學習推論晶片、加入深度的機器學習運算法支援,及其他包括儲存、資料庫、混合雲、邊緣運算 IoT 等解決方案。而具備微型機器學習能力的迷你自駕遙控車 DeepRacer 的現身,驚人之舉不僅抓人眼球,深入客戶體驗的用心,更成功抓住全球使用者的心。

為讓您與全球先進技術同步,共享最新趨勢資訊,解決您開發機器學習和發展 AIoT 所遇到的難題,AWS 台灣團隊將於 2019 年 1 月 31 日 (四) 舉辦《AWS re:Invent 2018 Recap 台北》,特別嚴選最適切國內諸位先進和企業需求的內容,從「技術創新」、「AIoT」兩大分組議程,發表 AWS 的新服務和新方案。大會除了邀請亞馬遜 AWS 大中華區首席雲計算企業顧問 (Principal Evangelist) 張俠博士分享 AWS 的解決方案藍圖外,眾多 AWS 資深專家也將分享包含機器學習、深度學習推理加速等新方案,完全託管的文件系統、資料庫,無伺服器、容器技術與安全性,以及大數據與分析、物聯網服務應用、儲存方案等最新技術。歡迎您親臨會場,全方位體驗 AWS 新服務將能為您創造的驚人創新之效益。

  • Identifiez-vous pour voir les commentaires

What’s New in AWS Database Services

  1. 1. What’s New in AWS Database Services AWS數據庫服務的新增功能 Dickson Yue, Solutions Architect, AWS 31 Jan 2019
  2. 2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Common data categories and use cases Relational Referential integrity, ACID transactions, schema- on-write Lift and shift, ERP, CRM, finance Key-value High throughput, low- latency reads and writes, endless scale Real-time bidding, shopping cart, social, product catalog, customer preferences Document Store JSON documents with quick access, query on any attribute Content management, personalization, mobile In-memory Query by key with microsecond latency Leaderboards, real-time analytics, caching Graph Quickly and easily create and navigate relationships between data Fraud detection, social networking, recommendation engine Time-series Collect, store, and process data sequenced by time IoT applications, event tracking Ledger Complete, immutable, and verifiable history of all changes to application data Systems of record, supply chain, health care, registrations, financial
  3. 3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS databases services Purpose-builtfor all your app needs Relational Key-value Document In-memory Graph Time-series Ledger NeptuneRDS Aurora CommercialCommunity ElastiCacheDynamoDB DocumentDB Redis Memcached NEW GA Timestream NEW Preview QLDB NEW Preview
  4. 4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Relational RDS
  5. 5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Which database engine version should I use? MySQL: 5.5, 5.6, 5.7, 8.0 MySQL 8.0: Window Functions, Common Table Expressions, JSON functions, Spatial support, improved performance, crash-safe Data Definition Language (DDL) operations, security roles, TLS 1.2 MariaDB: 10.0, 10.1, 10.2, 10.3 MariaDB 10.3: Oracle compatibility (PL/SQL parser), sequences, INTERSECT and EXCEPT, new ROW type and TYPE OF stored functions, invisible columns, temporal versioned tables, user-defined aggregates, instant ADD COLUMN operations PostgreSQL: 9.3, 9.4, 9.5, 9.6, 10, 11 (Preview) PostgreSQL 10: Native table partitioning, improved parallelism in query execution, ICU collation support, column group statistics, enhanced FDW and PLV8 extensions, huge pages enabled by default PostgreSQL 11: Embedded transactions within a stored procedure, improvements to partitioning, improvements to parallelism, adding columns with a non-null column default faster Oracle: 11.2, 12.1, 12.2 Oracle 12.2: New engine versioning scheme—Release Updates (RUs) and Release Update Revisions (RURs) SQL Server: 2008 R2, 2012, 2014, 2016, 2017 NEW! NEW! NEW! NEW!
  6. 6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How do I manage database log files? Database engine logs can be viewed in the Amazon RDS console or downloaded via Amazon RDS API Now publish logs in real time to Amazon CloudWatch Logs Set CloudWatch alarms based on text search patterns Supported engines are MySQL, MariaDB, and Oracle Coming soon for PostgreSQL CloudWatch alarms NEW! Oracle DB instance Amazon CloudWatch Logs MySQL DB instance alternate PostgreSQL instance
  7. 7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How can I track events with my Amazon RDS resources? • Amazon RDS event notifications let you know when important things happen • Built-in notifications for Amazon Simple Notification Service (Amazon SNS) • Amazon RDS now publishes events to Amazon CloudWatch Events • Lets you create rules to respond to changes in your resources • Supports cross-account event delivery • Six different source types (DB instance, DB parameter group, DB security group, DB snapshot, DB cluster, DB cluster snapshot) • 17 different event categories (availability, backup, deletion, configuration change, and more) NEW! NEW!
  8. 8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How do I adhere to best practices? • Amazon RDS Recommendations provides individualized best practice guidance by analyzing your resources • Initial set of configuration- based recommendations • Future launches will include usage, parameters, and performance recommendations • Results are presented in the AWS Management Console to apply immediately or schedule for next maintenance window NEW!
  9. 9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon RDS on VMware VMware vSphere ClusterAWS Region DMZ Connector NEW!
  10. 10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Provisioning and management Cluster Control Network Application Network VMware vSphere Cluster Connector Your Applications VMware Control VMs RDS Control VMs Connector
  11. 11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Database engine support Preview – Happening now! PostgreSQL 10.4 MySQL 5.7 SQL Server 2017 coming soon Sign up here: https://aws.amazon.com/rds/vmware/ GA PostgreSQL, MariaDB, MySQL, and SQL Server Soon thereafter Oracle
  12. 12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Relational Aurora
  13. 13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 0 50 100 150 200 250 1 2 3 4 Max write throughput – up 100% 0 200 400 600 800 1 2 3 4 Max read throughput – up 42% Launched with R3.8xl 32 cores, 256GB memory Now support R4.16xl 64 cores, 512GB memory R5.24xl coming soon 96 cores, 768GB memory Besides many performance optimizations, we are also upgrading HW platform Performance improvement over time Aurora MySQL – 2015-2018
  14. 14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora Multi-Master – scaling and availability 0 10000 20000 30000 40000 50000 60000 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63 65 67 69 71 73 75 77 79 81 83 85 87 89 91 93 95 97 99 101 103 105 107 109 111 113 115 117 119 121 123 125 AggregatedThroughput Time in minutes Sysbench workload on 4 R4.XL nodes Adding a node Adding a node Node going down Node recovering
  15. 15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora Global Database (GA) High-performance database for globally-distributed applications Single Global Database with cross region replication Replication typically completes in less than a second No impact on database performance Write master in one region and read replicas in other regions Cross-region disaster recovery Local read latency for applications with global users Primary Region Secondary Region Application Read/Write Master Storage Storage Read Instances (up to 15) Read Instances (up to 16) Replication <1s
  16. 16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. What’s new in Aurora Serverless Regions US East (N. Virginia), US East (Ohio), US West (Oregon), Europe (Ireland), Asia Pacific (Tokyo). Seoul, Singapore, Sydney, Mumbai, London, N. California, Paris, Frankfurt, Canada Central Compliance FedRAMP, HIPPA, PCI, SOC, ISO & HITRUST Preview Support for Aurora PostgreSQL Preview Support for REST DATA API
  17. 17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon RDS Data API for serverless applications Millions of IOT/mobile devices Data API fleet API End-point Amazon Aurora Serverless Access through simple web interface • Public endpoint addressable from anywhere • No client configuration required • No persistent connections required Ideal for Serverless applications (Lambda) Ideal for light-weight applications (IOT)
  18. 18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Key-Value
  19. 19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. DynamoDB Advancements over the last 21 months VPC endpoints April 2017 Auto scaling June 2017 DynamoDB Accelerator (DAX) April 2017 Time To Live (TTL) February 2017 Global tables On-demand backup Encryption at rest November 2017 November 2017 November 2017 Point-in-time recovery March 2018 SLA June 2018 99.999% SLA August 2018 Adaptive capacity ACID November 2018 Transactions November 2018 On-demand
  20. 20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. DynamoDB—read/write capacity on-demand (GA) No more capacity planning—pay only for what you use No capacity planning No need to specify how much read/write throughput you expect to use Ideal for unpredictable workloads Ramp from zero to tens of thousands of requests per second on demand Pay only for what you use Pay-per-request pricing
  21. 21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon DynamoDB Transactions (GA) Build internet-scale apps with ACID transactions Simplify application code with ACID guarantees Run transactions for large scale workloads Accelerate legacy migrations
  22. 22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Document
  23. 23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. MongoDB-compatible Fast, reliable, fully-managed MongoDB-compatible database MongoDB 3.6 Same drivers, tools Migration with DMS Replica sets Compatible with MongoDB Community Edition 3.6 Use the same MongoDB drivers and tools with DocumentDB; as simple as changing an application connection string Live migrations with DMS; free for 6-months Read scaling is easy with automatic replica set configurations
  24. 24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. MongoDB Architecture Sharded cluster scaling dramatically increases operational complexity Availability Zone 1 Availability Zone 2 Availability Zone 3 reads / writes Shard Primary Shard Primary Shard Secondaries SecondariesSecondaries Primary Shard Router replication Shard Router Shard Router Config Server Config ServerConfig Server Shard Balancing
  25. 25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. DocumentDB Architecture Separate compute and storage provide 2x throughput of current MongoDB managed services reads AWS Region Availability Zone 1 Availability Zone 2 Availability Zone 3 Instance (primary) Cluster volume Instance (replica) Instance (replica) Data copies Data copies Data copies writes reads reads
  26. 26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. In Memory
  27. 27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. What’s New: Redis & Memcached • Redis Streams • SortedSets now have LIST capabilities (POP and BLOCK) • HyperLogLogs has an optimized algorithm • Speed Improvements (Jemalloc additions, etc.) • Active Defragmentation • Added In-line HELP command for redis-cli • Native TLS Integration Redis (ElastiCache) • M o r e a t h t t p s : / / a w s . a m a z o n . c o m / r e d i s / W h a t s _ N e w _ R e d i s 5 • Automated Slab rebalancing • LRU crawler to background-reclaim memory • Faster hash table lookups with murmur3 algorithm  Redis 5.0  Memcached 1.5.10
  28. 28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. New: Amazon ElastiCache: In-Place Version Upgrades • Upgrade a Redis Cluster to newer engine version in-place • No Manual Steps or Application Changes • Available for ElastiCache for Redis Version 3.2 and Higher
  29. 29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. New: Amazon ElastiCache Optimized Instances M5 | R5 • Scale up to 9.5 TiB of in- memory capacity • AWS Nitro System, dedicated hardware & lightweight hypervisor, delivers performance indistinguishable from bare metal • Custom Intel Xeon Scalable processors up to 3.1 GHz & AVX-512
  30. 30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. When 9.5 TiB is not enough! Example 1: • Assume 125 shards made of 1 Primary + 1 Replica = 250 nodes • Assume R5.24xlarge ( 635.61 GiB ) • Cluster memory 635.61 GiB X 125 = ~80 TiB = ~88 TB Example 2: • Assume 250 shards made of 1 Primary + 0 Replica = 250 nodes • Assume R5.24xlarge ( 635.61 GiB ) • Cluster memory 635.61 GiB X 250 = ~159 TiB = ~170 TB New: Amazon ElastiCache 250 node support
  31. 31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Coming soon PERFORMANCE BOOST FOR MULTI-CORE NODES Further optimizations providing significant throughput boost RENAME COMMAND SUPPORT Ability to rename a command SELF-SERVICE PATCHING Provides increased flexibility to control when updates occur
  32. 32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Ledger
  33. 33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Common customer use cases Ledgers with centralized control Healthcare Verify and track providers and insurance Manufacturers Track distribution of a recalled product HR & Payroll Track changes to an individual’s profile Government Track vehicle title history
  34. 34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Challenges with building ledgers Adds unnecessary complexity BlockchainRDBMS - audit tables Difficult to maintain Hard to use and slow Hard to build Custom audit functionality using triggers or stored procedures Impossible to verify No way to verify changes made to data by sys admins
  35. 35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Quantum Ledger Database (QLDB) (Preview) Fully managed ledger database Track and verify history of all changes made to your application’s data Immutable Maintains a sequenced record of all changes to your data, which cannot be deleted or modified; you have the ability to query and analyze the full history Cryptographically verifiable Uses cryptography to generate a secure output file of your data’s history Easy to use Easy to use, letting you use familiar database capabilities like SQL APIs for querying the data Highly scalable Executes 2–3x as many transactions than ledgers in common blockchain frameworks
  36. 36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Ledger database concepts C | H J Journal C | H Current | History Current | History Journal Ledger comprises J L Ledger databaseL Journal determines Current | History
  37. 37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. ID Manufacturer Model Year VIN Owner ID Version Start End Manufacturer Model Year VIN Owner How it works ID Manufacturer Model Year VIN Owner 1 Tesla Model S 201 2 12345678 9 Traci Russell INSERT INTO cars << { 'Manufacturer': 'Tesla', 'Model': 'Model S', 'Year': '2012', 'VIN': '123456789', 'Owner': 'Traci Russel' } >> FROM cars WHERE VIN = '123456789' UPDATE owner = 'Ronnie Nash'FROM cars WHERE VIN = '123456789' UPDATE owner = 'Elmer Hubbard' J ID Version Start End Manufacturer Model Year VIN Owner 1 1 07/16/201 2 NULL Tesla Model S 201 2 12345678 9 Traci Russell current.cars C history.cars H ID Version Start End Manufacturer Model Year VIN Owner 1 1 07/16/201 2 08/03/201 3 Tesla Model S 201 2 12345678 9 Traci Russell 1 2 08/03/201 3 NULL Tesla Model S 201 2 12345678 9 Ronnie Nash ID Version Start End Manufacturer Model Year VIN Owner 1 1 07/16/201 2 08/03/201 3 Tesla Model S 201 2 12345678 9 Traci Russell 1 2 08/03/201 3 09/02/201 6 Tesla Model S 201 2 12345678 9 Ronnie Nash 1 3 09/02/201 6 NULL Tesla Model S 201 2 12345678 9 Elmer Hubbard ID Manufacturer Model Year VIN Owner 1 Tesla Model S 201 2 12345678 9 Ronnie Nash ID Manufacturer Model Year VIN Owner 1 Tesla Model S 201 2 12345678 9 Elmer Hubbard INSERT cars ID:1 Manufacturer: Tesla Model: Model S Year: 2012 VIN: 123456789 Owner: Traci Russell Metadata: { Date:07/16/2012 } H (x) UPDATE cars ID:1 Owner: Ronnie Nash Metadata: { Date:08/03/2013 } H (x) UPDATE cars ID:1 Owner: Elmer Hubbard Metadata: { Date: 09/02/2016 } H (x)
  38. 38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Time series
  39. 39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Timestream (sign up for the preview) Fast, scalable, fully managed time series database 1,000x faster and 1/10th the cost of relational databases Collect data at the rate of millions of inserts per second (10M/second) Trillions of daily events Adaptive query processing engine maintains steady, predictable performance Analytics optimized for time series data Built-in functions for interpolation, smoothing, and approximation Serverless Automated setup, configuration, server provisioning, software patching
  40. 40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS databases services Purpose-builtfor all your app needs Relational Key-value Document In-memory Graph Time-series Ledger NeptuneRDS Aurora CommercialCommunity ElastiCacheDynamoDB DocumentDB Redis Memcached NEW GA Timestream NEW Preview QLDB NEW Preview
  41. 41. Thank You

×