Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.

Migrating Data to the Cloud: Explore Your Options From AWS

570 vues

Publié le

AWS offers a variety of data migration services and tools to facilitate moving gigabytes to petabytes of data using your networks, our networks, or even email. Learn about the available data migration options, including the AWS Snowball family, AWS Storage Gateway, Amazon S3 Transfer Acceleration, and other approaches. We provide the guidance to help you find the right service or tool to fit your requirements, and share relevant customers use cases to inspire your first steps with the cloud.

  • Soyez le premier à commenter

Migrating Data to the Cloud: Explore Your Options From AWS

  1. 1. P U B L I C S E C T O R S U M M I T O T T A W A
  2. 2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Migrating Your Data to the Cloud: Exploring Your Options from AWS Stevan Beara WWPS Solutions Architect AWS
  3. 3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Agenda Overview of AWS Transfer Services Data Migration AWS Direct Connect AWS DataSync AWS Snowball Family AWS Transfer for SFTP AWS Storage Gateway Family S3 Transfer Acceleration AWS Partners
  4. 4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Portfolio breadth and depth* Amazon Elastic Block Store (Amazon EBS) Amazon Simple Storage Service (Amazon S3) Amazon Glacier Data movement OnlineOffline AWS Snow family AWS Storage Gateway family AWS Direct Connect AWS DataSync Amazon S3 Transfer Acceleration Storage partners AWS Transfer for SFTP Amazon Kinesis Data Streams, Amazon Kinesis Video Streams, & Amazon Kinesis Firehose Amazon Elastic File System (Amazon EFS) New! Devices New! Storage classes New! Management features New! Transfer services
  5. 5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T AWS data transfer & hybrid storage Online data transfer Hybrid storage Offline data transfer Private network connections to AWS Load streaming data into Amazon S3 Ship static data into and out of Amazon S3 Access AWS storage from on premises Edge locations for Amazon S3-enabled applications Online transfer of active data AWS DataSync AWS Transfer for SFTP SFTP transfers into Amazon S3 NEW NEW Storage and compute in disconnected environments
  6. 6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Why move to the cloud? Common drivers of moving data to the cloud: Pain points of data migration: While every cloud adoption journey is unique, all require a data migration step, which can be hindered by blockers such as: Cost effectiveness Workforce productivity Business agility Operational resilience Access to innovative services Disruption Speed Costs Channels Cloud compatibility
  7. 7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Migrating data: Five key questions 1) What kind of data is it, and where is it going? 4) How much data and time do you have? 2) One time or continuous movement? 3) One way or bi-directional? 5) How about the WAN? Amazon S3 Amazon EC2 Amazon EFS Amazon EBS Amazon Aurora Amazon EMR Amazon Glacier Amazon RDS AWS IoT Amazon Redshift Files Block volumes Databases IoT Streams
  8. 8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T
  9. 9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T AWS Direct Connect Reduce bandwidth Costs Consistent network performance Compatible with all AWS services Private connectivity to VPC Elastic Simple • Establish private connectivity between AWS and your data center • Dedicated connection can be partitioned into multiple virtual interfaces • Maintain network separation between public and private environments BENEFITS
  10. 10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T
  11. 11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T What use cases need to transfer active data? Migration of active application data Transferring data for time-sensitive, in-cloud analysis Replication of data for business continuity Online data transfer
  12. 12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T What is AWS DataSync? Online transfer service that simplifies, automates, and accelerates moving data between on-premises storage and AWS Fast data transfer Cost- effective Enterprise ready Combines the speed and reliability of network acceleration software with the cost-effectiveness of open source tools Easy to use Secure and reliable
  13. 13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T AWS DataSync • Up to 10Gbps with incremental transfers, inline compression, sparse file detection, and optimized read/write for Amazon S3 and Amazon Elastic File System (Amazon EFS)Fast data transfer Easy to use Secure and reliable Enterprise ready Cost- effective • Managed through AWS Management Console, AWS Command Line Interface (AWS CLI), or SDK; monitoring with Amazon CloudWatch, AWS infrastructure auto-deployed, and on-premises agents automatically updated • Data validated and encrypted in-transit and at-rest with automatic recovery from I/O or transmission errors • Full bandwidth management, PCI-DSS compliance, HIPPAA eligible, IAM, and AWS CloudTrail integrated • $0.04 per-GB copied
  14. 14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T As simple as one, two, three ... On-premises NFS file systems, Amazon S3 buckets, or Amazon EFS file systems Create a task by configuring storage locations and options Monitor in the console or through Amazon CloudWatch Start the task and monitor progress VMware ESXi 8 vCPU 32 GB memory Deploy the agent and associate to your AWS account 1 2 3
  15. 15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Shared file system NFS TLS How AWS DataSync works On-Premise Amazon S3 bucket AWS Storage resources AWS DataSync Agent deployed on-premises for fast access to local storage Region Amazon EFS file system AWS DataSync agent Data transfer over the WAN via efficient purpose- built protocol Managed from the console or AWS Command Line Interface (AWS CLI) Service in AWS writes or reads data from AWS storage services
  16. 16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Reduce infrastructure with AWS DataSync and Storage Gateway AWS DataSync transfers to Amazon S3 as part of migration; incremental sync keeps Amazon S3 up to date1 2 Latency-sensitive applications can access data through file gateway; can decommission NAS NAS Amazon S3 bucket On-Premise Region Applications 2 AWS DataSync AWS DataSync agent 1
  17. 17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T
  18. 18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Move large volumes into the cloud Moving large volumes of data over the internet can take years The cloud is not always accessible from remote locations where connectivity is limited or intermittent Traditional shipping of conventional hard drives is laborious and error prone AWS Snowball AWS Snowball Edge
  19. 19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Need for edge analytics in remote and harsh environments Various industries, ranging from research to transportation, necessitate edge computing capabilities to help cope with environments where data generation is decentralized, data volumes are significant, and network connectivity is either inaccessible or intermittent. Research Industrial Healthcare Transportation
  20. 20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Who's Using It? x ISV PartnersCustomers
  21. 21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T References “You got the coolest package I’ve ever delivered” - UPS driver (Sep 19, 2017) “I was hoping that I would get a chance to deliver one of these again” - The same UPS driver (May 13, 2019)
  22. 22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T AWS Snowball AWS Snowball Edge Compute or Storage Optimized AWS Snowmobile • 80-TB storage capacity • 10GE networking • Data encryption end-to-end • Rugged 8.5-G impact case • Rain and dust-resistant • 42 or 100-TB storage capacity • Data encryption end-to-end • Rugged 8.5-G impact case • Rain and dust resistant • AWS Greengrass support for local compute, messaging, and caching • EC2/AMI support for edge compute • Optional GPU • Exabyte-scale storage in a 45-ft container • Data encryption end-to-end • Dedicated security personnel • GPS tracking, alarm monitoring, 24/7 surveillance, and optional additional security AWS Snow Family
  23. 23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Snowball Edge options summary Amazon S3 Compatible Storage 42TB 100TB Compute Comparable to m5d.2xlarge Comparable to m4.4xlarge AWS Services available Amazon Lambda, File Gateway, Amazon EC2 Lambda, File Gateway, Amazon EC2 Memory 208GB 32GB vCPUs 52 24 Disk Space for Instances 7.62TB 1TB Clustering Available Available Typical job lifetime Can be long lasting About 1 month Networking Max 100Gb Max 40Gb GPU Optional Nvidia Tesla V100 No Storage Optimized Compute Optimized
  24. 24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Amazon Simple Storage Service (Amazon S3) Compatible Endpoint NFS File Interface Storage and compute cluster AWS Greengrass and Lambda support Line rate data transfer Hardware enabled data encryption Snowball Edge key features Amazon Elastic Compute Cloud (Amazon EC2) Instance support
  25. 25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Ordering new Snowball Edge variants
  26. 26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Validating Snowball Edge (present)
  27. 27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Validating Snowball Edge Compute Optimized • Compute optimized Edge has eight NFC tags embedded in the case. Opening the device renders the tags unreadable. • With AWS Snowball Edge Verification mobile app, customers can check the tags on a device as part of their security best practices. • Before using the app, customers will need the following: Snowball client Manifest file and unlock code Android or IOS phone with NFC scanning capabilities and a built-in camera. Snowball Edge Compute Optimized or Snowball Edge with GPU
  28. 28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T
  29. 29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T SFTP: It’s here; it’s everywhere Protocol is deeply embedded in workflows across a variety of industries Financial services $ Retail Healthcare … and more
  30. 30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T SFTP architecture on-premises today Hundreds of SFTP clients and apps On-premises - Operate infrastructure - Host, manage, and monitor - Data stored on-premises - Upfront costs (licenses)
  31. 31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Migrate SFTP workflows to AWS To benefit from • Durable storage in Amazon S3 • Processing, archiving, and retention of data • Integration with AWS services SFTP SFTP server and data Will your hundreds of partners change their workflows to integrate with the cloud??
  32. 32. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T In as simple as three steps Your users can now use your AWS SFTP server endpoint to transfer data Map your hostname Select your Amazon S3 bucket(s) Set up your users 1 2 3
  33. 33. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Your SFTP architecture now The same hundreds of users now serviced by AWS Transfer, without requiring changes + Enterprise ready + No end user disruption + Fully managed servers + Simple to use + Pay as you use + Native cloud integrations Amazon S3AWS SFTP AWS Transfer for SFTP
  34. 34. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T
  35. 35. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T AWS Storage Gateway Existing Data Archives New Data Corporate Data Centers or Offices AWS Storage Gateway HTTPS NFS SMB iSCSI VTL Hybrid storage service enabling applications to seamlessly use AWS storage On-Premises Gateway Service Amazon S3 Amazon EBS snapshots Amazon Glacier
  36. 36. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T The AWS Storage Gateway family File gateway Store and access objects in Amazon S3 from file-based applications with local caching Volume gateway Block storage on-premises backed by cloud storage with local caching, Amazon EBS snapshots, and clones Tape gateway Drop-in replacement for physical tape infrastructure backed by cloud storage with local caching Three gateway types provide file, block, and tape storage interfaces
  37. 37. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T AWS Storage Gateway key features Standard storage protocols Seamlessly connect on-premises applications to AWS storage without modifying applications Fully managed cache Frequently used data cached locally For low-latency access Optimized data transfer Secures upload of changed data and downloads requested data AWS integrated Manage on-premises gateways in AWS Management Console and use your data across the entire portfolio of AWS applications and services
  38. 38. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T File gateway overview Store and access objects in Amazon S3 from file-based applications with local caching Use cases • Back up files and databases as objects • Hybrid workflows for on- premises data (e.g., data piplelines) • Low-latency on-premises access to data in cloud (e.g., media editing) • Content distribution and collaboration File Gateway Objects in your Amazon S3 bucket NFS v3/v4 SMB v2/v3
  39. 39. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Volume gateway overview • Supports iSCSI block protocol • Available in two modes: cached and stored • Compresses and tiers partial or whole volumes to the cloud to reduce on-premises SAN/NAS footprint • Take EBS snapshots of on-premises volumes and store them in cloud Cloud-backed block storage presented on premises Key Capabilities Application server Amazon EBS snapshots ServiceVolume Gateway Volume stored in Amazon S3 HTTPSiSCSI Customer Premises
  40. 40. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T • Emulates physical tape device with a media changer and tape drives • Virtual tapes written to Amazon S3 • Ejected virtual tapes are marked “read only” and moved to “tape shelf” in Amazon Glacier • Recovery: Retrieve tapes to library (3–5 hours) and read data from a gateway Tape gateway overview Virtual tapes presented to on-premises backup applications Key Capabilities Backup server Tape library Tape shelfiSCSI HTTPS Media changer Tape Gateway Tape drives Customer Premises
  41. 41. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Storage Gateway is available on a variety of form factors Virtual machines Amazon EC2 Hardware appliance Corporate data centers In AWS Remote locations, branch offices WhereWhen Leverage existing VM infrastructure In-cloud data retrieval/access/DR Out of the box simplified experience
  42. 42. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T
  43. 43. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Amazon S3 Transfer Acceleration AWS Edge Location Optimized Throughput! Change your endpoint, not your code Leverages Amazon CloudFront global edge locations Optimized protocols No firewall exceptions No client software required
  44. 44. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Getting Started Enable Amazon S3 Transfer Acceleration for their bucket DNS resolution <bucket-name>.s3-accelerate.amazonaws.com resolves to the nearest POP location for the client uses the client IP and CloudFront latency based routing Update application / destination URI to: <bucket-name>.s3-accelerate.amazonaws.com File is uploaded to: <bucket-name>
  45. 45. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Rio De Janeiro Warsaw New York Atlanta Madrid Virginia Melbourne Paris Los Angeles Seattle Tokyo Singapore Time[hrs] 500 GB upload from these edge locations to a bucket in Singapore Public Internet How Fast is Amazon S3 Transfer Acceleration? S3 Transfer Acceleration On average, we have seen 171% improvement over regular Amazon S3 when uploading over long distances
  46. 46. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T
  47. 47. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Backup & restore Archive Primary storage BC/DRData migration AWS Partner Network (APN): Migration & storage
  48. 48. Thank you! © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T

×