SlideShare une entreprise Scribd logo
1  sur  45
Télécharger pour lire hors ligne
©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved
Introducing
Amazon Elastic File System
(Amazon EFS)
Timothy Harder
harder@amazon.com
Agenda
1. Provide an overview of Amazon EFS
2. Introduce Amazon EFS technical concepts
3. Conduct a walkthrough of creating a file system
4. Discuss file system security mechanisms
5. Explore the Amazon EFS regional availability and
durability model
Overview of Amazon EFS
The AWS storage portfolio
Amazon S3
• Object storage: Data presented as buckets of objects
• Data access via APIs over the Internet
Amazon
EFS
• File storage (analogous to NAS): Data presented as a file system
• Shared low-latency access from multiple EC2 instances
Amazon
Elastic Block
Store
• Block storage (analogous to SAN): Data presented as disk volumes
• Lowest-latency access from single Amazon EC2 instances
Amazon
Glacier
• Archival storage: Data presented as vaults/archives of objects
• Lowest-cost storage, infrequent access via APIs over the Internet
What is Amazon EFS?
• Fully managed file system for EC2 instances
• Provides standard file system semantics
• Works with standard operating system APIs
• Sharable across thousands of instances
• Elastically grows to petabyte scale
• Delivers performance for a wide variety of workloads
• Highly available and durable
• NFS v4–based
Amazon EFS is designed for a broad range of
use cases, such as:
• Content repositories
• Development environments
• Home directories
• Big data
Operating shared file storage today is a pain
Application owner
or developer
IT administrator
Business owner
• Estimate demand
• Procure hardware
• Set aside physical space
• Set up and maintain hardware (and network)
• Manage access and security
• Provide demand forecasts/business case
• Add lead times and extra coordination to your schedule
• Limit your flexibility and agility
• Make up-front capital investments, over buy, stay on a
constant upgrade/refresh cycle
• Sacrifice business agility
• Distract your people from your business’s mission
We focused on changing the game
Amazon EFS
is simple
Amazon EFS
is elastic
Amazon EFS
is scalable
1 2 3
Amazon EFS is simple
• Fully managed
– No hardware, network, file layer
– Create a scalable file system in seconds!
• Seamless integration with existing
tools and apps
– NFS v4—widespread, open
– Standard file system semantics
– Works with standard OS file system APIs
• Simple pricing = simple forecasting
1
Amazon EFS is elastic
• File systems grow and shrink
automatically as you add and remove
files
• No need to provision storage capacity
or performance
• You pay only for the storage space you
use, with no minimum fee
2
• File systems can grow to petabyte
scale
• Throughput and IOPS scale
automatically as file systems grow
• Consistent low latencies regardless
of file system size
• Support for thousands of concurrent
NFS connections
Amazon EFS is scalable3
Why does this matter…
… to app owners
and developers?
… to your
business?
• Easy to move existing code, applications, and tools
used today with existing NFS servers to the AWS cloud
• Simple shared file storage solution for new cloud-native
applications
• Predictable pricing with no up-front investment
• Increased agility
• Spend less time managing file storage and more
time focusing on your business
… to IT
administrators?
• Eliminates need to manage and maintain file system
storage at scale
Diving In
Some key AWS concepts to understand
• Region
• Availability Zone (AZ)
• Amazon Virtual Private Cloud (VPC)
Region
• Geographic area where
AWS services are available
• Customers choose
region(s) for their AWS
resources
• 11 regions worldwide
REGION
Availability Zone (AZ)
• Each region has multiple,
isolated locations known as
Availability Zones
• Low-latency links between
AZs in a region
• When launching an EC2
instance, a customer
chooses an AZ AVAILABILITY ZONE 3
EC2
AVAILABILITY ZONE 2
AVAILABILITY ZONE 1
EC2
EC2
EC2
REGION
Amazon VPC
• Logically isolated section
of the AWS cloud, virtual
network defined by the
customer
• When launching instances
and other resources,
customers place them in a
VPC
• All new customers have a
default VPC
AVAILABILITY ZONE 1
REGION
AVAILABILITY ZONE 2
AVAILABILITY ZONE 3
VPC
EC2
EC2
EC2
EC2
What is a file system?
• The primary resource in Amazon EFS
• Where you store files and directories
How to access a file system from an instance
• You “mount” a file system on an EC2 instance
(standard command); the file system appears like a
local set of directories and files
• An NFS v4 client is standard on Linux distributions
mount –t nfs4
[file system DNS name]:/
/[user’s target directory]
What is a mount target?
• To access your file
system from instances in
a VPC, you create mount
targets in the VPC
• A mount target is an NFS
v4 endpoint in your VPC
• A mount target has an IP
address and a DNS
name you use in your
mount command
AVAILABILITY ZONE 1
REGION
AVAILABILITY ZONE 2
AVAILABILITY ZONE 3
VPC
EC2
EC2
EC2
EC2
Mount
target
How does it all fit together?
AVAILABILITY ZONE 1
REGION
AVAILABILITY ZONE 2
AVAILABILITY ZONE 3
VPC
EC2
EC2
EC2
EC2
Customer’s file
system
There are three ways to set up and
manage a file system
• AWS Management Console
• AWS command line interface (CLI)
• AWS Software Development Kit (SDK)
The AWS Management Console, CLI, and SDK each
allow you to perform a variety of management tasks
• Create a file system
• Create and manage mount targets
• Tag a file system
• Delete a file system
• View details on file systems in your AWS account
Setting up and mounting a file system takes
less than a minute
1. Create a file system
2. Create a mount target in each AZ from which
you want to access the file system
3. Enable the NFS client on your instances
4. Run the mount command
Securing Your File System
Several security mechanisms
• Control network traffic to and from file systems (mount
targets) by using VPC security groups and network ACLs
• Control file and directory access by using standard
Linux/Windows directory-level/file-level permissions
• Control administrative access (API access) to file systems
by using AWS Identity and Access Management (IAM)
Only EC2 instances in the VPC you specify can access
your Amazon EFS file system
Customer’s file
system
VPC
EC2
EC2
EC2
EC2
VPC
EC2
EC2
EC2
EC2
VPC
EC2
EC2
Security groups control which instances in your VPC
can connect to your mount targets
Customer’s file
system
Security group:
sg-allowed
Security group:
Permit inbound traffic
from “sg-allowed”
Security group:
sg-not-allowed
Amazon EFS supports user-level file and directory
access permissions
• Set file/directory permissions to specify read-write-
execute permissions for users and groups
Integration with IAM provides administrative security
• Use IAM policies to control who can use
the administrative APIs to create, manage,
and delete file systems
• Amazon EFS supports action-level and
resource-level permissions
Regional Availability and Durability
In what regions can I use Amazon EFS?
• US-West (Oregon) *Preview
• US-East (Northern Virginia)
• EU (Ireland)
Data is stored in multiple AZs for high availability
and durability
• Every file
system object
(directory, file,
and link) is
redundantly
stored across
multiple AZs in
a region
AVAILABILITY
ZONE 1
REGION
AVAILABILITY
ZONE 2
AVAILABILITY
ZONE 3
Amazon
EFS
Data can be accessed from any AZ in the region
while maintaining full consistency
• Your EC2 instances
can connect to your
Amazon EFS file
system from any AZ in
a region
• All reads and writes will
be fully consistent in all
AZs; that is, a read in
one AZ is guaranteed
to have the latest data,
even if the data is
being written in another
AZ
AVAILABILITY
ZONE 1
REGION
VPC
EC2
EC2
EC2
AVAILABILITY
ZONE 2
AVAILABILITY
ZONE 3
EC2
Write
Read
Wrapping Up
Simple and predictable pricing
• With Amazon EFS, you pay only for the storage space you use
– No minimum commitments or up-front fees
– No need to provision storage in advance
– No other fees, charges, or billing dimensions
• Amazon EFS price: $0.30/GB-month
What to do next?
• Learn more at aws.amazon.com/efs
• Request an invite for our preview
Timothy Harder
harder@amazon.com
CHICAGO

Contenu connexe

En vedette

Corrida de Toros: Cultural Landscape and Language
Corrida de Toros: Cultural Landscape and LanguageCorrida de Toros: Cultural Landscape and Language
Corrida de Toros: Cultural Landscape and LanguageAlan Doherty
 
Houses of the world
Houses of the worldHouses of the world
Houses of the worldmarblocs
 
Marta, Sònia, Xavi G, Isaac, David, Raül, Marc
Marta, Sònia, Xavi  G, Isaac, David, Raül, MarcMarta, Sònia, Xavi  G, Isaac, David, Raül, Marc
Marta, Sònia, Xavi G, Isaac, David, Raül, Marcmarblocs
 
07 ZamyšLení ŠťAstné DěTství
07  ZamyšLení ŠťAstné DěTství07  ZamyšLení ŠťAstné DěTství
07 ZamyšLení ŠťAstné DěTstvíjedlickak07
 
線上即時客服
線上即時客服線上即時客服
線上即時客服kumee
 
Decimal Review
Decimal ReviewDecimal Review
Decimal Reviewejboggs
 
Cesare Del Moro, Strumenti informatici e telematici nella giustizia civile
Cesare Del Moro, Strumenti informatici e telematici nella giustizia civileCesare Del Moro, Strumenti informatici e telematici nella giustizia civile
Cesare Del Moro, Strumenti informatici e telematici nella giustizia civileAndrea Rossetti
 
企業戦略論 第8週の発表スライド
企業戦略論 第8週の発表スライド企業戦略論 第8週の発表スライド
企業戦略論 第8週の発表スライドHikaru GOTO
 
Workshop: Making the Best of the YouTube-Age
Workshop:  Making the Best of the YouTube-AgeWorkshop:  Making the Best of the YouTube-Age
Workshop: Making the Best of the YouTube-AgeBertram Gugel
 
Bagheria and Water Cultures
Bagheria and Water CulturesBagheria and Water Cultures
Bagheria and Water Culturesjexxon
 
Migrer vers PMB: retour d\'expérience d\'une migration depuis S4W
Migrer vers PMB: retour d\'expérience d\'une migration depuis S4WMigrer vers PMB: retour d\'expérience d\'une migration depuis S4W
Migrer vers PMB: retour d\'expérience d\'une migration depuis S4WPMB-BUG
 
Avvik Fra Normer
Avvik Fra NormerAvvik Fra Normer
Avvik Fra Normerguest89660f
 
Simone Aliprandi, Open source, open content, open data nell'ordinamento itali...
Simone Aliprandi, Open source, open content, open data nell'ordinamento itali...Simone Aliprandi, Open source, open content, open data nell'ordinamento itali...
Simone Aliprandi, Open source, open content, open data nell'ordinamento itali...Andrea Rossetti
 
Ad Club Alumni Presentation 2009
Ad Club Alumni Presentation 2009Ad Club Alumni Presentation 2009
Ad Club Alumni Presentation 2009somethingtochewon
 
09 FóRky PrasečInky
09  FóRky  PrasečInky09  FóRky  PrasečInky
09 FóRky PrasečInkyjedlickak07
 
Pc Static
Pc StaticPc Static
Pc Statickumee
 
Protecting your Microsoft Workloads with High Availability and Reliability
Protecting your Microsoft Workloads with High Availability and ReliabilityProtecting your Microsoft Workloads with High Availability and Reliability
Protecting your Microsoft Workloads with High Availability and ReliabilityAmazon Web Services
 
Blue Raster Presentation for Earth Observation in the Cloud Demo Day
Blue Raster Presentation for Earth Observation in the Cloud Demo DayBlue Raster Presentation for Earth Observation in the Cloud Demo Day
Blue Raster Presentation for Earth Observation in the Cloud Demo DayAmazon Web Services
 

En vedette (20)

Corrida de Toros: Cultural Landscape and Language
Corrida de Toros: Cultural Landscape and LanguageCorrida de Toros: Cultural Landscape and Language
Corrida de Toros: Cultural Landscape and Language
 
Houses of the world
Houses of the worldHouses of the world
Houses of the world
 
Marta, Sònia, Xavi G, Isaac, David, Raül, Marc
Marta, Sònia, Xavi  G, Isaac, David, Raül, MarcMarta, Sònia, Xavi  G, Isaac, David, Raül, Marc
Marta, Sònia, Xavi G, Isaac, David, Raül, Marc
 
07 ZamyšLení ŠťAstné DěTství
07  ZamyšLení ŠťAstné DěTství07  ZamyšLení ŠťAstné DěTství
07 ZamyšLení ŠťAstné DěTství
 
線上即時客服
線上即時客服線上即時客服
線上即時客服
 
Decimal Review
Decimal ReviewDecimal Review
Decimal Review
 
Cesare Del Moro, Strumenti informatici e telematici nella giustizia civile
Cesare Del Moro, Strumenti informatici e telematici nella giustizia civileCesare Del Moro, Strumenti informatici e telematici nella giustizia civile
Cesare Del Moro, Strumenti informatici e telematici nella giustizia civile
 
企業戦略論 第8週の発表スライド
企業戦略論 第8週の発表スライド企業戦略論 第8週の発表スライド
企業戦略論 第8週の発表スライド
 
Insectes
InsectesInsectes
Insectes
 
Workshop: Making the Best of the YouTube-Age
Workshop:  Making the Best of the YouTube-AgeWorkshop:  Making the Best of the YouTube-Age
Workshop: Making the Best of the YouTube-Age
 
Bagheria and Water Cultures
Bagheria and Water CulturesBagheria and Water Cultures
Bagheria and Water Cultures
 
Migrer vers PMB: retour d\'expérience d\'une migration depuis S4W
Migrer vers PMB: retour d\'expérience d\'une migration depuis S4WMigrer vers PMB: retour d\'expérience d\'une migration depuis S4W
Migrer vers PMB: retour d\'expérience d\'une migration depuis S4W
 
Avvik Fra Normer
Avvik Fra NormerAvvik Fra Normer
Avvik Fra Normer
 
CBS Outdoor 2 of 5
CBS Outdoor 2 of 5CBS Outdoor 2 of 5
CBS Outdoor 2 of 5
 
Simone Aliprandi, Open source, open content, open data nell'ordinamento itali...
Simone Aliprandi, Open source, open content, open data nell'ordinamento itali...Simone Aliprandi, Open source, open content, open data nell'ordinamento itali...
Simone Aliprandi, Open source, open content, open data nell'ordinamento itali...
 
Ad Club Alumni Presentation 2009
Ad Club Alumni Presentation 2009Ad Club Alumni Presentation 2009
Ad Club Alumni Presentation 2009
 
09 FóRky PrasečInky
09  FóRky  PrasečInky09  FóRky  PrasečInky
09 FóRky PrasečInky
 
Pc Static
Pc StaticPc Static
Pc Static
 
Protecting your Microsoft Workloads with High Availability and Reliability
Protecting your Microsoft Workloads with High Availability and ReliabilityProtecting your Microsoft Workloads with High Availability and Reliability
Protecting your Microsoft Workloads with High Availability and Reliability
 
Blue Raster Presentation for Earth Observation in the Cloud Demo Day
Blue Raster Presentation for Earth Observation in the Cloud Demo DayBlue Raster Presentation for Earth Observation in the Cloud Demo Day
Blue Raster Presentation for Earth Observation in the Cloud Demo Day
 

Plus de Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

Plus de Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Dernier

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Angeliki Cooney
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024The Digital Insurer
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Orbitshub
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamUiPathCommunity
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfOrbitshub
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Zilliz
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 

Dernier (20)

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 

Amazon EFS: Deploying Scalable, Shared File Systems

  • 1. ©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved Introducing Amazon Elastic File System (Amazon EFS) Timothy Harder harder@amazon.com
  • 2. Agenda 1. Provide an overview of Amazon EFS 2. Introduce Amazon EFS technical concepts 3. Conduct a walkthrough of creating a file system 4. Discuss file system security mechanisms 5. Explore the Amazon EFS regional availability and durability model
  • 4. The AWS storage portfolio Amazon S3 • Object storage: Data presented as buckets of objects • Data access via APIs over the Internet Amazon EFS • File storage (analogous to NAS): Data presented as a file system • Shared low-latency access from multiple EC2 instances Amazon Elastic Block Store • Block storage (analogous to SAN): Data presented as disk volumes • Lowest-latency access from single Amazon EC2 instances Amazon Glacier • Archival storage: Data presented as vaults/archives of objects • Lowest-cost storage, infrequent access via APIs over the Internet
  • 5. What is Amazon EFS? • Fully managed file system for EC2 instances • Provides standard file system semantics • Works with standard operating system APIs • Sharable across thousands of instances • Elastically grows to petabyte scale • Delivers performance for a wide variety of workloads • Highly available and durable • NFS v4–based
  • 6. Amazon EFS is designed for a broad range of use cases, such as: • Content repositories • Development environments • Home directories • Big data
  • 7. Operating shared file storage today is a pain Application owner or developer IT administrator Business owner • Estimate demand • Procure hardware • Set aside physical space • Set up and maintain hardware (and network) • Manage access and security • Provide demand forecasts/business case • Add lead times and extra coordination to your schedule • Limit your flexibility and agility • Make up-front capital investments, over buy, stay on a constant upgrade/refresh cycle • Sacrifice business agility • Distract your people from your business’s mission
  • 8. We focused on changing the game Amazon EFS is simple Amazon EFS is elastic Amazon EFS is scalable 1 2 3
  • 9. Amazon EFS is simple • Fully managed – No hardware, network, file layer – Create a scalable file system in seconds! • Seamless integration with existing tools and apps – NFS v4—widespread, open – Standard file system semantics – Works with standard OS file system APIs • Simple pricing = simple forecasting 1
  • 10. Amazon EFS is elastic • File systems grow and shrink automatically as you add and remove files • No need to provision storage capacity or performance • You pay only for the storage space you use, with no minimum fee 2
  • 11. • File systems can grow to petabyte scale • Throughput and IOPS scale automatically as file systems grow • Consistent low latencies regardless of file system size • Support for thousands of concurrent NFS connections Amazon EFS is scalable3
  • 12. Why does this matter… … to app owners and developers? … to your business? • Easy to move existing code, applications, and tools used today with existing NFS servers to the AWS cloud • Simple shared file storage solution for new cloud-native applications • Predictable pricing with no up-front investment • Increased agility • Spend less time managing file storage and more time focusing on your business … to IT administrators? • Eliminates need to manage and maintain file system storage at scale
  • 14. Some key AWS concepts to understand • Region • Availability Zone (AZ) • Amazon Virtual Private Cloud (VPC)
  • 15. Region • Geographic area where AWS services are available • Customers choose region(s) for their AWS resources • 11 regions worldwide REGION
  • 16. Availability Zone (AZ) • Each region has multiple, isolated locations known as Availability Zones • Low-latency links between AZs in a region • When launching an EC2 instance, a customer chooses an AZ AVAILABILITY ZONE 3 EC2 AVAILABILITY ZONE 2 AVAILABILITY ZONE 1 EC2 EC2 EC2 REGION
  • 17. Amazon VPC • Logically isolated section of the AWS cloud, virtual network defined by the customer • When launching instances and other resources, customers place them in a VPC • All new customers have a default VPC AVAILABILITY ZONE 1 REGION AVAILABILITY ZONE 2 AVAILABILITY ZONE 3 VPC EC2 EC2 EC2 EC2
  • 18. What is a file system? • The primary resource in Amazon EFS • Where you store files and directories
  • 19. How to access a file system from an instance • You “mount” a file system on an EC2 instance (standard command); the file system appears like a local set of directories and files • An NFS v4 client is standard on Linux distributions mount –t nfs4 [file system DNS name]:/ /[user’s target directory]
  • 20. What is a mount target? • To access your file system from instances in a VPC, you create mount targets in the VPC • A mount target is an NFS v4 endpoint in your VPC • A mount target has an IP address and a DNS name you use in your mount command AVAILABILITY ZONE 1 REGION AVAILABILITY ZONE 2 AVAILABILITY ZONE 3 VPC EC2 EC2 EC2 EC2 Mount target
  • 21. How does it all fit together? AVAILABILITY ZONE 1 REGION AVAILABILITY ZONE 2 AVAILABILITY ZONE 3 VPC EC2 EC2 EC2 EC2 Customer’s file system
  • 22. There are three ways to set up and manage a file system • AWS Management Console • AWS command line interface (CLI) • AWS Software Development Kit (SDK)
  • 23. The AWS Management Console, CLI, and SDK each allow you to perform a variety of management tasks • Create a file system • Create and manage mount targets • Tag a file system • Delete a file system • View details on file systems in your AWS account
  • 24. Setting up and mounting a file system takes less than a minute 1. Create a file system 2. Create a mount target in each AZ from which you want to access the file system 3. Enable the NFS client on your instances 4. Run the mount command
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 33. Several security mechanisms • Control network traffic to and from file systems (mount targets) by using VPC security groups and network ACLs • Control file and directory access by using standard Linux/Windows directory-level/file-level permissions • Control administrative access (API access) to file systems by using AWS Identity and Access Management (IAM)
  • 34. Only EC2 instances in the VPC you specify can access your Amazon EFS file system Customer’s file system VPC EC2 EC2 EC2 EC2 VPC EC2 EC2 EC2 EC2
  • 35. VPC EC2 EC2 Security groups control which instances in your VPC can connect to your mount targets Customer’s file system Security group: sg-allowed Security group: Permit inbound traffic from “sg-allowed” Security group: sg-not-allowed
  • 36. Amazon EFS supports user-level file and directory access permissions • Set file/directory permissions to specify read-write- execute permissions for users and groups
  • 37. Integration with IAM provides administrative security • Use IAM policies to control who can use the administrative APIs to create, manage, and delete file systems • Amazon EFS supports action-level and resource-level permissions
  • 39. In what regions can I use Amazon EFS? • US-West (Oregon) *Preview • US-East (Northern Virginia) • EU (Ireland)
  • 40. Data is stored in multiple AZs for high availability and durability • Every file system object (directory, file, and link) is redundantly stored across multiple AZs in a region AVAILABILITY ZONE 1 REGION AVAILABILITY ZONE 2 AVAILABILITY ZONE 3 Amazon EFS
  • 41. Data can be accessed from any AZ in the region while maintaining full consistency • Your EC2 instances can connect to your Amazon EFS file system from any AZ in a region • All reads and writes will be fully consistent in all AZs; that is, a read in one AZ is guaranteed to have the latest data, even if the data is being written in another AZ AVAILABILITY ZONE 1 REGION VPC EC2 EC2 EC2 AVAILABILITY ZONE 2 AVAILABILITY ZONE 3 EC2 Write Read
  • 43. Simple and predictable pricing • With Amazon EFS, you pay only for the storage space you use – No minimum commitments or up-front fees – No need to provision storage in advance – No other fees, charges, or billing dimensions • Amazon EFS price: $0.30/GB-month
  • 44. What to do next? • Learn more at aws.amazon.com/efs • Request an invite for our preview Timothy Harder harder@amazon.com