The document discusses various storage options on Amazon Web Services (AWS) including Simple Storage Service (S3), Elastic Block Store (EBS), and Glacier. It then provides details on how to configure NetBackup to leverage these AWS storage services for backup and recovery. Specific scenarios are presented on backing up on-premises and cloud-based workloads to S3, EBS, and Glacier using different NetBackup and AWS configurations. Reporting and monitoring capabilities are also demonstrated.

1. NetBackup and Amazon Web Services
Danilo Santos
Systems Engineer

2. Fundamental Storage Options from AWS

3. Elastic Block Store, S3 and Glacier
Fundamental Storage Options
Simple Storage Service
Highly scalable object storage
1 byte to 5TB in size
99.999999999% durability
Elastic Block Store
High performance block storage device
1GB to 1TB in size
Mount as drives to instances with snapshot/cloning functionalities
Glacier
Long term object archive
Extremely low cost per gigabyte
99.999999999% durability
Very fast ‘instance’ disks
Slow, rare access
Fast web object storage

4. Elastic Block Store, S3 and Glacier
Fundamental Storage Options
Simple Storage Service
Highly scalable object storage
1 byte to 5TB in size
99.999999999% durability
Elastic Block Store
High performance block storage device
1GB to 1TB in size
Mount as drives to instances with snapshot/cloning functionalities
Glacier
Long term object archive
Extremely low cost per gigabyte
99.999999999% durability

5. Elastic Block Store, S3 and Glacier
Fundamental Storage Options
Simple Storage Service Highly scalable object storage 1 byte to 5TB in size 99.999999999% durability
Elastic Block Store
High performance block storage device
1GB to 1TB in size
Mount as drives to instances with snapshot/cloning functionalities
Glacier
Long term object archive
Extremely low cost per gigabyte
99.999999999% durability
IMAGE
Persistent storage Volume lifetime is independent of any particular EC2 instance.
General purpose Raw, unformatted, block device. Use from Linux, Solaris or Windows.
High performance Equal to or better than local EC2 drive. Provisioned IOPS
High reliability Built-in redundancy within availability zone. AFR (Annual Failure Rate) between 0.1% and 0.4%.
Scalable Volume sizes ranging from 1 GB to 1 TB.
Easy Easy to create, attach, back up, restore, and delete volumes.

6. Elastic Block Store, S3 and Glacier
Fundamental Storage Options
Simple Storage Service
Highly scalable object storage
1 byte to 5TB in size
99.999999999% durability
Glacier Long term object archive Extremely low cost per gigabyte 99.999999999% durability
IMAGE
.
Paradigm
File system
Performance
Very fast (~100-4000 IOPs per volume)
Redundancy
Within data center
Security
Visible only to your EC2 instances
Pricing
$0.05/GB/Mo. allocated
Access from the Net?
No
Typical use case
It’s a disk drive
Elastic Block Store
High performance block storage device
1GB to 1TB in size
Mount as drives to instances with snapshot/cloning functionalities

7. Elastic Block Store, S3 and Glacier
Fundamental Storage Options
Elastic Block Store
High performance block storage device
1GB to 1TB in size
Mount as drives to instances with snapshot/cloning functionalities
Glacier
Long term object archive
Extremely low cost per gigabyte
99.999999999% durability
Simple Storage Service Highly scalable object storage 1 byte to 5TB in size 99.999999999% durability

8. Elastic Block Store, S3 and Glacier
Fundamental Storage Options
Elastic Block Store
High performance block storage device
1GB to 1TB in size
Mount as drives to instances with snapshot/cloning functionalities
Glacier
Long term object archive
Extremely low cost per gigabyte
99.999999999% durability
IMAGE
Amazon S3
Simple Storage Service
Highly scalable
data storage in-the-cloud
Programmatic access
via web services API
Is a Web Store
Not a file system
Fast, highly available
Durable
Economical
Paradigm
Object store
Performance
Very fast
Redundancy
Across data centers
Security
Public Key / Private Key
Pricing
$0.03/GB/month stored
Access from the Net?
Yes
Typical use case
Write once, read many
Simple Storage Service
Highly scalable object storage
1 byte to 5TB in size
99.999999999% durability

9. Elastic Block Store, S3 and Glacier
Fundamental Storage Options
Simple Storage Service
Highly scalable object storage
1 byte to 5TB in size
99.999999999% durability
Elastic Block Store
High performance block storage device
1GB to 1TB in size
Mount as drives to instances with snapshot/cloning functionalities
Glacier
Long term object archive
Extremely low cost per gigabyte
99.999999999% durability
.
Paradigm
Object Store
Performance
Data Retrieval Time (Min 3-5hrs)
Redundancy
Across data centers like S3
Security
Public Key / Private Key
Pricing
$0.01/GB/Mo.
Access from the Net?
Yes (Also Use S3 policies to move cold backup data for long term retention)
Typical use case
Long term and infrequent access (Typically <5% data per month)

10. Data on our infrastructure is durable
Object Copy
Object
Object Copy
AWS Region
Data Centers
Our customers don’t have to duplicate their data like they do with tape

11. Presentation Identifier Goes Here
No Brasil desde 1994
São Paulo e mais 6 Regionais
(RJ, DF, MG, RS, PE e PR)
Mais Importante região da América Latina
Crescimento recorde no mundo
Mais de 260+ Colaboradores
95% da lista Maiores & Melhores (Exame) são nossos Clientes
Symantec no Brasil
Confiança no mundo conectado.

12. NetBackup and Amazon
12
#1 Leader in Backup and Recovery Software*
Source: * Gartner: Market Share Analysis: Enterprise Distributed System Backup/Recovery Software Market, Worldwide, 2013. Published May 14, 2014.

13. NetBackup and Amazon
13
NetBackup 7.6 and AWS Overview
•Powered by Symantec OST Technology
–Cloud storage exposed as OST device
•‘At Rest’ and ‘In Flight’ Data Encryption
•Backup Throttling Support
•NetBackup OpsCenter Integration
OpenStorage Technology
010011010110101010110101110101000101010111000111010
800
1200
2400

14. NetBackup and Amazon
14
NetBackup 7.6 and AWS Example diagram
NetBackup Infrastructure
Cloud Storage Disk Pool
NetBackup Cloud Integration
•CloudStore Service Container must be present on NetBackup Media Server
•Available Cloud Storage Server options depend upon the storage provider
•Available disk pool types depend upon licensed features
•If a cloud storage disk pool is a storage destination in a storage lifecycle policy, NetBackup capacity management applies
Media Server
Master Server
Virtual Host
NBU Client
Cloud Svc Cont.
Symantec recommends using NetBackup Appliances as Master/Media Servers
Client Server

15. NetBackup and Amazon
15
NetBackup 7.6 and AWS Configuring cloud settings and throttling
General Cloud Settings
Advanced Throttling Settings

16. NetBackup Accelerator Technology
Maximizing performance through advanced synthetic backup capabilities
16
NetBackup and Amazon

17. NetBackup and Amazon
17
NetBackup 7.6 Accelerator Introduction and overview
•Creates Synthesized, Low-cost Full Backups
–Client impact similar to incremental backup
–Recovery benefits of full backups
•Uses Accelerator Track Log
–Intelligent detection of file changes
•Full Synthetic Backup Generated Inline
–Synthetic created while data is sent from client
–No separate schedule or synthetic “event”
•Can Be Combined with Client Deduplication
–Lower client deduplication impact when combined with Accelerator
–Client Deduplication enables “Client Direct” transport
NetBackup Accelerator
010011010110101010110101110101000101010111000111010
Deduplication Compatible
Inline Synthetic Processing
NetBackup Compatibility Lists: TECH59978

18. NetBackup and Amazon
18
NetBackup 7.6 Accelerator NetBackup Accelerator diagram
NetBackup 7.6 Accelerator
•Media Server combines changed blocks inline with previous backup to create synthetic full
•Supports key storage targets such as MSDP, NetBackup 50x0 Appliances, and cloud
Track Log Identifies Changes
Previous Full backup on Media Server
Changed blocks (“accelerator incremental”)
“Accelerator incremental” and “client direct” deduplication
Inline synthetic processing
Accelerator full backup created inline
NBU Appliance
NBU Client
Master Server
Client Dedupe
Catalog Data
Backup Data
Client Server

19. 19
NetBackup and AWS Reference Architecture
NetBackup capabilities with Amazon
NetBackup and Amazon

20. NetBackup and Amazon
20
NetBackup 7.6 and AWS Use Cases
•Use Case #1
–Back up on premise data to S3 Storage in the cloud using AWS S3 cloud connector
–On premise NetBackup Master/Media
•Use Case #2 (Two Options)
–On premise NetBackup master
–Backend uses S3 only
–Use Case 2a
•Back up workloads on premise to the cloud using Amazon Storage Gateway
–Use Case 2b
•Backup workloads on premise to the cloud using Riverbed SteelStore Gateway
•Use Case #3
–Back up workloads on premise to the cloud using Amazon Storage Gateway VTL
–Backend uses S3 and Glacier
–On premise NetBackup master

21. NetBackup and Amazon
21
NetBackup 7.6 and AWS Use Cases
•Use Case #4
–Back up workloads that reside within AWS EC2
–On premise NetBackup Master with Media Server on premise backing up local workloads
– Virtual Media Server EC2
–Media Server in EC2 uses Basic or Advanced Disk
•Use Case #5
–Back up workloads on premise to a Virtual Media Server in AWS
–On premise NetBackup Master
–Media Server in EC2 uses Basic or Advanced Disk
•Use Case #6
–Back up workloads on premise to a Virtual Media Server in AWS
–On premise NetBackup Master
–Media Server in EC2 uses MSDP

22. NetBackup and Amazon
22
NetBackup 7.6 and AWS Scenario #1
•Description:
–Leverage the cloud for offsite storage using S3 Storage
–NetBackup offers a cloud connector for AWS S3
–Cloud Storage Configuration Wizard facilitate the setup and provisioning for AWS
–NetBackup 7.6 Cloud Administrator’s Guide and several other documents provides documentation and support
–Expected throughput has been reported in the range of 1-6 MB/sec. Multi- streaming improves performance to the 15 – 20 MB/sec range.
–Accelerator is available for backups to the cloud and can potentially reduce the amount of data being sent to the cloud*
*Please See Symantec Compatibility Guides

23. NetBackup and Amazon
23
NetBackup 7.6 and AWS Scenario #1
Diagram - Scenario #1

24. NetBackup and Amazon
24
NetBackup 7.6 and AWS Scenario #2
•Description:
–Gateways are presented to NetBackup as either basic disk or advanced disk
–Connect via CIFS/NFS/iSCSI
–Appliance is not supported until iSCSI is supported
•Scenario 2b
–Example with Riverbed SteelStore Gateway
–Connect via CIFS/NFS

25. NetBackup and Amazon
25
NetBackup 7.6 and AWS Scenario #2a
Diagram - Scenario #2a

26. NetBackup and Amazon
26
NetBackup 7.6 and AWS Scenario #2b
Diagram - Scenario #2b

27. NetBackup and Amazon
27
NetBackup 7.6 and AWS Scenario #3
•Description:
–Storage Gateways presented as a VTL
–Backend uses S3 and Glacier

28. NetBackup and Amazon
28
NetBackup 7.6 and AWS Scenario #3
Diagram - Scenario #3

29. NetBackup and Amazon
29
NetBackup 7.6 and AWS Scenario #4
•Description:
–Master Server is On-Premise
–Media Server workload in the cloud
–Virtual media server in EC2 with storage
–Configured as a basic disk storage unit or advanced disk storage unit.
–For more information on running NetBackup in a virtualized environment, please refer to: http://www.symantec.com/docs/TECH127089.

30. NetBackup and Amazon
30
NetBackup 7.6 and AWS Scenario #4
Diagram - Scenario #4

31. NetBackup and Amazon
31
NetBackup 7.6 and AWS Scenario #5
•Description:
–Master Server is On-Premise
–Media Servers in Amazon EC2
–No on premise media server
–See the virtualization technote: http://www.symantec.com/docs/TECH127089
–Network Resiliency may need to be enabled

32. NetBackup and Amazon
32
NetBackup 7.6 and AWS Scenario #5
Diagram - Scenario #5

33. NetBackup and Amazon
33
NetBackup 7.6 and AWS Scenario #6
•Description:
–Media Servers in Amazon EC2
–Media Server in EC2 is configured as MSDP
•Uses EBS storage
–No on premise media server
–Network Resiliency may need to be enabled

34. NetBackup and Amazon
34
NetBackup 7.6 and AWS Scenario #6
Diagram - Scenario #6

35. NetBackup and Amazon
35
NetBackup 7.6 and AWS Launching the Cloud Configuration Wizard

36. NetBackup and Amazon
36
NetBackup 7.6 and AWS Launching the Cloud Configuration Wizard

37. NetBackup and Amazon
37
NetBackup 7.6 and AWS Launching the Cloud Configuration Wizard - Encryption
A NetBackup cloud storage server can be created with or without media server-side encryption. By default, encryption is disabled.
The NetBackup cloud storage server type depends on the provider. For Amazon S3 without encryption, the type is amazon_raw.

38. NetBackup and Amazon
38
NetBackup 7.6 and AWS Launching the Cloud Configuration Wizard
If you select the encryption option, the wizard checks whether nbkms is running on the master server.
If nbkms is not running on the master, you are asked for the information required to create a new KMS database.
For Amazon with encryption, the NetBackup cloud storage server type is amazon_crypt.

39. NetBackup and Amazon
39
NetBackup 7.6 and AWS Launching the Cloud Configuration Wizard
Add New Volume creates a new NetBackup volume and corresponding storage space in the provider’s cloud.
Available Capacity is Unlimited.

40. NetBackup and Amazon
40
NetBackup 7.6 and AWS Launching the Cloud Configuration Wizard
Select the cloud volume that was created

41. NetBackup and Amazon
41
NetBackup 7.6 and AWS Creating the disk pool for cloud storage

42. NetBackup and Amazon
42
NetBackup 7.6 and AWS Creating the disk pool for cloud storage - Summary
If the storage server uses encryption, there are KMS details in the summary. If a key group for each selected volume does not exist, then:
•A key group named storageServerName:volumeName is created for each volume.
•A key named volumeName is created with the passphrase provided by the user.

43. NetBackup and Amazon
43
NetBackup 7.6 and AWS Creating a storage unit for cloud storage
Create a storage unit that uses this disk pool now or through the NetBackup Administration Console later.
Specify the cloud storage server explicitly.
Name the new storage unit.

44. NetBackup and Amazon
44
NetBackup 7.6 and AWS NetBackup data layout in amazon cloud storage
NetBackup Image Fragment is stored as a folder under bucket “abc1x”
Explore bucket “abc1x” (which represents NetBackup disk volume)

45. NetBackup and Amazon
45
NetBackup 7.6 and AWS Reports: Data Written/Read to/from Cloud

46. NetBackup and Amazon
46
NetBackup 7.6 and AWS Reports: Job Success Rate

47. NetBackup and Amazon
47
NetBackup 7.6 and AWS Reports: Data expiring in future

48. NetBackup and Amazon
48
NetBackup 7.6 and AWS Reports: Cloud Metering

49. NetBackup and Amazon
49
NetBackup 7.6 and AWS Reports: Average Data Transfer Rate

50. NetBackup and Amazon
50
NetBackup 7.6 and AWS Reports: Cloud Metering Chargeback

51. Q
&
A
51
NetBackup and Amazon

52. Thank you!
Copyright © 2014 Symantec Corporation. All rights reserved. Symantec and the Symantec Logo are trademarks or registered trademarks of Symantec Corporation or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners.
This document is provided for informational purposes only and is not intended as advertising. All warranties relating to the information in this document, either express or implied, are disclaimed to the maximum extent allowed by law. The information in this document is subject to change without notice.
Danilo Santos
danilo_santos@symantec.com
55 11 9 9888-3616