PoINT Software & Systems presents a solution for tape-based object storage compatible with the S3 API. The solution uses erasure coding to store data across multiple tape drives in a library. It can be used for archiving cold data in public clouds, replicating and backing up cloud object storage, and implementing hierarchical storage management policies to tier files from primary to secondary storage on tape. The system provides scalability, high throughput, and protects against data loss through its use of erasure coding and an "air gap" approach enabled by tape.

1. www.point.de
PoINT Software & Systems
© 2019 PoINT Software & Systems GmbH
All rights reserved.
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
Storage-Forum 2019
28. + 29. November, Leipzig
PoINT Software & Systems GmbH
Thomas Thalmann

2. © 2019 PoINT Software & Systems GmbH
All rights reserved.
2
PoINT Software & Systems
www.point.de
Who we are
• Foundation of PoINT Software & Systems GmbH in 1994
• Experienced ISV for data and storage management software
• Software “Made in Germany”
• Global customers from small businesses to large enterprises
• World-wide reseller network and close cooperation with
major storage system vendors

3. 3© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de3
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
?
Storage classes at AWS, Google Cloud, etc.
AWS Google Cloud
S3 Standard Multi-Regional /
Regional
S3 Standard-IA Nearline
S3 Glacier Coldline
S3 Glacier Deep
Archive
"Ice cold archive
storage"
Accessfrequency
PriceperGB
Disk-based?
Tape-based?
Or Optical Media?

4. 4© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de4
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
Microsoft Azure – Archive Storage
Source: www.itwire.com/business-it-news/storage/82332-tape-is-the-new-tape,-says-azure-cto-for-now.html
“After evaluating various technologies
including Blu-ray and magnetic disk,
Microsoft came to the conclusion that
tape was still the way to go for
Azure's archival storage tier”

5. 5© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de5
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
Up to
230 GB/s
throughput
100
billion
objects per
S3 bucket
8
LTO
Libraries
Software Approach
256
LTO
Drives
High
Availability
S3 Object Storage
for Tape
Tape-based
Object
Storage
Scales by
Nodes
Erasure
Coding
for tape
storage
HTTP
Native
S3 API

6. 6© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de6
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
Concept &
Architecture
Client
Network
Tape Library
Administration
Network
System Network
(internal and
private)
IFN1
IFN2
IFN3
IFN4
DBN1
DBN2
DBN3
Client
Client
Client
Tape Library
Interface Nodes (IFN)
• S3 / HTTP service
• EC, hashing, encryption
• Library drives control
• Up to 8 LTO drives
• Multiple active nodes
Database Nodes (DBN)
• Databases and Logs
• HTML admin interface
• Library robotics control
• Up to 4 nodes possible
• Up to 100 billion objects
per S3 bucket
FC / iSCSI
FC / iSCSI
HTTP
HTTP
HTTP
HTTP
Multi Node Configuration

7. 7© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de7
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
• DBN and IFN services on one server
• Easy deployment
• Optional failover
Tape LibraryClient Network
S3 API
IFN & DBN
Drives
Control
Robotics
Control
Concept &
Architecture
Single Node Configuration

8. 8© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de8
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
Terms & Components
Archival Storage Device
• Group of up to 8 LTO tape
loaders or library units
Archival Storage Volume
• LTO medium
Protected Volume Array (PVA)
• 1-4 volumes
• Protected by Erasure Codes
Archival Storage Partition
• Space provided by PVAs
• Expands automatically
Object Repository (Bucket)
S3
PVA PVA
Partition

9. 9© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de9
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
Erasure Coding
e.g. EC(4,3)
S3Application
ObjectStream
S3 PUT
EC
S1
S2
S3
S1
S2
S3
Write Segmentation Encoding Write
Tape
EC
S1
S2
S3
64K Segment Size
{
Write Path
LTO Drives
Read Path
Read
S1
S2
S3
Reassambling
ObjectStream
S3Application
S3 GET
Read

10. 10© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de10
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
Use Cases
Any S3 compatible App
Big Data / Analytics
Object Storage (Tiering/ILM)
Backup of Cloud/Object Data
File Tiering & Archiving (HSM/ILM)
Tape
Tape-based
Object Storage
S3
S3
S3
S3
S3

11. 11© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de11
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
Use Cases
Any S3 compatible App
Big Data / Analytics
Object Storage (Tiering/ILM)
Backup of Cloud/Object Data
File Tiering & Archiving (HSM/ILM)
Tape
Tape-based
Object Storage
S3
S3
S3
S3
S3

12. 12© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de12
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
Use Cases
Any S3 compatible App
Big Data / Analytics
Object Storage (Tiering/ILM)
Backup of Cloud/Object Data
File Tiering & Archiving (HSM/ILM)
Tape
Tape-based
Object Storage
S3
S3
S3
S3
S3

13. 13© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de13
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
Use Cases
Any S3 compatible App
Big Data / Analytics
Object Storage (Tiering/ILM)
Backup of Cloud/Object Data
File Tiering & Archiving (HSM/ILM)
Tape
Tape-based
Object Storage
S3
S3
S3
S3
S3

14. 14© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de14
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
Backup of Cloud/Object Data is
Your Responsibility !

15. 15© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de15
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
RestoreReplicate/Backup
Problem
HA and redundancy do not
protect against:
• Human error
• Ransomware
• Malware
• Technology failure
Solution
Tape-based Object Storage
for Replication/Backup
• S3 API
• Scalable
• Fast throughput
Benefits
• “Air Gap”
• Native format (object to object)
• Cost effective
• Fast restore of large data sets
• Direct access to native object data
Replication & Backup of Cloud/Object Data to Tape
S3
S3
S3
Public/Private Cloud
Tape-based
Object Storage
on-premises

16. 16© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de16
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
Use Cases
Any S3 compatible App
Big Data / Analytics
Object Storage (Tiering/ILM)
Backup of Cloud/Object Data
File Tiering & Archiving (HSM/ILM)
Tape
Tape-based
Object Storage
S3
S3
S3
S3
S3

17. 17© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de17
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
Primary Storage
- NAS Systems (EMC Unity, NetApp FAS, Windows, …)
File Tiering & Archiving
Policy-based archiving
of inactive files from primary to
secondary/archive storage
CIFS / NFS
Off-premises
LAN
Client and application transparency
- Archived files are visible through primary storage
- Multiple options to access archived data
Secondary/Archive Storage
- HDD
- Appliances (CIFS, NFS)
- Object / Cloud (S3)
- Tape (LTO)
- OpticalOn-premises
Tiering/Archiving Software
z.B. PoINT Storage Manager
File Tiering & Archiving (HSM/ILM) to Cloud/Object Storage

18. 18© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de18
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
§ Independent of operating
system
§ HTTP/Internet
§ Search
§ Functionality
§ Versions
§ Search
§ Requires installation
§ Transparent file system
access
§ “Pass through“
§ Previous versions
in snapshots
§ Requires primary storage
support
§ Any NAS system
§ Indirect file system
access
§ HTTP/Internet
§ Looks similar to original
file
§ Reference to original file
§ Dependent of operating
system
Web Links
File System
Stubbing
File System
Stubbing
File System
Web Links
File System
Archiving & Access Methods
Application
Client System
Web Client
Browser
Symbolic Links
File System
Application
Client System
Web Client
Browser
Symbolic Links
File System
Application
Client System

19. 19© 2019 PoINT Software & Systems GmbH
All rights reserved.
www.point.de19
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
Conclusion
• Tape-based S3 Object Storage for
• Long term storage of huge amounts of cold data
• Protection against ransomware, malware, etc. by “Air Gap”
• Replication/backup of cloud/object data
• File Tiering & Archiving (HSM/ILM) for
• Fulfillment of archiving requirements
• Efficient use of primary storage
• Backup optimization

20. © 2019 PoINT Software & Systems GmbH
All rights reserved.
20
PoINT Software & Systems
www.point.de
www.point.de