Hitachi Unified Storage VM (HUS VM) and Hitachi Virtual Storage Platform (VSP) flash technology helps increase performance and decrease total disk quantity and while lowering power, cooling and space costs. Attend this WebTech to learn more about how to optimize Hitachi Unified Storage and Hitachi NAS Platform performance using flash acceleration, SSD storage, and other technologies.
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Optimize Hitachi Storage Performance with Flash
1. Hitachi Unified Storage
and Hitachi NAS
Platform Performance
Optimization with Flash
Acceleration
Nick Jarvis
Director, File, Content and
Cloud Solutions
August 14, 2013
1
2. WEBTECH EDUCATIONAL SERIES
HITACHI UNIFIED STORAGE AND HITACHI NAS PLATFORM
PERFORMANCE OPTIMIZATION WITH FLASH ACCELERATION
Hitachi Unified Storage (HUS) VM and Hitachi Virtual Storage Platform (VSP) flash
technology helps increase performance and decrease total disk quantity while lowering
power, cooling, and space costs. Attend this WebTech to learn more about how to
optimize Hitachi Unified Storage and Hitachi NAS Platform (HNAS) performance using
flash acceleration, SSD storage, and other technologies
By attending this webcast, you’ll learn how to
Increase HUS and HNAS performance by using flash technology
Identify key technologies and products needed to achieve optimum results
Locate and tune key parameters necessary for performance optimization
3. UPCOMING WEBTECHS
Maximize IT WebTechs
‒ Comprehensive and Simplified Management for VMware vSphere
Environments – Now, Even Better!, September 11, 9 a.m. PT, 12 p.m. ET
‒ Easily Deploy Microsoft® Private Cloud and Microsoft SQL Server® 2012 Data
Warehouse on Hitachi Converged Solutions, September 25, 9 a.m. PT, 12 p.m.
ET
Check www.hds.com/webtech for
Links to the recording, the presentation, and Q&A (available next week)
Schedule and registration for upcoming WebTech sessions
Questions will be posted in the HDS Community
-
http://community.hds.com/groups/webtech
4. Hitachi Unified Storage
and Hitachi NAS
Platform Performance
Optimization with Flash
Acceleration
Nick Jarvis
Director, File, Content and
Cloud Solutions
August 14, 2013
4
6. FLASH USE CASES
SUPPORTS APPLICATIONS THAT REQUIRE “RANDOM” WORKLOADS
File Shares
(unstructured)
SQL Server
Database
Analytics Apps
(Unix/Linux)
VMware/VDI
environments
Oracle Database
(Red Hat/OVM)
VMFS
OCFS/GFS
File System
NFS/CIFS
CSV/NTFS
GPFS/GFS
HDFS/JFFS
All of the above applications generate high random read/write IO and require low
latency.
Match use cases to flash implementations to deliver on performance promises at
lowest possible overall system cost
7. WHY ARE RANDOM IOPS
WORKLOADS CRITICAL?
I/O workloads are either random (many concurrent accesses to
relatively small blocks of data) or streaming (sequential data
transfers)
Historically, random access has been associated with
transactional workloads, which often represent an enterprise’s
most critical IT operations
Adoption of “scale-out” architectures with networked storage −
drivers for scale-out include server and desktop virtualization,
database consolidation, complex analytics, and data
warehousing
Even workloads that appear to be sequential from an individual
application’s point of view actually become random as they
interact with other workloads using advanced disk array
capabilities like de-clustered RAID, thin provisioning, and
automatic storage tiering
8. FUNDAMENTAL STORAGE PERFORMANCE
CHANGES AVAILABLE
Yesterday’s High Performance
Today’s High Performance
A single Hitachi Accelerated Flash storage
module can deliver 500X more IOPS than a
single high-performance disk drive
9. A PARADIGM SHIFT IN PERFORMANCE
APPROXIMATE PER-DEVICE PERFORMANCE POTENTIAL
Traditional Disk Drives
Solid State Capacity
Capacity
Drives
Performance
Drives
Commodity
SSD
Hitachi
Accelerated Flash
storage
IOPS
80
200
20,000
100,000
Resp.
Time
6
2
0.2
0.2
(milliseconds)
10. HITACHI INNOVATION: FLASH CAPACITY
HITACHI ACCELERATED FLASH STORAGE
Unique and patented
Hitachi technology
100+ Related
Patents
Granted or
Pending
High-bandwidth, multicore architecture allows
high density and
predictable performance
Industry improvements
regarding
‒ Enterprise durability with
cost-effective capacity
‒ Highest device density
‒ 5X device IOPS to SSD
CPU and Flash Management Engine
Block/Page
Mapping
Wear
Leveling
Data Refresh
Performance
Manager
Contiguous
Block Write
Avoidance
Endurance
Manager
11. FLEXIBILITY FOR APPLICATIONS
Adopting an “ALL-IN-ONE” enterprise storage platform provides
Hitachi flash acceleration
‒
Firmware that has been re-engineered to increase scalability for host I/O processing on
exiting VSP and HUS VM
‒
Can also be implemented without the need of SSD or Hitachi Accelerated Flash; however,
adding either of these will provide performance improvements
Hitachi Accelerated Flash (HAF)
‒ The HDS flash memory controller (HAF) is a multi-core, high-bandwidth architecture that
uses block and page mapping, wear leveling, an endurance manager, and inline write
compression that results in up to 94% write reduction
‒ Hitachi custom designed and built
Hitachi Dynamic Tiering (HDT) hybrid storage
‒
‒
Utilize automated sub-LUN dynamic tiering for pooling storage resources for application
host access
Thin provisioning capability for efficient storage utilization and better performance
Storage virtualization
‒
Virtualize up to 100+ external storage arrays and obtain the benefits of preserving existing
assets, migration, and/or consolidation for management
12. HITACHI INNOVATION: FLASH ACCELERATION
SOFTWARE REENGINEERING TO EXPLOIT FLASH CAPABILITIES
30+ fundamental software changes to
turbo-charge performance with flash
‒ New “express” I/O processing
Hitachi Storage
‒ Higher internal thread count support
‒ Improved wide striping capability
Significant performance impacts
‒ Up to 65% reduction in response time
‒ Up to 2X Hitachi Dynamic Provisioning
(HDP) scalability
Nondisruptive installation and transparent
to current applications
HUS VM and
VSP Optimized
for Flash
Today
13. HITACHI FLASH SOLUTIONS PORTFOLIO
ENTERPRISE
HYBRID ARRAY | INTELLIGENT CACHING | TEIRING
Flash Acceleration Software
Hitachi Accelerated Flash
Hybrid Storage Tiering
Scale
Flash acceleration improves
HDP wide stripping scalability
with hard drives up to 25%
HAF flash enclosure <76.8TB
capacity
SSD <102TB, SAS <1.8PB,
NL-SAS <3.7PB
Performance
HAF flash <1,000,000 random I/O,
<1ms latency with high
consistency
*Flash acceleration 49% to 61%
increased random I/O throughput
Data management and protection
Storage tiering for HAF, SSD, SAS,
NL-SAS (Hitachi Dynamic Tiering)
Management with Hitachi Command
Suite
* Only random performance is improved by flash acceleration; sequential performance is unaffected
14. HITACHI FLASH SOLUTIONS PORTFOLIO
ENTERPRISE | MIDRANGE
HYBRID AND ALL FLASH ARRAY | CACHING | TIERING
Flash Acceleration Software
Hitachi Accelerated Flash
Hybrid Storage Tiering
Scale
Flash acceleration improves HDP wide
stripping scalability with hard drives up
to 25%
HAF flash enclosure <19.2TB capacity
SSD <51TB, SAS <900TB, NL-SAS
<3.4PB
Performance
HAF flash <500,000 random I/O,
<1ms latency with high
consistency
*Flash acceleration 49% to 61%
increase random I/O throughput
Data management and protection
Storage tiering for HAF, SSD, SAS,
NL-SAS (Hitachi Dynamic Tiering)
Management with Hitachi
Command Suite
* Only random performance is improved by flash acceleration. Sequential performance is unaffected.
15. HUS VM ALL FLASH:
NO-COMPROMISE ALL-FLASH STORAGE
500,000
Up to 154TB
IOPS, <1ms
flash storage
response
Unified and
virtualized
capacity
Best storage
optimization
for flash
Best flash
form factor
and
durability
More flexible
than all-flash
systems
Hitachi flash
acceleration
software
Hitachi
Accelerated
Flash
Hitachi
Command
Suite
16. HITACHI VIRTUAL STORAGE PLATFORM:
FLASH-ACCELERATED, ENTERPRISE-READY
ADVANCED VSP FLASH OPTIONS CONTINUE ENTERPRISE LEADERSHIP
Virtualize and flash-enable current
Hitachi and 3rd-party storage
Boost performance of multiple
applications and platforms
(including mainframe)
Economic savings from efficient
data mobility over tiers with
Hitachi Dynamic Tiering and
Tiered Storage Manager
‒ Automate tiering of data
‒ Pin critical workloads in flash
1 Million IOPS
~200K more than EMC 40K
3X Scalability
Without a forced box-swap
17. HITACHI NAS FAMILY COMPARISON
Unified Storage
Dedicated storage
Easy to deploy and manage
Utilize dynamic tiering
File deduplication
HUS 110
HUS 130
HUS 150
HUS VM
HNAS
4060
HNAS
4080-4100
Availability
Symmetric HA
Symmetric HA
Symmetric HA
Symmetric HA
Clustered
Failover
Clustered
Failover
Number of Nodes
1 to 4
1 to 4
1 to 4
1 to 4
1 to 2
1 to 4
Connectivity
NFS,
SMB,
iSCSI,
Fibre Channel
NFS,
SMB,
iSCSI,
Fibre Channel
NFS,
SMB,
iSCSI,
Fibre Channel
NFS,
SMB,
iSCSI,
Fibre Channel
NFS,
SMB,
iSCSI,
Fibre Channel
NFS,
SMB,
iSCSI,
Fibre Channel
Storage
HUS 110
HUS 130
HUS 150
HUS VM
AMS and/or
VSP
AMS and/or
VSP
Maximum IP storage
capacity
360TB raw
756TB raw
2.88PB raw
3.4PB raw
8PB usable
16PB usable
FM = File Module
18. HNAS – STANDARD FILE SYSTEM
File
System
Meta Data
SAS
User Data
Traditional file system approach
Mixed IO on the same media
All or nothing footprint
One type of disk for all types of I/O
19. Optimized
File
System
HNAS – TIERED FILE SYSTEM
Meta Data
FLASH/
SSD / SAS
User Data
SAS/NL
-SAS
Optimized file system
approach
Mixed IO placed on most
effective and cost effective
storage platform
Best TCO for workflow
performance
Provides cost efficiency with equal performance by
using fewer or lower cost disks
Can be deployed with or without SSD drives
New installation with no degradation in I/O performance
Performance benefits depend on application
Improved spindle efficiency (achieve performance target with less storage)
Metadata intensive operation (e.g. backup, replication or data migration)
Large Files (VMware, Oracle, etc..)
20. Cluster
Wide Read
Cache
HNAS – CLUSTER READ CACHING
Cluster wide read cache
Read Caches
Enabled
4 x Bandwidth
Accelerate read intensive I/O
at scale
Cluster wide
FLASH/SSD/
SAS
NFS v3 environments
Read Caching
Copy1
Meta Data
User Data
Copy2
Copy3
Slow
Copy
Copy4
21. HNAS – LEVERAGING HDT FLASH
Optimized back-end storage
‒
Driven by HUS, HUS-VM and/or
VSP
‒
Economic savings from efficient
data mobility over tiers with Hitachi
Dynamic Tiering, Tiered Storage
Manager
‒
Automate tiering of data
‒
Pin critical workloads in flash
FLASH/SSD
HDT
User Data
TIER 1 DISK
TIER 2 DISK
22. FLASH + VIRTUALIZATION AT TURKCELL
3rd-largest GSM operator in Europe; 34.7 million subscribers
25. UPCOMING WEBTECHS
Maximize IT WebTechs
‒ Comprehensive and Simplified Management for VMware vSphere
Environments – Now, Even Better!, September 11, 9 a.m. PT, 12 p.m. ET
‒ Easily Deploy Microsoft® Private Cloud and Microsoft SQL Server® 2012 Data
Warehouse on Hitachi Converged Solutions, September 25, 9 a.m. PT, 12 p.m.
ET
Check www.hds.com/webtech for
Links to the recording, the presentation, and Q&A (available next week)
Schedule and registration for upcoming WebTech sessions
Questions will be posted in the HDS Community
-
http://community.hds.com/groups/webtech
Several system and application drivers are increasing the demand for high-performance storage solutions going forward
VMware – VMFS file system (Server consolidation + VDI)VMFS on block storage requires large amounts of random IOPSVMFS and customers can have higher density of VM’s per datastore thus reducing disk wastage.Customers can leverage vSphere 5 features like SDRS for tiered storage datastores for movement of VM’s between (tiers) using vmotionCustomers can leverage all vStorage API’s that are currently supported on the VSP i.e. VAAI, VASA, SRM & MPPRed Hat (OLTP workloads) – GFS / OCFS file systemsOLTP workloads demand high read/write IO with low latencyFor an I/O constrained OLTP database, many companies add HDDs to separate the database across many drives to alleviate the I/O bottleneck.Adding more HDD for just IOPS and not for increase disk capacity increases cost.IBM - GPFS file system (Analytics + Data Mining etc)Customers use GPFS to do low latency analytics, high-speed back up and recovery, high-speed file ingest, and optimize data workflow, enabling faster business process performance. Flexibility to support a wide variety of platforms - Linux, AIX, Windows
And the reasons are clear. The spinning disk performance of yesterday has been leapfrogged by the flash storage performance of today. In fact, on a device-by-device basis, a single Hitachi Accelerated Flash storage module that we deploy in our storage systems is capable of about 500 times more operations per second than what we once called a ‘high performance’ disk drive.
This chart demonstrates the per-device expectations of common storage media, and shows how significant the technological leap is to a Hitachi Accelerated Flash storage module. Any SSD leaps over the performance bar set by spinning disk drives, but Hitachi Accelerated Flash soars further ahead providing 5X more IOPS than an industry-standard SSD at similarly astounding response times. All this is done while offering significantly more capacity per device and the advanced memory management expected in such a robust Hitachi design.
One of those key innovation areas is now available to users in what we call Hitachi Accelerated Flash (HAF) storage, and our own flash storage memory controller that we internally called “Ashigara” and the unique packaging that it offered us. With over 80 patents either granted or pending for flash around the designs for this purpose built flash storage, it enables us a leadership position in flash.Built from the ground up to enable cost-effective, high-performance and high-density deployments of flash storage in enterprise data center environments, our Accelerated Flash storage raised the bar high above the capabilities of industry-standard SSDs that are the norm in the industry.The ability for Hitachi Accelerated Flash to manage more flash per controller, provide high-bandwidth performance and run advanced wear-leveling and diagnostics means our customers get the flash capacity and performance they need, without sacrificing reliability.
But Hitachi flash innovation extends well past our Flash controller and up into our HUS VM and VSP systems. While the SPC performance numbers that Silverton Consulting mentioned earlier in the presentation already demonstrated the high performance of our HUS systems, the architectures of the VSP and HUS VM allow for even greater performance scalability and customization.For years, storage systems were built with the idea that the performance was held back by spinning disk drives, and system software was optimized to make the most out of that situation. With flash, vendors are rushing to re-architect key parts of their onboard system code to more quickly move data around the inside of storage systems to keep up with the high performance of Flash. Hitachi, however, isn’t scrambling to deliver this customization. We already have.VSP optimization was delivered in 2012 and HUS VM will be delivered in June 2013. The system code for these arrays see significant flash-focused re-engineering, with over 30 fundamental changes to the code to enable higher thread-count processing and faster movement of data. Response times improve significantly and provisioning and functions become twice as useful.Of course, in staying with Hitachi’s focus on high-availability, these changes are non-disruptively installed and become transparent to other installed storage replication or management tools.
A layer above the infrastructure, sits a family of offerings aimed to provide intelligent access to business content and information. These software-based products provide management, protection, archiving and searching of your files, objects and information across the complete lifecycle.
A layer above the infrastructure, sits a family of offerings aimed to provide intelligent access to business content and information. These software-based products provide management, protection, archiving and searching of your files, objects and information across the complete lifecycle.
Such high performance optimizations allow us to produce no-compromise all-flash storage performance in our HUS VM, which competes with any all flash array for high performance with sub-millisecond response time to 500,000+ IOPS, but still brings all the functionality, availability and flexibility benefits of a non-Flash HUS VM. All of this happens with no changes to the serviceability and manageability of the systems. Hitachi Command Suite manages the system and the Dynamic Provisioning, Thin Image and the full suite of Hitachi replication tools can be leveraged as required.What if you decide that you want to add tiering and cost-effective hard drive capacity? HUS VM can be upgraded to a tiered storage system.Want a unified SAN/NAS system? No problem.
Our king of the hill is our multi-controller, massively scalable and rock-solid VSP. It has already proven 1M+ IOPS and the ability to handle multi-platform loads including the mainframe. The optimized code for VSP helped grow the performance scalability multiple times ahead of where the product was first launched delivering significant value to our customers.Many VSP customers are deploying Flash and tiering to scale the performance of their applications without having to completely re-architect their environments. Advanced management tools enable tiering but still provide a level of control to manage quality of service across applications by defining how much cache applications can utilize and even to “pin” critical data in flash.The other leading argument for tiering is an economic one.
Real customers are getting theefficiency of tiered flash storage today. Turkcell, a large GSM operator in Europe, is one such example and this is really a great case study that you could spend some timewith, seeing how the power of storage virtualization really can change an IT transformation. Turkcell leveraged flash and tiering to keep mainframe performance high, while vastly shrinking the amount of disk drives and racks deployed in their infrastructure.
Several system and application drivers are increasing the demand for high-performance storage solutions going forward