Scalability and Availability - Without Compromise
•
0 j'aime•1,077 vues
Hitachi Data Systems (HDS) presentation in Intel booth at Supercomputing 2012 (SC12) by Bjorn Andersson
Recommandé
Recommandé
Contenu connexe
Tendances
Tendances (18)
En vedette
En vedette (12)
Similaire à Scalability and Availability - Without Compromise
Similaire à Scalability and Availability - Without Compromise (20)
Dernier
Dernier (20)
Scalability and Availability - Without Compromise
- 1. SCALABILITY AND AVAILABILITY - WITHOUT COMPROMISE BJORN ANDERSSON, HITACHI DATA SYSTEMS SUPERCOMPUTING 2012, SALT LAKE CITY 1
- 2. SCALABILITY AND AVAILABILITY - THE CHALLENGES SCALABILITY AND AVAILABILITY – OPPOSING FORCES? Scale-up and Scale-out ‒ Different applications require different approaches Going beyond physics of single system or small cluster… ‒ More complexity (hundreds to many thousands of parts) ‒ More vulnerability (things break, bad things happen) You need to architect for it from the start ‒ Higher quality sub systems for higher reliability ‒ Design for resiliency and high availability ‒ Use the right technology in the right place ‒ How does a technology refresh impact availability? Copyright Hitachi Data Systems, 2012
- 3. HOW DO YOU MANAGE THIS? Common Subsystems ‒ Easy as long as each subsystem behave the same ‒ But, locks you in with a set of technologies or vendors Virtualization ‒ Removes dependencies and enable high availability ‒ Trade-off based on value of availability Applications Applications … Applications … Virtualization layer OS & SW Services OS & SW Services OS & SW Services … Virtualization and Aggregation layer Network Network Network … Virtualization and Aggregation layer Storage Storage Storage … Virtualization and Aggregation layer CPU CPU CPU SCALE and TECHNOLOGY SHIFTS SCALE Copyright Hitachi Data Systems, 2012
- 4. BIG DATA IS ESCALATING THE NEED FOR CONCURRENT SCALABILITY AND AVAILABILITY ALL DATA TYPES MACHINE DRIVEN HUMAN DRIVEN SATELLITE IMAGES EMAIL BUSINESS DRIVEN SENSORS DATA BIG DATA BIG DATA DOCUMENTS LANDSCAPE TODAY TOMORROW BIO- EVOLUTION INFORMATICS OLTP WEB LOGS M2M LOG FILES SOCIAL VIDEO AUDIO 1X 10X 100X COMPANIES MUST MANAGE, GOVERN AND ANALYZE MORE DATA WITH MORE COMPLEX RELATIONSHIPS…IN REAL TIME…AT SCALE Copyright Hitachi Data Systems, 2012
- 5. WHO IS HITACHI? HITACHI, LTD. – ORGANIZATION ELEVEN INDUSTRY SEGMENTS GROUP REVENUE BY INDUSTRY SEGMENT Others Information and Telecommunication Systems Financial Services 7% 4％ 9% 17％ Digital Media and 8% Power Consumer 8% 7% $112B 11％ Systems Products 13% 9％ 7% Social Infrastructure Component and Industrial and Devices Systems Automotive Electronic Systems Systems and Equipment High-Functional Construction Materials and Machinery Components Copyright Hitachi Data Systems, 2012
- 6. HITACHI ENTERPRISE CLASS HERITAGE A 50+ YEAR HERITAGE OF LEADERSHIP IN THE ENTERPRISE CLASS COMPUTE MARKET. R&D innovation and leadership ‒ A big user of HPC ‒ Key HPC player in Japan, expanding globally Quality and Reliability Service and Support (*1957: HIPAC-MK1 – Hitachi’s first digital computer) Copyright Hitachi Data Systems, 2012
- 7. OUR PORTFOLIO IS YOUR FOUNDATION DELIVERY DATA CENTER | CLOUD MANAGEMENT SOFTWARE INTELLIGENT File and content storage ACCESS Indexing and search FILE | CONTENT | SEARCH Intelligent object management FOUNDATION Integrated components CONVERGED include Hitachi servers INFRASTRUCTURE Fast time to value STORAGE | COMPUTE | NETWORK Predictable, reliable results STORAGE Reliability and performance INFRASTRUCTURE Sustainability ENTERPRISE | MIDRANGE Superior economics Copyright Hitachi Data Systems, 2012
- 8. INTEGRATED SCALABLE STORAGE PORTFOLIO SPECIALIZED APPLIANCES HDI HDI SINGLE HDI DUAL SOFTWARE CONTENT PLATFORM HCP 300 HCP 500 COMMAND SUITE FILE-ONLY PLATFORMS HNAS 3080 HNAS 3090 HNAS 3200 UNIFIED PLATFORMS HUS 110 HUS 130 HUS 150 HUS VM BLOCK-ONLY HUS 130 VSP PLATFORMS HUS 110 HUS 150 HUS VM Copyright Hitachi Data Systems, 2012
- 9. INTEGRATED SCALABLE PORTFOLIO UNIFIED MANAGEMENT ACROSS ALL STORAGE SYSTEMS Hitachi Unified Hitachi Unified Hitachi Virtual Storage 100 Storage VM Storage Platform Midrange Entry-Level Enterprise Enterprise Copyright Hitachi Data Systems, 2012
- 10. THE NEXT GENERATION OF UNIFIED STORAGE HITACHI UNIFIED STORAGE VM No more compromises HIGHEST PERFORMANCE High performance for wide range of demanding applications LOWEST High, dynamic scalability with OPERATING COST multiple storage technologies Enterprise class high availability c HIGHEST SCALABILITY Tiering and virtualization for both block and file based storage MOST EFFICIENT Simplified operation and easy migration EASIEST Best functionality for the best MIGRATION value Copyright Hitachi Data Systems, 2012
- 11. HARDWARE-ACCELERATED FILE SERVER DELIVERS THE HIGHEST IOPS AND MOST SCALABILITY Hardware File Line Rate Speed System IOPS Performance Advantage Software File System Number of Clients or Features Linear IOPS performance increases with hardware- accelerated file system per node Highest-capacity scalability, with up to 16PB in a single NFS namespace Benefits: Fewer file server nodes, more users, simpler management Copyright Hitachi Data Systems, 2012
- 12. HITACHI COMPUTE PORTFOLIO High availability, performance and HIGH-END scalability for the enterprise BLADE Optimized for virtualization, maximizing utilization in the data center CB 2000 CB 500 Highly dense chassis design optimized MIDRANGE for virtualization and consolidation BLADES Compact and flexible with a variety of CB 320 blade and connectivity options Compact and flexible application RACK-OPTIMI server platform ZED Available in Hitachi file and content CR 220 solutions Copyright Hitachi Data Systems, 2012
- 13. HITACHI COMPUTE: HIGH END BLADES Innovative blade design offers HITACHI COMPUTE BLADE 2000 performance & scalability “Hybrid” I/O design supports a diverse range of application workloads Hardware based LPAR logical partitioning maximizes utilization and efficiency without compromising security or performance Multi-blade SMP feature allows a system image to scale beyond a single blade (up to four blades) for application headroom and investment protection Copyright Hitachi Data Systems, 2012
- 14. HITACHI COMPUTE: MIDRANGE BLADES New Midrange Blade Chassis HITACHI COMPUTE BLADE 500 6 RU Height 8 Standard Blades, or 4 Double-wide Blades ‒ Blade types may be mixed Compute density between CB 2000 and CB 320 Introduces new technologies: ‒ New Intel Processor Architecture ‒ 10GigE native ports, CNA cards Virtualization and RAS features Customer Replaceable Units (CRUs) Copyright Hitachi Data Systems, 2012
- 15. UNIFIED COMPUTE PLATFORM FAMILY PORTFOLIO Hitachi Hitachi UCP Pro UCP Select Hypervisor Server Network Storage Copyright Hitachi Data Systems, 2012
- 16. HITACHI DATA SYSTEMS HIGH-THROUGHPUT STORAGE SOLUTION WITH LUSTRE SINGLE-RACK CONFIGURATION SOLUTION FRAMEWORK 1RU x86 Rack Server (Running Intel Chroma and Hitachi Command Suite) Second High-Availability Object Network Switch Storage Server (OSS) Pair MDS BUILDING BLOCK 1RU x86 1RU x86 Rack Server Rack Server Management and Network HUS 110 High-Availability Metadata (Internal Disk) Server (MDS) Cluster OSS BUILDING BLOCK First High-Availability Object 2RU x86 2RU x86 Rack Server Rack Server Storage Server (OSS) Pair HUS 150 5RU 5RU 84-Disk Tray 84-Disk Tray 12GB/sec target performance, 720TB usable capacity (1PB raw) Copyright Hitachi Data Systems, 2012
- 17. HDS HIGH-THROUGHPUT SOLUTION WITH LUSTRE COMPLEMENTS HNAS FOR THE MOST CAPABLE FILE STORAGE OFFERING Combines HDS high availability with Lustre scalability Easy design and deployment with pre-architected building blocks Simplified management with included management tools Streamlined vendor management with single infrastructure vendor Global presence and support Hitachi NAS Platform, powered by HDS High-Throughput BlueArc® (HNAS) High-Performance NAS Solution with Lustre Scalability Functionality Copyright Hitachi Data Systems, 2012
- 18. THANK YOU! bjorn.andersson@hds.com See us also in booth #1331 Copyright Hitachi Data Systems, 2012
Notes de l'éditeur
- Hello, I’m Bjorn Andersson with Hitachi Data SystemsThank you Intel for inviting me, we have a great partnerships where we use Intel technology in many of our products and solutions, storage and serversMy talk today will primarily focus on Production HPC environmentsWe typically sell to customers who care about uptime and availability as well as scalability. They are often commercial enterprises or a larger user community depends on their services being availableI only have limited time today so I can only give you a glimpse into what we’re doing, I invite you to discuss with me afterwards or visit our booth for a deeper discussion
- The title of my talk is about Scalability and Availability – which if you think about it may seem like a challenge/contradictionTwo options for scaling, bigger more capable building blocks or many of lesser building blocksWe have hardware accelerated NAS systems and large memory blade systems with 1.5TB, so we can do scale-up alsoAt some point you have to go beyond the capabilities of a single system or small cluster though and then you’re definitely into scale-outScale-out can potentially mean more complexity and with that more vulnerabilityArchitect for scalability with availability (and manageability) from the startLook at your applications and use the right technologyPlan forward for technology refreshesWe have a broad portfolio, including systems we sell to banks and other environments where high availability is a must
- Life ismore complexNeed to virtualizeData or services unavailable = zero performanceProduction environments how much do you value availability?This is the kind of thinking that is driving us to provide highly available solutions that also scales very well
- Another are that is putting even more emphasis on the issue of scalability and availability is big data.Again, we’re looking at production environmentsWe see it evolving in phases where we move from data generated, stored and processed in business systems to data generated by humans and more and more by machines or sensors and this is where the real data volumes are coming in and need to be analyzed.Hitachi is a very broad organization and we’re both a user, a generator and solution provider in this space
- Hitachi’s fiscal year runs from April to March.Total FY10 revenue: $112B (17% Y/Y growth)20% of overall R&D investment is in Information Systems and Telecommunications segmentsFY09: $96BFY08: $102BFY07: $112.2B FY06: $87BAny investment made in information technology, whether it’s networking, telecommunications, enterprise servers, super computers, storage systems, other storage solutions, etc., Hitachi Data Systems utilizes cross-pollination to reap the benefits of that investment and leverages it for the development of other products.Taking a look now at the composition of Hitachi, Ltd’s business and the vertical markets it competes in. Hitachi, Ltd. has 11 distinct business segments, which comprise the over 20,000-strong product portfolio. Comprising about 17% of total sales for last fiscal year is the Information Systems and Telecommunications Group. This is the most strategic business segment for Hitachi, and many times, the most profitable as well. This comprises storage systems, storage consulting services, super computers, telecommunications equipment, gigabit Ethernet routers, SONET switches, enterprise blade servers, which are now being sold in North America, Korea, as well as Japan and other geographies. Basically, all information systems in telecommunications, IT and networking all unified in one group spanning servers, networking and storage. Powerful unification amongst these three facilitates great cross-pollination efforts. NOTE: HGST is included in Component & Devices segment, not Information & Telecommunication Systems.Power Industrial Systems and Social Infrastructure & Industrial Systems are very profitable business segment for Hitachi, Ltd. This comprises everything ranging from Shinkansen Bullet Trains (the trains in Tokyo and other regions of the world that can go in excess of 150 to 160 miles-per-hour), thermonuclear fusion reactors; heavy earth-moving equipment; various turbines that are being made in conjunction with General Electric; and so forth. If your customer is interested in earth moving equipment, Hitachi produces bulldozers and cranes and other earth-moving equipments. (Note Caterpillar competes with Hitachi).There is also the financial services business segment comprised of various capital and leasing corporations, within Hitachi Ltd., which constitutes about 4% of overall total sales. The Electronic Systems and Equipment segment covers primarily semiconductor manufacturing equipment contributed to 9% of overall revenues. Hitachi, Ltd. has its own semiconductor fabrication operation which provides a distinct advantage over competitors. While many competitors rely upon third-parties for semiconductor chip manufacturing, we have our own fabrication plants, which gives us a powerful story from a vertical integration perspective.High Functional Materials & Components and Automotive Systems are a rather interesting group with tremendous industry expertise not many people are aware of. For one, Hitachi, Ltd. is a key supplier to automotive companies such as Honda, Toyota, Mazda, and General Motors. Case in point, Toyota recently turned to Hitachi, Ltd. for hybrid motors for its Lexus RX 400H hybrid.The turbo chargers in the Mazda Miata; the hoses and rubber materials in many of the Nissan cars leverage manufacturing innovations from Hitachi, Ltd. Another example, Hitachi, Ltd. owns a subsidiary called the Xanavi (Spelled x-a-n-a-v-i) which is a leading provider of navigation systems for automobiles. In fact, if you go to your local Infinity or Nissan dealer, all the navigation systems in those vehicles are from Xanavi, owned by Hitachi.
- In 1957 Hitachi developed it’s first digital computer HIPAC-MK-1In 1964 – The same year IBM announced the S/360 - Hitachi introduced the HITAC 5020 – The first large general purpose computer in JapanHITAC 8000 followed in 1965, with HITAC 8100 for small business.1967 HITAC 8210 – First medium scale general purpose compute using integrated circuits1979 – M200 – World’s fastest large general purpose computerSource: IPSJ Computer Museum: http://museum.ipsj.or.jp/en/computer/main/index.html
- We have a broad portfolio addressing both traditional data center environments and functionality that we put under the Cloud umbrella, Infrastructure cloud, content cloud, information cloudA layer above the infrastructure, sits a family of offerings aimed to provide intelligent access to business content and information. These software-based products provide management, protection, archiving and searching of your files, objects and information across the complete lifecycle.
- As well look at the HDS portfolio, The new HUS products will be establishing a new category of unified storage. We will continue to sell our AMS2000 and VSP as our midrange and enterprise block storage offerings. Over time, the block only configurations of HUS will replace the AMS2000. The HNAS product line will continue to be our file only line. Dedicated content storage can be delivered by HCP. This is a very good solution for cloud infrastructure and/or archiving. HDI is our data ingestor that is capable of moving data from the edge to the core where it can be better protected.By the 2nd half of 2012, all of these platforms will be managed by Command Suite. 7 years ago Hitachi announced a vision of a common management platform that will enable one platform for all data. The administrative efficiencies of this approach provides a lot of cost savings to our customers.
- Within our integrated, scalable storage portfolio, this new platform fills the gap between enterprise and midrangeIt will be positioned as a new, entry level enterprise storage platformIt is a unified extension to our new family of HUS products and bridges the gap to our VSP enterprise systemIt is complemented by the rest of the portfolio of NAS, HCP, HDIAnd unified management across the line creating a comprehensive architecture for all data
- To summarize what HUS VM gives our customersThe bottom line is that with HUS VM they don't need to compromise between functionality and performance. They get higher performance than the HUS 100 family and competitors. They get entry level enterprise class features for their technical apps, which is what they want. They get the flexibility of virtualizing and tiering on both the file and block level. They get high scalability to support the data growth and in addition they get the unified management across that will save them on operational costs.
- Hardware accelerated file system functionsNo performance drop off during peak load timesBoth IOPS and throughput with standard file systems like NFSHighly efficient
- Overview, from rackmount to high end blades, using Intel arhcitecture