Recommandé
Recommandé
Contenu connexe
Tendances
Tendances (20)
Similaire à Cw13 cloud meets big data by ibrahim alloub-emc
Similaire à Cw13 cloud meets big data by ibrahim alloub-emc (20)
Plus de inevitablecloud
Plus de inevitablecloud (9)
Dernier
Dernier (20)
Cw13 cloud meets big data by ibrahim alloub-emc
- 1. 1© Copyright 2013 EMC Corporation. All rights reserved. CLOUD MEETS BIG DATA An EMC Overview
- 2. 2© Copyright 2013 EMC Corporation. All rights reserved. Partners Services and Consulting Full range of complementary services; examples: Accenture, BearingPoint, and CSC Global Alliance Jointly define, test, integrate, deliver, and support; examples: Microsoft, Oracle, SAP, Lenovo and Cisco Service Providers Access to innovative, scalable infrastructure services; examples: Fujitsu Services, Bull, Dimension Data Channels Specialized expertise to build unique solutions; examples: Fujitsu Siemens, Unisys EMC Overview EMC at a Glance • Founded: 1979 • Revenues (2012): $21.7B • Fortune 500 Rank (2012): 139 • Employees: ≈ 60,000 • Countries with EMC operations: > 85 • R&D investment (2012): ≈ $2.6B • Total cash and investments (2012): $11.4B • Market capitalization: ~$52B Recognized Leadership • #1 external storage • #1 external RAID • #1 networked storage • #1 NAS • #1 total storage software • #1 storage management software • #1 device management software EMC is a global leader in enabling businesses and service providers to transform their operations and deliver Information Technology as a service. Fundamental to this transformation is cloud computing. Through innovative products and services, EMC accelerates the journey to cloud computing, helping IT departments to store, manage, protect and analyze their most valuable asset — information — in a more agile, trusted and cost-efficient way.
- 3. 3© Copyright 2013 EMC Corporation. All rights reserved. And Along The Way We Have… 60000 RETAINED / ATTRACTED TALENTED AND DEDICATED PEOPLE DELIVERED VALUE TO OVER 200000 ORGANIZATIONS
- 4. 4© Copyright 2013 EMC Corporation. All rights reserved. Research & Development Dual Innovation Strategy Technology Acquisitions 12% Investment 10% Investment
- 5. 5© Copyright 2013 EMC Corporation. All rights reserved. Disruptive / Opportunistic IT Trends Mobile Cloud Big Data Social T R U S T
- 6. 6© Copyright 2013 EMC Corporation. All rights reserved. Mobile Cloud Big Data Social T R U S T Our Sweet Spot!
- 7. 7© Copyright 2013 EMC Corporation. All rights reserved. Two Fundamental Challenges Lower Operational Costs Increase Revenue 63% MAINTAIN 37% INVEST ESG, 2012 IT Spending Intentions Survey, Jan 2012
- 8. 8© Copyright 2013 EMC Corporation. All rights reserved. CLOUD TRANSFORMS IT Lower Operational & Capital Expenditure
- 9. 9© Copyright 2013 EMC Corporation. All rights reserved. Agility Is the #1 Private Cloud Driver ―The majority see agility and speed as the primary benefits of private cloud computing.‖ GARTNER Source: “The Drivers And Challenges Of Private Cloud Computing”, March 2011, Gartner 55% Agility 12% Other 24% Cost 9% Business Alignment
- 10. 10© Copyright 2013 EMC Corporation. All rights reserved. Cloud Transforms IT Infrastructure Automate3Standardize1 Virtualize2
- 11. 11© Copyright 2013 EMC Corporation. All rights reserved. Capabilities and Requirements http://csrc.nist.gov/publications/drafts/800-145/Draft-SP-800-145_cloud-definition.pdf Rapid Elasticity Measured Service Broad Network Access Resource Pooling (Multi- Tenancy) On-Demand Self-Service NIST Definition of Cloud Computing
- 12. 12© Copyright 2013 EMC Corporation. All rights reserved. Cloud Computing models* Public Cloud - general public or a large industry group. Owned by an organization selling cloud services Community Cloud - shared by several organizations and supports a specific community that has shared concerns Virtual Private Cloud = Internal Data Center + External Service Provider Hybrid Cloud – Two or more type of clouds (private, community, or public) http://csrc.nist.gov/publications/drafts/800-145/Draft-SP-800-145_cloud-definition.pdf
- 13. 13© Copyright 2013 EMC Corporation. All rights reserved. Cloud. • Software as a Service (SaaS) Office 365, Google Suite, DropBox • Platform as a Service (PaaS) Azure, Google App Engine • Infrastructure as a Service (IaaS) Webhosting, Amazon EC2/S3 • Desktop as a Service (DaaS) VMware View, Citrix XenApp • Gaming as a Service (GaaS) Onlive, Playcast, OTOY XaaS
- 14. 14© Copyright 2013 EMC Corporation. All rights reserved. BIG DATA TRANSFORMS BUSINESS Increase Revenue
- 15. 15© Copyright 2013 EMC Corporation. All rights reserved. Data Sources Are Expanding GROW 50X IN THE NEXT 10 YEARS INFORMATION IN THE ENTERPRISE WILL Source : 2011 IDC Digital Universe Study
- 16. 16© Copyright 2013 EMC Corporation. All rights reserved. Massive Numbers of Massive Files Source : 2011 IDC Digital Universe Study, EMC Customers Big Data Applications Files In The Digital Universe 500 Quadrillion 5+ TB
- 17. 17© Copyright 2013 EMC Corporation. All rights reserved. Big Data Applications Structured Data Hybrid Cloud Telco Billing Retail POSSocial Media Clickstream Productivity Semi-Structured Data Gene Sequencing Unstructured Data Movie Editing Seismic Study Web ContentStorage Services Sales Forecast Social Media Clickstream Productivity
- 18. 18© Copyright 2013 EMC Corporation. All rights reserved. IN THE WORLD OF CLOUD AND BIG DATA TRUSTIS ESSENTIAL
- 19. 19© Copyright 2013 EMC Corporation. All rights reserved. INTRUSION TRADITIONAL THREATS FOCUSED ON PREVENTION TRADITIONAL SECURITY FOCUSED ON The Old World Of Security
- 20. 20© Copyright 2013 EMC Corporation. All rights reserved. Advanced Security Is Different. Prevention 80% Monitoring 15% Response 5% Historical Security Investment Prevention 33% Monitoring 33% Response 33% Future Security Investment Shift In Focus. Shift In Spend.
- 21. 21© Copyright 2013 EMC Corporation. All rights reserved. Trusted IT Means Ensuring Availability Of Applications, Systems & Data Identifying & Repelling Threats Protecting Data Continuous Availability Integrated Backup & Recovery Advanced Security
- 22. 23© Copyright 2013 EMC Corporation. All rights reserved. Our Comprehensive Portfolio Backup And Archiving Speed, Deduplication, VMware Integration Virtual Desktop Infrastructure: End-User Choice with IT Control Isilon AtmosVNX VMAX Data Domain, Avamar, NetWorker Ionix VPLEX vShield vCloud Director Greenplum Cloud FoundryvSphere vFabric Cloud FoundryvSphere vFabric Enterprise Applications Big Data Applications
- 23. 24© Copyright 2013 EMC Corporation. All rights reserved.© Copyright 2012 EMC Corporation. All rights reserved. Data Storage Backup & Recovery Enterprise content managemen t & Archiving Virtualizatio n Information Security Cloud Computing Governance Risk & compliance Data Analytics Big Data • Hardware • Software • Services
- 24. 25© Copyright 2013 EMC Corporation. All rights reserved. Virtualization & Cloud – CIO Top Priorities Source: Barclays CIO Survey, October 2012 Projected Customer Spending 2013
- 25. 26© Copyright 2013 EMC Corporation. All rights reserved. Challenges Faced by IT & Storage Managers Managing growth and the IT transformation Rank Challenge 1 Managing storage growth 2 Storage consolidation 3 Designing, deploying, and managing Backup, Recovery, and Archive solutions 4 Designing, deploying, and managing disaster recovery solutions 5 Making informed strategic/big-picture decisions 6 Designing, deploying, and managing storage in a virtualized server environment 7 Lack of skilled storage professionals 8 Designing, deploying, and managing storage in Cloud computing environments 9 Lack of skilled cloud technology professionals 10 Convincing upper management to adopt Cloud Source: Managing Information Storage: Trends, Challenges and Options 2012-2013
- 26. 27© Copyright 2013 EMC Corporation. All rights reserved. Job Growth, Talent Gap 0 0 3009 2001 826 3891 788 1272 366 226 1257 267 364 1433 238 0 1000 2000 3000 4000 5000 6000 Cloud Administrators Cloud Architects Data Scientists BR Administrators BC Administrators Storage Architects Storage Administrators Storage Managers Current Planned New New New +30.2% +36.8% +44.1% +13.3% +41.8% Plans to grow 34.6% Y/Y Source: Managing Information Storage: Trends, Challenges and Options 2012-2013
- 27. 28© Copyright 2013 EMC Corporation. All rights reserved. IT Job Needs ―By 2018...the United States alone faces a shortage of 140,000 to 190,000 people with analytical expertise and 1.5 million managers and analysts with the skills to understand and make decisions based on the analysis of big data.‖ ―In 2012, more than 1.7 million jobs related to cloud computing were remained unfilled worldwide. The reason for this is lack of training and certification.‖ ―In an August 2012 interview, Dr. Alicia Abella, Executive Director of the Innovative Services Research Department at AT&T Labs summed up the issue stating, We‘re going to need 800,000 more [U.S.] jobs by 2018 in computer technology alone. In the last three years we‘ve only graduated 24,000 in those sectors and that‘s not nearly enough.‖
- 28. 29© Copyright 2013 EMC Corporation. All rights reserved. EMC ACADEMIC ALLIANCE Educating Future IT Professionals http://education.EMC.com/AcademicAlliance
- 29. 30© Copyright 2013 EMC Corporation. All rights reserved. EMC Academic Alliance • Partners with colleges and universities to prepare students for roles in virtualization and cloud computing • Provides unique ‗open‘ courseware at no cost • Program resources – Free faculty readiness training – Instructor materials – Online faculty and student communities – Discount certification exam vouchers Provides students with competitive edge
- 30. 31© Copyright 2013 EMC Corporation. All rights reserved. Information Storage and Management Introduction to Information Storage Data Center Environment Data Protection: RAID Intelligent Storage System Storage Networking Technologies Introduction to Business Continuity, Backup and Archive Local and Remote Replication Cloud Computing Securing and Managing the Storage Infrastructure Cloud Infrastructure and Services Journey to Cloud Computing Overview of Classic Data Center Environment (Server, Storage, Network Virtualization (Compute, Storage, Network, App, Desktop) Backup Recovery and BC in a Virtualized Environment Cloud Security Cloud Infrastructure and Management Migration to Cloud Data Science and Big Data Analytics Introduction to Big Data Analytics Overview of Data Analytics Lifecycle Using R for Initial Analysis of the Data Adv Analytics and Statistical Modeling : Theory and Methods Adv Analytics and Statistical Modeling : Technology and Tools Concluding and Operationalizing, Analytics Project Big Data Analytics Lifecycle Lab Backup Recovery Systems and Architecture Backup Theory Information Storage Concepts Backup Client Backup Storage Node Backup and Recovery, Planning
- 31. 32© Copyright 2013 EMC Corporation. All rights reserved. Getting Started with the Academic Alliance 1. Visit http://education.EMC.com/academicalliance and click ―Apply for Membership‖ to complete and submit the online registration form. 2. Once approved, we will provide the faculty with free training and access to course materials, resources, and online support. 3. Faculty prepares to teach and schedules class(es). 4. Faculty provides EMC with number of students educated each year. For more information, please contact your Marwa.Zaghow@emc.com or EAA_Program_Office@emc.com
- 32. 33© Copyright 2013 EMC Corporation. All rights reserved. HEADCOUNT GROWTH Started 170 500++ BUSINESS UNITS • Technical support • Implementation services • Consultancy • Presales • Logistics • Project management • Call center • Global IT NEW SERVICES SINCE 2011 • Account Service Control • Service Quoting • Solution Delivery • Business Consulting • Chat support services • VIC coverage to EMEA • Sizing, Bid management • Project Management Office • Resource Management INNOVATION • 329 ideas submitted from Cairo • 5 Winners in EMC Global innovation conference • Top contribution in ideas/employee globally UNIVERSITY RELATIONS • Academic Alliance program • Sponsoring graduation projects • EMC Labs • Joint Research Projects • Job Shadowing / Internships • Technical Sessions • Employment Fairs • Conferences sponsorship 11 languages
- 33. 34© Copyright 2013 EMC Corporation. All rights reserved. CORPORATE SOCIAL RESPONSIBILITY •Food Bank project •Blood donations •Wayana Integrated Schools •Orphanages support •Global Biking Initiative •Ramadan bags •Computer & Science labs @ Schools •Back to school project •Sponsoring STEM schools •Campaign against Cancer •Sustineo Culture program
Notes de l'éditeur
- Every IT department, every company, has two fundamental challenges. They want to lower their operating costs and they want to use IT to increase revenue. And of course we’ve seen this data point before but the challenge that almost everybody has is a little bit less than two-thirds—or in some cases, more than two-thirds—of companies’ spend on IT is spent on maintaining existing systems with only a third of the budget being available to put new applications in place to help the business increase revenue, get closer to their customers, etc. And our strategy helps our customers directly address both of these challenges.The reason is the much of IT was created a traditional model where the applications owned the infrastructure. We created dedicated stacks of application, compute, network and storage. The result was low utilization of hardware resources and complex operations. Additionally, because each project tended to be fairly unique, these deployments were more error prone than necessary because the teams had less familiarity and the configurations weren’t tested as thoroughly as they would if everything was the standardized.With the traditional IT process, each new solution was a unique project that had to be procured, configured, tested and deployed. This caused the new project deployment cycles to be measured in months or weeks if you were really doing great. This makes it hard to drive the agility you need and the investment you need to increase revenue with IT.
- Cloud computing is a fundamental shift in IT that allows organizations to drive operational costs to the lowest possible level. This is a trend that is not only transforming data centers and IT, but it is transforming the IT industry. It is a dramatic shift from traditional client-server architectures and that shift requires new technologies and new architecture. As you look across the IT industry you can see many of the leaders in client server computing are having difficulties maintaining leadership and growth in the new world of Cloud Computing. At EMC, we believe cloud computing will define the next leaders in IT and the IT Industry and we are committed to build a leading cloud portfolio to help you lead IT transformation in your organization.
- “While cost is important, customers are willing to invest in private cloud computing in order to achieve agility.”“At Gartner’s Data Center Conference in December 2010, 170 attendees responded to a poll asking, ‘What is your main driver in moving to private clouds?’” A little more than half said that agility was their #1 reason for moving to private clouds, while almost a quarter said it was because of cost. (Source: “The Drivers and Challenges of Private Cloud Computing.” March 2011, Gartner.) NOTE:Source is Gartner press release: http://www.gartner.com/it/page.jsp?id=1526414Other: Defend IT 2%, Enable Hybrid 6%, Quality 2%, Don’t Know 5%
- So let’s talk a little bit about what we mean by helping customers move to the cloud. There are three very important steps. The first is that customers want to standardize. Historically, they’ve built their applications with one set of everything for each application and IT has become complex and very hard to automate. So standardizing up on fewer components—Intel processors, a complete storage infrastructure—helps them with step number one.The second step is then to virtualize that environment so you create an abstraction layer between the applications and the standardized hardware. This step is incredibly important from a hardware and software utilization standpoint. It allows much greater levels of consolidation and utilization in all your hardware infrastructure, driving savings that can be invested in automation and increasing agility.And then finally we help people automate. And these are the three steps to the cloud that help people transform their IT infrastructure. Increasingly, IT will be based on policies that are set at the application and information level and automatically enforced by an infrastructure that knows it’s own attributes. Let me give you an example… Suppose you have an application with very sensitive customer information and that information is regulated by the government. It must be stored within a specific list of countries, it must be encrypted at rest, and it must be processed and stored on machines where all administrators have a specific security clearance. When the infrastructure knows it’s attributes – location, administrative security zone, storage encryption settings, you can automatically balance workloads or proactively avoid outages and still comply with policies because the application policy is set, the infrastructure attributes are known. That’s the kind of automation that will allow IT to truly invest in driving revenue and differentiating the business, while still operating the business at the lowest cost possible.
- x86 is dominate in volumex86 crushes all risc/mainframe architectures in price perfServer virtualization allows pool massive logical server resources to scale up.No end in sight to the continued innovationAll clouds built on x86Flash has provided a way to avoid IO bottlenecks that can occur from massive consolidation and improvement in Compute performanceBELOW ARE NOTES ONLY, NOT FOR MONITOR:We see that the cloud is creating a confluence of three powerful underlying technologies - we believe these will bring long-term, fundamental change in IT:x86:Emergence of standardized x86 means commoditization of performance compute elements. As a result, x86 is dominating, 99% of all servers, and now over 60% of all server revenue. We’ve seen extraordinary growth in x86 performance leading up to 2011, from single-thread to multi-core. There’s been a 2000% performance increase since 2005—literally, we’ve gone super Moore’s Law in delivering performance.Virtualization:In 2009 we saw an important trend as virtual servers are now being delivered more than physical servers (i.e. the world has moved to virtualized servers) as the standard way to deliver compute capabilities.Flash:We’ve also seen that there’s been an emerging gap between what’s possible and the compute --as we’ve gone from microsecond to nanosecond compute cycles. We’ve continued to see aerial densities of hard drives allow for higher densities of storage, but a big performance gap in between.And flash technologies have innate solid-state memory capabilities to fill that gap.
- And this is where data growth can help to increase revenue and different the business. Big data transform business. It’s happening across every industry and in every geography, organizations that can leverage big data to increase their customers intimacy, improve operations and better understand their market, are leapfrogging competitors and leading the way.
- Explosion in types of data<CLICK>Not just types but size: New digital universe study by IDC, Information will grow 50x before 2021BELOW ARE NOTES ONLY, NOT FOR MONITOR:We see that the sources of data are expanding, and it’s not just the types of data, but the size of this data. Data will grow 50X in the next 10 years super Moore’s Law in growth rate of data.
- 500 Quadrillion Files In the Digital Universe in 2011 from IDC5TB is a large DNA image from our customers7TB is a large Seismic file from our customersBELOW ARE NOTES ONLY, NOT FOR MONITOR: It’s creating massive numbers of files, as well as massive size of files. It may be a 5 terabyte DNA image from one of our customers, or a 7 terabyte seismic file—there are literally 300 quadrillion files in existence today.
- Numerous Data source – numerous AppsExplosion of activityUnstructured and Semi-structureNext Slide – Massive Numbers and Massive FilesBELOW ARE NOTES ONLY, NOT FOR MONITOR:These numerous data sources are also creating new applications—an explosion of activity unstructured data, which is then leading to the next-generation set of semi-structured applications. Radically, this is moving past the structured transactional databases to a very broad set of cases for new data applications.
- Key trends such as virtualization, cloud computing, the inter-connectedness of people and organizations, and the emergence of “big data” applications offer better cost, agility, and flexibility; however they prevent IT and Security teams from maintaining direct control of IT resources. And they do so at a time when organizations have near-total reliance on digital assets and are operating in an increasingly complex landscape of compliance requirements, cyber-crime, and availability demands. Additionally, many IT and Security teams no longer have direct control of digital assets.The convergence of these trends has made it a business- and board-level priority for IT and security teams to ensure confidence in the security, availability, and governance of their information – regardless of where it resides.Because the landscape is growing increasingly more complex in a time of decreasing control, the need to create a threat-resistant “Trusted Infrastructure” is becoming more important than ever before and is not only difficult to achieve but very difficult to demonstrate.
- To transform business with Big Data, there is a new world of big data applications. In many industries there are special purpose applications like video editing, image processing. In all industries we are dealing with growing amounts of semi-structured and unstructured data that require new storage. Storage that can scale out to PB with linear performance and no increase in administrators or operational cost.<CLICK>These new big data apps are a compliment to the traditional enterprise apps that we have been optimizing for years. But, enterprise apps now run in our private clouds and need transactional storage that is tightly integrated with VMware and provides simplicity and efficiency to reduce cost and complexity, but also the scalability and availability needed for running mission critical applications. <CLICK>Of course, you need to protect all this information with backup and archive. One single platform that covers enterprise applications and big data applications. For backup, you need massive speed to handle the consolidation from server virtualization and it needs to be tigthly integrated with VMware to ensure you are as efficient as possible with server resources. Deduplication is the critical buying criteria in all backup environments today and more important than ever as virtual machine densities per physical server continue to grow.<CLICK>We expect all enterprises to end up with hybrid clouds and you need to build an enabling infrastructure now. That enabling infrastructure includes the ability to manage security and compliance, highly automated management drive largely based on policy and the ability to move workloads by integrating data movement with application movement.<CLICK>Transforming your business also depends on next generation big data analytics. The scale of big data and the value of the insights is completely different than past generations of data warehousing. You need a big data stack that covers both structured AND unstructured data and starts to integrate the kinds of real-time information available in places like Twitter, LinkedIn, etc… Handling this volume of information demands new architectures that are massively scalable.<CLICK>Finally, you need to provide end-users with their choice of device, but still maintain control and compliance for interacting with the Enterprise applications and information, wherever they may be running.At EMC, we have built this portfolio…<CLICK>
- A survey conducted by Barclays in late 2012 revealed that CIOs overwhelmingly identified their top spending priorities in three key areas: big data, cloud, and security. The courseware offered by EMC Academic Alliance directly addresses these important issues, providing students with practical knowledge to help address IT managers most critical challenges.
- IT/storage managers and storage professionals identified the listed activities and constraints as their key challenges. These challenges are common to both large enterprises as well as SME(Small and Medium Enterprises) sectors of the industry. Managing storage growth continues to be the foremost challenge. Since last year, storage consolidation has become the second most important challenge with an additional eight percent of organizations assigning it higher priority. Being able to make big picture/informed decisions continues to be an important challenge. In fact, this is becoming even more critical due to rapid IT transformation and the need to have trusted, highly competent advisors, architects, and designers to guide the direction of the IT organizations. Lack of skilled professionals for storagetechnologies and cloud computing is also becoming a major challenge. In addition, about seven percent of participants identified that infrastructure for Big Data analytics is becoming an important technology to address.Thisrepresents an untapped opportunity for students and universities to help businesses take control of managing the data. The full report is available in the EMC white paper “Managing Information Storage: Trends, Challenges and Options 2012-2013 available at http://education.EMC.com/AcademicAlliance
- Analysts and the media confirm that requirement through studies that show widespread requirements for individuals with education and certificatino in cloud computing and analytics:-IDC: 1.7 million cloud computing jobs remained unfulfilled in 2012 due to lack of training/certification-McKinsey: by 2018 US faces shortage of 140,000 – 190,000 with analytics expertise, and 1.5 million managers and analysts conversant on big data analysis-New America Media: 800,000 more US jobs in computer technology required by 2018 according to AT&T Labs
- 1,000+ Institutions in 60+ countriesEMC began providing information storage and management education to the academic community in 2006. Our goal was simple – as an industry leader we wanted to help prepare future IT professionals to fill the storage knowledge gap. As the IT landscape has evolved, so has the scope and nature of the knowledge gap, and so have our offerings. We are proud to introduce new ‘open’ courses to Academic Alliances to prepare students for successful careers in the new IT landscape.
- ISM – Principles and Concepts of information storage technologyProvides required technology foundation for making informed decisions in an increasingly complex IT environmentCIS - Principles and Concepts of Virtualization and Cloud Infrastructure TechnologiesProvides required technology foundation for Cloud Infrastructure and Services Enables IT professionals to make Informed decision on migration to CloudDSBDA - Principles and Concepts of Data Science and Big Data AnalyticsProvides required technology foundation for big data and the practice of analyticsEnables IT professionals to participate effectively in big data and other analytics projectsBRSA - Principles and Concepts of technologies used in Backup and Recovery environmentsProvides required technology foundation for Backup and Recovery infrastructure Enables IT professionals to make Informed decision on backup and recovery planning and implementation