Ce diaporama a bien été signalé.
Le téléchargement de votre SlideShare est en cours. ×

BDW Chicago 2016 - Ramu Kalvakuntla, Sr. Principal - Technical - Big Data Practice, Clarity Solution Group - Modern Data Architecture

Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Prochain SlideShare
Data Services Marketplace
Data Services Marketplace
Chargement dans…3
×

Consultez-les par la suite

1 sur 35 Publicité

BDW Chicago 2016 - Ramu Kalvakuntla, Sr. Principal - Technical - Big Data Practice, Clarity Solution Group - Modern Data Architecture

We all are aware of the challenges enterprises are having with growing data and silo’d data stores. Business is not able to make reliable decisions with un-trusted data and on top of that, they don’t have access to all data within and outside their enterprise to stay ahead of the competition and make key decisions in their business

This session will take a deep dive into current challenges business are having today and how to build a Modern Data Architecture using emerging technologies such as Hadoop, Spark, NoSQL data stores, MPP Data stores and scalable and cost effective cloud solutions such as AWS, Azure and Bigstep.

We all are aware of the challenges enterprises are having with growing data and silo’d data stores. Business is not able to make reliable decisions with un-trusted data and on top of that, they don’t have access to all data within and outside their enterprise to stay ahead of the competition and make key decisions in their business

This session will take a deep dive into current challenges business are having today and how to build a Modern Data Architecture using emerging technologies such as Hadoop, Spark, NoSQL data stores, MPP Data stores and scalable and cost effective cloud solutions such as AWS, Azure and Bigstep.

Publicité
Publicité

Plus De Contenu Connexe

Diaporamas pour vous (20)

Similaire à BDW Chicago 2016 - Ramu Kalvakuntla, Sr. Principal - Technical - Big Data Practice, Clarity Solution Group - Modern Data Architecture (20)

Publicité

Plus par Big Data Week (20)

Plus récents (20)

Publicité

BDW Chicago 2016 - Ramu Kalvakuntla, Sr. Principal - Technical - Big Data Practice, Clarity Solution Group - Modern Data Architecture

  1. 1. Building Enterprise Scale Solutions with Modern Data Architecture in Cloud Big Data Week, Chicago Business | Data | Analytics September 21, 2016
  2. 2. 1 Agenda Propriety and Confidential - ©2016 Clarity Solution Group, LLC. 1 Current Data Challenges 2 Healthcare Use Case 3 Modern Data Architecture 4 Why Cloud? 5 Benefits of a Modern Data Architecture 6 Q&A
  3. 3. 2 Current Enterprise Challenges • Business is tied up with descriptive analytics • No focus on predictive and prescriptive analytics to support key business decisions Lack of Business Insights • Data spread across multiple data stores • Inconsistent outcomes • Maintenance hassles Silo’d Data Stores • Appliance databases are expensive, more than $100K per Terabyte storage in some cases Expensive Platforms • Data growing from Terabytes to Petabytes to Exabyte's • Unable to manage with traditional databases Massive Data Growth Current Data Challenges ? Propriety and Confidential - ©2016 Clarity Solution Group, LLC.
  4. 4. 3 Data Growth in Healthcare Propriety and Confidential - ©2016 Clarity Solution Group, LLC. Internet of Things (IoT) (Zettabytes) External Data (Petabytes) Enterprise Data (Terabytes) Member Enrollment Data Pharmacy Data Medical Claims Data Helpdesk Data Product Data Provider Data Demographic Data Medical Transcripts Data Medicaid & Medicare Data Social Media Data Clinical Data (HL7) Wearable Data Genome Data Lab Data Medical Documents
  5. 5. 4 Use case: Personalized Patient Care (Digital Healthcare) Food Intake Heart Rate Medication Sleep Patterns Water Intake Blood Pressure Smart Phone W/ Wearables Calories In/Out Medical Images Medical Records Lab Results Doctors Notes Member Data Data Lake Machine Learning Predictive Models Physical Activity Notifications to Doctor Members Personalized Medicine Gamification for Encouragement Propriety and Confidential - ©2016 Clarity Solution Group, LLC.  Behavior modification leads to healthier lifestyles  Enables providers to more frequently monitor high risk patients
  6. 6. 5 Cost Savings using Digital Healthcare Data (Goldman Sachs) Propriety and Confidential - ©2016 Clarity Solution Group, LLC. Disease State Heart Diseases, COPD/Asthma, Diabetes Vertical Total Savings Opportunity Commercial Opportunity Remote Patient Monitoring $200+ billion ~$15 billion Routine & Psychological Care Telehealth $100+ billion ~$12 billion Obesity, smoking, overall lifestyle improvement Behavior Modification Indefinitely large ~$6 billion Source: Goldman Sachs Global Investment Research http://www.businessinsider.com/goldman-digital-healthcare-is-coming-2015-6
  7. 7. 6 Modern Data Architecture Blueprint Propriety and Confidential - ©2016 Clarity Solution Group, LLC. Data Sources Information Delivery Dashboards Operational Reports Self-Service Reporting Self Service Personalization on Mobile App Search and Data Discovery User / Analytics Sandbox Storage Service Process Compute Service Consumer Compute Service Enterprise Data Data LakeDataIngestionFramework(Real-time/Batch) Enterprise Information Management In-memory Storage Archive Storage Active Storage Enterprise Technical Metadata Management Enterprise Data Warehouse Data Mart Data Mart Reference Data Cached Cubes Restful Service Framework Data Governance & Security Environment Management Real-time Service Batch Service ETL Framework with Audit Control Balance SQL Service Ad-hoc Analytics Machine Learning Content Analytics Visualization & Reporting Service Real-time Analytics Data Analytics ? What-if Analytics User Sandbox Configuration Management Deployment Management Resource Analysis & Allocation Backup & Disaster Recovery Structured Data Unstructured Data Enrollment Data Claims Data Provider Data Help Desk Data Wearables Genomic Data Social Media Product Data Medicare / Medicaid Medical Transcripts Clinical Data Demographics Medical Documents Lab / Images
  8. 8. 7 Establishing a Modern Data Architecture (MDA) Propriety and Confidential - ©2016 Clarity Solution Group, LLC. MDA Enterprise Data Lake Establish an Enterprise Data lake to consolidate all disparate data sources and process all data needs for EDW, BI and Advanced Analytics using scalable platforms Machine Learning Establish Machine Learning algorithms to do predictive analysis and gain deep insights into your business Cloud Solutions Establish a scalable Cloud Platform Advanced Analytics Establish reactive approach to data and proactively leverage of analytics to manage risks and improve decision making Architecture Blueprint Establish an end to end Architecture Blueprint tailored to meeting your business objectives leveraging modern technologies and scalable platforms Strategy & Roadmap Establish a Strategy & Roadmap to meet business goals .
  9. 9. 8 Why Cloud? 1 2 3 Scalable & Cost Effective Solutions Faster adoption & easy to use World-class Security by design Propriety and Confidential - ©2016 Clarity Solution Group, LLC.
  10. 10. 9 Benefits of Modern Data Architecture Propriety and Confidential - ©2016 Clarity Solution Group, LLC. 1 3 2 Consolidates Silo’d Data sources Scalable Architecture for all data processing Business insights with Advanced Analytics
  11. 11. 10 Contact Information Propriety and Confidential - ©2016 Clarity Solution Group, LLC. 350+ Robert Fuller Practice Lead, Big Data Practice Clarity Solution Group E-mail: rfuller@clarity-us.com Ph: 312-520-6806 https://www.linkedin.com/in/bob-fuller-16035b2 Ramu Kalvakuntla Sr. Principal, Big Data Practice Clarity Solution Group E-mail: rkalvakuntla@clarity-us.com Ph: 630-697-5262 https://www.linkedin.com/in/ramukalvakuntla Clarity Solution Group | www.clarity-us.com
  12. 12. 11 Q&A Propriety and Confidential - ©2016 Clarity Solution Group, LLC.
  13. 13. 12 Information on Clarity Solution Group Appendix Propriety and Confidential - ©2016 Clarity Solution Group, LLC.
  14. 14. Create by unlocking the power of big data
  15. 15. 14 14 Who we are www.clarity-us.com ESTABLISHED 2008 OFFICES Chicago Redwood City Charlotte New York PARTNERS OF DATA EXPERIENC E 350+ CONSULTANTS 3500 YRS with nearly 4
  16. 16. 15 Financial Services Industrials The ecosystems we work in Communications and Media Hardware Social Media Telecom Retail and CPG SuppliersDistributors Stores Capital Markets Financial Information Services Banking Equipment Raw Materials Payers Providers Distribution Drug companies Healthcare and Life Sciences Studio/Agency Insurance Property and Casualty Financial InformationS ervices Life
  17. 17. 16 The kind of work we do Client Project Description Social Media Giant Our work created new customer insights and advanced targeting, which drove up demand and revenues by delivering unbeatable results for advertisers. Industrial Services Company The client estimates an ROI of more than 20x on this “1-second data” solution that makes IoT well data available in real time to the client and its customers. Wealth and Asset Management Firm Enabled near real-time internal and external data and analytic services, replacing expensive legacy ETL and code management platforms with innovative technologies. Consumer Product Company By beefing up data discovery with third party sources, and using advanced modeling techniques, we discovered purchase drivers that could deliver stores of untapped value.
  18. 18. 17 More than just another data and analytics consulting firm We have “T-shaped” consultants •Business savvy plus technology know-how − Creates a multiplier effect •Skilled across the entire “stack” •Verifiable business impact in the tens of millions of dollars
  19. 19. 18 More than just another data and analytics consulting firm Our culture: Impossible is Nothing
  20. 20. 19 Information Delivery Business analysis Data Management Data Engineering Advanced Analytics Machine Learning Data Science Data in service of business (not vice versa) Advise Build Enable Cloud Data Strategy
  21. 21. 20 We do that (in part) by accelerating results As experts in the field, we deliver accelerators that give our clients faster, lower-risk delivery from an easy-to-use product that works CLEAR ARCHETYPE Industry reference data models APACHE ™ HADOOP® ON WHEELS A Hadoop accelerator which speeds implementation without sacrificing data integrity ACE A set of tools to integrate your company’s data with external assets to create an omni- channel view of the consumer CLEAR FORENSIC S Data profiling and quality analysis tools to speed up understanding of key meta data metrics CLEAR CATALYST Data integration code generator that delivers consistently high quality code, quickly with minimal initial setup
  22. 22. 21 Introducing the Apache™ Hadoop® on Wheels framework A matrix of architecture, governance, and enablement capabilities that scale with the platform An architectural methodology for data architecture infrastructure sizing, component integration and tool, selection. An approach that combines the benefits of a formal governed warehouse with the dynamic aspects of big data analytics Enterprise-strength security and achievable data governance Automation and acceleration across implementation, governance, and enablement vectors Operational roadmap and tool kit to activate business value through analytic agility What it is What it does
  23. 23. 22 Advanced Consumer Engagement (ACE) • Pre-packaged data model • Sophisticated entity resolution matching engine • Visualization dashboard Key Accelerators • Software / hardware neutral • Built to scale based on big data technologies • On-premise or hosted The Clarity Approach Overcome barriers to personalized consumer engagement
  24. 24. 23 Their crew is several orders of magnitude better technically than most of their competitors. People don’t realize what that means. It’s a big deal.” — Head of Enterprise Business Intelligence More than just another data and analytics consulting firm I wouldn’t be able to replicate their people one-to-one… I’d need a business architect AND a tech lead. Or I’d need a project manager AND a technical architect. They do bring a unique background and unique skillsets to the table.” — Head of Enterprise Business Intelligence It’s amazing how many of them can write complex code and two minutes later have a sound trade-off discussion with the business.” — Sr. Director, Business Intelligence They’ve been there and done it over and over again. They know where the potholes are. They know what approaches work and what approaches don’t work.” — Director of Information Technology It’s a very personal organization… not like a [large IT company] … It feels like they have a vested interest in our success.” — Head of Enterprise Business Intelligence
  25. 25. CAPABILITIES BUSINESS CHALLENGE One of the largest data- consuming companies in the world needed faster insights from its tsunami of consumer and advertising data. APPROACH A big data instance, advanced analytics, and a small, agile team. OUTCOME Our work created new customer insights and advanced targeting, which drove up demand and revenues by delivering unbeatable results for advertisers. TECHNOLOGIES Apache™ Hadoop® Vertica Cluster Tableau®Master Data Management Advanced Analytics Data Warehouse Modernization Data Visualization Big Data Information Strategy Turning Likes Into Ad Revenue CS4005-062816© 2016 Clarity Solution Group, LLC. All other trademarks and copyrights are the exclusive property of their respective owners
  26. 26. BUSINESS CHALLENGE To understand how an investment in data and analytics could uncover what drives customers to purchase. APPROACH A POC to beef up data discovery with third party sources, and advanced modeling techniques to identify purchase drivers. OUTCOME The POC revealed stores of untapped value the firm can uncover by switching to big data. The client is proceeding with a full pilot program and expects the improved customer profiling and targeting to lead to measurable gains in profitability. CAPABILITIES TECHNOLOGIES Apache™ Hadoop® Vertica Cluster Tableau® Advanced Analytics Big Data Information Strategy Uncovering Purchase Drivers CS5013-070116© 2016 Clarity Solution Group, LLC. All other trademarks and copyrights are the exclusive property of their respective owners
  27. 27. CAPABILITIES BUSINESS CHALLENGE Support continued business growth and meet increasingly dynamic customer risk management and regulatory compliance demands while reducing latency and TCO. APPROACH Modernize bank’s data architecture and engineering platforms and services through re- defined development methods and establishment of an innovative, secure data lake, enabling new business analytic capabilities. OUTCOME Enabled near real-time internal and external data and analytic services, replacing expensive legacy ETL and code management platforms with innovative technologies. Improved solution delivery quality and cycle times through Agile methods. TECHNOLOGIES Cloudera Enterprise CDH ®, Cloudera Impala ®, Apache Spark™, Apache™ Hadoop® , Sqoop, Flume, Bamboo, Git, Stash, IBM DataStage®, Oracle Exadata® Master Data Management Advanced Analytics Data Warehouse Modernization Big Data Information Strategy Keeping Pace With Customers While Saving Money CS2002-080416© 2016 Clarity Solution Group, LLC. All other trademarks and copyrights are the exclusive property of their respective owners
  28. 28. BUSINESS CHALLENGE Increase brand retention and revenue by improved access to customer and retailer insights from new data and social media. APPROACH Our Consumer720 platform provided consumer identification, attribute enrichment, and engagement. OUTCOME Able to deliver personalized messages to customers who want them and through the customer’s preferred channel. Reduced marketing costs by tapping into first-party customer behavior and machine learning to enrich customer profiles and improve customer engagement. CAPABILITIES TECHNOLOGIES Apache™ Hadoop® Python ™ Tableau® Master Data management Advanced Analytics Data Visualization Big Data Making data blending simple (and profitable) CS5001-070116© 2016 Clarity Solution Group, LLC. All other trademarks and copyrights are the exclusive property of their respective owners.
  29. 29. BUSINESS CHALLENGE This oil and gas drilling company is on a mission to become the one-stop shop for data storage and data presentation for their customers. Their goal is to align better with their customers, focus on driving down the overall well cycle, and differentiate from their competitors. APPROACH Clarity delivered the strategy, planning and implementation of a “1-second data” solution that makes well data available in real-time to the client and its customers. OUTCOME Through Clarity’s work, the client gained new service offerings with a real competitive advantage. By enabling engineers to diagnose performance issues better at the wells, the client creates enhanced value to customer relationships and increased “stickiness”. Because of this, the client estimates an ROI of more than 20x on this differentiated offering. There are now further opportunities for ongoing managed services on the new platform to boost profits. CAPABILITIES Data Management & Data IntegrationProfiting From The Internet of Things Big Data Data Visualization Advanced Analytics CS6009-070116 TECHNOLOGIES Apache™ Hadoop® Hortonworks® Microsoft Azure ™ © 2016 Clarity Solution Group, LLC. All other trademarks and copyrights are the exclusive property of their respective owners.
  30. 30. BUSINESS CHALLENGE Existing data structures were insufficient to address urgent business questions, with direct impacts on revenue. APPROACH A service strategy to enable big data analytics, bridging gaps and augmenting an enterprise data warehouse program. OUTCOME Clarity Solution Group delivered high-value advanced analytics capability, enabling immediate actionable insights on existing data assets with quantifiable returns. CAPABILITIES TECHNOLOGIES Teradata® Teradata Aster ® Tableau® Big Data Speeding Time to Decision Information Strategy CS3013-070116© 2016 Clarity Solution Group, LLC. All other trademarks and copyrights are the exclusive property of their respective owners.
  31. 31. BUSINESS CHALLENGE This cable MSO sought to create an analytic environment where they can measure audiences and build campaigns that will achieve a desired reach and frequency. The firm needed a more scalable solution. OUTCOME Our solution enables our client to measure individual ads and supports comparative effectiveness metrics and closed- loop analysis. The environment we developed has allowed this client to perform advanced analytics, including audience views, campaign reach and frequency of the subscriber base,and will enable future advanced advertising capabilities, such as targeted ads. CAPABILITIES TECHNOLOGIES Hortonworks® Apache Spark ™ Openstack ® Teradata ® Netezza Advanced Analytics Data Integration Cable Company Improves Measurement of Ad Reach and Frequency Big Data APPROACH An environment to support visualizations and advanced analytics to gauge the effectiveness of different advertising strategies. The solution presents audience data for ads in conjunction with household, channel, and advertiser information. It supports the ad hoc and structured visualization environment delivering insights into audience viewing. CS4016-062816© 2016 Clarity Solution Group, LLC. All other trademarks and copyrights are the exclusive property of their respective owners.
  32. 32. CAPABILITIES BUSINESS CHALLENGE To build competitive differentiation by using sensor data to achieve faster time-to-market and optimize quality. APPROACH An advanced analytics architecture for a repository to store machine-generated sensor readings, quality test results, and asset maintenance history. Dashboards visualize sensor data for manufacturing quality metrics. OUTCOME Clarity Solution Group’s work identified the root cause of a quality defect, saving $10M annually. The client improved product quality, reduced risks at its manufacturing plants, and leveraged visualization technologies to help business users streamline day-to- day activities. This improved performance, productivity, and value. TECHNOLOGIES SQLServer ® SSIS SSAS Tableau ® Data Management and Data IntegrationAdvanced Analytics Data Visualization IoT Sensor Data Identifies Quality Defect Savings of $10M Annually CS6011-062916© 2016 Clarity Solution Group, LLC. All other trademarks and copyrights are the exclusive property of their respective owners
  33. 33. 32 CAPABILITIES BUSINESS CHALLENGE For a healthcare provider to implement a real-time streaming solution that delivers information for timely diagnostic queries that are up to date within five minutes. APPROACH Spark streams EMR changes, performing enrichment and updating data in micro- batches to a Phoenix data store for diagnostic queries. OUTCOME Potential health risks can now be identified same day, and the quality of care has improved through empowered diagnostic querying and alerts on real-time data. Speed and accuracy enable earlier, more preventative measures from physicians and reduce the cost of treatment. TECHNOLOGIES Apache Spark ™ Apache HBase ™ APACHE® Phoenix Java ™ Scala HDFS Big Data Diagnostic Querying in Real-Time Data Management & Data Integration Advanced Analytics CS3020-052016© 2016 Clarity Solution Group, LLC. All other trademarks and copyrights are the exclusive property of their respective owners.
  34. 34. 33 Contacts www.clarity-us.com Paul Fenick Director of Analyst Relations 203 733 1196 pfenick@clarity-us.com Mark Lewis Chief Marketing Officer 925 878 1311 mlewis@clarity-us.com
  35. 35. Headquarters 150 South Wacker, Suite 2750 Chicago, IL 60606 312-288-8428 www.clarity-us.com

×