Contenu connexe
Similaire à Introduction to Microsoft HDInsight and BI Tools
Similaire à Introduction to Microsoft HDInsight and BI Tools (20)
Plus de DataWorks Summit (20)
Introduction to Microsoft HDInsight and BI Tools
- 2. Our Speakers
Abhijit Lele
Solution Engineer
Rohit Bakhshi
Product Manager
Page 2
© Hortonworks Inc. 2013
- 3. Agenda
• HDP for Windows
• Integrating with the Microsoft Tool Ecosystem
• Demo
• Q&A
Page 3
© Hortonworks Inc. 2013
- 4. Introducing HDP for Windows
OPERATIONAL DATA Hortonworks
SERVICES SERVICES
Data Platform (HDP)
Manage &
Manage & Store,
Store,
Operate at
Operate at Process and
Process and For Windows
Scale
Scale Access Data
Access Data
• 100% Open Source
HADOOP CORE
Distributed Enterprise Hadoop
Storage & Processing
• Component and version
PLATFORM SERVICES Enterprise Readiness
compatible with Microsoft
HDInsight
HORTONWORKS
DATA PLATFORM (HDP) • Availability
For Windows
• Beta release available now
• GA early 2Q 2013
Page 4
© Hortonworks Inc. 2013
- 5. Windows support in Apache
Component Version
Hadoop 1.0.3
Pig 0.9.3
Hive 0.9.0
HCatalog 0.4.1
WebHCat 0.1.4
Sqoop 1.4.2
Oozie 3.2.0
Initial Hadoop Core Apache JIRA:
https://issues.apache.org/jira/browse/HADOOP-8079
Apache Hadoop branch-1-win github:
https://github.com/apache/hadoop-common/tree/branch-1-win
Apache Hadoop branch-trunk-win github:
https://github.com/apache/hadoop-common/tree/branch-trunk-win
© Hortonworks Inc. 2013
- 6. What do you get?
• More deployment choices
• Hadoop for Windows is for on-premise deployment
– Good fit for organizations with Hadoop operational experience
– Next step for those who are ready to move from POC to production
• Use HDInsight for public and private cloud
deployments
– HDInsight Service -> Windows Azure– available in Preview today
– HDInsight Server -> for interoperability across platforms of Hadoop, with
Microsoft tools, on premise – Developer Preview available today
• Full interoperability across platforms
• Created through partnership between Hortonworks
and Microsoft
– Eighteen months of development time
Page 6
© Hortonworks Inc. 2013
- 9. Agenda
• HDP for Windows
• Integrating with the Microsoft Tool Ecosystem
• Demo
• Q&A
Page 9
© Hortonworks Inc. 2013
- 10. Seamless Interoperability with Your Microsoft Tools
• Integrated with Microsoft
APPLICATIONS
tools for native big data
analysis
Microsoft Applications – Bi-directional connectors for SQL Server
and SQL Azure through SQOOP
– Excel ODBC integration through Hive
• Addressing demand for
DATA SYSTEMS
HORTONWORKS
DATA PLATFORM
Hadoop on Windows
For Windows – Ideal for Windows customers with
Hadoop operational experience
• Enables all common Hadoop
workloads
– Data refinement and ETL offload for
DATA SOURCES
high-volume data landing
Traditional Sources New Sources
(web logs, email, sensor data, social media)
– Data exploration for discovery of new
OLTP, (RDBMS, OLTP, OLAP) MOBILE
POS DATA business opportunities
SYSTEMS
Page 10
© Hortonworks Inc. 2013
- 11. Hadoop and Microsoft Connectivity
•Infrastructure Components
• Active Directory
• System Center
•Microsoft Data Connectivity
• Sqoop Connector
• SQL Server / SQL Parallel Data Warehouse
• Azure Storage / Azure Data Market
•Microsoft Business Intelligence (BI)
• ODBC Connectivity
© Hortonworks Inc. 2013
- 15. Hadoop/Hive and Analysis Services
•Delivers cost-efficient OLAP and data
mining functionality
•Supports ad-hoc data support queries in
Microsoft Excel and dashboards
•Offers exceptional query performance over
vast amounts of data
•SSAS to HIVE paper
–http://msdn.microsoft.com/en-
us/library/jj710329.aspx
© Hortonworks Inc. 2013
- 16. Interoperability: Looking Ahead, PolyBase
• Single query for relational &
Hadoop data
• Process data in place
• Seamless: Regular T-SQL PolyBase
command
• Future expansion to other data
sources
© Hortonworks Inc. 2013
- 17. Agenda
• HDP for Windows
• Integrating with the Microsoft Tool Ecosystem
• Demo
• Q&A
Page 17
© Hortonworks Inc. 2013
- 18. Demo Time!
Excel integration with HDP
• Interact with HDP through Excel
• Use Data Explorer to explore and turn raw data
into valuable information
Page 18
© Hortonworks Inc. 2013
