Contenu connexe
Plus de SAP Technology (20)
SAP HANA SPS09 - Hadoop Integration
- 1. 1
©2014 SAP AG or an SAP affiliate company. All rights reserved.
SAP HANA SPS 09 - What’s New? Hadoop Integration
SAP HANA Product Management November, 2014
(Delta from SPS08 to SPS09)
- 2. 3
Public
©2014 SAP SE or an SAP affiliate company. All rights reserved.
Key Themes for SAP HANA SPS09 The Platform for All Applications
Availability Flexibility Reliability
Cloud
Big Data & IoT
Next Gen Apps
Openness
Hardware, software, and cloud infrastructure flexibility, options, and openness for faster ROI
Accelerate
Innovate
Simplify
Deliver real-time insights into Big Data & IoT and provide new advanced analytic capabilities
Streamline cloud & on-premise deployments, data management, and enhance price performance options
Internal
- 3. ©2014 SAP AG. All rights reserved.
4
Internal
Enhanced data virtualization and access capabilities to support the
next generation logical enterprise architecture – Analytic Data Warehouse
Enhancements
New data source: SAP MaxDB
SAP Sources: HANA, ASE, IQ, MaxDB, ESP, SQLA
Database: Teradata, Microsoft SQLServer, Oracle, IBM DB2, IBM Netezza
Hadoop: Cloudera, Hortonworks, MapR & Others
Benefits
Real-time virtualized data access to external data sources
Compliments and leverages existing enterprise investments
Leverages advanced native SAP HANA capabilities to build applications
Optimized performance and reduces objections to start in-memory journey
Lower development costs by using data directly from its source system
Innovate Smart Data Access
- 4. ©2014 SAP AG. All rights reserved.
5
Internal
Innovate Enhanced Hadoop Integration
New and enhanced Hadoop integration for more advanced and
feature rich processing of Big Data
Virtual UDF (vUDF)
New type of User Defined Function for data federation
Direct access to HDFS without need for the package, mapper, and reducer specification
Invoke custom Map Reduce jobs
vUDF can be embedded in SQL
Use Cases & Benefits
Ability to leverage features in a Hadoop cluster other than HIVE & Spark (e.g. HDFS, MapReduce)
Ad-hoc query capabilities and processing of unstructured data
Utilize vUDF for use cases that don’t fit into the typical HIVE usage patterns via SDA
SAP HANA
vUDF Operator
RFC Hadoop
Hadoop
Map Reduce
HDFS
YARN
HIVE
- 5. ©2014 SAP AG. All rights reserved.
6
Internal
SAP HANA: Map Reduce/Virtual UDF – Architecture
- 6. ©2014 SAP AG. All rights reserved.
7
Internal
SAP HANA: Hadoop Integration
What’s New in SPS09
Direct access to HDFS file system from SAP HANA
Develop and invoke custom Map Reduce jobs from SAP HANA
a. SAP HANA studio as the single IDE to invoke the M/R jobs
b. Leverage HANA Repository design time for Map Reduce job, remote Hadoop source and virtual functions
c. Support of remote result caching of virtual function execution
Data Provisioning support for remote source connectivity for IM in HANA via SAP HANA Service/Adapter Framework
Support current versions of partner (Hortonworks, Cloudera etc.) Hadoop Distributions
- 7. ©2014 SAP AG. All rights reserved.
8
Internal
MR/Virtual UDF - Development Life Cycle (SAP HANA- SP09)
Java/MR Developer
HANA modeler/administrator
Business Analyst
- 8. 9
Public
©2014 SAP SE or an SAP affiliate company. All rights reserved.
Additional Important Resources for SAP HANA SPS09
SAP HANA SPS09 GTM Site
https://jam4.sapjam.com/wiki/show/v2tS6QGERlo0AlNKnTauC6
Internal
- 9. 10
Public
©2014 SAP SE or an SAP affiliate company. All rights reserved.
Further Information
SAP HANA SPS09 GTM Site
https://jam4.sapjam.com/wiki/show/v2tS6QGERlo0AlNKnTauC6
SAP Public Web
scn.sap.com
www.sap.com
www.sapbigdata.com
www.sap.com/solution/big-data/software/overview.html
- 10. Thank you
Contact information
Prasad Illapani
SAP HANA Product Management
AskSAPHANA@sap.com