SAP HANA como plataforma de desarrollo, combinando el mundo OLTP + OLAP

1. SAP HANA Platform SAP Platform Solution Group
Septiembre 2014

2. © 2013 SAP AG. All rights reserved. 2
Agenda
•
Introduction SAP HANA
•
SAP HANA Components
•
SAP HANA Platform – Development
•
References and Links

3. © 2013 SAP AG. All rights reserved. 3
Assuntos de interesse
Have you heard about SAP HANA?

4. © 2013 SAP AG. All rights reserved. 4
CPU
Next-generation Software & Hardware Architecture Removing data processing bottlenecks using latest innovations in computing
STORAGE
MEMORY
Compression
Partitioning
OLTP+OLAP in column Store
Insert Only on Delta
No Aggregate tables (Dynamic Aggregation)
Solid State
Flash
HDD
64bit address space 1 TB in current servers
Dramatic decline in price/performance
L3 Cache
L3 Cache
L3
Cache
L3
Cache
L3
Cache
L3
Cache
L3
Cache
L3
Cache
Multi-Core Architecture 8 CPU x 10 Cores per blade Massive parallel scaling with many blades
Logging and Backup

5. © 2013 SAP AG. All rights reserved. 5
One in-memory atomic copy of data for Transactions + Analysis

Eliminate unnecessary complexity and latency

Less hardware to manage

Accelerate through innovation and simplification

3 copies of data in different data models

Inherent data latency

Poor innovation leading to wastage
Separated Transactions + Analysis + Acceleration processes
SAP HANA (DRAM)
Transact
ETL
Analyze
ETL
Re-think Data Management with in-memory computing Need to eliminate redundant data copies, materialization and models
A Common Database Approach for OLTP and OLAP Using an In-Memory Columnar Database Hasso Plattner
VS
Accelerate
Cache

6. © 2013 SAP AG. All rights reserved. 6
•
Database & data processing engines
•
Application Server
•
Integration Services
•
Development, Deployment and Administration
Breakthrough Data & Application Processing Enabling real-time computing design patterns across entire software architecture
OLTP + OLAP in Columnar database
SIMPLIFIED
Application Processing
OPTIMIZED
End-to-end Data Processing
CONVERGED
Text
Image
Spatial/GIS
Transactions
Sensors
Prescriptive
Predictive
Sentiment Intelligence
Machine Learning
Operational Analytics
SAP HANA (Main Memory)
SAP HANA (Main Memory)
SAP HANA (Main Memory)
Application Layer
In-Memory Database layer
Libraries

7. Which HANA use cases you see for your company?

8. © 2013 SAP AG. All rights reserved. 8
Multi-channel Unified User Experience
SAP Business Suite
HANA Live
New SAP Apps
Partner Apps
SAP HANA PLATFORM
Application Services
Database Services
Integration & Synchronization Services
SAP HANA Platform Real time business Platform
SAP NetWeaver BW
Text Search
(InA)
Search Engine
Planning Engine
Rules Engine
Application & UI Services
Business Function Library
Predictive Analysis Library
Geo Spatial
Stored Procedure & Data Models
Data Services
Real-time Replication Services
Hadoop Integration
Flexible Deployment Model (On Premise, Hybrid & Cloud)
SQL, MDX, R, Odata
Data Virtualization (SDA)

9. © 2013 SAP AG. All rights reserved. 9

Easily migrate your applications. Deploy App without Re-Write
•
Process any Data within same query with ONE SQLScript

Build new web applications with any open source HTML5 / JS libraries, server-side Java script

SAP HANA supports 3rd party customized application as well as native HANA application.
Any Apps On Any App Server
Any SAP Applications
on SAP App Server
JSON
R
Open Connectivity
MDX
SQL
Native HANA Applications on SAP HANA App Server
SAP HANA
DB Server
DB-oriented Logic
Text Mining
Predictive
SQL Scripts
R Integration
Decision Tables
Extended App Services (Web Server)
Procedural App Logic
OData
Java Script
Unstructured
Application Library

Structured data

Click stream

Social network

Customer Data

Point of Sale

RFID

Machine Data

Connected Vehicles

Text Data

Geospatial Data

Smart Meter

Mobile
Application Platform Services Migrate Existing or Build New Application to Process Any Data

10. © 2013 SAP AG. All rights reserved. 10
SAP HANA – XS (Extended Services) Engine

11. © 2013 SAP AG. All rights reserved. 11
SAPUI5 - SAP User Interface for HTML 5
Visit the UI development toolkit for HTML5 https://sapui5.hana.ondemand.com/sdk/
Is a collection of libraries that developers can use to build desktop and mobile applications that run in a browser.
Develop in JavaScript

12. © 2013 SAP AG. All rights reserved. 12
SAP HANA XS Engine – Native Apps runing on HANA
•
XS Engine is part of SAP HANA Platform
•
XS Engine allows apps run on HANA
•
XS Apps are accesed via Mobile devices or Browser
•
XS Apps are develop using standard technologies (HTML5, JS, OData)
Please visit the SAP HANA Marketplace: http://marketplace.saphana.com/ Strategic Workforce Planning
SAP Fraud Management

13. © 2013 SAP AG. All rights reserved. 13
C4.5 decision tree
Weighted score tables
Regression
ABC classification
Spatial, Machine,
Real-time data
Hadoop/ Sybase IQ, Sybase ASE, Teradata
Unstructured
PAL
R-scripts
SQL Script Optimized Query Plan
Main Memory
Virtual Tables
Spatial Data
R-Engine
KNN classification
K-means
Associate analysis: market basket
Text Analysis
SAP HANA
HANA Studio/AFM, Apps & Tools
Predictive Analytics & Machine Learning Transforming the Future with Insight Today
Accelerate predictive analysis and scoring with in-database algorithms delivered out-of-the-box. Adapt the models frequently
Execute R commands as part of overall query plan by transferring intermediate DB tables directly to R as vector-oriented data structures
Predictive analytics across multiple data types and sources. (e.g.: Unstructured Text, Geospatial, Hadoop)

14. © 2013 SAP AG. All rights reserved. 14
Embedding Predictive Analytics into SAP HANA Applications
R Library
Predicative Analysis Library
SAP Predictive Analysis
SAP HANA Platform
Calculation
Traditional
Calculation
SAP HANA
Application Layer
Database Layer
Smart Meter Analytics
K-Means
What if pricing simulations for electricity plans
Customer Value Intelligence
ABC Classification
Churn probability and white space revenue analysis
•
Embed within business applications
•
Access to 3,500+ open-source algorithms via R integration
•
In-database processing for powerful and fast results
•
Rich visualization and analytics tools
Audience
Discovery & Targeting
Log Regressions
Identify customer clusters for precision targeting
Fraud Management
C4.5 Decision Tree
Reduce false positive fraud signals

15. © 2013 SAP AG. All rights reserved. 15
Solution today Planned innovations Future direction
Overview of SAP Predictive Analysis & Overview of R
SAP HANA Platform
Predictive Analysis Library (PAL)
R Integration for SAP HANA
R
SAP Predictive Analysis
SAP LoB & Industry Applications
Custom Applications
What is the R language?
An open source software language and environment for statistical computing and graphics with over 3000 add-on packages.
http://www.r-project.org/
The packages cover wide range topics -

Cluster Analysis & Finite Mixture Models

Probability Distributions

Computational Econometrics

Empirical Finance

Statistical Genetics

Graphic Displays, Dynamic Graphics, Graphic Devices & Visualisation

Machine Learning & Statistical Learning

Medical Image Analysis

Multivariate Statistics

Natural Language Processing

Statistics for the Social Sciences

Time Series Analysis

16. © 2013 SAP AG. All rights reserved. 16
The Predictive Analysis Library in SAP HANA Functional Overview
The Predictive Analysis Library (PAL) is a built-in C++ library to perform in-database data mining and statistical calculations, designed to provide excellent performance on large data sets.
Embedded in SAP HANA via the Application Function Library
Data Preparation

Sampling

Binning

Scaling

Convert Categorical to Binary
Outlier Detection

Inter-Quartile Range Test (Tukey’s Test)

Variance Test

Anomaly Detection
Cluster Analysis
ABC Classification
DBSCAN
K-Means
Kohonen Self Organized Maps
Time Series Analysis

Single Exponential Smoothing

Double Exponential Smoothing

Triple Exponential Smoothing
Link Prediction

Common Neighbours; Jaccard’s Coefficient; Adamic/Adar; Katzβ
Other

Weighted Scores Table
Classification Analysis

C4.5 Decision Tree Analysis

CHAID Decision Tree Analysis

K Nearest Neighbour

Multiple Linear Regression

Polynomial Regression

Exponential Regression

Bi-Variate Geometric Regression

Bi-Variate Logarithmic Regression

Logistic Regression

Naïve Bayes
Association Analysis
Apriori
Apriori Lite
Y
X
Z
Status: SAP HANA SPS6.

17. © 2013 SAP AG. All rights reserved. 17
Application Function Modeler
Application Function Modeler

A graphical editor to facilitate a faster and easier design-time process of creating the wrapper-procedures

AFL Models are stored as repository objects and can easily be re-used as part of development workflow.
Library Selection
Function List and Search
Parameters and specifications for table types
Model Editor

Drag‘n drop of functions

Template for table types

Data source selection and automatic mappings to table types
Sample SQL for procedure consumption

18. © 2013 SAP AG. All rights reserved. 18
The Predictive Analysis Library in SAP HANA Application Function Library (AFL) Architecture
Application Functions (C++)
SQLScript
HANA Clients (App Server, Analytics Technology, etc)
SAP HANA
Business Function Library
Predictive Analysis Library
AFL Framework
…
AFL Technology includes
Application Functions

Written in C++ and delivered as AFL content by SAP

Predictive Analysis and Business Function Library have been released in SPS05 as AFL content
AFL Framework
On demand library loading framework for registered and supported libraries

AFL are consumed for use from SqlScript via so-called wrapper-procedures. Consumption can be controlled via permissions.

Beyond the initial script-based approach, the Application Function Modeler is released with SPS06 as a graphical editor to facilitate the design-time process of creating the wrapper-procedures and can easily be re-used as part of development workflow.
Parameter Table
AFM

19. © 2013 SAP AG. All rights reserved. 20
SAP HANA (DRAM)
Operational ad-hoc analytics and monitoring Real-time insight into the in-the-moment business situations

Accelerate business decisions Provide vision across entire business process

Empower front-line employees Provide POS data analysis as interactive session with drill-down information

Implement real-time fraud detection, risk management and monitoring
Pricing
Accounting
Customers
Forecasting
Planning
Channel
Inventory
Products
Suppliers
Customer Service
Finance and Operations
Account Administration
•
OLTP + OLAP Processing
•
SAP HANA Live
•
SAP smart data access – data virtualization
•
Real-time data integration (Replication, Streaming)
•
Unified data modeling
•
Single-query access to data
Deployed as Datamart

20. © 2013 SAP AG. All rights reserved. 21
Big Data Warehousing and Big Data Apps drive big business Deeper insights into customer needs and wants

Extract value from big data Bring together the power of in-memory, Hadoop, predictive, text mining and spatial analytics

Dramatically improved performance for decision making from variety and volumes of structured and unstructured data

Create a logical data warehouse to respond to changing business environment
•
Hadoop/R Integration
•
Text Search, Analytics, NLP
•
Geospatial Processing
•
SAP HANA smart data access
•
BW & SAP Sybase IQ
•
In-DB Predictive Analytics
Brand Sentiment
:-)
Predictive Maintenance
Network Optimization
Insider Threats
Risk Mitigation, Real-time
Asset Tracking
360O Customer View
Propensity to Churn
Personalized Care
Product Recommendation
Real-time Demand/ Supply Forecast
Fraud Detection
SAP HANA PLATFORM

21. © 2013 SAP AG. All rights reserved. 22

File Filtering

Unlock text from binary documents

Ability to extract and process unstructured text data from various file formats (txt, html, xml, pdf, doc, ppt, xls, rtf, msg)

Load binary, flat, and other documents directly into HANA for native text search and analysis

Native Text Analysis

Give structure to unstructured textual content

Expose linguistic markup for text mining uses

Classify entities (people, companies, things, etc.)

Identify domain facts (sentiments, topics, requests, etc.)

Supports up to 31 languages for linguistic mark-up and extraction dictionary and 11 languages for predefined core extractions
SAP HANA Text Search & Analysis Extract information from documents. Perform text analysis on unstructured data
SAP HANA Text Analysis

22. © 2013 SAP AG. All rights reserved. 23
SAP HANA Full-Text Search Architecture
SAP HANA
HANA Search UI Search UI configured with the Info Access (InA) toolkit for HTML5 running natively on SAP HANA
Apps on HANA
Applications on any platform using SQL via ODBC/JDBC
Store
Tables
Engines
Search Engine
Analytic Engine
Extended Application Services
SQL, MDX
HANA App built with SAP UI5
Application running natively on / against SAP HANA
Preprocessor
Linguistic Processing
Entity, Fact Extraction
Metadata
Model
SAP HANA Studio
Modeler, Dev. Workbench
Info Access (InA) Service
server-side JS, OData
HANA App
Custom application leveraging SAP HANA search capabilities
Full-Text Indexing, Text Analysis
Modeling, Search Rule Sets
Full-Text search via SQL
SAP HANA Info Access (InA) toolkit, SInA API for JavaScript

23. © 2013 SAP AG. All rights reserved. 24
SAP HANA Spatial Processing Develop and deploy spatially-enabled analytics and applications
Transaction Data
Unstructured Data
Location Data
Machine Data
SAP HANA
Analytics
Applications
Visualization
GIS
SAP Info Access (HTML 5)
Mobility
REAL-TIME DATA
SPATIAL DATA
BUSINESS DATA
OLTP
Analytics
Planning
Predictive
Text
Spatial
Geo- Services
Geo- Content
Columnar Spatial Processing
Calc Model / Views
Spatial Functions
Spatial Data Types
Real-time high-performance spatial processing
Store, process, manipulate, retrieve and share spatial data
Unified modeling platform
Combine spatial with business data
Geo-content and services

24. © 2013 SAP AG. All rights reserved. 25
Capabilities:

SAP HANA spatial application development components include: Location Services (on- premises or cloud), Geo-Content, Application Interfaces, Services

Allows for visualization, interaction, and exploration of spatial data in SAP HANA via maps

Supports HTML5 deployments for browser or iPad

Consumes SAP HANA models

NOT a general purpose BI or GIS tool!
Benefits:
Quick development and deployment time
Low TCO & TCD and fast response times with 2- tier architecture
Components, content, and services included with SAP HANA; can also use other map svcs
SAP HANA Spatial Application Development
Quickly develop and deploy SAP HANA based spatial applications with provided geo-content and map services via the native XS engine
SAP HANA XS
iPad/ Browser
SAP HANA
HTML5 Application
Location Services
Maps
Geo-
coding
Services
Spatial
Engine
Geo- content

25. © 2013 SAP AG. All rights reserved. 26
Referencias SAP HANA
SAP HANA on AWS Cloud
•
Amazon Web Services – SAP HANA (http://aws.amazon.com/sap/saphana/)
Documentación
•
Manuales, información técnica, guías, información de desarrollo de applicaciones. (http://help.sap.com/hana_platform/)
•
Informacion general, SAP HANA Marketplace, foro, demos. (http://www.saphana.com/)
Comunidades
•
SCN - SAP HANA and In-Memory Computing (http://scn.sap.com/community/hana-in- memory)
•
SCN - SAP HANA Developer Center (http://scn.sap.com/community/developer- center/hana)
Capacitación y cursos
•
openSAP – Introduction to SAP HANA Software Development (https://open.sap.com/course/hana1)

26. Gracias !
Flavio Corradini
HANA Center of Excellence Leader
Latin America
flavio.corradini@sap.com