Kai Wähner (@KaiWaehner) is a Technology Evangelist and Community Director at TIBCO Software - a leading provider of integration and analytics middleware. Kai is an experience guy in broad variety of topics like Big Data, Advanced Analytics & Machine Learning, he loves to write articles and blog about new technologies and make talks. The talk is about 3 different projects where Kai's team built analytic models with technologies R, Apache Spark or H2O.ai which were deployed to real time processing. The use cases include predictive maintenance in manufacturing but also fraud detection in banking and context-specific pricing in insurance. For one of the cases, Kai gonna show detailed steps will be, how it was built and deployed using supervised/unsupervised ML. Talk was done together with my colleague Ankitaa Bhowmick.

1. Kai Wähner
Technology Evangelist
kontakt@kai-waehner.de
LinkedIn
@KaiWaehner
www.kai-waehner.de
Predictive Analytics Meetup Frankfurt (January 2017)
Machine Learning Applied to Real Time Scoring in Manufacturing and Other Businesses
Ankitaa Bhowmick
Solution Consultant
abhowmic@tibco.com
LinkedIn

2. © Copyright 2000-2017 TIBCO Software Inc.
Apply Big Data Analytics to Real Time Processing

3. © Copyright 2000-2017 TIBCO Software Inc.
Agenda
1) Machine Learning and Big Data Analytics
2) Use Cases for Predictive Analytics
3) Predictive Maintenance (Energy Utilities)
4) Predictive Scrapping (Assembly Line)

4. © Copyright 2000-2017 TIBCO Software Inc.
Agenda
1) Machine Learning and Big Data Analytics
2) Use Cases for Predictive Analytics
3) Predictive Maintenance (Energy Utilities)
4) Predictive Scrapping (Assembly Line)

5. Machine Learning
…. allows computers to find hidden insights without being
explicitly programmed where to look.

6. Real World Examples of Machine Learning
Spam Detection
Search Results +
Product Recommendation
Picture Detection
(Friends, Locations, Products)
Machine Learning is already present in daily life…
Now, every enterprise is beginning to leverage it!
The Next Disruption:
Google Beats Go Champion

7. © Copyright 2000-2017 TIBCO Software Inc.
From Insight to Action - Closed Loop for Big Data Analytics
Insight ActionEVENTSEVENTS

8. © Copyright 2000-2017 TIBCO Software Inc.
From Insight to Action - Closed Loop for Big Data Analytics
Insight Action
MONITOR
PREDICT
ACT
DECIDE
MODEL
ACCESS
ANALYZE
WRANGLE

9. © Copyright 2000-2017 TIBCO Software Inc.
• Business User / Analyst
• Data Scientist
• Citizen Data Scientist
• Developer
User Roles
AI-DRIVEN VISUAL ANALYTICS
DATA DISCOVERY DASHBOARDS
DATA SCIENCE RE-IMAGINED
PREDICTIVE MACHINE LEARNING
STREAMING ANALYTICS
REAL TIME ACTIONABLE

10. © Copyright 2000-2017 TIBCO Software Inc.
Agenda
1) Machine Learning and Big Data Analytics
2) Use Cases for Predictive Analytics
3) Predictive Maintenance (Energy Utilities)
4) Predictive Scrapping (Assembly Line)

11. Banking – Fraud Detection
Anti-Money Laundering
(AML)
Trade Surveillance
Credit/Debit card
monitoring
Health Insurance
Fraud
Insurance Fraud Online Operations
Act proactively before the fraud happened…

12. © Copyright 2000-2017 TIBCO Software Inc.
Retailer – Cross Selling / Customer Satisfaction
Sale of Premium
Upgrade
Sale of Perishable
Goods
Increase of Customer
Satisfaction
Partner Network Additional Services
Complaint
Management
Capture – Engage – Expand - Monetize
Patterns – Real time
MORE PERSONAL
MORE CONTEXT
social
CRM
POS
mobileweb
e-mails
© Copyright 2000-2015 TIBCO Software Inc.

13. © Copyright 2000-2017 TIBCO Software Inc.
Insurance – Context-Specific Pricing
Premium Price Quote
Optimization
Customer Risk
Scoring
Act proactively before the customer left the website…

14. © Copyright 2000-2017 TIBCO Software Inc.
Telco – Detection of Anomalies before Network Outage
Act proactively before the outage happens…

15. © Copyright 2000-2017 TIBCO Software Inc.
Analyze and Act on Critical Business Moments

16. © Copyright 2000-2017 TIBCO Software Inc.
Agenda
1) Machine Learning and Big Data Analytics
2) Use Cases for Predictive Analytics
3) Predictive Maintenance (Energy Utilities)
4) Predictive Scrapping (Assembly Line)

17. © Copyright 2000-2017 TIBCO Software Inc.
Use case : Sensor based equipment monitoring
• Reduce non-productive time: Big $$$
• System reliability
• Optimal run-time / maintenance

18. 1A. Sensor Analytics – Leading Indicator
Trend Analysis
Combination of Rules
CUSUM Analysis
Statistical Analysis
Statistical Process Control
Machine Learning
Location Change
– Variable moves up or down
Slope Change
– Variable changes trend
Variance Change
– Variable becomes more/less volatile
Process Threshold
– Shewhart control chart
Failure Model
y (0/1) = f (X, b) + e; f = logistic regression, trees, svm, nnet, ...
© Copyright 2000-2015 TIBCO Software Inc.
Sensor Analytics – Leading Indicator Identification

19. 2. Find Leading
Indicators
3. Backtest
Rules / Models
4. Push
Rules / Models
to Event Server
1. Study
Anomalies
Sensor Analytics – Patterns in Historical Data

20. 1. Rules / models pushed from Spotfire
2. Data streams into StreamBase
3. Rules / models applied to streaming data
4. Notifications /Alerts
Email, SMS,
Spotfire RCA on trigger
Database, BPM, …
LiveView on streaming data
© Copyright 2000-2015 TIBCO Software Inc.
Sensor Analytics – Real-Time Surveillance

21. TIBCO Spotfire + R / TERR
Live DemoLive Demo

22. © Copyright 2000-2017 TIBCO Software Inc.
Agenda
1) Machine Learning and Big Data Analytics
2) Use Cases for Predictive Analytics
3) Predictive Maintenance (Energy Utilities)
4) Predictive Scrapping (Assembly Line)

23. Scenario: Predictive Scrapping of Parts in an Assembly Line
Goal: Scrap parts as early as possible automatically to reduce costs in a manufacturing process.
Question: When to scrap a part in Station 1 instead of doing re-work or sending it to Station 2?
Station 1 Station 2
Cost Before
9€
7€ 13€
Total Cost
29€
(or more)
Scrap? Scrap?

24. TIBCO Spotfire with H2O.ai Integration
© Copyright 2000-2017 TIBCO Software Inc.
Example: Predictive Analytics for Manufacturing (“scrap parts as early as possible”)

25. TIBCO Spotfire with H2O.ai Integration
© Copyright 2000-2017 TIBCO Software Inc.
Example: Predictive Analytics for Manufacturing (“scrap parts as early as possible”)

26. Fast Data Architecture for Predictive Maintenance
Operational Analytics
Operations
Live UI
CSV Batch
JSON Real Time
XML Real Time
Streaming AnalyticsAction
Aggregate
Rules
Analytics
Correlate
Live Datamart
Continuous query
processing
Alerts
Manual action,
escalation
HISTORICAL ANALYSIS Data
Scientists
Flume
HDFS
Spotfire
R / TERR
HDFS
Hadoop (Cloudera)
StreamBase
TIBCO Fast Data Platform
H2O
Oracle RDBMS
Avro Parquet … PMML
Internal Data

27. © Copyright 2000-2017 TIBCO Software Inc.
TIBCO StreamBase Connector for R and TERR

28. © Copyright 2000-2017 TIBCO Software Inc.
TIBCO StreamBase Connector for H2O.ai

29. © Copyright 2000-2017 TIBCO Software Inc.
TIBCO StreamBase Connector for PMML

30. TIBCO Spotfire with H2O Integration
Data Discovery / Data Mining (“Are parts that repeat a station more likely scrap parts?”)

31. TIBCO Live Datamart
Operational Intelligence (“Monitor the manufacturing process and change rules in real time!”)
Live Dartmart Desktop Client

32. TIBCO Live Datamart
Operational Intelligence (“Monitor the manufacturing process and change rules in real time!”)
Live Dartmart Web API

33. TIBCO Spotfire + StreamBase + H2O.ai + Live Datamart
Live DemoLive Demo

34. © Copyright 2000-2017 TIBCO Software Inc.
Key Take-Aways
Ø Insights are hidden in Historical Data on Big Data Platforms
Ø Machine Learning and Big Data Analytics find these Insights by building Analytics Models
Ø Event Processing uses these Models (without Redevelopment) to take Action in Real Time

35. Questions? Please contact me!
Kai Wähner
Technology Evangelist
kontakt@kai-waehner.de
LinkedIn
@KaiWaehner
www.kai-waehner.de
Ankitaa Bhowmick
Solution Consultant
abhowmic@tibco.com
LinkedIn