SlideShare a Scribd company logo
1 of 19
Download to read offline
REAL-TIME
DECISION ENGINES
REACT TO YOUR BUSINESS WHEN IT SPEAKS TO YOU
ALEX PIERMATTEO
SERGIO SPINATELLI
2
Data Reply
Supports you in becoming Data-Driven with Cloud & Open-Source
Data & ML Engineering3
Data Platforms & Cloud
Solutions1
Event-Driven & Streaming
Applications2
Services
§ Enabling Customers to become Data-Driven by providing state of
the art Architectures and Applications focusing on Distributed &
Cloud technologies
§ Architecture and Development of Big Data Applications, Services
and Infrastructure, such as Data Platforms, Real-Time Decision
Engines and Machine Learning Applications
§ Providing highly automated, scalable and customised solutions
matching the client's needs
§ Build and Automate Machine Learning & Analytics Applications
for constantly delivering value
3
Event-Driven & Streaming Applications
We can support you in building efficient and scalable real-time
applications & microservices, based on modern streaming and
event-driven frameworks
§ Real-Time Decision Engines
§ Streaming Data Processing & Analytics
§ Real-Time Visualizations
§ Event-Sourcing for Business Applications
§ Chat-Bots & Cloud Native Applications
§ Technologies:
Apache Kafka, Confluent Platform, Kafka Streams, Apache Flink,
ksqlDB, AWS Kinesis, Azure EventHub, Google PubSub,
Serverless Functions, Redis, Kubernetes
Focus Area
Services
Sergio Spinatelli
Business Unit Manager
Architect
Alex Piermatteo
Business Unit Manager
Architect
REAL-TIME
DECISION ENGINES
Event-Driven Systems
The foundation for a new mindset
Based on Events: “significant changes of state”
§ A customer buys a product, a car’s tire pressure changes, a user clicks on a website button,
a passenger checks in
Events can be streamed from the systems recording or producing them (with Kafka!) to be made
available in real-time
Once events are available, they can drive new Business Value, because being Event-Driven means
being:
§ Actionable:
§ Events can trigger well defined actions (or chain of actions) like upselling, cross-
selling, notifications..
§ Relevant and Meaningful:
§ Reacting to events allows the action to be relevant in the context of the user and more
meaningful for them
§ Real-Time:
§ Actions performed in real-time instead of days later can improve customer satisfaction,
reduce risk and reduce costs
Real-Time Decision Engines
A smart way to use Events
Out in the wild: Organisations make decisions around stale and often inaccurate information
Real-Time Decision Engines turn real-time data into real-time action:
1. Provision of information in context and integrated with the decision work-flow in real-time
2. Ability of an organization to make then operational and business choices based on the most current data
3. Leveraging Situational Awareness to perform the most informed, accurate and fast decision on what action to take
Fast reaction times to real-world business events bring
new use cases:
§ Improving customer experience
§ Recognizing risk quickly
§ Acting on information as soon as it is available
§ Avoid mistakes due to outdated data
Real-Time Decision Engines
Key steps to building one
It's an iterative process based on a Microservice approach where each additional developed service provides a new set of features:
1. Start integrating key real-time data sources to create your Context information
• E.g.: customer information, permissions, last actions of a customer, interactions made with the customer, ..
2. Build services able to create Queryable "materialized views" of this context information
3. Integrate additional real-time Events which will drive your Actions and trigger your Business Logic
4. Deliver a use case able to get your Events as input and based on the most up to date contextual information decide in real-time what
Actions to perform
5. The Real-Time Decision Engine should be highly configurable, reusable and easy to extend
6. Add more contextual information (microservices + additional sources) as you need it for new use cases or to improve the precision of
your current RTDE ecosystem
Real-Time Decision Engines
Pattern 1 – Basic Flow
§ Any part of the architecture can be developed ad hoc based on
custom requirements
§ Due to its Event-Driven nature, the architecture can scale from
low to high volumes of events
§ The System matches every Event with the Real-Time Context
information to understand what to do
§ The Event-Based nature of the system makes the definitions of
the Decision Rules easy to make and understand
§ Each service in the Context layer can be reused for different use
cases
§ The microservice and decoupled approach makes the
architecture easy to extend with new features and tools
Real-Time Decision Engines
Pattern 2 – Batch Flow integration
§ The previous architecture can be adapted and used also for Use
Cases that are not exactly Event-Driven but are driven by some
particular Segmentation on top of the entire Context Dataset
§ In this case the entire Context can be included as a real-time
Golden Record in an OLAP/Data Grid system where the
filtering can run on top to define new Actions
§ The Segmentation is also distributed and can scale accordingly
with the Context Dataset size
Real-Time Decision Engines
Pattern 3 – Feedback loop to fuel further Decisions
§ The final "evolution" of an RTDE is the inclusion
in the Engine of the results coming back from the
generated Actions
§ This information can be processed to extend the
Real-Time Context of the Engine and used again
from the RTDE Layer to make even more precise
decisions
§ The results of the decisions can be also included
in Real-Time Visualization tools
RTDE INDUSTRY
EXAMPLES
RTDEs in the Telecommunications Industry
Common Applications and Use Cases
Example Use CasesTypical Data Sources
§ Network & infrastructure sensor data
§ Subscription data
§ Customer data
§ Consumption data
§ Sales data
§ Sales channel information and privacy constraints/permissions
§ Engagement and interaction data
§ Location data
§ Real-Time marketing campaigns
§ Cross-channel
§ Up-selling
§ Cross-selling
§ Location based
§ Network & infrastructure anomaly detection and alerting
§ Real-Time Customer 360
§ Real-Time Customer satisfaction feedback collection
§ Real-Time credit score check & subscription risk mitigation
13
Real-Time Marketing Campaigning and Next Best Offer
Telecommunication – Event-Driven & Streaming Applications
In order to generate personalized extension Offers to drive
profits, reduce costs and perform more accurate marketing
when the End Users hit their data plan limits, a migration from a
previous ETL-based marketing logic to a Real-Time Decision
Engine able to quickly react to business events was performed
Approach and achieved results
§ Development of a Real-Time Decision Engine able to generate a
personalized offer in seconds based on real-time information of
the End Users
§ Migration of all the previous Throttle Events Campaigns from
batch to a near-real-time fashion: The End Users of the Telco
Customer receive a new offer in seconds after they reach their
data volume threshold
§ Improved accuracy due to the usage of real-time information:
previously the Customer based the offers for its End User on 3-
day old data
Key Facts
§ Next Best offer within 5s of trigger event
§ 20k SMS per day to customers for main Brand
§ 15 Campaigns running after 6 month, 30 after 9 months
§ Errors percentage with the Marketing offers went down from
10% to 0.1% after the migration based on customers real-time
data
§ Cost reduction due to the dismission of some old licenses not
required anymore
Use case visualization
Use Case Overview
Business Goal
RTDEs in the Banking & Insurance Industries
Common Applications and Use Cases
Example Use CasesTypical Data Sources
Banking
§ Transaction data
§ Account data
§ Customer data
§ Loan data and credit score
§ Stock exchange data
§ Mobile phone location (e.g. mobile payments)
Insurance
§ Policy data
§ Customer data
§ Account data
§ Location and sensor data
Banking
§ Real-Time fraud detection and Contextual payment verification
§ Faster Account verification
§ Real-Time security breach detection
§ Shorter Loan decision times
§ Customized trading suggestions
§ Real-Time mobile app operations
§ ChatBot for customers to perform routine actions
Insurance
§ Shorter Policy approval decision times
§ Real-Time upselling and cross-selling
§ Real-Time checks for coverage and notifications
§ Real-Time security breach detection
§ ChatBots for customer support and performing actions on policies
15
Microservice-based Banking Middleware
Banking – Event-Driven & Streaming Applications
Business Goal
In order to process transactions and customer data in a scalable
and resilient way and to replace a legacy system integrating a
diverse ecosystem of internal and external banking systems, an
event-driven middleware was developed
Approach and achieved results
§ Integration and communication with systems of external partner
companies was achieved in a secure manner
§ Integration of internal core banking systems was achieved, and
the end-to-end integration allowed for fast data and transaction
flows
§ End-to-End solution using a microservice and event-driven
approach for scalability and resiliency
Key Facts
§ Greenfield project brought to a production-ready state in 4 months
§ Integrated and harmonized services and systems with substantial
differences in communication interfaces and approaches
§ Orchestrated 40 different workflows, including monetary
transactions
Use case visualization
Use case overview
RTDEs in the Media Industry
Common Applications and Use Cases
Example Use CasesTypical Data Sources
§ Content consumption data: what, when, who, ..
§ Advertisement and tracking data
§ EPG data for live TV
§ Subscription data
§ User demographic data
§ Content metadata (movie title, TV-program name, radio program
type..)
§ Clickstream data (online)
§ Real-Time:
§ Marketing campaigns
§ Content recommendations and cross-selling
§ Advertisement selection and placement
§ Churn analysis and prevention
§ Payment fraud detection
§ Payment method suggestion
§ Customer 360
17
Video Stream Event Analysis & Processing
Media – Event-Driven & Streaming Applications
Business Goal
To improve viewer experience and enforce restrictions in real-
time, a real-time decisioning engine based on video stream
events was needed, able to perform actions and take decisions
according to specific business logic
Approach and achieved results
§ End-to-End solution with frontend device data generation, ingestion,
stream processing applications and data analysis, enabling:
§ Concurrent Streams Block: real-time block of account sharing
§ Trending Content: real-time computation of what content (Video-
on-Demand or Live TV) is currently popular, to be automatically
highlighted to the users in the frontends
§ Analysis of video view sessions and event tracking: real-time
detection, tracking and and analysis of user viewing sessions,
integrated into the tracking and clickstream analytics
§ Resume Position: a more precise and up to date resume
position is computed and can be used to continue playback at a
later point in time
Key Facts
§ Go-Live after 3 months
§ Enforcements of user limitations in seconds
§ Accurate trending content near-real time on the main page for
better content discovery (incl. live events)
§ Improved video view session tracking
§ More accurate resume position after stop, e.g. on turning off the tv
Use case visualization
Use Case Overview
Q&A
SEE YOU AT THE CSE ROUNDTABLE!

More Related Content

What's hot

Designing ETL Pipelines with Structured Streaming and Delta Lake—How to Archi...
Designing ETL Pipelines with Structured Streaming and Delta Lake—How to Archi...Designing ETL Pipelines with Structured Streaming and Delta Lake—How to Archi...
Designing ETL Pipelines with Structured Streaming and Delta Lake—How to Archi...
Databricks
 

What's hot (20)

Top 5 Event Streaming Use Cases for 2021 with Apache Kafka
Top 5 Event Streaming Use Cases for 2021 with Apache KafkaTop 5 Event Streaming Use Cases for 2021 with Apache Kafka
Top 5 Event Streaming Use Cases for 2021 with Apache Kafka
 
GCP for Apache Kafka® Users: Stream Ingestion and Processing
GCP for Apache Kafka® Users: Stream Ingestion and ProcessingGCP for Apache Kafka® Users: Stream Ingestion and Processing
GCP for Apache Kafka® Users: Stream Ingestion and Processing
 
Observability for Data Pipelines With OpenLineage
Observability for Data Pipelines With OpenLineageObservability for Data Pipelines With OpenLineage
Observability for Data Pipelines With OpenLineage
 
Open core summit: Observability for data pipelines with OpenLineage
Open core summit: Observability for data pipelines with OpenLineageOpen core summit: Observability for data pipelines with OpenLineage
Open core summit: Observability for data pipelines with OpenLineage
 
Everything You wanted to Know About Distributed Tracing
Everything You wanted to Know About Distributed TracingEverything You wanted to Know About Distributed Tracing
Everything You wanted to Know About Distributed Tracing
 
Introduction to YARN and MapReduce 2
Introduction to YARN and MapReduce 2Introduction to YARN and MapReduce 2
Introduction to YARN and MapReduce 2
 
Serverless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
Serverless Kafka and Spark in a Multi-Cloud Lakehouse ArchitectureServerless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
Serverless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
 
Streaming Data Lakes using Kafka Connect + Apache Hudi | Vinoth Chandar, Apac...
Streaming Data Lakes using Kafka Connect + Apache Hudi | Vinoth Chandar, Apac...Streaming Data Lakes using Kafka Connect + Apache Hudi | Vinoth Chandar, Apac...
Streaming Data Lakes using Kafka Connect + Apache Hudi | Vinoth Chandar, Apac...
 
Spark graphx
Spark graphxSpark graphx
Spark graphx
 
Designing ETL Pipelines with Structured Streaming and Delta Lake—How to Archi...
Designing ETL Pipelines with Structured Streaming and Delta Lake—How to Archi...Designing ETL Pipelines with Structured Streaming and Delta Lake—How to Archi...
Designing ETL Pipelines with Structured Streaming and Delta Lake—How to Archi...
 
OpenTelemetry For Operators
OpenTelemetry For OperatorsOpenTelemetry For Operators
OpenTelemetry For Operators
 
Introduction to Apache Flink - Fast and reliable big data processing
Introduction to Apache Flink - Fast and reliable big data processingIntroduction to Apache Flink - Fast and reliable big data processing
Introduction to Apache Flink - Fast and reliable big data processing
 
Re-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and SparkRe-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and Spark
 
Stream Processing – Concepts and Frameworks
Stream Processing – Concepts and FrameworksStream Processing – Concepts and Frameworks
Stream Processing – Concepts and Frameworks
 
Sentiment Analysis
Sentiment AnalysisSentiment Analysis
Sentiment Analysis
 
Stream processing with Apache Flink (Timo Walther - Ververica)
Stream processing with Apache Flink (Timo Walther - Ververica)Stream processing with Apache Flink (Timo Walther - Ververica)
Stream processing with Apache Flink (Timo Walther - Ververica)
 
Delta from a Data Engineer's Perspective
Delta from a Data Engineer's PerspectiveDelta from a Data Engineer's Perspective
Delta from a Data Engineer's Perspective
 
Flink powered stream processing platform at Pinterest
Flink powered stream processing platform at PinterestFlink powered stream processing platform at Pinterest
Flink powered stream processing platform at Pinterest
 
Dynamic Rule-based Real-time Market Data Alerts
Dynamic Rule-based Real-time Market Data AlertsDynamic Rule-based Real-time Market Data Alerts
Dynamic Rule-based Real-time Market Data Alerts
 
Real-time Freight Visibility: How TMW Systems uses NiFi and SAM to create sub...
Real-time Freight Visibility: How TMW Systems uses NiFi and SAM to create sub...Real-time Freight Visibility: How TMW Systems uses NiFi and SAM to create sub...
Real-time Freight Visibility: How TMW Systems uses NiFi and SAM to create sub...
 

Similar to Data reply sneak peek: real time decision engines

Project Deliverable 4 Analytics, Interfaces, and Cloud Technolo.docx
Project Deliverable 4 Analytics, Interfaces, and Cloud Technolo.docxProject Deliverable 4 Analytics, Interfaces, and Cloud Technolo.docx
Project Deliverable 4 Analytics, Interfaces, and Cloud Technolo.docx
wkyra78
 

Similar to Data reply sneak peek: real time decision engines (20)

Real time data integration best practices and architecture
Real time data integration best practices and architectureReal time data integration best practices and architecture
Real time data integration best practices and architecture
 
DAC Tekiō by DAC Software Solutions Ltd.
DAC Tekiō by DAC Software Solutions Ltd.DAC Tekiō by DAC Software Solutions Ltd.
DAC Tekiō by DAC Software Solutions Ltd.
 
DataArt Financial Services and Capital Markets
DataArt Financial Services and Capital MarketsDataArt Financial Services and Capital Markets
DataArt Financial Services and Capital Markets
 
Apache Kafka® Use Cases for Financial Services
Apache Kafka® Use Cases for Financial ServicesApache Kafka® Use Cases for Financial Services
Apache Kafka® Use Cases for Financial Services
 
Project Deliverable 4 Analytics, Interfaces, and Cloud Technolo.docx
Project Deliverable 4 Analytics, Interfaces, and Cloud Technolo.docxProject Deliverable 4 Analytics, Interfaces, and Cloud Technolo.docx
Project Deliverable 4 Analytics, Interfaces, and Cloud Technolo.docx
 
Business and Data in motion
Business and Data in motionBusiness and Data in motion
Business and Data in motion
 
bpm3.1-era-fast-data-04
bpm3.1-era-fast-data-04bpm3.1-era-fast-data-04
bpm3.1-era-fast-data-04
 
EastWest Ageas Life Insurance – Insurer Transformation Award 2023
EastWest Ageas Life Insurance – Insurer Transformation Award 2023EastWest Ageas Life Insurance – Insurer Transformation Award 2023
EastWest Ageas Life Insurance – Insurer Transformation Award 2023
 
Data Analytics in Digital Transformation
Data Analytics in Digital TransformationData Analytics in Digital Transformation
Data Analytics in Digital Transformation
 
Business in Motion with Data at Rest
Business in Motion with Data at RestBusiness in Motion with Data at Rest
Business in Motion with Data at Rest
 
Oi
OiOi
Oi
 
ANZ C-Level Roundtable
ANZ C-Level RoundtableANZ C-Level Roundtable
ANZ C-Level Roundtable
 
Five performance factors you need to know about in 2018
Five performance factors you need to know about in 2018Five performance factors you need to know about in 2018
Five performance factors you need to know about in 2018
 
Transforming Financial Services with Event Streaming Data
Transforming Financial Services with Event Streaming DataTransforming Financial Services with Event Streaming Data
Transforming Financial Services with Event Streaming Data
 
APAC Exec Roundtable
APAC Exec Roundtable APAC Exec Roundtable
APAC Exec Roundtable
 
Cloud 2020: taking your customers into the future - Peter Schwartz Avanxo Clo...
Cloud 2020: taking your customers into the future - Peter Schwartz Avanxo Clo...Cloud 2020: taking your customers into the future - Peter Schwartz Avanxo Clo...
Cloud 2020: taking your customers into the future - Peter Schwartz Avanxo Clo...
 
New Analytic Uses of Master Data Management in the Enterprise
New Analytic Uses of Master Data Management in the EnterpriseNew Analytic Uses of Master Data Management in the Enterprise
New Analytic Uses of Master Data Management in the Enterprise
 
Big Data, Big Rewards
Big Data, Big RewardsBig Data, Big Rewards
Big Data, Big Rewards
 
BIG DATA, BIG REWARDS
BIG DATA, BIG REWARDSBIG DATA, BIG REWARDS
BIG DATA, BIG REWARDS
 
Week 3 Case 1 : Big Data Big Reward
Week 3 Case 1 :  Big Data Big RewardWeek 3 Case 1 :  Big Data Big Reward
Week 3 Case 1 : Big Data Big Reward
 

More from confluent

More from confluent (20)

Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
 
Santander Stream Processing with Apache Flink
Santander Stream Processing with Apache FlinkSantander Stream Processing with Apache Flink
Santander Stream Processing with Apache Flink
 
Unlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insightsUnlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insights
 
Workshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con FlinkWorkshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con Flink
 
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
 
AWS Immersion Day Mapfre - Confluent
AWS Immersion Day Mapfre   -   ConfluentAWS Immersion Day Mapfre   -   Confluent
AWS Immersion Day Mapfre - Confluent
 
Eventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalkEventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalk
 
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent CloudQ&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
 
Citi TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep DiveCiti TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep Dive
 
Build real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with ConfluentBuild real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with Confluent
 
Q&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service MeshQ&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service Mesh
 
Citi Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka MicroservicesCiti Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka Microservices
 
Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3
 
Citi Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging ModernizationCiti Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging Modernization
 
Citi Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time dataCiti Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time data
 
Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2
 
Data In Motion Paris 2023
Data In Motion Paris 2023Data In Motion Paris 2023
Data In Motion Paris 2023
 
Confluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with SynthesisConfluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with Synthesis
 
The Future of Application Development - API Days - Melbourne 2023
The Future of Application Development - API Days - Melbourne 2023The Future of Application Development - API Days - Melbourne 2023
The Future of Application Development - API Days - Melbourne 2023
 
The Playful Bond Between REST And Data Streams
The Playful Bond Between REST And Data StreamsThe Playful Bond Between REST And Data Streams
The Playful Bond Between REST And Data Streams
 

Recently uploaded

CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female serviceCALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
anilsa9823
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
mohitmore19
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
Health
 

Recently uploaded (20)

Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
 
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female serviceCALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS LiveVip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
Diamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with PrecisionDiamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with Precision
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf
 
Right Money Management App For Your Financial Goals
Right Money Management App For Your Financial GoalsRight Money Management App For Your Financial Goals
Right Money Management App For Your Financial Goals
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
 

Data reply sneak peek: real time decision engines

  • 1. REAL-TIME DECISION ENGINES REACT TO YOUR BUSINESS WHEN IT SPEAKS TO YOU ALEX PIERMATTEO SERGIO SPINATELLI
  • 2. 2 Data Reply Supports you in becoming Data-Driven with Cloud & Open-Source Data & ML Engineering3 Data Platforms & Cloud Solutions1 Event-Driven & Streaming Applications2 Services § Enabling Customers to become Data-Driven by providing state of the art Architectures and Applications focusing on Distributed & Cloud technologies § Architecture and Development of Big Data Applications, Services and Infrastructure, such as Data Platforms, Real-Time Decision Engines and Machine Learning Applications § Providing highly automated, scalable and customised solutions matching the client's needs § Build and Automate Machine Learning & Analytics Applications for constantly delivering value
  • 3. 3 Event-Driven & Streaming Applications We can support you in building efficient and scalable real-time applications & microservices, based on modern streaming and event-driven frameworks § Real-Time Decision Engines § Streaming Data Processing & Analytics § Real-Time Visualizations § Event-Sourcing for Business Applications § Chat-Bots & Cloud Native Applications § Technologies: Apache Kafka, Confluent Platform, Kafka Streams, Apache Flink, ksqlDB, AWS Kinesis, Azure EventHub, Google PubSub, Serverless Functions, Redis, Kubernetes Focus Area Services Sergio Spinatelli Business Unit Manager Architect Alex Piermatteo Business Unit Manager Architect
  • 5. Event-Driven Systems The foundation for a new mindset Based on Events: “significant changes of state” § A customer buys a product, a car’s tire pressure changes, a user clicks on a website button, a passenger checks in Events can be streamed from the systems recording or producing them (with Kafka!) to be made available in real-time Once events are available, they can drive new Business Value, because being Event-Driven means being: § Actionable: § Events can trigger well defined actions (or chain of actions) like upselling, cross- selling, notifications.. § Relevant and Meaningful: § Reacting to events allows the action to be relevant in the context of the user and more meaningful for them § Real-Time: § Actions performed in real-time instead of days later can improve customer satisfaction, reduce risk and reduce costs
  • 6. Real-Time Decision Engines A smart way to use Events Out in the wild: Organisations make decisions around stale and often inaccurate information Real-Time Decision Engines turn real-time data into real-time action: 1. Provision of information in context and integrated with the decision work-flow in real-time 2. Ability of an organization to make then operational and business choices based on the most current data 3. Leveraging Situational Awareness to perform the most informed, accurate and fast decision on what action to take Fast reaction times to real-world business events bring new use cases: § Improving customer experience § Recognizing risk quickly § Acting on information as soon as it is available § Avoid mistakes due to outdated data
  • 7. Real-Time Decision Engines Key steps to building one It's an iterative process based on a Microservice approach where each additional developed service provides a new set of features: 1. Start integrating key real-time data sources to create your Context information • E.g.: customer information, permissions, last actions of a customer, interactions made with the customer, .. 2. Build services able to create Queryable "materialized views" of this context information 3. Integrate additional real-time Events which will drive your Actions and trigger your Business Logic 4. Deliver a use case able to get your Events as input and based on the most up to date contextual information decide in real-time what Actions to perform 5. The Real-Time Decision Engine should be highly configurable, reusable and easy to extend 6. Add more contextual information (microservices + additional sources) as you need it for new use cases or to improve the precision of your current RTDE ecosystem
  • 8. Real-Time Decision Engines Pattern 1 – Basic Flow § Any part of the architecture can be developed ad hoc based on custom requirements § Due to its Event-Driven nature, the architecture can scale from low to high volumes of events § The System matches every Event with the Real-Time Context information to understand what to do § The Event-Based nature of the system makes the definitions of the Decision Rules easy to make and understand § Each service in the Context layer can be reused for different use cases § The microservice and decoupled approach makes the architecture easy to extend with new features and tools
  • 9. Real-Time Decision Engines Pattern 2 – Batch Flow integration § The previous architecture can be adapted and used also for Use Cases that are not exactly Event-Driven but are driven by some particular Segmentation on top of the entire Context Dataset § In this case the entire Context can be included as a real-time Golden Record in an OLAP/Data Grid system where the filtering can run on top to define new Actions § The Segmentation is also distributed and can scale accordingly with the Context Dataset size
  • 10. Real-Time Decision Engines Pattern 3 – Feedback loop to fuel further Decisions § The final "evolution" of an RTDE is the inclusion in the Engine of the results coming back from the generated Actions § This information can be processed to extend the Real-Time Context of the Engine and used again from the RTDE Layer to make even more precise decisions § The results of the decisions can be also included in Real-Time Visualization tools
  • 12. RTDEs in the Telecommunications Industry Common Applications and Use Cases Example Use CasesTypical Data Sources § Network & infrastructure sensor data § Subscription data § Customer data § Consumption data § Sales data § Sales channel information and privacy constraints/permissions § Engagement and interaction data § Location data § Real-Time marketing campaigns § Cross-channel § Up-selling § Cross-selling § Location based § Network & infrastructure anomaly detection and alerting § Real-Time Customer 360 § Real-Time Customer satisfaction feedback collection § Real-Time credit score check & subscription risk mitigation
  • 13. 13 Real-Time Marketing Campaigning and Next Best Offer Telecommunication – Event-Driven & Streaming Applications In order to generate personalized extension Offers to drive profits, reduce costs and perform more accurate marketing when the End Users hit their data plan limits, a migration from a previous ETL-based marketing logic to a Real-Time Decision Engine able to quickly react to business events was performed Approach and achieved results § Development of a Real-Time Decision Engine able to generate a personalized offer in seconds based on real-time information of the End Users § Migration of all the previous Throttle Events Campaigns from batch to a near-real-time fashion: The End Users of the Telco Customer receive a new offer in seconds after they reach their data volume threshold § Improved accuracy due to the usage of real-time information: previously the Customer based the offers for its End User on 3- day old data Key Facts § Next Best offer within 5s of trigger event § 20k SMS per day to customers for main Brand § 15 Campaigns running after 6 month, 30 after 9 months § Errors percentage with the Marketing offers went down from 10% to 0.1% after the migration based on customers real-time data § Cost reduction due to the dismission of some old licenses not required anymore Use case visualization Use Case Overview Business Goal
  • 14. RTDEs in the Banking & Insurance Industries Common Applications and Use Cases Example Use CasesTypical Data Sources Banking § Transaction data § Account data § Customer data § Loan data and credit score § Stock exchange data § Mobile phone location (e.g. mobile payments) Insurance § Policy data § Customer data § Account data § Location and sensor data Banking § Real-Time fraud detection and Contextual payment verification § Faster Account verification § Real-Time security breach detection § Shorter Loan decision times § Customized trading suggestions § Real-Time mobile app operations § ChatBot for customers to perform routine actions Insurance § Shorter Policy approval decision times § Real-Time upselling and cross-selling § Real-Time checks for coverage and notifications § Real-Time security breach detection § ChatBots for customer support and performing actions on policies
  • 15. 15 Microservice-based Banking Middleware Banking – Event-Driven & Streaming Applications Business Goal In order to process transactions and customer data in a scalable and resilient way and to replace a legacy system integrating a diverse ecosystem of internal and external banking systems, an event-driven middleware was developed Approach and achieved results § Integration and communication with systems of external partner companies was achieved in a secure manner § Integration of internal core banking systems was achieved, and the end-to-end integration allowed for fast data and transaction flows § End-to-End solution using a microservice and event-driven approach for scalability and resiliency Key Facts § Greenfield project brought to a production-ready state in 4 months § Integrated and harmonized services and systems with substantial differences in communication interfaces and approaches § Orchestrated 40 different workflows, including monetary transactions Use case visualization Use case overview
  • 16. RTDEs in the Media Industry Common Applications and Use Cases Example Use CasesTypical Data Sources § Content consumption data: what, when, who, .. § Advertisement and tracking data § EPG data for live TV § Subscription data § User demographic data § Content metadata (movie title, TV-program name, radio program type..) § Clickstream data (online) § Real-Time: § Marketing campaigns § Content recommendations and cross-selling § Advertisement selection and placement § Churn analysis and prevention § Payment fraud detection § Payment method suggestion § Customer 360
  • 17. 17 Video Stream Event Analysis & Processing Media – Event-Driven & Streaming Applications Business Goal To improve viewer experience and enforce restrictions in real- time, a real-time decisioning engine based on video stream events was needed, able to perform actions and take decisions according to specific business logic Approach and achieved results § End-to-End solution with frontend device data generation, ingestion, stream processing applications and data analysis, enabling: § Concurrent Streams Block: real-time block of account sharing § Trending Content: real-time computation of what content (Video- on-Demand or Live TV) is currently popular, to be automatically highlighted to the users in the frontends § Analysis of video view sessions and event tracking: real-time detection, tracking and and analysis of user viewing sessions, integrated into the tracking and clickstream analytics § Resume Position: a more precise and up to date resume position is computed and can be used to continue playback at a later point in time Key Facts § Go-Live after 3 months § Enforcements of user limitations in seconds § Accurate trending content near-real time on the main page for better content discovery (incl. live events) § Improved video view session tracking § More accurate resume position after stop, e.g. on turning off the tv Use case visualization Use Case Overview
  • 18. Q&A
  • 19. SEE YOU AT THE CSE ROUNDTABLE!