SlideShare une entreprise Scribd logo
1  sur  18
Télécharger pour lire hors ligne
Confluent Cloud – Data in Motion
06/10/2022
1
Confluent Cloud inside
the Digital
Transformation of
Autostrade per l’Italia
Confluent Cloud – Data in Motion
06/10/2022
Confluent Cloud – Data in Motion
06/10/2022
1. Company Presentation
2. ASPI Digital Transformation
3. The use of Kafka in ASPI
4. Confluent Cloud Migration
5. Next Steps
AGENDA
Confluent Cloud – Data in Motion
06/10/2022
3
2.855 km
of motorway in Italy
6,1 Billion €
+110% of investiments
in 2020/24 vs 2015/19
nearly 5.300
employees
204
Service Areas
1.907
Variable-message signs
along the network
4.991
cameras
3 Billion
€
of revenues Autostrade per l'Italia is one of Europe's leading
concessionaries for the construction and management
of toll motorways, with around 3,000 km of network
managed in Italy.
The Autostrade per l'Italia group includes five other
motorway concession companies and seven
companies that provide ancillary services to the core
motorway business and play a key role in
implementing the Company's transformation plan.
• Società Italiana
Traforo del Montebianco
• Raccordo Autostradale Valle d’Aosta
• Tangenziale di Napoli
• Autostrade Meridionali
• Società Autostradale Tirrenica
• Movyon
• Tecne
• Amplia Infrastructures
• Free-to-Experience
• Elgea
• Admoving
• Esse di Esse
• Giove clear
THE GROUP
THE COMPANY
2,5 Billion €
+60% of maint. costs
in 2020/24 vs 2015/19
Confluent Cloud – Data in Motion
06/10/2022
«Next To Digital» INITIATIVE
The Next To Digital initiative is included in the wide
Transformation Plan of Autostrade per l’Italia.
This initiative is the fundamental lever to guide and promote a
deep change in ASPI at multiple levels: new ways of working,
new technological capabilities, new skills to develop, new ways
of addressing all stakeholders (internal and external) and, finally, a
significant cultural change.
It concerns the digitalization of processes and services,
transformation of the road network into a "smart" infrastructure
through the most advanced technologies.
NtD initiative address these aims:
• Internal efficiency
• Civil infrastructure management and security
• Customer experience
200 Million €
of investment by 2024
+ 30 agile room
to develop End-to-End
innovative projects
Confluent Cloud – Data in Motion
06/10/2022
«Next To Digital» PROJECTS
Predictive models of traffic flows for planning construction sites
to minimize the impact on the road network (estimation of any
inconvenience caused and calculation of tariff discounts)
Real-time monitoring and alerting systems in relation to traffic
disruptions (e.g. road accidents) or road congestion on the network
due to:
- Proactive and dynamic management of lanes and speed limits
- Preventive deployment of traffic/rescue teams
New services for users: Recommended times for departure;
advance calculation of the toll; recommended restaurants,
attractions and places of interest along the route
Additional services in the service area (e.g. parking, "skip the line"
table reservation) and on the network (e.g. advance toll payment)
Digital communication channel between the customer and
Autostrade for distress alerts requests, complaints, assistance and
automatic processing of requests via Virtual Agent.
Confluent Cloud – Data in Motion
06/10/2022
Why Kafka?
• Become a Data Driven company
• Create a unique data layer to support Event Driven
architecture
• Eliminate Data Silos
• Provide Data Democratization through REST API
• Provide Standardization through JSON, AVRO
• Data Security with Zero Trust approach
Confluent Kafka has been chosen to accomplish Autostrade per l’Italia’s goals:
Confluent Cloud – Data in Motion
06/10/2022
Business Cases and Architecture
Confluent Cloud – Data in Motion
06/10/2022
Online Monitoring Traffic
GOAL
Monitor and analyze transit on tracks collected at toll booth in near real time.
HOW
RESULTS
Change-Data-Capture pattern of Confluent Cloud with 2 sync connectors.
• RAW data converted to JSON
formats for easier usability with
REST API
• Freshness of information for
end users
• Decoupling systems for less
overhead on DB2
Confluent Cloud – Data in Motion
06/10/2022
Electronic Toll enrichment
GOAL
Implementation of an on-cloud application that allows the management
of every aspect of the rectification traffic life cycle for users and special
users.
HOW
RESULTS
Raw Data is normalized and democratized through Kstream Java App
With Confluent Kafka, through the KStream we are able to deal with
data that was previously on silos to have a gain on data governance
on the outgoing DBMS.
Confluent Cloud – Data in Motion
06/10/2022
Integration Layer "CEM Impianti"
GOAL
Standardize the monitoring data and render them accessible via front end for reporting / monitoring activities.
HOW
RESULTS
Unique Integration Layer to collect data from OT Plants based on 3 steps:
• Mapping of monitoring data
• Data definition and Normalization
• Front-End for reporting and analytics
• Greater usability of data
• Reduced interventions time
• Best use of resources
• Reduction of low added value
activities
Confluent Cloud – Data in Motion
06/10/2022
PISTA 2.0
Most complex project based on Confluent Cloud (in evolution…)
GOAL
Refactoring of the message production and dispatching system from all the toll booths on the highway to a single Data Layer.
HOW
RESULTS
Provide a formal definition of the data using AVRO Schema, useful for:
• Manage information as a resource
• Create a process aimed at managing the data
• Data preparation and enrichment
• No use of DB for first ingestion of message acquisition
• Event Streaming – Ready
• Provide data detectability, monitoring and security
throughout its life cycle
Confluent Cloud – Data in Motion
06/10/2022
PISTA 2.0 Architecture
Confluent Cloud – Data in Motion
06/10/2022
13
13
Confluent Platform migration
to Confluent Cloud
Confluent Cloud – Data in Motion
06/10/2022
Migration to Confluent Cloud
SCENARIO
The migration from Confluent Platform to Confluent Cloud involved 15 Applications, mostly
based on collecting data from tracks and plants.
PROJECT
USE CASES
Autostrade per l’Italia started a multi-year modernization project that relies on the
transition from on-premise systems to Cloud platforms for increasing speed to
accomplish business requests and reduce low value-added activities.
• Pista 2.0 - First acquisition of transits and plate tracking on the toll booth
• Plants - Spooling of messages from suburbs to center
• TUTOR - collecting events
• Infoviability - collecting data from sensors on track
• Xmonit - Realtime monitoring and integration of plants
• FreeToX – Cashback system for customers
• Service Area – Smart services on the services area on the highway
Confluent Cloud – Data in Motion
06/10/2022
Confluent Platform
• 3 different environments on-premises
• Ansible playbooks for configurations
• Custom connectors
• Manage infrastructure for updates and develop new features
• Not scalable
• Storage tiering needed
• Managing Load Balancing for Kafka Brokers
ENVIRONMENTS
PROS
CONS
SVIL TEST PROD
Confluent Cloud – Data in Motion
06/10/2022
Confluent Cloud Architecture
ENVIRONMENTS
• Prod and noProd environments for data segregation
• Teampass as a Password Manager for Client API Keys & Secrets
• Zabbix as ASPI main Monitoring Platform
PROS
CONS
• 99.99% SLA
• Autoscaling
• No patching or planned maintenance
• Infinite Storage
• Easily connected via AWS Transit Gateway
• Users ACL: access to Control Center for Data Lineage view
• Kafka Connect onprem for custom use cases
Confluent Cloud – Data in Motion
06/10/2022
Next Steps
TRAFFIC PROJECT
IoT/MQTT
Refactoring of the functional perimeter, based on more than 70 applications, linked to the
collection and management of payments and transit data on the track. Main problems are:
• Highly interconnected area with strong dependencies between functional levels
• Highly standardized architectures based on legacy technologies and integration models (eg.: DB2,
db-to-db views).
• No API
• No Data Democratization
• No SecDevOps approach
• Solution: Confluent Cloud as single layer for Data acquisition & preparation.
Provide an enterprise platform for MQTT to manage messages from IoT devices and lay the
foundation for Event Driven Architecture.
• Main products identified: EMQX, HiveMQ, VerneMQ.
Confluent Cloud – Data in Motion
06/10/2022
18
THANK YOU
Confluent Cloud – Data in Motion
06/10/2022

Contenu connexe

Similaire à Confluent Cloud transforms ASPI's digital transformation

Forecast 2014: ODCA Board Best Practice: T-Systems
Forecast 2014: ODCA Board Best Practice: T-SystemsForecast 2014: ODCA Board Best Practice: T-Systems
Forecast 2014: ODCA Board Best Practice: T-SystemsOpen Data Center Alliance
 
Connectivité temps réel et bi-directionnelle ​ pour solutions IOT
Connectivité temps réel et bi-directionnelle ​ pour solutions IOTConnectivité temps réel et bi-directionnelle ​ pour solutions IOT
Connectivité temps réel et bi-directionnelle ​ pour solutions IOTSolace
 
Strategic Technical Presenation
Strategic Technical PresenationStrategic Technical Presenation
Strategic Technical PresenationStrategicProject
 
Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...
Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...
Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...CA Technologies
 
Cisco Connect Halifax 2018 Understanding Cisco's next generation sd-wan sol...
Cisco Connect Halifax 2018   Understanding Cisco's next generation sd-wan sol...Cisco Connect Halifax 2018   Understanding Cisco's next generation sd-wan sol...
Cisco Connect Halifax 2018 Understanding Cisco's next generation sd-wan sol...Cisco Canada
 
SCALES: Supply Chain Architecture Leading to Enhanced Services
SCALES: Supply Chain Architecture Leading to Enhanced Services SCALES: Supply Chain Architecture Leading to Enhanced Services
SCALES: Supply Chain Architecture Leading to Enhanced Services Fabio Massimi
 
Delivering Application Analytics for an Application Fluent Network
Delivering Application Analytics for an Application Fluent NetworkDelivering Application Analytics for an Application Fluent Network
Delivering Application Analytics for an Application Fluent NetworkBenjamin Eggerstedt
 
Why Ontario Government chose Equinix Cloud Exchange Connect
Why Ontario Government chose Equinix Cloud Exchange ConnectWhy Ontario Government chose Equinix Cloud Exchange Connect
Why Ontario Government chose Equinix Cloud Exchange ConnectMorgan Davidson
 
OSGi and Next Generation Trains - Jens Haeger, Deutsche Bahn
OSGi and Next Generation Trains - Jens Haeger, Deutsche BahnOSGi and Next Generation Trains - Jens Haeger, Deutsche Bahn
OSGi and Next Generation Trains - Jens Haeger, Deutsche Bahnmfrancis
 
Oracle Open World 2018 - Cloud Lift Accelerator Suite
Oracle Open World 2018 - Cloud Lift Accelerator SuiteOracle Open World 2018 - Cloud Lift Accelerator Suite
Oracle Open World 2018 - Cloud Lift Accelerator SuiteIke Aniagoh
 
Identifying Bottlenecks in Mobile Cloud Computing (MCC)
Identifying Bottlenecks in Mobile Cloud Computing (MCC)Identifying Bottlenecks in Mobile Cloud Computing (MCC)
Identifying Bottlenecks in Mobile Cloud Computing (MCC)Dr. Ranbijay Kumar
 
Confluent Partner Tech Talk with QLIK
Confluent Partner Tech Talk with QLIKConfluent Partner Tech Talk with QLIK
Confluent Partner Tech Talk with QLIKconfluent
 
Service Mesh: Two Big Words But Do You Need It?
Service Mesh: Two Big Words But Do You Need It?Service Mesh: Two Big Words But Do You Need It?
Service Mesh: Two Big Words But Do You Need It?DevOps.com
 
Cotendo Cloudlet Datasheet
Cotendo Cloudlet DatasheetCotendo Cloudlet Datasheet
Cotendo Cloudlet Datasheetgyanendra1
 
MF_OM_logistics_Final
MF_OM_logistics_FinalMF_OM_logistics_Final
MF_OM_logistics_FinalS K Goel
 

Similaire à Confluent Cloud transforms ASPI's digital transformation (20)

Javier Lecanda - Colt SDN/NFV Experience inca 201706
Javier Lecanda - Colt SDN/NFV Experience   inca 201706Javier Lecanda - Colt SDN/NFV Experience   inca 201706
Javier Lecanda - Colt SDN/NFV Experience inca 201706
 
Forecast 2014: ODCA Board Best Practice: T-Systems
Forecast 2014: ODCA Board Best Practice: T-SystemsForecast 2014: ODCA Board Best Practice: T-Systems
Forecast 2014: ODCA Board Best Practice: T-Systems
 
Connectivité temps réel et bi-directionnelle ​ pour solutions IOT
Connectivité temps réel et bi-directionnelle ​ pour solutions IOTConnectivité temps réel et bi-directionnelle ​ pour solutions IOT
Connectivité temps réel et bi-directionnelle ​ pour solutions IOT
 
Strategic Technical Presenation
Strategic Technical PresenationStrategic Technical Presenation
Strategic Technical Presenation
 
brocade-swisscom-ss
brocade-swisscom-ssbrocade-swisscom-ss
brocade-swisscom-ss
 
Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...
Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...
Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...
 
Cisco Connect Halifax 2018 Understanding Cisco's next generation sd-wan sol...
Cisco Connect Halifax 2018   Understanding Cisco's next generation sd-wan sol...Cisco Connect Halifax 2018   Understanding Cisco's next generation sd-wan sol...
Cisco Connect Halifax 2018 Understanding Cisco's next generation sd-wan sol...
 
ICC Data and Device management
ICC Data and Device managementICC Data and Device management
ICC Data and Device management
 
SCALES: Supply Chain Architecture Leading to Enhanced Services
SCALES: Supply Chain Architecture Leading to Enhanced Services SCALES: Supply Chain Architecture Leading to Enhanced Services
SCALES: Supply Chain Architecture Leading to Enhanced Services
 
Delivering Application Analytics for an Application Fluent Network
Delivering Application Analytics for an Application Fluent NetworkDelivering Application Analytics for an Application Fluent Network
Delivering Application Analytics for an Application Fluent Network
 
Why Ontario Government chose Equinix Cloud Exchange Connect
Why Ontario Government chose Equinix Cloud Exchange ConnectWhy Ontario Government chose Equinix Cloud Exchange Connect
Why Ontario Government chose Equinix Cloud Exchange Connect
 
OSGi and Next Generation Trains - Jens Haeger, Deutsche Bahn
OSGi and Next Generation Trains - Jens Haeger, Deutsche BahnOSGi and Next Generation Trains - Jens Haeger, Deutsche Bahn
OSGi and Next Generation Trains - Jens Haeger, Deutsche Bahn
 
Forecast key1 0615_ak_evening
Forecast key1 0615_ak_eveningForecast key1 0615_ak_evening
Forecast key1 0615_ak_evening
 
Bina systems Cloud Applications
Bina systems Cloud ApplicationsBina systems Cloud Applications
Bina systems Cloud Applications
 
Oracle Open World 2018 - Cloud Lift Accelerator Suite
Oracle Open World 2018 - Cloud Lift Accelerator SuiteOracle Open World 2018 - Cloud Lift Accelerator Suite
Oracle Open World 2018 - Cloud Lift Accelerator Suite
 
Identifying Bottlenecks in Mobile Cloud Computing (MCC)
Identifying Bottlenecks in Mobile Cloud Computing (MCC)Identifying Bottlenecks in Mobile Cloud Computing (MCC)
Identifying Bottlenecks in Mobile Cloud Computing (MCC)
 
Confluent Partner Tech Talk with QLIK
Confluent Partner Tech Talk with QLIKConfluent Partner Tech Talk with QLIK
Confluent Partner Tech Talk with QLIK
 
Service Mesh: Two Big Words But Do You Need It?
Service Mesh: Two Big Words But Do You Need It?Service Mesh: Two Big Words But Do You Need It?
Service Mesh: Two Big Words But Do You Need It?
 
Cotendo Cloudlet Datasheet
Cotendo Cloudlet DatasheetCotendo Cloudlet Datasheet
Cotendo Cloudlet Datasheet
 
MF_OM_logistics_Final
MF_OM_logistics_FinalMF_OM_logistics_Final
MF_OM_logistics_Final
 

Plus de confluent

Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...confluent
 
Santander Stream Processing with Apache Flink
Santander Stream Processing with Apache FlinkSantander Stream Processing with Apache Flink
Santander Stream Processing with Apache Flinkconfluent
 
Unlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insightsUnlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insightsconfluent
 
Workshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con FlinkWorkshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con Flinkconfluent
 
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...confluent
 
AWS Immersion Day Mapfre - Confluent
AWS Immersion Day Mapfre   -   ConfluentAWS Immersion Day Mapfre   -   Confluent
AWS Immersion Day Mapfre - Confluentconfluent
 
Eventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalkEventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalkconfluent
 
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent CloudQ&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent Cloudconfluent
 
Citi TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep DiveCiti TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep Diveconfluent
 
Build real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with ConfluentBuild real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with Confluentconfluent
 
Q&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service MeshQ&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service Meshconfluent
 
Citi Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka MicroservicesCiti Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka Microservicesconfluent
 
Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3confluent
 
Citi Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging ModernizationCiti Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging Modernizationconfluent
 
Citi Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time dataCiti Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time dataconfluent
 
Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2confluent
 
Data In Motion Paris 2023
Data In Motion Paris 2023Data In Motion Paris 2023
Data In Motion Paris 2023confluent
 
Confluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with SynthesisConfluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with Synthesisconfluent
 
The Future of Application Development - API Days - Melbourne 2023
The Future of Application Development - API Days - Melbourne 2023The Future of Application Development - API Days - Melbourne 2023
The Future of Application Development - API Days - Melbourne 2023confluent
 
The Playful Bond Between REST And Data Streams
The Playful Bond Between REST And Data StreamsThe Playful Bond Between REST And Data Streams
The Playful Bond Between REST And Data Streamsconfluent
 

Plus de confluent (20)

Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
 
Santander Stream Processing with Apache Flink
Santander Stream Processing with Apache FlinkSantander Stream Processing with Apache Flink
Santander Stream Processing with Apache Flink
 
Unlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insightsUnlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insights
 
Workshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con FlinkWorkshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con Flink
 
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
 
AWS Immersion Day Mapfre - Confluent
AWS Immersion Day Mapfre   -   ConfluentAWS Immersion Day Mapfre   -   Confluent
AWS Immersion Day Mapfre - Confluent
 
Eventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalkEventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalk
 
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent CloudQ&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
 
Citi TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep DiveCiti TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep Dive
 
Build real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with ConfluentBuild real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with Confluent
 
Q&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service MeshQ&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service Mesh
 
Citi Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka MicroservicesCiti Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka Microservices
 
Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3
 
Citi Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging ModernizationCiti Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging Modernization
 
Citi Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time dataCiti Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time data
 
Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2
 
Data In Motion Paris 2023
Data In Motion Paris 2023Data In Motion Paris 2023
Data In Motion Paris 2023
 
Confluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with SynthesisConfluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with Synthesis
 
The Future of Application Development - API Days - Melbourne 2023
The Future of Application Development - API Days - Melbourne 2023The Future of Application Development - API Days - Melbourne 2023
The Future of Application Development - API Days - Melbourne 2023
 
The Playful Bond Between REST And Data Streams
The Playful Bond Between REST And Data StreamsThe Playful Bond Between REST And Data Streams
The Playful Bond Between REST And Data Streams
 

Dernier

Recruitment Management Software Benefits (Infographic)
Recruitment Management Software Benefits (Infographic)Recruitment Management Software Benefits (Infographic)
Recruitment Management Software Benefits (Infographic)Hr365.us smith
 
A healthy diet for your Java application Devoxx France.pdf
A healthy diet for your Java application Devoxx France.pdfA healthy diet for your Java application Devoxx France.pdf
A healthy diet for your Java application Devoxx France.pdfMarharyta Nedzelska
 
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...Cizo Technology Services
 
React Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaReact Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaHanief Utama
 
Unveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsUnveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsAhmed Mohamed
 
Machine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their EngineeringMachine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their EngineeringHironori Washizaki
 
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte GermanySuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte GermanyChristoph Pohl
 
Sending Calendar Invites on SES and Calendarsnack.pdf
Sending Calendar Invites on SES and Calendarsnack.pdfSending Calendar Invites on SES and Calendarsnack.pdf
Sending Calendar Invites on SES and Calendarsnack.pdf31events.com
 
What is Advanced Excel and what are some best practices for designing and cre...
What is Advanced Excel and what are some best practices for designing and cre...What is Advanced Excel and what are some best practices for designing and cre...
What is Advanced Excel and what are some best practices for designing and cre...Technogeeks
 
VK Business Profile - provides IT solutions and Web Development
VK Business Profile - provides IT solutions and Web DevelopmentVK Business Profile - provides IT solutions and Web Development
VK Business Profile - provides IT solutions and Web Developmentvyaparkranti
 
What is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWhat is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWave PLM
 
Introduction Computer Science - Software Design.pdf
Introduction Computer Science - Software Design.pdfIntroduction Computer Science - Software Design.pdf
Introduction Computer Science - Software Design.pdfFerryKemperman
 
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...Matt Ray
 
Balasore Best It Company|| Top 10 IT Company || Balasore Software company Odisha
Balasore Best It Company|| Top 10 IT Company || Balasore Software company OdishaBalasore Best It Company|| Top 10 IT Company || Balasore Software company Odisha
Balasore Best It Company|| Top 10 IT Company || Balasore Software company Odishasmiwainfosol
 
Precise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive GoalPrecise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive GoalLionel Briand
 
Odoo 14 - eLearning Module In Odoo 14 Enterprise
Odoo 14 - eLearning Module In Odoo 14 EnterpriseOdoo 14 - eLearning Module In Odoo 14 Enterprise
Odoo 14 - eLearning Module In Odoo 14 Enterprisepreethippts
 
CRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. SalesforceCRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. SalesforceBrainSell Technologies
 
Folding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesFolding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesPhilip Schwarz
 
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...OnePlan Solutions
 

Dernier (20)

Recruitment Management Software Benefits (Infographic)
Recruitment Management Software Benefits (Infographic)Recruitment Management Software Benefits (Infographic)
Recruitment Management Software Benefits (Infographic)
 
A healthy diet for your Java application Devoxx France.pdf
A healthy diet for your Java application Devoxx France.pdfA healthy diet for your Java application Devoxx France.pdf
A healthy diet for your Java application Devoxx France.pdf
 
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...
 
React Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaReact Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief Utama
 
Unveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsUnveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML Diagrams
 
Machine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their EngineeringMachine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their Engineering
 
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte GermanySuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
 
2.pdf Ejercicios de programación competitiva
2.pdf Ejercicios de programación competitiva2.pdf Ejercicios de programación competitiva
2.pdf Ejercicios de programación competitiva
 
Sending Calendar Invites on SES and Calendarsnack.pdf
Sending Calendar Invites on SES and Calendarsnack.pdfSending Calendar Invites on SES and Calendarsnack.pdf
Sending Calendar Invites on SES and Calendarsnack.pdf
 
What is Advanced Excel and what are some best practices for designing and cre...
What is Advanced Excel and what are some best practices for designing and cre...What is Advanced Excel and what are some best practices for designing and cre...
What is Advanced Excel and what are some best practices for designing and cre...
 
VK Business Profile - provides IT solutions and Web Development
VK Business Profile - provides IT solutions and Web DevelopmentVK Business Profile - provides IT solutions and Web Development
VK Business Profile - provides IT solutions and Web Development
 
What is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWhat is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need It
 
Introduction Computer Science - Software Design.pdf
Introduction Computer Science - Software Design.pdfIntroduction Computer Science - Software Design.pdf
Introduction Computer Science - Software Design.pdf
 
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
 
Balasore Best It Company|| Top 10 IT Company || Balasore Software company Odisha
Balasore Best It Company|| Top 10 IT Company || Balasore Software company OdishaBalasore Best It Company|| Top 10 IT Company || Balasore Software company Odisha
Balasore Best It Company|| Top 10 IT Company || Balasore Software company Odisha
 
Precise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive GoalPrecise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive Goal
 
Odoo 14 - eLearning Module In Odoo 14 Enterprise
Odoo 14 - eLearning Module In Odoo 14 EnterpriseOdoo 14 - eLearning Module In Odoo 14 Enterprise
Odoo 14 - eLearning Module In Odoo 14 Enterprise
 
CRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. SalesforceCRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. Salesforce
 
Folding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesFolding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a series
 
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
 

Confluent Cloud transforms ASPI's digital transformation

  • 1. Confluent Cloud – Data in Motion 06/10/2022 1 Confluent Cloud inside the Digital Transformation of Autostrade per l’Italia Confluent Cloud – Data in Motion 06/10/2022
  • 2. Confluent Cloud – Data in Motion 06/10/2022 1. Company Presentation 2. ASPI Digital Transformation 3. The use of Kafka in ASPI 4. Confluent Cloud Migration 5. Next Steps AGENDA
  • 3. Confluent Cloud – Data in Motion 06/10/2022 3 2.855 km of motorway in Italy 6,1 Billion € +110% of investiments in 2020/24 vs 2015/19 nearly 5.300 employees 204 Service Areas 1.907 Variable-message signs along the network 4.991 cameras 3 Billion € of revenues Autostrade per l'Italia is one of Europe's leading concessionaries for the construction and management of toll motorways, with around 3,000 km of network managed in Italy. The Autostrade per l'Italia group includes five other motorway concession companies and seven companies that provide ancillary services to the core motorway business and play a key role in implementing the Company's transformation plan. • Società Italiana Traforo del Montebianco • Raccordo Autostradale Valle d’Aosta • Tangenziale di Napoli • Autostrade Meridionali • Società Autostradale Tirrenica • Movyon • Tecne • Amplia Infrastructures • Free-to-Experience • Elgea • Admoving • Esse di Esse • Giove clear THE GROUP THE COMPANY 2,5 Billion € +60% of maint. costs in 2020/24 vs 2015/19
  • 4. Confluent Cloud – Data in Motion 06/10/2022 «Next To Digital» INITIATIVE The Next To Digital initiative is included in the wide Transformation Plan of Autostrade per l’Italia. This initiative is the fundamental lever to guide and promote a deep change in ASPI at multiple levels: new ways of working, new technological capabilities, new skills to develop, new ways of addressing all stakeholders (internal and external) and, finally, a significant cultural change. It concerns the digitalization of processes and services, transformation of the road network into a "smart" infrastructure through the most advanced technologies. NtD initiative address these aims: • Internal efficiency • Civil infrastructure management and security • Customer experience 200 Million € of investment by 2024 + 30 agile room to develop End-to-End innovative projects
  • 5. Confluent Cloud – Data in Motion 06/10/2022 «Next To Digital» PROJECTS Predictive models of traffic flows for planning construction sites to minimize the impact on the road network (estimation of any inconvenience caused and calculation of tariff discounts) Real-time monitoring and alerting systems in relation to traffic disruptions (e.g. road accidents) or road congestion on the network due to: - Proactive and dynamic management of lanes and speed limits - Preventive deployment of traffic/rescue teams New services for users: Recommended times for departure; advance calculation of the toll; recommended restaurants, attractions and places of interest along the route Additional services in the service area (e.g. parking, "skip the line" table reservation) and on the network (e.g. advance toll payment) Digital communication channel between the customer and Autostrade for distress alerts requests, complaints, assistance and automatic processing of requests via Virtual Agent.
  • 6. Confluent Cloud – Data in Motion 06/10/2022 Why Kafka? • Become a Data Driven company • Create a unique data layer to support Event Driven architecture • Eliminate Data Silos • Provide Data Democratization through REST API • Provide Standardization through JSON, AVRO • Data Security with Zero Trust approach Confluent Kafka has been chosen to accomplish Autostrade per l’Italia’s goals:
  • 7. Confluent Cloud – Data in Motion 06/10/2022 Business Cases and Architecture
  • 8. Confluent Cloud – Data in Motion 06/10/2022 Online Monitoring Traffic GOAL Monitor and analyze transit on tracks collected at toll booth in near real time. HOW RESULTS Change-Data-Capture pattern of Confluent Cloud with 2 sync connectors. • RAW data converted to JSON formats for easier usability with REST API • Freshness of information for end users • Decoupling systems for less overhead on DB2
  • 9. Confluent Cloud – Data in Motion 06/10/2022 Electronic Toll enrichment GOAL Implementation of an on-cloud application that allows the management of every aspect of the rectification traffic life cycle for users and special users. HOW RESULTS Raw Data is normalized and democratized through Kstream Java App With Confluent Kafka, through the KStream we are able to deal with data that was previously on silos to have a gain on data governance on the outgoing DBMS.
  • 10. Confluent Cloud – Data in Motion 06/10/2022 Integration Layer "CEM Impianti" GOAL Standardize the monitoring data and render them accessible via front end for reporting / monitoring activities. HOW RESULTS Unique Integration Layer to collect data from OT Plants based on 3 steps: • Mapping of monitoring data • Data definition and Normalization • Front-End for reporting and analytics • Greater usability of data • Reduced interventions time • Best use of resources • Reduction of low added value activities
  • 11. Confluent Cloud – Data in Motion 06/10/2022 PISTA 2.0 Most complex project based on Confluent Cloud (in evolution…) GOAL Refactoring of the message production and dispatching system from all the toll booths on the highway to a single Data Layer. HOW RESULTS Provide a formal definition of the data using AVRO Schema, useful for: • Manage information as a resource • Create a process aimed at managing the data • Data preparation and enrichment • No use of DB for first ingestion of message acquisition • Event Streaming – Ready • Provide data detectability, monitoring and security throughout its life cycle
  • 12. Confluent Cloud – Data in Motion 06/10/2022 PISTA 2.0 Architecture
  • 13. Confluent Cloud – Data in Motion 06/10/2022 13 13 Confluent Platform migration to Confluent Cloud
  • 14. Confluent Cloud – Data in Motion 06/10/2022 Migration to Confluent Cloud SCENARIO The migration from Confluent Platform to Confluent Cloud involved 15 Applications, mostly based on collecting data from tracks and plants. PROJECT USE CASES Autostrade per l’Italia started a multi-year modernization project that relies on the transition from on-premise systems to Cloud platforms for increasing speed to accomplish business requests and reduce low value-added activities. • Pista 2.0 - First acquisition of transits and plate tracking on the toll booth • Plants - Spooling of messages from suburbs to center • TUTOR - collecting events • Infoviability - collecting data from sensors on track • Xmonit - Realtime monitoring and integration of plants • FreeToX – Cashback system for customers • Service Area – Smart services on the services area on the highway
  • 15. Confluent Cloud – Data in Motion 06/10/2022 Confluent Platform • 3 different environments on-premises • Ansible playbooks for configurations • Custom connectors • Manage infrastructure for updates and develop new features • Not scalable • Storage tiering needed • Managing Load Balancing for Kafka Brokers ENVIRONMENTS PROS CONS SVIL TEST PROD
  • 16. Confluent Cloud – Data in Motion 06/10/2022 Confluent Cloud Architecture ENVIRONMENTS • Prod and noProd environments for data segregation • Teampass as a Password Manager for Client API Keys & Secrets • Zabbix as ASPI main Monitoring Platform PROS CONS • 99.99% SLA • Autoscaling • No patching or planned maintenance • Infinite Storage • Easily connected via AWS Transit Gateway • Users ACL: access to Control Center for Data Lineage view • Kafka Connect onprem for custom use cases
  • 17. Confluent Cloud – Data in Motion 06/10/2022 Next Steps TRAFFIC PROJECT IoT/MQTT Refactoring of the functional perimeter, based on more than 70 applications, linked to the collection and management of payments and transit data on the track. Main problems are: • Highly interconnected area with strong dependencies between functional levels • Highly standardized architectures based on legacy technologies and integration models (eg.: DB2, db-to-db views). • No API • No Data Democratization • No SecDevOps approach • Solution: Confluent Cloud as single layer for Data acquisition & preparation. Provide an enterprise platform for MQTT to manage messages from IoT devices and lay the foundation for Event Driven Architecture. • Main products identified: EMQX, HiveMQ, VerneMQ.
  • 18. Confluent Cloud – Data in Motion 06/10/2022 18 THANK YOU Confluent Cloud – Data in Motion 06/10/2022