SlideShare une entreprise Scribd logo
1  sur  29
Télécharger pour lire hors ligne
Paradigmshift in Industry:
Telemetry driven production
- All Seeing Eyes -
(c) 2018/2019 Bastian Mäuser / NETZConsult (Germany)
Situation
(not so uncommon)
Customer
●Fr. Ant Niedermayr GmbH & Co. KG (https://niedermayr.net)
●218 Years of company history, est. 1801 by Franz Anton Niedermayr
●situated in the city of Regensburg, Bavaria, southern Germany
●Owner operated by Johannes Helmberger, Niedermayr ancestor in the
6th generation
●205 Employees
●Presscompany, Creative Department, IT + Datacenter Services
●Approved presenting major parts of the Project
Technical origin
●Already experience with various Timeseries DB through personal
opensource project involvement
●IT monitoring: Done plenty of times, everything well documented.
●Had nice IT Dashboards, why not apply this visibility approach to
Industrial Process?
●Aimed for four targets: controlling, prediction, save $$$, escape vendor
lock
●Quick first results: initial implementation took just a few days.
●Most of the work: interpreting and validating the numbers
Print?
●1 Lithoman IV 80p, 2 Lithoman-S 96p web offset printing Machines +
smaller Machines
●Output: up to 4.8M A4 pages per hour per Unit
●24/7 Production
●About 15 different Suppliers of Main subunits: simplified interfaces to
each other, very proprietary, high complexity. (Front-to-back: Splicer, 4x
Inking, Dryer, Remoistener, Web Cutter, Folder, Stitcher, Conveyor,
Trimmer, Stacker, Strapper, palettizer/Robot, Foliator)
Plant
Some Pictures
The Dilemma
●Industrial Plant suffer from a notorious high heterogenity of datasources and
accessprotocols throughout the sub units.
●A manual or semi-automated reporting / aggregation of the different sources
of data doesn’t scale and is often paid with high amounts of manual labor and
is prone to errors.
●Existing reportings: job-bound and only available after job completion. Exact
time-reference for metrics/events is impossible to achieve.
Datasources that ma5er
●Plantcontrol Pecom PMI: Postgres (ODBC) RDBMS
●MAN Roland IDC: MQTT
●Quadtech QTI IDC on 80p
●Energy: Janitza/Gridvis REST API
●ERP: System “Chroma”: Oracle 12 based Client/Server Application without
any usable API
●Robot Cell: MSSQL without client access, but Access to a OPCUA Server
●Baldwin Fluidmanagemend: MQTT
●Technotrans Ink Supply System
Possible Approaches
●Excel (rly?)
●RRD Collector
●Collection of Data in a tablerelational Structure (Postgres, Mysql etc) with
attached Visualisation (Cacti, Zabbix etc)
●Elastic Stack (Elastic Search, Beats, Logstash, Kibana)
●Graphite (Carbon/Whisper + Graphite + Grafana)
●Tick/G/L (Telegraf + InfluxDB + Chronograf + Kapacitor + Grafana) + LoudML
(disruptive Machine Learning API)
Decision for TICK
●Scales well at high ingest rates. Good to eat up to >500k data points per
second on a single Instance (we are at about 800 Datapoints / Machine /
Second)
●Compelling storage Engine (in terms of speed, space eficiency, space reclaim,
retention)
●Extensive ecosystem of plugins on the input and output (Telegraf)
●Proven production ready: many big names in IT rely on it
Chosen Approach: Node Red +TICK/G/L
Example View of a Nodered Flow for IDC
Steps
1.Identification of datasources that matter
2.Deploy instrumentation and extend where required
3.Technical interface design: Some work with plain telegraf, some require
moderate coding
4.Dashboard design (Grafana, Chronograf)
5.Derive KPI
6.Define criteria for Alerts
Difficulties
1.Reverse Engineering might be required
2.Dealing with outdated Hard- and Software is not uncommon
3.Negotiations with Machinesuppliers can be challenging
4.Data Validation
Good habbits
●Implement security right away (At least some reasonable Password for
MQTT Brokers, even better TLS Client certificates)
●Seperate VLAN
●Collecting everything that is available isn’t a good Idea either
●Avoid redundancy of Values
●Do a Interpretation Documentation (at what physical Points do
Measurements orginate, are they raw or already calculated)
●Don’t end up in having a Directory full of Customscripts – developed a
standard in Node Red
Electrical Power
●Consumption up to 4MW
(electrical)
●Biggest savings
Paper
●100000 metric Tons/yr
●Quantify waste
●Identify waste causes
●Reduce waste by
reducing Washcycles
●Predict situations to
avoid unplanned downtime
Central Ink supply
●2700 metric tons/yr
●Validate consumption
●Forecast required
deliveries
Result: tacIcal Overview
QA KPI (Dotgain)
Instrumetation: ΔE Deviation (densitometric)
Waste quantification and causes
more interessIng metrics in print
●Overall Waste
●Washing Waste
●Reel Numbers
●Web Width
Deep Analysis
Consumption
vs.
Efficiency
vs.
Staff
vs.
Jobs/Customer
vs.
Consumable
vs.
Quality KPI
More Deep Analysis
Consumeables in $$$
Incidents in Time and $$$
Achievements so far
●Production realtime data (some near realtime (10-30s at most), some real
streaming metrics <3)
●Significant energy savings (Upper 6 Digit Number/yr)
●Fine grained values
●LoudML / Tensorflow in place, ML Models applied and constantly developed
●Anomaly detection throughout raw datasources
●Close interval validation of business numbers with actual real measurements
●Successfully escaped Vendor lock-in
Future
●Deploy more Instrumentation: Vibration and waveformanalysis (eg.
precursoridentifikation bearing fails, conveyor drives, fans) with
specialized Hardware
●Even More metrics
●Continue ongoing Talks with vendors: Deliver all metrics on a MQTT
broker
●Signalling to Production: Reduce Washing waste by using IDC Signalling
derived from Dotgain Values in InfluxDB (Beta run ongoing)
Thank you for your attention
Questions ?
Bastian Mäuser
<bma@netz.org>

Contenu connexe

Tendances

Tendances (20)

Lessons Learned: Running InfluxDB Cloud and Other Cloud Services at Scale | T...
Lessons Learned: Running InfluxDB Cloud and Other Cloud Services at Scale | T...Lessons Learned: Running InfluxDB Cloud and Other Cloud Services at Scale | T...
Lessons Learned: Running InfluxDB Cloud and Other Cloud Services at Scale | T...
 
InfluxDB Community Office Hours September 2020
InfluxDB Community Office Hours September 2020 InfluxDB Community Office Hours September 2020
InfluxDB Community Office Hours September 2020
 
Optimizing InfluxDB Performance in the Real World by Dean Sheehan, Senior Dir...
Optimizing InfluxDB Performance in the Real World by Dean Sheehan, Senior Dir...Optimizing InfluxDB Performance in the Real World by Dean Sheehan, Senior Dir...
Optimizing InfluxDB Performance in the Real World by Dean Sheehan, Senior Dir...
 
Vasilis Papavasiliou [Mist.io] | Integrating Telegraf, InfluxDB and Mist to M...
Vasilis Papavasiliou [Mist.io] | Integrating Telegraf, InfluxDB and Mist to M...Vasilis Papavasiliou [Mist.io] | Integrating Telegraf, InfluxDB and Mist to M...
Vasilis Papavasiliou [Mist.io] | Integrating Telegraf, InfluxDB and Mist to M...
 
How to Improve Performance Testing Using InfluxDB and Apache JMeter
How to Improve Performance Testing Using InfluxDB and Apache JMeterHow to Improve Performance Testing Using InfluxDB and Apache JMeter
How to Improve Performance Testing Using InfluxDB and Apache JMeter
 
How to Store and Visualize CAN Bus Telematic Data with InfluxDB Cloud and Gra...
How to Store and Visualize CAN Bus Telematic Data with InfluxDB Cloud and Gra...How to Store and Visualize CAN Bus Telematic Data with InfluxDB Cloud and Gra...
How to Store and Visualize CAN Bus Telematic Data with InfluxDB Cloud and Gra...
 
Container Monitoring Best Practices Using AWS and InfluxData by Gunnar Aasen
Container Monitoring Best Practices Using AWS and InfluxData by Gunnar AasenContainer Monitoring Best Practices Using AWS and InfluxData by Gunnar Aasen
Container Monitoring Best Practices Using AWS and InfluxData by Gunnar Aasen
 
How a Time Series Database Contributes to a Decentralized Cloud Object Storag...
How a Time Series Database Contributes to a Decentralized Cloud Object Storag...How a Time Series Database Contributes to a Decentralized Cloud Object Storag...
How a Time Series Database Contributes to a Decentralized Cloud Object Storag...
 
Optimizing InfluxDB Performance in the Real World | Sam Dillard | InfluxData
Optimizing InfluxDB Performance in the Real World | Sam Dillard | InfluxDataOptimizing InfluxDB Performance in the Real World | Sam Dillard | InfluxData
Optimizing InfluxDB Performance in the Real World | Sam Dillard | InfluxData
 
Setting up InfluxData for IoT
Setting up InfluxData for IoTSetting up InfluxData for IoT
Setting up InfluxData for IoT
 
InfluxDB Live Product Training
InfluxDB Live Product TrainingInfluxDB Live Product Training
InfluxDB Live Product Training
 
InfluxDB 101 – Concepts and Architecture by Michael DeSa, Software Engineer |...
InfluxDB 101 – Concepts and Architecture by Michael DeSa, Software Engineer |...InfluxDB 101 – Concepts and Architecture by Michael DeSa, Software Engineer |...
InfluxDB 101 – Concepts and Architecture by Michael DeSa, Software Engineer |...
 
InfluxDB 101 - Concepts and Architecture | Michael DeSa | InfluxData
InfluxDB 101 - Concepts and Architecture | Michael DeSa | InfluxDataInfluxDB 101 - Concepts and Architecture | Michael DeSa | InfluxData
InfluxDB 101 - Concepts and Architecture | Michael DeSa | InfluxData
 
How Texas Instruments Uses InfluxDB to Uphold Product Standards and to Improv...
How Texas Instruments Uses InfluxDB to Uphold Product Standards and to Improv...How Texas Instruments Uses InfluxDB to Uphold Product Standards and to Improv...
How Texas Instruments Uses InfluxDB to Uphold Product Standards and to Improv...
 
Intro to InfluxDB 2.0 and Your First Flux Query by Sonia Gupta
Intro to InfluxDB 2.0 and Your First Flux Query by Sonia GuptaIntro to InfluxDB 2.0 and Your First Flux Query by Sonia Gupta
Intro to InfluxDB 2.0 and Your First Flux Query by Sonia Gupta
 
InfluxDB and Grafana: An Introduction to Time-Based Data Storage and Visualiz...
InfluxDB and Grafana: An Introduction to Time-Based Data Storage and Visualiz...InfluxDB and Grafana: An Introduction to Time-Based Data Storage and Visualiz...
InfluxDB and Grafana: An Introduction to Time-Based Data Storage and Visualiz...
 
DOWNSAMPLING DATA
DOWNSAMPLING DATADOWNSAMPLING DATA
DOWNSAMPLING DATA
 
GE IOT Predix Time Series & Data Ingestion Service using Apache Apex (Hadoop)
GE IOT Predix Time Series & Data Ingestion Service using Apache Apex (Hadoop)GE IOT Predix Time Series & Data Ingestion Service using Apache Apex (Hadoop)
GE IOT Predix Time Series & Data Ingestion Service using Apache Apex (Hadoop)
 
Kapacitor Manager
Kapacitor ManagerKapacitor Manager
Kapacitor Manager
 
Creating and Using the Flux SQL Datasource | Katy Farmer | InfluxData
Creating and Using the Flux SQL Datasource | Katy Farmer | InfluxData Creating and Using the Flux SQL Datasource | Katy Farmer | InfluxData
Creating and Using the Flux SQL Datasource | Katy Farmer | InfluxData
 

Similaire à How Sensor Data Can Help Manufacturers Gain Insight to Reduce Waste, Energy Consumption, and Get Rid of Pesky Spreadsheets

CAD Virtualization - the who the how and why ProSTEP iViP Conference
CAD Virtualization - the who the how and why ProSTEP iViP ConferenceCAD Virtualization - the who the how and why ProSTEP iViP Conference
CAD Virtualization - the who the how and why ProSTEP iViP Conference
Canopy Cloud
 
Evolution of Real-time User Engagement Event Consumption at Pinterest
Evolution of Real-time User Engagement Event Consumption at PinterestEvolution of Real-time User Engagement Event Consumption at Pinterest
Evolution of Real-time User Engagement Event Consumption at Pinterest
HostedbyConfluent
 

Similaire à How Sensor Data Can Help Manufacturers Gain Insight to Reduce Waste, Energy Consumption, and Get Rid of Pesky Spreadsheets (20)

Reducing Cost of Production ML: Feature Engineering Case Study
Reducing Cost of Production ML: Feature Engineering Case StudyReducing Cost of Production ML: Feature Engineering Case Study
Reducing Cost of Production ML: Feature Engineering Case Study
 
Intro to open source observability with grafana, prometheus, loki, and tempo(...
Intro to open source observability with grafana, prometheus, loki, and tempo(...Intro to open source observability with grafana, prometheus, loki, and tempo(...
Intro to open source observability with grafana, prometheus, loki, and tempo(...
 
DevOps Fest 2020. Pavlo Repalo. Edge Computing: Appliance and Challanges
DevOps Fest 2020. Pavlo Repalo. Edge Computing: Appliance and ChallangesDevOps Fest 2020. Pavlo Repalo. Edge Computing: Appliance and Challanges
DevOps Fest 2020. Pavlo Repalo. Edge Computing: Appliance and Challanges
 
L'evoluzione M2M nell'era di Industria 4.0
L'evoluzione M2M nell'era di Industria 4.0L'evoluzione M2M nell'era di Industria 4.0
L'evoluzione M2M nell'era di Industria 4.0
 
STREAM-0D: a new vision for Zero-Defect Manufacturing
STREAM-0D: a new vision for Zero-Defect ManufacturingSTREAM-0D: a new vision for Zero-Defect Manufacturing
STREAM-0D: a new vision for Zero-Defect Manufacturing
 
Dagster @ R&S MNT
Dagster @ R&S MNTDagster @ R&S MNT
Dagster @ R&S MNT
 
Spark Streaming Early Warning Use Case
Spark Streaming Early Warning Use CaseSpark Streaming Early Warning Use Case
Spark Streaming Early Warning Use Case
 
Danish Business Authority: Explainability and causality in relation to ML Ops
Danish Business Authority: Explainability and causality in relation to ML OpsDanish Business Authority: Explainability and causality in relation to ML Ops
Danish Business Authority: Explainability and causality in relation to ML Ops
 
Scaling up uber's real time data analytics
Scaling up uber's real time data analyticsScaling up uber's real time data analytics
Scaling up uber's real time data analytics
 
Industrial Internet of Things: Protocols an Standards
Industrial Internet of Things: Protocols an StandardsIndustrial Internet of Things: Protocols an Standards
Industrial Internet of Things: Protocols an Standards
 
Tracing-for-fun-and-profit.pptx
Tracing-for-fun-and-profit.pptxTracing-for-fun-and-profit.pptx
Tracing-for-fun-and-profit.pptx
 
Counting Unique Users in Real-Time: Here's a Challenge for You!
Counting Unique Users in Real-Time: Here's a Challenge for You!Counting Unique Users in Real-Time: Here's a Challenge for You!
Counting Unique Users in Real-Time: Here's a Challenge for You!
 
Lessons learned from designing QA automation event streaming platform(IoT big...
Lessons learned from designing QA automation event streaming platform(IoT big...Lessons learned from designing QA automation event streaming platform(IoT big...
Lessons learned from designing QA automation event streaming platform(IoT big...
 
Zero Downtime JEE Architectures
Zero Downtime JEE ArchitecturesZero Downtime JEE Architectures
Zero Downtime JEE Architectures
 
Data engineering in 10 years.pdf
Data engineering in 10 years.pdfData engineering in 10 years.pdf
Data engineering in 10 years.pdf
 
Using druid for interactive count distinct queries at scale
Using druid for interactive count distinct queries at scaleUsing druid for interactive count distinct queries at scale
Using druid for interactive count distinct queries at scale
 
Real-time processing of large amounts of data
Real-time processing of large amounts of dataReal-time processing of large amounts of data
Real-time processing of large amounts of data
 
CAD Virtualization - the who the how and why ProSTEP iViP Conference
CAD Virtualization - the who the how and why ProSTEP iViP ConferenceCAD Virtualization - the who the how and why ProSTEP iViP Conference
CAD Virtualization - the who the how and why ProSTEP iViP Conference
 
Get Your Head in the Cloud - Lessons in GPU Computing with Schlumberger
Get Your Head in the Cloud - Lessons in GPU Computing with SchlumbergerGet Your Head in the Cloud - Lessons in GPU Computing with Schlumberger
Get Your Head in the Cloud - Lessons in GPU Computing with Schlumberger
 
Evolution of Real-time User Engagement Event Consumption at Pinterest
Evolution of Real-time User Engagement Event Consumption at PinterestEvolution of Real-time User Engagement Event Consumption at Pinterest
Evolution of Real-time User Engagement Event Consumption at Pinterest
 

Plus de InfluxData

How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
InfluxData
 
How Delft University's Engineering Students Make Their EV Formula-Style Race ...
How Delft University's Engineering Students Make Their EV Formula-Style Race ...How Delft University's Engineering Students Make Their EV Formula-Style Race ...
How Delft University's Engineering Students Make Their EV Formula-Style Race ...
InfluxData
 
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
InfluxData
 
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
InfluxData
 

Plus de InfluxData (20)

Announcing InfluxDB Clustered
Announcing InfluxDB ClusteredAnnouncing InfluxDB Clustered
Announcing InfluxDB Clustered
 
Best Practices for Leveraging the Apache Arrow Ecosystem
Best Practices for Leveraging the Apache Arrow EcosystemBest Practices for Leveraging the Apache Arrow Ecosystem
Best Practices for Leveraging the Apache Arrow Ecosystem
 
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...
 
Power Your Predictive Analytics with InfluxDB
Power Your Predictive Analytics with InfluxDBPower Your Predictive Analytics with InfluxDB
Power Your Predictive Analytics with InfluxDB
 
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
 
Build an Edge-to-Cloud Solution with the MING Stack
Build an Edge-to-Cloud Solution with the MING StackBuild an Edge-to-Cloud Solution with the MING Stack
Build an Edge-to-Cloud Solution with the MING Stack
 
Meet the Founders: An Open Discussion About Rewriting Using Rust
Meet the Founders: An Open Discussion About Rewriting Using RustMeet the Founders: An Open Discussion About Rewriting Using Rust
Meet the Founders: An Open Discussion About Rewriting Using Rust
 
Introducing InfluxDB Cloud Dedicated
Introducing InfluxDB Cloud DedicatedIntroducing InfluxDB Cloud Dedicated
Introducing InfluxDB Cloud Dedicated
 
Gain Better Observability with OpenTelemetry and InfluxDB
Gain Better Observability with OpenTelemetry and InfluxDB Gain Better Observability with OpenTelemetry and InfluxDB
Gain Better Observability with OpenTelemetry and InfluxDB
 
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...
 
How Delft University's Engineering Students Make Their EV Formula-Style Race ...
How Delft University's Engineering Students Make Their EV Formula-Style Race ...How Delft University's Engineering Students Make Their EV Formula-Style Race ...
How Delft University's Engineering Students Make Their EV Formula-Style Race ...
 
Introducing InfluxDB’s New Time Series Database Storage Engine
Introducing InfluxDB’s New Time Series Database Storage EngineIntroducing InfluxDB’s New Time Series Database Storage Engine
Introducing InfluxDB’s New Time Series Database Storage Engine
 
Start Automating InfluxDB Deployments at the Edge with balena
Start Automating InfluxDB Deployments at the Edge with balena Start Automating InfluxDB Deployments at the Edge with balena
Start Automating InfluxDB Deployments at the Edge with balena
 
Understanding InfluxDB’s New Storage Engine
Understanding InfluxDB’s New Storage EngineUnderstanding InfluxDB’s New Storage Engine
Understanding InfluxDB’s New Storage Engine
 
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDB
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDBStreamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDB
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDB
 
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...
 
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022
 
Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022
 
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
 
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
 

Dernier

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 

Dernier (20)

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 

How Sensor Data Can Help Manufacturers Gain Insight to Reduce Waste, Energy Consumption, and Get Rid of Pesky Spreadsheets

  • 1. Paradigmshift in Industry: Telemetry driven production - All Seeing Eyes - (c) 2018/2019 Bastian Mäuser / NETZConsult (Germany)
  • 3. Customer ●Fr. Ant Niedermayr GmbH & Co. KG (https://niedermayr.net) ●218 Years of company history, est. 1801 by Franz Anton Niedermayr ●situated in the city of Regensburg, Bavaria, southern Germany ●Owner operated by Johannes Helmberger, Niedermayr ancestor in the 6th generation ●205 Employees ●Presscompany, Creative Department, IT + Datacenter Services ●Approved presenting major parts of the Project
  • 4. Technical origin ●Already experience with various Timeseries DB through personal opensource project involvement ●IT monitoring: Done plenty of times, everything well documented. ●Had nice IT Dashboards, why not apply this visibility approach to Industrial Process? ●Aimed for four targets: controlling, prediction, save $$$, escape vendor lock ●Quick first results: initial implementation took just a few days. ●Most of the work: interpreting and validating the numbers
  • 5. Print? ●1 Lithoman IV 80p, 2 Lithoman-S 96p web offset printing Machines + smaller Machines ●Output: up to 4.8M A4 pages per hour per Unit ●24/7 Production ●About 15 different Suppliers of Main subunits: simplified interfaces to each other, very proprietary, high complexity. (Front-to-back: Splicer, 4x Inking, Dryer, Remoistener, Web Cutter, Folder, Stitcher, Conveyor, Trimmer, Stacker, Strapper, palettizer/Robot, Foliator)
  • 8. The Dilemma ●Industrial Plant suffer from a notorious high heterogenity of datasources and accessprotocols throughout the sub units. ●A manual or semi-automated reporting / aggregation of the different sources of data doesn’t scale and is often paid with high amounts of manual labor and is prone to errors. ●Existing reportings: job-bound and only available after job completion. Exact time-reference for metrics/events is impossible to achieve.
  • 9. Datasources that ma5er ●Plantcontrol Pecom PMI: Postgres (ODBC) RDBMS ●MAN Roland IDC: MQTT ●Quadtech QTI IDC on 80p ●Energy: Janitza/Gridvis REST API ●ERP: System “Chroma”: Oracle 12 based Client/Server Application without any usable API ●Robot Cell: MSSQL without client access, but Access to a OPCUA Server ●Baldwin Fluidmanagemend: MQTT ●Technotrans Ink Supply System
  • 10. Possible Approaches ●Excel (rly?) ●RRD Collector ●Collection of Data in a tablerelational Structure (Postgres, Mysql etc) with attached Visualisation (Cacti, Zabbix etc) ●Elastic Stack (Elastic Search, Beats, Logstash, Kibana) ●Graphite (Carbon/Whisper + Graphite + Grafana) ●Tick/G/L (Telegraf + InfluxDB + Chronograf + Kapacitor + Grafana) + LoudML (disruptive Machine Learning API)
  • 11. Decision for TICK ●Scales well at high ingest rates. Good to eat up to >500k data points per second on a single Instance (we are at about 800 Datapoints / Machine / Second) ●Compelling storage Engine (in terms of speed, space eficiency, space reclaim, retention) ●Extensive ecosystem of plugins on the input and output (Telegraf) ●Proven production ready: many big names in IT rely on it
  • 12. Chosen Approach: Node Red +TICK/G/L
  • 13. Example View of a Nodered Flow for IDC
  • 14. Steps 1.Identification of datasources that matter 2.Deploy instrumentation and extend where required 3.Technical interface design: Some work with plain telegraf, some require moderate coding 4.Dashboard design (Grafana, Chronograf) 5.Derive KPI 6.Define criteria for Alerts
  • 15. Difficulties 1.Reverse Engineering might be required 2.Dealing with outdated Hard- and Software is not uncommon 3.Negotiations with Machinesuppliers can be challenging 4.Data Validation
  • 16. Good habbits ●Implement security right away (At least some reasonable Password for MQTT Brokers, even better TLS Client certificates) ●Seperate VLAN ●Collecting everything that is available isn’t a good Idea either ●Avoid redundancy of Values ●Do a Interpretation Documentation (at what physical Points do Measurements orginate, are they raw or already calculated) ●Don’t end up in having a Directory full of Customscripts – developed a standard in Node Red
  • 17. Electrical Power ●Consumption up to 4MW (electrical) ●Biggest savings
  • 18. Paper ●100000 metric Tons/yr ●Quantify waste ●Identify waste causes ●Reduce waste by reducing Washcycles ●Predict situations to avoid unplanned downtime
  • 19. Central Ink supply ●2700 metric tons/yr ●Validate consumption ●Forecast required deliveries
  • 22. Instrumetation: ΔE Deviation (densitometric)
  • 24. more interessIng metrics in print ●Overall Waste ●Washing Waste ●Reel Numbers ●Web Width
  • 26. More Deep Analysis Consumeables in $$$ Incidents in Time and $$$
  • 27. Achievements so far ●Production realtime data (some near realtime (10-30s at most), some real streaming metrics <3) ●Significant energy savings (Upper 6 Digit Number/yr) ●Fine grained values ●LoudML / Tensorflow in place, ML Models applied and constantly developed ●Anomaly detection throughout raw datasources ●Close interval validation of business numbers with actual real measurements ●Successfully escaped Vendor lock-in
  • 28. Future ●Deploy more Instrumentation: Vibration and waveformanalysis (eg. precursoridentifikation bearing fails, conveyor drives, fans) with specialized Hardware ●Even More metrics ●Continue ongoing Talks with vendors: Deliver all metrics on a MQTT broker ●Signalling to Production: Reduce Washing waste by using IDC Signalling derived from Dotgain Values in InfluxDB (Beta run ongoing)
  • 29. Thank you for your attention Questions ? Bastian Mäuser <bma@netz.org>