Ce diaporama a bien été signalé.
Le téléchargement de votre SlideShare est en cours. ×

OSMC 2022 | AI Driven Observability based on Open Source by Satish Karunakaran

Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité

Consultez-les par la suite

1 sur 11 Publicité

OSMC 2022 | AI Driven Observability based on Open Source by Satish Karunakaran

Télécharger pour lire hors ligne

Observability & monitoring of resources are growing every day and it is inevitable to analyse all the data points to arrive at a solution. At Mercedes-Benz we have developed an open source Data Metric Analyzer and drive it with Data Science to identify Anomalies. As part of this talk, I / we would like to discuss about how we established the entire Data Processing Eco-System based on Open Source. Different technologies that would be talked about includes:

– Python: Data Science Components
– Airflow: Data Orchestration for metrics
– Telegraf: Data Collection
– TimescaleDB: Data Store for Timeseries Data
– Grafana + Streamlit: Visualization

Observability & monitoring of resources are growing every day and it is inevitable to analyse all the data points to arrive at a solution. At Mercedes-Benz we have developed an open source Data Metric Analyzer and drive it with Data Science to identify Anomalies. As part of this talk, I / we would like to discuss about how we established the entire Data Processing Eco-System based on Open Source. Different technologies that would be talked about includes:

– Python: Data Science Components
– Airflow: Data Orchestration for metrics
– Telegraf: Data Collection
– TimescaleDB: Data Store for Timeseries Data
– Grafana + Streamlit: Visualization

Publicité
Publicité

Plus De Contenu Connexe

Publicité

OSMC 2022 | AI Driven Observability based on Open Source by Satish Karunakaran

  1. 1. AI-driven Observability based on Open Source Satish Karunakaran – IT Architect Dr. Sabine Gillner – Data Scientist & Product Manager
  2. 2. Mercedes-Benz Tech Innovation Präsentationsvorlage | 01.04.2022 1 Observability & Data Points Infrastructure Pain Points 2 3 Solving Infrastructure Pain Points with Data Building AI Driven Prediction Eco-System 4 5 Data Science & Prediction Agenda 6 Q & A
  3. 3. Mercedes-Benz Tech Innovation OSMC | 16.11.2022 3 Observability & Data Points • Millions of metrics per minute • Data Dependency across Logs, Traces & Metrics • Various definitions of Data Can the Operations Team generate value manually? Database Metrics Logs Trace Infrastructure Middleware
  4. 4. Mercedes-Benz Tech Innovation OSMC | 16.11.2022 4 Infrastructure Pain Points Focus : Cloud Databases Managed Un-managed (Pain Points) Availability Patch Management Scalability What to scale ? Should I optimize? Self-healing
  5. 5. Mercedes-Benz Tech Innovation OSMC | 16.11.2022 5 Solving Infrastructure Pain Points with Data 1 Is this behaviour normal ? 2 Looks Normal, but not sure! 3 Better than last week, but still not sure! 4 Found an Anomaly!
  6. 6. Mercedes-Benz Tech Innovation OSMC | 16.11.2022 6 Solving Infrastructure Pain Points with Data Anomaly Detection Deep Insights Optimizing Usage
  7. 7. Mercedes-Benz Tech Innovation OSMC | 16.11.2022 7 Data Science & Prediction Forecasting using XGBoost and Recurrent Neural Networks. Modeltraining Forecasting Monthly Training – Recurrent Network LSTM Daily Forecasting Anomalie Detection 10 min Prediction Process
  8. 8. Mercedes-Benz Tech Innovation OSMC | 16.11.2022 8 Data Science & Prediction Handling Real Time Performance Issues
  9. 9. Mercedes-Benz Tech Innovation OSMC | 16.11.2022 9 Building AI Driven Prediction Eco-System
  10. 10. Mercedes-Benz Tech Innovation 10 Apply now and be part of our team: www.mercedes-benz- techinnovation.com/en/jobs/ We‘re hiring!
  11. 11. Mercedes-Benz Tech Innovation GmbH Wilhelm-Runge-Street 11, 89081 Ulm Phone +49 731 505-06 / techinnovation@mercedes-benz.com / www.mercedes-benz-techinnovation.com Domicile and Court Registry: Ulm / HRB-No.: 3844 / Management: Daniel Geisel (CEO), Isabelle Krautwald

×