Monitoring mayhem - Using Prometheus

•Download as PPTX, PDF•

0 likes•618 views

How to monitor a Docker Swarms with Prometheues, Google cAdvisor & Node Exporter while sending alerts to Slack. This provides background on monitoring, some best practices and the landscape of containers at the moment.

Technology

Agenda
• Introduction
• Monitoring Overview
• Monitoring Components
• Demo
2

Brian Christner
Brian.Christner@swisscom.com / @idomyowntricks
> Swisscom Cloud Architect
> Docker Captain
> Background in Containers, Cloud, & Engineering
About me

Swisscom Developer Portal
Home for innovators and passionate developers
developer.swisscom.com
@Swisscom_Dev

Monitoring & Docker Swarm Overview
Did someone say
Monitoring?

Monitoring Best Practices
• Label your Containers (key value pair)
• --label environment="production"
• Set Resource Limits
• Don’t overlert yourself

Long vs Short Lived Containers
Long Lived Short Lived

What were building
https://github.com/vegasbrianc/prometheus

13
https://github.com/google/cadvisor
https://hub.docker.com/r/google/cadvisor
(Container Advisor)

Prometheus Node Exporter
https://github.com/r/prom/node-exporter
• Machine Metrics
• Pluggable Metrics

Prometheus Integrations
Official 3rd Party Exporters
• Blackbox
• CollectD
• Consul
• Graphite
• HAProxy
• InfluxDB
• JMX
• MEMcached
• Mesos
• MySQL
• SNMP
• StatsD
Official Client Libraries
• GO
• Java or Scala
• Python
• Ruby
Un-Official Client Libraries
• Bash
• Lisp
• Elixr
• Erlang
• Haskell
• Nua (NGINX)
• .NET / C#
• Node.js
• PHP
Directly Instrumented Software
• cAdvisor
• Node Ecporter
• Doorman
• Etcd
• Kubernetes-Mesos
• Kubernetes
• RobustIRC
• SkyDNS
• Weave Flux

MacBook Swarm
Internal Network Routing
Prometheus
MGR
Node01
cAdvisor My App
cAdvisor My App
Node02
cAdvisor My App
Grafana
Alert Manager
Promtheus Stack

Great Docker Resource –
http://veggiemonk.github.io/awesome-docker/
My Docker Projects - https://github.com/vegasbrianc
Docker Resources

What's hot

Cloud Native & DockerBrian Christner

DCSF19 Kubernetes Security with OPA Docker, Inc.

Canary Releases on Kubernetes w/ Spinnaker, Istio, and PrometheusKublr

Tectonic Summit 2016: Multi-Cluster Kubernetes: Planning for UnknownsCoreOS

End-to-end test automation with Endtest.devKonstantin Tarkus

Migrating Java JBoss EAP Applications to Kubernetes With S2IKonveyor Community

Mc git ops_incorpbackups_kanisterLibbySchulze

Remote debugging of Application in KubernetesConSol Consulting & Solutions Software GmbH

Metal³ – Metal Kubed, Bare Metal Provisioning for Kubernetes | Kim Bảo LongVietnam Open Infrastructure User Group

DockerCon SF 2015: Interconnecting Containers at Scale w/ NGINXDocker, Inc.

Cloud Native & DockerBrian Christner

Continuous Delivery to Kubernetes Using HelmAdnan Abdulhussein

How Docker EE Helps Open Doors at Assa AbloyDocker, Inc.

How to Run Kubernetes in Restrictive EnvironmentsKublr

DockerCon 18 Cool Hacks: solo.ioDocker, Inc.

DockerCon SF 2015 : Reliably shipping containers in a resource rich world usi...Docker, Inc.

Tectonic Summit 2016: Brandon Philips, CTO of CoreOS, KeynoteCoreOS

Choosing the right storage for stateful workloads on KubernetesLibbySchulze

Kubernetes Deployments: A "Hands-off" ApproachRodrigo Reis

Breaking tradition the future of package management with kubernetesLibbySchulze

What's hot (20)

Cloud Native & Docker

DCSF19 Kubernetes Security with OPA

Canary Releases on Kubernetes w/ Spinnaker, Istio, and Prometheus

Tectonic Summit 2016: Multi-Cluster Kubernetes: Planning for Unknowns

End-to-end test automation with Endtest.dev

Migrating Java JBoss EAP Applications to Kubernetes With S2I

Mc git ops_incorpbackups_kanister

Remote debugging of Application in Kubernetes

Metal³ – Metal Kubed, Bare Metal Provisioning for Kubernetes | Kim Bảo Long

DockerCon SF 2015: Interconnecting Containers at Scale w/ NGINX

Cloud Native & Docker

Continuous Delivery to Kubernetes Using Helm

How Docker EE Helps Open Doors at Assa Abloy

How to Run Kubernetes in Restrictive Environments

DockerCon 18 Cool Hacks: solo.io

DockerCon SF 2015 : Reliably shipping containers in a resource rich world usi...

Tectonic Summit 2016: Brandon Philips, CTO of CoreOS, Keynote

Choosing the right storage for stateful workloads on Kubernetes

Kubernetes Deployments: A "Hands-off" Approach

Breaking tradition the future of package management with kubernetes

Similar to Monitoring mayhem - Using Prometheus

Webinar: From Development to Production with Docker and MongoDBMongoDB

WSO2ConEU 2016 Tutorial - Deploying WSO2 Middleware on ContainersLakmal Warusawithana

Deploying WSO2 Middleware on ContainersImesh Gunaratne

Docker Containers for Continuous DeliverySynerzip

The new repository in AEM 6Jukka Zitting

Использование AzureDevOps при разработке микросервисных приложенийVitebsk Miniq

Docker Enterprise Workshop - IntroPatrick Chanezon

20160930 cloud foundry_overviewTakuya Saeki

Docker in Production: How RightScale Delivers Cloud ApplicationsRightScale

Cloud-native .NET Microservices mit KubernetesQAware GmbH

Docker Timisoara: Dockercon19 recap slides, 23 may 2019Radulescu Adina-Valentina

Containerising bootiful microservices javaeeconfIvan Vasyliev

Customizing Apache CloudStack - CCC13Ilya Musayev

Docker 101Arthur De Magalhaes

Docker Enterprise Workshop - TechnicalPatrick Chanezon

O'Reilly Software Architecture Conference London 2017: Building Resilient Mic...Ambassador Labs

Experts Live Switzerland 2017 - Automatisierte Docker Release Pipeline mit VS...Marc Müller

from Docker to Moby and back. what changed ?strikr .

Docker - From Walking To RunningGiacomo Vacca

Node.js on microsoft azure april 2014Brian Benz

Similar to Monitoring mayhem - Using Prometheus (20)

Webinar: From Development to Production with Docker and MongoDB

WSO2ConEU 2016 Tutorial - Deploying WSO2 Middleware on Containers

Deploying WSO2 Middleware on Containers

Docker Containers for Continuous Delivery

The new repository in AEM 6

Использование AzureDevOps при разработке микросервисных приложений

Docker Enterprise Workshop - Intro

20160930 cloud foundry_overview

Docker in Production: How RightScale Delivers Cloud Applications

Cloud-native .NET Microservices mit Kubernetes

Docker Timisoara: Dockercon19 recap slides, 23 may 2019

Containerising bootiful microservices javaeeconf

Customizing Apache CloudStack - CCC13

Docker 101

Docker Enterprise Workshop - Technical

O'Reilly Software Architecture Conference London 2017: Building Resilient Mic...

Experts Live Switzerland 2017 - Automatisierte Docker Release Pipeline mit VS...

from Docker to Moby and back. what changed ?

Docker - From Walking To Running

Node.js on microsoft azure april 2014

Recently uploaded

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh

Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra

A Beginners Guide to Building a RAG App Using Open Source MilvusZilliz

MS Copilot expands with MS Graph connectorsNanddeep Nachan

A Year of the Servo Reboot: Where Are We Now?Igalia

FWD Group - Insurer Innovation Award 2024The Digital Insurer

Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1

AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin

Automating Google Workspace (GWS) & more with Apps Scriptwesley chun

ICT role in 21st century education and its challengesrafiqahmad00786416

Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software

Architecting Cloud Native ApplicationsWSO2

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays

2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...apidays

Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2

Recently uploaded (20)

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Strategies for Landing an Oracle DBA Job as a Fresher

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

A Beginners Guide to Building a RAG App Using Open Source Milvus

MS Copilot expands with MS Graph connectors

A Year of the Servo Reboot: Where Are We Now?

FWD Group - Insurer Innovation Award 2024

Boost Fertility New Invention Ups Success Rates.pdf

AWS Community Day CPH - Three problems of Terraform

Automating Google Workspace (GWS) & more with Apps Script

ICT role in 21st century education and its challenges

Artificial Intelligence Chap.5 : Uncertainty

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Architecting Cloud Native Applications

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...

Exploring the Future Potential of AI-Enabled Smartphone Processors

Monitoring mayhem - Using Prometheus

1. Brian Christner 21 September 2016

2. Agenda • Introduction • Monitoring Overview • Monitoring Components • Demo 2

3. Brian Christner Brian.Christner@swisscom.com / @idomyowntricks > Swisscom Cloud Architect > Docker Captain > Background in Containers, Cloud, & Engineering About me

4. Swisscom Developer Portal Home for innovators and passionate developers developer.swisscom.com @Swisscom_Dev

5. Monitoring Overview

6. Monitoring & Docker Swarm Overview Did someone say Monitoring?

8. Monitoring Best Practices • Label your Containers (key value pair) • --label environment="production" • Set Resource Limits • Don’t overlert yourself

9. Long vs Short Lived Containers Long Lived Short Lived

10. Monitoring Components

11. What were building https://github.com/vegasbrianc/prometheus

12.

13. 13 https://github.com/google/cadvisor https://hub.docker.com/r/google/cadvisor (Container Advisor)

14. Prometheus Node Exporter https://github.com/r/prom/node-exporter • Machine Metrics • Pluggable Metrics

15. Prometheus Integrations Official 3rd Party Exporters • Blackbox • CollectD • Consul • Graphite • HAProxy • InfluxDB • JMX • MEMcached • Mesos • MySQL • SNMP • StatsD Official Client Libraries • GO • Java or Scala • Python • Ruby Un-Official Client Libraries • Bash • Lisp • Elixr • Erlang • Haskell • Nua (NGINX) • .NET / C# • Node.js • PHP Directly Instrumented Software • cAdvisor • Node Ecporter • Doorman • Etcd • Kubernetes-Mesos • Kubernetes • RobustIRC • SkyDNS • Weave Flux

16. MacBook Swarm Internal Network Routing Prometheus MGR Node01 cAdvisor My App cAdvisor My App Node02 cAdvisor My App Grafana Alert Manager Promtheus Stack

17. Compose File

18. Let’s have a look: DEMO

19. Great Docker Resource – http://veggiemonk.github.io/awesome-docker/ My Docker Projects - https://github.com/vegasbrianc Docker Resources

20. Questions?

Monitoring mayhem - Using Prometheus

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Monitoring mayhem - Using Prometheus

Similar to Monitoring mayhem - Using Prometheus (20)

More from Brian Christner

More from Brian Christner (11)

Recently uploaded

Recently uploaded (20)

Monitoring mayhem - Using Prometheus