End to-end monitoring with the prometheus operator - Max Inden
•
4 j'aime•2,370 vues
Retrouvez la présentation de Max Inden de Core OS lors du Paris Container Day
Recommandé
Contenu connexe
Tendances
Tendances (20)
Similaire à End to-end monitoring with the prometheus operator - Max Inden
Similaire à End to-end monitoring with the prometheus operator - Max Inden (20)
Plus de Paris Container Day
Plus de Paris Container Day (10)
Dernier
Dernier (20)
End to-end monitoring with the prometheus operator - Max Inden
- 1. End-to-end Monitoring with the Prometheus Operator By @mxinden
- 2. Max Inden Test-Engineer at CoreOS @mxinden Max.Inden@CoreOS.com
- 3. Secure, simplify and automate container infrastructure
- 4. Secure, simplify and automate container infrastructure
- 5. Secure, simplify and automate container infrastructure
- 6. Secure, simplify and automate container infrastructure
- 11. What is Prometheus? ● Open Source Monitoring ● Built by Soundcloud ● Inspired by borgmon ●
- 12. What is Prometheus? ● Pull-based ●
- 13. What is Prometheus? ● Pull-based ● Multi-Dimensional ●
- 14. What is Prometheus? ● Pull-based ● Multi-Dimensional ● Metrics, not logging, not tracing ●
- 15. What is Prometheus? ● Pull-based ● Multi-Dimensional ● Metrics, not logging, not tracing ● No magic! ●
- 17. Target /metrics Target /metrics Target /metrics
- 18. Prometheus Target /metrics Target /metrics Target /metrics
- 19. Prometheus Target /metrics Target /metrics Target /metrics 15s
- 20. Target /metrics # HELP http_requests_total Total number of HTTP requests made. # TYPE http_requests_total counter http_requests_total{code="200",path="/status"} 8
- 21. Target /metrics # HELP http_requests_total Total number of HTTP requests made. # TYPE http_requests_total counter http_requests_total{code="200",path="/status"} 8 Metric name
- 22. Target /metrics # HELP http_requests_total Total number of HTTP requests made. # TYPE http_requests_total counter http_requests_total{code="200",path="/status"} 8 Label
- 23. Target /metrics # HELP http_requests_total Total number of HTTP requests made. # TYPE http_requests_total counter http_requests_total{code="200",path="/status"} 8 Value
- 24. Prometheus Target /metrics Target /metrics Target /metrics
- 25. Prometheus Target /metrics Target /metrics Target /metrics PromQL
- 26. Current percentage of HTTP errors across all service instances?
- 27. Current percentage of HTTP errors across all service instances? sum by(path) rate(http_requests_total{status="500"}[5m])) / sum by(path) rate(http_requests_total[5m]))
- 28. Current percentage of HTTP errors across all service instances? {path="/status"} 0.0039 {path="/"} 0.0011 {path="/api/v1/topics/:topic"} 0.087 {path="/api/v1/topics} 0.0342 sum by(path) rate(http_requests_total{status="500"}[5m])) / sum by(path) rate(http_requests_total[5m]))
- 29. Prometheus Target /metrics Target /metrics Target /metrics PromQL
- 30. Prometheus Target /metrics Target /metrics Target /metrics PromQL Web UI Dashboard
- 31. Prometheus Target /metrics Target /metrics Target /metrics
- 32. Prometheus Target /metrics Target /metrics Target /metrics Alert Definition
- 33. ALERT DiskWillFillIn4Hours IF predict_linear(node_filesystem_free[1h], 4*3600) < 0 Is any disk about to run full within 4 hours? 0 now-1h +4h
- 34. Prometheus Target /metrics Target /metrics Target /metrics Alert Definition
- 35. Prometheus Target /metrics Target /metrics Target /metrics Alert Definition 1m
- 36. Prometheus Target /metrics Target /metrics Target /metrics Alert Definition 1m
- 37. Prometheus Target /metrics Target /metrics Target /metrics Alert Definition Alertmanager 1m
- 42. Prometheus Target /metrics Target /metrics Target /metrics Alertmanager
- 43. Prometheus Target /metrics Target /metrics Target /metrics Alertmanager
- 45. Monitoring
- 48. What is Kubernetes? Platform for running containerized applications
- 49. What is Kubernetes? Announced 2014 by Google Influenced by Borg & Omega v1.01 in July 2015 Kubernetes joins the CNCF
- 50. Master
- 62. Service Discovery ● Static target list ● DNS discovery ● Kubernetes discovery ● ...
- 65. Problem Prometheus is stateful and difficult to configure!
- 67. What is a K8s Operator?
- 68. What is a K8s Operator? Application specific operational knowledge
- 69. What is a K8s Operator?
- 70. What is a K8s Operator? </>
- 71. What is a K8s Operator? </>
- 72. What is a K8s Operator? </> Operator
- 74. Prometheus Operator ● Kubernetes native configuration ● Automated management and upgrades of Prometheus & Alertmanager
- 75. apiVersion: extensions/v1beta1 kind: Deployment metadata: name: my-app spec: ...
- 76. apiVersion: monitoring.coreos.com/v1alpha1 kind: Prometheus metadata: name: prometheus-k8s spec: ...
- 77. Kube-Prometheus Single command to install: ● Prometheus & Alertmanager Cluster ● Alerting rules ● Dashboarding
- 78. Demo
- 79. Recap
- 80. What is Prometheus? ● Pull-based ● Multi-Dimensional ● Metrics, not logging, not tracing ● No magic! ●
- 81. Prometheus Target /metrics Target /metrics Target /metrics 15s
- 82. Prometheus Target /metrics Target /metrics Target /metrics Alert Definition Alertmanager 1m
- 84. Where to go from here? Prometheus.io /coreos/prometheus-operator
- 85. San Francisco, New York & Berlin We are hiring!
- 86. Max Inden Test-Engineer at CoreOS @mxinden Max.Inden@CoreOS.com