Introduction to msales' monitoring stack. How to use Graylog and Grafana in a local environment. Presented by Mateusz Wadoń

1. Our way of system monitoring
in application development.

2. 2
About me
UI/UX enthusiast
Mateusz Wadoń
mateusz.wadon@msales.com
Software Developer at msales
@mwadon

3. 3
Monitoring Stack
Open-source: Grafana and Graylog
Localhost is free
DevOps knowledge
https://github.com/msales/ocoderfest-monitoring

4. 4
Offline mode

5. 5
Solution
version: "3"
services:
influxdb: ...
grafana: ...
mysql: ...
telegraf: ...
mongo: ...
elasticsearch: ...
graylog: ...
reverse-proxy: ...
networks:
ocoderfest-msales:
external: true

6. 6
Docker network

7. 7
Docker network
docker network create --driver bridge ocoderfest-msales
services:
influxdb:
container_name: influxdb.container
build: ./docker/influxdb
networks:
- ocoderfest-msales
ports:
- 8086:8086
grafana:
container_name: grafana.container
build: ./docker/grafana
restart: always
networks:
- ocoderfest-msales
depends_on:
- mysql
- influxdb
services:
php:
container_name: graylog_microservice_php
build: ./docker/php
networks:
- graylog-microservice
- ocoderfest-msales
volumes_from:
- code
depends_on:
- code
composer:
container_name: graylog_microservice_composer
build: ./docker/php
entrypoint: composer
networks:
- graylog-microservice
volumes_from:
- code
depends_on:
- code

8. 8
Localhost problem

9. 9
Localhost everywhere
InfluxDB
influxdb:
container_name: influxdb.container
build: ./docker/influxdb
networks:
- ocoderfest-msales
ports:
- 8086:8086
- 8083:8083

10. 10
Localhost everywhere
Grafana
grafana:
container_name: grafana.container
build: ./docker/grafana
restart: always
networks:
- ocoderfest-msales
ports:
- 3000:3000
depends_on:
- mysql
- influxdb

11. 11
Localhost everywhere
Graylog
graylog:
container_name: graylog.container
build: ./docker/graylog
depends_on:
- mongo
- elasticsearch
networks:
- ocoderfest-msales
ports:
- 9000:9000

12. 12
Reverse proxy
server {
listen 8888;
server_name influxdb.ocoderfest.msales;
location / {
proxy_pass http://influxdb.container:8083;
}
}
server {
listen 8888;
server_name grafana.ocoderfest.msales;
location / {
proxy_pass http://grafana.container:3000;
}
}
server {
listen 8888;
server_name graylog.ocoderfest.msales;
location / {
proxy_pass http://graylog.container:9000;
}
}

13. Reverse proxy
server {
listen 8888;
server_name influxdb.ocoderfest.msales;
location / {
proxy_pass http://influxdb.container:8083;
}
}
server {
listen 8888;
server_name grafana.ocoderfest.msales;
location / {
proxy_pass http://grafana.container:3000;
}
}
server {
listen 8888;
server_name graylog.ocoderfest.msales;
location / {
proxy_pass http://graylog.container:9000;
}
}
reverse-proxy:
container_name: reverse-proxy.container
build: ./docker/reverse-proxy
restart: always
networks:
- ocoderfest-msales
ports:
- 8888:8888
depends_on:
- influxdb
- grafana
- graylog

14. 14
Reverse proxy
server {
listen 8888;
server_name influxdb.ocoderfest.msales;
location / {
proxy_pass http://influxdb.container:8083;
}
}
server {
listen 8888;
server_name grafana.ocoderfest.msales;
location / {
proxy_pass http://grafana.container:3000;
}
}
server {
listen 8888;
server_name graylog.ocoderfest.msales;
location / {
proxy_pass http://graylog.container:9000;
}
}
127.0.0.1 influxdb.ocoderfest.msales
127.0.0.1 grafana.ocoderfest.msales
127.0.0.1 graylog.ocoderfest.msales

15. 15
Reverse proxy
server {
listen 8888;
server_name influxdb.ocoderfest.msales;
location / {
proxy_pass http://influxdb.container:8083;
}
}
server {
listen 8888;
server_name grafana.ocoderfest.msales;
location / {
proxy_pass http://grafana.container:3000;
}
}
server {
listen 8888;
server_name graylog.ocoderfest.msales;
location / {
proxy_pass http://graylog.container:9000;
}
}
influxdb:
container_name: influxdb.container
build: ./docker/influxdb
networks:
- ocoderfest-msales
ports:
- 8086:8086
grafana:
container_name: grafana.container
build: ./docker/grafana
restart: always
networks:
- ocoderfest-msales
depends_on:
- mysql
- influxdb
graylog:
container_name: graylog.container
build: ./docker/graylog
environment:
...
depends_on:
- mongo
- elasticsearch
networks:
- ocoderfest-msales

16. 16
Reverse proxy
grafana (http://grafana.ocoderfest.msales:8888)
influxdb (http://influxdb.ocoderfest.msales:8888)
graylog (http://graylog.ocoderfest.msales:8888)

17. 17
Port conflicts

18. 18
Demo
https://github.com/msales/ocoderfest-monitoring

19. 19

20. 20
Thanks
info.pl@msales.com www.msales.com +48 32 630 40 76
follow us @msalestech
follow me @mwadon