Mackerel Meetup #7 LT

1. KOWAZA
for Mackerel
id:karupanerura
Mackerel Meetup #7 LT

2. KOWAZA means small trick
in Japanese

3. about me
• id:karupanerura (twitter/github)
• Perl/Go/Swift/Kotlin/Java/JS/etc..
• Senior Engineer at Mobile Factoy, Inc.
• Join to Infrastructure Team since 2016/02
• Director at Japan Perl Association (JPA)

4. mackerel with me
• Mackerel contributer
• mackerel-agent-plugins (gearman)
• mackerel-check—plugins (masterha, ssh)
• Mackerel UG Organizer ← NEW

5. monitor processes

6. check-procs -p mysqld

7. Wait…

8. (In my environment)
MySQL is stopped
to backup at 5am-6am.

9. 🤔

10. true && echo “true” || echo “false”

11. 😙

12. [ 5 -le “$hour” -and “$hour” -le 6 ]
&& echo “OK check-procs: In shutdown”
|| check-procs -p mysqld

13. 😎

14. monitor logs

15. grep foo /path/to/log
| grep bar
| grep -v baz
| wc -l

16. check-log plugin

17. check-log
-f /path/to/log
-p foo
-p bar
-E baz
-c 1

18. Wait…

19. check-log
-f /path/to/log
-p foo
-p bar ←Cannot do it :(
-E baz
-c 1

20. 🤔

21. check-log
-f <(grep foo /path/to/log)
-p bar
-E baz
-c 1

22. 😙

23. grep foo /path/to/log
| check-log
-f /dev/stdin
-p bar
-E baz
-c 1

24. 😎

25. monitor mouts

26. Should mount a HDD
as readable & writable

27. (If mount with errors=remout-ro)
When the HDD is breaking,
re-mount the HDD readonly

28. monitor with Mackerel

29. # XXX: exit code 2 is CRITICAL
touch /tmp/write-test.watch
|| exit 2

30. But, hackish…

31. no kind message outputs…

32. 🤔

33. check-log -f /proc/mounts
-p ' ro(,|$)’
--no-state

34. 😙

35. Let’s hack Mackerel !!

36. 😎