Github's Orchestrator Hashicorp's Consul, Vault ProxySQL

1. Orchestrator, Consul, ProxySQL
with Super Tengen Toppa
Lee hyeongchae
FB/MySQL Korea User Group

2. Orchestrator, Consul, ProxySQL
with Super Tengen Toppa

4. Agenda
● WiX Engineering
- Orchestarting ProxySQL with OCP
● Github’s Orchestrator
● HashiCorp’s Consul
● ProxySQL and PMM
● Summary of TMI
● Demo
Copyright © 2020 HashiCorp

5. WiX Engineering
Orchestarting ProxySQL with OCP

6. @WixEng #PerconaLive 2017
Orchestarting ProxySQL with OCP - Avi(Avraham) Apelbaum
https://www.percona.com/blog/2017/08/31/percona-live-europe-featured-talks-orchestrating-proxysql-orchestrator-consul

7. @WixEng #PerconaLive 2017
Orchestarting ProxySQL with OCP

8. @WixEng #PerconaLive 2017
Orchestarting ProxySQL with OCP - Consul Cluster

9. @WixEng #PerconaLive 2017
Orchestarting ProxySQL with OCP - Orchestrator ( +meta repos )

10. @WixEng #PerconaLive 2017
Orchestarting ProxySQL with OCP - ProxySQL Cluster ( +Consul Agent )

11. @WixEng #PerconaLive 2017
Orchestarting ProxySQL with OCP - MySQL Cluster

12. Github’s Orchestrator

13. Yoshinori Matsunobu san’s MHA
Naver, Kakao, … etc
http://yoshinorimatsunobu.blogspot.com/2011/07/announcing-mysql-mha-mysql-master-high.html

14. Github’s Orchestrator
MySQL Replication Topology Management

15. Github’s Incident Analysis
2018.10.30
https://blog.github.com/2018-10-30-oct21-post-incident-analysis

16. code.openark.org
By Shlomi Noach
● MySQL master discovery methods, part 1: DNS
● MySQL master discovery methods, part 2: VIP & DNS
● MySQL master discovery methods, part 3: app & service discovery
● MySQL master discovery methods, part 4: Proxy heuristics
● MySQL master discovery methods, part 5: Service discovery & Proxy
● MySQL master discovery methods, part 6: other methods

17. By Shlomi Noach
Integration with Orchestrator

18. Hashicorp’s Consul

19. Hashicorp’s Consul

20. What is ...

21. History
Project Implementor Initial Release
Chubby Google 2006
Zookeeper Apache 2007
Doozerd Blake Mizerany 2010
Eureka Netflix 2012
ETCD CoreOS 2013
SmartStack Airbnb 2013
Surf HashiCorp 2014
SkyDNS Erik St. Martion 2014
Consul HashiCorp 2014

22. Sidecar Pattern
- Envoy Integration Parasyte

23. Autopilot or Bot Pattern
Service Mesh, DNS(SRV), Key-Value, … and Consul Template, envconsul
https://www.joyent.com/blog/applications-on-autopilot

24. ProxySQL and PMM

25. High-Performance MySQL Proxy

26. ProxySQL with consul
introduction, development, turn, and conclusion.
https://www.percona.com/blog/category/proxysql

27. PMM (Percona Monitoring and Management)
Orchestrator, ProxySQL, MySQL, ....

28. PMM = Prometheus + Grafana + Consul + ...

29. Summary of TMI

30. Summary
Parasite Architecture
● Web UI based HA : Orchestartor
● Parasite : Consul, Consul Template
● L7 Proxy : ProxySQL
● Monitoring : PMM
● DNS : dnsmasq, PowerDNS
● Data Plane : Envoy Proxy
● Control Plane : solo.io’s Gloo ( jaeger, opentracing )
● Auth : Hashicorp’s Vault, FreeIPA

32. HashiCorp Vault

33. MySQL Bastion
Approval Workflow
https://medium.com/hootsuite-engineering/mysql-bastion-streamlined-db-access-with-proxysql-vault-and-ad-aa79877247b4

34. MySQL Bastion
Access Workflow

35. ProxySQL 2.0
New Feature - LDAP plugin
https://www.percona.com/sites/default/files/ple19-slides/day1-pm/securing-pii-data-in-mysql.pdf

36. Secret Engines
proxysql-plugin
https://github.com/sql2/vault-proxysql-plugins

37. Demo

38. TERMINAL
> https://github.com/sql2/CPOP

39. Thank You
hyeongchae@gmail.com
39