Apache Pulsar Meetup 1116

1. 冉⼩⻰ 俄⼴宁
使⽤ pulsarctl 和 pulsar-manager
管理 pulsar 集群
2019/11/16

2. Who am I
• Go programmer
• PingCAP > Bitmain > StreamNative
• Pulsar committer
◦ pulsar-client-go
◦ Go Functions
◦ …
• https://github.com/wolfstudy

3. 01 Why develop pulsarctl 02 What is pulsarctl
03 How to use Admin Api 04 How to use CLI
05 How to contribute 06 Future
Pulsarctl

4. Why develop pulsarctl
• Apache Pulsar 是云原⽣的分布式系统
• pulsar admin 存在的问题
• 依赖多，需要加载JVM环境
• 描述信息不全
• 不易于 debug

5. 基于 REST API 使⽤ Go 语⾔开发的⼀个 CTL ⼯具
What is pulsarctl
Go Admin API
Command-cli tools
pulsarctl

6. How to use Admin Api
https://godoc.org/github.com/streamnative/pulsarctl

7. How to use Admin Api
Cluster.List()
instantiate a admin object
Call interface
1
2
https://github.com/streamnative/pulsarctl/blob/master/examples.go

8. How to use CLI
• Used for : 对该命令的使⽤场景进⾏描述
• Required Permission：使⽤该命令所需要的
权限
• Output：列出使⽤该命令所有的输出信息，包
括正确的输出和错误的输出
• Examples：列出命令的使⽤示例
• Flags: 该命令所需要的所有参数列表
https://streamnative.io/docs/pulsarctl/v0.1.0/

9. pulsarctl VS pulsar admin
废弃 json string, 使⽤特殊字符代替

10. pulsarctl VS pulsar admin
拆分 topics commands
subscriptions
topics

11. pulsarctl VS pulsar admin
整合 topics commands
partition topic
topic

12. How to contribute
https://github.com/streamnative/pulsarctl/blob/master/docs/zh/developer-guide.md
https://github.com/streamnative/pulsarctl/blob/master/CONTRIBUTING.md
https://github.com/streamnative/pulsarctl/

13. Feature
https://github.com/streamnative/pulsarctl/issues
• Add pulsarctl to Homebrew
• Add context for pulsarctl
• Add bookkeeper cli
• Separate policies from subscriptions
• Support different ways to dump result
• …

14. Thanks
Q & A

15. Who am I
• Java && Python programmer
• Creditease > Meituan > StreamNative
• Pulsar committer
◦ Pulsar Connector
◦ Pulsar Manager
◦ …
• https://github.com/tuteng

16. 01 Motivation 02 Operation
03 Doing 04 Future
Contents

17. Motivation
01

18. Motivation
Dashboard Pulsar-managerVS
• Focus on simple monitoring
• Weak management
• Multi-cluster is not
supported
• Focus on management
• Simple monitoring
• Multi-cluster, multi-environment
management
• More suitable for cloud
• JWT authentication authorization and
management
• Deployment simple

19. Operation
02

20. Operation

21. Multiple environments

22. Multiple clusters
• Geo replication
• Global tenants, namespace
• Topics management by cluster

23. Clusters management
• Set basic configuration
• Set failure domains
• Isolation policies

24. Clusters management

25. Tenants management
• Create Tenant
• Delete Tenant
• Update Configuration

26. Tenants management

27. Namespaces management
• Create Namespace
• Delete Namespace
• Update Policies

28. Namespaces management

29. Topics management
• More info(Storage, segment, cursor)
• Create Topic(Persistent, non-persistent)
• Delete Topic
• Update Configuration
• Topics monitor(Aggregated data)

30. Topics management

31. Topics monitor

32. Subscription management
• Consumer information
• Backlog skip
• Backlog clear
• Backlog expire
• Reset cursor

33. Subscription management

34. Authentication and authorization
• JWT tokens management
• Namespace grant permission
• Topic grant permission

35. Authentication and authorization

36. Deployment
• Docker
• K8s
• Self build

37. Doing
03

38. Authentication and authorization

39. Authentication and authorization
• User management
• Role management
• Deep into with multi tenant
• More detailed permission design

40. Authentication and authorization

41. Future
04

42. Future
• Aggregated data for tenants, namespaces
• Support large of topics(search, query, page)
• Bookies management

43. Thanks