apidays LIVE Helsinki & North: API Ecosystems - Connecting Physical and Digital March 16 & 17, 2022 Progressive Delivery in Kubernetes without Service Meshes Ara Pulido, Senior Technical Evangelist at Datadog

1. Progressive Delivery
in Kubernetes
(Service Mesh Free!)
Ara Pulido
@arapulido

2. Datadog is a monitoring
and analytics platform
that helps companies
improve observability
of their infrastructure
and applications

3. Kubernetes is a
container orchestration
platform to help you run
your containerized
applications in
production

4. @arapulido
What is
PROGRESSIVE
DELIVERY

5. @arapulido
Canary
PROGRESSIVE DELIVERY

6. @arapulido
Canary A/B Testing
PROGRESSIVE DELIVERY

7. @arapulido
Having code in
that not every user sees
PRODUCTION

8. @arapulido
Having a good
strategy is key
OBSERVABILITY

9. @arapulido
Progressive Delivery &
SERVICE MESHES

10. @arapulido
Data Plane
Service Mesh
Main container
Sidecar proxy
Pod

11. @arapulido
Data Plane
Control Plane
Service Mesh

12. @arapulido
Service Meshes add
to your Kubernetes cluster
COMPLEXITY

13. @arapulido
Service Networking
#1

14. @arapulido
Pod
Pod
Pod
SERVICE NETWORKING
Deployment

15. @arapulido
Pod
Pod
Pod
Client
SERVICE NETWORKING
Deployment

16. @arapulido
Pod
Pod
Pod
Client
SERVICE NETWORKING
Deployment
?

17. @arapulido
Service
Pod
Pod
Pod
Client
SERVICE NETWORKING

18. @arapulido
node
Service
Pod
Pod
Pod
Client
kube-proxy
SERVICE NETWORKING

19. @arapulido
Pod
v1
Pod
v1
Pod
v1
app:website
service:discounts
app:website
service:discounts
app:website
service:discounts
Deployment

20. @arapulido
Pod
v1
Pod
v1
Pod
v1
app:website
service:discounts
app:website
service:discounts
app:website
service:discounts
app:website
service:discounts
Deployment

21. @arapulido
Pod
v1
Pod
v1
Pod
v1
app:website
service:discounts
app:website
service:discounts
app:website
service:discounts
app:website
service:discounts
Deployment
Pod
v2
app:website
service:discounts
Deployment

22. @arapulido
Pod
v1
Pod
v1
Pod
v1
app:website
service:discounts
app:website
service:discounts
app:website
service:discounts
app:website
service:discounts
Pod
v2
app:website
service:discounts
Deployment
Deployment

23. @arapulido
Pod
v1
Pod
v1
Pod
v1
Pod
v2
app:website
service:discounts
app:website
service:discounts
app:website
service:discounts
app:website
service:discounts
app:website
service:discounts
25%OF TRAFFIC WILL GO TO
THE POD RUNNING V2
Deployment
Deployment

24. @arapulido
Ingress
#2

25. @arapulido
Load
Balancer

26. @arapulido
service:corporate
Load
Balancer
service:ecommerce

27. @arapulido
service:corporate
Load
Balancer
service:ecommerce
Ingress
corporate.com
shop.corporate.com

28. @arapulido
service1
service2
Ingress
foo.bar.com/foo
foo.bar.com/bar

29. @arapulido

30. @arapulido
Each implementation will have
its own way to do canaries
Ingress Controllers

31. @arapulido

32. @arapulido
service:frontend
Load
Balancer
shop.corporate.com
service:discounts service:holidays

33. @arapulido
service:frontend
Load
Balancer
Ingress
shop.corporate.com
service:discounts service:holidays

34. @arapulido
service:frontend
Load
Balancer
Ingress
shop.corporate.com
service:discounts service:holidays
service:frontend2
Ingress 2
90% traffic
10% traffic

35. @arapulido
service:frontend
Load
Balancer
Ingress
shop.corporate.com
service:discounts service:holidays
service:frontend2
Ingress 2
90% traffic
10% traffic
ANNOTATIONS
ARE NOT PART
OF THE SPEC

36. @arapulido
Each implementation will have
its own way to do canaries
Ingress Controllers

37. @arapulido
Gateway API
#3

38. @arapulido
Gateway API
#3
ALPHA

39. @arapulido
A set of APIs for deploying
L4 AND L7 ROUTING
Gateway API

40. @arapulido
Designed to be
expressive, extensible,
and role oriented
Gateway API
GENERIC,

41. @arapulido
service:frontend
Load
Balancer
prod-web-gw
service:frontend2
HTTPRoute
90% traffic
10% traffic

42. @arapulido

43. @arapulido
service:frontend
HTTPRoute service:discounts service:holidays
HTTPRoute
50% traffic
50% traffic
service:frontend service:discounts service:holidays
ns2
ns1
Load
Balancer
prod-web-gw

44. @arapulido
service:frontend
HTTPRoute service:discounts service:holidays
HTTPRoute
50% traffic
50% traffic
service:frontend service:discounts service:holidays
ns2
ns1
Load
Balancer
prod-web-gw
100%OF TRAFFIC WENT TO ONE
OF THE NAMESPACES
FAIL

45. @arapulido

46. @arapulido
v1alpha2

47. @arapulido
Gateway API
gateway-api.sigs.k8s.io

48. @arapulido
RECAP

49. @arapulido
Service Meshes are not required for progressive
delivery in Kubernetes
RECAP

50. @arapulido
Service Meshes are not required for progressive
delivery in Kubernetes
RECAP
The Ingress object doesn’t support canaries, but
implementations do

51. @arapulido
Service Meshes are not required for progressive
delivery in Kubernetes
RECAP
The Ingress object doesn’t support canaries, but
implementations do
Gateway API is a new K8s API extension to
standardize vendor implementations

52. @arapulido
Service Meshes are not required for progressive
delivery in Kubernetes
RECAP
The Ingress object doesn’t support canaries, but
implementations do
Gateway API is a new K8s API extension to
standardize vendor implementations
Good observability is key for successful progressive
deliveries

53. Thanks!
(we’re hiring!)
Ara Pulido
@arapulido