Sydney MuleSoft Meetup - 15th July 2021
Designing Apps for Runtime Fabric: Logging, Monitoring & Object Store Persistence
Speakers:
- Shefreen Kunhimohamed, NJC Labs, Integration Architect
Hosts/Moderators:
- Eva Mave Ng, MuleSoft, Senior Solution Engineer
- Royston Lobo, MuleSoft, Senior Technical Architect
To be notified for all future events, please join the Sydney MuleSoft Meetup group at https://meetups.mulesoft.com/sydney/
16. Speaker
17
❑ 15+ years of experience in IT industry
❑ 4+ years in Enterprise Integration & 10+ years in RF Network
Design, Planning & Optimization.
❑ Integration Practice Lead at NJC Labs Australia
❑ MCD, MCIA & MCPA Certified
#Linkedin
https://www.linkedin.com/in/shefreen-kunhimohamed-
28554915/
17. 18
❑ Introduction
❑ Runtime Fabric Introduction
❑ RTF on Self Managed Kubernetes Overview
❑ Persistent Object Store in RTF
❑ Log Externalisation Options for RTF
❑ Demo
❑ Object Store Persistency in RTF
❑ Object Store Migration from Cloudhub to RTF
❑ Infrastructure Monitoring & Logging
❑ Trivia Quiz
Agenda
19. 20
Benefits
○ Deploy Mule runtimes across any cloud, including
Microsoft Azure, Amazon Web Services (AWS), and
data centers
○ Run multiple run time versions in the same Runtime
Fabric
○ Scale Horizontally and redeploy with zero downtime
○ Control plane management via Anypoint platform
Runtime Fabric Overview
Runtime Fabric orchestrates and automates the deployment of
mule runtimes and applications in to containers in any cloud or on-
premised environment
20. 21
Runtime Fabric is delivered to customers as a
package of components that run on top of an
existing EKS/AKS/GKE cluster
Kubernetes control plane is not from Mulesoft but
handled by customer through AWS/Azure/Google.
Setup and provision your own ingress controller
and log forwarded solution.
Customers maintain the health of Kubernetes , and
Mulesoft maintains the RTF services and Mule
application deployments
Runtime Fabric on Self Managed Kubernetes
Runtime Fabric(Self-managed)
or GKE
21. 22
Flexibility of deployment since you can chose from a number of
Kubernetes providers and deployment targets can be changed easily
because of containerised applications. Also memory allocation is flexible
during deployment. Applications can also be deployed with as low as 0.02
vCore (Cloudhub is 0.1 minimum).
Less overhead as EKS/AKS/GKE are highly available and managed by
respective cloud providers. Autoscaling and Node groups feature helps to
maintain the minimum number of computing nodes required and scaling
up when absolutely required
RTF on Self Managed Kubernetes beneftis
23. 24
● Introduced in Anypoint Runtime Fabric(version 1.9)
● Facilitates storage and sharing of data across application replicas and restarts,
backed up by PostgresSQL(9+) database.
● Uses Object Store v2 REST API via the Object Store Connector to connect to
Persistence Gateway
● Enables deployment to both Anypoint Runtime Fabric and CloudHub without having
to modify your Mule application.
● When configured, users can select Use Persistent Object Store when deploying an
application using Runtime Manager.
Object Store Persistence Gateway
24. 25
Object Store Migration – Typical Solution
● os-migration app is an object store
v2 REST API implementation using
mule
● Migration app can be deployed to
either cloudhub or RTF cluster.
● More details to cover in the demo
26. 27
Logging & Monitoring for RTF on SMK
1
2
3
1. Logging from the application – log4j solution not supported by SMK
2. Sidecar container with a logging agent: Not recommended due to significant resource
consumption
3. Node level logging agent – Daemon set deployment for every single node created
27. 28
Logging & Monitoring for RTF on SMK
Mule-app1 Mule-app1 Mule-app2
Mule-app2 Mule-app3 Mule-app4
Mule-app Logs & metrics
28. 29
❑ RTF Cluster
❑ K8 & RTF Cluster
❑ Object Store
❑ Object Store migration from cloudhub to RTF
❑ Object store Persistence demo for an application restarted
❑ Logging framework using ELK stack
❑ Logging of application
❑ Monitoring of Infrastructure
Demo – RTF on EKS
29. 30
Object Store Migration – Demo Scenario
OS backed by AWS
Postgresql RDS Service
Partition Key
persons id
persons idExtra
persons idString
employees employeeId
employees token
1
2
30. 31
Logging & Monitoring for RTF on SMK
Mule-app1 Mule-app1 Mule-app2
Mule-app2 Mule-app3 Mule-app4
Mule-app Logs & metrics
31. 32
Wrapping up
● Runtime Fabric on Self Managed Kubernetes
○ Runtime Fabric overview and benefits discussed
○ Object Store migration solution with Persistence Gateway feature introduced
in latest RTF version.
○ Log externalization options – ELK solution demonstrated
● Support
○ For detailed discussion, contact me at Shefreen@njclabs.com
○ NJC Labs is a MuleSoft SI and Training partner, specialized in Enterprise
Integration
○ We can help accelerate your MuleSoft implementations using our APIOps
platform.