These slides are about log analytics and app insights with microsoft integration

2. App Insights
& Log Analytics
for Integration Solutions

3. About me
• Microsoft MVP 12 years
• Freelance Cloud Architect
• Based in Newcastle, UK
• https://mikestephenson.me/
• @Michael_Stephen

4. “How can Log Analytics and App Insights help me to
build supportable integration solutions?”

5. What have we been up to
Business
• Dozens of projects
• Multi-Year investment in Microsoft
IPaaS
• EAI Platform = Microsoft iPaaS
• EDMS Platform = Microsoft Data
Platform
• SAP / Power Platform / Power BI /
Workday / IBM Maximo / Most of
the main application platforms
Technical
• Environments - 5
• Resources (Across all environments)
• Logic Apps – 1895
• Function Apps – 116
• Integration Account – 5
• APIM – 5
• Service Bus
• Event Grid
• Event Hub
• Synapse

6. ETL & ELT Security & Governance
Enterprise Integration Platform
Durable Messaging
Data Transformation
Helper Functions Storage Hybrid
EAI API
Enterprise Scenarios
Business Rules System Workflow Human Workflow Business Users B2B Integration
Management &
Monitoring
Power BI
API
Management
Data Factory Key Vault
Logic Apps
Logic Apps
Integration
Account
Integration
Account
Power
Automate
Azure
Functions
Service Bus
Logic Apps
Azure
Functions
Advisor
Security
Centre
Storage
Azure SQL DB
Logic App
Inline Code
Data Gateway
Power App
Integration
Services
Environment
Enterprise
Connectors
Azure Monitor
Application
Insights
Application
Configuration Cosmos DB
Azure
Functions
Log Analytics
Synapse
Pipelines

7. Customer Manager
Transport Manager
Finance Manager
Storage Yard
Customer
Scenario: Petrochemical Plant Produces
Product and Ships to Customers in railcars

8. Customer Manager
Transport Manager
Finance Manager
Storage Yard
Customer
The plant is making product and sends
notifications about what it makes
Plant Production

9. Customer Manager
Transport Manager
Finance Manager
Storage Yard
Customer
Railcar gets loaded with product
Loading Railcars
Send notification

10. Customer Manager
Transport Manager
Finance Manager
Storage Yard
Customer
Shipping Notification
Send
Shipping Railcars
Can I have 1
railcar please
Dispatch 1 railcar
for order 1234

11. Customer Manager
Transport Manager
Finance Manager
Storage Yard
Customer
Send shipping updates
Shipping Status Updates
Railcar Delivered
Thanks I've got it

12. Plant Measurement Data
Railcar Loaded
Railcar Shipped
Railcar Shipping Status
Railcar Delivered
Synapse (EDMS)
Cosmos DB
Dataverse
Transport System

13. Plant Measurement Data
Synapse
EDMS Platform
EAI Platform
API Mgmt API Functions
Processor Functions
Cosmos DB
Dataverse
Transport System
Logic Apps

14. API Management
ms-bootcamp-apim
API Backend Functions
ms-bootcamp-func-api
Service Bus Processor Functions
ms-bootcamp-func-edmslink
Logic App Standard
ms-bootcamp-logicapp
ms-bootcamp-apim
Logic App Consumption
Railcar-Loaded-Receiver
ms-bootcamp-logs
ms-bootcamp-logicapp ms-bootcamp-func-api ms-bootcamp-func-edmslink

15. Performance & Load Monitoring

16. How can we view the
performance and load of my
integration solution

17. Plant Measurement Data Synapse (EDMS)

18. Plant Measurement Data
Synapse
Plant Measurement Data
EDMS Platform
EAI Platform
API Mgmt API Functions Processor Functions

19. Recap
• API Management
• Easy to configure App Insights on API Settings
• API Backend in Functions
• Using the ILogger sends data to App Insights
• Set instrumentation key
• Service Bus Processor Functions
• Using the ILogger sends data to App Insights
• Set instrumentation key

20. End to End Tracing

21. We have lots of components
how can we trace activity
across these components

22. Railcar Loaded
Railcar Shipping Status
Railcar Delivered
Synapse (EDMS)
Cosmos DB
Dataverse
Transport System

23. Plant Measurement Data
EAI Platform
API Mgmt API Functions
CONSUMPTION
Logic App
Cosmos DB
Dataverse
Transport System
STANDARD
Logic App
API Helpers

24. Simplified Logging

25. Its easy to use, but there is a
lot of complicated logging
data.
What if I just want some
simple log messages to help
me

26. Railcar Loaded
Synapse (EDMS)
Cosmos DB
Dataverse
Transport System

27. Plant Measurement Data
EAI Platform
API Mgmt API Functions
CONSUMPTION
Logic App
Cosmos DB
Dataverse
Transport System
STANDARD
Logic App
API Helpers

28. Views on your Data

29. Out of box
Custom

30. APIM
ms-bootcamp-apim
ms-bootcamp-logs
Logic App Standard
ms-bootcamp-logicapp
API Functions
ms-bootcamp-func-api
Background Functions
ms-bootcamp-func-edmslink
Log Data
Railcar Tracking APIM Overview Logic App Functions Overview
Management Availability
& SLA Dashboard

31. Availability Testing

32. “How do I know if all of the key apps and services in my
architecture are available”?

33. API Mgmt
API Functions Test
Service Bus via Logic App
Health Ping
Background Functions Test
Logic App Test
Dataverse via Logic App
SAP Test
Management Availability
& SLA Dashboard

34. Summary
• There’s lots of ways I can use Log Analytics and App Insights
• There are a couple of limitations in end to end tracing
• Be careful on the amount of data you log $$
• The data can help day to day troubleshooting
• I can get lots of views on the performance of my system

35. More Info
• Logic App Consumption + Log Analytics Out of the Box
• https://www.integration-playbook.io/docs/log-analytics-out-of-the-box
• Logic App + Log Analytics Custom Logging
• https://www.integration-playbook.io/docs/log-analytics-data-collector-api
• Logic Apps + App Insights
• https://www.integration-playbook.io/docs/app-insights-with-logicapps
• Logic Apps + APIM App Insights
• https://www.mikestephenson.me/2021/05/01/looking-at-logic-app-use-of-apim-in-app-insights-logs/
• Deep Dive on App Insights & Log Analytics from Integrate 2021 Video
• https://www.biztalk360.com/integrate-2021-remote/ (Look for my video)

36. Questions