The document discusses improving network observability at T-Mobile Netherlands with ElasticCloud. It introduces three people from T-Mobile's Data Driven Assurance team who work on network observability solutions using ElasticCloud. It then provides details on T-Mobile Netherlands as a company and describes the role and achievements of the Data Driven Assurance team. Finally, it outlines the architecture for network observability, including the business, application, and technical viewpoints.
3. Who’s who from T-Mobile’s Data Driven Assurance?
Michael
Bayes
Data Analyst
QA - Data Driven Assurance
mike.bayes@t-mobile.nl
Designs, builds and delivers network
observability solutions via
ElasticCloud.
Implements, optimizes and maintains
ElasticCloud Instances for multiple
teams
Jan
Stegink
Domain Architect
QA - Data Driven Assurance
jan.stegink@t-mobile.nl
Erwin
Halmans
Product Owner
QA - Data Driven Assurance
erwin.halmans@t-mobile.nl
Creator and guardian of the Event
based big data architecture for Network
Technology
Delivers the solution architecture for
various network observability
implementations
Champion and facilitator of the Data
Driven Assurance team
Translating prioritized business requests
& guiding the implementation of
network observability solutions
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 3
4. T-Mobile Nederland
T-Mobile Nederland is a Dutch telecommunication
service provider delivering mobile and fixed services
• Owned by investmentfunds Apax and Warburg Pincus,
and independent from Deutsche Telekom
• Awarded “best mobile network of The Netherlands”
five consecutive years
• Largest mobile service provider of the Netherlands
• 7 million mobile subscribers
• 800 thousand fixed subscribers
• 2 billion Euro revenue
• Headquarters in The Hague
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 4
5. Data Driven Assurance team
Make a substantial contribution to improving our Network Observability which leads to increased
operational stability and reduced operational costs of our networks and services
We achieve this by developing and maintaining a big data platform to distribute real time streaming
network data to consuming parties. It enables the delivery ofAIOps type applications
Mission
Network Operations & Network Operations Center, Network Security & Security Operations Center,
Network Design, Strategy, Quality Assurance, Intelligence & Insights
Stakeholders
Three data engineers, two data analysts, a domain architect and a product owner
Frontrunners in innovations, such as applying Big Data for telco networks , MDT and AI
Skillset: SNMP, Syslog, SFTP and MDT (data collection), Kafka platform management, Python,Java and
KSQL (streaming data pipelines), ElasticCloud platform management and APM, ML and Kibana
(analytical applications)
Team
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 5
6. The team’s evolution, achievements and outlook
‘18 ‘19 ‘20 ‘21 ‘22 ‘23 ‘24
The adventure begins:
Data Driven Assurance is
born //There is budget,
hardware, tools and
staffing
Big Data architecture for
Networks comes to
maturity// Migration from
Hadoop to Kafka begins //
AI Sandbox
Implemented Anodot’s
anomaly detection
platform // Predictive
model for failure and
replacement of optical
devices
DDA proves its value:
Delivered various Network
Observability applications
for ‘Thuis’ // Early detection
of hundreds of ‘Critical’
situations // Increase in
‘Thuis’ NPS
Focus on improving
‘Thuis’ leads to replacing
Anodot by ElasticCloud //
Changed data scientist
role to data analyst //
Fast tracked delivery of
network observability
applications for‘Thuis’
ElasticCloud usage goes
through the roof – data
optimization required //
Adoption of MDT takes a
flight: phase out of
legacy data collectors
5
9
3
3
6
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 6
9
Focus on Elastic ML//
Adoption of ‘Self Service’
analytics // Implement
container management
solution // Expand Kafka
cluster // . . . . . . . . .
?
Dark NOC
9. Business Viewpoint
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 9
ISSUES & OPPORTUNITIES: NEED FOR AUTOMATION
acquisition >100K devices >4M metrics / 5 min.
>50 tools >1y learning Technology: MDT
5G FMC Fiber
5G/ IoT applications
Operations
Cost
Customer
Care
10. Business viewpoint
10
Complexity Demand Technology
Observability (full picture, instant insights)
Anomaly
Detection
Root cause
Analysis
Impact analysis
ISSUES & OPPORTUNITIES: NEED FOR AUTOMATION
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
11. Business viewpoint
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 11
Overview
Insight
Anomaly detection,
RCA
Impact analysis
Mitigation
Performance network & customer operations
Cost
(Incidents, complaints)
Service level
(Claims, pro-active)
Satisfaction
(Churn)
12. Busines viewpoint
12
01
02
03
04
FULL PICTURE
INSTANT INSIGHTS
DETECTION
PREVENTIVE
PRO-ACTIVE (*)
CONTRIBUTION
AIOPS
DARK NOC
Benefits so far: Simplification/Consolidation, Observability,
Detection, MTTD, Availability, Outage Communication
CONTRIBUTION
DDA
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
13. Application viewpoint
13
EVENT PRODUCTION EVENT SOURCING EVENT CONSUMPTION
KEY FEATURES:
BIG DATA
STREAM ANALYTICS
AI/ML
PRODUCERS METRICS
LOGS
TRACES
FAULTS
INSIGHTS
ALARMS
SEARCH
ACTION
CONFIG.
CONSUMERS
Network
Operations
Network
Design
Customer
Operations
Quality
Assurance
Mobile
Network
Fixed
Network
(TMT)
Fixed
Network
(former
Tele2)
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
14. Application viewpoint
14
KEY FEATURES:
BIG DATA
STREAM ANALYTICS
AI/ML
SENSORS USE CASES
EVENT PRODUCTION EVENT SOURCING EVENT CONSUMPTION
M
L
VOLUME
VARIATY
VELOCITY
F
IM
MAINT
SEC
QA
T
C CC
VALUE
VARIABILITY
(self-service)
VERACITY
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
15. Application viewpoint
15
KEY FEATURES:
BIG DATA
STREAM ANALYTICS
AI/ML
SENSORS USE CASES
EVENT PRODUCTION EVENT SOURCING EVENT CONSUMPTION
M
L
F
IM
MAINT
SEC
QA
T
C CC
VISUALISATION
PREDICTION (*)
NOTIFICATION
DETECTION !
NORMA-
LISATION
ENRICHMENT
FILTERING
TRANSFOR-
MATION
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
18. Network Observability with Elastic
• Elastic Agents for system
monitoring
• APM to monitor key
operational support
applications
• Server log monitoring
• Network Operations
Dashboards to identify
network issues
• Anomaly Detection for
alerting
• Root cause analysis via
Discover