Big Data POC in communication industry

Michel Bruley
Michel BruleyMarketing Director à Michel Bruley
www.decideo.fr/bruley
POC in COMMS IndustryPOC in COMMS Industry
Michel Bruley
May 2013
www.decideo.fr/bruley
Background and purpose of the missionBackground and purpose of the mission
WAN LAN
TR-104
TR-69
TR-135
Access
Network
(POP,
DSLAM)
Access
Network
(POP,
DSLAM)
Customer
TR-98
Customer Data WarehouseNetwork Data
Technical Data (TR files)
• Statistics box
• Internet + Wifi + VoIP + IPTV
Technical Data (TR files)
• Statistics box
• Internet + Wifi + VoIP + IPTV
Customer data warehouse
•Customer details (mobile / ISP)
•Mobile usage
•Marketing campaigns
•Contact Customer Service and
•Service
•Churn
•...
Customer data warehouse
•Customer details (mobile / ISP)
•Mobile usage
•Marketing campaigns
•Contact Customer Service and
•Service
•Churn
•...
ACS
• Improve the quality of service provided to the customer
• Link technical data network/box with those of the customer data warehouse
www.decideo.fr/bruley
3 types of teams are involved3 types of teams are involved
1 - Crisis cell for direct interventions to be performed on the ground following the detection of serious problems
Process/Marketing
Teams
Costs
Customer demands
Churn
Process/Marketing
Teams
Costs
Customer demands
Churn
Networks
Team
Monitoring equipment /
incidents
Networks
Team
Monitoring equipment /
incidents
Products
Team
Box creation
Products
Team
Box creation
Technical owner support /
« War Room1
» industrialization
Business owner support / Customer impacts
evaluation & prioritization
Technical
Owner
Business
Owner
www.decideo.fr/bruley
ApproachApproach
Log
BOX
Logs BOX
TR files
> 20 000 files
> 500 Go
> 5 months data
=> > 1 Billion lines
Teradata Aster
Platform
Data Integration
Data mining
Preparation
Exploratory analysis
Tableau Software
Visualization tool
www.decideo.fr/bruley
Four major stagesFour major stages
Data
TR File + CS tickets + DSLAM topology + Customers
Data
TR File + CS tickets + DSLAM topology + Customers
>1 billion >700 K > 10 K > 1.5 million
• The first two steps (80% of the time) were an investment that is now roughly an asset
• The following two steps (20%) have produced the first examples of TR data analysis
www.decideo.fr/bruley
Sources identification and acquisition
Loading data
• 20K files loaded
• Billion records
Data understanding
• Broadband Forum /
Specifications TR-069 and TR-
135)
• Products team
• Networks team
Audit data
• Data quality
• Data reliability
TR files understanding & explorationTR files understanding & exploration
Essential for the following step:
•Need to have access to transverse
experts
•Systematic approach
Essential for the following step:
•Need to have access to transverse
experts
•Systematic approach
Exploration
30%
www.decideo.fr/bruley
In theory
– Hundreds of indicators
– Cover three services: ADSL, IPTV
and VOIP
In practice
– Insufficient granularity (day)
– Partial, unreliable or missing information
We selected four concepts
Desynchronization: loss of internet connection (IAD) results for the client in a loss of access to all
services
Reboot: reboot the box, at the initiative of the client or on the initiative of the operator
Lost packets (IPTV): the loss of a single packet can result in damage to the image and sound
Rate: number of packets transmitted per second. We look in particular for the down flow under QoS
fixed ISP
We selected four concepts
Desynchronization: loss of internet connection (IAD) results for the client in a loss of access to all
services
Reboot: reboot the box, at the initiative of the client or on the initiative of the operator
Lost packets (IPTV): the loss of a single packet can result in damage to the image and sound
Rate: number of packets transmitted per second. We look in particular for the down flow under QoS
fixed ISP
Customer service qualityCustomer service quality
measuremeasure
www.decideo.fr/bruley
Vision QoS/QoE ISP land line and customerVision QoS/QoE ISP land line and customer
experience from logs BOX (TR)experience from logs BOX (TR)
Objective: To improve the service provided to customers
www.decideo.fr/bruley
DSL VoIP IPTV
Indicators Error rate
(FEC + CRC + HEC +
Erroredsec)
Cut calls rate IPLR = lost packets ratio
Variations in flow
Synchronisation loss
Land line consumption TV consumption TVReboot
Consumption
Axes Physical network x Product x DSLAM x Location x Temporal x Customer
Quality Good  Medium  Bad 
Calculated metrics summaryCalculated metrics summary
www.decideo.fr/bruley
No IPTVNo IPTV
IPTV SDIPTV SD
IPTV HDIPTV HD
Falling rates and customer impactFalling rates and customer impact
August 2012 Septembrer 2012 October 2012 November 2012
Analysis = monitoring current down flow
•Red curve = 1 customer suffers a sudden drop in the flow passing HD to SD, followed by stabilization in SD. Impact: TV
quality degradation
•Blue curve = 1 customer suffers a sudden drop in flow, passing from an excellent full HD quality to a total degradation.
Impact: out of service.
Learning's
•Easy and fast identification of customers with problems
•Ability to rapidly decline this type of analysis on other monitored data
www.decideo.fr/bruley
Box Reboot and Resynchro by DSLAMBox Reboot and Resynchro by DSLAM
Customers attached to a DSLAM
Huawei suffer more disconnections and loss of access to services
Internet, VoIP & IPTV
Question: connection to a DSLAM Alcatel-Lucent or Huawei has an impact on customer
perception of quality ISP?
www.decideo.fr/bruley
Errors CRC
ErroredSecs
Errors FEC
Desynchronization
Customer health state historyCustomer health state history
Analysis
•Various technical indicators reflecting the health and performance of services, followed during a
period, for a customer
Learning's
•Synthetic vision facilitates diagnosis and visualization of technical impact on a customer
www.decideo.fr/bruley
Others analysisOthers analysis
• ISP closed barometer: The proportion of closing for technical problems
undergoing resynchronization / reboots, increases significantly with the merger of
the closing date.
• Assess the stability of products: product tracking throughout the park,
any extension. Calculations acceleration and therefore the lessons which can be
exploited.
• Correlation analysis and QoS customers: Possibility to analyze
technical data and customer relationship simultaneously. Qualification impact on
customers. With Aster the axes of analysis are very easy to cross: products,
technical equipment, location, ...
• ...
www.decideo.fr/bruley
Learning’s
•TR data alone in the current state, contribute little to the predictive power of the
models
•The improvement of the churn existing model is not significant
•We must not abandon the TR data but "stabilize" and cross them with other data,
with a deeper history (> 1 year)
Predictive CS IPTV model
Predictive churn ISP model
Predictive AnalysisPredictive Analysis
www.decideo.fr/bruley
The POC give us a better understanding of TR data, they offer the possibility to:
Provide an additional analysis axis of the customer
Highlight the quality of service experienced by the customer
Offer the potential for improved models for CS and Marketing (churn, ...)
Facilitate discussions / negotiations between services (networks, products,
process & marketing) around common observations and data
Conclusions regarding TR dataConclusions regarding TR data
1 sur 15

Recommandé

Freebox Delta ServerFreebox Delta Server
Freebox Delta Serversystem_plus
260 vues24 diapositives
Journey with TTSLJourney with TTSL
Journey with TTSLAnkan Debgupta
206 vues18 diapositives
LicensingLicensing
LicensingCA
330 vues28 diapositives
Case study Eircom - FiberPlanITCase study Eircom - FiberPlanIT
Case study Eircom - FiberPlanITComsof
1.3K vues15 diapositives

Contenu connexe

Tendances(12)

Plus de Michel Bruley(20)

Synthèse sur Neuville.pdfSynthèse sur Neuville.pdf
Synthèse sur Neuville.pdf
Michel Bruley4 vues
Propos sur les Big Data.pdfPropos sur les Big Data.pdf
Propos sur les Big Data.pdf
Michel Bruley12 vues
Sun tzuSun tzu
Sun tzu
Michel Bruley227 vues
Poc banking industry - ChurnPoc banking industry - Churn
Poc banking industry - Churn
Michel Bruley241 vues
Photos de famille 1895   1966Photos de famille 1895   1966
Photos de famille 1895 1966
Michel Bruley338 vues
J'aime BRULEYJ'aime BRULEY
J'aime BRULEY
Michel Bruley529 vues
Recette de la dinde au whiskyRecette de la dinde au whisky
Recette de la dinde au whisky
Michel Bruley1.1K vues
Les 2 guerres de René PuigLes 2 guerres de René Puig
Les 2 guerres de René Puig
Michel Bruley253 vues
Une societe se_presenteUne societe se_presente
Une societe se_presente
Michel Bruley116 vues
Dossiers noirs va 4191Dossiers noirs va 4191
Dossiers noirs va 4191
Michel Bruley258 vues
Irfm mini guide de mauvaise  conduiteIrfm mini guide de mauvaise  conduite
Irfm mini guide de mauvaise conduite
Michel Bruley352 vues
Estissac et thuisy   2017Estissac et thuisy   2017
Estissac et thuisy 2017
Michel Bruley801 vues
Big Data & PricingBig Data & Pricing
Big Data & Pricing
Michel Bruley1.3K vues

Big Data POC in communication industry

  • 1. www.decideo.fr/bruley POC in COMMS IndustryPOC in COMMS Industry Michel Bruley May 2013
  • 2. www.decideo.fr/bruley Background and purpose of the missionBackground and purpose of the mission WAN LAN TR-104 TR-69 TR-135 Access Network (POP, DSLAM) Access Network (POP, DSLAM) Customer TR-98 Customer Data WarehouseNetwork Data Technical Data (TR files) • Statistics box • Internet + Wifi + VoIP + IPTV Technical Data (TR files) • Statistics box • Internet + Wifi + VoIP + IPTV Customer data warehouse •Customer details (mobile / ISP) •Mobile usage •Marketing campaigns •Contact Customer Service and •Service •Churn •... Customer data warehouse •Customer details (mobile / ISP) •Mobile usage •Marketing campaigns •Contact Customer Service and •Service •Churn •... ACS • Improve the quality of service provided to the customer • Link technical data network/box with those of the customer data warehouse
  • 3. www.decideo.fr/bruley 3 types of teams are involved3 types of teams are involved 1 - Crisis cell for direct interventions to be performed on the ground following the detection of serious problems Process/Marketing Teams Costs Customer demands Churn Process/Marketing Teams Costs Customer demands Churn Networks Team Monitoring equipment / incidents Networks Team Monitoring equipment / incidents Products Team Box creation Products Team Box creation Technical owner support / « War Room1 » industrialization Business owner support / Customer impacts evaluation & prioritization Technical Owner Business Owner
  • 4. www.decideo.fr/bruley ApproachApproach Log BOX Logs BOX TR files > 20 000 files > 500 Go > 5 months data => > 1 Billion lines Teradata Aster Platform Data Integration Data mining Preparation Exploratory analysis Tableau Software Visualization tool
  • 5. www.decideo.fr/bruley Four major stagesFour major stages Data TR File + CS tickets + DSLAM topology + Customers Data TR File + CS tickets + DSLAM topology + Customers >1 billion >700 K > 10 K > 1.5 million • The first two steps (80% of the time) were an investment that is now roughly an asset • The following two steps (20%) have produced the first examples of TR data analysis
  • 6. www.decideo.fr/bruley Sources identification and acquisition Loading data • 20K files loaded • Billion records Data understanding • Broadband Forum / Specifications TR-069 and TR- 135) • Products team • Networks team Audit data • Data quality • Data reliability TR files understanding & explorationTR files understanding & exploration Essential for the following step: •Need to have access to transverse experts •Systematic approach Essential for the following step: •Need to have access to transverse experts •Systematic approach Exploration 30%
  • 7. www.decideo.fr/bruley In theory – Hundreds of indicators – Cover three services: ADSL, IPTV and VOIP In practice – Insufficient granularity (day) – Partial, unreliable or missing information We selected four concepts Desynchronization: loss of internet connection (IAD) results for the client in a loss of access to all services Reboot: reboot the box, at the initiative of the client or on the initiative of the operator Lost packets (IPTV): the loss of a single packet can result in damage to the image and sound Rate: number of packets transmitted per second. We look in particular for the down flow under QoS fixed ISP We selected four concepts Desynchronization: loss of internet connection (IAD) results for the client in a loss of access to all services Reboot: reboot the box, at the initiative of the client or on the initiative of the operator Lost packets (IPTV): the loss of a single packet can result in damage to the image and sound Rate: number of packets transmitted per second. We look in particular for the down flow under QoS fixed ISP Customer service qualityCustomer service quality measuremeasure
  • 8. www.decideo.fr/bruley Vision QoS/QoE ISP land line and customerVision QoS/QoE ISP land line and customer experience from logs BOX (TR)experience from logs BOX (TR) Objective: To improve the service provided to customers
  • 9. www.decideo.fr/bruley DSL VoIP IPTV Indicators Error rate (FEC + CRC + HEC + Erroredsec) Cut calls rate IPLR = lost packets ratio Variations in flow Synchronisation loss Land line consumption TV consumption TVReboot Consumption Axes Physical network x Product x DSLAM x Location x Temporal x Customer Quality Good  Medium  Bad  Calculated metrics summaryCalculated metrics summary
  • 10. www.decideo.fr/bruley No IPTVNo IPTV IPTV SDIPTV SD IPTV HDIPTV HD Falling rates and customer impactFalling rates and customer impact August 2012 Septembrer 2012 October 2012 November 2012 Analysis = monitoring current down flow •Red curve = 1 customer suffers a sudden drop in the flow passing HD to SD, followed by stabilization in SD. Impact: TV quality degradation •Blue curve = 1 customer suffers a sudden drop in flow, passing from an excellent full HD quality to a total degradation. Impact: out of service. Learning's •Easy and fast identification of customers with problems •Ability to rapidly decline this type of analysis on other monitored data
  • 11. www.decideo.fr/bruley Box Reboot and Resynchro by DSLAMBox Reboot and Resynchro by DSLAM Customers attached to a DSLAM Huawei suffer more disconnections and loss of access to services Internet, VoIP & IPTV Question: connection to a DSLAM Alcatel-Lucent or Huawei has an impact on customer perception of quality ISP?
  • 12. www.decideo.fr/bruley Errors CRC ErroredSecs Errors FEC Desynchronization Customer health state historyCustomer health state history Analysis •Various technical indicators reflecting the health and performance of services, followed during a period, for a customer Learning's •Synthetic vision facilitates diagnosis and visualization of technical impact on a customer
  • 13. www.decideo.fr/bruley Others analysisOthers analysis • ISP closed barometer: The proportion of closing for technical problems undergoing resynchronization / reboots, increases significantly with the merger of the closing date. • Assess the stability of products: product tracking throughout the park, any extension. Calculations acceleration and therefore the lessons which can be exploited. • Correlation analysis and QoS customers: Possibility to analyze technical data and customer relationship simultaneously. Qualification impact on customers. With Aster the axes of analysis are very easy to cross: products, technical equipment, location, ... • ...
  • 14. www.decideo.fr/bruley Learning’s •TR data alone in the current state, contribute little to the predictive power of the models •The improvement of the churn existing model is not significant •We must not abandon the TR data but "stabilize" and cross them with other data, with a deeper history (> 1 year) Predictive CS IPTV model Predictive churn ISP model Predictive AnalysisPredictive Analysis
  • 15. www.decideo.fr/bruley The POC give us a better understanding of TR data, they offer the possibility to: Provide an additional analysis axis of the customer Highlight the quality of service experienced by the customer Offer the potential for improved models for CS and Marketing (churn, ...) Facilitate discussions / negotiations between services (networks, products, process & marketing) around common observations and data Conclusions regarding TR dataConclusions regarding TR data

Notes de l'éditeur

  1. L’utilisation de services VoIP, IPTV, Internet Est-ce que le client utilise sa STB ? A partir de combien jours depuis son inscription a-t-il commencé à regarder la TV ? La qualité du service: Est-ce que les appels des clients sont parfois coupés ? Est-ce que le client redémarre souvent son IAD ? Est-ce que le client subit des pertes de connexion sans avoir redémarré la box ? Est-ce que le client subit des gels d’image ou saccade lorsqu’il regarde la TV ? Nous avons une vision: Par client, par type d’IAD, par type de STB, par type d’opérateur, par DSLAM, par région….