We propose a walkthrough of current utilization of Open Source Software in capacity planning for the Orange network infrastructure. The objective of our project is to have a platform that helps engineers to carefully plan the resources available to them as well as to correlate different incidents within remote parts of the infrastructure. In order to achieve this we started using Cacti with the Spine collector which worked great, but Orange France is a very large company with many entities, each with its own governance, and so we began to see some limitations. There was a need to centralize some information from different parts in Orange France as well as to integrate the equipment capacity and load values into BigData Orange. In order to achieve this we developed the “Puits de donneés” platform completely based on Open Source Software. The visualization and statistical analysis part is handled by Grafana while the ETL runs on Apache Software Foundation products like NiFi, Zookeeper and Ambari with a storage solution from MariaDB for which we did extensive performance tuning and customization due to the large amounts of data.

1. From Cacti to
Special thanks to Marian BURLACU
and Marius BOSTIOG
17/06/2020
Pascal SEIGNÉ / Silviu DIMULETE

2. 2 Orange 2020 – Communication externe
Cacti at Orange in 2013
Context
In 2013, use of CACTI not coordinated and
standardized with specific local instantiations
Stakes
Reinforce capacity monitoring with CACTI
Goal
Implementation of a standardized CACTI Common
Bundle for Orange with
- Optimized and standardized technical architecture
- Standardized capacity metrics
- Interfacing with operating tools
- Establishment of a CACTI skill center

3. 3 Orange 2020 – Communication externe
Improvements around Cacti
Cacti Common Bundle
• HMI customization
• New automated installation package
• Documentation update
• User support
Network equipments
• Validation of metrics
• Standardization of metrics
• Automatic addition of new network equipment
in production
• Alarming to supervision portal
Support and study
• Support
• Graphite study

4. 4 Orange 2020 – Communication externe
The need to think bigger
Limits
• 54 independent Cacti servers
• Individual collection of capacity metrics
• Different equipment models
• No multi-equipment view
• Separate sending of alarms to supervision
• No global view of Cacti data
Needs
• Exploration of capacity data by platform
• View the entire history
• Centralization of interfaces to capacity and supervision
tools
• Interfacing with other operating applications
• BigData Orange data supply

5. 5 Orange 2020 – Communication externe
Cacti
What is it? How does it work?
Cacti is an open-source, web-based network monitoring and graphing tool designed as a front-end
application for the open-source tool RRDtool.
Linux / Windows / Solaris server
PHPinterface
MySQL database
Poller Cacti
Script/SNMP requests
RRA files
RRDtool RRA files should be stored on a
NAS mount point (faster access
time, backup, availability)
The MySQL database can
also be hosted remotely
on a separate machine

6. 6 Orange 2020 – Communication externe
Cacti
Usage in Orange: Packaging
Cacti with Spine
CLI tools
htop glances mytop mc monit
tcpdump socat screen git nano
Cacti plugins
Analyze Api Audit Cycle Monitor
Mactrack Flowview Gexport Hmib Intropage
Maint Gpsmap Mikrotik Weathermap Reportit
Routerconfigs Syslog Thold Tools Webseer
Cacti Templates
Created on a standardized logic:
Type – Manufacturer and version –
characteristic

7. 7 Orange 2020 – Communication externe
Cacti
Usage in Orange: Deployment
Cacti VM
Spine
collector
Datacenter network equipments
• Routers
• Switches
• Firewalls
RRD
• Proxies
• Load
Balancers
• Linux Hosts
REST
APIs
SNMP data
Other Platforms
1-5m
collection

8. 8 Orange 2020 – Communication externe
Why ? To be able to handle a huge amount of data
How is it implemented ? scale up and scale out
Cacti
Scalability and limitations
Memory Pool
CPU
RAM
Storage
Cacti 1 Cacti 2 Cacti N
up
up
up
up
out out
up
up
up
up
up
up
up
up

9. 9 Orange 2020 – Communication externe
Why make a classification ? The use case will influence the infrastructure and tools that you will have
to use
Big Data Integration
Classification : By use-case
(Near) real-time :
 Detect problem
 Issue notification
 Adaptive content
 Reduce expenses
Non real-time :
 Behavior analysis
 Predict problems
 Predict limitations

10. 10 Orange 2020 – Communication externe
Big Data Integration
Classification : Tools
Queueing
system
• Kafka
• RabbitMQ
• ActiveMQ
Coordinator
• Zookeeper
• Ambari
Enrichment
Stream processing
(real-time job)
• Storm
• Spark
• Logstash
• NiFi
Batch processing
(planned job)
Correlation
In-memory database
• Reddis
Stream processing
• Spark
• Storm
Batch processing
(planned job)
Storage
&
Search
Databases
• NoSQL
• SQL
Storage engine
• HDFS
• ElasticSearch
Visualisation
Business
Intelligence tools
• Kibana
• Grafana

11. 11 Orange 2020 – Communication externe
Big Data Integration
Use case in Orange: PDG
Apache Ambari
Grafana
PHPMyAdminServer
CactiServer
CactiServer
Cacti
1-5m TimeSeries
NiFi
Zookeeper
Big Data
Platform
Streaming:
• NiFi
Queueing:
• Kafka
Storage:
• Hadoop
• 2.5 TB
partitione
d by week
• 30 billion
data
points
(Near) real-time
Non real-time
24H Metadata
REST
APIs

12. 12 Orange 2020 – Communication externe
Big Data Integration
Example: Traffic comparison
Example: Load during business hours and week comparsion

13. 13 Orange 2020 – Communication externe
Does anyone else need this?
What part would be of interest?
Contact us: pascal.seigne@orange.com silviu.dimulete@orange.com
Sharing with the FOSS community

14. 14 Orange 2020 – Communication externe
Thank you