MEASURE Measuring Software Engineering https://itea3.org/project/measure.html The goal of the project is to increase the quality and efficiency as well as reduce the costs and time-to-market of software engineering in Europe. By implementing a comprehensive set of tools for automated and continuous measurement, this project provides a toolset for future projects to properly measure their impact. More importantly, it opens a new field for innovation. The real innovation will be in the advanced analytics of the measurement data enabled by the project.

1. Measure Project –A Journey Between
Values and Value at OW2con’18
Alessandra Bagnato, Softeam R&D
Orange Gardens, Châtillon, 8th June 2018

2. 2
MEASURE
MEASURE ITEA 3 PROJECT
ITEA is the EUREKA Cluster
programme supporting
innovative, industry-driven,
pre-competitive R&D projects
in the area of Software-
intensive Systems & Services
(SiSS).

3. 3
MEASUREMEASURE EUREKA ITEA 3 Consortium

4. 4
MEASURE
Project Goals
▪ Increase quality and efficiency as well as reduce
the costs and time-to-market of software
engineering.
▪ Implementing a comprehensive set of tools for
automated and continuous measurement and
analysis.
▪ Provide a toolset for future projects to properly
measure their impact.
▪ Advanced analytics of the measurement data
enabled by the project.

5. 5
MEASURE
• A Journey Between Values and Value
• To develop a platform, methods and tools to
collect measurement and to analysis them
during the various phases of the software
development lifecycle to provide meaningful
recomandations.
• To define new metrics needed in today’s
industry context and markets
• To apply the results to 6 case studies
MEASURE Objectives

6. 6
MEASURE
Measure Solution
Develop Deploy Configure Collect
Measures apply to Software
Development process.
Store Visualize Combine Analyze
Exploit Measures and
Measurements.

7. 7
MEASURE
Measure Solution
Collect
Measure Execution
Process
Measurement Tool
Platform Agent
Collect
Analysis Platform
Analysis Services
Configure
Measure Integration in
Project Scope
Deploy
Packaging
Standardization
Measure Catalogue
Develop
Measure
Standardization
Measure Modeling Tool
Measure Development
Framework
Develop Deploy Configure Collect
Configure
Measure Visualization
Project Dashboards
Deploy
Measure Aggregation
Visual Aggregation
Develop
Big Data Storage
Store Visualize Combine Analyze

8. 8
MEASURE
Measure Solution : Tools
SMM Measure
Modeling Tool
Measure Platform
Analysis Tools
Quality Guard
Analysis Tool
Model
Measurement Tool
FSMHSGen
Montimage
Monitoring Tool
Energy Monitoring
Tool
RIVER
Measurement
Tools
Measure Collection
And Visualization
Measures
Development Tool
Platform Agent
Metrics Correlation
Clustering
Metrics Suggester
Integrated Measure Platform
Software Metrics
Prediction

9. 9
MEASURE
Develop Measures : Measure Standardisation
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
- Work with formal description of metrics
- Facilitate portability of metrics and measurements
Our Results :
- Provide an implementation of the SMM 1.1.1 OMG
standard (Structured Metrics Metamodel)
- Develop all of our Measure using this standard
implementation.
http://www.omg.org/spec/SMM/
http://forge.modelio.org/projects/smm

10. 10
MEASURE
Develop Measures : Measure Modeling
Tool
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
▪ Tooling the development of
measures
Our Results :
▪ Implementation of an extension for
Modelio Modeling Tool dedicated to
SMM Measure modeling
- Modeling Measure in SMM
- Tooling measure development and
packaging

11. 11
MEASURE
Develop Measures : Measure Development
Framework
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
▪ Provide a framework which help to
implement measures
Our Results :
▪ SMMMeasureLibrary
- Java Library which help to implement measures in
Java.
- Standardize measures as executable components
which can be executed by a platform to collect
measurements

12. 12
MEASURE
Deploy Measure : Standardized Packaging
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
▪ Unified the way the measures are packaged
Our Results :
▪ Specification of a packaging format for SMM executable
measures

13. 13
MEASURE
Deploy Measure : Measure Catalogue
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
▪ Provide a catalogue of measures which cover various
aspect of software development process
Our Results :
▪ 153 measures implemented covering various phases and
software development tool
- Measure catalogue :https://github.com/ITEA3-
Measure/Measures
- Documentation : https://github.com/ITEA3-
Measure/Measures/wiki

14. 14
MEASURE
Configure : Measure Integration in Project
Scope
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
▪ Apply generic measure in context
of specific projects
Our Results :
▪ Measure Scope identify during measure
implementation
▪ Allow the platform to manage instance of
measure which specifying the scope of the
measure

15. 15
MEASURE
Collect Measure: Measure Execution
Process
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
▪ Providing a measurement collecting system based on
the execution registered measures.
Our Results :
▪ Measure Scheduling Service
▪ Invoke the implementation of the direct measure
after having communicated to it the configuration
parameters defined by the measure instantiation.

16. 16
MEASURE
Collect Measure : Measurement Tool
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
▪ Develop Innovative Measures for
software development process.
Our Results :
▪ Development of specific Measurement
tool and associated measures
Model
Measurement Tool
FSMHSGen
Montimage
Monitoring Tool
Energy Monitoring
Tool
RIVER

17. 17
MEASURE
Deploy Measure : Platform Agent
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
▪ Execute Measures on client side
▪ Ensure Platform Scalability
Our Results :
▪ Development of Platform Agent
- standalone data collector
- work as remote execution engine for
the measure platform
- collect still managed by the platform

18. 18
MEASURE
Store Measurement : Big Data Storage
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
▪ Providing a storage service for collected and calculated
measurements.
▪ Store and process big quantity of data, parallel processing.
Our Results :
▪ Store measurement in Elasticsearch
- Distributed JSON-based search and analytics engine.
- Designed for horizontal scalability and high
reliability.

19. 19
MEASURE
Visualise Measures : Measure
Visualization
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
▪ Provide advanced and customisable visualisation options
for collected measures.
Our Results :
▪ Integration of Kibana in Measure platform.
▪ Simple visualisation or integration of customise visualisation
created with Kibana.

20. 20
MEASURE
Visualise Measures : Project Dashboards
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
▪ Organise Measures visualisation in project dashboards
Our Results :
▪ Development of customizable project dashboards.
- Simples Measure visualisation
- Combined Measures visualisation
- Analysis Results
- Custom contents
▪ Multi Level Dashboards

21. 21
MEASURE
Combine Measures : Measure
Aggregation
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
▪ Cross measure from differents tools and software
developement phases.
Our Results :
▪ Derived Measure Calculation: Using pre-existent
measurements stored in measurement database
to calculate new Measures.

22. 22
MEASURE
Combine Measures : Visual Aggregation
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
▪ Compare or aggregate several measures in the
same visualisation dashboard.
Our Results :
▪ Provide a way to define custom visualisation
which aggregate results from multiples
measures.

23. 23
MEASURE
Analyse Measures : Analysis Platform
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
▪ Integrate advanced data analysis functionality to
Measure Integrated Platform
Our Results :
▪ The Measure Platform provide
an extension mechanism which
allow to integrate Analysis Tools
- Tool Registration API
- Notification System
- Embedded Web Pages

24. 24
MEASURE
Analyse Measures : Analysis Services
Develop Deploy Configure Collect Store Visualize Combine Analyze
Challenges:
▪ Developed advance data analysis functionality to be
applied to measures collected by the platform.
Our Results :
Quality Guard
Analysis Tool
Metrics Correlation
Tool
Clustering Tool
Metrics Suggester
Tool
Software Metrics
Prediction Tool

25. 25
MEASURE
Measure Solution
Collect
Measure Execution
Process
Measurement Tool
Platform Agent
Collect
Analysis Platform
Analysis Services
Configure
Measure Integration in
Project Scope
Deploy
Packaging
Standardization
Measure Catalogue
Develop
Measure
Standardization
Measure Modeling Tool
Measure Development
Framework
Develop Deploy Configure Collect
Configure
Measure Visualization
Project Dashboards
Deploy
Measure Aggregation
Visual Aggregation
Develop
Big Data Storage
Store Visualize Combine Analyze

26. 26
MEASURE
Measure Solution : Tools
SMM Measure
Modeling Tool
Measure Platform
Analysis Tools
Quality Guard
Analysis Tool
Model
Measurement Tool
FSMHSGen
Montimage
Monitoring Tool
Energy Monitoring
Tool
RIVER
Measurement
Tools
Measure Collection
And Visualization
Measures
Development Tool
Platform Agent
Metrics Correlation
Clustering
Metrics Suggester
Integrated Measure Platform
Software Metrics
Prediction

27. 27
MEASURE
- UC1: SOFTEAM’s Modelio UML Modelling Tool
- UC2: DNCS’ Large Naval Software System environment
- UC3: Turkcell will provide a testbed environment for the developed
software during the Project. (Test Case Generation)
- UC4: TMOB’s Test Automation Management Tool
- UC5: Ericsson’s Software Delivery Risk Management. Turkgen will
support providing Knowledge discovery from operational big data
(Log data)
- UC6: Bitdefender’s secure software development process
Future Work: Final evaluation on 6
Project case studies

28. 28
MEASURE
Future Work: Final evaluation on 6
Project case studies
Measure Examples for
the Modelio Software
Development Lifecycle
case study

29. 29
MEASURE

30. Contacts
Alessandra Bagnato
Softeam R&D
alessandra.bagnato@softeam.fr
MEASURE Web Site:
http://measure.softeam-rd.eu/