1.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Mathieu Auvray – Consulting Engineer
Automated and Manual tests with
Tuleap Test Management

2.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Tuleap Test Management (TTM) story

3.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Context of TTM
• Test Management Tool easy to use
• Results observed (2 years usage at Enalean)
• Validation time : -65 %
• Testers engagement : +100 %
• Fun : +100...000 %
• Tested by customers

4.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Major improvements released in September 2017
• Raised bugs from campaign
• Easy campaign creation/edition
• Linked to Agile Dashboard
• Artifact covered by the test displayed in TTM

5.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Users want even more
Customer X : “How TTM can be linked to an automated test framework ?”
Test suites (list of tests) Share test status
More visibility and readability
Customer
Requirements
Commits
Delivery

6.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Our Proposition

7.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Main Challenges
➡ Performance (10 to 100 auto tests for 1 manual)
➡ Make it simple to setup for users
➡ Interoperability with different tools
➡ Avoid “labyrinth” solution
But Enalean likes challenges ….

8.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Demo

9.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Idea : Integrate automated test results into TTM
Test Campaign
Testers
Test Framework
JUnit XML
Tuleap APIs

10.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Configuring automated tests in Tuleap

11.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
How the template is made
A new “bot” user
is created in the project
Test
Automated_tests
A new string field
is associated to a Test Suite
Test Suites are linked to
to Test Definitions

12.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Configuring your test environment

13.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Your run tests calls TTM application
Bot Credentials
Project Name
Campaign Name
JUnit file
Test Results in TTML
Test Environment
Parameters

14.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Parse JUnit file
<?xml version="1.0" ?>
<testsuites>
<testsuite errors="0" failures="0" name="Test Automatic #1"
tests=“4">
<testcase classname=“xxx" name="Test1"/>
<testcase classname="xxx" name="Test2"/>
<testcase classname="xxx" name="Test3"/>
<testcase classname=“xxx" name="Test4"/>
</testsuite>
</testsuites>
Results
Automated_tests Field :
Test Automatic #1
Tuleap Test

15.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Even more easy with Jenkins

16.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Application pre-configured JenkinsFile

17.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Trigger Job from TTM

18.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
Results

19.
Automated and Manual tests in Tuleap Test Management @TuleapOpenALM
100 % Agile and Open Source
More information
● Automated and manual test in TTM : https://blog.tuleap.org/new-
tuleap-test-management-big-picture-manual-and-automated-tests-
together
● Doc : https://tuleap-documentation.readthedocs.io/en/latest/user-guide/
testmanagement.html#test-automation