Continuous testing - GUERLAIS ARGOT - Air France KLM Sogeti- Soirée du Test Logiciel Sophia 2019

1. Florence GUERLAIS & Marc ARGOT
Air France/KLM
17/10/19 Soirée du Test Logiciel STLS2019 1

2. Merci à nos sponsors
17/10/19 Soirée du Test Logiciel STLS2019 2

3. CONTINUOUS TESTING
Service Center Test, Marc Argot
Sophia-Antipolis, October 17th 2019

4. CONTINUOUS TESTING
Implement automated test into
continuous development and integration.
…as part of the software delivery pipeline, in order to
obtain immediate feedback on the business risks,
associated with a software release candidate.

5. By
Marc ARGOT, Test Engineer

6. SUMMARY
1. Air France - Service Center Test (SCT)
2. Continuous Testing principles
3. Integrated test examples
4. Conclusion

7. 1. Service Center Test (SCT)
1

8. Air France SCT services1
Project
Data / GDPR
Mobile
SecurityPerformance
Management
Agile/DevOps
Automatisation
Virtualisation
Environments
Tools
IoTMore to come…
Functional
Coordination E2E - API

9. Air France SCT applies…1
Project
…On:
• Back-end
• Front-end
• Mobile
• API
…In:
• Sophia Antipolis
• Toulouse
• Paris
• Bordeaux
• + KLM / Netherlands
Paris
Bordeaux
Toulouse
Sophia
Antipolis

10. 2. Continuous Testing
2

11. Continuous Testing : Goal2
Before After
 Not synchronized Dev/Test
 Not regular Regression Test
 Manual reporting
 Low visibility
 Synchronized Dev/Test
 Daily Regression Test
 Automatic reporting
 High visibility

12. Continuous Testing : Workflow2
Various types of
test:
 Functional
 Regression
 MMI
 Performance
 Etc

13. Continuous Testing : Variety of automated test2

14. 2 Maven Project: the ‘test pack’
The idea : Share a single Maven project for multiple projects and test types
using Java and other languages

15. Continuous Integration Server: Plan & perform2
 Plan
 Deploy
 Run
 Report
 History

16. Continuous Integration Server: Run tests in parallel2
When test cases
are independent
of each other

17. Continuous Integration Server: Report & History2
 Plan
 Deploy
 Run
 Report
 History

18. Continuous Testing : Benefits2
Suitable for your Agile team
Early detection of bugs
Periodic regression test
Various trigerring (nightly run, after a deployment or code change, on demand)
Reduce the risks
Better project visibility
Availability for the whole team (run and result)

19. Continuous Testing : Returns2
Bamboo runs on a bundled Apache Tomcat. It requires several
resources as servers, database, repositories…
Implementing a Bamboo Plan requires some effort
Automatic test might be disturbed by unstable environment
Long runs might be aborted
Frequent survey: check result daily and after each commit
Do not postpone issues fixing

20. So Continuous Testing is
 Applicable
 Easy to control
 Efficient
2

21. 3. Integrated Test Examples
3

22. Integrated test examples
a) Process execution
b) MQ File
c) Mobile device
d) API
e) Cucumber project
f) Xray
3

23. Process execution: SSH Library for Robot Framework3a
 Execute commands on remote
computers over an SSH connection
 Supports files transfer using SFTP
 Documentation:
http://robotframework.org/SSHLibrary/SSHLibrary.html
 Delivery:
https://github.com/robotframework/SSHLibrary
Some RF Keywords for SSH:

24. Process execution – Demo: verify checksum
Maven container
Copy fileCalculate checksumCompare checksumCopy fileLoginLogout
3a
Test script

25. 3a
Project
Process execution: Demo script

26. MQ File: What is MQ?3b

27. MQ File: Testing MQ file3b

28. Mobile testing3c
• Appium is an open-source tool for automating native,
mobile web, and hybrid applications on iOS mobile,
Android mobile, and Windows desktop platforms.
• Appium Support different programming languages
• Appium provides a single wrapper composed of a set of APIs to manipulate
the native resources of each mobile platform (iOS…)

29. 3c
For iOS mobile, XCUITest driver works via the installation of an helper application called
Web Driver Agent-Runner onto the device. (UiAutomator for Android)
Mobile testing

30. Mobile – Example of a mobile app for stewarts3c

31. API (Application Programming Interface)
Interface
3d

32. Cucumber
 Java oriented Test framework
 Dedicated to functional test writing
 BDD (Behavior-Driven Development)
 Test description  Gherkins
• Given …
• When …
• Then …
3e

33. Selenium – Cargo Quote & Book3e
Project

34. Test Management Tool Integration: Xray
 A Jira plug-in for:
• Test planning
• Test description
• Test reporting
 Integration with:
• Jira
• Bamboo
3f

35. Xray flow
Tested by feature Export feature(s)
Update resultDisplay result of tests
3f
project (run the
project)
project

36. Xray in Jira : some displays3f

37. Test and Tools Integration: Reminder
 Automatic tests can apply to a high variety of topics
 Automatic tests can be implemented with various technologies
 Test planning/reporting may be linked to Continuous Integration tools
3
ROBOT FRAMEWORK

38. 4. A few words to conclude…
4

39. Integration server: the heart of Continuous Testing
 Bamboo (or Jenkins) = Continuous Integration Server
(independently of virtual or hardware platforms)
 Many advantages:
• Early detection of bugs
• Availability
• Visibility and Reporting
 Dialog/Control/Drive your Continuous Integration Server
(e-mail in case of failure, launch Test on Demand, plan test campaigns...)
4
Deploy
TestReport
Develop
Continuous
Integration
Server

40. Q&A – Ideas sharing
Thanks for your attention.