Introduction aux tests de recette automatisés avec l'extension Drupal pour Behat

1. Introduction aux tests de recette automatisés
Avec l'extension Drupal pour Behat
didier.boff@ows.fr
B2F @ drupal.org
https://github.com/B2F
http:///twitter.com/zenelse

2. Les joies du test
Quand mon collègue avance sans plan de test
http://lesjoiesdutest.tumblr.com

3. Plan
● Retour d'expérience
○ Campus France
○ Divers outils démodés

4. Plan
● Retour d'expérience
○ Campus France
○ Divers outils démodés
● Méthodologie
○ BDD, Gherkin

5. Plan
● Retour d'expérience
○ Campus France
○ Divers outils démodés
● Méthodologie
○ BDD, Gherkin
● Développement
○ Behat/Mink
○ MinkExtension (démo)
○ DrupalExtension (démo)

6. Retour d'expérience
www.campusfrance.org
● Migration Drupal 6 -> 7

7. Retour d'expérience
www.campusfrance.org
● Migration Drupal 6 -> 7
● 100 sites, domain access
● multilingues

8. Retour d'expérience
www.campusfrance.org
● Migration Drupal 6 -> 7
● 100 sites, domain access
● multilingues
Quels tests ?

9. Retour d'expérience
Selenium
API
● click
● type
● select
● addSelection
● submit
● ... http://release.seleniumhq.org/selenium-
core/

10. Retour d'expérience
Selenium
IDE

11. Retour d'expérience
?
Test automatisé
Selenium
IDE

12. Retour d'expérience
Selenium
IDE
?
Test automatisé
Multidomaine

13. Retour d'expérience
Selenium
IDE
?AJAX
Multidomaine
Test automatisé

14. Retour d'expérience
Selenium Server
http://docs.seleniumhq.org/download/
java -jar selenium-server-standalone-<version-number>.jar
http://selenium.googlecode.com/files/selenium-server-standalone-2.33.0.jar

15. Retour d'expérience
Selenium Server
+ PHPUnit
PHPUnit_Extensions_SeleniumTestCase

16. Retour d'expérience
Selenium Server
+ PHPUnit
https://github.com/B2F/ows-phpunit
class OWSeleniumTestCase extends
PHPUnit_Extensions_SeleniumTestCase {
public function __construct($name = NULL, array $data = array(),
$dataName = '') {

17. Retour d'expérience
Selenium Server
+ PHPUnit
+ IDE

18. Retour d'expérience
Selenium Server
+ PHPUnit
+ IDE
+
Selenium IDE: PHP Formatters
https://github.com/brokenthumbs/PHP-Formatter

19. Retour d'expérience
Selenium Server
+ PHPUnit
+ IDE
+
Selenium IDE: PHP Formatters
https://github.com/brokenthumbs/PHP-Formatter
https://github.com/B2F/PHP-Formatter

20. Les joies du test
Quand je fais un test un peu trop compliqué pour un truc
tout simple
http://lesjoiesdutest.tumblr.com

21. Les joies du test
Quand je fais un test un peu trop
compliqué pour un truc tout simple ?

22. Les joies du test
Quand je fais un test un peu trop
compliqué pour un truc tout simple

23. Les joies du test
Quand je fais un test un peu trop
compliqué pour un truc tout simple
19 content types

24. Les joies du test
Quand je fais un test un peu trop
compliqué pour un truc tout simple
...

25. Méthodologie
● Behavior Driven Development (BDD)

26. Méthodologie
● Behavior Driven Development (BDD)
DrupalCon Portland 2013: BEHAT, BEHAVIORAL-
DRIVEN DEVELOPMENT AND SELENIUM IN DRUPAL
Ryan Weaver
https://portland2013.drupal.org

27. Méthodologie
● Gherkin

28. Méthodologie
● Gherkin
● Feature Suite de tests

29. Méthodologie
● Gherkin
● Feature
○ Scenario Test

30. Méthodologie
● Gherkin
● Feature
○ Scenario
■ Given
● And...
Contexte

31. Méthodologie
● Gherkin
● Feature
○ Scenario
■ Given
● And...
Contexte
Given I am on "/restaurants"

32. Méthodologie
● Gherkin
● Feature
○ Scenario
■ Given
● And...
■ When
● And...
Évènements

33. Méthodologie
● Gherkin
● Feature
○ Scenario
■ Given
● And...
■ When
● And...
Évènements
And I enter "Vietnam" for "pays"
And I enter "Bo Bun" for "plats"
And I enter "Paris 13" for "lieu"

34. Méthodologie
● Gherkin
● Feature
○ Scenario
■ Given
● And...
■ When
● And...
■ Then
● And...
Résultats
Then I should see the text "Pho Bida"

35. Opened Blackbox
● Cucumber
Gherkin + Ruby

36. Opened Blackbox
● Cucumber
=
Gherkin + Ruby

37. Opened Blackbox
● Cucumber
Gherkin + Ruby ?

38. Opened Blackbox
● Cucumber
Gherkin + PHP

39. Opened Blackbox
● Behat
http://behat.org/
=
Gherkin + PHP

40. Opened Blackbox
http://behat.org/
<?php
use BehatBehatContextBehatContext
class FeatureContext extends BehatContext
{
// /**
// * @Given /^I have done something with "([^"]*)"$/
// */
// public function iHaveDoneSomethingWith($argument)
// {
// doSomethingWith($argument);
// }
}
● Behat: ça fait quoi ?

41. Opened Blackbox
http://behat.org/
<?php
use BehatBehatContextBehatContext
class FeatureContext extends BehatContext
{
// /**
// * @Given /^I have done something with "([^"]*)"$/
// */
// public function iHaveDoneSomethingWith($argument)
// {
// doSomethingWith($argument);
// }
}
● Behat: ça fait quoi ?

42. Opened Blackbox
● Mink
Web acceptance testing
http://mink.behat.org/

43. Opened Blackbox
● Mink: drivers
$driver = new BehatMinkDriverZombieDriver();
http://mink.behat.org/

44. Opened Blackbox
● Mink: drivers
$driver = new BehatMinkDriverSahiDriver('firefox');
http://mink.behat.org/

45. Opened Blackbox
● Mink: drivers
$driver = new BehatMinkDriverGoutteDriver();
http://mink.behat.org/

46. Opened Blackbox
● Mink: drivers
$client = new SeleniumClient($host, $port);
$driver = new BehatMinkDriverSeleniumDriver(
'firefox', 'base_url', $client
);
http://mink.behat.org/

47. Opened Blackbox
● Mink: session
// init session:
$session = new BehatMinkSession($driver);
// start session:
$session->start();
http://mink.behat.org/
$session->visit('http://paris2013.drupalcamp.fr');

48. Opened Blackbox
● Mink: méthodes
$page = $session->getPage();
$element = $page->find('css', 'a#selector');
$element->getText();
http://mink.behat.org/

49. Opened Blackbox
● Mink: méthodes
$page = $session->getPage();
$element = $page->find('css', 'a#selector');
$element->getText();
http://mink.behat.org/

50. Développement
● En pratique
http://mink.behat.org/
Behat + Mink ?

51. Développement
● Mink extension
http://mink.behat.org/
=
Behat + Mink

52. Développement
● Mink extension
http://mink.behat.org/
STEPS

53. Développement
● Mink extension
http://mink.behat.org/
Given /^(?:|I )am on (?:|the )homepage$/
When /^(?:|I )go to (?:|the )homepage$/
Given /^(?:|I )am on "(?P<page>[^"]+)"$/
When /^(?:|I )go to "(?P<page>[^"]+)"$/
When /^(?:|I )reload the page$/
When /^(?:|I )move backward one page$/
When /^(?:|I )move forward one page$/
When /^(?:|I )press "(?P<button>(?:[^"]|")*)"$/
When /^(?:|I )follow "(?P<link>(?:[^"]|")*)"$/
When /^(?:|I )fill in "(?P<field>(?:[^"]|")*)" with "(?P<value>(?:[^"]|")*)"$/
When /^(?:|I )fill in "(?P<field>(?:[^"]|")*)" with:$/
When /^(?:|I )fill in "(?P<value>(?:[^"]|")*)" for "(?P<field>(?:[^"]|")*)"$/
When /^(?:|I )fill in the following:$/
When /^(?:|I )select "(?P<option>(?:[^"]|")*)" from "(?P<select>(?:[^"]|")*)"$/
When /^(?:|I )additionally select "(?P<option>(?:[^"]|")*)" from "(?P<select>(?:[^"]|")*)"$/
...
bin/behat -dl

54. Développement
● Mink extension
http://mink.behat.org/
Presses button with specified id|name|title|alt|value.
@When /^(?:|I )press "(?P<button>(?:[^"]|")*)"$/
Clicks link with specified id|title|alt|text.
@When /^(?:|I )follow "(?P<link>(?:[^"]|")*)"$/
Behat/MinkExtension/Context/MinkContext.php

55. Développement
Installation
http://docs.behat.org/#cookbook
Developing Web Applications with Behat and Mink

56. Développement
Installation
composer.json
{
"require": {
"behat/behat": "2.4.*@stable",
"behat/mink": "1.4.*@stable",
"behat/mink-extension": "*",
"behat/mink-goutte-driver": "*",
"behat/mink-selenium2-driver": "*"
},
"minimum-stability": "dev",
"config": {
"bin-dir": "bin/"
}
} http://docs.behat.org/cookbook/behat_and_mink.html

57. Développement
Installation
$ curl http://getcomposer.org/installer | php
$ php composer.phar install
http://docs.behat.org/cookbook/behat_and_mink.html

58. Développement
Installation
$ ls
bin composer.json composer.lock composer.phar vendor
http://docs.behat.org/cookbook/behat_and_mink.html

59. Développement
Installation
$ bin/behat --init
-> features/

60. Développement
Installation: suites de tests
features/{name}.feature
Feature: un exemple
Quelques steps pour illustrer une feature
Scenario: vérification qu'un lien est présent
Given I am at "/home"
When I click "Se connecter"
Then I should see "login"

61. Développement
Installation: customisation
$ bin/behat --init
-> features/bootstrap/FeatureContext.php

62. Développement
Installation: customisation
# features/bootstrap/FeatureContext.php
/**
* Features context.
*/
class FeatureContext extends BehatContext
{
...

63. Développement
Installation: customisation
# features/bootstrap/FeatureContext.php
/**
* Features context.
*/
class FeatureContext extends BehatContext
{
...

64. Développement
Installation: customisation
# features/bootstrap/FeatureContext.php
/**
* Features context.
*/
class FeatureContext extends MinkContext
{
...

65. Développement
Installation: subcontexts
# features/bootstrap/FeatureContext.php
use BehatMinkExtensionContextRawMinkContext;
use BehatMinkExtensionContextMinkContext;
class FeatureContext extends RawMinkContext
{
public function __construct(array $parameters)
{
$this->useContext('mink', new MinkContext);
}
}
http://extensions.behat.org/mink/

66. Développement
Installation: subcontexts
# features/bootstrap/FeatureContext.php
use BehatMinkExtensionContextRawMinkContext;
use BehatMinkExtensionContextMinkContext;
class FeatureContext extends RawMinkContext
{
public function __construct(array $parameters)
{
$this->useContext('mink', new MinkContext);
}
}
http://extensions.behat.org/mink/

67. Développement
● Mink steps
When will this be over ?
http://mink.behat.org/

68. Développement
● Mink steps
When I hover the element ?
/**
* @When /^I hover "([^"]*)"$/
*/
public function iHover($cssId)
{
http://mink.behat.org/
When will this be over ?

69. Développement
● Mink steps
/**
* @When /^I hover "([^"]*)"$/
*/
public function iHover($cssId)
{
$page = $this->getSession()->getPage();
$element = $page->find('css', $cssId);
http://mink.behat.org/api/behat/mink/element/nodeelement.html

70. Développement
● Mink steps
public function iHover($cssId)
{
$page = $this->getSession()->getPage();
$element = $page->find('css', $cssId);
if (null === $element) {
throw new ElementNotFoundException($this->getSession(), 'element', 'css', $
}
http://mink.behat.org/api/behat/mink/element/nodeelement.html

71. Développement
● Mink steps
__construct(Session session, string type, string selector, string locator)
And I hover "a[title='abcdefghi']" # FeatureContext::iHover()
Element matching css "a[title='abcdefghi']" not found.
throw new ElementNotFoundException
($this->getSession(), 'element', 'css', $cssId);
http://mink.behat.org/api/behat/mink/element/nodeelement.html

72. Développement
● Mink steps
public function iHover($cssId)
{
$page = $this->getSession()->getPage();
$element = $page->find('css', $cssId);
if (null === $element) {
throw new ElementNotFoundException($this->getSession(), 'element', 'css', $cssId
}
$element->mouseOver();
http://mink.behat.org/api/behat/mink/element/nodeelement.html

73. Développement
● Mink steps
public function iHover($cssId)
{
$page = $this->getSession()->getPage();
$element = $page->find('css', $cssId);
if (null === $element) {
throw new ElementNotFoundException($this->getSession(), 'element', 'css', $cssId
}
$element->mouseOver();
Attention: Selenium supporte le
mouseOver Javascript only :(
http://mink.behat.org/api/behat/mink/element/nodeelement.html

74. Développement
● Mink steps - AJAX
/**
* Waits some time or until JS condition turns true.
*
* @param integer $time time in milliseconds
* @param string $condition JS condition
*/
public function wait($time, $condition = 'false')
{
$this->driver->wait($time, $condition);
}
http://mink.behat.org/api/source/behat/mink/session.php.html

75. Développement
● Mink steps - AJAX
/**
* @When /^I wait (?P<timing>d+)sec$/
*/
public function iWaitNSec($timing) {
$this->getSession()->wait($timing*1000);
}
http://mink.behat.org/api/source/behat/mink/session.php.html

76. Développement
● Mink steps - AJAX
/**
* @When /^I wait (?P<timing>d+)sec$/
*/
public function iWaitNSec($timing) {
$this->getSession()->wait($timing*1000);
}
http://mink.behat.org/api/source/behat/mink/session.php.html

77. Développement
Démo
bin/behat features/demo.feature

78. Développement
Démo: colored output
bin/behat --ansi features/demo.feature
behat arguments: http://docs.behat.org/guides/6.cli.html

79. Développement
● OwsContext
https://github.com/B2F/OwsContext
public function iHover($cssId)
public function iWaitNsec($timing)
public function iClickTheElementMatching($selector)

80. Développement
● OwsContext
https://github.com/B2F/OwsContext
+ (experimental)
public function iWaitNSecForTheText($timing, $text)
public function iSwitchToTheIframeNamed($iframe)
public function iSwitchBackFromIframe()

81. Développement
Configuration
# behat.yml
default:
extensions:
BehatMinkExtensionExtension:
base_url: http://google.fr
goutte: ~
selenium2: ~

82. Développement
Configuration
● AJAX
@javascript
Scenario: vérification qu'un lien est présent
Given I am at "/home"
When I follow "my account"
Then I should see "my page title"

83. Développement
Configuration
● Profiles = overrides
# behat.yml
default:
...
custom:
extensions:
BehatMinkExtensionExtension:
base_url: http://another-url.com

84. Développement
Configuration
● Profiles
# bin/behat --profile=custom features/tests.feature

85. Développement
Configuration
● Filtres
# behat.yml
custom:
...
extensions:
...
filters:
tags: "@custom-filter"

86. Développement
Configuration
● Filtres
@javascript @custom-filter
Scenario: vérification qu'un lien est présent
Given I am at "/home"
When I hover "Se connecter"
Then I wait 1sec for the text "login"

87. Développement
● Drupal Extension
https://drupal.org/project/drupalextension

88. Développement
● Drupal Extension
/**
* Features context.
*/
class DrupalContext extends MinkContext implements DrupalAwareInterface {
private $drupal, $drupalParameters;
/**
* Basic auth user and password.
*/
public $basic_auth;
...
https://drupal.org/project/drupalextension

89. Développement
● Drupal Extension: installation
# composer.json
{
"require": {
"drupal/drupal-extension": "*"
},
"minimum-stability": "dev",
"config": {
"bin-dir": "bin/"
}
}
https://drupal.org/project/drupalextension

90. Développement
● Drupal Extension: installtion
$ curl http://getcomposer.org/installer | php
$ php composer.phar install
https://drupal.org/project/drupalextension

91. Développement
● Drupal Extension: configuration
#behat.yml
default:
paths:
features: 'features'
extensions:
BehatMinkExtensionExtension:
goutte: ~
selenium2: ~
base_url: http://www.campusfrance.org/
https://drupal.org/project/drupalextension

92. Développement
● Drupal Extension: configuration
#behat.yml
default:
paths:
features: 'features'
extensions:
BehatMinkExtensionExtension:
goutte: ~
selenium2: ~
base_url: http://www.campusfrance.org/
DrupalDrupalExtensionExtension:
blackbox: ~
https://drupal.org/project/drupalextension

93. Développement
● Drupal Extension en pratique
bin/behat -dl => liste les steps
https://drupal.org/project/drupalextension

94. Développement
● Drupal Extension: user steps
Given /^I am an anonymous user$/
Given /^I am not logged in$/
Given /^I am logged in as a user with the "(?P<role>[^"]*)" role$/
https://drupal.org/project/drupalextension

95. Développement
● Drupal Extension: configuration
#behat.yml
default:
paths:
features: 'features'
extensions:
...
DrupalDrupalExtensionExtension:
blackbox: ~
drush:
alias: myDrushAlias
https://drupal.org/project/drupalextension

96. Opened blackbox
● Drupal Extension: user steps
# @see Drupal/DrupalExtension/Context/DrupalContext.php
/**
* Helper function to login the current user.
*/
public function login() {
...
$this->getSession()->visit($this->locatePath('/user'));
$element = $this->getSession()->getPage();
$element->fillField($this->getDrupalText('username_field'), $this->user->name);
$element->fillField($this->getDrupalText('password_field'), $this->user->pass);
$submit = $element->findButton($this->getDrupalText('log_in'));
https://drupal.org/project/drupalextension

97. Développement
● Drupal Extension: user steps
#behat.yml
DrupalDrupalExtensionExtension:
text:
log_out: "Sign out"
log_in: "Sign in"
password_field: "Enter your password"
username_field: "Nickname"
https://drupal.org/project/drupalextension

98. Développement
● Drupal Extension: content steps
Given /^I am viewing (?:a|an) "(?P<type>[^"]*)" node with the title "(?P<title>[^"
Given /^I am viewing (?:a|an) "(?P<vocabulary>[^"]*)" term with the name "(?
P<name>[^"]*)"$/
https://drupal.org/project/drupalextension

99. Développement
● Drupal Extension: region steps
Then /^I should see the "(?P<heading>[^"]*)" heading in the "(?P<region>[^"]*)"(?:|reg
When /^I (?:follow|click) "(?P<link>[^"]*)" in the "(?P<region>[^"]*)"(?:| region)$/
Then /^I should see the link "(?P<link>[^"]*)" in the "(?P<region>[^"]*)"(?:| region)$/
Given /^I press "(?P<button>[^"]*)" in the "(?P<region>[^"]*)"(?:| region)$/
https://drupal.org/project/drupalextension

100. Développement
● Drupal Extension: region steps
#behat.yml
DrupalDrupalExtensionExtension:
region_map:
My region: "#css-selector"
Content: "#main .region-content"
Right sidebar: "#sidebar-second"
https://drupal.org/project/drupalextension

101. Développement
● Drupal Extension: misc steps
Given /^the cache has been cleared$/
Given /^I run cron$/
https://drupal.org/project/drupalextension

102. Développement
Démo

103. Développement
Conclusion:
Utilisez BDD pour faire des tests de régressions.

104. Introduction aux tests de recette automatisés
Avec l'extension Drupal pour Behat
didier.boff@ows.fr
B2F @ drupal.org
https://github.com/B2F
http:///twitter.com/zenelse
Merci de votre attention