To atdd-and-beyond

To ATDD And Beyond
Better Automated Acceptance Testing on the JVM

John Ferguson Smart

Consulta
nt
Trainer
Mentor
Author
Speaker
Coder
John Fer
guson S
mar t

The Plan

1) What is ATDD?
2) How can I do it
3) Let’s see it work

Acceptance Test Driven Development

The story of your app

Goals Make money by selling our stuff online

Display catalog
Features/Epics
Order products
Build a wishlist

User stories

Browse Catalog
In order to ﬁnd stuff I would like to buy
As a customer
I want to be able to browse through the
catalog

User stories
Browse Catalog
As a customer
catalog
Acceptance criteria
☑
See
all
the
top-‐level
categories
in
the
catalog
☑
Browse
through
the
sub-‐categories
☑
See
all
the
products
in
a
category

User stories
Browse Catalog
As a customer
catalog
Acceptance criteria
☑
See
all
the
top-‐level
categories
in
the
catalog
☑
Browse
through
the
sub-‐categories
☑
See
all
the
products
in
a
category

Scenario: See all top-level categories
Given I want to browse the catalog
When I am on the home page
Then I should see the following product categories: Clothing, Accessories, Shoes

Automated acceptance test

Automated acceptance test

Implemented development tests Implemented acceptance tests

Automated acceptance criteria

Deﬁne your goals


keep you on track


Provide better visibility


Allow faster release cycles


Reduce Risk


31%
faster
delivery
Delivery
Time

Using
ATDD
Tradi4onal

Provide more value


4
4mes
less
defects
Defect
Rate

Using
ATDD
Tradi4onal

Higher Quality

Why only do QA
at the end of the project?

Real quality cannot be injected at the end

It must be part of the process

Leave the boring stuff to the automated tests...

...and empower your QA team

Let testers focus on more intelligent testing

20

Keeping an eye on things

22

1 Discover your acceptance criteria

2 Automate your acceptance criteria

3 Implement your acceptance criteria

4 Execute your acceptance tests

23


Feature: Browse Catalog
In order to find items that I would like to buy
As a customer
I want to be able to browse through the catalog

Story: Browse by category
In order to find items more easily
As a customer
I want to be able to browse through the product categories
Acceptance Criteria
See all the top-level categories
Browse through the category hierarchy
Should display the correct products for each category
Each category should have the correct sub-categories

Deﬁne acceptance criteria for each story

24


Acceptance Criteria
See all the top-level categories
Browse through the category hierarchy


Clarify the acceptance criteria with examples

25


Story: Browse by category
Acceptance Criteria
As a customer top-level categories
See all the
I want Browse through the category the product categories
to be able to browse through hierarchy
Narrative:
As a customer
I want to be able to see what product categories exist


We now have an executable requirement

26


...but they will be reported as ‘pending’

27


Narrative:
As a customer
I want to be able to see what product categories exist


28


29


JUnit

30

4 Execute your acceptance tests

Functional Test Coverage

“What was tested”
vs
“What’s been done”

What have we tested?

Broken

Works

In Progress

What have we ﬁnished? Specified but no tests

Partially done?

Finished

Stay on top of your scenarios

Better visibility on what is done
More targeted reporting

Keep your scenarios organized
Goal:
In order to increase revenue from commissions on classified ads sales
As the head of the classified ads department
I want to increase the number of items sold via our classified ads

Capability
In order to increase the number of items I sell Feature

As a seller In order to increase sales of advertised articles

I want buyers to be able to view ads for items As a seller

they might want to purchase I want potential buyers to be able to display only the ads for
articles that they might be interested in purchasing.

Story
In order to find the items I am interested in faster
As a buyer
I want to be able to list all the ads with a particular keyword in
the description or title.

Store your requirements where it suits you

Customize Thucydides to work for you

RequirementsTagProvider
getRequirements()
getParentRequirementOf(testOutcome)
Capability
In order to increase the number of items I sell
As a seller
I want buyers to be able to view ads for items they might want to
Feature
In order to increase sales of advertised articles
As a seller MyRequirementProvider
I want potential buyers to be able to display only the ads for articles

MYPROJ-123
Story
In order to find the items I am interested in faster
As a buyer
I want to be able to list all the ads with a particular keyword in the
description or title.

Meta:
@issue MYPROJ-123

Scenario: Search by keyword
Given that I want to find products in the "<range>" range
When I search for products by keyword "<keywords>"
Then I should see a product with the title <expectedTitle>

Use tags for orthogonal concerns

• Non-functional requirements
• Iterations
• Current iteration vs regression tests
• Acceptance tests vs more detailed tests
• Related features
• System components
• ...

@RunWith(ThucydidesRunner) Tagging in JUnit
@Issue("NC-1")
@WithTag(name="Browse Ads")
class BrowseAdsByCategory {
    @Managed
    public WebDriver webdriver

    @ManagedPages(defaultUrl = "http://www.newsclassifieds-uat.appspot.com")
    public Pages pages

    @Steps
    BuyerSteps buyer

    @Test
    void "Browse ads by category"() {
        buyer.opens_home_page()
        buyer.chooses_classification "Furniture & Homewares"
        buyer.should_see_search_results_for "Furniture & Homewares"

        buyer.chooses_entry(1).from().other_results()
        buyer.should_see_details_for_the_selected_ad()

        buyer.returns_to_search_results()
        buyer.should_see_search_results_for "Furniture & Homewares"
    }
}

Have you got web tests that look like this?

Page Objects To The Rescue!

Better encapsulation
Easier to read
Easier to maintain
Still a bit unclear what we are doing

Test Steps To The Rescue!

Step methods focus on what we are doing


Step implementations detail the how


Steps are ordinary methods
    @Step
    public void proceedToPayment() {
        adPreviewPage.proceedToPayment();
    }
They can have parameters
   @Step
   public void searches_for(String searchTerms) {
        homePage.searchFor(searchTerms);
   }
They can be pending
   @Pending @Step
    public void searches_for(String searchTerms) {
        // Not done yet
    }

    @Step("The carousel should display {0} at a time")
    def should_see_a_number_of_visible_ads_in_the_carousel(int adCount) {
        assert homePage.visibleCarouselAds.size() == adCount
    }

You can customize the title


    @Step
    def browses_product_categories(String... categories) {
        selects_top_level_category(categories.head())
        categories.tail().each { subcategory ->
            browse_through_subcategory(subcategory)
        }
    } Steps can call other steps
    @Step
    def selects_top_level_category(String category) {
        homePage.select_top_level_category category
    }

    @Step
    def browse_through_subcategory(subcategory) {
        homePage.select_subcategory(subcategory)
    }


Test reports document the what and the how


Focus on what we are doing, not how we do it
More reusability
Better reporting

Even better with JBehave!

Narrative:
As a customer

Scenario: Browse through product categories
Given I am on the home page
When I browse through the product categories Clothing, Mens, Shirts
Then I should see a product with the title 3by3 Milano Stretch Cotton Shirt

JBehave describes what we are doing

Use normal Thucydides steps in the implementation


Narrative:
As a customer

class BrowseByCategorySteps extends BigCommerceJBehaveSteps{

    @Steps
    CustomerSteps customer; Use normal Thucydides steps
    @Given('I am on the home page')
    public void givenIAmOnTheHomePage() {
        customer.opens_home_page()
    }

    @When('I browse through the product categories $categories')
    public void whenIBrowseThroughTheProductCategories(List<String> categories) {
        customer.browses_product_categories(*categories)
    }

    @Then('I should see a product with the title "$expectedTitle"')
    public void thenIShouldSeeAProductWithTheTitle(String expectedTitle) {
        customer.should_see_product withTitle(expectedTitle)
    }
}


Narrative:
As a customer
Context

What

How

Illustrations


Narrative:
As a customer


Living documentation
Easier to read
Easier to maintain
More work maintaining the .story ﬁles

Thucydides Page Object support
Fluent selectors
Fluent matchers
HTML tables
Fluent waits

Thucydides Fluent Selectors
public class HomePage extends PageObject {

    @FindBy(name="adFilter.searchTerm")
    WebElement searchTerm;

    @FindBy(css=".keywords button")
    WebElement search;

    public HomePage2(WebDriver driver) {
        super(driver);
    }
Fluent selectors
    public void chooseCategory(String category) {
        findBy("#category-select").then(".arrow").then().click();
        findBy("#category-select").then(By.linkText(category)).then().click();
    }

    public void enterKeywords(String keywords) {
        $(searchTerm).type(keywords);
    }

    public void performSearch() {
        $(search).click();
Thucydides helper methods
    }
}

class ShoppingCartPage extends PageObject {

    ShoppingCartPage(WebDriver driver) {
        super(driver)
    } Page Object returns domain classes
    @FindBy(css = ".CartContents tbody tr")
    List<WebElement> shoppingCartItems

    List<CartItem> getCartItems() {
        shoppingCartItems.collect { cartItemfromElement(it) }
    }

    CartItem cartItemfromElement(WebElement element) {
        Integer quantity = Integer.parseInt(itemQuantity(element))
        String product = productName(element)
        BigDecimal itemPrice = priceOf(itemPrice(element))
        BigDecimal totalPrice = priceOf(totalPrice(element))

        return CartItem.containing(quantity).productsCalled(product).
                                             withAnItemPriceOf(itemPrice).
                                             andATotalOf(totalPrice)
    }
...
Building a CartItem from the WebElement


        super(driver)
    }
Classic WebDriver
    private String =productName(WebElement tr")
    @FindBy(css ".CartContents tbody cartItem) {
        cartItem.findElement(By.className("ProductName")).text
    }
    private String totalPrice(WebElement cartItem) {
        cartItem.findElement(By.className("CartItemTotalPrice")).text
    }
    }
    private String quantity = Integer.parseInt(itemQuantity(element))
        Integer itemPrice(WebElement cartItem) {
        cartItem.findElement(By.className("CartItemIndividualPrice")).text
    }
    private String itemQuantity(WebElement cartItem) {
        def itemQuantityDropdown
          = cartItem.findElement(
                     By.xpath(".//td[contains(@class,'CartItemQuantity')]/select"))
        element(itemQuantityDropdown).selectedValue
    }
    } ...


        super(driver)
    } Using Thucydides Fluent Selectors
    private String productName(WebElement cartItem) {
        element(cartItem).findBy(".ProductName").text
    }
    }
        element(cartItem).findBy(".CartItemTotalPrice").text
    }
    private String itemPrice(WebElement cartItem) {
        element(cartItem).findBy(".CartItemIndividualPrice").text
    }
        element(cartItem).findBy(".CartItemQuantity").then("select").selectedValue
    }
    }
...


        super(driver)
    } Using short-hand Thucydides Fluent Selectors
        $(cartItem).findBy(".ProductName").text
    }
    }
        $(cartItem).findBy(".CartItemTotalPrice").text
    }
        $(cartItem).findBy(".CartItemIndividualPrice").text
    }
        $(cartItem).findBy(".CartItemQuantity").then("select").selectedValue
    }
    }
...


        super(driver)
    }
(Pure Java version)
        return $(cartItem).findBy(".ProductName").getText();
    }
        return $(cartItem).findBy(".CartItemTotalPrice").getText();
    }
    }
        return $(cartItem).findBy(".CartItemIndividualPrice").getText();
    }
        return $(cartItem).findBy(".CartItemQuantity").then("select").getSelectedValue();
    }
    }
...

    List<String> getYAxes() {
        def axesElements = findAll(".dygraph-axis-label-y");
        axesElements.collect { WebElement axis -> axis.text }
    }
Finding multiple elements

Thucydides Fluent Matchers
import static org.hamcrest.Matchers.is;
import static net.thucydides.core.matchers.BeanMatchers.the;
...
    @Steps
    public DeveloperSteps developer;

    @Test
    public void should_search_for_artifacts_by_name() {
        developer.opens_the_search_page();
        developer.searches_for("Thucydides");
        developer.should_see_artifacts_where(the("ArtifactId", is("thucydides")),
                                             the("GroupId", is("net.thucydides")));
    }

Using Thucydides matchers

And Hamcrest matchers

import static net.thucydides.core.matchers.BeanMatcherAsserts.shouldMatch;
...
public class DeveloperSteps extends ScenarioSteps {
    @Steps
    public DeveloperSteps developer;
    SearchPage searchPage;
    SearchResultsPage searchResultsPage;
    @Test
    public DeveloperSteps(Pages pages) {
        super(pages);
        searchResultsPage = pages.getPage(SearchResultsPage.class);
searchPage = pages.getPage(SearchPage.class);
    }
    }
The Page Object returns a
    @Step
    public void opens_the_search_page() { list of POJOs
        searchPage.open();
    }
Applying the matchers
    @Step
    public void searches_for(String search_terms) {
        searchPage.enter_search_terms(search_terms);
        searchPage.starts_search();
    }

    @Step
    public void should_see_artifacts_where(BeanMatcher... matchers) {
        shouldMatch(searchResultsPage.getSearchResults(), matchers);

...
    @Steps
    public DeveloperSteps developer; The page object should return POJOs
    @Test
    public List<Artifact> getResults() {
        List<WebElement> rows = resultTable.findElements(By.xpath(".//tr[td]"));
        return convert(rows, toArtifacts());
    }
    }     private Converter<WebElement, Artifact> toArtifacts() {
        return new Converter<WebElement, Artifact>() {
            public Artifact convert(WebElement row) {
                List<WebElement> cells = row.findElements(By.tagName("td"));
                String groupId = cells.get(0).getText();
                String artifactId = cells.get(1).getText();
                String latestVersion = cells.get(2).getText();
                return new Artifact(groupId, artifactId, latestVersion);
            }
        };
    }

List<Person> persons = Arrays.asList(new Person("Bill", "Oddie"),
new Person("Tim", "Brooke-Taylor"));

shouldMatch(persons, the("firstName", is(not("Tim"))));
shouldMatch(persons, the("firstName", startsWith("B")));

Matcher work with simple POJOs

Thucydides and Tables
import static net.thucydides.core.pages.components.HtmlTable.rowsFrom;

public class SearchResultsPage extends PageObject {

    WebElement resultTable;

    public SearchResultsPage(WebDriver driver) {
        super(driver);
    }

    public List<Map<String, String>> getSearchResults() {
        return rowsFrom(resultTable);
    }
}

Convenience methods: convert
a table to a map of Strings

    @Test
    public void clicking_on_artifact_should_display_details_page() {
        developer.open_artifact_where(the("ArtifactId", is("thucydides")),

        developer.should_see_artifact_details_where(the("artifactId", is("thucydides")),
                                                    the("groupId", is("net.thucydides")));
    }

Using matchers to click on a
row in a table

    @Test
    public void clicking_on_artifact_should_display_details_page() {
        developer.open_artifact_where(the("ArtifactId", is("thucydides")),

        developer.should_see_artifact_details_where(the("artifactId", is("thucydides")),
                                                    the("groupId", is("net.thucydides")));
    } Pass through matchers
@Step
    public void open_artifact_where(BeanMatcher... matchers) {
        searchResultsPage.clickOnFirstRowMatching(matchers);
    }
import static net.thucydides.core.pages.components.HtmlTable.filterRows;
...
    @FindBy(css="#resultTable")
    WebElement resultTable; Return matching rows
    public void clickOnFirstRowMatching(BeanMatcher... matchers) {
        List<WebElement> matchingRows = filterRows(resultTable, matchers);
        WebElement targetRow = matchingRows.get(0);
        WebElement detailsLink
= $(targetRow).findBy(".//a[contains(@href,'artifactdetails')]");
        detailsLink.click();
    }

Thucydides Fluent Waits

Convenience methods
Extends the WebDriver Wait API

    void addToCart(Integer quantity) {
        $(quantitySelection).selectByVisibleText(quantity.toString())
        $(addToCart).click()
        waitForTextToAppear("added to your cart")
    }
A simple wait

    void uploadExistingImage(String imageUrl) {
        // upload an image
        ...
        waitForPresenceOf(".photo")
    }
Wait for an element to be rendered
    def waitForPageToLoad() {
        waitFor(500).milliseconds()
        waitForAbsenceOf("#loading")
    }

Wait for an element to disappear

    def searchByLocation(postcode) {
        element(location).typeAndTab(postcode)
        element(locationGo).click()
        waitFor("//div[@class='f-item'][contains(.,'${postcode}')]")
    }
Waiting for an XPath expression

    def filterByLocation(String state) {
        element(locationList).click()
        waitFor("#location-select li a")
        findBy("//span[@id='location-select']//a[contains(.,'$state')]").then().click()
        waitForCondition().until(stateIsChosen(state))

    } Wait for a non-trivial condition
    Function<? super WebDriver, Boolean> stateIsChosen(final String state) {
        return new Function<? super WebDriver, Boolean>() {

            @Override
            Boolean apply(driver) {
                return state == getCurrentSelectedState()
            };
        }
    } What are we waiting for

Thucydides Asserts
def shouldDisplaySubcategory(subCategory) {
findBy(".SubCategoryList").then(By.linkText(subCategory)).shouldBeCurrentlyVisible()
}

Check that this element is visible

@FindBy(id=”search”)
WebElement searchButton

def searchShouldBeEnabled() {
searchButton.shouldBeCurrentlyEnabled()
}

Check that this element is enabled

Smarter Webdriver coding

Prefer CSS to XPath


Use Nested Finds

Nested Finds
    findBy("//div[@id='category-select']//a[contains(@class,'arrow')]").click();
    findBy("//div[@id='category-select']//a[.,contains($category)]").click();
}

Hard to read, hard to maintain

    findBy("#category-select").then(".arrow").then().click();
    findBy("#category-select").then(By.linkText(category)).then().click();
}

A more readable approach


Confine Webdriver to
your Page Objects

Encapsulate Page Objects

    public ShoppingCartPage(WebDriver driver) {
        super(driver) Public API
    }

    public List<CartItem> getCartItems() {
    }
Webdriver stays
    private List<WebElement> shoppingCartItems private
    private CartItem cartItemfromElement(WebElement element) {

    }
...


Webdriver Query ~= JDBC Query

Learning More

sts
http://thucydi cydides-webte
des.info github.com/thu

http://thucydides-webtests.com

To ATDD And Beyond
Better Automated Acceptance Testing on the JVM

Thank You

John Ferguson Smart

To atdd-and-beyond

Recommandé

Recommandé

Contenu connexe

Similaire à To atdd-and-beyond

Similaire à To atdd-and-beyond (20)

Plus de John Ferguson Smart Limited

Plus de John Ferguson Smart Limited (20)

To atdd-and-beyond