Overview of UI testing tools for iOS, specially Cucumber

1. UI Testing
Taras Kalapun
1

3. “It seems to
be working”

4. “Nothing is
obviously broken”

5. Why Create Automated Tests?
• Find bugs while you sleep
• Repeatable regressions tests
• Quickly turn around updates to your
application
3

6. 4

7. Potential Testing Tools
hmmm...
5

8. Potential Testing Tools
• Frank and UISpec hmmm...
5

9. Potential Testing Tools
• Frank and UISpec hmmm...
• Sikuli
5

10. Potential Testing Tools
• Frank and UISpec hmmm...
• Sikuli
• FoneMonkey
5

11. Potential Testing Tools
• Frank and UISpec hmmm...
• Sikuli
• FoneMonkey
• iCuke
5

12. Potential Testing Tools
• Frank and UISpec hmmm...
• Sikuli
• FoneMonkey
• iCuke
• UIAutomation
5

13. UI Automation
6

14. 7

15. 8

16. Logging
var testName = "My first test";
UIALogger.logStart(testName);
// test code
UIALogger.logPass(testName);
9

17. test("Food screen", function(target, app) {
var window = app.mainWindow();
window.tabBars()[0].buttons()["Food"].tap();
var e;
// Choose Provider
e = window.tableViews()[0].cells()[0];
waitVisible(e);
e.tap();
delay(1);
// Choose food
e = window.tableViews()[0].cells()[0];
waitVisible(e);
e.tap();
delay(1);
// Put in basket
e = window.tableViews()[0].cells()[0];
waitVisible(e);
e.tap();
10

18. 11

19. test("User Info screen", function(target, app) {
var window = app.mainWindow();
var tabBar = window.tabBars()[0];
tabBar.buttons()["Info"].tap();
var tableView = window.tableViews()[0];
// Choose User Info
waitVisible(tableView.cells()["User Info"]);
tableView.cells()["User Info"].tap();
//textFields()[0].setValue(name);
tableView = window.tableViews()[0];
tableView.cells()["name"].textFields()
[0].setValue("Vasya");
tableView.cells()["email"].textFields()
[0].setValue("test@example.com");
tableView.cells()["phone"].textFields()
[0].setValue("+77777");
});
12

20. Handling Alerts
UIATarget.onAlert = function onAlert(alert) {
var title = alert.name();
UIALogger.logWarning("Alert with title '" +
title + "' encountered!");
if (title == "Warning") {
alert.buttons()["OK"].tap();
return true; // bypass default handler
}
return false; // use default handler
}
13

21. Multitasking
• Deactivate application for a given time
• Reactivating the application is handled
automatically
UIALogger.logMessage("Deactivating app");
UIATarget.localTarget().deactivateAppForDuration(10);
UIALogger.logMessage("Resuming test after
deactivation");
14

22. + ?
describe("Jasmine", function() {
it("makes testing JavaScript awesome!", function() {
expect(yourCode).toBeLotsBetter();
});
});
• http://pivotal.github.com/jasmine/
• https://github.com/dexterous/iOS-Acceptance-Testing
15

23. 16

24. Record/playback functional testing tool
• Records high-level user actions
• Integrates with OCUnit
• Generation of OCUnit test scripts
• Generation of JavaScript UIAutomation scripts
• Validation commands
http://www.gorillalogic.com/fonemonkey
17

25. 18

26. Zucchini
19

27. Frank and
Cucumber
20

28. Tests
iPhone
App
21

29. Tests
UISpec
Cucumber / Ruby
?
iPhone
App
21

30. Tests Frank
Server
UISpec
Cucumber / Ruby
iPhone
App
21

31. Tests Frank
Driver
Frank
Server
UISpec
Cucumber / Ruby
iPhone
App
21

32. Tests Frank
Driver
Frank
Server
“frankly”
UISpec
Cucumber / Ruby
iPhone
App
21

33. UISpec
UISpec is a Behavior Driven Development framework
for the iPhone that provides a full automated testing
solution that drives the actual iPhone UI
http://code.google.com/p/uispec/
22

34. UIScript
$(@"textField with placeholder:'Username'
setText:'bkuser'");
$(@"textField with placeholder:'Password'
setText:'bkpassword'");
$(@"navigationButton label with text:'Login' touch");
23

35. Scenario: [name of the scenario]
Given [some statement]
When [some action]
Then [some expected result]
And [another expectation]
24

36. Feature: Browsing catalog
In order to test catalog browsing
As a user
I want be able to browse
through catalog entries
25

37. Cucumber
Feature: Buying shoes
Background: The app is running
Given I launch the app
Scenario: Placing an order on shoes
When I open catalog
And I switch to "Categories" view
And I pick "Женская обувь" category
And I pick "Босоножки" subcategory
And I pick "Босоножки женские Lloyd" item
And I buy the item
Then I should see "1049.4" price badge
26

38. When /^I wait ([d.]+) second(?:s)?$/ do |seconds|
seconds = seconds.to_f
sleep( seconds )
end
Then /^I should see several entires in the table$/ do
section = 0
expected_num_rows = 2
num_rows_array = frankly_map( "tableView first",
"numberOfRowsInSection:", section )
raise "no table found" if num_rows_array.empty?
num_rows_array.first.should > expected_num_rows
end
27

39. When /^I pick "([^"]*)" item$/ do |item|
steps %Q{
When I wait to see "#{item}"
And I touch the 3rd table cell
}
end
When /^I buy the item$/ do
frankly_map("scrollView first scrollDown:220", "")
touch "view marked:'Buy'"
end
28

40. 29

41. 30

42. robotium
31

43. 32

44. Refs
• http://github.com/moredip/frank
• http://cuke4ninja.com
• http://cukes.info
• http://www.slideshare.net/sgleadow/frank-ios-testing
• http://www.slideshare.net/sgleadow/agile-ios
• http://stackoverflow.com/questions/4114083/ios-tests-specs-
tdd-bdd-and-integration-acceptance-testing
• kiwi - BDD Logick test
33