Mobile App Testing ScanAgile 2012

Daniel Knott
XING AG
@dnlkntt
http://www.adventuresinqa.com
Mobile App Testing –
Challenges, Solutions and Best Practices
Scandinavian Agile Conference 2012

Daniel Knott
Manager Quality Assurance
@dnlkntt
daniel.knott@xing.com
Daniel Knott has a technical background with different programming languages and quality
assurance tools. After his vocational education at IBM Deutschland GmbH, he studied
Computer Science with a focus on quality assurance. Since 2010 Daniel is working as a
Quality Assurance Manager at XING AG. In different projects he was responsible for the test
management, test automation and test execution in agile teams at XING. Currently, he works
in the mobile team, where he is involved in the test management and test automation on
Android and iPhone devices. Daniel likes to work in agile software development teams and to
automate test cases using technologies such as Robotium, KIF (Keep It Functional),
Selenium and Java. XING profile: https://www.xing.com/profile/Daniel_Knott.
Blog: http://www.adventuresinqa.com

1.  XING AG
2.  Why mobile testing?
3.  Challenges
4.  Solutions
5.  Best Practices
What’s inside?
2Mobile App Testing – Challenges, Solutions and Best Practices | Daniel Knott @dnlkntt | Helsinki, 08.03.2012

XING AG
 www.xing.com
 Business Social Network
 Located in Hamburg
 > 11.7 Mio. Members
 ~20% Mobile Traffic

XING AG

XING AG
Releases
50

XING AG

Why mobile testing?

Why mobile testing?
App
installa*on
is
failing

Layout
problems

Problems
with
Landscape
/
Portrait
Mode

Wrong
transla*on

Missing
ressources

No
connec*on
to
backend

Challenges

Challenges – Platforms

Challenges – Platforms
More
than
one
Vendor

Different
User
Interfaces

Different
Hardware

Different
SoFware
Versions

One
Vendor

Different
Hardware

Different
SoFware
Versions

Challenges – I18N

Challenges – Carrier Network

Solution –
Test Automation

Solution – Robotium
Black
Box
Test
Tool

Based
on
Java
and
JUnit
3

Supports
Android
1.6
–
4.x

Simulate
User
Interac*on

Simple
Structure

Device
&
Simulator

Test
against
APK
ﬁles

It‘s likeSelenium,
but for
AndroidTM
clickOnButton(text)
clickOnText(text)
clickOnImage(id)
clickInList(line)
searchText(text)
enterText(id, text)
waitForActivity(name, timeout)
waitForView(view)


public
void
testLoginFailed()
throws
Exception
{

solo.enterText(0,
“wrongusername”);

solo.enterText(1,
“wrongpassword”);

solo.clickOnButton(solo.getString(com.xing.android.R.string.button_login));

solo.waitForActivity("com.xing.android.activities.SpinnerLoginActivity",
2000);

assertTrue("ERROR:
Error
message
is
not
shown",

verifyTextIsPresent(solo.getString(

com.xing.android.R.string.dialog_error_body)));

solo.clickOnButton(solo.getString(com.xing.android.R.string.dialog_button));

}


public
void
testLoginFailed()
throws
Exception
{

solo.enterText(0,

solo.enterText(1,


2000);

assertTrue("ERROR:
Error
message
is
not
shown",




}

Solution – KIF (Keep It Functional)
Grey
Box
Test
Tool

Objec*ve
C

Currently
Simulator
only

Simulate
User
Interac*on

Really
Fast
&
Easy
to
integrate

stepToEnterText: @”Text”
stepToTapViewWithAccessibilityLabel: @”Text”
stepToWaitForViewWithAccessibilityLabel: @”Text”
stepToWaitForTimeInterval: 1
stepToWaitForTappableViewWithAccessibilityLabel: @”Text”
stepToWaitForAbsenceOfViewWithAccessibilityLabel: @”Text”
stepToTapRowInTableViewWithAccessibilityLabel: @”Text”

+
(id)scenarioLoginWithWrongCredentials
{

KIFTestScenario
*scenario
=
[KIFTestScenario
scenarioWithDescription:@"Test

the
login
wrong
credentials"];

[scenario
addStep:[KIFTestStep
stepToEnterText:@"wrongusername"

intoViewWithAccessibilityLabel:@"Login
User
Name"]];

[scenario
stepToEnterText:@"wrongpassword"

Password"]];

[scenario
stepToTapViewWithAccessibilityLabel:@"done"]];

[scenario

stepToWaitForViewWithAccessibilityLabel:LocalizedString

(@"ID_LOGIN_FAILED_MESSAGE")]];

[scenario

stepToTapViewWithAccessibilityLabel:LocalizedString

(@"ACC_FIELD_USER_NAME_LOGIN")]];

+
{

KIFTestScenario
*scenario
=
[KIFTestScenario

the
login
wrong
credentials"];

[scenario

User
Name"]];

[scenario

Password"]];

[scenario

[scenario



[scenario



Solution –
Crowd Source Testing

Solution – Internal Beta Release

Solution – Crowd Source Testing

Solution – Cloud Testing

Best
Practices

Best Practices
Know
your
customers

Write
test
automa*on

Combine
tools

Use
crowd
source
tes*ng

Don‘t
forget
the
languages

Don‘t
forget
the
carrier
network

Test
code
and
produc*on
code
in
same
language

Use
version
control
systems

Use
con*nuous
integra*on

Avoid
simulators

Thank you
for your
kind
attention!
The professional network
www.xing.com
Daniel Knott
Manager Quality Assurance
daniel.knott@xing.com
@dnlkntt
http://www.adventuresinqa.com/

We are hiring
We are looking for
Ruby, Perl, Java, JavaScript, iOS, QA
http://corporate.xing.com/english/company/careers-at-xing/

Links & References
  Robotium [http://code.google.com/p/robotium/]
  KIF [http://corner.squareup.com/2011/07/ios-integration-testing.html]
  WaxSim [https://github.com/square/waxsim]
  Hockeykit [http://hockeykit.net/]
  Apkudo [http://www.apkudo.com/]
  uTest [http://www.utest.com/]
  Testbirds.de [http://testbirds.de/]
  Testdroid [http://testdroid.com/]
  Perfecto Mobile [http://www.perfectomobile.com/]
  DeviceAnyWhere[http://www.keynotedeviceanywhere.com/index.aspx]

Links & References
  Scandinavian Agile Logo [http://scan-agile.org/wp-content/themes/sac20121/images/
scan_agile_2012_gray.png]
  Twitter Logo [https://si0.twimg.com/a/1318896278/images/logos/twitter_newbird_white.png]
  Businesswoman [http://www.istockphoto.com/stock-photo-16742115-businesswoman-
holding-a-blank-sign-isolated.php]
  Letters, by davide vizzini limbte [http://www.flickr.com/photos/limbte/4007115435/]
  Little Dish, by Juan de Dios Santander Vela [http://www.flickr.com/photos/juandesant/
209098053]
  App Store Logo [http://upload.wikimedia.org/wikipedia/de/0/05/App-Store-Logo.png]
  Robot [http://www.nassaulibrary.org/eastrock/robot.jpg]
  Robotium Logo [http://f.hatena.ne.jp/images/fotolife/r/re_shikajiro/20110601/
20110601224550.jpg]
  Square Logo [http://c580513.r13.cf2.rackcdn.com/wp-content/uploads/2011/07/Square_Logo
_Landscape1-500x214.png?9d7bd4]
  uTest Logo [http://upload.wikimedia.org/wikipedia/en/0/0d/UTest_company_logo.jpg]
  Mob4Hire [http://www.free-press-release.com/members/members_pic/200901/img/
1233074965.png]
  Apkudo [http://www.apkudo.com/a/images/apkudo.png]
  Testbirds [http://nest.testbirds.de/sites/default/files/LOGO_1.png]

Links & References
  DeviceAnywhere [http://www.keynotedeviceanywhere.com/images/logo.jpg]
  Perfecto Mobile Logo [http://www.perfectomobile.com/portal/export/sites/qsp/_info_/
general_image_gallery/logo.gif]
  Testdroid Logo [http://beta.testdroid.com/images/logo.png]
  Apple Logo [http://www.lte-tablets.de/files/2011/08/apple_logo.jpg]
  Android Logo [http://www.android.com/media/wallpaper/gif/android_logo.gif]
  Windows Phone Logo [http://upload.wikimedia.org/wikipedia/de/thumb/2/23/Windows_
Phone_Logo.svg/500px-Windows_Phone_Logo.svg.png]
  Blackberry Logo [http://us.blackberry.com/legal/bblogo_gray_003.jpg]
  WebOS Logo [http://upload.wikimedia.org/wikipedia/en/e/e0/WebOS_logo.svg]
  Symbian Logo [http://upload.wikimedia.org/wikipedia/de/thumb/c/c8/Symbian_OS_
logo.svg/686px-Symbian_OS_logo.svg.png]
  Google Play Logo [
http://www.android.com/images/brand/android_app_on_play_logo_small.png]
  Apple App Store Logo [http://www.inext.me/wp-content/uploads/2011/09/
app-store_logo.png]
  Windows Market Place Logo [http://modmyi.com/attachments/forums/iphone-4-
new-skins-themes-launches/483774d1290368882-release-windows-phone-7-hd-market-
place-2x.png]

Mobile App Testing ScanAgile 2012

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

Similaire à Mobile App Testing ScanAgile 2012

Similaire à Mobile App Testing ScanAgile 2012 (20)

Plus de Daniel Knott

Plus de Daniel Knott (17)

Dernier

Dernier (20)

Mobile App Testing ScanAgile 2012