Android Building, Testing and reversing

2. Agenda:
-Intro
-Android Testing
-Creating a project
-JUnit Testing
-Mock Objects + UI Testing
-Integration and acceptance test
-Performance and system testing
-Advance assertions
-TDD
-Real App Dev
!

3. Agenda:
-Tools
-Continuous Integration
!

4. Ego slide
Mobile Developer @ Sixt
M. Sc. UCM/RWTH
CS Teacher at Alcalá University
!
!
!
+EnriqueLópezMañas
@eenriquelopez

5. Ego slide
Mobile Developer @ Sixt
M.Sc. Politehnica Timisoara
!
!
!
+ami.antoch

6. Keywords
Continuous Integration
TDD
JUnit / Unit Testing
Instrumentation
Behavior Driven Development
Performance Testing
Profiling

7. What you need
• Java SE Version 1.6
• Android SDK Tools
• Eclipse IDE for Java Developers
• ADT
• (Android Bundle)

8. Testing
• Develop
• Finding
• Correcting

9. Is about productivity!
$59.5 billion annually
!
1/3 could be saved
!
(National Institute of Standards and
Technology (USA))

10. Why, what, how, when
During, before
!
Continuous Integration
!
Classes, methods, lines, basic
blocks..

11. Activity lifecycle

12. Activity lifecycle
Databases and filesystem operations

13. Activity lifecycle
Databases and filesystem operations
Physical characteristics of the device

14. Activity lifecycle
Databases and filesystem operations
Physical characteristics of the device
(AVD and Genymotion)

15. UnitTests
Written by programmers for programmers
JUnit

16. Elements of a test
The fixture
Method setUp()
Method tearDown()
Test preconditions (retrospection vs. annotations)

17. Assertions
• assertEquals()
• assertFalse()
• assertNotNull()
• assertNotSame()
• assertNull()
• assertSame()
• assertTrue()
• fail()

18. Mock objects
Mimic objects
• MockApplication
• MockContentProvider
• MockContentResolver
• MockContext
• MockCursor
• MockDialogInterface
• MockPackageManager
• MockResources

19. UI Tests
Annotation @UIThreadTest
Class TouchUtils
• Click
• Drag
• LongClick
• Scroll
• Tap
• Touch

20. Environments
Eclipse…
…but also IntelliJ!
…and Netbeans!

21. Instrumentation
Foundation
Control application under test and permit
injection

22. Project Test
MyProject
MyProjectTest

23. Testing Target
Device
AVD Machines
GenyMotion

24. Summary

25. Android Testing
Best practice: test should live in a separate
correlated project
• Stripped (not included in main)
• Easier to run in Emulator
• Takes less time
• Encourages code reusability

26. Create project

27. AVD

28. Genymotion

29. DDMS

30. TestAnnotations
@SmallTest
@MediumTest
@LargeTest
@Smoke
@FlakyTest (tolerance=4)
@UIThreadTest
@Suppress

31. Running Test
From Eclipse

33. Running Single Test

34. Running from the emulator

35. Running from the command line

36. Running from the command line
• All
• From an specific test case
• Specific test by name
• By category
• (create custom annotations)

37. Debug bugs

38. Summary
• Created first Android project
• Followed best practice creating companion project
• Simple test class
• Eclipse
• Command line options

39. Mockup
• All Mock implementations
• All methods non functional
• Throw UnsupportedOperationExceiption

40. UI Testing
• Android SDK Tools, 21+
• API 16+
Tools
• uiaumatorviewer
• uiautomator

41. Integration tests
Individual components work jointly

42. Integration tests
Individual components work jointly
Acceptance tests
QA, Business language

43. Performance tests
Performance behavior
System test
• GUI Test
• Smoke Tests
• Performance
• Installation

44. Benchmarking
• Traditional logging statement methods
• Creating Android performance tests
• Using profiling tools
• Microbenchmarks using Caliper

45. Benchmarking
/* (non-Javadoc)
* @see android.text.TextWatcher#onTextChanged(
* java.lang.CharSequence, int, int, int)
*/
public void onTextChanged(CharSequence s, int start,
int before, int count) {
if (!mDest.hasWindowFocus() || mDest.hasFocus() ||
s == null ) {
return; }
final String str = s.toString();
if ( "".equals(str) ) {
mDest.setText("");
return;
}
final long t0;
if ( BENCHMARK_TEMPERATURE_CONVERSION ) {
t0 = System.currentTimeMillis();
}
!

46. Benchmarking
try {
final double temp = Double.parseDouble(str);
final double result = (mOp == OP.C2F) ?
TemperatureConverter.celsiusToFarenheit(temp);
TemperatureConverter.fahrenheitToCelsius(temp);
final String resultString = String.format("%.2f", result);
mDest.setNumber(result);
mDest.setSelection(resultString.length());
} catch (NumberFormatException e) {
// WARNING
// this is generated while a number is entered,
// for example just a '-'
// so we don't want to show the error
} catch (Exception e) {
mSource.setError("ERROR: " + e.getLocalizedMessage());
}
if ( BENCHMARK_TEMPERATURE_CONVERSION ) {
long t = System.currentTimeMillis() - t0;
Log.i(TAG, "TemperatureConversion took " + t +
" ms to complete.");
}
}

47. Android performance tests
Classes hidden only for System
apps :(

48. Assertions in depth
• assertEquals
• assertFalse
• assertNotNull
• assertNotSame
• assertNull
• assertSame
• assertTrue
• assertFail

49. Assertions in depth
public void testNotImplementedYet() {
fail("Not implemented yet");
}

50. Assertions in depth
}
public void testShouldThrowException() {
try {
MyFirstProjectActivity.methodThatShouldThrowException();
fail("Exception was not thrown");
} catch ( Exception ex ) {
// do nothing
}

51. Custom messages
public void testMax() {
final int a = 1;
final int b = 2;
final int expected = b;
final int actual = Math.max(a, b);
assertEquals("Expection " + expected + " but was " + actual,
expected, actual);
}

52. Static imports
public void testAlignment() {
final int margin = 0;
...
android.test.ViewAsserts.assertRightAligned(
mMessage, mCapitalize, margin);
!
}

53. Static imports
import static android.test.ViewAsserts.assertRightAligned;
public void testAlignment() {
final int margin = 0;
assertRightAligned(mMessage, mCapitalize, margin);
}

54. View assertions
assertBaselineAligned

55. View assertions
assertBaselineAligned
assertBotomAligned

56. View assertions
assertBaselineAligned
assertBotomAligned
assertGroupContains

57. View assertions
assertBaselineAligned
assertBotomAligned
assertGroupContains
assertGroupIntegrity

58. View assertions
assertBaselineAligned
assertBotomAligned
assertGroupContains
assertGroupIntegrity
assertGroupNotContains

59. View assertions
assertBaselineAligned
assertBotomAligned
assertGroupContains
assertGroupIntegrity
assertGroupNotContains
assertHasScreenCoordinates

60. View assertions
assertBaselineAligned
assertBotomAligned
assertGroupContains
assertGroupIntegrity
assertGroupNotContains
assertHasScreenCoordinates
assertHorizontalCenterAligned

61. View assertions
assertLeftAligned

62. View assertions
assertLeftAligned
assertOffScreenAbove

63. View assertions
assertLeftAligned
assertOffScreenAbove
assertOffScreenBelow

64. View assertions
assertLeftAligned
assertOffScreenAbove
assertOffScreenBelow
assertOnScreen

65. View assertions
assertLeftAligned
assertOffScreenAbove
assertOffScreenBelow
assertOnScreen
assertRightAligned

66. View assertions
assertLeftAligned
assertOffScreenAbove
assertOffScreenBelow
assertOnScreen
assertRightAligned
assertTopAligned

67. View assertions
assertLeftAligned
assertOffScreenAbove
assertOffScreenBelow
assertOnScreen
assertRightAligned
assertTopAligned
assertVerticalCenterAligned

68. Example
public void testUserInterfaceLayout() {
final int margin = 0;
final View origin = mActivity.getWindow().getDecorView();
assertOnScreen(origin, mMessage);
assertOnScreen(origin, mCapitalize);
assertRightAligned(mMessage, mCapitalize, margin);
}

69. Even more
assertions
assertAssignableFrom

70. Even more
assertions
assertAssignableFrom
assertContainsRegex

71. Even more
assertions
assertAssignableFrom
assertContainsRegex
assertContainsInAnyOrder

72. Even more
assertions
assertAssignableFrom
assertContainsRegex
assertContainsInAnyOrder
assertContainsInOrder

73. Even more
assertions
assertAssignableFrom
assertContainsRegex
assertContainsInAnyOrder
assertContainsInOrder
assertEmpty

74. Even more
assertions
assertAssignableFrom
assertContainsRegex
assertContainsInAnyOrder
assertContainsInOrder
assertEmpty
assertEquals

75. Even more
assertions
assertMatchesRegex

76. Even more
assertions
assertMatchesRegex
assertNotContainsRegex

77. Even more
assertions
assertMatchesRegex
assertNotContainsRegex
assertNotEmpty

78. Even more
assertions
assertMatchesRegex
assertNotContainsRegex
assertNotEmpty
assertNotMatchesRegex

79. Even more
assertions
assertMatchesRegex
assertNotContainsRegex
assertNotEmpty
assertNotMatchesRegex
checkEqualsAndHashCodeMethods

80. Example
@UiThreadTest
public void testNoErrorInCapitalization() {
final String msg = "this is a sample";
mMessage.setText(msg);
mCapitalize.performClick();
final String actual = mMessage.getText().toString();
final String notExpectedRegexp = “(?i:ERROR)";
assertNotContainsRegex("Capitalization found error:",
notExpectedRegexp, actual);
}

81. assertActivityRequiresPermission
public void testActivityPermission() {
final String PKG = "com.example.aatg.myfirstproject";
final String ACTIVITY = PKG + ".MyFirstProjectActivity";
final String PERMISSION = android.Manifest.permission.WRITE_EXTERNAL_STORAGE;
assertActivityRequiresPermission(PKG, ACTIVITY, PERMISSION);
}

82. assertReadingContentUriRequiresPermission
}
public void testReadingContacts() {
final Uri URI = ContactsContract.AUTHORITY_URI;
final String PERMISSION =
android.Manifest.permission.READ_CONTACTS;
assertReadingContentUriRequiresPermission(URI, PERMISSION);

83. assertWritingContentUriRequiresPermission
public void testWritingContacts() {
final Uri URI = ContactsContract.AUTHORITY_URI;
final String PERMISSION =
android.Manifest.permission.WRITE_CONTACTS;
assertWritingContentUriRequiresPermission(URI, PERMISSION);
}

84. ActivityMonitor
}
public void testFollowLink() {
final Instrumentation inst = getInstrumentation();
IntentFilter intentFilter = new IntentFilter(Intent.ACTION_VIEW);
intentFilter.addDataScheme("http");
intentFilter.addCategory(Intent.CATEGORY_BROWSABLE);
ActivityMonitor monitor = inst.addMonitor(intentFilter, null, false);
assertEquals(0, monitor.getHits());
TouchUtils.clickView(this, mLink);
monitor.waitForActivityWithTimeout(5000);
assertEquals(1, monitor.getHits());
inst.removeMonitor(monitor);

85. Example project

86. Summary
Used several types of assertion
Explained mock objects
Exemplified different tests

87. Test Driven Development

88. Test Driven Development

89. Test Driven Development
• Difficult to divert code
• Focus
NO SILVER BULLET

90. Example project - temperature converter

91. Requirements:
• Application convert from Celsius to F.
• … and viceversa
• Two fields to input data
• When temperature is entered, other field updates
• Error displayed
• Some space reserved keyboard
• Entry fields start empty
• Digits right aligned
• Last entered values retained after onPause()

92. Concept design

93. Create projects

94. From requirement to tests

95. AVD and Emulator Options

96. Headless emulator
emulator -avd test -no-window -no-audio -no-boot-anim -port 5580 &

97. Monkeyrunner

98. Building with ant
android update project —path .

99. Jenkins

100. Testing recipes

102. Thank you !
+ Enrique López Mañas
@eenriquelopez