Using Mozmill to run automated functional tests against Firefox. It also demonstrates the on-going work of the QA team to run those tests on a daily basis and how we analyze reported results.

1. Mozmill Test Automation
Henrik Skupin

2. What is Mozmill
• Framework for automated UI testing
• Runnable as both an extension and from command line
• Available for applications built on the Mozilla Platform
• Integrated Development Environment
• Extendable by Python scripts (Software Update tests)
• Full unit test API (JavaScript Unit test module)
2

3. Architecture
Application Process (Firefox, Thunderbird, ...)
Extensions
JsBridge
Mozmill
IDE
JsBridge
Frame
Python (Mozmill)
Mozmill
3

4. Test Automation Project for Firefox
4

5. Test Automation Project for Firefox
• Creation and Maintenance of Mozmill Tests"
(Smoketests / BFT / FFT)
• Daily Test-runs against Nightly Builds of Firefox
• Reporting and Results Analysis"
(CouchDB, Brasstack)"
http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_list/summary/summary
• Testdays and Community Events
5

6. Demos
Mozmill restart testing
Software Update tests
Reporting & Analysis
6

7. Downloads & Code
• Mozmill Extension on AMO:"
https://addons.mozilla.org/en-US/firefox/addon/9018
• PyPI packages for Mozmill:"
http://pypi.python.org/pypi/mozmill"
http://pypi.python.org/pypi/jsbridge"
http://pypi.python.org/pypi/mozrunner
• Code repositories:"
http://github.com/mikeal/mozmill"
http://github.com/mikeal/jsbridge"
http://github.com/mikeal/mozrunner
7

8. Documentation & Communication
• Firefox Test Automation Project:"
https://wiki.mozilla.org/QA/Mozmill_Test_Automation
• Main Documentation on MDC:"
https://developer.mozilla.org/en/Mozmill
• Mozmill-Dev Google Group:"
http://groups.google.com/group/mozmill-dev
• IRC: #QA Channel on irc.mozilla.org
8

9. Questions
Developers
Clint Talbert (ctalbert): ctalbert@mozilla.com
Mikeal Rogers (mikeal): mikeal.rogers@gmail.com
Mozmill Test Automation
Henrik Skupin (whimboo): hskupin@mozilla.com
9

10. Questions?
Still Questions?
Ask!
10

11. Thank You
hskupin@mozilla.com
11