The MozMill crowd extension, which is currently under development by Mozilla QA, will offer an automated testing experience for people around the world. Help us to make Firefox even better!

1. quality.mozilla.org qa automation
MOZMILL CROWD
The birth of global automated testing
Anthony Hughes <ashughes@mozilla.com>
Henrik Skupin <hskupin@mozilla.com>

2. MOZMILL CROWD

3. MOZMILL CROWD
• What is MozMill?

4. MOZMILL CROWD
• What is MozMill?
• Automated test-runs

5. MOZMILL CROWD
• What is MozMill?
• Automated test-runs
• Extended testing with MozMill

6. MOZMILL CROWD
• What is MozMill?
• Automated test-runs
• Extended testing with MozMill
• MozMill Crowd extension

7. MOZMILL CROWD
• What is MozMill?
• Automated test-runs
• Extended testing with MozMill
• MozMill Crowd extension
• Demo

8. MOZMILL CROWD
• What is MozMill?
• Automated test-runs
• Extended testing with MozMill
• MozMill Crowd extension
• Demo
• Questions & Answers

9. WHAT IS MOZMILL
• Automation
• Framework & API
• Reporting
• IDE
• Documentation
• Community

10. AUTOMATED TEST-RUNS
• BFT
• Selection of automatable scripted manual tests from
Litmus (including Smoketests and BFT)
• Creation of new tests from too complex test scenarios
• Breakup in restart-less and restart tests
• Support for all localized builds
• Executable on all platforms

11. AUTOMATED TEST-RUNS
• Localization (L10n)
• Multiple usage of the same access keys
• Checking existing windows and dialogs for cut-off
elements
• Accessibility
• Testsof proper XUL markup for exposing content to
screen readers

12. AUTOMATED TEST-RUNS
• Add-ons
• Tests for add-ons provided by add-on authors
• Add-ons hosted on AMO or on other servers
• Breakup in restart-less and restart tests
• (Software Update)
• Release testing of feature and security releases
• Will not be promoted in MozMill Crowd

13. EXTENDED TESTING WITH MOZMILL
• In-house testing isn’t enough, we have to do more!
• Outsourcing tasks to a large group of people
• Increased coverage for daily test-runs
• Support localization teams by executing test-runs for
localized builds
• Help add-on authors to get their add-ons tested
• Performance tests on the testers system (planned)

14. MOZMILL CROWD EXTENSION
• Tool to allow crowd sourcing of Mozmill tests
• Which requirements have we set?
• Support for all platforms and branches
• Automatic setup of the whole MozMill environment
• Execution of available test-runs with a single click
• Sending of test results to a report server
• Customizable for more focused testing

15. MOZMILL CROWD EXTENSION
• Separate dialog with controls for test parameters
• Area for immediate output of test results

16. MOZMILL CROWD EXTENSION
• Preferences
• Selection
of the test
repository
• Sending reports
• Security
options for
add-ons test-run

17. DEMO
• What will be shown?
• Add-on test-run for the Google Toolbar extension
• BFT test-run in Firefox (fa)
• Test results

18. QUESTIONS & ANSWERS
Questions?
We will collected ideas and proposals in the following Etherpad document:
http://etherpad.mozilla.com:9000/h03KB01vcS

19. Thanks