UX STRAT USA 2017 presentation by Sharon Bautista, UX Researcher, Mozilla

1. From Product to UX Strategy:
Experimenting in the Open at Mozilla
UX STRAT USA
September 19, 2017
Sharon Bautista
@happy_stomach

2. About me
• Based in Chicago
• Researcher on Firefox UX team
• Qualitative research on topics
related to how people use the
internet
Myself pictured with two of my UX teammates and Firefox at our all-company meeting this past June

3. Today’s roadmap
• Mozilla’s story
• Browser as product
• Experimentation at Mozilla
• Experimentation & UX strategy

4. Mozilla’s Story
Image source: https://www.flickr.com/photos/mozillaallhands/31559390455/in/album-72157673850712094/

5. Then Now
2003
Mozilla
Foundation
founded
1998
Mozilla project
formed at
Netscape
2004
Firefox 1.0
released
2010
First Firefox
mobile
release
2013
Firefox OS
launches
2017
Mozilla
acquires
Pocket;
(November)
Firefox 57
released
2005
Mozilla
Corporation
created
Mozilla’s story
Source: https://wiki.mozilla.org/Timeline

6. To ensure the Internet is a global
public resource, open and accessible
to all. An Internet that truly puts
people first, where individuals can
shape their own experience and are
empowered, safe and independent.
Mozilla’s mission
Mozilla Foundation
Mozilla Corporation

7. What the mission means
• Profit is not the ultimate goal
• Priorities include:
• Protecting privacy of our users
• Ensuring they have choices about technology they use
• Removing barriers to the internet
• Open source community

8. Browser as Product
Image source: https://www.flickr.com/photos/mozillaallhands/27900398622/in/album-72157669425118160/

9. Desktop browsers, 2008-2010
• IE: 77.41%
• Firefox: 17.22%
• Safari: 2.70%
• Opera: 1.83%
• Other: 0.84%
• Chrome: 0%*
Source:http://www.netmarketshare.com/browser-market-share.aspx?qprid=1&qptimeframe=M&qpsp=110&qpnp=25
*Chrome’s first release was in September 2008

10. Desktop browsers, 2016-2017
• Chrome: 63.47%
• Firefox: 13.83%
• IE: 9.03%
• Safari: 5.04%
• Edge: 3.96%
• Opera: 2.25%
Source: http://gs.statcounter.com/browser-market-share/desktop/worldwide

11. The laptop screen of a participant in one of Mozilla’s research studies. This participant used terms like “browser” and “search” and “Google” interchangeably.

12. Source: https://www.cnet.com/special-reports/mozilla-firefox-fights-back-against-google-chrome/

13. Firefox UX team projects as of June 2017

14. Experimentation at Mozilla
Image source: https://www.flickr.com/photos/mozillaallhands/27886019462/in/album-72157669425118160/

15. Home page of the Test Pilot website: https://testpilot.firefox.com/

16. Test Pilot launch email from May 2016

17. Forbes article about Test Pilot’s Send experiment:https://www.forbes.com/sites/leemathews/2017/08/04/firefox-makers-new-app-makes-secure-file-sharing-a-breeze/#351bb17d1d03

18. Home page of the Test Pilot website: https://testpilot.firefox.com/

19. Active Test Pilot experiments as of September 2017

20. Detail page for the VoiceFill experiment, which allows people to search by voice using a limited number of search engines

21. Detail page for the No More 404s experiment, which linked people directly to the Wayback Machine when they encountered a 404

22. Graduation report detail
Source: https://testpilot.firefox.com/experiments/no-more-404s

23. Example Activity Stream new tab bugs in Bugzilla (https://bugzilla.mozilla.org/)

24. Firefox Test Pilot Twitter account

25. engineering
individual
contributor
established
Mozilla team
partner
organization
experiment
ideas
business
canvas
resource
coordination
metrics
user
research
user
experience
QA
security
legal
marketing
1. ideas
2. planning
3. design & build
Test Pilot Process

26. enhancements
4. learn
5. stop or ship
Test Pilot Process (continued)
launch
decisions
(more)
engineering
(more)
user research
(more)
user
experience
(more) QA
(more)
security
(more) legal
(more)
marketing
better browser
share
learnings

27. Experimentation
& UX Strategy
Image source: https://www.flickr.com/photos/mozillaallhands/31588837596/in/album-72157673850712094/

28. What Test Pilot has helped Mozilla realize
• Defined way of evaluating ideas
• Array of functions necessary for shipping a user-centered product
• Constraints of learning goals and time limits
• Timely, data-informed decision-making

29. How Test Pilot supports UX strategy
• Way to collect data needed for user-centered decisions
• Identify and set aside what’s *not* working
• Helping to inform what’s included in next generation Firefox

30. Challenges of experimentation
• Break with history
• Process takes practice
• Skeptics

31. “I feel like Firefox and Mozilla has: 1) a hiring
strategy for UX professionals, 2) a general
(positive) change in culture around accepting
UX design and research into the product
development fold, and 3) ux process work, but I
don't know that we are 'done' (or will ever be
done?) creating one, unified ‘UX Strategy’.”
- Firefox UX team member

32. Thank you
Sharon Bautista
@happy_stomach
sharon@mozilla.com

33. • Test Pilot: https://testpilot.firefox.com/
• Test Pilot Wiki: https://wiki.mozilla.org/Test_Pilot
• Test Pilot Medium: https://medium.com/firefox-test-pilot
Resources