SlideShare une entreprise Scribd logo
1  sur  32
Télécharger pour lire hors ligne
Streamline Your A/B Tests
Learn how to do smarter A/B tests
inspired by remote user research
Remote User Research
Research in which participants and researchers
do not interact in-person with users.
2/32
Quick Poll
Who used remote user research tools before?
3/32
Business Need
Where do you get ideas for AB Testing?
4/32
AB Testing Takes Time
5/32
http://www.chasedumont.com/images/a-b-test-0.jpg
Solution
1. Ask - engage users and find out
more about their needs, pain points
6/32
Solution
1. Ask - engage users and find out
more about their needs, pain points
2. Observe - see your website from the
users’ perspective and learn from
their behavior
7/32
Other Ways of Getting Ideas
• Web Analytics
• Visual Analytics
• Moderated Usability Testing
• In-Depth Interviews
• Customer Issue Categorization
• Brainstorming
8/32
Remote User Research Benefits
• Context-driven
• Cheap
• Simple
• Fast
• Flexible
9/32
The Process
1. Design the study
2. Recruit participants
3. Launch
4. Analyze results
5. Include results in AB Testing project
10/32
Data Source & Approach
11/32
What people do
(behavior)
What people say
(opinions)
Why & how to fix
(qualitative)
How many & how much
(quantitative)
Data Source & Approach
12/32
What people do
(behavior)
What people say
(opinions)
Why & how to fix
(qualitative)
How many & how much
(quantitative)
Automated Live
Moderated
Self-Moderated
Automated Static
Feedback Widgets
Data Source & Approach
13/32
What people do
(behavior)
What people say
(opinions)
Why & how to fix
(qualitative)
How many & how much
(quantitative)
Automated Live
Moderated
Self-Moderated
Automated Static
Feedback Widgets
Basic Categories
• Moderated
• Self-moderated
• Feedback Widgets
• Automated Live
• Automated Static
14/32
Moderated
15/32
Moderated
Overview:
• Live interviews with sound and audio
• You see how users perform tasks in natural environment
• You can talk with users while they’re using your website
Services:
16/32
Self-Moderated
17/32
Self-Moderated
Overview:
• Recorded sessions with sound and audio
• You see how users perform tasks in natural environment
• Results are delivered quickly
Services:
18/32
Feedback Widgets
19/32
Feedback Widgets
20/32
Feedback Widgets
Overview:
• Continuously measure and improve visitor satisfaction
• Good for collecting bugs and suggestions
• Feedback forms are fully customizable
Services:
21/32
Automated Live
22/32
Automated Live
23/32
Automated Live
24/32
Automated Live
25/32
Automated Live
Overview:
• Evaluate web usability by testing large quantities of people
• Metrics: task completion rates, number of clicks, time on task
• Benchmark your website against competition
Services:
26/32
Automated Static
27/32
Automated Static
Overview:
• Collect feedback on layouts, mockups, marketing creations
• You can be very precise about what you ask
• Great for testing out ideas before implementation
Services:
28/32
There’s More…
29/32
Useful Tips
1. Combine different methods
2. Test continuously
3. Define relevant participants
4. Keep it short and simple
5. You never know what you don't know
6. Always look for an inspiration
30/32
Always Look For an Inspiration
31/32
http://uxmag.com/sites/default/files/uploads/livefyre-images/004Usabilla-adding-questions.jpg
Special for Today’s Attendees
Coaching session with UsabilityTools expert
Topics:
• Kick Start Your Conversion Rate Optimization
• Shape up User Experience of Your Website
b.mozyrko@usabilitytools.com
32/32

Contenu connexe

En vedette

En vedette (9)

Empik vs. Merlin - UsabilityTools Case Study
Empik vs. Merlin - UsabilityTools Case StudyEmpik vs. Merlin - UsabilityTools Case Study
Empik vs. Merlin - UsabilityTools Case Study
 
Aktywne Słuchanie & Efektywna Komunikacja (WUD Silesia 2014)
Aktywne Słuchanie & Efektywna Komunikacja (WUD Silesia 2014)Aktywne Słuchanie & Efektywna Komunikacja (WUD Silesia 2014)
Aktywne Słuchanie & Efektywna Komunikacja (WUD Silesia 2014)
 
User story mapping workshop slideshare
User story mapping workshop slideshareUser story mapping workshop slideshare
User story mapping workshop slideshare
 
User Story Mapping
User Story MappingUser Story Mapping
User Story Mapping
 
User Story Mapping Workshop
User Story Mapping WorkshopUser Story Mapping Workshop
User Story Mapping Workshop
 
Story Mapping in a Nutshell
Story Mapping in a NutshellStory Mapping in a Nutshell
Story Mapping in a Nutshell
 
User Story Mapping Workshop (Design Skills 2016)
User Story Mapping Workshop (Design Skills 2016)User Story Mapping Workshop (Design Skills 2016)
User Story Mapping Workshop (Design Skills 2016)
 
User Story Mapping, Discover the whole story
User Story Mapping, Discover the whole storyUser Story Mapping, Discover the whole story
User Story Mapping, Discover the whole story
 
User Story Mapping in Practice
User Story Mapping in PracticeUser Story Mapping in Practice
User Story Mapping in Practice
 

Similaire à Streamline Your AB Testing

From User Personas to Testing: A Project Manager's Journey Towards Behat
From User Personas to Testing: A Project Manager's Journey Towards BehatFrom User Personas to Testing: A Project Manager's Journey Towards Behat
From User Personas to Testing: A Project Manager's Journey Towards Behat
Design for Drupal, Boston
 
UserExperienceWebroot
UserExperienceWebrootUserExperienceWebroot
UserExperienceWebroot
Nancy Shepard
 
Lean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisation
Lean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisationLean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisation
Lean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisation
Craig Sullivan
 

Similaire à Streamline Your AB Testing (20)

Conducting User Research
Conducting User ResearchConducting User Research
Conducting User Research
 
From User Personas to Testing: A Project Manager's Journey Towards Behat
From User Personas to Testing: A Project Manager's Journey Towards BehatFrom User Personas to Testing: A Project Manager's Journey Towards Behat
From User Personas to Testing: A Project Manager's Journey Towards Behat
 
Notes on usability testing
Notes on usability testingNotes on usability testing
Notes on usability testing
 
How to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian PrimerHow to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian Primer
 
Consights
ConsightsConsights
Consights
 
Presentation: Why Usability Testing Should be Part of your Accessibility Test...
Presentation: Why Usability Testing Should be Part of your Accessibility Test...Presentation: Why Usability Testing Should be Part of your Accessibility Test...
Presentation: Why Usability Testing Should be Part of your Accessibility Test...
 
Designing Mobile UX
Designing Mobile UXDesigning Mobile UX
Designing Mobile UX
 
Sourcing The Right Participants For Your UX Research & Testing
Sourcing The Right Participants For Your UX Research & TestingSourcing The Right Participants For Your UX Research & Testing
Sourcing The Right Participants For Your UX Research & Testing
 
How to Benchmark Your Online Customer Experience Against Competition
How to Benchmark Your Online Customer Experience Against CompetitionHow to Benchmark Your Online Customer Experience Against Competition
How to Benchmark Your Online Customer Experience Against Competition
 
Building a UX Research Program
Building a UX Research ProgramBuilding a UX Research Program
Building a UX Research Program
 
Understand people to design great experiences: An introduction to user research
Understand people to design great experiences: An introduction to user researchUnderstand people to design great experiences: An introduction to user research
Understand people to design great experiences: An introduction to user research
 
UserExperienceWebroot
UserExperienceWebrootUserExperienceWebroot
UserExperienceWebroot
 
Mcq peresentation
Mcq  peresentationMcq  peresentation
Mcq peresentation
 
When Mobile meets UX/UI powered by Growth Hacking Asia
When Mobile meets UX/UI powered by Growth Hacking AsiaWhen Mobile meets UX/UI powered by Growth Hacking Asia
When Mobile meets UX/UI powered by Growth Hacking Asia
 
ECIR Recommendation Challenges
ECIR Recommendation ChallengesECIR Recommendation Challenges
ECIR Recommendation Challenges
 
Lean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisation
Lean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisationLean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisation
Lean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisation
 
Lean UX vs Design Thinking (lang: ENG)
Lean UX vs Design Thinking (lang: ENG)Lean UX vs Design Thinking (lang: ENG)
Lean UX vs Design Thinking (lang: ENG)
 
Usability Testing To Prioritize Your Designs
Usability Testing To Prioritize Your DesignsUsability Testing To Prioritize Your Designs
Usability Testing To Prioritize Your Designs
 
Best Practices on Recruiting Participants for Remote User Testing
Best Practices on Recruiting Participants for Remote User TestingBest Practices on Recruiting Participants for Remote User Testing
Best Practices on Recruiting Participants for Remote User Testing
 
Establishing best practices to improve usefulness and usability of web interf...
Establishing best practices to improve usefulness and usability of web interf...Establishing best practices to improve usefulness and usability of web interf...
Establishing best practices to improve usefulness and usability of web interf...
 

Plus de Bartosz Mozyrko

Plus de Bartosz Mozyrko (7)

Product Discovery & Validation (World Product Day 2021)
Product Discovery & Validation (World Product Day 2021)Product Discovery & Validation (World Product Day 2021)
Product Discovery & Validation (World Product Day 2021)
 
Product Discovery & Smoke Testing (Cayman Enterprise City 2020)
Product Discovery & Smoke Testing (Cayman Enterprise City 2020)Product Discovery & Smoke Testing (Cayman Enterprise City 2020)
Product Discovery & Smoke Testing (Cayman Enterprise City 2020)
 
Domain Perks Case Study (ProductTank 2019)
Domain Perks Case Study (ProductTank 2019)Domain Perks Case Study (ProductTank 2019)
Domain Perks Case Study (ProductTank 2019)
 
BANT Qualification Technique For Young Entrepreneurs (Startup Weekend Kids 2017)
BANT Qualification Technique For Young Entrepreneurs (Startup Weekend Kids 2017)BANT Qualification Technique For Young Entrepreneurs (Startup Weekend Kids 2017)
BANT Qualification Technique For Young Entrepreneurs (Startup Weekend Kids 2017)
 
Kto pyta, nie błądzi (Startup Weekend Kids 2017)
Kto pyta, nie błądzi (Startup Weekend Kids 2017)Kto pyta, nie błądzi (Startup Weekend Kids 2017)
Kto pyta, nie błądzi (Startup Weekend Kids 2017)
 
Poznaj swojego klienta - trendy w badaniach marketingowych (SWPS 2012)
Poznaj swojego klienta - trendy w badaniach marketingowych (SWPS 2012)Poznaj swojego klienta - trendy w badaniach marketingowych (SWPS 2012)
Poznaj swojego klienta - trendy w badaniach marketingowych (SWPS 2012)
 
Researcher / Product Owner (WUD 2012)
Researcher / Product Owner (WUD 2012)Researcher / Product Owner (WUD 2012)
Researcher / Product Owner (WUD 2012)
 

Dernier

Dernier (20)

Unlocking the Mystery of the Voynich Manuscript
Unlocking the Mystery of the Voynich ManuscriptUnlocking the Mystery of the Voynich Manuscript
Unlocking the Mystery of the Voynich Manuscript
 
[Expert Panel] New Google Shopping Ads Strategies Uncovered
[Expert Panel] New Google Shopping Ads Strategies Uncovered[Expert Panel] New Google Shopping Ads Strategies Uncovered
[Expert Panel] New Google Shopping Ads Strategies Uncovered
 
Five Essential Tools for International SEO - Natalia Witczyk - SearchNorwich 15
Five Essential Tools for International SEO - Natalia Witczyk - SearchNorwich 15Five Essential Tools for International SEO - Natalia Witczyk - SearchNorwich 15
Five Essential Tools for International SEO - Natalia Witczyk - SearchNorwich 15
 
TAM_AdEx-Cross_Media_Report-Banking_Finance_Investment_(BFSI)_2023.pdf
TAM_AdEx-Cross_Media_Report-Banking_Finance_Investment_(BFSI)_2023.pdfTAM_AdEx-Cross_Media_Report-Banking_Finance_Investment_(BFSI)_2023.pdf
TAM_AdEx-Cross_Media_Report-Banking_Finance_Investment_(BFSI)_2023.pdf
 
2024 Social Trends Report V4 from Later.com
2024 Social Trends Report V4 from Later.com2024 Social Trends Report V4 from Later.com
2024 Social Trends Report V4 from Later.com
 
Analysis of Sineing Website and how to fix
Analysis of Sineing Website and how to fixAnalysis of Sineing Website and how to fix
Analysis of Sineing Website and how to fix
 
SP Search Term Data Optimization Template.pdf
SP Search Term Data Optimization Template.pdfSP Search Term Data Optimization Template.pdf
SP Search Term Data Optimization Template.pdf
 
Elevate Your Advertising Game: Introducing Billion Broadcaster Lift Advertising
Elevate Your Advertising Game: Introducing Billion Broadcaster Lift AdvertisingElevate Your Advertising Game: Introducing Billion Broadcaster Lift Advertising
Elevate Your Advertising Game: Introducing Billion Broadcaster Lift Advertising
 
How consumers use technology and the impacts on their lives
How consumers use technology and the impacts on their livesHow consumers use technology and the impacts on their lives
How consumers use technology and the impacts on their lives
 
The+State+of+Careers+In+Retention+Marketing-2.pdf
The+State+of+Careers+In+Retention+Marketing-2.pdfThe+State+of+Careers+In+Retention+Marketing-2.pdf
The+State+of+Careers+In+Retention+Marketing-2.pdf
 
20180928 Hofstede Insights Conference Milan The Power of Culture Led Brands.pptx
20180928 Hofstede Insights Conference Milan The Power of Culture Led Brands.pptx20180928 Hofstede Insights Conference Milan The Power of Culture Led Brands.pptx
20180928 Hofstede Insights Conference Milan The Power of Culture Led Brands.pptx
 
Social Media Marketing Portfolio - Maharsh Benday
Social Media Marketing Portfolio - Maharsh BendaySocial Media Marketing Portfolio - Maharsh Benday
Social Media Marketing Portfolio - Maharsh Benday
 
VIP Call Girls Dongri WhatsApp +91-9833363713, Full Night Service
VIP Call Girls Dongri WhatsApp +91-9833363713, Full Night ServiceVIP Call Girls Dongri WhatsApp +91-9833363713, Full Night Service
VIP Call Girls Dongri WhatsApp +91-9833363713, Full Night Service
 
Martal Group - B2B Lead Gen Agency - Onboarding Overview
Martal Group - B2B Lead Gen Agency - Onboarding OverviewMartal Group - B2B Lead Gen Agency - Onboarding Overview
Martal Group - B2B Lead Gen Agency - Onboarding Overview
 
Busty Desi⚡Call Girls in Sector 135 Noida Escorts >༒8448380779 Escort Service
Busty Desi⚡Call Girls in Sector 135 Noida Escorts >༒8448380779 Escort ServiceBusty Desi⚡Call Girls in Sector 135 Noida Escorts >༒8448380779 Escort Service
Busty Desi⚡Call Girls in Sector 135 Noida Escorts >༒8448380779 Escort Service
 
Rise and fall of Kulula.com, an airline won consumers by different marketing ...
Rise and fall of Kulula.com, an airline won consumers by different marketing ...Rise and fall of Kulula.com, an airline won consumers by different marketing ...
Rise and fall of Kulula.com, an airline won consumers by different marketing ...
 
Digital-Marketing-Into-by-Zoraiz-Ahmad.pptx
Digital-Marketing-Into-by-Zoraiz-Ahmad.pptxDigital-Marketing-Into-by-Zoraiz-Ahmad.pptx
Digital-Marketing-Into-by-Zoraiz-Ahmad.pptx
 
Distribution Ad Platform_ The Role of Distribution Ad Network.pdf
Distribution Ad Platform_ The Role of  Distribution Ad Network.pdfDistribution Ad Platform_ The Role of  Distribution Ad Network.pdf
Distribution Ad Platform_ The Role of Distribution Ad Network.pdf
 
Micro-Choices, Max Impact Personalizing Your Journey, One Moment at a Time.pdf
Micro-Choices, Max Impact Personalizing Your Journey, One Moment at a Time.pdfMicro-Choices, Max Impact Personalizing Your Journey, One Moment at a Time.pdf
Micro-Choices, Max Impact Personalizing Your Journey, One Moment at a Time.pdf
 
10 Email Marketing Best Practices to Increase Engagements, CTR, And ROI
10 Email Marketing Best Practices to Increase Engagements, CTR, And ROI10 Email Marketing Best Practices to Increase Engagements, CTR, And ROI
10 Email Marketing Best Practices to Increase Engagements, CTR, And ROI
 

Streamline Your AB Testing

Notes de l'éditeur

  1. Definition Traditionally, user research involves directly observing and talking with people in the context of their work. Researchers have travel to observe users in their natural environments or users/participants travel to a usability lab or focus-group facility. This is a solid source of user feedback and insights, unfortunately it’s expensive and time consuming. Remote user research on the other hand allows researchers and users to interact remotely. Remote user research can be either: moderated when the researcher and the participants go through the research activity together, or unmoderated when the researcher is not involved during the study. Survey is an example.
  2. In very curious if you’re here participating with a background knowledge on remote research. Great, that’s something that I was hoping for I’ll try to present in the way everybody could understand
  3. 1) Usually if you see that’s something’s wrong in GA paned you’d jump to AB testing. 2) How do you know which changes will bring significant improvement to your website? People assume once they have the AB Testing software they can test everything
  4. 1) Unfortunately this takes time. AB Test can last weeks or event months until you get statistically significant results 2) I’d assume that you don’t want to waste your valuable traffic on that
  5. So, what you have to do is to take a step back, and instead of guessing what the data means and shooting blind AB tests, validate your assumptions firs with website visitors.  You can ask your users directly
  6. 1) Or watch how they interact with your service or product
  7. There are also many other ways to that you can get the ideas from, but we’ll not cover them in the webinar. They range from analyzing your analytics to talking with the customer support department to brainstorming. If you want to know more you can reach out to me after the webinar, and I’ll be more than happy to share what I know
  8. Getting back to remote. Context-driven – Remote research allows users to use their own computers, letting you and your team see how they set up their desktop, navigate within website, and use tabs, for instance. This gives insight into how people work in their natural environment, Cheap – is a great solution for teams if you have limited budget; Scheduling a series of online studies can be far less costly than traveling around the the world in search for perfect target group. Simple – most of the tools automatically collect, analyze, and present data in useful visualizations, eliminating time-consuming data collection, organization Fast – usually it takes hours from launch to collect the results Flexible – you can start/stop any time, launch many small test at the same time Remote research lets you include people who would otherwise be left out, so you can have a more representative sample. With no geographical limits and higher numbers of participants, you can aim to get a truly representative sample of your users