10 A/B Testing Mistakes that Make Your Wallet Cry

Convert.com
Convert.comConvert.com
10 A/B Testing Mistakes That Make Your Wallet Cry !
Don’t Just Measure
Conversion Rate!
Sequential Testing
Is Not A/B Testing.
Random Testing.
Prioritization
of tests.
Small website
changes give small
conversion changes.
Calling tests early
Don’t surprise
your regulars.
Pre-plan your
tests sample size.
Website wide
consistency
for tests.
Segmenting requires
a bigger sample size.
A B
www.convert.com

Recommandé

Living with acceptance tests: Beyond Write-Once (XP NYC) par
Living with acceptance tests: Beyond Write-Once (XP NYC)Living with acceptance tests: Beyond Write-Once (XP NYC)
Living with acceptance tests: Beyond Write-Once (XP NYC)Daniel Wellman
447 vues53 diapositives
Think Tank Presentation 5-2012 par
Think Tank Presentation 5-2012Think Tank Presentation 5-2012
Think Tank Presentation 5-2012Jim Borzilleri
616 vues52 diapositives
Easy Breezy Small Business Bookkeeping par
Easy Breezy Small Business BookkeepingEasy Breezy Small Business Bookkeeping
Easy Breezy Small Business BookkeepingKabbage
4.4K vues17 diapositives
Selenium Shots by Kyle J. Ginavan & Ryan Felton par
Selenium Shots by Kyle J. Ginavan & Ryan FeltonSelenium Shots by Kyle J. Ginavan & Ryan Felton
Selenium Shots by Kyle J. Ginavan & Ryan FeltonSteven Chau
394 vues22 diapositives
How to reach a Data Driven culture par
How to reach a Data Driven cultureHow to reach a Data Driven culture
How to reach a Data Driven cultureMark Beekman
2.1K vues60 diapositives
DAMA Webinar - Big and Little Data Quality par
DAMA Webinar - Big and Little Data QualityDAMA Webinar - Big and Little Data Quality
DAMA Webinar - Big and Little Data QualityDATAVERSITY
34K vues21 diapositives

Contenu connexe

En vedette

PROG_UntoldStory ISV eBook_0706c FINAL par
PROG_UntoldStory ISV eBook_0706c FINALPROG_UntoldStory ISV eBook_0706c FINAL
PROG_UntoldStory ISV eBook_0706c FINALSolarWinds MSP
4.2K vues21 diapositives
Big Data Revolution: Are You Ready for the Data Overload? par
Big Data Revolution: Are You Ready for the Data Overload?Big Data Revolution: Are You Ready for the Data Overload?
Big Data Revolution: Are You Ready for the Data Overload?Aleah Radovich
24.2K vues17 diapositives
Data Culture Keynote and Exec Track Birm Dec 8th par
Data Culture Keynote and Exec Track Birm Dec 8thData Culture Keynote and Exec Track Birm Dec 8th
Data Culture Keynote and Exec Track Birm Dec 8thJonathan Woodward
6.8K vues138 diapositives
CDO Webinar: 2017 Trends in Data Strategy par
CDO Webinar: 2017 Trends in Data StrategyCDO Webinar: 2017 Trends in Data Strategy
CDO Webinar: 2017 Trends in Data StrategyDATAVERSITY
3.4K vues18 diapositives
Data Gravity, IoT, and Time Series - ThingMonk 2015 par
Data Gravity, IoT, and Time Series - ThingMonk 2015Data Gravity, IoT, and Time Series - ThingMonk 2015
Data Gravity, IoT, and Time Series - ThingMonk 2015dave.m
27.6K vues60 diapositives
This Isn't 'Big Data.' It's Just Bad Data. par
This Isn't 'Big Data.' It's Just Bad Data.This Isn't 'Big Data.' It's Just Bad Data.
This Isn't 'Big Data.' It's Just Bad Data.Peter Orszag
7.3K vues15 diapositives

En vedette(12)

PROG_UntoldStory ISV eBook_0706c FINAL par SolarWinds MSP
PROG_UntoldStory ISV eBook_0706c FINALPROG_UntoldStory ISV eBook_0706c FINAL
PROG_UntoldStory ISV eBook_0706c FINAL
SolarWinds MSP4.2K vues
Big Data Revolution: Are You Ready for the Data Overload? par Aleah Radovich
Big Data Revolution: Are You Ready for the Data Overload?Big Data Revolution: Are You Ready for the Data Overload?
Big Data Revolution: Are You Ready for the Data Overload?
Aleah Radovich24.2K vues
Data Culture Keynote and Exec Track Birm Dec 8th par Jonathan Woodward
Data Culture Keynote and Exec Track Birm Dec 8thData Culture Keynote and Exec Track Birm Dec 8th
Data Culture Keynote and Exec Track Birm Dec 8th
Jonathan Woodward6.8K vues
CDO Webinar: 2017 Trends in Data Strategy par DATAVERSITY
CDO Webinar: 2017 Trends in Data StrategyCDO Webinar: 2017 Trends in Data Strategy
CDO Webinar: 2017 Trends in Data Strategy
DATAVERSITY3.4K vues
Data Gravity, IoT, and Time Series - ThingMonk 2015 par dave.m
Data Gravity, IoT, and Time Series - ThingMonk 2015Data Gravity, IoT, and Time Series - ThingMonk 2015
Data Gravity, IoT, and Time Series - ThingMonk 2015
dave.m27.6K vues
This Isn't 'Big Data.' It's Just Bad Data. par Peter Orszag
This Isn't 'Big Data.' It's Just Bad Data.This Isn't 'Big Data.' It's Just Bad Data.
This Isn't 'Big Data.' It's Just Bad Data.
Peter Orszag7.3K vues
Data Science, Machine Learning and Neural Networks par BICA Labs
Data Science, Machine Learning and Neural NetworksData Science, Machine Learning and Neural Networks
Data Science, Machine Learning and Neural Networks
BICA Labs9K vues
Introduction to Data Science par Caserta
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
Caserta 6.2K vues
A Statistician's View on Big Data and Data Science (Version 1) par Prof. Dr. Diego Kuonen
A Statistician's View on Big Data and Data Science (Version 1)A Statistician's View on Big Data and Data Science (Version 1)
A Statistician's View on Big Data and Data Science (Version 1)
Myths and Mathemagical Superpowers of Data Scientists par David Pittman
Myths and Mathemagical Superpowers of Data ScientistsMyths and Mathemagical Superpowers of Data Scientists
Myths and Mathemagical Superpowers of Data Scientists
David Pittman96.7K vues
Big Data [sorry] & Data Science: What Does a Data Scientist Do? par Data Science London
Big Data [sorry] & Data Science: What Does a Data Scientist Do?Big Data [sorry] & Data Science: What Does a Data Scientist Do?
Big Data [sorry] & Data Science: What Does a Data Scientist Do?
Data Science London147.9K vues
Working With Big Data par Seth Familian
Working With Big DataWorking With Big Data
Working With Big Data
Seth Familian291.8K vues

Dernier

Inawsidom - Data Journey par
Inawsidom - Data JourneyInawsidom - Data Journey
Inawsidom - Data JourneyPhilipBasford
8 vues38 diapositives
6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf par
6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf
6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf10urkyr34
7 vues259 diapositives
Dr. Ousmane Badiane-2023 ReSAKSS Conference par
Dr. Ousmane Badiane-2023 ReSAKSS ConferenceDr. Ousmane Badiane-2023 ReSAKSS Conference
Dr. Ousmane Badiane-2023 ReSAKSS ConferenceAKADEMIYA2063
5 vues34 diapositives
[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo... par
[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo...[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo...
[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo...DataScienceConferenc1
9 vues77 diapositives
shivam tiwari.pptx par
shivam tiwari.pptxshivam tiwari.pptx
shivam tiwari.pptxAanyaMishra4
7 vues14 diapositives
Best Home Security Systems.pptx par
Best Home Security Systems.pptxBest Home Security Systems.pptx
Best Home Security Systems.pptxmogalang
9 vues16 diapositives

Dernier(20)

6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf par 10urkyr34
6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf
6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf
10urkyr347 vues
Dr. Ousmane Badiane-2023 ReSAKSS Conference par AKADEMIYA2063
Dr. Ousmane Badiane-2023 ReSAKSS ConferenceDr. Ousmane Badiane-2023 ReSAKSS Conference
Dr. Ousmane Badiane-2023 ReSAKSS Conference
AKADEMIYA20635 vues
[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo... par DataScienceConferenc1
[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo...[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo...
[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo...
Best Home Security Systems.pptx par mogalang
Best Home Security Systems.pptxBest Home Security Systems.pptx
Best Home Security Systems.pptx
mogalang9 vues
[DSC Europe 23][AI:CSI] Dragan Pleskonjic - AI Impact on Cybersecurity and P... par DataScienceConferenc1
[DSC Europe 23][AI:CSI]  Dragan Pleskonjic - AI Impact on Cybersecurity and P...[DSC Europe 23][AI:CSI]  Dragan Pleskonjic - AI Impact on Cybersecurity and P...
[DSC Europe 23][AI:CSI] Dragan Pleskonjic - AI Impact on Cybersecurity and P...
DGST Methodology Presentation.pdf par maddierlegum
DGST Methodology Presentation.pdfDGST Methodology Presentation.pdf
DGST Methodology Presentation.pdf
maddierlegum7 vues
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ... par DataScienceConferenc1
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...
OPPOTUS - Malaysians on Malaysia 3Q2023.pdf par Oppotus
OPPOTUS - Malaysians on Malaysia 3Q2023.pdfOPPOTUS - Malaysians on Malaysia 3Q2023.pdf
OPPOTUS - Malaysians on Malaysia 3Q2023.pdf
Oppotus31 vues
4_4_WP_4_06_ND_Model.pptx par d6fmc6kwd4
4_4_WP_4_06_ND_Model.pptx4_4_WP_4_06_ND_Model.pptx
4_4_WP_4_06_ND_Model.pptx
d6fmc6kwd47 vues
Lack of communication among family.pptx par ahmed164023
Lack of communication among family.pptxLack of communication among family.pptx
Lack of communication among family.pptx
ahmed16402315 vues
Games, Queries, and Argumentation Frameworks: Time for a Family Reunion par Bertram Ludäscher
Games, Queries, and Argumentation Frameworks: Time for a Family ReunionGames, Queries, and Argumentation Frameworks: Time for a Family Reunion
Games, Queries, and Argumentation Frameworks: Time for a Family Reunion
Data Journeys Hard Talk workshop final.pptx par info828217
Data Journeys Hard Talk workshop final.pptxData Journeys Hard Talk workshop final.pptx
Data Journeys Hard Talk workshop final.pptx
info82821711 vues
PRIVACY AWRE PERSONAL DATA STORAGE par antony420421
PRIVACY AWRE PERSONAL DATA STORAGEPRIVACY AWRE PERSONAL DATA STORAGE
PRIVACY AWRE PERSONAL DATA STORAGE
antony4204217 vues

10 A/B Testing Mistakes that Make Your Wallet Cry

  • 1. 10 A/B Testing Mistakes That Make Your Wallet Cry ! Don’t Just Measure Conversion Rate! Sequential Testing Is Not A/B Testing. Random Testing. Prioritization of tests. Small website changes give small conversion changes. Calling tests early Don’t surprise your regulars. Pre-plan your tests sample size. Website wide consistency for tests. Segmenting requires a bigger sample size. A B www.convert.com