SlideShare a Scribd company logo
1 of 34
Sell More Online:
10 A/B Test Results and Tips to
Improve Conversion Optimisation
Justin Rondeau
Chief Editor & Evangelist
WhichTestWon
@whichtestwon
@jtrondeau
Revenue Revelations – Best practices for the digital economy
Who I am:
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Version
A
Version
B
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Testing = Competitive Advantage
0.0%
20.0%
40.0%
60.0%
80.0%
100.0%
Marketers who run A/B
tests on email campaigns
Marketers who run A/B or
Multivariate tests on web
pages
How Many Marketers Use Tests to Optimize
Response Rates?
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Testing in the Subscription Industry
26%
43%
74%
57%
0% 20% 40% 60% 80% 100%
A/B or multivariate
testing on landing
pages
Price testing for
subscription offers
% Conducted Test % Not Used
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Why Bother Testing?
Most subscription sites are designed by using:
Owner‟s “gut”
Pre-formatted templates
Copying competitors
„Best Practices‟
Not testing.
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Ecommerce Category Page Test
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Winner?
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Results: 44% Lift in Purchases
& 66% Lift in RPV
Brand: Jules.fr
Agency: Altima
Technology: Google Website
Optimizer
Revenue Revelations – Best practices for the digital economy
Overlay Copy Test
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Winner
Results: 108.3% Lift in Double
Opt-In Newsletter Subscribers at
98% Confidence
Brand: Star-Kauf
Agency: QUISMA
Testing Tech: Google Website
Optimizer
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
GWO Users Be Warned!
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
August 1st
Revenue Revelations – Best practices for the digital economy
Benefit Copy Vs. Button Placement
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Winner
Results: 12.7% Increase in
Opened Savings Accounts
Brand: MoneYou
Agency: Online Dialogue
Technology: In-House
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Search Results Test
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Winner
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Results: 49% Lift in Purchases
Brand: fonq.nl
Agency: In-House
Technology: TypeResult
Revenue Revelations – Best practices for the digital economy
Default Content Test
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Winner!
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Results: 17.5% Lift in
Purchases
Brand: KRAS
Agency: Online Dialogue
Technology: In-House
Revenue Revelations – Best practices for the digital economy
Left Navigation vs. None
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
No Winner
Results: No Statistically
Significant Lift
Brand: Design3000
Agency: QUISMA
Technology: Optimizely
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Offer Copy Test
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Winner
Results: 22% Lift in Add to Cart
Clicks
Brand: Haymarket Publishing UK
Agency: House of Kaizen
Testing Tech: Visual Website
Optimizer
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Which Banner Increased Webinar Sign-Ups?
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Surprised?
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Results: 65% Lift in Webinar Sign-
Ups
Brand: Optimeister (Acquired by
QUISMA)
Agency: In-House
Testing Tech: Vertster
Revenue Revelations – Best practices for the digital economy
Multiple vs. Single Offers
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Winner
Results: 81% Lift in Subscription
Sales
Brand: Sanoma Media
Agency: Kwantic
Testing Tech: Adobe Test & Target
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
How do Testimonials Impact Sales?
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Winner
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Results: 34% Lift in Sales
Brand: WikiJobs
Agency: In-House
Testing Tech: Visual Website
Optimizer
Revenue Revelations – Best practices for the digital economy
2 Bonus Test Examples
•Email
•Mobile
Revenue Revelations – Best practices for the digital economy
Email Blast Template Test
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Winner
Results: 39% Lift in New Newspaper
Subscriptions
Brand: WirtschaftsBlatt.at
Agency: e-dialog
Testing Tech: Proprietary Email
Solution & Unbounce for the
Landing Page
Revenue Revelations – Best practices for the digital economy
MVT Homepage Device Test
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Revenue Revelations – Best practices for the digital economy
Button Imagery Matters
Results: 9.23% Lift in Online
Registrations
Brand: Direct Line Germany
Agency: Maxymiser
Technology: MaxMOBILE
Revenue Revelations – Best practices for the digital economy
Try Subscription Site Insider - 10 Days for $1
©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Sign up for 10 Days of
Complete Access to
Subscription Site Insider for
Less than a Euro!
http://www.subscriptionsite
insider.com/privateoffer/
Questions?
Email us:
webinar@vindicia.com
Visit us:
Blog: blog.vindicia.com
Community: community.vindicia.com
Twitter: @Vindicia
Website: www.vindicia.com

More Related Content

Viewers also liked

C:\Documents And Settings\Administrador\Escritorio\Te Kiero
C:\Documents And Settings\Administrador\Escritorio\Te KieroC:\Documents And Settings\Administrador\Escritorio\Te Kiero
C:\Documents And Settings\Administrador\Escritorio\Te KieroErick Od
 
Ullama e yaman ka fatwa salman taseer and mumtaz qadri
Ullama e yaman ka fatwa salman taseer and mumtaz qadriUllama e yaman ka fatwa salman taseer and mumtaz qadri
Ullama e yaman ka fatwa salman taseer and mumtaz qadriMuhammad Tariq
 
Spanu Mommyblogging Bocconi 03122008
Spanu Mommyblogging Bocconi 03122008Spanu Mommyblogging Bocconi 03122008
Spanu Mommyblogging Bocconi 03122008ASKinfomamme
 
Mat 1105 biseccion
Mat 1105 biseccionMat 1105 biseccion
Mat 1105 biseccionMarco Choque
 
Stručni članak Upravljanje projektnim rizicima
Stručni članak Upravljanje projektnim rizicimaStručni članak Upravljanje projektnim rizicima
Stručni članak Upravljanje projektnim rizicimagabrijelavarga
 
Prot. 2414 15 pl 044-2015 - cria o sítio histórico da prainha de vila velha
Prot. 2414 15   pl 044-2015 - cria o sítio histórico da prainha de vila velhaProt. 2414 15   pl 044-2015 - cria o sítio histórico da prainha de vila velha
Prot. 2414 15 pl 044-2015 - cria o sítio histórico da prainha de vila velhaClaudio Figueiredo
 
Projeto de relacionamento Convocados - Braskem
Projeto de relacionamento Convocados - BraskemProjeto de relacionamento Convocados - Braskem
Projeto de relacionamento Convocados - BraskemThatiana Lima
 
Ciências naturais – meio ambiente
Ciências naturais – meio ambienteCiências naturais – meio ambiente
Ciências naturais – meio ambientemariaisabelmoraes
 
What Does The Future Hold For ECM?
What Does The Future Hold For ECM?What Does The Future Hold For ECM?
What Does The Future Hold For ECM?Russ Stalters
 
La navigazione di profondità - V2
La navigazione di profondità - V2La navigazione di profondità - V2
La navigazione di profondità - V2guam7
 
Format Nova Powerpoint Presentatie
Format Nova Powerpoint PresentatieFormat Nova Powerpoint Presentatie
Format Nova Powerpoint Presentatiejostyl
 
1 ensayo contabilidad_de_costos_iibim_ejercicio_1(1)
1 ensayo contabilidad_de_costos_iibim_ejercicio_1(1)1 ensayo contabilidad_de_costos_iibim_ejercicio_1(1)
1 ensayo contabilidad_de_costos_iibim_ejercicio_1(1)Silvia Cedeño
 

Viewers also liked (17)

C:\Documents And Settings\Administrador\Escritorio\Te Kiero
C:\Documents And Settings\Administrador\Escritorio\Te KieroC:\Documents And Settings\Administrador\Escritorio\Te Kiero
C:\Documents And Settings\Administrador\Escritorio\Te Kiero
 
Ullama e yaman ka fatwa salman taseer and mumtaz qadri
Ullama e yaman ka fatwa salman taseer and mumtaz qadriUllama e yaman ka fatwa salman taseer and mumtaz qadri
Ullama e yaman ka fatwa salman taseer and mumtaz qadri
 
Ataque Cardiaco
Ataque CardiacoAtaque Cardiaco
Ataque Cardiaco
 
Spanu Mommyblogging Bocconi 03122008
Spanu Mommyblogging Bocconi 03122008Spanu Mommyblogging Bocconi 03122008
Spanu Mommyblogging Bocconi 03122008
 
Company Profile Pg
Company Profile PgCompany Profile Pg
Company Profile Pg
 
Tc 100 H
Tc 100 HTc 100 H
Tc 100 H
 
Obesidade
ObesidadeObesidade
Obesidade
 
Mat 1105 biseccion
Mat 1105 biseccionMat 1105 biseccion
Mat 1105 biseccion
 
Stručni članak Upravljanje projektnim rizicima
Stručni članak Upravljanje projektnim rizicimaStručni članak Upravljanje projektnim rizicima
Stručni članak Upravljanje projektnim rizicima
 
Prot. 2414 15 pl 044-2015 - cria o sítio histórico da prainha de vila velha
Prot. 2414 15   pl 044-2015 - cria o sítio histórico da prainha de vila velhaProt. 2414 15   pl 044-2015 - cria o sítio histórico da prainha de vila velha
Prot. 2414 15 pl 044-2015 - cria o sítio histórico da prainha de vila velha
 
Projeto de relacionamento Convocados - Braskem
Projeto de relacionamento Convocados - BraskemProjeto de relacionamento Convocados - Braskem
Projeto de relacionamento Convocados - Braskem
 
Ciências naturais – meio ambiente
Ciências naturais – meio ambienteCiências naturais – meio ambiente
Ciências naturais – meio ambiente
 
What Does The Future Hold For ECM?
What Does The Future Hold For ECM?What Does The Future Hold For ECM?
What Does The Future Hold For ECM?
 
La navigazione di profondità - V2
La navigazione di profondità - V2La navigazione di profondità - V2
La navigazione di profondità - V2
 
Format Nova Powerpoint Presentatie
Format Nova Powerpoint PresentatieFormat Nova Powerpoint Presentatie
Format Nova Powerpoint Presentatie
 
1 ensayo contabilidad_de_costos_iibim_ejercicio_1(1)
1 ensayo contabilidad_de_costos_iibim_ejercicio_1(1)1 ensayo contabilidad_de_costos_iibim_ejercicio_1(1)
1 ensayo contabilidad_de_costos_iibim_ejercicio_1(1)
 
Currículo
CurrículoCurrículo
Currículo
 

More from Vindicia

Reaching Consumers Beyond Subscription Billing
Reaching Consumers Beyond Subscription BillingReaching Consumers Beyond Subscription Billing
Reaching Consumers Beyond Subscription BillingVindicia
 
How To Improve Customer Acquisition | Vindicia
How To Improve Customer Acquisition | VindiciaHow To Improve Customer Acquisition | Vindicia
How To Improve Customer Acquisition | VindiciaVindicia
 
What to Consider When Looking for a Subscription Billing Solution
What to Consider When Looking for a Subscription Billing SolutionWhat to Consider When Looking for a Subscription Billing Solution
What to Consider When Looking for a Subscription Billing SolutionVindicia
 
5 Steps to Improve Subscription Customer Retention
5 Steps to Improve Subscription Customer Retention5 Steps to Improve Subscription Customer Retention
5 Steps to Improve Subscription Customer RetentionVindicia
 
Vindicia and Ooyala for OTT Content Opportunities
Vindicia and Ooyala for OTT Content OpportunitiesVindicia and Ooyala for OTT Content Opportunities
Vindicia and Ooyala for OTT Content OpportunitiesVindicia
 
Will OTT providers capitalize on syndicated shows? - Vindicia
Will OTT providers capitalize on syndicated shows? - VindiciaWill OTT providers capitalize on syndicated shows? - Vindicia
Will OTT providers capitalize on syndicated shows? - VindiciaVindicia
 
Vindicia Webinar | What's new in CashBox
Vindicia Webinar | What's new in CashBoxVindicia Webinar | What's new in CashBox
Vindicia Webinar | What's new in CashBoxVindicia
 
Think Global, Act Local: Global Payments Strategies for Digital Businesses
Think Global, Act Local: Global Payments Strategies for Digital BusinessesThink Global, Act Local: Global Payments Strategies for Digital Businesses
Think Global, Act Local: Global Payments Strategies for Digital BusinessesVindicia
 
Pricing Innovation for the Digital Economy: Yield Management and Targeted Pri...
Pricing Innovation for the Digital Economy: Yield Management and Targeted Pri...Pricing Innovation for the Digital Economy: Yield Management and Targeted Pri...
Pricing Innovation for the Digital Economy: Yield Management and Targeted Pri...Vindicia
 
Defining Flexible Payments and their Value
Defining Flexible Payments and their ValueDefining Flexible Payments and their Value
Defining Flexible Payments and their ValueVindicia
 

More from Vindicia (10)

Reaching Consumers Beyond Subscription Billing
Reaching Consumers Beyond Subscription BillingReaching Consumers Beyond Subscription Billing
Reaching Consumers Beyond Subscription Billing
 
How To Improve Customer Acquisition | Vindicia
How To Improve Customer Acquisition | VindiciaHow To Improve Customer Acquisition | Vindicia
How To Improve Customer Acquisition | Vindicia
 
What to Consider When Looking for a Subscription Billing Solution
What to Consider When Looking for a Subscription Billing SolutionWhat to Consider When Looking for a Subscription Billing Solution
What to Consider When Looking for a Subscription Billing Solution
 
5 Steps to Improve Subscription Customer Retention
5 Steps to Improve Subscription Customer Retention5 Steps to Improve Subscription Customer Retention
5 Steps to Improve Subscription Customer Retention
 
Vindicia and Ooyala for OTT Content Opportunities
Vindicia and Ooyala for OTT Content OpportunitiesVindicia and Ooyala for OTT Content Opportunities
Vindicia and Ooyala for OTT Content Opportunities
 
Will OTT providers capitalize on syndicated shows? - Vindicia
Will OTT providers capitalize on syndicated shows? - VindiciaWill OTT providers capitalize on syndicated shows? - Vindicia
Will OTT providers capitalize on syndicated shows? - Vindicia
 
Vindicia Webinar | What's new in CashBox
Vindicia Webinar | What's new in CashBoxVindicia Webinar | What's new in CashBox
Vindicia Webinar | What's new in CashBox
 
Think Global, Act Local: Global Payments Strategies for Digital Businesses
Think Global, Act Local: Global Payments Strategies for Digital BusinessesThink Global, Act Local: Global Payments Strategies for Digital Businesses
Think Global, Act Local: Global Payments Strategies for Digital Businesses
 
Pricing Innovation for the Digital Economy: Yield Management and Targeted Pri...
Pricing Innovation for the Digital Economy: Yield Management and Targeted Pri...Pricing Innovation for the Digital Economy: Yield Management and Targeted Pri...
Pricing Innovation for the Digital Economy: Yield Management and Targeted Pri...
 
Defining Flexible Payments and their Value
Defining Flexible Payments and their ValueDefining Flexible Payments and their Value
Defining Flexible Payments and their Value
 

Recently uploaded

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 

Recently uploaded (20)

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 

Sell More Online: 10 A/B Test Results and Tips to Improve Conversion Optimisation

  • 1. Sell More Online: 10 A/B Test Results and Tips to Improve Conversion Optimisation Justin Rondeau Chief Editor & Evangelist WhichTestWon @whichtestwon @jtrondeau
  • 2. Revenue Revelations – Best practices for the digital economy Who I am: ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 3. Revenue Revelations – Best practices for the digital economy Version A Version B ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 4. Revenue Revelations – Best practices for the digital economy Testing = Competitive Advantage 0.0% 20.0% 40.0% 60.0% 80.0% 100.0% Marketers who run A/B tests on email campaigns Marketers who run A/B or Multivariate tests on web pages How Many Marketers Use Tests to Optimize Response Rates? ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 5. Revenue Revelations – Best practices for the digital economy Testing in the Subscription Industry 26% 43% 74% 57% 0% 20% 40% 60% 80% 100% A/B or multivariate testing on landing pages Price testing for subscription offers % Conducted Test % Not Used ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 6. Revenue Revelations – Best practices for the digital economy Why Bother Testing? Most subscription sites are designed by using: Owner‟s “gut” Pre-formatted templates Copying competitors „Best Practices‟ Not testing. ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 7. Revenue Revelations – Best practices for the digital economy Ecommerce Category Page Test ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 8. Revenue Revelations – Best practices for the digital economy Winner? ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Results: 44% Lift in Purchases & 66% Lift in RPV Brand: Jules.fr Agency: Altima Technology: Google Website Optimizer
  • 9. Revenue Revelations – Best practices for the digital economy Overlay Copy Test ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 10. Revenue Revelations – Best practices for the digital economy Winner Results: 108.3% Lift in Double Opt-In Newsletter Subscribers at 98% Confidence Brand: Star-Kauf Agency: QUISMA Testing Tech: Google Website Optimizer ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 11. Revenue Revelations – Best practices for the digital economy GWO Users Be Warned! ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. August 1st
  • 12. Revenue Revelations – Best practices for the digital economy Benefit Copy Vs. Button Placement ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 13. Revenue Revelations – Best practices for the digital economy Winner Results: 12.7% Increase in Opened Savings Accounts Brand: MoneYou Agency: Online Dialogue Technology: In-House ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 14. Revenue Revelations – Best practices for the digital economy Search Results Test ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 15. Revenue Revelations – Best practices for the digital economy Winner ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Results: 49% Lift in Purchases Brand: fonq.nl Agency: In-House Technology: TypeResult
  • 16. Revenue Revelations – Best practices for the digital economy Default Content Test ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 17. Revenue Revelations – Best practices for the digital economy Winner! ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Results: 17.5% Lift in Purchases Brand: KRAS Agency: Online Dialogue Technology: In-House
  • 18. Revenue Revelations – Best practices for the digital economy Left Navigation vs. None ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 19. Revenue Revelations – Best practices for the digital economy No Winner Results: No Statistically Significant Lift Brand: Design3000 Agency: QUISMA Technology: Optimizely ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 20. Revenue Revelations – Best practices for the digital economy Offer Copy Test ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 21. Revenue Revelations – Best practices for the digital economy Winner Results: 22% Lift in Add to Cart Clicks Brand: Haymarket Publishing UK Agency: House of Kaizen Testing Tech: Visual Website Optimizer ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 22. Revenue Revelations – Best practices for the digital economy Which Banner Increased Webinar Sign-Ups? ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 23. Revenue Revelations – Best practices for the digital economy Surprised? ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Results: 65% Lift in Webinar Sign- Ups Brand: Optimeister (Acquired by QUISMA) Agency: In-House Testing Tech: Vertster
  • 24. Revenue Revelations – Best practices for the digital economy Multiple vs. Single Offers ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 25. Revenue Revelations – Best practices for the digital economy Winner Results: 81% Lift in Subscription Sales Brand: Sanoma Media Agency: Kwantic Testing Tech: Adobe Test & Target ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 26. Revenue Revelations – Best practices for the digital economy How do Testimonials Impact Sales? ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 27. Revenue Revelations – Best practices for the digital economy Winner ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Results: 34% Lift in Sales Brand: WikiJobs Agency: In-House Testing Tech: Visual Website Optimizer
  • 28. Revenue Revelations – Best practices for the digital economy 2 Bonus Test Examples •Email •Mobile
  • 29. Revenue Revelations – Best practices for the digital economy Email Blast Template Test ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 30. Revenue Revelations – Best practices for the digital economy Winner Results: 39% Lift in New Newspaper Subscriptions Brand: WirtschaftsBlatt.at Agency: e-dialog Testing Tech: Proprietary Email Solution & Unbounce for the Landing Page
  • 31. Revenue Revelations – Best practices for the digital economy MVT Homepage Device Test ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
  • 32. Revenue Revelations – Best practices for the digital economy Button Imagery Matters Results: 9.23% Lift in Online Registrations Brand: Direct Line Germany Agency: Maxymiser Technology: MaxMOBILE
  • 33. Revenue Revelations – Best practices for the digital economy Try Subscription Site Insider - 10 Days for $1 ©2012, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Sign up for 10 Days of Complete Access to Subscription Site Insider for Less than a Euro! http://www.subscriptionsite insider.com/privateoffer/
  • 34. Questions? Email us: webinar@vindicia.com Visit us: Blog: blog.vindicia.com Community: community.vindicia.com Twitter: @Vindicia Website: www.vindicia.com

Editor's Notes

  1. https://whichtestwon.com/grasshopper-test
  2. Free Town Offer Helped. Got users to fill out a ‘non-required’ registration form after they installed the game. A/B test on The Sims 3 game launcher page. All versions were designed to fit a screen at 600×800 resolution so that no buttons appeared below the fold. The test ran until it hit 99.9% conclusiveness.
  3. itors came from a combination of direct traffic, PPC traffic, and affiliate-driven traffic. All PPC ad offers matched the offer on the page. The splash page was the first page they saw.
  4. Possible Lesson – Simplicity is king. The other wording, though friendly and personal, was too much.
  5. 95% Confidence, same CTA ‘Calculate Your Quote’ Total Change 9.63% lift…so the button had the biggest impact