SlideShare une entreprise Scribd logo
1  sur  25
Télécharger pour lire hors ligne
OPTIMIZELY: A/B
TESTING MADE EASY
Chris Castiglione
@castig
OPTIMIZELY: A/B TESTING MADE EASY


VOCABULARY
OPTIMIZING LANDING PAGES FOR CONVERSION


VOCABULARY
A/B Test

Call to Action (CTA)

Experiment

Control (or “The Original)

Multivariate Test
OPTIMIZELY: A/B TESTING MADE EASY


WHY A/B TESTING?
A/B TEST
HYPOTHESIS #1: LONGER PAGE
HYPOTHESIS #1: LONGER PAGE
HYPOTHESIS #2: PERSON
HYPOTHESIS #3: LONG PAGE + PERSON
HYPOTHESIS #3: LONG PAGE + PERSON
HYPOTHESIS #4: CHANGING PEOPLE
HYPOTHESIS #4: CHANGING PEOPLE
OPTIMIZING LANDING PAGES FOR CONVERSION


CONCLUSION
Page length is an important variable

Big photos of smiling customers work
OPTIMIZELY: A/B TESTING MADE EASY


SETTING UP AN
OPTIMIZELY
EXPERIMENT
OPTIMIZELY: A/B TESTING MADE EASY


IMPLEMENTING THE
PROJECT CODE
Q&A
Q:   What should I test?
WHAT TO TEST
Short page vs. Long Page

Headline Text

Buttons

Form fields
Q:   Is it possible to target
     specific users?
TARGETING
Language

Browser

Visitor Type (new vs. returning)

IP

Referrer

Custom Events
Q:   Can I specify the
     amount of traffic that
     comes to my
     experiment?
SPECIFY THE AMOUNT OF TRAFFIC
OPTIONS -> Traffic Allocation
Q:   What effect does the
     JavaScript project
     code have on page
     performance?
PAGE PERFORMANCE
Around 35-40kb (very small!)

The code run from Optimizely’s CDN

Contenu connexe

Similaire à Optimizely

Ilasi-Engineer-Resume
Ilasi-Engineer-ResumeIlasi-Engineer-Resume
Ilasi-Engineer-Resume
Michael Ilasi
 
Michael D. Rapp Csm, Oshp2
Michael D. Rapp  Csm, Oshp2Michael D. Rapp  Csm, Oshp2
Michael D. Rapp Csm, Oshp2
Michael D. Rapp
 

Similaire à Optimizely (15)

How to Execute and A/B Test Cross-Channel Personalization
How to Execute and A/B Test Cross-Channel PersonalizationHow to Execute and A/B Test Cross-Channel Personalization
How to Execute and A/B Test Cross-Channel Personalization
 
The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...
The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...
The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...
 
8520687 product
8520687 product8520687 product
8520687 product
 
Growth for Early Stage Startups
Growth for Early Stage StartupsGrowth for Early Stage Startups
Growth for Early Stage Startups
 
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
 
Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them
 
Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them
 
Test Cases are dead, long live Checklists!
Test Cases are dead, long live Checklists!Test Cases are dead, long live Checklists!
Test Cases are dead, long live Checklists!
 
Optimizing website conversions through A/B split testing
Optimizing website conversions through A/B split testingOptimizing website conversions through A/B split testing
Optimizing website conversions through A/B split testing
 
A Simple Metric for Designing, Evaluating, and Managing Blue Ocean Projects
A Simple Metric for Designing, Evaluating, and Managing Blue Ocean ProjectsA Simple Metric for Designing, Evaluating, and Managing Blue Ocean Projects
A Simple Metric for Designing, Evaluating, and Managing Blue Ocean Projects
 
Ilasi-Engineer-Resume
Ilasi-Engineer-ResumeIlasi-Engineer-Resume
Ilasi-Engineer-Resume
 
Michael D. Rapp Csm, Oshp2
Michael D. Rapp  Csm, Oshp2Michael D. Rapp  Csm, Oshp2
Michael D. Rapp Csm, Oshp2
 
Improve your content: The What, Why, Where and How about A/B Testing
Improve your content: The What, Why, Where and How about A/B TestingImprove your content: The What, Why, Where and How about A/B Testing
Improve your content: The What, Why, Where and How about A/B Testing
 
[Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management [Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management
 
Transforming Culture Using DevOps Principles by Ashley Hunsberger
Transforming Culture Using DevOps Principles by Ashley HunsbergerTransforming Culture Using DevOps Principles by Ashley Hunsberger
Transforming Culture Using DevOps Principles by Ashley Hunsberger
 

Plus de Chris Castiglione

Food is confusing: Plant vs. Paleo
Food is confusing: Plant vs. Paleo Food is confusing: Plant vs. Paleo
Food is confusing: Plant vs. Paleo
Chris Castiglione
 
Programming For Non-Programmers Social Media Week 2015
Programming For Non-Programmers Social Media Week 2015Programming For Non-Programmers Social Media Week 2015
Programming For Non-Programmers Social Media Week 2015
Chris Castiglione
 

Plus de Chris Castiglione (9)

Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...
Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...
Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...
 
Food is confusing: Plant vs. Paleo
Food is confusing: Plant vs. Paleo Food is confusing: Plant vs. Paleo
Food is confusing: Plant vs. Paleo
 
The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015
The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015
The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015
 
Programming For Non-Programmers Social Media Week 2015
Programming For Non-Programmers Social Media Week 2015Programming For Non-Programmers Social Media Week 2015
Programming For Non-Programmers Social Media Week 2015
 
Programming For Non-Programmers: 2013
Programming For Non-Programmers: 2013Programming For Non-Programmers: 2013
Programming For Non-Programmers: 2013
 
Wordpress
WordpressWordpress
Wordpress
 
Up & Running Web Hosting
Up & Running Web HostingUp & Running Web Hosting
Up & Running Web Hosting
 
PHP vs. Ruby on Rails
PHP vs. Ruby on RailsPHP vs. Ruby on Rails
PHP vs. Ruby on Rails
 
Ids classes-floats
Ids classes-floatsIds classes-floats
Ids classes-floats
 

Dernier

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 

Dernier (20)

Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 

Optimizely