SlideShare une entreprise Scribd logo
1  sur  25
Télécharger pour lire hors ligne
OPTIMIZELY: A/B
TESTING MADE EASY
Chris Castiglione
@castig
OPTIMIZELY: A/B TESTING MADE EASY


VOCABULARY
OPTIMIZING LANDING PAGES FOR CONVERSION


VOCABULARY
A/B Test

Call to Action (CTA)

Experiment

Control (or “The Original)

Multivariate Test
OPTIMIZELY: A/B TESTING MADE EASY


WHY A/B TESTING?
A/B TEST
HYPOTHESIS #1: LONGER PAGE
HYPOTHESIS #1: LONGER PAGE
HYPOTHESIS #2: PERSON
HYPOTHESIS #3: LONG PAGE + PERSON
HYPOTHESIS #3: LONG PAGE + PERSON
HYPOTHESIS #4: CHANGING PEOPLE
HYPOTHESIS #4: CHANGING PEOPLE
OPTIMIZING LANDING PAGES FOR CONVERSION


CONCLUSION
Page length is an important variable

Big photos of smiling customers work
OPTIMIZELY: A/B TESTING MADE EASY


SETTING UP AN
OPTIMIZELY
EXPERIMENT
OPTIMIZELY: A/B TESTING MADE EASY


IMPLEMENTING THE
PROJECT CODE
Q&A
Q:   What should I test?
WHAT TO TEST
Short page vs. Long Page

Headline Text

Buttons

Form fields
Q:   Is it possible to target
     specific users?
TARGETING
Language

Browser

Visitor Type (new vs. returning)

IP

Referrer

Custom Events
Q:   Can I specify the
     amount of traffic that
     comes to my
     experiment?
SPECIFY THE AMOUNT OF TRAFFIC
OPTIONS -> Traffic Allocation
Q:   What effect does the
     JavaScript project
     code have on page
     performance?
PAGE PERFORMANCE
Around 35-40kb (very small!)

The code run from Optimizely’s CDN

Contenu connexe

Similaire à A/B Testing Made Easy with Optimizely

How to Execute and A/B Test Cross-Channel Personalization
How to Execute and A/B Test Cross-Channel PersonalizationHow to Execute and A/B Test Cross-Channel Personalization
How to Execute and A/B Test Cross-Channel PersonalizationCXL
 
The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...
The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...
The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...Manuel Da Costa
 
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...Optimizely
 
Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Optimizely
 
Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Optimizely
 
Test Cases are dead, long live Checklists!
Test Cases are dead, long live Checklists!Test Cases are dead, long live Checklists!
Test Cases are dead, long live Checklists!SQALab
 
Optimizing website conversions through A/B split testing
Optimizing website conversions through A/B split testingOptimizing website conversions through A/B split testing
Optimizing website conversions through A/B split testingJavid Jamae
 
A Simple Metric for Designing, Evaluating, and Managing Blue Ocean Projects
A Simple Metric for Designing, Evaluating, and Managing Blue Ocean ProjectsA Simple Metric for Designing, Evaluating, and Managing Blue Ocean Projects
A Simple Metric for Designing, Evaluating, and Managing Blue Ocean ProjectsRod King, Ph.D.
 
Ilasi-Engineer-Resume
Ilasi-Engineer-ResumeIlasi-Engineer-Resume
Ilasi-Engineer-ResumeMichael Ilasi
 
Michael D. Rapp Csm, Oshp2
Michael D. Rapp  Csm, Oshp2Michael D. Rapp  Csm, Oshp2
Michael D. Rapp Csm, Oshp2Michael D. Rapp
 
A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...
A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...
A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...Internet Marketing Software - WordStream
 
Improve your content: The What, Why, Where and How about A/B Testing
Improve your content: The What, Why, Where and How about A/B TestingImprove your content: The What, Why, Where and How about A/B Testing
Improve your content: The What, Why, Where and How about A/B Testingintrotodigital
 
[Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management [Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management Optimizely
 
Transforming Culture Using DevOps Principles by Ashley Hunsberger
Transforming Culture Using DevOps Principles by Ashley HunsbergerTransforming Culture Using DevOps Principles by Ashley Hunsberger
Transforming Culture Using DevOps Principles by Ashley HunsbergerSauce Labs
 

Similaire à A/B Testing Made Easy with Optimizely (16)

How to Execute and A/B Test Cross-Channel Personalization
How to Execute and A/B Test Cross-Channel PersonalizationHow to Execute and A/B Test Cross-Channel Personalization
How to Execute and A/B Test Cross-Channel Personalization
 
The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...
The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...
The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...
 
8520687 product
8520687 product8520687 product
8520687 product
 
Growth for Early Stage Startups
Growth for Early Stage StartupsGrowth for Early Stage Startups
Growth for Early Stage Startups
 
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
 
Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them
 
Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them
 
Test Cases are dead, long live Checklists!
Test Cases are dead, long live Checklists!Test Cases are dead, long live Checklists!
Test Cases are dead, long live Checklists!
 
Optimizing website conversions through A/B split testing
Optimizing website conversions through A/B split testingOptimizing website conversions through A/B split testing
Optimizing website conversions through A/B split testing
 
A Simple Metric for Designing, Evaluating, and Managing Blue Ocean Projects
A Simple Metric for Designing, Evaluating, and Managing Blue Ocean ProjectsA Simple Metric for Designing, Evaluating, and Managing Blue Ocean Projects
A Simple Metric for Designing, Evaluating, and Managing Blue Ocean Projects
 
Ilasi-Engineer-Resume
Ilasi-Engineer-ResumeIlasi-Engineer-Resume
Ilasi-Engineer-Resume
 
Michael D. Rapp Csm, Oshp2
Michael D. Rapp  Csm, Oshp2Michael D. Rapp  Csm, Oshp2
Michael D. Rapp Csm, Oshp2
 
A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...
A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...
A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...
 
Improve your content: The What, Why, Where and How about A/B Testing
Improve your content: The What, Why, Where and How about A/B TestingImprove your content: The What, Why, Where and How about A/B Testing
Improve your content: The What, Why, Where and How about A/B Testing
 
[Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management [Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management
 
Transforming Culture Using DevOps Principles by Ashley Hunsberger
Transforming Culture Using DevOps Principles by Ashley HunsbergerTransforming Culture Using DevOps Principles by Ashley Hunsberger
Transforming Culture Using DevOps Principles by Ashley Hunsberger
 

Plus de Chris Castiglione

Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...
Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...
Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...Chris Castiglione
 
Food is confusing: Plant vs. Paleo
Food is confusing: Plant vs. Paleo Food is confusing: Plant vs. Paleo
Food is confusing: Plant vs. Paleo Chris Castiglione
 
The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015
The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015
The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015Chris Castiglione
 
Programming For Non-Programmers Social Media Week 2015
Programming For Non-Programmers Social Media Week 2015Programming For Non-Programmers Social Media Week 2015
Programming For Non-Programmers Social Media Week 2015Chris Castiglione
 
Programming For Non-Programmers: 2013
Programming For Non-Programmers: 2013Programming For Non-Programmers: 2013
Programming For Non-Programmers: 2013Chris Castiglione
 

Plus de Chris Castiglione (9)

Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...
Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...
Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...
 
Food is confusing: Plant vs. Paleo
Food is confusing: Plant vs. Paleo Food is confusing: Plant vs. Paleo
Food is confusing: Plant vs. Paleo
 
The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015
The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015
The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015
 
Programming For Non-Programmers Social Media Week 2015
Programming For Non-Programmers Social Media Week 2015Programming For Non-Programmers Social Media Week 2015
Programming For Non-Programmers Social Media Week 2015
 
Programming For Non-Programmers: 2013
Programming For Non-Programmers: 2013Programming For Non-Programmers: 2013
Programming For Non-Programmers: 2013
 
Wordpress
WordpressWordpress
Wordpress
 
Up & Running Web Hosting
Up & Running Web HostingUp & Running Web Hosting
Up & Running Web Hosting
 
PHP vs. Ruby on Rails
PHP vs. Ruby on RailsPHP vs. Ruby on Rails
PHP vs. Ruby on Rails
 
Ids classes-floats
Ids classes-floatsIds classes-floats
Ids classes-floats
 

Dernier

Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?XfilesPro
 

Dernier (20)

Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?
 

A/B Testing Made Easy with Optimizely