SlideShare une entreprise Scribd logo
1  sur  30
Télécharger pour lire hors ligne
How to Leverage Experimentation
as a Growth Strategy
A conversation with The Motley Fool
Before we get started:
● Presentation slides and recording
will be available to you
● Use the Q&A panel to ask questions
or make comments - these will be
answered during the Q&A segment
at the end of the panel
Today’s panelists:
● Leads US Marketing operations and
optimization at The Motley Fool
● Works with Marketing, Tech, Editorial
and Product teams to scale testing
● Prior, Nate drove testing strategy for the
user acquisition team
James Flory
Experimentation Strategist
WiderFunnel
● Experimentation Strategist partnered
with companies like Intercom, Direct
Energy, and Providence Healthcare
● Expertise in behavioral psychology and
personalization
Nate Wallingsford
Head of US Marketing
Operations & Optimization
The Motley Fool
Q: How does “experimentation” fit
into your role at The Motley Fool?
Q: You described your initial tests as
“good idea tests”—why did you start
looking for an alternative method?
Q: How did the first experiment we
ran together differ from these good
idea tests?
+7.90%
+11.62%
+11.62%
Variation A
Variation B
Variation C
Variation D
+0.2%
-3.0%
-18.5%
-12.2%
Q: How do you respond to losing tests?
What has been the team and the
organization’s response to this side of
experimentation?
Variation B
Variation CVariation D
+23%+19.1%
Variation B
Variation A Variation B Variation C
+9.15%+14.45%
+8.88%
Q: Many testing teams focus on fixing
usability problems but understanding
your customers is crucial to providing an
ideal customer experience. How should
Optimizers balance the two?
The Two Sides of Optimization
The BJ Fogg Model describes behavioural
change as a function of two factors,
motivation and ability.
In optimization, both of these factors
play a pivotal role in developing good
hypotheses either together or apart.
-11.2%
+0.41%
-6.05%
Q: What does “experimentation at scale”
mean to you? How are you working to
scale experimentation at The Motley
Fool?
Q: How do you transfer and leverage
insights across multiple teams at The
Motley Fool?
Q: What does your technology stack for
experimentation look like?
Q: What are you most proud of when
you think about the experimentation
program at The Motley Fool?
Q: What does the future of
experimentation look like at The Motley
Fool?
Q&A
Looking to implement or scale an
experimentation program at your organization?
Send us an email to find out if you qualify for our
services!
Email: iwant@widerfunnel.com
Thank you!

Contenu connexe

Tendances

Optimizely Experience Customer Story - Atlassian
Optimizely Experience Customer Story - AtlassianOptimizely Experience Customer Story - Atlassian
Optimizely Experience Customer Story - AtlassianOptimizely
 
Product Experimentation | Forming Strong Experiment Hypotheses
Product Experimentation | Forming Strong Experiment HypothesesProduct Experimentation | Forming Strong Experiment Hypotheses
Product Experimentation | Forming Strong Experiment HypothesesOptimizely
 
Optimizing Your B2B Demand Generation Machine
Optimizing Your B2B Demand Generation MachineOptimizing Your B2B Demand Generation Machine
Optimizing Your B2B Demand Generation MachineOptimizely
 
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...Optimizely
 
UX Analytics and Experimentation for eCommerce Growth
UX Analytics and Experimentation for eCommerce GrowthUX Analytics and Experimentation for eCommerce Growth
UX Analytics and Experimentation for eCommerce GrowthVWO
 
Losing is the New Winning
Losing is the New WinningLosing is the New Winning
Losing is the New WinningOptimizely
 
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...Optimizely
 
Optimizely's Optimization Benchmark Findings Webinar Slides
Optimizely's Optimization Benchmark Findings Webinar SlidesOptimizely's Optimization Benchmark Findings Webinar Slides
Optimizely's Optimization Benchmark Findings Webinar SlidesOptimizely
 
How Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into ConsumersHow Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into ConsumersOptimizely
 
Maximizing Optimizely Website Performance
Maximizing Optimizely Website PerformanceMaximizing Optimizely Website Performance
Maximizing Optimizely Website PerformanceOptimizely
 
VWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation RoadmapVWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation RoadmapVWO
 
Measure Your Way To Maturity
Measure Your Way To MaturityMeasure Your Way To Maturity
Measure Your Way To MaturityOptimizely
 
Art of Conducting Visitor Research
Art of Conducting Visitor ResearchArt of Conducting Visitor Research
Art of Conducting Visitor ResearchVWO
 
Testing Your Testing Program
Testing Your Testing ProgramTesting Your Testing Program
Testing Your Testing ProgramJill Martay
 
WAW Houston presentation- Sunny Taj
WAW Houston presentation- Sunny TajWAW Houston presentation- Sunny Taj
WAW Houston presentation- Sunny TajKashif Khurshid
 
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...Optimizely
 
Are You Ready To Move Towards Conversion Optimization?
Are You Ready To Move Towards Conversion Optimization?Are You Ready To Move Towards Conversion Optimization?
Are You Ready To Move Towards Conversion Optimization?VWO
 
How To Build a Winning Conversion Optimization Strategy
How To Build a Winning Conversion Optimization StrategyHow To Build a Winning Conversion Optimization Strategy
How To Build a Winning Conversion Optimization StrategyVWO
 
Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough Optimizely
 

Tendances (20)

Optimizely Experience Customer Story - Atlassian
Optimizely Experience Customer Story - AtlassianOptimizely Experience Customer Story - Atlassian
Optimizely Experience Customer Story - Atlassian
 
Product Experimentation | Forming Strong Experiment Hypotheses
Product Experimentation | Forming Strong Experiment HypothesesProduct Experimentation | Forming Strong Experiment Hypotheses
Product Experimentation | Forming Strong Experiment Hypotheses
 
Optimizing Your B2B Demand Generation Machine
Optimizing Your B2B Demand Generation MachineOptimizing Your B2B Demand Generation Machine
Optimizing Your B2B Demand Generation Machine
 
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
 
UX Analytics and Experimentation for eCommerce Growth
UX Analytics and Experimentation for eCommerce GrowthUX Analytics and Experimentation for eCommerce Growth
UX Analytics and Experimentation for eCommerce Growth
 
Magento Meetup New Delhi- AB Testing
Magento Meetup New Delhi- AB TestingMagento Meetup New Delhi- AB Testing
Magento Meetup New Delhi- AB Testing
 
Losing is the New Winning
Losing is the New WinningLosing is the New Winning
Losing is the New Winning
 
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
 
Optimizely's Optimization Benchmark Findings Webinar Slides
Optimizely's Optimization Benchmark Findings Webinar SlidesOptimizely's Optimization Benchmark Findings Webinar Slides
Optimizely's Optimization Benchmark Findings Webinar Slides
 
How Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into ConsumersHow Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into Consumers
 
Maximizing Optimizely Website Performance
Maximizing Optimizely Website PerformanceMaximizing Optimizely Website Performance
Maximizing Optimizely Website Performance
 
VWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation RoadmapVWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation Roadmap
 
Measure Your Way To Maturity
Measure Your Way To MaturityMeasure Your Way To Maturity
Measure Your Way To Maturity
 
Art of Conducting Visitor Research
Art of Conducting Visitor ResearchArt of Conducting Visitor Research
Art of Conducting Visitor Research
 
Testing Your Testing Program
Testing Your Testing ProgramTesting Your Testing Program
Testing Your Testing Program
 
WAW Houston presentation- Sunny Taj
WAW Houston presentation- Sunny TajWAW Houston presentation- Sunny Taj
WAW Houston presentation- Sunny Taj
 
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
 
Are You Ready To Move Towards Conversion Optimization?
Are You Ready To Move Towards Conversion Optimization?Are You Ready To Move Towards Conversion Optimization?
Are You Ready To Move Towards Conversion Optimization?
 
How To Build a Winning Conversion Optimization Strategy
How To Build a Winning Conversion Optimization StrategyHow To Build a Winning Conversion Optimization Strategy
How To Build a Winning Conversion Optimization Strategy
 
Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough
 

Similaire à Experimentation as a growth strategy: A conversation with The Motley Fool

__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...
__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...
__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...JunniferParaiso1
 
Why We Test - Rethinking Your Approach
Why We Test - Rethinking Your ApproachWhy We Test - Rethinking Your Approach
Why We Test - Rethinking Your Approachaudreybloemer
 
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMHow to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMProduct School
 
Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010
Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010
Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010TEST Huddle
 
How to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO programHow to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO programVWO
 
Growth Hacking - High Tempo Testing
Growth Hacking - High Tempo TestingGrowth Hacking - High Tempo Testing
Growth Hacking - High Tempo TestingTomek Duda
 
How to Master Product Management Case Studies by fmr Groupon PM
How to Master Product Management Case Studies by fmr Groupon PMHow to Master Product Management Case Studies by fmr Groupon PM
How to Master Product Management Case Studies by fmr Groupon PMProduct School
 
uShip - Building a Culture Rooted in Experimentation
uShip - Building a Culture Rooted in ExperimentationuShip - Building a Culture Rooted in Experimentation
uShip - Building a Culture Rooted in ExperimentationOptimizely
 
Conversion Conference 2011 NYC presentation
Conversion Conference 2011 NYC presentationConversion Conference 2011 NYC presentation
Conversion Conference 2011 NYC presentationBrian Jones
 
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8Optimizely
 
Trade up from cube to corner office - OpenText TeamSite Optimost
Trade up from cube to corner office - OpenText TeamSite OptimostTrade up from cube to corner office - OpenText TeamSite Optimost
Trade up from cube to corner office - OpenText TeamSite Optimostsuparupaa
 
Trade up from cube to corner office - OpenText Optimost
Trade up from cube to corner office - OpenText OptimostTrade up from cube to corner office - OpenText Optimost
Trade up from cube to corner office - OpenText OptimostOpenText
 
Agile Marketing Methodology PowerPoint Presentation Slides
Agile Marketing Methodology PowerPoint Presentation SlidesAgile Marketing Methodology PowerPoint Presentation Slides
Agile Marketing Methodology PowerPoint Presentation SlidesSlideTeam
 
Why the first 2 stages of Design thinking are important for a startup?
Why the first 2 stages of Design thinking are important for a startup?Why the first 2 stages of Design thinking are important for a startup?
Why the first 2 stages of Design thinking are important for a startup?Anuradha Sridharan
 
DRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKES
DRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKESDRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKES
DRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKESHuman Capital Media
 
Conducting the Experimentation Orchestra
Conducting the Experimentation OrchestraConducting the Experimentation Orchestra
Conducting the Experimentation OrchestraOptimizely
 
DV 2016: Building a Culture of Testing and Optimization
DV 2016: Building a Culture of Testing and OptimizationDV 2016: Building a Culture of Testing and Optimization
DV 2016: Building a Culture of Testing and OptimizationTealium
 
How to Keep Up Your Creative Testing After Budget Cuts
How to Keep Up Your Creative Testing After Budget CutsHow to Keep Up Your Creative Testing After Budget Cuts
How to Keep Up Your Creative Testing After Budget CutsTinuiti
 

Similaire à Experimentation as a growth strategy: A conversation with The Motley Fool (20)

__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...
__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...
__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...
 
Why We Test - Rethinking Your Approach
Why We Test - Rethinking Your ApproachWhy We Test - Rethinking Your Approach
Why We Test - Rethinking Your Approach
 
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMHow to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PM
 
Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010
Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010
Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010
 
How to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO programHow to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO program
 
Growth Hacking - High Tempo Testing
Growth Hacking - High Tempo TestingGrowth Hacking - High Tempo Testing
Growth Hacking - High Tempo Testing
 
How to Master Product Management Case Studies by fmr Groupon PM
How to Master Product Management Case Studies by fmr Groupon PMHow to Master Product Management Case Studies by fmr Groupon PM
How to Master Product Management Case Studies by fmr Groupon PM
 
uShip - Building a Culture Rooted in Experimentation
uShip - Building a Culture Rooted in ExperimentationuShip - Building a Culture Rooted in Experimentation
uShip - Building a Culture Rooted in Experimentation
 
Conversion Conference 2011 NYC presentation
Conversion Conference 2011 NYC presentationConversion Conference 2011 NYC presentation
Conversion Conference 2011 NYC presentation
 
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
 
Trade up from cube to corner office - OpenText TeamSite Optimost
Trade up from cube to corner office - OpenText TeamSite OptimostTrade up from cube to corner office - OpenText TeamSite Optimost
Trade up from cube to corner office - OpenText TeamSite Optimost
 
Trade up from cube to corner office - OpenText Optimost
Trade up from cube to corner office - OpenText OptimostTrade up from cube to corner office - OpenText Optimost
Trade up from cube to corner office - OpenText Optimost
 
Agile Marketing Methodology PowerPoint Presentation Slides
Agile Marketing Methodology PowerPoint Presentation SlidesAgile Marketing Methodology PowerPoint Presentation Slides
Agile Marketing Methodology PowerPoint Presentation Slides
 
Why the first 2 stages of Design thinking are important for a startup?
Why the first 2 stages of Design thinking are important for a startup?Why the first 2 stages of Design thinking are important for a startup?
Why the first 2 stages of Design thinking are important for a startup?
 
Going to the Source
Going to the SourceGoing to the Source
Going to the Source
 
PMP® Sample Questions
PMP® Sample QuestionsPMP® Sample Questions
PMP® Sample Questions
 
DRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKES
DRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKESDRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKES
DRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKES
 
Conducting the Experimentation Orchestra
Conducting the Experimentation OrchestraConducting the Experimentation Orchestra
Conducting the Experimentation Orchestra
 
DV 2016: Building a Culture of Testing and Optimization
DV 2016: Building a Culture of Testing and OptimizationDV 2016: Building a Culture of Testing and Optimization
DV 2016: Building a Culture of Testing and Optimization
 
How to Keep Up Your Creative Testing After Budget Cuts
How to Keep Up Your Creative Testing After Budget CutsHow to Keep Up Your Creative Testing After Budget Cuts
How to Keep Up Your Creative Testing After Budget Cuts
 

Plus de Chris Goward

[Webinar] The power of experimentation in direct-to-consumer eCommerce
[Webinar] The power of experimentation in direct-to-consumer eCommerce[Webinar] The power of experimentation in direct-to-consumer eCommerce
[Webinar] The power of experimentation in direct-to-consumer eCommerceChris Goward
 
Culture of experimentation: A conversation with Microsoft
Culture of experimentation: A conversation with MicrosoftCulture of experimentation: A conversation with Microsoft
Culture of experimentation: A conversation with MicrosoftChris Goward
 
Thriving Through COVID: The Surprising Science of Emotion Behind Fast Growth
Thriving Through COVID: The Surprising Science of Emotion Behind Fast GrowthThriving Through COVID: The Surprising Science of Emotion Behind Fast Growth
Thriving Through COVID: The Surprising Science of Emotion Behind Fast GrowthChris Goward
 
[Webinar] Groomed for Success: Dollar Shave Club Wins with Experimentation
[Webinar] Groomed for Success: Dollar Shave Club Wins with Experimentation[Webinar] Groomed for Success: Dollar Shave Club Wins with Experimentation
[Webinar] Groomed for Success: Dollar Shave Club Wins with ExperimentationChris Goward
 
How to optimize your e-commerce website at every touch point
How to optimize your e-commerce website at every touch pointHow to optimize your e-commerce website at every touch point
How to optimize your e-commerce website at every touch pointChris Goward
 
[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...
[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...
[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...Chris Goward
 
[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...
[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...
[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...Chris Goward
 
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick SoChris Goward
 
How to Partner With WiderFunnel
How to Partner With WiderFunnelHow to Partner With WiderFunnel
How to Partner With WiderFunnelChris Goward
 
Lunch & Learn - Secret to Successful Experimentation
Lunch & Learn - Secret to Successful ExperimentationLunch & Learn - Secret to Successful Experimentation
Lunch & Learn - Secret to Successful ExperimentationChris Goward
 
[Webinar] Getting started with server-side testing - presented by WiderFunnel...
[Webinar] Getting started with server-side testing - presented by WiderFunnel...[Webinar] Getting started with server-side testing - presented by WiderFunnel...
[Webinar] Getting started with server-side testing - presented by WiderFunnel...Chris Goward
 
Segment. Personalize. Optimize - by Chris Goward
Segment. Personalize. Optimize - by Chris GowardSegment. Personalize. Optimize - by Chris Goward
Segment. Personalize. Optimize - by Chris GowardChris Goward
 
Beyond CRO Basics - by Chris Goward of WiderFunnel - hosted by Optimizely
Beyond CRO Basics - by Chris Goward of WiderFunnel - hosted by OptimizelyBeyond CRO Basics - by Chris Goward of WiderFunnel - hosted by Optimizely
Beyond CRO Basics - by Chris Goward of WiderFunnel - hosted by OptimizelyChris Goward
 
How to increase your sales by more than 40% like weBoost did
How to increase your sales by more than 40% like weBoost didHow to increase your sales by more than 40% like weBoost did
How to increase your sales by more than 40% like weBoost didChris Goward
 
Create your never-ending marketing idea engine for A/B testing and personaliz...
Create your never-ending marketing idea engine for A/B testing and personaliz...Create your never-ending marketing idea engine for A/B testing and personaliz...
Create your never-ending marketing idea engine for A/B testing and personaliz...Chris Goward
 
Learn from failed A/B tests to create winning results
Learn from failed A/B tests to create winning resultsLearn from failed A/B tests to create winning results
Learn from failed A/B tests to create winning resultsChris Goward
 
Strategic personalization: Better process, better insights, better sales.
Strategic personalization: Better process, better insights, better sales.Strategic personalization: Better process, better insights, better sales.
Strategic personalization: Better process, better insights, better sales.Chris Goward
 
Mastering the A/B Testing Idea Engine
Mastering the A/B Testing Idea EngineMastering the A/B Testing Idea Engine
Mastering the A/B Testing Idea EngineChris Goward
 
Personal branding for business and marketing students
Personal branding for business and marketing studentsPersonal branding for business and marketing students
Personal branding for business and marketing studentsChris Goward
 
Do Conversion Optimization Like the Pros
Do Conversion Optimization Like the ProsDo Conversion Optimization Like the Pros
Do Conversion Optimization Like the ProsChris Goward
 

Plus de Chris Goward (20)

[Webinar] The power of experimentation in direct-to-consumer eCommerce
[Webinar] The power of experimentation in direct-to-consumer eCommerce[Webinar] The power of experimentation in direct-to-consumer eCommerce
[Webinar] The power of experimentation in direct-to-consumer eCommerce
 
Culture of experimentation: A conversation with Microsoft
Culture of experimentation: A conversation with MicrosoftCulture of experimentation: A conversation with Microsoft
Culture of experimentation: A conversation with Microsoft
 
Thriving Through COVID: The Surprising Science of Emotion Behind Fast Growth
Thriving Through COVID: The Surprising Science of Emotion Behind Fast GrowthThriving Through COVID: The Surprising Science of Emotion Behind Fast Growth
Thriving Through COVID: The Surprising Science of Emotion Behind Fast Growth
 
[Webinar] Groomed for Success: Dollar Shave Club Wins with Experimentation
[Webinar] Groomed for Success: Dollar Shave Club Wins with Experimentation[Webinar] Groomed for Success: Dollar Shave Club Wins with Experimentation
[Webinar] Groomed for Success: Dollar Shave Club Wins with Experimentation
 
How to optimize your e-commerce website at every touch point
How to optimize your e-commerce website at every touch pointHow to optimize your e-commerce website at every touch point
How to optimize your e-commerce website at every touch point
 
[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...
[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...
[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...
 
[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...
[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...
[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...
 
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
 
How to Partner With WiderFunnel
How to Partner With WiderFunnelHow to Partner With WiderFunnel
How to Partner With WiderFunnel
 
Lunch & Learn - Secret to Successful Experimentation
Lunch & Learn - Secret to Successful ExperimentationLunch & Learn - Secret to Successful Experimentation
Lunch & Learn - Secret to Successful Experimentation
 
[Webinar] Getting started with server-side testing - presented by WiderFunnel...
[Webinar] Getting started with server-side testing - presented by WiderFunnel...[Webinar] Getting started with server-side testing - presented by WiderFunnel...
[Webinar] Getting started with server-side testing - presented by WiderFunnel...
 
Segment. Personalize. Optimize - by Chris Goward
Segment. Personalize. Optimize - by Chris GowardSegment. Personalize. Optimize - by Chris Goward
Segment. Personalize. Optimize - by Chris Goward
 
Beyond CRO Basics - by Chris Goward of WiderFunnel - hosted by Optimizely
Beyond CRO Basics - by Chris Goward of WiderFunnel - hosted by OptimizelyBeyond CRO Basics - by Chris Goward of WiderFunnel - hosted by Optimizely
Beyond CRO Basics - by Chris Goward of WiderFunnel - hosted by Optimizely
 
How to increase your sales by more than 40% like weBoost did
How to increase your sales by more than 40% like weBoost didHow to increase your sales by more than 40% like weBoost did
How to increase your sales by more than 40% like weBoost did
 
Create your never-ending marketing idea engine for A/B testing and personaliz...
Create your never-ending marketing idea engine for A/B testing and personaliz...Create your never-ending marketing idea engine for A/B testing and personaliz...
Create your never-ending marketing idea engine for A/B testing and personaliz...
 
Learn from failed A/B tests to create winning results
Learn from failed A/B tests to create winning resultsLearn from failed A/B tests to create winning results
Learn from failed A/B tests to create winning results
 
Strategic personalization: Better process, better insights, better sales.
Strategic personalization: Better process, better insights, better sales.Strategic personalization: Better process, better insights, better sales.
Strategic personalization: Better process, better insights, better sales.
 
Mastering the A/B Testing Idea Engine
Mastering the A/B Testing Idea EngineMastering the A/B Testing Idea Engine
Mastering the A/B Testing Idea Engine
 
Personal branding for business and marketing students
Personal branding for business and marketing studentsPersonal branding for business and marketing students
Personal branding for business and marketing students
 
Do Conversion Optimization Like the Pros
Do Conversion Optimization Like the ProsDo Conversion Optimization Like the Pros
Do Conversion Optimization Like the Pros
 

Dernier

Fiverr's Product Marketing Interview Assignment
Fiverr's Product Marketing Interview AssignmentFiverr's Product Marketing Interview Assignment
Fiverr's Product Marketing Interview AssignmentFarrel Brest
 
Exploring The World Of Adult Ad Networks.pdf
Exploring The World Of Adult Ad Networks.pdfExploring The World Of Adult Ad Networks.pdf
Exploring The World Of Adult Ad Networks.pdfadult marketing
 
Digital Marketing Spotlight: Lifecycle Advertising Strategies.pdf
Digital Marketing Spotlight: Lifecycle Advertising Strategies.pdfDigital Marketing Spotlight: Lifecycle Advertising Strategies.pdf
Digital Marketing Spotlight: Lifecycle Advertising Strategies.pdfDemandbase
 
When to use Machine Learning Models in SEO and Which ones to use - Lazarina S...
When to use Machine Learning Models in SEO and Which ones to use - Lazarina S...When to use Machine Learning Models in SEO and Which ones to use - Lazarina S...
When to use Machine Learning Models in SEO and Which ones to use - Lazarina S...LazarinaStoyanova
 
What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick...
What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick...What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick...
What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick...Ahrefs
 
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdf
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdfDIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdf
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdfmayanksharma0441
 
TAM AdEx 2023 Cross Media Advertising Recap - Auto Sector
TAM AdEx 2023 Cross Media Advertising Recap - Auto SectorTAM AdEx 2023 Cross Media Advertising Recap - Auto Sector
TAM AdEx 2023 Cross Media Advertising Recap - Auto SectorSocial Samosa
 
Miss Immigrant USA Activity Pageant Program.pdf
Miss Immigrant USA Activity Pageant Program.pdfMiss Immigrant USA Activity Pageant Program.pdf
Miss Immigrant USA Activity Pageant Program.pdfMagdalena Kulisz
 
The Impact of Digital Technologies
The Impact of Digital Technologies The Impact of Digital Technologies
The Impact of Digital Technologies bruguardarib
 
Michael Kors marketing assignment swot analysis
Michael Kors marketing assignment swot analysisMichael Kors marketing assignment swot analysis
Michael Kors marketing assignment swot analysisjunaid794917
 
Codes and Conventions of Film Magazine Websites.pptx
Codes and Conventions of Film Magazine Websites.pptxCodes and Conventions of Film Magazine Websites.pptx
Codes and Conventions of Film Magazine Websites.pptxGeorgeCulica
 
The 10 Most Inspirational Leaders LEADING THE WAY TO SUCCESS, 2024
The 10 Most Inspirational Leaders LEADING THE WAY TO SUCCESS, 2024The 10 Most Inspirational Leaders LEADING THE WAY TO SUCCESS, 2024
The 10 Most Inspirational Leaders LEADING THE WAY TO SUCCESS, 2024CIO Business World
 
What’s the difference between Affiliate Marketing and Brand Partnerships?
What’s the difference between Affiliate Marketing and Brand Partnerships?What’s the difference between Affiliate Marketing and Brand Partnerships?
What’s the difference between Affiliate Marketing and Brand Partnerships?Partnercademy
 
Common Culture: Paul Willis Symbolic Creativity
Common Culture: Paul Willis Symbolic CreativityCommon Culture: Paul Willis Symbolic Creativity
Common Culture: Paul Willis Symbolic CreativityMonishka Adhikari
 
2024's Top PPC Tactics: Triple Your Google Ads Local Leads
2024's Top PPC Tactics: Triple Your Google Ads Local Leads2024's Top PPC Tactics: Triple Your Google Ads Local Leads
2024's Top PPC Tactics: Triple Your Google Ads Local LeadsSearch Engine Journal
 
Inbound Marekting 2.0 - The Paradigm Shift in Marketing | Axon Garside
Inbound Marekting 2.0 - The Paradigm Shift in Marketing | Axon GarsideInbound Marekting 2.0 - The Paradigm Shift in Marketing | Axon Garside
Inbound Marekting 2.0 - The Paradigm Shift in Marketing | Axon Garsiderobwhite630290
 
Digital Marketing in 5G Era - Digital Transformation in 5G Age
Digital Marketing in 5G Era - Digital Transformation in 5G AgeDigital Marketing in 5G Era - Digital Transformation in 5G Age
Digital Marketing in 5G Era - Digital Transformation in 5G AgeDigiKarishma
 
The 10 Most Influential CMO's Leading the Way of Success, 2024 (Final file) (...
The 10 Most Influential CMO's Leading the Way of Success, 2024 (Final file) (...The 10 Most Influential CMO's Leading the Way of Success, 2024 (Final file) (...
The 10 Most Influential CMO's Leading the Way of Success, 2024 (Final file) (...CIO Business World
 
SEO and Digital PR - How to Connect Your Teams to Maximise Success
SEO and Digital PR - How to Connect Your Teams to Maximise SuccessSEO and Digital PR - How to Connect Your Teams to Maximise Success
SEO and Digital PR - How to Connect Your Teams to Maximise SuccessLiv Day
 
The Evolution of Internet : How consumers use technology and its impact on th...
The Evolution of Internet : How consumers use technology and its impact on th...The Evolution of Internet : How consumers use technology and its impact on th...
The Evolution of Internet : How consumers use technology and its impact on th...sowmyrao14
 

Dernier (20)

Fiverr's Product Marketing Interview Assignment
Fiverr's Product Marketing Interview AssignmentFiverr's Product Marketing Interview Assignment
Fiverr's Product Marketing Interview Assignment
 
Exploring The World Of Adult Ad Networks.pdf
Exploring The World Of Adult Ad Networks.pdfExploring The World Of Adult Ad Networks.pdf
Exploring The World Of Adult Ad Networks.pdf
 
Digital Marketing Spotlight: Lifecycle Advertising Strategies.pdf
Digital Marketing Spotlight: Lifecycle Advertising Strategies.pdfDigital Marketing Spotlight: Lifecycle Advertising Strategies.pdf
Digital Marketing Spotlight: Lifecycle Advertising Strategies.pdf
 
When to use Machine Learning Models in SEO and Which ones to use - Lazarina S...
When to use Machine Learning Models in SEO and Which ones to use - Lazarina S...When to use Machine Learning Models in SEO and Which ones to use - Lazarina S...
When to use Machine Learning Models in SEO and Which ones to use - Lazarina S...
 
What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick...
What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick...What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick...
What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick...
 
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdf
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdfDIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdf
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdf
 
TAM AdEx 2023 Cross Media Advertising Recap - Auto Sector
TAM AdEx 2023 Cross Media Advertising Recap - Auto SectorTAM AdEx 2023 Cross Media Advertising Recap - Auto Sector
TAM AdEx 2023 Cross Media Advertising Recap - Auto Sector
 
Miss Immigrant USA Activity Pageant Program.pdf
Miss Immigrant USA Activity Pageant Program.pdfMiss Immigrant USA Activity Pageant Program.pdf
Miss Immigrant USA Activity Pageant Program.pdf
 
The Impact of Digital Technologies
The Impact of Digital Technologies The Impact of Digital Technologies
The Impact of Digital Technologies
 
Michael Kors marketing assignment swot analysis
Michael Kors marketing assignment swot analysisMichael Kors marketing assignment swot analysis
Michael Kors marketing assignment swot analysis
 
Codes and Conventions of Film Magazine Websites.pptx
Codes and Conventions of Film Magazine Websites.pptxCodes and Conventions of Film Magazine Websites.pptx
Codes and Conventions of Film Magazine Websites.pptx
 
The 10 Most Inspirational Leaders LEADING THE WAY TO SUCCESS, 2024
The 10 Most Inspirational Leaders LEADING THE WAY TO SUCCESS, 2024The 10 Most Inspirational Leaders LEADING THE WAY TO SUCCESS, 2024
The 10 Most Inspirational Leaders LEADING THE WAY TO SUCCESS, 2024
 
What’s the difference between Affiliate Marketing and Brand Partnerships?
What’s the difference between Affiliate Marketing and Brand Partnerships?What’s the difference between Affiliate Marketing and Brand Partnerships?
What’s the difference between Affiliate Marketing and Brand Partnerships?
 
Common Culture: Paul Willis Symbolic Creativity
Common Culture: Paul Willis Symbolic CreativityCommon Culture: Paul Willis Symbolic Creativity
Common Culture: Paul Willis Symbolic Creativity
 
2024's Top PPC Tactics: Triple Your Google Ads Local Leads
2024's Top PPC Tactics: Triple Your Google Ads Local Leads2024's Top PPC Tactics: Triple Your Google Ads Local Leads
2024's Top PPC Tactics: Triple Your Google Ads Local Leads
 
Inbound Marekting 2.0 - The Paradigm Shift in Marketing | Axon Garside
Inbound Marekting 2.0 - The Paradigm Shift in Marketing | Axon GarsideInbound Marekting 2.0 - The Paradigm Shift in Marketing | Axon Garside
Inbound Marekting 2.0 - The Paradigm Shift in Marketing | Axon Garside
 
Digital Marketing in 5G Era - Digital Transformation in 5G Age
Digital Marketing in 5G Era - Digital Transformation in 5G AgeDigital Marketing in 5G Era - Digital Transformation in 5G Age
Digital Marketing in 5G Era - Digital Transformation in 5G Age
 
The 10 Most Influential CMO's Leading the Way of Success, 2024 (Final file) (...
The 10 Most Influential CMO's Leading the Way of Success, 2024 (Final file) (...The 10 Most Influential CMO's Leading the Way of Success, 2024 (Final file) (...
The 10 Most Influential CMO's Leading the Way of Success, 2024 (Final file) (...
 
SEO and Digital PR - How to Connect Your Teams to Maximise Success
SEO and Digital PR - How to Connect Your Teams to Maximise SuccessSEO and Digital PR - How to Connect Your Teams to Maximise Success
SEO and Digital PR - How to Connect Your Teams to Maximise Success
 
The Evolution of Internet : How consumers use technology and its impact on th...
The Evolution of Internet : How consumers use technology and its impact on th...The Evolution of Internet : How consumers use technology and its impact on th...
The Evolution of Internet : How consumers use technology and its impact on th...
 

Experimentation as a growth strategy: A conversation with The Motley Fool

  • 1. How to Leverage Experimentation as a Growth Strategy A conversation with The Motley Fool
  • 2. Before we get started: ● Presentation slides and recording will be available to you ● Use the Q&A panel to ask questions or make comments - these will be answered during the Q&A segment at the end of the panel
  • 3. Today’s panelists: ● Leads US Marketing operations and optimization at The Motley Fool ● Works with Marketing, Tech, Editorial and Product teams to scale testing ● Prior, Nate drove testing strategy for the user acquisition team James Flory Experimentation Strategist WiderFunnel ● Experimentation Strategist partnered with companies like Intercom, Direct Energy, and Providence Healthcare ● Expertise in behavioral psychology and personalization Nate Wallingsford Head of US Marketing Operations & Optimization The Motley Fool
  • 4. Q: How does “experimentation” fit into your role at The Motley Fool?
  • 5. Q: You described your initial tests as “good idea tests”—why did you start looking for an alternative method?
  • 6. Q: How did the first experiment we ran together differ from these good idea tests?
  • 7.
  • 8.
  • 11.
  • 12. Variation A Variation B Variation C Variation D +0.2% -3.0% -18.5% -12.2%
  • 13. Q: How do you respond to losing tests? What has been the team and the organization’s response to this side of experimentation?
  • 14. Variation B Variation CVariation D +23%+19.1% Variation B
  • 15.
  • 16. Variation A Variation B Variation C +9.15%+14.45% +8.88%
  • 17. Q: Many testing teams focus on fixing usability problems but understanding your customers is crucial to providing an ideal customer experience. How should Optimizers balance the two?
  • 18. The Two Sides of Optimization The BJ Fogg Model describes behavioural change as a function of two factors, motivation and ability. In optimization, both of these factors play a pivotal role in developing good hypotheses either together or apart.
  • 20.
  • 23. Q: What does “experimentation at scale” mean to you? How are you working to scale experimentation at The Motley Fool?
  • 24. Q: How do you transfer and leverage insights across multiple teams at The Motley Fool?
  • 25. Q: What does your technology stack for experimentation look like?
  • 26. Q: What are you most proud of when you think about the experimentation program at The Motley Fool?
  • 27. Q: What does the future of experimentation look like at The Motley Fool?
  • 28. Q&A
  • 29. Looking to implement or scale an experimentation program at your organization? Send us an email to find out if you qualify for our services! Email: iwant@widerfunnel.com