SlideShare ist ein Scribd-Unternehmen logo
1 von 31
Downloaden Sie, um offline zu lesen
CASE STUDIES
“Wenn wir erraten wollen, was für unsere Besucher 
funktioniert, dann könnten wir genauso gut eine Münze 
werfen. Wir sind auf A/B Testing angewiesen, um 
bessere Entscheidungen zu treffen.”! 
– Peter Koechley, Gründer, Upworthy 
! 
! 
.”
Quelle: taalenhersenen.wordpress.com 
Quelle:Scribewise.com
Case 1 - NRC 
Wie schaffe ich es, möglichst viele Abonnenten für meine neue Zeitung zu gewinnen?
ORIGINAL ABO-SEITE
Test! 
! 
Was ist die beste Darstellung der Angebote? 
!
TESTAUFBAU 
• 10 Varianten der Abo-Seite in Optimizely erstellt 
• Trafficberechnung und Verteilung 
• 10 Tage Laufzeit 
• Beste 4 Varianten schaffen es in Runde 2 des Tests
Original 
Variante 2 
Variante 3 
Variante 4
Original 
Gewinner 25% mehr Abos 
Variante 2 Variante 4
Segmentierung Mobile vs. Non-Mobile 
Klarer Verlierer 
Klarer Gewinner
Learnings 
1. Ohne Testen verschenkt man großartige Möglichkeiten der Optimierung 
2. Planen Sie den Test auf Basis von Hypothesen 
3. Segmentieren Sie Ihre Ergebnisse - Mobile User sind komplett anders
Nächste Schritte 
1. Learnings aus Online auf Offline anwenden 
2. Weitere Tests auf Mobile und Tablet 
3. Tests in Apps (NRC hat 5 Apps)
Case 2 - Aftenbladet 
Wie schaffe ich es, dass sich Besucher zur Bezahlseite durchklicken?
ORIGINAL BANNER
TESTAUFBAU 
• Learnings aus früheren Tests als Basis für Hypothesen 
• verschiedene Varianten von Titel, Text und CTA erstellen 
• Multivariater Test (MVT) in Optimizely aufgesetzt 
• Beste Variante ermitteln
Original 
200 verschiedene 
Varianten später… 
155% mehr CTR zur Bezahlseite
ORIGINAL BANNER
Case 3 - Aftenbladet 
Wie schaffe ich es, mehr Besucher für die “Digital-Only” Version zu begeistern?
“Nur” 2 
Hinweise auf 
digitale Inhalte 
ORIGINAL ABO- SEITE
TESTVORLAUF 
• Pre-Launch mit der Originalseite für 2 Wochen 
• Hypothesen aus Literatur & Umfrage unter Abo-Käufern 
• Häufigste Antworten: 
1. Ich kaufe Digital Only, weil ich NUR Digital will. 
2. Ich will nicht, dass die Papierzeitung meinen Mülleimer verstopft.
VARIANTE 2
Gegen 
108% mehr Conversions
Case 4 - Upworthy 
Leiden die Anzahl der Social Shares unter der Platzierung von Artikelempfehlungen?
! 
! 
Wer kennt ? 
!
BUSINESS MODEL 
Quelle:: upworthy.com Quelle:: Businessinsider
TESTAUFBAU 
• Problem für Nutzer: Zusätzlichen Content finden 
• Hypothese 1: Inhaltsempfehlungen führen zu mehr gelesenen Artikeln 
• Hypothese 2: Inhaltsempfehlungen führen zu weniger Social Sharing 
__________________________________________________________________ 
! ! ! Paradox of Choice
TESTAUFBAU II 
• 2 Tests 
• Platzierung der Inhaltsempfehlungen (Recommendation Modules) 
• Design der Inhaltsempfehlungen (Anzahl, Größe, Hintergrundfarbe…) 
• Content in die Module per Javascript einfügen
Quelle:: blog.optimizely.com
1. Recommendation modules = Mehr Engagement 
2. Minimilastische Optik & 3 Inhaltsempfehlungen auf der rechten 
Seite = Gewinner 
Ergebnis 
3. Alle Varianten erhöhten Social Shares!!!
Paradox of Choice 
Erklärung 
! 
Auch wenn Nutzer den ersten Artikel nicht teilen wollten, 
so gaben Ihnen die Inhaltsempfehlungen mehr 
Möglichkeiten, Inhalte zu finden, die sie teilen wollten.
"Upworthy is the single most socially optimized site 
we've seen," said Edward Kim, CEO of social-action 
measurement pioneer SimpleReach, whose clients 
include Time, Entertainment Weekly, and Forbes. 
Upworthy is just a remarkable media network." 
! 
! 
Quelle:: PRNewswire/Upworthy .”

Weitere ähnliche Inhalte

Mehr von Optimizely

Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationOptimizely
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Optimizely
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing RightOptimizely
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleAtlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleOptimizely
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Optimizely
 
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion RevenueZillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion RevenueOptimizely
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsOptimizely
 
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...Optimizely
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Optimizely
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingBuilding an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingOptimizely
 
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideAMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideOptimizely
 
Evolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentEvolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentOptimizely
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOvercoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOptimizely
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...Optimizely
 
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyMaking Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyOptimizely
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueKick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueOptimizely
 
Experimentation through Clients' Eyes
Experimentation through Clients' EyesExperimentation through Clients' Eyes
Experimentation through Clients' EyesOptimizely
 
Shipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubShipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubOptimizely
 
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with ExperimentationTest Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with ExperimentationOptimizely
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely
 

Mehr von Optimizely (20)

Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive Experimentation
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing Right
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleAtlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
 
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion RevenueZillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical Teams
 
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingBuilding an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team Offering
 
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideAMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server Side
 
Evolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentEvolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product Development
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOvercoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
 
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyMaking Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product Strategy
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueKick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
 
Experimentation through Clients' Eyes
Experimentation through Clients' EyesExperimentation through Clients' Eyes
Experimentation through Clients' Eyes
 
Shipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubShipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHub
 
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with ExperimentationTest Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with Experimentation
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature Delivery
 

Case Studies - Conversion Optimierung für Publisher und Medien

  • 2. “Wenn wir erraten wollen, was für unsere Besucher funktioniert, dann könnten wir genauso gut eine Münze werfen. Wir sind auf A/B Testing angewiesen, um bessere Entscheidungen zu treffen.”! – Peter Koechley, Gründer, Upworthy ! ! .”
  • 4. Case 1 - NRC Wie schaffe ich es, möglichst viele Abonnenten für meine neue Zeitung zu gewinnen?
  • 6. Test! ! Was ist die beste Darstellung der Angebote? !
  • 7. TESTAUFBAU • 10 Varianten der Abo-Seite in Optimizely erstellt • Trafficberechnung und Verteilung • 10 Tage Laufzeit • Beste 4 Varianten schaffen es in Runde 2 des Tests
  • 8. Original Variante 2 Variante 3 Variante 4
  • 9. Original Gewinner 25% mehr Abos Variante 2 Variante 4
  • 10. Segmentierung Mobile vs. Non-Mobile Klarer Verlierer Klarer Gewinner
  • 11. Learnings 1. Ohne Testen verschenkt man großartige Möglichkeiten der Optimierung 2. Planen Sie den Test auf Basis von Hypothesen 3. Segmentieren Sie Ihre Ergebnisse - Mobile User sind komplett anders
  • 12. Nächste Schritte 1. Learnings aus Online auf Offline anwenden 2. Weitere Tests auf Mobile und Tablet 3. Tests in Apps (NRC hat 5 Apps)
  • 13. Case 2 - Aftenbladet Wie schaffe ich es, dass sich Besucher zur Bezahlseite durchklicken?
  • 15. TESTAUFBAU • Learnings aus früheren Tests als Basis für Hypothesen • verschiedene Varianten von Titel, Text und CTA erstellen • Multivariater Test (MVT) in Optimizely aufgesetzt • Beste Variante ermitteln
  • 16. Original 200 verschiedene Varianten später… 155% mehr CTR zur Bezahlseite
  • 18. Case 3 - Aftenbladet Wie schaffe ich es, mehr Besucher für die “Digital-Only” Version zu begeistern?
  • 19. “Nur” 2 Hinweise auf digitale Inhalte ORIGINAL ABO- SEITE
  • 20. TESTVORLAUF • Pre-Launch mit der Originalseite für 2 Wochen • Hypothesen aus Literatur & Umfrage unter Abo-Käufern • Häufigste Antworten: 1. Ich kaufe Digital Only, weil ich NUR Digital will. 2. Ich will nicht, dass die Papierzeitung meinen Mülleimer verstopft.
  • 22. Gegen 108% mehr Conversions
  • 23. Case 4 - Upworthy Leiden die Anzahl der Social Shares unter der Platzierung von Artikelempfehlungen?
  • 24. ! ! Wer kennt ? !
  • 25. BUSINESS MODEL Quelle:: upworthy.com Quelle:: Businessinsider
  • 26. TESTAUFBAU • Problem für Nutzer: Zusätzlichen Content finden • Hypothese 1: Inhaltsempfehlungen führen zu mehr gelesenen Artikeln • Hypothese 2: Inhaltsempfehlungen führen zu weniger Social Sharing __________________________________________________________________ ! ! ! Paradox of Choice
  • 27. TESTAUFBAU II • 2 Tests • Platzierung der Inhaltsempfehlungen (Recommendation Modules) • Design der Inhaltsempfehlungen (Anzahl, Größe, Hintergrundfarbe…) • Content in die Module per Javascript einfügen
  • 29. 1. Recommendation modules = Mehr Engagement 2. Minimilastische Optik & 3 Inhaltsempfehlungen auf der rechten Seite = Gewinner Ergebnis 3. Alle Varianten erhöhten Social Shares!!!
  • 30. Paradox of Choice Erklärung ! Auch wenn Nutzer den ersten Artikel nicht teilen wollten, so gaben Ihnen die Inhaltsempfehlungen mehr Möglichkeiten, Inhalte zu finden, die sie teilen wollten.
  • 31. "Upworthy is the single most socially optimized site we've seen," said Edward Kim, CEO of social-action measurement pioneer SimpleReach, whose clients include Time, Entertainment Weekly, and Forbes. Upworthy is just a remarkable media network." ! ! Quelle:: PRNewswire/Upworthy .”