SlideShare a Scribd company logo
1 of 42
Craig Sullivan Group CX Manager Belron® Cross Channel Testing Insights, tips, the future @OptimiseOrDie
Naked self promotion @OptimiseOrDie ,[object Object]
A/B and Multi-variate testing
Cross channel optimisation
User CenteredDesign
Usability testing
Customer Research & Insight
Web Analytics
Browser and email compatibility
Contact deflection and online self service
Site search analytics
Site, Page and Campaign optimisation
Test design and execution
A long usable site portfolio
ROI on UX improvements
Over 18 years of boring meetingsGroup CX Manager for Belron®  (Autoglass) I get to do it with crowds
Outline What is optimisation? Belron® Testing Culture The multiscreen and channel world Designing for multi channel Call centre optimisation Call and channel tracking Case study : Chat ROI Resources
What’s optimisation? @OptimiseOrDie
A set of techniques, implemented in order to influence customer behaviour towards these outcomes: Increased revenue or profit Increasing NPS (Customer Sat) scores      Lower cost for business or contact centres Increasing productivity or labour flexibility Simply delighting customers We may fail with 90% of what we try.   The 10% of winners let us shift behaviour hugely and measurably.
Belron®Testing Culture @OptimiseOrDie
If you go to the men's washrooms at the Schiphol airport in Amsterdam, you may notice there's a fly in the urinals.  It’s screen printed . So what do you think most men do? That's right, they aim at the fly when they urinate.  They don't even think about it, and they don't need to read a user's manual; it's just an instinctive reaction that means 85% less spillage! The interesting feature of these urinals is that they're deliberately designed to take advantage of this inherent human male tendency. This is my job.
Small team, big challenge Team of 3- 2 Optimisers, 1 x part time designer Higher ROI or lower costs, without spending more Stuff that doesn’t hinder SEO, PPC, Performance Measurable ROI - not ego or opinion Fast return and low cost techniques Over 25M page tests, 17 international tests live now ROI is > 100 x optimisation costs
Level 3 Serious testing Level 2 Early maturity Level 4 Core business value Level 5 You rock, awesomely Culture Ninja Team Testing in the DNA Cross silo team Systematic tests Dedicated team Volume opportunities Small team Low hanging fruit Level 1 Starter Level _____________________________________________________________________________________________ _  Process Company wide Outline process Well developed Streamlined Local Heroes Chaotic Good _______________________________________________________________________________________________ + Multi variate Session replay No segments +Spread tool use Dynamic adaptive targeting Machine learning Realtime +Funnel optimisation Call tracking Some segments Micro testing +Cross channel testing Integrated CRO and analytics Segmentation Testing focus Ad Hoc ________________________________________________________________________________________________ Guessing A/B testing Basic tools Bounce rates Big volume landing pages + Funnel analysis Low converting  & High loss pages Multichannel funnels Cross channel synergy Analytics   focus + offline integration Single channel picture + Funnel fixes Forms analytics Channel switches ________________________________________________________________________________________________ +Regular usability testing/research Prototyping Session replay Onsite feedback +User Centered Design Layered feedback Mini product tests + Customer sat scores tied to UX Rapid iterative testing and design + All channel view of customer Driving offline using online All promotion driven by testing   Insight methods ________________________________________________________________________________________________ Analytics Surveys Contact Centre Low budget usability Mission Continual improvement Get buyin Prove ROI Scale the testing Mine value
It’s a multiscreen multichannel world @OptimiseOrDie
Insight - Inputs
Operating System % of all unique visitors
Designing for multi-platform @OptimiseOrDie
Your ‘design’ team? Web/Online Pesky Meddling Kids? Marketing Who designs this stuff anyway? Brand IT THE CUSTOMER Legal CEO
User Centered Design Research
Insight - Inputs
Multi channel and platform Insight
Our Tools Inputs See slide
What were the benefits? Very fast build – post research: 10 weeks to build 3 cross platform sites Focused on the user (but not driven by them) Customer services, the process, the contact channels – a BIG part of the design team effort Align business and tech capability with customer ‘models’ Rapid iterative design and build = fast feedback Design product and contact options for revenue Cross channel synergy really helps work out issues Higher overall grasp of service, lifted barriers, less pain... Big increase in incremental sales To get multi-channel right, you need to design across them. Lo budget testing can start with paper, webcam, £40!...
Cross Channel Optimisation @OptimiseOrDie
What is the ROI then? TV Comparison TV - Off TV - On +2.4% +6.4% -1.3% +14.8%
People images that suck…
Photo Guidelines Groups, vans, stores, corporate guff = NO Single person – not groups or even person + customer Open, Friendly, Natural, Smiling, Engaged = YES Uniform – has huge effect, even wearing branded ball cap improves conversion Look straight at viewer or slightly towards CTA Plain backgrounds only No folded arms, arms on hips, pointing, scowling, cheesy smiles, hands behind back, hanging useless by the side, clasped by groin, fiddling with hands Arms with prop instead – hold a clipboard, rag, tool – I’m working for *you* Female images work best in almost every country – they slay the guys Natural, authentic and not ‘model’ or ‘stock’ image types work best for people We get better images now, but we keep working on the guidelines! We still got a genital framing picture the other week Photoshoots and tests are now being used to drive advertising strategy Pre TV test of potential ‘actors’ on website.  X factor meets split testing.
Call Centre optimisation Mini studies: Abandon testing Emergency phone switchoff & Overspill systems Contact deflection systems and self servicing Scripting Experiments APIs and other systems integration Chat testing Phone tracking
Abandon testing Reduce unwanted phone hangups.  Remove corporate guffspeak Don’t mention the website, esp. if this is the web number (D’oh!) Don’t give a generic or corporate drone apology message Quote real KPIs and timings (ING direct, average queue time) Make routing emotionally driven – not confusing categories that map poorly onto customer needs Experiment with queue timing – find sweet spot, don’t overquote Test plan Two countries, big phone systems, Q4 2011 Test variants of messages, music, timings, amounts quoted Messages make a big impact – experiment freely with volumes Opportunity is large due to high call volumes we have What people hate vs. What people have on their company lines On a mission here!
Switchoff		   Overspill If you have spikes, have a throttle: Busiest TV & Radio campaign so far, Q2 2011 for Autoglass® Designed a phone ‘switchoff’ system, permanently on tap Routed majority of contact to a web form Prevented a backlog situation from developing Bought time and still exceeded customer expectations (<4h excellent) Used twice to dampen inbound call volumes Overspill systems: Get a UX designer to make you a fast entry system Make them simple, easy to learn and leverage your web platform Give API access to overspill companies Sometimes heavy IT integration isn’t needed  No training, like Facebook

More Related Content

What's hot

An Overlooked Part of Outdoor Industry Retail? Data
An Overlooked Part of Outdoor Industry Retail? DataAn Overlooked Part of Outdoor Industry Retail? Data
An Overlooked Part of Outdoor Industry Retail? Data
GoSpotCheck
 

What's hot (20)

Getfeedback Flow Actions for Salesforce
Getfeedback Flow Actions for SalesforceGetfeedback Flow Actions for Salesforce
Getfeedback Flow Actions for Salesforce
 
People Power - How Moss Bros built their optimisation culture - Paul Rouke at...
People Power - How Moss Bros built their optimisation culture - Paul Rouke at...People Power - How Moss Bros built their optimisation culture - Paul Rouke at...
People Power - How Moss Bros built their optimisation culture - Paul Rouke at...
 
Conquering the perfect storm share[1]
Conquering the perfect storm share[1]Conquering the perfect storm share[1]
Conquering the perfect storm share[1]
 
How to turn your data into revenue-driving customer-centric experiences
How to turn your data into revenue-driving customer-centric experiencesHow to turn your data into revenue-driving customer-centric experiences
How to turn your data into revenue-driving customer-centric experiences
 
Take action on customer feedback with surveys and Salesforce
Take action on customer feedback with surveys and SalesforceTake action on customer feedback with surveys and Salesforce
Take action on customer feedback with surveys and Salesforce
 
Product analytics-Funnel Analysis
Product analytics-Funnel AnalysisProduct analytics-Funnel Analysis
Product analytics-Funnel Analysis
 
Customer experience trends 2016
Customer experience trends 2016Customer experience trends 2016
Customer experience trends 2016
 
Jw conversion elite talk final black
Jw conversion elite talk final blackJw conversion elite talk final black
Jw conversion elite talk final black
 
Data transformation in the sales environment - cat herding in sales prez
Data transformation in the sales environment - cat herding in sales prezData transformation in the sales environment - cat herding in sales prez
Data transformation in the sales environment - cat herding in sales prez
 
Stephen kenwright conversion elite
Stephen kenwright conversion eliteStephen kenwright conversion elite
Stephen kenwright conversion elite
 
Conversion optimization for startups
Conversion optimization for startupsConversion optimization for startups
Conversion optimization for startups
 
Differentiating in the age of the customer - Forrester 10 maj på Creuna
Differentiating in the age of the customer - Forrester 10 maj på CreunaDifferentiating in the age of the customer - Forrester 10 maj på Creuna
Differentiating in the age of the customer - Forrester 10 maj på Creuna
 
Connecting the Clouds to Drive the Customer Journey
Connecting the Clouds to Drive the Customer JourneyConnecting the Clouds to Drive the Customer Journey
Connecting the Clouds to Drive the Customer Journey
 
Developing a Customer Experience Vision
Developing a Customer Experience VisionDeveloping a Customer Experience Vision
Developing a Customer Experience Vision
 
Optimizely Summer School Class 1 - Analyze
Optimizely Summer School Class 1 - AnalyzeOptimizely Summer School Class 1 - Analyze
Optimizely Summer School Class 1 - Analyze
 
Website Redesigns: Why they Fail and How to Ensure Success
Website Redesigns: Why they Fail and How to Ensure SuccessWebsite Redesigns: Why they Fail and How to Ensure Success
Website Redesigns: Why they Fail and How to Ensure Success
 
Listening to the Voice of the Customer in an Omnichannel World
Listening to the Voice of the Customer in an Omnichannel WorldListening to the Voice of the Customer in an Omnichannel World
Listening to the Voice of the Customer in an Omnichannel World
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
 
An Overlooked Part of Outdoor Industry Retail? Data
An Overlooked Part of Outdoor Industry Retail? DataAn Overlooked Part of Outdoor Industry Retail? Data
An Overlooked Part of Outdoor Industry Retail? Data
 
Salesforce for Service
Salesforce for ServiceSalesforce for Service
Salesforce for Service
 

Similar to Cross channel testing insights and recommendations - jump - oct 12 2011 - widescreen - craig sullivan

nextNY Online Marketing School - SEM Presentation
nextNY Online Marketing School - SEM PresentationnextNY Online Marketing School - SEM Presentation
nextNY Online Marketing School - SEM Presentation
nextNY
 
SPACC IT Day Azul7 Analytics Presentation
SPACC IT Day Azul7 Analytics PresentationSPACC IT Day Azul7 Analytics Presentation
SPACC IT Day Azul7 Analytics Presentation
Azul 7
 
Design for Business Impact - Increase Your ROI & Velocity
Design for Business Impact - Increase Your ROI & VelocityDesign for Business Impact - Increase Your ROI & Velocity
Design for Business Impact - Increase Your ROI & Velocity
Chloë Bregman, CSPO
 

Similar to Cross channel testing insights and recommendations - jump - oct 12 2011 - widescreen - craig sullivan (20)

Conversion Summit Slides - 1 Sep 2011 - Craig Sullivan
Conversion Summit Slides - 1 Sep 2011 - Craig SullivanConversion Summit Slides - 1 Sep 2011 - Craig Sullivan
Conversion Summit Slides - 1 Sep 2011 - Craig Sullivan
 
Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...
Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...
Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...
 
CCNS Webinar
CCNS WebinarCCNS Webinar
CCNS Webinar
 
Conversion Rate Optimization at OMS - the 5 Step Conversion Optimization Stra...
Conversion Rate Optimization at OMS - the 5 Step Conversion Optimization Stra...Conversion Rate Optimization at OMS - the 5 Step Conversion Optimization Stra...
Conversion Rate Optimization at OMS - the 5 Step Conversion Optimization Stra...
 
Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive Experimentation
 
Using Attribution Modeling to Grow Your Business
Using Attribution Modeling to Grow Your BusinessUsing Attribution Modeling to Grow Your Business
Using Attribution Modeling to Grow Your Business
 
[Webinar] The Scalable Way: Unlocking Data To Drive Great Customer Experience...
[Webinar] The Scalable Way: Unlocking Data To Drive Great Customer Experience...[Webinar] The Scalable Way: Unlocking Data To Drive Great Customer Experience...
[Webinar] The Scalable Way: Unlocking Data To Drive Great Customer Experience...
 
Conversion Optimization Framework to Build Sustainable and Repeat Growth
Conversion Optimization Framework to Build Sustainable and Repeat GrowthConversion Optimization Framework to Build Sustainable and Repeat Growth
Conversion Optimization Framework to Build Sustainable and Repeat Growth
 
Radically Improve Conversion Rates - eMSF 2009
Radically Improve Conversion Rates - eMSF 2009Radically Improve Conversion Rates - eMSF 2009
Radically Improve Conversion Rates - eMSF 2009
 
The Scalable Way: Unlocking Data To Drive Great Customer Experience and Conve...
The Scalable Way: Unlocking Data To Drive Great Customer Experience and Conve...The Scalable Way: Unlocking Data To Drive Great Customer Experience and Conve...
The Scalable Way: Unlocking Data To Drive Great Customer Experience and Conve...
 
Widemile and Microsoft Multivariate Testing Case Study
Widemile and Microsoft Multivariate Testing Case StudyWidemile and Microsoft Multivariate Testing Case Study
Widemile and Microsoft Multivariate Testing Case Study
 
ONTC Slides
ONTC SlidesONTC Slides
ONTC Slides
 
nextNY Online Marketing School - SEM Presentation
nextNY Online Marketing School - SEM PresentationnextNY Online Marketing School - SEM Presentation
nextNY Online Marketing School - SEM Presentation
 
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMHow to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PM
 
SPACC IT Day Azul7 Analytics Presentation
SPACC IT Day Azul7 Analytics PresentationSPACC IT Day Azul7 Analytics Presentation
SPACC IT Day Azul7 Analytics Presentation
 
Design for Business Impact - Increase Your ROI & Velocity
Design for Business Impact - Increase Your ROI & VelocityDesign for Business Impact - Increase Your ROI & Velocity
Design for Business Impact - Increase Your ROI & Velocity
 
Wettemann
WettemannWettemann
Wettemann
 
How To Build a Winning Conversion Optimization Strategy
How To Build a Winning Conversion Optimization StrategyHow To Build a Winning Conversion Optimization Strategy
How To Build a Winning Conversion Optimization Strategy
 
DV 2016: Building a Culture of Testing and Optimization
DV 2016: Building a Culture of Testing and OptimizationDV 2016: Building a Culture of Testing and Optimization
DV 2016: Building a Culture of Testing and Optimization
 
E C L004 Dokich 091807
E C L004  Dokich 091807E C L004  Dokich 091807
E C L004 Dokich 091807
 

More from Craig Sullivan

More from Craig Sullivan (20)

Cross Device Optimisation - Google Analytics Shortcuts
Cross Device Optimisation - Google Analytics ShortcutsCross Device Optimisation - Google Analytics Shortcuts
Cross Device Optimisation - Google Analytics Shortcuts
 
Product Design is Poo - And we're all going to die
Product Design is Poo - And we're all going to dieProduct Design is Poo - And we're all going to die
Product Design is Poo - And we're all going to die
 
Product design is Poo - And how to fix it!
Product design is Poo - And how to fix it!Product design is Poo - And how to fix it!
Product design is Poo - And how to fix it!
 
Conversion Research in One Hour
Conversion Research in One HourConversion Research in One Hour
Conversion Research in One Hour
 
Web Analytics Wednesday - Session Replay Tools are Vital
Web Analytics Wednesday - Session Replay Tools are VitalWeb Analytics Wednesday - Session Replay Tools are Vital
Web Analytics Wednesday - Session Replay Tools are Vital
 
eMetrics London - The AB Testing Hype Cycle
eMetrics London - The AB Testing Hype CycleeMetrics London - The AB Testing Hype Cycle
eMetrics London - The AB Testing Hype Cycle
 
Interact London - 21 Oct 2015 - Scaling Stupidity
Interact London - 21 Oct 2015 - Scaling StupidityInteract London - 21 Oct 2015 - Scaling Stupidity
Interact London - 21 Oct 2015 - Scaling Stupidity
 
Surviving the AB Testing Hype Cycle - Reaktor Breakpoint 2015
Surviving the AB Testing Hype Cycle - Reaktor Breakpoint 2015Surviving the AB Testing Hype Cycle - Reaktor Breakpoint 2015
Surviving the AB Testing Hype Cycle - Reaktor Breakpoint 2015
 
Surviving the hype cycle Shortcuts to split testing success
Surviving the hype cycle   Shortcuts to split testing successSurviving the hype cycle   Shortcuts to split testing success
Surviving the hype cycle Shortcuts to split testing success
 
Myths and Illusions of Cross Device Testing - Elite Camp June 2015
Myths and Illusions of Cross Device Testing - Elite Camp June 2015Myths and Illusions of Cross Device Testing - Elite Camp June 2015
Myths and Illusions of Cross Device Testing - Elite Camp June 2015
 
Myths, Lies and Illusions of AB and Split Testing
Myths, Lies and Illusions of AB and Split TestingMyths, Lies and Illusions of AB and Split Testing
Myths, Lies and Illusions of AB and Split Testing
 
20 Ways to Shaft your Split Tesring : Conversion Conference
20 Ways to Shaft your Split Tesring : Conversion Conference20 Ways to Shaft your Split Tesring : Conversion Conference
20 Ways to Shaft your Split Tesring : Conversion Conference
 
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to Me
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to MeBrighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to Me
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to Me
 
Digital Impact 2014 - Oh Boy These AB tests sure look like Bullshit to me
Digital Impact 2014 - Oh Boy These AB tests sure look like Bullshit to meDigital Impact 2014 - Oh Boy These AB tests sure look like Bullshit to me
Digital Impact 2014 - Oh Boy These AB tests sure look like Bullshit to me
 
20 top AB testing mistakes and how to avoid them
20 top AB testing mistakes and how to avoid them20 top AB testing mistakes and how to avoid them
20 top AB testing mistakes and how to avoid them
 
#Measurefest : 20 Simple Ways to Fuck Up your AB tests
#Measurefest : 20 Simple Ways to Fuck Up your AB tests#Measurefest : 20 Simple Ways to Fuck Up your AB tests
#Measurefest : 20 Simple Ways to Fuck Up your AB tests
 
#Measurecamp : 18 Simple Ways to F*** up Your AB Testing
#Measurecamp : 18 Simple Ways to F*** up Your AB Testing#Measurecamp : 18 Simple Ways to F*** up Your AB Testing
#Measurecamp : 18 Simple Ways to F*** up Your AB Testing
 
UXPA UK - Toolkits and Tips for Blending UX, Analytics and CRO
UXPA UK - Toolkits and Tips for Blending UX, Analytics and CROUXPA UK - Toolkits and Tips for Blending UX, Analytics and CRO
UXPA UK - Toolkits and Tips for Blending UX, Analytics and CRO
 
The Neuromarketing Toolkit - Chinwag Psych - 4 Feb 2014
The Neuromarketing Toolkit - Chinwag Psych - 4 Feb 2014The Neuromarketing Toolkit - Chinwag Psych - 4 Feb 2014
The Neuromarketing Toolkit - Chinwag Psych - 4 Feb 2014
 
12 Things to do Before Your Company Dies : Conversion Conference London - Oct...
12 Things to do Before Your Company Dies : Conversion Conference London - Oct...12 Things to do Before Your Company Dies : Conversion Conference London - Oct...
12 Things to do Before Your Company Dies : Conversion Conference London - Oct...
 

Recently uploaded

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Recently uploaded (20)

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 

Cross channel testing insights and recommendations - jump - oct 12 2011 - widescreen - craig sullivan

  • 1. Craig Sullivan Group CX Manager Belron® Cross Channel Testing Insights, tips, the future @OptimiseOrDie
  • 2.
  • 9. Browser and email compatibility
  • 10. Contact deflection and online self service
  • 12. Site, Page and Campaign optimisation
  • 13. Test design and execution
  • 14. A long usable site portfolio
  • 15. ROI on UX improvements
  • 16. Over 18 years of boring meetingsGroup CX Manager for Belron® (Autoglass) I get to do it with crowds
  • 17. Outline What is optimisation? Belron® Testing Culture The multiscreen and channel world Designing for multi channel Call centre optimisation Call and channel tracking Case study : Chat ROI Resources
  • 19. A set of techniques, implemented in order to influence customer behaviour towards these outcomes: Increased revenue or profit Increasing NPS (Customer Sat) scores Lower cost for business or contact centres Increasing productivity or labour flexibility Simply delighting customers We may fail with 90% of what we try. The 10% of winners let us shift behaviour hugely and measurably.
  • 21. If you go to the men's washrooms at the Schiphol airport in Amsterdam, you may notice there's a fly in the urinals. It’s screen printed . So what do you think most men do? That's right, they aim at the fly when they urinate. They don't even think about it, and they don't need to read a user's manual; it's just an instinctive reaction that means 85% less spillage! The interesting feature of these urinals is that they're deliberately designed to take advantage of this inherent human male tendency. This is my job.
  • 22. Small team, big challenge Team of 3- 2 Optimisers, 1 x part time designer Higher ROI or lower costs, without spending more Stuff that doesn’t hinder SEO, PPC, Performance Measurable ROI - not ego or opinion Fast return and low cost techniques Over 25M page tests, 17 international tests live now ROI is > 100 x optimisation costs
  • 23. Level 3 Serious testing Level 2 Early maturity Level 4 Core business value Level 5 You rock, awesomely Culture Ninja Team Testing in the DNA Cross silo team Systematic tests Dedicated team Volume opportunities Small team Low hanging fruit Level 1 Starter Level _____________________________________________________________________________________________ _ Process Company wide Outline process Well developed Streamlined Local Heroes Chaotic Good _______________________________________________________________________________________________ + Multi variate Session replay No segments +Spread tool use Dynamic adaptive targeting Machine learning Realtime +Funnel optimisation Call tracking Some segments Micro testing +Cross channel testing Integrated CRO and analytics Segmentation Testing focus Ad Hoc ________________________________________________________________________________________________ Guessing A/B testing Basic tools Bounce rates Big volume landing pages + Funnel analysis Low converting & High loss pages Multichannel funnels Cross channel synergy Analytics focus + offline integration Single channel picture + Funnel fixes Forms analytics Channel switches ________________________________________________________________________________________________ +Regular usability testing/research Prototyping Session replay Onsite feedback +User Centered Design Layered feedback Mini product tests + Customer sat scores tied to UX Rapid iterative testing and design + All channel view of customer Driving offline using online All promotion driven by testing Insight methods ________________________________________________________________________________________________ Analytics Surveys Contact Centre Low budget usability Mission Continual improvement Get buyin Prove ROI Scale the testing Mine value
  • 24. It’s a multiscreen multichannel world @OptimiseOrDie
  • 26.
  • 27. Operating System % of all unique visitors
  • 28.
  • 30. Your ‘design’ team? Web/Online Pesky Meddling Kids? Marketing Who designs this stuff anyway? Brand IT THE CUSTOMER Legal CEO
  • 33. Multi channel and platform Insight
  • 34. Our Tools Inputs See slide
  • 35. What were the benefits? Very fast build – post research: 10 weeks to build 3 cross platform sites Focused on the user (but not driven by them) Customer services, the process, the contact channels – a BIG part of the design team effort Align business and tech capability with customer ‘models’ Rapid iterative design and build = fast feedback Design product and contact options for revenue Cross channel synergy really helps work out issues Higher overall grasp of service, lifted barriers, less pain... Big increase in incremental sales To get multi-channel right, you need to design across them. Lo budget testing can start with paper, webcam, £40!...
  • 36. Cross Channel Optimisation @OptimiseOrDie
  • 37. What is the ROI then? TV Comparison TV - Off TV - On +2.4% +6.4% -1.3% +14.8%
  • 39. Photo Guidelines Groups, vans, stores, corporate guff = NO Single person – not groups or even person + customer Open, Friendly, Natural, Smiling, Engaged = YES Uniform – has huge effect, even wearing branded ball cap improves conversion Look straight at viewer or slightly towards CTA Plain backgrounds only No folded arms, arms on hips, pointing, scowling, cheesy smiles, hands behind back, hanging useless by the side, clasped by groin, fiddling with hands Arms with prop instead – hold a clipboard, rag, tool – I’m working for *you* Female images work best in almost every country – they slay the guys Natural, authentic and not ‘model’ or ‘stock’ image types work best for people We get better images now, but we keep working on the guidelines! We still got a genital framing picture the other week Photoshoots and tests are now being used to drive advertising strategy Pre TV test of potential ‘actors’ on website. X factor meets split testing.
  • 40. Call Centre optimisation Mini studies: Abandon testing Emergency phone switchoff & Overspill systems Contact deflection systems and self servicing Scripting Experiments APIs and other systems integration Chat testing Phone tracking
  • 41. Abandon testing Reduce unwanted phone hangups. Remove corporate guffspeak Don’t mention the website, esp. if this is the web number (D’oh!) Don’t give a generic or corporate drone apology message Quote real KPIs and timings (ING direct, average queue time) Make routing emotionally driven – not confusing categories that map poorly onto customer needs Experiment with queue timing – find sweet spot, don’t overquote Test plan Two countries, big phone systems, Q4 2011 Test variants of messages, music, timings, amounts quoted Messages make a big impact – experiment freely with volumes Opportunity is large due to high call volumes we have What people hate vs. What people have on their company lines On a mission here!
  • 42. Switchoff Overspill If you have spikes, have a throttle: Busiest TV & Radio campaign so far, Q2 2011 for Autoglass® Designed a phone ‘switchoff’ system, permanently on tap Routed majority of contact to a web form Prevented a backlog situation from developing Bought time and still exceeded customer expectations (<4h excellent) Used twice to dampen inbound call volumes Overspill systems: Get a UX designer to make you a fast entry system Make them simple, easy to learn and leverage your web platform Give API access to overspill companies Sometimes heavy IT integration isn’t needed No training, like Facebook
  • 43. Contact deflection & self service People like immediate gratification! The iceberg of contact opportunity Make people like you for not helping! If you stick it in help, will it go away? No elephant graveyard, please (FAQ) Instrument for analytics and ROI Set it up to measure and improve Gamification of content? Adoption? LOVEFiLM Help Centre: Ratings, Deflection tracking, self service tracking Please view in your account, Please visit your account, Please check your next billing date, Your next billing date is 1 Feb What about your measurement? Basics – Ratings, Did you find this answer helpful? Intermediate – Tracking behaviour and contact channels Add tracking of self service events or behaviour Set up a game or reward structure Continually improve and get proof Add phone tracking - make avoidable contact visible Remove all barriers to self servicing for high cost/volume contacts Try Amazon, lol! Help experts? Sticky Content are brill.
  • 44. Script Optimisation How can we optimise phone conversion? Dedicated test teams Script testing often limited Now – we can use A/B or MV testing, with API integration Try out 3,4,5 different versions of key areas or entire script ‘Wrapping’ sends XML message event, triggers analytics tag Analyse in the same way as an A/B or multi-variate web test Fast optimisation of handling scripts, using a mini lab Should yield 3-5% higher performing scripts, minimum Shows what variables drive script performance globally Aim for Q2 2012 for a proof of concept
  • 45. Platform APIs Use of web platform APIs now for: Contact centre messages Facebook app Mobile site and apps Scheduling Analytics tag firing Just making APIs, automagically makes: People use them Improvements happen New ideas happen, that you didn’t expect Incompatible stuff get glued together Complex IT integration projects go away
  • 46. A - Chat Split A B B - Chat C - Chat C Contact Us Contact Form Ringback Chat Testing
  • 47. Damage Appt Details 1 Details 2 Damage Appt Details 1 Details 2 A - Chat Free B – With Chat 0844 371 0051 0844 371 0047 0844 371 0052 0844 371 0048 0844 371 0053 0844 371 0049 0844 371 0054 0844 371 0050
  • 48. Chat testing 1 month trial – properly A/B tested Measured all the contact channels for movements – what happened? Over a week, chat saves 17 calls – yay! But swapped that for 329 chats @ 8.25 minutes. Ouch. Increased ringback requests? Email form about the same. No statistically significant impact on conversion Assumption was big impact, huge impact! Anecdotally, a wonderful tool. Agreed. Customers happy, yes, but not in a good businessway Like putting your customer service desk into the street You must measure influences in contact volumes when trialling Chat Be very careful – prove your ROI on any pilot. Only 7-10% use and out of those, less than 50% are influencable etc. etc. The productivity Myth of chat Your situation may differ – please TEST!
  • 49. Call tracking How it works: Rent a bank of numbers Add a dynamic ‘tag’ to your page Phone number appears automatically Customer calls this number Captures the keywords, landing page, converting page, traffic source Geo mapping captures customer location When the call is hung up, optionally record the outcome code (sale, loss) Have a special number for Facebook, SEO, Adwords traffic etc. Lets you analyse from web -> phone call -> wait time -> wrapping Builds a link between web and call, finally
  • 50. Call tracking Why you should use it! Most people under-report on web driven phone contact or sales You can’t work out your advertising effectiveness, if you don’t include phone If you don’t measure phone, your A/B tests may be wrong You can capture all your web AND phone, in one easy interface Allows you a multi-channel view of all your contact sources Lets you record offline campaigns as well with specific numbers (print, TV etc.) You can experiment with routing, messages, on hold music – much more easily If you can’t afford lots of phone numbers, this is an easy way to get tracking
  • 51. Who? * I read up on these or talked to them. These are my picks.
  • 52. Call tracking What data can you get? Data to keyword, group or traffic source level – for Phone contact/conversions Splits by location, traffic source, time, date Data on the call – how long to answer, to abandon, call duration Data post call – was there a sale? Linkage between marketing activity and phone ROI on web channels Which parts of your site drive contact Tagging supports GA, Omniture, Others Complete call analytics (including recording, if wanted)
  • 53. Tracking tips Make contact points trackable (phone, email, form, chat etc.) For example: Collapsible phone section on Contact Us form – tracks intent Phone ‘reveal’ icon, button or widget – tracks intent Tap to call wrapper on Phone Use a smart email form instead of email address Use ‘ringme’ ringback functionality If email being generated, tweak subject line Integrate call centre events for maximum coverage If you can’t buy phone tracking, make your own (mail me!) Use phone tracking for major traffic groups, say: PPC groups, Organic, Print, PPC, email, TV, Brand keywords See your phone traffic in GA, Omniture and most packages
  • 54. Belron Conversion ROI 12.4% from Web increase 12.5% increase from Multi Variate Testing 3.5% increase in downstream conversion rate 4% increase in online conversion from mobile optimised site Reduced call time (1s = 10k p.a.) Faster booking time (<4%) 5.5% increase in NPS (Customer sat) score Customer delight – feedback. Less questions and worries Total increase in conversion (measured) = 32% Actual increase in conversion = 41% NO additional marketing spend needed Web Channel : ROI positive within 2 weeks
  • 55. Further reading… Any questions? Get in touch! : sullivac@gmail.com : @OptimiseOrDie : linkd.in/pvrg14 : slidesha.re/nlCDm6 Email Twitter Slideshare
  • 56. CRO and Testing resources 101 Landing page tips : slidesha.re/8OnBRh 544 Optimisation tips : bit.ly/8mkWOB 108 Optimisation tips : bit.ly/3Z6GrP 32 CRO tips : bit.ly/4BZjcW 57 CRO books : bit.ly/dDjDRJ CRO article list :bit.ly/nEUgui Smashing Mag article : bit.ly/8X2fLk