SlideShare une entreprise Scribd logo
1  sur  35
Télécharger pour lire hors ligne
Julia Birks
Strategic Design Lead, Isobar
Twitter @juliabirks
Dave Calleja
Associate Design Director -
Experimentation
Twitter @davecalleja
Introductions
Insights Island
How do you even decide what
you’re building?
Do you want profits???
SERIOUSLY.
If you’re not
collecting insights
around users’
needs, start doing
it NOW!
@juliabirks • @davecalleja • @isobarAU
Insights Island: A scary slide you need to pay attention to
“Our customers will
show us what
they need”
“We know better
than our customers”
@juliabirks • @davecalleja • @isobarAU
17%
3%
CX Leaders CX laggards
Compound average revenue growth 2010-15
Source: June 21, 2016 “Customer Experience Drives Revenue Growth, 2016” Forrester report
So you’re
collecting
insights!
Insights Island
@juliabirks • @davecalleja • @isobarAU
Lesson 1:
Know you’re stuck on
Insights Island
Lesson 2:
Value Atoll is a real place*
*But not really
Lesson 3:
Get to Value Atoll by creating
an experimentation culture
Ways of working
that enable
experimentation
AKA The speedboat
@juliabirks • @davecalleja • @isobarAU
Ways of Working
Principles over
process
Create guiding principles
Maximise opportunities
to deliver value
Don’t be a process zealot!
@juliabirks • @davecalleja • @isobarAU
Design and deliver
it together
Ways of Working
Diverse teams
From gender to skills
Minimise silos
Maximise knowledge sharing
Design with users
Customers and staff
@juliabirks • @davecalleja • @isobarAU
Every good team needs a coach
Ways of Working
@juliabirks • @davecalleja • @isobarAU
Value lives in
the middle
DESIRABILITY
VIABILITY FEASIBILITY
Ways of Working
@juliabirks • @davecalleja • @isobarAU
Desirable and feasible?
You can’t service it or
afford it
Desirable and viable?
It’s a great idea that can’t
be built
Viable and feasible?
No customer wants it
Value lives in
the middle
Ways of Working
@juliabirks • @davecalleja • @isobarAU
Value lives in
the middle
DESIRABILITY
VIABILITY FEASIBILITY
Ways of Working
@juliabirks • @davecalleja • @isobarAU
Run all the
experiments
Ways of Working
@juliabirks • @davecalleja • @isobarAU
Run all the
experiments
Refinement Exploration
Best solution
is missed
Many alternate
solutions explored
Ways of Working
@juliabirks • @davecalleja • @isobarAU
Run all of the experiments
Run all the experiments
ANZ Small Business ATM
Enabling
experimentation
through culture
AKA The sea
Create
psychological
safety
Culture of Enablement
More likely to own mistakes
Better partners to their colleagues
Less likely to leave
More openness to diverse ideas
@juliabirks • @davecalleja • @isobarAU
Don’t fail —
disprove your
hypothesis
Culture of Enablement
‘Fail fast, fail often’ is a goal
Promote learning through
experimentation
“I have a hypothesis, let’s go
and test it”
Accept and celebrate killing ideas
@juliabirks • @davecalleja • @isobarAU
Democratise
your ideas
Culture of Enablement
Evidence based decision making
Empower everyone
to contribute ideas
Establish an idea or
experiment framework
@juliabirks • @davecalleja • @isobarAU
Experimentation Framework - Hypothesis & Ideation
IF
OPPORTUNITY OR CHALLENGE
Any aspect of the experience or system
which could be improved
This is not the specific change e.g
moving an element on a page.
THEN
PREDICTED RESULT
What is the expected outcome of the
solution?
How will the business or user be
impacted?
BECAUSE
RATIONALE
Why do we believe the result will occur?
What insights inform this?
PROFESSIONAL HUNCH QUALITATIVE DATA QUANTITATIVE DATA
PRIMARY METRIC SECONDARY/MONITORING METRICS TARGET / AUDIENCE
@juliabirks • @davecalleja • @isobarAU
Experimentation Framework - Planning & Development
Plann
BUSINESS & CUSTOMER IMPACT DESIGN & DEVELOPMENT EFFORT DURATION
LOW HIGHLEVEL OF EFFORT
DEGREEOFIMPACTHIGHLOW
QUICK WINS
HARD SLOGS
@juliabirks • @davecalleja • @isobarAU
“...When you are lacking in faith,
Others will be unfaithful to you…”
- Lao Tzu, writing in the Tao Te Ching
Culture of Enablement
Unblock issues
Trust teams to try, be like
the bumpers in bowling
Develop skills and
confidence
Enable autonomy,
mastery, and purpose
Foster servant
leadership
@juliabirks • @davecalleja • @isobarAU
Lead by doing
Culture of Enablement
Organisational
belief
Team/group belief
Professional belief
Self belief
Structure
Business benefits
Governance
Strategy and vision
Ways of working
Team dynamics
Vision alignment
Future skills
Quality & craft
Mastery
Fulfillment
Wellness
Social Connections
Purpose
@juliabirks • @davecalleja • @isobarAU
Bringing it all
together
Bringing it all together
Define & Ideate
Discover & Learn Design & Build
Deliver & Test
Form & Align
Review Prepare
Test
A case study
@juliabirks • @davecalleja • @isobarAU
Run all of the experiments
Bringing it all together
Finding wins
Delivering value through experimentation, from LAST Conference 2018 in Melbourne
Delivering value through experimentation, from LAST Conference 2018 in Melbourne

Contenu connexe

Tendances

No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
Matthew Philip
 
Beyond KPIs & OKRs: How “measuring from below” enables innovation and true ef...
Beyond KPIs & OKRs: How “measuring from below” enables innovation and true ef...Beyond KPIs & OKRs: How “measuring from below” enables innovation and true ef...
Beyond KPIs & OKRs: How “measuring from below” enables innovation and true ef...
Jutta Eckstein
 
Infinite MVP Development Solutions
Infinite MVP Development SolutionsInfinite MVP Development Solutions
Infinite MVP Development Solutions
Xavier Johnson
 

Tendances (20)

How Atlassian's User Research Went Agile (and So Can Yours)
How Atlassian's User Research Went Agile (and So Can Yours)How Atlassian's User Research Went Agile (and So Can Yours)
How Atlassian's User Research Went Agile (and So Can Yours)
 
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
 
Fa102 assignment one
Fa102 assignment oneFa102 assignment one
Fa102 assignment one
 
Product Management Bootcamp (16 Jan 2016)
Product Management Bootcamp (16 Jan 2016)Product Management Bootcamp (16 Jan 2016)
Product Management Bootcamp (16 Jan 2016)
 
Digital Experiments - Action Design DC 10 Sept 15
Digital Experiments - Action Design DC 10 Sept 15Digital Experiments - Action Design DC 10 Sept 15
Digital Experiments - Action Design DC 10 Sept 15
 
Loggable
LoggableLoggable
Loggable
 
Meaningful Metrics for Startups
Meaningful Metrics for StartupsMeaningful Metrics for Startups
Meaningful Metrics for Startups
 
Acceptance, accessible, actionable and auditable
Acceptance, accessible, actionable and auditableAcceptance, accessible, actionable and auditable
Acceptance, accessible, actionable and auditable
 
Is data visualisation bullshit?
Is data visualisation bullshit?Is data visualisation bullshit?
Is data visualisation bullshit?
 
Beyond KPIs & OKRs: How “measuring from below” enables innovation and true ef...
Beyond KPIs & OKRs: How “measuring from below” enables innovation and true ef...Beyond KPIs & OKRs: How “measuring from below” enables innovation and true ef...
Beyond KPIs & OKRs: How “measuring from below” enables innovation and true ef...
 
ProductTank Amsterdam January 2015 - Ivar Pruijn
ProductTank Amsterdam January 2015 - Ivar PruijnProductTank Amsterdam January 2015 - Ivar Pruijn
ProductTank Amsterdam January 2015 - Ivar Pruijn
 
Get it right the first time - AJ Davis - Product Camp Austin 2018
Get it right the first time - AJ Davis - Product Camp Austin 2018Get it right the first time - AJ Davis - Product Camp Austin 2018
Get it right the first time - AJ Davis - Product Camp Austin 2018
 
Growth Hacking: The Human Operating System for Martech (Marketing Technology)
Growth Hacking: The Human Operating System for Martech (Marketing Technology)Growth Hacking: The Human Operating System for Martech (Marketing Technology)
Growth Hacking: The Human Operating System for Martech (Marketing Technology)
 
Prototyping 101 TajRiba
Prototyping 101 TajRibaPrototyping 101 TajRiba
Prototyping 101 TajRiba
 
Infinite MVP Development Solutions
Infinite MVP Development SolutionsInfinite MVP Development Solutions
Infinite MVP Development Solutions
 
Mastering the Blog: A Step-by-Step Plan from Launch to Leads
Mastering the Blog: A Step-by-Step Plan from Launch to LeadsMastering the Blog: A Step-by-Step Plan from Launch to Leads
Mastering the Blog: A Step-by-Step Plan from Launch to Leads
 
Startups for Non-Technical Founders
Startups for Non-Technical FoundersStartups for Non-Technical Founders
Startups for Non-Technical Founders
 
"Building a Company Wide Growth Culture" at SaaStr Annual 2016
"Building a Company Wide Growth Culture" at SaaStr Annual 2016"Building a Company Wide Growth Culture" at SaaStr Annual 2016
"Building a Company Wide Growth Culture" at SaaStr Annual 2016
 
Grow with CRO - 7 Ways CRO is a Growth Driver for Your Business
Grow with CRO - 7 Ways CRO is a Growth Driver for Your BusinessGrow with CRO - 7 Ways CRO is a Growth Driver for Your Business
Grow with CRO - 7 Ways CRO is a Growth Driver for Your Business
 
Amy S Friend-stc-spectrum-Lickety-Split-Learning-Agile-2014
Amy S Friend-stc-spectrum-Lickety-Split-Learning-Agile-2014Amy S Friend-stc-spectrum-Lickety-Split-Learning-Agile-2014
Amy S Friend-stc-spectrum-Lickety-Split-Learning-Agile-2014
 

Similaire à Delivering value through experimentation, from LAST Conference 2018 in Melbourne

GA_LeanResearch
GA_LeanResearchGA_LeanResearch
GA_LeanResearch
Liya James
 

Similaire à Delivering value through experimentation, from LAST Conference 2018 in Melbourne (20)

LEAN - Measuring Value in Early Stage Products or Services
LEAN - Measuring Value in Early Stage Products or ServicesLEAN - Measuring Value in Early Stage Products or Services
LEAN - Measuring Value in Early Stage Products or Services
 
UX Field Research Toolkit - A Workshop at Big Design - 2017
UX Field Research Toolkit - A Workshop at Big Design - 2017UX Field Research Toolkit - A Workshop at Big Design - 2017
UX Field Research Toolkit - A Workshop at Big Design - 2017
 
Innovate Series - Finding Product Market Fit
Innovate Series - Finding Product Market FitInnovate Series - Finding Product Market Fit
Innovate Series - Finding Product Market Fit
 
Developing Your Digital Genius Through Storytelling - How To Grow Your Busine...
Developing Your Digital Genius Through Storytelling - How To Grow Your Busine...Developing Your Digital Genius Through Storytelling - How To Grow Your Busine...
Developing Your Digital Genius Through Storytelling - How To Grow Your Busine...
 
Vanity vs impact presentation
Vanity vs impact presentationVanity vs impact presentation
Vanity vs impact presentation
 
UX Field Research Toolkit - Updated for Big Design 2018
UX Field Research Toolkit - Updated for Big Design 2018UX Field Research Toolkit - Updated for Big Design 2018
UX Field Research Toolkit - Updated for Big Design 2018
 
Numberstories 151105195238-lva1-app6892
Numberstories 151105195238-lva1-app6892Numberstories 151105195238-lva1-app6892
Numberstories 151105195238-lva1-app6892
 
Number Stories: Win Friends and Influence HiPPOs with an Effective Measuremen...
Number Stories: Win Friends and Influence HiPPOs with an Effective Measuremen...Number Stories: Win Friends and Influence HiPPOs with an Effective Measuremen...
Number Stories: Win Friends and Influence HiPPOs with an Effective Measuremen...
 
Become a social media super hero
Become a social media super heroBecome a social media super hero
Become a social media super hero
 
Doors, Walls and Old Trees: Prioritizing to Get Simple
Doors, Walls and Old Trees: Prioritizing to Get SimpleDoors, Walls and Old Trees: Prioritizing to Get Simple
Doors, Walls and Old Trees: Prioritizing to Get Simple
 
Testing the unknown: the art and science of working with hypothesis
Testing the unknown: the art and science of working with hypothesisTesting the unknown: the art and science of working with hypothesis
Testing the unknown: the art and science of working with hypothesis
 
Positioning Internal Audit for the Future
Positioning Internal Audit for the FuturePositioning Internal Audit for the Future
Positioning Internal Audit for the Future
 
Webinars kpi version dschool 2014 11
Webinars kpi version dschool 2014 11Webinars kpi version dschool 2014 11
Webinars kpi version dschool 2014 11
 
Lean LaunchPad e@UBC Lessons Learned presented at iHub Nairobi 2014.08.12
Lean LaunchPad e@UBC Lessons Learned presented at iHub Nairobi 2014.08.12Lean LaunchPad e@UBC Lessons Learned presented at iHub Nairobi 2014.08.12
Lean LaunchPad e@UBC Lessons Learned presented at iHub Nairobi 2014.08.12
 
Going Beta Will Set You Free by Jake Bennett of POP - Seattle Interactive Con...
Going Beta Will Set You Free by Jake Bennett of POP - Seattle Interactive Con...Going Beta Will Set You Free by Jake Bennett of POP - Seattle Interactive Con...
Going Beta Will Set You Free by Jake Bennett of POP - Seattle Interactive Con...
 
GA_LeanResearch
GA_LeanResearchGA_LeanResearch
GA_LeanResearch
 
Do you need a Better Conversion Rate? - Growth Hacking Toronto
Do you need a Better Conversion Rate? - Growth Hacking TorontoDo you need a Better Conversion Rate? - Growth Hacking Toronto
Do you need a Better Conversion Rate? - Growth Hacking Toronto
 
How to Capitalize on the Buzz around Quizzes
How to Capitalize on the Buzz around QuizzesHow to Capitalize on the Buzz around Quizzes
How to Capitalize on the Buzz around Quizzes
 
Evan Hamilton: How to Find the ROI of Community Management
Evan Hamilton: How to Find the ROI of Community ManagementEvan Hamilton: How to Find the ROI of Community Management
Evan Hamilton: How to Find the ROI of Community Management
 
UX Conversion Camp: Shop Direct
UX Conversion Camp: Shop DirectUX Conversion Camp: Shop Direct
UX Conversion Camp: Shop Direct
 

Dernier

Beyond the Codes_Repositioning towards sustainable development
Beyond the Codes_Repositioning towards sustainable developmentBeyond the Codes_Repositioning towards sustainable development
Beyond the Codes_Repositioning towards sustainable development
Nimot Muili
 
Agile Coaching Change Management Framework.pptx
Agile Coaching Change Management Framework.pptxAgile Coaching Change Management Framework.pptx
Agile Coaching Change Management Framework.pptx
alinstan901
 
Abortion pills in Jeddah |• +966572737505 ] GET CYTOTEC
Abortion pills in Jeddah |• +966572737505 ] GET CYTOTECAbortion pills in Jeddah |• +966572737505 ] GET CYTOTEC
Abortion pills in Jeddah |• +966572737505 ] GET CYTOTEC
Abortion pills in Riyadh +966572737505 get cytotec
 

Dernier (15)

How Software Developers Destroy Business Value.pptx
How Software Developers Destroy Business Value.pptxHow Software Developers Destroy Business Value.pptx
How Software Developers Destroy Business Value.pptx
 
Intro_University_Ranking_Introduction.pptx
Intro_University_Ranking_Introduction.pptxIntro_University_Ranking_Introduction.pptx
Intro_University_Ranking_Introduction.pptx
 
Strategic Management, Vision Mission, Internal Analsysis
Strategic Management, Vision Mission, Internal AnalsysisStrategic Management, Vision Mission, Internal Analsysis
Strategic Management, Vision Mission, Internal Analsysis
 
Beyond the Codes_Repositioning towards sustainable development
Beyond the Codes_Repositioning towards sustainable developmentBeyond the Codes_Repositioning towards sustainable development
Beyond the Codes_Repositioning towards sustainable development
 
International Ocean Transportation p.pdf
International Ocean Transportation p.pdfInternational Ocean Transportation p.pdf
International Ocean Transportation p.pdf
 
BDSM⚡Call Girls in Sector 99 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 99 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 99 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 99 Noida Escorts >༒8448380779 Escort Service
 
Reviewing and summarization of university ranking system to.pptx
Reviewing and summarization of university ranking system  to.pptxReviewing and summarization of university ranking system  to.pptx
Reviewing and summarization of university ranking system to.pptx
 
Marketing Management 16th edition by Philip Kotler test bank.docx
Marketing Management 16th edition by Philip Kotler test bank.docxMarketing Management 16th edition by Philip Kotler test bank.docx
Marketing Management 16th edition by Philip Kotler test bank.docx
 
Leaders enhance communication by actively listening, providing constructive f...
Leaders enhance communication by actively listening, providing constructive f...Leaders enhance communication by actively listening, providing constructive f...
Leaders enhance communication by actively listening, providing constructive f...
 
internal analysis on strategic management
internal analysis on strategic managementinternal analysis on strategic management
internal analysis on strategic management
 
Agile Coaching Change Management Framework.pptx
Agile Coaching Change Management Framework.pptxAgile Coaching Change Management Framework.pptx
Agile Coaching Change Management Framework.pptx
 
Abortion pills in Jeddah |• +966572737505 ] GET CYTOTEC
Abortion pills in Jeddah |• +966572737505 ] GET CYTOTECAbortion pills in Jeddah |• +966572737505 ] GET CYTOTEC
Abortion pills in Jeddah |• +966572737505 ] GET CYTOTEC
 
Independent Escorts Vikaspuri / 9899900591 High Profile Escort Service in Delhi
Independent Escorts Vikaspuri  / 9899900591 High Profile Escort Service in DelhiIndependent Escorts Vikaspuri  / 9899900591 High Profile Escort Service in Delhi
Independent Escorts Vikaspuri / 9899900591 High Profile Escort Service in Delhi
 
Safety T fire missions army field Artillery
Safety T fire missions army field ArtillerySafety T fire missions army field Artillery
Safety T fire missions army field Artillery
 
Dealing with Poor Performance - get the full picture from 3C Performance Mana...
Dealing with Poor Performance - get the full picture from 3C Performance Mana...Dealing with Poor Performance - get the full picture from 3C Performance Mana...
Dealing with Poor Performance - get the full picture from 3C Performance Mana...
 

Delivering value through experimentation, from LAST Conference 2018 in Melbourne

  • 1.
  • 2. Julia Birks Strategic Design Lead, Isobar Twitter @juliabirks Dave Calleja Associate Design Director - Experimentation Twitter @davecalleja Introductions
  • 3.
  • 4.
  • 5. Insights Island How do you even decide what you’re building? Do you want profits??? SERIOUSLY. If you’re not collecting insights around users’ needs, start doing it NOW! @juliabirks • @davecalleja • @isobarAU
  • 6. Insights Island: A scary slide you need to pay attention to “Our customers will show us what they need” “We know better than our customers” @juliabirks • @davecalleja • @isobarAU 17% 3% CX Leaders CX laggards Compound average revenue growth 2010-15 Source: June 21, 2016 “Customer Experience Drives Revenue Growth, 2016” Forrester report
  • 8.
  • 9. Lesson 1: Know you’re stuck on Insights Island
  • 10. Lesson 2: Value Atoll is a real place* *But not really
  • 11. Lesson 3: Get to Value Atoll by creating an experimentation culture
  • 12.
  • 13. Ways of working that enable experimentation AKA The speedboat @juliabirks • @davecalleja • @isobarAU
  • 14. Ways of Working Principles over process Create guiding principles Maximise opportunities to deliver value Don’t be a process zealot! @juliabirks • @davecalleja • @isobarAU
  • 15. Design and deliver it together Ways of Working Diverse teams From gender to skills Minimise silos Maximise knowledge sharing Design with users Customers and staff @juliabirks • @davecalleja • @isobarAU
  • 16. Every good team needs a coach Ways of Working @juliabirks • @davecalleja • @isobarAU
  • 17. Value lives in the middle DESIRABILITY VIABILITY FEASIBILITY Ways of Working @juliabirks • @davecalleja • @isobarAU
  • 18. Desirable and feasible? You can’t service it or afford it Desirable and viable? It’s a great idea that can’t be built Viable and feasible? No customer wants it Value lives in the middle Ways of Working @juliabirks • @davecalleja • @isobarAU
  • 19. Value lives in the middle DESIRABILITY VIABILITY FEASIBILITY Ways of Working @juliabirks • @davecalleja • @isobarAU
  • 20. Run all the experiments Ways of Working @juliabirks • @davecalleja • @isobarAU
  • 21. Run all the experiments Refinement Exploration Best solution is missed Many alternate solutions explored Ways of Working @juliabirks • @davecalleja • @isobarAU
  • 22. Run all of the experiments Run all the experiments ANZ Small Business ATM
  • 24. Create psychological safety Culture of Enablement More likely to own mistakes Better partners to their colleagues Less likely to leave More openness to diverse ideas @juliabirks • @davecalleja • @isobarAU
  • 25. Don’t fail — disprove your hypothesis Culture of Enablement ‘Fail fast, fail often’ is a goal Promote learning through experimentation “I have a hypothesis, let’s go and test it” Accept and celebrate killing ideas @juliabirks • @davecalleja • @isobarAU
  • 26. Democratise your ideas Culture of Enablement Evidence based decision making Empower everyone to contribute ideas Establish an idea or experiment framework @juliabirks • @davecalleja • @isobarAU
  • 27. Experimentation Framework - Hypothesis & Ideation IF OPPORTUNITY OR CHALLENGE Any aspect of the experience or system which could be improved This is not the specific change e.g moving an element on a page. THEN PREDICTED RESULT What is the expected outcome of the solution? How will the business or user be impacted? BECAUSE RATIONALE Why do we believe the result will occur? What insights inform this? PROFESSIONAL HUNCH QUALITATIVE DATA QUANTITATIVE DATA PRIMARY METRIC SECONDARY/MONITORING METRICS TARGET / AUDIENCE @juliabirks • @davecalleja • @isobarAU
  • 28. Experimentation Framework - Planning & Development Plann BUSINESS & CUSTOMER IMPACT DESIGN & DEVELOPMENT EFFORT DURATION LOW HIGHLEVEL OF EFFORT DEGREEOFIMPACTHIGHLOW QUICK WINS HARD SLOGS @juliabirks • @davecalleja • @isobarAU
  • 29. “...When you are lacking in faith, Others will be unfaithful to you…” - Lao Tzu, writing in the Tao Te Ching Culture of Enablement Unblock issues Trust teams to try, be like the bumpers in bowling Develop skills and confidence Enable autonomy, mastery, and purpose Foster servant leadership @juliabirks • @davecalleja • @isobarAU
  • 30. Lead by doing Culture of Enablement Organisational belief Team/group belief Professional belief Self belief Structure Business benefits Governance Strategy and vision Ways of working Team dynamics Vision alignment Future skills Quality & craft Mastery Fulfillment Wellness Social Connections Purpose @juliabirks • @davecalleja • @isobarAU
  • 32. Bringing it all together Define & Ideate Discover & Learn Design & Build Deliver & Test Form & Align Review Prepare Test A case study @juliabirks • @davecalleja • @isobarAU
  • 33. Run all of the experiments Bringing it all together Finding wins