SlideShare a Scribd company logo
1 of 17
Jason Evanish
Product, KISSmetrics
Kickass Products Meetup
April 24, 2013
Source: “The Inconvenient Truth About Product”, March 17, 2013
404 Tests
Source: scapromotions.com
Source: MakeCheckThink Blog, August 25, 2012
Source: “Value Creation vs. Value Capture”, April 21, 2013
Product Experiments

More Related Content

More from Jason Evanish

Everything you need to know about 1 on 1s to prevent turnover and motivate yo...
Everything you need to know about 1 on 1s to prevent turnover and motivate yo...Everything you need to know about 1 on 1s to prevent turnover and motivate yo...
Everything you need to know about 1 on 1s to prevent turnover and motivate yo...Jason Evanish
 
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...Jason Evanish
 
10 Things They Don't Teach You in College About Entrepreneurship
10 Things They Don't Teach You in College About Entrepreneurship10 Things They Don't Teach You in College About Entrepreneurship
10 Things They Don't Teach You in College About EntrepreneurshipJason Evanish
 
Getting to Product Market Fit - An Overview of Customer Discovery & Validation
Getting to Product Market Fit - An Overview of Customer Discovery & ValidationGetting to Product Market Fit - An Overview of Customer Discovery & Validation
Getting to Product Market Fit - An Overview of Customer Discovery & ValidationJason Evanish
 
A Greenhorn's Journey - Social Entrepreneur Edition
A Greenhorn's Journey - Social Entrepreneur EditionA Greenhorn's Journey - Social Entrepreneur Edition
A Greenhorn's Journey - Social Entrepreneur EditionJason Evanish
 
Greenhorn Connect: Advice on Partnerships for Startups
Greenhorn Connect: Advice on Partnerships for StartupsGreenhorn Connect: Advice on Partnerships for Startups
Greenhorn Connect: Advice on Partnerships for StartupsJason Evanish
 
The Boston Entrepreneur Ecosystem: Presentation at Northeastern University
The Boston Entrepreneur Ecosystem: Presentation at Northeastern UniversityThe Boston Entrepreneur Ecosystem: Presentation at Northeastern University
The Boston Entrepreneur Ecosystem: Presentation at Northeastern UniversityJason Evanish
 
The Entrepreneur Road
The Entrepreneur RoadThe Entrepreneur Road
The Entrepreneur RoadJason Evanish
 
GreenhornTV Ep. 45 for Oct 10th to Oct 16th
GreenhornTV Ep. 45 for Oct 10th to Oct 16thGreenhornTV Ep. 45 for Oct 10th to Oct 16th
GreenhornTV Ep. 45 for Oct 10th to Oct 16thJason Evanish
 
How to make the most of startup weekend
How to make the most of startup weekendHow to make the most of startup weekend
How to make the most of startup weekendJason Evanish
 
A Greenhorn's Journey
A Greenhorn's JourneyA Greenhorn's Journey
A Greenhorn's JourneyJason Evanish
 

More from Jason Evanish (12)

Everything you need to know about 1 on 1s to prevent turnover and motivate yo...
Everything you need to know about 1 on 1s to prevent turnover and motivate yo...Everything you need to know about 1 on 1s to prevent turnover and motivate yo...
Everything you need to know about 1 on 1s to prevent turnover and motivate yo...
 
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
 
10 Things They Don't Teach You in College About Entrepreneurship
10 Things They Don't Teach You in College About Entrepreneurship10 Things They Don't Teach You in College About Entrepreneurship
10 Things They Don't Teach You in College About Entrepreneurship
 
Getting to Product Market Fit - An Overview of Customer Discovery & Validation
Getting to Product Market Fit - An Overview of Customer Discovery & ValidationGetting to Product Market Fit - An Overview of Customer Discovery & Validation
Getting to Product Market Fit - An Overview of Customer Discovery & Validation
 
Lean startup 101
Lean startup 101Lean startup 101
Lean startup 101
 
A Greenhorn's Journey - Social Entrepreneur Edition
A Greenhorn's Journey - Social Entrepreneur EditionA Greenhorn's Journey - Social Entrepreneur Edition
A Greenhorn's Journey - Social Entrepreneur Edition
 
Greenhorn Connect: Advice on Partnerships for Startups
Greenhorn Connect: Advice on Partnerships for StartupsGreenhorn Connect: Advice on Partnerships for Startups
Greenhorn Connect: Advice on Partnerships for Startups
 
The Boston Entrepreneur Ecosystem: Presentation at Northeastern University
The Boston Entrepreneur Ecosystem: Presentation at Northeastern UniversityThe Boston Entrepreneur Ecosystem: Presentation at Northeastern University
The Boston Entrepreneur Ecosystem: Presentation at Northeastern University
 
The Entrepreneur Road
The Entrepreneur RoadThe Entrepreneur Road
The Entrepreneur Road
 
GreenhornTV Ep. 45 for Oct 10th to Oct 16th
GreenhornTV Ep. 45 for Oct 10th to Oct 16thGreenhornTV Ep. 45 for Oct 10th to Oct 16th
GreenhornTV Ep. 45 for Oct 10th to Oct 16th
 
How to make the most of startup weekend
How to make the most of startup weekendHow to make the most of startup weekend
How to make the most of startup weekend
 
A Greenhorn's Journey
A Greenhorn's JourneyA Greenhorn's Journey
A Greenhorn's Journey
 

Recently uploaded

Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 

Recently uploaded (20)

Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 

Product Experiments

Editor's Notes

  1. So the more I thought about, the more I thought about Marty Cagan's post "The inconvenient truth about product" which basically says that every feature you build, even the stuff you launch is still an experiment and might fail.  Thinking that all product is an experiment got me thinking about framing my talk around that concept and the tools we use at KISSmetrics to try to succeed more than we fail on our "experiments". Let me know if that's off track from what you're getting from other panelists.
  2. This is great when you’re just starting out. Sell the value proposition. It’s less valuable once you have a product, but can often turn into your marketing site. This is great when you don't have a site yet. Once you have a product, less valuable. We're launching a mobile app (see myanalyticsapp.com) and used this and have thousands of sign ups
  3. Copy, color, flow, information on the page Good for: Marketing Site, on boarding.
  4. We don't do much of this because we love doing the next one...
  5. Validate what they need We ask our customers questions all the time
  6. We'll search parts of our user base to ask questions of them (use our own product's People Search for this) We always like to have already done some CustDev interviews to better inform the questions 10 open ended questions is a total fail. Have direct discussions if you don't know what to ask
  7. We don't like using these to share with customers bc most don't know how to imagine something will work in our experience
  8. Share with customers or potential ones a prototype so they can see how it actually works. This helps ourselves too. We test it on ourselves
  9. We have a feedback box on every page on the site. We get 50+ emails every week filled with passionate, frustrated, excited, confused users. The perfect group to experiment with. I'll go back to old ones to reach out about experiments or if they're asking about stuff we're currently thinking about I'll send it right away...they may be just the early adopter we want for such a feature.
  10. Turn on a feature for a customer with the check of a box, that way you only do it for a few people to get key feedback. Allows you to start getting feedback sooner as you manage the expectations of those seeing it
  11. We've been trying not to overbuild things lately and so that means often taking away as much as we can and focusing on releasing only the absolutely core problem. We've already found how that changes our priorities, while getting something out the door faster.
  12. I saw this post over the weekend an thought it hammered home what I hope you take away from today. There’s a lot of great tactics you can apply, but they’re all there just to deliver on on goal.