SlideShare une entreprise Scribd logo
1  sur  30
@vladblagojevic
 @nickboucart
  @sirris_be
Agile Development
   is good for…
Will agile help them build better
            products?
Google Wave




Build it, and they will come…
(good products = big bucks)

           Right?
What do you need for a successful business?
Auto/pers
                 What                    onal/comm
                 will you                unities?
                 need to    What do                    Who are
What can         master?    you offer?                 your
you                         Value?                     customer
outsource                   Uniqueness                 s?
to whom?                    ?
                What do                  How to
                you need                 communic
                to build                 ate &
                up?                      deliver?

                                                How will
            What                                you make
            are my                              money?
            costs?
Groupon: deal of the day in your inbox.

Get 50%-90% off the best stuff your city has to
   offer.
Merchant                              Personal/Call
                        Acquisition                             Centers
                       Copy-writing
                                                              Automated/
                           Deal                 New, local                               Merchants
                                                                E-mail
                         selection              customers
                                              (guarantee #)

                                                                                         Consumers
                                               Discounts
                                                               Direct sales
                          Email DB
                                                              Google ads
                       Personalization
                           engine                             Social media




                                                                       50% commission
                               Cust. acquisition
    Merchant                   (30% of revenue)                        20% unfulfilled
Acquisition (sales =
                                                                         groupons
  ½ employees)                        Churn
Entrepreneurship as a science
began as a MMO game
                              What happened
                                       here?



began with PDA payment tool
Who is the
customer?

What do they
value?

What is our product
anyway?
”Startup   is    a   temporary
 organization with purpose to
 search for a repeatable and
 scalable business model.

                           S. Blank


      Startup ~ research
State
            Hypotheses




 Pivot or
                         Experiment
persevere
State
            Hypotheses




 Pivot or
                         Experiment
persevere
parkr™

                Bootstrapping:
                parking scouts                      SMS
                                      Help find                      Drivers in
                                      parking     Mobile app
GPS producers                                                          cities
                                      Monetize
                Near-location          unused
                 notifier + UI        parking     App store
                 Community                          Viral
                 User credit
                   cards


                                                              Micro
                    Community                               commission
     Platform     (parking spotter)
parkr™

                Bootstrapping:
                parking scouts                  SMS
                                  Help find
                                  parking     Mobile app        Drivers in
GPS producers
                                                                  cities
                                  Monetize
                Near-location      unused
                 notifier + UI    parking     App store
                 Community                      Viral
                 User credit
                   cards

                                                             Micro
                                                           commission
                     Community
    Platform          (scouts)
Customers                                       Problem
do I know who they are & how to reach              top 3 customer problems?
               them?
                                                 Pain level: must have vs nice to
    Segment? Early adopter?                      have
    Roles: user, economic buyer,
                                                 Awareness: active vs. latent
     influencer, saboteur?
    How do they search for                      Alternatives : how do they deal
     products?                                    with these problems today?


                                   Solution
                              top 3 product features?
          Do they solve the top 3 problems?
          Barriers to adoption (e.g. fit/integration with existing workflow)?
          Is my price accepted?
State
            Hypotheses




 Pivot or
                         Experiment
persevere
A 1st problem is…            Would you pay $20 a
Does this resonate with      month to use a tool like
you? How do you deal         this?
with it today?
Is it a must-have?...




  This is how our solution looks today
  (screen per problem).
  Which of the screens resonated the
  most? Which could you live without?
  Are there any additional features you
  think are missing?                        Use Mocks
Trouble Parking in Brussels?
www.parkr.com
Find parking when you need it.
Park easily in busy streets of Brussels

Paying too much for parking?
www.parkr.com
Monetize your unused parking time and
help others find free parking!
Concierge MVP   Wizard of Oz
Document
            Hypotheses




 Pivot or                Experiment
persevere
CHEATSHEET

                                   Customer problem pivot: same product, same segment,
                                   different problem
   Change of an aspect of          Starbucks : started selling coffee beans & espresso makers
                                   Segment pivot: same product , similar problem,
    a business model               different set of customers
                                    e.g. consumers aren’t buying, enterprises have a similar problem

     Successful startups           Sometimes a pure marketing change
                                   Technology pivot: repurpose the technology to solve a
      change direction quickly     more pressing or marketable problem
                                   Product feature pivot: remove features for focus, or to
     Based on learning            add features for a more holistic solution
                                    pay close attention to what real customers are doing
                                   Revenue model pivot
                                    e.g. from a premium customized, to a low price commoditized solution
   Grounded in the vision          e.g. from a one-time sale to monthly subscription or license fees
                                    e.g. razor versus blade strategy

     They keep one foot in the    Sales channel pivot: use lessons learned from customers
                                   to switch from direct sales
      past and place one foot in    E.g. distribution channel, ecommerce, white-labeling …
                                   Product versus services pivot: if products are too
      a new possible future        different or too complex to be sold effectively to the
                                   customer with the problem
                                    bundle support services with the product, education offerings...

   Vision: search space           Major competitor pivot: react when a major new player
                                   or competitor jumps into your space
                                    one of the above pivots to build your differentiation and stay alive
Parkr™ foursquare for parking spots

                Bootstrapping:
                parking scouts                          SMS
                                       Help find
                                       parking       Community         Drivers in
GPS producers
                                                                         cities
                                       Monetize
                Near-location           unused
                 notifier + UI         parking        App store
                 Community                              Viral            Cities
                                      Promoting
                 User credit             public
                   cards                             Mobile app
                                       transport

                                                   App fee          Micro
                       Building                                   commission
     Platform        Community                     Subvention
                    (critical mass)
IDEAS


     Pivot                                Continuous
             LEARN              BUILD
Root-cause                                deployment



             DATA               PRODUCT




                      MEASURE




                      Metrics                        Lean startup
                     Feedback             build-measure-learn loop
                                                       by Eric Ries
   Counter-intuitive and            Speed
    beyond comfort zone                If you’re really on to
                                        something, there are other
   Learn from the data                 4-5 companies pursuing a
                                        similar vision
     You don’t get a gold star
      for following the process
                                     Techniques helpful, but
   It’s okay to be                   you need to be very
    opportunistic                     creative
     …but stay grounded in
      your vision                    Emotional rollercoaster

                                     Find mentors
   Lean Startup by Eric Ries         Tools
     startuplessonslearned.com         leancanvas.com
     theleanstartup.com/book            leanlaunchlab.com
     sllconf.com                       usertesting.com
   Steve Blank                         KissMetrics, Piwik
     steveblank.com                    uservoice.com
     steveblank.com/books.html
   Ash Maurya                        More references
     ashmaurya.com                       businessmodelgeneration.com
     runningleanhq.com (book)            venturehacks.com
   Dave McClure                          500hats.typepad.com
     AARRR: Startup metrics for          paulgraham.com
      pirates                             news.ycombinator.com/
                                      Even more:
                                       steveblank.com/tools-and-
                                       blogs-for-entrepreneurs
   Startup Weekend               Talk to us
    Brussels 21-23 October          Vladimir Blagojevic
     Featuring Ash Maurya           ▪ vladimir
                                       .blagojevic@sirris.be
     brussels.startupweeken
                                     ▪ blog.launched.be
      d.org
                                     ▪ @vladblagojevic
 betagroup.be
                                    Nick Boucart
 Founder Institute &                ▪   nick.boucart@sirris.be
  MIC                                ▪   sinnobok.org
 westartup .eu                      ▪   @nickboucart
 techbrew.be                        ▪   Book: The art of software
                                         innovation

Contenu connexe

Tendances

What do customers really want in their mobile experience?
What do customers really want in their mobile experience?What do customers really want in their mobile experience?
What do customers really want in their mobile experience?High Start Group
 
Services Presentation by Insight
Services Presentation by InsightServices Presentation by Insight
Services Presentation by InsightHayk Ghazaryan
 
How we make money?
How we make money?How we make money?
How we make money? Gram Games
 
Day2 0830 wexler_connecting brands
Day2 0830 wexler_connecting brandsDay2 0830 wexler_connecting brands
Day2 0830 wexler_connecting brandsMediabistro
 
Understanding the sphere of integrated marketing
Understanding the sphere of integrated marketingUnderstanding the sphere of integrated marketing
Understanding the sphere of integrated marketingEddie Choi
 
Media mind mobile_advertising_2011
Media mind mobile_advertising_2011Media mind mobile_advertising_2011
Media mind mobile_advertising_2011Ivan lin
 
Optism Alcatel-Lucent Presentation Mobile Marketing Meets the Wallet at th…
Optism Alcatel-Lucent Presentation Mobile Marketing Meets the Wallet at th…Optism Alcatel-Lucent Presentation Mobile Marketing Meets the Wallet at th…
Optism Alcatel-Lucent Presentation Mobile Marketing Meets the Wallet at th…Optism
 
Rob Leathern - Facebook to Display: Retargeting Your Audience
Rob Leathern - Facebook to Display: Retargeting Your AudienceRob Leathern - Facebook to Display: Retargeting Your Audience
Rob Leathern - Facebook to Display: Retargeting Your AudienceMediabistro
 
ConsumerX Retail: Best Location
ConsumerX Retail: Best LocationConsumerX Retail: Best Location
ConsumerX Retail: Best LocationConsumerX Retail
 
How mobile apps are transforming CRM
How mobile apps are transforming CRMHow mobile apps are transforming CRM
How mobile apps are transforming CRMKuliza Technologies
 
Mobile travel masterclass deck camerjam mobile marketing
Mobile travel masterclass deck camerjam mobile marketingMobile travel masterclass deck camerjam mobile marketing
Mobile travel masterclass deck camerjam mobile marketingJames Cameron
 
Mobile Marketing: Supercharge Your Brand From Your Customer's Pocket
Mobile Marketing: Supercharge Your Brand From Your Customer's PocketMobile Marketing: Supercharge Your Brand From Your Customer's Pocket
Mobile Marketing: Supercharge Your Brand From Your Customer's PocketTaylor Host
 
Gaining a 360 View of Your Potential Customer: A Cutting Edge Approach at Tel...
Gaining a 360 View of Your Potential Customer: A Cutting Edge Approach at Tel...Gaining a 360 View of Your Potential Customer: A Cutting Edge Approach at Tel...
Gaining a 360 View of Your Potential Customer: A Cutting Edge Approach at Tel...Datalicious
 
Digital "Elastic" Commerce - Right Here, Right Now - Jump Conference 2011
Digital "Elastic" Commerce - Right Here, Right Now - Jump Conference 2011Digital "Elastic" Commerce - Right Here, Right Now - Jump Conference 2011
Digital "Elastic" Commerce - Right Here, Right Now - Jump Conference 2011Elastic Path
 
Business Model Canvas (workshop at IIM Ahmedabad)
Business Model Canvas (workshop at IIM Ahmedabad)Business Model Canvas (workshop at IIM Ahmedabad)
Business Model Canvas (workshop at IIM Ahmedabad)Nagarjun Kandukuru
 
Marcelo cabane ibm - ecommerce day
Marcelo cabane   ibm - ecommerce day Marcelo cabane   ibm - ecommerce day
Marcelo cabane ibm - ecommerce day Marcos Pueyrredon
 

Tendances (19)

Insite Presentation Slide
Insite Presentation SlideInsite Presentation Slide
Insite Presentation Slide
 
What do customers really want in their mobile experience?
What do customers really want in their mobile experience?What do customers really want in their mobile experience?
What do customers really want in their mobile experience?
 
Services Presentation by Insight
Services Presentation by InsightServices Presentation by Insight
Services Presentation by Insight
 
How we make money?
How we make money?How we make money?
How we make money?
 
Enactive
EnactiveEnactive
Enactive
 
Day2 0830 wexler_connecting brands
Day2 0830 wexler_connecting brandsDay2 0830 wexler_connecting brands
Day2 0830 wexler_connecting brands
 
Understanding the sphere of integrated marketing
Understanding the sphere of integrated marketingUnderstanding the sphere of integrated marketing
Understanding the sphere of integrated marketing
 
Media mind mobile_advertising_2011
Media mind mobile_advertising_2011Media mind mobile_advertising_2011
Media mind mobile_advertising_2011
 
Optism Alcatel-Lucent Presentation Mobile Marketing Meets the Wallet at th…
Optism Alcatel-Lucent Presentation Mobile Marketing Meets the Wallet at th…Optism Alcatel-Lucent Presentation Mobile Marketing Meets the Wallet at th…
Optism Alcatel-Lucent Presentation Mobile Marketing Meets the Wallet at th…
 
Rob Leathern - Facebook to Display: Retargeting Your Audience
Rob Leathern - Facebook to Display: Retargeting Your AudienceRob Leathern - Facebook to Display: Retargeting Your Audience
Rob Leathern - Facebook to Display: Retargeting Your Audience
 
ConsumerX Retail: Best Location
ConsumerX Retail: Best LocationConsumerX Retail: Best Location
ConsumerX Retail: Best Location
 
How mobile apps are transforming CRM
How mobile apps are transforming CRMHow mobile apps are transforming CRM
How mobile apps are transforming CRM
 
Mobile travel masterclass deck camerjam mobile marketing
Mobile travel masterclass deck camerjam mobile marketingMobile travel masterclass deck camerjam mobile marketing
Mobile travel masterclass deck camerjam mobile marketing
 
Mobile Marketing: Supercharge Your Brand From Your Customer's Pocket
Mobile Marketing: Supercharge Your Brand From Your Customer's PocketMobile Marketing: Supercharge Your Brand From Your Customer's Pocket
Mobile Marketing: Supercharge Your Brand From Your Customer's Pocket
 
New Advertising Media
New Advertising MediaNew Advertising Media
New Advertising Media
 
Gaining a 360 View of Your Potential Customer: A Cutting Edge Approach at Tel...
Gaining a 360 View of Your Potential Customer: A Cutting Edge Approach at Tel...Gaining a 360 View of Your Potential Customer: A Cutting Edge Approach at Tel...
Gaining a 360 View of Your Potential Customer: A Cutting Edge Approach at Tel...
 
Digital "Elastic" Commerce - Right Here, Right Now - Jump Conference 2011
Digital "Elastic" Commerce - Right Here, Right Now - Jump Conference 2011Digital "Elastic" Commerce - Right Here, Right Now - Jump Conference 2011
Digital "Elastic" Commerce - Right Here, Right Now - Jump Conference 2011
 
Business Model Canvas (workshop at IIM Ahmedabad)
Business Model Canvas (workshop at IIM Ahmedabad)Business Model Canvas (workshop at IIM Ahmedabad)
Business Model Canvas (workshop at IIM Ahmedabad)
 
Marcelo cabane ibm - ecommerce day
Marcelo cabane   ibm - ecommerce day Marcelo cabane   ibm - ecommerce day
Marcelo cabane ibm - ecommerce day
 

En vedette

Mike burrows level demand, balance workload and manage schedule risk with c...
Mike burrows   level demand, balance workload and manage schedule risk with c...Mike burrows   level demand, balance workload and manage schedule risk with c...
Mike burrows level demand, balance workload and manage schedule risk with c...AGILEMinds
 
Sami honkonen scheduling work in kanban
Sami honkonen   scheduling work in kanbanSami honkonen   scheduling work in kanban
Sami honkonen scheduling work in kanbanAGILEMinds
 
Patrick steyaert lean adaptive management - achieving complex business goal...
Patrick steyaert   lean adaptive management - achieving complex business goal...Patrick steyaert   lean adaptive management - achieving complex business goal...
Patrick steyaert lean adaptive management - achieving complex business goal...AGILEMinds
 
Olav maassen risk management
Olav maassen   risk managementOlav maassen   risk management
Olav maassen risk managementAGILEMinds
 
Dave snowden practice without sound theory will not scale
Dave snowden   practice without sound theory will not scaleDave snowden   practice without sound theory will not scale
Dave snowden practice without sound theory will not scaleAGILEMinds
 
Lean Startup - Customer Development - Aarrr metrics
Lean Startup - Customer Development - Aarrr metricsLean Startup - Customer Development - Aarrr metrics
Lean Startup - Customer Development - Aarrr metricsAGILEMinds
 
Karl scotland science of kanban
Karl scotland   science of kanbanKarl scotland   science of kanban
Karl scotland science of kanbanAGILEMinds
 
Méthodes Agiles, L’essentiel de KANBAN.
Méthodes Agiles, L’essentiel de KANBAN.Méthodes Agiles, L’essentiel de KANBAN.
Méthodes Agiles, L’essentiel de KANBAN.aettarrouzi
 

En vedette (8)

Mike burrows level demand, balance workload and manage schedule risk with c...
Mike burrows   level demand, balance workload and manage schedule risk with c...Mike burrows   level demand, balance workload and manage schedule risk with c...
Mike burrows level demand, balance workload and manage schedule risk with c...
 
Sami honkonen scheduling work in kanban
Sami honkonen   scheduling work in kanbanSami honkonen   scheduling work in kanban
Sami honkonen scheduling work in kanban
 
Patrick steyaert lean adaptive management - achieving complex business goal...
Patrick steyaert   lean adaptive management - achieving complex business goal...Patrick steyaert   lean adaptive management - achieving complex business goal...
Patrick steyaert lean adaptive management - achieving complex business goal...
 
Olav maassen risk management
Olav maassen   risk managementOlav maassen   risk management
Olav maassen risk management
 
Dave snowden practice without sound theory will not scale
Dave snowden   practice without sound theory will not scaleDave snowden   practice without sound theory will not scale
Dave snowden practice without sound theory will not scale
 
Lean Startup - Customer Development - Aarrr metrics
Lean Startup - Customer Development - Aarrr metricsLean Startup - Customer Development - Aarrr metrics
Lean Startup - Customer Development - Aarrr metrics
 
Karl scotland science of kanban
Karl scotland   science of kanbanKarl scotland   science of kanban
Karl scotland science of kanban
 
Méthodes Agiles, L’essentiel de KANBAN.
Méthodes Agiles, L’essentiel de KANBAN.Méthodes Agiles, L’essentiel de KANBAN.
Méthodes Agiles, L’essentiel de KANBAN.
 

Similaire à Nick boucart lean startups

Staying abreast of customer expectations
Staying abreast of customer expectationsStaying abreast of customer expectations
Staying abreast of customer expectationsThomas Wieberneit
 
Lean Analytics for Nikkei BP
Lean Analytics for Nikkei BPLean Analytics for Nikkei BP
Lean Analytics for Nikkei BPLean Analytics
 
How I Achieved $15,000 Daily Sales on Google Play | Android App Monetization
How I Achieved $15,000 Daily Sales on Google Play | Android App MonetizationHow I Achieved $15,000 Daily Sales on Google Play | Android App Monetization
How I Achieved $15,000 Daily Sales on Google Play | Android App MonetizationKatsuaki Sato
 
Rise of the Marketing Technologist (And What It Means For Agencies)
Rise of the Marketing Technologist (And What It Means For Agencies)Rise of the Marketing Technologist (And What It Means For Agencies)
Rise of the Marketing Technologist (And What It Means For Agencies)Scott Brinker
 
Cockroaches, the Value of Co-creation, & Reflection in #NewMR by Nacho Racca ...
Cockroaches, the Value of Co-creation, & Reflection in #NewMR by Nacho Racca ...Cockroaches, the Value of Co-creation, & Reflection in #NewMR by Nacho Racca ...
Cockroaches, the Value of Co-creation, & Reflection in #NewMR by Nacho Racca ...InsightInnovation
 
Digital Marketing Innovation
Digital Marketing InnovationDigital Marketing Innovation
Digital Marketing Innovationdgsumner
 
Innovacio en l\'Accio Social - PereTarres - Infonomia
Innovacio en l\'Accio Social - PereTarres - InfonomiaInnovacio en l\'Accio Social - PereTarres - Infonomia
Innovacio en l\'Accio Social - PereTarres - InfonomiaOscarArnau
 
The past present and future of ai in customer experience
The past present and future of ai in customer experienceThe past present and future of ai in customer experience
The past present and future of ai in customer experienceConvergeHub
 
nowUmatter Investor Deck (Dec 2012)
nowUmatter Investor Deck (Dec 2012)nowUmatter Investor Deck (Dec 2012)
nowUmatter Investor Deck (Dec 2012)Joseph Cameron
 
RewardMe Deck for Motorola
RewardMe Deck for MotorolaRewardMe Deck for Motorola
RewardMe Deck for MotorolaYu-kai Chou
 
Umsl challanges for brand measuring social media -marshall sponder - apr...
Umsl    challanges for brand measuring social media  -marshall sponder  - apr...Umsl    challanges for brand measuring social media  -marshall sponder  - apr...
Umsl challanges for brand measuring social media -marshall sponder - apr...Marshall Sponder
 
Marketing 101 for google io final nv
Marketing 101 for google io final nvMarketing 101 for google io final nv
Marketing 101 for google io final nvPatrick 'Mad' Mork
 
Mobile Couponing
Mobile CouponingMobile Couponing
Mobile CouponingKunal Gupta
 
Marshall Sponder - Social Media Monitoring Analytics - Measure13
Marshall Sponder - Social Media Monitoring Analytics - Measure13Marshall Sponder - Social Media Monitoring Analytics - Measure13
Marshall Sponder - Social Media Monitoring Analytics - Measure13Our Social Times
 

Similaire à Nick boucart lean startups (20)

Staying abreast of customer expectations
Staying abreast of customer expectationsStaying abreast of customer expectations
Staying abreast of customer expectations
 
Lean Analytics for Nikkei BP
Lean Analytics for Nikkei BPLean Analytics for Nikkei BP
Lean Analytics for Nikkei BP
 
How I Achieved $15,000 Daily Sales on Google Play | Android App Monetization
How I Achieved $15,000 Daily Sales on Google Play | Android App MonetizationHow I Achieved $15,000 Daily Sales on Google Play | Android App Monetization
How I Achieved $15,000 Daily Sales on Google Play | Android App Monetization
 
Rise of the Marketing Technologist (And What It Means For Agencies)
Rise of the Marketing Technologist (And What It Means For Agencies)Rise of the Marketing Technologist (And What It Means For Agencies)
Rise of the Marketing Technologist (And What It Means For Agencies)
 
Cockroaches, the Value of Co-creation, & Reflection in #NewMR by Nacho Racca ...
Cockroaches, the Value of Co-creation, & Reflection in #NewMR by Nacho Racca ...Cockroaches, the Value of Co-creation, & Reflection in #NewMR by Nacho Racca ...
Cockroaches, the Value of Co-creation, & Reflection in #NewMR by Nacho Racca ...
 
Digital Marketing Innovation
Digital Marketing InnovationDigital Marketing Innovation
Digital Marketing Innovation
 
Innovacio en l\'Accio Social - PereTarres - Infonomia
Innovacio en l\'Accio Social - PereTarres - InfonomiaInnovacio en l\'Accio Social - PereTarres - Infonomia
Innovacio en l\'Accio Social - PereTarres - Infonomia
 
Innovació en l'Acció Social
Innovació en l'Acció Social Innovació en l'Acció Social
Innovació en l'Acció Social
 
Crossroadz bim b
Crossroadz bim bCrossroadz bim b
Crossroadz bim b
 
The past present and future of ai in customer experience
The past present and future of ai in customer experienceThe past present and future of ai in customer experience
The past present and future of ai in customer experience
 
nowUmatter Investor Deck (Dec 2012)
nowUmatter Investor Deck (Dec 2012)nowUmatter Investor Deck (Dec 2012)
nowUmatter Investor Deck (Dec 2012)
 
Mis07
Mis07Mis07
Mis07
 
Kaavio final 2013 stanford e245
Kaavio final 2013 stanford e245Kaavio final 2013 stanford e245
Kaavio final 2013 stanford e245
 
RewardMe Deck for Motorola
RewardMe Deck for MotorolaRewardMe Deck for Motorola
RewardMe Deck for Motorola
 
Biz Model for AtracTable
Biz Model for AtracTableBiz Model for AtracTable
Biz Model for AtracTable
 
Umsl challanges for brand measuring social media -marshall sponder - apr...
Umsl    challanges for brand measuring social media  -marshall sponder  - apr...Umsl    challanges for brand measuring social media  -marshall sponder  - apr...
Umsl challanges for brand measuring social media -marshall sponder - apr...
 
Marketing 101 for google io final nv
Marketing 101 for google io final nvMarketing 101 for google io final nv
Marketing 101 for google io final nv
 
Mobile Couponing
Mobile CouponingMobile Couponing
Mobile Couponing
 
Glossads
GlossadsGlossads
Glossads
 
Marshall Sponder - Social Media Monitoring Analytics - Measure13
Marshall Sponder - Social Media Monitoring Analytics - Measure13Marshall Sponder - Social Media Monitoring Analytics - Measure13
Marshall Sponder - Social Media Monitoring Analytics - Measure13
 

Plus de AGILEMinds

Michael kennedy set-based decision making taming system complexity
Michael kennedy   set-based decision making taming system complexityMichael kennedy   set-based decision making taming system complexity
Michael kennedy set-based decision making taming system complexityAGILEMinds
 
Mattias skarin what would you do - analysing charts
Mattias skarin   what would you do - analysing chartsMattias skarin   what would you do - analysing charts
Mattias skarin what would you do - analysing chartsAGILEMinds
 
Matthias bohlen team and contracts
Matthias bohlen   team and contractsMatthias bohlen   team and contracts
Matthias bohlen team and contractsAGILEMinds
 
Mark robinson what does lean mean for software testing
Mark robinson   what does lean mean for software testingMark robinson   what does lean mean for software testing
Mark robinson what does lean mean for software testingAGILEMinds
 
Jurgen de smet yves hanoulle real options
Jurgen de smet yves hanoulle   real optionsJurgen de smet yves hanoulle   real options
Jurgen de smet yves hanoulle real optionsAGILEMinds
 
John seddon it’s the system stupid!
John seddon   it’s the system stupid!John seddon   it’s the system stupid!
John seddon it’s the system stupid!AGILEMinds
 
Jasper sonnevelt pitfalls of a large kanban implementation
Jasper sonnevelt   pitfalls of a large kanban implementationJasper sonnevelt   pitfalls of a large kanban implementation
Jasper sonnevelt pitfalls of a large kanban implementationAGILEMinds
 
Jason yip kanban for it operations
Jason yip   kanban for it operationsJason yip   kanban for it operations
Jason yip kanban for it operationsAGILEMinds
 
Eric willeke when models collide
Eric willeke   when models collideEric willeke   when models collide
Eric willeke when models collideAGILEMinds
 
Don reinertsen is it time to rethink deming
Don reinertsen   is it time to rethink demingDon reinertsen   is it time to rethink deming
Don reinertsen is it time to rethink demingAGILEMinds
 
David joyce jalipo build it and they will come
David joyce   jalipo build it and they will comeDavid joyce   jalipo build it and they will come
David joyce jalipo build it and they will comeAGILEMinds
 
David anderson kanban when is it not appropriate
David anderson   kanban when is it not appropriateDavid anderson   kanban when is it not appropriate
David anderson kanban when is it not appropriateAGILEMinds
 
Corry clybouw integrated user documentation
Corry clybouw   integrated user documentationCorry clybouw   integrated user documentation
Corry clybouw integrated user documentationAGILEMinds
 
Bob marshall rightshifting in a nutshell v1c
Bob marshall   rightshifting in a nutshell v1cBob marshall   rightshifting in a nutshell v1c
Bob marshall rightshifting in a nutshell v1cAGILEMinds
 
Bob marshall realising value - how to apply rightshifting v1c
Bob marshall   realising value - how to apply rightshifting v1cBob marshall   realising value - how to apply rightshifting v1c
Bob marshall realising value - how to apply rightshifting v1cAGILEMinds
 
Arne roock limit your wip
Arne roock   limit your wipArne roock   limit your wip
Arne roock limit your wipAGILEMinds
 
Alan shalloway lean-kanban is about people
Alan shalloway   lean-kanban is about peopleAlan shalloway   lean-kanban is about people
Alan shalloway lean-kanban is about peopleAGILEMinds
 
Practical intro to kanban- Joakim Sunden
Practical intro to kanban- Joakim SundenPractical intro to kanban- Joakim Sunden
Practical intro to kanban- Joakim SundenAGILEMinds
 
Feature injection - Antony Marcano & Andy Palmer
Feature injection - Antony Marcano & Andy PalmerFeature injection - Antony Marcano & Andy Palmer
Feature injection - Antony Marcano & Andy PalmerAGILEMinds
 
Applying lean principles and kanban in the enterprise - Kevin Ryan
Applying lean principles and kanban in the enterprise - Kevin RyanApplying lean principles and kanban in the enterprise - Kevin Ryan
Applying lean principles and kanban in the enterprise - Kevin RyanAGILEMinds
 

Plus de AGILEMinds (20)

Michael kennedy set-based decision making taming system complexity
Michael kennedy   set-based decision making taming system complexityMichael kennedy   set-based decision making taming system complexity
Michael kennedy set-based decision making taming system complexity
 
Mattias skarin what would you do - analysing charts
Mattias skarin   what would you do - analysing chartsMattias skarin   what would you do - analysing charts
Mattias skarin what would you do - analysing charts
 
Matthias bohlen team and contracts
Matthias bohlen   team and contractsMatthias bohlen   team and contracts
Matthias bohlen team and contracts
 
Mark robinson what does lean mean for software testing
Mark robinson   what does lean mean for software testingMark robinson   what does lean mean for software testing
Mark robinson what does lean mean for software testing
 
Jurgen de smet yves hanoulle real options
Jurgen de smet yves hanoulle   real optionsJurgen de smet yves hanoulle   real options
Jurgen de smet yves hanoulle real options
 
John seddon it’s the system stupid!
John seddon   it’s the system stupid!John seddon   it’s the system stupid!
John seddon it’s the system stupid!
 
Jasper sonnevelt pitfalls of a large kanban implementation
Jasper sonnevelt   pitfalls of a large kanban implementationJasper sonnevelt   pitfalls of a large kanban implementation
Jasper sonnevelt pitfalls of a large kanban implementation
 
Jason yip kanban for it operations
Jason yip   kanban for it operationsJason yip   kanban for it operations
Jason yip kanban for it operations
 
Eric willeke when models collide
Eric willeke   when models collideEric willeke   when models collide
Eric willeke when models collide
 
Don reinertsen is it time to rethink deming
Don reinertsen   is it time to rethink demingDon reinertsen   is it time to rethink deming
Don reinertsen is it time to rethink deming
 
David joyce jalipo build it and they will come
David joyce   jalipo build it and they will comeDavid joyce   jalipo build it and they will come
David joyce jalipo build it and they will come
 
David anderson kanban when is it not appropriate
David anderson   kanban when is it not appropriateDavid anderson   kanban when is it not appropriate
David anderson kanban when is it not appropriate
 
Corry clybouw integrated user documentation
Corry clybouw   integrated user documentationCorry clybouw   integrated user documentation
Corry clybouw integrated user documentation
 
Bob marshall rightshifting in a nutshell v1c
Bob marshall   rightshifting in a nutshell v1cBob marshall   rightshifting in a nutshell v1c
Bob marshall rightshifting in a nutshell v1c
 
Bob marshall realising value - how to apply rightshifting v1c
Bob marshall   realising value - how to apply rightshifting v1cBob marshall   realising value - how to apply rightshifting v1c
Bob marshall realising value - how to apply rightshifting v1c
 
Arne roock limit your wip
Arne roock   limit your wipArne roock   limit your wip
Arne roock limit your wip
 
Alan shalloway lean-kanban is about people
Alan shalloway   lean-kanban is about peopleAlan shalloway   lean-kanban is about people
Alan shalloway lean-kanban is about people
 
Practical intro to kanban- Joakim Sunden
Practical intro to kanban- Joakim SundenPractical intro to kanban- Joakim Sunden
Practical intro to kanban- Joakim Sunden
 
Feature injection - Antony Marcano & Andy Palmer
Feature injection - Antony Marcano & Andy PalmerFeature injection - Antony Marcano & Andy Palmer
Feature injection - Antony Marcano & Andy Palmer
 
Applying lean principles and kanban in the enterprise - Kevin Ryan
Applying lean principles and kanban in the enterprise - Kevin RyanApplying lean principles and kanban in the enterprise - Kevin Ryan
Applying lean principles and kanban in the enterprise - Kevin Ryan
 

Dernier

Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAndikSusilo4
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?XfilesPro
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 

Dernier (20)

Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & Application
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 

Nick boucart lean startups

  • 2. Agile Development is good for…
  • 3. Will agile help them build better products?
  • 4. Google Wave Build it, and they will come… (good products = big bucks) Right?
  • 5. What do you need for a successful business?
  • 6. Auto/pers What onal/comm will you unities? need to What do Who are What can master? you offer? your you Value? customer outsource Uniqueness s? to whom? ? What do How to you need communic to build ate & up? deliver? How will What you make are my money? costs?
  • 7. Groupon: deal of the day in your inbox. Get 50%-90% off the best stuff your city has to offer.
  • 8. Merchant Personal/Call Acquisition Centers Copy-writing Automated/ Deal New, local Merchants E-mail selection customers (guarantee #) Consumers Discounts Direct sales Email DB Google ads Personalization engine Social media 50% commission Cust. acquisition Merchant (30% of revenue) 20% unfulfilled Acquisition (sales = groupons ½ employees) Churn
  • 10. began as a MMO game What happened here? began with PDA payment tool
  • 11. Who is the customer? What do they value? What is our product anyway?
  • 12.
  • 13. ”Startup is a temporary organization with purpose to search for a repeatable and scalable business model. S. Blank Startup ~ research
  • 14. State Hypotheses Pivot or Experiment persevere
  • 15. State Hypotheses Pivot or Experiment persevere
  • 16. parkr™ Bootstrapping: parking scouts SMS Help find Drivers in parking Mobile app GPS producers cities Monetize Near-location unused notifier + UI parking App store Community Viral User credit cards Micro Community commission Platform (parking spotter)
  • 17. parkr™ Bootstrapping: parking scouts SMS Help find parking Mobile app Drivers in GPS producers cities Monetize Near-location unused notifier + UI parking App store Community Viral User credit cards Micro commission Community Platform (scouts)
  • 18. Customers Problem do I know who they are & how to reach top 3 customer problems? them?  Pain level: must have vs nice to  Segment? Early adopter? have  Roles: user, economic buyer,  Awareness: active vs. latent influencer, saboteur?  How do they search for  Alternatives : how do they deal products? with these problems today? Solution top 3 product features?  Do they solve the top 3 problems?  Barriers to adoption (e.g. fit/integration with existing workflow)?  Is my price accepted?
  • 19. State Hypotheses Pivot or Experiment persevere
  • 20. A 1st problem is… Would you pay $20 a Does this resonate with month to use a tool like you? How do you deal this? with it today? Is it a must-have?... This is how our solution looks today (screen per problem). Which of the screens resonated the most? Which could you live without? Are there any additional features you think are missing? Use Mocks
  • 21. Trouble Parking in Brussels? www.parkr.com Find parking when you need it. Park easily in busy streets of Brussels Paying too much for parking? www.parkr.com Monetize your unused parking time and help others find free parking!
  • 22. Concierge MVP Wizard of Oz
  • 23. Document Hypotheses Pivot or Experiment persevere
  • 24. CHEATSHEET Customer problem pivot: same product, same segment, different problem  Change of an aspect of Starbucks : started selling coffee beans & espresso makers Segment pivot: same product , similar problem, a business model different set of customers e.g. consumers aren’t buying, enterprises have a similar problem  Successful startups Sometimes a pure marketing change Technology pivot: repurpose the technology to solve a change direction quickly more pressing or marketable problem Product feature pivot: remove features for focus, or to  Based on learning add features for a more holistic solution pay close attention to what real customers are doing Revenue model pivot e.g. from a premium customized, to a low price commoditized solution  Grounded in the vision e.g. from a one-time sale to monthly subscription or license fees e.g. razor versus blade strategy  They keep one foot in the Sales channel pivot: use lessons learned from customers to switch from direct sales past and place one foot in E.g. distribution channel, ecommerce, white-labeling … Product versus services pivot: if products are too a new possible future different or too complex to be sold effectively to the customer with the problem bundle support services with the product, education offerings...  Vision: search space Major competitor pivot: react when a major new player or competitor jumps into your space one of the above pivots to build your differentiation and stay alive
  • 25. Parkr™ foursquare for parking spots Bootstrapping: parking scouts SMS Help find parking Community Drivers in GPS producers cities Monetize Near-location unused notifier + UI parking App store Community Viral Cities Promoting User credit public cards Mobile app transport App fee Micro Building commission Platform Community Subvention (critical mass)
  • 26.
  • 27. IDEAS Pivot Continuous LEARN BUILD Root-cause deployment DATA PRODUCT MEASURE Metrics Lean startup Feedback build-measure-learn loop by Eric Ries
  • 28. Counter-intuitive and  Speed beyond comfort zone  If you’re really on to something, there are other  Learn from the data 4-5 companies pursuing a similar vision  You don’t get a gold star for following the process  Techniques helpful, but  It’s okay to be you need to be very opportunistic creative  …but stay grounded in your vision  Emotional rollercoaster  Find mentors
  • 29. Lean Startup by Eric Ries  Tools  startuplessonslearned.com  leancanvas.com  theleanstartup.com/book leanlaunchlab.com  sllconf.com  usertesting.com  Steve Blank  KissMetrics, Piwik  steveblank.com  uservoice.com  steveblank.com/books.html  Ash Maurya  More references  ashmaurya.com  businessmodelgeneration.com  runningleanhq.com (book)  venturehacks.com  Dave McClure  500hats.typepad.com  AARRR: Startup metrics for  paulgraham.com pirates  news.ycombinator.com/  Even more: steveblank.com/tools-and- blogs-for-entrepreneurs
  • 30. Startup Weekend  Talk to us Brussels 21-23 October  Vladimir Blagojevic  Featuring Ash Maurya ▪ vladimir .blagojevic@sirris.be  brussels.startupweeken ▪ blog.launched.be d.org ▪ @vladblagojevic  betagroup.be  Nick Boucart  Founder Institute & ▪ nick.boucart@sirris.be MIC ▪ sinnobok.org  westartup .eu ▪ @nickboucart  techbrew.be ▪ Book: The art of software innovation

Notes de l'éditeur

  1. … developing solutions that cannot be specified entirely upfront… delivering customer value… involving a customer in software development… (iterative) product delivery - you build good products!
  2. “I think GeoCities was the first proof that you could have something really popular and still not make any money on the internet”Webvan: Poster child of premature scaling Grocery business has razor-thin margins to begin with, it was never able to attract enough customers to justify its spending spree
  3. What do you need for a successful business?
  4. On LeanKanbanwe can ask the audience, and show filed by field. On XP Day we will do the workshop, and then ask each group and also show what we got.
  5. What are the major risks?
  6. Notsureaboutthisslide
  7. Good for very early feedback, or choosing between alternativesMention measuring already
  8. This experimentation approach does not stop when the product is finally deployed to users. You treat your feature/improvement ideas as hypotheses. You build them (or a minimal version that will allow you to learn) and deply as fast as possible. Agile practices are essential. You have to be able to iterate quickly and respond rapidly to customer feedback. Then you measure. You measure behaviour your feature was supposed to promote (e.g. whether email notifications bring customers back to the product), and monitor metrics that are relevant for your business. You also solicit feedback from your customers: both online, and face to face (e.g. usability tests). Pivoting at this later stage may mean simply rolling back the change (if it proves to have adverse – or even zero – effect). If you encountered a problem, you want to make sure you are dealing with it systemically, therefore root-causing (e.g. using 5Y). This practice can be also integrated with retrospects.