SlideShare une entreprise Scribd logo
1  sur  26
Télécharger pour lire hors ligne
lsoftware development
                                     e a n
               The Fastest Learner Wins
                       Living with Black Swans

mary@poppendieck.com       Mary Poppendieck      www.poppendieck.com
Agenda

1.   Compelling Offer
          Observing
2.   Immediate Connection
          Questioning
3.   Adoption Chain
          Networking
4.   Validated Assumptions
2
          Experimenting
     August 12   Copyright©2012 Poppendieck.LLC   l e a n
Todd Park
    2010       Harvard Graduate (Economics)
               Booz Allen Hamilton Consultant (Managed Care)
               Athenahealth (1997)
                        Maternity Clinic
                        Health Care Records
                        Very successful IPO

               Retirement (2007)
               US Health and Human
                 Services CTO (2009)
    2011




                                                                Artist Regina Holliday




3          August 12        Copyright©2012 Poppendieck.LLC   l e a n
                                                     US Federal Government CTO (2012)
Agenda

1.   Compelling Offer
          Observing
2.   Immediate Connection
          Questioning
3.   Adoption Chain
          Networking
4.   Validated Assumptions
4
          Experimenting
     August 12   Copyright©2012 Poppendieck.LLC   l e a n
Strategic Inflection Point


                                                           Business goes on
                                                           to new heights




                              10x change in some
                           element of the business.
                  What worked before doesn’t work now.
                    The executives are the last to know.

5   August 12   Copyright©2010 Poppendieck.LLC   l e a n        Business
                                                                declines
Compelling Offer
10X Improvement in some aspect of the offer
Salesforce.com
     SaaS gave a 10X reduction in installation and operating costs
Skype
     Peer-to-peer IP telephony for a 10X reduction in long distance charges
Wikipedia
     Open source collaboration for a 10X increase in the speed and a 100X
      reduction in cost for encyclopedia development and maintenance
Dropbox
     10X improvement in ease of use and safety for those who wanted to keep
      multiple devices in sync.
YouTube
     Cell phones gave a 10X improvement in capability to take casual videos,

6     August 12    Copyright©2012 Poppendieck.LLC     l e a n
      YouTube gave a 10X improvement in ease of sharing those videos.
                          See also: http://ecorner.stanford.edu/authorMaterialInfo.html?mid=2732
Working Backward
                                                                           PRESS RELEASE
                                                        Heading –
     Working Backward                                    Name the product in a way the reader (i.e. your target
                                                         customers) will understand.
                                                        Sub-Heading –
    1. Write a Press Release                             Describe who the market for the product is and what
                                                         benefit they get. One sentence only underneath the title.
                                                        Summary –
                                                         Give a summary of the product and the benefit. Assume
                                                         the reader will not read anything else so make this good.
                                                        Problem -
                                                         Describe the problem your product solves.
                                                        Solution –
    2. Write a list of FAQ’s                             Describe how your product elegantly solves the problem.
                                                        Quote from You –
       (and answers)                                     A quote from a spokesperson in your company.
                                                        How to Get Started –
    3. Describe the Customer                             Describe how easy it is to get started.
       Experience                                       Customer Quote –
                                                         Provide a quote from a hypothetical customer that
                                                         describes how they experienced the benefit.
    4. Write a User Manual.                             Closing and Call to Action –



7
       http://www.allthingsdistributed.com
        /2006/11/working_backwards.html

         August 12           Copyright©2012 Poppendieck.LLC   l e a n
                                                         Wrap it up; give pointers where the reader should go next.

                                                              http://www.quora.com/What-is-Amazons-approach-to-
                                                                 product-development-and-product-management
Exercise: Write
      a Press Release
Innovation Skill: Observing
Working as a group, write a press
release for a product real or imaginary.
                                             1. Aim  the press release at
        PRESS RELEASE
                                                consumers of the product.
  Title –
                                             2. Create a tag line to quickly
  Central theme (Tag line) –                    summarize the central theme.
  Summary (10X effect) –                     3. Summarize the offer in
  Problem –                                     terms of its10X effect.
  Solution –                                 4. Center your message on a
  Getting Started –
                                                single theme that will define
                                                what the product is and is not.

 8
  Call to Action –
       August 12   Copyright©2012 Poppendieck.LLC   l e a n
Agenda

1.   Compelling Offer
          Observing
2.   Immediate Connection
          Questioning
3.   Adoption Chain
          Networking
4.   Validated Assumptions
9
          Experimenting
     August 12   Copyright©2012 Poppendieck.LLC   l e a n
Release Cycle
                      6 Months
Quick & Dirty Value Stream Map:
                     Need a       Need a
                     Feature      Feature              Design        Develop            Harden      UAT




     Release Cycle                     Release Cycle                    Release Cycle

                                                                Value-Added Time
                                                         Total Cycle Time Time
                                                                 Total Cycle
                      Start    Average Start                                                              End



                                        Development Model:
                                                  Releases are very painful
                                                  Avoid releases!
10     August 12           Copyright©2012 Poppendieck.LLC       l e a n
                                                                   Thanks to Kent Beck for his ideas on cadence.
Release Cycle
                   Quarterly
 Hardening: 2 – 4 weeks
 Early integration testing becomes essential
 Typically: 2 – 4 week iterations
 Code from each iteration goes to integration testing

                                 Business issues (if software is
                                  sold/delivered to customers):
                                  How to price and sell releases?
                                  Which releases to support?
                                            Supporting multiple branches


11   August 12     Copyright©2012 Poppendieck.LLC   l e a n
                                              can create a support nightmare
Release Cycle
                   Monthly
Now you need:
Hardening  3 days
Cross Functional Team
Visualization
Short Daily Meetings
SBE/TDD really working!


                                    Works best for:
                                      Software as a Service (SaaS)
                                           [Any download to local machines is pushed.]


12   August 12     Copyright©2012 Poppendieck.LLC   l e a n
                                      Internal Software
Release Cycle
     Weekly/Daily/Continuous
Kanban works well
Iterations become irrelevant                   The team
Estimating is not very important              is everyone.
No branching – Develop on the trunk
Test & deployment automation is essential
Rapid cycles of learning drive portfolio decisions

                                Things. Just. Work.
                                 One or our large web-based customers
                                  has been deploying daily for five years!
                                 Google: gmail deploys 2X/week

13     August 12   Copyright©2012 Poppendieck.LLC   l e a n
                                 What is the fastest release cycle here?
Immediate Connection
           Bent Victor                                                              Our
      Inventing on Principle
              http://vimeo.com/36579366                                     Guiding Principle:
                                                                           People should not be
                                                                             told what to do.
                                                                          Combining Principles:
                                                                         Teams should adjust what
Bent’s Guiding Principle:                                                 they are doing based on
   Creators need an                                                      what team members learn
 immediate connection
 with what they create.                                                  directly from their efforts.
Bret Victor invents tools that enable people to understand and
create. He has designed experimental UI concepts at Apple, interactive
data graphics for Al Gore, and musical instruments at Alesis.
 14          August 12               Copyright©2012 Poppendieck.LLC         l e a n
Exercise: Draw a
                                Feedback Matrix
                        Innovation Skill: Questioning
                               I adjust what I do based on:
          Immediate
visibility of results




                                                                                            1.   Have everyone at the
                                                                                                 table plot a point for a
                                                                                                 typical development
                                                                                                 team members.
                                                                                            2.   Add additional points
                                                                                                 for members from
info about results




                                                                                                 different functions.
                                                                                            3.   Plot the ideal point
Delayed




                                                                                                 for team members
                                                                                                 working on that

             15
                        Indirect information
                        about consumers

                             August 12                                          l e a n
                                                                        Direct connection
                                                                          with consumers
                                               Copyright©2012 Poppendieck.LLC
                                                                                                 compelling offer.
Agenda

1.   Compelling Offer
          Observing
2.   Immediate Connection
          Questioning
3.   Adoption Chain
          Networking
4.   Validated Assumptions
16
          Experimenting
     August 12   Copyright©2012 Poppendieck.LLC   l e a n
The Age of the Platform




                                             Contributor                   Consumer




17    August 12   Copyright©2012 Poppendieck.LLC   l e a n
                                                        Platform
                                                     (infrastructure and rules)
Adoption Chain
 Innovators often forget Complementors!


                                     3G
            Music?                                          Repair?       Books?
                                  Networks?




The first MP3 Player
                         The first 3G Phone             Run-flat tires    The first e-reader
        1998
                                2002                 Honda Odyssey 2005          2006



 18        August 12     Copyright©2012 Poppendieck.LLC   l e a n
Cost vs. Relative Benefit
Adopters see value differently.
Innovator’s Perspective               Adopter’s Perspective
                                                                           Innovator
                                                                                             ++
                                                 Relative                                    ++
                                                 Benefit
               Product                                                     Distributor
                                                                                             +
                 Cost                                                                        ++
                                                       Product Cost
                                                       + Additional         Retailer          -
                                                       Costs/Risks

                                                                           Consumer
                                                                                             ++
                                                                                            +++

       New                             New     Old
                                                                             This adoption chain
     Product                         Product Product
                                                                                will not work!
     Benefit                         Benefit Benefit


       If any organization on the adoption chain perceives

19
          a negative value, the adoption chain is broken.
        August 12        Copyright©2012 Poppendieck.LLC     l e a n   The Wide Lens, by Ron Adner
Exercise: Evaluate
        the Adoption Chain
Innovation Skill: Networking
You would like to develop a product with compelling value
and provide immediate connection between the product
creators and consumers. In order to achieve this, you need        Adoption Chain
the cooperation of organizations within and outside of you
                                                                Party 1
                                                                            ++
company that are not part of your immediate team.                           ++
1.   Make a list of the parties who must change the way they
                                                                Party 2      +
     do things in order for the improvement to be successful.
2.   Look at the benefits to be gained and the cost of change   Party 3       -
     from the perspective of each party.
                                                                Party 4     ++
3.   Are there parties where the cost outweighs the benefit?               +++

4.   What can be done to change the equation so the benefits


 20
     are greater than the cost for that party?

          August 12     Copyright©2012 Poppendieck.LLC   l e a n
Agenda

1.   Compelling Offer
          Observing
2.   Immediate Connection
          Questioning
3.   Adoption Chain
          Networking
4.   Validated Assumptions
21
          Experimenting
     August 12   Copyright©2012 Poppendieck.LLC   l e a n
Validated Assumptions
Only a few large companies have been able to sustain growth
over time by coming up with successful new disruptive
businesses. These companies share a common practice: They
have systems in place that encourage small, cross-functional
employee teams to conduct frugal experiments. Scott Cook, Intuit
Validated Assumptions:
1.    List assumptions that must be true in order for the product to succeed.
      a) Which ones are most important?
2.    Devise experiments to determine whether critical assumptions are true.
      a) Create a measurable hypotheses that will demonstrate clear cause and effect.
      b) Run many, quick experiments to test the hypotheses.
                      Lean Startup:
                      1.   Start with a Business Success Model
                           a) Success metrics which demonstrate clear cause and effect.
                      2.   Establish a baseline – with a Minimum Viable Product


                                                            l e a n
                      3.   Target every initiative at improving a success metric
                      4.   Do not add capabilities without validation (eg. split test)
 22       August 12        Copyright©2012 Poppendieck.LLC
Experimental Approach

                Site visitors are randomly
       A      assigned to see version A or B             B                  Don’t Miss this excellent paper:
                                                                             Online Experimentation at Microsoft
                                                                             by Kohavi , Crook, & Longbotham
                                                                                    Presented at KDD 2009
                                                                             (Knowledge Discovery & Data Mining)
                                                                           http://exp-platform.com/expMicrosoft.aspx

14.5% Conversion        B is better than A           18.6% Conversion

       Amazon.com Case Study                             1. Most of the time the guess about how customers
 Amazon’s Greg Linden created a prototype                   will behave will be wrong – even for experts!
 which gave personalized recommendations
 based on items in the shopping cart. The feature        2. Test early – don’t waste a lot of time on in-
 was opposed by a marketing SVP who told Greg               depth analysis or planning the perfect design.
 to stop, but Greg created a test anyway. He was
                                                         3. Test often – most experiments don’t tell much.
 allowed to pushed it live. The feature ‘won’ by
 such a wide margin that it was immediately              4. A failed experiment is not a failure – it’s a


                                                                    l e a n
 adopted, increasing sales by an estimated 3%.              learning opportunity. The only failures are failure
                 http://glinden.blogspot.com/2006/
                04/early-amazon-shopping-cart.html          to learn or failing to conduct a good experiment.
  23        August 12          Copyrignt©2011 Poppendieck.LLC
Why?
Impact Maps

Why?                Who?                             Who?
Who?
How?             How?                                            How?
What?
          What?                                                   What?


Connections
=Assumptions
24   August 12    Copyright©2012 Poppendieck.LLC   l e a n     Images and ideas from:
                                                            Impact Mapping Handbook
                                                       by Gojko Adzic – Available soon
                                                     Check out:www.impactmapping.org
Exercise: Find and
Validate Assumptions
Innovation Skill: Experimenting
Validate assumptions for your compelling offer.
1. Draw an Impact Map.
                                                                Impact
      a) Start with the goal – make it measurable.
                                                                 Map
      b) Who needs to be involved?
      c) How will they contribute?                             Why?
      d) What needs to be done to support each contribution?   Who?
2.    List the assumptions connect each node on the map.       How?
3.    Prioritize the assumptions; select the top two.          What?
4.    How will you measure these two assumptions?              Assump-
                                                                tions?
5.

 25
      Devise an experiment to validate each assumption.
          August 12    Copyright©2012 Poppendieck.LLC   l e a n
lsoftware development
                                   e a n
                       Thank You!
             More Information: www.poppendieck.com

mary@poppendieck.com     Mary Poppendieck      www.poppendieck.com

Contenu connexe

Tendances

Doc is a Four Letter Word
Doc is a Four Letter WordDoc is a Four Letter Word
Doc is a Four Letter WordMatt Badgley
 
Learnings from founding a Computer Vision startup: Chapter 8 Software Enginee...
Learnings from founding a Computer Vision startup: Chapter 8 Software Enginee...Learnings from founding a Computer Vision startup: Chapter 8 Software Enginee...
Learnings from founding a Computer Vision startup: Chapter 8 Software Enginee...Till Quack
 
Automated softwaretestingmagazine december2011
Automated softwaretestingmagazine december2011Automated softwaretestingmagazine december2011
Automated softwaretestingmagazine december2011Amira Manai
 
"The Lean Mindset": Mary & Tom Poppendieck's Keynote at AgileDayChile 2013
"The Lean Mindset": Mary & Tom Poppendieck's Keynote at AgileDayChile 2013"The Lean Mindset": Mary & Tom Poppendieck's Keynote at AgileDayChile 2013
"The Lean Mindset": Mary & Tom Poppendieck's Keynote at AgileDayChile 2013ChileAgil
 
Learnings from founding a Computer Vision startup: Chapter 10: Competition & ...
Learnings from founding a Computer Vision startup: Chapter 10: Competition & ...Learnings from founding a Computer Vision startup: Chapter 10: Competition & ...
Learnings from founding a Computer Vision startup: Chapter 10: Competition & ...Till Quack
 

Tendances (6)

Doc is a Four Letter Word
Doc is a Four Letter WordDoc is a Four Letter Word
Doc is a Four Letter Word
 
Learnings from founding a Computer Vision startup: Chapter 8 Software Enginee...
Learnings from founding a Computer Vision startup: Chapter 8 Software Enginee...Learnings from founding a Computer Vision startup: Chapter 8 Software Enginee...
Learnings from founding a Computer Vision startup: Chapter 8 Software Enginee...
 
Automated softwaretestingmagazine december2011
Automated softwaretestingmagazine december2011Automated softwaretestingmagazine december2011
Automated softwaretestingmagazine december2011
 
"The Lean Mindset": Mary & Tom Poppendieck's Keynote at AgileDayChile 2013
"The Lean Mindset": Mary & Tom Poppendieck's Keynote at AgileDayChile 2013"The Lean Mindset": Mary & Tom Poppendieck's Keynote at AgileDayChile 2013
"The Lean Mindset": Mary & Tom Poppendieck's Keynote at AgileDayChile 2013
 
Learnings from founding a Computer Vision startup: Chapter 10: Competition & ...
Learnings from founding a Computer Vision startup: Chapter 10: Competition & ...Learnings from founding a Computer Vision startup: Chapter 10: Competition & ...
Learnings from founding a Computer Vision startup: Chapter 10: Competition & ...
 
Simple design
Simple designSimple design
Simple design
 

Similaire à The Fastest Learner Wins: Continuous Learning Through Rapid Release Cycles

It's Not About Working Software After All!
It's Not About Working Software After All!It's Not About Working Software After All!
It's Not About Working Software After All!Ignite
 
Mobile's Impact on Workflow and Talent
Mobile's Impact on Workflow and TalentMobile's Impact on Workflow and Talent
Mobile's Impact on Workflow and Talentproductcampnyc
 
Becoming an Enterprise SaaS Company | DecisionDesk @ TechPint
Becoming an Enterprise SaaS Company | DecisionDesk @ TechPintBecoming an Enterprise SaaS Company | DecisionDesk @ TechPint
Becoming an Enterprise SaaS Company | DecisionDesk @ TechPintJohn Knific
 
Solution Design - The Hidden Side of UX (for Product Managers)
Solution Design - The Hidden Side of UX (for Product Managers)Solution Design - The Hidden Side of UX (for Product Managers)
Solution Design - The Hidden Side of UX (for Product Managers)Above the Fold
 
Solution Design - The Hidden Side of UX (for Product Managers)
Solution Design - The Hidden Side of UX (for Product Managers)Solution Design - The Hidden Side of UX (for Product Managers)
Solution Design - The Hidden Side of UX (for Product Managers)Joe Baz
 
Lean Software Development Principles
Lean Software Development PrinciplesLean Software Development Principles
Lean Software Development PrinciplesJohn Vajda
 
Walk, Don't Run: Incremental Change in Enterprise UX
Walk, Don't Run: Incremental Change in Enterprise UXWalk, Don't Run: Incremental Change in Enterprise UX
Walk, Don't Run: Incremental Change in Enterprise UXuxpin
 
Nicholas Hoffmeyer - Adobe Systems - BL_S2_2016
Nicholas Hoffmeyer  - Adobe Systems - BL_S2_2016Nicholas Hoffmeyer  - Adobe Systems - BL_S2_2016
Nicholas Hoffmeyer - Adobe Systems - BL_S2_2016Nick Hoffmeyer
 
design thinking pitch deck presentation
design thinking  pitch deck presentationdesign thinking  pitch deck presentation
design thinking pitch deck presentationSaranya S
 
scrum_po__Publish_dec09_2017_hyd_
scrum_po__Publish_dec09_2017_hyd_scrum_po__Publish_dec09_2017_hyd_
scrum_po__Publish_dec09_2017_hyd_Anubhav Sinha
 
Week2 - IDX 200 Aesthetic Interactions
Week2 - IDX 200 Aesthetic InteractionsWeek2 - IDX 200 Aesthetic Interactions
Week2 - IDX 200 Aesthetic InteractionsMark Zelis
 
Prototyping and MVPs for startups
Prototyping and MVPs for startupsPrototyping and MVPs for startups
Prototyping and MVPs for startupsGeorge Krasadakis
 
case discussion:DEO Product Development
case discussion:DEO Product Developmentcase discussion:DEO Product Development
case discussion:DEO Product DevelopmentSandeep Gunjan
 
How to Best Develop a Product by PlateRate Founder
How to Best Develop a Product by PlateRate FounderHow to Best Develop a Product by PlateRate Founder
How to Best Develop a Product by PlateRate FounderProduct School
 
MARKETING STRATEGIES OF BRANDING APPLE INC
MARKETING STRATEGIES OF BRANDING APPLE INCMARKETING STRATEGIES OF BRANDING APPLE INC
MARKETING STRATEGIES OF BRANDING APPLE INCVivek Mahajan
 

Similaire à The Fastest Learner Wins: Continuous Learning Through Rapid Release Cycles (20)

It's Not About Working Software After All!
It's Not About Working Software After All!It's Not About Working Software After All!
It's Not About Working Software After All!
 
Mobile's Impact on Workflow and Talent
Mobile's Impact on Workflow and TalentMobile's Impact on Workflow and Talent
Mobile's Impact on Workflow and Talent
 
Becoming an Enterprise SaaS Company | DecisionDesk @ TechPint
Becoming an Enterprise SaaS Company | DecisionDesk @ TechPintBecoming an Enterprise SaaS Company | DecisionDesk @ TechPint
Becoming an Enterprise SaaS Company | DecisionDesk @ TechPint
 
Bie 02
Bie 02Bie 02
Bie 02
 
Solution Design - The Hidden Side of UX (for Product Managers)
Solution Design - The Hidden Side of UX (for Product Managers)Solution Design - The Hidden Side of UX (for Product Managers)
Solution Design - The Hidden Side of UX (for Product Managers)
 
Solution Design - The Hidden Side of UX (for Product Managers)
Solution Design - The Hidden Side of UX (for Product Managers)Solution Design - The Hidden Side of UX (for Product Managers)
Solution Design - The Hidden Side of UX (for Product Managers)
 
Lean Software Development Principles
Lean Software Development PrinciplesLean Software Development Principles
Lean Software Development Principles
 
Think like a Product Manager II
Think like a Product Manager IIThink like a Product Manager II
Think like a Product Manager II
 
Walk, Don't Run: Incremental Change in Enterprise UX
Walk, Don't Run: Incremental Change in Enterprise UXWalk, Don't Run: Incremental Change in Enterprise UX
Walk, Don't Run: Incremental Change in Enterprise UX
 
Inside the box - Discussion Guide
Inside the box - Discussion GuideInside the box - Discussion Guide
Inside the box - Discussion Guide
 
Nicholas Hoffmeyer - Adobe Systems - BL_S2_2016
Nicholas Hoffmeyer  - Adobe Systems - BL_S2_2016Nicholas Hoffmeyer  - Adobe Systems - BL_S2_2016
Nicholas Hoffmeyer - Adobe Systems - BL_S2_2016
 
Dual-Track Agile at Scale
Dual-Track Agile at ScaleDual-Track Agile at Scale
Dual-Track Agile at Scale
 
design thinking pitch deck presentation
design thinking  pitch deck presentationdesign thinking  pitch deck presentation
design thinking pitch deck presentation
 
scrum_po__Publish_dec09_2017_hyd_
scrum_po__Publish_dec09_2017_hyd_scrum_po__Publish_dec09_2017_hyd_
scrum_po__Publish_dec09_2017_hyd_
 
Week2 - IDX 200 Aesthetic Interactions
Week2 - IDX 200 Aesthetic InteractionsWeek2 - IDX 200 Aesthetic Interactions
Week2 - IDX 200 Aesthetic Interactions
 
Prototyping and MVPs for startups
Prototyping and MVPs for startupsPrototyping and MVPs for startups
Prototyping and MVPs for startups
 
case discussion:DEO Product Development
case discussion:DEO Product Developmentcase discussion:DEO Product Development
case discussion:DEO Product Development
 
How to Best Develop a Product by PlateRate Founder
How to Best Develop a Product by PlateRate FounderHow to Best Develop a Product by PlateRate Founder
How to Best Develop a Product by PlateRate Founder
 
MARKETING STRATEGIES OF BRANDING APPLE INC
MARKETING STRATEGIES OF BRANDING APPLE INCMARKETING STRATEGIES OF BRANDING APPLE INC
MARKETING STRATEGIES OF BRANDING APPLE INC
 
Cs207 1
Cs207 1Cs207 1
Cs207 1
 

Plus de drewz lin

Web security-–-everything-we-know-is-wrong-eoin-keary
Web security-–-everything-we-know-is-wrong-eoin-kearyWeb security-–-everything-we-know-is-wrong-eoin-keary
Web security-–-everything-we-know-is-wrong-eoin-kearydrewz lin
 
Via forensics appsecusa-nov-2013
Via forensics appsecusa-nov-2013Via forensics appsecusa-nov-2013
Via forensics appsecusa-nov-2013drewz lin
 
Phu appsec13
Phu appsec13Phu appsec13
Phu appsec13drewz lin
 
Owasp2013 johannesullrich
Owasp2013 johannesullrichOwasp2013 johannesullrich
Owasp2013 johannesullrichdrewz lin
 
Owasp advanced mobile-application-code-review-techniques-v0.2
Owasp advanced mobile-application-code-review-techniques-v0.2Owasp advanced mobile-application-code-review-techniques-v0.2
Owasp advanced mobile-application-code-review-techniques-v0.2drewz lin
 
I mas appsecusa-nov13-v2
I mas appsecusa-nov13-v2I mas appsecusa-nov13-v2
I mas appsecusa-nov13-v2drewz lin
 
Defeating xss-and-xsrf-with-my faces-frameworks-steve-wolf
Defeating xss-and-xsrf-with-my faces-frameworks-steve-wolfDefeating xss-and-xsrf-with-my faces-frameworks-steve-wolf
Defeating xss-and-xsrf-with-my faces-frameworks-steve-wolfdrewz lin
 
Csrf not-all-defenses-are-created-equal
Csrf not-all-defenses-are-created-equalCsrf not-all-defenses-are-created-equal
Csrf not-all-defenses-are-created-equaldrewz lin
 
Chuck willis-owaspbwa-beyond-1.0-app secusa-2013-11-21
Chuck willis-owaspbwa-beyond-1.0-app secusa-2013-11-21Chuck willis-owaspbwa-beyond-1.0-app secusa-2013-11-21
Chuck willis-owaspbwa-beyond-1.0-app secusa-2013-11-21drewz lin
 
Appsec usa roberthansen
Appsec usa roberthansenAppsec usa roberthansen
Appsec usa roberthansendrewz lin
 
Appsec usa2013 js_libinsecurity_stefanodipaola
Appsec usa2013 js_libinsecurity_stefanodipaolaAppsec usa2013 js_libinsecurity_stefanodipaola
Appsec usa2013 js_libinsecurity_stefanodipaoladrewz lin
 
Appsec2013 presentation-dickson final-with_all_final_edits
Appsec2013 presentation-dickson final-with_all_final_editsAppsec2013 presentation-dickson final-with_all_final_edits
Appsec2013 presentation-dickson final-with_all_final_editsdrewz lin
 
Appsec2013 presentation
Appsec2013 presentationAppsec2013 presentation
Appsec2013 presentationdrewz lin
 
Appsec 2013-krehel-ondrej-forensic-investigations-of-web-exploitations
Appsec 2013-krehel-ondrej-forensic-investigations-of-web-exploitationsAppsec 2013-krehel-ondrej-forensic-investigations-of-web-exploitations
Appsec 2013-krehel-ondrej-forensic-investigations-of-web-exploitationsdrewz lin
 
Appsec2013 assurance tagging-robert martin
Appsec2013 assurance tagging-robert martinAppsec2013 assurance tagging-robert martin
Appsec2013 assurance tagging-robert martindrewz lin
 
Amol scadaowasp
Amol scadaowaspAmol scadaowasp
Amol scadaowaspdrewz lin
 
Agile sdlc-v1.1-owasp-app sec-usa
Agile sdlc-v1.1-owasp-app sec-usaAgile sdlc-v1.1-owasp-app sec-usa
Agile sdlc-v1.1-owasp-app sec-usadrewz lin
 
Vulnex app secusa2013
Vulnex app secusa2013Vulnex app secusa2013
Vulnex app secusa2013drewz lin
 
基于虚拟化技术的分布式软件测试框架
基于虚拟化技术的分布式软件测试框架基于虚拟化技术的分布式软件测试框架
基于虚拟化技术的分布式软件测试框架drewz lin
 
新浪微博稳定性经验谈
新浪微博稳定性经验谈新浪微博稳定性经验谈
新浪微博稳定性经验谈drewz lin
 

Plus de drewz lin (20)

Web security-–-everything-we-know-is-wrong-eoin-keary
Web security-–-everything-we-know-is-wrong-eoin-kearyWeb security-–-everything-we-know-is-wrong-eoin-keary
Web security-–-everything-we-know-is-wrong-eoin-keary
 
Via forensics appsecusa-nov-2013
Via forensics appsecusa-nov-2013Via forensics appsecusa-nov-2013
Via forensics appsecusa-nov-2013
 
Phu appsec13
Phu appsec13Phu appsec13
Phu appsec13
 
Owasp2013 johannesullrich
Owasp2013 johannesullrichOwasp2013 johannesullrich
Owasp2013 johannesullrich
 
Owasp advanced mobile-application-code-review-techniques-v0.2
Owasp advanced mobile-application-code-review-techniques-v0.2Owasp advanced mobile-application-code-review-techniques-v0.2
Owasp advanced mobile-application-code-review-techniques-v0.2
 
I mas appsecusa-nov13-v2
I mas appsecusa-nov13-v2I mas appsecusa-nov13-v2
I mas appsecusa-nov13-v2
 
Defeating xss-and-xsrf-with-my faces-frameworks-steve-wolf
Defeating xss-and-xsrf-with-my faces-frameworks-steve-wolfDefeating xss-and-xsrf-with-my faces-frameworks-steve-wolf
Defeating xss-and-xsrf-with-my faces-frameworks-steve-wolf
 
Csrf not-all-defenses-are-created-equal
Csrf not-all-defenses-are-created-equalCsrf not-all-defenses-are-created-equal
Csrf not-all-defenses-are-created-equal
 
Chuck willis-owaspbwa-beyond-1.0-app secusa-2013-11-21
Chuck willis-owaspbwa-beyond-1.0-app secusa-2013-11-21Chuck willis-owaspbwa-beyond-1.0-app secusa-2013-11-21
Chuck willis-owaspbwa-beyond-1.0-app secusa-2013-11-21
 
Appsec usa roberthansen
Appsec usa roberthansenAppsec usa roberthansen
Appsec usa roberthansen
 
Appsec usa2013 js_libinsecurity_stefanodipaola
Appsec usa2013 js_libinsecurity_stefanodipaolaAppsec usa2013 js_libinsecurity_stefanodipaola
Appsec usa2013 js_libinsecurity_stefanodipaola
 
Appsec2013 presentation-dickson final-with_all_final_edits
Appsec2013 presentation-dickson final-with_all_final_editsAppsec2013 presentation-dickson final-with_all_final_edits
Appsec2013 presentation-dickson final-with_all_final_edits
 
Appsec2013 presentation
Appsec2013 presentationAppsec2013 presentation
Appsec2013 presentation
 
Appsec 2013-krehel-ondrej-forensic-investigations-of-web-exploitations
Appsec 2013-krehel-ondrej-forensic-investigations-of-web-exploitationsAppsec 2013-krehel-ondrej-forensic-investigations-of-web-exploitations
Appsec 2013-krehel-ondrej-forensic-investigations-of-web-exploitations
 
Appsec2013 assurance tagging-robert martin
Appsec2013 assurance tagging-robert martinAppsec2013 assurance tagging-robert martin
Appsec2013 assurance tagging-robert martin
 
Amol scadaowasp
Amol scadaowaspAmol scadaowasp
Amol scadaowasp
 
Agile sdlc-v1.1-owasp-app sec-usa
Agile sdlc-v1.1-owasp-app sec-usaAgile sdlc-v1.1-owasp-app sec-usa
Agile sdlc-v1.1-owasp-app sec-usa
 
Vulnex app secusa2013
Vulnex app secusa2013Vulnex app secusa2013
Vulnex app secusa2013
 
基于虚拟化技术的分布式软件测试框架
基于虚拟化技术的分布式软件测试框架基于虚拟化技术的分布式软件测试框架
基于虚拟化技术的分布式软件测试框架
 
新浪微博稳定性经验谈
新浪微博稳定性经验谈新浪微博稳定性经验谈
新浪微博稳定性经验谈
 

The Fastest Learner Wins: Continuous Learning Through Rapid Release Cycles

  • 1. lsoftware development e a n The Fastest Learner Wins Living with Black Swans mary@poppendieck.com Mary Poppendieck www.poppendieck.com
  • 2. Agenda 1. Compelling Offer Observing 2. Immediate Connection Questioning 3. Adoption Chain Networking 4. Validated Assumptions 2 Experimenting August 12 Copyright©2012 Poppendieck.LLC l e a n
  • 3. Todd Park 2010 Harvard Graduate (Economics) Booz Allen Hamilton Consultant (Managed Care) Athenahealth (1997)  Maternity Clinic  Health Care Records  Very successful IPO Retirement (2007) US Health and Human Services CTO (2009) 2011 Artist Regina Holliday 3 August 12 Copyright©2012 Poppendieck.LLC l e a n US Federal Government CTO (2012)
  • 4. Agenda 1. Compelling Offer Observing 2. Immediate Connection Questioning 3. Adoption Chain Networking 4. Validated Assumptions 4 Experimenting August 12 Copyright©2012 Poppendieck.LLC l e a n
  • 5. Strategic Inflection Point Business goes on to new heights 10x change in some element of the business. What worked before doesn’t work now. The executives are the last to know. 5 August 12 Copyright©2010 Poppendieck.LLC l e a n Business declines
  • 6. Compelling Offer 10X Improvement in some aspect of the offer Salesforce.com  SaaS gave a 10X reduction in installation and operating costs Skype  Peer-to-peer IP telephony for a 10X reduction in long distance charges Wikipedia  Open source collaboration for a 10X increase in the speed and a 100X reduction in cost for encyclopedia development and maintenance Dropbox  10X improvement in ease of use and safety for those who wanted to keep multiple devices in sync. YouTube  Cell phones gave a 10X improvement in capability to take casual videos, 6 August 12 Copyright©2012 Poppendieck.LLC l e a n YouTube gave a 10X improvement in ease of sharing those videos. See also: http://ecorner.stanford.edu/authorMaterialInfo.html?mid=2732
  • 7. Working Backward PRESS RELEASE Heading – Working Backward Name the product in a way the reader (i.e. your target customers) will understand. Sub-Heading – 1. Write a Press Release Describe who the market for the product is and what benefit they get. One sentence only underneath the title. Summary – Give a summary of the product and the benefit. Assume the reader will not read anything else so make this good. Problem - Describe the problem your product solves. Solution – 2. Write a list of FAQ’s Describe how your product elegantly solves the problem. Quote from You – (and answers) A quote from a spokesperson in your company. How to Get Started – 3. Describe the Customer Describe how easy it is to get started. Experience Customer Quote – Provide a quote from a hypothetical customer that describes how they experienced the benefit. 4. Write a User Manual. Closing and Call to Action – 7 http://www.allthingsdistributed.com /2006/11/working_backwards.html August 12 Copyright©2012 Poppendieck.LLC l e a n Wrap it up; give pointers where the reader should go next. http://www.quora.com/What-is-Amazons-approach-to- product-development-and-product-management
  • 8. Exercise: Write a Press Release Innovation Skill: Observing Working as a group, write a press release for a product real or imaginary. 1. Aim the press release at PRESS RELEASE consumers of the product. Title – 2. Create a tag line to quickly Central theme (Tag line) – summarize the central theme. Summary (10X effect) – 3. Summarize the offer in Problem – terms of its10X effect. Solution – 4. Center your message on a Getting Started – single theme that will define what the product is and is not. 8 Call to Action – August 12 Copyright©2012 Poppendieck.LLC l e a n
  • 9. Agenda 1. Compelling Offer Observing 2. Immediate Connection Questioning 3. Adoption Chain Networking 4. Validated Assumptions 9 Experimenting August 12 Copyright©2012 Poppendieck.LLC l e a n
  • 10. Release Cycle 6 Months Quick & Dirty Value Stream Map: Need a Need a Feature Feature Design Develop Harden UAT Release Cycle Release Cycle Release Cycle Value-Added Time Total Cycle Time Time Total Cycle Start Average Start End Development Model:  Releases are very painful  Avoid releases! 10 August 12 Copyright©2012 Poppendieck.LLC l e a n Thanks to Kent Beck for his ideas on cadence.
  • 11. Release Cycle Quarterly  Hardening: 2 – 4 weeks  Early integration testing becomes essential  Typically: 2 – 4 week iterations  Code from each iteration goes to integration testing Business issues (if software is sold/delivered to customers):  How to price and sell releases?  Which releases to support?  Supporting multiple branches 11 August 12 Copyright©2012 Poppendieck.LLC l e a n can create a support nightmare
  • 12. Release Cycle Monthly Now you need: Hardening  3 days Cross Functional Team Visualization Short Daily Meetings SBE/TDD really working! Works best for:  Software as a Service (SaaS) [Any download to local machines is pushed.] 12 August 12 Copyright©2012 Poppendieck.LLC l e a n  Internal Software
  • 13. Release Cycle Weekly/Daily/Continuous Kanban works well Iterations become irrelevant The team Estimating is not very important is everyone. No branching – Develop on the trunk Test & deployment automation is essential Rapid cycles of learning drive portfolio decisions Things. Just. Work.  One or our large web-based customers has been deploying daily for five years!  Google: gmail deploys 2X/week 13 August 12 Copyright©2012 Poppendieck.LLC l e a n  What is the fastest release cycle here?
  • 14. Immediate Connection Bent Victor Our Inventing on Principle http://vimeo.com/36579366 Guiding Principle: People should not be told what to do. Combining Principles: Teams should adjust what Bent’s Guiding Principle: they are doing based on Creators need an what team members learn immediate connection with what they create. directly from their efforts. Bret Victor invents tools that enable people to understand and create. He has designed experimental UI concepts at Apple, interactive data graphics for Al Gore, and musical instruments at Alesis. 14 August 12 Copyright©2012 Poppendieck.LLC l e a n
  • 15. Exercise: Draw a Feedback Matrix Innovation Skill: Questioning I adjust what I do based on: Immediate visibility of results 1. Have everyone at the table plot a point for a typical development team members. 2. Add additional points for members from info about results different functions. 3. Plot the ideal point Delayed for team members working on that 15 Indirect information about consumers August 12 l e a n Direct connection with consumers Copyright©2012 Poppendieck.LLC compelling offer.
  • 16. Agenda 1. Compelling Offer Observing 2. Immediate Connection Questioning 3. Adoption Chain Networking 4. Validated Assumptions 16 Experimenting August 12 Copyright©2012 Poppendieck.LLC l e a n
  • 17. The Age of the Platform Contributor Consumer 17 August 12 Copyright©2012 Poppendieck.LLC l e a n Platform (infrastructure and rules)
  • 18. Adoption Chain Innovators often forget Complementors! 3G Music? Repair? Books? Networks? The first MP3 Player The first 3G Phone Run-flat tires The first e-reader 1998 2002 Honda Odyssey 2005 2006 18 August 12 Copyright©2012 Poppendieck.LLC l e a n
  • 19. Cost vs. Relative Benefit Adopters see value differently. Innovator’s Perspective Adopter’s Perspective Innovator ++ Relative ++ Benefit Product Distributor + Cost ++ Product Cost + Additional Retailer - Costs/Risks Consumer ++ +++ New New Old This adoption chain Product Product Product will not work! Benefit Benefit Benefit If any organization on the adoption chain perceives 19 a negative value, the adoption chain is broken. August 12 Copyright©2012 Poppendieck.LLC l e a n The Wide Lens, by Ron Adner
  • 20. Exercise: Evaluate the Adoption Chain Innovation Skill: Networking You would like to develop a product with compelling value and provide immediate connection between the product creators and consumers. In order to achieve this, you need Adoption Chain the cooperation of organizations within and outside of you Party 1 ++ company that are not part of your immediate team. ++ 1. Make a list of the parties who must change the way they Party 2 + do things in order for the improvement to be successful. 2. Look at the benefits to be gained and the cost of change Party 3 - from the perspective of each party. Party 4 ++ 3. Are there parties where the cost outweighs the benefit? +++ 4. What can be done to change the equation so the benefits 20 are greater than the cost for that party? August 12 Copyright©2012 Poppendieck.LLC l e a n
  • 21. Agenda 1. Compelling Offer Observing 2. Immediate Connection Questioning 3. Adoption Chain Networking 4. Validated Assumptions 21 Experimenting August 12 Copyright©2012 Poppendieck.LLC l e a n
  • 22. Validated Assumptions Only a few large companies have been able to sustain growth over time by coming up with successful new disruptive businesses. These companies share a common practice: They have systems in place that encourage small, cross-functional employee teams to conduct frugal experiments. Scott Cook, Intuit Validated Assumptions: 1. List assumptions that must be true in order for the product to succeed. a) Which ones are most important? 2. Devise experiments to determine whether critical assumptions are true. a) Create a measurable hypotheses that will demonstrate clear cause and effect. b) Run many, quick experiments to test the hypotheses. Lean Startup: 1. Start with a Business Success Model a) Success metrics which demonstrate clear cause and effect. 2. Establish a baseline – with a Minimum Viable Product l e a n 3. Target every initiative at improving a success metric 4. Do not add capabilities without validation (eg. split test) 22 August 12 Copyright©2012 Poppendieck.LLC
  • 23. Experimental Approach Site visitors are randomly A assigned to see version A or B B Don’t Miss this excellent paper: Online Experimentation at Microsoft by Kohavi , Crook, & Longbotham Presented at KDD 2009 (Knowledge Discovery & Data Mining) http://exp-platform.com/expMicrosoft.aspx 14.5% Conversion B is better than A 18.6% Conversion Amazon.com Case Study 1. Most of the time the guess about how customers Amazon’s Greg Linden created a prototype will behave will be wrong – even for experts! which gave personalized recommendations based on items in the shopping cart. The feature 2. Test early – don’t waste a lot of time on in- was opposed by a marketing SVP who told Greg depth analysis or planning the perfect design. to stop, but Greg created a test anyway. He was 3. Test often – most experiments don’t tell much. allowed to pushed it live. The feature ‘won’ by such a wide margin that it was immediately 4. A failed experiment is not a failure – it’s a l e a n adopted, increasing sales by an estimated 3%. learning opportunity. The only failures are failure http://glinden.blogspot.com/2006/ 04/early-amazon-shopping-cart.html to learn or failing to conduct a good experiment. 23 August 12 Copyrignt©2011 Poppendieck.LLC
  • 24. Why? Impact Maps Why? Who? Who? Who? How? How? How? What? What? What? Connections =Assumptions 24 August 12 Copyright©2012 Poppendieck.LLC l e a n Images and ideas from: Impact Mapping Handbook by Gojko Adzic – Available soon Check out:www.impactmapping.org
  • 25. Exercise: Find and Validate Assumptions Innovation Skill: Experimenting Validate assumptions for your compelling offer. 1. Draw an Impact Map. Impact a) Start with the goal – make it measurable. Map b) Who needs to be involved? c) How will they contribute? Why? d) What needs to be done to support each contribution? Who? 2. List the assumptions connect each node on the map. How? 3. Prioritize the assumptions; select the top two. What? 4. How will you measure these two assumptions? Assump- tions? 5. 25 Devise an experiment to validate each assumption. August 12 Copyright©2012 Poppendieck.LLC l e a n
  • 26. lsoftware development e a n Thank You! More Information: www.poppendieck.com mary@poppendieck.com Mary Poppendieck www.poppendieck.com