SlideShare une entreprise Scribd logo
1  sur  9
Using logic diagrams to
aid critical reflection
Paul Ducker, DAPA Day, 23 March 2010
What is a logic model?
“If you don’t know where you’re going, how are you
         gonna’ know when you get there?”
            Yogi Berra, Former major league baseball player and manager




• a logic model is a picture of how you believe your
  programme will work

• it lays out what the programme is expected to
  achieve, based on an identified chain of events

• it helps create shared understanding
• it enables you to anticipate the data and
  resources you will need to achieve success
What do they look like?
What do they look like?




  INPUTS   ACTIVITIES   OUTPUTS   OUTCOMES   IMPACT
How are they used?
“Most of the value in a logic model is in the process
 of creating, validating and modifying the model....”
               W.K.Kellogg Foundation Evaluation Handbook (1998)



• during design and planning to help develop and
  communicate programme strategy

• during programme implementation and
  management to focus energy

• throughout development and delivery to ensure
  evaluation and strategic reporting are
  embedded and encourage reflection and learning.
Including assumptions

• A logic model only has to be logical and sequential
• It becomes more powerful when you say why you
  expect the desired change to happen

• Adding the causal mechanism moves the model
  from programme logic to programme theory
“A logic model brings program concepts and dreams to life”
                                   W.K.Kellogg Foundation Logic Model Development Guide




  “These models help build a common understanding between managers
and evaluation ... such agreement is a pre-requisite for evaluation work that
is likely to be useful to management. [These models] display the key events
   (inputs, activities, outcomes) that could be monitored and the assumed
      causal linkages that could be tested in evaluations of the program”
      Joseph S. Wholey, Harry P. Haltry and K.E Newcomer quoted in W.K.Kellogg Foundation Logic Model Development Guide




   “The idea that evaluation should include conceptualising and testing a
program’s theory of change emerged in the 1970s as part of a more general
     concern about assessing a program’s readiness for evaluation........
 evaluability assessment was the evaluator’s version of foreplay: getting the
         program ready for the act itself - the act being evaluation”
                                     Micheal Quinn Patton, Utilization-Focused Evaluation
Limits of logic                                               (criticisms of logic models)




• Over simplifying complex problems
  clear how model relates to wider environment)
                                                                             (include assumptions, be




• Encourages narrow, linear thinking based on past
  experience (start with need and desired outcomes, and then work back to activities)

• All very well but ....                    (start from the premise that evaluation is about helping focus
  effort on the right things, not just be about reporting on progress to funders, otherwise it is not worth
  the effort)
The end
Good luck

Contenu connexe

Dernier

Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfchloefrazer622
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room servicediscovermytutordmt
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh
 
General AI for Medical Educators April 2024
General AI for Medical Educators April 2024General AI for Medical Educators April 2024
General AI for Medical Educators April 2024Janet Corral
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Disha Kariya
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfAyushMahapatra5
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
social pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajansocial pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajanpragatimahajan3
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphThiyagu K
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingTeacherCyreneCayanan
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxiammrhaywood
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 

Dernier (20)

Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdf
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room service
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
General AI for Medical Educators April 2024
General AI for Medical Educators April 2024General AI for Medical Educators April 2024
General AI for Medical Educators April 2024
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
social pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajansocial pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajan
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 

En vedette

How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 

En vedette (20)

How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 

DAPA programmes: Using logic models (truncated version)

  • 1. Using logic diagrams to aid critical reflection Paul Ducker, DAPA Day, 23 March 2010
  • 2. What is a logic model? “If you don’t know where you’re going, how are you gonna’ know when you get there?” Yogi Berra, Former major league baseball player and manager • a logic model is a picture of how you believe your programme will work • it lays out what the programme is expected to achieve, based on an identified chain of events • it helps create shared understanding • it enables you to anticipate the data and resources you will need to achieve success
  • 3. What do they look like?
  • 4. What do they look like? INPUTS ACTIVITIES OUTPUTS OUTCOMES IMPACT
  • 5. How are they used? “Most of the value in a logic model is in the process of creating, validating and modifying the model....” W.K.Kellogg Foundation Evaluation Handbook (1998) • during design and planning to help develop and communicate programme strategy • during programme implementation and management to focus energy • throughout development and delivery to ensure evaluation and strategic reporting are embedded and encourage reflection and learning.
  • 6. Including assumptions • A logic model only has to be logical and sequential • It becomes more powerful when you say why you expect the desired change to happen • Adding the causal mechanism moves the model from programme logic to programme theory
  • 7. “A logic model brings program concepts and dreams to life” W.K.Kellogg Foundation Logic Model Development Guide “These models help build a common understanding between managers and evaluation ... such agreement is a pre-requisite for evaluation work that is likely to be useful to management. [These models] display the key events (inputs, activities, outcomes) that could be monitored and the assumed causal linkages that could be tested in evaluations of the program” Joseph S. Wholey, Harry P. Haltry and K.E Newcomer quoted in W.K.Kellogg Foundation Logic Model Development Guide “The idea that evaluation should include conceptualising and testing a program’s theory of change emerged in the 1970s as part of a more general concern about assessing a program’s readiness for evaluation........ evaluability assessment was the evaluator’s version of foreplay: getting the program ready for the act itself - the act being evaluation” Micheal Quinn Patton, Utilization-Focused Evaluation
  • 8. Limits of logic (criticisms of logic models) • Over simplifying complex problems clear how model relates to wider environment) (include assumptions, be • Encourages narrow, linear thinking based on past experience (start with need and desired outcomes, and then work back to activities) • All very well but .... (start from the premise that evaluation is about helping focus effort on the right things, not just be about reporting on progress to funders, otherwise it is not worth the effort)

Notes de l'éditeur

  1. Logic models come in as many sizes and shapes as the programmes they represent Although, at their heart they all have the five basic components of: Inputs: the things we invest in a programme or bring to bear on a situation. The materials that the organisation or programme takes in and then processes to produce the results desired by the organisation Activities: Processes are used by the organisation or programme to manipulate and arrange items to produce the results desired by the organisation or programme. Logic models are usually only concerned with the major recurring processes associated with producing the results desired by the organisation or programme Outputs: Outputs are usually the tangible results of the major processes in the organization. They are usually accounted for by their number Outcomes: Outcomes are the (hopefully positive) impacts on those people whom the organization wanted to benefit with its programs. Outcomes are usually specified in terms of: a) learning, including enhancements to knowledge, understanding/perceptions/attitudes, and behaviors b) skills (behaviors to accomplish results, or capabilities) c) conditions (increased security, stability, pride, etc.) It's often to specify outcomes in terms of short-term, intermediate and long-term Impact: Can be seen as Outcome in the longer term (7 - 10 years)
  2. Saying that you crawl before you walk before you run is a descriptive logic model; Saying that you crawl, and crawling develops the gross-motor skills and body control capabilities that make it possible to walk; you walk, and walking develops the balance, further gross-motor skills, and body control needed to run .... moves the model from programme logic to programme theory
  3. Avoid linear thinking by starting from the desired outcome and working back ... rather than strictly following the left to right orthodoxy of inputs to outcome ... Paul McCawley, University of Idaho, suggests asking the following sorts of questions: 1. What is the current situation that we intend to impact? 2. What will it look like when we achieve the desired situation or outcome? 3. What behaviours need to change for that outcome to be achieved? 4. What knowledge or skills do people need before the behaviour will change? 5. What activities need to be performed to cause the necessary learning? 6. What resources will be required to achieve the desired outcome?
  4. Key sources: - W.K.Kellogg Foundation Logic Model Development Guide, Updated 2004 http://www.wkkf.org/knowledge-center/Resources-Page.aspx [Accessed 20/03/10] - Utilization-Focused Evaluation, 4th Edition, Michael Quinn Patton, Sage 2008 - Teaching for Quality Learning at University, 3rd Edition, John Biggs and Catherine Tang, SRHE/OU 2007 - The Logic Model for program planning and evaluation, Paul F. McCawley, Associate director, University of Idaho Extension. Downloaded from http://www.uidaho.edu/extension/LogicModel.pdf [Accessed 20/03/10] - Paper outlining approach to Logic model used by the Center for Youth and Communities at the Heller School for Social Policy and Management, Brandeis Universities. Downloaded from http://www.service-learningpartnership.org/site/DocServer/Tool_2_Logic_Models.pdf?docID=2282 [Accessed 20/02/10] - University of Winsconsin Extension Program development and evaluation pages (information, templates and link to an online course) http://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html [Accessed 20/03/10] - United Way: Outcome measurement resource network i. Program outcome model http://www.liveunited.org/Outcomes/Resources/MPO/model.cfm [Accessed 20/03/10] ii. Measuring program outcomes: a practical approach, 1996 http://www.liveunited.org/Outcomes/Resources/MPO/ [Accessed 20/03/10]