SlideShare a Scribd company logo
1 of 16
How Rigorous Evaluations Support Program
            Implementation

           Donna Smith-Moncrieffe
      National Crime Prevention Centre
         Kids Not Cons Conference
             March 21-23, 2012
                   Toronto
Summary of the Presentation

 NCPC Mandate


 Evaluations at NCPC
       Elements of a Rigorous Evaluation



 How Rigorous Evaluations Support Program Implementation?


           Learning from Results
           Fidelity: Understanding How to Implement the Program
           Logic Model: Understanding How Activities Lead to Results



 Summary




                                                                        2
3
NCPC’s Elements of a Rigorous Evaluation




                                           4
Rigorous Evaluations Can Be Beneficial for
Project Development and Implementation




                                             5
How Rigorous Evaluations Support Program
Implementation




                                           6
Learning from Results




                        7
# 1 Learning From Results




                            8
# 1 Learning From Results Cont’d




                                   9
Program Fidelity




                   10
#2: Fidelity: Understanding How to Implement
the Program




                                               11
# 2: Fidelity
Relationship Between Fidelity & Type of Program




                              Highest Level of
                                  Fidelity




                                         Moderate Levels
                                           of Fidelity




                                                 Low Levels of
                                                    Fidelity


                                                                 12
Logic Model: Understanding How Program
Activities Lead to Results




                                         13
# 3: Logic Models




                    14
Summary

● Projects can improve implementation by using the following strategies and/
  or tools:


    - Learning from the results (especially if the results are shared and used
        during the evaluation)
    - Using a fidelity tool
    - Frequently referring to the logic model to ensure that the target group,
        activities and outcomes are “logically” related
    -
● Obtaining Value for Money results (cost effectiveness of programming) and
  using tools to increase accountability contribute to long term benefits
  including:


    - Using the budget to enhance program management
    - Program sustainability
    - Increased probability of future funding
                                                                                 15
Thank You




                           Contact:

         Donna Smith-Moncrieffe, BSc. Crim Dip, MSc.
                   Senior Evaluation Advisor
    Public Safety Canada, National Crime Prevention Centre
                Policy, Research and Evaluation
                        Tel: 416-952-0423
                       Fax: 416-952-0483
          Email: donna.smith-moncrieffe@ps-sp.gc.ca
   Web : www.PublicSafety.gc.ca | www.SecuritePublique.gc.ca



                                                               16

More Related Content

Similar to Ps sp-#581705-1-how rigorous program evaluation supports program implementation

Evaluation introduction
Evaluation introductionEvaluation introduction
Evaluation introduction
Nathan Loynes
 
Running head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docx
Running head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docxRunning head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docx
Running head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docx
toltonkendal
 
importance of resources allocation in formal method of software engineering ...
 importance of resources allocation in formal method of software engineering ... importance of resources allocation in formal method of software engineering ...
importance of resources allocation in formal method of software engineering ...
Abdul Naqashbandi
 

Similar to Ps sp-#581705-1-how rigorous program evaluation supports program implementation (20)

Work shop project management
Work shop project managementWork shop project management
Work shop project management
 
Adam Suchley - Predictive Delivery Assurance - APM Assurance SIG Conference 2018
Adam Suchley - Predictive Delivery Assurance - APM Assurance SIG Conference 2018Adam Suchley - Predictive Delivery Assurance - APM Assurance SIG Conference 2018
Adam Suchley - Predictive Delivery Assurance - APM Assurance SIG Conference 2018
 
PMP - Project Initiation Template for Professionals
PMP - Project Initiation Template for ProfessionalsPMP - Project Initiation Template for Professionals
PMP - Project Initiation Template for Professionals
 
How to Implement & Manage an Energy Management Program
How to Implement & Manage an Energy Management ProgramHow to Implement & Manage an Energy Management Program
How to Implement & Manage an Energy Management Program
 
Evaluation introduction
Evaluation introductionEvaluation introduction
Evaluation introduction
 
Free video lecture bca
Free video lecture bcaFree video lecture bca
Free video lecture bca
 
Breaking the Project Failure Cycle
Breaking the Project Failure CycleBreaking the Project Failure Cycle
Breaking the Project Failure Cycle
 
Predictive project analytics: Will your project be successful?
Predictive project analytics: Will your project be successful?Predictive project analytics: Will your project be successful?
Predictive project analytics: Will your project be successful?
 
Florence Kalipa_latest
Florence Kalipa_latestFlorence Kalipa_latest
Florence Kalipa_latest
 
Disaster Risk Management
Disaster Risk ManagementDisaster Risk Management
Disaster Risk Management
 
Elements of Effective Practice - Design, Management & Evaluation
Elements of Effective Practice - Design, Management & EvaluationElements of Effective Practice - Design, Management & Evaluation
Elements of Effective Practice - Design, Management & Evaluation
 
Running head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docx
Running head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docxRunning head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docx
Running head PROJECT MANAGEMENT.1PROJECT MANAGEMENT.2.docx
 
Program Management 2.0: Risk Management
Program Management 2.0: Risk ManagementProgram Management 2.0: Risk Management
Program Management 2.0: Risk Management
 
concept of evaluation "Character insight"
concept of evaluation "Character insight"concept of evaluation "Character insight"
concept of evaluation "Character insight"
 
Ben Mkt 347 Week 4
Ben Mkt 347 Week 4Ben Mkt 347 Week 4
Ben Mkt 347 Week 4
 
importance of resources allocation in formal method of software engineering ...
 importance of resources allocation in formal method of software engineering ... importance of resources allocation in formal method of software engineering ...
importance of resources allocation in formal method of software engineering ...
 
12 Step Program and 12 Reasons why PRojects Fail
12 Step Program and 12 Reasons why PRojects Fail12 Step Program and 12 Reasons why PRojects Fail
12 Step Program and 12 Reasons why PRojects Fail
 
Developing Standards for Enterprise Schedule Quality
Developing Standards for Enterprise Schedule QualityDeveloping Standards for Enterprise Schedule Quality
Developing Standards for Enterprise Schedule Quality
 
Improving Accountability
Improving AccountabilityImproving Accountability
Improving Accountability
 
Challenging Aspects of Modern Project Management
Challenging Aspects of Modern Project ManagementChallenging Aspects of Modern Project Management
Challenging Aspects of Modern Project Management
 

Recently uploaded

Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
AnaAcapella
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 

Recently uploaded (20)

Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Magic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptxMagic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptx
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Third Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptxThird Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptx
 

Ps sp-#581705-1-how rigorous program evaluation supports program implementation

  • 1. How Rigorous Evaluations Support Program Implementation Donna Smith-Moncrieffe National Crime Prevention Centre Kids Not Cons Conference March 21-23, 2012 Toronto
  • 2. Summary of the Presentation  NCPC Mandate  Evaluations at NCPC  Elements of a Rigorous Evaluation  How Rigorous Evaluations Support Program Implementation?  Learning from Results  Fidelity: Understanding How to Implement the Program  Logic Model: Understanding How Activities Lead to Results  Summary 2
  • 3. 3
  • 4. NCPC’s Elements of a Rigorous Evaluation 4
  • 5. Rigorous Evaluations Can Be Beneficial for Project Development and Implementation 5
  • 6. How Rigorous Evaluations Support Program Implementation 6
  • 8. # 1 Learning From Results 8
  • 9. # 1 Learning From Results Cont’d 9
  • 11. #2: Fidelity: Understanding How to Implement the Program 11
  • 12. # 2: Fidelity Relationship Between Fidelity & Type of Program Highest Level of Fidelity Moderate Levels of Fidelity Low Levels of Fidelity 12
  • 13. Logic Model: Understanding How Program Activities Lead to Results 13
  • 14. # 3: Logic Models 14
  • 15. Summary ● Projects can improve implementation by using the following strategies and/ or tools: - Learning from the results (especially if the results are shared and used during the evaluation) - Using a fidelity tool - Frequently referring to the logic model to ensure that the target group, activities and outcomes are “logically” related - ● Obtaining Value for Money results (cost effectiveness of programming) and using tools to increase accountability contribute to long term benefits including: - Using the budget to enhance program management - Program sustainability - Increased probability of future funding 15
  • 16. Thank You Contact: Donna Smith-Moncrieffe, BSc. Crim Dip, MSc. Senior Evaluation Advisor Public Safety Canada, National Crime Prevention Centre Policy, Research and Evaluation Tel: 416-952-0423 Fax: 416-952-0483 Email: donna.smith-moncrieffe@ps-sp.gc.ca Web : www.PublicSafety.gc.ca | www.SecuritePublique.gc.ca 16