Show Me the Outcomes! Evaluating and Proving Your Impact on the Community Learn how to: 1. Understand how to build a successful outcomes plan for your nonprofit organization 2. Increase your funding by proving your program success to your funders 3. Make informed decisions about future programming and resource allocation You will also receive an inside view of the Apricot Outcomes Palette™, a dynamic outcomes reporting tool Presented by: Kathryn Engelhardt-Cronk Founder/CEO/President Community TechKnowledge, Inc.

1. Show Me the Outcomes!
Evaluating and Proving Your
Impact on the Community
Kathryn Engelhardt-Cronk
Founder/CEO/President
Community TechKnowledge, Inc.
kec@communitytech.net

2. Why Are You Here Today?
 How am I going to continue to raise funds to
keep my nonprofit running?
 How am I going to prove that our services are
a success?
 How do I keep my staff focused on what
works?
 How can I save money, while increasing our
capacity to serve?
 How do I keep my board and other volunteers
informed of our organization’s progress
 How do I engage and empower our consumers
in their progress

3. Solution to Your “Pain”- #1
You Will Need Technology Tools to
Support Your New Outcomes/
Evaluation Plan

4. Benefits of Technology in
Implementing an Outcomes Model
1. Provide a simple, completely secure and
straightforward, easy and efficient, unique
data entry at the point of service

5. Benefits of Technology in
Implementing an Outcomes Model
1. Simple, completely secure and
straightforward, easy and efficient, unique
data entry at the point of service
2. Provide sophisticated, visually clear and
attractive, informative reports in a variety of
color-coded, graphic formats

6. Benefits of Technology in
Implementing an Outcomes Model
1. Simple, completely secure and
straightforward, easy and efficient, unique
data entry at the point of service
2. Sophisticated, visually clear and attractive,
informative reports in a variety of color-
coded, graphic formats
3. Allow you to provide consumers, policy
makers, staff and funders with timely critical
information re: your mission, progress &
success

7. Benefits of Technology in
Implementing an Outcomes Model
1. Simple, completely secure and
straightforward, easy and efficient, unique
data entry at the point of service
2. Sophisticated, visually clear and attractive,
informative reports in a variety of color-
coded, graphic formats
3. Consumers, policy makers, staff and funders
receive critical information re: your mission,
progress & success
4. You won’t have to be Archimedes to track
your data

8. You (or me) Tracking
Outcomes Without Technology

9. You Reporting Outcomes
WITH Technology
Permanent Senior Access Green Arts Access Increased Pre-School Decrease
Housing to Health Care Strategy for School Voter Readiness School
Education Age Children Registration Drop Out %

10. Solution to Your “Pain” - #2
Develop an Outcomes/
Evaluation Plan!

11. At Least 5 Good Reasons …
1. To define program/project success

12. At Least 5 Good Reasons …
1. To define program/project success
2. To understand the components and process
of success

13. At Least 5 Good Reasons …
1. To define program/project success
2. To understand the components and process
of success
3. To prove program/project success

14. At Least 5 Good Reasons …
1. To define program/project success
2. To understand the components and process
of success
3. To prove program/project success
4. To make informed decisions about future
programming and resource allocation

15. At Least 5 Good Reasons …
1. To define program/project success
2. To understand the components and
process of success
3. To prove program/project success
4. To make informed decisions about
future programming and resource
allocation
5. To qualify for more and larger grants
and for other funding

16. In a Perfect World …
Outcome/Evaluation models
are implemented as a part of a
total community-wide Impact
Strategy

17. 5 Step Impact/Outcomes
Framework
Impact Strategy/Statement
Impact Area/s
Outcomes (Where YOU, the
Service Provider,
Gain Focus and
Indicators Begin Planning)
Milestones
Target Achievement

18. Step 1: What is an Impact
Strategy Statement?
MANY stakeholders develop a
community-wide, long-term
strategy that includes the
relevant universe and that
results in a quality of life-based
statement.

19. In Other Words…
Most service provider
organizations DO NOT create or
sustain community-wide Impact
Strategies.

20. Sample Impact Strategy
Statements
Build vibrant and tolerant
democracies whose
governments are accountable
to their citizens.
Promote community-wide
wellness

21. Step 1 Promote community-wide
wellness
Impact Area/s
Outcomes (Where YOU, the
Service Provider,
Gain Focus and
Indicators Begin Planning)
Milestones
Target Achievement

22. Step 2: Impact Areas
This is where strategic thinking
begins to focus on the specific
needs of a community or special
demographic
Tip #1. Allows Service Providers and Funders
to begin to understand where their
organizations and programs “fit” within the
strategy and how they can make a
measureable difference.

23. Sample Impact Areas
The Open Society Institute works to build
vibrant and tolerant democracies whose
governments are accountable to their citizens.
Impact Area: Health
Promote community-wide wellness
Impact Area: Housing

24. Promote community-wide wellness
Step 2 Housing
Outcomes
Indicators
Milestones
Target Achievement

25. Step 3: Outcomes
…where your work begins
But first, let’s create a fictitious
organization that needs an
Outcomes/Evaluation Plan.

26. The Nonprofit:
“Life Skills Housing Access”
Mission: “To provide effective and
enhanced housing options that meet
the needs of all community
members.”
Program for which
funding
is needed:
Homeless Housing
Services

27. Outcomes Definition
Outcomes are benefits or changes
for individuals or populations
during or after participating in
program activities and/or
influenced by a program's outputs.
(a.k.a. Objectives; Strategic Themes)

28. Outcome Attributes
 Can be measured

29. Outcome Attributes
 Can be measured
 Are directly related to Impact Areas

30. Outcome Attributes
 Can be measured
 Are directly related to Impact Areas
 Acts to define performance goals of
Impact Strategy

31. Outcome Attributes
 Can be measured
 Are directly related to Impact Areas
 Acts to define performance goals of
Impact Strategy
 Requires periodic review
Tip #2. Individual or multiple Outcome/s
can be collaboratively imposed by
funders OR developed by the service
provider or a communicating consortium
of providers.

32. Sample Outcome
“Permanent Housing Access for
Homeless Individuals in Our
Community”

33. Outcomes Statement

34. Promote community-wide wellness
Housing
Step 3 Permanent Housing
For Our Homeless
Indicators
Milestones
Target Achievement

35. Step 4: Indicators
 Specific, measure-able
performance goals, consisting of
individual outputs, inputs and
milestones/targets.

36. What Are Indicators?, con’d.…
 Specific, measure-able
performance goals, consisting of
individual outputs, inputs and
milestones/targets.
 These Indicators are tracked to
measure how well a program is
achieving an Outcome.

37. Indicator Attributes
 Definable, quantifiable, measure-
able

38. Indicator Attributes
 Definable, quantifiable, measure-
able
 Metrics are drawn upon analysis of
available national /regional
information

39. Indicator Attributes
 Definable, quantifiable, measure-
able
 Metrics are drawn upon analysis of
available national /regional
information
 Aligns Outcomes with your
services’ relevance

40. Two (2) Sample Indicators
Indicator #1: 80% of program
Participants Will Successfully
Acquire Permanent Housing

41. Two (2) Sample Indicators
Indicator #1: 80% of program
Participants Will Successfully
Acquire Permanent Housing
Indicator #2: 85% of Enrollees
Will Report a Better Understanding
of Available Housing Options

42. Promote community-wide wellness
Housing
Permanent Housing for
Our Homeless
Step 4
80% of program Participants Will
Successfully Acquire Permanent
Housing
Milestones
Target
Achievements

43. Indicator/s Statement

44. Step 5: The Evaluation
Plan
Now comes the hardest (and the most
satisfying) component of Outcomes
Modeling.

45. What is Performance
Evaluation?
The Definition:
Strategies and objectives for a
program's, client’s/consumer’s or
group of clients’/consumers’ level
of achievement and how you will
prove success.
a.k.a Service or Consumer Goals; Results

46. Performance Evaluation /
Measurement Attributes
 Definition of target population/s

47. Performance Evaluation /
Measurement Attributes
 Definition of target population/s
 Identification of service/program inputs, and
outputs and goals that tie to each Indicator

48. Performance Evaluation /
Measurement Attributes
 Definition of target population/s
 Identification of service/program inputs, and
outputs and goals that tie to each Indicator
 Expectations defined that directly correlate
with analysis of what constitutes successful
performance

49. Performance Evaluation /
Measurement Attributes
 Definition of target population/s
 Identification of service/program inputs, and
outputs and goals that tie to each Indicator
 Expectations defined that directly correlate
with analysis of what constitutes successful
performance
 Progress is monitored via defined
methodologies to measure Indicator
fulfillment

50. Promote community-wide wellness
Housing
Permanent Housing for
Our Homeless
Step 4
80% of program Participants Will
Successfully Acquire Permanent
Housing
Milestones
Target
Achievements:
Evaluation Plan

51. Unique Performance
Milestones

52. Homeless Housing Services:
Performance Measurement Example …
 Target Population: 50 males and females,
aged 18+ who are currently homeless or living in
temporary quarters

53. Plan Description
 Target Population: 50 males and females,
aged 18+ who are currently homeless or living in
temporary quarters
 Service Description: Counseling and one-to-
one support to prepare and place homeless
individuals for permanent housing access

54. Plan Description
 Target Population: 50 males and females,
aged 18+ who are currently homeless or living in
temporary quarters
 Service Description: Counseling and one-to-
one support to prepare and place homeless
individuals for permanent housing access
 Inputs: Three full-time staff counselors; Life
Skills Housing Funds - total $20,000; resource
lists of local AA and NA groups; bus vouchers for
transportation to groups: total $500; furniture
vouchers for each successfully placed
participant: total $4,500

55. Performance Measurement
Example: Outputs
 50 homeless individuals recruited

56. Performance Measurement
Example: Outputs
 50 homeless individuals recruited
 Each applicant receives $10 in bus vouchers

57. Performance Measurement
Example: Outputs
 50 homeless individuals recruited
 Each applicant receives $10 in bus vouchers
 Each participant attends three AA or NA
meetings prior to apt application (150
meetings)

58. Performance Measurement
Example: Outputs
 50 homeless individuals recruited
 Each applicant receives $10 in bus vouchers
 Each participant attends three AA or NA
meetings prior to apt application (150
meetings)
 Each participant applies for, and views, at
least three available apartments (150 views)

59. Performance Measurement
Example: Outputs
 50 homeless individuals recruited
 Each applicant receives $10 in bus vouchers
 Each participant attends three AA or NA
meetings prior to apt application (150
meetings)
 Each participant applies for, and views, at
least three available apartments (150 views)
 Each participant applies for Life Skills Housing
Fund assistance of $500

60. Performance Measurement
Example: Outputs
 50 homeless individuals recruited
 Each applicant receives $10 in bus vouchers
 Each participant attends three AA or NA
meetings prior to apt application (150
meetings)
 Each participant applies for, and views, at
least three available apartments (150 views)
 Each participant applies for Life Skills Housing
Fund assistance of $500
 Each successful participant receives Re-Use
Network voucher for furniture assistance –
each participant $100

61. Performance Measurement
Example: Outputs
 50 homeless individuals recruited
 Each applicant receives $10 in bus vouchers
 Each participant attends three AA or NA
meetings prior to apt application (150
meetings)
 Each participant applies for, and views, at
least three available apartments (150 views)
 Each participant applies for Life Skills Housing
Fund assistance of $500
 Each successful participant receives Re-Use
Network voucher for furniture assistance –
each participant $100
 Each applicant receives moving assistance

62. Demographic/Output Data
Collection

63. Client Demographics

64. Client Demographics: Age

65. Output Tracking Form

66. Sample Program Output
Report

67. Performance Measurement
Example – Program Goals
Consumer/Program Goals
 40 of all 50 of program enrollees
successfully placed in permanent
housing for at least 60 days

68. Performance Measurement
Example – Program Goals
Consumer/Program Goals
 40 of all 50 of program enrollees
successfully placed in permanent
housing for at least 60 days
 47 of 50 enrollees self-report
that they understand more
about planning for and finding
housing

69. The Completed Impact Strategy
Outcomes Framework
Promote community-wide wellness
Basic Needs/Housing
Permanent Housing
Access for Homeless
80% of Participants Will
Successfully Acquire
Permanent Housing
Homeless
Housing
Evaluation Plan

70. Consumer Program Goals

71. 60 Day Follow Up--by
Program

72. Methodology Examples
Evaluation Methodology:
 Enrollees self-report AA/NA Attendance

73. Methodology Examples
Evaluation Methodology:
 Enrollees self-report AA/NA Attendance
 Counselors document Life Skills Housing Fund
application

74. Methodology Examples
Evaluation Methodology:
 Enrollees self-report AA/NA Attendance
 Counselors document Life Skills Housing Fund
application
 Counselors document 3 apartment applications
and viewing

75. Methodology Examples
Evaluation Methodology:
 Enrollees self-report AA/NA Attendance
 Counselors document Life Skills Housing Fund
application
 Counselors document 3 apartment applications
and viewing
 Counselors document apartment acceptance
and furniture voucher is provided

76. Methodology Examples
Evaluation Methodology:
 Enrollees self-report AA/NA Attendance
 Counselors document Life Skills Housing Fund
application
 Counselors document 3 apartment applications
and viewing
 Counselors document apartment acceptance
and furniture voucher is provided
 Move-in date and event are documented by
counselor

77. Methodology Examples
Evaluation Methodology:
 Enrollees self-report AA/NA Attendance
 Counselors document Life Skills Housing Fund
application
 Counselors document 3 apartment applications
and viewing
 Counselors document apartment acceptance
and furniture voucher is provided
 Move-in date and event are documented by
counselor
 Counselor schedules 60-day follow-up visit to
assess housing permanence

78. Methodology Examples
Evaluation Methodology:
 Enrollees self-report AA/NA Attendance
 Counselors document Life Skills Housing Fund
application
 Counselors document 3 apartment applications
and viewing
 Counselors document apartment acceptance
and furniture voucher is provided
 Move-in date and event are documented by
counselor
 Counselor schedules 60-day follow-up visit to
assess housing permanence
 Counselor contacts both unsuccessful enrollees
and successful enrollees to request self-report
on knowledge gained and assesses interest in
renewed attempt

79. Consumer Measurements

80. Attendance Measurement

81. Program Measurements

82. Individual Milestone Tracking to
Achieve Indicator/Outcome

83. Individual Breaching
Milestones
Unmet

84. Aggregated Milestone Tracking to
Achieve Program Indicator/Outcome

85. Q&A