1. 090421_abstract01 copie.pdf 1 21.04.2009 17:51:26
Making Knowledge Transfer and Exchange (KTE) Relevant and Effective for HIV/AIDS Community Based Organisations (CBOs)
Building an Evaluation Plan of the Out illons-Nous Project of the Coalition des organismes communautaires québécois de lutte contre le sida (COCQ-Sida)
Mélina Bernier, Ghayas Fadel, Ken Monteith
COCQ-Sida
Background
e Outillons-Nous (ON) is a KTE structure where community workers share practices and collaborate with researchers to update
interventions based on new evidence and/or develop further research questions that need to be investigated. Over the last few years, the
Methodology
project’s structure and methodology were updated based on participants’ evaluations and discussions with the organising committees.
However, no follow up procedure or outcome analysis was done after these changes to document the e cacy or value of the ON. To build the evaluation plan, three data collection strategies were used:
 A review of organisational documents such as the values and mission statement and the operational objectives
Objective  Analysis of the evaluation forms completed by participants of ON from 2006 to 2008 and minutes from meetings of the
organising committees
Develop a validated evaluation plan based on the Savoir-faire et Savoir-dire community evaluation guide (Zúñiga, R, Luly, M-H, 2005)  Analysis of focus group discussions and individual interviews with key stakeholders. e interview content was qualitatively
and empowerment evaluation principles (Fetterman, DM, Wandersman, A, 2005) to judge the e cacy and value of the ON training analysed and various themes were categorised.
sessions.
Results
We performed 8 interviews with 15 stakeholders: We used a convenience sample to include di erent contexts and populations: Horizontal analysis of the interviews also provided a series of contextual factors and preexisting
variables that need to be taken into account in the evaluation process. ese include:
 Community workers  Montréal  Housing services
 An intervention coordinator  Outside Montréal  Prevention services  Geographical location and distance
 Executive Directors of member organisations  Support services  Organisations that regularly participate in ON,  Varying backgrounds and experience of participants
 Members of the Board of Directors of COCQ-Sida that include regional those that don’t, and those that rarely participate 
High rate of personnel turnover in community based organisations
representatives of people living with HIV/AIDS (PHAs) 
Variety of communities served and di erent organisational mandates
 A representative of the funding agency Based on the analysis of the interviews with stakeholders and the review of organisational 
documents, we were able to build a logic model that represents the ON project as it currently  Available training programs already in place
 A researcher who previously presented at an ON session
stands.  Availability of time and human resources
 Internal organisational culture
Mission
Group HIV/AIDS community based organisations in Québec to:
 Foster and support the emergence of joint actions
 Encourage, support and consolidate community action in the ght against HIV/AIDS
 Foster solidarity in the movement
 Pool approaches, activities and resources Process evaluation
To respond to the issues a ecting people living with HIV or AIDS and everyone else who may be a ected by HIV.
C
M
J
Activities
CM
Aim
MJ
CJ
CMJ
N
Identify knowledge and capacity building needs based on:
 Improve the quality of life of people living with HIV/AIDS
 Consultation with di erent stakeholders, PHAs, member organisations and researchers
 Foster prevention e orts, improve access to quality healthcare and support services
 New research ndings
 Inform and educate the public of the risks of HIV transmission
 Lower the incidence of new infections
 New and innovative intervention practices
 Relevant issues related to advancements in HIV/AIDS
Expected results
Hold three to ve ON sessions per year.
Plan, organise and hold interactive ON sessions using di erent pedagogical tools to ensure full Sessions should achieve the maximum possible
participation and successful KTE. Sessions are open to community workers, volunteers, PHAs, number of the objectives previously stated.
coordinators and Executive Directors of member organisations as well as institutional partners.
Objectives
 Enhance the capacity of community workers and volunteers of member organisations
 Create and promote opportunities for networking, KTE and partnerships for community workers and member organisations
 Foster partnerships between researchers and community based organisations
 Recognize, share and put into practice the expertise of community workers
 Facilitate access to new research results, especially for organisations outside Montréal input output
 Harmonise interventions, update knowledge and inform practices based on new research data and evidence
 Develop and implement new interventions, programs and tools
 Multiply the impact of the ON by training new agents and providing continuing education modules cost advantages
 Explore innovative practices
 Provoke collective thinking and discussions about di erent issues related to HIV/AIDS, community work and action
 Facilitate participation of member organisations from across the province by providing logistical and nancial support
 Monitor and evaluate ON outcomes, provide follow up and support and make necessary changes to improve actions
 For the funding agency: keep in touch with the reality of front line community work
 For researchers: provide a KTE structure to reach a broader audience of stakeholders Efficiency evaluation
Relevance evaluation Efficacy evaluation
Lessons Learned
Projects in community based organisations sometimes evolve organically as collective actions towards a shared social goal. is evolutionary process makes it di cult to document the project as a whole and to identify evaluation criteria.
Using the Savoir-faire et Savoir-dire guide and empowerment evaluation principles allowed us to build a logic model informed by the various stakeholders’ experiences of the ON. We were able to document the project and gain a better understanding of its dynamic as opposed to a
preconceived idea that does not re ect the complex reality of the ON. We also identi ed a series of contextual factors and preexsiting variables that a ect the project.
In this community based approach, objectives are viewed as guidelines and not as speci c end results. is way, the evaluation takes into account expected and unexpected results, whether they are positive or negative. Furthermore, this process ensures that e cacy and value will be
judged according to the needs of the stakeholders and within the organisation’s means and mission.
e logic model has to be updated as the project continues to evolve. is will ensure internal and external validity both for the COCQ-Sida and the funding agency. e savoir faire et savoir dire guide contains various tools that can be used to this purpose.
Next steps
e proposed logic model will be validated by stakeholders and necessary adjustments will be made. It will inform the evaluation plan of the ON sessions which will take place in the coming year.
References cited Acknowledgement
Fetterman, DM. and A Wandersman. 2005. Empowerment Evaluation Principles in Practice. New York, London: e Guilford Press. e authors would like to thank all the interview participants for their time and valuable input. We would also like to thank Valérie Marchand, Caroline Racicot and Sarah
Zúñiga, R and M.-H Luly. 2005. Savoir-faire et Savoir-dire: un guide d’évaluation communautaire. Montréal : COCQ-Sida. Raymond for their contribution.