La trousse d’outils d’évaluation des programmes, mise au point par le Centre d’excellence de l’Ontario en santé mentale des enfants et des adolescents, expose dans ses grandes lignes un processus en trois étapes applicable à l’évaluation des programmes. Elle renferme des listes utiles, des étapes à suivre et des gabarits pour créer un modèle logique et produire un rapport final. Cette trousse d’outils peut servir à quiconque s’occupe en permanence de planifier et d’effectuer l’évaluation de programmes, d’accéder à des sources de données et d’analyser des données.
Cliquez ici pour lire le sommaire qu’a élaboré le CCNMO sur l’outil : http://www.nccmt.ca/fr/ressources/interrogez-le-registre/68
Le Centre de collaboration nationale des méthodes et outils est financé par l’Agence de la santé publique du Canada et affilié à l’Université McMaster. Les vues exprimées ici ne reflètent pas nécessairement la position officielle de l’Agence de la santé publique du Canada.
Le CCNMO est l’un des six centres de collaboration nationale en santé publique au Canada. Les Centres encouragent et améliorent l’utilisation des connaissances provenant de la recherche scientifique et des autres savoirs afin de renforcer la pratique et les politiques de santé publique au Canada.
Equity and KT: Insights from the 2021 Knowledge Translation (KT) Student Awar...
Webinaire du CCNMO : une trousse d’outils d’évaluation des programmes
1. Follow us @nccmt Suivez-nous @ccnmo
Financé par l’Agence de la santé publique du Canada | Affilié à l’Université
McMaster
Les opinions exprimées ici ne représentent pas nécessairement celles de l’Agence de la santé publique du
Canada.
Un outil pour l’évaluation des
programmes
Conférencière :
Kyle Ferguson
Melissa Jennings
11 mai 2016, de 13 h à 14 h 30 (HE)
2. Follow us @nccmt Suivez-nous @ccnmo
Utilisez Q&A pour afficher des
commentaires ou des questions
pendant le webinaire.
• « Envoyez » les questions à tous
(et non en privé à l’animatrice)
Problèmes de connexion
• Connexion à Internet filée (et non
sans fil) recommandée
• Ligne d’aide WebEx offerte 24
heures sur 24, sept jours sur sept
• 1-866-229-3239
Gestion interne
2
Q&A
Panneau latéral du
participant dans
WebEx
3. Follow us @nccmt Suivez-nous @ccnmo
Après aujourd’hui
La présentation PowerPoint (en anglais et en français)
et l’enregistrement audio en anglais seront offerts.
Ces ressources se trouveront aux adresses
suivantes :
PowerPoint: http://www.slideshare.net/NCCMT/
L’enregistrement audio:
https://www.youtube.com/user/nccmt/videos
3
4. Follow us @nccmt Suivez-nous @ccnmo
1re question de sondage
Combien de personnes regardent la
séance d’aujourd’hui avec vous?
1. Il n’y a que moi
2. 2 ou 3
3. 4 ou 5
4. Plus de 5
4
5. Follow us @nccmt Suivez-nous @ccnmo
Your profession?
Put a √ on your answer (or RSVP via email)
/
Epidemiologist Management (director,
supervisor, etc.)
Allied health
professionals (nurse,
dietician, dental
hygenist, etc.)
Librarian Physician / Dentist Other
5
6. Follow us @nccmt Suivez-nous @ccnmo
Un outil pour l’évaluation des
programmes
http://www.nccmt.ca/resources/search/68
Épisode 24
6
7. 2e question de sondage
D’où venez-vous?
1. BC
2. AB
3. SK
4. MB
5. ON
6. QC
7. NB
8. NS
9. PEI
10. NL
11. YK
11. NWT
12. NU
13.
Extérieur
du
Canada
7
8. Follow us @nccmt Suivez-nous @ccnmo 8
CCN des
maladies
infectieuses
Winnipeg, MB
CCN des
méthodes
et outils
Hamilton, ON
CCN sur les
politiques publiques
et la santé
Montréal, QC
CCN des
déterminants
de la santé
Antigonish, NS
CCN de la
santé
autochtone
Prince George, BC
CCN en santé
environnementale
Vancouver, BC
9. Registre des méthodes et des outils
Occasions
d’apprentissage en
ligne
AteliersMultimédia
Public Health+
Réseautage et
relations externes
Produits et services du CCNMO
9
10. 3e question de sondage
De quel secteur êtes-vous?
1. Santé publique
2. Santé (autre)
3. Éducation
4. Recherche
5. Gouvernement ou ministère provincial ou
territorial
6. Municipalité
7. Analyse de politiques (ONG, etc.)
8. Autre 10
11. Follow us @nccmt Suivez-nous @ccnmo
Kyle Ferguson
Assistant de rechercheCentre
d’excellence de l’Ontario en santé
mentale des enfants et des adolescents
Conférencière
11
12. Follow us @nccmt Suivez-nous @ccnmo
Melissa Jennings
Gestionnaire, Services de soutienCentre
d’excellence de l’Ontario en santé
mentale des enfants et des adolescents
Conférencière
12
54. Follow us @nccmt Suivez-nous @ccnmo
• Utilisez Q&A pour afficher des
commentaires ou des
questions durant le webinaire.
• « Envoyez » vos questions à
tous (et non en privé à
l’animatrice).
Q&A
Vos commentaires ou
questions
54
Panneau latéral du
participant dans
WebEx
55. Follow us @nccmt Suivez-nous @ccnmo
Votre rétroaction est importante
Veuillez prendre quelques minutes pour partager
vos idées sur le webinaire d’aujourd’hui.
Vos commentaires et vos suggestions permettent
d’améliorer les ressources que nous offrons et de
planifier d’autres webinaires.
Le sondage court se trouve à l’adresse :
https://nccmt.co1.qualtrics.com/SE/?SID=SV
_9nvkcbyCiqsuFzT
55
56. 4e question de sondage
Quelles étapes allez-vous suivre ensuite?
Je planifie…
A. d’accéder à l’outil pour l’évaluation des
programmes;
B. de lire le sommaire du CCNMO sur l’outil
pour l’évaluation des programmes;
C. de songer à utiliser l’outil pour l’évaluation
des programmes;
D. de parler de l’outil pour l’évaluation des
programmes à un collègue.
56
57. Follow us @nccmt Suivez-nous @ccnmo
Financé par l’Agence de la santé publique du Canada | Affilié à l’Université
McMaster
Les opinions exprimées ici ne représentent pas nécessairement celles de l’Agence de la santé publique du
Canada.
Afin d’en savoir plus sur le Centre de
collaboration nationale des méthodes et
outils :
Site Web du CCNMO : www.nccmt.ca
Communications : nccmt@mcmaster.ca
Notes de l'éditeur
the NCCPH program is dispersed across the country with 6 National Collaborating Centres
the National Collaborating Centre for Methods and Tools is located at McMaster University, in Hamilton
4 of the other NCC’s support the use of research evidence in specific public health content areas
NCCMT and NCC Healthy Public Policy work across content areas
the focus of NCCMT improving access to, and use of, methods and tools that support moving research evidence into decisions related to public health practice, programs, and policyin Canada.
NCCMT offers a products and services to help apply research evidence in decision making
This presentation today is going to provide an overview of the Online Learning Opportunities that NCCMT offers.
Thanks for that introduction, so let’s get started on talking about our program evaluation toolkit
So the first thing I want to go over is how to find the ETK. If you go to the Centre’s website www.excellenceforchildandyouth.ca, you’ll see a tab for the Centre’s resource hub. <next slide>
That will take you to this picture where you can find all kinds of different Centre resources. We’ll talk a little more later on about some of these resources that complement the toolkit but for now we’ll click on the toolkit button down in the bottom right corner
You’ll scroll through some of the different And here you’ll see all the toolkits the Centre has to offer across a range of topics like Youth Engagement, Youth Suicide prevention and down in the Support services section is where you’ll find the ETK
A quick note I want to mention is that the ETK as well as all of the centre products mentioned today are also available in French. I know there are a few people here today who might like to know so I just wanted to bring that up before we dive into the toolkit
So this is the toolkit
And it’s split into three main sections: planning, using and doing and each section has details information about steps or, rather, aspects that are relevant to each of those three stages. The planning section covers a wide variety of topics
And it’s split into three main sections: planning, using and doing and each section has details information about steps or, rather, aspects that are relevant to each of those three stages
And it’s split into three main sections: planning, using and doing and each section has details information about steps or, rather, aspects that are relevant to each of those three stages
The Centre’s vision with each of these is to meet agencies where they are at in the process. When we provide evaluation support we like to meet agencies where they’re at, rather they’re just starting out or a it further along in the process and ready to start doing an evaluation. The idea is we would meet people where they are along the process and tailor our supports to meet you where you’re at and move you forward
So one thing you’ll notice throughout the guide are these “download example” or “download worksheet” links. And what these are is they’re a document that you can download directly through the toolkit that applies directly to the section
So one thing you’ll notice throughout the guide are these “download example” or “download worksheet” links. And what these are is they’re a document that you can download directly through the toolkit that applies directly to the section
So, as we mentioned, the guide does focus quite heavily on the planning side of the evaluation process. This was where the majority of the agencies we work with were starting from so the guide really focuses a lot on those who are starting right from step one. And we’ll now spend a bit of time diving into
So the planning section kicks off with stakeholder engagement and talks a bit about some of the reasons you would want to involve various stakeholders. Some examples of who could be a stakeholder are included, so these could be anyone from funders, to program staff, to program participants, to collaborating agencies or community leaders.
One provided attachment in this section covers identifying relevant stakeholders and helps work you through identifying who these may be for your evaluation and some of the key questions to ask yourself about each group such as what does this stakeholder bring to the eval, how important their perspective is and what may be some of their motivation to participate
One provided attachment in this section covers identifying relevant stakeholders and helps work you through identifying who these may be for your evaluation and some of the key questions to ask yourself about each group such as what does this stakeholder bring to the eval, how important their perspective is and what may be some of their motivation to participate
The next section covers an area we work quite extensively with people in the planning phase and that is developing a program logic model and this section features a lot of attachments to help walk people through the development of a logic model. So this includes things like a glossary to go over some common terms used with a logic model
The next section covers an area we work quite extensively with people in the planning phase and that is developing a program logic model and this section features a lot of attachments to help walk people through the development of a logic model. So this includes things like a glossary to go over some common terms used with a logic model
The next section covers an area we work quite extensively with people in the planning phase and that is developing a program logic model and this section features a lot of attachments to help walk people through the development of a logic model. So this includes things like a glossary to go over some common terms used with a logic model
The next section covers an area we work quite extensively with people in the planning phase and that is developing a program logic model and this section features a lot of attachments to help walk people through the development of a logic model. So this includes things like a glossary to go over some common terms used with a logic model
The next section I wanted to highlight involves actually building your evaluation framework. This piece follows a whole section related to identifying indicators and talking about different kinds of outcomes you might be trying to measure
A quick summary of some practical points you may want to consider, but what I want to draw your attention to is this factsheet we’ve been granted permission to distribute which covers in great detail some aspects related to measurement specifically.
The next resource I want to highlight are these templates for developing an evaluation framework. So this is the template, and there’s one for process evaluations and one for outcome evaluations. The two templates are exactly they same they just help to focus attention on different aspects and really help you to outline and put things in concrete terms
Examples of differences between process and outcome eval questions
Using the example provided with our suicide prevention program before here’s how it could look filled in
Using the example provided with our suicide prevention program before here’s how it could look filled in
So I want to take us back to the learning hub to go over some of those additional resources we mentioned earlier that help complement the evaluation toolkit <next slide>
The first thing I want to draw your attention to is the learning modules over here and once you click there and scroll down
You’ll see there are six modules all dedicated to evaluation and the first thing you’ll notice is that we have entire modules dedicated to each planning, doing and using evaluation. They cover content similar to what we’ve already talked about in the toolkit so I want to talk a little bit instead about some of the other evaluation modules
So this is the module on qualitative and quantitative methods and it covers a lot of content from goals and what is a qualitative inquiry right down to specific interview techniques and running focus groups. Again, this module serves as a good introduction and is helpful for those who aren’t quite as familiar with some of these techniques or are looking to brush up
Next I want to talk about the ethics module and since most of us here today work in a health or health related field, this can be particularly important, especially when you’re dealing with anything which may contain patient information. The module works you through ethical considerations as they pertain to evaluation and how to make sure we’re conducting our evaluations with the highest ethical integrity
Finally there’s a module on developmental evaluation. Now this module might be a bit more theoretical and not as applied as two of the other modules, but the concepts covered become particularly important when we’re talking about evaluations
Here’s a profile and along the top we have tabs for different sorts of information you might need
Finally there’s our project showcase and what this is, is it’s a database of final reports from past evaluation work the Centre has supported with child and youth community agencies across the province of Ontario
So if we search you get a list of projects you can search through for anything similar and it saves you starting completely from square one