SlideShare une entreprise Scribd logo
1  sur  38
Télécharger pour lire hors ligne
1
EU Universe Awareness
Programme Evaluation
Guide
MOTIVATION
LEGACY
Awareness of
the Universe
(Knowledge)
Scientific
Skills
Intercultural
Attitudes
EU UNAWE
fostering
2
This document contains materials to support National Managers (NM)
visiting at least one school, to gather evidence for evaluation of the
EU-UNAWE-Program.
There are four main ways proposed for gathering general information:
• Observations using an Astronomy Awareness Framework
evaluation template, for children who are too young to
write
• Pre and post visit mind maps/drawings for 7-10 year olds
• Quick evaluation with an Astro-poster
• By means of a card game where children can identify
objects and find correlations between them
For the evaluation of the specific activities developed by each EU-UNAWE-
partner we propose some playful activities (games).
In addition, survey templates linked to the framework are supplied for
gathering evidence from teachers, and pupils who are old enough to write.
These can be used whether or not NM are able to visit the school.
Summary
3
EU-UNAWE project goals
Evaluation methodology
Framework for children: Domains of active learning of EU-UNAWE
Detailed description of the domains of active learning (DAL)
Evidence of the impact for children according to the DAL
Gathering evidence: process diagram
First pre/post activity template: Drawing the night sky
Pre/post activity template alternative
Child observation template: Gathering evidences
Pupils survey
Evaluation games: Astro-Cards
Quick evaluation: Astro-Poster
Framework for teachers: Astronomy Awareness fields
Astronomy Awareness Framework for teachers. Detailed description
Teacher workshop survey plus e-form link
Letter to teachers
Parent letter and ethical permission
Teacher thank you letter after visit
Tracing activity development
Evaluating long term impacts
Checklist for the evaluation
Astro-Cards
4
5
6
7
8
9
10
11
12
13
14
19
20
21
22
24
25
26
27
28
29
31
Content
4
EU-UNAWE project goals
An evaluation concept of the European Universe Awareness programme (EU-UNAWE)
must be strongly linked to the general and specific goals of the programme. In resume
these are the following:
The Programe is addressed specially to disadvantaged children in different social
environments.
The program intends to stimulate through images, playful activities,
experiments, models and artistic activities the children´s awareness of
astronomical objects and the place of the Earth as part of the Universe in a way
of broadening the children´s view of the world. In doing so try to use daily-
life materials in the activities, experiments and models such that children can
reproduce them at home.
Awaken the awareness of the uniqueness of the Earth and of the need for
environmental preservation.
Motivate children to appreciate other cultures via stories and twinning activities
with children living in other countries, making them aware of the place in which
other children live, their common cultural features and differences.
Throughout stimulate children´s curiosity giving them the occasion and time to
formulate their own questions related to the Universe.
Develop EUNAWE-contents to be linked to daily school curricula via training of
the teachers.
To achieve these goals the partners of the project have developed diverse materials for
teacher training workshops and subsequently children’s class activities.
4
1
2
3
4
5
6
5
Evaluation Methodology
These evaluation materials focus on two key stakeholders: children and teachers.
The project goals cover a range of domains of learning: motivation, scientific skills, knowledge,
and intercultural attitudes. A framework for evaluation specific to UNAWE, ‘Astronomy
Awareness’, is proposed as the basis for gathering evidence.
Care has been taken to design a research methodology that acknowledges the strengths in a
multi-national project and also allows for data from different locations and activities to be
combined. Therefore, it is intended that this document supports National Managers (NM) to
gather evidence with the aim of demonstrating a full range of impacts for teachers and pupils.
Gathering evidence about children’s learning
This data collection will require a visit to at least one school. In order that data collection is
realistic, a number of qualitative evidence collection routes are proposed in anticipation that
National Managers (NM) will select appropriate methods to suit children, capacity, hardware
and activity. It is hoped that NM will use pre/post activity drawings or an observation template
supplied to gather qualitative information about children’s actions about astronomy. In
addition, card games, photos, video, recordings, and notes are all admissible as evidence and
will help to build a clear understanding of the activities undertaken throughout the lifetime of
the project.
There is a survey for teachers (with e-form) and an optional follow up survey activity for
children, suitable for 8-10 year olds. These can also be sent to schools independently of visiting,
in order to gather more evidence.
National Managers are most welcome to share other examples of evaluation methods.
Understanding programme development
Clearly, detailed reflection has been essential to develop both children’s resources and
activities, and teacher workshops. This reflection and improvement process has the potential
to be a rich source of learning for future projects. A paper template and e-form are provided
for National Managers to complete, in order that others can gain insight into programme
development, as a legacy from EU-UNAWE.
Gathering evidence from teachers
Excellent practice is already taking place around teacher evaluation using quantitative and
qualitative questions on survey forms. Based on good examples supplied by NM, questions
have been modified in order that data can be collated and logically correlated with the
Astronomy Awareness framework for children’s learning.
Paper and e-forms are supplied for dissemination to teachers.
Pre -existing evaluation data in different formats is welcome: eval@unawe.org
Instructions show the process for visiting and collecting qualitative evidence from one school.
It is expected that this is the minimum, and greater statistical significance will be achieved for
your project if you can visit more schools or use volunteers to assist in gathering more data.
6
Framework for children:
Domains of active learning (DAL)
of EU-UNAWE
Using the general program goals, it is clear that the concepts underlying UNAWE
cover several domains of active learning:
The inspiration for assigning domains of learning for UNAWE evaluation is based on Information
from the Museums’ Libraries and Archives Framework ‘Inspiring Learning for All’ generic learning
outcomes and Nichols’ framework ‘(2012) Earthsmarts socioecological literacy’.
Framework for children:
Domains of active learning (DAL)
of EU-UNAWE
Using the general program goals, it is clear that the concepts underlying UNAWE
cover several domains of active learning:
The inspiration for assigning domains of learning for UNAWE evaluation is based on Information
from the Museums’ Libraries and Archives Framework ‘Inspiring Learning for All’ generic learning
MOTIVATION
Awareness of
the Universe
(Knowledge)
Scientific
Skills
Intercultural
Attitudes
EU UNAWE
fostering
7
UNAWE Domains of active learning
7
UNAWE Domains of active learning
Objectives Evidence
Motivation
Enjoyment,
Inspiration
Curiosity
Tenacity
• Children are doing the tasks with
pleasure
• Children seem enchanted
• Children react with diligence in
front of the proposed activities
• Children demonstrate attention
• Children apply perseverance /
tenacity
• Children manifest inquisitiveness
• Children introduce some complex
questions
Develop Scientific Thinking & Problem Solving
Techniques; Planning & Conducting Investigations
Observation, Identification, Classification,
Making interconnections, Changing Perspective &
Communication
From curriculum: example of school wording of this
section
Discussing and Questioning
Ask questions which can be answered through an
investigation
Use scientific language regularly in discussions
Planning
Plan and carry out a test to collect evidence
Select information from a range of resources
Observing
Decide what observations need to be made
Select appropriate equipment for observation or
measuring results
Interpreting
Draw conclusions linked to scientific knowledge and
understanding.
Recognise patterns and trends based on the observation
or investigation
Ideas and Evidence
Recognise that scientific ideas are based on evidence
which can be verified by observations
Use the imagination together with scientific knowledge
to understand and think about why something happen
Recording
Decide on an appropriate method of recording
Present results using tables, graphs, pictures
Evaluation
Review the work and reflect on the results
• Correct use of vocabulary or
gesture to name objects and
phenomena observed in sky
• Grouping objects/ phenomena to
indicate developing understanding
of astronomy concepts
• Making conjectures available to be
contrasted
• Developing some experiences
related to the hypothesis
• Linking new information with
existing conceptions of the same
or different areas
• Removing previous points of view
according to new inputs
• Sharing with others their new
knowledge
ScientificSkills
8
Objectives Evidence
Knowledge & Understanding
 
Observing, exploring and discovering:
1. The Sun, Sun relative position, Sun light
(shadows), Day/night cycle, time zones, the seasons,
the Moon, the Earth as a planet, awareness of the
existence of water and of the Earth atmosphere and
Sun light for the development of life on Earth, Solar
and Moon eclipses,...
2. The Solar system: planets characteristics and
movements, wharf planets, asteroids, comets,...
3. The Stars in the night sky, the constellations,
orientation, the Life-cycle of stars, the formation of
stars and planets,...
4. Our place in the Milky Way, Family of galaxies,...
5. Current developments in astronomy
6. Magnetic fields (compass, northern lights,...)
7. Several complementary questions
 
Valuing different cultural perspective. Recognising
different physical perspectives. Positive attitude
towards astronomy. Valuing inclusive education
 
Working Individually & in Teams
 
• Demonstrating awareness of
different cultures
• Ability to observe and explain
differences in phenomena in
different countries
• Statements of future activity with
regards to astronomy
• Act on an appropriate way in a
frame of diversity
Direct observation and/or recording
of naming, first explanations,
discussing, drawing, construction,
creative responses, movements
and dances, etc. to demonstrate
knowledge of one of the features
listed. left
UniverseKnowledgeInterculturalAttitudes
99
Gathering evidence: Process diagram
Route 1 Route 2 Route 3
Pre/ Post
• you know teacher
• Children can write
Observe
• you are not
leading activity
Observe game
• you are leading
main activity
Send teacher permission form, parent letter, arrange visit
Children do pre
activity personal
meaning map
(PMM)
Reproduce evaluation
game from template
Practice observation template
Consider additional evidence: photo, video, drawing
Activity Activity Activity
Observe record
3 children
Children return
to PMM and add
new ideas in
different colour
Optional: support
observations with
child interview
Eval. game
Observe record
3 children
Scan in PMM Enter obs. Data into google form
Send PMM images/additional info to eval@unawe.org
Thank teacher and class
AssumptionsAdminPreactivityTeaching
activity
Postactivity
(straightafter)
Submitting
data
Admin
1010
Date............................Location..........................
Activitybeingevaluated........................................
Childage..............M/FLanguages:.......................
School...................................................................
Pretendsitisnight!Drawthesky.Whatdoyousee?
Name:
Instructions:
Childrenaddideasaswritingordrawing,preactivity,
usingapencil.Aftertheiractivity,returnandaddnew
ideasusingaPENorBLUEcolouredpencil
PMM
Personalmeaningmap
templatetophotocopy
School...................................................................
1111
Date............................Location..........................
Activitybeingevaluated........................................
Childage..............M/FLanguages:.......................
School...................................................................
PMM
Personalmeaningmap
templatetophotocopy
Name:
Whatdoyouknowaboutthe
skyandspace?
Haveyougotanyquestions?
Writeordraw
Name:
Whatdoyouknowaboutthe
skyandspace?
Haveyougotanyquestions?
Writeordraw
Activitybeingevaluated........................................
School...................................................................
Instructions:
Childrenaddideasaswritingordrawing,preactivity,
usingapencil.Aftertheiractivity,returnandaddnew
ideasusingaPENorBLUEcolouredpencil
1212
Name of observer: ………………………Location: …………………..........
Date of observation: ……………………….....Time: ............................
Activity being evaluated:………………………….................................
Child age…………….M/F Languages:………………….........................
School……………………………..........................................................
Child observation template (4-7 years)
Tally / score (e.g. III) Total Evidence (e.g. “smiled on seeing moon”
MotivationScientific
Skills
KnowledgeInternational
Attitudes
Submit information online: http://goo.gl/2eFfW
Name of observer: ………………………Location: …………………..........
Date of observation: ……………………….....Time: ............................
Activity being evaluated:………………………….................................
Child age…………….M/F Languages:………………….........................
School……………………………..........................................................
13
Pupil survey (8-10 years)
1 What activities have you done in class about space?
2 What did you enjoy about this topic?
3 Is there anything you did not like?
4 Would you like to find out more about astronomy and space in future?
5 Have you got any questions about space?
6 If you were going to make a Space Museum or a space display for your
class, what topics and objects would you put in?
Write or draw to explain your plan.
Work on the back of this paper.
Name: ............................................ Date: ........................................
School: .............................................................................................
Teacher: ..................................................... Age: .............................
1414
Evaluation materials
Astro-Cards classification games
Exercise 1
Card game “Astro-Cards”: Identification and classification game of astronomical
objects.
Age:
Materials:
Goal:
8
Card set “Astro-families” (24 cards)
Evaluate children´s awareness of the existence of
different astronomical objects and of the place of the
Earth among them by asking them just to identify those
that they know and to name them. In doing so, children
can group them in families (planets, comets, stars,
nebula, constellations, galaxies, etc).
Link to Astronomy and scientific skills:
Astronomy relies strongly on the observation, identification and posterior
classification of objects into family classes, and on their location in space at
different scales and distances. Observation and classification skills play therefore
a key role .
15
Astro-cards evaluation games
Exercise 2
15
Astro-cards evaluation games
Exercise 2
Identification of objects belonging to the Solar System
Ask children to identify some objects among the cards belonging to the Solar
System.
Objects belonging to the Solar system
Link to Astronomy and scientific skills:
To learn about our cosmic adress and our neighbourhood it is important that
children gain a idea of all objects belonging to the Solar System
16
Astro-cards evaluation games
Exercise 3
16
Astro-cards evaluation games
Exercise 3
Identification and classification of planets
Ask children to identify among the cards the planets , to name them and group them
into solid and gaseous planets according to their distances to the Sun.
The solid planets of the Solar System
Gaseous planets
Link to Astronomy and scientific skills:
The distinktion between solid (rocky) and gaseous, and their distance to the Sun
planets plays an important role when discussing the habitability of planets. Therefor
is this classification fundamental of the discussion about life in the Solar System.
Also, the uniqueness of the Earth among the planets can only be understood in this
classification context.
17
Astro-cards evaluation games
Exercise 4
17
Astro-cards evaluation games
Exercise 4
Identification and classification of asteriods and comets
Ask children to identify among the cards the asteroids and comets and to discuss about
their differences and location in the Solar System.
Link to Astronomy and scientific skills:
Both asteroids and comets are considered as fossiles objects of the Solar System and
are connected to ist formation history. Planets formed in the past from the collisions
of hundred of thousands of asteroids which had in turn formed out from dust grains
of the protoplanetary disc sorrounding the Sun. Comets are icy objects that, when close
enough to the Sun, displays a visible coma (a thin temporary atmosphere) and a tail. It
is thought that the Earth water came from lots of comets impacting its surface.
18
Astro-cards evaluation games
Exercise 5
18
Astro-cards evaluation games
Exercise 5
Identification and classification of nebula and star clusters
Ask children to identify among the cards the nebula (birth place of stars) and the open
and globular star clusters.
19
Astro-cards evaluation games
Exercise 6
19
Astro-cards evaluation games
Exercise 6
Identification and classification of galaxies, galaxy families
and galaxy clusters
20
Quick evaluation: Astro-Poster
Another posibility of performing a quick evaluation is to show children the poster
bellow and ask them to identify as many objects as possible. In doing so they could
describe their size and location (e.g. within the Milky Way, outside the Milky Way).
21
MOTIVATION
Awareness of
the Universe
(Knowledge)
Scientific
Skills
Intercultural
Attitudes
EU UNAWE
fostering
LEGACY
Astronomy Awareness Framework
for teachers
Teacher additional area for impact: Legacy
Teachers gain subject knowledge for teaching their pupils in the domains previously
explained. In addition there is potential for the impact of the project to be multiplied
through:
• Teachers disseminating knowledge
• Teachers critically appraising resources and activities, in order to make
recommendations for future projects
• Embedding astronomy activities into curriculum
22
Astronomy Awareness Framework for
teachers: Detailed description
22
Astronomy Awareness Framework for
teachers: Detailed description
Definition
MotivationScientificSkillsKnowledge
Intercultural
Attitudes
Legacy
1. Enjoyment
2. Inspiration
3. Creativity
4. Persistence
1. Curiosity
2. Observation
3. Identification
4. Classification
5. Making interconnections
6. Changing perspective
7. Communication
Observing, exploring  and discovering:
1. The Sun, Sun light (shadows), Day/night cycle, the seasons, the Moon, the Earth
as a planet, awareness of the existence of water and of the Earth atmosphere and
Sun light for the development of life on Earth, Solar and Moon eclipses.
2. The Solar system: planets characteristics and movements, wharf planets,
asteroids, comets.
3. The Stars in the night sky, the constellations, the life-cycle of stars, the formation
of stars and planets
4. Our place in the Milky Way, Family of galaxies
5. Current developments in astronomy
1. Valuing different cultural perspectives
2. Positive attitudes towards astronomy
1. Disseminating knowledge to other teachers
2. Recommendations for improvements
3. Embedding new materials in curriculum
Motivation
1. Curiosity
7. Communication
Observing, exploring  and discovering:Observing, exploring  and discovering:
Intercultural
Current developments in astronomy
1. Valuing different cultural perspectives
Intercultural
Disseminating knowledge to other teachers
23
Name: ………………………..................... Date: …………………...........
Workshop Location: ……………………….Time: ...............................
Date of teacher workshop:…………………………..............................
Age of class taught: …………….School name: ................................
School adress:………………….........................................................
Your email adress: .....................................................................
School…………………………….........................................................
Teacher workshop survey (page 1/2)
We would prefer that this is completed online at: http://goo.gl/XejyP
About you
1 What did you enjoy about the course?
2 Did you gain knowledge about the universe? Please explain.
3 Did you develop any new skills or practice existing skills?
4 Did the course make you consider cultural perspectives differently?
5 Did you share aspects of this course with other staff? How?
6 Have you got any recommendations for improvements to your course?
7Have you embedded any new materials into the curriculum as a result of this course?
Name: ………………………..................... Date: …………………...........
Workshop Location: ……………………….Time: ...............................
Date of teacher workshop:…………………………..............................
Age of class taught: …………….School name: ................................
School adress:………………….........................................................
Your email adress: .....................................................................
School…………………………….........................................................
24
About your pupils
8 How did you interpret the activities for your pupils?
9 What did they enjoy about the activity?
10 Were there any constraints to implementing the activity?
11 What do you think your pupils learnt?
12 Did they have the opportunity to try out any new skills?
13 Did they have opportunities for cultural learning?
14Which aspects of curriculum assessment did the activities address?
15Please rate the UNAWE resources out of 10,(10= excellent):
16How could future projects support opportunities for children to be involved in astronomy?
Any other comments?
Teacher workshop survey (page 2/2)
2525
Teacher letter/email template
Send to teachers before visit
Universe Awareness Activity observation
Dear insert teacher name,
Thank you for taking the opportunity to attend the recent Teacher training course on
<insert date>.
I am looking forward to your class participating in activities which aim to increase their
understanding and excitement about astronomy.
As part of the programme, and to allow it to continue free of charge, UNAWE are obliged
to gather information about the activities and how children respond to them.
I hope you do not mind me contacting you to request assistance. I have chosen your
school because <insert specific reasons here >I
I would like to ask permission to visit you for an evaluation activity. I do not anticipate
that this would detract from your normal class activities,. I hope to gather evidence
about children’s learning in the form of a short activity and some observations. These
may also be useful for teacher assessment. I would also like to find out your opinions
about implementing the activities.
If you are happy for this activity to take place, I would be grateful if you could circulate
the letters attached to parents; I would like to collect them when I visit.
Here are some dates which might be suitable for a visit:
<Dates>
If none of these suit you then please let me know good alternatives.
Please feel free to contact me by email: <email address> or phone <number> at a
convenient time to check times and dates.
With best wishes and thanks for your support,
National Manager name
National Manager <insert location>
UNAWE
www.unawe.org
2626
Parent letter template
Send/email to teachers before visit
NB recommend sending a class set to teachers
Dear parent,
Your son/daughter’s teacher <insert name> has recently taken part in a workshop aiming to
increase children’s understanding and excitement about astronomy.
Owing to your teacher’s enthusiasm for astronomy, we have chosen your child’s class for a follow
up visit, so that we can see activities taking place in the classroom.
As part of the programme, and to allow it to continue free of charge, Universe Awareness are
obliged to gather information about the activities and how children respond to them.
I would like to ask permission to gather information in different ways. I would be grateful if
you could indicate on the attached form whether you are happy for anonymous evidence to be
gathered as shown below.
If you have noticed your child speaking about astronomy topics recently, I would be very
interested to hear about it. <email here> if you have any questions please do not hesitate to
contact me:
With best wishes and thanks for your support,
National Manager name
National Manager <insert location>
UNAWE
www.unawe.org
26
Name of child / children
School
Your name
We would like to gather evidence about UNAWE children’s astronomy programme. This may be used in
communicating the benefits of the trip; for example in may go on a website for researchers, educators,
parents or teachers to look at. It may be used to persuade other organisations to run a similar project,
which may involve press coverage. Children will not be identified by name.
Please indicate if you are happy for evidence (photo/video/microphone/written) to be gathered.
We will not use the images taken, or any other information you provide, for any other purpose.
Contact details will only be used to communicate with you, and all conditions of the Data Protection
Act 1998 will be adhered to.
I give permission for my son/daughter to take part in the ‘Universe Awareness’ school activity during
class time, at school, and for evidence to be collected as indicated above.
Signed: Data:
School
Your nameYour name
We would like to gather evidence about UNAWE children’s astronomy programme. This may be used in
I give permission for my son/daughter to take part in the ‘Universe Awareness’ school activity during
27
Teacher letter template
Send to teachers after visit
Dear insert teacher name,
Thank you very much for allowing me to visit on <insert date here>.
I would like to thank you and the class for making me feel welcome, and for
facilitating collection of vital evidence about learning. This data will be used to
improve the programme, and also to develop future Programmes.
In case you have not yet completed the online survey, here is the address:
http://goo.gl/XejyP
Children’s opinions are of key importance and likeiwise, I am keen to see the
children’s opinions from their survey activity. (NB delete if children are under
8)
The results will be made available in a full report towards the end of 2013, and
if you would like a copy please send your contact details to eval@unawe.org
If you have any questions please do not hesitate to contact me:
<insertemail here>
National Manager name
National Manager <insert location>
UNAWE
www.unawe.org
28
Tracing resources/activity development
Your name:
Your location:
Activity title:
Audience: Children age�./Teachers
Number of participants
Activity type: Festival, workshop, game, lesson, drop in, outreach, other
Where did it take place?
Date of activity
Time of activity
How did you develop this resource? (conception and delivery)
Image file name
In order to better understand your programme development process, we would
like to ask you to reflect on and complete the following information online. Please
complete one form per activity including teacher workshop activities you have
developed.
Information can be brief.
We would prefer that this is completed online at: http://goo.gl/yJQY5
(Please send an image of the programme to eval@unawe.org)
1
2
3
4
5
6
7
8
9
10
11
Here are the questions:
2929
Evaluating long term impact
We recognise that long term impact is a question frequently asked in evaluation.
Whilst demonstrating long term impact was not stated as an evaluation outcome
in this EU proposal, if you wish to gather supporting information then it would be
possible using the following interview methodology:
Search records for a class that you can still contact, who have taken
part in previous UNAWE activities.
Contact a teacher at the school and request an interview with a group
of pupils.
Use the following questions for a semi-structured interview (This
means encourage conversation around the four key questions). :
• Record age, date, name, school and year of UNAWE
participation.
• On a scale of 1-10, where 1= dislike and 10 = like very much,
how do you feel about astronomy?
Discuss responses with the group.
• If you were planning to teach younger children about
astronomy, what would you like to tell them about?
• Do you ever observe the night sky?
• Do you think you will use what you know about astronomy in
future?
In addition, it is then necessary to find a control group of pupils the
same age, who have not taken part in UNAWE activities.
If you submit notes about interviews with both groups, these can be
included, correlated with the Astronomy Awareness framework, as
part of the final report.
There is a google form here to submit information.
Interviewing to assess long term impact
1
2
3
30
Checklist for the evaluation
30
Checklist for the evaluation
Task
Date
planned Completed
Task
Decide which route is suitable for you
Identify school (s) to observe
Send teacher letters together with parent information
Set observation dates
Produce evaluation game using template
Practice observation schedule
Consider video recording or sound/photos as additional
material
Agree activity, timing and pupils to observe with teacher.
You may need to explain evaluation game or pre visit
materials.
Discuss photography and video with teacher
Photocopy PMM
Photocopy teacher survey
Photocopy pupil survey if pupils are over 8
Recharge digital camera/dictaphone
Take game/PMM/observation sheets/ teacher survey/pupil
survey to school, together with any recording hardware
Route 1: Pre visit PMM
Route 2: Observe activity and record 3 pupils minimum
Route 1: Post visit PMM OR Route 3: post visit evaluation
game plus observations
Give teacher survey and pupil survey
Collect teacher survey (if not eform), pupil surveys and
parent permission forms
Route 1: scan in PMMs
Route 2 and 3: submit observation data
Download and email any supporting video/photo/drawing
evidence
Thank teacher and class
Task
Decide which route is suitable for youDecide which route is suitable for you
Identify school (s) to observeIdentify school (s) to observe
Send teacher letters together with parent informationSend teacher letters together with parent information
Set observation datesSet observation dates
Produce evaluation game using templateProduce evaluation game using template
Practice observation schedulePractice observation schedule
Consider video recording or sound/photos as additional
material
Agree activity, timing and pupils to observe with teacher.
Discuss photography and video with teacher
Photocopy PMMPhotocopy PMM
Photocopy teacher surveyPhotocopy teacher survey
Photocopy pupil survey if pupils are over 8Photocopy pupil survey if pupils are over 8
Recharge digital camera/dictaphoneRecharge digital camera/dictaphone
Take game/PMM/observation sheets/ teacher survey/pupil
survey to school, together with any recording hardware
Route 1: Pre visit PMMRoute 1: Pre visit PMM
Route 2: Observe activity and record 3 pupils minimumRoute 2: Observe activity and record 3 pupils minimum
Route 1: Post visit PMM OR Route 3: post visit evaluation
game plus observations
Give teacher survey and pupil surveyGive teacher survey and pupil survey
Collect teacher survey (if not eform), pupil surveys and
parent permission forms
Route 1: scan in PMMsRoute 1: scan in PMMs
Route 2 and 3: submit observation dataRoute 2 and 3: submit observation data
Download and email any supporting video/photo/drawing
evidence
Thank teacher and class
planned
31
Astro-Cards
Moon - Terresrial - Planets
32
Astro-Cards
Gaseous Planets
33
Astro-Cards
Asteriods
34
Astro-Cards
Comets
35
Astro-Cards
Sun - Stars - Clusters
36
Astro-Cards
Nebula
37
Astro-Cards
Galaxies
38
Authors: Cecilia Scorza and Grace Kimble
Coordination: Pedro Russo
Design and Layout: Charlotte Provot
ISBN: 9789491760037
www.eu-unawe.org

Contenu connexe

Tendances

Tendances (8)

FisAstEE project presentation
FisAstEE   project presentationFisAstEE   project presentation
FisAstEE project presentation
 
ODS Summer School - Project Scenario by José Gonçalves
ODS Summer School - Project Scenario by José GonçalvesODS Summer School - Project Scenario by José Gonçalves
ODS Summer School - Project Scenario by José Gonçalves
 
Kindergarten Earth and Space in 3D
Kindergarten Earth and  Space in 3DKindergarten Earth and  Space in 3D
Kindergarten Earth and Space in 3D
 
Astronomy in Nepal
Astronomy in NepalAstronomy in Nepal
Astronomy in Nepal
 
Astronomy Education and Outreach in Nepal
Astronomy Education and Outreach in NepalAstronomy Education and Outreach in Nepal
Astronomy Education and Outreach in Nepal
 
Promoting Space Science Education and astronomy in nepal
Promoting Space Science Education and astronomy in nepalPromoting Space Science Education and astronomy in nepal
Promoting Space Science Education and astronomy in nepal
 
Week 3A: Powerful Learning Through Integration
Week 3A: Powerful Learning Through IntegrationWeek 3A: Powerful Learning Through Integration
Week 3A: Powerful Learning Through Integration
 
Asgment hbsc1103
Asgment hbsc1103Asgment hbsc1103
Asgment hbsc1103
 

En vedette

TEDxFuzhou Stories
TEDxFuzhou StoriesTEDxFuzhou Stories
TEDxFuzhou Stories
TEDtoChina
 
Orbiter w geografii
Orbiter w geografiiOrbiter w geografii
Orbiter w geografii
JacekKupras
 
Notonlyblackholes
NotonlyblackholesNotonlyblackholes
Notonlyblackholes
JacekKupras
 
Sex Differences In Relationships
Sex Differences In RelationshipsSex Differences In Relationships
Sex Differences In Relationships
1Leu
 
Kcu app fair_present
Kcu app fair_presentKcu app fair_present
Kcu app fair_present
JacekKupras
 
Guida Uso V Teng
Guida Uso V TengGuida Uso V Teng
Guida Uso V Teng
JacekKupras
 

En vedette (20)

Lawrence Wang: social media and TEDx
Lawrence Wang: social media and TEDxLawrence Wang: social media and TEDx
Lawrence Wang: social media and TEDx
 
Kierunek Mars
Kierunek MarsKierunek Mars
Kierunek Mars
 
Atlantislaunch
AtlantislaunchAtlantislaunch
Atlantislaunch
 
TEDxNanjing
TEDxNanjingTEDxNanjing
TEDxNanjing
 
TEDxFuzhou Stories
TEDxFuzhou StoriesTEDxFuzhou Stories
TEDxFuzhou Stories
 
TEDxTaipei Campus Outreach
TEDxTaipei Campus OutreachTEDxTaipei Campus Outreach
TEDxTaipei Campus Outreach
 
Orbiter w geografii
Orbiter w geografiiOrbiter w geografii
Orbiter w geografii
 
Notonlyblackholes
NotonlyblackholesNotonlyblackholes
Notonlyblackholes
 
Obserwatorium im. Mikołaja Kopernika
Obserwatorium im. Mikołaja KopernikaObserwatorium im. Mikołaja Kopernika
Obserwatorium im. Mikołaja Kopernika
 
Sex Differences In Relationships
Sex Differences In RelationshipsSex Differences In Relationships
Sex Differences In Relationships
 
Wolce 2012 role
Wolce 2012 role Wolce 2012 role
Wolce 2012 role
 
Kcu app fair_present
Kcu app fair_presentKcu app fair_present
Kcu app fair_present
 
TEDxFiveStarSquare
TEDxFiveStarSquareTEDxFiveStarSquare
TEDxFiveStarSquare
 
Atlantislanding
AtlantislandingAtlantislanding
Atlantislanding
 
Guida Uso V Teng
Guida Uso V TengGuida Uso V Teng
Guida Uso V Teng
 
TEDxHongkong
TEDxHongkongTEDxHongkong
TEDxHongkong
 
The Disciplines of Continuous innovation
The Disciplines of Continuous innovationThe Disciplines of Continuous innovation
The Disciplines of Continuous innovation
 
Learning design exeter2014
Learning design exeter2014Learning design exeter2014
Learning design exeter2014
 
Aviation Business 2.0
Aviation Business 2.0Aviation Business 2.0
Aviation Business 2.0
 
Corporate Presentation V3
Corporate Presentation V3Corporate Presentation V3
Corporate Presentation V3
 

Similaire à Eu unawe evaluation

Comprehensive Overview IEC Public
Comprehensive Overview IEC PublicComprehensive Overview IEC Public
Comprehensive Overview IEC Public
beccane
 
Evaluation and Assessment of Learning and ProgramsLearni
Evaluation and Assessment of Learning and ProgramsLearniEvaluation and Assessment of Learning and ProgramsLearni
Evaluation and Assessment of Learning and ProgramsLearni
BetseyCalderon89
 
Evaluation and Assessment of Learning and ProgramsLearni.docx
Evaluation and Assessment of Learning and ProgramsLearni.docxEvaluation and Assessment of Learning and ProgramsLearni.docx
Evaluation and Assessment of Learning and ProgramsLearni.docx
turveycharlyn
 
UDL Lesson Plan Subject EnglishGrade First Grade.docx
UDL Lesson Plan Subject EnglishGrade First Grade.docxUDL Lesson Plan Subject EnglishGrade First Grade.docx
UDL Lesson Plan Subject EnglishGrade First Grade.docx
ouldparis
 
Collaborative Lesson Plan Farooqi
Collaborative Lesson Plan  FarooqiCollaborative Lesson Plan  Farooqi
Collaborative Lesson Plan Farooqi
Aysha Farooqi
 

Similaire à Eu unawe evaluation (20)

EU-UNAWE Programme Evaluation
EU-UNAWE Programme EvaluationEU-UNAWE Programme Evaluation
EU-UNAWE Programme Evaluation
 
172157
172157172157
172157
 
Passionbased Inquiry
Passionbased InquiryPassionbased Inquiry
Passionbased Inquiry
 
Project
ProjectProject
Project
 
Ede222 topic 1
Ede222 topic 1Ede222 topic 1
Ede222 topic 1
 
Comprehensive Overview IEC Public
Comprehensive Overview IEC PublicComprehensive Overview IEC Public
Comprehensive Overview IEC Public
 
Project Based Learning
Project Based LearningProject Based Learning
Project Based Learning
 
Project co curriculam
Project  co curriculamProject  co curriculam
Project co curriculam
 
Faheem, shimaa mohamed understanding and using schiece process skills school...
Faheem, shimaa mohamed understanding and using schiece  process skills school...Faheem, shimaa mohamed understanding and using schiece  process skills school...
Faheem, shimaa mohamed understanding and using schiece process skills school...
 
Inquiry
InquiryInquiry
Inquiry
 
Evaluation and Assessment of Learning and ProgramsLearni
Evaluation and Assessment of Learning and ProgramsLearniEvaluation and Assessment of Learning and ProgramsLearni
Evaluation and Assessment of Learning and ProgramsLearni
 
Evaluation and Assessment of Learning and ProgramsLearni.docx
Evaluation and Assessment of Learning and ProgramsLearni.docxEvaluation and Assessment of Learning and ProgramsLearni.docx
Evaluation and Assessment of Learning and ProgramsLearni.docx
 
Faheem, shimaa mohamed understanding and using schiece process skills sc...
Faheem, shimaa mohamed understanding and using schiece process skills sc...Faheem, shimaa mohamed understanding and using schiece process skills sc...
Faheem, shimaa mohamed understanding and using schiece process skills sc...
 
Edu 671 wk 5 discussion 1 mock action research proposal presentation
Edu 671 wk 5 discussion 1 mock action research proposal presentationEdu 671 wk 5 discussion 1 mock action research proposal presentation
Edu 671 wk 5 discussion 1 mock action research proposal presentation
 
UDL Lesson Plan Subject EnglishGrade First Grade.docx
UDL Lesson Plan Subject EnglishGrade First Grade.docxUDL Lesson Plan Subject EnglishGrade First Grade.docx
UDL Lesson Plan Subject EnglishGrade First Grade.docx
 
King School Ely Evidence ppt
King School Ely Evidence pptKing School Ely Evidence ppt
King School Ely Evidence ppt
 
Transition
TransitionTransition
Transition
 
Collaborative Lesson Plan Farooqi
Collaborative Lesson Plan  FarooqiCollaborative Lesson Plan  Farooqi
Collaborative Lesson Plan Farooqi
 
Edt 507
Edt 507Edt 507
Edt 507
 
SDO .pptx
SDO .pptxSDO .pptx
SDO .pptx
 

Plus de JacekKupras

Astronomy curricula for different ages and cultural backgrounds
Astronomy curricula for different ages and cultural backgroundsAstronomy curricula for different ages and cultural backgrounds
Astronomy curricula for different ages and cultural backgrounds
JacekKupras
 
Przegląd misji Mars Science Laboratory
Przegląd misji Mars Science LaboratoryPrzegląd misji Mars Science Laboratory
Przegląd misji Mars Science Laboratory
JacekKupras
 
21 Century Skills w pigułce
21 Century Skills w pigułce21 Century Skills w pigułce
21 Century Skills w pigułce
JacekKupras
 
EarthCam - Witamy na pokładzie:)
EarthCam - Witamy na pokładzie:)EarthCam - Witamy na pokładzie:)
EarthCam - Witamy na pokładzie:)
JacekKupras
 
MoonKam dla każdego
MoonKam dla każdegoMoonKam dla każdego
MoonKam dla każdego
JacekKupras
 
Earth camwinter2012
Earth camwinter2012Earth camwinter2012
Earth camwinter2012
JacekKupras
 
WorldWide Telescope w gimnazjalnym projekcie edukacyjnym
WorldWide Telescope w gimnazjalnym projekcie edukacyjnymWorldWide Telescope w gimnazjalnym projekcie edukacyjnym
WorldWide Telescope w gimnazjalnym projekcie edukacyjnym
JacekKupras
 
Koniec epoki kredy
Koniec epoki kredyKoniec epoki kredy
Koniec epoki kredy
JacekKupras
 
Wieża toruńskiego ratusza
Wieża toruńskiego ratuszaWieża toruńskiego ratusza
Wieża toruńskiego ratusza
JacekKupras
 

Plus de JacekKupras (20)

Astronomy curricula for different ages and cultural backgrounds
Astronomy curricula for different ages and cultural backgroundsAstronomy curricula for different ages and cultural backgrounds
Astronomy curricula for different ages and cultural backgrounds
 
Edukacja z WorldWide Telescope cz. 4
Edukacja z WorldWide Telescope cz. 4Edukacja z WorldWide Telescope cz. 4
Edukacja z WorldWide Telescope cz. 4
 
Edukacja z WorldWide Telescope cz. 3
Edukacja z WorldWide Telescope cz. 3Edukacja z WorldWide Telescope cz. 3
Edukacja z WorldWide Telescope cz. 3
 
Edukacja z WorldWide Telescope cz. 2
Edukacja z WorldWide Telescope cz. 2Edukacja z WorldWide Telescope cz. 2
Edukacja z WorldWide Telescope cz. 2
 
Edukacja z WorldWide Telescope cz. 3
Edukacja z WorldWide Telescope cz. 3Edukacja z WorldWide Telescope cz. 3
Edukacja z WorldWide Telescope cz. 3
 
Edukacja z WorldWide Telescope
Edukacja z WorldWide TelescopeEdukacja z WorldWide Telescope
Edukacja z WorldWide Telescope
 
Przegląd misji Mars Science Laboratory
Przegląd misji Mars Science LaboratoryPrzegląd misji Mars Science Laboratory
Przegląd misji Mars Science Laboratory
 
21 Century Skills w pigułce
21 Century Skills w pigułce21 Century Skills w pigułce
21 Century Skills w pigułce
 
Co to takiego
Co to takiegoCo to takiego
Co to takiego
 
EarthCam - Witamy na pokładzie:)
EarthCam - Witamy na pokładzie:)EarthCam - Witamy na pokładzie:)
EarthCam - Witamy na pokładzie:)
 
MoonKam dla każdego
MoonKam dla każdegoMoonKam dla każdego
MoonKam dla każdego
 
Earth camwinter2012
Earth camwinter2012Earth camwinter2012
Earth camwinter2012
 
Instrukcja do Globe at Night
Instrukcja do Globe at NightInstrukcja do Globe at Night
Instrukcja do Globe at Night
 
Globeatnight
GlobeatnightGlobeatnight
Globeatnight
 
Tour do's and don'ts
Tour do's and don'tsTour do's and don'ts
Tour do's and don'ts
 
Creative computing with Scratch
Creative computing with ScratchCreative computing with Scratch
Creative computing with Scratch
 
WorldWide Telescope w gimnazjalnym projekcie edukacyjnym
WorldWide Telescope w gimnazjalnym projekcie edukacyjnymWorldWide Telescope w gimnazjalnym projekcie edukacyjnym
WorldWide Telescope w gimnazjalnym projekcie edukacyjnym
 
Koniec epoki kredy
Koniec epoki kredyKoniec epoki kredy
Koniec epoki kredy
 
WorldWide Telescope
WorldWide TelescopeWorldWide Telescope
WorldWide Telescope
 
Wieża toruńskiego ratusza
Wieża toruńskiego ratuszaWieża toruńskiego ratusza
Wieża toruńskiego ratusza
 

Eu unawe evaluation

  • 1. 1 EU Universe Awareness Programme Evaluation Guide MOTIVATION LEGACY Awareness of the Universe (Knowledge) Scientific Skills Intercultural Attitudes EU UNAWE fostering
  • 2. 2 This document contains materials to support National Managers (NM) visiting at least one school, to gather evidence for evaluation of the EU-UNAWE-Program. There are four main ways proposed for gathering general information: • Observations using an Astronomy Awareness Framework evaluation template, for children who are too young to write • Pre and post visit mind maps/drawings for 7-10 year olds • Quick evaluation with an Astro-poster • By means of a card game where children can identify objects and find correlations between them For the evaluation of the specific activities developed by each EU-UNAWE- partner we propose some playful activities (games). In addition, survey templates linked to the framework are supplied for gathering evidence from teachers, and pupils who are old enough to write. These can be used whether or not NM are able to visit the school. Summary
  • 3. 3 EU-UNAWE project goals Evaluation methodology Framework for children: Domains of active learning of EU-UNAWE Detailed description of the domains of active learning (DAL) Evidence of the impact for children according to the DAL Gathering evidence: process diagram First pre/post activity template: Drawing the night sky Pre/post activity template alternative Child observation template: Gathering evidences Pupils survey Evaluation games: Astro-Cards Quick evaluation: Astro-Poster Framework for teachers: Astronomy Awareness fields Astronomy Awareness Framework for teachers. Detailed description Teacher workshop survey plus e-form link Letter to teachers Parent letter and ethical permission Teacher thank you letter after visit Tracing activity development Evaluating long term impacts Checklist for the evaluation Astro-Cards 4 5 6 7 8 9 10 11 12 13 14 19 20 21 22 24 25 26 27 28 29 31 Content
  • 4. 4 EU-UNAWE project goals An evaluation concept of the European Universe Awareness programme (EU-UNAWE) must be strongly linked to the general and specific goals of the programme. In resume these are the following: The Programe is addressed specially to disadvantaged children in different social environments. The program intends to stimulate through images, playful activities, experiments, models and artistic activities the children´s awareness of astronomical objects and the place of the Earth as part of the Universe in a way of broadening the children´s view of the world. In doing so try to use daily- life materials in the activities, experiments and models such that children can reproduce them at home. Awaken the awareness of the uniqueness of the Earth and of the need for environmental preservation. Motivate children to appreciate other cultures via stories and twinning activities with children living in other countries, making them aware of the place in which other children live, their common cultural features and differences. Throughout stimulate children´s curiosity giving them the occasion and time to formulate their own questions related to the Universe. Develop EUNAWE-contents to be linked to daily school curricula via training of the teachers. To achieve these goals the partners of the project have developed diverse materials for teacher training workshops and subsequently children’s class activities. 4 1 2 3 4 5 6
  • 5. 5 Evaluation Methodology These evaluation materials focus on two key stakeholders: children and teachers. The project goals cover a range of domains of learning: motivation, scientific skills, knowledge, and intercultural attitudes. A framework for evaluation specific to UNAWE, ‘Astronomy Awareness’, is proposed as the basis for gathering evidence. Care has been taken to design a research methodology that acknowledges the strengths in a multi-national project and also allows for data from different locations and activities to be combined. Therefore, it is intended that this document supports National Managers (NM) to gather evidence with the aim of demonstrating a full range of impacts for teachers and pupils. Gathering evidence about children’s learning This data collection will require a visit to at least one school. In order that data collection is realistic, a number of qualitative evidence collection routes are proposed in anticipation that National Managers (NM) will select appropriate methods to suit children, capacity, hardware and activity. It is hoped that NM will use pre/post activity drawings or an observation template supplied to gather qualitative information about children’s actions about astronomy. In addition, card games, photos, video, recordings, and notes are all admissible as evidence and will help to build a clear understanding of the activities undertaken throughout the lifetime of the project. There is a survey for teachers (with e-form) and an optional follow up survey activity for children, suitable for 8-10 year olds. These can also be sent to schools independently of visiting, in order to gather more evidence. National Managers are most welcome to share other examples of evaluation methods. Understanding programme development Clearly, detailed reflection has been essential to develop both children’s resources and activities, and teacher workshops. This reflection and improvement process has the potential to be a rich source of learning for future projects. A paper template and e-form are provided for National Managers to complete, in order that others can gain insight into programme development, as a legacy from EU-UNAWE. Gathering evidence from teachers Excellent practice is already taking place around teacher evaluation using quantitative and qualitative questions on survey forms. Based on good examples supplied by NM, questions have been modified in order that data can be collated and logically correlated with the Astronomy Awareness framework for children’s learning. Paper and e-forms are supplied for dissemination to teachers. Pre -existing evaluation data in different formats is welcome: eval@unawe.org Instructions show the process for visiting and collecting qualitative evidence from one school. It is expected that this is the minimum, and greater statistical significance will be achieved for your project if you can visit more schools or use volunteers to assist in gathering more data.
  • 6. 6 Framework for children: Domains of active learning (DAL) of EU-UNAWE Using the general program goals, it is clear that the concepts underlying UNAWE cover several domains of active learning: The inspiration for assigning domains of learning for UNAWE evaluation is based on Information from the Museums’ Libraries and Archives Framework ‘Inspiring Learning for All’ generic learning outcomes and Nichols’ framework ‘(2012) Earthsmarts socioecological literacy’. Framework for children: Domains of active learning (DAL) of EU-UNAWE Using the general program goals, it is clear that the concepts underlying UNAWE cover several domains of active learning: The inspiration for assigning domains of learning for UNAWE evaluation is based on Information from the Museums’ Libraries and Archives Framework ‘Inspiring Learning for All’ generic learning MOTIVATION Awareness of the Universe (Knowledge) Scientific Skills Intercultural Attitudes EU UNAWE fostering
  • 7. 7 UNAWE Domains of active learning 7 UNAWE Domains of active learning Objectives Evidence Motivation Enjoyment, Inspiration Curiosity Tenacity • Children are doing the tasks with pleasure • Children seem enchanted • Children react with diligence in front of the proposed activities • Children demonstrate attention • Children apply perseverance / tenacity • Children manifest inquisitiveness • Children introduce some complex questions Develop Scientific Thinking & Problem Solving Techniques; Planning & Conducting Investigations Observation, Identification, Classification, Making interconnections, Changing Perspective & Communication From curriculum: example of school wording of this section Discussing and Questioning Ask questions which can be answered through an investigation Use scientific language regularly in discussions Planning Plan and carry out a test to collect evidence Select information from a range of resources Observing Decide what observations need to be made Select appropriate equipment for observation or measuring results Interpreting Draw conclusions linked to scientific knowledge and understanding. Recognise patterns and trends based on the observation or investigation Ideas and Evidence Recognise that scientific ideas are based on evidence which can be verified by observations Use the imagination together with scientific knowledge to understand and think about why something happen Recording Decide on an appropriate method of recording Present results using tables, graphs, pictures Evaluation Review the work and reflect on the results • Correct use of vocabulary or gesture to name objects and phenomena observed in sky • Grouping objects/ phenomena to indicate developing understanding of astronomy concepts • Making conjectures available to be contrasted • Developing some experiences related to the hypothesis • Linking new information with existing conceptions of the same or different areas • Removing previous points of view according to new inputs • Sharing with others their new knowledge ScientificSkills
  • 8. 8 Objectives Evidence Knowledge & Understanding   Observing, exploring and discovering: 1. The Sun, Sun relative position, Sun light (shadows), Day/night cycle, time zones, the seasons, the Moon, the Earth as a planet, awareness of the existence of water and of the Earth atmosphere and Sun light for the development of life on Earth, Solar and Moon eclipses,... 2. The Solar system: planets characteristics and movements, wharf planets, asteroids, comets,... 3. The Stars in the night sky, the constellations, orientation, the Life-cycle of stars, the formation of stars and planets,... 4. Our place in the Milky Way, Family of galaxies,... 5. Current developments in astronomy 6. Magnetic fields (compass, northern lights,...) 7. Several complementary questions   Valuing different cultural perspective. Recognising different physical perspectives. Positive attitude towards astronomy. Valuing inclusive education   Working Individually & in Teams   • Demonstrating awareness of different cultures • Ability to observe and explain differences in phenomena in different countries • Statements of future activity with regards to astronomy • Act on an appropriate way in a frame of diversity Direct observation and/or recording of naming, first explanations, discussing, drawing, construction, creative responses, movements and dances, etc. to demonstrate knowledge of one of the features listed. left UniverseKnowledgeInterculturalAttitudes
  • 9. 99 Gathering evidence: Process diagram Route 1 Route 2 Route 3 Pre/ Post • you know teacher • Children can write Observe • you are not leading activity Observe game • you are leading main activity Send teacher permission form, parent letter, arrange visit Children do pre activity personal meaning map (PMM) Reproduce evaluation game from template Practice observation template Consider additional evidence: photo, video, drawing Activity Activity Activity Observe record 3 children Children return to PMM and add new ideas in different colour Optional: support observations with child interview Eval. game Observe record 3 children Scan in PMM Enter obs. Data into google form Send PMM images/additional info to eval@unawe.org Thank teacher and class AssumptionsAdminPreactivityTeaching activity Postactivity (straightafter) Submitting data Admin
  • 12. 1212 Name of observer: ………………………Location: ………………….......... Date of observation: ……………………….....Time: ............................ Activity being evaluated:…………………………................................. Child age…………….M/F Languages:…………………......................... School…………………………….......................................................... Child observation template (4-7 years) Tally / score (e.g. III) Total Evidence (e.g. “smiled on seeing moon” MotivationScientific Skills KnowledgeInternational Attitudes Submit information online: http://goo.gl/2eFfW Name of observer: ………………………Location: ………………….......... Date of observation: ……………………….....Time: ............................ Activity being evaluated:…………………………................................. Child age…………….M/F Languages:…………………......................... School……………………………..........................................................
  • 13. 13 Pupil survey (8-10 years) 1 What activities have you done in class about space? 2 What did you enjoy about this topic? 3 Is there anything you did not like? 4 Would you like to find out more about astronomy and space in future? 5 Have you got any questions about space? 6 If you were going to make a Space Museum or a space display for your class, what topics and objects would you put in? Write or draw to explain your plan. Work on the back of this paper. Name: ............................................ Date: ........................................ School: ............................................................................................. Teacher: ..................................................... Age: .............................
  • 14. 1414 Evaluation materials Astro-Cards classification games Exercise 1 Card game “Astro-Cards”: Identification and classification game of astronomical objects. Age: Materials: Goal: 8 Card set “Astro-families” (24 cards) Evaluate children´s awareness of the existence of different astronomical objects and of the place of the Earth among them by asking them just to identify those that they know and to name them. In doing so, children can group them in families (planets, comets, stars, nebula, constellations, galaxies, etc). Link to Astronomy and scientific skills: Astronomy relies strongly on the observation, identification and posterior classification of objects into family classes, and on their location in space at different scales and distances. Observation and classification skills play therefore a key role .
  • 15. 15 Astro-cards evaluation games Exercise 2 15 Astro-cards evaluation games Exercise 2 Identification of objects belonging to the Solar System Ask children to identify some objects among the cards belonging to the Solar System. Objects belonging to the Solar system Link to Astronomy and scientific skills: To learn about our cosmic adress and our neighbourhood it is important that children gain a idea of all objects belonging to the Solar System
  • 16. 16 Astro-cards evaluation games Exercise 3 16 Astro-cards evaluation games Exercise 3 Identification and classification of planets Ask children to identify among the cards the planets , to name them and group them into solid and gaseous planets according to their distances to the Sun. The solid planets of the Solar System Gaseous planets Link to Astronomy and scientific skills: The distinktion between solid (rocky) and gaseous, and their distance to the Sun planets plays an important role when discussing the habitability of planets. Therefor is this classification fundamental of the discussion about life in the Solar System. Also, the uniqueness of the Earth among the planets can only be understood in this classification context.
  • 17. 17 Astro-cards evaluation games Exercise 4 17 Astro-cards evaluation games Exercise 4 Identification and classification of asteriods and comets Ask children to identify among the cards the asteroids and comets and to discuss about their differences and location in the Solar System. Link to Astronomy and scientific skills: Both asteroids and comets are considered as fossiles objects of the Solar System and are connected to ist formation history. Planets formed in the past from the collisions of hundred of thousands of asteroids which had in turn formed out from dust grains of the protoplanetary disc sorrounding the Sun. Comets are icy objects that, when close enough to the Sun, displays a visible coma (a thin temporary atmosphere) and a tail. It is thought that the Earth water came from lots of comets impacting its surface.
  • 18. 18 Astro-cards evaluation games Exercise 5 18 Astro-cards evaluation games Exercise 5 Identification and classification of nebula and star clusters Ask children to identify among the cards the nebula (birth place of stars) and the open and globular star clusters.
  • 19. 19 Astro-cards evaluation games Exercise 6 19 Astro-cards evaluation games Exercise 6 Identification and classification of galaxies, galaxy families and galaxy clusters
  • 20. 20 Quick evaluation: Astro-Poster Another posibility of performing a quick evaluation is to show children the poster bellow and ask them to identify as many objects as possible. In doing so they could describe their size and location (e.g. within the Milky Way, outside the Milky Way).
  • 21. 21 MOTIVATION Awareness of the Universe (Knowledge) Scientific Skills Intercultural Attitudes EU UNAWE fostering LEGACY Astronomy Awareness Framework for teachers Teacher additional area for impact: Legacy Teachers gain subject knowledge for teaching their pupils in the domains previously explained. In addition there is potential for the impact of the project to be multiplied through: • Teachers disseminating knowledge • Teachers critically appraising resources and activities, in order to make recommendations for future projects • Embedding astronomy activities into curriculum
  • 22. 22 Astronomy Awareness Framework for teachers: Detailed description 22 Astronomy Awareness Framework for teachers: Detailed description Definition MotivationScientificSkillsKnowledge Intercultural Attitudes Legacy 1. Enjoyment 2. Inspiration 3. Creativity 4. Persistence 1. Curiosity 2. Observation 3. Identification 4. Classification 5. Making interconnections 6. Changing perspective 7. Communication Observing, exploring  and discovering: 1. The Sun, Sun light (shadows), Day/night cycle, the seasons, the Moon, the Earth as a planet, awareness of the existence of water and of the Earth atmosphere and Sun light for the development of life on Earth, Solar and Moon eclipses. 2. The Solar system: planets characteristics and movements, wharf planets, asteroids, comets. 3. The Stars in the night sky, the constellations, the life-cycle of stars, the formation of stars and planets 4. Our place in the Milky Way, Family of galaxies 5. Current developments in astronomy 1. Valuing different cultural perspectives 2. Positive attitudes towards astronomy 1. Disseminating knowledge to other teachers 2. Recommendations for improvements 3. Embedding new materials in curriculum Motivation 1. Curiosity 7. Communication Observing, exploring  and discovering:Observing, exploring  and discovering: Intercultural Current developments in astronomy 1. Valuing different cultural perspectives Intercultural Disseminating knowledge to other teachers
  • 23. 23 Name: ………………………..................... Date: …………………........... Workshop Location: ……………………….Time: ............................... Date of teacher workshop:………………………….............................. Age of class taught: …………….School name: ................................ School adress:…………………......................................................... Your email adress: ..................................................................... School……………………………......................................................... Teacher workshop survey (page 1/2) We would prefer that this is completed online at: http://goo.gl/XejyP About you 1 What did you enjoy about the course? 2 Did you gain knowledge about the universe? Please explain. 3 Did you develop any new skills or practice existing skills? 4 Did the course make you consider cultural perspectives differently? 5 Did you share aspects of this course with other staff? How? 6 Have you got any recommendations for improvements to your course? 7Have you embedded any new materials into the curriculum as a result of this course? Name: ………………………..................... Date: …………………........... Workshop Location: ……………………….Time: ............................... Date of teacher workshop:………………………….............................. Age of class taught: …………….School name: ................................ School adress:…………………......................................................... Your email adress: ..................................................................... School…………………………….........................................................
  • 24. 24 About your pupils 8 How did you interpret the activities for your pupils? 9 What did they enjoy about the activity? 10 Were there any constraints to implementing the activity? 11 What do you think your pupils learnt? 12 Did they have the opportunity to try out any new skills? 13 Did they have opportunities for cultural learning? 14Which aspects of curriculum assessment did the activities address? 15Please rate the UNAWE resources out of 10,(10= excellent): 16How could future projects support opportunities for children to be involved in astronomy? Any other comments? Teacher workshop survey (page 2/2)
  • 25. 2525 Teacher letter/email template Send to teachers before visit Universe Awareness Activity observation Dear insert teacher name, Thank you for taking the opportunity to attend the recent Teacher training course on <insert date>. I am looking forward to your class participating in activities which aim to increase their understanding and excitement about astronomy. As part of the programme, and to allow it to continue free of charge, UNAWE are obliged to gather information about the activities and how children respond to them. I hope you do not mind me contacting you to request assistance. I have chosen your school because <insert specific reasons here >I I would like to ask permission to visit you for an evaluation activity. I do not anticipate that this would detract from your normal class activities,. I hope to gather evidence about children’s learning in the form of a short activity and some observations. These may also be useful for teacher assessment. I would also like to find out your opinions about implementing the activities. If you are happy for this activity to take place, I would be grateful if you could circulate the letters attached to parents; I would like to collect them when I visit. Here are some dates which might be suitable for a visit: <Dates> If none of these suit you then please let me know good alternatives. Please feel free to contact me by email: <email address> or phone <number> at a convenient time to check times and dates. With best wishes and thanks for your support, National Manager name National Manager <insert location> UNAWE www.unawe.org
  • 26. 2626 Parent letter template Send/email to teachers before visit NB recommend sending a class set to teachers Dear parent, Your son/daughter’s teacher <insert name> has recently taken part in a workshop aiming to increase children’s understanding and excitement about astronomy. Owing to your teacher’s enthusiasm for astronomy, we have chosen your child’s class for a follow up visit, so that we can see activities taking place in the classroom. As part of the programme, and to allow it to continue free of charge, Universe Awareness are obliged to gather information about the activities and how children respond to them. I would like to ask permission to gather information in different ways. I would be grateful if you could indicate on the attached form whether you are happy for anonymous evidence to be gathered as shown below. If you have noticed your child speaking about astronomy topics recently, I would be very interested to hear about it. <email here> if you have any questions please do not hesitate to contact me: With best wishes and thanks for your support, National Manager name National Manager <insert location> UNAWE www.unawe.org 26 Name of child / children School Your name We would like to gather evidence about UNAWE children’s astronomy programme. This may be used in communicating the benefits of the trip; for example in may go on a website for researchers, educators, parents or teachers to look at. It may be used to persuade other organisations to run a similar project, which may involve press coverage. Children will not be identified by name. Please indicate if you are happy for evidence (photo/video/microphone/written) to be gathered. We will not use the images taken, or any other information you provide, for any other purpose. Contact details will only be used to communicate with you, and all conditions of the Data Protection Act 1998 will be adhered to. I give permission for my son/daughter to take part in the ‘Universe Awareness’ school activity during class time, at school, and for evidence to be collected as indicated above. Signed: Data: School Your nameYour name We would like to gather evidence about UNAWE children’s astronomy programme. This may be used in I give permission for my son/daughter to take part in the ‘Universe Awareness’ school activity during
  • 27. 27 Teacher letter template Send to teachers after visit Dear insert teacher name, Thank you very much for allowing me to visit on <insert date here>. I would like to thank you and the class for making me feel welcome, and for facilitating collection of vital evidence about learning. This data will be used to improve the programme, and also to develop future Programmes. In case you have not yet completed the online survey, here is the address: http://goo.gl/XejyP Children’s opinions are of key importance and likeiwise, I am keen to see the children’s opinions from their survey activity. (NB delete if children are under 8) The results will be made available in a full report towards the end of 2013, and if you would like a copy please send your contact details to eval@unawe.org If you have any questions please do not hesitate to contact me: <insertemail here> National Manager name National Manager <insert location> UNAWE www.unawe.org
  • 28. 28 Tracing resources/activity development Your name: Your location: Activity title: Audience: Children age�./Teachers Number of participants Activity type: Festival, workshop, game, lesson, drop in, outreach, other Where did it take place? Date of activity Time of activity How did you develop this resource? (conception and delivery) Image file name In order to better understand your programme development process, we would like to ask you to reflect on and complete the following information online. Please complete one form per activity including teacher workshop activities you have developed. Information can be brief. We would prefer that this is completed online at: http://goo.gl/yJQY5 (Please send an image of the programme to eval@unawe.org) 1 2 3 4 5 6 7 8 9 10 11 Here are the questions:
  • 29. 2929 Evaluating long term impact We recognise that long term impact is a question frequently asked in evaluation. Whilst demonstrating long term impact was not stated as an evaluation outcome in this EU proposal, if you wish to gather supporting information then it would be possible using the following interview methodology: Search records for a class that you can still contact, who have taken part in previous UNAWE activities. Contact a teacher at the school and request an interview with a group of pupils. Use the following questions for a semi-structured interview (This means encourage conversation around the four key questions). : • Record age, date, name, school and year of UNAWE participation. • On a scale of 1-10, where 1= dislike and 10 = like very much, how do you feel about astronomy? Discuss responses with the group. • If you were planning to teach younger children about astronomy, what would you like to tell them about? • Do you ever observe the night sky? • Do you think you will use what you know about astronomy in future? In addition, it is then necessary to find a control group of pupils the same age, who have not taken part in UNAWE activities. If you submit notes about interviews with both groups, these can be included, correlated with the Astronomy Awareness framework, as part of the final report. There is a google form here to submit information. Interviewing to assess long term impact 1 2 3
  • 30. 30 Checklist for the evaluation 30 Checklist for the evaluation Task Date planned Completed Task Decide which route is suitable for you Identify school (s) to observe Send teacher letters together with parent information Set observation dates Produce evaluation game using template Practice observation schedule Consider video recording or sound/photos as additional material Agree activity, timing and pupils to observe with teacher. You may need to explain evaluation game or pre visit materials. Discuss photography and video with teacher Photocopy PMM Photocopy teacher survey Photocopy pupil survey if pupils are over 8 Recharge digital camera/dictaphone Take game/PMM/observation sheets/ teacher survey/pupil survey to school, together with any recording hardware Route 1: Pre visit PMM Route 2: Observe activity and record 3 pupils minimum Route 1: Post visit PMM OR Route 3: post visit evaluation game plus observations Give teacher survey and pupil survey Collect teacher survey (if not eform), pupil surveys and parent permission forms Route 1: scan in PMMs Route 2 and 3: submit observation data Download and email any supporting video/photo/drawing evidence Thank teacher and class Task Decide which route is suitable for youDecide which route is suitable for you Identify school (s) to observeIdentify school (s) to observe Send teacher letters together with parent informationSend teacher letters together with parent information Set observation datesSet observation dates Produce evaluation game using templateProduce evaluation game using template Practice observation schedulePractice observation schedule Consider video recording or sound/photos as additional material Agree activity, timing and pupils to observe with teacher. Discuss photography and video with teacher Photocopy PMMPhotocopy PMM Photocopy teacher surveyPhotocopy teacher survey Photocopy pupil survey if pupils are over 8Photocopy pupil survey if pupils are over 8 Recharge digital camera/dictaphoneRecharge digital camera/dictaphone Take game/PMM/observation sheets/ teacher survey/pupil survey to school, together with any recording hardware Route 1: Pre visit PMMRoute 1: Pre visit PMM Route 2: Observe activity and record 3 pupils minimumRoute 2: Observe activity and record 3 pupils minimum Route 1: Post visit PMM OR Route 3: post visit evaluation game plus observations Give teacher survey and pupil surveyGive teacher survey and pupil survey Collect teacher survey (if not eform), pupil surveys and parent permission forms Route 1: scan in PMMsRoute 1: scan in PMMs Route 2 and 3: submit observation dataRoute 2 and 3: submit observation data Download and email any supporting video/photo/drawing evidence Thank teacher and class planned
  • 38. 38 Authors: Cecilia Scorza and Grace Kimble Coordination: Pedro Russo Design and Layout: Charlotte Provot ISBN: 9789491760037 www.eu-unawe.org