SlideShare une entreprise Scribd logo
1  sur  26
Framing quality indicators for multilingual repositories of Open
Educational Resources
– The LangOER European network
EFQUEL Innovation Forum
and International LINQ Conference
9 May, Crete
Sylvi Vigmo
Linda Bradley
Anne-Christin Tannhäuser
Katerina Zourou
This project was financed with the support of the European Commission. This publication is the sole responsibility of the author and
the Commission is not responsible for any use that may be made of the information contained therein.
About the LangOER network
– Fryske Academy, The Netherlands
– Web2learn, Greece
– European Schoolnet, Belgium
– University of Gothenburg, Sweden
– Jan Dlugosz University, Poland
– Mykolas Romeris University, Lithuania
– International Council for Open and Distance
Education, Norway
– European Foundation for Quality in E-
learning, Belgium
– Rezekne Higher Education Institution, Latvia
European funded network (2014-2016), 9 partners:
Co-ufunded by the Commission (LLP programme, KA2 action)
Strands of activities
•State-of-the art of OER in less used languages
•International policy makers capacity building
•Teacher training
•Regional and minority languages & OER
•Challenges for language learning
•Mainstream good practice at European policy making level
Scope of the LangOER project
•Enhance the linguistic and cultural components of OER
•Foster sustainability through OER reuse
•Address needs of policy makers and educators
•Raise awareness of risk of exclusion of less used languages from the OER landscape
•Offer training to educators of less used languages, face-to-face and online
•Embrace stakeholders of regional and minority languages in remotely located areas of
Europe to gain knowledge, develop skills
Three main questions
• How can less used languages, including Regional and Minority
languages, benefit from Open Educational Practices (OEP)?
• How can Open Educational Resources (OER) be shaped to
foster linguistic and cultural diversity in Europe?
• What policies are favourable to the uptake of quality OER in
less used language communities?
Set-up of today’s workshop
• Key quality indicators of repositories of OER
• Current situation in multilingual repositories of OER
• LangOER project state-of-the-art results
• Discussion:
– Examples of multilingual repositories
– quality indicators of multilingual repositories
Keywords from UNESCO’s definition
Definition of OER
•teaching, learning and research materials
•in the public domain
•released under an open license
•no-cost access
•possible to adapt and redistribute
•with no or limited restrictions
UNESCO, 2012, Paris OER Declaration
QUALITY INDICATORS FOR OER
REPOSITORIES
Atenas, J. & Havemann, L. (2013). Quality Assurance in the Open: An Evaluation of
OER Repositories. INNOQUAL - International Journal for Innovation and Quality in
Learning , 1 (2). pp. 22-34.
Our Source
@jatenas
@leohavemann
Developed to
support open
practices
10 Indicators
10 Indicators
10 Indicators
10 Indicators
10 Indicators
10 Indicators
10 Indicators
Zooming in on some indicators
• Multilingual support
• Social media support
• Peer review
• User evaluation tools
State-of-the-art investigaton method
Method
•Online investigation and input from the 7 partner languages;
Dutch, Frisian, Greek, Latvian, Lithuanian, Polish, Swedish, as well
as from Danish, Estonian, Finnish, French, Hungarian, Icelandic,
Italian, Norwegian, German, Romanian
– Local and national OER & OER communities
– Status of OER
•Survey from experts in the field concerning awareness of studies
on repositories of OER:
– From a linguistic perspective
– Of less used languages
– Multilingual resources
State-of-the-art investigaton results 1
• Lacking common ground – interpretation too open
• Licensing less explicit
• OER linked to ”open learning” and ”accessibility”
http://www.narcis.nl
State-of-the-art investigaton results 2
• Diversified picture
Languages with considerable OER resources
–Active and vibrant; state-supported or grass-root
initiatives
Languages with few or any OER resources
–Restrictions in copyright
–Dependent on international initiatives
–Not really OER: rather ABOUT OER
• For enthusiasts, relatively unknown to the
majority of teachers and learners
• Restricted innovative scope of OER and
language use
Swedish OER repository lektion.se
Interaction: exploring OER repositories
• Lemill http://lemill.net/ “Web community for finding, authoring
and sharing learning resources for school teachers
• 70206 learning resources in 87 languages
• Varying content
Type and number of
Activities:
Interaction: Screenshots from Lemill
With an acount, anyone can edit:
Example of the most common type ”Web pages”:
Interaction: Interactive activity
• Have a look at the OER example from Lemill http://lemill.net
• Discuss the quality aspects on this repository
• Benefits and drawbacks on this repository?
• What would be specific from a less-used-language perspective?
Interaction: Summing up
• Discussion of findings
•Quality concerns in OER repositories for less used languages:
•How can less used languages, including Regional and Minority
languages, benefit from Open Educational Practices (OEP)?
•How can Open Educational Resources (OER) be shaped to foster
linguistic and cultural diversity in Europe?
•June 2014: Working policy paper by ICDE and LangOER team on
policy challenges and opportunities for less used languages on a
national and international level
•June 2014 webinar: ”The current picture of OER for less used
languages”
•Teacher training activities in GR, LV, LT, PL, SE, NO in autumn
2014 and possibly also remotely through EUN’s European
Schoolnet
Current and future activities
Staying in touch
http://langoer.eun.org/
#langOER
LangOER
OER and languages
OER and languages
LangOER teachers’ group (in preparation)

Contenu connexe

Tendances

Open Educational Resources and Practices for Language Vitality: the Case of L...
Open Educational Resources and Practices for Language Vitality: the Case of L...Open Educational Resources and Practices for Language Vitality: the Case of L...
Open Educational Resources and Practices for Language Vitality: the Case of L...LangOER
 
New networking opportunities
New networking opportunitiesNew networking opportunities
New networking opportunitiesLangOER
 
Pedagogy, technology and training for language learning and teaching: the ECM...
Pedagogy, technology and training for language learning and teaching: the ECM...Pedagogy, technology and training for language learning and teaching: the ECM...
Pedagogy, technology and training for language learning and teaching: the ECM...LangOER
 
Wikiwijs: from top down to bottum up
Wikiwijs: from top down to bottum upWikiwijs: from top down to bottum up
Wikiwijs: from top down to bottum upEADTU
 
Short summary: "OER uptake for lesser-used languages"
Short summary: "OER uptake for lesser-used languages"Short summary: "OER uptake for lesser-used languages"
Short summary: "OER uptake for lesser-used languages"LangOER
 
Linguistic Diversity on the Web: Open Educational Resources and Open Educatio...
Linguistic Diversity on the Web: Open Educational Resources and Open Educatio...Linguistic Diversity on the Web: Open Educational Resources and Open Educatio...
Linguistic Diversity on the Web: Open Educational Resources and Open Educatio...LangOER
 
LangOER Conference: Welcome message
LangOER Conference: Welcome message LangOER Conference: Welcome message
LangOER Conference: Welcome message LangOER
 
EdReNe Session
EdReNe SessionEdReNe Session
EdReNe SessionLangOER
 
Session "OER in Practice"
Session "OER in Practice"Session "OER in Practice"
Session "OER in Practice"LangOER
 
Enhancing teaching and learning of less used languages through Open Education...
Enhancing teaching and learning of less used languages through Open Education...Enhancing teaching and learning of less used languages through Open Education...
Enhancing teaching and learning of less used languages through Open Education...Web2Learn
 
Eurocall2015 enhancing teaching and learning of less used languages through o...
Eurocall2015 enhancing teaching and learning of less used languages through o...Eurocall2015 enhancing teaching and learning of less used languages through o...
Eurocall2015 enhancing teaching and learning of less used languages through o...LindaBradley35
 
Opening Up Open Access - OER
Opening Up Open Access - OEROpening Up Open Access - OER
Opening Up Open Access - OERMicah Vandegrift
 
OER In practice - Cultural appropiation of open content
OER In practice - Cultural appropiation of open contentOER In practice - Cultural appropiation of open content
OER In practice - Cultural appropiation of open contentLangOER
 
OER In practice - Lifelong learning of teachers and Open Education Resources:...
OER In practice - Lifelong learning of teachers and Open Education Resources:...OER In practice - Lifelong learning of teachers and Open Education Resources:...
OER In practice - Lifelong learning of teachers and Open Education Resources:...LangOER
 
ECMI project on status of minority languages and languages rights in Europe
ECMI project on status of minority languages and languages rights in EuropeECMI project on status of minority languages and languages rights in Europe
ECMI project on status of minority languages and languages rights in EuropeLangOER
 
Going open: the teachers’ perspective on openness in education
Going open: the teachers’ perspective on openness in education Going open: the teachers’ perspective on openness in education
Going open: the teachers’ perspective on openness in education LangOER
 
MOOCs for Language learning and Opportunities
MOOCs for Language learning and OpportunitiesMOOCs for Language learning and Opportunities
MOOCs for Language learning and OpportunitiesLangOER
 
How can OER enhance the position of less used languages on a global scale?
How can OER enhance the position of less used languages on a global scale?How can OER enhance the position of less used languages on a global scale?
How can OER enhance the position of less used languages on a global scale?LangOER
 

Tendances (18)

Open Educational Resources and Practices for Language Vitality: the Case of L...
Open Educational Resources and Practices for Language Vitality: the Case of L...Open Educational Resources and Practices for Language Vitality: the Case of L...
Open Educational Resources and Practices for Language Vitality: the Case of L...
 
New networking opportunities
New networking opportunitiesNew networking opportunities
New networking opportunities
 
Pedagogy, technology and training for language learning and teaching: the ECM...
Pedagogy, technology and training for language learning and teaching: the ECM...Pedagogy, technology and training for language learning and teaching: the ECM...
Pedagogy, technology and training for language learning and teaching: the ECM...
 
Wikiwijs: from top down to bottum up
Wikiwijs: from top down to bottum upWikiwijs: from top down to bottum up
Wikiwijs: from top down to bottum up
 
Short summary: "OER uptake for lesser-used languages"
Short summary: "OER uptake for lesser-used languages"Short summary: "OER uptake for lesser-used languages"
Short summary: "OER uptake for lesser-used languages"
 
Linguistic Diversity on the Web: Open Educational Resources and Open Educatio...
Linguistic Diversity on the Web: Open Educational Resources and Open Educatio...Linguistic Diversity on the Web: Open Educational Resources and Open Educatio...
Linguistic Diversity on the Web: Open Educational Resources and Open Educatio...
 
LangOER Conference: Welcome message
LangOER Conference: Welcome message LangOER Conference: Welcome message
LangOER Conference: Welcome message
 
EdReNe Session
EdReNe SessionEdReNe Session
EdReNe Session
 
Session "OER in Practice"
Session "OER in Practice"Session "OER in Practice"
Session "OER in Practice"
 
Enhancing teaching and learning of less used languages through Open Education...
Enhancing teaching and learning of less used languages through Open Education...Enhancing teaching and learning of less used languages through Open Education...
Enhancing teaching and learning of less used languages through Open Education...
 
Eurocall2015 enhancing teaching and learning of less used languages through o...
Eurocall2015 enhancing teaching and learning of less used languages through o...Eurocall2015 enhancing teaching and learning of less used languages through o...
Eurocall2015 enhancing teaching and learning of less used languages through o...
 
Opening Up Open Access - OER
Opening Up Open Access - OEROpening Up Open Access - OER
Opening Up Open Access - OER
 
OER In practice - Cultural appropiation of open content
OER In practice - Cultural appropiation of open contentOER In practice - Cultural appropiation of open content
OER In practice - Cultural appropiation of open content
 
OER In practice - Lifelong learning of teachers and Open Education Resources:...
OER In practice - Lifelong learning of teachers and Open Education Resources:...OER In practice - Lifelong learning of teachers and Open Education Resources:...
OER In practice - Lifelong learning of teachers and Open Education Resources:...
 
ECMI project on status of minority languages and languages rights in Europe
ECMI project on status of minority languages and languages rights in EuropeECMI project on status of minority languages and languages rights in Europe
ECMI project on status of minority languages and languages rights in Europe
 
Going open: the teachers’ perspective on openness in education
Going open: the teachers’ perspective on openness in education Going open: the teachers’ perspective on openness in education
Going open: the teachers’ perspective on openness in education
 
MOOCs for Language learning and Opportunities
MOOCs for Language learning and OpportunitiesMOOCs for Language learning and Opportunities
MOOCs for Language learning and Opportunities
 
How can OER enhance the position of less used languages on a global scale?
How can OER enhance the position of less used languages on a global scale?How can OER enhance the position of less used languages on a global scale?
How can OER enhance the position of less used languages on a global scale?
 

En vedette

Open educational practices, a tool for empowerment
 Open educational practices, a tool for empowerment Open educational practices, a tool for empowerment
Open educational practices, a tool for empowermentLangOER
 
21 Lessons Learned from my Military Transition
21 Lessons Learned from my Military Transition21 Lessons Learned from my Military Transition
21 Lessons Learned from my Military TransitionJP Patino
 
Digital Connect 2014
Digital Connect 2014Digital Connect 2014
Digital Connect 2014Grafic.guru
 
Enhancement of LangOER project good practices
Enhancement of LangOER project good practicesEnhancement of LangOER project good practices
Enhancement of LangOER project good practicesLangOER
 
Tema 2frm 5
Tema 2frm 5Tema 2frm 5
Tema 2frm 5keey14
 
Roadmap OER
Roadmap OERRoadmap OER
Roadmap OERLangOER
 
Carrier Summary
Carrier Summary Carrier Summary
Carrier Summary Grafic.guru
 
WHAT YOU NEED FOR HAPPY, ENGAGED EMPLOYEES THE ADVANCED GUIDE TO EMPLOYEE SUR...
WHAT YOU NEED FOR HAPPY, ENGAGED EMPLOYEES THE ADVANCED GUIDE TO EMPLOYEE SUR...WHAT YOU NEED FOR HAPPY, ENGAGED EMPLOYEES THE ADVANCED GUIDE TO EMPLOYEE SUR...
WHAT YOU NEED FOR HAPPY, ENGAGED EMPLOYEES THE ADVANCED GUIDE TO EMPLOYEE SUR...Grafic.guru
 
OER insights into a multilingual landscape
OER insights into a multilingual landscapeOER insights into a multilingual landscape
OER insights into a multilingual landscapeLangOER
 
Translation services for STEM OER: the Scientix approach
Translation services for STEM OER: the Scientix approachTranslation services for STEM OER: the Scientix approach
Translation services for STEM OER: the Scientix approachLangOER
 
Africa Green Corporation
Africa Green CorporationAfrica Green Corporation
Africa Green CorporationGrafic.guru
 
Bridging language acquision and language policy
Bridging language acquision and language policyBridging language acquision and language policy
Bridging language acquision and language policyLangOER
 
IATEFL Conference: Open up your classroom: Open Educational Resources in Lang...
IATEFL Conference: Open up your classroom: Open Educational Resources in Lang...IATEFL Conference: Open up your classroom: Open Educational Resources in Lang...
IATEFL Conference: Open up your classroom: Open Educational Resources in Lang...LangOER
 
Kitchen vocabulary
Kitchen vocabularyKitchen vocabulary
Kitchen vocabularyZoir Tetuani
 
Social networks and their role in open educational language practice and inte...
Social networks and their role in open educational language practice and inte...Social networks and their role in open educational language practice and inte...
Social networks and their role in open educational language practice and inte...LangOER
 
Coral media studio
Coral media studioCoral media studio
Coral media studioGrafic.guru
 
Europeana4education
Europeana4educationEuropeana4education
Europeana4educationLangOER
 

En vedette (20)

Open educational practices, a tool for empowerment
 Open educational practices, a tool for empowerment Open educational practices, a tool for empowerment
Open educational practices, a tool for empowerment
 
21 Lessons Learned from my Military Transition
21 Lessons Learned from my Military Transition21 Lessons Learned from my Military Transition
21 Lessons Learned from my Military Transition
 
Digital Connect 2014
Digital Connect 2014Digital Connect 2014
Digital Connect 2014
 
CAREER SUMMARY
CAREER SUMMARYCAREER SUMMARY
CAREER SUMMARY
 
Enhancement of LangOER project good practices
Enhancement of LangOER project good practicesEnhancement of LangOER project good practices
Enhancement of LangOER project good practices
 
Power point (1)
Power point (1)Power point (1)
Power point (1)
 
Tema 2frm 5
Tema 2frm 5Tema 2frm 5
Tema 2frm 5
 
Roadmap OER
Roadmap OERRoadmap OER
Roadmap OER
 
Carrier Summary
Carrier Summary Carrier Summary
Carrier Summary
 
WHAT YOU NEED FOR HAPPY, ENGAGED EMPLOYEES THE ADVANCED GUIDE TO EMPLOYEE SUR...
WHAT YOU NEED FOR HAPPY, ENGAGED EMPLOYEES THE ADVANCED GUIDE TO EMPLOYEE SUR...WHAT YOU NEED FOR HAPPY, ENGAGED EMPLOYEES THE ADVANCED GUIDE TO EMPLOYEE SUR...
WHAT YOU NEED FOR HAPPY, ENGAGED EMPLOYEES THE ADVANCED GUIDE TO EMPLOYEE SUR...
 
OER insights into a multilingual landscape
OER insights into a multilingual landscapeOER insights into a multilingual landscape
OER insights into a multilingual landscape
 
Translation services for STEM OER: the Scientix approach
Translation services for STEM OER: the Scientix approachTranslation services for STEM OER: the Scientix approach
Translation services for STEM OER: the Scientix approach
 
Africa Green Corporation
Africa Green CorporationAfrica Green Corporation
Africa Green Corporation
 
Bridging language acquision and language policy
Bridging language acquision and language policyBridging language acquision and language policy
Bridging language acquision and language policy
 
IATEFL Conference: Open up your classroom: Open Educational Resources in Lang...
IATEFL Conference: Open up your classroom: Open Educational Resources in Lang...IATEFL Conference: Open up your classroom: Open Educational Resources in Lang...
IATEFL Conference: Open up your classroom: Open Educational Resources in Lang...
 
Kitchen vocabulary
Kitchen vocabularyKitchen vocabulary
Kitchen vocabulary
 
Topik 4 Tipe Data
Topik 4 Tipe DataTopik 4 Tipe Data
Topik 4 Tipe Data
 
Social networks and their role in open educational language practice and inte...
Social networks and their role in open educational language practice and inte...Social networks and their role in open educational language practice and inte...
Social networks and their role in open educational language practice and inte...
 
Coral media studio
Coral media studioCoral media studio
Coral media studio
 
Europeana4education
Europeana4educationEuropeana4education
Europeana4education
 

Similaire à Framing quality indicators for multilingual repositories of Open Educational Resources

Open Educational Resources for less used languages in an increasingly digital...
Open Educational Resources for less used languages in an increasingly digital...Open Educational Resources for less used languages in an increasingly digital...
Open Educational Resources for less used languages in an increasingly digital...LangOER
 
Teaching and learning less used languages through OER and OEP, LINQ Conferenc...
Teaching and learning less used languages through OER and OEP, LINQ Conferenc...Teaching and learning less used languages through OER and OEP, LINQ Conferenc...
Teaching and learning less used languages through OER and OEP, LINQ Conferenc...LangOER
 
OER: insights into a multilingual landscape
OER: insights into a multilingual landscapeOER: insights into a multilingual landscape
OER: insights into a multilingual landscapeLangOER
 
ICMl conference, Belgrade 2015
ICMl conference, Belgrade 2015ICMl conference, Belgrade 2015
ICMl conference, Belgrade 2015Marit Bijlsma
 
OER: insights into a multilingual landscape - EUROCALL 2014 conference
OER: insights into a multilingual landscape - EUROCALL 2014 conference  OER: insights into a multilingual landscape - EUROCALL 2014 conference
OER: insights into a multilingual landscape - EUROCALL 2014 conference LangOER
 
Nordic OER by Alastair Creelman
Nordic OER by Alastair CreelmanNordic OER by Alastair Creelman
Nordic OER by Alastair CreelmanLangOER
 
EmpOERing students and academics through large-scale open content initiatives
EmpOERing students and academics through large-scale open content initiatives EmpOERing students and academics through large-scale open content initiatives
EmpOERing students and academics through large-scale open content initiatives witthaus
 
How can OER enhance the position of less used languages on a global scale?
How can OER enhance the position of less used languages on a global scale?How can OER enhance the position of less used languages on a global scale?
How can OER enhance the position of less used languages on a global scale?The Open Education Consortium
 
Workshop on OER and less used languages
Workshop on OER and less used languagesWorkshop on OER and less used languages
Workshop on OER and less used languagesicdeslides
 
REFLESS project top-level conference: Waldemar Martyniuk, Council of Europe's...
REFLESS project top-level conference: Waldemar Martyniuk, Council of Europe's...REFLESS project top-level conference: Waldemar Martyniuk, Council of Europe's...
REFLESS project top-level conference: Waldemar Martyniuk, Council of Europe's...REFLESS Project
 
An Introduction to Open Educational Resources
An Introduction to Open Educational ResourcesAn Introduction to Open Educational Resources
An Introduction to Open Educational ResourcesLangOER
 
ukas Bleichenbacher & Richard Rossner: Towards a Common European Framework fo...
ukas Bleichenbacher & Richard Rossner: Towards a Common European Framework fo...ukas Bleichenbacher & Richard Rossner: Towards a Common European Framework fo...
ukas Bleichenbacher & Richard Rossner: Towards a Common European Framework fo...eaquals
 
Accessibility of OERs for Diverse Learners and Guidelines for Dyslexia in Mod...
Accessibility of OERs for Diverse Learners and Guidelines for Dyslexia in Mod...Accessibility of OERs for Diverse Learners and Guidelines for Dyslexia in Mod...
Accessibility of OERs for Diverse Learners and Guidelines for Dyslexia in Mod...Una Daly
 
Eurocall SpeakApps Presentation - Open Educational Resources and the CEFR
Eurocall SpeakApps Presentation - Open Educational Resources and the CEFREurocall SpeakApps Presentation - Open Educational Resources and the CEFR
Eurocall SpeakApps Presentation - Open Educational Resources and the CEFRSpeakApps Project
 
How to Implement OER in an Accessible User-friendly Way
How to Implement OER in an Accessible User-friendly WayHow to Implement OER in an Accessible User-friendly Way
How to Implement OER in an Accessible User-friendly WayJacqueline L. Frank
 
REFLESS project - About LLAS
REFLESS project - About LLASREFLESS project - About LLAS
REFLESS project - About LLASREFLESS Project
 
Building a European learning analytics community
Building a European learning analytics communityBuilding a European learning analytics community
Building a European learning analytics communityRebecca Ferguson
 

Similaire à Framing quality indicators for multilingual repositories of Open Educational Resources (20)

Open Educational Resources for less used languages in an increasingly digital...
Open Educational Resources for less used languages in an increasingly digital...Open Educational Resources for less used languages in an increasingly digital...
Open Educational Resources for less used languages in an increasingly digital...
 
Teaching and learning less used languages through OER and OEP, LINQ Conferenc...
Teaching and learning less used languages through OER and OEP, LINQ Conferenc...Teaching and learning less used languages through OER and OEP, LINQ Conferenc...
Teaching and learning less used languages through OER and OEP, LINQ Conferenc...
 
OER: insights into a multilingual landscape
OER: insights into a multilingual landscapeOER: insights into a multilingual landscape
OER: insights into a multilingual landscape
 
ICMl conference, Belgrade 2015
ICMl conference, Belgrade 2015ICMl conference, Belgrade 2015
ICMl conference, Belgrade 2015
 
OER: insights into a multilingual landscape - EUROCALL 2014 conference
OER: insights into a multilingual landscape - EUROCALL 2014 conference  OER: insights into a multilingual landscape - EUROCALL 2014 conference
OER: insights into a multilingual landscape - EUROCALL 2014 conference
 
Nordic OER
Nordic OERNordic OER
Nordic OER
 
Nordic OER by Alastair Creelman
Nordic OER by Alastair CreelmanNordic OER by Alastair Creelman
Nordic OER by Alastair Creelman
 
EmpOERing students and academics through large-scale open content initiatives
EmpOERing students and academics through large-scale open content initiatives EmpOERing students and academics through large-scale open content initiatives
EmpOERing students and academics through large-scale open content initiatives
 
How can OER enhance the position of less used languages on a global scale?
How can OER enhance the position of less used languages on a global scale?How can OER enhance the position of less used languages on a global scale?
How can OER enhance the position of less used languages on a global scale?
 
Workshop on OER and less used languages
Workshop on OER and less used languagesWorkshop on OER and less used languages
Workshop on OER and less used languages
 
REFLESS project top-level conference: Waldemar Martyniuk, Council of Europe's...
REFLESS project top-level conference: Waldemar Martyniuk, Council of Europe's...REFLESS project top-level conference: Waldemar Martyniuk, Council of Europe's...
REFLESS project top-level conference: Waldemar Martyniuk, Council of Europe's...
 
An Introduction to Open Educational Resources
An Introduction to Open Educational ResourcesAn Introduction to Open Educational Resources
An Introduction to Open Educational Resources
 
ukas Bleichenbacher & Richard Rossner: Towards a Common European Framework fo...
ukas Bleichenbacher & Richard Rossner: Towards a Common European Framework fo...ukas Bleichenbacher & Richard Rossner: Towards a Common European Framework fo...
ukas Bleichenbacher & Richard Rossner: Towards a Common European Framework fo...
 
Cambrigde language plaza_2011
Cambrigde language plaza_2011Cambrigde language plaza_2011
Cambrigde language plaza_2011
 
Accessibility of OERs for Diverse Learners and Guidelines for Dyslexia in Mod...
Accessibility of OERs for Diverse Learners and Guidelines for Dyslexia in Mod...Accessibility of OERs for Diverse Learners and Guidelines for Dyslexia in Mod...
Accessibility of OERs for Diverse Learners and Guidelines for Dyslexia in Mod...
 
Language learning and teaching in multilingual classrooms
Language learning and teaching in multilingual classroomsLanguage learning and teaching in multilingual classrooms
Language learning and teaching in multilingual classrooms
 
Eurocall SpeakApps Presentation - Open Educational Resources and the CEFR
Eurocall SpeakApps Presentation - Open Educational Resources and the CEFREurocall SpeakApps Presentation - Open Educational Resources and the CEFR
Eurocall SpeakApps Presentation - Open Educational Resources and the CEFR
 
How to Implement OER in an Accessible User-friendly Way
How to Implement OER in an Accessible User-friendly WayHow to Implement OER in an Accessible User-friendly Way
How to Implement OER in an Accessible User-friendly Way
 
REFLESS project - About LLAS
REFLESS project - About LLASREFLESS project - About LLAS
REFLESS project - About LLAS
 
Building a European learning analytics community
Building a European learning analytics communityBuilding a European learning analytics community
Building a European learning analytics community
 

Plus de LangOER

Slotsesje Fryske MOOC
Slotsesje Fryske MOOCSlotsesje Fryske MOOC
Slotsesje Fryske MOOCLangOER
 
Re-visiting the pedagogy of the languages of minority communities - Frisian MOOC
Re-visiting the pedagogy of the languages of minority communities - Frisian MOOCRe-visiting the pedagogy of the languages of minority communities - Frisian MOOC
Re-visiting the pedagogy of the languages of minority communities - Frisian MOOCLangOER
 
The problem of using Open Educational Resources in the Lithuanian language as...
The problem of using Open Educational Resources in the Lithuanian language as...The problem of using Open Educational Resources in the Lithuanian language as...
The problem of using Open Educational Resources in the Lithuanian language as...LangOER
 
eTwinning Conference 2016: Essentials for creating your own Open Educational ...
eTwinning Conference 2016: Essentials for creating your own Open Educational ...eTwinning Conference 2016: Essentials for creating your own Open Educational ...
eTwinning Conference 2016: Essentials for creating your own Open Educational ...LangOER
 
Highlights from open discussion on educators’ involvement
Highlights from open discussion on educators’ involvementHighlights from open discussion on educators’ involvement
Highlights from open discussion on educators’ involvementLangOER
 
Results of session – EdReNe
Results of session – EdReNeResults of session – EdReNe
Results of session – EdReNeLangOER
 
The future of credentials for learning outcomes with OER and MOOCs
The future of credentials for learning outcomes with OER and MOOCsThe future of credentials for learning outcomes with OER and MOOCs
The future of credentials for learning outcomes with OER and MOOCsLangOER
 
The OER World Map as a tool to speed up the development of the European OER m...
The OER World Map as a tool to speed up the development of the European OER m...The OER World Map as a tool to speed up the development of the European OER m...
The OER World Map as a tool to speed up the development of the European OER m...LangOER
 
The Case Study of the MOOC #Deu4Arab: A Practical Pronunciation Training for ...
The Case Study of the MOOC #Deu4Arab: A Practical Pronunciation Training for ...The Case Study of the MOOC #Deu4Arab: A Practical Pronunciation Training for ...
The Case Study of the MOOC #Deu4Arab: A Practical Pronunciation Training for ...LangOER
 
Creating communities in MOOCs “Safe bubbles in a sea of openness”
Creating communities in MOOCs “Safe bubbles in a sea of openness”Creating communities in MOOCs “Safe bubbles in a sea of openness”
Creating communities in MOOCs “Safe bubbles in a sea of openness”LangOER
 
Reform of the Danish public school
Reform of the Danish public schoolReform of the Danish public school
Reform of the Danish public schoolLangOER
 
LRE Directory of OER Repositories
LRE Directory of OER RepositoriesLRE Directory of OER Repositories
LRE Directory of OER RepositoriesLangOER
 
Update on the Jewish Heritage Network
Update on the Jewish Heritage NetworkUpdate on the Jewish Heritage Network
Update on the Jewish Heritage NetworkLangOER
 
The Basque language in education: from mono to multilingualism
The Basque language in education: from mono to multilingualismThe Basque language in education: from mono to multilingualism
The Basque language in education: from mono to multilingualismLangOER
 
Sami Languages in Education: Comparative Case Study of Finland and Sweden
Sami Languages in Education: Comparative Case Study of Finland and SwedenSami Languages in Education: Comparative Case Study of Finland and Sweden
Sami Languages in Education: Comparative Case Study of Finland and SwedenLangOER
 
The Greek speaking Minority Education in Istanbul: how open is it?
The Greek speaking Minority Education in Istanbul: how open is it?The Greek speaking Minority Education in Istanbul: how open is it?
The Greek speaking Minority Education in Istanbul: how open is it?LangOER
 
Teaching regional or minority languages in Slovakia
Teaching regional or minority languages in SlovakiaTeaching regional or minority languages in Slovakia
Teaching regional or minority languages in SlovakiaLangOER
 

Plus de LangOER (17)

Slotsesje Fryske MOOC
Slotsesje Fryske MOOCSlotsesje Fryske MOOC
Slotsesje Fryske MOOC
 
Re-visiting the pedagogy of the languages of minority communities - Frisian MOOC
Re-visiting the pedagogy of the languages of minority communities - Frisian MOOCRe-visiting the pedagogy of the languages of minority communities - Frisian MOOC
Re-visiting the pedagogy of the languages of minority communities - Frisian MOOC
 
The problem of using Open Educational Resources in the Lithuanian language as...
The problem of using Open Educational Resources in the Lithuanian language as...The problem of using Open Educational Resources in the Lithuanian language as...
The problem of using Open Educational Resources in the Lithuanian language as...
 
eTwinning Conference 2016: Essentials for creating your own Open Educational ...
eTwinning Conference 2016: Essentials for creating your own Open Educational ...eTwinning Conference 2016: Essentials for creating your own Open Educational ...
eTwinning Conference 2016: Essentials for creating your own Open Educational ...
 
Highlights from open discussion on educators’ involvement
Highlights from open discussion on educators’ involvementHighlights from open discussion on educators’ involvement
Highlights from open discussion on educators’ involvement
 
Results of session – EdReNe
Results of session – EdReNeResults of session – EdReNe
Results of session – EdReNe
 
The future of credentials for learning outcomes with OER and MOOCs
The future of credentials for learning outcomes with OER and MOOCsThe future of credentials for learning outcomes with OER and MOOCs
The future of credentials for learning outcomes with OER and MOOCs
 
The OER World Map as a tool to speed up the development of the European OER m...
The OER World Map as a tool to speed up the development of the European OER m...The OER World Map as a tool to speed up the development of the European OER m...
The OER World Map as a tool to speed up the development of the European OER m...
 
The Case Study of the MOOC #Deu4Arab: A Practical Pronunciation Training for ...
The Case Study of the MOOC #Deu4Arab: A Practical Pronunciation Training for ...The Case Study of the MOOC #Deu4Arab: A Practical Pronunciation Training for ...
The Case Study of the MOOC #Deu4Arab: A Practical Pronunciation Training for ...
 
Creating communities in MOOCs “Safe bubbles in a sea of openness”
Creating communities in MOOCs “Safe bubbles in a sea of openness”Creating communities in MOOCs “Safe bubbles in a sea of openness”
Creating communities in MOOCs “Safe bubbles in a sea of openness”
 
Reform of the Danish public school
Reform of the Danish public schoolReform of the Danish public school
Reform of the Danish public school
 
LRE Directory of OER Repositories
LRE Directory of OER RepositoriesLRE Directory of OER Repositories
LRE Directory of OER Repositories
 
Update on the Jewish Heritage Network
Update on the Jewish Heritage NetworkUpdate on the Jewish Heritage Network
Update on the Jewish Heritage Network
 
The Basque language in education: from mono to multilingualism
The Basque language in education: from mono to multilingualismThe Basque language in education: from mono to multilingualism
The Basque language in education: from mono to multilingualism
 
Sami Languages in Education: Comparative Case Study of Finland and Sweden
Sami Languages in Education: Comparative Case Study of Finland and SwedenSami Languages in Education: Comparative Case Study of Finland and Sweden
Sami Languages in Education: Comparative Case Study of Finland and Sweden
 
The Greek speaking Minority Education in Istanbul: how open is it?
The Greek speaking Minority Education in Istanbul: how open is it?The Greek speaking Minority Education in Istanbul: how open is it?
The Greek speaking Minority Education in Istanbul: how open is it?
 
Teaching regional or minority languages in Slovakia
Teaching regional or minority languages in SlovakiaTeaching regional or minority languages in Slovakia
Teaching regional or minority languages in Slovakia
 

Dernier

Congestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentationCongestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentationdeepaannamalai16
 
BIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptx
BIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptxBIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptx
BIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptxSayali Powar
 
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITWQ-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITWQuiz Club NITW
 
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...DhatriParmar
 
Man or Manufactured_ Redefining Humanity Through Biopunk Narratives.pptx
Man or Manufactured_ Redefining Humanity Through Biopunk Narratives.pptxMan or Manufactured_ Redefining Humanity Through Biopunk Narratives.pptx
Man or Manufactured_ Redefining Humanity Through Biopunk Narratives.pptxDhatriParmar
 
ESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnv
ESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnvESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnv
ESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnvRicaMaeCastro1
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)lakshayb543
 
4.11.24 Poverty and Inequality in America.pptx
4.11.24 Poverty and Inequality in America.pptx4.11.24 Poverty and Inequality in America.pptx
4.11.24 Poverty and Inequality in America.pptxmary850239
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmStan Meyer
 
ClimART Action | eTwinning Project
ClimART Action    |    eTwinning ProjectClimART Action    |    eTwinning Project
ClimART Action | eTwinning Projectjordimapav
 
How to Fix XML SyntaxError in Odoo the 17
How to Fix XML SyntaxError in Odoo the 17How to Fix XML SyntaxError in Odoo the 17
How to Fix XML SyntaxError in Odoo the 17Celine George
 
Mythology Quiz-4th April 2024, Quiz Club NITW
Mythology Quiz-4th April 2024, Quiz Club NITWMythology Quiz-4th April 2024, Quiz Club NITW
Mythology Quiz-4th April 2024, Quiz Club NITWQuiz Club NITW
 
Team Lead Succeed – Helping you and your team achieve high-performance teamwo...
Team Lead Succeed – Helping you and your team achieve high-performance teamwo...Team Lead Succeed – Helping you and your team achieve high-performance teamwo...
Team Lead Succeed – Helping you and your team achieve high-performance teamwo...Association for Project Management
 
4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptxmary850239
 
Measures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataMeasures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataBabyAnnMotar
 
Expanded definition: technical and operational
Expanded definition: technical and operationalExpanded definition: technical and operational
Expanded definition: technical and operationalssuser3e220a
 
Textual Evidence in Reading and Writing of SHS
Textual Evidence in Reading and Writing of SHSTextual Evidence in Reading and Writing of SHS
Textual Evidence in Reading and Writing of SHSMae Pangan
 
DIFFERENT BASKETRY IN THE PHILIPPINES PPT.pptx
DIFFERENT BASKETRY IN THE PHILIPPINES PPT.pptxDIFFERENT BASKETRY IN THE PHILIPPINES PPT.pptx
DIFFERENT BASKETRY IN THE PHILIPPINES PPT.pptxMichelleTuguinay1
 

Dernier (20)

INCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptx
INCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptxINCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptx
INCLUSIVE EDUCATION PRACTICES FOR TEACHERS AND TRAINERS.pptx
 
Congestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentationCongestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentation
 
BIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptx
BIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptxBIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptx
BIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptx
 
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITWQ-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
 
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
 
Man or Manufactured_ Redefining Humanity Through Biopunk Narratives.pptx
Man or Manufactured_ Redefining Humanity Through Biopunk Narratives.pptxMan or Manufactured_ Redefining Humanity Through Biopunk Narratives.pptx
Man or Manufactured_ Redefining Humanity Through Biopunk Narratives.pptx
 
ESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnv
ESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnvESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnv
ESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnv
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
 
4.11.24 Poverty and Inequality in America.pptx
4.11.24 Poverty and Inequality in America.pptx4.11.24 Poverty and Inequality in America.pptx
4.11.24 Poverty and Inequality in America.pptx
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and Film
 
Paradigm shift in nursing research by RS MEHTA
Paradigm shift in nursing research by RS MEHTAParadigm shift in nursing research by RS MEHTA
Paradigm shift in nursing research by RS MEHTA
 
ClimART Action | eTwinning Project
ClimART Action    |    eTwinning ProjectClimART Action    |    eTwinning Project
ClimART Action | eTwinning Project
 
How to Fix XML SyntaxError in Odoo the 17
How to Fix XML SyntaxError in Odoo the 17How to Fix XML SyntaxError in Odoo the 17
How to Fix XML SyntaxError in Odoo the 17
 
Mythology Quiz-4th April 2024, Quiz Club NITW
Mythology Quiz-4th April 2024, Quiz Club NITWMythology Quiz-4th April 2024, Quiz Club NITW
Mythology Quiz-4th April 2024, Quiz Club NITW
 
Team Lead Succeed – Helping you and your team achieve high-performance teamwo...
Team Lead Succeed – Helping you and your team achieve high-performance teamwo...Team Lead Succeed – Helping you and your team achieve high-performance teamwo...
Team Lead Succeed – Helping you and your team achieve high-performance teamwo...
 
4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx
 
Measures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped dataMeasures of Position DECILES for ungrouped data
Measures of Position DECILES for ungrouped data
 
Expanded definition: technical and operational
Expanded definition: technical and operationalExpanded definition: technical and operational
Expanded definition: technical and operational
 
Textual Evidence in Reading and Writing of SHS
Textual Evidence in Reading and Writing of SHSTextual Evidence in Reading and Writing of SHS
Textual Evidence in Reading and Writing of SHS
 
DIFFERENT BASKETRY IN THE PHILIPPINES PPT.pptx
DIFFERENT BASKETRY IN THE PHILIPPINES PPT.pptxDIFFERENT BASKETRY IN THE PHILIPPINES PPT.pptx
DIFFERENT BASKETRY IN THE PHILIPPINES PPT.pptx
 

Framing quality indicators for multilingual repositories of Open Educational Resources

  • 1. Framing quality indicators for multilingual repositories of Open Educational Resources – The LangOER European network EFQUEL Innovation Forum and International LINQ Conference 9 May, Crete Sylvi Vigmo Linda Bradley Anne-Christin Tannhäuser Katerina Zourou This project was financed with the support of the European Commission. This publication is the sole responsibility of the author and the Commission is not responsible for any use that may be made of the information contained therein.
  • 2. About the LangOER network – Fryske Academy, The Netherlands – Web2learn, Greece – European Schoolnet, Belgium – University of Gothenburg, Sweden – Jan Dlugosz University, Poland – Mykolas Romeris University, Lithuania – International Council for Open and Distance Education, Norway – European Foundation for Quality in E- learning, Belgium – Rezekne Higher Education Institution, Latvia European funded network (2014-2016), 9 partners: Co-ufunded by the Commission (LLP programme, KA2 action)
  • 3. Strands of activities •State-of-the art of OER in less used languages •International policy makers capacity building •Teacher training •Regional and minority languages & OER •Challenges for language learning •Mainstream good practice at European policy making level
  • 4. Scope of the LangOER project •Enhance the linguistic and cultural components of OER •Foster sustainability through OER reuse •Address needs of policy makers and educators •Raise awareness of risk of exclusion of less used languages from the OER landscape •Offer training to educators of less used languages, face-to-face and online •Embrace stakeholders of regional and minority languages in remotely located areas of Europe to gain knowledge, develop skills
  • 5. Three main questions • How can less used languages, including Regional and Minority languages, benefit from Open Educational Practices (OEP)? • How can Open Educational Resources (OER) be shaped to foster linguistic and cultural diversity in Europe? • What policies are favourable to the uptake of quality OER in less used language communities?
  • 6. Set-up of today’s workshop • Key quality indicators of repositories of OER • Current situation in multilingual repositories of OER • LangOER project state-of-the-art results • Discussion: – Examples of multilingual repositories – quality indicators of multilingual repositories
  • 7. Keywords from UNESCO’s definition Definition of OER •teaching, learning and research materials •in the public domain •released under an open license •no-cost access •possible to adapt and redistribute •with no or limited restrictions UNESCO, 2012, Paris OER Declaration
  • 8. QUALITY INDICATORS FOR OER REPOSITORIES
  • 9. Atenas, J. & Havemann, L. (2013). Quality Assurance in the Open: An Evaluation of OER Repositories. INNOQUAL - International Journal for Innovation and Quality in Learning , 1 (2). pp. 22-34. Our Source @jatenas @leohavemann
  • 17. Zooming in on some indicators • Multilingual support • Social media support • Peer review • User evaluation tools
  • 18. State-of-the-art investigaton method Method •Online investigation and input from the 7 partner languages; Dutch, Frisian, Greek, Latvian, Lithuanian, Polish, Swedish, as well as from Danish, Estonian, Finnish, French, Hungarian, Icelandic, Italian, Norwegian, German, Romanian – Local and national OER & OER communities – Status of OER •Survey from experts in the field concerning awareness of studies on repositories of OER: – From a linguistic perspective – Of less used languages – Multilingual resources
  • 19. State-of-the-art investigaton results 1 • Lacking common ground – interpretation too open • Licensing less explicit • OER linked to ”open learning” and ”accessibility” http://www.narcis.nl
  • 20. State-of-the-art investigaton results 2 • Diversified picture Languages with considerable OER resources –Active and vibrant; state-supported or grass-root initiatives Languages with few or any OER resources –Restrictions in copyright –Dependent on international initiatives –Not really OER: rather ABOUT OER • For enthusiasts, relatively unknown to the majority of teachers and learners • Restricted innovative scope of OER and language use Swedish OER repository lektion.se
  • 21. Interaction: exploring OER repositories • Lemill http://lemill.net/ “Web community for finding, authoring and sharing learning resources for school teachers • 70206 learning resources in 87 languages • Varying content Type and number of Activities:
  • 22. Interaction: Screenshots from Lemill With an acount, anyone can edit: Example of the most common type ”Web pages”:
  • 23. Interaction: Interactive activity • Have a look at the OER example from Lemill http://lemill.net • Discuss the quality aspects on this repository • Benefits and drawbacks on this repository? • What would be specific from a less-used-language perspective?
  • 24. Interaction: Summing up • Discussion of findings •Quality concerns in OER repositories for less used languages: •How can less used languages, including Regional and Minority languages, benefit from Open Educational Practices (OEP)? •How can Open Educational Resources (OER) be shaped to foster linguistic and cultural diversity in Europe?
  • 25. •June 2014: Working policy paper by ICDE and LangOER team on policy challenges and opportunities for less used languages on a national and international level •June 2014 webinar: ”The current picture of OER for less used languages” •Teacher training activities in GR, LV, LT, PL, SE, NO in autumn 2014 and possibly also remotely through EUN’s European Schoolnet Current and future activities
  • 26. Staying in touch http://langoer.eun.org/ #langOER LangOER OER and languages OER and languages LangOER teachers’ group (in preparation)