SlideShare une entreprise Scribd logo
1  sur  35
International benchmarking.
The first dual mode distance
 learning benchmarking club
Who are we…

                              Ebba Ossiannilsson
                              Lund University, SE




                                           Margareta Hellström
                                           KTH, SE
                             Paul Bacsich
                             Matic Media Ltd. UK




                                        Andreas Hedrén
                                        Gotland University, SE

Ossiannilsson et al. / NGL2012Falun /
Learning environment




Ossiannilsson et al. / NGL2012Falun /
Learning environment




                                        Steve Wheeler, University of Plymouth,
                                        2010
               http://www.flickr.co
               m/photos/luc/
Ossiannilsson et al. / NGL2012Falun /
Ossiannilsson et al. / NGL2012Falun /
“We are currently preparing students for jobs
 that don’t yet exist… Using technologies that
 haven’t been invented… In order to solve
 problems we don’t even know are problems
 yet.”
 (Source: Fish & McLeod, Shift Happens, Wikispaces.com)




                              Foto: Anders Olsson, Lnu
Ossiannilsson et al. / NGL2012Falun /
New and emerging technologies...




                                                                        Steve Wheeler, University of Plymouth, 2011
                                        http://www.weirdthings.org.uk


...are often met with opposition.
Ossiannilsson et al. / NGL2012Falun /
Benchmarking, some definitions
                                         Benchmarking is an exemplar-driven teleological process
                                         operating within an organization [sic] with the objective of
                                         intentionally changing an existing state of affairs into
                                         a superior state of affairs. (Moriarty, 2008, p. 30).

…the ´locus´ of benchmarking lies
between the current and desirable
states of affairs and contributes to the
transformation processes that realise
these improvements. (Moriarty and
Smallman, 2009, p. 484)
...is a
technique, method, process, activity, incentive, or
reward which conventional wisdom regards as
more effective at delivering a particular outcome
than any other technique, method, process, etc.
when applied to a particular condition or
circumstance

 Ossiannilsson et al. / NGL2012Falun /
Self evaluation for quality enhancement




                                          benchmark-careers.co


  Ossiannilsson et al. / NGL2012Falun /
The Benhmarking process
                                                       Determine
                                                         what to
                                                       benchmark




                                                                              Form a
                                Take action                                benchmarking
                                                                               team




                                         Collect and
                                                                      Identify
                                           analyse
                                                                   benchmarking
                                        benchmarking
                                                                     partners
                                         information




                      Ossiannilsson, E. (2011). Findings from European
                      benchmarking exercises on e-learning: value and
                      impact. CreativeEducation.2(3):208-219.

Ossiannilsson et al. / NGL2012Falun /
Benefits and values
                   self-assess institution   respond to national performance indicators
                                             and benchmarks

                                                                strengthen institutional identity
better understand the process
                                                                                  enhance reputation
                   measure and compare
                                                                set new standards for the sector

discover new ideas,
                                                                      set targets for improvement



obtain data to support decision-making


                                                   van Vught et al., (2008). A practical guide.
                                                   Benchmarking in European HE. ESMU
    Ossiannilsson et al. / NGL2012Falun /
Limitations
 Time?


      Commitment?


Benchmarks?


     Interpretations?


Language?


     Who is involved?



  Ossiannilsson et al. / NGL2012Falun /
The First dual-mode distance
benchmarking club, partners

 •   UK        University of Leicester (lead),
 •   UK        University of Liverpool,
 •   Australia University of Southern Queensland
 •   New Zeeland Massey University
 •   Canada    Thompson Rivers University
 •   Sweden    Lund University
 •   Sweden    KTH

 • Gotland University was not in the club, but did the
   benchmarking with Pick&Mix
Ossiannilsson et al. / NGL2012Falun /
Pick&Mix
The Pick&Mix; the iterative self-review process with use
of expert moderators
• Encourages a more senior level of participation from
  the institution: the result is “theirs”, not the moderators
• Get comfortable over time with the criteria as they
  apply to their institution
• Helps them move directly to implementation of change
• Selects against complex methodologies – not an
  issue with Pick&Mix as it is simple (compared with
  others)
• Requires more effort from moderators (Bacsich, 2011)


Ossiannilsson et al. / NGL2012Falun /
Critical success factors

                                                               • 22 Leadership in e-Learning
Code         Criterion name
                                                               • 29    Management Style
•   04       Usability
                                                               • 35    Relationship Management
•   06       eLearning strategy
                                                                 Upwards
•   07       Decisions on Projects
                                                               • 53    Reliability
•   10       Training
                                                               • 58    Market Research
•   12       Costs
                                                               • 60    Security
•   13       Planning Annually
                                                               • 91    Student Understanding of
•   16       Technical Support to Staff                          System
•   19       Decisions on Programmes                           • 92    Student Help Desk
                                                               • 94    Student Satisfaction

06d   Distance Learning   Regularly updated Distance Learning Strategy, integrated with
      Strategy            Learning and Teaching Strategy and all related strategies (e.g.
                          e-Learning, if relevant).

Ossiannilsson et al. / NGL2012Falun /
Ossiannilsson et al. / NGL2012Falun /
Meetings and process

Meeting                    Aims of meeting
• Initial meeting           Initial collection of evidence,
                            and selection of supplementary
                            criteria
• Mid-process meeting       Further collection of evidence
• Scoring rehearsal meeting Final tweaks on and chasing of
                             evidence
• Scoring meeting            xxx

• Reflection meeting                    To move to change




Ossiannilsson et al. / NGL2012Falun /
Roadmap…




Ossiannilsson et al. / NGL2012Falun /
The First dual-mode distance
                       benchmarking club
  Tasks for Lund University, SE
• benchmark, in accordance with the detailed
  criteria
• consider the already defined and/or suggest
  any other critical success factors
• based on experience and results from
  EADTU's
   E-xcellence+ and ESMU's ELBE correlate
  Pick&Mix with those

Ossiannilsson et al. / NGL2012Falun /
Benchmarking projects conducted
                   by Lund University, SE

• The Swedish National Agency of Higher Education,
  ELQ


• EADTU, E-xcellence+



• ESMU, Benchmarking eLearning exercise 2009

• The First dual-mode distance learning benchmarking
  club (Concordance)
Ossiannilsson et al. / NGL2012Falun /
The Excellence project by the European Association o
                Distance Teaching Universities, EADTU




Products   Services




   Management
                              http://www.eadtu.nl/e-xcellencelabel



 Ossiannilsson et al. / NGL2012Falun /
Ossiannilsson et al. / NGL2012Falun /
Ossiannilsson et al. / NGL2012Falun /
©Ossiannilsson & Landgren, 2011

Ossiannilsson et al. / NGL2012Falun /
KTH 1…
Ask each of the respondents to value
each criterion not only on level 1- 6 but
also do this for 4 different organizational
levels
• Individual/or course level
• Departmental level
• “School “level
• Institutional /or “KTH” level.

Ossiannilsson et al. / NGL2012Falun /
KTH 2…
• Illuminated “islands” with very advanced and high
  quality distance e-learning existed. Internal
  information about their work was not reaching outside
  their group.
• At the same time “dark corners” that had not even
  thought of the possibility to use new technologies to
  enhance their student’s learning or to try blended
  learning models for more flexibility were found.
• KTH could learn from studying successful e-learning
  initiatives within its organization from departments
  that have worked for years in different online initiatives
  and to develop blended learning models.
• Reports but also as a seminar series, were the
  results could be discussed and good examples
  disseminated locally.
Ossiannilsson et al. / NGL2012Falun /
KTH 3…
            Eighteen (18) new core criteria were
            chosen and grouped in the following
            areas:
            Student involvement

            Educational/Pedagogical anchoring

            Staff recognition and reward

            Open Educational Resources

Ossiannilsson et al. / NGL2012Falun /
Gotland University
         • Find suggestions on how to strengthen the
           institution’s e-learning.
         • The Pick&Mix method was the expected possibility
           to relatively quickly, with a relatively small effort,
           without access to own experts in e-learning get a
           good view and understanding of the current
           state of the institution’s e-learning.
         • Give results that would be straight forward to use
           to find suggestions on what aspects of the
           institutions e-learning to address and what to do in
           order to improve.
         • A key aspect that was found appealing when
           making the decision to use Pick&Mix was the
           easily understood and concrete (critical)
           success factors
Ossiannilsson et al. / NGL2012Falun /
Gotland University 2

            • Gotland University had a few
              specific issues that needed to
              be addressed for locally
              specific reasons.
            • The nature of these issues
              differed from the benchmarking
              success factors so these
              issues were addressed in
              parallel but separately.
Ossiannilsson et al. / NGL2012Falun /
Gotland University 3…

• In a few cases …not straight forward to identify the
  University’s score for the success factors. This was mostly
  from institution internal reasons. The effect of this was that the
  benchmarking exercise made it clear that there was interesting
  information that was not easily accessible at the institution.
• The use of Pick&Mix…relatively straight forward and very useful
  and easy to use the output from the method to suggest
  changes to achieve improvements
• Identify the state of it’s e-learning on a somewhat absolute
  scale and to identify what aspects and areas of it’s e-learning
  that needs most improvement and also what measures is needed
  to achieve the identified improvements


Ossiannilsson et al. / NGL2012Falun /
Three key conclusions from the
benchmarking exercise were that…

1. Only Thompson Rivers University has any strong
expertise in market research for e-learning, not only in
the Club but out of all the institutions benchmarked with
Pick&Mix

2. No institution has strong competence in costing e-
learning

3. Staff reward and recognition for e-learning is not
adequate anywhere.

Ossiannilsson et al. / NGL2012Falun /
Conclusion on methodology and
                benchmarking outcomes 1
• The political message is that such clubs are
  useful and that one could be easily set up in
  the Scando-Baltic region

• Issues raised above could be handled by
  different wording appropriate to the national
  languages and cultures within a common
  conceptual scheme for example as developed
  by Lund University.


Ossiannilsson et al. / NGL2012Falun /
Conclusion on methodology and
                benchmarking outcomes 2
• Co-operations like the distance learning benchmarking club can
  play a role on an inter-institutional level, both nationally and
  internationally, in the absence of any national level governing.

• Through co-operations like the distance learning benchmarking
  club institutions could network, share knowledge, increase
  their competence and strengthen their e-learning.

• The dissemination of Pick&Mix through the work pursued within
  the club has created a knowledge foundation that can be
  taken further to both be used within the institutions of the
  club and also to involve more institutions.


Ossiannilsson et al. / NGL2012Falun /
The door is
                                                              open …

                                                              What next?




   Ossiannilsson et al. / NGL2012Falun /
                                              TIIM2011_ Oulu_Ebba
Bild: Wikimedia Commons, Push the button, CC BY SA
Ebba Ossiannilsson, Paul Bacsish, Margareta Hellström, Andreas
                Hedrén




                                               Footprints
                                               Ebba.Ossiannilsson@ced.lu.se
                                               Ebba.Ossiannilsson@oulu.fi

                                               Paul Bacsich (Matic Media Ltd)
                                               paul@matic-media.co.uk

                                               Margareta Hellström
                                               mhel@kth.se

                                               Andreas Hedrén
                                               andreas.hedren@hgo.se
Ossiannilsson et al. / NGL2012Falun /

Contenu connexe

En vedette

04 analytic conceit_or_operational_necessity_deanz
04 analytic conceit_or_operational_necessity_deanz04 analytic conceit_or_operational_necessity_deanz
04 analytic conceit_or_operational_necessity_deanz
VISCED
 
02 benchmarking for_virtual_schools_mods
02 benchmarking for_virtual_schools_mods02 benchmarking for_virtual_schools_mods
02 benchmarking for_virtual_schools_mods
VISCED
 
Benchmarking
BenchmarkingBenchmarking
Benchmarking
slayerxor
 
Seminar on polymorphism
Seminar on polymorphismSeminar on polymorphism
Seminar on polymorphism
023henil
 

En vedette (20)

08 virtual schooling_and_the_future_of_education
08 virtual schooling_and_the_future_of_education08 virtual schooling_and_the_future_of_education
08 virtual schooling_and_the_future_of_education
 
13 the use_of_media_in_virtual_schooling
13 the use_of_media_in_virtual_schooling13 the use_of_media_in_virtual_schooling
13 the use_of_media_in_virtual_schooling
 
04 analytic conceit_or_operational_necessity_deanz
04 analytic conceit_or_operational_necessity_deanz04 analytic conceit_or_operational_necessity_deanz
04 analytic conceit_or_operational_necessity_deanz
 
02 benchmarking for_virtual_schools_mods
02 benchmarking for_virtual_schools_mods02 benchmarking for_virtual_schools_mods
02 benchmarking for_virtual_schools_mods
 
10 results as_we_near_the_end
10 results as_we_near_the_end10 results as_we_near_the_end
10 results as_we_near_the_end
 
12 european virtual_schools_innovative_practice
12 european virtual_schools_innovative_practice12 european virtual_schools_innovative_practice
12 european virtual_schools_innovative_practice
 
09 virtual schooling_in_europe_alt
09 virtual schooling_in_europe_alt09 virtual schooling_in_europe_alt
09 virtual schooling_in_europe_alt
 
11 eden looking_for_success_factors
11 eden looking_for_success_factors11 eden looking_for_success_factors
11 eden looking_for_success_factors
 
07 the different_news_from_visced_eden
07 the different_news_from_visced_eden07 the different_news_from_visced_eden
07 the different_news_from_visced_eden
 
"Benchmarking & Innovation-How Benchmarking can Support the development of a ...
"Benchmarking & Innovation-How Benchmarking can Support the development of a ..."Benchmarking & Innovation-How Benchmarking can Support the development of a ...
"Benchmarking & Innovation-How Benchmarking can Support the development of a ...
 
Open Source Pharma: Game changing for innovative medicine
Open Source Pharma: Game changing for innovative medicineOpen Source Pharma: Game changing for innovative medicine
Open Source Pharma: Game changing for innovative medicine
 
Innovation Drives Profit: Why it matters and how to do it
Innovation Drives Profit: Why it matters and how to do itInnovation Drives Profit: Why it matters and how to do it
Innovation Drives Profit: Why it matters and how to do it
 
Sarah Fisher (Johnson & Johnson) - The innovation execution gap
Sarah Fisher (Johnson & Johnson) - The innovation execution gapSarah Fisher (Johnson & Johnson) - The innovation execution gap
Sarah Fisher (Johnson & Johnson) - The innovation execution gap
 
Innovation in pharma - Challenges and Opportunities - 3 May 2016
Innovation in pharma - Challenges and Opportunities - 3 May 2016Innovation in pharma - Challenges and Opportunities - 3 May 2016
Innovation in pharma - Challenges and Opportunities - 3 May 2016
 
Catalysing Innovation in Pharma IT: Keeping AstraZeneca Ahead of Disruptive T...
Catalysing Innovation in Pharma IT: Keeping AstraZeneca Ahead of Disruptive T...Catalysing Innovation in Pharma IT: Keeping AstraZeneca Ahead of Disruptive T...
Catalysing Innovation in Pharma IT: Keeping AstraZeneca Ahead of Disruptive T...
 
Best practices for pharmaceutical training seminars and employee engagement
Best practices for pharmaceutical training seminars and employee engagementBest practices for pharmaceutical training seminars and employee engagement
Best practices for pharmaceutical training seminars and employee engagement
 
Artificial Intelligence, Predictive Modelling and Chatbots: Applications in P...
Artificial Intelligence, Predictive Modelling and Chatbots: Applications in P...Artificial Intelligence, Predictive Modelling and Chatbots: Applications in P...
Artificial Intelligence, Predictive Modelling and Chatbots: Applications in P...
 
Benchmarking
BenchmarkingBenchmarking
Benchmarking
 
Benchmarking
BenchmarkingBenchmarking
Benchmarking
 
Seminar on polymorphism
Seminar on polymorphismSeminar on polymorphism
Seminar on polymorphism
 

Similaire à 03 ngl international_benchmarking

Preparing for an inter-institutional Benchmarking activity using the ACODE Be...
Preparing for an inter-institutional Benchmarking activity using the ACODE Be...Preparing for an inter-institutional Benchmarking activity using the ACODE Be...
Preparing for an inter-institutional Benchmarking activity using the ACODE Be...
Charles Darwin University
 
NTLT 2012 Peter Coolbear Keynote Presentation to Conference
NTLT 2012 Peter Coolbear Keynote Presentation to ConferenceNTLT 2012 Peter Coolbear Keynote Presentation to Conference
NTLT 2012 Peter Coolbear Keynote Presentation to Conference
NTLT Conference
 
Sequent e xcellence gu-eo_vilnius
Sequent e xcellence gu-eo_vilniusSequent e xcellence gu-eo_vilnius
Sequent e xcellence gu-eo_vilnius
Ebba Ossiannilsson
 

Similaire à 03 ngl international_benchmarking (20)

Quality enhancement ltu2014 intropresentation 140929
Quality enhancement ltu2014 intropresentation 140929Quality enhancement ltu2014 intropresentation 140929
Quality enhancement ltu2014 intropresentation 140929
 
Ossiannilsson tiim2011
Ossiannilsson tiim2011Ossiannilsson tiim2011
Ossiannilsson tiim2011
 
Oer a question of quality ossiannilsson130219
Oer a question of quality ossiannilsson130219Oer a question of quality ossiannilsson130219
Oer a question of quality ossiannilsson130219
 
Ossiannilsson TIIM2011, 29/06/2011
Ossiannilsson TIIM2011, 29/06/2011Ossiannilsson TIIM2011, 29/06/2011
Ossiannilsson TIIM2011, 29/06/2011
 
Ossiannilsson TIIM2011
Ossiannilsson TIIM2011Ossiannilsson TIIM2011
Ossiannilsson TIIM2011
 
Ossiannilsson TIIM2011
Ossiannilsson TIIM2011Ossiannilsson TIIM2011
Ossiannilsson TIIM2011
 
Quality enhancement ltu2014 fokusgrupper 1409291401001
Quality enhancement ltu2014 fokusgrupper 1409291401001Quality enhancement ltu2014 fokusgrupper 1409291401001
Quality enhancement ltu2014 fokusgrupper 1409291401001
 
Vilnius pres dianne lalancette
Vilnius pres dianne lalancetteVilnius pres dianne lalancette
Vilnius pres dianne lalancette
 
Ppt on educational measurement and evaluation
Ppt on educational measurement and evaluationPpt on educational measurement and evaluation
Ppt on educational measurement and evaluation
 
Preparing for an inter-institutional Benchmarking activity using the ACODE Be...
Preparing for an inter-institutional Benchmarking activity using the ACODE Be...Preparing for an inter-institutional Benchmarking activity using the ACODE Be...
Preparing for an inter-institutional Benchmarking activity using the ACODE Be...
 
NTLT 2012 Peter Coolbear Keynote Presentation to Conference
NTLT 2012 Peter Coolbear Keynote Presentation to ConferenceNTLT 2012 Peter Coolbear Keynote Presentation to Conference
NTLT 2012 Peter Coolbear Keynote Presentation to Conference
 
Alison Bone - closing the loop
Alison Bone - closing the loopAlison Bone - closing the loop
Alison Bone - closing the loop
 
Assessment and Feedback programme update (April 2012)
Assessment and Feedback programme update (April 2012)Assessment and Feedback programme update (April 2012)
Assessment and Feedback programme update (April 2012)
 
Ascertaining Impacts of Open Educational Practices in Shifting Mindsets
Ascertaining Impacts of Open Educational Practices in Shifting MindsetsAscertaining Impacts of Open Educational Practices in Shifting Mindsets
Ascertaining Impacts of Open Educational Practices in Shifting Mindsets
 
Ossiannilsson evaluation and accreditation for quality assurance in higher di...
Ossiannilsson evaluation and accreditation for quality assurance in higher di...Ossiannilsson evaluation and accreditation for quality assurance in higher di...
Ossiannilsson evaluation and accreditation for quality assurance in higher di...
 
TEA.ppt
TEA.pptTEA.ppt
TEA.ppt
 
Sequent e xcellence gu-eo_vilnius
Sequent e xcellence gu-eo_vilniusSequent e xcellence gu-eo_vilnius
Sequent e xcellence gu-eo_vilnius
 
e-Learning Guide written for the University of Southampton.
e-Learning Guide written for the University of Southampton.e-Learning Guide written for the University of Southampton.
e-Learning Guide written for the University of Southampton.
 
Governing Quality Of Online Content Through Threshold Standards: Facilitating...
Governing Quality Of Online Content Through Threshold Standards: Facilitating...Governing Quality Of Online Content Through Threshold Standards: Facilitating...
Governing Quality Of Online Content Through Threshold Standards: Facilitating...
 
ABDC-25July2014-MarkFreeman-final
ABDC-25July2014-MarkFreeman-finalABDC-25July2014-MarkFreeman-final
ABDC-25July2014-MarkFreeman-final
 

Plus de VISCED

Paul Bacsich - Sero - Critical Success Factors, Benchmarking and Quality in V...
Paul Bacsich - Sero - Critical Success Factors, Benchmarking and Quality in V...Paul Bacsich - Sero - Critical Success Factors, Benchmarking and Quality in V...
Paul Bacsich - Sero - Critical Success Factors, Benchmarking and Quality in V...
VISCED
 

Plus de VISCED (15)

01 alt 2011
01 alt 201101 alt 2011
01 alt 2011
 
14 visced oeb_nz2
14 visced oeb_nz214 visced oeb_nz2
14 visced oeb_nz2
 
Critical Success Factors for Virtual Schools
Critical Success Factors for Virtual SchoolsCritical Success Factors for Virtual Schools
Critical Success Factors for Virtual Schools
 
Jacqueline Daniell - Interhigh - A Tale Of Two Schools
Jacqueline Daniell - Interhigh - A Tale Of Two Schools Jacqueline Daniell - Interhigh - A Tale Of Two Schools
Jacqueline Daniell - Interhigh - A Tale Of Two Schools
 
Paul Bacsich - Sero - Critical Success Factors, Benchmarking and Quality in V...
Paul Bacsich - Sero - Critical Success Factors, Benchmarking and Quality in V...Paul Bacsich - Sero - Critical Success Factors, Benchmarking and Quality in V...
Paul Bacsich - Sero - Critical Success Factors, Benchmarking and Quality in V...
 
Laura Kalniņa - Rīgas Tālmācības Vidusskola, Latvia - Riga Distance Education...
Laura Kalniņa - Rīgas Tālmācības Vidusskola, Latvia - Riga Distance Education...Laura Kalniņa - Rīgas Tālmācības Vidusskola, Latvia - Riga Distance Education...
Laura Kalniņa - Rīgas Tālmācības Vidusskola, Latvia - Riga Distance Education...
 
George Watley - Northampton University - Cost-Effectiveness of Virtual Schooling
George Watley - Northampton University - Cost-Effectiveness of Virtual SchoolingGeorge Watley - Northampton University - Cost-Effectiveness of Virtual Schooling
George Watley - Northampton University - Cost-Effectiveness of Virtual Schooling
 
Fernando Albuquerque Costa - Instituto de Educação - Distance Learning Projec...
Fernando Albuquerque Costa - Instituto de Educação - Distance Learning Projec...Fernando Albuquerque Costa - Instituto de Educação - Distance Learning Projec...
Fernando Albuquerque Costa - Instituto de Educação - Distance Learning Projec...
 
Els Janssens - Bednet - On-line School Education for Children and Youngsters ...
Els Janssens - Bednet - On-line School Education for Children and Youngsters ...Els Janssens - Bednet - On-line School Education for Children and Youngsters ...
Els Janssens - Bednet - On-line School Education for Children and Youngsters ...
 
Barry Phillips - Sero - The Virtual School Landscape in Europe
Barry Phillips - Sero - The Virtual School Landscape in EuropeBarry Phillips - Sero - The Virtual School Landscape in Europe
Barry Phillips - Sero - The Virtual School Landscape in Europe
 
Matteo Uggeri - METID - PSO
Matteo Uggeri - METID - PSOMatteo Uggeri - METID - PSO
Matteo Uggeri - METID - PSO
 
Taru Kekkonen - Otavanopisto - Inclusion. Rural and Dispersed
Taru Kekkonen - Otavanopisto - Inclusion. Rural and DispersedTaru Kekkonen - Otavanopisto - Inclusion. Rural and Dispersed
Taru Kekkonen - Otavanopisto - Inclusion. Rural and Dispersed
 
Ronny Karlsson - Sofia Distans - Sofia Distance Education
Ronny Karlsson - Sofia Distans - Sofia Distance EducationRonny Karlsson - Sofia Distans - Sofia Distance Education
Ronny Karlsson - Sofia Distans - Sofia Distance Education
 
Patrick, Teeter - iNacol - North America & K-12 Online Learning
Patrick, Teeter - iNacol - North America & K-12 Online LearningPatrick, Teeter - iNacol - North America & K-12 Online Learning
Patrick, Teeter - iNacol - North America & K-12 Online Learning
 
Wicks, Darrow - iNacol - Case Study USA
Wicks, Darrow - iNacol - Case Study USAWicks, Darrow - iNacol - Case Study USA
Wicks, Darrow - iNacol - Case Study USA
 

Dernier

1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Krashi Coaching
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
heathfieldcps1
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 

Dernier (20)

1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdf
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 

03 ngl international_benchmarking

  • 1. International benchmarking. The first dual mode distance learning benchmarking club
  • 2. Who are we… Ebba Ossiannilsson Lund University, SE Margareta Hellström KTH, SE Paul Bacsich Matic Media Ltd. UK Andreas Hedrén Gotland University, SE Ossiannilsson et al. / NGL2012Falun /
  • 4. Learning environment Steve Wheeler, University of Plymouth, 2010 http://www.flickr.co m/photos/luc/ Ossiannilsson et al. / NGL2012Falun /
  • 5. Ossiannilsson et al. / NGL2012Falun /
  • 6. “We are currently preparing students for jobs that don’t yet exist… Using technologies that haven’t been invented… In order to solve problems we don’t even know are problems yet.” (Source: Fish & McLeod, Shift Happens, Wikispaces.com) Foto: Anders Olsson, Lnu Ossiannilsson et al. / NGL2012Falun /
  • 7. New and emerging technologies... Steve Wheeler, University of Plymouth, 2011 http://www.weirdthings.org.uk ...are often met with opposition. Ossiannilsson et al. / NGL2012Falun /
  • 8. Benchmarking, some definitions Benchmarking is an exemplar-driven teleological process operating within an organization [sic] with the objective of intentionally changing an existing state of affairs into a superior state of affairs. (Moriarty, 2008, p. 30). …the ´locus´ of benchmarking lies between the current and desirable states of affairs and contributes to the transformation processes that realise these improvements. (Moriarty and Smallman, 2009, p. 484) ...is a technique, method, process, activity, incentive, or reward which conventional wisdom regards as more effective at delivering a particular outcome than any other technique, method, process, etc. when applied to a particular condition or circumstance Ossiannilsson et al. / NGL2012Falun /
  • 9. Self evaluation for quality enhancement benchmark-careers.co Ossiannilsson et al. / NGL2012Falun /
  • 10. The Benhmarking process Determine what to benchmark Form a Take action benchmarking team Collect and Identify analyse benchmarking benchmarking partners information Ossiannilsson, E. (2011). Findings from European benchmarking exercises on e-learning: value and impact. CreativeEducation.2(3):208-219. Ossiannilsson et al. / NGL2012Falun /
  • 11. Benefits and values self-assess institution respond to national performance indicators and benchmarks strengthen institutional identity better understand the process enhance reputation measure and compare set new standards for the sector discover new ideas, set targets for improvement obtain data to support decision-making van Vught et al., (2008). A practical guide. Benchmarking in European HE. ESMU Ossiannilsson et al. / NGL2012Falun /
  • 12. Limitations Time? Commitment? Benchmarks? Interpretations? Language? Who is involved? Ossiannilsson et al. / NGL2012Falun /
  • 13. The First dual-mode distance benchmarking club, partners • UK University of Leicester (lead), • UK University of Liverpool, • Australia University of Southern Queensland • New Zeeland Massey University • Canada Thompson Rivers University • Sweden Lund University • Sweden KTH • Gotland University was not in the club, but did the benchmarking with Pick&Mix Ossiannilsson et al. / NGL2012Falun /
  • 14. Pick&Mix The Pick&Mix; the iterative self-review process with use of expert moderators • Encourages a more senior level of participation from the institution: the result is “theirs”, not the moderators • Get comfortable over time with the criteria as they apply to their institution • Helps them move directly to implementation of change • Selects against complex methodologies – not an issue with Pick&Mix as it is simple (compared with others) • Requires more effort from moderators (Bacsich, 2011) Ossiannilsson et al. / NGL2012Falun /
  • 15. Critical success factors • 22 Leadership in e-Learning Code Criterion name • 29 Management Style • 04 Usability • 35 Relationship Management • 06 eLearning strategy Upwards • 07 Decisions on Projects • 53 Reliability • 10 Training • 58 Market Research • 12 Costs • 60 Security • 13 Planning Annually • 91 Student Understanding of • 16 Technical Support to Staff System • 19 Decisions on Programmes • 92 Student Help Desk • 94 Student Satisfaction 06d Distance Learning Regularly updated Distance Learning Strategy, integrated with Strategy Learning and Teaching Strategy and all related strategies (e.g. e-Learning, if relevant). Ossiannilsson et al. / NGL2012Falun /
  • 16. Ossiannilsson et al. / NGL2012Falun /
  • 17. Meetings and process Meeting Aims of meeting • Initial meeting Initial collection of evidence, and selection of supplementary criteria • Mid-process meeting Further collection of evidence • Scoring rehearsal meeting Final tweaks on and chasing of evidence • Scoring meeting xxx • Reflection meeting To move to change Ossiannilsson et al. / NGL2012Falun /
  • 19. The First dual-mode distance benchmarking club Tasks for Lund University, SE • benchmark, in accordance with the detailed criteria • consider the already defined and/or suggest any other critical success factors • based on experience and results from EADTU's E-xcellence+ and ESMU's ELBE correlate Pick&Mix with those Ossiannilsson et al. / NGL2012Falun /
  • 20. Benchmarking projects conducted by Lund University, SE • The Swedish National Agency of Higher Education, ELQ • EADTU, E-xcellence+ • ESMU, Benchmarking eLearning exercise 2009 • The First dual-mode distance learning benchmarking club (Concordance) Ossiannilsson et al. / NGL2012Falun /
  • 21. The Excellence project by the European Association o Distance Teaching Universities, EADTU Products Services Management http://www.eadtu.nl/e-xcellencelabel Ossiannilsson et al. / NGL2012Falun /
  • 22. Ossiannilsson et al. / NGL2012Falun /
  • 23. Ossiannilsson et al. / NGL2012Falun /
  • 24. ©Ossiannilsson & Landgren, 2011 Ossiannilsson et al. / NGL2012Falun /
  • 25. KTH 1… Ask each of the respondents to value each criterion not only on level 1- 6 but also do this for 4 different organizational levels • Individual/or course level • Departmental level • “School “level • Institutional /or “KTH” level. Ossiannilsson et al. / NGL2012Falun /
  • 26. KTH 2… • Illuminated “islands” with very advanced and high quality distance e-learning existed. Internal information about their work was not reaching outside their group. • At the same time “dark corners” that had not even thought of the possibility to use new technologies to enhance their student’s learning or to try blended learning models for more flexibility were found. • KTH could learn from studying successful e-learning initiatives within its organization from departments that have worked for years in different online initiatives and to develop blended learning models. • Reports but also as a seminar series, were the results could be discussed and good examples disseminated locally. Ossiannilsson et al. / NGL2012Falun /
  • 27. KTH 3… Eighteen (18) new core criteria were chosen and grouped in the following areas: Student involvement Educational/Pedagogical anchoring Staff recognition and reward Open Educational Resources Ossiannilsson et al. / NGL2012Falun /
  • 28. Gotland University • Find suggestions on how to strengthen the institution’s e-learning. • The Pick&Mix method was the expected possibility to relatively quickly, with a relatively small effort, without access to own experts in e-learning get a good view and understanding of the current state of the institution’s e-learning. • Give results that would be straight forward to use to find suggestions on what aspects of the institutions e-learning to address and what to do in order to improve. • A key aspect that was found appealing when making the decision to use Pick&Mix was the easily understood and concrete (critical) success factors Ossiannilsson et al. / NGL2012Falun /
  • 29. Gotland University 2 • Gotland University had a few specific issues that needed to be addressed for locally specific reasons. • The nature of these issues differed from the benchmarking success factors so these issues were addressed in parallel but separately. Ossiannilsson et al. / NGL2012Falun /
  • 30. Gotland University 3… • In a few cases …not straight forward to identify the University’s score for the success factors. This was mostly from institution internal reasons. The effect of this was that the benchmarking exercise made it clear that there was interesting information that was not easily accessible at the institution. • The use of Pick&Mix…relatively straight forward and very useful and easy to use the output from the method to suggest changes to achieve improvements • Identify the state of it’s e-learning on a somewhat absolute scale and to identify what aspects and areas of it’s e-learning that needs most improvement and also what measures is needed to achieve the identified improvements Ossiannilsson et al. / NGL2012Falun /
  • 31. Three key conclusions from the benchmarking exercise were that… 1. Only Thompson Rivers University has any strong expertise in market research for e-learning, not only in the Club but out of all the institutions benchmarked with Pick&Mix 2. No institution has strong competence in costing e- learning 3. Staff reward and recognition for e-learning is not adequate anywhere. Ossiannilsson et al. / NGL2012Falun /
  • 32. Conclusion on methodology and benchmarking outcomes 1 • The political message is that such clubs are useful and that one could be easily set up in the Scando-Baltic region • Issues raised above could be handled by different wording appropriate to the national languages and cultures within a common conceptual scheme for example as developed by Lund University. Ossiannilsson et al. / NGL2012Falun /
  • 33. Conclusion on methodology and benchmarking outcomes 2 • Co-operations like the distance learning benchmarking club can play a role on an inter-institutional level, both nationally and internationally, in the absence of any national level governing. • Through co-operations like the distance learning benchmarking club institutions could network, share knowledge, increase their competence and strengthen their e-learning. • The dissemination of Pick&Mix through the work pursued within the club has created a knowledge foundation that can be taken further to both be used within the institutions of the club and also to involve more institutions. Ossiannilsson et al. / NGL2012Falun /
  • 34. The door is open … What next? Ossiannilsson et al. / NGL2012Falun / TIIM2011_ Oulu_Ebba Bild: Wikimedia Commons, Push the button, CC BY SA
  • 35. Ebba Ossiannilsson, Paul Bacsish, Margareta Hellström, Andreas Hedrén Footprints Ebba.Ossiannilsson@ced.lu.se Ebba.Ossiannilsson@oulu.fi Paul Bacsich (Matic Media Ltd) paul@matic-media.co.uk Margareta Hellström mhel@kth.se Andreas Hedrén andreas.hedren@hgo.se Ossiannilsson et al. / NGL2012Falun /