SlideShare une entreprise Scribd logo
1  sur  14
Télécharger pour lire hors ligne
The value of measurement in
research practice:
Evaluating ICT training in
education

Francesca Fanni, Izak van Zyl, Isabella Rega, and Lorenzo Cantoni
New Media in Education Laboratory (NewMinE Lab), Università della
Svizzera italiana, Lugano, Switzerland
Isabella Rega
Isabella.rega@usi.ch
Objectives
• to describe the use of a blended approach in analysing the
  impact of ICTs in education.
  • quantitative (based on questionnaire data) measurements
  • qualitative (based on interview data) measurements
• to show how each may complement the other
Self-Efficacy (SE) Construct
People’s judgment of their capabilities to organize and execute
   courses of action required to attain designated types of
                       performances.
                                                   Bandura, 1995

• 4 main sources
  •   mastery experiences,
  •   vicarious experiences,
  •   social persuasion,
  •   and emotional states.
Computer SE (CSE) & Teacher SE
(TSE)
                               CSE
an individual perception of his or her ability to use computers in
                 the accomplishment of a task
                                        Compeau & Higgins, 1995

                            TSE
  Judgment of his or her capabilities to bring about desired
 outcomes of student engagement and learning, even among
     those students who may be difficult or unmotivated
                                                  Bandura, 1995
The Sample and the Measurements
• Group A: 42 teachers - Rosmead and Zimasa
• Group B: 68 teachers - Vukukhanye, Blossom,
  Thembani and Moshesh
           Group A                     Group B
• Quantitative Approach     • Quantitative Approach
  • July 2009 - beginning     • July 2009
  • January 2010 - middle     • January 2010
  • May 2010 – end            • --


• Qualitative Approach      • Qualitative Approach
  • February/April 2010       • June/August 2010
Quantitative Results/1
                     Group A
   8
   7
   6
   5
   4
   3
   2
   1
   0
         July 2009    January 2010   May 2010
   TSE       7.2          6.7           7
   CSE       5.7          6.1          6.3
Quantitative Results/2
                Group B
  8
  7
  6
  5
  4
  3
  2
  1
  0
        July 2009         January 2010
  TSE       7.2               6.9
  CSE       5.7               5.7
10
                                                             15
                                                                  20
                                                                       25
                                                                            30




                                0
                                      5
    internal psychology (A)
    internal psychology (B)


   student engagement (A)
   student engagement (B)


classroom management (A)
classroom management (B)


instructional strategies (A)
 instructional strategies (B)


            preparation (A)
            preparation (B)


                  admin (A)
                  admin (B)
                                                                                 Mastery Experience Positive




           personal use (A)
                                                                                                               Qualitative Results/1




           personal use (B)


                 general (A)
                 general (B)


                support (A)
                 support (B)
                                    ACTUAL
                                             POSSIBLE
0
                                         10
                                                        20
                                                             30
                                                                  40
                                                                       50
                                                                            60
    internal psychology (A)
    internal psychology (B)


   student engagement (A)
   student engagement (B)


classroom management (A)
classroom management (B)


instructional strategies (A)
 instructional strategies (B)


           personal use (A)
           personal use (B)


        technical issues (A)
                                                                                                               Qualitative Results/2




        technical issues (B)
                                                                                 Negative Mastery Experience




                 general (A)
                 general (B)


                support (A)
                 support B)
                                    ACTUAL
                                             POSSIBLE
Qualitative Results/3
           Vicarious Experience Positive
  60


  50


  40


  30


  20                                       POSSIBLE
                                           ACTUAL
  10


  0
Qualitative Results/4
           Vicarious Experience Negative
   60

   50

   40

   30

   20
                                           POSSIBLE
   10                                      ACTUAL

    0
Hints on Complementarity
• Quantitative results
   • Group A:
       • CSE slightly increased, TSE stable.
       • No correlation between CSE and TSE.
       • CSE and TSE starting values: high


• Qualitative results:
   • High starting CSE value:
       • Group B: already using technologies in a variety of ways : to engage their students
         in learning activities, to manage their classes, to design and deliver their
         instructional strategies, for lesson preparation, and to perform administrative tasks
       • Group A started using more technologies within their working activities, featuring
         many usages from the realm of possible to the realm of actual and increasing their
         perceptions of mastery experiences in ICT.
   • No correlation between CSE and TSE
       • It is not a matter of not adoption, teachers are in fact using ICTs (for various
         purposes), but cannot explicitly relate this to their perceptions of being better
         educators
THANK YOU!




Isabella Rega
Isabella.rega@usi.ch

Contenu connexe

Similaire à CIRN Conference: MELISSA

Past awesome final
Past awesome finalPast awesome final
Past awesome finalrafontech
 
Think like an isd 2013
Think like an isd 2013Think like an isd 2013
Think like an isd 2013A Cutler
 
DL resourcing talk 2012
DL resourcing talk 2012DL resourcing talk 2012
DL resourcing talk 2012Mark Kerrigan
 
LAS Training and Instruction Librarian’s Group - Learning Outcomes How Can W...
LAS Training and Instruction Librarian’s Group - Learning Outcomes How Can W...LAS Training and Instruction Librarian’s Group - Learning Outcomes How Can W...
LAS Training and Instruction Librarian’s Group - Learning Outcomes How Can W...librarysmu
 
Curriculum Management for Senior Management Teams in South Africa
Curriculum Management for Senior Management Teams in South AfricaCurriculum Management for Senior Management Teams in South Africa
Curriculum Management for Senior Management Teams in South AfricaEducation Moving Up Cc.
 
Portfolios in self assessment
Portfolios in self assessmentPortfolios in self assessment
Portfolios in self assessmentMaria Mu
 
Instructional Strategies for Blended Learning Handouts
Instructional Strategies for Blended Learning HandoutsInstructional Strategies for Blended Learning Handouts
Instructional Strategies for Blended Learning HandoutsUniversity of Central Florida
 
The Pearls and Perils of For-Profit Education (Deborah Riemer)
The Pearls and Perils of For-Profit Education (Deborah Riemer)The Pearls and Perils of For-Profit Education (Deborah Riemer)
The Pearls and Perils of For-Profit Education (Deborah Riemer)ODLAA
 
Case study_GUVI_Workshop_Final version
Case study_GUVI_Workshop_Final versionCase study_GUVI_Workshop_Final version
Case study_GUVI_Workshop_Final versionParasuram K
 
OPEN Kickoff: OLI Learner Centered Design
OPEN Kickoff: OLI Learner Centered DesignOPEN Kickoff: OLI Learner Centered Design
OPEN Kickoff: OLI Learner Centered DesignBill Jerome
 
NCCET December Webinar - Restructuring Continuing Education and Corporate Tra...
NCCET December Webinar - Restructuring Continuing Education and Corporate Tra...NCCET December Webinar - Restructuring Continuing Education and Corporate Tra...
NCCET December Webinar - Restructuring Continuing Education and Corporate Tra...NCCET
 
NEASC Presentation on TASC
NEASC Presentation on TASCNEASC Presentation on TASC
NEASC Presentation on TASCHelfried Zrzavy
 

Similaire à CIRN Conference: MELISSA (20)

Past awesome final
Past awesome finalPast awesome final
Past awesome final
 
Career launch fg2010
Career launch  fg2010Career launch  fg2010
Career launch fg2010
 
SAPA Provincial Presentation 2011
SAPA Provincial Presentation 2011SAPA Provincial Presentation 2011
SAPA Provincial Presentation 2011
 
Think like an isd 2013
Think like an isd 2013Think like an isd 2013
Think like an isd 2013
 
OCAD U Teaching Expo 2015
OCAD U Teaching Expo 2015OCAD U Teaching Expo 2015
OCAD U Teaching Expo 2015
 
DL resourcing talk 2012
DL resourcing talk 2012DL resourcing talk 2012
DL resourcing talk 2012
 
Witbank Circuit Strategic Planning
Witbank Circuit Strategic PlanningWitbank Circuit Strategic Planning
Witbank Circuit Strategic Planning
 
Icem&siie 2011 peer-assessment
Icem&siie 2011 peer-assessmentIcem&siie 2011 peer-assessment
Icem&siie 2011 peer-assessment
 
CCE and Grading System @ Agra
CCE and Grading System @ AgraCCE and Grading System @ Agra
CCE and Grading System @ Agra
 
LAS Training and Instruction Librarian’s Group - Learning Outcomes How Can W...
LAS Training and Instruction Librarian’s Group - Learning Outcomes How Can W...LAS Training and Instruction Librarian’s Group - Learning Outcomes How Can W...
LAS Training and Instruction Librarian’s Group - Learning Outcomes How Can W...
 
Curriculum Management for Senior Management Teams in South Africa
Curriculum Management for Senior Management Teams in South AfricaCurriculum Management for Senior Management Teams in South Africa
Curriculum Management for Senior Management Teams in South Africa
 
Portfolios in self assessment
Portfolios in self assessmentPortfolios in self assessment
Portfolios in self assessment
 
Instructional Strategies for Blended Learning Handouts
Instructional Strategies for Blended Learning HandoutsInstructional Strategies for Blended Learning Handouts
Instructional Strategies for Blended Learning Handouts
 
Theory of change
Theory of changeTheory of change
Theory of change
 
UP ACE MTL Unit 1 Session 3
UP ACE MTL Unit 1   Session 3UP ACE MTL Unit 1   Session 3
UP ACE MTL Unit 1 Session 3
 
The Pearls and Perils of For-Profit Education (Deborah Riemer)
The Pearls and Perils of For-Profit Education (Deborah Riemer)The Pearls and Perils of For-Profit Education (Deborah Riemer)
The Pearls and Perils of For-Profit Education (Deborah Riemer)
 
Case study_GUVI_Workshop_Final version
Case study_GUVI_Workshop_Final versionCase study_GUVI_Workshop_Final version
Case study_GUVI_Workshop_Final version
 
OPEN Kickoff: OLI Learner Centered Design
OPEN Kickoff: OLI Learner Centered DesignOPEN Kickoff: OLI Learner Centered Design
OPEN Kickoff: OLI Learner Centered Design
 
NCCET December Webinar - Restructuring Continuing Education and Corporate Tra...
NCCET December Webinar - Restructuring Continuing Education and Corporate Tra...NCCET December Webinar - Restructuring Continuing Education and Corporate Tra...
NCCET December Webinar - Restructuring Continuing Education and Corporate Tra...
 
NEASC Presentation on TASC
NEASC Presentation on TASCNEASC Presentation on TASC
NEASC Presentation on TASC
 

Dernier

1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhikauryashika82
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docxPoojaSen20
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterMateoGardella
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxVishalSingh1417
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxnegromaestrong
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxAreebaZafar22
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfSanaAli374401
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin ClassesCeline George
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...christianmathematics
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Shubhangi Sonawane
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxVishalSingh1417
 

Dernier (20)

Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 

CIRN Conference: MELISSA

  • 1. The value of measurement in research practice: Evaluating ICT training in education Francesca Fanni, Izak van Zyl, Isabella Rega, and Lorenzo Cantoni New Media in Education Laboratory (NewMinE Lab), Università della Svizzera italiana, Lugano, Switzerland
  • 3. Objectives • to describe the use of a blended approach in analysing the impact of ICTs in education. • quantitative (based on questionnaire data) measurements • qualitative (based on interview data) measurements • to show how each may complement the other
  • 4. Self-Efficacy (SE) Construct People’s judgment of their capabilities to organize and execute courses of action required to attain designated types of performances. Bandura, 1995 • 4 main sources • mastery experiences, • vicarious experiences, • social persuasion, • and emotional states.
  • 5. Computer SE (CSE) & Teacher SE (TSE) CSE an individual perception of his or her ability to use computers in the accomplishment of a task Compeau & Higgins, 1995 TSE Judgment of his or her capabilities to bring about desired outcomes of student engagement and learning, even among those students who may be difficult or unmotivated Bandura, 1995
  • 6. The Sample and the Measurements • Group A: 42 teachers - Rosmead and Zimasa • Group B: 68 teachers - Vukukhanye, Blossom, Thembani and Moshesh Group A Group B • Quantitative Approach • Quantitative Approach • July 2009 - beginning • July 2009 • January 2010 - middle • January 2010 • May 2010 – end • -- • Qualitative Approach • Qualitative Approach • February/April 2010 • June/August 2010
  • 7. Quantitative Results/1 Group A 8 7 6 5 4 3 2 1 0 July 2009 January 2010 May 2010 TSE 7.2 6.7 7 CSE 5.7 6.1 6.3
  • 8. Quantitative Results/2 Group B 8 7 6 5 4 3 2 1 0 July 2009 January 2010 TSE 7.2 6.9 CSE 5.7 5.7
  • 9. 10 15 20 25 30 0 5 internal psychology (A) internal psychology (B) student engagement (A) student engagement (B) classroom management (A) classroom management (B) instructional strategies (A) instructional strategies (B) preparation (A) preparation (B) admin (A) admin (B) Mastery Experience Positive personal use (A) Qualitative Results/1 personal use (B) general (A) general (B) support (A) support (B) ACTUAL POSSIBLE
  • 10. 0 10 20 30 40 50 60 internal psychology (A) internal psychology (B) student engagement (A) student engagement (B) classroom management (A) classroom management (B) instructional strategies (A) instructional strategies (B) personal use (A) personal use (B) technical issues (A) Qualitative Results/2 technical issues (B) Negative Mastery Experience general (A) general (B) support (A) support B) ACTUAL POSSIBLE
  • 11. Qualitative Results/3 Vicarious Experience Positive 60 50 40 30 20 POSSIBLE ACTUAL 10 0
  • 12. Qualitative Results/4 Vicarious Experience Negative 60 50 40 30 20 POSSIBLE 10 ACTUAL 0
  • 13. Hints on Complementarity • Quantitative results • Group A: • CSE slightly increased, TSE stable. • No correlation between CSE and TSE. • CSE and TSE starting values: high • Qualitative results: • High starting CSE value: • Group B: already using technologies in a variety of ways : to engage their students in learning activities, to manage their classes, to design and deliver their instructional strategies, for lesson preparation, and to perform administrative tasks • Group A started using more technologies within their working activities, featuring many usages from the realm of possible to the realm of actual and increasing their perceptions of mastery experiences in ICT. • No correlation between CSE and TSE • It is not a matter of not adoption, teachers are in fact using ICTs (for various purposes), but cannot explicitly relate this to their perceptions of being better educators