SlideShare a Scribd company logo
1 of 16
The San Jacinto College Quality Enhancement Plan Deepening Insights into Student Learning withQualitative Data Presenters: Dr. James Semones, Dr. Karen Hattaway and Bret Nelson 1
Context for Assessment Emphasis on Reading in Academic transfer classes Discipline Fluency  Faculty Inquiry 2
Where Does Assessment Begin? Did you see that? What did the students do? What does this mean? What do we do next? 3
“Our first impressions are generated by our experiences and our environment, which means that we can change our first impressions. . . by changing the experiences that comprise those impressions…”   from Blink
Quantitative & Qualitative Data Quantitative Data What is it? What can it tell us? Qualitative Data What is it? What does it tell us? What are points for concern when we look at grade data? 5
What is lost in quantitative assessment  Full profile of student As accountable for learning As one who experiences rather than one who enrolls As one who grows rather than one who completes Full profile of faculty As accountable for creating learning situation As designer of path for student growth As architect of changes for student path As evaluator and encourager
What is most lost: A profile of education  As more than beginnings and endings As recursive experiences As growth in apparent failure As an environment of continuous development
History Class Activity What would the teacher do with this data? What would the researcher do with it? What are the inquiry questions? 8
Observations on Assessment “Assessment should not only serve as an external evaluation and public conscience for higher education institutions; at the very least, it also should do no harm to instruction. . . . When we embed assessment in instruction, it is much more likely that what is assessed will contribute to and be compatible with the core objectives of  instruction.” – Lee Schulman 9
English Class ActivityDeparture and Destination 25 students enrolled 15 wrote the final-exam paper Of the 15 writing the final exam, 13 passed Grade distribution: 5 W’s ; 8 F’s; 2 D’s; 6 C’s; 5 B’s 10
Using Qualitative Assessments in Sociology: A Case Study How the use of qualitative approaches (faculty inquiry) can inform and perhaps improve quantitative results Observations of students Student interviews Methodology: A Brief Overview End of semester quantitative results and comparisons: What do they really mean? 11
Spring 2008: QEP Observation/Reflection Focus on Reading Twenty-four percent (24.2%) had not acquired a textbook by end-of-term. Fewer than 25% of students regularly brought their texts to class.   Only about 10% to 15% of the students ever participated in class discussion.   In student interviews (a sample of about 30), 20 percent (20%) revealed that they had neverread a single book to completion.   Only 7 students (8.6%) of 81 whose texts were examined knew the fundamentals of text annotation.
Example of a Qualitative Assessment:2008 QEP Pilot Group Student Interviews “I never really knew what to study in a textbook before. Now, it’s like a light has been turned on. Thank you professor.”    “Textbooks don’t put me to sleep anymore. Now I know what to look for and highlight in my book.”  “I went from a D- on my first test to a B on the last one. . . . I never really read my books before. It was because I did not have to. . . ) “I used to hate to read. Now I am beginning to see the value, especially in sociology and history. I used to think history was so boring. . . .” “I want to take more courses that are QEP next semester. It’s more work but you get something out of it. Until this semester, I thought reading really sucked.”
Methodology: A Brief OverviewFall 2009 QEP Implementation All Fall campus sections of SOCI 1301 –QEP Group (2009) – taught by co-presenter received several QEP strategic interventions (N = 139) A textbook authored by the co-presenter (Doing Sociology: A Basic Text, 2010 (along with an interactive guide and workbook containing strategic pedagogical interventions) was first used For a comparative fit (Fall to Fall), the QEP Group (2009) was compared to the Non-QEP Group (2008)
Fall 2008 vs. Fall 2009 End-of-Term Grades: Non-QEP vs. QEP SOCI 1301 Sections Completers: Non-QEP (2008) = 73.3% QEP (2009) = 79.9% Gain = + 6.6%   ,[object Object]
Non-QEP (2008) = 6.7%

More Related Content

What's hot

Motivational interviewing in and out of the classroom
Motivational interviewing in and out of the classroomMotivational interviewing in and out of the classroom
Motivational interviewing in and out of the classroom
SHU Learning & Teaching
 

What's hot (20)

Changing conceptions and practice
Changing conceptions and practiceChanging conceptions and practice
Changing conceptions and practice
 
Changing conceptions
Changing conceptionsChanging conceptions
Changing conceptions
 
TESTA, UCL Teaching and Learning Conference Keynote (April 2015)
TESTA, UCL Teaching and Learning Conference Keynote (April 2015) TESTA, UCL Teaching and Learning Conference Keynote (April 2015)
TESTA, UCL Teaching and Learning Conference Keynote (April 2015)
 
Mixing Measures: How We Used Quantitative and Qualitative Techniques to Asses...
Mixing Measures: How We Used Quantitative and Qualitative Techniques to Asses...Mixing Measures: How We Used Quantitative and Qualitative Techniques to Asses...
Mixing Measures: How We Used Quantitative and Qualitative Techniques to Asses...
 
Being known and knowing stuff: linking feedback and RIT
Being known and knowing stuff: linking feedback and RITBeing known and knowing stuff: linking feedback and RIT
Being known and knowing stuff: linking feedback and RIT
 
A broken assessment paradigm?
A broken assessment paradigm?A broken assessment paradigm?
A broken assessment paradigm?
 
Frustrating formative
Frustrating formativeFrustrating formative
Frustrating formative
 
TESTA, Kingston University Keynote
TESTA, Kingston University KeynoteTESTA, Kingston University Keynote
TESTA, Kingston University Keynote
 
Term 3 TAI - Mentoring and Google Docs
Term 3 TAI    - Mentoring and Google DocsTerm 3 TAI    - Mentoring and Google Docs
Term 3 TAI - Mentoring and Google Docs
 
TESTA, HEPN University of Sheffield (December 2014)
 TESTA, HEPN University of Sheffield (December 2014) TESTA, HEPN University of Sheffield (December 2014)
TESTA, HEPN University of Sheffield (December 2014)
 
TESTA, University of Greenwich Keynote (July 2013)
TESTA, University of Greenwich Keynote (July 2013)TESTA, University of Greenwich Keynote (July 2013)
TESTA, University of Greenwich Keynote (July 2013)
 
Push back Sisyphus! Connecting feedback to learning
Push back Sisyphus! Connecting feedback to learningPush back Sisyphus! Connecting feedback to learning
Push back Sisyphus! Connecting feedback to learning
 
The High School Litter Box
The High School Litter BoxThe High School Litter Box
The High School Litter Box
 
Fresh skillssummary
Fresh skillssummaryFresh skillssummary
Fresh skillssummary
 
Excellent teaching through action research
Excellent teaching through action researchExcellent teaching through action research
Excellent teaching through action research
 
Motivational interviewing in and out of the classroom
Motivational interviewing in and out of the classroomMotivational interviewing in and out of the classroom
Motivational interviewing in and out of the classroom
 
V4 amcoa+presentation+davidson+hickey+%282%29
V4 amcoa+presentation+davidson+hickey+%282%29V4 amcoa+presentation+davidson+hickey+%282%29
V4 amcoa+presentation+davidson+hickey+%282%29
 
'See Better': The case for a phenomenological and logotherapeutic vision of r...
'See Better': The case for a phenomenological and logotherapeutic vision of r...'See Better': The case for a phenomenological and logotherapeutic vision of r...
'See Better': The case for a phenomenological and logotherapeutic vision of r...
 
Experience of using formative assessment and students perception of formative...
Experience of using formative assessment and students perception of formative...Experience of using formative assessment and students perception of formative...
Experience of using formative assessment and students perception of formative...
 
Changing the assessment narrative
Changing the assessment narrativeChanging the assessment narrative
Changing the assessment narrative
 

Similar to Deepening Insights into Student Learning with Qualitative Data

Assessment Strategies and Innovative Teaching Practices
Assessment Strategies and Innovative Teaching PracticesAssessment Strategies and Innovative Teaching Practices
Assessment Strategies and Innovative Teaching Practices
Mostafa Ewees
 
P gcert appraising your teaching 2011slideshare
P gcert appraising your teaching 2011slideshareP gcert appraising your teaching 2011slideshare
P gcert appraising your teaching 2011slideshare
ClareVMilsom
 
CoreSep11: assessment_and_feedback
CoreSep11: assessment_and_feedbackCoreSep11: assessment_and_feedback
CoreSep11: assessment_and_feedback
Academic Development
 
Pg cert appraising your teaching 2011
Pg cert appraising your teaching 2011 Pg cert appraising your teaching 2011
Pg cert appraising your teaching 2011
ClareVMilsom
 

Similar to Deepening Insights into Student Learning with Qualitative Data (20)

1 why do testa
1 why do testa1 why do testa
1 why do testa
 
TESTA, Imperial College Education Day (March 2015)
TESTA, Imperial College Education Day (March 2015)TESTA, Imperial College Education Day (March 2015)
TESTA, Imperial College Education Day (March 2015)
 
Out of the long shadow of the NSS: TESTA's transformative potential
Out of the long shadow of the NSS: TESTA's transformative potentialOut of the long shadow of the NSS: TESTA's transformative potential
Out of the long shadow of the NSS: TESTA's transformative potential
 
Cracking the challenge of formative assessment and feedback
Cracking the challenge of formative assessment and feedbackCracking the challenge of formative assessment and feedback
Cracking the challenge of formative assessment and feedback
 
Why do TESTA?
Why do TESTA?Why do TESTA?
Why do TESTA?
 
Changing Perceptions of ourselves
Changing Perceptions of ourselvesChanging Perceptions of ourselves
Changing Perceptions of ourselves
 
Squeezing assessment and stretching learning
Squeezing assessment and stretching learningSqueezing assessment and stretching learning
Squeezing assessment and stretching learning
 
Implications of TESTA for curriculum design
Implications of TESTA for curriculum designImplications of TESTA for curriculum design
Implications of TESTA for curriculum design
 
Assessment Strategies and Innovative Teaching Practices
Assessment Strategies and Innovative Teaching PracticesAssessment Strategies and Innovative Teaching Practices
Assessment Strategies and Innovative Teaching Practices
 
Flipping the technology-pedagogy equation: principles to improve assessment a...
Flipping the technology-pedagogy equation: principles to improve assessment a...Flipping the technology-pedagogy equation: principles to improve assessment a...
Flipping the technology-pedagogy equation: principles to improve assessment a...
 
Notes: What Do You Do When You Do What You Do with Student Ratings?
Notes: What Do You Do When You Do What You Do with Student Ratings?Notes: What Do You Do When You Do What You Do with Student Ratings?
Notes: What Do You Do When You Do What You Do with Student Ratings?
 
Lights, action, clapperboards: changing how students think and perform throug...
Lights, action, clapperboards: changing how students think and perform throug...Lights, action, clapperboards: changing how students think and perform throug...
Lights, action, clapperboards: changing how students think and perform throug...
 
Continuous Assessment
Continuous AssessmentContinuous Assessment
Continuous Assessment
 
P gcert appraising your teaching 2011slideshare
P gcert appraising your teaching 2011slideshareP gcert appraising your teaching 2011slideshare
P gcert appraising your teaching 2011slideshare
 
EDTEC 795A Case Study
EDTEC 795A Case StudyEDTEC 795A Case Study
EDTEC 795A Case Study
 
Testa interactive masterclass
Testa interactive masterclassTesta interactive masterclass
Testa interactive masterclass
 
CoreSep11: assessment_and_feedback
CoreSep11: assessment_and_feedbackCoreSep11: assessment_and_feedback
CoreSep11: assessment_and_feedback
 
Pg cert appraising your teaching 2011
Pg cert appraising your teaching 2011 Pg cert appraising your teaching 2011
Pg cert appraising your teaching 2011
 
Workshop 5: Techniques II
Workshop 5: Techniques IIWorkshop 5: Techniques II
Workshop 5: Techniques II
 
Hardest Part Teaching
Hardest Part TeachingHardest Part Teaching
Hardest Part Teaching
 

Recently uploaded

會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文
會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文
會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文
中 央社
 
Financial Accounting IFRS, 3rd Edition-dikompresi.pdf
Financial Accounting IFRS, 3rd Edition-dikompresi.pdfFinancial Accounting IFRS, 3rd Edition-dikompresi.pdf
Financial Accounting IFRS, 3rd Edition-dikompresi.pdf
MinawBelay
 

Recently uploaded (20)

An Overview of the Odoo 17 Discuss App.pptx
An Overview of the Odoo 17 Discuss App.pptxAn Overview of the Odoo 17 Discuss App.pptx
An Overview of the Odoo 17 Discuss App.pptx
 
24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...
24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...
24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...
 
An overview of the various scriptures in Hinduism
An overview of the various scriptures in HinduismAn overview of the various scriptures in Hinduism
An overview of the various scriptures in Hinduism
 
ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH FORM 50 CÂU TRẮC NGHI...
ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH FORM 50 CÂU TRẮC NGHI...ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH FORM 50 CÂU TRẮC NGHI...
ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH FORM 50 CÂU TRẮC NGHI...
 
Software testing for project report .pdf
Software testing for project report .pdfSoftware testing for project report .pdf
Software testing for project report .pdf
 
philosophy and it's principles based on the life
philosophy and it's principles based on the lifephilosophy and it's principles based on the life
philosophy and it's principles based on the life
 
TỔNG HỢP HƠN 100 ĐỀ THI THỬ TỐT NGHIỆP THPT VẬT LÝ 2024 - TỪ CÁC TRƯỜNG, TRƯ...
TỔNG HỢP HƠN 100 ĐỀ THI THỬ TỐT NGHIỆP THPT VẬT LÝ 2024 - TỪ CÁC TRƯỜNG, TRƯ...TỔNG HỢP HƠN 100 ĐỀ THI THỬ TỐT NGHIỆP THPT VẬT LÝ 2024 - TỪ CÁC TRƯỜNG, TRƯ...
TỔNG HỢP HƠN 100 ĐỀ THI THỬ TỐT NGHIỆP THPT VẬT LÝ 2024 - TỪ CÁC TRƯỜNG, TRƯ...
 
Word Stress rules esl .pptx
Word Stress rules esl               .pptxWord Stress rules esl               .pptx
Word Stress rules esl .pptx
 
UChicago CMSC 23320 - The Best Commit Messages of 2024
UChicago CMSC 23320 - The Best Commit Messages of 2024UChicago CMSC 23320 - The Best Commit Messages of 2024
UChicago CMSC 23320 - The Best Commit Messages of 2024
 
會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文
會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文
會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文會考英文
 
Basic Civil Engineering notes on Transportation Engineering, Modes of Transpo...
Basic Civil Engineering notes on Transportation Engineering, Modes of Transpo...Basic Civil Engineering notes on Transportation Engineering, Modes of Transpo...
Basic Civil Engineering notes on Transportation Engineering, Modes of Transpo...
 
MichaelStarkes_UncutGemsProjectSummary.pdf
MichaelStarkes_UncutGemsProjectSummary.pdfMichaelStarkes_UncutGemsProjectSummary.pdf
MichaelStarkes_UncutGemsProjectSummary.pdf
 
....................Muslim-Law notes.pdf
....................Muslim-Law notes.pdf....................Muslim-Law notes.pdf
....................Muslim-Law notes.pdf
 
II BIOSENSOR PRINCIPLE APPLICATIONS AND WORKING II
II BIOSENSOR PRINCIPLE APPLICATIONS AND WORKING IIII BIOSENSOR PRINCIPLE APPLICATIONS AND WORKING II
II BIOSENSOR PRINCIPLE APPLICATIONS AND WORKING II
 
Financial Accounting IFRS, 3rd Edition-dikompresi.pdf
Financial Accounting IFRS, 3rd Edition-dikompresi.pdfFinancial Accounting IFRS, 3rd Edition-dikompresi.pdf
Financial Accounting IFRS, 3rd Edition-dikompresi.pdf
 
How to Analyse Profit of a Sales Order in Odoo 17
How to Analyse Profit of a Sales Order in Odoo 17How to Analyse Profit of a Sales Order in Odoo 17
How to Analyse Profit of a Sales Order in Odoo 17
 
The Ball Poem- John Berryman_20240518_001617_0000.pptx
The Ball Poem- John Berryman_20240518_001617_0000.pptxThe Ball Poem- John Berryman_20240518_001617_0000.pptx
The Ball Poem- John Berryman_20240518_001617_0000.pptx
 
IPL Online Quiz by Pragya; Question Set.
IPL Online Quiz by Pragya; Question Set.IPL Online Quiz by Pragya; Question Set.
IPL Online Quiz by Pragya; Question Set.
 
HVAC System | Audit of HVAC System | Audit and regulatory Comploance.pptx
HVAC System | Audit of HVAC System | Audit and regulatory Comploance.pptxHVAC System | Audit of HVAC System | Audit and regulatory Comploance.pptx
HVAC System | Audit of HVAC System | Audit and regulatory Comploance.pptx
 
BỘ LUYỆN NGHE TIẾNG ANH 8 GLOBAL SUCCESS CẢ NĂM (GỒM 12 UNITS, MỖI UNIT GỒM 3...
BỘ LUYỆN NGHE TIẾNG ANH 8 GLOBAL SUCCESS CẢ NĂM (GỒM 12 UNITS, MỖI UNIT GỒM 3...BỘ LUYỆN NGHE TIẾNG ANH 8 GLOBAL SUCCESS CẢ NĂM (GỒM 12 UNITS, MỖI UNIT GỒM 3...
BỘ LUYỆN NGHE TIẾNG ANH 8 GLOBAL SUCCESS CẢ NĂM (GỒM 12 UNITS, MỖI UNIT GỒM 3...
 

Deepening Insights into Student Learning with Qualitative Data

  • 1. The San Jacinto College Quality Enhancement Plan Deepening Insights into Student Learning withQualitative Data Presenters: Dr. James Semones, Dr. Karen Hattaway and Bret Nelson 1
  • 2. Context for Assessment Emphasis on Reading in Academic transfer classes Discipline Fluency Faculty Inquiry 2
  • 3. Where Does Assessment Begin? Did you see that? What did the students do? What does this mean? What do we do next? 3
  • 4. “Our first impressions are generated by our experiences and our environment, which means that we can change our first impressions. . . by changing the experiences that comprise those impressions…” from Blink
  • 5. Quantitative & Qualitative Data Quantitative Data What is it? What can it tell us? Qualitative Data What is it? What does it tell us? What are points for concern when we look at grade data? 5
  • 6. What is lost in quantitative assessment Full profile of student As accountable for learning As one who experiences rather than one who enrolls As one who grows rather than one who completes Full profile of faculty As accountable for creating learning situation As designer of path for student growth As architect of changes for student path As evaluator and encourager
  • 7. What is most lost: A profile of education As more than beginnings and endings As recursive experiences As growth in apparent failure As an environment of continuous development
  • 8. History Class Activity What would the teacher do with this data? What would the researcher do with it? What are the inquiry questions? 8
  • 9. Observations on Assessment “Assessment should not only serve as an external evaluation and public conscience for higher education institutions; at the very least, it also should do no harm to instruction. . . . When we embed assessment in instruction, it is much more likely that what is assessed will contribute to and be compatible with the core objectives of instruction.” – Lee Schulman 9
  • 10. English Class ActivityDeparture and Destination 25 students enrolled 15 wrote the final-exam paper Of the 15 writing the final exam, 13 passed Grade distribution: 5 W’s ; 8 F’s; 2 D’s; 6 C’s; 5 B’s 10
  • 11. Using Qualitative Assessments in Sociology: A Case Study How the use of qualitative approaches (faculty inquiry) can inform and perhaps improve quantitative results Observations of students Student interviews Methodology: A Brief Overview End of semester quantitative results and comparisons: What do they really mean? 11
  • 12. Spring 2008: QEP Observation/Reflection Focus on Reading Twenty-four percent (24.2%) had not acquired a textbook by end-of-term. Fewer than 25% of students regularly brought their texts to class.   Only about 10% to 15% of the students ever participated in class discussion.   In student interviews (a sample of about 30), 20 percent (20%) revealed that they had neverread a single book to completion.   Only 7 students (8.6%) of 81 whose texts were examined knew the fundamentals of text annotation.
  • 13. Example of a Qualitative Assessment:2008 QEP Pilot Group Student Interviews “I never really knew what to study in a textbook before. Now, it’s like a light has been turned on. Thank you professor.” “Textbooks don’t put me to sleep anymore. Now I know what to look for and highlight in my book.” “I went from a D- on my first test to a B on the last one. . . . I never really read my books before. It was because I did not have to. . . ) “I used to hate to read. Now I am beginning to see the value, especially in sociology and history. I used to think history was so boring. . . .” “I want to take more courses that are QEP next semester. It’s more work but you get something out of it. Until this semester, I thought reading really sucked.”
  • 14. Methodology: A Brief OverviewFall 2009 QEP Implementation All Fall campus sections of SOCI 1301 –QEP Group (2009) – taught by co-presenter received several QEP strategic interventions (N = 139) A textbook authored by the co-presenter (Doing Sociology: A Basic Text, 2010 (along with an interactive guide and workbook containing strategic pedagogical interventions) was first used For a comparative fit (Fall to Fall), the QEP Group (2009) was compared to the Non-QEP Group (2008)
  • 15.
  • 18.
  • 20. QEP (2009) = 26.6%
  • 21.
  • 23. QEP (2009) = 56.3%
  • 24.
  • 26. QEP (2009) = 76.3%
  • 27.
  • 30.

Editor's Notes

  1. Shulman says faculty inquiry creates an array of assessments. You decide what you want to measure through faculty inquiry.
  2. Here is what inquiry looks when you “see” the bear. Play Barbara’s blog.
  3. Refer to Barbara’s blog and her observations about students and herself.
  4. Data is in the form of words, pictures or objects – qualitative.Data is in the form of numbers and statistics – quantitative.
  5. What does this tell us about the reading skills of the students in the class?
  6. As the 8th President of the Carnegie Foundation for the Advancement of Teaching says….
  7. Go to handouts.