Presentation describes creating a culture of assessment at your institution. And outlines a study of four analytical questions developed by the AAHSL Task Force On Qualitative Assessment.

1. E (p) owering Your Institution A Mixed-Model Approach to Assessment © 2004 Douglas Joubert Douglas James Joubert Greenblatt Library

4. Creating a Culture of Assessment Culture of Assessment Benchmarking ARL Service Academy AAHSL Task Force Questions LibQUAL+ “ Aspirational” “ Comparator”

5. Speaking a common language Q ua n t i t a t i v e Input Output Outcomes Qualitative Performance Indicators Assessment

6. Influential Players Input Output Outcomes Qualitative Performance Indicators Assessment

7. Mixed Model Approaches

8. Linear Model of Research Adapted from Flick, 2002 Theory H 1 Sampling Analysis Validation

9. Circular Model of Research Adapted from Glaser & Strauss, in Flick, 2002 Comparing Comparing Comparing Sampling Sampling Case Textual analysis Case Textual analysis Case Textual analysis PA T

10. Quantitative Research Quick! get to the cheese To Maze

11. Qualitative Research I really don’t like cheese I need a vacation Do these frames make me look smart? To Maze Why am I here?

12. Qualitative Research “ Triangulation ” “ Grounded Theory” “ Bricoleur ”

13. Statistical Inference Flowchart Adapted from Rosner, 2000 Two Variables? Both continuous? Prediction? r/s between 2 variables? Both variables normal? Pearson correlation Rank correlation Linear regression Y Y N Y Y N Y

14. Overall Data Considerations 24 th AAHSL 25 th AAHSL Local SPSS Tables Local SPSS Tables Local SPSS Tables 2002 LibQUAL+

15. Overall Data Considerations N > 13,000 24 th AAHSL 25 th AAHSL Local SPSS Tables Local SPSS Tables Local SPSS Tables 2002 LibQUAL+

16. Overall Data Considerations Descriptive 24 th AAHSL 25 th AAHSL Local SPSS Tables Local SPSS Tables Local SPSS Tables 2002 LibQUAL+

21. Hypothesis 1 Hypothesis I (H 1 ) was operationalized as, “What is the affect of library reporting structure on the mean measure of overall quality of service?”

27. Descriptive Statistics for Overall Quality of Service 19.2% 1.408 7.35 13127 Total 19.4% 1.393 7.19 759 University Library 20.2% 1.457 7.22 649 Other 17.6% 1.323 7.50 5972 Health Science Center 22.0% 1.583 7.18 879 University Administration 20.1% 1.451 7.23 4868 Medical School CV (%) SD Mean Count Library Reports To How would you rate overall quality of the service provided by the library?

28. Type III Tests of Fixed Effects for Overall Quality of Service a a. Dependent Variable: How rate overall quality of the service? .464 .924 27.038 4 LIBSTRUC .000 6640.536 26.927 1 Intercept Sig. F Den df Num df Source

29. Hypothesis 3 Hypothesis 3 (H 03 ) was operationalized as, “How does the number of constituents served affect satisfaction ratings?”

33. Descriptive Statistics for H 3

37. Transformed Correlations 32 N .027 Sig. (2-tailed) -.391* Pearson Correlation Total Constituents Served LibQUAL+ Mean Overall Quality of Service by Institution * Correlation is significant at the 0.05 level (2-tailed).

39. Total Constituents as a Predictor of Measures of Overall Quality of Service Total Constituents accounts for 15.3% of the variance of M_OQS X Y .153 .391 R 2 R

41. Collaboration & Innovation Building Connections Biostatistics AAHSL Peer Networks New Directions Qualitative 2005 LibQUAL Local Projects