CIL 2011 Performance Measures: Illustrating Value to Your Community for web
•
0 j'aime•534 vues
Recommandé
Recommandé
Contenu connexe
Tendances
Tendances (20)
Similaire à CIL 2011 Performance Measures: Illustrating Value to Your Community for web
Similaire à CIL 2011 Performance Measures: Illustrating Value to Your Community for web (20)
Plus de Rebecca Jones
Plus de Rebecca Jones (20)
Dernier
Dernier (20)
CIL 2011 Performance Measures: Illustrating Value to Your Community for web
- 1. Performance Measures Illustrating Value to Your Community Rebecca Jones, MLS rebecca@dysartjones.com 905.731.5836 www.dysartjones.com
- 2. Can we talk?How’s your value measuring up? Attribution: Michiel1972 at nl.wikipedia
- 4. Demonstrate that the library makes a difference
- 5. Focus attention on what is being done & what is most important for the organization
- 6. Are critical for managing, planning & decision-making
- 9. Most measures indicate past performance
- 10. No cause-and-effect relationship between measures
- 11. Performance measures quantitative, but library outcomes are largely qualitativeMeasuring for Results: The Dimensions of Public Library Effectiveness, Joe Matthews, 2004
- 13. The first conversation shouldn’t be when measures are presented
- 14. “More” isn’t necessarily better
- 15. In fact, “more” clouds the issue and the message
- 16. There are two types of measuresoperational & management purposes Strategic & stakeholder purposes
- 17. Measures Are, by definition, based on a “beginning” or monitors results against an agreed-to objective or value
- 19. How much is it doing?
- 20. How well is it doing it?
- 25. understand their culture
- 26. performance measurement system that fits that culture
- 27. “Value” is dynamic, economic , psychological & relative to alternativesLearning from others
- 29. Focuses on what matters most to library’s success
- 30. Understanding what’s being accomplished rather than on what’s being performed
- 31. Uses a common language with staff and decision-makers
- 32. Specifies owner
- 34. Informal survey …demonstrate the library’s value to its users, students/faculty, university, community, or clients? What measures? How do you identify the measures? Have you changed them in the past 2-5 years?
- 36. Stories have replaced stats Increasingly: Measures agreed to &/or aligned with decision-maker measures Follow-up de-briefs with a few ppl for impact or “difference made” discussions Time saved + costs avoided; possibly ideas generated Internal monitoring vs. decision-maker value Decreasing!
- 37. We need to measure new things in new ways Stories of Impact eat Statistics for breakfast
- 38. Usage Statistics
- 41. Benefits of Scorecard “…a clear understanding of what drives value within your area and what doesn’t…………. ……..greater insight into senior management’s strategic plans …….and a better knowledge not only of the strategic role you play within the organization but how you can enhance that role and sit at the decision-making table” Joseph DeFeo, Measuring What Matters. Industrial Management, v.42,n.3, May 2000
- 42. ARL’s Balanced Scorecard Project Collaborative project with Ascendant Strategy Management Group Participating libraries: Johns Hopkins University McMaster University, University of Virginia University of Washington. To assist, train, and facilitate use in a small number of ARL libraries Test the value of a collaborative model for learning about and implementing the new tool.
- 43. User Perspective How well is the library meeting the needs of our users? Internal Process Perspective How do the library's internal processes function to efficiently deliver library collections and services? Finance Perspective How well are the library's finances managed to achieve our mission? Learning/Growth Perspective How well is the library positioned to ensure that goals are met in the future?
- 47. Align library outcomes with:
- 50. Success
- 55. The value of closing the digital divide to employment & education in communities
- 60. Based on “logical links” cause & effect
- 61. Logical links:
- 62. IF the library ensures current, reliable information for project teams, THEN the project team’s decisions will be based on the best information available
- 65. Academic Library
- 66. Start with the end in mind Refocus from the activity to the impact
- 67. Understand the context Align strategies & objectives Identify programs & services Define measures Manage collection Measurement Framework Interpret data Communicate results Adapted from Measuring What Matters: A Library/LRC Outcomes Assessment Manual by Lindauer
- 68. Understand the Context “The greatest chance of success will come from affiliating the library with the unique goals of its parent organization, and the needs of the people working to hit those targets.” Jim Matarazzo, “Corporate Score,” in Library Journal, v 132, #2, pp 42-43
- 69. Know the contexters Name your stakeholders In your environment, how is value defined, measured & communicated? How do they measure their progress?
- 70. Align Strategies & Objectives Example taken from “Identifying and Communicating the Contributions of Library and information services in Hospitals and Academic health sciences Centers” by Eileen Abels and Keith Cogdill in the Journal of the Medical Library Association January 2004 pp. 46-55
- 71. Define success What will success look like? Then ask how will you track success/progress towards meeting goals & objectives What indicators or measures will you use? Qualitative? Quantitative? What data needs to be collected? How? Keep it key Keep it simple Be practical Don’t get mired – or overwork frontline staff
- 72. Define measures by success being sought
- 73. Understand the context Align objectives Identify programs & services Define measures Manage collection Measurement Framework Interpret data Communicate results Adapted from Measuring What Matters: A Library/LRC Outcomes Assessment Manual by Lindauer
- 75. Determine a collection schedule
- 76. Work out agreements with other departments that have needed data
- 77. Divest current data collection or indicators that are no longer relevant to invest in new measures
- 79. What does the data say? What doesn’t it say?
- 80. Examine it from various angles
- 83. Focus on the few critical “There's no magic set of metrics that works for everyone. Similarities exist between libraries with similar goals or individuals with similar roles. But the question, “What should I measure for my library?” has no stock answer. You have to figure out for yourself which metrics will most assist you with what you're trying to accomplish.” Adapted from Melaney Smith, Four Steps Toward Actionable MetricsAnalyzing Customer Data June 3, 2003 http://www.clickz.com/res/analyze_data/article.php/2215751
- 85. Demand for meaningful measures in a complex, crowded, competitive environment
- 86. What will not change?
- 88. Thank you Let us know how you are doing! jane@dysartjones.com rebecca@dysartjones.com
Notes de l'éditeur
- Ulla’s book
- Press the easy button
- I’m factoring into this what Jane & I see & hear from clients- A few with more impact
- Aligns measures with strategies to track progress, reinforce accountability and prioritize improvement opportunitiesA “system” of measures based on 4 perspectives:customer internalfinancialInnovationLimits measures to those most criticalIn the past, libraries focused on the internal process perspective (cost, time, quality) to measure their activities and services and implement change. Yet, a big shift from the internal process perspective measurements to the customer perspective measurements (how much the customer is satisfied by the service) was noticed in the last two decades. However, the implementation of the balanced scorecard in libraries did not occur until the early 21st century where many libraries, NGO’s, and governmental agencies took the initiative in applying BSC in their institutions. One successful experience took place at the University of Virginia library that developed a plan to implement the balanced scorecard in 2001.
- McMaster is one of four libraries in North America participating in the Association of Research Libraries’ (ARL) Library Scorecard Pilot, based on the Balanced Scorecard framework created by Harvard business professors Robert S. Kaplan and David P. Norton. The Scorecard allows us to examine our current and future performance based on four balanced perspectives (the user, staff learning and growth, internal processes and financial health). We have identified 10 objectives, each of which corresponds directly to one of the 4 perspectives above. The objectives are also linked to one of 25 measures, some, standardized tools that can be benchmarked against other libraries (e.g. LIBQUAL results), others, in-house instruments designed to capture aspects unique to our local environment.We have set targets for each measure and have scored ourselves as green (meeting the target), yellow (approaching the target, but not there yet), or red (not meeting the target). To view our progress, please visit: library.mcmaster.ca/library-scorecard.
- OCLC was awarded a grant from the Bill and Melinda Gates Foundation to explore attitudes and perceptions about library funding and to evaluate the potential of a large-scale marketing and advocacy campaign to increase public library funding in the U.S. The findings of this research are now available in the OCLC report, From Awareness to Funding: A study of library support in America. Though this study was based on data from the United States, there are findings in the report that could be applicable to any library seeking to understand the connections between public perceptions and library supportARCL – very first recommendation:Define outcomes
- The Economic Value ofThe Free LibraryIn PhiladelphiaOctober 21, 2010Fels Research & ConsultingUniversity of Pennsylvania, Fels Institute of GovernmentDeborah Diamond, Ph.D., Senior ConsultantKevin C. Gillen, Ph.D., Research FellowUniversity of Pennsylvania, Institute for Urban ResearchMarissa Litman, AssociateDavid Thornburgh, Executive DirectorA traditional economic impact/economic value assessment of the Library was part of the answer to this question. However, in order to really answer the question “what’s the Library worth,” the team at Fels looked at the Library’s value in relation to the experiences that people have with the Library and the reasons they use it. In other words, the “value” question has to be answered in the context of Library usage. What’s the value of the Library to job seekers? To business owners? To parents of school children? Measuring the value of the Library in the context of the Library’s mission and the ways it adds value to people’s lives was intended to make the economic impact and value story easier to understand and more meaningful. Using circulation data, in-depth customer interviews, online and hard copy surveys, and field research, the team at Fels assessed the Library in four areas: Literacy, Workforce Development, Business Development, and Value to Homes and Neighborhoods. Their findings, detailed in the PDF of the study below, show that the Free Library provided millions of dollars in economic impact to the City of Philadelphia in FY 2010.Literacy, Workforce Development, BusinessDevelopment, and Value to Homes and Neighborhoods.Literacy The economic value of the Library services that help Philadelphians learn to read andacquire working skills totals $21.8 million for FY10, comprised of:◦ $18.4 million in literacy-related reading & lending◦ $2.6 million in literacy related programming◦ $818,000 in literacy-related online activities 10% of survey respondents report “ I couldn’t have learned to read without thelibrary,” meaning an estimated 10,788 people attribute their ability to read to the FreeLibrary. 13% of survey respondents report they taught someone else to read and could nothave done it without the Free Library, meaning 14,024 people attribute their beingable to teach someone to read to the Library.Workforce Development The economic value of the Library services that help Philadelphians locate jobopportunities and develop career skills totals $6 million for FY10, comprised of:◦ $2.2 million in career development book-reading & lending◦ $2.1 million in job-finding online activities, including workforce database usageand online job searching/prep◦ $1.7 million job-readiness and workforce-related programming Fels estimates that 979 Philadelphians found jobs directly as a result of the resourcesprovided by the Library in FY10.◦ 979 entry-level jobs translates into $30.4 million in earned income in one year(at an average entry-level salary for Philadelphia), generating $1.2 millionannually in wage tax revenue for the cityBusiness Development The economic value of the Library services that help Philadelphians develop orenhance their own businesses totals $3.8 million for FY10, comprised of: $2.9 million in business development online and database activities $819,285 in business development book-reading & lending $55,385 in business development programming 8% of survey respondents report that they could not have started, grown or improved theirbusiness without the Free Library, resulting in an estimated 8,630 businesses that benefitedfrom Free Library business development services.Fels Institute of Government, University of PennsylvaniaFels Research & ConsultingThe Economic Value of the Free Library in Philadelphia
- U of VirginiaJim Self, the director of management information services at the University of Virginia library, stated that the balanced scorecard helped librarians to better control statistical operations by limiting the number of metrics between four and eight per perspective. Also, two targets for each metric were defined to measure achievements. Self believed that the “intelligibility” of the balanced scorecard allowed the library to assess its yearly performance by looking at the overall performance pie chart and by comparing charts of different perspectives in order to understand how well the library is doing and locate places that need improvements.1. The first step is in examining the library’s mission statement and reformulating it, if required, to make it as clear and simple as possible. The mission statement should be at the center of the balanced scorecard project. Then, a plan of work, relating the mission statement to the four perspectives of the BSC, should be drafted. Librarians must ask for example: what kind of financial changes do we need to realize the goal stated in the mission statement? Or what are the internal changes needed to increase staff performance? These questions will help defining the performance metrics for each perspective to be used for measuring the actual performance of the library.2. The balanced scorecard project manager presents the performance metrics to all people involved in the project by organizing meetings with the public and the library managers. The objectives of these meetings are to create awareness of the goals of the BSC project and to gain support from people involved in the process.3. The BSC project manager chooses a reasonable number of metrics for each perspective (3 to 6 metrics), ensures that the chosen metrics are measurable, and defines one or more targets for each metric. Different methods can be used to gather the data.4. The performance metrics will be used to measure the performance of the library from different perspectives and stimulate employees and managers to think how the library should react in light of the gathered data, and the results must improve performance in the future.5. The last step is to disseminate the findings to the concerned people including employees, managers, community, and funders. The distribution of the results has both internal and external values. It gives employees a clear idea about their actual performance and what it should be done to improve performance in the future. In addition, sharing the results with the public raises awareness of the library’s future services and plans within the community. In addition, the results will provide funders with exact figures on how the funds are used by the library and their effects on users.