Pennsylvania Library Association Conference Presentation, State College, October, 4, 2011

1. The Free Library of Philadelphia Hot Spots Program Evaluation Pennsylvania Library Association Annual Conference State College, Pennsylvania October 2, 2011 Colin Rhinesmith, Adjunct Research FellowNew America Foundation

2. Free Library of Philadelphia Hot Spots Program Evaluation Introductions Colin Rhinesmith: Adjunct Research Fellow with the New America Foundation’s Open Technology Initiative and doctoral student at the Graduate School of Library and Information Science at the University of Illinois at Urbana-Champaign: http://people.lis.illinois.edu/~crhines Open Technology Initiative: Think tank in Washington, D.C. thatformulates policy and regulatory reforms to support open architectures and open source innovations and facilitates the development and implementation of open technologies and communications networks: http://oti.newamerica.net/about_oti Colin Rhinesmith, PaLa Conference Presentation 2 10/4/11

3. Free Library of Philadelphia Hot SpotsProgram Evaluation Evaluation Design Process March – May 2011: Determined qualitative and quantitative evaluation needs June – Aug 2011: Inventoried existing data collection tools and developed new instruments Sept – Oct 2011: Presented, reviewed, and finalized the evaluation plan Colin Rhinesmith, PaLa Conference Presentation 3 10/4/11

4. Free Library of Philadelphia Hot Spots Program Evaluation Program Objectives Objective #1: Increase awareness, understanding, and use of computers and the Internet for social and economic development. Objective #2: Increase access to training and social support services for individuals and families. Objective #3: Increase awareness, understanding, and use of library services for community development. Objective #4: Improve comfort with digital media tools, applications, and services for work and play. Objective #5: Increase access to employment and educational opportunities through digital and media literacy skills. Colin Rhinesmith, PaLa Conference Presentation 4 10/4/11

5. Free Library of Philadelphia Hot SpotsProgram Evaluation Program Logic Model Inputs – The resources brought to a project Activities – The actions undertaken to bring about desired ends Outputs – The immediate results of an action (e.g., numbers of “X”) Outcomes – Changes that occur showing movement toward achieving ultimate goals and objectives Reference: Frechtling, J. A. (2007). Logic modeling methods in program evaluation. San Francisco: John Wiley & Sons, Inc. Colin Rhinesmith, PaLa Conference Presentation 5 10/4/11

6. Colin Rhinesmith, PaLa Conference Presentation 6 10/4/11

7. Free Library of Philadelphia Hot SpotsProgram Evaluation Methodology Colin Rhinesmith, PaLa Conference Presentation 7 10/4/11

8. Free Library of Philadelphia Hot SpotsProgram Evaluation Example: Online Survey – Computer Assistant Daily Reporting Tool 1. How did people use the hot spot today?2. What did people accomplish?3. What challenges did people face?4. Which trainings took place?5. How did people use the library's electronic databases?6. How were the books in the reference library used?7. Did anyone sign up for a library card?8. What did you do to promote the hot spot?9. Did you have any contact with community organizations? If yes, please describe the experience.10. Did you have any contact with the host organization? If yes, please describe the experience.11. Please use this space to write a short narrative about your experience at the hot spot today. Colin Rhinesmith, PaLa Conference Presentation 8 10/4/11

9. Free Library of Philadelphia Hot SpotsProgram Evaluation Data Gathering & Reporting Plan Oct 2011: Gather data from online tools, focus groups, and interviews with community partners, computer assistants, and residents. Oct – Nov 2011: Draft, review, and complete formative report June – July 2012: Gather data from survey tools, focus groups, and interviews with community partners and computer assistants August 2012: Draft, review, and complete final report Colin Rhinesmith, PaLa Conference Presentation 9 10/4/11

10. Thank you Contact Colin RhinesmithAdjunct Research Fellow, Open Technology Initiative New America Foundationrhinesmith (at) newamerica (dot) netDoctoral Student | Information in Society FellowGraduate School of Library and Information ScienceUniversity of Illinois at Urbana-Champaignhttp://people.lis.illinois.edu/~crhines Colin Rhinesmith, COSLA Community Webinar Presentation 10 10/3/11