Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.

NYPL Internet Lending pre-pilot OST survey results

637 vues

Publié le

Internet Lending 100 unit pilot survey results.

  • Login to see the comments

  • Soyez le premier à aimer ceci

NYPL Internet Lending pre-pilot OST survey results

  1. 1. NYPL Mobile Hotspot Lending 100 Unit Test Preliminary Metrics July 2014
  2. 2. We have developed a logic model to identify how we can measure impact against the programs 4 goals. Indicators / Measures Goal 1 Goal 2 Goal 3 Goal 4 Source By data tracking/capture: # of devices lent, average length of loan X X Tally % enrollment of eligible households X X Tally % return enrollment of eligible households X X Tally Hours of use, bandwidth used, nature of use (urls visited) X X ISP Library online resource use - measured by urls visited X ISP Educational online resource use - measured by urls categories visited X ISP Cost per use (per $/household, $/mo) X Tally Return rate (devices returned without damage/total devices lent out) X Tally By survey: # of household users (by age, income, employment status) X Survey % of households intending to continue “library lent” internet access X Survey # of households intending to purchase a computer post lend X Survey # of households intending to internet service post lend X Survey Level of satisfaction with and attitudes related to the service X Survey Attitudes or perception of skills of participants understanding of the Internet and computer skills (Confidence, Skills Learned, new usage - comparators) X Survey Programs users are aware of that they did not know about before X Survey Programs users have used X Survey By other tracked data: (Anecdotal) Commitments received by corporate partners X Tally Commitments received by FCC for ongoing funding X Tally Commitments received by other potential funders X Tally Partner libraries sign on to pilot by end of year X Tally Interest expressed by other cities/major library systems X Tally 2 Goal 1 Increase students/household access to at home broadband internet Goal 2 Raise digital exposure and confidence Goal 3 Increase engagement with library-provided and/or recommended learning resources Goal 4 Establish a scalable public library model for tackling the national digital divide
  3. 3. TALLY DATA 3
  4. 4. • A total of 106 households showed interest in the program by completing a user interest form • Of those who communicated interest, 84% were eligible • A total of 91 households are participating in the pilot (98% of those eligible) • A total of 91 wireless routers and 50 Chromebooks were loaned Chromebooks were only made available to Out of School Time (OST) students • 34 households checked out both devices; 47 checked out only the wireless router; and 6 checked out only the Chromebook • 47 participants are ESOL students at Bronx Library Center (BLC); the remaining participants are parents of OST students at Mott Haven (19), Highbridge (13), and Port Richmond (12) Lent 0 20 40 60 Wifi & Chromebook WiFi Chrome Book Spanish English 4 Goal 1 Increase students/household access to at home broadband internet NOTE: • 37% of participating households primarily speak Spanish • TechConnect not channel not tested
  5. 5. ISP DATA 5
  6. 6. There are three program goals measured through ISP and survey data 6 Goal 1 Increase student/household access to at home broadband internet Goal 2 Raise digital exposure and confidence Goal 3 Increase engagement with library-provided and/or recommended learning resources
  7. 7. Activity measurement limitations and related assumptions 7 Method: Activity measured by connections on a particular port. We are not given full destination website addresses due to privacy regulations of the ISP. We were provided the port labels of the destination networks. While not perfect, it does provide a hint as to the nature of activity because certain activity (such as email, streaming video, social media, gaming, chat and messaging) which occurs on uniquely labeled ports. Assumption: Chromebook Activity The port traffic label SPDY we assume to be Google Chromebook traffic. Because we lent Chromebooks to 50% of our participants that traffic may potentially skew the results but only by 2%. “Google” activity for this analysis is essentially Chromebook/Google Apps activity. Assumption: Anonymous Traffic We assume that the "Anonymous" traffic (traffic on ports commonly labeled "HTTP") consists of Google traffic as well. Google owns roughly 68% of all web traffic so we assume 68% of the "Anonymous" traffic is Google traffic as well. NOTE: For the 10K pilot, if we chooses Sprint, we will be able to route all traffic through a monitoring service to intercept CIPA restricted sites (black listed web site categories.) We will therefore, have greater visibility as to the category of traffic based on the full address. This will be anonymous and in aggregate so we preserve privacy.
  8. 8. Users are spending an average of 3.19 hours online per day, and most often at times when the library is closed (6PM – 12AM local) 0 500000 1000000 1500000 2000000 2500000 3000000 3500000 12:00AM 1:00AM 2:00AM 3:00AM 4:00AM 5:00AM 6:00AM 7:00AM 8:00AM 9:00AM 10:00AM 11:00AM 12:00PM 1:00PM 2:00PM 3:00PM 4:00PM 5:00PM 6:00PM 7:00PM 8:00PM 9:00PM 10:00PM 11:00PM Connections Time of Day (UTC) • Average Time on-line: 3.19 hours/day • This equates to 191 minutes vs a single 40 minute session at library during opening hours 8 Goal 1 Increase students/household access to at home broadband internet Note: TIME of Day on chart is UTC so subtract 3 hours for local time.
  9. 9. 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 % Activity vs % Data Volume % Traffic % Volume Data 384.7 GB/mo 173.2 GB/mo 102.7 GB/mo 51.3 GB/mo HH Usage GB/mo 4.23 GB/HH/mo 1.90 GB/HH/mo 1.13 GB/HH/mo 0.56 GB/HH/mo Activity Anonymous YouTube Encrypted Video 9 Goal 1 Increase students/household access to at home broadband internet Goal 2 Raise digital exposure and confidence We see healthy traffic levels around >9GB per household per month, most of which is anonymous
  10. 10. File Sharing, Social Media, YouTube, and Google Web Properties seem to represent bulk of traceable activity online. Anonymous 68% File Sharing 14% Encrypted 6% Social Media 6% YouTube 3% Google 2% Entertainment 1% 95% of Traffic Anonymous File Sharing Encrypted Social Media YouTube Google Entertainment Anonymous 48% YouTube 22% Encrypted 13% Video 6% Social Media 5% App Store 4% Entertainmen t 1% Music 1% 95% of Volume Anonymous YouTube Encrypted Video Social Media App Store Entertainment Music 10 Goal 2 Raise digital exposure and confidence
  11. 11. Usage of educational content is not measurable through ISP data for the 100 unit test, so we will rely on exit surveys to measure this goal Anonymous 48% YouTube 22% Encrypted 13% Video 6% Social Media 5% App Store 4% Entertainment 1% Music 1% 95% of Volume Anonymous YouTube Encrypted Video Social Media App Store Entertainment Music For the 10K test, we will have the ability to capture URL traffic programmatically. We could assume Khan Academy is part of the YouTube activity for our OST students. Other resources like Mango for ESOL or Math Whiz or NYPL are most likely masked due to port labeling and lack of URL logging. 11 Goal 3 Increase engagement with library-provided and/or recommended learning resources
  12. 12. SURVEY DATA – PRELIMINARY Survey data includes 23 responses from parents with children participating in the library’s OST program. 12
  13. 13. Participants report an average of 2.2 adults and 1.6 children per household, or an average of 3.8 total household users 52% 35% 13% 0% 10% 20% 30% 40% 50% 60% 1 2 3 %ofhouseholds # of child users Child Users (ages 5+) per Household 22% 57% 9% 9% 4% 0% 10% 20% 30% 40% 50% 60% 1 2 3 4 5 %ofhouseholds # of adult users Adult Users per Household 13 Goal 1 Increase students/household access to at home broadband internet preliminary survey n = 23
  14. 14. 11% 50% 39% 0% 20% 40% 60% $50K - 75K $25K - 50K Under $25K % of households Total Household Income 27% 55% 14% 5% 0% 20% 40% 60% Employed full- time Employed part- time Not employed, looking for work Student % of households Employment Status – Head of Household 14 Goal 1 Increase students/household access to at home broadband internet preliminary survey n = 23 Nearly all households report incomes under $50K, and less than one third of all heads of household are employed full-time
  15. 15. The majority of respondents report that they have gained confidence in both their own and their children’s ability to use the Internet 26% 19% 43% 57% 30% 24% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Own Ability (Adult) Child's Ability Much more confident than before More confident than before About as confident as before Since participating in the Internet Lending pilot how confident are you in your own / your child’s ability to use the Internet? 15 Goal 2 Raise digital exposure and confidence preliminary survey n = 23 **“Much less confident” and “less confident” were also answer options
  16. 16. 39% 39% 43% 57% 70% 91% 0% 20% 40% 60% 80% 100% Finding or applying for a job Connecting with friends / family (e.g.… Learning job-related skills Keeping informed of current events Checking information about child's… Helping child with schoolwork % of respondents Nearly all respondents used the Internet to help their children with schoolwork, and many used it for job-related purposes In the past two months, have you used the Internet for any of the following reasons? 16 Goal 2 Raise digital exposure and confidence preliminary survey n = 23
  17. 17. If offered Internet service for $10 / month, the majority of respondents feel it is somewhat or very likely they would purchase it in the next six months How likely is it that you will purchase a computer or Internet service in the next six months? 30% 10% 13% 19% 13% 13% 38% 30% 33% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Computer Internet Service ($10/month) Very likely Somewhat likely Neither likely nor unlikely Somewhat unlikely Very unlikely 17 Goal 2 Raise digital exposure and confidence preliminary survey n = 23
  18. 18. The vast majority of respondents were promoters of both the library’s wireless Internet and Chromebook services 90% 10% NPS – Internet Service Promoter Detractor Passive Net Promoter Score = 80 96% 4% NPS – Chromebook Promoter Detractor Passive Net Promoter Score = 96 18 Goal 2 Raise digital exposure and confidence preliminary survey n = 23 Net Promoter measures the likelihood of patrons recommending our services to a friend or coworker by asking, “on a scale of 0 to 10 (10 being the highest and 0 being the lowest), how likely are you to recommend (X) to a friend or colleague?” Promoters are people who select 9 or 10, passives 8 or 7, and detractors those who picked 0 through 6. The Net promoter score is then calculated by subtracting the % of promoters by the % of detractors.
  19. 19. Nearly all households intend to renew their devices 19 Goal 2 Raise digital exposure and confidence preliminary survey n = 23 How likely is it that you will renew the device after the current loan period ends? 5% 5% 5% 5% 10% 85% 86% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Wireless Router Chromebook Very likely Somewhat likely Neither likely nor unlikely Somewhat unlikely Very unlikely
  20. 20. 18% 14% 23% 9% 9% 9% 27% 32% 41% 36% 32% 14% 9% 14% 14% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Khan Academy Math Whiz Power My Learning In the past two months, how often did your child visit the following websites? Daily or more A few times a week Once a week 20 Goal 3 Increase engagement with library-provided and/or recommended learning resources preliminary survey n = 23 Respondents indicated frequent usage of all three library- recommended learning resources included in the survey

×