Key performance indicators (KPI) can transform college and career readiness goals into a plan for continuous improvement of student outcomes. During this session, administrators will learn best practices for using Naviance to track individual students and to develop longitudinal data sets on student engagement and performance. Discover how this information can improve practices and policies throughout your school or district. *This session is for administrators only. Todd Bloom, Chief Academic Officer, Hobsons

1. KPIs for College & Career
Readiness
Todd Bloom, Ph.D.
Chief Academic Officer, Hobsons
July 12, 2012

2. Agenda
Policy, Research & Market Development
at Hobsons (5 min)
Contextualized Need for KPIs (15 min)
Your Key Performance Indicators (15 min)
KPIs Prioritized and Shared (15 min)
Q & A / Wrap-Up / Evaluation (15 min)
1

3. Policy, Research & Market
Development at Hobsons

4. What our team does
Monitor and influence policy concerning P-
20 student success (e.g. RttT-D info, state-mandated ILP
and graduation plans, ESEA Waivers)
Conduct relevant research (e.g. ILP report, bridges
blog, personalized learning)
Keep you informed on key issues
• Social media (blog, Twitter)
• Articles and white papers
3

5. Contextualized Need for KPIs:
From Macro Trends to Local Response

6. Global Economic Competition
“The goal for America’s educational system is clear: Every
student should graduate from high school ready for college
and a career by 2020. We must lead the world in college
completion by 2020” – President Obama
We’re in 16th place and we’ve heard this before…
• 1983 – A Nation at Risk (standards)
• 1994 – Goals 2000 (performance targets)
• 2001 – No Child Left Behind (accountability)
• 2009 – ARRA/Race to the Top
5

7. Global Economic Competition
Skeptical practitioners – The college completion goal
http://chronicle.com/article/A-Crisis-of-Confidence/127530/
6

8. Global Economic Competition
7

9. Cost for K12 Provider
Deep reductions to K-12
state formula funding
since the onset of the
recession
• ARRA has expired
• Rainy day funds are
exhausted
• States have resisted raising
additional taxes
• Pressure on school districts
• New School Year Brings
Steep Cuts in State Funding
for Schools
(Center on Budget & Policy Priorities)
8

10. Cost for Higher Ed Provider
9

11. Consumer-Driven Education
More than ever, education consumers (students) have
more informed choice
• Access to K-12 and HE institutional data to determine best SROI
• Growth of K-12 school choice (charters) and proliferation of
postsecondary options
• Increase in college applications per student/HE cost per student
enrollment (NACAC: 7/student in 2012)
However, choice is dependent on access to
information, which is not afforded to all students…
10

12. Consumer-Driven Education
The consumer will “look” different in the future…
K-12 student demographics (2010 to 2020)
• flat for students who are White; Black;
• increase 25% for students who are Hispanic;
• increase 36% for students who are Asian/Pacific Islander
• increase 17% for students who are American Indian/Alaska Native
HE student demographics (2010 to 2020)
• flat for students who are White; American Indian/Alaska Native
• increase 25% for students who are Black;
• increase 46% for students who are Hispanic;
• increase 25% for students who are Asian/Pacific Islander
The Center for Public Education
11

13. Consumer-Driven Education
Demand for anywhere, anytime, AND relevant learning
Distance education, hybrid models that blend online with face-to-
face instruction (Rocketship Education)
iTunesU, DIYU, Utube/edu
“Small” colleges – Pepperdine U in Malibu AND Buenos Aires,
Florence, Heidelberg, London, Shanghai, Switzerland
The online universities
MOOC
12

14. Macro Forces - Policy - Local
K-12 Postsecondary
• Common Core State Standards & • Emphasis on college completion and
assessments “gainful employment”
• SLDS • Shifting finance models in response
• Student growth monitoring and to decreased state funding (Obama
engagement efficiency demand)
• Teacher and principal • SROI of remediation
effectiveness • Instructor effectiveness
• Statewide P-20 data systems • Student “recovery”
• ILP and RttT -D
Huge theme: information drives performance and high performance gets results!
13

15. Your College and Career Readiness
KPIs

16. Your KPIs
Independently brainstorm college and career
readiness indicators that you
collect, monitor, and share with others.
Share your KPIs with the person next to you.
• Are these KPIs outcomes or inputs?
• How often do you review these KPIs?
• With whom do you share the KPI performance data
• How do you know which are most important?
15

17. KPI Data and Guidance
 Sources of Data
 Naviance reports
 Surveys
 SIS
 National Student Clearinghouse
 Guidance
 College Readiness Index System (Annenberg Institute for School Reform)
 School Districts Scorecards (Montgomery Co, Anoka, Gwinnet Co, Fulton Co,
etc.)
 Council of Great City Schools
16

18. Student Growth & Proficiency
 Grade Point Average  % of students who used
 Test score averages PrepMe at least once
– PLAN  % of students who complete
– PSAT the learning style assessment
– SAT  % of students who complete
– ACT
Do What You Are assessment
– State assessment(s)
 % of students who complete
 International Baccalaureate
Career Key assessment
scores
 % of students who complete
 International Baccalaureate
a Course Plan
scores by course
 Course Plan Rigor distribution
17

19. College Planning
 College Power Score  Number of applications for
distribution individual colleges
 Alignment of Course Demand  % of students who submit
Forecast with college one or more college
readiness curriculum applications
determined by school/district  % of students admitted to one
 Student interest in specific or more colleges
courses that school/district  % of students who intend to
indicate align with college attend college after
readiness goals graduation
 Meaningful and up-to-date
 Number of applications for scholarship database
individual colleges available for student use
18

20. Career Planning
 % of students who identify careers and career clusters of interest
 % of students interested in professional careers
 % of students interested in technical careers
 % of students interested in careers with specific
characteristics, such as STEM, that are determined by the
school/district
19

21. Student Engagement
 % of students who report  % of students who report they
understanding their learning understand the knowledge
styles and skills necessary for
 % of students who report they success in their careers of
have explored colleges and interest
careers based on learning  % of students who set goals
style assessment  % of students who met goal
 % of students who report they  % of students who completed
understand the links between tasks that align with college
careers, preparation and career readiness as
needed, college major and determined by the
projected income school/district(e.g. FAFSA
completion, internship/
mentorship requirement)
20

22. Alumni Performance
 % of students who enrolled in  % of students who are
college satisfied with their post high
 % of students who completed school plans
college degrees  % of students who enrolled in
 % of students who completed remedial college
college degrees within a mathematics, English or other
specified timeframe courses
 % of students who completed
 % of students with positive remedial college
perceptions of college and math, English or other
career readiness courses
 % of students satisfied with
teaching or other specified
aspects of their K-12
experience
21

23. KPI Prioritization
Form a team with 3-5 people. Review the hand-out of
KPIs. For each of the 5 areas below, identify 3-5 KPIs that
your team believes are most important (i.e. “key”) to
monitoring or predicting college and career readiness.
Justify why your team’s selections are most important.
Share with whole group.
 Student growth and proficiency
 College planning
 Career planning
 Student engagement
 Alumni performance
22

24. KPIs and Promising Practices
For those KPIs which we all find to be “key”, how might
we benefit from sharing our results?
[IMPORTANT: What is “key” for some schools/district may not be for others – check
your school/district strategic plan]
How could we share promising practices associated with
dramatic KPI improvement?
Are there barriers to sharing KPI performance and
promising practices across schools/districts?
Could we develop more robust CCR KPIs?
23

25. Suggestions: KPIs Must Live
• Build a college and career readiness “scorecard” (set of
KPIs) for your school/district
– But don’t do it alone
• Consider performance targets for each KPI
– Determine reasonability through (internal and
external)benchmarking
• Consider who and what drives/influences each KPI
• Manage to the KPIs
– If KPIs are “key”, then they ought to impact change
• Share scorecard results with all (those who impact and
those who are impacted by)
24

26. Suggestions: KPIs Must Live
Managing to KPIs is similar to great teaching:
25

27. Questions and Observations
What did you not learn that you wish you had?
How could Hobsons K12 provide you with
support with regard to college and career
readiness KPIs?
26

28. Recent Release:
Top 11 Trends in Higher Education (and they matter to K12)
Please complete evaluation
27

29. Todd Bloom
todd.bloom@hobsons.com
@todd_bloom