1. WORKSHOP # 2 Vision to Know and Do :Helping Educators Use Data Effectively ASBO International 2005 Annual Meeting FRIDAY, OCTOBER 21, 2005 Boston, MA

2. WORKSHOP AGENDA Learning about CoSN’s Data-driven Decision Making Initiative: Vision to Know and Do Small Group Exercise Reporting Out and Reaching Consensus

4. an easy to use mechanism for educating school leaders

5. a nationally-recognized framework for sharing knowledgeSupported by Founding Partners ETS, IBM and SAS with additional support from Co-nect, Dell, Pearson Education, Plato Learning; PowerSchool , SchoolNet, and Texas Instruments. Scholastic Administr@tor is the Media Partner.

6. DEFINITION Data-Driven Decision Making A process of making choices based on appropriate analysis of relevant information

7. DATA DRIVEN DECISION MAKING PROCESS Determine your desired outcome Define your business processes Identify data available

8. VISION TO KNOW AND DO Released Vision to Know and Do: The Power of Data as a Tool in Educational Decision Making and From Vision to Action: How School Districts Use Data to Improve Performance ,in depth examinations of the issue Created a rich website, www.3d2know.org Developed a self assessment tool to estimate a district’s readiness to use data-driven decision models Convened a Congressional Seminars in Washington, DC Issued quarterly newsletter, Vision to Know and Do newsletter

9. CURRENT CONTEXT Data collection, analysis and reporting are critical components of No Child Left Behind (NCLB). School districts must collect more data, in more detail and disaggregate them. State-level systems and support are being developed for collecting and integrating student assessment data with demographic information.

10. NATIONAL EDUCATION TECHNOLOGY PLAN TowardA New Golden Age in American Educationcalls upon states, districts and schools to establish a plan to integrate data systems; use data from both administrative and instructional systems to understand relationships; ensure interoperability; and use assessment results to inform instruction.

11. NCLB "Information is the key to holding schools accountable for improved performance every year among every student group…Data is our best management tool. I often say that what gets measured, gets done. If we know the contours of the problem, and who is affected, we can put forward a solution. Teachers can adjust lesson plans. Administrators can evaluate curricula. Data can inform decision-making. Thanks to No Child Left Behind, we're no longer flying blind." Secretary of Education Margaret Spellings

12. MOVING BEYOND THE MANDATE Current environment is an opportunity to: use data to transform teaching, learning and administration. inform decisions about everything from class schedules to textbook reading levels to professional development budgets. provide a rationale for decisions that parents, teachers, taxpayers, and students can understand.

13. TEN REASONS TO BRING DATA INTO DECISIONS Assess the current and future needs of students Decide what to change Determine if goals are being met Engage in continuous school improvement Identify root causes of problems Align instruction to standards. Provide personalized instruction. Track professional development Meet accountability provisions of NCLB Keep constituents informed about progress.

14. DATA AND HURRICANE KATRINA The Mississippi Student Information System—which stores the past four years of student records—is serving as a backup for districts that have lost crucial equipment and software, and the information they contain. Mississippi districts receiving evacuated students from other districts in the state are tapping the state’s database for course records, grades, Carnegie units, and special classifications, thus smoothing those students’ transitions into new schools.

15. Perceived Benefits of Technology (Digital Leadership Divide,CoSN/Grunwald Associates Survey)

16. Small Medium Large Total DATA-DRIVEN DECISION MAKING Districts That Employ A Data-driven Decision Making Process (Digital Leadership Divide: CoSN/Grunwald Survey)

17. CHANGING THE MINDSET Why does education data make educators so uncomfortable? To only slightly exaggerate, for the past 150 years data was something a third party required you to gather about yourself so they could embarrass you with it three months later. Or so teachers and administrators believed. Data was something higher-ups would use to catch you doing something wrong. No longer. As Montgomery County MD Superintendent Jerry Weast elegantly says, in his district, he uses data to catch you doing something right. That’s the good news. The better news is that the idea is catching on.

19. Identifies factors for successfully integrating data into decision making processes

21. Data Rich District:Rural Response to Local Expectations Name: Chugach School District Location: Prince William Sound, Alaska Enrollment: 214 students

23. Hold town meetings to shape a shared vision

24. Implement balanced instructional model

25. Write standards in a continuum from pre-kindergarten through 16

26. Determine assessments aligned to standards

27. Change reporting process for children, parents, teachers

30. Collect data using electronic methods

31. Deliver information to decision makers (classroom, building, district)

33. Define district goals, objectives and projects Collect data using format and informal check points Check stakeholder satisfaction Analyze promptly and share results Compile analyses annually Evaluate performance and achievement Pearl River Improvement Process

35. It has to start at the top.

36. Progress has to be measurable

37. Business models are starting points.

38. Community outreach is essential.

40. DATA RICH DISTRICTS From Vision to Action draws from interviews with more than 30 experts around the country Detailed profiles of Lemon Grove School District (CA), Fulton County Schools (GA) and Cleveland Municipal School District (OH). Profiles and examples in From Vision to Action provide others with examples and techniques.

41. DISTRICTS INTERVIEWED *Indicates 2003-2004 enrollment.

42. FULTON COUNTY, GA Getting started: District wide strategic planning process in place Implementation: Cross functional teams help school site with data use and analysis Results: All elementary schools met AYP targets in 2003-4

43. LEMON GROVE Getting started: ubiquitous access to technology and focus on literacy Implementation: easy to use reports of multiple measures Results: 3 out of 4 Title I schools declared high achieving

44. CLEVELAND MUNICIPAL SCHOOL DISTRICT Getting started: data warehouse developed with site specialist access Implementation: Data teams discuss and analyze results to apply interventions Results: Reduced unexcused absences in one school from 9% to 2%

45. KEY THEMES Implementing a successful school district data-driven decision making process requires a collaborative team approach. The process is continual and cyclical moving from the collection of data , to reporting and analysis and finally to using data for targeted interventions. Technology tools can be effectively utilized in the process.

46. TEAM APPROACH TO SUCCESS design and implementation involves the IT department, curriculum and instruction, assessment ,evaluation, and professional development with oversight by the superintendent. integration into classroom practice requires the buy-in of teachers, principals and site-based support staff

47. Technology Tools Data Information = TECHNOLOGY MATTERS

48. TECHNOLOGY MATTERS Technology is constantly changing Information is the result of passing Data through Technology Tools Technology, by itself, has no value Results are primary goal

49. Applications SIS Assessment Finance Instruction Components of a Data Based Decision Making System School Interoperability Framework & IMS Reporting and Analysis ServicesTurning data into useful information Dissemination Sharing data with the community (ie: report cards) Data Warehouse Reports State and Federal Reporting Meeting reporting compliance Training Learning how to use data to make informed decisions. Personalized Instruction Source: US Department of Education, 2003.

50. DATA DRIVEN DECISION MAKING PROCESS A process of three functional areas: collection, integration and dissemination of data; analysis and reporting of data; and process and procedures for acting on the data.

52. Are the technical and human support tools in place to move data from warehouse to schoolhouse?

53. Are systems developed to integrate data into instruction?

54. Are teachers using assessments to measure progress?

56. Does the district support the process with analytical tools and trained staff to give decision makers confidence in the data and tools?

58. Have data teams developed a process for identifying, recommending and implementing intervention based on data?

61. Interoperability 42%

62. Lack of understanding about what to do with the data 39%

63. Absence of clear priorities 36%

66. LESSONS LEARNED Select your technology team based on expertise and ability to perform Technologies employed must be based on the business goals and not the other way around Let the technology team do their job with frequent check points to the business model

67. ONLINE ASSESSMENT TOOL Take a simple 10-question assessment is available at 3d2know.cosn.org/assessment/survey.cfm Receive an immediate response Learn where you are in the process of becoming a data rich district

68. NEW: FAQ’S Visit www.3d2know.org View the full list of FAQ’s Coming Soon: Moderated discussion around these questions

70. Publications

71. Best Practices

72. Other Resources

74. GROUP EXERCISE #2 Report out your findings Share your experiences Capture the findings --- We want to present these to a larger audience and post on www.3d2know.org

75. ABOUT COSN CoSN Mission To promote the use of information technologies and the Internet to ensure technology has a positive effect on learning by focusing on leadership development, coalition building, advocacy and emerging technologies. Audience Key technology leaders at the school district, state and national level

76. CoSN GOALS Leadership Development: supporting school leaders to ensure technology has a positive effect on learning Advocacy: creating an effective voice on education technology issues Coalition Building: building partnerships and collaborative efforts around the use of technology in schools Emerging Technology: exploring meaningful uses for new technologies in education

77. COSN LEADERSHIP INITIATIVE New!! Accessible Technologies for All Students Project http://www.accessibletech4all.org/ increasing achievement and success for all students through the unlimited and effective use of accessible technologies Taking Total Cost of Ownership (TCO) to the Classroom http://classroomtco.cosn.org/ Helping School Leaders Budget More Accurately for Education Technology Safeguarding the Wired Schoolhouse http://safewiredschools.cosn.org/ Resources to Help School Administrators Understand Internet Safety Strategies 3D: Vision to Know & Do http://3d2know.cosn.org/ Enabling Educators to Think Strategically about the Use of Data Driven Decision-Making Cyber Security for the Digital District http://securedistrict.cosn.org/ Ensuring Security of School Networks

78. Irene K. Speroirene@cosn.orgVice President202-861-2676 x112 1710 Rhode Island Ave., NW #900Washington, DC 20036www.cosn.org