Sharon Wavle, Associate Director, Decision Support & Reporting, Office of Online Education at Indiana University. Presentation: Finding Common Ground: Online Education Definitions and Data across the Big 10 https://sunyonlinesummit2020.edublogs.org/2020/01/12/commonground/ https://sunyonlinesummit2020.edublogs.org/about/day-2/ Annual conference for the SUNY online teaching and learning community of practice. https://sunyonlinesummit2020.edublogs.org/ February 26-28, 2020, NY, NY Conference website: http://opensunysummit2019.edublogs.org/ Program: https://sunyonlinesummit2020.edublogs.org/about/program/ Speakers: https://sunyonlinesummit2020.edublogs.org/speakers/ Recordings: https://sunyonlinesummit2020.edublogs.org/mediasite/ Materials: https://sunyonlinesummit2020.edublogs.org/registration/materials/

1. Online Education Definitions and
Data Across the Big 10
INDIANA UNIVERSITY
FINDING COMMON GROUND

2. INDIANA UNIVERSITY
BA Economics
Class of 1985
MS Computer Science
Class of 1987

3. INDIANA UNIVERSITY
BA Economics
Class of 1985
MS Computer Science
Class of 1987

4. INDIANA UNIVERSITY
BA Economics
Class of 1985
MS Computer Science
Class of 1987
Faculty, 1989-1996 Adjunct,1996-1999
Faculty, 1999-2009 LotusNotes! Spring 2000

5. INDIANA UNIVERSITY
2013

6. AGENDA
• Why? Charter and Purpose
• Who, When? Working Group Timeline
• What? Data Definitions and Metrics
• How? Data Collection Template/Survey
• So What? Data Analysis
• Now What? Lessons Learned, Looking Ahead

7. Why? Charter and Purpose
SECTION 1

8. INDIANA UNIVERSITY
“What gets measured, gets managed”
~ Peter Drucker
If you can’t measure it, you can’t manage it.

9. INDIANA UNIVERSITY
Big 10 Working Group Purpose
Gather data to allow for benchmarking institutions against each other and
provide for better comparisons/discussion
§ More efficient process for collecting data
§ More consistent method of sharing data across institutions
§ Create apples-to-apples comparisons
Foundation: Collegial and collaborative Big 10 Online Leaders yearly meetings

10. INDIANA UNIVERSITY
“How Many Online Students Do You Have?”
“How Do You Define an Online Class?”

11. INDIANA UNIVERSITY
Working Group Charter
§ Review existing BTAA data collections from prior meetings
§ Review a variety of existing definitions and data reporting
§ Review publicly reported data, such as IPEDS, where definitions already
exist
§ Establish an easy data collection mechanism to collect a variety of online
education measures to provide clarity and benefit discussions and decision-
making within the BTAA

12. Who, When? Working Group
Timeline
SECTION 2

13. INDIANA UNIVERSITY
Working Group Membership
Chris Foley (BTAA Sponsor), Indiana University
Dan Murphy, Northwestern University
Ansel Oakleaf, Ohio State University
Aps Pandya, University of Nebraska
Sarah Roberts, Purdue University
Bob Rubinyi, University of Minnesota
Sharon Wavle, Indiana University

14. INDIANA UNIVERSITY
Working Group Timeline
March 2019: Working group established
April 2019: Draft definitions/data collection template created
May 2019: Draft reviewed/feedback from BTAA leaders
May 2019: Data Collection template/survey finalized
June 2019: BTAA Data Request sent out
July 2019: Compilation of results
July 2019: Presentation available for summer meeting

15. What? Data Definitions and
Metrics
SECTION 3

16. INDIANA UNIVERSITY
Data Definitions
Starting Point = Online Definitions Workgroup (2018)
§ Julie Uranis, Vice President, Online and Strategic Initiatives, UPCEA (lead)
§ Russell Poulin, Senior Director, Policy, Analysis, & Strategic Alliances, WICHE
Cooperative for Educational Technologies (WCET)
§ Ken Sauer, Senior Associate Commissioner and Chief Academic Officer, Indiana
Commission for Higher Education (ICHE)
§ Mary Niemiec, Associate Vice President for Digital Education and Director, University of
Nebraska Online
§ Lucas Kavlie, Vice President, Academic Engagement, Western Governors University
§ Devon Cancilla, Chief Knowledge Officer, Online Learning Consortium
§ Sharon Wavle, Associate Director, Decision Support and Reporting, Indiana University
Online
Added Big 10 Institutional Definitions: Definitions Working Document

17. INDIANA UNIVERSITY
Data Definitions
Online Class
Any class section where the students and instructor are separated by distance and
technology is used to bridge that distance gap through either asynchronous or
synchronous methodologies. Students are not required to come to a physical campus
location, with exceptions for infrequent orientations or exams.
Hybrid Class
Any class where the student has regular on campus meetings in combination with online
asynchronous or synchronous Instruction
Face-to-Face Class
Any class where the student completes all or almost all of the course through regular on
campus or face-to-face meetings. There may be infrequent class meetings online but
there is no significant reduction in "seat time." Face-to-face classes to not include
independent study, internships, externships, practicum, study abroad, or
dissertation/research classes.

18. INDIANA UNIVERSITY
Data Definitions
Online Program
Any academic degree or certificate program in which all of the required coursework can
be completed through online classes, with exceptions for concentrated, short-term
residency requirements.
Hybrid Program
Any academic degree or certificate program in which at least 50% of the required
coursework can be completed through online classes, but there is at least one course
outside of a concentrated, short-term residency requirement that students must complete
that is face-to-face or hybrid.
On Campus Program
Any academic degree or certificate program in which less than 50% of the required
coursework can be completed through online classes.

19. INDIANA UNIVERSITY
Metrics
Program Level
Number of Online Programs (By Degree Level)
Number of Students Enrolled (By Term and Degree Level, Unduplicated AY Counts)
Number of Graduates (Fiscal Year, by Degree Level))
Student Level
Students Taking 1 or More Online Class (By Term and Career, Unduplicated AY Counts)
Students Taking All Classes Online (By Term and Career, Unduplicated AY Counts)
Course Level
Online, Hybrid, Face to Face Credit Hours Taken (By Term and Career)
Total University Credit Hours Taken (By Term and Career)
Timeframes: a/o 6/1/19, Fall 2017, Spring 2018, Summer 2018, Fall 2018, Spring 2019

20. How? Data Collection
Template/Survey
SECTION 4

21. INDIANA UNIVERSITY
Data Collection
Process:
1. Finalized metrics
2. Google Sheets template for quantitative data
3. Google Forms for qualitative responses
4. Review/comment by Big 10 leadership
5. Finalized and sent to institutions with instructions

22. INDIANA UNIVERSITY
Data Collection
Each institution was asked to:
1. Read the instructions and definitions in the BTAA Data
Collection Sheet.
2. Complete their institution’s rows on each of the 4 tabs in the
BTAA Data Collection Sheet.
3. Prepare responses for the BTAA Online Unit Support Survey
4. Enter their responses in the BTAA Online Unit Support
Survey.

23. So What? Data Analysis
SECTION 5

24. INDIANA UNIVERSITY
Data Analysis
Respondents (10 of 15, some provided just basic data):
• Indiana University (Indiana)
• The Ohio State University (Ohio State)
• Penn State University (Penn State)
• Purdue University (Purdue-Flagship Only)
• Rutgers University (Rutgers)
• University of Chicago (Chicago)
• University of Iowa (Iowa)
• University of Maryland (Maryland)
• University of Minnesota (Minnesota)
• University of Nebraska (Nebraska)

25. INDIANA UNIVERSITY
Data Analysis
First Step: Flatten data collection sheet

26. INDIANA UNIVERSITY
Data Analysis
First Step: Flatten data collection sheet

27. INDIANA UNIVERSITY

28. INDIANA UNIVERSITY

29. INDIANA UNIVERSITY
Institution Fall 2017 Fall 2018
Change
17-18
% Change
17-18
Undup. Heads
AY17-18
Indiana University 4,753 5,652 899 19% 6,942
Ohio State University 968 1,406 438 31% 1,204
Penn State University 13,871 14,264 393 3% 19,597
Purdue University - F 1,766 2,009 243 14% 2,513
Rutgers University* 1,811 1,766 -45 -2% 2,231
University of Iowa 837 906 69 8% 1,263
University of Maryland 882 979 97 11%
University of Minnesota 1,652 1,778 126 8% 2,593
Online Program Enrollment

30. INDIANA UNIVERSITY
Undergraduate Credit Hours
Online Credit Hours Face-to-Face Credit Hours Online as % of All
Institution F17 F18 ∆ 17-18 F17 F18 ∆ 17-18 F17 F18 ∆ 17-18
Indiana 115,290 121,788 5.6% 853,585 839,265 -1.7% 11.4% 12.1% 0.7
Ohio State 59,090 68,530 16.0% 661,070 660,861 -0.001 7.9% 9.0% 1.1
Penn State 132,300 138,300 4.5% 947,300 919,500 -2.9% 11.8% 12.6% 0.8
Purdue - F 16,487 21,062 27.7% 404,398 420,511 4.0% 3.8% 4.6% 0.8
Rutgers 55,707 55,272 -0.8% 628,008 630,644 0.4% 7.7% 7.5% -0.2
Iowa 39,989 41,936 4.9% 292,721 282,592 -3.5% 11.7% 12.2% 0.5
Minnesota 54,245 58,791 8.4% 668,277 658,933 -1.4% 7.4% 8.0% 0.6
Nebraska 57,282 61,861 8.0% 456,837 446,285 -2.3% 11.0% 12.1% 1.1

31. INDIANA UNIVERSITY
Undergraduate Credit Hours

32. INDIANA UNIVERSITY
Undergrad Students – 1 or More Online Class
Taking 1 or More Online Total Student Headcount 1 or More as % of Total
Institution F17 F18 ∆ 17-18 F17 F18 ∆ 17-18 F17 F18 ∆ 17-18
Indiana 23,993 24,711 3.0% 74,606 73,738 -1.2% 32.2% 33.5% 1.4
Ohio State 15,783 17,702 12.2% 52,517 53,734 2.3% 30.1% 33.0% 2.9
Penn State 24,000 25,400 5.8% 77,500 75,700 -2.3% 31.0% 33.6% 2.6
Purdue - F 4,903 6,171 25.9% 30,658 32,309 5.4% 16.0% 19.1% 3.1
Rutgers 13,506 11,936 -11.6% 50,286 51,090 1.6% 26.9% 23.4% -3.5
Iowa 11,905 12,147 2.0% 24,591 24,016 -2.3% 48.4% 50.6% 2.2
Minnesota 14,839 15,242 2.7% 44,094 43,978 -0.2% 33.7% 34.7% 1.0
Nebraska 16,694 16,854 1.0% 38,607 38,075 -1.4% 43.2% 44.3% 1.0

33. INDIANA UNIVERSITY
Undergrads – 1 or More Online Class

34. INDIANA UNIVERSITY
Undergrads – All Online Classes

35. INDIANA UNIVERSITY
Online Support Unit Survey
8 institutions responding
§ Big 10 member is part of a system (7)
– 3-7 campuses (6)
– 25 campuses (1)
– Flagship only (1)
§ All 7 had system-wide responsibilities

36. INDIANA UNIVERSITY
Online Support Unit Survey
8 institutions responding
§ Housed in Provost’s Office (5)
– Other locations included IT, continuing education, separate VP
§ Has governance or advisory committee (7)
§ Scope includes online programs (8)
§ Scope includes online courses for online learners (6)
§ Scope includes online courses for residential learners (4)

37. INDIANA UNIVERSITY
4
4
5
5
6
6
6
7
7
7
7
8
Student retention and coaching
Student support and advising
Video/multimedia production
Project management
Quality control/assurance
Data and academic analytics
Instructional design and development
Market research
Marketing
Recruitment and Enrollment
Vendor and/or OPM management
State authorization and compliance
Major Services Provided by Online Support Units

38. INDIANA UNIVERSITY
Online Support Unit Survey
8 institutions responding
§ Support Unit Staff Size
• 1-5 FTE (1)
• 25-50 FTE (5)
• 100-125 FTE (1)
§ Budget: $3.5M - $10M (range from 6 respondents)
§ Total Online Course Revenue: $107M (average of 6 respondents)
§ Total Online Program Revenue: $41M (average of 6 respondents)

39. Now What? Lessons
Learned, Looking Ahead
SECTION 7

40. INDIANA UNIVERSITY
Lessons Learned
§ Varying levels of ability to report online education data
§ Flagship vs. System Reporting
§ Technical glitches – google sheets/forms
§ Forum for discussing common analytics issues
§ Data use and privacy concerns
§ Clarified/improved individual institution definitions, processes

41. INDIANA UNIVERSITY
Looking Ahead
§ Summer data collection
§ Increase response rates
§ How-to video
§ Analyst access
§ National working group, expanded scope?
§ BTAA leadership: future research/analytics

42. INDIANA UNIVERSITY
Acknowledgements
§ Chris Foley, Associate Vice President for University Academic Affairs and Director,
Office of Online Education
§ Big 10 Academic Alliance (BTAA) Online Leadership Group
§ BTAA Data Definitions Working Group
– Dan Murphy, Northwestern University
– Ansel Oakleaf, Ohio State University
– Aps Pandya, University of Nebraska
– Sarah Roberts, Purdue University
– Bob Rubinyi, University of Minnesota
§ IU Online Decision Support Team
– Chelsie Deatrick, Data Analyst
– Ben Adams, Data Analyst
– Mandy Bartley, Online Curriculum Manager

43. Questions/Discussion