DETA Research Center Update
•Télécharger en tant que PPTX, PDF•
0 j'aime•1,432 vues
Presented at the UWM Online Program Council on 3.25.16
Recommandé
Recommandé
Contenu connexe
Tendances
Tendances (20)
Similaire à DETA Research Center Update
Similaire à DETA Research Center Update (20)
Dernier
Dernier (20)
DETA Research Center Update
- 1. National Research Center for Distance Education and Technological Advancements (DETA) Tanya Joosten, DETA Co-Director and PI, @tjoosten, tjoosten@uwm.edu Diane Reddy, DETA Co-Director and PI, reddy@uwm.edu slideshare.net/tjoosten uwm.edu/deta/summit #DETASummit
- 2. Identify practices (instructional and institutional) that impact those outcomes
- 3. Conduct rigorous, interdisciplinary, and standardized research Flicker cc astronomyblog
- 4. Year 1 activity: Host national summit
- 5. Desired outcomes Access Learning Effectiveness Satisfaction Instructional Effectiveness http://uwm.edu/deta/desired-outcomes/
- 6. Area of investigation guided by overarching research questions •Gather pertinent literature Formulate hypotheses to be tested • Identify variables and their direction Design study • Develop measures and instrumentation to test hypotheses Conduct the study and analyze results • Collect data and analyze results across institutions Research models
- 8. In understanding student success in distance education, we as a field need to have a consistent understanding of student success across programs and institutions, including identifying shared desired outcomes. In considering this need, what are the research questions that will assist us in identifying key factors impacting these shared desired outcomes to best enhance the understanding of distance education across institutions and populations?
- 9. Research questions Defined What are the different design components (content, interactivity, assessments) that impact student learning? What patterns of behaviors lead to increased student learning for different populations? What support structures are critical to providing quality access to online instruction? Exploratory (Interpretive) What are the definitions of success from students’ perspective? How can we define and measure student success beyond traditional outcomes? What is the currency of student learning beyond the existing credit hours? What are the key components that promote a sustainable and an effective teaching and learning ecosystem?
- 11. In consideration of the research questions proposed in enhancing our understanding of the key factors, what variables should be included in the framework of inquiry to help us answer these questions surrounding distance education and technological advancements?
- 13. Shared measures – Student performance is based on numerical representation of grade converted to a 4.0 scale received in the course on assessments and as an overall grade. RQs - What are the different design components (content, interactivity, assessments) that impact student learning?
- 15. RFP for pilot grant awards Flicker cc yourdon
- 17. Research toolkit: Research model
- 18. Research toolkit: Guides to research
- 19. Research toolkit: Data collection
- 20. Research toolkit: Data codebooks
- 21. DETA Research Fellows Simone Concaico, Ph.D., Education Ray Fleming, Ph.D., Psychology, UPace Roger Smith, Ph.D., Health Sciences, R2D2 Center Judee Richardson and Matthew Mayesheba, UW System and Extension Pam Holt, Milwaukee Area Technical College
- 22. UWM Research Partners Mike Allen, Ph.D., Communication Dylan Barth, Ph.D., CETL and English
- 23. Institutional Research Partners Oregon State University University of Central Florida California State University - Fullerton Florida SouthWestern San Diego Community College District WCET/Montana State
- 24. DETA ELI Research Partners Meeting
- 25. DETA ELI Research Partners Meeting
- 26. DETA Invited - ELI Leadership Seminar
- 27. Other highlights The 2016 Key Issues in Teaching and Learning, EDUCAUSE Learning Initiative. Evaluating Student Success in Online Programs by Kristi DePaul, Next Generation Learning Challenges. DETA Advances Distance Ed Research Through Grants and a Toolkit by Russ Poulin, WCET
- 28. Other highlights Seminar at Online EDUCA in Berlin, Germany. Workshop at the WICHE Cooperative for Educational Technology (WCET) Annual Meeting in Denver. Presentation and workshops at the Online Learning Consortium (OLC) International Conference for Online Learning in Orlando.
- 30. Tanya Joosten, @tjoosten, tjoosten@uwm.edu Diane Reddy reddy@uwm.edu http://www.uwm.edu/deta http://www.slideshare.edu/tjoosten
Notes de l'éditeur
- Thanks for coming….
- How do we design our instruction? Considerations in content, assessment, interactivity (including supporting our students) Organizing our courses online Since it isn’t about time, it is about learning outcomes and their careful alignment to assessments and to learning activities.
- …to identify outcomes and influences on all students. We want to identify key factors that are impacting our desired outcomes. Specifically, we look to examine the effectiveness of education interventions across courses, programs, and institutions We would like to follow WWC standards by conducting Randomized Controlled Trials and Quasi-Experimental Designs when possible
- Once of our first activities was to bring experts from around the country to assist us in developing a research model impacting our research agenda that will be conducted in year 2 of the grant. We want to bring some coherency to the field of distance education research and use that foundation to guide our research as part of this grant. We hope our work today will assist us in developing research toolkits that will drive cross-institutional distance education research in year 2 of our grant. These research toolkits will have priority research questions to be answered, a framework of inquiry including variables and shared measures, guidance in methodology including instrumentation, data mining techniques, and sample syntax, and more.
- As part of the grant, we think of success as providing students access to quality learning, while leaving them satisfied with their experiences. Desired Outcomes Access All learners who wish to learn online can access learning in a wide array of programs and courses,1 particularly underrepresented, those with disabilities and minorities.2 An essential component in distance education is a comprehensive infrastructure for learning that provides all individuals with the resources they need when and where they are needed. The underlying principle is that infrastructure includes people, instructional resources, processes, learning resources, policies, broadband, hardware, and software. It brings state-of-the art technology into learning to enable, motivate, and inspire all students, regardless of background, languages, or disabilities, to achieve.4 Data can be collected by examining administrative and technical infrastructure, which provides access to all prospective and enrolled learners. Access quality metrics are used for information dissemination, learning resource delivery, and tutoring services.1 Other possibilities include data gathered from student information systems, from student perception surveys, or objective accessibility ratings of online courses and programs. Learning effectiveness Learning effectiveness indicates a demonstration that learning outcomes were met or exceeded standards.1 This includes areas of study with research outcomes focusing on student success in achieving learning outcomes2 and other potential indicators of achievement (success, failure, achievement gains, academic achievement, improvement).3 Moreover, learning effectiveness could also include topics of retention (of content) and retention in a course (sometimes called attrition) or program (degree completion). Typically data are gathered through direct assessment of student learning (e.g. overall grades, exam grades, or other assessments), faculty perception surveys, faculty interviews comparing learning effectiveness in delivery modes, and student focus groups or interviews measuring learning gains.1 Additionally, requests for new and better ways to measure what matters include concurrent data collection. Here, focusing on diagnosing strengths and weakness during the course of learning provides the opportunity for more immediate improved student performance. Furthermore, these technology-based assessments provide the opportunity to allow data to drive decisions on the basis of what is best for each and every student based on their unique attributes and interactivity in class.4 Other possibilities include data gathered from student information systems or from student perception surveys. Satisfaction Faculty are pleased with teaching online, citing appreciation and happiness. Students are pleased with their experiences in learning online, including interaction with instructors and peers, learning outcomes that match expectations, services, and orientation.1 Faculty and student surveys can indicate equal or growing satisfaction to traditional forms of learning. Other metrics can include repeat teaching of online courses by individual faculty and increase in percentage of faculty teaching online showing growing endorsement. Qualitative methods can include interviews, focus groups, testimonials with faculty, staff (including advisors and tutors), and/or students.1 Instructional effectiveness Instructional effectiveness indicates the quality of education meets program, institutional, and national standards.1 The focus is on what and how we teach to match what people need to know, how they learn, where and when they will learn, and who needs to learn.4 The areas of study might include instructional improvement, program effectiveness, administrator effectiveness, curriculum evaluation, educational quality, outcomes of education programs, and instructional media.3 Additionally, instructional effectiveness is not limited to instruction provided inside the classroom, but extends itself to instructional support or supplemental instruction and guidance provided through institutional services or through staff and individuals outside of the classroom. Traditionally, as in face-to-face delivered courses, student ratings of instructional effectiveness are collected. However, typically these standards in distance education and online learning are communicated in a course or program rubric (e.g., UC Chico, QM) which is administered through an objective rating of a course or program in addition to traditional methods. Recent work looks to gather this data through student perceptions of instructional effectiveness through course and program rubrics converted to student surveys. Other possibilities include objective ratings of online course and program design and instructional delivery. References: 1. Online Learning Consortium, 5 Pillars 2. U.S. Department of Education, Application for Grants 3. What Works Clearinghouse 4. National Ed Tech Plan, U.S. Department of Education
- We need to speak the same language… We will accomplish our objectives through 7 goals and an array of activities by developing a research infrastructure that considers practice, instructional and research, and technological consideration in developing a national collaborative for DE research recognizing, again, the interrelatedness of research and pedagogy. See p. 8 Table 11 Provide Justification for year 1 goal Discuss each activity for year 1 goal 2. Determine desired outcomes 3. Identify research questions to facilitate cross-institutional research 4. Establish framework of inquiry, including common variables Moving forward: 5. Formulate measures 6. Establish research instrumentation and methodology Transition: Now, let’s talk more specifically about our first activity as we are launching this grant.
- Provide Justification for year 1 goal Discuss each activity for year 1 goal 1. Host national summit 2. Determine desired outcomes 3. Establish framework of inquiry 4. Formulate measures 5. Establish research instrumentation Transition: Now, let’s talk more specifically about our first activity as we are launching this grant.
- 8:30-9:15 Idea generation and brainstorming activities 9:15-9:30 Break 9:30-10:15 Idea generation and brainstorming activities 10:15-10:30 Break 10:30-10:45 Vote: Consensus gathering and prioritization through online polling 10:45-11:00 Summary and next steps
- Provide Justification for year 1 goal Discuss each activity for year 1 goal 1. Host national summit 2. Determine desired outcomes 3. Establish framework of inquiry 4. Formulate measures 5. Establish research instrumentation Transition: Now, let’s talk more specifically about our first activity as we are launching this grant.
- Provide Justification for year 1 goal Discuss each activity for year 1 goal 1. Host national summit 2. Determine desired outcomes 3. Establish framework of inquiry 4. Formulate measures 5. Establish research instrumentation Transition: Now, let’s talk more specifically about our first activity as we are launching this grant.
- 9:30-10:15 Idea generation and brainstorming activities 10:15-10:30 Break 10:30-10:45 Vote: Consensus gathering and prioritization through online polling 10:45-11:00 Summary and next steps
- Provide Justification for year 1 goal Discuss each activity for year 1 goal 1. Host national summit 2. Determine desired outcomes 3. Establish framework of inquiry 4. Formulate measures 5. Establish research instrumentation Transition: Now, let’s talk more specifically about our first activity as we are launching this grant.
- So, we developed a list of RQs and a list of variables, which informed the framework of inquiry. All of these activites led to the research toolkit. Let’s take a deep dive into the toolkit. 1. Host national summit 2. Determine desired outcomes 3. Establish framework of inquiry 4. Formulate measures 5. Establish research instrumentation Transition: Now, let’s talk more specifically about our first activity as we are launching this grant.
- The research toolkits produced from year 1 activities will be used by our research fellows, institutional partners, CBEN institutions Furthermore, they will provide the guides and tools necessary too facilitate rigorous cross institutional research from experimental and survey designed studies gathering data from in-class assessment, survey packets, and student information system or data warehoused student data. Note: Do not go into detail until slide 22 Now, let’s talk about the potential for you to get funding to collaborate with us….
- Request for proposals for DETA subgrant awards is available in the research toolkit in Section 1. You will find background information, grant participation requirements, proposal requirements, and proposal review criteria. The goal with the process is not to build hurdles in obtaining funding and support, but to ensure rigorous cross-institutional research and data collection and address audiences of interest Goal 2 activities 2. Evaluate pilot grant proposal submissions 3. Engage research fellows in research projects 4. Ensure data collection addresses audiences of interest
- Now, as mentioned, the toolkits are a year 2 activity that has already taken place, to assist us in our primary year 2 goal -- Collect data by replicating research models at the course, program, and institutional level Let’s talk in a bit more detail how the contents of the toolkits are going to help make this happen…
- The first goal of the grant activities is to develop research models for online learning that provide guidance in the practice of distance education research. The models were intended to facilitate the exploration of instructional practices, inform future instructional practices, serve as a model for future research practices across educational institutions, and enhance consistency in the field. In the development process, it became clear that a more general research model was needed to represent the various research models and designs that would be deployed as part of the DETA research efforts rather than several specific research models. More information is available in the toolkit or on our website.
- Diane could discuss methodological considerations – how it can help them do research, etc. She could mention WWC standards
- Tanya can discuss gathering data through SIS and Surveys Diane can mention how these will compliment experimental studies
- Tanya can discuss how codebooks will help with data merging and how these are iterative…they will be improved once partners are identified and as data acquisition and merging
- Tanya can discuss how codebooks will help with data merging and how these are iterative…they will be improved once partners are identified and as data acquisition and merging
- Tanya can discuss how codebooks will help with data merging and how these are iterative…they will be improved once partners are identified and as data acquisition and merging
- Tanya can discuss how codebooks will help with data merging and how these are iterative…they will be improved once partners are identified and as data acquisition and merging
- Thanks to all of you for funding your travel to join the DETA partners here at ELI and share your knowledge and expertise in this area to ensure we have a well informed research model moving forward. Thanks to ELI for hosting us at their annual meeting. We greatly appreciate the efforts of their staff in helping us make this event a success. Enjoy the conference.