Webquest presentation for Edu 643 at CMU

1. Ellen Feig June 2010 Web Quest Presentation

2. Introduction Why? As part of their curriculum, first year English Composition students (college level) must write a four page persuasive research paper The paper must include at least four outside sources and be in MLA format The paper is based upon the issues addressed in Peter Singer’s essay “The Singer Solution to World Poverty” Students should obtain information literacy by end of course

3. Learning Objectives Read and analyze persuasive essay Determine own opinion based upon comprehension of main points of essay Research skills including: ability to find appropriate sources and annotate same, and ability to use online databases and library based materials. Ability to draft and revise four page persuasive research paper using at least four outside sources and MLA format. Ability to paraphrase, summarize and quote where appropriate; recognition of concepts surrounding plagiarism

4. Analyze: To study or determine the nature and relationship of the parts by analysis. Who is the audience? College Freshmen in a first year English Composition class What do they need to learn? Analysis of a persuasive essay, research skills including understanding of viable versus non-viable sites, ability to utilize both Internet and library based sources, and ability to create a workable draft of a persuasive research paper. What are the delivery options? As I wanted students to really work their way through the analysis and research process, I felt that a Web Quest was the best option. Having worked with Webgarden before, I decided to use that program to create the resource. What constraints exist? I did not see any constraints existing as my students have full access to a computer lab and one hundred percent of them have computers with Internet access at home. What will students do to determine their competency? As they move through the quest, I will continue to check their progress to ensure that they are on track. What is the timeline for project completion? Students have a two week period to complete the project with two hours of in class lab time in the computer lab. The final paper is due the last day of each semester. What are the classroom/Web learning differences? I had to take into account the fact that I have many ESL students in my class; this fact made me simplify some of the instructions in the quest. In addition, I decided to spend one class period actually moving through the quest to determine all were comfortable using same. What are the online pedagogical considerations? I really wanted my students to be able to integrate both visual and verbal instructions and thus included lectures with each lab period.

5. Design: Systematic method of research, planning, developing, evaluating and managing an instructional process. Continue with subject matter analysis: Before I sat down to outline and storyboard the quest, I researched and created a set of potential resources (including websites) that students could access. In addition, I re-read Singer’s essay and made a list of potential pro and con arguments. Apply instructional strategies according to content type: As the goal of the assignment is two-fold (research and writing), I was determined to create a linear quest; with each step in the process, students would move up the ladder to the final paper. This strategy is akin to scaffolding where one creates a project based upon certain skill sets that must be obtained in order to move forward in the project. Create storyboards: I sat down and, utilizing a storyboard template, create a board of how the project should look and flow. This “visual outline” allowed me to keep on track while creating the first version of the quest. Design the user interface: As I was using a pre-designed template (Webgarden.com), I did not have to design an interface. However, I did move through some sample quests in order to gain a better understanding of what my quest needed and to access whether or not the quest was workable. Collect needed materials: I actually found this to be one of the most time consuming aspects of the project as I initially pulled copyright protected images; accordingly, I had to go back and find new images that were not protected. In addition, I had to make sure that I had a good list of sites and resources for students to use.

6. Develop: Process of authoring and producing the materials needed to meet the objectives. Research and collect resources which will be included in Web Quest Outline steps to the quest and review same to insure all steps are present and clear Create a storyboard of each “slide” in quest and review flow/organization Determine “guideposts” that should be met by students as they move through quest

7. Implement: Establish implementation timeline and procedures for training learner, and delivering final product. Prepare learning environment by handing out one-sheet to students that outlines the quest including how to access it, expectations and objectives Reviewing in class with students the quest slides (i.e. moving through the quest step-by-step) and answering any questions concerning same Availability during lab hours to assist students as they work through quest

8. Evaluate: Systemic process that determines the quality and effectiveness of the instructional design as well as the final product. Evaluation goal: To determine if quest is a workable assessment that meets goals and objectives Preparation: Hand out one-sheet to students explaining assessment; review in class how to access quest and expectations Data collection: Survey class via online threaded discussion on WebCT asking their opinion of experience – “Did you enjoy the Web Quest assignment? Are there things you would change?” Data analysis: Review responses to question and list Revision: Based upon responses, revise quest on June 18th to be more explicit with required assignments; revise each of the process areas so that expectations are clarified Recycling: Retesting of resource will take place in Fall semester 2010 during Composition I class

9. Web Quest Screen shot taken from: http://questgarden.com/86/83/6/091012104232/

10. Implementation In order to test this assessment, the quest was introduced to students in Composition 1 (WRT101) summer session during the week of June 14, 2010. Students were given an assignment sheet with instructions on how to access quest, what objectives were and expected outcomes. Students began to move through the quest on June 14 during three hour class. On June 16, they were asked to answer two questions on WebCT discussion board (dl.bergen.edu) concerning thoughts on use of quest. Their responses were used to revise quest on June 18th.

11. Peer Evaluation Survey The survey (see below) was given to three faculty members (one Sociology professor, one Psychology professor and one Communications professor) on June 14th. Faculty were first asked to move through the quest and note any concerns/issues that they had with same; none of the faculty had ever used a quest before. SURVEY: The purpose of this survey is to evaluate a Web Quest created for final paper assignment in Composition 1 class for summer session. The main objectives for my project were to ensure that by the end of the assessment, students would have: Ability to read and analyze a persuasive essay Ability to formulate opinion and thesis based upon research Ability to research using both the Internet and offline sources Ability to create a MLA formatted Works Cited page Ability to draft a persuasive paper Ability to revise paper and avoid plagiarism Please indicate your level of agreement with the following statements (1= Strongly Disagree, 2= Disagree, 3= Neutral, 4= Agree, and 5= Strongly Agree): All activities, tasks and assessments all align with learning objectives and standards. Information is organized in a clear, logical way. The assessment appropriately assessed students’ ability to meet the objectives. The graphics, sound and/or animation assist in presenting an overall theme and enhance understanding of concepts, ideas and relationships. Multimedia elements are clear. All activities, tasks and assessment directions are written clearly and project easy to navigate.

12. Kirkpatrick’s 4 Levels of Evaluation The four levels of Kirkpatrick's evaluation model measure: reaction of student - what they thought and felt about the training learning - the resulting increase in knowledge or capability behavior - extent of behavior and capability improvement and implementation/application results - the effects on the environment resulting from the trainee's performance http://www.businessballs.com/kirkpatricklearningevaluationmodel.htm

13. Reaction of Peer Evaluators Did the evaluators like and enjoy the quest? All evaluators enjoyed the quest. Did they consider the quest relevant? The evaluators, although in other disciplines, believed that the issue addressed in the quest was an important one and relevant to students. Was it a good use of their time? The evaluators believed that students would like the quest as it was a new way of moving through a final paper. In addition, evaluators thought that a quest would be fun for students. Ease and comfort of experience. Although none of the evaluators had used a quest before, they all found it easy to use. Level of effort required to make the most of the learning. One of the concerns of evaluators was that such a resource might be “hand-holding,” i.e. that it walked the student through their final paper rather than allowing students to work on their own. Perceived practicability and potential for applying the learning. All evaluators stated that they believed the quest resource had a great deal of practicality and potential for all disciplines.

14. Peer Evaluation Survey, Cont’d All activities, tasks and assessments all align with learning objectives and standards. Evaluators strongly agreed with this statement. Information is organized in a clear, logical way. Evaluators found that the quest needed to be clearer in its expectations so that students would understand what was expected during each process. The assessment appropriately assessed students’ ability to meet the objectives. Evaluators strongly agreed with this statement. The graphics, sound and/or animation assist in presenting an overall theme and enhance understanding of concepts, ideas and relationships. Multimedia elements are clear. Evaluators agreed with this statement but suggested that additional media elements such as videos be included. All activities, tasks and assessment directions are written clearly and project easy to navigate. Evaluators expressed concern that some of the process was not clearly outlined; accordingly, revisions were made. Evaluators did find that the project was incredibly easy to navigate. The quest is a valuable resource for teaching. Evaluators expressed that they would use a quest in their own classrooms.

15. Summary When creating a Web Quest, it is essential to clearly outline each element in the resource before creating same. In addition, testing the quest and revising based upon test results is imperative. Students enjoyed the experience of using this resource as did peer evaluators. However, both groups expressed concern that certain elements of the quest were not clear (specifically, delivery of certain elements of the assessment). Use of a Web Quest can easily meet class objectives and goals including information and media literacy.