1. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Online Marking & eAssessment
Blayn Parkinson │ Blended Learning Enhancement Officer
Jisc/QCA definition of eAssessment
e-Assessment is the end-to-end electronic assessment processes
where ICT is used for the presentation of assessment activity, and
the recording of responses. This includes the end-to-end
assessment process from the perspective of learners, tutors,
learning establishments, awarding bodies and regulators, and the
general public.
JISC, Effective Practice with eAssessment (2007)
2. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Session Outline
eAssessment
Why Online
Minimum Expectations/Baselining
Turnitin
Originality Reports
Blackboard and Grade Centre
Marking Workflow
Submission Restrictions
3. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
1. Specifying
2. Setting
3. Supporting
4. Submitting
5. Marking and
production of
feedback
6.Recording
grades
7. Returning
marks and
feedback
8. Reflecting
eAssessment
JISC Assessment
and
Feedback Lifecycle
https://goo.gl/94Mhts
4. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
1. Specifying
2. Setting
3. Supporting
4. Submitting
5. Marking and
production of
feedback
6.Recording
grades
7. Returning
marks and
feedback
8. Reflecting
eAssessment
JISC Assessment
and
Feedback Lifecycle
https://goo.gl/94Mhts
5. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
eAssessment
Why?
6. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Reasons for
considering the use
of e-submission and
e-marking include:
Flexibility and convenience
Saving paper and reducing printing costs
Tracking submissions and progress (for staff and students)
Use of text-matching software (Turnitin), to help identify plagiarism
Process Management: One central, secure and familiar system (Blackboard)
Easy archiving
Provision of clear, timely and easily accessible feedback
Opportunities for innovative and engaging feedback
Greater consistency e.g. comment banks or rubrics
No large quantities of paper
Access marking from anywhere
Markers can re-edit their feedback in a document as they go through it
Why Online?
JISC has worked with
several institutions on
Electronic Assessment
Management (EAM) and
evaluated these projects.
They have summarised
some of the benefits for
students and benefits for
staff.
7. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Good practice for online submission
Good practice
8. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Clearly Signpost in the VLE where students need to go to find...
Good practice
Submission point(s)
Assignment & Submission Criteria
Marking Criteria
Mitigating Circumstances
Support and Guides
Each Module will need a ‘My Grades’ linkTip:
•During a lecture, bring up
the VLE and show the
submission point and any
supporting material and
resources that go with it.
9. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Good practice
1
2
An example of module design with key information clearly signposted.
Tip:
•If modules have
a similar layout it
makes it easier
for students to
navigate.
10. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Turnitin
Turnitin checks text-based assignments for information
copied from websites, electronic journals and the work
of other students. Staff can create a Turnitin submission
area in VLE modules/organisations.
Student Guides
eAssessment Survival Guide
https://www.leeds.ac.uk/vle/students/assess/eassessment/
Submit a Turnitin paper
https://www.leeds.ac.uk/vle/students/assess/turnitin/
How to get your Turnitin receipt
https://www.youtube.com/watch?v=XGK-2L-DN6A (Youtube)
11. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Student Submission
12. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Turnitin in the VLE
Example submission
point
1. Enter your details into the
appropriate text fields.
2. Choose the file you wish
to upload .
3. Click ‘Upload’ to submit.
Students View 1.
2.
13. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Setting up a submission point
14. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Turnitin in the VLE
Staff View
Optional Settings
When creating a submission area, you should
review the optional settings. To do this, click the
Optional Settings button on the new assignment
page.
1. 2.
15. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Turnitin in the VLE
Key optional settings
1. Allow Submission after due date
2. Generate Originality Report for submission.
3. When you want the originality report
generating
4. Do you want the students to see the originality
report (Should be set to No)
5. Revel the grade only on the ‘Post Date’ (not
before).
6. Do you want to use anonymous marking
(Yes/No).
7. Do you want the submitted papers adding to
the Turnitin repository (Yes/No)
8. Where to attach a rubric to the assignment.
1
2
3
4
5
6
7
8
16. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
File Type
MS Word (.doc/.docx)*, WordPerfect (.wpd), PostScript (.ps/.eps), HTML, RTF (.rtf), OpenOffice (.odt)**
plain text (.txt) and Google Drive's 'Docs' format.
PowerPoint files (.pptx, .ppt, .ppsx, and .pps).
Note:
* MS Word - Office 365/OneDrive files aren't currently accepted.
** Open Office Text: Turnitin will not accept .odt files created and downloaded from Google Docs online, or
".doc" files created using OpenOffice.
File size limits are:
40MB (text and mixed media),
2MB for text only files,
Max 400 pages in length.
Browser Restrictions
Turnitin no longer supports Internet Explorer 10 or older
Turnitin Restrictions
Guide:
Managing documents file sizes for submission (https://goo.gl/y3WW7q)
17. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Originality Reports
18. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Originality Reports
YouTube Video: Originality Reports -
How to interpret them
https://www.youtube.com/watch?v=
f9w_qsb-dP8
19. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Turnitin
Turnitin checks text-based assignments for information
copied from websites, electronic journals and the work
of other students. Staff can create a Turnitin submission
area in VLE modules/organisations.
Staff Guides
UoL VLE Support Turnitin Guide
https://www.leeds.ac.uk/vle/staff/assess/turnitin/
YouTube Video: Grade a Turnitin Assignment
https://www.youtube.com/watch?v=NuZp18N5fy4
YouTube Video: How Turnitin works with Blackboard Grade Centre
https://www.youtube.com/watch?v=GJjXWvCsGgM
YouTube Video: Originality Reports - How to interpret them
https://www.youtube.com/watch?v=f9w_qsb-dP8
20. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Grade Centre
21. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
VLE & the Grade Centre
Terminology
Grade Centre – Blackboard
Grade Mark - Turnitin
Grade Book – Bespoke application, Banner interface with Blackboard (in development)
The Grade Centre provides access to student
submissions and other gradable activity.
UoL VLE Guide: Grade Centre
https://www.leeds.ac.uk/vle/staff/assess/gradecentre/
Blackboard’s own guide: Grade Centre (external site)
22. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
VLE & the Grade Centre
Smart Views
1
2
3
4
From the Grade Centre
1. Click Manage > Smart Views
2. Create Smart View
3. Any ‘Smart View’ stared as a ‘Favorited’ will
display under the ‘Full Grade Centre’ link in the
left hand menu
Guides
UoL: Smart View Guide.
Blackboard: Smart View Guide
23. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
VLE & the Grade Centre
Entering Grades
From the Full Grade Centre or a Smart View
1. Grade Centre > Full Grade Centre or Smart
View
2. Roll cursor over submission to grade
3. Click contextual menu button > View Grade
Details/Attempt
or
Click into grade box to enter grades
Guides
UoL: What is the Grade Centre?
Blackboard: Grade Centre
Blackboard: Entering Grades
24. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Marking with an iPad
25. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Using an iPad
1. Log into the VLE and go to Organisational Tool>Turnitin Assignments
2. Practice Marking on the desktop computer
3. Generate an iPad/mobile Access code
4. Switch to an iPad and try marking on that (don’t forget to sync once finished)
5. Create a custom Marking List and export (email it to yourself) and import
Desktop and iPad
26. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Using an iPad
Turnitin Webcast: Grade Anywhere -- Turnitin for iPad (YouTube)
Marking-with-Turnitin-app (YouTube)
Turnitin on the iPad - University of Kent (PDF)
Other Links
https://youtu.be/sNcucatlw-c
27. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Faculty of Environment: Blended Learning web site
https://digifoe.wordpress.com/guidance/assessment-feedback-marking/
VLE Organisations With Assessment Information
Geography, SoG Staff: L&T Information
SEE Staff: L&T Information
Transport Studies
Student Education Service
http://ses.leeds.ac.uk/info/22169/assessment-related_policies
Resources
28. Faculty of Earth and EnvironmentDigifoe.wordpress.com │ b.parkinson@leeds.ac.uk
Questions
Notes de l'éditeur
TRAFFIC: Transforming Assessment and Feedback For Institutional Change
Specifying- How much information is needed at time of course- How is it logged and passed on to eAssessment systems
Setting- What are the submission date? Feedback dates?- How is the work to be presented/submitted- How will feedback be returned to students, and in what format?- What information is given to students?- What do colleagues need to know (teaching team, admin, technical staff?)- What are the arrangements for reassessment if needed?
Supporting- Do students need any technical support?- How much focus is there/should there be on assessment during the teaching session
Submitting- Is there a plan B in case of technical failure?- How are special factors taken into account (disabilities, exceptional factors)?- How do markers get access to the work?
Marking and Production of Feedback- How is work for large groups distributed?- Can second markers/moderators get it at the same time?- How do markers communicate decisions/queries?- How is the sample for the external examiner/internal moderators chosen and distributed?- Is there a stranded format for the feedback?- What impact might this have on other submissions?
Recording grades- Who records the grades (first marker, second marker, moderator, administrative team?)- Who checks them?- What records need to be kept (eg mark sheets, moderation summaries)?- What’s the deadline?
Returning marks and feedback- Are marks and feedback returned together or separately?- Is there a standard feedback form or technique? How is audio or video feedback distributed to students?- Is marked work annotated and returned?- How is face to face return of work recorded?
Reflecting- What do students to with feedback?- What do we do with it?- How do we use feedback to move students forward (e.g. clear feed-forward techniques, sharing generic feedback with tutors at next level of study)?- Can we share feedback automatically with personal tutors?
TRAFFIC: Transforming Assessment and Feedback For Institutional Change
Specifying- How much information is needed at time of course- How is it logged and passed on to eAssessment systems
Setting- What are the submission date? Feedback dates?- How is the work to be presented/submitted- How will feedback be returned to students, and in what format?- What information is given to students?- What do colleagues need to know (teaching team, admin, technical staff?)- What are the arrangements for reassessment if needed?
Supporting- Do students need any technical support?- How much focus is there/should there be on assessment during the teaching session
Submitting- Is there a plan B in case of technical failure?- How are special factors taken into account (disabilities, exceptional factors)?- How do markers get access to the work?
Marking and Production of Feedback- How is work for large groups distributed?- Can second markers/moderators get it at the same time?- How do markers communicate decisions/queries?- How is the sample for the external examiner/internal moderators chosen and distributed?- Is there a stranded format for the feedback?- What impact might this have on other submissions?
Recording grades- Who records the grades (first marker, second marker, moderator, administrative team?)- Who checks them?- What records need to be kept (eg mark sheets, moderation summaries)?- What’s the deadline?
Returning marks and feedback- Are marks and feedback returned together or separately?- Is there a standard feedback form or technique? How is audio or video feedback distributed to students?- Is marked work annotated and returned?- How is face to face return of work recorded?
Reflecting- What do students to with feedback?- What do we do with it?- How do we use feedback to move students forward (e.g. clear feed-forward techniques, sharing generic feedback with tutors at next level of study)?- Can we share feedback automatically with personal tutors?
Use a Padlet wall for this activity.
Some reasons for considering the use of e-submission and e-marking include:
Flexibility and convenience e.g. students can submit assignments or access marks and feedback from anywhere without being restricted by office hours
Saving paper and reducing printing and toner costs if using e-marking
Tracking submissions and progress (for staff and students)
Ability to use text-matching software (Turnitin), which is integrated with Blackboard, to help identify plagiarism
Whole process can be managed in one central, secure and familiar system (Blackboard)
Archiving of assignments, feedback and marks for future reference e.g. for external examiner access
Provision of clear, timely and easily accessible feedback
Opportunities for innovative and engaging feedback e.g. audio or video, as well as greater consistency e.g. through use of comment banks or rubrics showing feedback relating to assessment criteria
Markers do not have to collect and carry large quantities of paper, and can access their marking from anywhere
Markers can re-edit their feedback in a document as they go through it
Ability for markers to re-use feedback comments relating to common issues
JISC has worked with several institutions on EAM and evaluated these projects. They have summarised some of the benefits for students and benefits for staff.
A mixture of good practice and institutional requirements
A mixture of good practice and institutional requirements
An example of good module layout with documents, guidance and key module areas clearly signposted
All of this underpins good assessment practices in relation to online marking
Flip to VLE to demonstrate.
Along with UoL guides there are a number of videos demonstrating key Turnitin processes.
How a student submits to a Turnitin assignment.
Hoe to create a Turnitin assignment point
*Go through some of the specific settings in the ‘Optional’ section
Restrictions to file submissions
Some screenshots
Links to specific resources guides and videos
Demonstration
Along with UoL guides there are a number of videos demonstrating key Turnitin processes.
Accessing the grade centre
*Accessing Smart views
*Smart Views from Groups
*Turnitin Assignment by Groups
Entering Grades
This should work either from desktop to iPad or from iPad to desktop
This should work either from desktop to iPad or from iPad to desktop