Improving the Anonymous Marking workflow

Idea created by ab38030 on Dec 17, 2015

    EDIT: For this round of voting, we are focused on notifying students who have not yet submitted and excluding students who have not submitted from self and peer assessment.


    Our institution is working towards e-submission and e-marking for all summative coursework. The University also has a strong commitment to anonymous marking to ensure fairness and parity. There is also an ongoing campaign by the UK National Union of Students for Universities to introduce anonymous marking.

    We have been using the anonymous marking option in the Assignment Tool and have found some limitations and restrictions that impact on our academics and administrators ability to use the assignment tool effectively for marking. The modules that are currently piloting its use often have large cohorts of students, with multiple staff marking the assignment and course administrators who oversee the submission process for students.


    Based on our experience and feedback from users, the following enhancements have been suggested:


    1. Make the attempt ID visible to students and keep the attempt ID associated with the assignment once anonymous marking has been removed.

    On rare occasions, it is necessary for the tutor or the student to identify an attempt, for example if the file the student has submitted has failed to upload correctly. We currently have no way of identifying a submission to let a student know there is a problem or for a student to contact us to tell us their file has not uploaded correctly.

    Where academics are marking offline with downloaded files they need to be able to associate their feedback with the attempt after anonymity is lifted. e.g. to apply late penalties or not, where there have been extenuating circumstances and eventually for review by the external examiner.


    2. A method for staff to identify or contact students who have not submitted an assignment or where there is a problem with a submitted assignment file.

    At the moment there is not a way to contact a student when the assignment is anonymous. Administrators have previously been able to follow-up with students who have failed to submit or where there is an issue with what they have submitted. (Perhaps the ability to do this from the Retention Centre, or an 'email attempt user' for an individual assignment.)


    3. The ability to clear an attempt,


    The ability to allow an individual student to make an additional attempt, both options based on the student being able to see the attempt ID.

    (This would potentially compromise the anonymity of the student in certain circumstances, as they would need to identify themselves by revealing the attempt ID to an academic / administrator but it would improve the service we can provide to the student, where an issue has arisen on the assignment.)


    4. Allow Download files to show multiple attempts by the same user or only the latest attempt.


    5. Display attempts by student in Grade Centre > Needs Marking.

    If you have allowed multiple attempts for the assignment, when you look in Needs Marking, all of the separate attempts are shown without the ability to see or associate attempts by the same student. If you are only interesting in marking the latest attempt of a student you can't easily see this unless you open the attempt and then look in the grading panel to see the number of attempts made.


    6. Introduce a 'Save and Continue' button on the Inline grading page.

    Blackboard currently moves automatically to the next assignment when clicking Save Draft or Submit. Academics would often like to save work as they go along and remain on the same assignment.

    (Not specifically related to anonymous marking but useful!)


    7. See the spread of marks to enable moderation to take place.

    It is not easy to see what marks have been given to an anonymous assignments as it is not visible in the Grade Centre. Academics often need to have an overview of the marks they have given and make comparisons between assignments that have similar marks to ensure parity.


    8. Ability to highlight or favourite Attempts to make it easy to revisit them.

    Useful for large cohorts and where you need to easily identify an attempt that you want to revisit e.g. for moderation purposes.


    We would be keen to find out if these issues and suggested enhancements would help out others using anonymous marking?

    Product Version (if applicable):0