During the Study Group’s bi-weekly meeting, peer assessments were brought up, and we shared some of the experiences we’d had with them, in this course and others. They can be quite frustrating. Here are some of the problems we’ve encountered.
One reason is that some learners will score submissions without even looking at them. For your own score to be released, you must first score other learners’ submissions. So some learners go through the motions just for the sake of getting their own score. As a result, even a blank copy might receive a passing grade.
Sometimes, submitting a blank assignment isn’t even required to access other students’ submissions. A simple Google search does the trick. For instance, Manoel found a website with solutions for all the peer-graded assignments of Coursera’s Social Psychology course we’d just taken. The website also has solutions for other courses, including courses from other platforms.
A few keywords, often taken from the assignment prompt itself, is usually all that’s needed to find solutions online. Some popular courses even have complete walkthroughs on YouTube.
While providers usually ask students to uphold an Honor Code, sometimes by checking a box before submitting an assignment, it doesn’t seem to do much to deter motivated cheaters.
Many learners who spend considerable time and effort on their assignments feel aggrieved that cheaters appear to go unpunished.
Some instructors mention the risk of plagiarism and ask reviewers to actively help catch cheaters by flagging suspect assignments. One way to find if an assignment is plagiarized is to Google a few sentences from an assignment and see if it returns some matches.
On YouTube, Manoel also found videos that show how to cheat on popular online courses. These invite learners to join groups on various messaging platforms, such as WhatsApp and Telegram, to progress through courses together, share answers, and give each other passing grades.
Recently, I came across a course discussion in which a mentor said a learner’s assignment was plagiarised. The learner protested, claiming that it was their own work.
Cheating on assignments is not new. The issue was already brought up in 2012 during The Year of the MOOC, when Coursera and other large MOOC providers began to operate. While some measures have been taken, such as disabling the ability to copy/paste other students’ assignments, it appears that over the last nine years, online course providers have made little progress in preventing at-scale cheating on their platforms.
Delays occur when no one is available to review your assignment. Some course forums are full of pleas to “Please assess my assignment”. In fact, requesting reviews on the forum is one of Coursera’s own recommendations, but not a very useful one considering many course forums are deserted.
In a course I took in 2017, several of my assignments were assessed by the same learners, and I assessed theirs. When few learners are in a particular session of a course, it can sometimes take weeks for results to come back. @ruima waited more than a month for her final assessment in Social Psychology to be reviewed. My wait was shorter — 10 days.
A similar issue can occur when there are no assignments available to review. I have sometimes had to check the course each day for several days before I could review enough assignments to receive my own course grade.
Most courses with peer reviews ask learners to review 3 to 5 submissions, then results at the extreme ends are ignored. This helps reduce bias, but it can be confusing for the learner.
Some people will give full points just because the assignment was attempted. Alternatively, some people will give 0 points if they disagree with the assignment’s opinions, even if the rubric asks peers to assess the writing, not the point of view. As a result, some learners who put time and effort into their assignment might get a low grade, while some who merely attempted the assignment might get a passing one.
With participants worldwide, learners have varying command of the language (usually English), which can affect writing assignments as well as reading and commenting on others. Feedback may be minimal, which can be particularly frustrating if points have been deducted without explanation.
Sometimes, such as when there’s a lack of reviewers, your assignment score might end up being determined by a single person. In those cases, whether you get a fair score will entirely depend on that person, which may lead to a lot of frustration.
If you are unhappy with your results, some providers allow you to resubmit your assignment.
Advantages of peer assessments
With so many problems with peer assessments, you might wonder if there is anything good about them. Happily, there are some advantages. By researching, planning, and writing your assignment, you will remember more about the subject. Sometimes, you will find some interesting insights as you assess your peers’ submissions. But don’t copy other assignments and resubmit them as your own!
Your peers might point out issues with your writing that you were unaware of, such as a poorly written essay or arguments that are hard to understand. Use this feedback to learn and improve.
While peer-assessed assignments can be a great learning tool, the credibility of online courses will not endure unless providers take strong action against cheating.
Online learning specialist, still learning after 150+ MOOCs completed since 2012. Class Central customer support and help since 2018.
I am keen to help others make the most of online learning, so I set up a website: www.onlinelearningsuccess.org