{"id":438,"date":"2022-05-03T14:31:09","date_gmt":"2022-05-03T14:31:09","guid":{"rendered":"https:\/\/blogs.oregonstate.edu\/success\/?p=438"},"modified":"2022-05-03T14:38:05","modified_gmt":"2022-05-03T14:38:05","slug":"peer-review","status":"publish","type":"post","link":"https:\/\/blogs.oregonstate.edu\/success\/2022\/05\/03\/peer-review\/","title":{"rendered":"Choosing a Peer Review Platform"},"content":{"rendered":"

by Kelley Calvert<\/a><\/p>\n

Please visit this document<\/a> for an accessible version of this article.<\/p>\n

Note<\/em><\/strong>: Done well, peer assessment can remove the emphasis on grades and refocus energy on learning, shifting the instructor role from grading extensively to facilitating and coaching writing processes. In this post, I uphold the value of peer assessment as a point of departure and do not further debate the merits or shortcomings of this pedagogical approach. For more thinking on this debate, I encourage folks to check out the Headagogy podcast, particularly the episodes on ungrading and peer assessment linked <\/em>here<\/em><\/a>.<\/em><\/p>\n

Once, in a time not-so-long ago, students schlepped to class, backpacks heavy with paper copies of their most recent essays, made notes on paper, scribbled in each other\u2019s margins, and commented on the instructor\u2019s questions. As a student, I always wondered how the instructor measured the quality of our feedback to one another and assessed how well we incorporated each other\u2019s reviews\u2013did they ever really look at those hundreds of papers piled on their desks?<\/p>\n

Today\u2019s digital equivalents of paper peer review include Canvas, Eduflow, Eli Review, and Peerceptiv, all of which permit greater efficiency and efficacy in responding to writing. These platforms allow multiple (often anonymous) peer reviewers, give writers an opportunity to rate feedback, and provide instructors with dashboard insights into student writing and feedback. As a result, instructors\u2019 questions about peer assessment today differ substantially from years past, often boiling down to choice: How do we decide on a digital platform?<\/p>\n

Considerations<\/h2>\n

An instructor might think about several issues when selecting a peer assessment platform, including supported assignment types (documents, audio, video), cost, data privacy, user options, functionality, and review types (anonymous, random, manual). Depending on one\u2019s context, these criteria might take on varying degrees of importance, but generally speaking, the most important criteria seem to be functionality and cost. With this in mind, the chart below provides insights into the four most-widely used platforms on campus: Canvas, EduFlow, Peerceptiv, and Eli Review.<\/p>\n\n\n\n\n\n\n\n\n
\n

Platform<\/h2>\n<\/td>\n

\n

Cost<\/h2>\n<\/td>\n

\n

Functionality<\/h2>\n<\/td>\n

\n

Review Type<\/h2>\n<\/td>\n<\/tr>\n<\/thead>\n

Canvas<\/strong><\/td>\nFree<\/td>\nAllows students to give and receive feedback using rubric<\/td>\nAnonymous or Known<\/td>\n<\/tr>\n
EduFlow<\/strong><\/td>\nFree up to 15 students or $20 a month up to 100<\/td>\n\u2981\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Includes self-review function<\/p>\n

\u2981\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Allows rating of peer reviews<\/p>\n

\u2981\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Includes instructor analytics<\/td>\n

Anonymous or Known<\/td>\n<\/tr>\n
Peerceptiv<\/strong><\/td>\n$15 a month payable by student, instructor, or institution<\/td>\n\u2981\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Focuses on data and assessment<\/p>\n

\u2981\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Generates grade through peer review<\/p>\n

\u2981\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Allows rating of peer reviews<\/td>\n

Anonymous<\/td>\n<\/tr>\n
Eli Review<\/strong><\/td>\nStarts at $12.50 a month for students<\/td>\n\u2981\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Focuses on entire writing process<\/p>\n

\u2981\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Provides online instruction<\/p>\n

\u2981\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Includes instructor analytics<\/td>\n

Anonymous or known<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

Platforms<\/h2>\n

Canvas<\/a> <\/strong>offers instructors a free means of assigning peer reviews manually or automatically. Instructors can include a rubric and\/or require comments in the review. Canvas allows TA access and allows both anonymous and known peer review. Canvas offers a great number of benefits, but compared to other options, it may be somewhat limited as other options provide stronger instructor analytics and scaffold students\u2019 writing process.<\/p>\n

EduFlow<\/a> <\/strong>enables anonymous peer review assigned manually or automatically while also providing the teacher access to analytical data about student writing. If the instructor has \u201corganization\u201d as a criterion in the rubric, and this area consistently receives low ratings, they may decide to spend additional class time discussing how to structure the writing project. This platform also allows students to hold their peer reviewers accountable through ratings of their commentary.<\/p>\n

Peerceptiv<\/a>,<\/strong> similar to EduFlow, provides instructor analytics and student reviews of feedback. Students review one another\u2019s writing anonymously in Peerceptiv. the platform then generates grades using automated grading algorithms. While some may feel uncomfortable with this idea, Peerceptiv holds that these scores are as accurate as traditional instructor grading, allowing for more efficient instruction.<\/p>\n

Eli Review<\/a><\/strong> in comparison to Perceptive, focuses more on the learning process itself. Including instructional units on revision for instructors and students, Eli Review engages all members of the classroom in the learning process. It creates an environment for students that encourages debriefing, modeling of drafts and feedback, and creating\/responding to revision plans. It does not generate grades but serves more as a \u201claboratory\u201d for practice.<\/p>\n

Ultimately, there is no perfect solution and one\u2019s choice of platform might rest heavily on their purpose for seeking one. I find myself drawn to Eli Review due to its focus on the iterative nature of the writing process, but I\u2019m also interested in Peerceptiv in the context of larger classes and Eduflow for its support of a variety of assignment types. Have you used any of these platforms? If so, please comment and share your thoughts.<\/p>\n","protected":false},"excerpt":{"rendered":"

by Kelley Calvert Please visit this document for an accessible version of this article. Note: Done well, peer assessment can remove the emphasis on grades and refocus energy on learning, shifting the instructor role from grading extensively to facilitating and coaching writing processes. In this post, I uphold the value of peer assessment as a … <\/p>\n

Continue reading “Choosing a Peer Review Platform”<\/span><\/a><\/p>\n","protected":false},"author":11895,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[18],"tags":[],"class_list":["post-438","post","type-post","status-publish","format-standard","hentry","category-spring-2022-issue-1"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/blogs.oregonstate.edu\/success\/wp-json\/wp\/v2\/posts\/438","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.oregonstate.edu\/success\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.oregonstate.edu\/success\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/success\/wp-json\/wp\/v2\/users\/11895"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/success\/wp-json\/wp\/v2\/comments?post=438"}],"version-history":[{"count":3,"href":"https:\/\/blogs.oregonstate.edu\/success\/wp-json\/wp\/v2\/posts\/438\/revisions"}],"predecessor-version":[{"id":446,"href":"https:\/\/blogs.oregonstate.edu\/success\/wp-json\/wp\/v2\/posts\/438\/revisions\/446"}],"wp:attachment":[{"href":"https:\/\/blogs.oregonstate.edu\/success\/wp-json\/wp\/v2\/media?parent=438"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/success\/wp-json\/wp\/v2\/categories?post=438"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/success\/wp-json\/wp\/v2\/tags?post=438"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}