As online educators, we strive for a balance of learning activities that incorporate three types of engagement: learner-to-content, learner-to-instructor, and learner-to-learner.  The learner-to-learner component is often filled through discussion boards or group projects, but an underutilized and undervalued option is peer review.

The Rationale

There are many ways peer review benefits students, among them Cornell University Center for Teaching Innovation lists:

  • Empower students to take responsibility for and manage their own learning.
  • Enable students to learn to assess and give others constructive feedback to develop lifelong assessment skills.
  • Enhance students’ learning through knowledge diffusion and exchange of ideas.
  • Motivate students to engage with course material more deeply.

More broadly, the authors of The Knowledge Illusion argue that our individual capacity for knowledge is often much more limited than we realize and that our true depth of knowledge is held collectively.  They remind us that, “when you put it all together, human thought is incredibly impressive.  But it is a product of a community, not of any individual alone” (page 5).  In our increasingly complex world, some evidence of a shift towards building knowledge collectively can be seen in research. For example, in the MEDLINE database, “the average number of authors per article has nearly quadrupled from about 1.5 in 1950 to 5.5 in 2014” (page 226).  This is just one of many examples the authors use to illustrate how essential collaboration and relationship skills have become.  In nearly every field, students need to be prepared to be more than individual achievers, but rather to contribute effectively to a group.  Peer review provides students an opportunity to give and receive feedback with the goal of creating a better end product, but it is also an opportunity for students to practice and build their teamwork skills.

Moreover, International Society for Technology in Education (ISTE) Standard 3b emphasizes the need for students to, “evaluate the accuracy, perspective, credibility and relevance of information, media, data or other resources.”  Peer review is a great way for us to meet this standard and to combat against misinformation, by teaching students to evaluate and challenge claims.  In Weaponized Lies: How to Think Critically in the Post-Truth Era author Daniel J. Levitin shares strategies for how we can think more critically and evaluate the trustworthiness of what we are being told.  He notes that, “sometimes the people giving you the facts are hoping you’ll draw the wrong conclusion; sometimes they don’t know the difference themselves” (page xx).  If your students are in either of these groups, it benefits them to have an attentive reader review their work and provide respectful suggestions for improvement prior to a final assignment submission.  This may help you as the instructor to avoid catching errors too late in the process when students cannot revise their work.

The Explanation

However, students may not see the value of peer review on their own.  The Teaching Center at Washington University in St. Louis describes many reasons students may express uncertainty around peer review as, “Many students do not perceive feedback from peers as relevant to the process… students are likely to assume that it is only the instructor’s feedback that ‘counts.’”  Therefore, it is important that we explain to students why we are asking them to engage in peer review explicitly.

It can be helpful to explain specifically how this will relate to industry or field of study requirements as a student advances as a professional and scholar – it looks different for a researcher than it does for a project manager, so motivate students by sharing with them how they will engage in similar activities in the future as this gives them an opportunity to practice what Starting Point: Teaching Entry Level Geoscience describes as, “key skills such as abstracting, developing arguments, describing, assessing, criticizing, analyzing, and reviewing.”  As Faculty Focus advises, we can’t assume that students will implicitly understand the purpose of peer review.  When we craft a peer review assignment, we need to think carefully about how we will articulate the benefits of the process to students.  It can be helpful to answer questions like, “Why am I having students do this?” and “Why should students be excited about this process?”  Or, to take it a step further, we can anticipate the questions from our students’ perspective and proactively address the purpose and logistics in the assignment description, by answering questions like, “Why am I doing peer review?” and “How am I supposed to review my peer’s work?”  Make sure the technology needed and processes are clear and that resources are provided for students that need more guidance.

The Process

Remember, knowing why students are peer reviewing and being able to peer review are two totally different skills.  If you are an Ecampus instructor, talk with your instructional designer about strategies that can help your peer review process be more successful.  Some of the best practices suggested by Center for Instructional Technology & Training at the University of Florida include:

  • Clarify expectations in advance
  • Check your students have all the tools they will need
  • Provide enough time in the peer review process so that students can meaningfully engage – this may span more than one module
  • Model the type of feedback you want your students to use
  • Create a quality rubric as a guide

Your instructional designer can also talk to you about digital tools or strategies that can be used to introduce students to peer review. For example, you can discuss whether it makes more sense to use Canvas Peer Review or another tool, like Peerceptiv, which is research-validated peer assessment technology available for Ecampus courses.

Remember, students need opportunities to practice peer review, as they may never have done it before.  That means they have to get familiar with both the tools and the process.  It’s best if they can practice with the technology on a low stakes assignment before using it for a high stakes assignment, so that they can familiarize themselves with a peer review process without the added anxiety of a major grade on the line.  It will also take time for you as the instructor to get familiar with the process, but it is a completely worthwhile investment!

I invite you to consider some concluding thoughts from Levitin, “Information gathering and research that used to take anywhere from hours to weeks now takes just seconds… The implicit bargain that we all need to make explicit is that we will use just some of that time we saved in information acquisition to perform proper information verification” (page 253).  Let’s reinvest some of the time our students saved researching to engage them in verifying claims, evaluating evidence, offering commentary, and incorporating feedback – all of which support the development of a stronger student work and the building of a collective knowledge.

Curious what an Ecampus Instructional Designer is looking for when they approve slides for narrated lectures?  It certainly depends on the course content.

Generally, the top three things I am looking at are copyright, accessibility, and aesthetics.

For this post, I am going to focus on copyright and I will return to the other topics in a future post.  A copy of the slides, which includes links to helpful materials, is available below the video as well as a list of resources.

Slides: Copyright Considerations for Narrated Slides

Resources:

When teaching face-to-face, you might break your lectures into weeks because you will only meet with students once or twice a week.  You hope to give them all the information they need during your face-to-face sessions for them to successfully complete work independently between classes.

While a typical face-to-face lecture can span 50-90 minutes, there is evidence to suggest shortening the length for your online students may be a better practice.  Your online students may be in and out of your course many more times than they would be face-to-face and this gives you the opportunity to think about designing your video lectures differently.  Organizing your lectures topically, rather than weekly can be a powerful way to redesign your course.

Students can find what they need, when they need it

Imagine you are taking a course on humor and Week 1 covered the causes of laughter.  Midterms are approaching and you realize you understood the causes exaggeration and anticipation, but can’t remember what protection was about.  If there was one long lecture on the causes of humor, you would have to re-watch or scroll through the whole lecture to find this one piece of information.  But, if your instructor had each of the lectures separated out and named by topic, you could easily review the one topic that was confusing to you.  If you have a limited amount of time to study, you can place your focus on studying the content, rather than finding it.

The practice of topic-based videos also makes finding content later much easier for your learners. Consider how much harder it is to find information when you are looking through titles like “Week 2”.  By Week 9, when students might be reviewing for their final, is it likely they will remember exactly what you covered in Week 2?  However, they could quickly glance at topical titles to jog their memory when deciding what to study.

Speaking from experience, I reviewed videos from a course I had completed to prepare for a job interview.  I remembered that the course had the lectures broken out by topic rather than week, so it was easy to refresh myself on concepts that I was sure would come up with the employer.

Students can digest smaller pieces

Topical lectures, perhaps several short ones per week, are easier to digestible than weekly lectures.  And, shorter lectures are more likely to be viewed by students.

Imagine a course where the topics might be complex, intimidating or unfamiliar.  For me, this could be German.  If I bought a German book today, I know it would sit on my shelf collecting dust.  But, I might use an app like Duolingo to learn a couple of words each day, which feels much more manageable.  Consider that microlearning is advantageous, particularly for adult students that may benefit by breaking their studying into many small, achievable sessions.

It is faster and easier for you to make changes

If you are noticing that students are just “not getting” a certain topic, it is much easier to rerecord a small video on just this one topic than to rerecord a long video on several topics.  This is particularly true if many of the topics covered are being understood – why make more work for yourself?

It is also easier to rearrange videos if they are topical.  If you realize that one topic belongs in Week 2 and not in Week 7, you can simply move that one part without re-thinking the whole week two video.

Topical videos allow you to add value to other course materials

An effective use of short videos can be to add value to the topic through your experience or expertise as the instructor.  You can discuss a case study or scenario that relates to a topic that helps students understand the topic in action.  Rather than a long video that includes both the lecture and the example, break these into two parts.  If you totally reiterate what students are learning in another part of their course, like a reading, they might wonder why they are doing both activities.  But, your examples add a layer of meaning and depth to the other course materials.

People can find almost any information on the internet.  Part of their motivation to take courses is to gain access to your knowledge as an expert in the field.  Short videos that talk about real-life situations adds both instructor presence and meaning for students.

Short videos load more quickly

No one wants technology to be a barrier for students.  Short videos load more quickly, which can be important to students that don’t have consistent access to high-speed internet.  You don’t want the student to get frustrated and give up simply because a video is too long, when it can easily be divided into pieces.

Challenge yourself to be focused

By committing to create shorter content, you challenge yourself to be focused and refined in what you share.  By setting a goal, like recording videos under 7 minutes per topic, the quality of the content must be top notch.  This encourages you to review your content to cut out what is redundant, unclear, or off-topic, which can be very satisfying.  And, if you model being on point, precise, and specific – your students will have a clear expectation on the quality of work they are expected to create as well.

Examples

Like some inspiration to get started?  Thanks Joanna Abbott for this example that comes in at 4 minutes and 41 seconds: ALS 114 decision making matrix

Intake meetings, where I met instructors for the first time, is one of my favorite aspects of being an instructional designer because every meeting is so different.  I especially love having first meetings in the instructor’s office and getting a glance at the books adorning their shelves, the art displayed on their walls, their projects, research, and insights on whiteboards, napkins, and notepads.  Sometimes faculty come in with little to no online teaching experience and are not sure where to start; other times they have years of experience and crystal clear ideas on how they want to design their course.  I really feel fortunate to work with brilliant minds from a variety of backgrounds!

But, what makes for the very best of the best intake meetings?  When we really develop a relationship.

It is easy to dive right into the logistics at the intake, because instructors often have burning questions about their courses, particularly if there have been little hang ups that have been irking them.  How does grading this type of assignment work in the LMS?  When are the deadlines for working on the course development?  Do I have to follow the Ecampus syllabus template exactly?  These type of questions are important and I enjoy helping faculty get clarity, so I do, of course, make plenty of time to address them.  But, the best start comes from getting to know you first!

When I get to know you and your vision for your course, I learn about your teaching style.  I learn about the things that make you excited to teach and where your learners sometimes get stuck in your courses.  I learn about why you use certain sorts of assessments and not others, what “keeps you awake” when you think about your course and what would make you really proud of your work when we are finished with our development.

I also learn about ways of partnering that energize you and ways that drain you, which helps me to figure out how I can best use my skills to enrich your course design.  You are without a doubt the expert in your subject – frankly, intimidatingly so at times.  My goal is to find an approach to collaborating that taps deeply into your expertise, while leveraging my knowledge of students, andragogy, design, online tools, accessibility, and the like.

The knowledge I bring to the table sometimes requires me to challenge you, which can be uncomfortable.  I sometimes have to ask questions like, “is this an appropriate assessment for the learning outcome?  Would you consider structuring this activity in another way?”  I do this to advocate for students and their learning – not just to be a nuisance.  Having an authentic working relationship helps us to discuss these aspects of your course openly and genuinely.  There are times I need you to push back and let me know that the existing structure is important to you and why.  And, there are times that I need you to trust my skills as a designer and be open to exploring a new approach.

The sooner we can get comfortable with one another, the deeper we can dive into your course and the more time we can dedicate to the optimizations that makes your course easier and more enjoyable to deploy in the long run.  We are fortunate to use a two term development cycle so we have plenty of time to iron out and revisit snags that will lead to a lot less work during the actual facilitation of your course.  My strongest courses come from faculty that I have met with multiple times, developed a real partnership with, and now share cohesive and motivating goals.  I invite you to really “lean into” your relationship with your instructional designer – ask questions, get curious, be vulnerable, take time – your course design (and your ID) will thank you for it!