This post is adapted from a panel talk for AI Week, Empowering OSU: Stories of Harnessing Generative AI for Impact in Staff and Faculty Work

This past spring marked one year in my role as an instructional designer for Ecampus. Like many of our readers, I started conversing with AI in the early months of 2023, following OpenAI’s rollout of ChatGPT. Or as one colleague noted in recapping news of the past year, “generative AI happened.” Later, I wrote a couple of posts for this blog on AI and media literacy. A few things became clear from this work. Perhaps most significantly, in the words of research professor Ethan Mollick: “You will need to check it all.”

As the range of courses I support began to expand, so did my everyday use of LLM-powered tools. Here are some of my prompts to ChatGPT from last year, edited for clarity:

  • What is the total listening time of the Phish album Sigma Oasis?
    • Answer: 66 minutes and 57 seconds
  • How many lines are in the following list of special education acronyms (ranging from Section 504 – the Rehabilitation Act – to TBI – Traumatic Brain Injury)?
    • Answer: 27 lines
  • Where is the ancient city of Carthage today?
    • Answer: Today, Carthage is an archaeological site and historical attraction in the suburbs of the Tunisian capital, Tunis.
  • What is the name of the Roman equivalent of the Greek god Zeus?
    • Answer: Jupiter, king of the gods and the god of the sky and thunder
  • What’s the difference between colors D73F09 and DC4405?
    • Answer: In terms of appearance, … 09 will likely have a slightly darker, more orange-red hue compared to … 05, which might appear brighter. (Readers might also know these hues as variations on Beaver Orange.)

And almost every day:

  • Please create an (APA or MLA) citation of the following …

The answers were often on point but always in need of fact checking or another iteration of the prompt. Early LLMs were infamously prone to hallucinations. Factual errors and tendencies toward bias are still not uncommon.

As you can sense from my early prompts, I was mostly using AI as either a kind of smart calculator or an uber-encyclopedia. But in recent months, my colleagues and I here at Course Development and Training (CDT)—along with other units in the Division of Educational Ventures (DEV)—have been using AI in more creative and collaborative ways. And that’s where I want to focus this post.

The Partnership

First, some context for the work we do at DEV. Online course development is both a journey and a partnership between the instructor or faculty member and any number of support staff, from training to multimedia and beyond. Anchoring this partnership is the instructor’s working relationship with the instructional designer—an expert in online pedagogy and educational technology, but also a creative partner in developing the online or hybrid course.

Infographic showing the online course development process, from set up, to terms 1-2 in collaboration with the instructional designer, to launch and refresh.
Fig. 1. Collaboration anchors the story of online course development at OSU (credit: Ecampus).

Ecampus now offers more than 1,800 courses in more than 100 subjects. Every course results from a custom build that must maintain our strong reputation for quality (see fig. 1). This post is focused on that big circle in the middle—collaboration with the instructional designer. That’s where I see incredible potential for support or “augmentation” from generative AI tools.

As Yong Bakos, a senior instructor with the College of Engineering, recently reminded Faculty Forum, modern forms of this technology have been around since the 1940s, starting with the influence of programmable computers on World War II. But now, he added—in challenging faculty using AI to figure out rapid, personalized feedback for learners—”we speak the same language.”

Through continued partnership, how do we make such processes more nimble, more efficient? What does augmentation and collaboration look like when we add tools like Copilot or a custom GPT? Many instructional designers have been wrestling with these questions as of late.

“Human Guided, but AI Assisted”

Here are a few answers from educators Wesley Kinsey and Page Durham at Germanna Community College in Virginia (see fig. 2). Generative AI—also known as GAI—is a powerful tool, says Kinsey. “But the real magic happens when it is paired with a framework that ensures course quality.”

Slide on
Fig. 2. From a recent QM webinar on “unleashing” generative AI (CC BY-NC-ND).

Take this line of inquiry a little farther, and one starts to wonder: How might educators track or evaluate progress toward such use cases?

Funneling Toward Augmentation

As a thought experiment, I offer the following criteria and inventory—a kind of self-assessment of my own “human guided” journey through course development with generative AI (see fig. 3).

Criteria for Augmenting Development with Generative AI

ESTABLISHED – Regular, refined practice in course development
— EMERGING – Irregular and/or unrefined practice, could be improved
— ENVISION – Under consideration or imagined, not yet practiced

Faculty with experience teaching online may find my suggested criteria familiar; “established, emerging, envision” is adapted from an Ecampus checklist used in course redevelopment.

Funnel-shaped infographic with five augmentations: (1) From set up to intake; (2) Course content; (3) Suggested revisions; (4) Discussion, planning, and review; (5) Building and rebuilding
Fig. 3. Self-assessment of augmenting development with generative AI (CC BY-NC-SA).

Augmentation 1: From Set Up to Intake

Broadly speaking, I’m only starting to use chatbots in kicking off a course development—to capture a bulleted summary of an intake over Zoom, for example. Or with these kinds of level-setting prompts:

  • Remind me, what is linear regression analysis?
  • What fields are important to physical hydrology?
  • Explain to a college professor the migration of a social annotation learning tool from LTI 1.1 to 1.3.

Augmentation 2: Course Content

In my experience, instructors are only now beginning to envision how they might propose a course or develop its learning materials and activities with support from tools like Copilot—which is increasingly adept at helping us with this kind of iterative brainstorming work. The key here will be getting comfortable with practice, engaging in sustained conversations with defined parameters, often in scenarios that build on existing content. In recent practice with building assignments, I’m finding Claude 3 Sonnet helpful—more nuanced in its responses, and because you can upload brief documents at no cost and revisit previous chats.

Screenshot of conversation with Copilot, starting with a request to create an MLA citation of a lecture by Liam Callanan at the Bread Loaf Writers' Conference
Fig. 4. From a “more precise” conversation on citation generation. Can you spot Copilot’s errors in applying MLA style?

Augmentation 3: Suggested Revisions

Once course content begins rolling in, I apply more established practices for augmentation. For building citations of learning materials, I’m using Copilot’s “more precise” mode for its more robust abilities to read the open web and draw on various style guides (see fig. 4). With activities, often the germ of an idea for interaction needs enlargement—a statement of purpose or more detailed instructions. Here are a few more examples from working with the School of Psychological Science, with prompts edited for brevity:

  • What would be the purpose of practicing rebus puzzles in a lower division course on general psychology?
  • Please analyze the content of the following exam study guide, excerpted in HTML. Then, suggest a two-sentence statement of purpose that should replace the phrase lorem ipsum.
  • How should college students think about exploring Rorschach tests with inkblots? Please suggest two prompts for reflection (see fig. 5.)
Screenshot of Week 6 - Reflection Activity - Rorschach Inkblot Test, including a warning about the limitations of Rorschach tests and prompts for reflection
Fig. 5. From an augmented reflection activity in PSY 202H, General Psychology (credit: Juan Hu).

Augmentation 4: Discussion, Planning & Review

As with course planning, I’m not quite there yet with using generative AI to shape module templates and collect preferred settings for the building I do in Canvas. But by next year—armed perhaps with a desktop license for Copilot—I can imagine using AI to offer instructors custom templates or prompts to accelerate the design process. One more note on annotating augmentation—it’s incredibly important to let my faculty partners know—with consistent labeling—when I’m suggesting course content adapted from a conversation with AI. Most often, I’m not the subject matter expert—they are. That rule of thumb from Ethan Mollick still holds true: “You will need to check it all.”

Augmentation 5: Building & Rebuilding—More Efficiently

Finally, I look forward to exploring opportunities for more efficiently writing and revising the code behind everything we do with support from generative AI. Just imagine if the designer or instructor could ask a bot to suggest ways to strengthen module learning outcomes or update a task list, right there in Canvas.

Your Turn

With the above inventory in mind, let’s pause to reflect. To what extent are you comfortable using generative AI as a course developer? In what ways could this technology supplement new partnerships with instructional designers—or other colleagues involved in the discipline you teach? Together, how would you assess “augmentation” at each stage of the course development process?

Looking back on my own year of “human guidance with AI assistance,” I now turn more reflexively to AI for help with frontline design work—even as our team considers, for example, the ethical dimensions of asking chatbots to deliver custom graphics for illustrating weekly modules. In other stages, I’m still finding my footing in leveraging new tools, particularly during set up, refresh, and redesign. As we continue to partner with faculty, I remain open to navigating the evolving intersection of AI and course development.

(And now, for fun: Can you spot the augmentation? How much of that last sentence was crafted with support from a “creative” conversation with Copilot? Find the answer below.)

Resources, etc.

The following resources may be helpful in exploring generative AI tools, becoming more fluent with their applications, and considering their role in your teaching and learning practices.

I was recently reminded of a conference keynote that I attended a few years ago, and the beginning of an academic term seems like an appropriate time to revisit it on this blog.

In 2019, Dan Heath, a bestselling author and senior fellow at Duke University’s CASE Center, gave a presentation at InstructureCon, a conference for Canvas users, where he talked about how memories are formed. He explained that memories are composed of moments. Moments, according to Heath, are “mostly forgettable and occasionally remarkable.” To illustrate, most of what I’ve done today–dropping my kids off at spring break camp, replying to emails, going to a lunchtime yoga class, and writing this blog post–will largely be forgotten by next month. There is nothing remarkable about today. Unremarkable is often a desirable state because it means that an experience occurred without any hiccups or challenges.

Heath went on to describe what it is that makes great experiences memorable. His answer: Great experiences consist of “peaks,” and peaks consist of at least one of the following elements: elevation, insight, pride, or connection. He argued that we need to create more academic peaks in education. Creating peaks, he contends, will lead to more memorable learning experiences.

So, how do we create these peaks that will lead to memorable experiences? Let’s explore some ideas through the four approaches outlined by Heath.

Elevation. Elevation refers to moments that bring us joy and make us feel good. You might bring this element into your course by directly asking students to share what is bringing them joy, perhaps as an icebreaker. Sharing their experiences might also lead to connection, which is another way (see below) to create peaks that lead to memorable experiences. 

Insight. Insight occurs when new knowledge allows us to see something differently. Moments of insight are often sparked by reflection. You might consider making space for reflection in your courses. Creativity is another way to spark new insights. How might students engage with course concepts in new, creative ways? To list off a few ideas, perhaps students can create a meme, record a podcast, engage in a role play, or write a poem.

Pride. People often feel a sense of pride when their accomplishments are celebrated. To spark feelings of accomplishment in your students, I encourage you to go beyond offering positive feedback and consider sharing particularly strong examples of student work with the class (after getting permission–of course!) Showcasing the hard work of students can help students to feel proud of their efforts and may even lead to moments of joyful elevation.

Connection. Connection refers to our ties with other people. Experiencing connection with others can feel deeply rewarding. As I mentioned above, asking students to share their experiences with peers is one way to foster connection. In Ecampus courses, we aim to foster student-student and student-teacher connection, but I encourage you to explore other opportunities for students to make meaningful connections. Perhaps students can get involved with their communities or with colleagues, if they happen to have a job outside of classes. Students could connect with their academic advisors or the writing center to support their work in a course. There are many ways to foster connections that support students in their learning!

It’s easy to focus on delivering content, especially in online courses. This was one of Heath’s overarching points. The key, however, to creating memorable learning experiences is to take a student-centered approach to designing and facilitating your course. 

I invite you to start the term off by asking yourself: How can I create more moments of elevation, insight, pride, and connection for my students? It might be easier than you think.

References:

Heath, D. (2019, July 10). Keynote. InstructureCon. Long Beach, CA.

Seems like an easy question to answer, right? I might not give it a second thought.

Yet, as an online course developer, I sometimes find myself in conversations with co-developers where I realize I’ve been working under a different assumption about what a lecture is. And that’s fine, I kind of like having my preconceptions challenged. I wanted to share a little of that experience.

Our media development team has one of the stricter definitions of lecture, a specific kind of video recording. They have to, they are handling hundreds of videos every term. It’s essential for them to be able to sort media into the most efficient pipeline. Makes sense.

However, when I am working with subject matter experts, instructors, co-developers, etc. … I have found it useful to stay more flexible regarding many definitions. Sometimes errors in assumptions can open a door for discourse. It has certainly been a creative challenge. As an example, I’ll reminisce a little about a couple of my favorite mistaken assumptions about lectures. Ah yes, I remember it like it happened just this last Fall ….

I helped develop an upper-division online course centered on technology for educators. My first mistaken assumption was going in all ready to talk about video lecturing. The instructor on this co-development was a podcaster and wanted to deliver lectures in that format. I’ve had other instructors who preferred podcast lectures, no worries there. Some instructors see podcasts as a more portable kind of lecture or an alternative way to access the content. Students can listen to lectures on the go or download the lecture for offline listening. We just had to make sure to include transcripts for accessibility instead of captioning.

Also, I got to design the following playback interfaces to make them look more ‘podcasty’.

As you’ve probably guessed, there was a second mistaken assumption on my part. I was thinking the podcasts were the lectures. The podcasts are pieces of a larger “discourse given before an audience or class especially for instruction”. (Miriam-Webster: lecture and discourse). For our course, this discourse might be composed of multiple media element types.

The instructor wanted each ‘lecture’ to be a curated collection of learning elements focusing on specific topics; podcasts, video, reading, even Padlet posts. Part of the pedagogy here is to immerse them, as students, in a variety of technologies in the lectures that they may be using as educators. Together, we collaborated to find the most effective way to present all of this material as discrete lectures. Below is what we came up with. Would you still consider these lectures?

Interestingly, I don’t think we’ve quite strayed far from the Merriam-Webster definitions:

  • lecture: A discourse given before an audience or class especially for instruction
  • discourse: Formal and orderly and usually extended expression of thought on a subject. Connected speech or writing

While the course did include some interactive learning elements, these were not incorporated into lectures. It’s an interesting thought though.

  • How would you incorporate interactive exercises into lectures?
  • Does that still work within the definitions given above?

Maybe we can stretch the definition a little more. (Hmm. Perhaps in another blog post)

My takeaway here is that a lecture doesn’t have to be something given before a live class, or a simple narrated PowerPoint video online. As a course developer, my goal is to support my co-developer’s vision. But I am also serving the learning needs of students. As an online course developer, I have more flexibility about what a lecture can be. It makes sense to be open to more possibilities. I look forward to having more of these conversations with co-developers.

Stay flexible. Keep learning.

“Belonging is a universal human need that is fundamentally linked to learning and well-being. It describes an individual’s experience of feeling that they are, or are likely to be, accepted and respected as a valued contributor in a specific environment.”           

Structures for Belonging: A Synthesis of Research on Belonging-Supportive Learning Environments
image of Maslow's pyramid of needs

Maslow’s Hierarchy of Needs is a helpful framework when discussing belonging, which falls in the middle, at level three, just above the basics for survival (level one: air, water, food, shelter) and safety (level 2: health, employment, family, security). 

Image from Wikimedia Commons

Have you heard the word belonging recently in reference to students and employees? At OSU, it seems to be popping up frequently in conversations and discussions, onboardings and trainings, online and off, becoming a buzzword for those concerned with teaching and learning, recruitment and outreach, employee satisfaction, and student success, and has become a focal point of our ongoing efforts towards diversity, equity, and inclusion. This increased focus on the concept of belonging at OSU is reflected in the university’s 2018 Innovate & Integrate: Plan for Inclusive Excellence, and is echoed by the 2021 Oregon Department of Education’s passing of the Every Student Belongs rule, which states, “It is the policy of the State Board of Education that all students, employees, and visitors in public schools are entitled to learn, work, and participate in an environment that is safe and free from discrimination, harassment, and intimidation.” These initiatives reflect a growing understanding that traditionally prevailing systems of power have historically marginalized certain groups and excluded them from many realms of life, including education, and prioritize a commitment to changing the status quo explicitly and with intention. 

At Ecampus, belonging is an area of active study, and our effort to extend the feeling of belonging to our online students is an important part of our mission, vision, & values and our own Inclusive Excellence Strategic Plan’s goals. We realize that our Ecampus students come from a wide range of backgrounds, seek online learning for a variety of reasons, and comprise higher numbers of students from historically marginalized backgrounds, and thus, combined with the nature of online learning, can feel increased isolation and less of a sense of belonging than their on-campus peers. 

What is belonging and why is it important?

Belonging is a complex, multi-layered, and changeable quality that is nonetheless very important for student success. Maslow’s Hierarchy of Needs places belonging in the category of psychological needs, just above the basic needs including food, water, air, safety, and shelter. While there are many definitions, the concept of belonging generally encompasses feeling safe, appreciated, welcomed, valued, and respected in a given situation. Humans learn to search for and interpret signals that they belong or do not belong when entering into new situations or contexts. Marginalized groups have had to learn to be cognizant of where and when they could expect to be excluded and on the alert for cues signaling such. Traditionally, educational institutions have been places of exclusionary practices, often closed to large groups in both policy and practice. Students from marginalized populations, facing this problematic history of exclusion, may be looking for signals and signs that indicate the extent to which they are valued and respected as members of the school community. Students may not be sure they will be accepted in institutions, departments, courses, and other school environments and may be consciously or unconsciously searching for such clues as reassurance that they do, in fact, belong. 

Belonging is important for student success because it conveys a host of positive benefits and is a crucial aspect of educational accomplishment. When students find welcoming, inclusive attitudes, see others like themselves being accepted and thriving, and are made to feel safe, protected, supported, and valued, their sense of belonging increases, which in turn allows them to relax and be confident sharing more of their full selves. Students who have a strong sense of belonging show increased academic performance, better attendance, persistence, retention, and motivation, and less likelihood of dropping out. Dr. Terrill Strayhorn, Professor of Urban Education and Vice President for Academic and Student Affairs at LeMoyne-Owen College, in his book College Student’s Sense of Belonging, concludes that “deprivation of belonging in college prevents achievement and wellbeing, while satisfaction of college students’ sense of belonging is a key to educational success for all students.” 

In education, as in our society at large, belonging is often related to larger systems that privilege and prefer certain groups and their ideas, beliefs, and ways of being. Those whose race, ethnicity, sexual identity, gender, class, indigeneity, language, or ability are not of the majority are especially likely to be anxious and “on alert” to othering, exclusion, bullying, and stereotyping. This can have dramatic negative short and long term effects, including lowered cognitive capacity, increased stress, and reduced persistence and achievement. Students who lack a sense of belonging may feel uncomfortable in class or group work, unable to concentrate, and may experience self-consciousness and worry, which makes it that much more difficult to attain higher-level needs such as self-confidence, recognition, respect, fulfillment, and achievement. When students face active discrimination, bullying, or other forms of harassment, they may become depressed, choose to disengage, drop courses, or discontinue studying. With such dire consequences, taking the time to understand and assist in ensuring all OSU students are made to feel welcomed and accepted is well worth the effort. 

Why do online students sometimes feel less of a sense of belonging? 

There are many contributing factors to the disparity between online and traditional students’ development of a sense of belonging, starting with the very nature of the modality in which they study. Students living and studying on campus often have more frequent contact with instructors, campus staff, and other students, both structured and impromptu, providing opportunities to build relationships that can enhance their sense of community and belonging. The pacing of on-campus courses tends to be predictable, with regular meetings during which students often have the chance to ask questions (and receive answers quickly) and get to know fellow students and instructors. Instructors have dedicated class time to review important concepts, check understanding, and provide opportunities for students to get to know them and their fellow students. The traditional on-campus experience is geared towards taking a diverse group of students and building a cohesive community in many ways- students have a wide array of support services available to them, many activities, sports, and clubs they can join, and have a host of opportunities to participate in the rich culture of OSU and in academic and social communities, most of which are easily accessible on campus. Indeed, the very nature of on-campus learning seeks to provide a community for traditional students, many of whom are young and leaving their own homes and communities for the first time.

In contrast, Ecampus courses are asynchronous, featuring no scheduled meeting times, as our students live around the USA and the world. While this format allows for increased access for students who cannot attend in person, the lack of face-to-face interaction can make it difficult for both students and instructors to make personal connections. Unless their courses are carefully designed to provide chances for interaction, conversation, collaboration, and community building, online students may not often interact with their instructors or peers. Online students can experience feelings of isolation, loneliness, and disengagement, which can greatly affect their sense of belonging as an OSU student as well as their success and performance. 

Complicating things even further is the tendency to experience digital miscommunication, the concept that humans are less able to infer tone, underlying sentiment, and in general not understand nuance when communicating by text and online, to some extent due to the lack of context and/or visual clues one gets when interacting face to face. A 2016 literature review on the topic of establishing community in online courses found digital communication to be a consistent issue, noting “…the absence of visual meaning-making cues such as gesture, voice tone, and immediate interaction can frustrate students and lead to feelings of isolation and disconnectedness in an online classroom” and recommended that instructors who teach online learn the nuances of these different communication needs. 

It must be noted that some online students, who may be older, working full or part time, caring for family, or otherwise already leading (sometimes overly) full lives do not particularly want or need the sense of community that younger traditional students may seek out from their university. They may have little time to devote to community building and little interest in superfluous interaction, shying away from an increased social burden they may not have time and energy to fully commit to. Since we cannot know in advance the detailed makeup of our student body, planning with an assumption that creating belonging is an important aspect of our approach serves online students best.

Stay tuned for Part 2: What can we do to help? for research-based strategies you can use to improve belonging and inclusion.


Sources

Ally for Canvas | Learn@OregonState

Belonging and Emotional Safety – Casel Schoolguide 

Building Inclusivity and Belonging | Division of Student Affairs

College Student’s Sense of Belonging

Creating a Safe and Respectful Environment in Our Nation’s Classrooms 

Cultural Centers | Oregon State University

Decades of Scientific Research that Started a Growth Mindset Revolution

Ecampus Essentials – Standards and Principles – Faculty Support | Oregon State Ecampus | OSU Degrees Online

Establishing Community in Online Courses: A Literature Review 

Growth Mindset in the Higher Education Classroom | Center for Learning Experimentation, Application, and Research

Innovate & Integrate: Plan for Inclusive Excellence | Institutional Diversity 

Mission, Vision and Values | Oregon State Ecampus | OSU Degrees Online

Online Teaching Principles – Standards and Principles – Faculty Support | Oregon State Ecampus | OSU Degrees Online

Oregon Department of Education 

OSU Search Advocate Program

Peer Mentor Program | TRiO | Oregon State University

Social Justice Education Initiative 

State of Oregon Diversity, Equity, and Inclusion Action Plan

Student Academic Experience Survey 2022

The UDL Guidelines

Update Syllabus – Term Checklist and Forms – Faculty Support | Oregon State Ecampus | OSU Degrees Online

Using a warmer tone in college syllabi makes students more likely to ask for help, OSU study finds | Oregon State University

Utilizing Inclusive and Affirming Language | Institutional Diversity

Some form of group work is a common activity that I help design with faculty every term. Oftentimes, faculty ask how to consider the different levels of engagement from individual group members and how to assess group work, often in the form of a group grade. Improving group work in asynchronous courses and group contracts to promote accountability are some of many ways to guide students into collaborative work. However, collaborative work may require offering equitable opportunities to all students to succeed. Based on the work by Feldman (2019), I’d like to outline some suggestions for assessment design through an equity lens.

Before jumping into assessing group work, Feldman outlines three pillars of equitable grades:

  1. “They are mathematically accurate, validly reflecting a student’s academic performance.
  2. They are bias-resistant, preventing biased subjectivity from infecting our grades.
  3. They motivate students to strive for academic success, persevere, accept struggles and setbacks, and to gain critical lifelong skills” (Feldman, p. 71).

With these three pillars in mind, let’s examine some potential issues with a group receiving one grade for their work.

  1. Accuracy: a collective group grade does not necessarily reflect an individual’s contribution to the group work or assess an individual student’s learning in terms of outcomes. For example, if a group splits up sections of a project into individual responsibilities, a student who did their assigned section very well may not have had an opportunity to gain new knowledge or build on their learning for aspects where they were struggling. And a group grade does not accurately capture their individual work or learning.
  2. Bias: Many times peer evaluations of group work come with some kind of group contract or accountability measure. However, there is a possibility for bias in how students evaluate their peers, especially if that evaluation is based on behaviors like turning things in on time and having strong social skills instead of learning. For example, maybe one of the group members had a job with a variable schedule from week to week, making it difficult to join regular group discussions and complete work at the same pace every week for the duration of the project. Other group members may perceive them as difficult to work with or inconsistent in their commitment and award them fewer points in a peer evaluation, especially if other group members did not have outside factors noticeably impacting their performance.
  3. Motivation: Group contracts and using evaluation as a way to promote productivity is an external motivator and does not instill a sense of internal relevance for students participating in group work. Instead, students may feel resentful that their peers may evaluate them harshly for things outside of their control, which can quickly snowball into a student disengaging from group work entirely.

“The purpose of group work is not to create some product in which all members participate, but for each student to learn specific skills or content through the group’s work together.”

Feldman, p. 104

So how do we assess this learning? Individually. If we can reimagine group work as a journey toward an individual reaching a learning outcome, then instead of assessing a behavior (working well and timeliness in a group) or what a group produces, we can instead create an assessment that captures the individual impact of the group work instead. Feldman outlines some tips for encouraging group work without a group grade:

  1. Have a clear purpose statement and overview for the group work that outlines the rationale and benefit of learning that content in a group context.
  2. Have clear evaluation criteria that shows the alignment of the group work with a follow-up individual assessment.
  3. If possible, include students in the process by having a brainstorm or pre-work discussion ahead of time about what makes groups productive, how to ensure students learn material when working in groups, and what kinds of collaborative expectations can be set for a particular cohort of students.
  4. Be patient with students navigating a new assessment strategy for the first time and offer ample feedback throughout the process so students are set up for success on their assessments.
  5. Ensure the follow-up individual assessment is in alignment with learning outcomes and is focused on the content or skills students are expected to gain through group work.

As an added bonus, assessing group work individually in this way is often simpler than elaborate group work rubrics with separate peer evaluations factored in, making it both easier for the instructor and easier for the student to understand how their grade is calculated. Additionally, it will be important to design this group work with intention—if an individual could learn the material on their own, then what is the purpose of the group interaction? Think about a group project you may have assigned or designed in the past. What was the intention for that journey as a group? And how might you reimagine it if there was an individual assessment after its completion? I hope these questions are great starting points for reflecting on group work assessments and redesigning with equity in mind!

References

Feldman, J. (2019). Grading for equity: What it is, why it matters, and how it can transform schools and classrooms. Thousand Oaks, CA: Corwin.

By Cat Turk and Mary Ellen Dello Stritto

In this time of rapid change in online education, we can benefit from leveraging the expertise of faculty who have experienced the evolution of online education. At the Oregon State University (OSU) Ecampus Research Unit, we have been learning from a group of instructors who have taught online for ten years or more. A review of recent research uncovered that these instructors are an untapped resource. Their insights can provide valuable guidance for instructors who are just beginning their careers or instructors who may be preparing to teach online for the first time. Further, their perspectives can also be enlightening for online students.

In 2018-2019 we conducted interviews with 33 OSU faculty who had been teaching online for 10 years or more as a part of a larger study. Two of the questions we asked them were the following:

  1. What skills do you think are most valuable for online instructors to have?
  2. What skills do you think are most valuable for online students to have?

We will share some of the results of a qualitative analysis of these questions and highlight the similarities and differences.

When asked about the most valuable skills for online instructors, three key skills emerged: communication, organization, and time management. When asked about the most valuable skills for online students to have, the same skills were among the most frequently mentioned by these instructors.

As the table below shows, in the responses about skills for online instructors, communication emerged as the most prominent skill, with 85% of instructors in the study emphasizing its importance, while time management and organization were split evenly at 45%. In their response about skills for students, 64% of the instructors emphasized both communication and time management, while 42% discussed organization. When discussing communication for instructors, they indicated that effective communication is essential for building rapport with students, providing clear instructions, and facilitating meaningful interactions in the online environment. Organization (such as structuring course materials or their weekly work process) and time management skills (such as scheduling availability to connect with students) were also highly valued by these instructors. Read more about the analysis of instructor skills here.

 Skills for InstructorsSkills for Students
Communication    28 responses (85%)   21 responses (64%)
Time Management15 responses (45%)  21 responses (64%)
Organization15 responses (45%)   14 responses (42%)
Self-Motivation   —21 responses (64%)            
Frequency of responses of skills for instructors and students.

The responses to both questions emphasized the significance of communication skills in written assignments and in proactive connections within the scope of the online learning environment. Instructors articulated that online students needed to be proactive communicators themselves. Examples of this include contacting their instructors about questions and clarification in a timely way, interacting with their peers in a respectful manner, and turning in quality written assignments that demonstrate comprehension of their learning material. For students, clear and effective communication ensures understanding and engagement, while organization facilitates seamless navigation through course materials, and time management ensures that students are able to make the most of the asynchronous environment.

While time management and organization were both considered by instructors to be just as crucial for students, their responses demonstrated that these skills were needed for different reasons than would be the case for instructors. Instructors personally valued time management and organization due to the nature of facilitating courses online. When the online classroom can travel from place to place, setting blocks of intentional time and structuring hours accordingly were considered essential to instructors for maintaining a work-life balance and so tasks would not be missed.

On the other hand, according to these instructors, students need time management and organization due to the asynchronous and sometimes isolating nature of online courses. One instructor stressed that:

 “[Students] do need to be more organized than on-ground students, because there’s not that weekly meeting to keep students on track.”

These instructors indicated some online students may need to structure their study time to accommodate a different time zone, while others may need to structure their academic pursuits around careers or children. Another instructor emphasized that:

“A lot of our [online students] actually work full-time, so they have families and kids and have to be much more organized too.”

While there were overlaps with the responses to the two questions, a notable difference was the emergence of another skill for students: self-motivation. This concept of self-motivation emerged from the instructor responses about students’ capacity to persevere in online courses. This included their level of motivation, capacity to learn on their own, and comfort with self-paced learning.

One instructor said the following about students’ self-motivation,

“Some people would say it’s self-discipline, but I think it’s more of they have to have a purpose for that class.”

Self-motivation was not mentioned by the instructors as a skill for online instructors, suggesting that these instructors perceive this as more pertinent to students for success in managing their own learning process. It is worth noting that proactive communication was highlighted as an essential aspect of self-motivation, with instructors emphasizing that students who take the initiative in reaching out to them tend to be more successful. This observation suggests that self-motivated individuals are more likely to actively seek support and clarification, which can enhance their learning experience and overall success. 

Another noteworthy aspect was the need for students to be comfortable with learning in physical isolation. Instructors acknowledged that online learners must navigate the challenges of studying independently without the immediate presence of peers and instructors. For online students specifically,

“They need to be motivated because they’re not going to have peers sitting in a classroom with them, and they don’t have a place that they have to physically go every week.”

This finding underscores the importance of maintaining motivation and engagement, as students ideally possess an intrinsic drive to succeed despite the absence of a physical connection to the university and their classmates.

The findings from this study highlight the importance of certain similar skills for both online instructors and students. Effective communication, organization, and time management are vital for success in the online learning environment for both instructors and students. We found this to be an interesting connection that online students might benefit from understanding: these are key skills that students and instructors have in common.

Our findings about self-motivation may be useful for online instructors. Consider incorporating strategies that foster student self-motivation, such as goal-setting exercises, regular check-ins, and providing opportunities for self-reflection. By empowering students to take ownership of their learning, instructors might enhance student engagement and success in the online environment.

Further, students can learn from the instructors’ emphasis on communication, organization, and time management skills. They can intentionally work on improving their communication skills, seeking clarification when needed, and actively participating in online discussions. Developing effective organization and time management strategies, such as creating schedules, prioritizing tasks, and breaking them down into manageable chunks, may significantly enhance their online learning experience.

The field of online education is evolving rapidly, and here we can see how educators and students alike are adapting to these changes. The experiences of long-term online instructors provide valuable insights into the skills necessary for success in the online learning environment. In the future, what answers would we find if we asked students the same question: what do online students think are the skills needed to succeed in the online classroom? By understanding the shared and distinct perspectives of instructors and students, educators can design effective online courses and support systems that foster meaningful learning experiences and empower students to succeed.

An illustration of a person kneeling and question marks around

Have you ever been assigned a task but found yourself asking: “What’s the point of this task? Why do I need to do this?” Very likely, no one has informed you of the purpose of this task! Well, it likely was because that activity was missing to show a critical element: the purpose. Just like the purpose of a task can be easily left out, in the context of course design, a purpose statement for an assignment is often missing too.

Creating a purpose statement for assignments is an activity that I enjoy very much. I encourage instructors and course developers to be intentional about that statement which serves as a declaration of the underlying reasons, directions, and focus of what comes next in an assignment. But most importantly, the statement responds to the question I mentioned at the beginning of this blog…why…?

Just as a purpose statement should be powerful to guide, shape, and undergird a business (Yohn, 2022), a purpose statement for an assignment can guide students in making decisions about using strategies and resources, shape students’ motivation and engagement in the process of completing the assignment, and undergird their knowledge and skills.  Let’s look closer at the power of a purpose statement.

What does “purpose” mean?

Merriam-Webster defines purpose as “something set up as an object or end to be”, while Cambridge Dictionary defines it as “why you do something or why something exists”. These definitions show us that the purpose is the reason and the intention behind an action.

Why a purpose is important in an assignment?

The purpose statement in an assignment serves important roles for students, instructors, and instructional designers (believe it or not!).

For students

The purpose will:

  1. answer the question “why will I need to complete this assignment?”
  2. give the reason to spend time and resources working out math problems, outlining a paper, answering quiz questions, posting their ideas in a discussion, and many other learning activities.
  3. highlight its significance and value within the context of the course.
  4. guide them in understanding the requirements and expectations of the assignment from the start.

For instructors

The purpose will:

  1. guide the scope, depth, and significance of the assignment.
  2. help to craft a clear and concise declaration of the assignment’s objective or central argument.
  3. maintain the focus on and alignment with the outcome(s) throughout the assignment.
  4. help identify the prior knowledge and skills students will be required to complete the assignment.
  5. guide the selection of support resources.

For instructional designers

The purpose will:

  1. guide building the structure of the assignment components.
  2. help identify additional support resources when needed.
  3. facilitate an understanding of the alignment of outcome(s).
  4. help test the assignment from the student’s perspective and experience.

Is there a wrong purpose?

No, not really. But it may be lacking or it may be phrased as a task. Let’s see an example (adapted from a variety of real-life examples) below:

Project Assignment:

“The purpose of this assignment is to work in your group to create a PowerPoint presentation about the team project developed in the course. Include the following in the presentation:

  • Title
  • Context
  • Purpose of project
  • Target audience
  • Application of methods
  • Results
  • Recommendations
  • Sources (at least 10)
  • Images and pictures

The presentation should be a minimum of 6 slides and must include a short reflection on your experience conducting the project as a team.”

What is unclear in this purpose? Well, unless the objective of the assignment is to refine students’ presentation-building skills, it is unclear why students will be creating a presentation for a project that they have already developed. In this example, creating a presentation and providing specific details about its content and format looks more like instructions instead of a clear reason for this assignment to be.

A better description of the purpose could be:

“The purpose of this assignment is to help you convey complex information and concepts in visual and graphic formats. This will help you practice your skills in summarizing and synthesizing your research as well as in effective data visualization.”

The purpose statement particularly underscores transparency, value, and meaning. When students know why, they may be more compelled to engage in the what and how of the assignment. A specific purpose statement can promote appreciation for learning through the assignment (Christopher, 2018).

Examples of purpose statements

Below you will find a few examples of purpose statements from different subject areas.

Example 1: Application and Dialogue (Discussion assignment)

Courtesy of Prof. Courtney Campbell – PHL /REL 344

Example 2: An annotated bibliography (Written assignment)

Courtesy of Prof. Emily Elbom – WR 227Z

Example 3: Reflect and Share (Discussion assignment)

Courtesy of Profs. Nordica MacCarty and Shaozeng Zhang – ANTH / HEST 201

With the increased availability of language learning models (LLMs) and artificial intelligence (AI) tools (e.g., ChatGPT, Claude2), many instructors worry that students would resort to these tools to complete the assignments. While a clear and explicit purpose statement won’t deter the use of these highly sophisticated tools, transparency in the assignment description could be a good motivator to complete the assignments with no or little AI tools assistance.

Conclusion

Knowing why you do what you do is crucial” in life says Christina Tiplea. The same applies to learning, when “why” is clear, the purpose of an activity or assignment can become a more meaningful and crucial activity that motivates and engages students. And students may feel less motiavted to use AI tools (Trust, 2023).

Note: This blog was written entirely by me without the aid of any artificial intelligence tool. It was peer-reviewed by a human colleague.

Resources:

Christopher, K. (02018). What are we doing and why? Transparent assignment design benefits students and faculty alike. The Flourishing Academic.

Sinek, S. (2011). Start with why. Penguin Publishing Group.

Trust, T. (2023). Addressing the Possibility of AI-Driven Cheating, Part 2. Faculty Focus.

Yohn, D.L. (2022). Making purpose statements matter. SHR Executive Network.

I have always struggled with test anxiety. As a student, from first-grade spelling tests through timed essay questions while earning my Masters of Science in Education, I started exams feeling nauseous and underprepared. (My MSEd GPA was 4.0). I blame my parents. Both were college professors and had high expectations for my academic performance. I am in my 50s, and I still shutter remembering bringing home a low B on a history test in eighth grade. My father looked disappointed and told me, “Debbie, I only expect you to do the best you can do. But I do not think this is the best you can do.” 

I am very glad my parents instilled in me a high value of education and a strong work ethic. This guidance heavily influenced my own desire to work in Higher Ed. Reflecting on my own journey and the lingering test anxiety that continues to haunt me, it has become evident that equipping students with comprehensive information to prepare for and navigate quizzes or exams holds the potential to alleviate the anxiety I once struggled with.

Overlooking the instructions section for an exam, assignment, or quiz is common among instructors during online course development. This might seem inconsequential, but it can significantly impact students’ performance and overall learning experience. Crafting comprehensive quiz instructions can transform your course delivery, fostering a more supportive and successful student learning environment.

The Role of Quizzes in Your Course

Quizzes serve as diagnostic and evaluative tools. They assess students’ comprehension and application of course materials, helping identify knowledge gaps and areas for additional study. The feedback instructors receive through student quiz scores enables instructors to evaluate the effectiveness of the course learning materials and activities and understand how well students are mastering the skills necessary to achieve the course learning outcomes. This enables instructors to identify aspects of the course design needing improvement and modify and adjust their teaching strategies and course content accordingly. By writing thorough and clear quiz instructions, you support students’ academic growth and improve the overall quality of your course.

Explain the Reason

Explain how the quiz will help students master specific skills to motivate them to study. The skills and knowledge students are expected to develop should be clearly defined and communicated. Connect it to course learning outcomes and encourage students to track their progress against them (Align Assessments, Objectives, Instructional Strategies – Eberly Center – Carnegie Mellon University, n.d.).

Why did you assign the quiz? Would you like your students to receive frequent feedback, engage with learning materials, prepare for high-stakes exams, or improve their study habits?

Equipping Students for Successful Quiz Preparation

Preparing for a quiz can be daunting for students. To help them navigate this process, provide a structured guide for preparation. Leading up to the quiz, you may want to encourage your students to:

  1. Review the lectures: Highlight the importance of understanding key concepts discussed.
  2. Review the readings: Encourage students to reinforce their understanding by revisiting assigned readings and additional materials.
  3. Engage in review activities: Suggest using review materials, practice questions, or study guides to cement knowledge.
  4. Participate in discussions: Reflecting on class discussions can offer unique insights and deepen understanding.
  5. Seek clarification: Remind students to contact their instructor or teaching assistant for any questions or clarifications. You add a Q&A discussion forum for students to post questions leading up to the quiz.

Crafting Clear and Detailed Quiz Instructions 

When taking the quiz, clear instructions are vital to ensure students understand what is expected of them. Here’s a checklist of details to include in your quiz instructions:

  1. Time Limit: Explicitly mention the duration of the quiz, the amount of time students have to complete the quiz once they have started it, or if it’s untimed. Suggest how they may want to pace the quiz to ensure they have time to complete all the questions.
  2. Availability Window: You should specify an availability window for asynchronous online students. It refers to the time frame during which the quiz can be accessed and started. By giving an extended window, you allow students to take the quiz at a time that suits them. Once they begin, the quiz duration will apply.
  3. Number of Attempts: Indicate whether students have multiple attempts or just a single opportunity to take the quiz.
  4. Question Format: Provide information about the types of questions included and any specific formatting requirements. 
  5. Quiz Navigation: Have you enforced navigational restrictions on the quiz, such as preventing students from returning to a question or only showing questions one at a time? Share this information in the instructions and explain the reasoning.
  6. Point Allocation: Break down how points are distributed, including details for varying point values and partial credit.
  7. Resources: Specify whether students can use external resources, textbooks, or notes during the quiz.
  8. Academic Integrity Reminders: Reinforce the importance of academic integrity, detailing expectations for honest conduct during the quiz.
  9. Feedback and Grading: Clarify how and when students will receive feedback and their grades.
  10. Showing Work: If relevant, provide clear guidelines on how students present their work (solving equations, pre-writing activities, etc.) or reasoning for particular question types.

End with a supportive “Good Luck!” to ease students’ nerves and inspire confidence.

Crafting comprehensive quiz instructions is a vital step in ensuring successful course delivery. Providing students with clear expectations, guidelines, and support enhances their quiz experience and contributes to a positive and productive learning environment (Detterman & Andrist, 1990). As course developers and designers, we are responsible for fostering these optimal conditions for student success. Plus, as my father would say, it is satisfying to know you have “done the best you can do.”

References

Align Assessments, Objectives, Instructional Strategies—Eberly Center—Carnegie Mellon University. (n.d.). Eberly Center: Carnegie Mellon University. Retrieved June 28, 2023, from https://www.cmu.edu/teaching/assessment/basics/alignment.html

Detterman, D. K., & Andrist, C. G. (1990). Effect of Instructions on Elementary Cognitive Tasks Sensitive to Individual Differences. The American Journal of Psychology, 103(3), 367–390. https://doi.org/10.2307/1423216

Footnote: My son called as I was wrapping up this post. I told him I was finishing up a blog post for Ecampus. “I kind of threw Grandpa under the bus,” I said. After I shared the history test example, he said, “you didn’t learn much.” He and his sister felt similar academic pressure; I may have even used the same line about the best you can do. In my defense, he is now. Ph.D. candidate in Medicinal Chemistry and his sister just completed a Masters in Marine Bio.

Image by: pingebat, licensed from Adobe Stock

As higher-ed professionals involved in course design, we have the honor, privilege, and responsibility of shaping the learning experiences for countless students. Among the many tools at our disposal, course mapping stands out as a fundamental technique that deserves a spotlight. Couse mapping fosters clarity, and showcases alignment between the learning outcomes/objectives and course materials, assessments and activities. In this blog post, we will explore the importance of course mapping in online higher-ed courses, highlighting its role in meeting the new requirements in the recently updated Quality Matters (QM) rubric 7th edition. Join us as we delve into the transformative power of course mapping, benefiting course developers, instructors, instructional designers, and learners alike.

The Big-Picture:

The updated QM rubric (7th edition) recognizes the strength of course maps as a design tool, and has now made them a required element for course review. To quote the QM rubric update workshop (2023), “the course map must include all of the following components mapped to one another so the connection between them is apparent: course learning [outcomes/] objectives, module learning outcomes/objectives, assessments, materials, activities, and tools.” At its core, course mapping involves creating a visual representation of the entire course curriculum, breaking it down into manageable units, and illustrating the relationships between various components. This visual often takes the form of a table, but many variations exist. Course mapping is a holistic approach, which provides a roadmap for instructors, course developers, and designers to create a comprehensive, cohesive and well-structured learning experience; and for students to easily navigate and find the content and assignments. By explicitly relating the aforementioned course components, course maps simply demonstrate alignment and make clear the purpose of each element as part of the larger picture. 

Orchestrating a Symphony of Learning & Student Success:

With the implementation of the new QM rubric (7th edition), course mapping has gained significant prominence as a means of ensuring alignment and coherence across the curriculum.  By mapping out the weekly outcomes/objecives, learning activities, materials, tools, and assessments, instructors can ensure that each component of the course aligns with the overall outcomes/objetcives. This process can highlight pathways for students to progress logically through the content. Additionally, course mapping facilitates coordination among multiple instructors or instructional designers involved in a course, enabling a consistent design and a more harmonic learning experience for students. Much like a conductor of an orchestra, a course map provides the nuanced direction to each section. Harmony in a design means that elements are unified. Learners benefit from this because they more clearly connect their learning activities with a specific purpose. 

By imbuing the many learning activities with clear purpose (alignment to the outcomes/objectives), learners understand the work they are being asked to complete.  Mapping out course activities also provides instructors with a high-level view of their course, which helps ensure a balanced distribution of learning strategies, which can help accommodate a variety of learning needs. As a result, students are more likely to be engaged, motivated, and empowered to take ownership of their learning, which can lead to improved learning. Course maps act as a first step towards transparent course design, which empowers learners to take initiative and work through problems independently. If we give them all the pieces and help them make connections, they can forge their own pathway to success.

Efficiency and Continuous Improvement:

Course mapping also acts as a vehicle for efficiency and continuous improvement in higher education courses. By visualizing the entire course, instructors and instructional designers can identify potential gaps, redundancies, or misalignments, leading to more effective course revisions. Moreover, the iterative nature of course mapping promotes reflection and collaboration among course developers, instructors, instructional designers, and course reviewers, fostering a culture of continuous improvement. 

Additionally, for instructors the course map then acts as a blue print for the course, which can enhance the connection between the course elements, which can also be helpful if course outcomes/objectives need to change. For instance, courses with detailed maps might be more efficiently adapted, as instructors can easily identify parts of their courses that will need to change and know where to focus their energy.

Assessment and Accreditation – Meeting Quality Standards:

Accreditation bodies and quality assurance agencies like QM place a strong emphasis on clearly defined learning outcomes/objectives and assessment strategies. Course mapping provides a comprehensive framework for demonstrating alignment with quality standards or accreditation competencies. By mapping learning outcomes/objectives to assessments, instructors can provide evidence of student achievement and ensure that all necessary areas are adequately covered. This not only satisfies accreditation requirements but also enhances transparency and accountability within the course, program, and even the institution. At OSU Ecampus, we use the Ecampus Essentials list to ensure we are creating high-quality online and hybrid learning experiences. All Ecampus courses are expected to meet the essential standards and are strongly encouraged to meet the exemplary standards.

Conclusion:

As higher education professionals, we have a shared responsibility to provide transformative courses and programs that prepare learners for the challenges of the future. Course mapping stands as a crucial tool in achieving this goal by fostering alignment, engagement, and continuous improvement. As the new Quality Matters (QM) rubric (7th edition) recognizes, course mapping is an essential practice in creating intentional and effective courses. By investing time and effort in course mapping, instructors and instructional designers can craft coherent and purposeful learning experiences that empower students and maximize their potential for success.

Let’s embrace course mapping as a tool for success in online higher education, ensuring that our courses are meticulously crafted, intentional, and impactful. 

Course Mapping Tools:

  1. The Online Course Mapping Guide
  2. OSU Ecampus Course Planning Chart
  3. Berkeley Digital Learning Services Course Map Template (Public Use)
  4. University of Arizona Course Map Templates

Course Map Samples Shared in the QM Rubric Update:

  1. ACCT 3551 Course Map
  2. Course Alignment Map for HIS 121 American History to 1865

References:

Beckham, R., Riedford, K., & Hall, M. (2017). Course Mapping: Expectations Visualized. Journal for Nurse Practitioners, 13(10), e471–e476. https://doi.org/10.1016/j.nurpra.2017.07.021 

Digital Learning Hub in the Teaching + Learning Commons at UC San Diego. (n.d.). What is a Course Map? The Online Course Mapping Guide. Retrieved July 5, 2023, from https://www.coursemapguide.com/what-is-a-course-map

Quality Matters. (2023, May 22). QM Course Worksheet, HE Seventh Edition. Retrieved July 5, 2023, from https://docs.google.com/document/d/16d1mDaII_kgXvyjeT_brn-TKqACnr_OY_D_r5SnJlC0/edit 

As educators and instructional designers, one of our tasks is to create online learning environments that students can comfortably use to complete their course activities effectively. These platforms need to be designed in such a way as to minimize extraneous cognitive load and maximize generative processing: that is, making sure that the learners’ efforts are spent on understanding and applying the instructional material and not on figuring out how to use the website or app. Research and practice in User Experience (UX) design – more specifically, usability – can give us insights that we can apply to improve our course page design and organization.

Getting Started: General Recommendations

Steve Krug, in his classic book Don’t Make Me Think: A Common Sense Approach to Web Usability, explains that, in order for a website or app to be easy to use, the essential principle can be stated as “don’t make me think” (Krug, 2014). That may sound like a strange principle in an educational context, but what Krug referred to is precisely the need to avoid wasting the users’ cognitive resources on how a particular platform works (thus reducing extraneous cognitive load), and to make them feel comfortable using that product (enhancing generative processing). When looking at a web page or app, it should be, as much as possible, obvious what information is on there, how it is organized, what can be clicked on, or where to start; this way, the user can focus on the task at hand.

Krug (2014) provided a few guidelines for ensuring that the users effortlessly see and understand what we want them to:

  • Use conventions: Using standardized patterns makes it easier to see them quickly and to know what to do. Thus, in online courses, it helps to have consistency in how the pages are designed and organized: consider using a template and having standard conventions within a program or institution.
  • Create effective visual hierarchies: The visual cues should represent the actual relationships between the things on the page. For instance, the more important elements are larger, and the connected parts are grouped together on the page or designed in the same style. This saves the user effort in the selection and organization processes in the working memory.
  • Separate the content into clearly defined areas: If the content is divided into areas, each with a specific purpose, the page is easier to parse, and the user can quickly select the parts that are the most relevant to them.
  • Make it obvious what is clickable: Figuring out the next thing to click is one of the main things that users do in a digital environment; hence, the designer must make this a painless process. This can be done through shape, location or formatting—for example, buttons can help emphasize important linked content.
  • Eliminate distractions: Too much complexity on a page can be frustrating and impinges on the users’ ability to perform their tasks effectively. Thus, we need to avoid having too many things that are “clamoring for your attention” (Krug, 2014, Chapter 3). This is consistent with the coherence principle of multimedia learning, which states that elements that do not support the learning goal should be kept to a minimum and that clutter should be avoided. Related to this, usability experts recommend avoiding repeating a link on the same page because of potential cognitive overload. This article from the Nielsen Norman Group explains why duplicate links are a bad idea, and when they might be appropriate.
  • Format text to support scanning: Users often need to scan pages to find what they want. We can do a few things towards this goal: include well-written headings, with clear formatting differences between the different levels and appropriate positioning close to the text they head; make the paragraphs short; use bulleted lists; and highlight key terms.

Putting It to the Test: A UX Study in Higher Education

The online learning field has yet to give much attention to UX testing. However, a team from Penn State has recently published a book chapter describing a think-aloud study with online learners at their institution (Gregg et al., 2020). Here is a brief description of their findings and implications for design:

  • Avoid naming ambiguities – keep wording clear and consistent, and use identical terms for an item throughout the course (e.g., “L07”, “Lesson07)
  • Minimize multiple interfaces – avoid adding another tool/platform if it does not bring significant benefits.
  • Design within the conventions of the LMS – for example, avoid using both “units” and “lessons” in a course; stick to the LMS structure and naming conventions as much as possible.
  • Group related information together – for example, instead of having pieces of project information in different places, put them all on one page and link to that when needed.
  • Consider consistent design standards throughout the University – different departments may have their own way of doing things, but it is best to have some standards across all classes.

Are you interested in conducting UX testing with your students? Good news: Gregg et al. (2020) also reflected on their process and generated advice for conducting such testing, which is included in their chapter and related papers. You can always start small! As Krug (2014, Chapter 9) noted, “Testing one user is 100 percent better than testing none. Testing always works, and even the worst test with the wrong user will show you important things you can do to improve your site”.

References

Gregg, A., Reid, R., Aldemir, T., Gray, J., Frederick, M., & Garbrick, A. (2020). Think-Aloud Observations to Improve Online Course Design: A Case Example and “How-to” Guide. In M. Schmidt, A. A. Tawfik, I. Jahnke, & Y. Earnshaw (Eds.), Learner and User Experience Research: An Introduction for the Field of Learning Design & Technology. EdTech Books. https://edtechbooks.org/ux/15_think_aloud_obser

Krug, S. (2014). Don’t make me think, revisited: A common sense approach to Web usability. New Riders, Peachpit, Pearson Education.

Loranger, H. (2016). The same link twice on the same page: Do duplicates help or hurt? Nielsen Norman Group. https://www.nngroup.com/articles/duplicate-links/