By: Julie Jacobs, Jana King, Dana Simionescu, Tianhong Shi

Overview

A recent scenario with our course development team challenged our existing practices with lecture media. Formerly, we had encouraged faculty to include only slides with narration in their lecture videos due to concerns about increasing learners’ cognitive load. Students voiced their hope for more instructor presence in courses, and some instructors started asking about including video of themselves inserted into their lectures. This prompted us to begin thinking about instructor presence in lecture videos more deeply: why were we discouraging faculty from including their faces in lecture videos? While our practices were informed by research-based media theory, we also recognized those theories might be outdated.

We began to explore the latest research with the following question in mind: does visual instructor presence in lectures increase extraneous cognitive load in learners? We use the phrase “visual instructor presence” to refer to lecture videos where an instructor’s moving image is seen giving the lecture, composited together with their slides. This technique is also commonly referred to as “picture-in-picture”, as seen in the image below.

Image 1: Adam Vester, instructor in College of Business, in his lecture design for BA 375 Applied Quantitative Methods.

A task force was created to review recent research on visual instructor presence and cognitive load, specifically in lecture-type videos. Our literature review included a look at leading multimedia learning scholar Richard E. Mayer’s newest group of principles. We also reviewed more than 20 other scholarly articles, many of which were focused on learner perception, motivation & engagement, and emotion.

Findings

According to recent work in multimedia learning, research in this area should focus on three areas, namely learning outcomes (“what works/ what does not work?”), learning characteristics (“when does it work?”), and learning process (“how does it work?”) (Mayer, 2020). Below are our conclusions from the 23 research articles we reviewed regarding instructional videos, attempting to answer the above questions of “what works”, “when does it work”, and “how does it work”.

This review of recent literature shows no evidence that visual instructor presence increases extraneous cognitive load.
Students tend to prefer lectures with visual instructor presence – they report increased satisfaction and better perceived learning, which can boost motivation and engagement.
While some studies find no difference in performance outcomes when visual instructor presence is utilized, others found increased performance outcomes with visual instructor presence. Proposed explanations: embodiment techniques such as gestures, eye contact, and body movement which fosters generative processing (the cognitive processes required for making sense of the material); social cues can help direct the learners’ attention; increased motivation (as per point 2 above) contributes to better learning.
The effects may depend on the specific type of visual instructor presence (e.g., small picture-in-picture, green-screen, or lightboard) and the characteristics of the content (complex/difficult vs simpler/easier).

Recommendations

Based on these findings, our team has decided to remove the default discouragement of instructors wishing to use picture-in-picture in lectures. If an instructor is interested in having their visual presence in the lectures, we encourage them to discuss this option with their Instructional Designer and Lecture Media Coordinator to determine if this style is a good fit for them and their content.

Image 2: Bryony DuPont, associate professor of Mechanical Engineering, utilizing visual instructor presence in her lecture design for ME 382 Introduction to Design.

We recommend considering the following points:

What is their presentation style? Do they tend to spend a lot of time talking over a slide or is there a lot of text or other action (e.g. software demo) happening in the video? If there’s a lot happening on the screen, perhaps it’s better to not put their video on top of it (the instructor video could be placed only at the beginning and/or end instead).
What type of content? Is it simple or more complex? For more visually complex content, a lightboard or digital notation without picture-in-picture may work better, to take advantage of the dynamic drawing principle and the gaze guidance principle.
Is it a foreign language course? If so, it’s likely helpful for the learners to see the instructor’s mouth and body language.
Is the instructor comfortable with being on video? If they’re not comfortable with it, it may not add value. This being said, our multimedia professionals can help make instructors more comfortable in front of the camera and coach them on a high-embodied style of lecturing.

Since implementing these guidelines and working with an increased number of lectures with visual instructor presence, we also noticed that it works best when the instructor does not look and sound like they’re reading. Therefore, for people who like working with a script, we recommend practicing in advance so they can sound more natural and are able to enhance their presentation with embodiment techniques.

We would love to hear about your opinions or experiences with this type of video. Share them in the comments!

For a detailed summary of our findings and full citation list, please see the full Literature Review.

Image by: pingebat, licensed from Adobe Stock

As higher-ed professionals involved in course design, we have the honor, privilege, and responsibility of shaping the learning experiences for countless students. Among the many tools at our disposal, course mapping stands out as a fundamental technique that deserves a spotlight. Couse mapping fosters clarity, and showcases alignment between the learning outcomes/objectives and course materials, assessments and activities. In this blog post, we will explore the importance of course mapping in online higher-ed courses, highlighting its role in meeting the new requirements in the recently updated Quality Matters (QM) rubric 7th edition. Join us as we delve into the transformative power of course mapping, benefiting course developers, instructors, instructional designers, and learners alike.

The Big-Picture:

The updated QM rubric (7th edition) recognizes the strength of course maps as a design tool, and has now made them a required element for course review. To quote the QM rubric update workshop (2023), “the course map must include all of the following components mapped to one another so the connection between them is apparent: course learning [outcomes/] objectives, module learning outcomes/objectives, assessments, materials, activities, and tools.” At its core, course mapping involves creating a visual representation of the entire course curriculum, breaking it down into manageable units, and illustrating the relationships between various components. This visual often takes the form of a table, but many variations exist. Course mapping is a holistic approach, which provides a roadmap for instructors, course developers, and designers to create a comprehensive, cohesive and well-structured learning experience; and for students to easily navigate and find the content and assignments. By explicitly relating the aforementioned course components, course maps simply demonstrate alignment and make clear the purpose of each element as part of the larger picture.

Orchestrating a Symphony of Learning & Student Success:

With the implementation of the new QM rubric (7th edition), course mapping has gained significant prominence as a means of ensuring alignment and coherence across the curriculum. By mapping out the weekly outcomes/objecives, learning activities, materials, tools, and assessments, instructors can ensure that each component of the course aligns with the overall outcomes/objetcives. This process can highlight pathways for students to progress logically through the content. Additionally, course mapping facilitates coordination among multiple instructors or instructional designers involved in a course, enabling a consistent design and a more harmonic learning experience for students. Much like a conductor of an orchestra, a course map provides the nuanced direction to each section. Harmony in a design means that elements are unified. Learners benefit from this because they more clearly connect their learning activities with a specific purpose.

By imbuing the many learning activities with clear purpose (alignment to the outcomes/objectives), learners understand the work they are being asked to complete. Mapping out course activities also provides instructors with a high-level view of their course, which helps ensure a balanced distribution of learning strategies, which can help accommodate a variety of learning needs. As a result, students are more likely to be engaged, motivated, and empowered to take ownership of their learning, which can lead to improved learning. Course maps act as a first step towards transparent course design, which empowers learners to take initiative and work through problems independently. If we give them all the pieces and help them make connections, they can forge their own pathway to success.

Efficiency and Continuous Improvement:

Course mapping also acts as a vehicle for efficiency and continuous improvement in higher education courses. By visualizing the entire course, instructors and instructional designers can identify potential gaps, redundancies, or misalignments, leading to more effective course revisions. Moreover, the iterative nature of course mapping promotes reflection and collaboration among course developers, instructors, instructional designers, and course reviewers, fostering a culture of continuous improvement.

Additionally, for instructors the course map then acts as a blue print for the course, which can enhance the connection between the course elements, which can also be helpful if course outcomes/objectives need to change. For instance, courses with detailed maps might be more efficiently adapted, as instructors can easily identify parts of their courses that will need to change and know where to focus their energy.

Assessment and Accreditation – Meeting Quality Standards:

Accreditation bodies and quality assurance agencies like QM place a strong emphasis on clearly defined learning outcomes/objectives and assessment strategies. Course mapping provides a comprehensive framework for demonstrating alignment with quality standards or accreditation competencies. By mapping learning outcomes/objectives to assessments, instructors can provide evidence of student achievement and ensure that all necessary areas are adequately covered. This not only satisfies accreditation requirements but also enhances transparency and accountability within the course, program, and even the institution. At OSU Ecampus, we use the Ecampus Essentials list to ensure we are creating high-quality online and hybrid learning experiences. All Ecampus courses are expected to meet the essential standards and are strongly encouraged to meet the exemplary standards.

Conclusion:

As higher education professionals, we have a shared responsibility to provide transformative courses and programs that prepare learners for the challenges of the future. Course mapping stands as a crucial tool in achieving this goal by fostering alignment, engagement, and continuous improvement. As the new Quality Matters (QM) rubric (7th edition) recognizes, course mapping is an essential practice in creating intentional and effective courses. By investing time and effort in course mapping, instructors and instructional designers can craft coherent and purposeful learning experiences that empower students and maximize their potential for success.

Let’s embrace course mapping as a tool for success in online higher education, ensuring that our courses are meticulously crafted, intentional, and impactful.

Course Mapping Tools:

Course Map Samples Shared in the QM Rubric Update:

References:

Beckham, R., Riedford, K., & Hall, M. (2017). Course Mapping: Expectations Visualized. Journal for Nurse Practitioners, 13(10), e471–e476. https://doi.org/10.1016/j.nurpra.2017.07.021

Digital Learning Hub in the Teaching + Learning Commons at UC San Diego. (n.d.). What is a Course Map? The Online Course Mapping Guide. Retrieved July 5, 2023, from https://www.coursemapguide.com/what-is-a-course-map

Quality Matters. (2023, May 22). QM Course Worksheet, HE Seventh Edition. Retrieved July 5, 2023, from https://docs.google.com/document/d/16d1mDaII_kgXvyjeT_brn-TKqACnr_OY_D_r5SnJlC0/edit

This month brings the new and improved QM Higher Education Rubric, Seventh Edition! To see the detailed changes, you can order the new rubric or take the Rubric Update Session, which is a self-paced workshop that will be required for all QM role holders. In the meantime, if you’d like a short summary of the revisions, continue reading below.

The main changes include:

The number of Specific Review Standards has increased from 42 to 44.
The points value scheme was also slightly revised, with the total now being 101.
A few terminology updates were implemented.
The descriptions and annotations for some of the general and specific standards were revised.
The instructions were expanded and clarified, with new additions for synchronous and continuous education courses.

Most of the standards (general or specific) have undergone changes consisting of revised wording, additional special instructions, and/or new examples to make the standards clearer and emphasize the design of inclusive and welcoming courses. In addition, some standards have received more substantial revisions – here are the ones that I found the most significant:

Standard 3: There is a new Specific Standard: SRS 3.6: “The assessments provide guidance to the learner about how to uphold academic integrity.” This standard is met if “the course assessments incorporate or reflect how the institution’s academic integrity policies and standards are relevant to those assessments.” SRS 3.6 is the main addition to the 7^th edition, and a very welcome one, especially considering the new complexities of academic integrity policies.

Standard 4: SRS 4.5 (“A variety of instructional materials is used in the course.”) has received an important annotation revision – this standard is met if at least one out of three of the following types of variety are present in the course: variety of type of media; different perspectives/representations of ideas; diverse, non-stereotypical representations of persons or demographic groups. I was really happy to see this clarification, since it’s always been a little difficult to evaluate what constitutes “variety”, and reviewers will certainly appreciate the recognition of diversity of people and ideas.

Standard 8: SRS 8.3 was divided into two separate Specific Standards: SRS 8.3 “Text in the course is accessible.” and SRS 8.4 “Images in the course are accessible.” At the same time 8.5 (former 8.4) was turned into “Video and audio content in the course is accessible.” This should allow for a more nuanced evaluation of the various accessibility elements, and it is nice to see the focus on captions for both video and audio materials. Moreover, these three standards (SRS 8.3, 8.4, and 8.5) now include publisher-created content – this is an important step forward in terms of advocating for all educational materials to be made accessible upfront.

In addition to the standards themselves, some changes were made to the Course Format Chart, the Course Worksheet, and the Glossary. Notably, a course/alignment map is now required with the Course Worksheet – a change that is sure to spark delight among QM reviewers. The definitions of activities and assessments were also revised to clarify the distinction between the two – another much-needed modification that should eliminate a common point of confusion.

Overall, the new edition brings about clearer instructions, more relevant examples, and a deeper inclusion of diversity, accessibility, and academic integrity. Reviewers and course designers should find it easier to evaluate or create high quality courses with this updated guidance.

My family and I were preparing for a move. We packed up some of our things, removing extraneous items from our walls and surfaces and preparing our house to list and show. Not willing to part with these things, we rented a small storage unit to temporarily warehouse all this extra “stuff.” Well, as it turned out, we ended up not moving at all, and after a few months went to clear out the storage unit and retrieve our extra things. The funny thing was, we could hardly remember what had gone in there, and as it turns out, we did not miss most of the items we had packed away. We ended up selling most of what was in that storage unit, and shortly thereafter, we did even more “spring cleaning.” One of the bedrooms, which also doubles an office, needed particular attention. The space was dysfunctional, in that multiple doors and drawers were blocked from fully opening. After a little purging and reorganization this room now functions beautifully, with enough space to open every door and drawer. I have been calling this process “moving back into our own house,” and it’s been a joy to rethink, reorganize, and reclaim our living spaces.

Course Design Connection

As I have been working with more instructors who are redeveloping existing courses, I have been trying to bring this mindset into my instructional design work. How can we reclaim our online learning spaces and make them more inviting and functional? How can we help learners open all the proverbial doors and operate fully within the learning environment? You guessed it: While our first instinct might be to add more to the course, the answer might lie in the other direction. With a little editing and a keen eye on alignment, we can very intentionally remove things from our courses that might be needless or even distracting. We can also rearrange our pages and modules to maximize our learner’s attention.

Memory and Course Design

Our working memories, according to Cowan (2010), can only store 3-5 meaningful items at a time. Thus, it becomes essential to consider what is genuinely necessary on any given LMS page. If we focus on helping learners to achieve the learning outcomes when choosing the content to keep in each module, we can intentionally remove distractors. There can be a place for tangential or supplemental information, but those items should not live in the limelight. To help get us started on this “cleaning process,” we can ask ourselves a few simple questions. Are there big-ticket items (assignments, discussions, readings) that are not directly helping learners reach the outcomes? Are we formatting pages and arranging content in beneficial and progressive ways? Might we express longer bodies of text in ways that are more concisely or clearly? Can we break text up with related visuals? Below are some tips to help guide your process as you “clean” up your course and direct your learners where to focus.

Cut out the Bigger Extraneous Content

It is simple to assume that for your learners to meet the course outcomes, they must read and comprehend many things and complete a wide variety of assignments. When planning your learning activities, it’s crucial to keep in mind the limits of the brain and also that giving learners opportunities to practice applying content will be more successful than asking them to memorize and restate it. For courses with dense content, lean into your course outcomes to guide your editing process. Focusing on the objectives can help you remove extraneous readings and activities. This will allow your learners to concentrate on the key points. (Cowden & Sze, 2012)

Review Instructions

For the items you choose to keep in your course, reviewing assignment instructions, and discussion prompts is helpful. Consider inviting a non-expert to read these items. An outside eye might help you to simplify what you are asking your learners to accomplish by calling to your attention any points of confusion. You may be tempted to add more detail, but try to figure out where you can remove text when possible. Why use a paragraph to explain something that only needs a few sentences? Simplifying your language can enable learners to get to the point faster. (For more on this, see the post by intern Aimee L. Lomeli Garcia about Improving Readability). When reviewing your instructions and prompts, think about what learners want to know:

· What should they pay attention to?

· Where do they start?

· What do they do next?

· What is expected?

· How are they being assessed/graded?

(Grennan, 2018)

Utilize Best Practices for Formatting

Use native formatting tools like styles, headers, and lists to help visually break up content and make it more approachable. Here are some examples:

If I were to list my favorite animals here without a list, it would look like this: dogs, turtles, hummingbirds, frogs, elephants, and cheetahs.

Suppose I give you that same list using a header and number list format. In that case, it becomes much easier to digest mentally, and it looks nicer on the page:

Julie’s Favorite Animals

Dogs
Turtles
Hummingbirds
Frogs
Elephants
Cheetahs

Provide High-Level Overviews

If an assignment does need a more thorough explanation, and your instructions are running long, you can always create a high-level overview, calling out the main points of the page. You could place this in a call-out box or its own section (preferably at the top). This is where learners can quickly look for reminders about what to do next and how to do it. Providing a high-level overview alongside detailed instructions will cater to a variety of learning preferences and help set up your learners for success.

Module Organization

Scaling up beyond single pages and assignments to module organization, consider the order you want learners to encounter ideas and accomplish tasks. Don’t be afraid to move pages around within your modules to help learners find the most efficient and helpful pathway through your material (Shift Elearning, n.d.).

Wrapping It Up

The culture of “more is better” is pervasive, and it’s almost always easier to add rather than to remove information. In online learning, when we buy into the “culture of more” we can impede the success of our learners. But more isn’t always better; sometimes more is just more. Instead, don’t be afraid to dust off that delete button and start reclaiming and reorganizing your course for ultimate learner success. Sometimes less is best. For more on the art of subtraction, see Elisabeth McBrien’s blog post from February of 2022.

References

Cowan, N. (2010). The magical mystery four. Current Directions in Psychological Science, 19(1), 51–57. https://doi.org/10.1177/0963721409359277

Cowden, P., & Sze, S. (2012). ONLINE LEARNING: THE CONCEPT OF LESS IS MORE. Allied Academies International Conference.Academy of Information and Management Sciences.Proceedings, 16(2), 1-6. https://oregonstate.idm.oclc.org/login?url=https://www.proquest.com/scholarly-journals/online-learning-concept-less-is-more/docview/1272095325/se-2

Grennan, H. (2018, April 30). Why less is more in Elearning. Belvista Studios – eLearning Blog. Retrieved April 4, 2023, from http://blog.belvistastudios.com/2018/04/why-less-is-more-in-elearning.html

Lomeli Garcia, A. L. (2023, January 17). Five Tips on Improving Readability in Your Courses. Ecampus Course Development and training. Retrieved April 4, 2023, from https://blogs.oregonstate.edu/inspire/2023/01/17/five-tips-on-improving-readability-in-your-courses/

McBrien, E. (2022, February 24). Course design challenge: Try subtraction. Ecampus Course Development and training. Retrieved April 4, 2023, from https://blogs.oregonstate.edu/inspire/2022/02/24/course-design-challenge-try-subtraction/

Parker, R. (2022, June 30). Why less is more for e-learning course materials. Synergy Learning. Retrieved April 4, 2023, from https://synergy-learning.com/blog/why-less-is-sometimes-more-when-it-comes-to-your-e-learning-course-materials/

Shift Elearning. (n.d.). The art of simplification in Elearning Design. The Art of Simplification in eLearning Design. Retrieved April 4, 2023, from https://www.shiftelearning.com/blog/the-art-of-simplification-in-elearning-design

University of Waterloo, Queen’s University, & University of Toronto; and Conestoga Colleg (n.d.). Module 3: Quality course structure and content. In High Quality Online Courses . essay, Pressbooks Open Library, from https://ecampusontario.pressbooks.pub/hqoc/chapter/3-1-module-overview/

The idea that students learn best when they have the opportunity to apply what they are learning to real-world contexts is the basis of Experiential Learning Theory (ELT). Learning by doing is at its core, and as a high-impact practice, there is increasingly more emphasis on experiential learning in higher education. There is plenty of evidence that supports the benefits of this type of learning. It affords students an opportunity to connect knowledge to authentic situations and increases learner autonomy, motivation, and overall satisfaction (Kolb and Kolb, 2018). Many OSU Ecampus Courses feature such experiences. In fact, OSU’s Honors College requires all courses to include experiential learning components, and this is increasingly the case across disciplines at OSU.

What does experiential learning look like?

Kolb's Cycle of Experiential Learning — The Experiential Learning Cycle, image by Izhaki via Wikimedia Commons, CC BY-SA 3.0

Many of us may think of community engagement, project-based learning, or practicums when we consider what constitutes an experiential learning experience. While these are solid examples of ELT in practice, experiential learning can take many forms across learning environments. David Kolb describes experiential learning as a four-stage process in his cycle of learning (Kolb and Kolb, 2018). According to Kolb, learning is a process where knowledge is created through the transformation of experience. Students can engage with the cycle at any point in the experience as long as they engage with all four stages. The flexibility of hybrid and online learning presents rich possibilities for incorporating this process. The four stages of Kolb’s experiential learning process include:

Concrete learning: engage in a new experience or critically interpret a past experience.
Reflective observation: use experience and background knowledge to understand the relevance or meaning of the experience.
Abstract conceptualization: gain a new understanding of the experience by adjusting thinking based on reflection.
Active experimentation: engage experimentally by applying new insights to the situation in a practical way.

Kolb’s theory is not without limitations in that it does not provide clear answers about how collaboration between learners affects reflection, and it doesn’t account for learning that occurs without reflection (Psychology, 2022). While his model isn’t the final word on all of the ways learners make sense of the world, it does provide a good starting point for understanding and designing effective real-world learning opportunities.

What makes a good experiential learning experience?

Regardless of the activity, both the experience and the learning are fundamental in experiential learning scenarios, and the ongoing engagement of both the instructor and the student is critical. In experiential environments, students take ownership of their learning process by taking a more active role such as in posing questions, experimenting, and constructing meaning through their persistent participation in the experience. The role of the instructor, on the other hand, is to ensure that the experience is of high quality and in alignment with the stated learning outcomes while also supporting the learner to develop autonomy in using the principles of experiential learning as defined by The National Society of Experiential Education (NSEE).

Eight Principles of Good Practice for All Experiential Learning Activities

Intention: the activity is structured around a formal process and the purpose and rationale for why the activity was chosen is transparent and clear to students.
Preparedness and planning: students understand expectations for engaging in the learning experience and have the necessary background knowledge and preparation to participate in the planned learning with support throughout the process.
Authenticity: the learning experience is relevant and designed in response to an authentic context or situation in collaboration with those affected by it.
Reflection: the experience is transformative and allows for knowledge discovery through a process of making and testing decisions around expected or observed outcomes and through consideration of assumptions and implications related to prior and present learning.
Orientation and training: learner support and guidance include sufficient background preparation needed for successful achievement of learning outcomes.
Monitoring and continuous improvement: students receive continuous feedback and support to enhance the learning experience and ensure achievement of learning outcomes.
Assessment and evaluation: students receive helpful and timely feedback from the instructor and any external facilitators, and monitoring and adjustments to process are made as appropriate to ensure achievement of outcomes.
Acknowledgement: All students and external stakeholders or facilitators are recognized for their work, progress, and contribution to the experience.

Experiential Learning in OSU Ecampus Courses

The following examples illustrate a small selection of the many creative experiential learning opportunities OSU faculty developers have incorporated into their online and hybrid courses in collaboration with Ecampus instructional designers.

Build a community of writers online. Students read, critique, write, edit, revise, and share original pieces of creative writing. An activity modeled after the Iowa Writer’s Workshop and implemented in a creative writing course.
Discover and Promote well-being in an Online Community. Students in a philosophy class engage in activities in their local community and online to talk about topics around well-being. They then reflect on those experiences and dialogue before compiling a “happiness toolkit” and sharing it with peers.
Explore health and fitness assessment techniques used to measure cardiovascular health. Through a series of hands-on labs, students monitor volunteers’ exercise regimes and calculate cardiovascular fitness values to make recommendations based on the data collected.
Collaborate in a team to study and analyze management case studies. Students work through complex and ambiguous problems to solve a workplace challenge and find solutions before participating in an authentic human resources simulation.
Write and perform music. Students in a performance-based music course write and perform original pieces of music.
Examine poverty and its effect on students’ local communities. Students complete a public health scavenger hunt guided by specific questions, reflection, and peer collaboration. They then create a guide describing public health issues and potential solutions.
Investigate the necessary conditions for designing effective teams and work groups, including best practices and processes needed for maximum productivity, strategies to resolve common issues in teams, and methods to evaluate team performance. Students then apply their learning by leading a team in real life.
Analyze and conduct research on a local public health issue. Students partner with community organizations in their area to identify needs and apply principles of public health to authentic contexts.

The list is far from exhaustive. New courses featuring experiential learning are currently in development across disciplines. Faculty interested in learning more about how to get started learning by doing in hybrid and online courses can learn more by checking out the Ecampus experiential learning resources page.

Resources

Eight Principles of Good Practice for All Experiential Learning Activities. (n.d.). Retrieved January 19, 2023, from https://www.nsee.org/index.php?option=com_content

Inside Higher Ed, Roberts, J., & Welton, A. (2022, August 3). The foundational best practices in experiential learning. Inside Higher Ed.

Kolb, AY & Kolb, DA 2017, The experiential educator: Principles and practices of experiential learning, EBLS Press, Kaunakakai, HI.

Kolb, A., & Kolb, D. (2018). Eight important things to know about the experiential learning cycle.

Proposing Experiential Learning Opportunities (ELOS). (n.d.). Center for Integrative and Experiential Learning, Revised March 2019.

Psychology, P. (2022, December 6). Experiential Learning (Definition + Examples) | Practical Psychology. Practical Psychology.

Learning outcomes (LOs) are used in instructional design to describe the skills and knowledge that students should have at the end of a course or learning unit, and to design assessments and activities that support these goals. It is widely agreed that specific, measurable outcomes are essential for planning instruction; however, some educators question the benefits of explicitly presenting them to students. I have been asked (and wondered myself): “What is the point of listing learning outcomes in the course?” “How do they help learning? “Do students even read them?”

So, I went on a quest for research that attempted to answer such questions. I was particularly interested in unit/module-level outcomes, as those are the ones that directly steer the content, and students see them throughout the course. Here’s a brief summary of what I found.

Note: the studies use the terms “learning outcome”, “learning objective”, or “learning goal” – they all refer to the same concept: a specific and measurable description of the skills and knowledge that students are expected to have at the end of a learning unit/period of study. At OSU we use the term “outcomes”.

What Does the Research Say?

Armbruster et al. (2009) redesigned an Introductory Biology course at Georgetown University, Washington, DC, using active learning and student-centered pedagogies, leading to increased student performance and satisfaction. One of the strategies used was to include explicit learning goals in the lecture slides, and labeling exam and quiz questions with the related goals. Students’ attitudes towards the course were assessed via a questionnaire and comparison of university-administered student evaluations. Students were asked to rank lecture components in terms of helpfulness to learning, and the authors found that one of the highest-ranking elements was the inclusion of explicit learning goals.

Simon and Taylor (2009) surveyed 597 students from computer science and microbiology and immunology courses at the University of British Columbia, where instructors presented learning goals at the beginning of each lecture or topic area. The questions were open and the answers coded into a number of categories, which helped them identify several values of goals. The main value was “knowing what I need to know”: students reported that the goals showed them how to focus their efforts and felt that the goals “allowed them to organize the information more effectively and be more expertlike in their approach to the class” (Simon & Taylor, 2009, p.55). The authors did not find any difference between presenting the goals before each lecture versus at the beginning of the unit/topic area.

Brooks et al. (2014) examined students’ views of learning outcomes at the University of Leicester, UK. First, they surveyed 918 students taking Biological Sciences, English and Medicine courses. They found that 81% of participants agreed or strongly agreed that learning outcomes are useful learning aids. Additionally, 46% found LOs more useful as their courses progressed, and 49% reported that they engaged more with the LOs as the course progressed. The authors also investigated when LOs are most useful, and found that the most common answer (46%) was when reviewing the material. Moreover, 49% of students reported that LOs can only be fully understood at the end of a module. The researchers followed up on these results with a focus group, which confirmed that students use LOs in various ways and at various points during the course.

Osueke et al. (2018) looked into students’ use and perceptions of learning objectives at University of Georgia. 185 students in an undergraduate Introduction to Biochemistry and Molecular Biology course took part in the study. The instructors included instructions in the syllabus, which they also stated on the first day of class: “Focus on the learning objectives. The exams will assess your accomplishment of the learning objectives. Use the learning objectives as a guide for what to focus on when you are completing assignments and studying for exams.” Students completed two assignments requiring them to explain their use of the LOs. The researchers found that many students (33.8%) reported they had been instructed on how to use LOs to study – these instructions ranged from passively “look over” to using them as a study guide. The ways students used the LOs were: as questions to answer (47.4%), as a resource for studying (24.1%), as a self-assessment tool (14.3%), and passive use (13.5%). When asked why they find the LOs helpful, students said that they help them: narrow down the information (57.1%); organize their studying (23.3%); communicate information (5.3%); monitor their understanding (4.5%); forced them to study (1.5%).

Sana et al. (2020) conducted three experiments aiming to find to what extent presenting the LOs improve retention of information. Participants were asked to read five passages on a neuroscience topic, and then they were tested on comprehension and retention. The experiments took place at McMaster University, Ontario and employed different participants, methods, materials, and procedures. They found that: interpolating LOs throughout the lesson (as opposed to all LOs presented at the beginning) improved learning compared to not including LOs, especially when students’ attention was explicitly directed to them; converting LOs into pretest questions (that students attempted to answer) further enhanced performance; multiple-choice and short answer questions were equally effective; and withholding feedback on pretests was more effective than providing feedback – the explanation proposed by the authors for this last finding was that students may be more motivated to seek the correct answers themselves, which causes further processing of the material.

Barnard et al. (2021) investigated students’ and academics’ perspectives on the purpose of learning objectives and approaches to assessment preparation. They conducted focus groups with participants from an undergraduate Psychology course at the University of Nottingham, UK. The students reported that LOs are useful for guidance, as they “use them to create direction for some of the learning and revision strategies” (Barnard et al., 2021, p. 679).

Conclusions and Recommendations

Good news! The findings of these studies suggest that many students do appreciate clear LOs and use them to guide their learning. The LOs help them understand what they are expected to know – thus, students use them to focus their study, to review for an exam, and to self-check their knowledge.

As instructors and instructional designers, what can we do to help students take full advantage of LOs? Apart from having specific and measurable LOs, make sure that the LOs are well aligned with the activities, and make this alignment explicit. It may also be helpful to offer some guidance on how to use the LOs, for instance by prompting students to recap their learning at the end of a unit based on the LOs. Finally, we could turn the LOs into questions and use them as a pretest.

For more on creating and using LOs, check out the CBE—Life Sciences Education website, which has an informative guide, including a section on student use.

Do you have any other ideas or resources on how to use learning outcomes to improve students’ experience and study habits? If so, we’d love to hear from you!

References

Armbruster, P., Patel, M., Johnson, E., & Weiss, M. (2009). Active learning and student-centered pedagogy improve student attitudes and performance in Introductory Biology. CBE Life Sciences Education, 8(3), 203–213. https://doi.org/10.1187/cbe.09-03-0025

Barnard, M., Whitt, E., & McDonald, S. (2021). Learning objectives and their effects on learning and assessment preparation: Insights from an undergraduate psychology course. Assessment and Evaluation in Higher Education, 46(5), 673–684. https://doi.org/10.1080/02602938.2020.1822281

Brooks, S., Dobbins, K., Scott, J. J. A., Rawlinson, M., & Norman, R. I. (2014). Learning about learning outcomes: The student perspective. Teaching in Higher Education, 19(6), 721–733. https://doi.org/10.1080/13562517.2014.901964

Osueke, B., Mekonnen, B., & Stanton, J. D. (2018). How undergraduate science students use learning objectives to study. Journal of Microbiology & Biology Education, 19(2). https://doi.org/10.1128/jmbe.v19i2.1510

Sana, F., Forrin, N. D., Sharma, M., Dubljevic, T., Ho, P., Jalil, E., & Kim, J. A. (2020). Optimizing the efficacy of learning objectives through pretests. CBE Life Sciences Education, 19(3), ar43–ar43. https://doi.org/10.1187/cbe.19-11-0257

Simon, B., & Taylor, J. (2009). What is the value of course-specific learning goals? Journal of College Science Teaching, 39(2), 52–57. Retrieved from: https://www.colorado.edu/sei/sites/default/files/attached-files/what_is_the_value_of_course-specific_learning_goals.pdf

The following is a guest blog post from Aimee L. Lomeli Garcia, MLA. Aimee completed an Instructional Design internship with OSU Ecampus during the Fall of 2022.

Have you ever found yourself reading the same paragraph over and over again only to not retain any information? Or been so overwhelmed with the content you’re trying to read that you’re unable to absorb any of it? Odds are that it may not just be the content you’re trying to read; it may be the way the information is laid out. One way to help read and retain information is to make the text more readable.

Making information readable in your online course can seem overwhelming, but there are a few steps that you can take to make the content more digestible for students.

What is Readability?

First off – what is readability? Readability is defined as “the ease in which a reader can comprehend text” (Calonia, 2020). Readability is a vital aspect to keep in mind as you design online courses. It not only makes the content of the class easier to read but increases the likelihood that students will understand the faculty’s content through lectures and discussions. Better readability also decreases the risk of students misunderstanding the content, experiencing frustration, and increases the risk of students becoming disinterested in interacting with the course. Though there are multiple options to make content more readable, there are five ways that you can adapt the content in your course: chunking content, using whitespace, avoiding wordiness, creating infographics, and utilizing color.

Chunking Content

What does “chunking content” mean? Chunking means breaking content into smaller chunks to make it easier to understand. This strategy originates from the field of cognitive psychology, which has proven that the human brain can “process, understand, and remember information better when broken into smaller pieces” (Moran, 2016).

Let’s demonstrate!

Below are the first two paragraphs of Harry Potter and the Sorcerer’s Stone by J.K. Rowling:

Chapter One
The Boy Who Lived
Mr. and Mrs. Dursley, of number four, Privet Drive, were proud to say that they were perfectly normal, thank you very much. They were the last people you’d expect to be involved in anything strange or mysterious because they just didn’t hold with such nonsense.

When reading through this excerpt, it’s easy for your eyes to scan through the information without comprehending it. There are a few common methods that will help with chunking your material: make your paragraphs shorter, add space between your paragraphs, and develop clear hierarchies of text.

Utilizing these methods, let’s make this paragraph more readable:

Chapter One

The Boy Who Lived

Mr. and Mrs. Dursley, of number four, Privet Drive, were proud to say that they were perfectly normal, thank you very much. They were the last people you’d expect to be involved in anything strange or mysterious, because they just didn’t hold with such nonsense.

Using Whitespace

Whitespace is defined as “empty space between and around elements of a page” (Babich, 2017). Whitespace creates a backdrop or frame to make your content easier to read. Like chunking information, whitespace allows the eye to find information easily. Take these slides for example:

“Plastic Coffee Cup on Book” by Anna Shvets from Pexels

Do you notice how much easier it is to read the different types of coffee drinks on the slide that has more white space? In a study done by Wichita State University, research confirmed that increasing the amount of whitespace actually improves reading comprehension!

Avoiding Wordiness

We’ve all experienced reading material that has excessive wordiness. In a manner of speaking, “wordiness means using more words than necessary within a sentence, especially short, vague words that do not add much meaning” (Eliminating Wordiness, 2022). Unfortunately, the overuse of unnecessary words can muddle ideas and cause confusion for students.

To decrease wordiness, focus on the key points you want to convey and use an active voice instead of a passive voice. Consider the following example:

“All of the students who are new to this university are required ot attend an orientatin that has been scheduled for December 1^st.”

When reading this sentence, it’s difficult to decipher what the necessary information is for the reader to understand. Instead, let’s focus on the key points and use an active voice in this sentence:

“New students are required to attend orientation on December 1^st.”

Here, we eliminated the unnecessary wording, allowing readers to understand the message the sentence is trying to convey.

Use Visuals

Pictures speak louder than words! Using visual media, such as infographics, pictures, videos, animations, and films, make content easier for students to understand and could decrease the amount of writing you have to do for the class! You can obtain visual media through free online resources such as Pexels, Pixabay, or Openverse or created on your own (Canva is a favorite for me).

So, instead of using this:

Cells are the building blocks of life. A cell is composed of cytoplasm, a nucleus, ribosomes, and mitochondria. Cytoplasm is made up of a jell-like structure that contains the contents of the cell. The nucleus serves as the command center and is typically the largest part of the inside of the cell. Ribosomes are tiny parts of the cell that make proteins and mitochondria are jelly-bean shaped and create energy from the food we eat.

Try this!

Labeled animal cell — Image by brgfx on Freepik

Color

Color makes a significant impact on the readability of your page. This can be easy to overlook, as we typically use the standard black font/white background combination. However, adding color to words or backgrounds can bring attention to a message you’re trying to convey. There are ways to do this successfully and ways to add color poorly.

Looking at the red text on the first example can be challenging for someone with no vision issues. Imagine the difficulty students who have a visual impairment can have – in particular, red/green color blindness.

On the second example, having a text color that is nearly the same shade as the background can make reading the text nearly impossible. It takes effort to read the quote in the example – can you imagine reading a scholarly journal with the same formatting?

Don’t let these examples dissuade you from trying text colors and backgrounds! To verify if a color combination is readable, visit the Contrast Checker page, enter the RGB or RYB codes and the website will notify you if the color combinations are reader-friendly.

Conclusion

Drafting your site can be overwhelming when considering readability, but there are several steps you can take to make the course content easier to understand.

Chunking content helps break text into smaller pieces so content is easier for students to digest.
Whitespace provides empty space for your content to pop
Avoiding wordiness can make your content and message clearer
Using visuals allows you to utilize pictures, videos, infographics, and other media to convey content
Strategic use of color on your page can make reading the material more comfortable and less straining for all students, including those with vision impairments.

Below are links to resources and tools if you’d like to dive into more information about readability and the impact it has on the success of students of online students. Thanks for reading!

References

Babich, N. (2017, June 30). The power of whitespace. UX Planet. Retrieved November 28, 2022, from https://uxplanet.org/the-power-of-whitespace-a1a95e45f82b

Calonia, J. (2020, September 2). What is readability? Grammarly Blog. Retrieved November 28, 2022, from https://www.grammarly.com/blog/readability/

Eliminating wordiness. (2022). Hamilton College. Retrieved November 28, 2022, from https://www.hamilton.edu/academics/centers/writing/writing-resources/eliminating-wordiness

Moran, K. (2016, March 20). How chunking helps content processing. Nielsen Norman Group. Retrieved November 28, 2022, from https://www.nngroup.com/articles/chunking/

Sabo, C. (2018, June 19). Getting started guide: using infographics for teaching and learning. Learning Technologies. Retrieved November 28, 2022, from http://www.codlearningtech.org/2018/06/19/getting-started-guide-using-infographics-for-teaching-and-learning/

Wordiness. (2022). Las Positas College Reading & Writing Center. Retrieved November 28, 2022, from http://www.laspositascollege.edu/raw/wordiness.php#:~:text=Wordiness%20means%20using%20more%20words,main%20focus%20of%20the%20sentence

The following is a guest blog post from Michelle Coxey. Michelle completed an Instructional Design internship with OSU Ecampus during the Fall of 2022.

“Bolsover Castle” by David Merrett is licensed under CC BY 2.0

Ian Wilkins is a high school language arts teacher, but besides the students, his passion is social justice. He shares a powerful metaphor that education is like a heavily gated castle. Those inside the castle are comfortable and safe and do not realize that the people outside are hungry (Chardin & Novak, 2021). If someone opens the gate and admits a person from the outside, would that person feel comfortable and safe inside like everyone already there? Would they know the rules of the castle? Would they feel like they fit in and deserved to be there? Would the food inside reflect their own tastes, needs, and preferences? Would they stay, or would they want to return to their own comfort zone outside with their family?

If higher education is the castle, who belongs inside the castle?

Because of financial aid and diversity efforts in admissions, first-generation and low-income (FLI) students usually have access to higher education. But 90% of FLI students do not graduate from college within six years (Zinshteyn, 2016). The gates to the castle are open, but why don’t FLI students stay?

Inclusion goes beyond admissions. A student’s experience and motivation to stay is heavily influenced by the inclusiveness of the design in online courses. As a result, instructional designers are in an ideal position to design courses that are more aligned with life for FLI students outside of the virtual classroom.

Imposter Syndrome

If you are reading this, you have experienced it at some point in your career, no doubt. Imposter syndrome is that uncomfortable feeling that you are incompetent and have fooled everyone into thinking that you belong. Imposter syndrome is a nearly universal experience and has been studied since the 1970’s. However, in the last few years, researchers and social justice activists have suggested that imposter syndrome is actually the result of systemic bias. As white people, especially men, advance in their education and careers, they develop more confidence, and the feelings of imposter syndrome usually go away. However, because of systemic bias, people with marginalized identities feel more like a fraud the further they advance in their education and careers (Tulshyan & Burey, 2021).

College is a breeding ground for imposter syndrome. Most new college students have a steep learning curve and feel insecure, but the struggles are amplified for FLI students. The structure and culture of higher education is very different from the circumstances and environments they grew up in. Many FLI students blame themselves, assuming they aren’t working hard enough. Yet, cultural and social differences are to blame for their imposter feelings.

Instructional Designers Can Help

Former U.S. President Barack Obama (2010) said, “The best anti-poverty program is a world-class education.” If he is correct, instructional designers hold a lot of power because we are working to provide a world-class education for others (U.S. News, n.d.). Plus, we have managed to successfully navigate higher education ourselves and have constant access to learning in our jobs. Additionally, instructional designers are on the front lines of dismantling imposter syndrome by guiding and training instructors and designing courses and learning activities with FLI students in mind.

In addition to the research-based best practices for engagement, inclusion, and assignment transparency when designing online courses, instructional designers should consider the income demographics of online students. Online students are often FLI students. Fifty percent of online students’ family income is below $39,000 a year (Classes and Careers, 2018). Online students are likely to be working and juggling family responsibilities in addition to taking classes (OSU, 2020). They may not be taking classes online because it is the ideal learning environment for them, but because they need to fit education into their other responsibilities. Additionally, some online students pursue disciplines and majors they don’t love because of scheduling convenience or because a particular degree will bring financial security.

Instructional designers can relieve some of the pressure and insecurity for FLI students by intentionally creating an inclusive space in every course. Here are twelve research-based suggestions for how instructional designers can be inclusive of FLI students when designing courses and collaborating with instructors.

Find out who the FLI students are in each course. In addition to helping instructors understand the demographics of Ecampus students, designers could encourage instructors to learn which students are FLI students. Instructors could have an informal conversation or could give an assignment where students share how their background and culture relate to the class subject. Andragogy emphasizes the importance of student experience in learning. When instructors help students see that their social class affects their college experience, the student’s life experiences can be an anchor to attach what they learn in class (Checkoway, 2018).
Help students embrace their identity. Find opportunities for students to embrace their identity, regularly share about their lives, and solve problems in their own families and communities. Give students plenty of choice, provide examples using a variety of cultures, and consider topics and stories that people with a low-income can relate to. Students should analyze case studies involving situations and organizations they are familiar with. If material is real to the student, they can grasp it quicker. For example, students could learn velocity using the model of car they drive, or write an essay on a policy issue they care about (Checkoway, 2018).
Encourage Small group work. Higher education in the U.S. caters to an individualistic, independent, and merit-based culture. This is even more true in online courses where everyone works asynchronously. However, FLI students often come from interdependent cultures (Canning et al., 2019; Stephens et al., 2012; Townsend et al., 2021). Group activities help students collaborate and connect with each other, supporting students that struggle with imposter syndrome or that feel more comfortable working with others.
Eliminate competition between students. Competition in STEM classes increase feelings of imposter syndrome for all students, especially FLI students (Canning et al., 2019). Encourage instructors to eliminate competitive activities, such as requiring students to promote themselves in online discussions. Also, grading on a curve creates a hierarchy that causes anxiety and self-doubt in a lot of students. And last, encourage instructors to include opportunities for collaboration and cooperation and be clear that all students can succeed.
Double down on inclusion in STEM classes. Extra care should be taken to support FLI students when designing and teaching STEM classes. In STEM programs, the number of FLI students is only 20 percent (Peña et al., 2022). This is especially problematic because the stakes are high for FLI students in STEM classes because students who pursue STEM careers earn significantly higher salaries. Instructional designers should design activities that help students see themselves as scientists.
Design low-stakes formative assessments. Design several low-stakes formative assessments early in the course to address learning gaps in students with less confidence or experience. These assignments help FLI students learn the “hidden curriculum” of higher education, which includes expectations about assignments that are often “unspoken” or implied (Tyson, 2014). FLI students may not know to ask questions, so these assignments should be designed to provide early feedback, identify students needing more support resources, and clarify misunderstandings about policies and expectations.
Use Inclusive language. Encourage instructors to use supportive and inclusive language and avoid jargon in syllabi, assignment instructions, and informal videos. This helps students without experience feel like they belong in the course.
Apply course concepts to the real world. Help instructors become transparent with how assignments and course outcomes develop skills that are useful in the real-world. This effort benefits all students but especially helps students that are in danger of dropping the course see the long-term value of sticking with it.
Design social annotation activities. With social annotation, students collaborate to annotate an open educational resource (OER). This learning activity promotes interdependence and shared meaning-making among classmates. Hypothesis, NowComment, Perusal, and Diigo are a few popular tools for social annotation (Farber, 2019).
Identify career paths. FLI students may not have access to insights about careers, education, research, or internships. Encourage instructors to share details about their own career path and professional development as well as how to navigate different careers within the discipline. Instructional designers could create a discussion board for students to ask and answer questions with their peers about future careers.
Encourage financial sensitivity. Consider using low or no-cost learning resources. Use OER, older editions of textbooks, and if a high-cost text is necessary, justify it. Also, work with the campus library to see if required textbooks can be made available online. And last, encourage instructors to teach students how to access, read, bookmark, highlight, and annotate digital resources so they can get the most out of their study sessions.
Explicitly explain office hours. Explicitly state that students are encouraged to contact the instructor with questions. Explain what office hours are, that they are useful for creating supportive bonds between instructors and students, and that students are invited to go anytime. Many FLI students feel intimidated by going or do not even realize how speaking with the professor would be useful (Tyson, 2014).

Circling back to the castle metaphor, the castle is comfortable if you already are used to the structure and culture of higher education. But to help FLI students feel confident and successful, instructional designers can design courses more in line with life for FLI students outside the gates. Instead of molding FLI students to fit in at college, instructional designers can adapt to them, designing courses with a focus on interdependent and collaborative learning activities.

References

Canning, E., LaCrosse, J., Kroeper, K., & Murphy, M. (2019, November 19). Feeling like an imposter: The effect of perceived classroom competition on the daily psychological experiences of first-generation college students. Social Psychological and Personality Science, 11(5), 647-657. https://doi.org/10.1177%2F1948550619882032

Chardin, M. & Novak, K. (2021). Equity by design: Delivering on the power and promise of UDL. Corwin.

Checkoway, B. (2018, August 20). Inside the gates: First-generation students finding their way. Higher Education Studies, 8(3). https://doi.org/10.5539/hes.v8n3p72

Classes and Careers. (2018). Online College Student Trends [Infographic]. https://www.classesandcareers.com/online/online-college-students-growth-demographics

Farber, M. (2019, July 22). Social Annotation and the Digital Age. Edutopia. https://www.edutopia.org/article/social-annotation-digital-age

Obama, B. (2010, January 7). Remarks by the President in State of the Union address [Speech]. The White House. https://obamawhitehouse.archives.gov/the-press-office/remarks-president-state-union-address

Oregon State University Ecampus. (2020). OSU Ecampus annual student survey report. https://ecampus.oregonstate.edu/services/student-services/student-survey-2020.pdf

Peña C., Ruedas-Gracia N., Cohen J.R., Tran N., & Stratton M.B. (2022, October 6). Ten simple rules for successfully supporting first-generation/low-income (FLI) students in STEM. PLOS Computational Biology, 18(10). https://doi.org/10.1371/journal.pcbi.1010499

Stephens, N., Fryberg, S., Markus, H., Johnson, C., & Covarrubias, R. (2012). Unseen disadvantage: How American universities’ focus on independence undermines the academic performance of first-generation college students. Journal of Personality and Social Psychology, 102(6), 1178–1197. https://doi-org.ezproxy.proxy.library.oregonstate.edu/10.1037/a0027143

Townsend, S., Stephens, N., & Hamedani, M. (2021, February 9). Difference-education improves first-generation students’ grades throughout college and increases comfort with social group difference. Personality and Social Psychology Bulletin, 47(10), 1510-1519. https://doi-org.ezproxy.proxy.library.oregonstate.edu/10.1177%2F0146167220982909

Tulshyan R. & Burey, J. (2021, February 11). Stop telling women they have imposter syndrome. Harvard Business Review. https://hbr.org/2021/02/stop-telling-women-they-have-imposter-syndrome

Tyson, C. (2014, August 4). The hidden curriculum. Inside Higher Ed. https://www.insidehighered.com/news/2014/08/04/book-argues-mentoring-programs-should-try-unveil-colleges-hidden-curriculum

U.S. News & World Report. (n.d.). Oregon State University. Best Online Programs. https://www.usnews.com/education/online-education/oregon-state-university-3210/bachelors

Zinshteyn, M. (2016, March 13). How to help first-generation students succeed. The Atlantic. https://www.theatlantic.com/education/archive/2016/03/how-to-help-first-generation-students-succeed/473502/

If you design or teach online courses, and the term Regular and Substantive Interaction (RSI) is unfamiliar to you, not to worry. It’s likely that you’ve already implemented some degree of RSI in your online courses. RSI is the US Department of Education (DoE) requirement for institutions receiving federal funds to “ensure that there is regular and substantive interaction between students and instructors” in their online courses. It was intended as a quality assurance and consumer protection measure, but it is also a key component of high-quality online learning. Simply put, student-teacher interactions must be consistent and meaningful throughout the delivery of an online course. There is a mountain of research supporting this idea by now, and we have long known that this type of interaction is an essential component of learning and has a deep impact on student experience and satisfaction with online learning.

word cloud containing high- frequency words from post — Word cloud created via WordItOut.com

Characteristics of RSI

You may be thinking that you already have plenty of quality interaction in your course. If you’re familiar with the Ecampus Essentials standards for course development (based on the Quality Matters course design rubric) or the Ecampus Online Teaching Principles, you know that teacher-student interaction is a basic component of effective online course design and delivery. You may also be thinking that “interaction” is a vague term. After all, interactions can occur synchronously or asynchronously via many different platforms. They can occur in response to student progress in a particular course or be an intentional aspect of the instructor’s course delivery plan. So, what exactly does quality interaction in the context of RSI entail? The DOE guidelines outline the main characteristics of regular and substantive interaction as follows:

Instructor-initiated

Instructor-student interaction should be an intentional component of the course design and delivery. While students should also be encouraged to reach out to the instructor as needed, interactions should be required and initiated by the instructor to be considered RSI. For example, ad hoc office hours and auto-graded objective quizzes would not be considered RSI, but requested office visits, individualized feedback on assignments or open-ended quizzes, and instructor-facilitated online discussion forums would qualify as regular and sustained interactions. Likewise, announcements tailored to the course content during the term of the delivery would also meet the guidelines for RSI.

Frequent and consistent

Simply put, frequent and consistent interaction means that you are present in your course in an intentional manner regularly throughout the term. Instructor presence in online courses deeply impacts student learning, satisfaction, and motivation, so this is probably not a new idea for those who have taught online. Many online instructors maintain instructor presence through regular announcements or videos providing updates on student progress or feedback, adding to ideas presented in student discussions or other submissions, offering clarifications to questions regarding content or assignments, etc. There are many ways for instructors to be present in a course so that students feel that they are part of a community of learners. To meet the standards for RSI, the instructor presence should also be planned and occur regularly throughout the term.

Focused on the course subject

Interactions should be related to the academic content and help students to achieve the course outcomes. Assignments should provide a space for instructors to assess student learning through substantive feedback. Non-specific feedback (Good job!) or a grade entered without comments related to work on the assignment at hand would not count as RSI. However, communications providing reading guidance, posting examples with explanations, sending an announcement clarifying concepts students may have missed in a discussion are all good examples of interactions focused on the course subject. That’s not to say that sending a message of encouragement or celebration to students (Go Beavs!) would not be an important component of social presence in a course.

Faculty member meets accreditation standards

This requirement presents a little bit of a murky area, and each institution will need to decide who would be considered a qualified subject matter expert based on their accrediting body standards. For example, Teaching Assistants (TAs) may or may not be considered qualified subject matter experts depending on where they are in their postgraduate journey. However, regardless of the level of expertise, the role of any TA or other course mentor can never be in lieu of the instructor interaction in a course.

Increasing RSI in your course

Meaningful interaction may already be an integral part of your course design and delivery, or you may have some work to do in that area. Whatever your current level of RSI, there are many ways to increase or vary the interaction in your course. Some practitioners note that what constitutes “meaningful interaction” for the purposes of RSI compliance can be difficult to measure. In response, the DoE updated their definition of Regular and Substantive Interaction (RSI) in 2021 to further clarify the issue for practitioners. To be considered regular and substantive, interaction, “…must engage students in teaching, learning, and assessment, as well as two of these five actions:

providing direct instruction;
assessing or providing feedback on a student’s course work;
providing information or responding to questions about the content of a course or competency;
facilitating a group discussion regarding the content of a course or competency;
or other instructional activities approved by the institution’s or program’s accrediting agency.”

The good news is that the DoE definition is broad enough to include a huge range of activities giving course developers and instructors many options for choosing how and when interaction occurs in a course. While not an exhaustive list, a few recommendations to boost RSI in your course include:

Set expectations

Make your plan for interaction clear to students, and include them in setting expectations for both the instructor and the students. Your communication policy stating the response time students can expect from you on emails and assignment feedback should be stated in the syllabus and posted in the course. You should also tell learners how to communicate with you. Make participation expectations clear through discussion guidelines and rubrics for participation. You might also create an introductory activity in which students and the instructor make their expectations explicit through a negotiated process.

Provide timely and individualized feedback

There are many methods for delivering feedback (written, video, audio, conferences, etc). In fact, using a combination of methods is good practice for incorporating elements of Universal Design for Learning (UDL). Regardless of how you deliver feedback, it should add to or extend students’ understanding, make concrete suggestions for improvement, highlight what they are doing well, or provide models.

Send regular announcements

Announcements are handy for sending reminders about due dates and other housekeeping items. As an RSI strategy, announcements present a useful vehicle for digging into course content and helping students to synthesize important information. You might use announcements to extend concepts from the previous week’s activities, contextualize content students will see in the coming week, or to identify sticky points or patterns seen in student work. While announcements can be used for on the fly reminders or clarifications, it is a good idea to establish a pattern for sending substantive announcements whether that be on Sunday evenings or at other intervals so that students know when to expect them.

Incorporate tools for meaningful interaction

VoiceThread, Padlet, and Perusall are just a few examples of platforms that instructors can use to facilitate interaction. While it may be tempting to incorporate several tools to boost engagement, a more effective approach would be to avoid using technology for the sake of using technology. Instead, try incorporating one or two tools and create meaningful tasks around them. Use each two or more times during the term so that students spend their time engaging with each other and the content via the tool rather than learning how to use it.

Conduct surveys and evaluations

Midterm surveys on students’ experience in the course are helpful for second-half tweaks to stay on track toward the goals you set out to accomplish. They can also be useful for making adjustments for the next time you deliver the course. Ask students how they feel about the interactions with other students and the instructor. Ask how they could be improved, and encourage them to reflect on their own contributions. If there is group work involved, solicit opinions about how it is going and how you can support their collaborations. In doing so, you give learners the opportunity to ask for help where they need it, and you gain information to give you ideas for how to structure interactions for the next iteration of the course. A trusted colleague or an instructor designer can also be helpful in evaluating the level of RSI in your course. When you feel you have reached your goals around interaction and other markers of high-quality course design, consider asking for a formal review of your course to become Quality Matters certified.

Hold regular office hours

In order to qualify as RSI, office hours must be predictable, scheduled, and required rather than an optional feature of the course. While synchronous sessions should be kept to a minimum to allow for student flexibility, you can also facilitate meaningful interaction via a virtual meetings. If you give mini-lectures or provide models for specific lessons, for example, you might consider recording your explanations so all students, including those who cannot attend a particular session, benefit from the extra guidance.

Resources

Poulin, R. (2016) Interpreting what is Required for “Regular and Substantive Interaction”. WCET Frontiers. Retrieved from https://wcet.wiche.edu/frontiers/2016/09/30/interpreting-regular-and-substantive-interaction/

Regular and Substantive Interaction. SUNY Online. Retrieved from https://oscqr.suny.edu/rsi/

Regular & Substantive Interaction (RSI) in Online Learning. Chemeketa Center for Academic Innovation. Retrieved from https://facultyhub.chemeketa.edu/instruction/rsi/

How to Increase Regular and Substantive Interaction (RSI) in Online and Distance Learning. OLC Webinar 2021. Retrieved from https://onlinelearningconsortium.org/webinar/how-to-increase-regular-and-substantive-interaction-rsi-in-online-and-distance-learning/

Quality Online Practices: Regular and Substantive Interaction (RSI). University of Tennessee Knoxville. Retrieved from https://onlinelearning.utk.edu/online-teaching-learning-resources/quality-online-practices/rsi/

In Dr. Freeman Hrabowski’s TED Talk “4 Pillars of College Success in Science”, he told the story of Nobel laureate Isidor Isaac Rabi’s mother’s famous question: Did you ask a good question today? Let’s pause for a minute and reflect: What is a good question? What questions do you ask most frequently? What questions do your students or children ask most?

Types of Questions

Teachers usually encourage students to ask questions. Dr. Peter Liljedahl, author of “Building Thinking Classrooms in Mathematics” and professor of Mathematics Education at Simon Fraser University in Canada, however, points out that not all questions need and should be answered directly. According to Liljedahl, there are three types of questions and only one type of questions requires direct answers. Liljedahl categorizes questions in K-12 mathematics classrooms into the following three types:

Proximity Questions
Stop Thinking Questions
Keep Thinking Questions (Liljedahl, 2020)

Proximity questions refer to questions students ask when the teacher is close by, as the name suggests. Liljedahl’s research showed that the information gained from such proximity questions was not being used at all. Stop-Thinking Questions are questions students ask just to get the teacher to do the thinking for them, with the hope that the teacher will answer it and they can stop thinking, such as “Is this right?”, “Do we have to learn this?”, or “Is this going to be on the test?” Unlike the first two types of questions, keep-thinking questions are often clarification questions or about extensions the students want to pursue. According to to Liljedahl, if you have an authentic and level-appropriate task for students to work on, 90% of the questions being asked are proximity questions or stop-thinking questions and only 10% of questions students ask are keep-thinking questions. Liljedahl pointed out that answering proximity questions and stop-thinking questions are harmful to learning because it stops students from thinking.

Next, how could teachers differentiate the types of questions being asked? Liljedahl offers a simple solution to separate keep-thinking questions from the other two types of questions: Are they asking for more activity or less, more work or less, more thinking or less?

After differentiating the types of questions, what should teachers do with these proximity questions and stop-thinking question? Ignore them? No, not at all! Liljedahl emphasizes that there is a big difference between having students’ questions heard and not answered, and having their questions not heard. How should teachers answers these proximity questions and stop-thinking questions then?

Ten Things to Say to Proximity And Stop-Thinking Questions

Liljedahl provides the following list of ten responses to a proximity or stop-thinking question so that you are not giving away the answer and taking the thinking opportunity away from students. Basically, you turn the questions back to your students!

Isn’t that interesting?
Can you find something else?
Can you show me how you did that?
Is that always true?
Why do you think that is?
Are you sure?
Does that make sense?
Why don’t you try something else?
Why don’t you try another one?
Are you asking me or telling me? (Liljedahl, 2021, p. 90)

Cross-Discipline Nature of Good Questions

“Building Thinking Classrooms“ is recommended to me by some college biology teachers in the US. Biology teachers recommending math teaching book, isn’t that interesting? The reasoning behind this recommendation is that the techniques being taught in this book could be easily applied to any other teaching context to get your students engaged in thinking, whether it is K12 education or college education, math teaching or teaching of another subject.

If this brief introduction got you interested in reading the rest of the book and find out the rest of what the author has to share, it is available at Oregon State University library as an ebook or you can purchase it online.

Asking Good Questions for Management and Education Administration

If you are not directly involved in teaching and learning, but in administrative or management role in an organization, Dr. Amy Edmondson has some practical suggestions for asking good questions to keep organization growing healthily. Dr. Amy Edmondson, author of “The Fearless Organization”, Novartis professor of Leadership and Management at the Harvard Business School, states that good questions focus on what matters, invite careful thought, and give people room to respond. Edmondson also suggests three strategies for framing good questions:

To broaden the discussion. For example: What do others think?
What are we missing? For example: What other options could we consider?
How would XXX (such as our role model, our mentor, or our competitor) approach this? For example: Who has a different perspective?

With the above tips for asking questions, are you ready to ask a good question today?

References

Edmondson, A. (2018). The Fearless Organization: Creating Psychological Safety in the Workplace for Learning, Innovation and Growth. Hoboken, NJ: John Wiley & Sons, Inc.

Hrabowski, F. (2013). 4 Pillars of College Success in Science. TED Talk. https://www.ted.com/talks/freeman_hrabowski_4_pillars_of_college_success_in_science?language=en

Liljedahl, P. (2020). Building Thinking Classrooms in Mathematics, Grades K-12 : 14 Teaching Practices for Enhancing Learning. Thousand Oaks: Corwin, 2020

Overview

Findings

Recommendations

The Big-Picture:

Orchestrating a Symphony of Learning & Student Success:

Efficiency and Continuous Improvement:

Assessment and Accreditation – Meeting Quality Standards:

Conclusion:

Course Mapping Tools:

Course Map Samples Shared in the QM Rubric Update:

References:

Course Design Connection

Memory and Course Design

Cut out the Bigger Extraneous Content

Review Instructions

Utilize Best Practices for Formatting

Julie’s Favorite Animals

Provide High-Level Overviews

Module Organization

Wrapping It Up

References

What does experiential learning look like?

What makes a good experiential learning experience?

Eight Principles of Good Practice for All Experiential Learning Activities

Experiential Learning in OSU Ecampus Courses

Resources

What Does the Research Say?

Conclusions and Recommendations

References

What is Readability?

Chunking Content

Let’s demonstrate!

Using Whitespace

Avoiding Wordiness

Use Visuals

Color

Conclusion

References

Imposter Syndrome

Instructional Designers Can Help

References

Characteristics of RSI

Instructor-initiated

Frequent and consistent

Focused on the course subject

Faculty member meets accreditation standards

Increasing RSI in your course

Set expectations

Provide timely and individualized feedback

Send regular announcements

Incorporate tools for meaningful interaction

Conduct surveys and evaluations

Hold regular office hours

Resources

Types of Questions

Ten Things to Say to Proximity And Stop-Thinking Questions

Cross-Discipline Nature of Good Questions

Asking Good Questions for Management and Education Administration

References

Contact Info