Background

“In the Winter Term 2024, the Ecampus Research Unit conducted a survey study of 669 students who had taken online courses at OSU. The 40-item survey was designed to assess students’ knowledge and use of generative AI tools, as well as their perceptions of their use in their courses and careers. A full report of this study is available on the Ecampus Research Unit website. Based on the results of this study, several recommendations were developed to guide decision making about generative AI tools in online courses.”

Dello Stritto, Underhill, & Aguiar (2024).

This recent study highlighted three key recommendations for faculty seeking to integrate generative AI into their courses effectively:

  • Recommendation 1
    • Write a course policy about generative AI that is clearly explained.
  • Recommendation 2
    • Consider a wide range of student emotions and concerns when integrating generative AI in your online courses.
  • Recommendation 3
    • Educate students on generative AI tools.

Applying data to design

To apply these recommendations in practice, we can reorganize them into instructional design categories that foster AI resiliency in course design: Course Learning Outcomes, Learner Profiles, Learning Materials, Activities and Assessments, and Course Policies. These categories offer a comprehensive framework for integrating AI while addressing students’ concerns and enhancing learning experiences.

Course Policies: Establish Clear Guidelines for AI Usage

Reflecting Recommendation 1, developing a clear, transparent policy on AI usage is key. Faculty should articulate when and how students can use AI tools, providing specific examples of ethical use. By defining these expectations early in the course, instructors help students understand the role AI can play in their learning process, promoting academic integrity. 

Learner Profiles: Address Emotional and Academic Concerns

In line with Recommendation 2, it is essential to consider students’ diverse reactions to AI—ranging from excitement to anxiety—when designing a course. This is where understanding Learner Profiles becomes critical. 

Learning Materials and Activities: Ensure Relevance and Adaptability with AI

Recommendation 3 emphasizes the importance of educating students about generative AI, which can be achieved through thoughtful integration into learning materials, activities, and assessments.

Course Learning Outcomes: Integrate AI with Intentional Learning Design

The integration of generative AI tools into course design necessitates an examination of their impact on student mastery of the Course Learning Outcomes. It is vital to ensure that student use of AI tools supplement and enhance the learning process rather than bypass cognitive engagement.

With these four considerations in mind, we can now introduce a tool to help assess and improve course resilience against generative AI, while providing learners with clear policy decisions and explanations.

Introducing CART: Course AI Resiliency Tracker 

In response to the clear need for effective integration of generative AI in educational settings, a new tool has been developed (as part of a wider suite of artificial intelligence tools) to assist faculty in navigating this complex landscape. This tool is designed to support instructors in evaluating how generative AI could respond to their course learning outcomes by highlighting its current capabilities to address and complete these outcomes. It facilitates a detailed understanding of learner profiles to ensure that AI applications are relevant and accessible to all students. Additionally, the tool encourages faculty to reflect on the currency and relevance of their learning materials and to assess how AI might be incorporated into activities and assignments. By examining existing course policies on AI usage and offering actionable steps for course development, this resource aims to demystify generative AI for both educators and students, promoting a thoughtful and strategic approach to its integration or decision to restrict AI.

Getting Started

Upon accessing the landing page, you will be prompted to input your Course ID, after which you may proceed by selecting the “Start” button.

Course AI Resilience Tracker Tool Getting Started Page

Learning Outcomes

The first step in the tool involves a reflection on your Course Learning Outcomes (CLOs). At this stage, you will have the option to choose from a list of commonly used learning outcome verbs, organized by the general categories of Bloom’s Taxonomy. Note that there is a current selection limit of five CLOs at one time, and faculty with verbs absent from this list are encouraged at this time to select verbs that are most like those in their own CLOs to get feedback that will feel the most transferable.

Course AI Resilience Tracker Learning Outcomes Page

After selecting the appropriate verbs that align with your outcomes, click on the “Test Resiliency” button. This will display feedback on how generative AI may already be able to meet expectations for common tasks associated with those action verbs.

Your Learners

Following the assessment of CLOs, the next step encourages you to consider your learners. In this section, you are invited to input relevant details about your students, including their backgrounds, career aspirations, prior knowledge, or any other contextual information that could inform your generative AI course policies. We are aware that this question might feel challenging, especially for faculty who teach all kinds of learners as part of a general education course. In this case, consider this as a more general introduction to the wide variety of learner profiles that may take the course, and how generative AI may be used from their perspective.

Your responses here, as with all inputs in the tool, will be temporarily stored and displayed on the Summary Page for your future reference.

Course AI Resilience Tracker Your Learners Page

Learning Materials

Next, the tool asks you to evaluate the relevance and adaptability of your learning materials. You may choose from the pre-set options provided, or alternatively, you can select “Other” to add customized choices based on your specific course materials.

Course AI Resilience Tracker Learning Materials Page

Activities and Assessments

Next, you will be prompted to reflect on your course activities and assessments. This section includes three key questions. Two of the questions are straightforward yes-or-no inquiries, while the third invites you to select one or more methods that you currently employ to promote academic integrity in your assessments. Including this information alongside activities and assessments bolsters understanding for your learners about expected Gen AI usage, why the choice has been made, and enhances academic integrity across the entire course.

Course AI Resilience Tracker Activities and Assessments Page

Course Policies

You will then be prompted to consider an important question: does your syllabus currently include a policy on generative AI? This reflection is crucial for ensuring transparency and consistency in how AI is addressed throughout your course design. After choosing one of the answers, you will be able to select from some key elements to include in your AI usage policy.

Course AI Resilience Tracker Course Policies Page

Next Steps

Finally, the tool concludes by prompting you to consider the next steps in your course development, offering guidance on how to proceed with integrating generative AI effectively. Each choice offers different recommendations as automatic feedback, and you are encouraged to read through them all before moving onto the final summary.

Course AI Resilience Tracker Next Steps Page

Summary Page

At the conclusion of the tool, you will be directed to a Summary Page that consolidates all your previous inputs, along with the guidance and recommendations provided throughout the process. This comprehensive summary can be printed or saved as a PDF for future reference and review.

The benefits of using the tool

Recommendation 1: A clearly explained course policy

The new tool supports this recommendation by guiding instructors to design course policies that offer clear instructions to learners on what is allowed and disallowed, and most importantly to give rationales behind these policy decisions.

Recommendation 2: Considering learner profiles

The tool helps instructors map these profiles to ensure that generative AI is integrated in ways that are accessible, equitable, and aligned with the emotional and cognitive needs of different students. By anticipating student concerns, instructors can provide thoughtful guidance on how AI will or will not be used in various course activities and assessments.

Recommendation 3: Ensure Relevance and Adaptability with AI

The tool helps instructors evaluate the relevance and adaptability of their current materials by offering pre-set options or the ability to add customized choices. This process ensures that course content remains up-to-date and flexible enough to incorporate generative AI effectively or alternatively,  provides avenues to secure assessments against AI generated content.

Course Learning Outcomes: Integrate AI with Intentional Learning Design

The tool supports this by guiding instructors through a reflection on their CLOs, offering a selection of commonly used learning outcome verbs categorized by Bloom’s Taxonomy. It also helps educators recognize the extent to which generative AI can currently accomplish many of these learning outcomes, providing valuable insights into the specific areas where AI might enhance or support course goals. the purpose of this is to ensure that AI integration choices are not just incidental, but strategically aligned with fostering critical thinking, creativity, and problem-solving skills within the broader context of your course objectives.

Conclusion

In response to the growing need for effective AI integration, this new tool helps faculty navigate the complexities of incorporating generative AI into course design. By addressing Course Learning Outcomes, Learner Profiles, Learning Materials, Activities and Assessments, and Course Policies, the tool promotes a strategic approach that aims to demystify AI for both educators and students. With thoughtful integration, well-designed generative AI policies can enhance learning experiences, help prepare students for future, teach learners to avoid potential pitfalls, and maintain the academic integrity of online courses.

License and Attribution

License

Course AI Resilience Tracker Tool, created by Oregon State University Ecampus, is licensed under Creative Commons Attribution-NonCommercial 4.0 International

Text Content and Guidance

Ashlee Foster, Dana Simionescu, Philip Chambers, Katherine McAlvage, and Cub Kahn

HTML/JavaScript Development

Philip Chambers

References

Dello Stritto, M. E., Underhill G. R., & Aguiar, N. R. (2024). Online Students’ Perceptions of Generative AI. Oregon State University Ecampus Research Unit. https://ecampus.oregonstate.edu/research/publications/

Helpful Links

animations for MTH 112Z

MTH 112Z at Oregon State University is designed to prepare students for calculus and related disciplines. This course explores trigonometric functions and their applications as well as the language and measurement of angles, triangles, circles, and vectors. These topics are explored symbolically, numerically, and graphically in real-life applications. MTH 112Z is designated as a Common Course Numbering (CCN) in the state of Oregon, ending with “Z” in the course number. When transferring to an Oregon public college or university, “CCN courses will be accepted as if they were taken at the institution students transfer to (that is, the receiving institution)” (State of Oregon, 2023).

An instructor from the math department and Tianhong Shi from Ecampus collaborated in designing a brand-new version of MTH 112 to meet the new Core Ed requirements for Oregon State University and Z course requirement for the state of Oregon. At the beginning of this project, the design team identified major challenges of this course as follows:
1. Content challenges
2. Low motivation for some students to continue studying math at this level after initial frustration in this course.
3. Low interest in participation in class discussions.

The instructor and Tianhong met regularly to discuss the challenges, brainstorm strategies for solutions, and delineate a plan to implement practical solutions for MTH 112Z. The solutions that were implemented in the course include:

1. Creating a safe and inclusive learning environment that students will feel they belong here.
2. Creating short animated stories of how math operates in people’s real life, each video is about or less than 30 seconds long. The purpose of these animations is to build a bridge between math learning and real life and to motivate students to learn the topics of each unit.
3. Helping students to identify the steps in solving a math problem to scaffold learning and build learning success step by step.
4. Creating “Make Learning Fun” discussion topics: Research (Purinton and Burke, 2019; Tews, et.al., 2014) tells us that when students feel emotionally relaxed and happy, learning is more effective. Therefore, one “Make Learning Fun” discussion forum is created for each unit.

Building an Inclusive and Trusting Learning Community where Students Belong
College belonging is defined as “students’ perceived social support on campus, a feeling or sensation of connectedness, the experience of mattering or feeling cared about, accepted, respected, valued by, and important to the group”, according to Strayhorn (2018, p.4). The strategies used to build an inclusive and trusting learning community in MTH 112Z included the following:
1. In Start Here Module, the instructor made a video covering Artificial Intelligence (AI), academic integrity, honesty, and diversity, to explicitly explain the expectations for this course regarding academic integrity and why it is so.
2. Also in Start Here Module, the instructor built a “Name Tents 112Z” discussion board for students to introduce themselves, setting an example by introducing the instructor himself first.
3. There is a Diversity Forum where students can post comments that they would want the instructor to know about themselves to make learning more inclusive.

Making Content Relevant
In addressing the challenging content, the instructor identified concepts that would be better explained through a set of short animated videos, recorded the audio narratives, and the media team helped creating the short animations. For example, at the beginning of unit 4 is an animation about finding the length of a tall tree on campus. And here is the transcript of the video: “The Trees on the O S U campus, are wonderful . how tall are the cedar trees by the memorial union? if you measure the angle from the ground to the top of the tree and know the distance you’re standing away from the tree, you can compute it. Make a triangle and set up an equation to get the height. Which function would you use?” And here is the transcript of unit 5 animation video: “You can get swept away in a river. Oregon has many great rivers for boating. When you were kayaking, you need to account for how much the current will push you off course, this can be done with vector. One vector represents the river’s flow with direction and strength, another vector is the direction which you kayak. The results of these two added together is the direction you end up going. If you want to reach a certain point on the other side, where should you aim?” We can see from these two examples that they are relevant to student lives (trees and kayaking) and relevant to the topics of the units. And these animations tell short stories, hoping to motivate students for learning.

Scaffolding Toward Learning Success
Scaffolded learning activities provide students a supportive learning environment (Dennen, 2004). In each unit’s content discussion forum and homework assignment, students explore problem solving step by step and discuss with each other to help them build confidence and fluency in problem solving. By such a design, the design team hoped students would get the support they needed and would be able to easily identify where they did wrong and how to improve or correct based on the feedback they receive from the online homework system and from the instructor and Teaching Assistants.

Making Learning Fun
Emotional health is important for students’ learning success. Research suggests there is a significant positive relation between fun delivery of content and the forms of engagement (Tews, et al., 2014). Schwartz et al. (2016) also recommend building fun elements in learning for effective teaching and learning. So the design team strived to build elements of fun into the course. The short animations are meant for fun. In addition, each unit has a “Just For Fun” discussion forum to bring students’ attention to learning and promote motivation. Below are examples of these discussions:

Unit 1 Just for Fun: Please read through this survey and describe how you would answer the questions. (The survey was about having students imagine themselves navigating through the forest on foot and trying to find their way to their cabin.)

Unit 2 Just for Fun: What do you think of the animation?

Unit 3: Just for Fun: Please take a picture of something you can model with a sine function as you have been studying in this module. It could be a windmill if you live near a windmill, or an ocean if you live near an ocean. Make sure it is a picture that you have taken and then explain briefly what it is and how you would model its movement.

Unit 4 Just for Fun: Describe a time when you could feel the effect of the wind or water current as you were moving. For example, winters in Oregon are blustery and you can get blown around when you are biking.
Or you can describe a way that you would use vectors in your own life.

Unit 5 Just for Fun: This is it! you’re almost done–
What was a topic in the course that was interesting to you? or what was a topic that didn’t seem to be useful?

That is what we did to make introductory college math fun, inclusive and learnable. If you have ideas for math or STEM course design, feel free to share with us (Tianhong.shi@oregonstate.edu). The more, the better!

References
Dennen, V. P. (2004). Cognitive apprenticeship in educational practice: Research on scaffolding, modeling, mentoring, and coaching as instructional strategies. In D. H. Jonassen (Ed.), Handbook of Research on Educational Communications and Technology (2nd ed.), (p. 815). Mahwah, NJ: Lawrence Erlbaum Associates.

Hogan, K., and Pressley, M. (1997). Scaffolding student learning: Instructional approaches and issues.Cambridge, MA: Brookline Books.

Huck, C and Zhang, J., Efects of the COVID-19 Pandemic on K-12 Education: A Systemic Literature Review. Educational Research and Development Journal. Summer 2021, Vol. 24.

State of Oregon. (2023). The Oregon Transfer Compass. Retrieved at https://www.oregon.gov/highered/about/transfer/pages/transfer-compass.aspx


Purinton, E. and Burke, M. (2019). Student Engagement and Fun: Evidence from the Field. Business Education Innovation Journal, Volume 11 Number 2, P133-P140.


Schwartz, D. L., Tsang, J. M., & Blair, K. P. (2016). The ABCs of how we learn : 26 scientifically proven approaches, how they work, and when to use them (First edition.). W.W. Norton & Company, Inc.

Strayhorn, T. L. (2018). College students’ sense of belonging. Routledge. https://doi-org.oregonstate.idm.oclc.org/10.4324/9781315297293

Tews, M. J., Jackson, K., Ramsay, C., & Michel, J. W. (2014). Fun in the college classroom: Examining its nature and relationship with student engagement. College Teaching, 63(1), 16-26.

In our hyper-connected world, it’s tempting to think that technology like Google, Generative Artificial Intelligence, and our smartphones have rendered memory obsolete. But is that really true?

I recently participated in a book club offered by Oregon State University’s Center for Teaching and Learning. The book we read, Remembering and Forgetting in the Age of Technology: Teaching, Learning, and the Science of Memory in a Wired World by Michelle D. Miller, challenges misconceptions about how technology affects our memory and attention and offers valuable insights for educators. Let’s explore some key takeaways.

Memory Still Matters

There has been a growing backlash against memorization in education, with critics claiming it’s outdated and harmful to creativity and critical thinking. But here’s the kicker: memory actually supports robust, transferable thinking skills. Memory and thinking aren’t enemies – they’re complementary partners in learning.

Despite the “Google it” mentality, memory remains crucial. It’s not just about recalling facts; it’s about building a foundation for critical thinking and creativity. For one thing, it’s impossible in certain situations to stop and look things up (think emergency room doctors or lawyers during a trial). But more than that, our own memorized knowledge in a discipline allows us to consider context and practice skills fluently.

We’re all familiar with Bloom’s taxonomy and its bottom level: “Remembering”. Michelle Miller recommends that, instead of viewing memory as the “lowest” level of thinking, consider it the foundation. Higher-order thinking skills interact with and reinforce memory, creating a two-way street of learning.

The Power of Testing

Contrary to popular belief, quizzes and tests aren’t the enemy. Research shows that retrieval practice actually strengthens long-term retention, supports complex skills, and can even reduce test anxiety. It’s not about memorizing for the test; it’s about reinforcing learning.

In addition, “pre-quizzing” – that is, giving a quiz before introducing the material (ungraded or graded for participation only) – has been shown to help activate prior knowledge, integrate new information into existing schemas, and identify gaps or misconceptions that instructors can address.

Attention Spans: Not What You Think

The idea that “attention spans are shrinking” isn’t backed by solid science. In fact, in attention research there’s no such thing as “attention span”! And that “Students can only pay attention for 10 minutes at a time” idea? It’s based on outdated, poorly designed studies.

What about the idea that technology worsens our attention? There is no strong evidence that technology is affecting our ability to pay attention. While people often report this phenomenon (about themselves or others), a more likely explanation seems to be our decreased tolerance for boredom rather than our actual ability. However, smartphones can indeed be very distracting, and they can also affect memory negatively through the “I can Google it” effect – the expectation that information will be available online anytime can reduce our memory encoding.

Handwriting vs. Typing: It’s Complicated

The debate over handwritten versus typed notes isn’t as clear-cut as you might think. What matters most is your note-taking strategy. The best notes, regardless of medium, involve synthesizing ideas rather than transcribing verbatim.

Enhancing Memory in the Classroom

The good news is that there are many things an educator can do to help students remember essential content. Here are some strategies:

  1. Create meaning and structure: When we process information deeply and evaluate it for meaning we remember it better than when we perform shallow processing. Organizational schemes like narrative structures help information stick, and active learning techniques such as project-based learning ensure a deeper level of engagement with the content.
  2. Connect to prior knowledge: Ask questions to elicit information, draw explicit connections with previous material, and use pre-quizzing to help students see the gaps and stimulate curiosity.
  3. Embrace visualization: We’re visual creatures – use this to engage your audience. Create and ask students to create mind-maps, infographics, or other visual representations.
  4. Engage emotions: Both positive and negative emotions can enhance memory, but aim for a supportive atmosphere, which has been shown to improve learning outcomes. The emotion of surprise is a powerful memory enhancer.
  5. Connect to goals: Show how information is relevant to students’ immediate objectives.
  6. Use the self-reference effect: Relating information to oneself boosts memory. Ask students to bring their own experience or interests into the learning process through personalized assignments.
  7. Implement retrieval practice: Regular quizzing with immediate feedback can significantly boost retention.
  8. Space it out: Distribute practice over time instead of cramming.

Conclusion

In this age of information overload, understanding how memory works is more crucial than ever. By debunking myths and implementing evidence-based strategies, we can help students navigate the digital landscape while building strong, adaptable minds. I’ve only touched on a few points, but this book is chock-full of interesting information that’s useful not just for educators but for everyone!

What myths about memory and technology have you encountered in your teaching? How might you incorporate these insights into your classroom? Share your thoughts in the comments below!

References

Miller, M. D. (2022). Remembering and forgetting in the age of technology: teaching, learning, and the science of memory in a wired world (1st ed.). West Virginia University Press.

The idea of creating equitable learning environments is at the core of inclusive practices. Many educators argue that equitable learning environments are essential for student success, but what does this mean in practice? Inclusive practices build upon the premise that design and teaching should adapt to support students’ unique needs, fostering student agency. Student-centered approaches prioritize equity over equality. It’s crucial to understand that equity, which tailors resources and opportunities to individual needs, fundamentally differs from equality, which assumes that students should receive the same treatment and that this treatment is thus fair for all.

Equity refers to the “removal of systemic barriers and biases (e.g., policies, processes, outcomes), enabling all individuals to have equal opportunity to access and benefit from resources and opportunities.” (University of Waterloo, n.d.). Equity in online learning means removing barriers to participation. This is especially true for underrepresented groups, first-generation students, and those with different learning styles. Barriers include accessing materials, completing assignments, and interacting with peers and instructors. Applying an equity lens to online and hybrid design and facilitation involves many factors. Among these, structure, flexibility, and feedback are particularly critical. In this post, we will explore these elements from the perspective of the course as a whole. This will set the stage for a deeper examination of these same elements at the assessment level in my next blog post. Stay tuned!

Structure

  • Provide short descriptions for each learning material and their value in the learning process. What do students gain from reading or watching the required material for the remaining activities? 
  • Include a purpose statement in each assignment and how it contributes to learning and achieving outcomes. How are the assessments connected to the overall goal of the course? 
  • Design assessments that promote active learning, higher-order thinking, and student agency. How are students involved in the learning process? How do students apply concepts? Do assessments reflect meaningful personal experiences?   
  • Make the module content, format, and requirements consistent. How are students expected to participate in discussions? Are there activities that can benefit students from peer learning and interaction? For example, create spaces for students to collaborate and support each other beyond the traditional discussion boards.
  • Build in multimodalities for content and assessments. What are the skills that are being asked in the assignment (e.g., emphasize writing or deepening concept understanding)? Are there other ways in which students can demonstrate their learning?  For example, rather than a written paper, consider allowing students to submit an audio recording, a multimedia presentation, a collage, etc.
  • Provide a clear course schedule with regular milestones and check-in points to support learning. For instance, incorporate scaffolding into course activities and assessments with low-stakes and formative assessments.

Flexibility

While a clear and robust course structure is essential for guiding students through the learning process, it’s equally important to recognize the role flexibility plays in supporting diverse learners. Flexibility does not mean a lack of academic integrity or rigor. Flexibility can mean many things for many people therefore, it is important to clarify its intention, meaning, and place in the course. The most common use of flexibility in the online classroom is for extensions on assignments, which can help reduce instructor bias and increase student engagement and agency (Ruesch & Sarvary, 2023). How else can flexibility be incorporated into an online course? Following, there are a few ideas and questions to guide the decision about flexibility:

  • Consider updating late submission policies. Ensure that students know what to expect if unforeseen circumstances prevent them from submitting assignments by the due date. Be cognizant that life happens to everyone, and we need to offer kindness and empathy to students. How can an “automatic” late assignment policy work within the nature and scope of the course?
  • In selecting materials, identify multiple formats students can use to gain knowledge. Are there media-based materials that provide the textbook content in an alternative way (e.g., audiobook, ebook)?
  • Design assignments that include choice for students to select the format or topic of their preference. Do assignments need to all be written? Where can students choose their own topic for a project?

Feedback

While structure and flexibility are essential components of an inclusive learning environment, they alone are insufficient. Research suggests that instructor presence is fundamental to developing a sense of belonging and connection in the online environment. In addition, instructor feedback is as critical as presence to promote learning. Instructor feedback can help students identify the areas to improve. It can also help instructors identify additional resources to support students. Providing students feedback is mutually beneficial. Students receive actionable feedback on their progress and instructors learn what works in the course and what to improve. Let’s explore some ideas for feedback as a framework to build a connection with students:

  • Create feedback guidelines that communicate to students what to expect from you and when. When will assignments be graded and grades reported? How soon will you respond to email questions?
  • Consider offering feedback in multiple formats, such as audio or video in addition to text. Reflect on which activities might benefit from the added context and personal connection audio/video feedback would provide?
  • Prepare rubrics or grading guidelines that clearly indicate to students how the assignments will be graded. Ensure the rubrics are connected to the purpose and expectations of the assignments.
  • Give students actionable feedback that shows students their learning progress and guides them on how to improve.
  • Design the course modules to include feedback and revision steps. This approach will help students see how all course components are connected and contribute to meeting the course outcomes.
  • Include peer feedback (peer review) that 1) gives students guidance on how to conduct a peer review, and 2) enhances their critical thinking and perspectives by reading peers’ work.

Educators can move away from a one-size-fits-all approach by intentionally combining structure, flexibility, and feedback. This creates an environment that addresses the diverse and unique needs of all students and ensures every student has an equal opportunity to succeed, regardless of where they start.

References

  • Eddy, S. L., & Hogan, K. A. (2014). Getting under the hood: how and for whom does increasing course structure work?. CBE life sciences education, 13(3), 453–468. https://doi.org/10.1187/cbe.14-03-0050
  • Ruesch, J. M., & Sarvary, M. A. (2024, March). Structure and flexibility: systemic and explicit assignment extensions foster an inclusive learning environment. In Frontiers in Education (Vol. 9, p. 1324506). Frontiers Media SA.
  • University of Waterloo (n.d.). Humanizing Virtual Learning. https://ecampusontario.pressbooks.pub/humanizinglearningonline/


This layered paper art depicts the Heceta Head Lighthouse amid colorful hills, a flowing river, and tall green trees. Whimsical clouds and birds add depth, creating a vibrant and detailed handcrafted scene.

I’d like to share a recent experience highlighting the crucial role of collecting and using feedback to enhance our online course materials. As faculty course developers and instructional designers, we understand the importance of well-designed courses. However, even minor errors can diminish the quality of an otherwise outstanding online course.

This layered paper art depicts the Heceta Head Lighthouse amid colorful hills, a flowing river, and tall green trees. Whimsical clouds and birds add depth, creating a vibrant and detailed handcrafted scene.
A lighthouse on the Oregon coast, where student feedback and technological tools act as the guiding light. Image generated with Midjourney.

A Student’s Perspective

Recently, feedback was forwarded to me submitted by an online student enrolled in a course I had helped develop.

He praised the overall design of the courses and the instructors’ responsiveness, but he pointed out some typographic and grammatical errors that caused confusion. He mentioned issues like quiz answers not matching the questions and contradictory examples.

What stood out to me was his statement:

“These courses are well-designed and enjoyable. Their instructors are great. They deserve written material to match.”

Proactive Steps for Quality Improvement

This feedback got me thinking about how we can proactively address such concerns and ensure our course materials meet the high standards our students deserve. Here are a few ideas that might help:

Implement a Feedback Mechanism

Incentivize students to hunt for flaws. Reward sharp eyes for spotting typos and grammar slips. Bonus points could spark enthusiasm, turning proofreading into a game of linguistic detective work. For example:

  • Weekly Surveys: Add a question to the weekly surveys asking students to report any errors they encounter, specifying the location (e.g., page number, section, or assignment).
    • “Did you encounter any typographic or grammatical errors in the course materials this week? If so, please describe them here, including the specific location (e.g., page number, section, or assignment).”
  • Assignment Feedback: Include a text-field option for students to report errors alongside their file uploads in each assignment submission.

Utilize Technology Tools

Consider using technology tools to streamline the review process and help identify typographic, grammatical, or factual errors.

AI tools

The latest advanced AI tools can assist in identifying grammatical errors, suggesting more precise phrasing, and improving overall readability. They can also highlight potential inconsistencies or areas needing clarification, ensuring the materials are more accessible to students. They can also help format documents consistently, create summary points for complex topics, and even generate quiz questions based on the content.

(Oregon State University employees and currently enrolled students have access to the Data Protected version of Copilot. By logging in with their OSU credentials, users can use Copilot with commercial data protection, ensuring their conversations are secure and that Microsoft cannot access any customer data.)

Many powerful AI tools exist. But always verify their information for accuracy. Use them as a helper, not your only guide. AI tools complement human judgment but can’t replace it. Your oversight is essential. It ensures that AI-suggested changes align with the learning goals. It also preserves your voice and expertise.

Tools for content help

Some tools can be used to target different areas of content improvement:

  • Grammar and Style Checkers:
  • Fact-Checking Tools:
    • Google Scholar: This can be used to verify academic sources and find citations and references.
    • Snopes.com: Checks common misconceptions and urban legends
    • FactCheck.org: Verifies political claims and statements
  • Language Translation Tools:
    • Google Translate: Offers quick translations for various languages
    • DeepL: Provides accurate translations for multi-language content
  • Text-to-Speech and Proofreading:
  • Collaborative Editing Platforms:
    • Google Docs: Allows real-time collaboration and suggesting mode
    • Microsoft Word (with Track Changes): Enables collaborative editing

Request Targeted Assistance

If specific content requires a closer review, ask for help from other SMEs, your instructional designer, colleagues, or even students. Collaboration can provide fresh perspectives and help catch errors that might have been overlooked.

Encourage Open Communication

Foster an environment where students feel comfortable reporting errors and providing feedback. Make it clear that their input is valued and will be used to improve the course.

Embrace Constructive Criticism

It’s natural to feel defensive when receiving critical feedback (I always do!), but view it as an opportunity for potential improvement. By addressing these concerns, you can enhance the quality of your course materials and ultimately improve our students’ learning experience.

In the ever-evolving landscape of higher education, online, distance learning has emerged as a dynamic and accessible platform for students worldwide. However, with this shift to asynchronous online classrooms we must prioritize inclusivity and engagement in our educational strategies. Recognizing this need, Ecampus embarked on a journey to understand inclusive course design and teaching practices through the eyes of the learners.

Survey Summary 

In 2021, Ecampus implemented an Inclusive Excellence Strategic Plan. One goal of this plan focused on enhancing inclusive teaching and learning in online courses. As part of this initiative, a pilot study was conducted during the academic year 2022-2023, to develop a mechanism for students to provide feedback on their learning experiences. The study employed a series of weekly surveys, designed to elicit responses regarding moments of engagement and distancing within online courses.

Administered across five Ecampus courses, the pilot study garnered responses from 163 enrolled students. The findings provide invaluable insights into the nuances of online learning design and offer actionable recommendations for educators seeking to cultivate inclusive excellence in their own asynchronous, online classrooms. The questions were as follows:

  1. At what moment (point) in class this week were you most engaged as a learner?
  2. At what moment (point) in class this week were you most distanced as a learner?
  3. What else about your experience as a learner this week would you like to share?

These questions were carefully crafted to elicit responses related to diversity, equity, and inclusion (DEI). By using the verbs “engaged” and “distanced,” students were prompted to reflect on moments of connection and disconnection within their learning environments. The open-ended nature of the questions allowed students to provide contextual feedback, offering valuable insights beyond the scope of predefined categories.

The results of the survey provide a multifaceted understanding of students’ experiences in online courses. Across all five courses, certain patterns emerged regarding elements that students found most engaging and most distancing. These insights served as a springboard for the development of actionable recommendations aimed at enhancing course design and fostering inclusive learning environments.

Alignment

One crucial area highlighted by the survey results was the importance of alignment. Students noticed when their courses had assessments that were aligned with course content, and they noticed when this alignment was missing. Ensuring that learning objectives are represented in instructional materials, practice activities, assessments, and evaluation criteria is key. For more on this, please see “Alignment” by Karen Watté from 2017.

Learning Materials

Another prominent theme in the survey responses was the overwhelming nature of long, uncurated lists of readings and learning materials, which tended to alienate learners. To address this, providing a reading guide or highlighting key points can alleviate feelings of overwhelm. Optimizing content presentation and learning activities emerged as a key factor in promoting engagement and inclusivity. 

Incorporating interactive elements such as knowledge checks and practice activities within or between short lectures keeps students actively engaged and reinforces learning objectives. By utilizing multiple modes of content delivery–videos, lectures, and readings–educators can cater to diverse learning styles and preferences. Providing study guides is also noted as an effective strategy for enhancing comprehension and engagement with learning materials. 

Community & Connection

Supporting student-to-student interaction is pivotal in fostering a sense of community and participation (Akyol & Garrison, 2008). Many learners noted that they enjoyed engaging in small group discussions, in fact 50% of students in one course noted that the week 1 introductory discussion was the point they felt most engaged. Additionally, students across the courses were excited to view and respond to the creative work of their peers. Community-building course elements like these foster a sense of community and collaboration within the virtual classroom. 

While some students had mixed feelings about peer review activities–voicing concerns about feeling unqualified to judge their peer’s work–distinct guidelines and rubrics can empower learners to develop critical thinking, increase ownership, and enhance their communication skills. Thus, thoughtfully crafted peer review processes can also help to enhance the educational experience.

Authentic Activities

Incorporating authentic or experiential learning activities was also highlighted in student responses as a means of connecting course content to real-world scenarios. By integrating professional case studies, practical exercises, real-world applications, and reflective activities, educators can deepen students’ understanding of course material. Survey respondents noted again, and again how they felt engaged when coursework was relevant and applicable outside the classroom. This type of authentic work in courses can also increase learner motivation. (Gulikers, Bastiaens, & Kirschner, 2004)

Timely Feedback & RSI

By offering timely feedback on student work, online educators demonstrate their active presence and assist students in understanding the critical aspects of assessments, ultimately enhancing their chances of success. One student is quoted as saying,

“I really appreciate the involvement of the instructor. In the past I’ve had Ecampus classes where the teacher was doing the bare minimum and didn’t grade things until the last minute so I wasn’t even sure how I was doing in the class until it was almost over. I appreciate the speed at which things have been graded and the feedback I’ve already received. I appreciate the care put into announcements too!”

Timely feedback and time-bound announcements are also notable ways to showcase Regular and Substantive Interaction (RSI). Please also see “Regular & Substantive Interaction in Your Online Course” by Christine Scott.

Scaffolding

Another noteworthy recommendation from the survey findings was the importance of providing scaffolding and support throughout the course. Respondents expressed appreciation for feedback from peers and instructors to improve their writing. One student noted, “When I used my peer review feedback to improve my draft.” Offering additional resources and tutorials for unfamiliar or complex concepts ensures that all students have the support they need to succeed.Moreover, breaking down larger, high-stakes assignments into smaller, manageable tasks, can reduce feelings of overwhelm, provide a sense of accomplishment, increase early feedback and promote overall success. 

Autonomy

Furthermore, offering choice and flexibility in assignments and assessments empowers students to take ownership of their learning journey. Whether it’s offering choice in topics, deliverable types, or exercise formats, providing students with agency fosters a sense of autonomy and engagement. One respondent noted, “I think choosing a project topic was the most engaging part of this week, because allowing students to research things that they are interested [in,] within some constraints is a good way to get them engaged and interested in the topics.” 

Note on Survey Administration

One final take away from the study underscores the importance of thoughtful survey administration. While weekly surveys offer robust results, participating faculty indicated that surveying students every week was too frequent.   Instead, it’s recommended to conduct surveys between one to three times throughout the course, striking a balance between gathering insights and respecting students’ time. Additionally, transparent communication about the purpose and use of student feedback is essential for fostering trust and eliciting honest responses. Students should understand that their feedback is valued and how it will be utilized to improve their learning experience in both the current term and future iterations of the course.

Conclusion

Engagement and inclusion in online education is multifaceted and ongoing. By listening to student feedback, implementing actionable recommendations, and fostering a culture of continuous improvement, educators can create transformative learning experiences that empower students to thrive in the digital age. Together, let us embark on this journey towards inclusive excellence, ensuring that every learner has the opportunity to succeed while feeling valued, supported, and empowered to reach their full potential.

References

Akyol, Z., & Garrison, D. R. (2008). The development of a community of inquiry over time in an online course: Understanding the progression and integration of social, cognitive and teaching presence. Journal of Asynchronous Learning Networks, 12(3-4), 3-22. 10.24059/olj.v12i3.72 

Gulikers, J.T.M., Bastiaens, T.J. & Kirschner, P.A. (2004). A five-dimensional framework for authentic assessment. ETR&D 52, 67–86. https://doi.org/10.1007/BF02504676 

Scott, C. (2022, November 7). Regular & Substantive Interaction in Your Online Course. Ecampus Course Development & Training Blog.https://blogs.oregonstate.edu/inspire/2022/11/07/regular-substantive-interaction-in-your-online-course/ 

Watté, K. (2017, January 27). Alignment. Ecampus Course Development & Training Blog.   https://blogs.oregonstate.edu/inspire/2017/01/27/alignment/  


This image is part of the Transformation Projects at the Ars Electronica Kepler's Garden at the JUK. The installation AI Truth Machine deals with the chances and challenges of finding truth through a machine.

All the buzz recently has been about Generative AI, and for good reason. These new tools are reshaping the way we learn and work. Within the many conversations about Artificial Intelligence in Higher Ed a common thread has been appearing regarding the other AI–Academic Integrity. Creating and maintaining academic integrity in online courses is a crucial part of quality online education. It ensures that learners are held to ethical standards and encourages a fair, honest, and respectful learning environment. Here are some strategies to promote academic integrity and foster a culture of ethical behavior throughout your online courses, even in the age of generative AI.

Create an Academic Integrity Plan

Having a clear academic integrity plan is essential for any course. Create an instructor-only page within your course that details a clear strategy for maintaining academic integrity. This plan might include a schedule for revising exam question banks to prevent cheating, as well as specific measures to detect and address academic dishonesty (plagiarism or proctoring software). In this guide, make note of other assignments or places in the course where academic integrity is mentioned (in the syllabus and/or particular assignments), so these pages can be easily located and updated as needed. By having a plan, you can ensure a consistent approach across the course.

Exemplify Integrity Throughout the Course

It is important to weave academic integrity into the fabric of your course. Begin by introducing the concept in your Start Here module. Provide an overview of what integrity means in your course, including specific examples of acceptable and unacceptable behavior. This sets the tone for the rest of the course and establishes clear expectations. On this page, you might:

  • Offer resources and educational materials on academic integrity for learners, such as guides on proper citation and paraphrasing.
  • Include definitions of academic dishonesty, such as plagiarism, cheating, and falsification.
  • Provide guidance on how learners might use generative AI within the class, including what is and is not considered acceptable.
  • Add scenarios or case studies that allow learners to discuss and understand academic integrity issues, specifically related to the use of generative AI.
  • Connect academic integrity with ethical behavior in the larger field.
  • Provide a place for learners to reflect on what it means for them to participate in the course in a way that maximizes their learning while maintaining academic integrity.

Throughout the course, continue to reinforce these ideas. Reminders about academic integrity can be integrated into various lessons and modules. By articulating the integrity expectations at the activity and assignment level, you provide learners with a deeper understanding of how these principles apply to their work. 

Set Clear Expectations for Assignments

When designing assignments, it is important to be explicit about your expectations for academic integrity. Outline what learners should and should not do when completing the task. For instance, if you do not want them to collaborate on a particular assignment, state that clearly. Provide examples and resources to guide learners on how to properly cite sources or avoid plagiarism. Be specific with your expectations and share why you have specific policies in place. For instance, if you want to discourage the use of generative AI in particular assignments, call out the ways it can and cannot be used. As an example, you might tell learners they can use generative AI to help form an outline or check their grammar in their finished assignment, but not to generate the body text. Share the purpose behind the policy, in this case it might be something about how a writing assignment is their opportunity to synthesize their learning and cement specific course concepts. This kind of transparency shows respect for the tools and the learning process, while also clearly outlining for learners what is acceptable.

Encourage Conversations About Integrity

Creating opportunities for learners to engage in discussions about academic integrity can help solidify these concepts in their minds. You can incorporate forums or discussion boards where learners can share their thoughts and experiences related to integrity. This also gives them a chance to ask questions and seek clarification on any concerns they may have. Encourage open dialogue between instructors and learners regarding academic integrity and any related concerns. These conversations can also extend beyond the classroom, exploring how integrity applies in your field or career paths. By connecting academic integrity to real-world scenarios, you help learners understand its relevance and importance in their professional lives.

Foster a Supportive Learning Environment

A supportive learning environment can help reinforce academic integrity by making learners feel comfortable asking questions and seeking guidance. Offer resources like definitions, guides, or access to mentors who can provide additional support. When learners know they have access to help, they are more likely to adhere to integrity standards. With generative AI in the learning landscape, we will inevitably encounter more “gray areas” in academic integrity. Be honest with your learners about your concerns and your hopes. Being open to conversations can only enhance the learning experience and the integrity in your courses.

We all play a role in cultivating a culture of academic integrity in online courses. By documenting a clear plan, weaving integrity into the course content, setting clear expectations, encouraging conversations, and providing support, you can create an environment where honesty and ethical behavior are valued and upheld. This not only benefits learners during their academic journey but also helps them develop skills and values that will serve them well in their future careers.

A few years ago, I was taking a Statistics class that was dreaded by most students in my graduate program. Upon starting, I discovered with pleasure that the instructor had introduced a new textbook, called An Adventure in Statistics: The Reality Enigma by Andy Field. The book followed a story-telling format and featured an outlandish science-fiction type plot, humor, colorful graphics, and comic-book snippets.

The merits of storytelling have been widely discussed, and that’s not what I want to talk about here. Rather, I’d like to highlight a specific element that I believe made a great contribution to the book’s instructional value: most of the content is presented through the dialogue between the main character, Zach, who needs to learn statistics, and various mentors, in particular one professor-turned-cat. The mentors guide Zach through his learning journey by explaining concepts, answering his queries, and challenging him with thought-provoking points. This makes the content more approachable and easier to understand as we, the students, struggle, ask questions, and learn together with Zach.

I believe that using dialogues—in particular of the student-tutor type—instead of monologues in instructional materials is an underutilized method of making difficult concepts more accessible. It is not a topic that has been researched much, but I did encounter a few interesting references.

One term that is often used to refer to this type of learning—by observing others learn—is “vicarious learning”. It was introduced in the 1960’s by Bandura, who showed that learning can happen through observing others’ behavior. Later, it was also used to talk about learning through the experiences of others or through storytelling (Roberts, 2010).

I was interested specifically in the effectiveness of student-tutor dialogue, which is a type of vicarious learning, and I found two articles that presented research on this topic.

Muller, Sharma, Eklund, and Reiman (2007) used instructional videos on quantum mechanics topics for second year physics students. In one condition, the video was a regular presentation of the material. In the other, the video was a semi-authentic dialogue between a student and a tutor, and incorporated alternative conceptions that physics students might hold, in combination with Socratic dialogue. The authors found significantly better outcomes on the post-test for the dialogue treatment.

Chi, Kang, and Yaghmourian (2017) conducted two studies that also featured physics concepts. They compared the effects of student-tutor dialogue videos versus lecture-style monologue videos, using the same tutors and the same supporting multimedia presentations. They, too, found increased learning for the students who watched the dialogue videos. They also found that students who watched the dialogue videos seemed to engage more in solving problems, generating substantive comments, and interacting constructively with their peers. The researchers offered some possible explanations for why this was the case: the incorrect statements and questions of the tutee triggered a more active engagement; tutees can serve as a model of learning; tutees make errors which are followed by tutor feedback – what they call “conflict episodes” that may motivate students to try harder.

Creating tutorial dialogue videos is time consuming and more difficult than making regular lectures. So, it is certainly not practical to use them on a large scale. However, it may be worth considering them for those areas where students struggle a lot.

Let us know if you’ve tried vicarious learning in any shape or form!

References:

Bandura A, Ross D, Ross S (1963) Vicarious reinforcement and imitative learning. Journal of Abnormal and Social Psychology 67(6): 601–607.

Chi, M. T., Kang, S., & Yaghmourian, D. L. (2017). Why students learn more from dialogue- than monologue-videos: Analyses of peer interactions. Journal of the Learning Sciences, 26(1), 10-50.

Muller, D. A., Sharma, M. D., Eklund, J., & Reimann, P. (2007). Conceptual change through vicarious learning in an authentic physics setting. Instructional Science, 35(6), 519–533. http://www.jstor.org/stable/41953754

Roberts, D. (2010). Vicarious learning: A review of the literature. Nurse Education in Practice, 10(1), 13-16.

I was recently reminded of a conference keynote that I attended a few years ago, and the beginning of an academic term seems like an appropriate time to revisit it on this blog.

In 2019, Dan Heath, a bestselling author and senior fellow at Duke University’s CASE Center, gave a presentation at InstructureCon, a conference for Canvas users, where he talked about how memories are formed. He explained that memories are composed of moments. Moments, according to Heath, are “mostly forgettable and occasionally remarkable.” To illustrate, most of what I’ve done today–dropping my kids off at spring break camp, replying to emails, going to a lunchtime yoga class, and writing this blog post–will largely be forgotten by next month. There is nothing remarkable about today. Unremarkable is often a desirable state because it means that an experience occurred without any hiccups or challenges.

Heath went on to describe what it is that makes great experiences memorable. His answer: Great experiences consist of “peaks,” and peaks consist of at least one of the following elements: elevation, insight, pride, or connection. He argued that we need to create more academic peaks in education. Creating peaks, he contends, will lead to more memorable learning experiences.

So, how do we create these peaks that will lead to memorable experiences? Let’s explore some ideas through the four approaches outlined by Heath.

Elevation. Elevation refers to moments that bring us joy and make us feel good. You might bring this element into your course by directly asking students to share what is bringing them joy, perhaps as an icebreaker. Sharing their experiences might also lead to connection, which is another way (see below) to create peaks that lead to memorable experiences. 

Insight. Insight occurs when new knowledge allows us to see something differently. Moments of insight are often sparked by reflection. You might consider making space for reflection in your courses. Creativity is another way to spark new insights. How might students engage with course concepts in new, creative ways? To list off a few ideas, perhaps students can create a meme, record a podcast, engage in a role play, or write a poem.

Pride. People often feel a sense of pride when their accomplishments are celebrated. To spark feelings of accomplishment in your students, I encourage you to go beyond offering positive feedback and consider sharing particularly strong examples of student work with the class (after getting permission–of course!) Showcasing the hard work of students can help students to feel proud of their efforts and may even lead to moments of joyful elevation.

Connection. Connection refers to our ties with other people. Experiencing connection with others can feel deeply rewarding. As I mentioned above, asking students to share their experiences with peers is one way to foster connection. In Ecampus courses, we aim to foster student-student and student-teacher connection, but I encourage you to explore other opportunities for students to make meaningful connections. Perhaps students can get involved with their communities or with colleagues, if they happen to have a job outside of classes. Students could connect with their academic advisors or the writing center to support their work in a course. There are many ways to foster connections that support students in their learning!

It’s easy to focus on delivering content, especially in online courses. This was one of Heath’s overarching points. The key, however, to creating memorable learning experiences is to take a student-centered approach to designing and facilitating your course. 

I invite you to start the term off by asking yourself: How can I create more moments of elevation, insight, pride, and connection for my students? It might be easier than you think.

References:

Heath, D. (2019, July 10). Keynote. InstructureCon. Long Beach, CA.

Seems like an easy question to answer, right? I might not give it a second thought.

Yet, as an online course developer, I sometimes find myself in conversations with co-developers where I realize I’ve been working under a different assumption about what a lecture is. And that’s fine, I kind of like having my preconceptions challenged. I wanted to share a little of that experience.

Our media development team has one of the stricter definitions of lecture, a specific kind of video recording. They have to, they are handling hundreds of videos every term. It’s essential for them to be able to sort media into the most efficient pipeline. Makes sense.

However, when I am working with subject matter experts, instructors, co-developers, etc. … I have found it useful to stay more flexible regarding many definitions. Sometimes errors in assumptions can open a door for discourse. It has certainly been a creative challenge. As an example, I’ll reminisce a little about a couple of my favorite mistaken assumptions about lectures. Ah yes, I remember it like it happened just this last Fall ….

I helped develop an upper-division online course centered on technology for educators. My first mistaken assumption was going in all ready to talk about video lecturing. The instructor on this co-development was a podcaster and wanted to deliver lectures in that format. I’ve had other instructors who preferred podcast lectures, no worries there. Some instructors see podcasts as a more portable kind of lecture or an alternative way to access the content. Students can listen to lectures on the go or download the lecture for offline listening. We just had to make sure to include transcripts for accessibility instead of captioning.

Also, I got to design the following playback interfaces to make them look more ‘podcasty’.

As you’ve probably guessed, there was a second mistaken assumption on my part. I was thinking the podcasts were the lectures. The podcasts are pieces of a larger “discourse given before an audience or class especially for instruction”. (Miriam-Webster: lecture and discourse). For our course, this discourse might be composed of multiple media element types.

The instructor wanted each ‘lecture’ to be a curated collection of learning elements focusing on specific topics; podcasts, video, reading, even Padlet posts. Part of the pedagogy here is to immerse them, as students, in a variety of technologies in the lectures that they may be using as educators. Together, we collaborated to find the most effective way to present all of this material as discrete lectures. Below is what we came up with. Would you still consider these lectures?

Interestingly, I don’t think we’ve quite strayed far from the Merriam-Webster definitions:

  • lecture: A discourse given before an audience or class especially for instruction
  • discourse: Formal and orderly and usually extended expression of thought on a subject. Connected speech or writing

While the course did include some interactive learning elements, these were not incorporated into lectures. It’s an interesting thought though.

  • How would you incorporate interactive exercises into lectures?
  • Does that still work within the definitions given above?

Maybe we can stretch the definition a little more. (Hmm. Perhaps in another blog post)

My takeaway here is that a lecture doesn’t have to be something given before a live class, or a simple narrated PowerPoint video online. As a course developer, my goal is to support my co-developer’s vision. But I am also serving the learning needs of students. As an online course developer, I have more flexibility about what a lecture can be. It makes sense to be open to more possibilities. I look forward to having more of these conversations with co-developers.

Stay flexible. Keep learning.