In the ever-evolving landscape of higher education, online, distance learning has emerged as a dynamic and accessible platform for students worldwide. However, with this shift to asynchronous online classrooms we must prioritize inclusivity and engagement in our educational strategies. Recognizing this need, Ecampus embarked on a journey to understand inclusive course design and teaching practices through the eyes of the learners.

Survey Summary 

In 2021, Ecampus implemented an Inclusive Excellence Strategic Plan. One goal of this plan focused on enhancing inclusive teaching and learning in online courses. As part of this initiative, a pilot study was conducted during the academic year 2022-2023, to develop a mechanism for students to provide feedback on their learning experiences. The study employed a series of weekly surveys, designed to elicit responses regarding moments of engagement and distancing within online courses.

Administered across five Ecampus courses, the pilot study garnered responses from 163 enrolled students. The findings provide invaluable insights into the nuances of online learning design and offer actionable recommendations for educators seeking to cultivate inclusive excellence in their own asynchronous, online classrooms. The questions were as follows:

  1. At what moment (point) in class this week were you most engaged as a learner?
  2. At what moment (point) in class this week were you most distanced as a learner?
  3. What else about your experience as a learner this week would you like to share?

These questions were carefully crafted to elicit responses related to diversity, equity, and inclusion (DEI). By using the verbs “engaged” and “distanced,” students were prompted to reflect on moments of connection and disconnection within their learning environments. The open-ended nature of the questions allowed students to provide contextual feedback, offering valuable insights beyond the scope of predefined categories.

The results of the survey provide a multifaceted understanding of students’ experiences in online courses. Across all five courses, certain patterns emerged regarding elements that students found most engaging and most distancing. These insights served as a springboard for the development of actionable recommendations aimed at enhancing course design and fostering inclusive learning environments.

Alignment

One crucial area highlighted by the survey results was the importance of alignment. Students noticed when their courses had assessments that were aligned with course content, and they noticed when this alignment was missing. Ensuring that learning objectives are represented in instructional materials, practice activities, assessments, and evaluation criteria is key. For more on this, please see “Alignment” by Karen Watté from 2017.

Learning Materials

Another prominent theme in the survey responses was the overwhelming nature of long, uncurated lists of readings and learning materials, which tended to alienate learners. To address this, providing a reading guide or highlighting key points can alleviate feelings of overwhelm. Optimizing content presentation and learning activities emerged as a key factor in promoting engagement and inclusivity. 

Incorporating interactive elements such as knowledge checks and practice activities within or between short lectures keeps students actively engaged and reinforces learning objectives. By utilizing multiple modes of content delivery–videos, lectures, and readings–educators can cater to diverse learning styles and preferences. Providing study guides is also noted as an effective strategy for enhancing comprehension and engagement with learning materials. 

Community & Connection

Supporting student-to-student interaction is pivotal in fostering a sense of community and participation (Akyol & Garrison, 2008). Many learners noted that they enjoyed engaging in small group discussions, in fact 50% of students in one course noted that the week 1 introductory discussion was the point they felt most engaged. Additionally, students across the courses were excited to view and respond to the creative work of their peers. Community-building course elements like these foster a sense of community and collaboration within the virtual classroom. 

While some students had mixed feelings about peer review activities–voicing concerns about feeling unqualified to judge their peer’s work–distinct guidelines and rubrics can empower learners to develop critical thinking, increase ownership, and enhance their communication skills. Thus, thoughtfully crafted peer review processes can also help to enhance the educational experience.

Authentic Activities

Incorporating authentic or experiential learning activities was also highlighted in student responses as a means of connecting course content to real-world scenarios. By integrating professional case studies, practical exercises, real-world applications, and reflective activities, educators can deepen students’ understanding of course material. Survey respondents noted again, and again how they felt engaged when coursework was relevant and applicable outside the classroom. This type of authentic work in courses can also increase learner motivation. (Gulikers, Bastiaens, & Kirschner, 2004)

Timely Feedback & RSI

By offering timely feedback on student work, online educators demonstrate their active presence and assist students in understanding the critical aspects of assessments, ultimately enhancing their chances of success. One student is quoted as saying,

“I really appreciate the involvement of the instructor. In the past I’ve had Ecampus classes where the teacher was doing the bare minimum and didn’t grade things until the last minute so I wasn’t even sure how I was doing in the class until it was almost over. I appreciate the speed at which things have been graded and the feedback I’ve already received. I appreciate the care put into announcements too!”

Timely feedback and time-bound announcements are also notable ways to showcase Regular and Substantive Interaction (RSI). Please also see “Regular & Substantive Interaction in Your Online Course” by Christine Scott.

Scaffolding

Another noteworthy recommendation from the survey findings was the importance of providing scaffolding and support throughout the course. Respondents expressed appreciation for feedback from peers and instructors to improve their writing. One student noted, “When I used my peer review feedback to improve my draft.” Offering additional resources and tutorials for unfamiliar or complex concepts ensures that all students have the support they need to succeed.Moreover, breaking down larger, high-stakes assignments into smaller, manageable tasks, can reduce feelings of overwhelm, provide a sense of accomplishment, increase early feedback and promote overall success. 

Autonomy

Furthermore, offering choice and flexibility in assignments and assessments empowers students to take ownership of their learning journey. Whether it’s offering choice in topics, deliverable types, or exercise formats, providing students with agency fosters a sense of autonomy and engagement. One respondent noted, “I think choosing a project topic was the most engaging part of this week, because allowing students to research things that they are interested [in,] within some constraints is a good way to get them engaged and interested in the topics.” 

Note on Survey Administration

One final take away from the study underscores the importance of thoughtful survey administration. While weekly surveys offer robust results, participating faculty indicated that surveying students every week was too frequent.   Instead, it’s recommended to conduct surveys between one to three times throughout the course, striking a balance between gathering insights and respecting students’ time. Additionally, transparent communication about the purpose and use of student feedback is essential for fostering trust and eliciting honest responses. Students should understand that their feedback is valued and how it will be utilized to improve their learning experience in both the current term and future iterations of the course.

Conclusion

Engagement and inclusion in online education is multifaceted and ongoing. By listening to student feedback, implementing actionable recommendations, and fostering a culture of continuous improvement, educators can create transformative learning experiences that empower students to thrive in the digital age. Together, let us embark on this journey towards inclusive excellence, ensuring that every learner has the opportunity to succeed while feeling valued, supported, and empowered to reach their full potential.

References

Akyol, Z., & Garrison, D. R. (2008). The development of a community of inquiry over time in an online course: Understanding the progression and integration of social, cognitive and teaching presence. Journal of Asynchronous Learning Networks, 12(3-4), 3-22. 10.24059/olj.v12i3.72 

Gulikers, J.T.M., Bastiaens, T.J. & Kirschner, P.A. (2004). A five-dimensional framework for authentic assessment. ETR&D 52, 67–86. https://doi.org/10.1007/BF02504676 

Scott, C. (2022, November 7). Regular & Substantive Interaction in Your Online Course. Ecampus Course Development & Training Blog.https://blogs.oregonstate.edu/inspire/2022/11/07/regular-substantive-interaction-in-your-online-course/ 

Watté, K. (2017, January 27). Alignment. Ecampus Course Development & Training Blog.   https://blogs.oregonstate.edu/inspire/2017/01/27/alignment/  


I was recently reminded of a conference keynote that I attended a few years ago, and the beginning of an academic term seems like an appropriate time to revisit it on this blog.

In 2019, Dan Heath, a bestselling author and senior fellow at Duke University’s CASE Center, gave a presentation at InstructureCon, a conference for Canvas users, where he talked about how memories are formed. He explained that memories are composed of moments. Moments, according to Heath, are “mostly forgettable and occasionally remarkable.” To illustrate, most of what I’ve done today–dropping my kids off at spring break camp, replying to emails, going to a lunchtime yoga class, and writing this blog post–will largely be forgotten by next month. There is nothing remarkable about today. Unremarkable is often a desirable state because it means that an experience occurred without any hiccups or challenges.

Heath went on to describe what it is that makes great experiences memorable. His answer: Great experiences consist of “peaks,” and peaks consist of at least one of the following elements: elevation, insight, pride, or connection. He argued that we need to create more academic peaks in education. Creating peaks, he contends, will lead to more memorable learning experiences.

So, how do we create these peaks that will lead to memorable experiences? Let’s explore some ideas through the four approaches outlined by Heath.

Elevation. Elevation refers to moments that bring us joy and make us feel good. You might bring this element into your course by directly asking students to share what is bringing them joy, perhaps as an icebreaker. Sharing their experiences might also lead to connection, which is another way (see below) to create peaks that lead to memorable experiences. 

Insight. Insight occurs when new knowledge allows us to see something differently. Moments of insight are often sparked by reflection. You might consider making space for reflection in your courses. Creativity is another way to spark new insights. How might students engage with course concepts in new, creative ways? To list off a few ideas, perhaps students can create a meme, record a podcast, engage in a role play, or write a poem.

Pride. People often feel a sense of pride when their accomplishments are celebrated. To spark feelings of accomplishment in your students, I encourage you to go beyond offering positive feedback and consider sharing particularly strong examples of student work with the class (after getting permission–of course!) Showcasing the hard work of students can help students to feel proud of their efforts and may even lead to moments of joyful elevation.

Connection. Connection refers to our ties with other people. Experiencing connection with others can feel deeply rewarding. As I mentioned above, asking students to share their experiences with peers is one way to foster connection. In Ecampus courses, we aim to foster student-student and student-teacher connection, but I encourage you to explore other opportunities for students to make meaningful connections. Perhaps students can get involved with their communities or with colleagues, if they happen to have a job outside of classes. Students could connect with their academic advisors or the writing center to support their work in a course. There are many ways to foster connections that support students in their learning!

It’s easy to focus on delivering content, especially in online courses. This was one of Heath’s overarching points. The key, however, to creating memorable learning experiences is to take a student-centered approach to designing and facilitating your course. 

I invite you to start the term off by asking yourself: How can I create more moments of elevation, insight, pride, and connection for my students? It might be easier than you think.

References:

Heath, D. (2019, July 10). Keynote. InstructureCon. Long Beach, CA.

There are many benefits to using rubrics for both instructors and students, as discussed in Rubrics Markers of Quality Part 1 – Unlock the Benefits. Effective rubrics serve as a tool to foster excellence in teaching and learning, so let’s take a look at some best practices and tips to get you started.

Best Practices

Alignment

Rubrics should articulate a clear connection between how students demonstrate learning and the (CLO) Course Learning Outcomes. Solely scoring gateway criteria, the minimum expectations for a task, (e.g., word count, number of discussion responses) can be alluring. Consider a rubric design to move past minimum expectations and assess what students should be able to do after completing a task.

Detailed, Measurable, and Observable

Clear and specific rubrics have the potential to communicate to how to demonstrate learning, how performance evaluation measures, and markers of excellence. The details provide students with a tool to self-assess their progress and level up their performance autonomously.

Language Use

Rubrics create the opportunity to foster an inclusive learning environment. Application of clear and consistent language takes into consideration a diverse student composition. Online students hail from around the world and speak various native languages. Learners may interpret the meaning of different words differently. Use simple terms with specific and detailed descriptions. Doing so creates space for students to focus on learning instead of decoding expectations. Additionally, consider the application of parallel language consistently. The use of similar language (e.g. demonstrates, mostly demonstrates, and doesn’t demonstrate) across each criterion can be helpful to differentiate between each performance level.

Tips of the Trade!

Suitability

Consider the instructional aim, learning outcomes, and the purpose of a task when choosing the best rubric for your course.

  • Analytic Rubrics: The hallmark design of an analytic rubric evaluates performance criteria separately. Characteristically this rubric’s structure is a grid, and evaluation of performance scores are on a continuum of levels. Analytic rubrics are detailed, specific, measurable, and observable. Therefore, this rubric type is an excellent tool for formative feedback and assessment of learning outcomes.
  • Holistic Rubrics: Holistic rubrics evaluate criteria together in one general description for each performance level. Ideally, this rubric design evaluates the overall quality of a task.  Consider the application of a holistic rubric can when an exact answer isn’t needed, when deviation or errors are allowed, and for interpretive/exploratory activities.
  • General Rubrics: Generalized rubrics can be leveraged to assess multiple tasks that have the same learning outcomes (e.g., reflection paper, journal). Performance dimensions focus solely on outcomes versus discrete task features.

Explicit Expectations

Demystifying expectations can be challenging.  Consider articulating performance expectations in the task description before deploying a learning task. Refrain from using rubrics as a standalone vehicle to communicate expectations. Unfortunately, students may miss the rubric all together and fail to meet expectations. Secondly, make the implicit explicit! Be transparent. Provide students with all the information and tools they need to be successful from the outset.

Iterate

A continuous improvement process is a key to developing high-quality assessment rubrics. Consider multiple tests and revisions of the rubric. There are several strategies for testing a rubric. 1) Consider asking students, teaching assistants, or professional colleagues to score a range of work samples with a rubric. 2) Integrate opportunities for students to conduct self-assessments. 3) Consider assessing a task with the same rubric between course sections and academic terms. Reflect on how effectively and accurately the rubric performed, after testing is complete. Revise and redeploy as needed.

Customize

Save some time, and don’t reinvent the wheel. Leverage existing samples and templates. Keep in mind that existing resources weren’t designed with your course in mind. Customization will be needed to ensure the accuracy and effectiveness of the rubric.

Are you interested in learning more about rubrics and how they can enrich your course? Your Instructional Designer can help you craft effective rubrics that will be the best fit for your unique course.

References

Additional Resources

The Basics
Best Practices
Creating and Designing Rubrics

Would you like to save time grading, accurately assess student learning, provide timely feedback, track student progress, demonstrate teaching and learning excellence, foster communication, and much more? If you answered yes, then rubrics are for you! Let’s explore why the intentional use of rubrics can be a valuable tool for instructors and students.

Value for instructors

  • Time management: Have you ever found yourself drowning in a sea of student assignments that need to be graded ASAP (like last week)?  Grading with a rubric can quicken the process because each student is graded in the same way using the same criteria. Rubrics which are detailed, specific, organized and measurable clearly communicate expectations. As you become familiar with how students are commonly responding to an assessment, feedback can be easily personalized and readily deployed.
  • Timely and meaningful feedback: Research has shown that there are several factors that enhance student motivation. One factor is obtaining feedback that is shared often, detailed, timely, and useful. When students receive relevant, meaningful, and useful feedback quickly they have an opportunity to self-assess their progress, course correct (if necessary), and level up their performance.
  • Data! Data! Data! Not only can rubrics provide a panoramic view of student progress, but the tool can also help identify teaching and learning gaps. Instructors will be able to identify if students are improving, struggling, remaining consistent, or if they are missing the mark completely. The information gleaned from rubrics can be utilized to compare student performance within a course, between course sections, or even across time. As well as, the information can serve as feedback to the instructor regarding the effectiveness of the assessment.
  • Effectiveness: When a rubric is designed from the outset to measure the course learning outcomes the rubric can serve as a tool for effective, and accurate, assessment. Tip! Refrain from solely scoring gateway criteria (i.e. organization, mechanics, and grammar). Doing so is paramount because students will interpret meeting the criteria as a demonstration that they have met the learning outcomes even if they haven’t. If learning gaps are consistently identified consider evaluating the task and rubric to ensure instructions, expectations, and performance dimensions are clear and aligned.
  • Shareable: As academic programs begin to develop courses for various modalities (i.e. on campus, hybrid, online) consistently assessing student learning can be a challenge. The advantage of rubrics is they can be easily shared and applied between course sections and modalities. Doing so can be especially valuable when the same course is taught by multiple instructors and teaching assistants.
  • Fosters communication: Instructors can clearly articulate performance expectations and outcomes to key stakeholders such as teaching assistants, instructors, academic programs, and student service representatives (e.g. Ecampus Student Success Team, Writing Center). Rubrics provide additional context above and beyond what is outlined in the course syllabus. A rubric can communicate how students will be assessed, what students should attend to, and how institutional representatives can best help support students. Imagine a scenario where student contacts the Writing Center with the intent of reviewing a draft term paper, and the representative asks for the grading criteria or rubric. The grading criteria furnished by the instructor only outlines the requirements for word length, formatting, and citation conventions. None of the aforementioned criteria communicate the learning outcomes or make any reference to the quality of the work. In this example, the representative might find it challenging to effectively support the student without understanding the instructor’s implicit expectations.
  • Justification: Have you ever been tasked with justifying a contested grade? Rubrics can help you through the process! Rubrics which are detailed, specific, measurable, complete, and aligned can be used to explain why a grade was awarded. A rubric can quickly and accurately highlight where a student failed to meet specific performance dimensions and/ or the learning outcomes.
  • Evidence of teaching improvement: The values of continuous improvement, lifelong learning, and ongoing professional development are woven into the very fabric of academia. Curating effective assessment tools and methods can provide a means of demonstrating performance and providing evidence to support professional advancement.

Value for students

  • Equity: Using rubrics creates an opportunity for consistent and fair grading for all students. Each student is assessed on the same criteria and in the same way. If performance criteria are not clearly communicated from the outset then evaluations may be based on implicit expectations. Implicit expectations are not known or understood by students, and it can create an unfair assessment structure.
  • Clarity: Ambiguity is decreased by using student-centered language. Student composition is highly diverse, and many students speak different native languages. Therefore, students may have different interpretations as to what words mean (e.g. critical thinking). Using very clear and simplistic language can mitigate unintended barriers and decrease confusion.
  • Expectations: Students know exactly what they need to do to demonstrate learning, what instructors are looking for, how to meet the instructor’s expectations, and how to level up their performance. A challenge can be to ensure that all expectations (implicit and explicit) are clearly communicated to students. Tip! Consider explaining expectations in the description of the task as well.
  • Skill development: Rubrics can introduce new concepts/ terminology and help students develop authentic skills (e.g. critical thinking) which can be applied outside of their academic life.
  • Promotes metacognition and self-regulatory behavior: Guidance and feedback help students reflect on their thought processes, self-assess, and foster positive learning behaviors.

As an Ecampus course developer, you have a wide array of support services and experts available to you. Are you interested in learning more about rubric design, development, and implementation? Contact your Instructional Designer today to begin exploring best-fit options for your course. Stay tuned for Rubrics: Markers of Quality (Part 2) –Tips & Best Practices.

References:

  • Brookhart, S. M. (2013). How to create and use rubrics for formative assessment and grading. Alexandria, Va.: ASCD.
  • Richter, D., & Ehlers, Ulf-Daniel. (2013). Open Learning Cultures: A Guide to Quality, Evaluation, and Assessment for Future Learning. (1st ed.). Berlin, Heidelberg: Springer.
  • Stevens, D. D., & Levi, Antonia. (2013). Introduction to rubrics: an assessment tool to save grading time, convey effective feedback, and promote student learning (2nd ed.). Sterling, Va.: Stylus.
  • Walvoord, B. E. F., & Anderson, Virginia Johnson. (2010). Effective grading: a tool for learning and assessment in college (Second edition.). San Francisco, CA: Jossey-Bass.