I was recently assigned to be the Instructional Designer for an introductory programming course here at OSU. While working with the instructor, I was happy to see his inventiveness in assessment design. As one example, the instructor created an assignment to introduce loops, a block of code in a computer program that repeats while a condition is true. Here’s how he described the assignment to the students:

Your assignment is to simulate the progression of a zombie epidemic as it spreads through Portland, Oregon, beginning in the year 2001 (which was about the time that zombies became unnervingly popular). This assignment will test whether you can use loops when translating from a problem to a computational solution.
(Scaffidi, 2019)

I was excited about the design possibilities this introduced to a usually dry topic. Zombies! I built the page in our LMS, Canvas, and was excited to review it with him.

“Isn’t this fun?” I asked, showing him the assignment page I had created:

Zombie epidemic programming assignment introduction

“I guess so,” he said, “is there any research to indicate that decorative graphics support learning?” he asked me. I guess that’s fair to ask, even if it was a bit of a buzzkill.

I had no idea if including cool pictures was a research-based best practice in online course design. While I really wanted it to be true and felt like it should be true, I could not immediately cite peer-reviewed studies that supported the use of zombie images to improve learner engagement; I had never seen such research. But, I was determined to look before our next meeting.

The instructor’s research challenge led me to discover Research Rabbit. Research Rabbit is a relatively new online platform that helps users find academic research. Research Rabbit has users organize found research into collections. As articles are added to a collection, Research Rabbit helps identify related research.

Without realizing how much time I was exploring, four hours quickly passed in which I was wholly engrossed in the search to justify including a zombie picture in one assignment for one instructor. Below, I will share a few of the features that enamored me with Research Rabbit and why I continue to use it regularly.

Why I love Research Rabbit

Visualization of Search Results

Rather than combing through reference lists at the bottom of a paper, you can quickly view any works cited by a paper you have selected or change views and get a list of articles that have cited the selected document. Those results are presented in a list view, a network view, or on a timeline.

A Tool for Discovery

Research Rabbit starts generating suggested additions as soon as you add a paper to a collection. The more papers you add, the more accurate these recommendations become. It works somewhat like personalized Netflix or Spotify recommendations (ResearchRabbit, n.d.), helping you discover research you may not have been aware of in this same area of study.

Using their discovery functionality, you can identify clusters of researchers (those that have published together or frequently cite each other’s work). You can also use the “Earlier Work” option to see when research on a particular topic may have started and identify foundational papers in the field. Looking for “Later Work” helps you find the latest research and stay current on your research topic.

Free Forever

The Research Rabbit founders explain their reasoning for keeping their tool Free Forever as follows:

Why? It’s simple, really.
Researchers commit years of time, energy, and more to advance human knowledge. Our job is to help you discover work that is relevant, not to sell your work back to you.
(Research Rabbit FAQ)

Research Rabbit Syncs Collections to Zotero

I would have lost a lot of enthusiasm for Research Rabbit if I had to manually add each new paper to my Zotero collection. But Research Rabbit integrates with Zotero, and automatically syncs any designated collections. If you use a different reference tool, you can also export Research Rabbit collections in common bibliographic formats.

A Tool for Sharing and Collaboration

Once you have created a collection, you can invite other researchers to view or edit a collection based on the permissions you set. Collaborators can also add comments to individual items. Research Rabbit also gives you an opportunity to create public collections that can be shared with a custom link.

How to Explore Research Rabbit on Your Own

The feature set of Research Rabbit is beautifully demoed on the Research Rabbit website. From there, you can explore how to visualize papers, discover author networks, and start building collections. There is also a growing list of introductory and instructional videos by the academic community online.

So What Happened with the Zombies?

You can review some of the research yourself by checking out my Research Rabbit Collection of Articles on Visual Design in Online Learning. Much to my delight, after conducting my (4-hour) search, I did find some research-based evidence that aesthetics improved engagement and recall (Deanna Grant-Smith et al., 2019). Many of the studies, however, also suggested that visuals in online courses should also have some instructional function and help communicate ideas to avoid cognitive overload (Rademacher, 2019).

Maybe next time, I’ll suggest embedding this:

A flowchart of a conditional loop feature Zombie images. — Zombie Images by Freepik

References

Deanna Grant-Smith, Timothy Donnet, James Macaulay, Renee Chapman, & Renee Anne Chapman. (2019). Principles and practices for enhanced visual design in virtual learning environments: Do looks matter in student engagement? https://doi.org/10.4018/978-1-5225-5769-2.ch005

Rademacher, C. (2019, May 13). Value of Images in Online Learning. Ecampus Course Development & Training. http://blogs.oregonstate.edu/inspire/2019/05/13/the-value-of-images-in-online-learning/

Research Rabbit FAQ. (n.d.). [Online tool]. Research Rabbit. Retrieved October 3, 2022, from https://researchrabbit.notion.site/Welcome-to-the-FAQ-c33b4a61e453431482015e27e8af40d5

ResearchRabbit. (n.d.). ResearchRabbit. Retrieved October 4, 2022, from https://www.researchrabbit.ai

Scaffidi, C. (2019). CS 201: Computer Programming for Non-CS Majors.

In my last post, I wrote about how designing an ‘open course‘ empowers others to make desired edits more easily. One major component of an open course is providing adequate and accurate documentation for your intended audience. If you were handed a course to teach or redesign, what aspects about the course would you like to know? Probably as much as possible, which would require a strong set of documentation detailing design processes and decisions, learning outcomes, tutorials for using novel course elements, and so on. If you care about having a solid set of documentation for your courses, then you may be a ‘Documentarian‘. In this post, I look into some components of good documentation design from the software field, and apply them to instructional design.

Informing the recommendations of this post are the Documentation Principles of Write the Docs, a “global community of people who care about documentation”. As described by the Write the Docs authors, their set of principles:

“seeks to define similar standards for software documentation that, when practiced, will foster clean and intuitive content”
https://www.writethedocs.org/guide/writing/docs-principles/#documentation-principles

While software is the stated primary purpose of these principles, much of it is applicable across a wider range of subjects, with aspects of instructional design (such as design and code choices) falling into similar categories.

Why is documentation important?

Every Instructional Designer will work with many different people, known as stakeholders, across every project. The stakeholders of a project fulfill different roles and have distinct requirements. Fellow Instructional Designers, eLearning Developers, Middle and Senior Managers, Subject Matter Experts, and the learners themselves are all examples of stakeholders with different needs and roles. Each of the stakeholders on any particular project will require a certain level of documentation matching their needs. Use of an external tool, for example warrants instructions for how to incorporate the tool into an LMS and its functions for designers, but also instructions on how to use the tool as a user for the learners on the course.

Perhaps some of the most important people to consider when designing a course are the ones who will inherit it later on when the original designers have moved onto other projects. Because of this inevitability, proper documentation is key to understanding how a course was designed, the original intended audience or needs analysis (in case any prerequisite courses are changed in a way that breaks the flow of this one – example: switching from one programming language to another in the classes leading up to this, resulting in it not being fit for purpose), decisions made and why they were taken, how certain features work, just to name a few.

With these reasons for well-structured documentation in mind, what should designers include in documentation? For that, Write the Docs has some advice.

General recommended documentation principles

Write the Docs breaks down “good documentation” into multiple components. The full explanation of each can be found on their Documentation Principles page. Here, I will just use the summary of each one from the page.

The components state:

Documentation should be:

Precursory: Begin documenting before you begin developing.
Participatory: In the documentation process, include everyone from developers to end users.

The content (meaning how documentation is written) should be:

Arid: Accept (some) Repetition In Documentation.
Skimmable: Structure content to help readers identify and skip over concepts which they already understand or see are not relevant to their immediate questions.
Exemplary: Include (some) examples and tutorials in content.
Consistent: Use consistent language and formatting in content.
Current: Consider incorrect documentation to be worse than missing documentation.

Sources (meaning where content creators store documentation) should be:

Nearby: Store sources as close as possible to the code which they document.
Unique: Eliminate content overlap between separate sources.

Each publication (meaning the end product that users see) should be:

Discoverable: Funnel users intuitively towards publications through all likely pathways.
Addressable: Provide addresses to readers which link directly to content at a granular level.
Cumulative: Content should be ordered to cover prerequisite concepts first.
Complete: Within each publication, cover concepts in-full, or not at all.
Beautiful: Visual style should be intentional and aesthetically pleasing.

A documentation body should be:

Comprehensive: Ensure that together, all the publications in the body of documentation can answer all questions the user is likely to have.

Documenting course designs

Taking the above principles, which were initially designed for software, as a guide, we can see how they would fit into the field of instructional design.

General ideas

The principles of documentation being precursory and participatory are simple to follow, especially if one takes on a project management role in course design. Intake meetings and early plans are the first steps to crafting course design documentation. It is at this stage that the initial course design plans are mapped out by the stakeholders on the project. This includes Designers, Faculty, Project Managers and Product Owners (if these are separate people), to name a few. The initial plans for learning outcomes, assessments, and general ideas for activities on a more granular scale can all be converted into documentation on the structure of the course. These would usually fit into a ‘Design Solution’ document that gives an overview of how higher level course decisions are put into practice, or at least intended to be, once the course is running. An ID and the rest of the course design team could revisit this documentation during an evaluative stage to see if things were still going to plan, or modify it based on feedback.

Intended learner journey

I use the phrase “learner journey” a lot, but I am not entirely sure how well known it is, nor if I am using it in a standard way. So for this instance, my meaning of “learner journey” is the following: How the course developer is expecting the learner(s) to interact with the course site. This includes things such as: what learners are expected to click on when reaching the course landing page, the order in which they are expected to complete modules, how assignments are completed, etc. There is room here for interpretation, but it does not hurt to note the intended learner interactions and progression through a course. That way, other faculty members who may be teaching the course in the future can quickly understand learner progression too. This could take the form of a more technical document for fellow instructors, and a quick video for students (or more, depending on how in-depth you wish to go in the learner-facing side of things).

As an Instructional Designer, I often take on the role of the learner sometime during a course development. I will set out a specific meeting time with a faculty member to go through how I would approach this content as a learner, and ask them if this was an intended way for the learners to interact with the content. I usually start by following the order of the module, which is usually set up in the order a learner should complete tasks. What happens, though, if a learner decides that they are just not going to bother reading the Overview page for that week (or any week) and skips right to the Assessments? Is there anything preventing the learner from completing an assignment before they know important background information? Maybe some sort of purpose statement would help (e.g. “This assignment will test your knowledge of learning materials for Week 3. You should complete this week’s background reading tasks before submitting your work.”)?

Content, or how documentation is written

Most Instructional Designers will know about how to make a page more readable by including headings, descriptive hyperlinks, and other stylized formatting like ample paragraph breaks and correctly set up list items (ordered and unordered, for example). If you can create documentation in this way, it meets the skimmable principle and helps readers quickly identify the section they are looking for. I would also recommend adding a unique ID to each distinct section of each page so readers can quickly jump to it using a navigation menu. To find out more about this, see the W3Schools HTML id Attribute page. Once these are set up, you can link anyone to a specific part of the page.

In the previous article on designing the open course, I included a section on the “Side by Side Code Block Tutorials” I use to demonstrate new and complex course elements. This aims to hit the exemplary principle, as it gives readers a quick example of how certain elements work and how to manipulate them in the future.

Video tutorials

Video tutorials are another way to give examples using a step by step process, and provide an additional level of personalization that is often missing from text-only tutorials. There are some downsides to video tutorials, however, which may influence the decision to create them.

Each of the following involve the time commitment required to create videos in the first place, and the principle of staying current.

Scripting and editing
- Usually a video tutorial, or series of videos, involves scripting what the person giving the tutorial is going to say. With written documentation, this would usually be the end of the process – but with videos, it is only step one. The written form then needs to be spoken, correctly, and edited to make sure any mistakes are removed or audio synched up with what is happening on the screen.
Editing mistakes or changes
- It advisable before creating a video tutorial to check if the procedure, process, or system is going to remain in place for long enough to make the time investment making a decent tutorial video worth it. It is a lot easier to change text-based tutorials when something changes than record another video. Additionally, videos are a more personalized version of a tutorial, and if the initial video creator moves on to another position or institution, it would no longer be possible to keep the consistency of any other videos in the documentation.

Those who write documentation with others will know about the importance of an agreed upon style guide. Using the same style of writing, formatting, and terminology across pages and writers ensures that no one section or page stands out or looks jarring in comparison to another, thus fulfilling the consistency principle.

Sources, or where content creators store documentation

For an Instructional Designer, it is not always possible to include documentation directly next to the thing it is explaining. For example, certain Learning Management Systems will remove code comments from all pages, leaving just the content. This is contrary to software development in general, where comments can be left inside code without issue. Therefore I recommend expanding the definition of ‘nearby’ when it comes to documentation for online courses to get around this potential problem.

How you, or your institution, store documentation will have a large effect on how people interact with it. Some institutions use specialized software such as the well-known Confluence by Atlassian, which allows collaboration between users. Other platforms such as Google Workspace are easier to start using for universities and colleges, which often already have Google accounts ready to go, and can be used without extra costs. A similar outcome is offered by other platforms such as a WordPress installation with multiple users creating and contributing to existing articles. Depending on the Learning Management System, it is possible to include documentation closer to the course files (such as attaching files to pages), which is recommended under the nearby principle. Using a single repository for documentation is important so that similar and identical information (such as tutorials on the same topic) are not unnecessarily duplicated (i.e. kept unique) in multiple places such as on an LMS, blog, shared docs. For example, a user of Canvas duplicating tutorial pages across courses leads to problems if part of the tutorial needs to change. This means numerous edits across multiple courses as opposed to pointing to one central location that requires edits only once.

Publications, or how someone can find what they are looking for

Continuing from the previous paragraph on Sources (where the writers store documents), the discoverability of the documentation is key. Where are faculty, designers, and support staff likely to look for help on various topics? Consider linking to the established repository where possible – rather than duplicating it across multiple sites. This will make it easier for others to find the help they require. In a previous section, I included a link to the W3Schools HTML id Attribute page. Specifically here, we are interested in the “HTML Bookmarks with ID and Links” section which tells us about how to jump to different “bookmarks” of a very long page. This is handy when you want to point someone directly to a smaller part of a more complicated and longer page. Doing this manually, however, can take a lot of time, but there are shortcuts for creating these IDs.

When writing documentation, I often use Markdown and then export to HTML. During this conversion process, the headings are automatically given a unique ID in HTML. When pointing people to this part of the documentation, I just need to append a # and the ID name of the heading to the end of the URL. This is known as making the documentation addressable, and links the reader directly to where they would be helped the most. For example, I might want you to go directly to the General recommended documentation principles section of this page, and you can do so with that previous link.

The Write the Docs authors ask the following question:

Can a reader follow your entire body of documentation, linearly, from start to finish without getting confused?

Answering “yes” to this would fulfill the requirements of being cumulative, and this is important when writing something like a tutorial for faculty from start to finish. I try to structure HTML tutorial documentation with the absolute basics first, using headings to structure the page, so that if an instructor already knows basic HTML/CSS principles, they can just skip to the sections that are important to them. If they know nothing about it, however, they should be able to start at the beginning and go through the steps in order.

Completeness of a document increases in complexity depending on what you are writing about. Rather than overpromising what will be in the documentation, state to the reader which parts are covered and stick to those. For example, if there are five assessment criteria for an essay titled Essay 1, only covering three of those in a document titled “Assessment Criteria for Essay 1, Explained” would be misleading.

The beauty of a page is subjective, but proper document structure can help enormously. Things like logical reading order of headings, use of whitespace, properly sized images with captions/alt-text go a long way to making documents more readable.

Documentation Body

The time required to make your institution’s documentation comprehensive also depends on the complexity of the systems in use. Write The Docs defines comprehensive documentation as being able to answer all the questions a user is likely to have. Instructional Designers are often connected to all aspects of the course, and can work with the various teams involved to provide the informative questions and answers required to be as comprehensive as possible for all stakeholders.

Conclusion

Creating successful documentation in the Instructional Design field starts from the inception of a project. It begins with the very first needs analysis and ends with a fully comprehensive set of publications that are easy to access by both writers and readers. It is a collaborative process and involves promotion and discoverability. but once created, it provides opportunities for learning, understanding, and importantly, modification and revisions to existing projects. For those thinking of designing an open course, or if you simply like learning more about how things work, perhaps you too are a Documentarian.

References

Chambers, P. (2022, May 23). Designing the open course: Why Instructional Designers should follow a “right to repair” plan. Ecampus Course Development & Training Inspire Blog. https://blogs.oregonstate.edu/inspire/2022/05/23/designing-the-open-course-why-instructional-designers-should-follow-a-right-to-repair-plan/.
HTML id Attribute. Retrieved from https://www.w3schools.com/htmL/html_id.asp.
Mundorff, M. (2022, April 18). An Introduction to Markdown. Ecampus Course Development & Training Inspire Blog. https://blogs.oregonstate.edu/inspire/2022/04/18/an-introduction-to-markdown/.
Write the Docs, CC BY-NC-SA 4.0.

Introduction

When I hear the word presence, I’m reminded of a teacher taking attendance at the beginning of class. I picture the teacher calling out each student’s name, the students responding either “here!” or “present!” in turn. In this scenario, though, while the students each affirm their presence, the teacher’s presence is a given. The teacher doesn’t mark herself present in the attendance record. The teacher doesn’t need to prove they taught class or prove they exist to students. As one might suspect, this is an area where online asynchronous courses differ from traditional classrooms: one’s presence is not a given. Presence becomes even more important in online settings. Perhaps that’s why we hear so much about it. Online presence. Social presence. Instructor presence. But, what do these words really mean in virtual classrooms?

There are many ways to define presence. The first entry in Merriam Webster’s online dictionary defines presence as “the fact or condition of being present.” This entry directs readers to present (adjective, entry 3 of 4), which defines present as “now existing or in progress.” There is an immediacy to these words, a temporal aspect, and a physicality: Presence. How do we reconcile the temporal and physical connotations of this term with online, asynchronous interactions?

In this digital age, I think most folks would agree that it’s possible to experience presence online, to feel that someone is real, even if they’re not standing in front of you. But, how do we define it within this context? How do we describe presence to someone who’s attempting to achieve it virtually? For myself and other instructional designers tasked with guiding faculty to design and prepare to facilitate an online course, where they’re told their ability to establish presence will directly impact student success, what advice do we offer? Simply put, how is presence communicated in an online, asynchronous course?

To begin answering these questions, I’ll provide an overview of Garrison et al.’s (2000) Community of Inquiry (CoI) framework, which defines three presences for computer-mediated communication (i.e., the communication that occurs in online courses and other digital environments). Then, we’ll briefly consider how you might think about presence in your own online courses.

Overview of Community of Inquiry (COI)

We’ll start with a brief overview of Garrison et al.’s (2000) model of Community of Inquiry (CoI). CoI is a conceptual model that identifies three presences that are essential for online classrooms. It’s worth noting, too, that this model was created to provide a framework for presence mediated through the use of digital technologies. The three presences are 1) cognitive presence, 2) social presence, and 3) teaching presence.

Cognitive presence refers to the opportunities learners have “to construct meaning through sustained communication” (Garrison et al., 2000, p. 89). This is considered a foundational element of the model and might include, for example, an instructor providing feedback to students or students engaging in peer review.

Social presence includes opportunities the instructor and students have to share personal details within the classroom environment. Social presence supports cognitive presence and plays an important role in meeting course goals that are explicitly affective (Garrison et al., 2000).

Teaching presence is divided into two functions: structure and process. The structure can be thought of as the design of the educational environment and the process is often thought of as the facilitation of the environment (Garrison et al., 2000). Although different people may be involved in each function (e.g., an instructional designer and teacher might design a course, but a different instructor and a TA might be responsible for facilitating the course), both functions play a role in teaching presence.

While we don’t have enough space here to dig into each of these presences, I highly recommend checking out the article, “Designing a community of inquiry in online courses” (Fiock, 2020), which lists many instructional activities that can be implemented to support each type of presence.

Suggestions for Moving Forward

Ultimately, you might find it hard to keep these presences straight, and that’s okay! Richardson and Lowenthal (2017) point out that academic publications don’t even use the same terms to describe various online presences. Acknowledging that there are different interpretations of presence in online contexts and different approaches for achieving presence online is the point of this post. In the future, you can always refer back here or save the resources listed below for reference later. In Ecampus, we try to emphasize instructor-student, student-student, and student-content interaction, an approach you might find easier to remember.

What I hope you take away from this post is that it’s not as important to remember the differences between each of these presences as much as it is important to include a variety of strategies in your course to communicate and establish presence. I’d also encourage you to occasionally try new approaches and to strive to communicate presence in multiple ways, without getting locked into a narrow view of presence and what it means in online classrooms.

References & Resources

Fiock, H. (2020). Designing a Community of Inquiry in online courses. The International Review of Research in Open and Distributed Learning, 21(1), 135-153. https://doi.org/10.19173/irrodl.v20i5.3985

Garrison, Anderson, T., & Archer, W. (1999). Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2), 87–105. https://doi.org/10.1016/S1096-7516(00)00016-6

Merriam-Webster. (n.d.). Presence. In Merriam-Webster.com dictionary. Retrieved July 29, 2022, from https://www.merriam-webster.com/dictionary/presence

Merriam-Webster. (n.d.). Present. In Merriam-Webster.com dictionary. Retrieved July 29, 2022, from https://www.merriam-webster.com/dictionary/present

Richardson, J. C., & Lowenthal, P. (2017). Instructor social presence: Learners’ needs and a neglected component of the community of inquiry framework. In A. Whiteside, A. Garrett Dikkers, & K. Swan, (Eds.), Social presence in online learning: Multiple perspectives on practice and research (pp. 86-98). Stylus.

Are you searching for a way to increase student-to-student interaction in your teaching? Would you thrill at the idea of more creative online discussions? This post describes a well-tested approach that supports strong inter-student interaction and avoids the typically mundane discussion activity. Best of all, this approach works effectively in multiple STEM disciplines, including mathematics, engineering, coding, and other problem-solving orientated subjects.

Creative Discussions

Since I always look for ways to make online discussions more engaging and meaningful for students, I like to share instructors’ creative and fun approaches. Several years ago, I wrote a blog post explaining how a math instructor engaged students, asking them to find examples of parabolas they were studying that week in their local environment and post pictures on the discussion board. It was a huge success and had students enthusiastically sharing their discoveries.

I’m currently working with an engineering instructor to develop a series of graduate-level online courses. The challenge is how to approach a series of homework activities. The assigned problems are difficult, so solving in small groups is beneficial. However, the instructor also wants to make sure that all students independently develop a firm grasp of the principles and processes, but without worry about right answers.

Enter the two-step problem solving approach. Here’s how it works:

First, students review a complex scenario-based problem, which they attempt to resolve individually. Students are assessed on accurate application of the proper processes, formulas, or steps to solve the problem, not on whether they come up with the correct answer.

In the following week, students work in 3- or 4-person teams, uploading and sharing their individual responses on the group’s private discussion board. This leads to the second step, where students review the logic and processes taken by team members. To reach agreement on the correct answer, they collaborate and discuss all the proposed approaches, actively engaging with and educating each other, citing resources that support why their approach is correct. Ultimately, each small group must interact and debate until they reach a consensus, which is submitted and graded for a correct (or not) answer.

Successful Outcomes

The engineering instructor has implemented this approach for several terms and finds it successful in several ways.

The individual first attempt minimizes the potential of a student shirking their duties or not giving their full effort to the group activity.
Being assessed on approach and application of appropriate principles eases the anxiety of getting the right answer, which minimizes the temptation to use shortcuts or unethical options.
The group discussion supports active learning and requires students to present their solution. When the student believes their answer is correct, they confidently cite evidence and reference applicable resources to explain their rationale.
Given today’s global business environment, the ability to succeed as part of a team is an essential skill to master, requiring effective communication, persuasion, and negotiation to arrive at a consensus.
Working as a team alleviates pressure and allows everyone to contribute, more or less evenly. Students must interact with peers and learn to respect and appreciate individual differences, skills, and perspectives.
Although most problems have a “right” answer, solutions often include a more nuanced response that highlights the need for some degree of subjective judgment.

Using this two-step approach has been valuable for students. It reinforces their efforts to grasp the formulas and processes related to the problem, while simultaneously providing the space to learn from their peers. And as noted earlier, this method is easily adaptable to many disciplines and subjects. If you are searching for a way to increase student-to-student interaction in your teaching, you may want to give this two-step approach a try.

We’d love to hear your feedback and comments, so please post if you want to share your experience with this or other creative approaches. Good luck!

Susan Fein, Ecampus Instructional Designer, susan.fein@oregonstate.edu

This is a guest post by Ecampus Instructional Design Intern Chandler Gianattasio.

At DePaul School for Dyslexia, I teach 5th-8th graders conceptual mathematics, ranging from basic number sense to advanced topics in Algebra 1. Through this experience, I have discovered something I had never heard of before, a learning disability commonly seen coinciding with dyslexia, called dyscalculia. Many people describe dyscalculia as “dyslexia for math.” Dyscalculia affects one’s ability to take in mathematical information, connect with and build upon prior concepts learned, discern cues for application, and accurately retrieve information. DePaul provides an alternative education for students with learning disabilities, emphasizing explicit instruction to best support their students. In this post, I will discuss the common deficits that make up dyscalculia, where it falls in the realm of disabilities, and some ways we can accommodate students with dyscalculia in higher education.

Having dyscalculia can be debilitating, making it seem nearly impossible to keep up with neuro-typical classmates, especially when your class is on a fast-paced schedule, and when you are subliminally being told that asking for extra help will make you appear like you are lazy, unintelligent, unable to help yourself, and will just be one more problem that the instructor has to resolve. In Figure 1 (seen below), I have divided deficits of dyscalculia into five categories: executive functioning deficits¹, auditory processing deficits², nonverbal learning deficits³, language processing deficits⁴, and visual-spatial deficits⁵. Each category has a set of commonly experienced difficulties below them. However, these lists of difficulties are not exhaustive.

Figure 1. “Common Challenges Faced by Learners with Dyscalculia” By Chandler Gianattasio – CC BY-NC.

Looking at some of the common symptoms of dyscalculia, you may be thinking that many of these symptoms are also found in other disabilities, such as dyslexia, autism, ADHD, and more, and you would be correct. There is a large amount of overlap amongst developmental disabilities, and each disabled individual presents with their own unique combination of symptoms and, often, coexisting disabilities. To understand where dyscalculia falls within the world of developmental disabilities, I referred to the Individuals with Disabilities Education Act (IDEA) by the Department of Education. Through IDEA, 13 distinctions of disabilities were made:

[Specific] Learning Disability ([S]LD)
- Dyslexia, Dysgraphia, Dyscalculia
Other Health Impairment (conditions that limit a child’s strength, energy or alertness)
- ADHD, EFD, NVLD
Autism Spectrum Disorder
Emotional Disturbance
- Generalized Anxiety Disorder, Bipolar Personality Disorder, Obsessive-Compulsive Disorder, Major Depressive Disorder, etc.
Speech or Language Impairment
- LPD
Visual Impairment (including blindness)
- VPD
Deafness
Hearing Impairment
- APD
Deaf-Blindness
Orthopedic Impairment
Intellectual Disability
Traumatic Brain Injury
Multiple Disabilities

From this list, you may notice that there are only three diagnoses recognized as LDs: dyslexia, a reading disability, dysgraphia, a writing disability, and dyscalculia, a mathematical disability. All three of these LDs, as well as the majority of the other disabilities, have very similar biological limitations, each with the potential for a visual-spatial deficit, language-processing deficit, nonverbal learning deficit, auditory processing deficit, and executive functioning deficit. Due to individuals within each diagnosis having their own unique combination of symptoms, some may not have deficits in each of these areas. Figure 2 represents the potential combination of deficits an individual with each of these LDs may have. For instance, if you were to draw a straight line from dyslexia to the outer edge of the figure, the various deficits intersected would be representative of the profile of one individual. This figure shows the fluidity between different diagnoses and how easily co-existing conditions occur, due to a very similar underlying makeup.

Figure 2. “Potential Combinations of Deficits Behind Each Learning Disability” By Chandler Gianattasio, CC BY-NC-SA.

Figure 3 is shown below to reiterate the significant overlap found between disabilities. Looking specifically at weaker listening skills in this study, a characteristic originally classified as an APD trait, is also a very prevalent trait in individuals with LPD, dyslexia, ADHD and other LDs.

Auditory Processing Disorder (APD), Specific Language Impairment (SLI), Learning Disorders (LD), Attention Deficit Hyperactivity Disorder (ADHD), Autism Spectrum Disorders (ASD). [Colors shown in the charts do not correlate with Figures 1 & 2].

Figure 3. “Same or Different: The Overlap Between Children with Auditory Processing Disorders and Children with Other Developmental Disorders: A Systematic Review” By Ellen de Wit, et al, CC BY-NC-ND.

Supportive Instructional Strategies

Supporting Executive Functioning Deficits

Students struggling with executive functioning become overwhelmed often due to either external or internal stimuli. They often struggle with rejection sensitivity dysphoria, emotional dysregulation and “time blindness”. The most significant way you can support these students is by creating a safe, non-judgemental space for them to communicate with you, and encourage them to always self-advocate, no matter what. You can further support students navigating executive functioning difficulties by doing the following:

Providing easily accessible reminders of important events and assignment due dates. Time management can be a major difficulty, especially with projects over an extended period of time.
Giving lots of positive reinforcement, checking in frequently, and having regularly scheduled meetings.
Pointing out any prior knowledge that is being built upon, and have them answer any questions based on prior knowledge that they’ve mastered in class to boost their confidence and increase their motivation.
Reducing extraneous stimuli and eliminating background noise as much as possible – whether that be in their environment, on a worksheet, in a presentation, in reference material, etc.

Supporting Visual-Spatial Deficits

Students with visual-spatial deficits often struggle with creating their own visual representations of concepts being discussed, especially abstract or microscopic concepts. When navigating directions, these students also struggle with orientation – both cardinal and left versus right. This often presents when they are performing calculations with negative numbers. Most students with dyscalculia learn adding and subtracting via number lines that they manually traverse to understand the connection between operations properly. To help your students who have visual-spatial difficulties, you could offer the following:

Providing tangible manipulatives that they can touch and physically move in order to see how parts function together
- This could be provided when introducing a new concept as an addition to 2D drawings or descriptions
- It’s always beneficial to have manipulatives available for your students whether that’s physical objects for in-person sessions or interactive virtual manipulatives for online sessions.
Providing graph paper, templates, and/or graphic organizers can be highly beneficial to your students to organize their thoughts and break up information.
Integrating as much UDL in as possible! Presenting information in multiple formats and allowing the students to demonstrate their learning in multiple ways will allow these students to participate in class and showcase their knowledge confidently.

Supporting Auditory Processing Deficits

Students with an auditory processing deficit struggle to comprehend directions and content from listening. The most significant way you can help your students who struggle with auditory processing is by doing the following:

Speaking clearly.
Trying your best not to explain things too quickly.
Being very consistent with the terminology you use (try not to use multiple names for one entity or idea).
Checking in with students often to see if they understand what is being taught or asked of them.
Always encouraging students to ask questions as they work.

Supporting Nonverbal Learning Deficits

Students with nonverbal learning deficits are very literal and struggle to see the overall picture, especially when it comes to abstract concepts. You can support students with an NVLD by doing the following:

Creating a lot of associations and parallels between content and what they already know (common, everyday nuances) could help these individuals a lot.
Teaching concepts alongside any procedural knowledge you want them to retain will help them significantly, as they understand the “why” behind the steps.
Making sure to provide a lot of concrete examples, especially when introducing a new topic.
Structuring classes, making them as consistent and repetitive as possible. If they know what to expect and they are confident that they know how to handle it, these students will thrive.

Supporting Language Processing Deficits

Language processing deficits very commonly occur alongside auditory processing deficits. Students with this difficulty struggle with comprehending directions and content both from listening and reading. To help support these students, try the following:

Keeping language used simple and consistent.
Ensuring adequate (and modifiable if possible) background to text contrast/color.
Using 1.5+ line spacing and increased spacing between letters or symbols.
Chunking content and utilizing bullet points when possible.
Using consistent color associations with certain topics can go a long way (i.e. red for negative and blue for positive).
Starting lessons off with a graphic organizer or outline, showing how ideas fit together.
Including simple diagrams to illustrate concepts or procedures.
Highlighting keywords, numbers in word problems, or other important information you want to make sure they see.
Creating accessible asynchronous/recorded lectures.
Providing access to pre-written notes, “cheat sheets” displaying steps and formulas needed and worked-out sample problems so students can see what they are to do.

Remember that improving the learning experiences of our learners with special needs almost never comes at a cost to the “typical” learner – improving access, accessibility, and support for one improves these areas for all.

Available Accommodations at OSU:

In the Comments Below, Tell Me:

Do you have any experience designing for learners with dyscalculia? What are some strategies you have found beneficial?

Resources to Explore:

Dyscalculia Blog
Teaching Strategies to Support Dyslexic and Dyspraxic Students
Teaching Strategies to Help Students Think with Numbers
Dyscalculia Apps and Resources
- Math Ref (iOS App)
- Math Assistant in OneNote (Microsoft)
A Guide to Classroom and At-Home Accommodations for Dyscalculia
Authentic Assessment Methods for Mathematics
Dyscalculia Services – Providing Screening, Professional Development for Educators & Support for Students
- Math Assessment Reasoning & Strategy
Learning Disabilities Association of America: Adults with Learning Disabilities

Information shown in Figures 1 & 2 derived from the following sources:

“Dyscalculia: neuroscience and education” By Liane Kaufmann; “Double dissociation of functions in developmental dyslexia and dyscalculia” By O. Rubinsten & A. Henik; “Numerical estimation in adults with and without developmental dyscalculia” By S. Mejias, J. Grégoire, M. Noël; “A general number-to-space mapping deficit in developmental dyscalculia” By S. Huber, et al.; “Developmental Dyscalculia in Adults: Beyond Numerical Magnitude Impairment” By A. de Visscher, et al.; “Working Memory Limitations in Mathematics Learning: Their Development, Assessment, and Remediation” By Daniel Berch; “Learning Styles and Dyslexia Types-Understanding Their Relationship and its Benefits in Adaptive E-learning Systems” By A. Y. Alsobhi & K. H. Alyoubi; “The Cognitive Profile of Math Difficulties: A Meta-Analysis Based on Clinical Criteria” By S. Haberstroh & G. Schulte-Körne; “Mathematical Difficulties in Nonverbal Learning Disability or Co-Morbid Dyscalculia and Dyslexia” By I. Mammarella, et al.; “Developmental dyscalculia is related to visuo-spatial memory and inhibition impairment” By D. Scuzs, et al.; “Dyscalculia and the Calculating Brain” By Isabelle Rapin

The distinction of potential difficulties one might experience were determined by the symptoms commonly seen in the following disorders:

Executive Functioning Disorder (EFD)
Auditory Processing Disorder (APD)
Nonverbal Learning Disorder (NVLD)
Language Processing Disorder (LPD)
Visual Processing Disorder (VPD)

Illustration of educational items such as papers, ruler, glasses, formulas, grades. — Image by chenspec from Pixabay

This post is the second installment in the series that describe the main characteristics, major benefits, design considerations, and practices and challenges of implementing an ungrading approach. This second blog presents the types of ungrading practices, challenges to implementation, and main takeaways derived from the book chapters and discussion with my colleagues in the Ungrading book club.

Types of Ungrading Practices

To begin, it is important to recap that the underlying concept supporting ungrading is deep, extensive, and formative feedback. This means that instructors are expected to design low-stakes formative assessments and devote substantial time and effort to craft feedback that students can use to revise their work. This section summarizes several contributions the book chapters authors made in regards to pedagogical practices, strategies, tips, and resources to adopt ungrading. Instructors can combine the ungrading practices or use them as stand-alone activities.

Approaches to Assignments

Portfolios: Students can build their portfolios with different digital tools that allow them to create personal or professional materials that are useful beyond the class (e.g., website, content curation). The critical element in a portfolio assignment is that there needs to be space for critical thinking and metacognitive work that can be shared with others. An additional element can include portfolio conferences. For these conferences, students meet with their instructors to review their course work and make annotations about their learning journey (they can also discuss their final grade).
Project-based Learning, Problem-based Learning, Inquiry-based Learning: Students work on activities that relate to their own experiences, real-life applications, and ill-structured scenarios. These activities encourage students to work with others, find solutions, investigate deeper, and apply concepts studied in the course to realistic situations.
Staged Assignments: Students work on reviewing/redoing assignments to allow them to learn from the feedback they received from their peers and/or instructor.
Minimal Grading: Use of a holistic or simplified grading schema (e.g., pass/fail, strong/satisfactory/weak).

Student Participation

Contract Grading: Students can be graded over the labor completed. Students are responsible for reviewing their workload in the class and determining how they will accomplish it. Students will be in a process of understanding why grades matter to them and that the grade they give themselves will be attached to the amount of work they complete. Students sign a contract that clearly specifies the assignments and student responsibilities to achieve an A-C letter grade in the course. This grading system can allow students to negotiate their contracts with instructors.
Process Letters: An activity where students describe their learning process and how they evolve in their work in the class. This can be multimodal (e.g., presentations, reflections that combine audio, video, and text) and/or accompany major assignments.
Student-made Rubrics: Students can develop their own rubrics, which can become a learning activity in itself.
Participatory Voices: Students can contribute to course content by creating content, adding items to the syllabus, selecting the type/format of feedback they want to receive, evaluating peers, and developing an intellectual voice. Through self-evaluation and peer evaluation, students can reflect on their learning, understand the process of evaluating others, and focus on excellence and building confidence. Students are given a set of guiding questions to engage in self-and peer evaluation. At the end of the project or term, they recommend a grade for themselves and their peers.
Declaration Quiz: A quiz that asks students to select a checklist of the assignment requirements that they have completed. This can be a low-stakes assignment that helps students reflect on how they accomplished the task. Instructors can create declaration quizzes for each assignment and associate the number of points to the letter-based system.

Interaction

Peer Assessment: When students work in groups, they can evaluate each other. Students can write about their contributions to the group projects as well as their experiences with the team. This can give instructors a view of the team dynamics and activities that are not usually visible.
Grade-Free Zones: This involves reviewing major assignments and/or providing a sandbox space for students to experiment before they engage in completing formal assignments. Students can submit early assignments or portions of them for peer comments or the instructor’s early feedback.

Mastery Orientation

Mastery Learning Artifacts: Students collect learning artifacts that they have developed to demonstrate their mastery of the learning concepts based on the exemplary work and expectations provided by the instructor. Students submit these artifacts at the end of the term. In addition, students describe the areas of growth based on the instructor’s feedback (e.g., revisions).
Single-point Rubrics: This type of rubric includes criteria and fixed binary points (done = 1; not done =0). Comments can be added to either point to note the improvements to be made (in case it is not done) and to highlight the aspects that go beyond expectations. A benefit of this type of rubric is that it encourages mastery of content and keeps students’ focus away from the grade itself.
Feedback Logs: Students collect feedback and identify the areas in which they received more feedback, work out strategies to improve those areas, and reflect on the ways they are learning.
Feedback and Revisions: Students work on a series of drafts, and the instructor provides comments that students are expected to incorporate in the next revised draft. A grade can be added to the final draft.
Self-Assessment: Consider metacognitive activities that engage students in their own evaluation of learning and in dialogue with the instructor. Encourage students to develop their own standards and self-scrutiny practices.
Student Individual Plan: Students articulate goals and values for themselves about a class or a project. The instructor can help students by providing reflection guidelines and templates for developing their own goals.

Challenges to Implementation

While ungrading encourages a shift from a focus on grades to a focus on feedback and metacognitive activities for student learning and success, its implementation is not without challenges. The challenges range from local critiques to structural and how-tos.

One of the biggest challenges is the misunderstanding of what ungrading involves –an active activity that engages students and instructors with grades as a system, which is different from not grading. Without having a clear understanding of the concept itself, the rationale behind it, and how it will benefit students more than a grade-based system, using alternative means for grading may jeopardize the student learning experience.
A second challenge is the structural system of grades that prioritizes performance over learning. If the focus continues to be on how students perform in a class rather than on their learning, Kohn and Stommel argue that using an ungrading system that gets rid of grades will not be sufficient to push toward a system that creates learning spaces for critical thinking, reflection, and metacognition.
A third challenge involves the redefinition of the curriculum, innovative pedagogy, and how to assess learning. If the idea of content coverage and memorization of facts prevails, learning is treated more as information transfer –from the instructor or textbook to the students. In this transfer, students may not necessarily own their learning. Along with this is the way assessments are designed to emphasize judgment of students’ performance. If the teaching method does not allow room for real learning, ungrading will not make a difference. Thus, the convergence of changes to the curriculum, pedagogy, and assessment methods is of utmost importance.
A fourth challenge is more systemic and structural. Kohn argues that control, in many educational cases, prevents students’ choice and voice in their learning journeys. If ungrading is to have a way in educational contexts, instructors, and even administrators, will be invited to relinquish some of the control they exert over students’ performance to welcome students’ decisions related to their learning needs and interests.
A fifth challenge is a deep and widespread belief that grades reflect learning and action. There is a great concern that if grades are to be eliminated, students will not complete their assignments, need to do more work, or even skip classes. Also, instructors will have to “grade” more and be overburdened.
A final challenge is the over-reliance on rubrics that, according to Khon (foreword, p.xvii), is a system for “judging students…They offer umpteen different axes along which to make students think about their performance— often at the cost of becoming less immersed in what they’re doing.” It is not that ungrading does not provide guidance but it is important to avoid overcontrol evaluation practices. Instructors will need to analyze when and how rubrics help students focus on the learning process (and not solely on the points they get).

Takeaways

The book offered clear rationales, experiences, and strategies that instructors could consider if they feel they want to move away from the grade-focused system. In addition, as a designer, I have a better understanding and collection of resources to use during my consultations with faculty who might be looking into authentic and alternative means for assessment and grading.

Ungrading requires a reconceptualization of the curriculum, pedagogical, and assessment practices. If an alternative means of assessing student learning is to be implemented, the content, activities, and assignments need to open opportunities for students to engage in their own process of learning, reflection, and feedback. If we don’t level the playing field for students, no grading (or ungrading) system would be worth trying.

Grades are considered to be problematic because they contribute to widening the educational equity gaps. Ungrading, as a student-centered approach, can help mitigate some of the inequalities that students experience for access to successful learning. Since not all students come with the same knowledge and skills, ungrading, as a system that personalizes learning and assessments, will orient each student to focus on the feedback that they need.

Ungrading does not mean that instructors do not grade or that students have a free pass. Ungrading requires a deeper understanding of what learning means and how to design learning activities and contexts in which it can be evidenced. There is no universal magic approach to do it. If you are seriously considering moving to ungrading practices, start small, one step at a time.

Have you ventured into ungrading? If so, how did it go? What works and what does not? If not, what are your thoughts about ungrading? I’d like to invite you to share comments or experiences.

References

Blum, S. D. (2020). Ungrading: Why Rating Students Undermines Learning (and What to Do Instead). West Virginia University Press.

Stommel, J. (June 3, 2022). The word “ungrading. [Twitter post]. https://twitter.com/Jessifer/status/1532921663980986369

Warner, J. (January 4, 2016). I Have Seen the Glories of the Grading Contract…and I’m not going back. Inside Higher Ed. [Blog post]. https://www.insidehighered.com/blogs/just-visiting/i-have-seen-glories-grading-contract

NDAs and Open Pedagogy

One of the principles upheld by the open pedagogy movement is that the role of the learner must be active and the tasks that they engage in must be meaningful. These are not new ideas by any stretch, but as we move toward a more open pedagogical environment, it becomes necessary to examine the types of assignments that we create and assign. How do these tasks contribute to efforts to democratize education and increase learner autonomy, engagement, and freedom? What makes an assignment open? To answer these questions, this post will explore the relationship between open pedagogy and open assignments.

While interest in the topic of open pedagogy has steadily gained steam in the roughly 50 years since its inception, definitions of and familiarity with the concept of today’s open pedagogy vary among educational practitioners. Some discussions focus on the expansion of the use of these resources. You might be hard-pressed to find an instructor who hasn’t at least reused open content (See 5R framework of Open Content) or encountered such materials as a student. Other conversations emphasize the remix and revise aspect of open content and pedagogical practices, and the number of faculty-created Open Educational Resources (OERs) intended to replace the traditional textbook is ever increasing. Still others have turned their attention to implementation of open pedagogical practices that put students in the role of content creators rather than passive beneficiaries of innovations in open content. In our efforts to create tasks that accomplish this shift in the role of the learner, we must first ask what the value of the task is for the student, peers, and the larger community, and what life will such a task have after its completion. To answer these questions, we can look to the non-disposable assignment (NDA).

Non-Disposable Assignments (NDAs)

To define the characteristics of this type of assignment, it is helpful to first define what we mean by “disposable” assignment. It is safe to say that we are all familiar with these types of assignments: typically they include one-off or busy work tasks designed to be filed away and forgotten as soon as completed and graded. In his article What is Open Pedagogy (2013), David Wiley described the disposable assignment in this way:

These are assignments that students complain about doing and faculty complain about grading. They’re assignments that add no value to the world – after a student spends three hours creating it, a teacher spends 30 minutes grading it, and then the student throws it away. Not only do these assignments add no value to the world, they actually suck value out of the world.

Online learning within the confines of a learning management system (LMS) is particularly ripe for these types of assignments. In fact, one could argue they are designed for this type of task. In an online course, instructors create and post the assignment, students complete it, instructors grade it, the course ends, student work is deleted, the course is rolled over, and the next crop of students begins the cycle again. The work is designed to be contained within the LMS for the duration of a course, not to be shared with a broader audience of students or colleagues.

As an alternative to the disposable assignment in favor of more meaningful tasks, Wiley coined the term Non-Disposable Assignment. The NDA (also referred to as a renewable assignment), in contrast to its binworthy counterpart, is an assignment that “adds value to the world.” Later definitions, no doubt influenced by the growing open pedagogy movement and the promotion of the use of OER materials, go further and hold that an NDA ought to produce a resource that is openly published so that “others can find, use, and if desired, repurpose or update the work,” (Jhangiani, 2015; Wiley, 2013; Wiley et al., 2017; Wiley & Hilton, 2018). Such assignments put the learner in the role of creator and impact or benefit an audience beyond the instructor and student. Because the premise of the NDA is that it can not only be shared widely, but also revised and reused without permission by both instructors and students, the content should be openly licensed. Considering the role of learners as authors of the content, they should have a say in determining the type of open license appropriate for their work.

In the article A Conceptual Framework for Non-Disposable Assignments: Inspiring Implementation, Innovation, and Research, Seraphine et al (2019) provide a set of principles NDAs must adhere to. The Five Principles are summarized as follows:

NDAs fundamentally involve information collaboration and exchange.
As forms of responsive and responsible pedagogy, NDAs involve communication throughout and opportunities for revision, creativity, modifying key terms and objectives, etc.
While NDAs might not necessarily involve communal assembly, the resulting product or practice must always be shared outside the teacher-student dyad, creating opportunities for communal access of the NDA as an information resource
NDAs produce learning through cooperative critique.
Because they are not exams or isolated writing assignments, NDAs involve innovation as a fundamental concept.

Benefits and Value of NDAs

Apart from their ability to reach a broad audience, NDAs increase student motivation, engagement and autonomy resulting in improved achievement of learning outcomes. (Ariely, Kamenica, & Prelec, 2008; Chalofsky & Krishna, 2009; Pink, 2011). While this claim may be at least in part anecdotal, it follows that when students know that their work may be used by peers, faculty, and colleagues across their field in the future, investment in the quality of their work increases. Non-disposable assignments and authentic assessments have the potential to add value in other areas by:

promoting community engagement.
fostering innovation.
interrogating and dismantling systems of oppression by centering experiences of historically marginalized groups.
providing opportunities for culturally rich content (inject identity, student influence over content).
cultivating information literacy skills.
increasing accessibility to educational resources.
helping students communicate in writing to a general audience.
offering opportunities to collaborate with peers around the world.
increasing self-regulated learning and autonomy.

Despite their numerous benefits, NDAs are not without challenges and risks. For example, some students may be resistant to the exposure and the vulnerability inherent in creating open content for broad use. In such cases, instructors must provide alternative assignments or options not to share. Because student-generated content requires substantial metacognitive skills, instructors must ensure that NDAs involve significant scaffolding at multiples stages in the learning process (Zimmerman, 1990; Zimmerman, 2002). Furthermore, the open nature of student-generated content presents a quality control challenge that instructors must anticipate and address by providing multiple opportunities for revision and peer review.

NDA Design and Students as Producers

Implementing assignments that have the potential for broad impact beyond the typical instructor-student dyad can seem daunting. After all, conceptualizing and creating tasks that effectively revise the role of student from a passive one to actual content creators is no small feat. However, it is important to remember that the scope can vary widely. Indeed a well-crafted discussion between two students might form the basis for a renewable assignment. Other examples may include experiential connections such as student-generated podcasts; the production of flyers, guidelines, or materials for local community organizations; or even collaboratively created and maintained global resources such as wikis like the Chemistry Library. Whatever the scope, NDAs can—and arguably should—be iterative allowing for innovation and adaptation to various contexts.

With the role of the student as producer in mind and an understanding of the potential pitfalls that an open assignment might present, faculty can then turn to the conventional principles of backward design to develop meaningful student learning experiences that add value for learners and their peers while also promoting community engagement.

Instructors should consider the role of students as they develop non-disposable assignments to put students in the role of content creators. Source: The Non-Disposable Assignment: Enhancing Personalised Learning – Session 1 Slideshare, CC Attribution-ShareAlike

Examples & Resources

References

Jhangiani, R. (2017). Ditching the ‘‘disposable assignment’’ in favor of open pedagogy. http://teachpsych.org/E-xcellence-in-Teaching-Blog/4583103.
Paskevicius, Micheal, Knaack, Liesel (2017). The Non-Disposable Assignment: Enhancing Personalised Learning – Session 1 (Slideshare) https://www.slideshare.net/mpaskevi/the-nondisposable-assignment-enhancing-p
Seraphin SB, Grizzell JA, Kerr-German A, Perkins MA, Grzanka PR, Hardin EE. A Conceptual Framework for Non-Disposable Assignments: Inspiring
Wiley, D. (2013, October 21). What is Open Pedagogy? Retrieved 15 June 2022, from https://opencontent.org/blog/archives/297
Zimmerman, B. J. , Becoming a self-regulated learner. Theory into Practice, 2002; 41, 65-70. doi: 10.1207/s15430421tip4102_2.

Over the last couple of terms, I joined a series of reading sessions with instructional design colleagues to read Alfie Khon and Susan Blum’s book Ungrading. Why Rating Students Undermines Learning (and What to Do Instead) and discuss the practices and implications of this approach to reconceptualize assessment design and the place of grading. This two-part blog aims to capture the takeaways from those discussions including the main concepts, approaches, types of activities, implications, and challenges of adopting ungrading practices. This first part of the blog covers a brief overview of the concept of ungrading, its major benefits, and design considerations; and the second blog will include a summary of the types of ungrading practices and challenges to implementation ––all derived from the authors’ extensive arguments and examples. For a detailed review and summary of the book chapters, you can also check the blog Assessment Design: Ideas from Ungrading Book.

Overview of Ungrading

The concept of ungrading is sparking widespread interest only recently even though educators have been studying and using ungrading approaches for quite some time. The foundational premise of ungrading is to move away from a focus on grades that judge, rank, sort, and quantify student learning to adopting an approach that focuses on using alternative and authentic means to assess learning such as self-evaluation, reflection, student-generated questions, peer feedback, to name a few. Along with that premise is the questionable ranking that comes with grading which makes students compete with one another in an artificial way. Sorensen-Unruh (chapter 9) sees ungrading as a conversational method that facilitates the communication between instructors and students about how students perform in the class. If, as underscored by the authors, grading and the fact of assigning point values to students’ performance makes more harm than good, then, why use grading? Considering that grading is rooted in our educational systems, many of these authors conclude that it becomes inevitable to grade student learning as it is currently done today.

Several scholars and instructors consider grading to be problematic. First, grades are not good indicators of learning. Blum (chapter 3) argues that grading assumes all students are the same, does not provide accurate information about student learning gains, is consequential, adds fear and avoidance of negative consequences, and is arbitrary and instructor-led. Second, the overemphasis on grades can lead to a decrease in intrinsic motivation, students’ excessive anxiety, and the complexity of quantifying how learning happens (Stommel, chapter 1). Third, it can also decrease interest in learning, students may feel inclined for easier tasks, and critical thinking is lacking (Alfie Khon, foreword). Fourth, grading makes students be fixated more on their grades than on the process of learning, leading them to believe that grades are all that matters in school (Khon & Blum; Talbert, 2020). And finally, too much focus on grades can be detrimental to students’ mental health (Eyler, 2022). However, ungrading does not mean dismissing grades altogether. Instead, Stommel proposes creating a learning space that fosters critical thinking, reflection, and metacognition– all skills that are valuable for 21st-century education. Likewise, Alfie Khon contends that grading can be participatory since it does not require a unilateral decision, and thus, students can also propose their own grades (with the instructor’s reservation to accept them).

“Ultimately ungrading— eliminating the control-based function of grades, with all its attendant harms— means that, as long as the noxious institutional requirement to submit a final grade remains in place, whatever grade each student decides on is the grade we turn in, period.”
(Khon, 2020, p. xv)

While ungrading may be an innovative approach to assessments, it should be thought of carefully and adopted with a clear objective. Ungrading, as pointed out by Katopodis and Davison (chapter 7), needs a structure to be effective, allowing students to envision themselves as authoritative, creative, confident, and active, thus achieving a high impactful goal. As ungrading requires instructors to evolve in their approach to assessment, it does too for students who are expected to engage in a process of self-evaluation, self-assessment, and reflection. This requires engagement in metacognitive practices that many students might not be ready to embark on or don’t know how to do it. In addition, while ungrading is believed to be student-centered, it can deepen equity gaps if guideposts are entirely removed. Sorensen-Unruh (chapter 9) believes that ungrading is a matter of social justice –going beyond the expected student agency and aiming at having students exercise their voice and participate in assessment decisions.

As a whole, Blum (introduction chapter) provokes us all to rethink the nature of grading considering that students’ learning conditions vary, with many enduring inequities at many levels. Blum wants us to keep focused on how “varying assessment and feedback methods contribute to the real learning of real individual learners, rather than imposing an arbitrary method of sorting.” (p. xxii); all for the sake of healthy learning.

These are a few key points about the arguments for ungrading. While this assessment practice is taking force in higher education, there are also many critics and skeptics. The purpose of this blog is not to enter into the discussion and controversy of ungrading, but to share a few perspectives and takeaways after an intense and well-structured book club discussion. In the following section of this part-one blog, I will share considerations for designing for ungrading.

Assessment Design Considerations

Tasks and activities from a laptop computer

The educational system requires all instructors to submit grades at the end of every term. There is dissatisfaction with the current grading practices among many instructors and students as explained at large in the book. Here is where the ungrading movement takes force to provide alternative ways to account for evidence of student learning. Riesbeck (chapter 8) argued that by implementing ungrading practices, students can focus more on the content and feedback than on the grades. The use of critique-driven learning allows for more easily quantifiable efforts, progress, and accomplishment. Each ungrading consideration is dependent on a myriad of factors that may or not apply to each instructor’s context. The bottom line in ungrading is re-envisioning the teaching and learning process, engaging students in active learning, and active self-assessment through feedback. The following are design considerations:

Decenter grading and communicate (un)grading practices

Instructors can encourage students to focus on the process of learning, instead of talking about grades, Blums says, we should talk about the purpose and goals of the activities with students. These conversations can help develop relationships with students to encourage them to own their learning and have a voice in that process. Decentering grades also involves having an ongoing conversation with students, colleagues, and administrators about assessment decisions. Although each instructor exercises their academic freedom, it is also essential to share assessment practices that work and possible changes to implement. In these conversations, it is also important to carefully use language that conveys a clear understanding of the concept and practice of ungrading to avoid confusion, anxiety, misunderstandings, and reactions that prevent its implementation. Having these kinds of conversations can help shift the mind from a grade-focused to a learning-focused approach. A key element in these conversations is to ensure that the pedagogical reason behind the adoption of ungrading practices is not only clear but well understood (and this may take time).

Set a structure for ungrading

As with other elements of exemplary course design considerations, the structure of assessment practices is necessary. Adding a structure for ungrading assignments gives students a clear objective, steps, and flow that allow them to be consistent and accountable to their own learning goals and strategies.

Reflect on pedagogical and assessment practices

Instructors are invited to examine more in-depth their grading policies, why they grade in the way they do, what they are grading, and how they grade. In many cases, the path to ungrading is a response to dissatisfaction with grading policies. Aaron Blackwelder (chapter 2) says that, over time, he turned into a gatekeeper; he lost focus and was more interested in meeting institutional and “rigor” requirements than building relationships with students. His students had turned into competitive grade seekers. He questioned what a grade really suggests and posits that grades fail to communicate learning. The fact that grading allocates a specific number or letter that can bring some negative feelings to students, can also negatively affect the potential for learning. Sackstein (chapter 4) calls for a change in mindset to identify the way in which learning can be communicated and understood beyond the traditional use of numbers and letters. While Blum also argues for assessing the entire learning experience (with portfolios, for example), Sacksatein suggests considering changes in the language of grading which can provide students with an opportunity to shift the way they feel and think about their own learning.

Teach students to view mistakes as a necessary step in the learning process

Instructors are invited to reflect on how traditional grading practices are punitive, dehumanizing, and demotivating. Gibbs (chapter 6) points out that a system that punishes students for making mistakes reinforces the notion that all learning is flawless and therefore mistakes need to be avoided. Ungrading, on the other hand, aims to implement and cement the idea that learning is a process that needs constant feedback for that learning to be consolidated. Therefore, students need to be given opportunities not only to learn from their mistakes but to act on them in an interactive way. This requires instructors to plan for assessments that include steps for review (e.g., self, peer) to help the student build their skills, and knowledge over time.

Care for students and their learning

Instructors are also invited to demonstrate more explicitly that they care and validate students’ work. Further, Gibbs (Chapter 6) argues that her teaching philosophy is better summarized by the word “freedom”, the freedom that learners have to learn and grow at their rhythm and the freedom to make mistakes and learn from them. The role of the instructor is then to be supportive in that process through feedback and empathy. Ungrading, as it is overall discussed throughout the book, does not mean that there are no assessments or grading at all. On the contrary, the assessments should focus on helping students build their knowledge and understanding in less stressful ways, allowing students to build learning habits, develop creativity, become better communicators, and connect to their lived experiences and contexts. Caring for students also involves valuing their identity as learners and what they bring into the learning environment.

Be aware that ungrading can increase student anxiety and uncertainty

It is critical that instructors who are considering ungrading be cognizant that it involves a high level of anxiety and uncertainty on the part of students. Let’s recognize that students are so used and “conditioned” to grades that they will find it confusing not to have a grade associated with each assignment in the course. Many students consider being successful if they score a perfect grade which can be overwhelming and obscure the value of learning. Instructors who adopt ungrading should explain why and how ungrading will be done in certain classes. This will add transparency to the expectations and assumptions that instructors have about students.

Implement student voice and choice supported with personalized feedback

Instructors can help students take ownership of their learning through hands-on, real-life activities that allow students to use the content they are learning in projects of their interest, conduct research, and solve problems. Students can choose their topics and projects and the instructors can guide them to narrow topics and ensure the projects are feasible within the course timeframe. Consider feedback as a formative assessment approach that enables students to make choices about their learning strategies and needs to improve their learning tasks. Sackstein (chapter 4 ) suggests teaching students to collect feedback and identify the strategies that work for different kinds of assignment revisions. This way, students can develop better strategies that move them from lower-thinking to higher-thinking processes.

Since ungrading promotes the use of student-self assessment and reflection practices, it implies that instructors will need to personalize and tailor feedback to meet students where they are. In addition, instructors can consider setting a culture of feedback (Gibbs, chapter 6) where instructors teach students to use feedback to improve their work, provide peer feedback effectively, and see the value of learning from their mistakes.

Promote peer support

Authors of several chapters in this book have posited that students are more likely to give each other better feedback in the absence of grades. This kind of feedback can allow students to help each other, learn from one another, expand their awareness of their own understanding, and develop skills for life. Peer support will also help students build their confidence and autonomy to learn from each other.

Trust students

One critical aspect of assessment is trust –trust that students do the work they are expected to do by themselves. Instructors have legitimate reasons to express their concerns and create course policies about academic integrity that lead them to adopt plagiarism systems and surveillance tools to monitor and proctor students’ work. In adopting ungrading, trust is fundamental to change the way learning and performances are assessed. It involves helping students think differently about what it means to learn. Instructors can help students evolve in their approach to learning to move away from grades to focus on their learning by including in assessments strategies for building capacity for metacognition, confidence in their skills, life-long learning goals, and owning their learning.

Ungrading does not mean instructors don’t grade and students don’t receive grades on their work. Ungrading, as posited by the authors in the Ungrading book, is a mindset to approach student learning differently. In the second part of this blog, I will share the types of ungrading practices, implications, and challenges as presented in the book.

References

Coghlan, S., Miller, T. & Paterson, J. (2021). Good Proctor or “Big Brother”? Ethics of Online Exam Supervision Technologies. Philos. Technol. 34, 1581–1606. https://doi.org/10.1007/s13347-021-00476-1
Eyler, J. (2022, March 7). Grades Are at the Center of the Student Mental Health Crisis. InsideHigher Ed. [Blog]
Kohn, A., & Blum, S. D. (2021). Ungrading: Why Rating Students Undermines Learning (and What to Do Instead). West Virginia University Press.
Shi, T. (2022). Assessment Design: Ideas from Ungrading Book. [Ecampus blog]
Stommel, J. (2020, February 6). Ungrading: an FAQ. [Blog]
Talbert, R. (2022, March 30). Ungrading after 11 weeks. [Blog]

Intro

The concept of the ‘right to repair’ has been on my mind recently, both as a user of tech products and as a designer of online courses. Electronics are notorious these days for their enigmatic design. The user is not trusted to make repairs or is restricted in the ways they can interact with device components. This is a choice made by manufacturers to limit access to approved vendors or repair shops. Instructional Designers have a similar choice when building courses. Do we follow a restrictive approach to modifications, or open up courses by anticipating, welcoming, and providing the resources for modifications?

Difficult by design

I recently experienced the restrictive side myself as I needed to fix an air purifier that had an unfortunate run-in with my youngest child and her colorful stickers. Apparently, the inside of the machine was not pretty enough, and the stickers were now stuck inside the machine, not quite clogging up the fan, but making a noticeable noise when the purifier was running. Realizing that I should probably remove them from the mechanism, and the partially obstructed fan, I grabbed my handy screwdriver, and rotated the cylindrical case to find where to begin.

And then I saw it – nothing. There were no screws on the outer shell. I turned it around a few more times, holding on to some hope that there was another way in – some switch to press or clasp to unhook. Nothing. The company designed the device to prevent a consumer from taking it apart. The only thing I had access to was the filter opening. No screws inside there either, and the manual had no sections on repairing the device.

I was put into a situation where I knew what I needed to do, and how to do it, but had no way of accomplishing it. If I tried to open it in a way it was not designed to be (whatever that was), I risked breaking the device even further, and voiding the warranty.

This is the situation many technology users find themselves in these days, which has led to a push for the right to repair one’s own devices.

Right to repair principles

Had the manufacturer made the air purifier with the consumer in mind, it may have been more closely aligned with right to repair principles, which are given by The Repair Association through their Policy Objectives. Some more relevant ones are currently paraphrased on the Right to repair – Wikipedia article:

the device should be constructed and designed in a manner that allows repairs to be made easily;
end users and independent repair providers should be able to access original spare parts and tools (software as well as physical tools) needed to repair the device at fair market conditions;
repairs should by design be possible and not hindered by software programming;
the repairability of a device should be clearly communicated by the manufacturer.

Applicability to Instructional Design

This whole endeavor got me thinking: What is the best choice for designers and developers who create courses and complex elements for our users? It seems that it falls into the same design philosophy choices that we see with other products like computer hardware or electronics today. For simplicity’s sake, let’s narrow it down to these two opposite choices designers have when making course components:

Modifying course elements is made difficult because the designer is either not confident in the instructor’s abilities to properly work with the design, actively discouraging changes, thus resulting in no change until the user approaches the designer(s) again.
Course elements are designed with user modifications in mind, and the user is left with sufficient instructions, access, and ability to make changes when necessary.

I prefer to use technology that closely follows the second choice, as this is more aligned with the ‘right to repair’, and results in more user-friendly practices. That is not to say that everyone would want to modify courses, but the option should be there.

Or, in other words:

It is the philosophical difference between engineering things to make them harder for the end user because you don’t trust them and documenting things to educate the end user so you know you can trust them.
Linus Sebastian, talking about the design choices of a pro-repair consumer laptop

If the previous main points of “right to repair” were to be re-written with online education in mind, how would these look? Perhaps something like this:

The course and its objects should be constructed and designed in a manner that allows edits to be made easily.
Instructors and SMEs should be able to access course components and tools needed to modify the course and its elements.
Revisions and additions should be possible and not hindered by design choices.
The Instructional Designer should clearly communicate the ability to modify the course, and how to do it.

How we could do it

What could we do as course designers to inform and empower faculty? Here are a few ideas:

General Documentation for Course Elements

By far one of the simplest ways to provide support to users is through basic documentation pages. If located on the course site itself, they can remain unpublished so learners do not see them. For those who would like more autonomy over their course structure and design, detailed documentation pages provide an excellent way to take the initiative and make the desired edits. Well-written documentation may also reduce the need for Instructional Designer support after the course is running. Plus, if you, as the designer, are worried about things breaking, you can always have a backup of all materials ready to revert pages.

Side by Side Code Blocks Tutorials

I use these all the time with fellow designers. On a Learning Management System (LMS), these function as a tutorial page where the page is split into two columns. Users can see the HTML/CSS code on the left and how it is displayed on the right. Then it’s a matter of copying the code from the code block and pasting it where they want it to go. This practice is very useful when it comes to the more advanced features of your LMS. This makes it easier to choose which element a user wants to incorporate or edit.

Side by side code tutorial blocks provide a quick way to show off how elements work, and a quick way to copy elements into other parts of the course.

Learner Journey and Alignment

If an instructor wants to change the course a few terms after it has been running, how do we achieve a similar look and feel to the one created by the Instructional Designer long after the project has been developed? Mapping the expected learner journey, and how the content aligns with learning outcomes, can help with this. For example, imagine the learner is expected to interact with a week-long module by completing the following tasks in this order:

Step A (Fulfills Learning Outcomes 1, 3. Informs Steps C and D)
Step B (Fulfills Learning Outcome 2. Informs Steps C and D)
Step C (Fulfills Learning Outcomes 3, 4)
Step D (Fulfills Learning Outcome 1, 4)

Each step may include reading or watching learning materials, completing an assignment, participating in a discussion, and so on. How would this expected behavior change if, later on, an instructor added an additional assessment between C and D? What about removing Step B entirely (which in this example would remove alignment to Learning Outcome 2 from the module). Would a learner on this new version of the course still have the required information to complete the remaining parts of the module? Would they interact with the content in the same order as initially expected (and how the course was likely designed to be completed)?

These are things Instructional Designers plan and check during the initial development which can be shared to ensure that the same methods are followed in subsequent iterations of the course.

Conclusion

Some may prefer to leave everything in the hands of an experienced Instructional Design team, and use their expertise whenever a change is required. For others who have enough technical skills to edit content, the desire to learn more, or would like more autonomy and ownership over course content, an open course design provides the same user-friendly approach that at ‘right to repair’ would have for general electronics.

References

Right to Repair, Wikipedia: https://en.wikipedia.org/wiki/Right_to_repair
Policy Objectives, The Repair Organization: https://www.repair.org/policy
Linus Tech Tips: https://www.youtube.com/c/LinusTechTips

This blog post is an Instructor Spotlight authored by Xiaohui Chang. Xiaohui is a Toomey Faculty Fellow and Associate Professor of Business Analytics in the College of Business. This post is a follow up to Improving Student Engagement and Connection in Online Learning: Part I, Proactive Support.

Introduction

Since the first post in the series appeared a few months ago, we have received plenty of feedback from other instructors who are actively engaged in online education. Some of the stories shared by them reiterate the points we discussed, and others included tips and techniques that have worked particularly well for them. Almost all of them agreed that teaching well online remains a challenging task.

“I love the notes on proactive student support … especially the notes on checking in with those who are behind. Sometimes all they need is a little empathy!”
Vic Matta, Associate Professor, College of Business, Ohio University

“I regularly incorporate each of these in my relationships with my students, to include weekly zoom “what’s up” meetings with my students. I check in on them if they’re behind on assignments…Yes, it takes effort; but my mission is to help these students find the greatness within themselves to succeed.”

To quickly recap what we have discussed in Part 1, we touched on how to employ empathy statements in communications with students, restructure and promote the office hours, provide personal feedback for students, and periodically check in with students who are behind. You may also refer to the first article here: Improving Student Engagement and Connection in Online Learning: Part I, Proactive Support.

Continuing from the first post, Part II will revolve around six specific practices that I have found particularly helpful for online teaching and learning.

Practice 1: Adopt a variety of communication methods

I provide assignment instructions and guidance using a variety of communication methods including texts, diagrams, images, and short video clips. I have learned that instructions with screenshots and videos tend to be better in explaining complicated procedures than text alone.

Video Tutorial Example: Creating a random sample using XLSTAT

Practice 2: Create a Q&A Discussion Board

I have a separate discussion on Canvas for students to address issues with the class in general (content questions, technical issues, deadlines). Instead of emailing the instructor regarding issues other students may also have questions about, students are encouraged to use this forum so that all can benefit from the questions and answers. I usually wait for a few hours for students to answer each other’s questions first before I provide mine.

When students email me questions that are a good fit for the Q&A Discussion Board, I’d respond through email first and then recommend the students submit the questions to the discussion board so that other students can learn from the questions and answers. This discussion board also creates an inviting and engaging learning environment for the students who don’t get to meet their classmates in a face-to-face setting.

Practice 3: Estimate the amount of time taken for each assignment

I was skeptical of this at first as the time taken would vary drastically for each individual. However, student feedback indicates that estimated times helped them plan for the week and set aside an appropriate amount of time. We don’t need to worry too much about making the estimates accurate for everyone as students will automatically adjust given their own work styles. A workload calculator that I have found helpful is developed by the Center for Advancement of Teaching at Wake Forest University, called the Workload Estimator 2.0.

For more information about estimation rates, see the explanation here – Workload Estimator: How We Calculated.

Practice 4: Ensure timely replies

This practice is obvious, but difficult to do when one is teaching multiple sessions with hundreds of students. For online classes, timely replies make students feel as though they are taking an in-person class with all of the built-in support and resources. I understand that we all have different teaching priorities and schedules, however, it all comes down to figuring out how to most efficiently organize our days so that we can be available to students.

Setting aside a couple of times a day for handling emails has worked quite well for me, e.g., the first thing in the morning, after noon, and before the end of the day. I try my best to respond to students’ emails within 24 hours and check my mailbox at least once every day on the weekends.

The timely replies in discussions were super helpful. It really felt as though I took this in person with all of the built-in help and support.
Student quote

Practice 5: Synchronize assignments with Canvas calendar

I have also synced all assignments and my office hours (renamed as Ask Me Anything Hours) on Canvas so that there are office hours available around when assignments are due. This proves to be incredibly convenient and useful for both students and instructors.

Practice 6: Reorganize course content

Here are several Canvas LMS tips that have helped in organizing the course content and saved my time. I try to organize everything in modules. Under each module, all items are split into two main components: resources and to-do lists, so students know exactly what assignments they would need to complete for each module. I also adopt a fixed set of systems for titling Canvas items. Items within modules are indented to help with organization.

Weekly agenda and announcements are also hyperlinked to guide students with the course navigation. I could not emphasize enough how much I value the internal messaging in the Canvas grade book that was briefly discussed in my previous post. This feature allows instructors to message students who haven’t submitted yet or who scored less than a certain point. Definitely a slick way to send quick emails to a target group.

Recently, I have been experimenting with a range of visual cues (e.g., emojis) to categorize course content. An example is provided below.

Screenshot of the module view of the course, demonstrating using of emojis as visual cues next to assignments. A written assignment has a pencil and paper emoji, a quiz has a question mark emoji, etc.

There was also a recent post on using emojis for visual way finding and fostering a friendly tone in online classes here: My Experience with Emojis in Online Courses: Affordances and Considerations.

Conclusion

It’s always best to keep an open mind when trying out new teaching practices and adapt them to your individual style and subject matter.

If you have any online teaching practices that you’re fond of, please feel free to contact me at Xiaohui.Chang@oregonstate.edu as I will be very excited to hear them and test them out.

Why I love Research Rabbit

Visualization of Search Results

A Tool for Discovery

Free Forever

Research Rabbit Syncs Collections to Zotero

A Tool for Sharing and Collaboration

How to Explore Research Rabbit on Your Own

So What Happened with the Zombies?

References

Why is documentation important?

General recommended documentation principles

Documenting course designs

General ideas

Intended learner journey

Content, or how documentation is written

Video tutorials

Sources, or where content creators store documentation

Publications, or how someone can find what they are looking for

Documentation Body

Conclusion

References

Creative Discussions

Successful Outcomes

Supportive Instructional Strategies

Supporting Executive Functioning Deficits

Supporting Visual-Spatial Deficits

Supporting Auditory Processing Deficits

Supporting Nonverbal Learning Deficits

Supporting Language Processing Deficits

Available Accommodations at OSU:

In the Comments Below, Tell Me:

Resources to Explore:

Types of Ungrading Practices

Approaches to Assignments

Student Participation

Interaction

Mastery Orientation

Challenges to Implementation

Takeaways

References

NDAs and Open Pedagogy

Non-Disposable Assignments (NDAs)

Benefits and Value of NDAs

NDA Design and Students as Producers

Examples & Resources

References

Overview of Ungrading

Assessment Design Considerations

Decenter grading and communicate (un)grading practices

Set a structure for ungrading

Reflect on pedagogical and assessment practices

Teach students to view mistakes as a necessary step in the learning process

Care for students and their learning

Be aware that ungrading can increase student anxiety and uncertainty

References

Intro

Difficult by design

Right to repair principles

Applicability to Instructional Design

How we could do it

General Documentation for Course Elements

Side by Side Code Blocks Tutorials

Learner Journey and Alignment

Conclusion

References

Introduction

Practice 1: Adopt a variety of communication methods

Video Tutorial Example: Creating a random sample using XLSTAT

Practice 2: Create a Q&A Discussion Board

Practice 3: Estimate the amount of time taken for each assignment

Practice 4: Ensure timely replies

Practice 5: Synchronize assignments with Canvas calendar

Practice 6: Reorganize course content

Conclusion

Contact Info