Illustration of educational items such as papers, ruler, glasses, formulas, grades. — Image by chenspec from Pixabay

This post is the second installment in the series that describe the main characteristics, major benefits, design considerations, and practices and challenges of implementing an ungrading approach. This second blog presents the types of ungrading practices, challenges to implementation, and main takeaways derived from the book chapters and discussion with my colleagues in the Ungrading book club.

Types of Ungrading Practices

To begin, it is important to recap that the underlying concept supporting ungrading is deep, extensive, and formative feedback. This means that instructors are expected to design low-stakes formative assessments and devote substantial time and effort to craft feedback that students can use to revise their work. This section summarizes several contributions the book chapters authors made in regards to pedagogical practices, strategies, tips, and resources to adopt ungrading. Instructors can combine the ungrading practices or use them as stand-alone activities.

Approaches to Assignments

Portfolios: Students can build their portfolios with different digital tools that allow them to create personal or professional materials that are useful beyond the class (e.g., website, content curation). The critical element in a portfolio assignment is that there needs to be space for critical thinking and metacognitive work that can be shared with others. An additional element can include portfolio conferences. For these conferences, students meet with their instructors to review their course work and make annotations about their learning journey (they can also discuss their final grade).
Project-based Learning, Problem-based Learning, Inquiry-based Learning: Students work on activities that relate to their own experiences, real-life applications, and ill-structured scenarios. These activities encourage students to work with others, find solutions, investigate deeper, and apply concepts studied in the course to realistic situations.
Staged Assignments: Students work on reviewing/redoing assignments to allow them to learn from the feedback they received from their peers and/or instructor.
Minimal Grading: Use of a holistic or simplified grading schema (e.g., pass/fail, strong/satisfactory/weak).

Student Participation

Contract Grading: Students can be graded over the labor completed. Students are responsible for reviewing their workload in the class and determining how they will accomplish it. Students will be in a process of understanding why grades matter to them and that the grade they give themselves will be attached to the amount of work they complete. Students sign a contract that clearly specifies the assignments and student responsibilities to achieve an A-C letter grade in the course. This grading system can allow students to negotiate their contracts with instructors.
Process Letters: An activity where students describe their learning process and how they evolve in their work in the class. This can be multimodal (e.g., presentations, reflections that combine audio, video, and text) and/or accompany major assignments.
Student-made Rubrics: Students can develop their own rubrics, which can become a learning activity in itself.
Participatory Voices: Students can contribute to course content by creating content, adding items to the syllabus, selecting the type/format of feedback they want to receive, evaluating peers, and developing an intellectual voice. Through self-evaluation and peer evaluation, students can reflect on their learning, understand the process of evaluating others, and focus on excellence and building confidence. Students are given a set of guiding questions to engage in self-and peer evaluation. At the end of the project or term, they recommend a grade for themselves and their peers.
Declaration Quiz: A quiz that asks students to select a checklist of the assignment requirements that they have completed. This can be a low-stakes assignment that helps students reflect on how they accomplished the task. Instructors can create declaration quizzes for each assignment and associate the number of points to the letter-based system.

Interaction

Peer Assessment: When students work in groups, they can evaluate each other. Students can write about their contributions to the group projects as well as their experiences with the team. This can give instructors a view of the team dynamics and activities that are not usually visible.
Grade-Free Zones: This involves reviewing major assignments and/or providing a sandbox space for students to experiment before they engage in completing formal assignments. Students can submit early assignments or portions of them for peer comments or the instructor’s early feedback.

Mastery Orientation

Mastery Learning Artifacts: Students collect learning artifacts that they have developed to demonstrate their mastery of the learning concepts based on the exemplary work and expectations provided by the instructor. Students submit these artifacts at the end of the term. In addition, students describe the areas of growth based on the instructor’s feedback (e.g., revisions).
Single-point Rubrics: This type of rubric includes criteria and fixed binary points (done = 1; not done =0). Comments can be added to either point to note the improvements to be made (in case it is not done) and to highlight the aspects that go beyond expectations. A benefit of this type of rubric is that it encourages mastery of content and keeps students’ focus away from the grade itself.
Feedback Logs: Students collect feedback and identify the areas in which they received more feedback, work out strategies to improve those areas, and reflect on the ways they are learning.
Feedback and Revisions: Students work on a series of drafts, and the instructor provides comments that students are expected to incorporate in the next revised draft. A grade can be added to the final draft.
Self-Assessment: Consider metacognitive activities that engage students in their own evaluation of learning and in dialogue with the instructor. Encourage students to develop their own standards and self-scrutiny practices.
Student Individual Plan: Students articulate goals and values for themselves about a class or a project. The instructor can help students by providing reflection guidelines and templates for developing their own goals.

Challenges to Implementation

While ungrading encourages a shift from a focus on grades to a focus on feedback and metacognitive activities for student learning and success, its implementation is not without challenges. The challenges range from local critiques to structural and how-tos.

One of the biggest challenges is the misunderstanding of what ungrading involves –an active activity that engages students and instructors with grades as a system, which is different from not grading. Without having a clear understanding of the concept itself, the rationale behind it, and how it will benefit students more than a grade-based system, using alternative means for grading may jeopardize the student learning experience.
A second challenge is the structural system of grades that prioritizes performance over learning. If the focus continues to be on how students perform in a class rather than on their learning, Kohn and Stommel argue that using an ungrading system that gets rid of grades will not be sufficient to push toward a system that creates learning spaces for critical thinking, reflection, and metacognition.
A third challenge involves the redefinition of the curriculum, innovative pedagogy, and how to assess learning. If the idea of content coverage and memorization of facts prevails, learning is treated more as information transfer –from the instructor or textbook to the students. In this transfer, students may not necessarily own their learning. Along with this is the way assessments are designed to emphasize judgment of students’ performance. If the teaching method does not allow room for real learning, ungrading will not make a difference. Thus, the convergence of changes to the curriculum, pedagogy, and assessment methods is of utmost importance.
A fourth challenge is more systemic and structural. Kohn argues that control, in many educational cases, prevents students’ choice and voice in their learning journeys. If ungrading is to have a way in educational contexts, instructors, and even administrators, will be invited to relinquish some of the control they exert over students’ performance to welcome students’ decisions related to their learning needs and interests.
A fifth challenge is a deep and widespread belief that grades reflect learning and action. There is a great concern that if grades are to be eliminated, students will not complete their assignments, need to do more work, or even skip classes. Also, instructors will have to “grade” more and be overburdened.
A final challenge is the over-reliance on rubrics that, according to Khon (foreword, p.xvii), is a system for “judging students…They offer umpteen different axes along which to make students think about their performance— often at the cost of becoming less immersed in what they’re doing.” It is not that ungrading does not provide guidance but it is important to avoid overcontrol evaluation practices. Instructors will need to analyze when and how rubrics help students focus on the learning process (and not solely on the points they get).

Takeaways

The book offered clear rationales, experiences, and strategies that instructors could consider if they feel they want to move away from the grade-focused system. In addition, as a designer, I have a better understanding and collection of resources to use during my consultations with faculty who might be looking into authentic and alternative means for assessment and grading.

Ungrading requires a reconceptualization of the curriculum, pedagogical, and assessment practices. If an alternative means of assessing student learning is to be implemented, the content, activities, and assignments need to open opportunities for students to engage in their own process of learning, reflection, and feedback. If we don’t level the playing field for students, no grading (or ungrading) system would be worth trying.

Grades are considered to be problematic because they contribute to widening the educational equity gaps. Ungrading, as a student-centered approach, can help mitigate some of the inequalities that students experience for access to successful learning. Since not all students come with the same knowledge and skills, ungrading, as a system that personalizes learning and assessments, will orient each student to focus on the feedback that they need.

Ungrading does not mean that instructors do not grade or that students have a free pass. Ungrading requires a deeper understanding of what learning means and how to design learning activities and contexts in which it can be evidenced. There is no universal magic approach to do it. If you are seriously considering moving to ungrading practices, start small, one step at a time.

Have you ventured into ungrading? If so, how did it go? What works and what does not? If not, what are your thoughts about ungrading? I’d like to invite you to share comments or experiences.

References

Blum, S. D. (2020). Ungrading: Why Rating Students Undermines Learning (and What to Do Instead). West Virginia University Press.

Stommel, J. (June 3, 2022). The word “ungrading. [Twitter post]. https://twitter.com/Jessifer/status/1532921663980986369

Warner, J. (January 4, 2016). I Have Seen the Glories of the Grading Contract…and I’m not going back. Inside Higher Ed. [Blog post]. https://www.insidehighered.com/blogs/just-visiting/i-have-seen-glories-grading-contract

Introduction

Getting students to read the syllabus is often a challenge in online courses. It is not uncommon for students to ask faculty questions that have answers easily found in the document. Even if students do read the syllabus, they may only skim through it. Ways to encourage a thorough reading include strategies like “easter egg” hunts where students find particular items to pass a syllabus quiz. This article will explore another method that uses a software application called Perusall, which is designed to encourage close reading.

Perusall is used at the Oregon State University Ecampus as a learning technology integration with Canvas, the learning management system. Using Perusall, students can highlight, make comments, and ask questions on a document. There is a grading interface with Canvas and a variety of settings, including reminders for students to complete the assignment. It offers a useful way for students to engage with the syllabus together, which can lead to closer reading than if they had done so individually.

Results

To test this idea, a professor used this approach with a 400/500 class that involved multiple assignments in Perusall throughout the term. If the syllabus assignment proved useful in Perusall, then it would also serve as an introduction to the platform for students. Here are some examples of student engagement that resulted from this activity:

Requests for additional background material to check for prerequisite knowledge.
Interest in the website of the professor (linked to in the syllabus).
Shoutouts to the course teaching assistant.
Concerns about the prerequisites for the class, which were addressed by the professor specifically.
Questions about technology used in the course based on students’ previous experiences in other courses.
Gratitude for ending the course week on Mondays instead of Sundays.
Confirmation by a student that the textbook is available as an electronic copy at the library.
Inquiries into the length and other logistics of Zoom office hours.
Excitement expressed by a student about a focus paper requirement.
Queries about how grade numbers are rounded and types of quiz questions.
Exchanges between a TA and a student looking forward to further discussions in Perusall.
Clarifications about the different work expected for undergraduates and graduates.
Ideas about how to communicate as a class.
Questions about the details of major assignments.
Appreciation of opportunities to participate in frequent knowledge checks.
Thanks for the late assignment policy and statements about flexibility.
Advice about how to check assignment due dates.

Conclusions

Students’ comments and conversations helped to initiate a feeling of community in the course. Many logistical issues were clarified for students by providing and encouraging a forum for discussion. There were highlights and comments by students on seven of ten pages of the syllabus. The three pages that were not discussed were university required policies. There were no negative comments about using Perusall as a syllabus activity. So this seems like a good method to engage students at the beginning of a course to prepare them for success. It may be especially helpful for classes using Perusall in other assignments because it provides a way to practice using the application.

References

Johnson. (2006). Best practices in syllabus writing: contents of a learner-centered syllabus. The Journal of Chiropractic Education, 20(2), 139–144. https://doi.org/10.7899/1042-5055-20.2.139
Lund Dean, & Fornaciari, C. J. (2014). The 21st-Century Syllabus. Journal of Management Education, 38(5), 724–732. https://doi.org/10.1177/1052562913504764
Sager, Azzopardi, W., & Cross, H. (2008). Syllabus selection: innovative learning activity. The Journal of Nursing Education, 47(12), 576–576.
Stein, & Barton, M. H. (2019). The “Easter egg” syllabus: Using hidden content to engage online and blended classroom learners. Communication Teacher, 33(4), 249–255. https://doi.org/10.1080/17404622.2019.1575440
Wagner, Smith, K. J., Johnson, C., Hilaire, M. L., & Medina, M. S. (2022). Best Practices in Syllabus Design. American Journal of Pharmaceutical Education, 8995–8995. https://doi.org/10.5688/ajpe8995

NDAs and Open Pedagogy

One of the principles upheld by the open pedagogy movement is that the role of the learner must be active and the tasks that they engage in must be meaningful. These are not new ideas by any stretch, but as we move toward a more open pedagogical environment, it becomes necessary to examine the types of assignments that we create and assign. How do these tasks contribute to efforts to democratize education and increase learner autonomy, engagement, and freedom? What makes an assignment open? To answer these questions, this post will explore the relationship between open pedagogy and open assignments.

While interest in the topic of open pedagogy has steadily gained steam in the roughly 50 years since its inception, definitions of and familiarity with the concept of today’s open pedagogy vary among educational practitioners. Some discussions focus on the expansion of the use of these resources. You might be hard-pressed to find an instructor who hasn’t at least reused open content (See 5R framework of Open Content) or encountered such materials as a student. Other conversations emphasize the remix and revise aspect of open content and pedagogical practices, and the number of faculty-created Open Educational Resources (OERs) intended to replace the traditional textbook is ever increasing. Still others have turned their attention to implementation of open pedagogical practices that put students in the role of content creators rather than passive beneficiaries of innovations in open content. In our efforts to create tasks that accomplish this shift in the role of the learner, we must first ask what the value of the task is for the student, peers, and the larger community, and what life will such a task have after its completion. To answer these questions, we can look to the non-disposable assignment (NDA).

Non-Disposable Assignments (NDAs)

To define the characteristics of this type of assignment, it is helpful to first define what we mean by “disposable” assignment. It is safe to say that we are all familiar with these types of assignments: typically they include one-off or busy work tasks designed to be filed away and forgotten as soon as completed and graded. In his article What is Open Pedagogy (2013), David Wiley described the disposable assignment in this way:

These are assignments that students complain about doing and faculty complain about grading. They’re assignments that add no value to the world – after a student spends three hours creating it, a teacher spends 30 minutes grading it, and then the student throws it away. Not only do these assignments add no value to the world, they actually suck value out of the world.

Online learning within the confines of a learning management system (LMS) is particularly ripe for these types of assignments. In fact, one could argue they are designed for this type of task. In an online course, instructors create and post the assignment, students complete it, instructors grade it, the course ends, student work is deleted, the course is rolled over, and the next crop of students begins the cycle again. The work is designed to be contained within the LMS for the duration of a course, not to be shared with a broader audience of students or colleagues.

As an alternative to the disposable assignment in favor of more meaningful tasks, Wiley coined the term Non-Disposable Assignment. The NDA (also referred to as a renewable assignment), in contrast to its binworthy counterpart, is an assignment that “adds value to the world.” Later definitions, no doubt influenced by the growing open pedagogy movement and the promotion of the use of OER materials, go further and hold that an NDA ought to produce a resource that is openly published so that “others can find, use, and if desired, repurpose or update the work,” (Jhangiani, 2015; Wiley, 2013; Wiley et al., 2017; Wiley & Hilton, 2018). Such assignments put the learner in the role of creator and impact or benefit an audience beyond the instructor and student. Because the premise of the NDA is that it can not only be shared widely, but also revised and reused without permission by both instructors and students, the content should be openly licensed. Considering the role of learners as authors of the content, they should have a say in determining the type of open license appropriate for their work.

In the article A Conceptual Framework for Non-Disposable Assignments: Inspiring Implementation, Innovation, and Research, Seraphine et al (2019) provide a set of principles NDAs must adhere to. The Five Principles are summarized as follows:

NDAs fundamentally involve information collaboration and exchange.
As forms of responsive and responsible pedagogy, NDAs involve communication throughout and opportunities for revision, creativity, modifying key terms and objectives, etc.
While NDAs might not necessarily involve communal assembly, the resulting product or practice must always be shared outside the teacher-student dyad, creating opportunities for communal access of the NDA as an information resource
NDAs produce learning through cooperative critique.
Because they are not exams or isolated writing assignments, NDAs involve innovation as a fundamental concept.

Benefits and Value of NDAs

Apart from their ability to reach a broad audience, NDAs increase student motivation, engagement and autonomy resulting in improved achievement of learning outcomes. (Ariely, Kamenica, & Prelec, 2008; Chalofsky & Krishna, 2009; Pink, 2011). While this claim may be at least in part anecdotal, it follows that when students know that their work may be used by peers, faculty, and colleagues across their field in the future, investment in the quality of their work increases. Non-disposable assignments and authentic assessments have the potential to add value in other areas by:

promoting community engagement.
fostering innovation.
interrogating and dismantling systems of oppression by centering experiences of historically marginalized groups.
providing opportunities for culturally rich content (inject identity, student influence over content).
cultivating information literacy skills.
increasing accessibility to educational resources.
helping students communicate in writing to a general audience.
offering opportunities to collaborate with peers around the world.
increasing self-regulated learning and autonomy.

Despite their numerous benefits, NDAs are not without challenges and risks. For example, some students may be resistant to the exposure and the vulnerability inherent in creating open content for broad use. In such cases, instructors must provide alternative assignments or options not to share. Because student-generated content requires substantial metacognitive skills, instructors must ensure that NDAs involve significant scaffolding at multiples stages in the learning process (Zimmerman, 1990; Zimmerman, 2002). Furthermore, the open nature of student-generated content presents a quality control challenge that instructors must anticipate and address by providing multiple opportunities for revision and peer review.

NDA Design and Students as Producers

Implementing assignments that have the potential for broad impact beyond the typical instructor-student dyad can seem daunting. After all, conceptualizing and creating tasks that effectively revise the role of student from a passive one to actual content creators is no small feat. However, it is important to remember that the scope can vary widely. Indeed a well-crafted discussion between two students might form the basis for a renewable assignment. Other examples may include experiential connections such as student-generated podcasts; the production of flyers, guidelines, or materials for local community organizations; or even collaboratively created and maintained global resources such as wikis like the Chemistry Library. Whatever the scope, NDAs can—and arguably should—be iterative allowing for innovation and adaptation to various contexts.

With the role of the student as producer in mind and an understanding of the potential pitfalls that an open assignment might present, faculty can then turn to the conventional principles of backward design to develop meaningful student learning experiences that add value for learners and their peers while also promoting community engagement.

Instructors should consider the role of students as they develop non-disposable assignments to put students in the role of content creators. Source: The Non-Disposable Assignment: Enhancing Personalised Learning – Session 1 Slideshare, CC Attribution-ShareAlike

Examples & Resources

References

Jhangiani, R. (2017). Ditching the ‘‘disposable assignment’’ in favor of open pedagogy. http://teachpsych.org/E-xcellence-in-Teaching-Blog/4583103.
Paskevicius, Micheal, Knaack, Liesel (2017). The Non-Disposable Assignment: Enhancing Personalised Learning – Session 1 (Slideshare) https://www.slideshare.net/mpaskevi/the-nondisposable-assignment-enhancing-p
Seraphin SB, Grizzell JA, Kerr-German A, Perkins MA, Grzanka PR, Hardin EE. A Conceptual Framework for Non-Disposable Assignments: Inspiring
Wiley, D. (2013, October 21). What is Open Pedagogy? Retrieved 15 June 2022, from https://opencontent.org/blog/archives/297
Zimmerman, B. J. , Becoming a self-regulated learner. Theory into Practice, 2002; 41, 65-70. doi: 10.1207/s15430421tip4102_2.

Bringing Critical Language Awareness to Instructional Texts and to How You Evaluate Student Writing

Instructional designers spend a lot of time working with words – they’re the raw materials that instructors share with us in the development of their online courses – but it’s often unclear what liberties we should take with instructors’ writing, and, on a related note, how we should coach instructors to assess their students’ writing. If inclusivity and equity are central values in course design, how might that be reflected in the seemingly mundane act of copyediting instructional texts or in setting up an instructor’s rubric to include “standard” grammar as a criterion? When the instructional designer copy edits the instructor’s words, or the instructor assesses a student’s writing proficiency, what raciolinguistic dynamics does that enact? Critical Language Awareness gives us the insight that our “language conventions and language practices are invested with power relations and ideological processes” (Wendt and Apugo), so the work we do with instructors’ and students’ words should be understood in the context of those power relations. What follows is a letter addressed to instructors that I hope will spark conversation on these issues, in the hopes that all the participants in the course – those who design, facilitate, and inhabit the spaces created by these texts – can reach their goals while using their own voices.

How would you like me to approach copy edits and other confusions?

Dear instructor,

Let’s start first with the practical and (seemingly) neutral question of how I handle your instructional texts, as I will read all the course materials you share with me. A common agreement I reach with instructors is to let me correct any obvious typos, misspellings, and punctuation issues, but to require I check with you in all other cases. Sometimes, as a colleague of mine has shared, instructors will ask the instructional designer to leave typos untouched, because they want to model authenticity, vulnerability, and a focus on meaning over surface perfection. This can serve as an invitation to students to let go of the fear and shame associated with making mistakes – so I’d be glad to help you towards this goal, as well, provided your intended meaning is still clear. Keep in mind that Ecampus students have expressed concerns when they notice a pattern of spelling or grammatical errors in a course, citing the typos as evidence of lower-quality, less credible course materials or a lack of instructor presence (McAlvage and Racek). But if you consider the imperfections in your writing to be a feature rather than a bug, you should make that explicit to students; let them know in what ways it’s intended to serve as a model for their own writing or for their overall approach to your course. Typos aside, I will also ask about instructions that you find obvious (and that may be pretty clear to me, too), because I am trying to anticipate all the ways your instructions could be misunderstood by others. So if it seems that I am being a bit obtuse about what something you wrote means, that’s the reason! A related question is on tone – are you open to receiving my feedback in this area? Our instructional design team encourages you to use a welcoming tone; students turn away from instructors when a “punitive” or commanding tone is used in a syllabus by, for example, seeking their support less often (Ishiyama et al. qtd. in Roberts 47). If you agree, I can help you spot those areas that feel less welcoming. For my part, I will strive in my communications with you to adopt a collegial tone, but should you find that is not the case, please let me know.

Now that we’ve thought through some of the practical questions on how I’ll work with your words, I’d like to ask you to reflect more broadly on your relationship to your writing and language use. How did you learn to write in your field, and what experience would you like your students to have with your use of language in your course? What do you expect of your students’ writing, and is it something that your outcomes assess? As you think over your responses to these questions, let me share a bit about my relationship to language and writing and how it affects my work.

Who are you to correct me?

My father used to tell a joke about a guy touring a college campus who stops to ask a student, “Where’s the library at?” and is told in response, “You should never end a sentence with a preposition.” He then rephrases his question, “Where’s the library at, [ jerk ] ?” My father taught writing, after earning his PhD in English literature, and later wrote books, so I grew up believing a command of “good” written English was my genetic inheritance. But now I can see that my mastery of a particular language standard has mostly to do with my immersion in a socioeconomic group whose language practices are privileged through white supremacy. So while the joke shows that correcting other’s language can open you up to counterattack – Who are you to correct me? What makes you right and me wrong? – many will not be empowered to answer back. Nor does this language privilege typically operate on the level of overt interpersonal confrontation, as in the joke – it’s usually invisible – “a product or effect of assessment systems and structures, our [standard operating procedures] in classrooms and other places where language is judged, despite anyone’s intentions, that produce political, cultural, linguistic, and economic dominance for White people” (Inoue 7). Enforcing language standards is an oppressive practice, a way to gatekeep who can succeed and who cannot, and in the case of the joke, who is subject to judgment for the simple act of asking directions to the library.

The joke also gives us the insight that language standards are a self-replicating system of oppression, as each student who is coached to evaluate language in this way internalizes the standards and is then given license to impose them on others. As a result of my own immersion in and sense of “ownership” over standard English (Whiteness as Property), I brought into my instructional design practice a certain unexamined confidence about my ability to critique and correct others’ writing. I wanted to help instructors present instructional texts that were clearer, more succinct, error-free – more like the way I wanted the writing to sound than the way the instructor had written it. I had to stop and ask myself whether that was doing instructors a service or not. For example, in the case that a course shell was designated for a single instructor (and should rightfully showcase their voice), a colleague felt the edited text misrepresented the instructor to their students – there would be a disconnect between the “corrected” writing in the static course shell versus the writing that would appear once the term got underway. My corrections were also potentially an erasure of the instructor’s identity and the imposition of a certain language standard that wasn’t desired.

Where do you see yourself, if at all, in my approaches to correcting others’ writing? And what role would you play in the linguistic power struggle set up by my father’s joke? Are you the guy who asks for directions, the college student who corrects him, a bystander, or perhaps a mediator of some sort? I hope these anecdotes have helped you to reflect on your own positionality and how that shapes your approach to your students’ writing, and, specifically, to its evaluation.

How will you evaluate and respond to your students’ writing?

Before you answer, tell me, does your course devote time to teaching students to write according to a particular standard? Are there specific lectures, learning materials, or learning activities that scaffold how to write in this way? No? Putting aside the issue of how you’ll assess students’ writing given the raciolinguistic considerations, we generally don’t assess students’ skills in areas that aren’t part of the course itself, and we are compelled to align our assessments to show mastery of the stated outcomes of the course (What is alignment within a Quality Matters framework?). If written expression doesn’t appear in your outcomes, should you penalize students when surface features of their writing don’t match your understanding of what is standard?

Another consideration when you assess students’ writing is your own mastery of academic and dominant language standards. Respectfully, I have observed quite a few assignments in which the very instructions exhorting students to polish their writing and produce grammatical, error-free texts themselves contain spelling and grammar errors. I have even seen a grading rubric that spelled grammar as “grammer”! So, I would invite you to think about your own writing and whether you feel comfortable determining your students’ mastery of these language standards. If you do find your approach reflects a perfect or nearly perfect achievement of standard writing, how did you come about that position, and is it legitimate to wield your knowledge of dominant language practices in the way you are planning?

Who is served by your attention to students’ writing, and who is disadvantaged?

You might very well respond that college students and professionals need to write using the dominant standard as a practical necessity, since they will be judged if they do not, and their life prospects will be impacted (in much the way you and your course may be judged if students find a pattern of typos or grammatical idiosyncrasies). This may be true, but we must acknowledge how it puts “the onus on language-minoritized students to mimic the white speaking subject.” Where would you like to focus your attention? On compelling your students to meet a standard, when achievement of that standard will not wholly shield them from discrimination, or on compelling yourself to “imagine and enact alternative, more inclusive realities” (Flores and Rosa 155, 168)?

Rather than positioning yourself as the students’ judge, you might instead be their supporter, connecting them to resources like a writing center that will help them produce more polished writing. You can promote these services in your syllabus, announcements, or, for example, directly alongside an assignment’s grading criteria:

Your final draft should show evidence of having been edited and revised for clarity and organization. Reach out to the Writing Center for an appointment if you would like their feedback on global aspects of your writing or would like coaching on specific areas of grammar and punctuation. If you are a multilingual writer, the center offers Multilingual Support.

Keep in mind that, depending on the approach of the writing center, your students may end up being coached to conform their writing to the dominant standard. If you’ve decided to forgo judging students’ writing on the basis of its surface conformity to these standards, you might make it clear through a rubric which outcome-related knowledge and skills you will instead evaluate for evidence of learning. I acknowledge this is hard work to do, hard work to let go of language standards you may have invested a great deal of time in mastering, and which feel important to your discipline. But it is possible, as I’ve seen in the approach taken by OSU’s gateway English Composition course, WR 121, in which students achieve outcomes related very specifically to writing, while the focus of evaluation is primarily on the time and labor invested in their writing process, rather than on the perfection of their final product.

Turning back towards the work I do with your course, I am challenged by the same raciolinguistic considerations, so, to conclude, I would like to remind both you and me that writing and proofing services are something I can provide – but it’s not required that you make use of them in your course development. In the same way that you probably shouldn’t assess students’ writing if it’s not a part of the stated course learning outcomes, I also shouldn’t attempt to shape the writing and language in your course without your express permission, because this is not a part of my unit’s guiding standards for course design, the Ecampus Essentials and Exemplaries. And, because more broadly, when we focus on the ideal of a standard English, we perpetuate racial hierarchies. You are entitled to your own voice, form of expression, and approaches toward writing (and you might consider how your students have this right, as well).

Thanks for reading this! I hope this has given you an opportunity to reflect critically on some of the language practices that so many of us in higher ed engage in. I look forward to hearing your reactions and coming up with an approach that meets your pedagogical goals while also being concordant with your values.

Finding alternatives

I have raised considerations in this post about how, and if at all, you should assess your students’ writing, without doing much to ideate alternatives, so I’d like to share a few resources. To learn more about how you can create an equitable environment for culturally and linguistically diverse students, read my colleague Nadia Jaramillo’s post, Dimensions for Culturally Responsive Learning Design. For a compelling take on alternatives to grading writing based on a white supremacist standard, which informs the approach of WR 121, read Asao Inoue’s book Labor-Based Grading Contracts. For a quicker read, I also recommend you review the three main approaches to grading the writing of multilingual writers – each with unique benefits and drawbacks – which might help you to clarify your current practice and to be more intentional in the future. Finally, if you, like me, are working to undo many of the lessons you’ve learned and absorbed about dominant writing practices, you might also be interested to read about a related concept – how perfectionism, seemingly a race-neutral value that drives the pursuit of excellence, is instead a feature of white supremacy.

Works Cited

Flores, Nelson, and Jonathan Rosa. “Undoing Appropriateness: Raciolinguistic Ideologies and Language Diversity in Education.” Harvard Educational Review, vol. 85, no. 2, Harvard Graduate School Education, 2015, pp. 149–71.

Inoue, Asao B. Labor-Based Grading Contracts : Building Equity and Inclusion in the Compassionate Writing Classroom. The WAC Clearinghouse, 2019.

McAlvage, Katherine, and Brittni Racek. “How do you approach (if at all) grammar corrections with your instructors?.” Received by Ecampus ID team, 18 May 2022. Slack channel exchange.

Roberts, Maxine. T. (n.d.). CUE Syllabi Review Guide Appendix, Center for Urban Education.

Wendt, Jillian L., Ed, and Apugo, Danielle L., Ed. K-12 STEM Education in Urban Learning Environments. IGI Global, IGI Global, 2019.

By Naomi R. Aguiar & Tianhong Shi

For eight straight years, OSU’s online bachelor’s programs have been ranked in the top 10 in the nation by U.S. News & World Report. How do we achieve that? One way is through collaboration between faculty and online learning design experts. Ecampus instructional designers support and partner with faculty to ensure that evidence-based research is applied in the courses we develop.

Another way is through research conducted by our very own faculty at OSU. In the Research Unit at Ecampus, faculty can receive funding to conduct research in online teaching and learning through the Research Fellows Program. In this program, funded faculty members conduct original research with students and instructors over the course of a 15- to 18-month period. At the conclusion of their projects, faculty write white papers, which are open access articles published by the Research Unit and catalogued in the OSU Scholars Archive. These white papers provide actionable insights that both instructional designers and faculty members can directly apply to course design. Below, we share two specific examples from recently published white papers that can reinforce or inform decisions in course design.

Visual Design Matters

In a recently published white paper, researchers Yuzhi Sun and David Nembhard conducted an experiment examining how graphical displays of information and the use of highlighting can impact a learner’s engagement with the material, their “cognitive load” (i.e., the amount of information a learner is tasked with), and their learning performance. Using EEG (a method that measures different types of brain waves by placing electrodes on the scalp), Sun and Nembhard found that presenting information as tables rather than dot graphs increased students’ cognitive load, but also increased their engagement with the material and their retention of the information. Highlighting the most essential information also had a positive impact on students’ ability to retain learned information.

Sun and Nembhard’s (2022) findings support the Ecampus Essentials guidelines for online course design; specifically, visually representing course content in multiple ways that align with weekly and course outcomes. In many of our Ecampus STEM courses, data are presented in tables and explained by instructors in several different ways, such as in narrated PowerPoints, light board learning glass videos, or whiteboard screencast videos.

Here is a specific example of how this is used in one of our courses, the Differential Calculus for Engineers and Scientists (MTH251). The figure below shows a table used in a math problem-solving video that helps students categorize information into what is already known and what needs to be solved for.

https://media.oregonstate.edu/media/t/1_rpfn2l96

Another example comes from a habitat analysis course (Habitat Analysis 1), in which information is highlighted in videos to bring students’ attention to important content information. The red highlighted areas in the figure below clearly indicate a grizzly bear’s habitat.

https://media.oregonstate.edu/media/t/1_bcwtpg1c

On Writing Intensive Courses

In another white paper, Andrew Bouwma describes a study he conducted to help instructors provide timely feedback to students in writing intensive online courses. In a Zoology 349 course, Bouwma examined students’ acceptance of a web-based peer review tool, Peerceptiv, as well as the extent to which using this approach could improve students’ writing skills. Overall, Bouwma found that students’ acceptance of this peer review tool was high. Most students agreed that the Peerceptiv tool was easy to use and that comments from their peers were helpful. Students also agreed that the Peerceptiv assignments enabled them to think more critically about the subject matter and helped them produce better writing assignments. And beyond positive perceptions of the tool, students further demonstrated significant writing gains in both their thesis statements and in their essay structures.

Bouwma has since held several information sharing sessions about Peerceptiv tool for other instructors. Now, more biology and STEM courses are using the Peerceptiv tool, and it has even been creatively adapted into a Business Applications Development course (BA272) that teaches python coding. In this course, coding assignments were once assigned to students individually and debugging errors in coding could be a daunting task. With the use of the Peerceptiv, peer reviewing has assisted students in identifying coding errors more quickly. One instructor also noted that the use of this tool has improved the quality of peer feedback, as well as provided students with insights to improve their programming skills. The successful use of this tool in other courses highlights the broad application of Bouwma’s original study to other online learning contexts.

Want to Learn More?

Each year, the Oregon State University Ecampus Research Unit funds projects, up to $25,000 each, to support the research, development and scholarship efforts of faculty and/or departments in the area of online education through the OSU Ecampus Research Fellows program.

This program aims to:

Fund research that is actionable and impacts student online learning
Provide resources and support for research leading to external grant applications
Promote effective assessment of online learning
Encourage the development of a robust research pipeline on online teaching and learning at Oregon State

Fellows program applications are due Nov. 1 each year. If you are interested in submitting an application, reach out to Naomi Aguiar, the OSU Ecampus Assistant Director of Research. Research Unit staff are available to help you design a quality research project and maximize your potential for funding.

References

Bouwma, A. M. (2021). Testing the Efficacy and Student Acceptance of a Peer-Review Writing Program in an Online Course. White Paper. Corvallis, OR: Oregon State University Ecampus Research Unit.

Sun, Y., & Nembhard, D. A. (2022). Modeling online learning performance with biometrics: Current study and future directions. White Paper. Corvallis, OR: Oregon State University Ecampus Research Unit.

Ashlee M. C. Foster, MSEd | Instructional Design Specialist | Oregon State University Ecampus

Whether a pedagogical approach is affirmed by research and/or practical evidence intentional design and effective deployment of pedagogical strategies are essential. We will begin with an exploration of evidence-based design components, which build upon the characteristics of Project-based Learning (PjBL), as discussed in Project-based Learning (Part 1) – Architecture for Authenticity.

Getting Started

Begin with the end in mind. Take a moment to establish the outcomes, goals, and real-world connections that will underpin the project. Consider using the following elements as your guide.

Identify the Course Learning Outcomes (CLO) students should be able to demonstrate upon successful completion of the course
Identify the intended project outcomes and the alignment to the course learning outcomes
Identify skills students will practice and master while engaging with the project
Articulate the purpose of the project within the contexts of the course, academic program, field of study, and profession
Articulate authentic connections between the project, across academic disciplines, and professional practice
Connect the project to an authentic purpose that extends beyond the confines of the course

Course Design Elements

Next, reflect on how you can design your project to incorporate most of the following PjBL core design elements.

Image credit: Gold Standard Project Based Learning by PBLWorks is licensed under CC BY-NC-ND 4.0.

Authentic Challenge

Initially, consider creating an opportunity for students to self-select a challenge. This can be anything from finding a solution to existing problems, a remedy for historical barriers, answers for disciplinary relevant questions, or asking new questions. Whatever the challenge may be, a best practice is to contextualize it within a real-world context. Affirm student voice and choice by explicitly sharing how the project connects to the academic discipline, professional field of practice, and real issues by providing feedback. Lastly, help students to see how they can connect the challenge to themselves.

Authentic Product

Development of an artifact that is relevant, timely, impactful, and piques personal interest help to bridge the concepts to the real world. To effectively create an artifact that produces a public good, students should engage in an iterative process that includes: planning, prototyping, seeking and applying feedback from diverse stakeholders (i.e., public, target audience, instructor, peers, Subject Matter Expert), personal reflection, and revisions. To determine whether your project is authentic, consider whether the product(s) create a lasting and meaningful impact beyond the classroom. Examples of authentic products could include a business plan to innovate an existing accessibility tool, a podcast to share about (DEI) Diversity Equity and Inclusion practices or to generate oral histories (i.e., audio interviews) of underrepresented populations.

Sustained Inquiry

Incorporation of formal and informal opportunities for students to question, research, gather information, conduct analysis, apply new knowledge, generate additional inquiries, and highlight evidence is key to the design. These opportunities should be integrated into the architecture of the project, but the actions should be student-driven. This strategy will help promote knowledge construction.

Student Autonomy

Create varied opportunities for students to make their own choices, both collectively and individually. Student-driven choice can extend to such elements as question development, selection of public a product, identification of target audiences, establishment of collaboration protocols, application of knowledge and feedback, and prototype revision methods. Doing so situates students as the diver of their own learning process and creates space for students to hone their metacognitive skills (i.e., self-regulation, monitoring, and self-directed learning).

Reflection

Due to its roots in constructivism, reflection is commonly used in PjBL. Reflection is used as a strategy to foster deep learning, personal ownership of learning, assimilation of new knowledge, integration of lived experiences, effective inquiry, assessment of quality, and the navigation of challenges. While serving as a guide on the side, consider integrating activities to foster ongoing reflection of critical questions. Such questions may include:

What is known?
What needs to be known?
What evidence exists?
Will the product have an impact on the world outside of the course? How?
Do I/we bring any personal biases to the project which impacts the design of the product?
Does the design of the product represent the diversity of the target audiences?
What works or does not work? Why?
How can the product be improved? What is the rationale behind the recommended changes?
How can the quality and efficacy of the product be tested?
Does the project extend on what the academic domain and professional field have established? If not, how can the project be modified to contribute additional knowledge or insights?
How does the project connect to my life, my lived experiences, and that of others?
How will the project help me to develop my professional skills?

An example of a PjBL reflective activity is a design journal. Design journals can include text, visualization, and media elements. Each entry can be structured to cover the following: knowledge gained, ideas, sustained inquiry (i.e., questions, additional research needed), the rationale for product changes, and next steps.

Critique & Revision

Integrating activities, such as a design journal, provides students the opportunity to actively critique, revise, and obtain feedback throughout the duration of the project. There is a multitude of scenarios that may call for critique. Students may find their initial idea to be too broad or specific. The original line of inquiry may have been faulty. One may find the product does not generate the intended public good or service. Therefore, revising the goal and creating a new product may be necessary. Alternatively, situations can arise where students learn of a product’s unintended harm, so a new prototype may need to be created. The goal is to create a course climate that is psychologically safe enough to encourage iteration.

Success Tips

Please note that these best practices and design elements offer a framework. Your course is unique. There is an unending list of potential factors that can impact the design of your course and project (e.g., accreditation, professional competencies, academic rigor, program outcomes, administrative expectations, etc.).

Keep in mind that you do not have to incorporate everything and the kitchen sink. Take what you can from existing literature, practitioner testimonials, industry needs, professional practices, real-world examples, and lessons learned from your own lived experiences.
Begin with small additions to your course, assess the impact of those changes, and revise as you deem appropriate.
Remember that nothing will be perfect, and there are always opportunities to improve. Design with the best fit in mind!

Looking Ahead!

You are cordially invited to revisit the Ecampus Course Development and Training Blog for Project-based Learning (Part 3) – Practical Preparation. In the final installment of this series, we will explore additional project-based learning activities, identify opportunities to integrate technology and examine actual project samples.

References

Almulla. (2020). The Effectiveness of the Project-Based Learning (PBL) Approach as a Way to Engage Students in Learning. SAGE Open, 10(3)
Budhai, S. (2016, January 29). Designing Effective Team Projects in Online Courses [blog]. Faculty Focus.
Chen, & Yang, Y.-C. (2019). Revisiting the effects of project-based learning on students’ academic achievement: A meta-analysis investigating moderators. Educational Research Review, 26, 71–81.
Gold Standard PBL: Essential Project Design Elements. (n.d.). Buck Institute for Education.
Grossman, Dean, C. G. P., Kavanagh, S. S., & Herrmann, Z. (2019). Preparing teachers for project-based teaching. Phi Delta Kappan, 100(7), 43–48.
Guo, Saab, N., Post, L. S., & Admiraal, W. (2020). A review of project-based learning in higher education: Student outcomes and measures. International Journal of Educational Research, 102, 101586.
Larmer, J. (2012) PBL: What Does it Take for a Project to be ‘Authentic’? Edutopia
Lewis, R., Gerber, E. M., Carlson, S. E., & Easterday, M. W. (2019). Opportunities for educational innovations in authentic project-based learning: understanding instructor perceived challenges to design for adoption. Educational Technology Research and Development, 67(4), 953–982.
Morgan, T. (2019). Enabling Meaningful Reflection Within Project-Based-Learning in Engineering Design Education. In Design Education Today (pp. 61–90). Springer International Publishing.
Product Toolkits: Scaffolding Guides for Authentic PBL Products. (2012) Buck Institute of Education.
Project Design Rubric. (2015). Buck Institute of Education. Retrieved from: https://www.bie.org/object/document/project_design_rubric

Over the last couple of terms, I joined a series of reading sessions with instructional design colleagues to read Alfie Khon and Susan Blum’s book Ungrading. Why Rating Students Undermines Learning (and What to Do Instead) and discuss the practices and implications of this approach to reconceptualize assessment design and the place of grading. This two-part blog aims to capture the takeaways from those discussions including the main concepts, approaches, types of activities, implications, and challenges of adopting ungrading practices. This first part of the blog covers a brief overview of the concept of ungrading, its major benefits, and design considerations; and the second blog will include a summary of the types of ungrading practices and challenges to implementation ––all derived from the authors’ extensive arguments and examples. For a detailed review and summary of the book chapters, you can also check the blog Assessment Design: Ideas from Ungrading Book.

Overview of Ungrading

The concept of ungrading is sparking widespread interest only recently even though educators have been studying and using ungrading approaches for quite some time. The foundational premise of ungrading is to move away from a focus on grades that judge, rank, sort, and quantify student learning to adopting an approach that focuses on using alternative and authentic means to assess learning such as self-evaluation, reflection, student-generated questions, peer feedback, to name a few. Along with that premise is the questionable ranking that comes with grading which makes students compete with one another in an artificial way. Sorensen-Unruh (chapter 9) sees ungrading as a conversational method that facilitates the communication between instructors and students about how students perform in the class. If, as underscored by the authors, grading and the fact of assigning point values to students’ performance makes more harm than good, then, why use grading? Considering that grading is rooted in our educational systems, many of these authors conclude that it becomes inevitable to grade student learning as it is currently done today.

Several scholars and instructors consider grading to be problematic. First, grades are not good indicators of learning. Blum (chapter 3) argues that grading assumes all students are the same, does not provide accurate information about student learning gains, is consequential, adds fear and avoidance of negative consequences, and is arbitrary and instructor-led. Second, the overemphasis on grades can lead to a decrease in intrinsic motivation, students’ excessive anxiety, and the complexity of quantifying how learning happens (Stommel, chapter 1). Third, it can also decrease interest in learning, students may feel inclined for easier tasks, and critical thinking is lacking (Alfie Khon, foreword). Fourth, grading makes students be fixated more on their grades than on the process of learning, leading them to believe that grades are all that matters in school (Khon & Blum; Talbert, 2020). And finally, too much focus on grades can be detrimental to students’ mental health (Eyler, 2022). However, ungrading does not mean dismissing grades altogether. Instead, Stommel proposes creating a learning space that fosters critical thinking, reflection, and metacognition– all skills that are valuable for 21st-century education. Likewise, Alfie Khon contends that grading can be participatory since it does not require a unilateral decision, and thus, students can also propose their own grades (with the instructor’s reservation to accept them).

“Ultimately ungrading— eliminating the control-based function of grades, with all its attendant harms— means that, as long as the noxious institutional requirement to submit a final grade remains in place, whatever grade each student decides on is the grade we turn in, period.”
(Khon, 2020, p. xv)

While ungrading may be an innovative approach to assessments, it should be thought of carefully and adopted with a clear objective. Ungrading, as pointed out by Katopodis and Davison (chapter 7), needs a structure to be effective, allowing students to envision themselves as authoritative, creative, confident, and active, thus achieving a high impactful goal. As ungrading requires instructors to evolve in their approach to assessment, it does too for students who are expected to engage in a process of self-evaluation, self-assessment, and reflection. This requires engagement in metacognitive practices that many students might not be ready to embark on or don’t know how to do it. In addition, while ungrading is believed to be student-centered, it can deepen equity gaps if guideposts are entirely removed. Sorensen-Unruh (chapter 9) believes that ungrading is a matter of social justice –going beyond the expected student agency and aiming at having students exercise their voice and participate in assessment decisions.

As a whole, Blum (introduction chapter) provokes us all to rethink the nature of grading considering that students’ learning conditions vary, with many enduring inequities at many levels. Blum wants us to keep focused on how “varying assessment and feedback methods contribute to the real learning of real individual learners, rather than imposing an arbitrary method of sorting.” (p. xxii); all for the sake of healthy learning.

These are a few key points about the arguments for ungrading. While this assessment practice is taking force in higher education, there are also many critics and skeptics. The purpose of this blog is not to enter into the discussion and controversy of ungrading, but to share a few perspectives and takeaways after an intense and well-structured book club discussion. In the following section of this part-one blog, I will share considerations for designing for ungrading.

Assessment Design Considerations

Tasks and activities from a laptop computer

The educational system requires all instructors to submit grades at the end of every term. There is dissatisfaction with the current grading practices among many instructors and students as explained at large in the book. Here is where the ungrading movement takes force to provide alternative ways to account for evidence of student learning. Riesbeck (chapter 8) argued that by implementing ungrading practices, students can focus more on the content and feedback than on the grades. The use of critique-driven learning allows for more easily quantifiable efforts, progress, and accomplishment. Each ungrading consideration is dependent on a myriad of factors that may or not apply to each instructor’s context. The bottom line in ungrading is re-envisioning the teaching and learning process, engaging students in active learning, and active self-assessment through feedback. The following are design considerations:

Decenter grading and communicate (un)grading practices

Instructors can encourage students to focus on the process of learning, instead of talking about grades, Blums says, we should talk about the purpose and goals of the activities with students. These conversations can help develop relationships with students to encourage them to own their learning and have a voice in that process. Decentering grades also involves having an ongoing conversation with students, colleagues, and administrators about assessment decisions. Although each instructor exercises their academic freedom, it is also essential to share assessment practices that work and possible changes to implement. In these conversations, it is also important to carefully use language that conveys a clear understanding of the concept and practice of ungrading to avoid confusion, anxiety, misunderstandings, and reactions that prevent its implementation. Having these kinds of conversations can help shift the mind from a grade-focused to a learning-focused approach. A key element in these conversations is to ensure that the pedagogical reason behind the adoption of ungrading practices is not only clear but well understood (and this may take time).

Set a structure for ungrading

As with other elements of exemplary course design considerations, the structure of assessment practices is necessary. Adding a structure for ungrading assignments gives students a clear objective, steps, and flow that allow them to be consistent and accountable to their own learning goals and strategies.

Reflect on pedagogical and assessment practices

Instructors are invited to examine more in-depth their grading policies, why they grade in the way they do, what they are grading, and how they grade. In many cases, the path to ungrading is a response to dissatisfaction with grading policies. Aaron Blackwelder (chapter 2) says that, over time, he turned into a gatekeeper; he lost focus and was more interested in meeting institutional and “rigor” requirements than building relationships with students. His students had turned into competitive grade seekers. He questioned what a grade really suggests and posits that grades fail to communicate learning. The fact that grading allocates a specific number or letter that can bring some negative feelings to students, can also negatively affect the potential for learning. Sackstein (chapter 4) calls for a change in mindset to identify the way in which learning can be communicated and understood beyond the traditional use of numbers and letters. While Blum also argues for assessing the entire learning experience (with portfolios, for example), Sacksatein suggests considering changes in the language of grading which can provide students with an opportunity to shift the way they feel and think about their own learning.

Teach students to view mistakes as a necessary step in the learning process

Instructors are invited to reflect on how traditional grading practices are punitive, dehumanizing, and demotivating. Gibbs (chapter 6) points out that a system that punishes students for making mistakes reinforces the notion that all learning is flawless and therefore mistakes need to be avoided. Ungrading, on the other hand, aims to implement and cement the idea that learning is a process that needs constant feedback for that learning to be consolidated. Therefore, students need to be given opportunities not only to learn from their mistakes but to act on them in an interactive way. This requires instructors to plan for assessments that include steps for review (e.g., self, peer) to help the student build their skills, and knowledge over time.

Care for students and their learning

Instructors are also invited to demonstrate more explicitly that they care and validate students’ work. Further, Gibbs (Chapter 6) argues that her teaching philosophy is better summarized by the word “freedom”, the freedom that learners have to learn and grow at their rhythm and the freedom to make mistakes and learn from them. The role of the instructor is then to be supportive in that process through feedback and empathy. Ungrading, as it is overall discussed throughout the book, does not mean that there are no assessments or grading at all. On the contrary, the assessments should focus on helping students build their knowledge and understanding in less stressful ways, allowing students to build learning habits, develop creativity, become better communicators, and connect to their lived experiences and contexts. Caring for students also involves valuing their identity as learners and what they bring into the learning environment.

Be aware that ungrading can increase student anxiety and uncertainty

It is critical that instructors who are considering ungrading be cognizant that it involves a high level of anxiety and uncertainty on the part of students. Let’s recognize that students are so used and “conditioned” to grades that they will find it confusing not to have a grade associated with each assignment in the course. Many students consider being successful if they score a perfect grade which can be overwhelming and obscure the value of learning. Instructors who adopt ungrading should explain why and how ungrading will be done in certain classes. This will add transparency to the expectations and assumptions that instructors have about students.

Implement student voice and choice supported with personalized feedback

Instructors can help students take ownership of their learning through hands-on, real-life activities that allow students to use the content they are learning in projects of their interest, conduct research, and solve problems. Students can choose their topics and projects and the instructors can guide them to narrow topics and ensure the projects are feasible within the course timeframe. Consider feedback as a formative assessment approach that enables students to make choices about their learning strategies and needs to improve their learning tasks. Sackstein (chapter 4 ) suggests teaching students to collect feedback and identify the strategies that work for different kinds of assignment revisions. This way, students can develop better strategies that move them from lower-thinking to higher-thinking processes.

Since ungrading promotes the use of student-self assessment and reflection practices, it implies that instructors will need to personalize and tailor feedback to meet students where they are. In addition, instructors can consider setting a culture of feedback (Gibbs, chapter 6) where instructors teach students to use feedback to improve their work, provide peer feedback effectively, and see the value of learning from their mistakes.

Promote peer support

Authors of several chapters in this book have posited that students are more likely to give each other better feedback in the absence of grades. This kind of feedback can allow students to help each other, learn from one another, expand their awareness of their own understanding, and develop skills for life. Peer support will also help students build their confidence and autonomy to learn from each other.

Trust students

One critical aspect of assessment is trust –trust that students do the work they are expected to do by themselves. Instructors have legitimate reasons to express their concerns and create course policies about academic integrity that lead them to adopt plagiarism systems and surveillance tools to monitor and proctor students’ work. In adopting ungrading, trust is fundamental to change the way learning and performances are assessed. It involves helping students think differently about what it means to learn. Instructors can help students evolve in their approach to learning to move away from grades to focus on their learning by including in assessments strategies for building capacity for metacognition, confidence in their skills, life-long learning goals, and owning their learning.

Ungrading does not mean instructors don’t grade and students don’t receive grades on their work. Ungrading, as posited by the authors in the Ungrading book, is a mindset to approach student learning differently. In the second part of this blog, I will share the types of ungrading practices, implications, and challenges as presented in the book.

References

Coghlan, S., Miller, T. & Paterson, J. (2021). Good Proctor or “Big Brother”? Ethics of Online Exam Supervision Technologies. Philos. Technol. 34, 1581–1606. https://doi.org/10.1007/s13347-021-00476-1
Eyler, J. (2022, March 7). Grades Are at the Center of the Student Mental Health Crisis. InsideHigher Ed. [Blog]
Kohn, A., & Blum, S. D. (2021). Ungrading: Why Rating Students Undermines Learning (and What to Do Instead). West Virginia University Press.
Shi, T. (2022). Assessment Design: Ideas from Ungrading Book. [Ecampus blog]
Stommel, J. (2020, February 6). Ungrading: an FAQ. [Blog]
Talbert, R. (2022, March 30). Ungrading after 11 weeks. [Blog]

By: Ashlee M. C. Foster MSEd, Instructional Design Specialist | Oregon State University Ecampus

Did you know a pedagogical approach exists that positively impacts student academic achievement and engages them as active participants in learning? Great news…there is! Let me introduce you to the world of Project Based Learning (PBL).

What is PBL?

PBL is a student-centered pedagogical approach where students, both individually and within small groups, engage with meaningful, relevant, and authentic projects which result in a product. Oftentimes, PBL is commonly associated and/or thought to be interchangeable with Problem Based Learning. However, there is a distinction between the two. The principal focus of PBL is on the active construction of knowledge. Additionally, student autonomy, beliefs, values, and motivations are situated as a fundamental driving force of the instructional approach.

What are the characteristics of PBL?

The essence of PBL is anchored in attributes, which foster high-quality learning experiences. Direct instruction is no longer the principal mechanism for delivery. Negotiation of knowledge between the educator and the students occurs through an exchange of ideas, questioning, inquiry, considerations, and perspectives. PBL often engages students in an ongoing process consisting of investigation, collection, analysis, prototyping, testing, peer/instructor feedback, revisions, and reflection. Learner autonomy is key in that students make their own decisions about various aspects of the projects (i.e., line of inquiry, collaborative processes, application of feedback, types of revisions, solutions).

Is it effective? Prove it!

As reported by Chen and Yang (2019), a positive impact on student achievement has been observed across 20 years (i.e. 1998-2017) of PBL peer-reviewed literature. The researcher’s principal investigation was to compare traditional instruction with that of PBL. Traditional instructional delivery was found to prompt students to apply low-level cognitive processes (e.g., understand, remember). Whereas, PBL can encourage the development of (HOTS) Higher Order Thinking Skills (i.e., analysis synthesis) and metacognitive skills (i.e., regulation, monitoring, self-directed learning, evaluation, assessment). According to the meta-analysis, the aforementioned benefits were found not to be impacted by academic discipline, educational stage (undergraduate, post-baccalaureate, graduate), or geographic location. This is great news for our distance and hybrid learners!

How do I get started?

When considering PBL there are a few questions to reflect on before implementing this practice. First, ask yourself, is this a best-fit approach? Consider the academic discipline, subject content, course learning outcomes, your instructional style, student attributes, and the intended goals to answer this foundational question. A word of caution is to use PBL in a way that is relevant, authentic, and collaborative in nature. Steel clear of using projects as a shiny solution. Lastly, contextualize the project. Doing so will help students connect the project to their academic career, professional development, and personal growth. Remember to share the ‘why’!

Project Examples

Here are a few project examples to spark some ideas:

solve a problem (e.g., uninformed voting)
generate a plan (e.g., foster sustainability)
create a product (e.g., computer/mobile application, oral history interviews)
seek valid answers and recommend solutions (e.g., electing national officials)
engage with a persistent issue in a tangible way (e.g., advocating, protesting, public speech)

Do you have an example to share?

Respond in the comments if you currently use, have used, or intend to incorporate PBL in your course. Do you have any tried and true strategies for effective projects? Have you experienced any wins or challenges? Share with the community and join the discussion. Make sure to return to read Project-Based Learning (Part 2) – Mindful Design for practical implementation tips!

References

Almulla. (2020). The Effectiveness of the Project-Based Learning (PBL) Approach as a Way to Engage Students in Learning. SAGE Open, 10(3)
Budhai, S. (2016, January 29). Designing Effective Team Projects in Online Courses [blog]. Faculty Focus.
Chen, & Yang, Y.-C. (2019). Revisiting the effects of project-based learning on students’ academic achievement: A meta-analysis investigating moderators. Educational Research Review, 26, 71–81.
Grossman, Dean, C. G. P., Kavanagh, S. S., & Herrmann, Z. (2019). Preparing teachers for project-based teaching. Phi Delta Kappan, 100(7), 43–48.
Guo, Saab, N., Post, L. S., & Admiraal, W. (2020). A review of project-based learning in higher education: Student outcomes and measures. International Journal of Educational Research, 102, 101586.

Intro

The concept of the ‘right to repair’ has been on my mind recently, both as a user of tech products and as a designer of online courses. Electronics are notorious these days for their enigmatic design. The user is not trusted to make repairs or is restricted in the ways they can interact with device components. This is a choice made by manufacturers to limit access to approved vendors or repair shops. Instructional Designers have a similar choice when building courses. Do we follow a restrictive approach to modifications, or open up courses by anticipating, welcoming, and providing the resources for modifications?

Difficult by design

I recently experienced the restrictive side myself as I needed to fix an air purifier that had an unfortunate run-in with my youngest child and her colorful stickers. Apparently, the inside of the machine was not pretty enough, and the stickers were now stuck inside the machine, not quite clogging up the fan, but making a noticeable noise when the purifier was running. Realizing that I should probably remove them from the mechanism, and the partially obstructed fan, I grabbed my handy screwdriver, and rotated the cylindrical case to find where to begin.

And then I saw it – nothing. There were no screws on the outer shell. I turned it around a few more times, holding on to some hope that there was another way in – some switch to press or clasp to unhook. Nothing. The company designed the device to prevent a consumer from taking it apart. The only thing I had access to was the filter opening. No screws inside there either, and the manual had no sections on repairing the device.

I was put into a situation where I knew what I needed to do, and how to do it, but had no way of accomplishing it. If I tried to open it in a way it was not designed to be (whatever that was), I risked breaking the device even further, and voiding the warranty.

This is the situation many technology users find themselves in these days, which has led to a push for the right to repair one’s own devices.

Right to repair principles

Had the manufacturer made the air purifier with the consumer in mind, it may have been more closely aligned with right to repair principles, which are given by The Repair Association through their Policy Objectives. Some more relevant ones are currently paraphrased on the Right to repair – Wikipedia article:

the device should be constructed and designed in a manner that allows repairs to be made easily;
end users and independent repair providers should be able to access original spare parts and tools (software as well as physical tools) needed to repair the device at fair market conditions;
repairs should by design be possible and not hindered by software programming;
the repairability of a device should be clearly communicated by the manufacturer.

Applicability to Instructional Design

This whole endeavor got me thinking: What is the best choice for designers and developers who create courses and complex elements for our users? It seems that it falls into the same design philosophy choices that we see with other products like computer hardware or electronics today. For simplicity’s sake, let’s narrow it down to these two opposite choices designers have when making course components:

Modifying course elements is made difficult because the designer is either not confident in the instructor’s abilities to properly work with the design, actively discouraging changes, thus resulting in no change until the user approaches the designer(s) again.
Course elements are designed with user modifications in mind, and the user is left with sufficient instructions, access, and ability to make changes when necessary.

I prefer to use technology that closely follows the second choice, as this is more aligned with the ‘right to repair’, and results in more user-friendly practices. That is not to say that everyone would want to modify courses, but the option should be there.

Or, in other words:

It is the philosophical difference between engineering things to make them harder for the end user because you don’t trust them and documenting things to educate the end user so you know you can trust them.
Linus Sebastian, talking about the design choices of a pro-repair consumer laptop

If the previous main points of “right to repair” were to be re-written with online education in mind, how would these look? Perhaps something like this:

The course and its objects should be constructed and designed in a manner that allows edits to be made easily.
Instructors and SMEs should be able to access course components and tools needed to modify the course and its elements.
Revisions and additions should be possible and not hindered by design choices.
The Instructional Designer should clearly communicate the ability to modify the course, and how to do it.

How we could do it

What could we do as course designers to inform and empower faculty? Here are a few ideas:

General Documentation for Course Elements

By far one of the simplest ways to provide support to users is through basic documentation pages. If located on the course site itself, they can remain unpublished so learners do not see them. For those who would like more autonomy over their course structure and design, detailed documentation pages provide an excellent way to take the initiative and make the desired edits. Well-written documentation may also reduce the need for Instructional Designer support after the course is running. Plus, if you, as the designer, are worried about things breaking, you can always have a backup of all materials ready to revert pages.

Side by Side Code Blocks Tutorials

I use these all the time with fellow designers. On a Learning Management System (LMS), these function as a tutorial page where the page is split into two columns. Users can see the HTML/CSS code on the left and how it is displayed on the right. Then it’s a matter of copying the code from the code block and pasting it where they want it to go. This practice is very useful when it comes to the more advanced features of your LMS. This makes it easier to choose which element a user wants to incorporate or edit.

Side by side code tutorial blocks provide a quick way to show off how elements work, and a quick way to copy elements into other parts of the course.

Learner Journey and Alignment

If an instructor wants to change the course a few terms after it has been running, how do we achieve a similar look and feel to the one created by the Instructional Designer long after the project has been developed? Mapping the expected learner journey, and how the content aligns with learning outcomes, can help with this. For example, imagine the learner is expected to interact with a week-long module by completing the following tasks in this order:

Step A (Fulfills Learning Outcomes 1, 3. Informs Steps C and D)
Step B (Fulfills Learning Outcome 2. Informs Steps C and D)
Step C (Fulfills Learning Outcomes 3, 4)
Step D (Fulfills Learning Outcome 1, 4)

Each step may include reading or watching learning materials, completing an assignment, participating in a discussion, and so on. How would this expected behavior change if, later on, an instructor added an additional assessment between C and D? What about removing Step B entirely (which in this example would remove alignment to Learning Outcome 2 from the module). Would a learner on this new version of the course still have the required information to complete the remaining parts of the module? Would they interact with the content in the same order as initially expected (and how the course was likely designed to be completed)?

These are things Instructional Designers plan and check during the initial development which can be shared to ensure that the same methods are followed in subsequent iterations of the course.

Conclusion

Some may prefer to leave everything in the hands of an experienced Instructional Design team, and use their expertise whenever a change is required. For others who have enough technical skills to edit content, the desire to learn more, or would like more autonomy and ownership over course content, an open course design provides the same user-friendly approach that at ‘right to repair’ would have for general electronics.

References

Right to Repair, Wikipedia: https://en.wikipedia.org/wiki/Right_to_repair
Policy Objectives, The Repair Organization: https://www.repair.org/policy
Linus Tech Tips: https://www.youtube.com/c/LinusTechTips

This blog post is an Instructor Spotlight authored by Xiaohui Chang. Xiaohui is a Toomey Faculty Fellow and Associate Professor of Business Analytics in the College of Business. This post is a follow up to Improving Student Engagement and Connection in Online Learning: Part I, Proactive Support.

Introduction

Since the first post in the series appeared a few months ago, we have received plenty of feedback from other instructors who are actively engaged in online education. Some of the stories shared by them reiterate the points we discussed, and others included tips and techniques that have worked particularly well for them. Almost all of them agreed that teaching well online remains a challenging task.

“I love the notes on proactive student support … especially the notes on checking in with those who are behind. Sometimes all they need is a little empathy!”
Vic Matta, Associate Professor, College of Business, Ohio University

“I regularly incorporate each of these in my relationships with my students, to include weekly zoom “what’s up” meetings with my students. I check in on them if they’re behind on assignments…Yes, it takes effort; but my mission is to help these students find the greatness within themselves to succeed.”

To quickly recap what we have discussed in Part 1, we touched on how to employ empathy statements in communications with students, restructure and promote the office hours, provide personal feedback for students, and periodically check in with students who are behind. You may also refer to the first article here: Improving Student Engagement and Connection in Online Learning: Part I, Proactive Support.

Continuing from the first post, Part II will revolve around six specific practices that I have found particularly helpful for online teaching and learning.

Practice 1: Adopt a variety of communication methods

I provide assignment instructions and guidance using a variety of communication methods including texts, diagrams, images, and short video clips. I have learned that instructions with screenshots and videos tend to be better in explaining complicated procedures than text alone.

Video Tutorial Example: Creating a random sample using XLSTAT

Practice 2: Create a Q&A Discussion Board

I have a separate discussion on Canvas for students to address issues with the class in general (content questions, technical issues, deadlines). Instead of emailing the instructor regarding issues other students may also have questions about, students are encouraged to use this forum so that all can benefit from the questions and answers. I usually wait for a few hours for students to answer each other’s questions first before I provide mine.

When students email me questions that are a good fit for the Q&A Discussion Board, I’d respond through email first and then recommend the students submit the questions to the discussion board so that other students can learn from the questions and answers. This discussion board also creates an inviting and engaging learning environment for the students who don’t get to meet their classmates in a face-to-face setting.

Practice 3: Estimate the amount of time taken for each assignment

I was skeptical of this at first as the time taken would vary drastically for each individual. However, student feedback indicates that estimated times helped them plan for the week and set aside an appropriate amount of time. We don’t need to worry too much about making the estimates accurate for everyone as students will automatically adjust given their own work styles. A workload calculator that I have found helpful is developed by the Center for Advancement of Teaching at Wake Forest University, called the Workload Estimator 2.0.

For more information about estimation rates, see the explanation here – Workload Estimator: How We Calculated.

Practice 4: Ensure timely replies

This practice is obvious, but difficult to do when one is teaching multiple sessions with hundreds of students. For online classes, timely replies make students feel as though they are taking an in-person class with all of the built-in support and resources. I understand that we all have different teaching priorities and schedules, however, it all comes down to figuring out how to most efficiently organize our days so that we can be available to students.

Setting aside a couple of times a day for handling emails has worked quite well for me, e.g., the first thing in the morning, after noon, and before the end of the day. I try my best to respond to students’ emails within 24 hours and check my mailbox at least once every day on the weekends.

The timely replies in discussions were super helpful. It really felt as though I took this in person with all of the built-in help and support.
Student quote

Practice 5: Synchronize assignments with Canvas calendar

I have also synced all assignments and my office hours (renamed as Ask Me Anything Hours) on Canvas so that there are office hours available around when assignments are due. This proves to be incredibly convenient and useful for both students and instructors.

Practice 6: Reorganize course content

Here are several Canvas LMS tips that have helped in organizing the course content and saved my time. I try to organize everything in modules. Under each module, all items are split into two main components: resources and to-do lists, so students know exactly what assignments they would need to complete for each module. I also adopt a fixed set of systems for titling Canvas items. Items within modules are indented to help with organization.

Weekly agenda and announcements are also hyperlinked to guide students with the course navigation. I could not emphasize enough how much I value the internal messaging in the Canvas grade book that was briefly discussed in my previous post. This feature allows instructors to message students who haven’t submitted yet or who scored less than a certain point. Definitely a slick way to send quick emails to a target group.

Recently, I have been experimenting with a range of visual cues (e.g., emojis) to categorize course content. An example is provided below.

Screenshot of the module view of the course, demonstrating using of emojis as visual cues next to assignments. A written assignment has a pencil and paper emoji, a quiz has a question mark emoji, etc.

There was also a recent post on using emojis for visual way finding and fostering a friendly tone in online classes here: My Experience with Emojis in Online Courses: Affordances and Considerations.

Conclusion

It’s always best to keep an open mind when trying out new teaching practices and adapt them to your individual style and subject matter.

If you have any online teaching practices that you’re fond of, please feel free to contact me at Xiaohui.Chang@oregonstate.edu as I will be very excited to hear them and test them out.

Types of Ungrading Practices

Approaches to Assignments

Student Participation

Interaction

Mastery Orientation

Challenges to Implementation

Takeaways

References

Introduction

Results

Conclusions

References

NDAs and Open Pedagogy

Non-Disposable Assignments (NDAs)

Benefits and Value of NDAs

NDA Design and Students as Producers

Examples & Resources

References

Bringing Critical Language Awareness to Instructional Texts and to How You Evaluate Student Writing

How would you like me to approach copy edits and other confusions?

Who are you to correct me?

How will you evaluate and respond to your students’ writing?

Who is served by your attention to students’ writing, and who is disadvantaged?

Finding alternatives

Works Cited

By Naomi R. Aguiar & Tianhong Shi

Visual Design Matters

On Writing Intensive Courses

Want to Learn More?

References

Getting Started

Course Design Elements

Authentic Challenge

Authentic Product

Sustained Inquiry

Student Autonomy

Reflection

Critique & Revision

Success Tips

Looking Ahead!

References

Overview of Ungrading

Assessment Design Considerations

Decenter grading and communicate (un)grading practices

Set a structure for ungrading

Reflect on pedagogical and assessment practices

Teach students to view mistakes as a necessary step in the learning process

Care for students and their learning

Be aware that ungrading can increase student anxiety and uncertainty

References

What is PBL?

What are the characteristics of PBL?

Is it effective? Prove it!

How do I get started?

Project Examples

Do you have an example to share?

References

Intro

Difficult by design

Right to repair principles

Applicability to Instructional Design

How we could do it

General Documentation for Course Elements

Side by Side Code Blocks Tutorials

Learner Journey and Alignment

Conclusion

References

Introduction

Practice 1: Adopt a variety of communication methods

Video Tutorial Example: Creating a random sample using XLSTAT

Practice 2: Create a Q&A Discussion Board

Practice 3: Estimate the amount of time taken for each assignment

Practice 4: Ensure timely replies

Practice 5: Synchronize assignments with Canvas calendar

Practice 6: Reorganize course content

Conclusion

Contact Info