NDAs and Open Pedagogy

One of the principles upheld by the open pedagogy movement is that the role of the learner must be active and the tasks that they engage in must be meaningful. These are not new ideas by any stretch, but as we move toward a more open pedagogical environment, it becomes necessary to examine the types of assignments that we create and assign. How do these tasks contribute to efforts to democratize education and increase learner autonomy, engagement, and freedom? What makes an assignment open? To answer these questions, this post will explore the relationship between open pedagogy and open assignments. 

While interest in the topic of open pedagogy has steadily gained steam in the roughly 50 years since its inception, definitions of and familiarity with the concept of today’s open pedagogy vary among educational practitioners. Some discussions focus on the expansion of the use of these resources. You might be hard-pressed to find an instructor who hasn’t at least reused open content (See 5R framework of Open Content) or encountered such materials as a student. Other conversations emphasize the remix and revise aspect of open content and pedagogical practices, and the number of faculty-created Open Educational Resources (OERs) intended to replace the traditional textbook is ever increasing. Still others have turned their attention to implementation of open pedagogical practices that put students in the role of content creators rather than passive beneficiaries of innovations in open content. In our efforts to create tasks that accomplish this shift in the role of the learner, we must first ask what the value of the task is for the student, peers, and the larger community, and what life will such a task have after its completion. To answer these questions, we can look to the non-disposable assignment (NDA). 

Non-Disposable Assignments (NDAs) 

To define the characteristics of this type of assignment, it is helpful to first define what we mean by “disposable” assignment. It is safe to say that we are all familiar with these types of assignments: typically they include one-off or busy work tasks designed to be filed away and forgotten as soon as completed and graded. In his article What is Open Pedagogy (2013), David Wiley described the disposable assignment in this way: 

These are assignments that students complain about doing and faculty complain about grading. They’re assignments that add no value to the world – after a student spends three hours creating it, a teacher spends 30 minutes grading it, and then the student throws it away. Not only do these assignments add no value to the world, they actually suck value out of the world.

Online learning within the confines of a learning management system (LMS) is particularly ripe for these types of assignments. In fact, one could argue they are designed for this type of task. In an online course, instructors create and post the assignment, students complete it, instructors grade it, the course ends, student work is deleted, the course is rolled over, and the next crop of students begins the cycle again. The work is designed to be contained within the LMS for the duration of a course, not to be shared with a broader audience of students or colleagues. 

As an alternative to the disposable assignment in favor of more meaningful tasks, Wiley coined the term Non-Disposable Assignment. The NDA (also referred to as a renewable assignment), in contrast to its binworthy counterpart, is an assignment that “adds value to the world.” Later definitions, no doubt influenced by the growing open pedagogy movement and the promotion of the use of OER materials, go further and hold that an NDA ought to produce a resource that is openly published so that “others can find, use, and if desired, repurpose or update the work,” (Jhangiani, 2015; Wiley, 2013; Wiley et al., 2017; Wiley & Hilton, 2018). Such assignments put the learner in the role of creator and impact or benefit an audience beyond the instructor and student. Because the premise of the NDA is that it can not only be shared widely, but also revised and reused without permission by both instructors and students, the content should be openly licensed. Considering the role of learners as authors of the content, they should have a say in determining the type of open license appropriate for their work.

In the article A Conceptual Framework for Non-Disposable Assignments: Inspiring Implementation, Innovation, and Research, Seraphine et al (2019) provide a set of principles NDAs must adhere to. The Five Principles are summarized as follows: 

  1. NDAs fundamentally involve information collaboration and exchange.
  2. As forms of responsive and responsible pedagogy, NDAs involve communication throughout and opportunities for revision, creativity, modifying key terms and objectives, etc.
  3. While NDAs might not necessarily involve communal assembly, the resulting product or practice must always be shared outside the teacher-student dyad, creating opportunities for communal access of the NDA as an information resource 
  4. NDAs produce learning through cooperative critique.
  5. Because they are not exams or isolated writing assignments, NDAs involve innovation as a fundamental concept.

Benefits and Value of NDAs

Apart from their ability to reach a broad audience, NDAs increase student motivation, engagement and autonomy resulting in improved achievement of learning outcomes. (Ariely, Kamenica, & Prelec, 2008; Chalofsky & Krishna, 2009; Pink, 2011). While this claim may be at least in part anecdotal, it follows that when students know that their work may be used by peers, faculty, and colleagues across their field in the future, investment in the quality of their work increases. Non-disposable assignments and authentic assessments have the potential to add value in other areas by:

  • promoting community engagement.
  • fostering innovation. 
  • interrogating and dismantling systems of oppression by centering experiences of historically marginalized groups.
  • providing opportunities for culturally rich content (inject identity, student influence over content). 
  • cultivating information literacy skills.  
  • increasing accessibility to educational resources.
  • helping students communicate in writing to a general audience.
  • offering opportunities to collaborate with peers around the world. 
  • increasing self-regulated learning and autonomy.

Despite their numerous benefits, NDAs are not without challenges and risks. For example, some students may be resistant to the exposure and the vulnerability inherent in creating open content for broad use. In such cases, instructors must provide alternative assignments or options not to share. Because student-generated content requires substantial metacognitive skills, instructors must ensure that NDAs involve significant scaffolding at multiples stages in the learning process (Zimmerman, 1990; Zimmerman, 2002). Furthermore, the open nature of student-generated content presents a quality control challenge that instructors must anticipate and address by providing multiple opportunities for revision and peer review

NDA Design and Students as Producers

Implementing assignments that have the potential for broad impact beyond the typical instructor-student dyad can seem daunting. After all, conceptualizing and creating tasks that effectively revise the role of student from a passive one to actual content creators is no small feat. However, it is important to remember that the scope can vary widely. Indeed a well-crafted discussion between two students might form the basis for a renewable assignment. Other examples may include experiential connections such as student-generated podcasts; the production of flyers, guidelines, or materials for local community organizations; or even collaboratively created and maintained global resources such as wikis like the Chemistry Library. Whatever the scope, NDAs can—and arguably should—be iterative allowing for innovation and adaptation to various contexts. 

With the role of the student as producer in mind and an understanding of the potential pitfalls that an open assignment might present, faculty can then turn to the conventional principles of backward design to develop meaningful student learning experiences that add value for learners and their peers while also promoting community engagement.

Instructors should consider the role of students as they develop non-disposable assignments to put students in the role of content creators. Source: The Non-Disposable Assignment: Enhancing Personalised Learning – Session 1 Slideshare, CC Attribution-ShareAlike


Examples & Resources 

References 

 

Over the last couple of terms, I joined a series of reading sessions with instructional design colleagues to read Alfie Khon and Susan Blum’s book Ungrading. Why Rating Students Undermines Learning (and What to Do Instead) and discuss the practices and implications of this approach to reconceptualize assessment design and the place of grading. This two-part blog aims to capture the takeaways from those discussions including the main concepts, approaches, types of activities, implications, and challenges of adopting ungrading practices. This first part of the blog covers a brief overview of the concept of ungrading, its major benefits, and design considerations; and the second blog will include a summary of the types of ungrading practices and challenges to implementation ––all derived from the authors’ extensive arguments and examples. For a detailed review and summary of the book chapters, you can also check the blog Assessment Design: Ideas from Ungrading Book.

Overview of Ungrading

The concept of ungrading is sparking widespread interest only recently even though educators have been studying and using ungrading approaches for quite some time. The foundational premise of ungrading is to move away from a focus on grades that judge, rank, sort, and quantify student learning to adopting an approach that focuses on using alternative and authentic means to assess learning such as self-evaluation, reflection, student-generated questions, peer feedback, to name a few. Along with that premise is the questionable ranking that comes with grading which makes students compete with one another in an artificial way. Sorensen-Unruh (chapter 9) sees ungrading as a conversational method that facilitates the communication between instructors and students about how students perform in the class. If, as underscored by the authors, grading and the fact of assigning point values to students’ performance makes more harm than good, then, why use grading? Considering that grading is rooted in our educational systems, many of these authors conclude that it becomes inevitable to grade student learning as it is currently done today.  

A clock and a checklist

Several scholars and instructors consider grading to be problematic. First, grades are not good indicators of learning. Blum (chapter 3) argues that grading assumes all students are the same, does not provide accurate information about student learning gains, is consequential, adds fear and avoidance of negative consequences, and is arbitrary and instructor-led. Second, the overemphasis on grades can lead to a decrease in intrinsic motivation, students’ excessive anxiety, and the complexity of quantifying how learning happens (Stommel, chapter 1). Third, it can also decrease interest in learning, students may feel inclined for easier tasks, and critical thinking is lacking (Alfie Khon, foreword). Fourth, grading makes students be fixated more on their grades than on the process of learning, leading them to believe that grades are all that matters in school (Khon & Blum; Talbert, 2020). And finally, too much focus on grades can be detrimental to students’ mental health (Eyler, 2022). However, ungrading does not mean dismissing grades altogether. Instead, Stommel proposes creating a learning space that fosters critical thinking, reflection, and metacognition– all skills that are valuable for 21st-century education. Likewise, Alfie Khon contends that grading can be participatory since it does not require a unilateral decision, and thus, students can also propose their own grades (with the instructor’s reservation to accept them). 

“Ultimately ungrading— eliminating the control-based function of grades, with all its attendant harms— means that, as long as the noxious institutional requirement to submit a final grade remains in place, whatever grade each student decides on is the grade we turn in, period.”

(Khon, 2020, p. xv)

While ungrading may be an innovative approach to assessments, it should be thought of carefully and adopted with a clear objective. Ungrading, as pointed out by Katopodis and Davison (chapter 7), needs a structure to be effective, allowing students to envision themselves as authoritative, creative, confident, and active, thus achieving a high impactful goal. As ungrading requires instructors to evolve in their approach to assessment, it does too for students who are expected to engage in a process of self-evaluation, self-assessment, and reflection. This requires engagement in metacognitive practices that many students might not be ready to embark on or don’t know how to do it. In addition, while ungrading is believed to be student-centered, it can deepen equity gaps if guideposts are entirely removed. Sorensen-Unruh (chapter 9) believes that ungrading is a matter of social justice –going beyond the expected student agency and aiming at having students exercise their voice and participate in assessment decisions. 

As a whole, Blum (introduction chapter) provokes us all to rethink the nature of grading considering that students’ learning conditions vary, with many enduring inequities at many levels. Blum wants us to keep focused on how “varying assessment and feedback methods contribute to the real learning of real individual learners, rather than imposing an arbitrary method of sorting.” (p. xxii); all for the sake of healthy learning. 

These are a few key points about the arguments for ungrading. While this assessment practice is taking force in higher education, there are also many critics and skeptics. The purpose of this blog is not to enter into the discussion and controversy of ungrading, but to share a few perspectives and takeaways after an intense and well-structured book club discussion. In the following section of this part-one blog, I will share considerations for designing for ungrading. 

Assessment Design Considerations

Tasks and activities from a laptop computer

The educational system requires all instructors to submit grades at the end of every term. There is dissatisfaction with the current grading practices among many instructors and students as explained at large in the book. Here is where the ungrading movement takes force to provide alternative ways to account for evidence of student learning. Riesbeck (chapter 8) argued that by implementing ungrading practices, students can focus more on the content and feedback than on the grades. The use of critique-driven learning allows for more easily quantifiable efforts, progress, and accomplishment. Each ungrading consideration is dependent on a myriad of factors that may or not apply to each instructor’s context. The bottom line in ungrading is re-envisioning the teaching and learning process, engaging students in active learning, and active self-assessment through feedback. The following are design considerations:

Decenter grading and communicate (un)grading practices

Instructors can encourage students to focus on the process of learning, instead of talking about grades, Blums says, we should talk about the purpose and goals of the activities with students. These conversations can help develop relationships with students to encourage them to own their learning and have a voice in that process. Decentering grades also involves having an ongoing conversation with students, colleagues, and administrators about assessment decisions. Although each instructor exercises their academic freedom, it is also essential to share assessment practices that work and possible changes to implement.  In these conversations, it is also important to carefully use language that conveys a clear understanding of the concept and practice of ungrading to avoid confusion, anxiety, misunderstandings, and reactions that prevent its implementation. Having these kinds of conversations can help shift the mind from a grade-focused to a learning-focused approach. A key element in these conversations is to ensure that the pedagogical reason behind the adoption of ungrading practices is not only clear but well understood (and this may take time).

Set a structure for ungrading

As with other elements of exemplary course design considerations, the structure of assessment practices is necessary. Adding a structure for ungrading assignments gives students a clear objective, steps, and flow that allow them to be consistent and accountable to their own learning goals and strategies. 

Reflect on pedagogical and assessment practices

Instructors are invited to examine more in-depth their grading policies, why they grade in the way they do, what they are grading, and how they grade. In many cases, the path to ungrading is a response to dissatisfaction with grading policies. Aaron Blackwelder (chapter 2) says that, over time, he turned into a gatekeeper; he lost focus and was more interested in meeting institutional and “rigor” requirements than building relationships with students. His students had turned into competitive grade seekers. He questioned what a grade really suggests and posits that grades fail to communicate learning. The fact that grading allocates a specific number or letter that can bring some negative feelings to students, can also negatively affect the potential for learning. Sackstein (chapter 4) calls for a change in mindset to identify the way in which learning can be communicated and understood beyond the traditional use of numbers and letters.  While Blum also argues for assessing the entire learning experience (with portfolios, for example), Sacksatein suggests considering changes in the language of grading which can provide students with an opportunity to shift the way they feel and think about their own learning. 

Teach students to view mistakes as a necessary step in the learning process

Instructors are invited to reflect on how traditional grading practices are punitive, dehumanizing, and demotivating. Gibbs (chapter 6) points out that a system that punishes students for making mistakes reinforces the notion that all learning is flawless and therefore mistakes need to be avoided. Ungrading, on the other hand, aims to implement and cement the idea that learning is a process that needs constant feedback for that learning to be consolidated. Therefore, students need to be given opportunities not only to learn from their mistakes but to act on them in an interactive way. This requires instructors to plan for assessments that include steps for review (e.g., self, peer) to help the student build their skills, and knowledge over time.

Care for students and their learning

Instructors are also invited to demonstrate more explicitly that they care and validate students’ work. Further, Gibbs (Chapter 6) argues that her teaching philosophy is better summarized by the word “freedom”, the freedom that learners have to learn and grow at their rhythm and the freedom to make mistakes and learn from them. The role of the instructor is then to be supportive in that process through feedback and empathy. Ungrading, as it is overall discussed throughout the book, does not mean that there are no assessments or grading at all. On the contrary, the assessments should focus on helping students build their knowledge and understanding in less stressful ways, allowing students to build learning habits, develop creativity, become better communicators, and connect to their lived experiences and contexts. Caring for students also involves valuing their identity as learners and what they bring into the learning environment.  

Be aware that ungrading can increase student anxiety and uncertainty

It is critical that instructors who are considering ungrading be cognizant that it involves a high level of anxiety and uncertainty on the part of students. Let’s recognize that students are so used and “conditioned” to grades that they will find it confusing not to have a grade associated with each assignment in the course. Many students consider being successful if they score a perfect grade which can be overwhelming and obscure the value of learning. Instructors who adopt ungrading should explain why and how ungrading will be done in certain classes. This will add transparency to the expectations and assumptions that instructors have about students.

Implement student voice and choice supported with personalized feedback

Instructors can help students take ownership of their learning through hands-on, real-life activities that allow students to use the content they are learning in projects of their interest, conduct research, and solve problems. Students can choose their topics and projects and the instructors can guide them to narrow topics and ensure the projects are feasible within the course timeframe. Consider feedback as a formative assessment approach that enables students to make choices about their learning strategies and needs to improve their learning tasks. Sackstein (chapter 4 ) suggests teaching students to collect feedback and identify the strategies that work for different kinds of assignment revisions. This way, students can develop better strategies that move them from lower-thinking to higher-thinking processes. 

Since ungrading promotes the use of student-self assessment and reflection practices, it implies that instructors will need to personalize and tailor feedback to meet students where they are. In addition, instructors can consider setting a culture of feedback (Gibbs, chapter 6) where instructors teach students to use feedback to improve their work, provide peer feedback effectively, and see the value of learning from their mistakes. 

Promote peer support

Authors of several chapters in this book have posited that students are more likely to give each other better feedback in the absence of grades. This kind of feedback can allow students to help each other, learn from one another, expand their awareness of their own understanding, and develop skills for life. Peer support will also help students build their confidence and autonomy to learn from each other. 

Trust students

One critical aspect of assessment is trust –trust that students do the work they are expected to do by themselves. Instructors have legitimate reasons to express their concerns and create course policies about academic integrity that lead them to adopt plagiarism systems and surveillance tools to monitor and proctor students’ work. In adopting ungrading, trust is fundamental to change the way learning and performances are assessed. It involves helping students think differently about what it means to learn. Instructors can help students evolve in their approach to learning to move away from grades to focus on their learning by including in assessments strategies for building capacity for metacognition, confidence in their skills, life-long learning goals, and owning their learning. 

Ungrading does not mean instructors don’t grade and students don’t receive grades on their work. Ungrading, as posited by the authors in the Ungrading book, is a mindset to approach student learning differently. In the second part of this blog, I will share the types of ungrading practices, implications, and challenges as presented in the book. 

References

Intro

The concept of the ‘right to repair’ has been on my mind recently, both as a user of tech products and as a designer of online courses. Electronics are notorious these days for their enigmatic design. The user is not trusted to make repairs or is restricted in the ways they can interact with device components. This is a choice made by manufacturers to limit access to approved vendors or repair shops. Instructional Designers have a similar choice when building courses. Do we follow a restrictive approach to modifications, or open up courses by anticipating, welcoming, and providing the resources for modifications?

Difficult by design

I recently experienced the restrictive side myself as I needed to fix an air purifier that had an unfortunate run-in with my youngest child and her colorful stickers. Apparently, the inside of the machine was not pretty enough, and the stickers were now stuck inside the machine, not quite clogging up the fan, but making a noticeable noise when the purifier was running. Realizing that I should probably remove them from the mechanism, and the partially obstructed fan, I grabbed my handy screwdriver, and rotated the cylindrical case to find where to begin.

And then I saw it – nothing. There were no screws on the outer shell. I turned it around a few more times, holding on to some hope that there was another way in – some switch to press or clasp to unhook. Nothing. The company designed the device to prevent a consumer from taking it apart. The only thing I had access to was the filter opening. No screws inside there either, and the manual had no sections on repairing the device.

I was put into a situation where I knew what I needed to do, and how to do it, but had no way of accomplishing it. If I tried to open it in a way it was not designed to be (whatever that was), I risked breaking the device even further, and voiding the warranty.

This is the situation many technology users find themselves in these days, which has led to a push for the right to repair one’s own devices.

Right to repair principles

Had the manufacturer made the air purifier with the consumer in mind, it may have been more closely aligned with right to repair principles, which are given by The Repair Association through their Policy Objectives. Some more relevant ones are currently paraphrased on the Right to repair – Wikipedia article:

  1. the device should be constructed and designed in a manner that allows repairs to be made easily;
  2. end users and independent repair providers should be able to access original spare parts and tools (software as well as physical tools) needed to repair the device at fair market conditions;
  3. repairs should by design be possible and not hindered by software programming;
  4. the repairability of a device should be clearly communicated by the manufacturer.

Applicability to Instructional Design

This whole endeavor got me thinking: What is the best choice for designers and developers who create courses and complex elements for our users? It seems that it falls into the same design philosophy choices that we see with other products like computer hardware or electronics today. For simplicity’s sake, let’s narrow it down to these two opposite choices designers have when making course components:

  1. Modifying course elements is made difficult because the designer is either not confident in the instructor’s abilities to properly work with the design, actively discouraging changes, thus resulting in no change until the user approaches the designer(s) again.
  2. Course elements are designed with user modifications in mind, and the user is left with sufficient instructions, access, and ability to make changes when necessary.

I prefer to use technology that closely follows the second choice, as this is more aligned with the ‘right to repair’, and results in more user-friendly practices. That is not to say that everyone would want to modify courses, but the option should be there.

Or, in other words:

It is the philosophical difference between engineering things to make them harder for the end user because you don’t trust them and documenting things to educate the end user so you know you can trust them.  

Linus Sebastian, talking about the design choices of a pro-repair consumer laptop

If the previous main points of “right to repair” were to be re-written with online education in mind, how would these look? Perhaps something like this:

  1. The course and its objects should be constructed and designed in a manner that allows edits to be made easily.
  2. Instructors and SMEs should be able to access course components and tools needed to modify the course and its elements.
  3. Revisions and additions should be possible and not hindered by design choices.
  4. The Instructional Designer should clearly communicate the ability to modify the course, and how to do it.

How we could do it

What could we do as course designers to inform and empower faculty? Here are a few ideas:

General Documentation for Course Elements

By far one of the simplest ways to provide support to users is through basic documentation pages. If located on the course site itself, they can remain unpublished so learners do not see them. For those who would like more autonomy over their course structure and design, detailed documentation pages provide an excellent way to take the initiative and make the desired edits. Well-written documentation may also reduce the need for Instructional Designer support after the course is running. Plus, if you, as the designer, are worried about things breaking, you can always have a backup of all materials ready to revert pages.

Side by Side Code Blocks Tutorials

I use these all the time with fellow designers. On a Learning Management System (LMS), these function as a tutorial page where the page is split into two columns. Users can see the HTML/CSS code on the left and how it is displayed on the right. Then it’s a matter of copying the code from the code block and pasting it where they want it to go. This practice is very useful when it comes to the more advanced features of your LMS. This makes it easier to choose which element a user wants to incorporate or edit.

Side by side code tutorial blocks provide a quick way to show off how elements work, and a quick way to copy elements into other parts of the course.

Learner Journey and Alignment

If an instructor wants to change the course a few terms after it has been running, how do we achieve a similar look and feel to the one created by the Instructional Designer long after the project has been developed? Mapping the expected learner journey, and how the content aligns with learning outcomes, can help with this. For example, imagine the learner is expected to interact with a week-long module by completing the following tasks in this order:

  • Step A (Fulfills Learning Outcomes 1, 3. Informs Steps C and D)
  • Step B (Fulfills Learning Outcome 2. Informs Steps C and D)
  • Step C (Fulfills Learning Outcomes 3, 4)
  • Step D (Fulfills Learning Outcome 1, 4)

Each step may include reading or watching learning materials, completing an assignment, participating in a discussion, and so on. How would this expected behavior change if, later on, an instructor added an additional assessment between C and D? What about removing Step B entirely (which in this example would remove alignment to Learning Outcome 2 from the module). Would a learner on this new version of the course still have the required information to complete the remaining parts of the module? Would they interact with the content in the same order as initially expected (and how the course was likely designed to be completed)?

These are things Instructional Designers plan and check during the initial development which can be shared to ensure that the same methods are followed in subsequent iterations of the course.

Conclusion

Some may prefer to leave everything in the hands of an experienced Instructional Design team, and use their expertise whenever a change is required. For others who have enough technical skills to edit content, the desire to learn more, or would like more autonomy and ownership over course content, an open course design provides the same user-friendly approach that at ‘right to repair’ would have for general electronics.

References

  1. Right to Repair, Wikipedia: https://en.wikipedia.org/wiki/Right_to_repair
  2. Policy Objectives, The Repair Organization: https://www.repair.org/policy
  3. Linus Tech Tips: https://www.youtube.com/c/LinusTechTips

This blog post is an Instructor Spotlight authored by Xiaohui Chang. Xiaohui is a Toomey Faculty Fellow and Associate Professor of Business Analytics in the College of Business. This post is a follow up to Improving Student Engagement and Connection in Online Learning: Part I, Proactive Support.


Introduction

Since the first post in the series appeared a few months ago, we have received plenty of feedback from other instructors who are actively engaged in online education. Some of the stories shared by them reiterate the points we discussed, and others included tips and techniques that have worked particularly well for them. Almost all of them agreed that teaching well online remains a challenging task.

“I love the notes on proactive student support … especially the notes on checking in with those who are behind. Sometimes all they need is a little empathy!”

Vic Matta, Associate Professor, College of Business, Ohio University 

“I regularly incorporate each of these in my relationships with my students, to include weekly zoom “what’s up” meetings with my students. I check in on them if they’re behind on assignments…Yes, it takes effort; but my mission is to help these students find the greatness within themselves to succeed.”

To quickly recap what we have discussed in Part 1, we touched on how to employ empathy statements in communications with students, restructure and promote the office hours, provide personal feedback for students, and periodically check in with students who are behind. You may also refer to the first article here: Improving Student Engagement and Connection in Online Learning: Part I, Proactive Support.

Continuing from the first post, Part II will revolve around six specific practices that I have found particularly helpful for online teaching and learning.

Practice 1: Adopt a variety of communication methods

I provide assignment instructions and guidance using a variety of communication methods including texts, diagrams, images, and short video clips. I have learned that instructions with screenshots and videos tend to be better in explaining complicated procedures than text alone.

Video Tutorial Example: Creating a random sample using XLSTAT

Practice 2: Create a Q&A Discussion Board

I have a separate discussion on Canvas for students to address issues with the class in general (content questions, technical issues, deadlines). Instead of emailing the instructor regarding issues other students may also have questions about, students are encouraged to use this forum so that all can benefit from the questions and answers. I usually wait for a few hours for students to answer each other’s questions first before I provide mine.

When students email me questions that are a good fit for the Q&A Discussion Board, I’d respond through email first and then recommend the students submit the questions to the discussion board so that other students can learn from the questions and answers. This discussion board also creates an inviting and engaging learning environment for the students who don’t get to meet their classmates in a face-to-face setting.

Practice 3: Estimate the amount of time taken for each assignment

I was skeptical of this at first as the time taken would vary drastically for each individual. However, student feedback indicates that estimated times helped them plan for the week and set aside an appropriate amount of time. We don’t need to worry too much about making the estimates accurate for everyone as students will automatically adjust given their own work styles. A workload calculator that I have found helpful is developed by the Center for Advancement of Teaching at Wake Forest University, called the Workload Estimator 2.0.

For more information about estimation rates, see the explanation here – Workload Estimator: How We Calculated.

Practice 4: Ensure timely replies

This practice is obvious, but difficult to do when one is teaching multiple sessions with hundreds of students. For online classes, timely replies make students feel as though they are taking an in-person class with all of the built-in support and resources. I understand that we all have different teaching priorities and schedules, however, it all comes down to figuring out how to most efficiently organize our days so that we can be available to students.

Setting aside a couple of times a day for handling emails has worked quite well for me, e.g., the first thing in the morning, after noon, and before the end of the day. I try my best to respond to students’ emails within 24 hours and check my mailbox at least once every day on the weekends.

The timely replies in discussions were super helpful. It really felt as though I took this in person with all of the built-in help and support.

Student quote

Practice 5: Synchronize assignments with Canvas calendar

I have also synced all assignments and my office hours (renamed as Ask Me Anything Hours) on Canvas so that there are office hours available around when assignments are due. This proves to be incredibly convenient and useful for both students and instructors.

Practice 6: Reorganize course content

Here are several Canvas LMS tips that have helped in organizing the course content and saved my time. I try to organize everything in modules. Under each module, all items are split into two main components: resources and to-do lists, so students know exactly what assignments they would need to complete for each module. I also adopt a fixed set of systems for titling Canvas items. Items within modules are indented to help with organization.

Weekly agenda and announcements are also hyperlinked to guide students with the course navigation. I could not emphasize enough how much I value the internal messaging in the Canvas grade book that was briefly discussed in my previous post. This feature allows instructors to message students who haven’t submitted yet or who scored less than a certain point. Definitely a slick way to send quick emails to a target group.

Recently, I have been experimenting with a range of visual cues (e.g., emojis) to categorize course content. An example is provided below.

Screenshot of the module view of the course, demonstrating using of emojis as visual cues next to assignments. A written assignment has a pencil and paper emoji, a quiz has a question mark emoji, etc.

There was also a recent post on using emojis for visual way finding and fostering a friendly tone in online classes here: My Experience with Emojis in Online Courses: Affordances and Considerations.

Conclusion

It’s always best to keep an open mind when trying out new teaching practices and adapt them to your individual style and subject matter.

If you have any online teaching practices that you’re fond of, please feel free to contact me at Xiaohui.Chang@oregonstate.edu as I will be very excited to hear them and test them out. 

In this post I’m returning to an important topic: accessibility. In a previous blog my colleague Susan Fein explained how everyone benefits from more accessible materials and that a large number of our students have some degree of disability.

Word documents are ubiquitous in our courses, as well as for other work-related activities. If a Word document is designed for digital consumption – such as posting in the Learning Management System or on a website – it needs to comply with accessibility standards. Fortunately, Word includes excellent tools for making your file accessible! I will first go over the main accessibility features, and then show you how to implement them in the video below.

  • Accessibility checker: Word includes a tool that helps you check your work. It is useful but it doesn’t catch all the errors.
  • Structure: headings, spacing, lists: Marking these properly will let screen reader users skim the content and understand its organization easily. Structure a document in a hierarchical manner: the title should be Heading 1 (NOT the “Title” style – that one just gets read as simple text). The next major sections should be Heading 2, subsections of a Heading 2 are Heading 3, and so on. Do not skip levels. You can change the appearance of all these styles to match your aesthetic. If you wish, you can also save style sets to have them ready to use.
  • Images: There are two main things to take care of here: adding alt text (so screen reader users can listen to the description) and making sure that the image is in line with the text (to keep the reading order clear).
  • Colors: If you use colors, make sure there is enough contrast between text and background.  Even people with good eyesight can struggle to read something if the contrast is not strong. In addition, remember that many people are color blind, so do not rely on color to convey essential information. For example, avoid something like “The readings in blue are very important, make sure you read them carefully! The optional resources are in green”. Use other means of signaling instead, such as bold or italics.
  • Links: Links need to include meaningful text rather than the URL. A screen reader will read the URL one letter at a time, which is not very helpful. In addition, descriptive links help both screen reader users and sighted users skim the document to get an idea of the content or find specific information.
  • Tables: Tables can cause trouble to screen reader users – do not use them for layout! Only use them for actual tabulated information. When you use tables, the main rule is to keep them simple and avoid split cells, merged cells and nested tables. Then, make sure you have a designated header row, which helps screen reader users navigate the data.
  • Document properties: The document needs to have a title set in its properties. This title is helpful for blind users because the screen reader announces it as the document is loaded in the program.

Save to PDF – yay or nay? Avoid turning your document into a PDF file, if the document is meant for online reading. PDFs are hard to make accessible. If you must make a PDF, start with a fully accessible Word file. It is recommended to use PDFs only when the design includes complex or unusual elements (for example special/technical fonts, musical notes etc.). If you are using a PDF because you have a complex layout, consider posting both the PDF and a simplified Word file, in case someone needs the fully accessible version.

Watch this 10-minute video that walks you through an example of making a document accessible. I’m using Microsoft 365 on Windows – if you’re using another version of Word or platform, things may look slightly different. Timestamps:

  • Accessibility checker – 00:38
  • Headings – 01:46
  • Lists – 04:56
  • Spacing – 05:27
  • Images – 06:16
  • Colors – 07:29
  • Links – 08:09
  • Tables – 08:49
  • Title Property – 09:33

As you can see, the process of creating accessible Word documents is straightforward. Turning this into a standard practice will greatly help people who access information electronically, with or without assistive devices. Let’s make it happen!

References:


This past February, I was putting together a proposal for the 2022 Distance Teaching & Learning (DT&L) Conference, and I shared my draft with a couple of my colleagues for feedback.

Typically, when requesting feedback, our team relies on Google Docs, which has a nice feature set for suggesting edits.

However, I was not using Google Docs. I explained that they would be viewing my formatted document on HackMD, a collaborative web-based Markdown tool.

One of the colleagues I had asked for feedback responded:

What are the pros and cons compared to a google doc, may I ask?

That question inspired this blog post.

What is Markdown?

Markdown is a plain text format with a simple syntax to add formatting elements (headings, lists, quotes, bold, italics, etc.). It is easy to convert Markdown files into other formats, such as PDFs, HTML, and rich text. One of the primary uses of Markdown is creating content for the web, which can be done with almost no knowledge of HTML. The first Markdown specification was developed by John Gruber and Aaron Swartz in 2004 and released as Open Source.

What Are the Advantages of Writing in Markdown?

It Is Easy to Learn and Fast to Write

Most markdown syntax is intuitive. Perhaps you are writing a document, and you decide you want to emphasize some text using bold or italics styling. In Markdown, you can surround the words with underscores or asterisks rather than select content and apply a style from a menu or keyboard command. For bold text, add either two asterisks or two underscores before and after the word (your choice, most editors support either syntax):

**bold**
__bold__

For text that you want to be displayed in italics, use one underscore or asterisk before and after the word:

*italics*
_italics_

Creating hyperlinks in documents, a somewhat tedious process in a word-processing program or HTML, is as easy as putting a descriptive link text in brackets and then an address immediately following in parenthesis, like this:

[OSU Canvas Dashboard](https://canvas.oregonstate.edu/)

which in my document becomes: OSU Canvas Dashboard.

It Is Just a Text File

A Markdown file with the extension “.md” is just a plain text file. Storing information in plain text files has several advantages:

  1. Text files are future-proof. You can open a plain text file with any editor on any platform. You are not hostage to the proprietary format chosen by an application developer. You are not dependent on any particular software program still being around to open your Markdown files.
  2. Text files require very little storage. This blog post, written in Markdown, was almost 250% larger once converted to a Microsoft Word document.
  3. Text files are platform-agnostic, making them easy to share with other people or multiple devices. A text file can be opened on a Mac, on Windows, in Chrome OS, in a web browser, on an ios or Android smartphone, or on a Linux machine.
  4. If you open up one of your Markdown text documents in platforms like Box or Dropbox, it automatically renders the HTML.

Markdown is Highly Portable

One of the most significant advantages to writing in Markdown is how easy it is to convert Markdown into virtually any other file format:

  • HTML: With no knowledge or experience in web development, you can quickly convert Markdown to HTML. There are many ways to convert Markdown to HTML. You can use a web-based tool such as Markdown2Html or StackEdit or work in a text editor with support for exporting Markdown in various formats like Brackets.
  • RTF: An RTF file keeps basic formatting, such as links or emphasis, while retaining a text file’s flexibility and small size.
  • PDFs: Many Tools support applying CSS-based styles during a conversion. On my Mac, I use Marked 2 and several of the Marked 2 – Custom Styles to create beautiful PDF files.
  • Word: Markdown formatting information (titles, headings, quotes, paragraphs, lists, etc.) is retained during conversion. Suppose you convert a document from Markdown to Word. You can then apply any of the built-in styles available in Microsoft Word to format your file instantly.

For a much longer list of the supported conversion file types, explore Pandoc, a universal conversion utility. Using Pandoc, I have converted markdown files into a slide deck, a mind map, a Google Doc, and a Microsoft Word doc, but there are dozens of additional options.

It Is Easier to Read and Write Than HTML

Let’s look at a numbered list with some simple formatting. I have applied bold to item 1 and italics to item 4:

  1. Analysis
  2. Design
  3. Development
  4. Implementation
  5. Evaluation

Here is what that list looks like in Markdown:

1. **Analysis**
2. Design
3. Development
4. _Implementation_
5. Evaluation

If you were to write that same list in HTML, it would look like this:

<ol>
<li><strong>Analysis</strong>
</li><li>Design</li>
<li>Development</li>
<li><em>Implementation</em></li><li>Evaluation</li>
</ol>

Even if you are comfortable coding in HTML, writing the list in Markdown is much quicker and can be quickly converted to HTML at any time.

You Can Write Without Distraction

Using Markdown, I can focus on content rather than the formatting. I can indicate how something should be formatted (as a hyperlink, heading, paragraph, etc.) and then let a MarkDown tool transform my document to numerous other file types. I don’t have to look at dozens of text and paragraph formatting options on a ribbon toolbar or interrupt my writing to apply them.

What Do You Need to Get Started?

A Text Editor

You can write Markdown in any text editor. However, many tools provide a real-time preview of your formatted document and give you several export options. These web-based Markdown tools are free options worth exploring:

  • Dillinger is a great place to start. You can experiment with the syntax and instantly preview your content without installing any software on your computer. StackEdit works much the same way. Both are free, and both support export to HTML and PDF.
  • HackMD is another web-based tool, also free, which has collaborations options.

If you prefer working in a desktop application, there are also many options. Here is a nice write up of several Markdown Editors.

Learning the Syntax

After choosing your editor, you need to get familiar with some basic syntax. The most common and helpful Markdown syntax is very easy to master. You saw bold, italics, and a Markdown link earlier. Here are a few more examples:

Headings

To place a heading in the document, precede the text for the heading with one or more hashtags. Here’s a level two heading:

Level Two Heading

In Markdown, you would write it like this:

## Level Two Heading

Many Markdown editors also support the use of an id in a heading:

### Level Three Heading {#custom-id}

When converted to HTML, this will give you an anchor that you can use to link directly to that heading.

<h3 id="custom-id">Level Three Heading</h3>

Lists

Lists look much like they would in any other document. Here is a numbered list:

  1. trumpet
  2. french horn
  3. tubal
  4. trombone

which in Markdown is:

1. trumpet
2. french horn
3. tuba
4. trombone 

and an unordered list:

  • cymbal
  • drum
  • marimba
  • tambourine
  • xylophone

looks like this in Markdown:

- cymbal
- drum
- marimba
- tambourine
- xylophone

Or you can use the single * with a space to make a list of items like this:

* string instruments
    * cello
    * violin
    * harp

Note the support for indenting lists using spaces in the example above, which would work with either * or -. The Markdown list above would render like this:

  • string instruments
    • cello
    • violin
    • harp

Hyperlinks

To make a hyperlink in Markdown, you write a descriptive title in brackets, followed by the URL in parenthesis, as mentioned above. You can even save yourself the trouble of manually creating markdown links through the use of one of the many available browser extensions like this one for Chrome or this one for Firefox, which allow you to copy a website address as a Markdown link.

Rather than document the complete set of Markdown formatting options, I will refer you to the Markdown Basic Syntax Guide or in Markdown:

[Markdown Basic Syntax Guide](https://www.Markdownguide.org/basic-syntax/)

MultiMarkdown: An Expansion of the Language

The Markdown language is Open Source. Since its inception, other developers have enhanced the language to include options beneficial to academic writers. These include:

  • tables
  • blockquotes
  • citations
  • footnotes [^1]

Adding specific examples of these items is beyond this basic Markdown blog post. Instead, I recommend reviewing the MultiMarkdown v6 Syntax Guide. As you will see, the syntax for the new items follows the same spirit of being easy to add to a document and relatively intuitive syntax.

Advanced Tools and Applications

If you want to do a deep dive on Markdown, here are a few resources you can explore:

Yes, But What Are the Cons?

You may recall that my colleague asked about the pros and the cons. So, as much as I love writing in Markdown, I should be transparent about the limitations I have encountered.

  1. Collaboration. Both Microsoft Word and Google Docs support providing feedback on documents using the review or suggestion features. I have yet to find a Markdown editor that supports this type of collaboration. When I want to have a document reviewed, I convert the Markdown document to one of those other formats and then convert it back after implementing the feedback. Converting from Markdown to something, as I have said, is something most markdown editors already do. Converting from some other format to Markdown may take more effort. In this case, I used a Google Doc add-on, Docs to Markdown.
  2. Citation tool support. When writing in academia, I use an integrated tool for citation. Zotero, when installed as an add-on to Word or Google Docs, will help generate bibliographies and inline citations. I have managed to integrate Zotero integrations into my Markdown editor of choice (Visual Studio Code), but it was very fiddly. I followed the setup described in this video: Setting Up a Scholarly Writing Environment With Markdown, VSCodium, and Pandoc. Not for the faint of heart, with a very detailed how-to, step-by-step video, it still took me the better part of a Saturday, with reasonably in-depth knowledge of Markdown, Zotero, and my editor.

Conclusion

To begin your Markdown journey, I suggest starting here: Markdown Guide. The easiest way to learn Markdown is to start using it; you can learn the basics in minutes. Once you do, you will find broad application and support. You can use Markdown to write HTML, draft blog posts, create documentation, and post messages on messaging platforms or forums such as Reddit, Discord, and GitHub.

[^1]: It seems worth mentioning, in a footnote, that I wrote this blog post entirely in Markdown. Feel free to download it and take a look. To see it with the formatted HTML, try pasting it in the online markdown editor Dillinger.

By Susan Fein, Ecampus instructional designer

If you use slide presentations to deliver information and then provide a digital version of the slides to support learners, this post is for you!

Instructors teaching online or who use a companion LMS or website to accompany in-person classes often upload the slide file to aid students in notetaking. However, you may not be aware that digital files are not automatically accessible to those using assistive technologies, such as screen readers. Following a few simple and easy guidelines will improve accessibility of your materials for all students and demonstrate your thoughtful attention to inclusivity and equity.

Who Benefits from Accessibility?

Everyone, not only those with disabilities, benefit from accessible learning materials. The U.S. Census Bureau estimates that there are more than 40 million people in the U.S. with a disability, so odds are good that some of them will be in your courses.

Accessibility practices support all learners, not just those who require them. In 2016, the OSU Ecampus Research Unit conducted a nationwide survey about student use of video closed captions. In that study, 70% of respondents who did not self-identify as having a disability used captions at least some of the time.

I asked OSU’s disability access center how many online students request disability-related accommodations. So far this year, 23.9% of those served by their office are Ecampus students. Last year, nearly 40% of all Ecampus courses had at least one student with an accommodation, and nearly 15% of all online-only students used a disability-related accommodation.

To ensure equity, regardless of who does or does not depend on accessibility support, it is vital to make all learning materials compliant with accessibility standards. When educators intentionally create fully accessible materials, we more equitably serve all online learners.

What Can You Do?

Here are five easy-to-follow tips that elevate your commitment and ability to create accessible materials.

Tip #1. Use a template. Templates are important because basic formatting for accessibility is already built in. By inserting your content into designated sections, you preempt some accessibility issues without any extra effort. For example, when you insert the topic of each slide into the designated title field, the slide structure maintains the correct sequence in which a screen reader encounters the various elements on the slide. If you are concerned about being too constrained or predictable, these designated fields accommodate your creativity! It is okay to reshape, resize, or reposition a field if you do not like its default appearance or location.

Regardless of which end of the design spectrum you lean, always start with a template. If you are not fond of colorful designs or fancy formats, there is a basic, unadorned template you can use. If you are a fan of fun, frivolity, or fabulous, select one of many free template options found online to suit your theme or topic. Check out the different templates Ecampus has developed with college-specific themes. One of them might be a good fit for you.

Tip #2. Enter a unique title on each slide. Each slide in your presentation must have a unique title. This permits a screen reader to navigate easily from one slide to the next. What happens when you have segments of the presentation that require two or more slides to fully deliver the information? No problem! There are various ways to address this.

When several slides focus on a different aspect of the primary topic, use that in the title. For example, you are creating a presentation about Health and Wellness and have multiple slides on the topic of Cooking. You want to introduce the topic, describe meal preparation, and offer ideas for healthy snacks. Since these are three distinct subtopics, a good approach is to label the slides as Cooking: Overview, Cooking: Meal Preparation, and Cooking: Healthy Snacks. Repeating the main topic in the title helps the learner connect each segment but still delineates separate subtopics.

If the subject matter does not neatly break into clear subgroups, it is fine to use a sequential number, such as Cooking Part 1, Cooking Part 2, etc. Since most creators develop a presentation’s content, sequence, and flow thoughtfully and logically, if you take a moment to consider why you grouped together specific ideas, the unique titles will likely emerge.

Tip #3. Follow best practices. If you search online for guidance about how to create effective slide presentations, you will discover that many sources offer similar suggestions. Most of these include recommendations about text (contrast, font size, font style), use of images, page structure, and so on. Use this short list as a helpful reminder of these other accessible-friendly best practices.

  • Text should be easy to read, with good contrast. Black text on a white background is ideal and classic. Be cautious of templates with too subtle contrast. They might not meet accessibility guidance for visually disabled learners. Use 18-point (or larger) sans serif font for readability.
  • Use images judiciously. Pictures convey themes, present an idea, or evoke a mood. However, too many can detract from the message, be confusing, or appear unprofessional. Aim for a “less is more” approach. (Learn more about accessibility for images in the next tip.)
  • Include adequate white space to separate and group content. Bullets are optional. Keep slide structure simple. Use phrases or a few words rather than full sentences. Break up content into multiple slides to avoid crowding.

Tip #4. Create alt-tags for images. A screen reader recognizes the presence of an image but it cannot discern the content. To be accessible, that information is provided as a text description or alt-tag.

If you have images in your slide deck, each must have an alternate text description. The alt-tag describes and explains the content of an image. Usually it is not accessible or helpful to use the file name. And beware of tools that try to divine the content of an image and insert descriptions. These are usually wildly inaccurate and unhelpful.

The majority of images in an effective presentation should be essential to the learner’s experience; the image is required for accurate comprehension of the content. The are images such as charts, graphs, photos, maps, or data. Other images may be optional or decorative; nice to have but not essential to the learning and, if not seen by the student, do not impede the learner’s ability to grasp the material.

For essential images, write a brief (1-3 sentences) text description. No need to include lead-in words like “this is an image of…” Describe the key educational value of that image. What about it is important to the learner? What is the essence of the information you want the learner to know about that chart, graph, or photo?

Screen shot of alt text box for an image from Office 365 PowerPoint
Screen image from Office 365 PowerPoint

Decorative images have two options: enter a description or skip over the image. To skip, enter null text (“ ”) as the alt tag or, if available in your version of PowerPoint, select the “decorative” option. Both choices direct the screen reader to ignore the image. If you prefer to tag a non-essential image, use a simple description, such as “team logo” or “Professor Kumar.”

Understand that writing good alt tags is a challenging skill that takes time and practice to master, so do your best. You may want to confer with the Disability Access Center, an instructional designer, or other faculty support group if you need assistance.

For more information about how to write effective alt tags, refer to these or other resources.

Tip #5. Use meaningful text to format links. Please do not insert a full URL on your slide. Screen readers recognize a URL link and read aloud every individual letter and symbol, often in a monotone mechanical voice, depending on the specific assistive tool. Think about how frustrating, confusing, and unhelpful that is. Instead, format each link using meaningful text, as demonstrated in this post. For example, the two resources linked above use the article’s full title as the meaningful text. Also, avoid the over-used, too generic “Click here for more information,” with the word “here” formatted as the hyperlink. Instead, select text that specifically identifies the URL content, such as “Visit the Disability Access Services web page for more information.”

Accessibility Supports Equity

Demonstrate your commitment to equity! With just a few extra minutes, you can easily meet minimum accessibility standards by following these tips and using the accessibility checker tool built right into PowerPoint!

Reference

Linder, K. (2016). Student uses and perceptions of closed captions and transcripts: Results from a national study. Corvallis, OR: Oregon State University Ecampus Research Unit.

In your work as an instructor or instructional designer, what kinds of course design problems have you been trying to solve lately? Perhaps there’s a discussion board assignment that you’d like to make more engaging, or maybe there’s a lab activity that students struggle with.


According to recent research findings published in the journal Nature, “…people are more likely to consider solutions that add features than solutions that remove them, even when removing features is more efficient” (Meyvis, T. and Yoon, H., 2021). In a course design context, this means we will probably reach for something we can add to our course to fix a problem: a shiny new tool we learned about at a conference, an extra video lecture, or an additional step for that lab activity that students struggle with. We do need to include quality tools and fresh media to our courses, certainly. However, because there is so much to cover in any given course, we should strategically subtract all unnecessary elements. The aforementioned Nature article has brought to my attention that I may be regularly neglecting the powerful design move that subtraction offers. As a result of reflecting on that, I’ve collected a few examples of how instructors and instructional designers can use subtraction in course design.

Subtraction example #1: Remove formal requirements from informal practice activities

Let’s take a look at a discussion board assignment as an example. Sometimes discussion boards are treated more like formal writing opportunities than discussions. For example, do you require students to not only respond to the prompt but also use a formal style of discourse and cite evidence in accordance with APA style guidelines and do so in a certain number of words? We don’t require students to use APA style or converse with a word count in our in-person discussions, so why would we do this in an online course (Darby, 2020)? Consider subtracting those formal writing requirements for discussion boards, and reserve the APA citations and formal requirements for polished writing assignments. That way, online discussions can be a place to practice and informally grapple with new concepts and ideas the way that face-to-face discussions are. Then, after students have a chance to work through topics in an informal way, they will be ready to try more formal tasks on the topic, such as constructing an argument and appropriately citing evidence according to a particular style guide.

Subtraction example #2: Reduce the frequency of office hours

If you hold office hours at a set time each week, and you notice that few students attend, consider doing away with the set weekly “office hours” altogether. Instead, invite students to make an appointment with you at least once during the term, at a time and in a modality that works well for them, or reduce the frequency of office hours to two or three timely sessions (optional attendance) per term, such as before each exam. Take questions in advance so that students too busy to attend can still benefit from the sessions, and post a recording of the session afterward in an announcement. According to Lowenthal, Dunlap, and Snelson (2017), less frequent but more focused office hours increased participation from students. Lastly, consider renaming your new infrequent office hours to something warm and inviting, such as “Coffee Break” or “Consultations” (Darby, 2019), which students may find more welcoming. Building in plans for facilitation and instructor presence in the early stages of course development allows faculty to focus more on teaching while the course is running and less on reactive problem solving.

Subtraction example #3: Dethrone teaching “folklore”

Teaching “folklore,” which John Warner calls the ineffective “practices handed down instructor to instructor” (p. 207, 2020), shows up uninvited, particularly when you have been assigned a course to teach that you had no hand in developing. One example of teaching folklore is the stubborn assumption that serious scholars are gatekeepers for their fields. Evidence of this exclusionary approach may show up in the form of a stern, overly formal, or cold tone in a syllabus. Consider removing verbiage that conveys a cold tone, since we now know that warm-tone syllabi encourage students to reach out to their professors (Gurung and Galardi, 2021). Another example of this is inflexible class “policies” that reflect an individual instructor’s preferences and not university policies. Consider reviewing the policies stated in the syllabus and delete any that are not aligned with actual university policies. Further, the idea that students must achieve a level of eloquence and scholarly sophistication on par with faculty in order to be considered for a grade of “A” on an assignment is another example of this. Evidence of this type of folklore could be found in rubrics with benchmarks that are nearly impossible to achieve. The element that could be subtracted here is not the rubric, but rather the specific language in the rubric that makes it impossible for students to succeed in the assignment. Neuromyths, which are false beliefs about the brain and learning, could also be included in the category of teaching folklore. If you spot neuromyths in a course, remove them. In summary, if you spot one of these ineffective teaching folklore elements in your course, consider removing the “folklore” item.

For this design challenge, try subtracting ineffective design elements before adding new items to solve course design problems. If you are unsure if something should stay or go, ask yourself what purpose this element serves in the course. It should then become clear whether the item belongs or needs adjustment. Even small adjustments can transform learners’ experiences. What have you removed from your course? Share how the process was for you by leaving a comment.

References:

Blum, S. D. (Ed.). (2020). Ungrading : Why rating students undermines learning (and what to do instead). West Virginia University Press.

Darby, Flower. The Secret Weapon of Good Online Teaching: Discussion Forums 6 ways to lead meaningful class discussions in an asynchronous online forum. August 24, 2020.

Darby, Flower, and James M. Lang. Small Teaching Online : Applying Learning Science in Online Classes, John Wiley & Sons, Incorporated, 2019. ProQuest Ebook Central, http://ebookcentral.proquest.com/lib/osu/detail.action?docID=5780349.

Created from osu on 2022-01-18 23:50:41.

Gasiewski, J.A., Eagan, M.K., Garcia, G.A. et al. From Gatekeeping to Engagement: A Multicontextual, Mixed Method Study of Student Academic Engagement in Introductory STEM Courses. Res High Educ 53, 229–261 (2012). https://doi.org/10.1007/s11162-011-9247-y

Gurung, R. A. R., & Galardi, N. R. (2021). Syllabus Tone, More Than Mental Health Statements, Influence Intentions to Seek Help. Teaching of Psychology. https://doi.org/10.1177/0098628321994632

Lowenthal, P. R., Dunlap, J. C., & Snelson, C. (2017). Live synchronous web meetings in asynchronous online courses: Reconceptualizing virtual office hours. Online Learning , 21 (4). https://doi.org/10

Meyvis, T. & Yoon, H. (2021). Adding is favoured over subtracting in problem solving. Nature.

Shi, T. Debunking Neuromyths and Applications for Online Teaching and Learning: Part 1. February 13, 2019. Ecampus Course Development and Training Blog.

Warner, J. “Wile E. Coyote, the Hero of Ungrading” from Chapter 13 of Ungrading.

clipboard, green apple, notebook, hand writing with pencil, scissors and spool of thread emojis used in module items

What should you know about emojis if you plan to use them in your online courses? Not being an extremely online person and not, perhaps, of the right generation, I came to emojis later than others and felt uncertain using them. What did these symbols communicate to others, and how would it reflect on me if I used them in my work with instructors and students? Without research-based answers to these questions, I nonetheless began using emojis in online course designs for the purpose of visual wayfinding and for fostering a friendly, playful tone. After several terms of using emojis in this way, I wondered whether they were accomplishing my goals. Now I’d like to share the background on emojis I’ve researched—and wish I had had earlier—so that you can avoid any missteps.

Wayfinding

Using emojis in the Canvas Modules menu (which doesn’t otherwise permit any modification of its visual design) has been one way to increase the salience of certain items or to lend them a certain skeuomorphism. With ‘at-a-glance’ speed—faster than reading text—students can quickly identify their intended navigational path once they’ve grasped the symbolism of each emoji. I use these symbols consistently for assignments of the same type across weekly modules. Here’s how the emojis looked in a graphic design course, which itself featured a lesson on semiotics and the way icons, indexes, and symbols operate as visual shorthand:

There are 6 module items arrayed one on top of the other in a list. Each item title has a number, a distinct emoji, and a text-based title. The emojis used are a clipboard, green apple, notebook, hand writing with pencil, scissors and spool of thread.

All the emojis chosen for this course reference the domain of school or making—a scissors represents creative assignments, a spool of thread winks at the idea of “threads” in a discussion. The usage of emojis, along with other design choices related to page layout and color scheme, was a way to model the design skills being taught. Students could thus experience how thoughtful design influenced their interactions with a digital product, in this case, a college course.

Tone

I had also hoped that using emojis would communicate to students that a course was welcoming, approachable, and not all deadly serious. Much research has been done to understand how the set of emojis depicting faces influences the emotional reception of text-based messages, but my course designs have generally used non-face emojis. Research on this set of objects, the meaning and emotional valence of which might be more opaque, also shows that emoji objects communicate positive affect or playfulness, perhaps because they demonstrate that the user has invested care and emotion work in choosing an emoji appropriate for interpersonal exchange (Riordan, 2017). Whether that is appropriate within online learning is less clear; emojis were found to increase students’ perception of how caring an instructor was, but they also led students to perceive the instructor as less competent (Vareberg and Westerman, 2020). And while they might “lighten the mood,” emojis were considered inappropriate in contexts that students considered formal, such as email (Kaye, et al., 2016). Within the domain of commerce, emojis in ads were pleasing to customers when the product was perceived as hedonic rather than utilitarian, suggesting again that context is a critical factor in emoji’s reception. Another consideration to have in mind is the multiplicity of interpretations an emoji might have at the intersection of gender, language, culture, etc. (Bai, Qiyu, et al., 2019), and how that will affect your intended tone.

Considerations with Accessibility

In testing my emojis in Canvas, I relied on ReadSpeaker TextAid; this accessibility tool simply skipped emojis and read only the surrounding text aloud – which was fine, as the critical content I wanted to communicate was in text form, and the emojis were essentially decorative. Unfortunately, after reading a great post on the experience of emojis for individuals with sight impairments who use assistive technology, I discovered that the ReadSpeaker TextAid behavior wasn’t typical. Using screenreaders more commonly used by individuals with sight impairments, I then confirmed that when emojis are encountered, their official names are, indeed, read aloud. This means that my visually clever discussion title was now rendered in speech as ‘2.6 Spool of Thread Discussion,’ lengthening the time it took to get to the useful information and adding irrelevant content. Whereas an emoji can be hidden from assistive technology via html on a Canvas page or assignment, there is no mechanism to do this within the title of a page or assignment. This means that, if an emoji is a must-have, it should be placed at the end of the Canvas item title, where it will be read last and prove less bothersome to learners using screenreaders. For me, however, this creates a jagged, irregular visual appearance when viewed in the Canvas Modules menu, and coming at the end of the title, makes the emojis a less useful navigational shortcut for sighted students.

Emojis appear at the end of each module item in a list of six. Each item title has a different length, so the emojis appear at different distances from the start of each line.

For tips on accessible emoji use, you should read Emojis: Readibility Guidelines and “Do Emojis and Accessibility Work Together?”. If you need to identify an emoji’s official title as read by a screenreader, consult the emoji’s entry in emojipedia.org, which will also show you the varied appearances an emoji takes on different platforms—another consideration you’ll need to have in mind.

Is the Party Over? 🎉

Unfortunately, with this research in mind, I can no longer sprinkle emojis throughout my Canvas courses like so much happy confetti. Now, I’ll recommend to the instructors I partner with that they use emojis sparingly, for the purposes of communicating the emotional valence of a message (to ‘smooth out the rough edges of digital life,’ as so incisively put by Stark and Crawford, 2015) or to increase salience, but always in accessible ways, and always with a few caveats in mind.

References

Aitchison, Suzanne. “Accessible Images, Icons and Emojis.” Up Your A11y.

Bai, Qiyu, et al. “A Systematic Review of Emoji: Current Research and Future Perspectives.” Frontiers in Psychology, vol. 10, Frontiers Research Foundation, 2019, pp. 2221–2221, doi:10.3389/fpsyg.2019.02224. Full Text.

Content Design London. “Emojis.” Readability Guidelines.

Finke, Beth. “Emojis and Accessibility: The DOS and Don’ts of Including Emojis in Texts and Emails.” Easterseals Blog.

Kaye, Linda K., et al. ““Turn That Frown Upside-down”: A Contextual Account of Emoticon Usage on Different Virtual Platforms.” Computers in Human Behavior, vol. 60, Elsevier Ltd, 2016, pp. 463–67, doi:10.1016/j.chb.2016.02.088. Full Text.

Mace, Di. “Do Emojis and Accessibility Work Together?” Blueprint – Blog by Tiny.

Riordan, Monica A. “Emojis as Tools for Emotion Work: Communicating Affect in Text Messages.” Journal of Language and Social Psychology, vol. 36, no. 5, SAGE Publications, 2017, pp. 549–67, doi:10.1177/0261927X17704238. Read via OSU Library.

Stark, Luke, and Kate Crawford. “The Conservatism of Emoji: Work, Affect, and Communication.” Social Media + Society, vol. 1, no. 2, SAGE Publications, 2015, p. 205630511560485, doi:10.1177/2056305115604853. Full Text.

Vareberg, Kyle R., and David Westerman. “To: -) Or to ☺, That Is the Question: a Study of Students’ Initial Impressions of Instructors’ Paralinguistic Cues.” Education and Information Technologies, vol. 25, no. 5, Springer US, 2020, pp. 4501–16, doi:10.1007/s10639-020-10181-9. Read via OSU Library.

Subject matter experts in many fields have embarked on authoring projects with the goal of replacing traditional published texts or customizing content for specific learners’ needs, yet large-scale creation of open textbooks or series designed for language learners has been slower to gain traction (Blyth and Thoms, 2021). Efforts in this area have largely been limited to adapting existing OER materials (5R activities) for specific learning contexts or piecemeal creation of online activities to provide reinforcement of isolated language skills. Part 1 in this series outlines the potential benefits, limitations, and challenges that programs and instructors face when undertaking large-scale authoring projects to address the needs of language learners. The purpose of this second post is to offer guidance for creating open source language texts and present a framework for getting started.

Language Acquisition as an OER Subject Matter

Before getting into the nitty-gritty of creating an OER for language learners, it is worth pointing out how this process differs from open authoring projects for other disciplines. While OER writing projects come with inherent challenges regardless of the field, authoring comprehensive language learning content presents a unique challenge. One reason for this is that language teaching and acquisition involves complex sequencing and scaffolding of skills, language items, and linguistic concepts unique to the field of language acquisition (Howard and Major, 2004). An effective resource must present language items not only in the established order of second language acquisition, but also at the correct level for the learners at hand. The “correct level” is fluid and influenced by many variables (first language interference, motivation, metacognitive skills related to the process of learning a language, fossilization of rules, literacy in the first language, prior knowledge and educational experiences, and so on). While, say, writing a history text also involves expert scaffolding to ensure that content builds on what came before, there are fewer moving parts to align, and presentation and sequencing can and will vary from one subject matter expert author to the next. Effective language learning materials, on the other hand, are more like a house of cards that relies on complex relationships between a variety of aspects of the target language, language input, learning context, and characteristics of the learners themselves. 

Language acquisition occurs when input is just beyond what students understand of a language (known as comprehensible input i + 1), so writing materials that consistently hit the sweet spot for learning is tricky even for the most seasoned language educator. In addition to presenting language in a specific sequence and at the appropriate level, authors must also consider how much new language content is enough at each stage and how to introduce, recycle, and reinforce this language through engaging and original texts as well as audios that present authentic and relevant contexts. All of this new content must then be aligned to learning outcomes related to both language form and function. Learners need not only the nuts and bolts of the language, but pragmatics are equally important—how is the language used in specific contexts and with a variety of interlocutors? What models will convey this information accurately in a way that is accessible at different levels of proficiency? 

Understanding the social aspect of language is as important as the grammar and structure. Language proficiency involves much more than speaking and listening in a new language. All of the linguistic aspects must be delivered via content that also serves as a vehicle for familiarizing learners with the cultural and social contexts where the language is spoken. This should be done in a thematic way, weaving in social justice issues in a timely and relevant manner, sensitive to the complexity of the issues at hand. The author(s) must also be able to write engaging texts that present level-appropriate target grammar, vocabulary, and cultural information in activities that build upon each other or recycle the language previously taught. In addition to being linguistically sound, these original texts and audios must also demonstrate awareness and care for representation, integrating cultural and social justice topics relevant to the diversity of cultures, communities, interests, and social issues of a variety of speakers of the target language. 

Creating language materials that incorporate all of these considerations requires a broad skillset beyond expertise in teaching the subject matter. Significant professional development and exploration may be necessary before embarking on expansive authoring projects for language learning. With careful coordination and planning, and an understanding of the process and support required, language programs, instructors, and learners stand to reap long-term benefits from creative, relevant, inclusive, and dynamic open resources. What follows is a suggested process and a sample framework for undertaking open source textbook production for language learning contexts.

Step 1: Survey of needs, resources, and intended uses

The first step in any authoring project is to identify the needs of a program and determine what kind of text will be used and how. This includes the extent of the textbook use within the department and also as a resource for the broader language learning community. A quality textbook resource can increase student autonomy and interest in language learning generally by providing accessible resources readily available to learners anywhere in the world (Godwin-Jones). At this stage, some questions to ask include: 

  • Who are your learners and what is their motivation for learning a new language? 
  • What kind of textbook needs to be replaced? What gaps do you seek to fill by replacing current text materials? 
  • How will the resource fit into the larger curriculum? 
  • Is the need for a single course text or a cohesive series to cover an entire level or multiple levels? 
  • Who is available to collaborate and what are their areas of expertise? 
  • What resources and support are available for the project?
  • How will time and resources be accounted for? 
  • What is the timeline for implementation?
  • Who will provide expert and outside peer review of the textbook materials? 
  • How will the textbook materials be maintained and updated over time to ensure long-term viability? 

Most language programs involve extensive faculty collaboration. Instructors teach multiple courses across various levels. As such, it is important to promote broad participation in the planning stage to encourage instructor input, address concerns, and determine the scope of the implementation (e.g., across courses, levels). Gathering input on content and soliciting expertise among colleagues increases faculty buy-in and ownership of new materials.

Step 2: Identify the scope of your project

Once the shape of the project has been determined, it is time to outline the specifics of the resource(s) to be created. Determining the scope involves identifying learning outcomes. These are often mandated by the program, but they might also need to be rewritten or revised by the authoring team. Both the Common European Framework of Reference for Languages (CEFR) and the American Council on the Teaching of Foreign Languages (ACTFL) provide guidance on proficiency standards for world languages. Beyond language outcomes, it is also important to identify what the content goals are. This may involve generating a master list of topics, social justice and cultural themes to be addressed, and so on. At this stage, identify subject matter experts and any professional development needs. Who will participate as part of the core authoring team? Who will be responsible for quality control and review? Keep in mind that creating, reviewing, building, piloting, and maintaining comprehensive open language materials requires a significant time commitment, even if the goal is to create a single course text.

See ACTFL World Readiness Standards for Learning Languages

Step 3: Collaborate on a framework scope and sequence

The importance of this stage cannot be understated, particularly when multiple authors and stakeholders are involved. Once the themes, topics, outcomes, and other aspects of the materials have been identified and divided up into learning segments (levels across a series, units of a text, etc.), it is time to write the scope and sequence, which is basically a detailed outline. This outline should clearly show how everything fits together and serves as a framework for authoring materials that weave together language function and form, grammar points, text genres, readings, audios, pronunciation, vocabulary, practice activities, interaction, cultural and social justice themes, topics, etc.—all with attention to a logical progression, order of acquisition, recycling of language items, and student engagement. 


Let’s take a language text for English language learners as an illustrative example. If the grammar point for a learning segment is the present perfect tense, what types of contextualized content elicits that structure naturally? Perhaps a short biography representative of one aspect of the culture can serve this purpose. Reading and audio texts might present a person’s life experience so far. This offers an opportunity to consider whose lived experience will be represented via this text. Which vocabulary items are crucial for using the language around this topic? How much vocabulary will be new and how much recycled? Using the present perfect form as an example, we might focus on a number of participial adjectives and the prepositions for/since (She has been interested insince…). Language teachers as subject matter experts should have no trouble identifying these items regardless of the target language—this is how SLA comes into play. They teach this content all the time. The challenge is in putting it all together across units. That is, in addition to the grammar, punctuation, pronunciation, and writing systems (depending on the writing system of the language at hand) authors need to consider how the language builds on what was previously taught, how much is enough to present in each segment, what the cultural and social topics to be woven into authentic texts are, etc. A good scope and sequence defines all of this. For this reason, settling on a solid scope and sequence will require extensive coordination across subject matter experts, departments (in many cases), and in all cases, several rounds of review and revision before any writing begins.

sample scope and sequence template
Fig. 1 presents a sample unit from a scope and sequence created for a text for learners of English (CEFR A1+ level). This structure is applicable regardless of the target language although there may be some differences depending on the characteristics of the language. For example, phonetic languages may require less focus on pronunciation while languages using non-roman script will need to build in instruction on writing systems. View an accessible version of this template.

Step 4: Write and build

Once a final scope and sequence is in place and an authoring team has been identified, it’s time to start creating materials. Some questions to guide this stage include: 

  • Who will write the text and audio scripts? 
  • Who will provide diverse voice talent for audio texts? 
  • Who will record and edit audio? 
  • Where will the content be hosted and who will create it? (If using a tool such as Pressbooks, consider training for materials developers.) 
  • What platforms will be used for any interactive content? (H5P, Quizlet, Playposit, etc.) and who will build these? 
  • Where will the interactive repository be stored? 
  • Who is responsible for acquiring Creative Commons images and maps?
  • How will accessibility be ensured? 
  • What learner analytics will be gathered and how?

Because most of the activities in a learning segment tend to spring from the reading and listening input, it may be helpful to start with writing all of the texts for a level or course before creating the rest of the content. Audio and written texts must expose learners to a wide range of genres and text types (Tomlinson, 2012), so it may be useful to start by generating a list of genres to be covered. The texts, whether they are original or curated from online sources, must be reviewed and revised or adapted to ensure they contain the necessary language at the appropriate level, generate interest, employ the intended tone and voice for the genre, follow identified themes, incorporate social justice and cultural topics, and are accurate (in the case of non-fiction texts). If the content is curated, it needs to be reviewed for copyright and accessibility. 

Throughout the authoring stage, frequent check-ins among authors and reviewers can help to ensure quality, authenticity, inclusivity, and adherence to the determined scope and sequence. 

Step 5: Review and revise

Just as at every other stage of the process, peer reviews and revisions should be coordinated so that there is continuity in the editing process. It is important to enlist the help of internal and external subject matter experts. Assign different review tasks (big picture reviews of content and continuity along with detailed reviews of the language presentation) and provide each with review rubrics or guidelines to streamline feedback. External reviewers outside of the organization can help provide neutral insight. Enlisting the help of those with expertise in social justice topics, regional cultural perspectives, and different varieties of the language can help ensure accuracy, representation, inclusivity, and engagement. Be sure to review feedback as a team to reach an agreement on how to approach revisions to draft materials. 

Here is a sample rubric for reviewing original course materials, but rubrics should be adapted according to the scope and sequence and goals of each project.

Step 6: Implement and iterate 

Finally, it is time to pilot your new OER, but you aren’t done yet! Deliver the content to learners and collect their feedback as well as input from your teaching team. Keep in mind that an OER can be a work in progress, and one advantage of an open textbook is that it can be an evolving resource. Each iteration should involve coordination and input from the team who will be using the materials. Share your new resource widely. A high-quality OER opens the door for resource sharing with a broad community of colleagues, building visibility for the language program and lending credibility among colleagues around the world for the subject matter expert creators (Blyth and Thoms, 2021). 

Step 7: Create a plan for long-term viability: updating materials, quality control, and access

While creating an open source textbook for language learners can be a continually iterative process, once the new materials reach a point of stability and all stakeholders are satisfied with the product, authors or departments need to create a plan for maintaining the materials. Unlike costly textbooks which quickly become outdated, open access resources are easier to update (once the initial investment in time and resources has been made), save students money, and expand access to learners everywhere. The key is to create a plan for longevity so that updates are systematic, incorporate learner and instructor input, and are reviewed for quality control. The beauty of an OER for language learning is that it offers the opportunity to democratize teaching and learning by being responsive to the changing landscape of social justice education, shifting cultural influences, evolving characteristics of language learners, and distinct learning contexts.

References 

American Council on the Teaching of Foreign Languages (ACTFL)

Common European Framework of Reference for Languages – Companion Volume (2020)

Blyth, C. S., & Thoms, J. J. (Eds.). (2021). Open education and second language learning and teaching: The rise of a new knowledge ecology. Multilingual Matters. https://www.multilingual-matters.com/page/detail/?k=9781800411005

Godwin-Jones, Robert. “OER Use in Intermediate Language Instruction: A Case Study.” CALL in a Climate of Change: Adapting to Turbulent Global Conditions – Short Papers from EUROCALL 2017, 2017, pp. 128–134., https://doi.org/10.14705/rpnet.2017.eurocall2017.701. 

Howard, Jocelyn & Major, Jae. (2004). Guidelines for Designing Effective English Language Teaching Materials. 

Tomlinson, B. (2012). Materials development for language learning and teaching. Language Teaching, 45(2), 143–179. https://doi.org/10.1017/S0261444811000528