clipboard, green apple, notebook, hand writing with pencil, scissors and spool of thread emojis used in module items

What should you know about emojis if you plan to use them in your online courses? Not being an extremely online person and not, perhaps, of the right generation, I came to emojis later than others and felt uncertain using them. What did these symbols communicate to others, and how would it reflect on me if I used them in my work with instructors and students? Without research-based answers to these questions, I nonetheless began using emojis in online course designs for the purpose of visual wayfinding and for fostering a friendly, playful tone. After several terms of using emojis in this way, I wondered whether they were accomplishing my goals. Now I’d like to share the background on emojis I’ve researched—and wish I had had earlier—so that you can avoid any missteps.

Wayfinding

Using emojis in the Canvas Modules menu (which doesn’t otherwise permit any modification of its visual design) has been one way to increase the salience of certain items or to lend them a certain skeuomorphism. With ‘at-a-glance’ speed—faster than reading text—students can quickly identify their intended navigational path once they’ve grasped the symbolism of each emoji. I use these symbols consistently for assignments of the same type across weekly modules. Here’s how the emojis looked in a graphic design course, which itself featured a lesson on semiotics and the way icons, indexes, and symbols operate as visual shorthand:

There are 6 module items arrayed one on top of the other in a list. Each item title has a number, a distinct emoji, and a text-based title. The emojis used are a clipboard, green apple, notebook, hand writing with pencil, scissors and spool of thread.

All the emojis chosen for this course reference the domain of school or making—a scissors represents creative assignments, a spool of thread winks at the idea of “threads” in a discussion. The usage of emojis, along with other design choices related to page layout and color scheme, was a way to model the design skills being taught. Students could thus experience how thoughtful design influenced their interactions with a digital product, in this case, a college course.

Tone

I had also hoped that using emojis would communicate to students that a course was welcoming, approachable, and not all deadly serious. Much research has been done to understand how the set of emojis depicting faces influences the emotional reception of text-based messages, but my course designs have generally used non-face emojis. Research on this set of objects, the meaning and emotional valence of which might be more opaque, also shows that emoji objects communicate positive affect or playfulness, perhaps because they demonstrate that the user has invested care and emotion work in choosing an emoji appropriate for interpersonal exchange (Riordan, 2017). Whether that is appropriate within online learning is less clear; emojis were found to increase students’ perception of how caring an instructor was, but they also led students to perceive the instructor as less competent (Vareberg and Westerman, 2020). And while they might “lighten the mood,” emojis were considered inappropriate in contexts that students considered formal, such as email (Kaye, et al., 2016). Within the domain of commerce, emojis in ads were pleasing to customers when the product was perceived as hedonic rather than utilitarian, suggesting again that context is a critical factor in emoji’s reception. Another consideration to have in mind is the multiplicity of interpretations an emoji might have at the intersection of gender, language, culture, etc. (Bai, Qiyu, et al., 2019), and how that will affect your intended tone.

Considerations with Accessibility

In testing my emojis in Canvas, I relied on ReadSpeaker TextAid; this accessibility tool simply skipped emojis and read only the surrounding text aloud – which was fine, as the critical content I wanted to communicate was in text form, and the emojis were essentially decorative. Unfortunately, after reading a great post on the experience of emojis for individuals with sight impairments who use assistive technology, I discovered that the ReadSpeaker TextAid behavior wasn’t typical. Using screenreaders more commonly used by individuals with sight impairments, I then confirmed that when emojis are encountered, their official names are, indeed, read aloud. This means that my visually clever discussion title was now rendered in speech as ‘2.6 Spool of Thread Discussion,’ lengthening the time it took to get to the useful information and adding irrelevant content. Whereas an emoji can be hidden from assistive technology via html on a Canvas page or assignment, there is no mechanism to do this within the title of a page or assignment. This means that, if an emoji is a must-have, it should be placed at the end of the Canvas item title, where it will be read last and prove less bothersome to learners using screenreaders. For me, however, this creates a jagged, irregular visual appearance when viewed in the Canvas Modules menu, and coming at the end of the title, makes the emojis a less useful navigational shortcut for sighted students.

Emojis appear at the end of each module item in a list of six. Each item title has a different length, so the emojis appear at different distances from the start of each line.

For tips on accessible emoji use, you should read Emojis: Readibility Guidelines and “Do Emojis and Accessibility Work Together?”. If you need to identify an emoji’s official title as read by a screenreader, consult the emoji’s entry in emojipedia.org, which will also show you the varied appearances an emoji takes on different platforms—another consideration you’ll need to have in mind.

Is the Party Over? 🎉

Unfortunately, with this research in mind, I can no longer sprinkle emojis throughout my Canvas courses like so much happy confetti. Now, I’ll recommend to the instructors I partner with that they use emojis sparingly, for the purposes of communicating the emotional valence of a message (to ‘smooth out the rough edges of digital life,’ as so incisively put by Stark and Crawford, 2015) or to increase salience, but always in accessible ways, and always with a few caveats in mind.

References

Aitchison, Suzanne. “Accessible Images, Icons and Emojis.” Up Your A11y.

Bai, Qiyu, et al. “A Systematic Review of Emoji: Current Research and Future Perspectives.” Frontiers in Psychology, vol. 10, Frontiers Research Foundation, 2019, pp. 2221–2221, doi:10.3389/fpsyg.2019.02224. Full Text.

Content Design London. “Emojis.” Readability Guidelines.

Finke, Beth. “Emojis and Accessibility: The DOS and Don’ts of Including Emojis in Texts and Emails.” Easterseals Blog.

Kaye, Linda K., et al. ““Turn That Frown Upside-down”: A Contextual Account of Emoticon Usage on Different Virtual Platforms.” Computers in Human Behavior, vol. 60, Elsevier Ltd, 2016, pp. 463–67, doi:10.1016/j.chb.2016.02.088. Full Text.

Mace, Di. “Do Emojis and Accessibility Work Together?” Blueprint – Blog by Tiny.

Riordan, Monica A. “Emojis as Tools for Emotion Work: Communicating Affect in Text Messages.” Journal of Language and Social Psychology, vol. 36, no. 5, SAGE Publications, 2017, pp. 549–67, doi:10.1177/0261927X17704238. Read via OSU Library.

Stark, Luke, and Kate Crawford. “The Conservatism of Emoji: Work, Affect, and Communication.” Social Media + Society, vol. 1, no. 2, SAGE Publications, 2015, p. 205630511560485, doi:10.1177/2056305115604853. Full Text.

Vareberg, Kyle R., and David Westerman. “To: -) Or to ☺, That Is the Question: a Study of Students’ Initial Impressions of Instructors’ Paralinguistic Cues.” Education and Information Technologies, vol. 25, no. 5, Springer US, 2020, pp. 4501–16, doi:10.1007/s10639-020-10181-9. Read via OSU Library.

Subject matter experts in many fields have embarked on authoring projects with the goal of replacing traditional published texts or customizing content for specific learners’ needs, yet large-scale creation of open textbooks or series designed for language learners has been slower to gain traction (Blyth and Thoms, 2021). Efforts in this area have largely been limited to adapting existing OER materials (5R activities) for specific learning contexts or piecemeal creation of online activities to provide reinforcement of isolated language skills. Part 1 in this series outlines the potential benefits, limitations, and challenges that programs and instructors face when undertaking large-scale authoring projects to address the needs of language learners. The purpose of this second post is to offer guidance for creating open source language texts and present a framework for getting started.

Language Acquisition as an OER Subject Matter

Before getting into the nitty-gritty of creating an OER for language learners, it is worth pointing out how this process differs from open authoring projects for other disciplines. While OER writing projects come with inherent challenges regardless of the field, authoring comprehensive language learning content presents a unique challenge. One reason for this is that language teaching and acquisition involves complex sequencing and scaffolding of skills, language items, and linguistic concepts unique to the field of language acquisition (Howard and Major, 2004). An effective resource must present language items not only in the established order of second language acquisition, but also at the correct level for the learners at hand. The “correct level” is fluid and influenced by many variables (first language interference, motivation, metacognitive skills related to the process of learning a language, fossilization of rules, literacy in the first language, prior knowledge and educational experiences, and so on). While, say, writing a history text also involves expert scaffolding to ensure that content builds on what came before, there are fewer moving parts to align, and presentation and sequencing can and will vary from one subject matter expert author to the next. Effective language learning materials, on the other hand, are more like a house of cards that relies on complex relationships between a variety of aspects of the target language, language input, learning context, and characteristics of the learners themselves. 

Language acquisition occurs when input is just beyond what students understand of a language (known as comprehensible input i + 1), so writing materials that consistently hit the sweet spot for learning is tricky even for the most seasoned language educator. In addition to presenting language in a specific sequence and at the appropriate level, authors must also consider how much new language content is enough at each stage and how to introduce, recycle, and reinforce this language through engaging and original texts as well as audios that present authentic and relevant contexts. All of this new content must then be aligned to learning outcomes related to both language form and function. Learners need not only the nuts and bolts of the language, but pragmatics are equally important—how is the language used in specific contexts and with a variety of interlocutors? What models will convey this information accurately in a way that is accessible at different levels of proficiency? 

Understanding the social aspect of language is as important as the grammar and structure. Language proficiency involves much more than speaking and listening in a new language. All of the linguistic aspects must be delivered via content that also serves as a vehicle for familiarizing learners with the cultural and social contexts where the language is spoken. This should be done in a thematic way, weaving in social justice issues in a timely and relevant manner, sensitive to the complexity of the issues at hand. The author(s) must also be able to write engaging texts that present level-appropriate target grammar, vocabulary, and cultural information in activities that build upon each other or recycle the language previously taught. In addition to being linguistically sound, these original texts and audios must also demonstrate awareness and care for representation, integrating cultural and social justice topics relevant to the diversity of cultures, communities, interests, and social issues of a variety of speakers of the target language. 

Creating language materials that incorporate all of these considerations requires a broad skillset beyond expertise in teaching the subject matter. Significant professional development and exploration may be necessary before embarking on expansive authoring projects for language learning. With careful coordination and planning, and an understanding of the process and support required, language programs, instructors, and learners stand to reap long-term benefits from creative, relevant, inclusive, and dynamic open resources. What follows is a suggested process and a sample framework for undertaking open source textbook production for language learning contexts.

Step 1: Survey of needs, resources, and intended uses

The first step in any authoring project is to identify the needs of a program and determine what kind of text will be used and how. This includes the extent of the textbook use within the department and also as a resource for the broader language learning community. A quality textbook resource can increase student autonomy and interest in language learning generally by providing accessible resources readily available to learners anywhere in the world (Godwin-Jones). At this stage, some questions to ask include: 

  • Who are your learners and what is their motivation for learning a new language? 
  • What kind of textbook needs to be replaced? What gaps do you seek to fill by replacing current text materials? 
  • How will the resource fit into the larger curriculum? 
  • Is the need for a single course text or a cohesive series to cover an entire level or multiple levels? 
  • Who is available to collaborate and what are their areas of expertise? 
  • What resources and support are available for the project?
  • How will time and resources be accounted for? 
  • What is the timeline for implementation?
  • Who will provide expert and outside peer review of the textbook materials? 
  • How will the textbook materials be maintained and updated over time to ensure long-term viability? 

Most language programs involve extensive faculty collaboration. Instructors teach multiple courses across various levels. As such, it is important to promote broad participation in the planning stage to encourage instructor input, address concerns, and determine the scope of the implementation (e.g., across courses, levels). Gathering input on content and soliciting expertise among colleagues increases faculty buy-in and ownership of new materials.

Step 2: Identify the scope of your project

Once the shape of the project has been determined, it is time to outline the specifics of the resource(s) to be created. Determining the scope involves identifying learning outcomes. These are often mandated by the program, but they might also need to be rewritten or revised by the authoring team. Both the Common European Framework of Reference for Languages (CEFR) and the American Council on the Teaching of Foreign Languages (ACTFL) provide guidance on proficiency standards for world languages. Beyond language outcomes, it is also important to identify what the content goals are. This may involve generating a master list of topics, social justice and cultural themes to be addressed, and so on. At this stage, identify subject matter experts and any professional development needs. Who will participate as part of the core authoring team? Who will be responsible for quality control and review? Keep in mind that creating, reviewing, building, piloting, and maintaining comprehensive open language materials requires a significant time commitment, even if the goal is to create a single course text.

See ACTFL World Readiness Standards for Learning Languages

Step 3: Collaborate on a framework scope and sequence

The importance of this stage cannot be understated, particularly when multiple authors and stakeholders are involved. Once the themes, topics, outcomes, and other aspects of the materials have been identified and divided up into learning segments (levels across a series, units of a text, etc.), it is time to write the scope and sequence, which is basically a detailed outline. This outline should clearly show how everything fits together and serves as a framework for authoring materials that weave together language function and form, grammar points, text genres, readings, audios, pronunciation, vocabulary, practice activities, interaction, cultural and social justice themes, topics, etc.—all with attention to a logical progression, order of acquisition, recycling of language items, and student engagement. 


Let’s take a language text for English language learners as an illustrative example. If the grammar point for a learning segment is the present perfect tense, what types of contextualized content elicits that structure naturally? Perhaps a short biography representative of one aspect of the culture can serve this purpose. Reading and audio texts might present a person’s life experience so far. This offers an opportunity to consider whose lived experience will be represented via this text. Which vocabulary items are crucial for using the language around this topic? How much vocabulary will be new and how much recycled? Using the present perfect form as an example, we might focus on a number of participial adjectives and the prepositions for/since (She has been interested insince…). Language teachers as subject matter experts should have no trouble identifying these items regardless of the target language—this is how SLA comes into play. They teach this content all the time. The challenge is in putting it all together across units. That is, in addition to the grammar, punctuation, pronunciation, and writing systems (depending on the writing system of the language at hand) authors need to consider how the language builds on what was previously taught, how much is enough to present in each segment, what the cultural and social topics to be woven into authentic texts are, etc. A good scope and sequence defines all of this. For this reason, settling on a solid scope and sequence will require extensive coordination across subject matter experts, departments (in many cases), and in all cases, several rounds of review and revision before any writing begins.

sample scope and sequence template
Fig. 1 presents a sample unit from a scope and sequence created for a text for learners of English (CEFR A1+ level). This structure is applicable regardless of the target language although there may be some differences depending on the characteristics of the language. For example, phonetic languages may require less focus on pronunciation while languages using non-roman script will need to build in instruction on writing systems. View an accessible version of this template.

Step 4: Write and build

Once a final scope and sequence is in place and an authoring team has been identified, it’s time to start creating materials. Some questions to guide this stage include: 

  • Who will write the text and audio scripts? 
  • Who will provide diverse voice talent for audio texts? 
  • Who will record and edit audio? 
  • Where will the content be hosted and who will create it? (If using a tool such as Pressbooks, consider training for materials developers.) 
  • What platforms will be used for any interactive content? (H5P, Quizlet, Playposit, etc.) and who will build these? 
  • Where will the interactive repository be stored? 
  • Who is responsible for acquiring Creative Commons images and maps?
  • How will accessibility be ensured? 
  • What learner analytics will be gathered and how?

Because most of the activities in a learning segment tend to spring from the reading and listening input, it may be helpful to start with writing all of the texts for a level or course before creating the rest of the content. Audio and written texts must expose learners to a wide range of genres and text types (Tomlinson, 2012), so it may be useful to start by generating a list of genres to be covered. The texts, whether they are original or curated from online sources, must be reviewed and revised or adapted to ensure they contain the necessary language at the appropriate level, generate interest, employ the intended tone and voice for the genre, follow identified themes, incorporate social justice and cultural topics, and are accurate (in the case of non-fiction texts). If the content is curated, it needs to be reviewed for copyright and accessibility. 

Throughout the authoring stage, frequent check-ins among authors and reviewers can help to ensure quality, authenticity, inclusivity, and adherence to the determined scope and sequence. 

Step 5: Review and revise

Just as at every other stage of the process, peer reviews and revisions should be coordinated so that there is continuity in the editing process. It is important to enlist the help of internal and external subject matter experts. Assign different review tasks (big picture reviews of content and continuity along with detailed reviews of the language presentation) and provide each with review rubrics or guidelines to streamline feedback. External reviewers outside of the organization can help provide neutral insight. Enlisting the help of those with expertise in social justice topics, regional cultural perspectives, and different varieties of the language can help ensure accuracy, representation, inclusivity, and engagement. Be sure to review feedback as a team to reach an agreement on how to approach revisions to draft materials. 

Here is a sample rubric for reviewing original course materials, but rubrics should be adapted according to the scope and sequence and goals of each project.

Step 6: Implement and iterate 

Finally, it is time to pilot your new OER, but you aren’t done yet! Deliver the content to learners and collect their feedback as well as input from your teaching team. Keep in mind that an OER can be a work in progress, and one advantage of an open textbook is that it can be an evolving resource. Each iteration should involve coordination and input from the team who will be using the materials. Share your new resource widely. A high-quality OER opens the door for resource sharing with a broad community of colleagues, building visibility for the language program and lending credibility among colleagues around the world for the subject matter expert creators (Blyth and Thoms, 2021). 

Step 7: Create a plan for long-term viability: updating materials, quality control, and access

While creating an open source textbook for language learners can be a continually iterative process, once the new materials reach a point of stability and all stakeholders are satisfied with the product, authors or departments need to create a plan for maintaining the materials. Unlike costly textbooks which quickly become outdated, open access resources are easier to update (once the initial investment in time and resources has been made), save students money, and expand access to learners everywhere. The key is to create a plan for longevity so that updates are systematic, incorporate learner and instructor input, and are reviewed for quality control. The beauty of an OER for language learning is that it offers the opportunity to democratize teaching and learning by being responsive to the changing landscape of social justice education, shifting cultural influences, evolving characteristics of language learners, and distinct learning contexts.

References 

American Council on the Teaching of Foreign Languages (ACTFL)

Common European Framework of Reference for Languages – Companion Volume (2020)

Blyth, C. S., & Thoms, J. J. (Eds.). (2021). Open education and second language learning and teaching: The rise of a new knowledge ecology. Multilingual Matters. https://www.multilingual-matters.com/page/detail/?k=9781800411005

Godwin-Jones, Robert. “OER Use in Intermediate Language Instruction: A Case Study.” CALL in a Climate of Change: Adapting to Turbulent Global Conditions – Short Papers from EUROCALL 2017, 2017, pp. 128–134., https://doi.org/10.14705/rpnet.2017.eurocall2017.701. 

Howard, Jocelyn & Major, Jae. (2004). Guidelines for Designing Effective English Language Teaching Materials. 

Tomlinson, B. (2012). Materials development for language learning and teaching. Language Teaching, 45(2), 143–179. https://doi.org/10.1017/S0261444811000528

The following is a guest blog post from Andrea De Lei. Andrea completed an Instructional Design internship with OSU Ecampus during Fall 2021.

WHY SELF-CARE IS IMPORTANT FOR COLLEGE STUDENTS

Stress is not a new concept to college students, faculty, or staff. By teaching and incorporating self-care and overall health into your curriculum and design, your students can better manage stress and the host of obligations they may have to balance: full course loads, employment, commitments to their family and friends, internship, and networking opportunities. The Covid-19 pandemic this past two years added additional stressors both in teaching and engaging with students -added isolation and global pandemic stressors. To say these past two years was challenging would be an understatement. One way to get students and ourselves to practice self-care is to incorporate it into our lessons. 

In a 2016 survey of Canadian university students, 

  • 90% of respondents reported feeling overwhelmed by all they had to do, 
  • over 40% reported stress as the number one impact on their academic performance, 
  • 71% wanted more information on stress reduction (Alberta Canada Reference Group, 2016). 

BURNOUT IS NOT NEW

College students are experiencing high rates of anxiety, depression, burnout, and unhealthy coping mechanisms to manage their stress. A study done by Ohio State University showed that in August 2020, student burnout was at 40%. When Ohio State conducted the survey again in April 2021, it was 71%, highlighting the continued struggles of student mental health and the need for higher education to create a holistic approach centered around student health and wellness. Teaching self-care can help instructors prevent student burnout, interact more effectively with students and create a culture more conducive to learning. Teaching and practicing self-care is necessary to balance and prevent burnout (Tan & Castillo, 2014). 

BENEFITS OF ADDING SELF-CARE INTO THE CURRICULUM

The past year was filled with unprecedented events; social injustices, global pandemic, and increased stress diminished our prioritization of self-care. Increased isolation and loneliness mixed with online learning have created a void in identifying when someone needs help. Traditional self-care checkpoints are not as prominent for distance online learners as students learning in-person. Instructors can play a crucial role in supporting student mental health and wellbeing by incorporating self-care into their curriculum. 

A visual graphic showing multiple layers within OSU that highlight how OSU at a university, Ecampus, and campus partners prioritizing student health within their mission and values.


Image 1:Wellness Embedded in a Culture of Student Health visual aid created by Andrea De Lei; content cited from Oregon State University (OSU), OSU Ecampus and OSU Student Affairs webpages.

HOW CAN YOU ADD SELF-CARE INTO THE CURRICULUM

Supporting university-wide mental health initiatives is critical to student success and wellbeing. But, how do I add self-care in my online math course? Understanding the values of your university, department, campus culture, and needs of the students can help align these values into the curriculum and add self-care into any online course. A key component is giving students opportunities to plan time to incorporate self-care into their busy and stressful lives.

“Self-care has an experiential component in that it includes reflection and action in conjunction with real-world encounters” (Hroch, 2013, p. 5). Consider one or multiple assignments focused on self-care and wellness. Adding self-care and wellness can look like a wellness self-assessment, engaging in self-care activities and reflecting on that experience, incorporating additional resources into the syllabus or providing a “get out of jail [assignment] card.”

Self-Care and wellness discussion Canvas module example
Image 2: Self-Care and Wellness Discussion Module online Canvas course created by Andrea De Lei, 2021.

O’Brien-Richardson (2019) recommends four self-care strategies to support students: making yourself available, pausing for mental breaks, allowing for moments of self-reflection, and equalizing class participation. Suggested self-care activities for students can include an array of possibilities. From physical, spiritual, emotional, social and many more. Self-care is personal to the individual and looks different for everyone. Some examples include:

  • Physical self-care activities
    • Go on a run
    • Practice yoga
    • Get some sleep
  • Spiritual/Mindfulness self-care activities
    • Read poetry
    • Meditate
    • Take a milk bath
  • Emotional self-care activities
    • Write your feelings down.
    • Cry and laugh
    • Practice self-compassion.
  • Social self-care activities
    • In-person or virtual coffee or lunch with a friends/family
    • Phone or virtual facetime 
    • Join a [insert interest] club
    • Watch a movie or show with friends/family

THERE’S ROOM FOR IMPROVEMENT

To sum it up, adding self-care and wellness into the online curriculum can help students take time for themselves, destress, self-reflect, and create healthy habits to become better involved and engaged students. Instructors can continue to support students in various ways: self-care assignments, making yourself available, pausing for mental breaks, and allowing for moments of self-reflection.

References

Alberta Canada Reference Group (2016). Executive summary. American college health association. National College Health Assessment.

Hroch, P. (2013). Encountering the “ecopolis” Foucault’s epimeleia heautou and environmental relations. ETopia online initiative of TOPIA: Canadian Journal of Cultural Studies. Retrieved from http://etopia.journals.yorku.ca/index.php/etopia/article/view/36563/33222

O’Brien-Richardson, P. (2019, October 14). 4 Self-care strategies to support students. Harvard Business Publishing Education. https://hbsp.harvard.edu/inspiring-minds/4-self-care-strategies-to-support-students 

Saken, P., & Gerad, D. (2021, July 26). Survey: Anxiety, depression and burnout on the rise as college students prepare to return to campus [Student Mental Health MMR news release]. The Ohio State University Wexner Medical Center. http://osuwmc.multimedia-newsroom.com/index.php/2021/07/26/survey-anxiety-depression-and-burnout-on-the-rise-as-college-students-prepare-to-return-to-campus/ 

Tan, S. Y., & Castillo, M. (2014). Self-care and beyond: A brief literature review from a Christian perspective. Journal of Psychology and Christianity, 33(1), 90-95.

A group of instructional designers at Ecampus participated in a book club reading “Ungrading” (Kohn & Blum, 2020). We learned many creative ways of designing assessments through participation in this book club. If you happen to be searching for ideas on designing or re-designing assessments in your teaching, we would highly recommend this book!

The idea of “Ungrading” may sound radical to many of us. Yet instructors at all types of educational institutions have tried ungrading in many different courses, ranging from humanity courses, to STEM courses, and from primary education to higher education. Starr Sackstein (author of Chapter 4 “Shifting the Grading Mindset” of the book) encourages educators to consider “ways to adjust small things in the classroom that will lead to important growth for students”. And this suggestion of starting small is coherent with what James Lang proposes in his book “Small Teaching” (Lang, 2016) and Thomas Tobin’s +1 strategy for implementing new teaching and learning strategies (Tobin & Behling, 2018). Sackstein provides a table comparing the grades vocabulary that focuses on judgement or criticism, with the non-grade vocabulary focusing on assessing and opportunity for improvement.

In chapter 5, Arthur Chiaravalli proposed a way for teaching without grades: Descriptive Grading Criteria, such as A for outstanding, B for Good, C for Satisfactory and I for Incomplete. Do you remember elementary school report cards that use E for Excellent, S for Satisfactory, and NI for Need Improvement type of categories? I think that is exactly what descriptive grading criteria represent. 

In chapter 7, Christina Katopodis and Cathy Davidson offer a new approach to start a new term/semester by asking students:” What is Success in this class for you? And How can I help you achieve it?” (p. 107) Katopodis and Davidson also remind us the importance of explaining why when you challenge your students to take their own learning seriously and give students opportunities for metacognitive reflections about the learning activities themselves. Katopodis and Davidson also offer a model of contract grading for Twenty-First Century Literacies and a model of collaborative peer evaluation. Students’ grades in the course come from self-and-peer evaluations using detailed evaluation forms. 

In chapter 8, Christopher Riesbeck described his critique-driven learning and assessment design of do-review-redo submission process for his intermediate-level programming course. I have used similar approach in my own teaching before and it works very well for any course with manageable number of students. The advantage for this approach is every one of your students can improve their first submissions based on feedback they receive from the instructor. The disadvantage for this approach is the potentially extended time instructors may spend on providing the feedback and reviewing the submissions and re-submissions. The key to this assessment method is making sure that the workload of providing feedback and reviewing revisions is manageable. In chapter 9, Clarissa Sorensen-Unruh provided her experience of using ungrading in her organic chemistry II course, giving students opportunities to practice evaluating their own work.

And that is only snippets of what I took away from a few chapters from this book. Many resources about ungrading outside the book were shared during our book club meetings, such as two-stage exams, group exams  and public exams. To answer a common question that ungrading practices may fit humanity courses more easily, Cyndie McCarley shared “Grading for Growth” blog written and maintained by two math instructors Robert Talbert and David Clark. To learn about all the creative assessment design methods introduced in this book, read it yourself either through library ebook or get a hard copy and enjoy reading, designing and experimenting! 

References

Kohn, A. and Blum, S. (2020). Ungrading. West Virginia University Press. 

Lang, J. (2016). Small Teaching. Jossey-Bass. 

Tobin, T.J. and Behling, K.T. (2018). Reach Everyone, Teach Everyone. West Virginia University Press. 


“Annotation provides information, making knowledge more accessible. Annotation shares commentary, making both expert opinion and everyday perspective more transparent. Annotation sparks conversation, making our dialogue – about art, religion, culture, politics, and research – more interactive. Annotation expresses power, making civic life more robust and participatory. And annotation aids learning, augmenting our intellect, cognition, and collaboration. This is why annotation matters.” 

                                          -Kalir and Garcia

Annotation 

When you think back to your early college years, you may remember your professor assigning a text to annotate. Annotating a text has long been a common task in higher education, one that ideally promotes deeper reading, interaction with, and comprehension of important texts. Annotation assignments vary widely but the traditional paper-based type of annotation asks readers to respond to a text as it is read, physically marking or highlighting the text itself and perhaps writing in the margins. This approach allows students to enter into a dialogue with the text by recording their responses to the text, adding reflections or critiques, and anchoring those reactions to a specific place in the text. When students annotate a text, they are working their way through skills that span the levels of Bloom’s Taxonomy, from remembering to predicting, connecting, analysing, and evaluating. Annotation, at its best, encourages active engagement with a text beyond the surface level, promoting deeper critical thinking and stronger retention of concepts. 

While this is, of course, fantastic individual practice, the nature of traditional annotation assignments is primarily solitary. Today’s classrooms place more of an emphasis on 21st century skills such as group and collaborative study, and new digital tools have been developed that have revolutionized what, how, and with whom we can annotate. So-called social annotation has picked up speed with the growing popularity of two major players, Perusall and Hypothes.is, bolstered by the sudden shift to remote learning in 2020. Online instructors seeking ways to replicate the back and forth, robust discussion of a face-to-face class have found these tools a fitting substitute, and the asynchronous format of the discussion means these tools have a place in all modalities. 

Equity, Inclusion, & Community

“As a teaching method, critical social annotation allows for equitable conversations to unfold in-line with the knowledge being presented in course texts. In this way, it can potentially subvert or even redress instances of inequity in course content.” 

                                                                                                         – Brown and Croft

Social annotation platforms increase equity and inclusion in a course in several ways. Digital annotation platforms offer students a variety of ways to connect with material, allowing students to post links, images, video, and more in response to the text, their peers, and other annotators. By putting students’ ideas front and center, social annotation can empower learners to take initiative and experience more feelings of control over their educational process. Unlike the fast paced back and forth of traditional face-to-face discussions, the nature of digital social annotation allows students more time to engage with the text and to take as long as they need to post and respond (within the assignment boundaries). Additionally, the major platforms discussed in this post feature easy-to-use controls that require little technical expertise to use. They also boast comprehensive accessibility features that combine to provide inclusivity to a wide range of student needs. 

Social Annotation as Collective Construction of Meaning

One major difference between today’s digital social annotation and traditional solitary practice is that when students in a particular class collectively annotate a text using one of the digital platforms available today, they are actively building knowledge and understanding as a group. By sharing the document for collective annotation, the act of annotating itself becomes a social activity and contributes to the interaction of individuals within the group.  Socially annotating a text is one of the best ways to encourage close and active reading skills, with many studies reporting higher levels of student comprehension of socially annotated materials. Students who collectively annotate a text are entering into an exchange of questions, opinions, perspectives, and reactions to a text, engaging in a discourse with their peers (and facilitator, usually) and by extension learning from and with them. The process of a social annotation assignment allows students to see knowledge creation in action and become co-creators. 

Use of social annotation in asynchronous online courses can also increase sociability within an otherwise geographically remote, disparate group of students. Asynchronous instructors sometimes struggle to provide opportunities for real social interaction and building of community given the limits of the modality. An often unstated goal of higher education is to socialize students to academic community norms, and social annotation allows students to experience and practice some of these. For example, students annotating collectively learn appropriate language for responding to peers’ ideas and criticisms, develop online academic social identities, and gain experience with navigating power dynamics within the higher education classroom. 

Ready to Try It Out?

Adding social annotation to a course involves matching the task to your learning outcomes, deciding which readings would be best suited to annotation, and choosing your online annotation platform. 

Assignments can be tailored to meet a variety of instructional purposes and goals:

  • Recognizing formatting of various documents
  • Providing background or contextual information 
  • Learning academic norms for responding to peers- supporting, agreeing, disagreeing
  • Drafting questions and responses that are rigorous and meaningful
  • Determining main points vs. supporting details
  • Distinguishing fact from opinion
  • Identifying themes, tone, biases, author’s purpose, rhetorical devices, etc.
  • Learning and practicing discipline-specific writing and reading conventions 
  • Connecting the material to the field of study, to their own practice, or to other course materials
  • Developing evaluative and analytical skills
  • Considering differing perspectives and viewpoints in constructing knowledge
  • Facilitating a deeper understanding of difficult passages

Some best practices to consider when using collective annotation online:

  • Remind students that they have already practiced annotation in their everyday lives (reading and making your own notes in your inherited cookbook, reading your teacher’s remarks on your essay, leaving comments on a colleague’s report)
  • Model annotation with a fun text first
  • Seed the reading with your own comments, questions, and notes to help guide students 
  • Situate the social annotation assignment within the context of the course and make clear the intentions you have for the activity
  • If the activity is to be graded, be sure students know the grading criteria, preferably by providing a rubric
  • Annotation assignments are ideal for small group activities, and some platforms automatically create groups
  • Be prepared to provide guidelines for behavior and etiquette among students and to need to enforce these guidelines if students step out of line
  • Monitor the discussion and provide nudges, likes, upvotes, or validations, and otherwise engage with the dialogue throughout the assignment
  • If the platform allows tagging, do so- students get notified when someone responds to their post or asks a question, a convenience which increases the likelihood of them returning to the assignment for further interaction 

Social Annotation Tools: The Major Players

Perusall (stand-alone site/integrated into various LMS, including canvas)

Perusall is a collective annotation platform developed by Harvard University following a major research initiative into online collective annotation. Perusall offers free accounts for teachers and students at the basic level with options for institutions to integrate the tool into their LMS. The platform allows educators to use Perusall directly for stand-alone courses and upload their own materials for annotation as well as partner with their textbook catalog to purchase and annotate textbooks directly. For integrated LMS users, Perusall offers seamless grade pass back and options for pass/no pass grading as well as a robust automatic AI grading system that saves time and effort. Some instructors have also used Perusall for peer review to great effect using student-uploaded documents. *recommended tool for Ecampus courses

Sample Perusall annotation assignment

Hypothes.is (Google Chrome browser extension)

Hypothes.is is a groundbreaking new tool that bypasses restrictions of the classroom and enables anyone anywhere to annotate any webpage via a unique delivery system- as a browser extension that creates a layer over any webpage. This open source, free tool can revolutionize how we view and interact with web pages as well as texts by allowing us to save our annotations privately as well as publicly, inviting the world at large to socially annotate with us. Hypothes.is is also available as an integrated tool in most LMSs. The company also hosts the AnnotatED community, a group of users that hosts events, studies, and conferences to learn best practices for the tool. *recommended tool for research with a wider audience.

Hypothes.is Introduction Video

Sources

Adapting to Disciplinary Literacy Conventions – Open English @ SLCC

Home : Hypothesis

Innovation | Cégep Vanier College

Kalir, Remi H., and Garcia, Antero. Annotation. United States, MIT Press, 2021.

https://www.google.com/books/edition/Annotation/ejoiEAAAQBAJ?hl=en&gbpv=0

Pedagogy | ANNOTATION TOOLS

Perusall

Social Annotation | Center for Teaching Innovation

Social Annotation – Pedagogical Support and Innovation Pedagogical Support and 

Social Annotation and an Inclusive Praxis for Open Pedagogy in the College Classroom

Tools for Social Annotation in the Digital Age

A trigger warning in a college course alerts students to the presence of material that may provoke a traumatic response. It might sound something like this:

As a reminder, this week’s reading contains an account of suicide. Please prepare accordingly and employ self‐care throughout the in‐class discussion. One self‐care option is to make use of the Monsour Counseling Center (Sample Syllabus Language, Claremont Colleges CTL).

The usage of trigger warnings has been debated by faculty, administration, students, and researchers, and after spending time reading the arguments and research, I am uncertain whether I would recommend them to an instructor who asked for my advice on the matter. So, rather than advocating for or against trigger warnings, this guide presents several resources for instructors exploring their usage.

Among my instructional design colleagues, trigger warnings have some obvious appeal, perhaps because they dovetail well with the UDL checkpoints that direct us to “facilitate personal coping skills and strategies” and “minimize threats and distractions” in our courses, but their utility is contested. The American Association of University Professors (AAUP), in their report “On Trigger Warnings” outlines some of the issues. Trigger warnings might stifle free and open discussion of difficult topics, prejudice students against engaging with instructional materials critically or encourage avoidance, and interfere with academic freedom. However, in “Teaching with Trauma: Trigger Warnings, Feminism, and Disability Pedagogy,” Carter (2019) asserts that the AAUP misunderstands the goal of trigger warnings and who they’re for – they aren’t intended to protect students in general from adverse learning experiences but rather to provide students who experience trauma and anxiety with the means to engage – in other words, trigger warnings are a question of access and accommodation. Indeed, students themselves are requesting trigger warnings or complaining when they’re not used, as found by the National Coalition Against Censorship in its survey of 800 faculty.

This cartoon argues that trigger warnings challenge an aggressive, misogynist culture that expects victims to take responsibility for the harms it inflicts.
Excerpt from M. Slade’s cartoon at Everyday Feminism

What do we know from experimental research about the effects of trigger warnings? Jones et al. (2020) in their article “Helping or Harming? The Effect of Trigger Warnings on Individuals With Trauma Histories” describe how they presented reading passages that either did or did not contain trigger warnings to over 400 non-students who self-reported trauma. The trigger warnings did not reduce anxiety and instead seemed to cause participants to view traumatic life experiences as even more central to their life stories. Because trauma survivors who ascribe more importance to their trauma are at greater risk for PTSD, this research would suggest that trigger warnings are harming the students we most want to help.

Bentley (2017) in her article “Trigger warnings and the student experience” investigates the reactions of about 60 undergraduates taking 2nd and 3rd year courses that included trigger warnings related to the topics of war and terrorism. Notably, students who didn’t self-report a mental health condition actually experienced more anxiety. The 3rd year students, perhaps because they were further along in their degree, were more likely to perceive trigger warnings as an affront to their self-competence as learners. On the other hand, some students found the warnings helped them explore difficult topics more freely, because they were given time to frame their thoughts and feelings within an academic, rather than a reactionary or personal, context. Other students found the warnings useful because, without them, the triggering nature of course topics would not have been immediately obvious.

For instructors looking for practical tips on how, when, and where to employ a trigger warning, the University of Michigan has prepared a comprehensive “Introduction to Content Warnings and Trigger Warnings”. While content featuring sexual assault may be an obvious trigger, this guide lists 20 other potential triggers that instructors might not have considered, such as classism or fat phobia, and for which students might appreciate a warning. The guide also suggests that, since what triggers others can be hard to predict, instructors should consider inviting students to request which specific types of content they’d like to be flagged. Rather than infantilizing students, the guide argues, trigger warnings empower students to prepare to engage with difficult topics, because with the knowledge of potential triggers, students can work with a therapist or schedule more time to engage with materials, thereby making them more responsible for their learning, not less. The guide also details options for implementation, like flagging individual learning materials in the course schedule by triggering topic, or by issuing blanket warnings in the course description for a course that is largely composed of potentially triggering material. This is a must-read for anyone who has decided to implement trigger warnings.

Part I: Role of Course Developer as Media Curator 

This post is Part I of a two-part series on video selection and use in online courses. Part I provides the reasoning behind understanding course videos selection by course developers as a curatorial process. Part II will explore video curation in practice in course development and provide a course design perspective on video presentation and management issues.

Recent Video Use Trends

In September of 2020 the enterprise video company Kaltura Inc. conducted its seventh annual State of Video in Education 2020 report. The report included responses from across the education system spectrum with higher education institutions making up 53% of all respondents (Figure 1.).

Chart showing percentages of educator sectors in response to Kaltura survey.
Figure 1. Percentage of respondents to video survey by education sector.

This report described how remote teaching-driven course changes impacted video adoption and use in education. Remote teaching and learning was the most common use of video (83% of respondents). Lecture captured as video was used by 69% of the responding institutions.

The executive summary identified a number of key insights and trends related to changes in video use in education. A select few can be seen below:

  • Use of video for remote teaching and learning grew by 28% over 2019.
  • Video use is viewed as positive. Respondents (84%) saw video as having a positive impact on student satisfaction, 73% seeing video increase student achievements and 76% believe it increased instructor satisfaction.
  • Students as creators of video increased by 13% from 2019 to 2020.
  • In higher education there was rising video use for remote teaching, lecture capture, and flipping the classroom.
  • Actual growth in the use of video for remote teaching and learning grew by 28%.
  • A majority of respondents (68%) want to continue to blend traditional teaching with today’s virtual innovations; such as video.

In some ways this is not surprising. This past year forced many instructors in higher education to convert face-to-face courses to remote instruction. Much of that transition was accomplished with synchronous sessions via ZOOM or some other video conferencing program. Live video conference sessions, if recorded, also served as a support resource for students. In response to the challenges of the past year both live and recorded video were adopted to make remote learning doable. Fully online courses do not have this live element as they are asynchronous and did not have to adapt in this way.

In asynchronous courses at Oregon State University our Ecampus course developers utilize video differently. Video is as a key media element in delivering course content to learners, promoting faculty presence, and to build depth into projects and assignments. Video content may be produced internally by course developers (e.g., instructors) and used in courses via an enterprise video system (e.g., Kaltura). Video content may also be sourced from external video-based social media sites (e.g., YouTube and Vimeo) or educational and commercial collections (e.g., Kanopy or Amazon) and via syndicated video sources (e.g., podcasts and Twitter).

Given the plethora of video available and a trend toward increased video integration into instruction the challenge to course developers is the selecting, managing, and presenting video content to support and compliment course learning outcomes. Ultimately this also becomes a course design challenge for instructional designers who must adapt to manage the integration of increasing levels of video in the course in a way that makes sense from a pedagogical perspective as well as visual design aesthetic.

Course Developers as Media Curators

What is a Curator?

The growing value of video in the experience of a course suggests that course developers (e.g., instructors) consider a new way of thinking about how video is selected, managed and presented. In essence, I am suggesting that for a given course the course developer serves as a curator of video content.

But what is curator? Should a course developer really think like a curator? How might curated media shape course development and instructional design?

In order to explore this notion of course developers as media curators a bit more I would like to share the definition of what a curator is from the American Alliance of Museum (AAM) Curators Committee (2009). The preamble to the curator core competencies of a curator defined the term curator as:

Curators are highly knowledgeable, experienced, or educated
in a discipline
relevant to the museum’s purpose or mission. 

Curators are further described as having nine core competencies and related applied skills. The competencies are:

Collection planning       Scholary Research              Exhibition Development
Collecting                        Object Research                  Education
Collection Care               Applied Research               Outreach & Advocacy

In Figure 2. we see these same foundational roles expressed by the AAM coupled with a definition of curator and description of the work of a curator. Also included is the domain of the work. Those domains are preservation, research, and communication. The global context of curation is, in this definition, a museum. The more discrete context is the exhibition, or exhibit application. Yet it is all part of a curator’s work.

Curator defined with context.
Figure 2. Definition of the term curator and select context example.

What we see in this definition in Figure 2. is the premise that curators select, gather, care for, and prepare presentations of single items that in aggregate make up a curated collection. That collection becomes a resource and object of education, outreach, advocacy and presentation.

This makes the act of curatorship a scholarly and creative practice that is deeply intentional and based upon the definitional parameters of the organization doing the work.

Course Developers – Curators of Video Collections

Now let us think about what an online course developer is and what they do. At Ecampus course developers collaborate with instructional designers to plan an online course. Instructional designers advise and take content selected by the course developer and build that content into Canvas, our learning management system.  The created courses are then shared with students. Course developers are considered content experts much like museum curators are. Let’s look at that a bit more closely.

In Figure 3. below we can see a comparison between the definitional role and duties of a museum curator and course developer. There are striking parallels between these roles. So much so that it would seem reasonable to think about what a course developer does as also a curatorial practice. A practice focused on the learning content, including video, for a given course.

Perhaps the greatest difference between these to two curatorial practices is the context of each. In asynchronous course development it is not uncommon for instructors to perform many of these same functions as museum curators but on a more discrete scale. The scope and context of their focus is obviously different.

In essence a course developer actively gathers and in may cases, creates unique course elements that form the curated media collection for a course. That collection of texts (readings), images, web resources and video is then used for education, research, and perhaps outreach with a constant eye on student access to media. Ultimately a course media collection is intended to permit the course developer to fulfill the purpose of the course and guide students in achieving the course learning outcomes.

The physical design of the course, with its media collection, is the domain of the instructional designer. The collaboration between the course developer and instructional designer are key in preparing the course as an “education exhibition” of sorts that has clear learning outcomes.

Course Video Selection: The Art of Curatorship

We began this discussion with the importance of video in online course development and design. With that in mind it is logical that video curation is an important element of course-wide media collection identification.

Video collection, cataloging, arranging and assembling for display in a course fits quite well within the parameters of curating. Any curation is also about a level of storying, opportunities for engagement, information sharing and perspective sharing (Potter, 2017). In course development these processes as applied to course media, and in particular video, have the potential to create and shape the nature, experience, and associated learning in an online course.

In making decisions about video use in online courses, a course developer would apply their knowledge and expertise to curate the selections. Clear learning outcomes provide a pedagogical and content structure to the video curation process. Once a video collection is established other decisions may come into play that reference an aesthetic for the collection. This is the art of curatorship.

The art of curatorship has been viewed as closely aligned  to a design process (Shuey, 2014) and may be guided by an interpretation of the universal visual design principles as conceptual guides to the education exhibition that is the online course. In this sense the curator is not thinking as much about the collection items per se but more about how the collection fits together to provide and support a narrative, flow, or education scaffolding for the course.

Thinking Like A Curator 

As an exercise in curatorial thinking let’s take some re-interpreted concepts of visual design and see if they help us think through how we curate not only individual videos but also a video collection. This brief list includes accompanying questions that are informed by the identified principle and may shape the curation of video. In these examples found videos are outside video sources where created videos are those made by the course developer.

  • Balance: What is the intended balance between: Created and found curated videos? Permanent video and temporary (single-use) video content?
  • Emphasis: How does found video reinforce or extend created video? Is there a particular focus or intention of video use?
  • Movement: Is there a scaffolding of curated video that matches the scaffolding of the course progression? How does the video curation contribute to that progression?
  • Pattern: Is curated content focused, more general in nature, or quite diverse in source, topic or message? 
  • Rhythm: Does video use and viewing support or promote a rhythm of engagement for the course that compliments course objectives?
  • Repetition: Are curated videos reinforcing similar ideas or concepts? Are videos used consistently for certain aspects of the course (i.e., narrated lectures)?
  • Proportion: Does the video collection time commitment fit within the time expectations for the course? What is the ideal proportion of video to text, image, and other course media?
  • Variety: Are curated videos from different content sources and types? What is the ideal balance for the course?
  • Unity: Does the video collection promote a sense of wholeness to the course? Could the video collection, on its own, communicate identifiable ideas, patterns of ideas, or a range of perspectives on a topic?
    Does video accessibility contribute to the overall course accessibility?

In working through this exercise, we begin to move beyond video collecting by subject toward a more complete analysis of video collection selection and use that includes intertwined pedagogic and aesthetic considerations. This helps create a video collection that is intentional in its item selection, organization and use.

Final Thoughts

Recent research by Kaltura Inc. indicates that video use in education is on the rise in the past year. A continued growth of access to video and ability to create video coupled with an interest in integrating video in education efforts suggests course developers have a challenging task regarding media selection and use.

This article presents the idea that course developers, whether obvious or not, are actively engaged in a curatorial process regarding media selection and use. In addition, because of the importance and prevalence of video, its curation is presented as a key element of the larger course media curation effort. Lastly, we have explored how video collections contribute to academic and aesthetic value of a course and provided some key considerations based upon extending classic visual design principles to a curatorial practice.

It is interesting that the term curation has Latin roots in the verb curare; which means to take care of. Course developers conducting intentional video curation contribute to meaningful media curation for a course. This engagement in the practice of a curator is truly a professional act of caring about the quality of course development and the impact on student learning.

In Part II of this series we will address the practice of video curation in the context of an online course and explore instructional design considerations for video use that balance and complement a sample course video collection.

References

American Alliance of Museums. (2009). Curators Committee (CurCom): Curator’s core competencies. https://www.aam-us.org/professional-networks/curators-committee/ 

Kaltura Inc. (2020) The state of video in education 2020: Insights and trends [seventh edition].
https: //corp.kaltura.com/resources/the-state-of-video-in-education-2020/

Potter, J. (2017). Curation. In K. Peppler (Ed.), The SAGE encyclopedia of out of school learning (pp. 4-6). SAGE Publications Inc., Thousand Oaks, CA.

Shuey, G. (2014, October 21). The art of content curation. RELEVANCE.
https: //www.relevance.com/the-art-of-content-curation/

Wikipedia (n.d.). Definition of term collection.
https://en.wikipedia.org/wiki/Collection_(artwork)

Wikipedia (n.d.). Definition of term curator.
https://en.wikipedia.org/wiki/Curator

Video Resources 

Special thanks for the following individuals for their contributions to this article.

  • Chris Lindberg, Instructional Design Specialist, Oregon State University, Ecampus, Corvallis, Oregon.
  • Cody Rademacher, Curator, Holocaust Museum & Cohen Education Center. Naples, Florida.

Evaluating Textbooks

When selecting a textbook, there are a number of factors to evaluate. In addition to assessing the textbook for appropriate content, one category that I recommend looking at is how inclusive the textbook is. Here are a few guiding questions to ask when evaluating textbooks for inclusion:

student studying on a laptop
Photo by Surface on Unsplash

  • What is the cost of this textbook? Have you looked for open (free) textbooks, perhaps from the Open Textbook Library or considered writing or adapting your own? Affordability is inclusive.
  • Do the textbook images of people represent diverse cultural heritage and lived experiences?
  • Are the contributions to the field that are highlighted in the textbook from a diverse range of scholars in the field? If not, is there discussion about why certain voices were historically excluded from the field?
  • Is the textbook accessible? If there is an e-book, do the images have alt text, for example? Can students with disabilities access all materials in the book?
  • If the textbook is an e-book, are the concepts presented in multiple ways, such as text, infographic, slide decks, or multimedia elements? Giving students choices in how they explore the course concepts empowers them to use their existing preferences, and helps them develop new strengths and avenues for learning.

What to Do When the Textbook Is Not Ideal

It’s tough to find a textbook that is inclusive and has all of the concepts you are hoping to teach. What can you do when you find a textbook that has the concepts you need but is lacking in inclusive excellence? Here are some simple ideas for addressing this:

  • Consider giving publisher feedback. Write a brief email to the publisher about your concerns around a lack of representation in the book or whatever it is that you see as missing. 
  • For any text you choose, consider inviting students to write to the publisher if they see areas for improvement, whether that is with cost, bias, or other issues. You could include the contact information for the publisher in your course materials page, inviting students to write in feedback directly to the publisher. 
  • Acknowledge to your students that the textbook isn’t as inclusive as you would like it to be. Share the ways that you are advocating for better quality. You could also invite students to have a bias hunt discussion about the textbook or course materials. Then you could collect that feedback and send it to the publisher.
  • If the textbook lacks contributions from a diverse range of scholars, consider adding scholarly articles, images, or interviews from diverse professionals in your field to your course learning materials pages, in your LMS course site.
  • Consider highlighting professional organizations in your field that promote and mentor the professional development of scholars from specific historically underrepresented communities.

Have you had success in this area of evaluating textbooks? Have you found a publisher or textbook that has made gains in this area? If so, please share your resources in the comments.

References: 

We believe textbooks should be diverse and inclusive. Here’s what we’re doing about it.

Peralta Online Equity Rubric

UDL Progression Rubric

Open Textbook Library

Image credit: Surface on Unsplash

Man Reading Touchscreen
Man Reading Touchscreen” | Image by Karolina Grabowska from Pixabay

Background

Five years ago, I wrote a small entry in the ORTESOL Newsletter about the then state of “adaptive software capable of teaching, testing, giving feedback, and most importantly, adjusting to student needs” (Chambers, 2015: 13). I mentioned a set of technologies colloquially referred to as the “Digital Aristotle”, or ‘Project Halo’ (Friedland et al., 2004), and the update to this six years later (Gunning et al., 2010). The Digital Aristotle was described as ‘an application that will encompass much of the world’s scientific knowledge and be capable of applying sophisticated problem-solving to answer novel questions’ (Friedland et al., 2004).

At the time, I was writing about a more grandiose piece of software that might one day replace the repetitive tasks of an ESOL classroom. The idea, or perhaps the concern about this technology for existing teachers was where they would fit in once a set of algorithms could replicate much of the day to day learning of a language course.

Five years on, I turn to how learning designers might be able to incorporate AI into course design.

Potential

First, a question: is there currently a program capable of teaching a course and adapting to student needs like an instructor? The answer is still no. Certain technology has, however, progressed to the point that portions of an online course can be enhanced by AI.

Adaptive Learning

Quite possibly the most exciting development in artificial intelligence for learning is that of adaptive learning. This concept has been in the works for a while with certain platforms utilizing algorithms to produce content that adapt to specific learner needs.

Instructure’s Canvas for instance, allows Instructional Designers to set up ‘Differentiated Assignments’ (Canvas Doc Team, How do I view differentiated assignments with different due dates in a course?, 2017) and ‘MasteryPaths’ (Canvas Doc Team, How do I use MasteryPaths in course modules?, 2020) which ‘allows targeted learning activities to be assigned to different users and sections’ (‘MasteryPaths’). Currently this is a manual process with course designers creating every assessment beforehand. The best students might not see the additional activities. It is not ‘intelligent’ in the way that course content is adapted specifically for a learner’s needs and on the fly. To do this requires large amounts of data and most importantly, AI training to see patterns, strengths, and weaknesses for a particular learner.

This is why Duolingo records progress at every step and offers learners a review of concepts the learner struggles with in previous activities. Platforms that provide an automated review often use large question banks and flag questions that learners initially, or continuously incorrectly answer. An intelligent AI could create novel questions based on learner goals, data from prior students, and information about the subject matter. An example of this is Google or Amazon’s ability to predict and offer products or suggestions based on the vast amount of information provided to them every single day. Certain training providers are currently working with application developers to produce tools capable of this on-the-fly feedback and adaptation.

Discussions

At the OLC Innovate 2020 conference, Kasey Gandham from Ed Tech company Paperback and Kim A. Scalzo, Executive Director of Open SUN, demonstrated how Paperback’s AI is being used with online discussions to help students write higher quality posts. As students write their discussion posts, the AI program checks for “close-ended questions, plagiarism, insufficient length, content about class logistics, profanity and abuse’ (Gandham & Scalzo, 2020). After this, if required, the post is moderated and the learner receives email feedback saying why and how to revise their post. The AI is also capable of suggesting posts to feature as the best of the week by analyzing, among other things, sentence depth and ‘curiosity score’.

More than a Quiz

The role and importance of ‘big data’ in online learning cannot be understated. Technology already exists that records the time learners interact with learning materials. It knows where they are clicking/tapping on the screen and how long activities hold learner attention. Using this data, AI could suggest, or even craft assessments that are adapted specifically to a single learner’s usage habits. Traditional quizzes which assess information retention could become only part of the larger formative assessment of the entire course, at every point in the course, without the learner even realizing any of this is happening.

Future

AI-enhanced design has the ability to transform Instructional Designers like never before. It could help us to modify our own design practices based on how learners are responding to course content. Through learner feedback, it could demonstrate which activities are most appealing and conducive to personalized learning goals. Big data’s role in recording learner interactions with content can provide insights into preferred learning styles and methods of instruction. Instructional Designers will have to continue adapting with the technology just as we have done in our everyday lives.

References

Canvas Doc Team. (2017, April 19). How do I view differentiated assignments with different due dates in a course? Retrieved July 02, 2020, from https://community.canvaslms.com/docs/DOC-10036-how-do-i-view-differentiated-assignments-with-different-due-dates-in-a-course

Canvas Doc Team. (2020, April 6). How do I use MasteryPaths in course modules? Retrieved July 02, 2020, from https://community.canvaslms.com/docs/DOC-26231-how-do-i-use-masterypaths-in-course-modules 

Chambers, P. (2015, Spring). “Digital Aristotle” and ESL: What does it mean for us?. ORTESOL Quarterly Newsletter, 38(1), P.12-13.

Friedland, N.S. et al. (2004). ‘Project Halo: Towards a Digital Aristotle’, American Association for Artificial Intelligence, 25(4), pp. 29-47. DOI: http:// dx.doi.org/10.1609/aimag.v25i4.1783.

Gandham, K. and Scalzo, K., A. (2020, June). USING AI IN DISCUSSION TO SCALE ACCESS TO QUALITY ONLINE EDUCATION. OLC Innovate 2020, Online Presentation. https://onlinelearningconsortium.org/olc-innovate-2020-session-page/?session=8486 

Gunning, D. et al. (2010). ‘Project Halo Update – Progress Toward Digital Aristotle’, Association for the Advancement of Artificial Intelligence, 31(3), pp. 33-58. DOI: http:// dx.doi.org/10.1609/aimag.v31i3.2302.

Lately I’ve heard from a number of faculty whose students have expressed stress or overwhelm at the workload in a course. Further, students as well as faculty have had to adjust to a new routine or pace in their lives in recent months. All of this change gives us a chance to examine the workload and pace of a course so that it is manageable for both students and instructors. To that end, I offer three simple things that faculty can do to make their workload more manageable:

  • Manage expectations
  • Post time estimates for each activity
  • Consider your own availability

Manage expectations

One of the most effective ways to help students understand how much they should plan to do each week in the course is to be explicit and specific about the workload, early in the course. Refer to the credit hour policy to help students understand expectations. At OSU, it is expected that students engage with course materials and activities for 3 hours per week for every credit hour. So for a 3-credit course, students should expect to work about 9 hours each week on reading, studying, assignments, discussion boards, and other activities. This information is generally listed in the syllabus, but it’s nice to highlight this in an announcement early in the course, or perhaps even in an intro video or weekly overview video. Being explicit early in the course sets expectations for everyone, builds trust, and cuts down on negative emotions from students who feel there is too much (or not enough) in a course.

Post time estimates for each activity

One complaint that students occasionally have is that there is an uneven workload from week to week. One way to address this is to post estimated times for each activity for the week. This could appear in a task list on a weekly overview page, for example. This helps in several ways. First, it helps students who struggle to manage their time effectively. If they know that the assignment takes about 2 hours to complete, they can plan for that chunk of time in their week. Moreover, perhaps there are six readings posted in one week, but each reading is only about 5-10 minutes long. Posting this helps students understand that there are a number of short readings this week. That way students don’t assume each reading takes too long and decide to skip some of them. Moreover, being explicit about time estimates helps students know that you are sticking with the credit hour policy as well, which is another way to build trust.
If you find that the tasks you’ve outlined exceed the credit hour policy, let your learning objectives for the course guide your decisions for what to keep and what to cut.

Consider your own availability

Lastly, consider your own availability. Be explicit with students about when you are available so that you can be sure to carve out time to recharge your batteries. For example, if you like to have a bit of time to relax on the weekends, you might have your weekly assignments due on Monday of the following week for each module, rather than Sunday. That way, if students have questions about an assignment that they are wrapping up over the weekend, you still have Monday morning to get back to them instead of scrambling to answer multiple emails on Sunday evening.