Category Archives: Teaching

Improving the Feedback Cycle, Part 2

Posted on by | Leave a reply
chart describing the steps in the feedback process

In part one of this two-part blog series, we focused on setting the stage for a better feedback cycle by preparing students to receive feedback. In part two, we’ll discuss the remaining steps of the cycle- how to deliver feedback effectively and ensure students use it to improve.

In part one, we learned about the benefits of adding a preliminary step to your feedback system by preparing students to receive suggestions and view them as helpful and valuable rather than as criticism. If you haven’t read part one, I recommend doing so before continuing. This first crucial but often overlooked step involves fostering a growth mindset and creating an environment where students understand the value of feedback and learn to view it as a tool for improvement rather than criticism. 

Step 2: Write Clear Learning Outcomes

The next step in the cycle is likely more familiar to teachers, as much focus in recent decades has been placed on developing and communicating clear, measurable learning outcomes when designing and delivering courses. Bloom’s Taxonomy is commonly used as a reference when determining learning outcomes and is often a starting point in backwards design strategy. Instructors and course designers must consider how a lesson, module, or course aligns with the learning objectives so that students are well-equipped to meet these outcomes via course content and activities. Sharing these expected outcomes with students, in the form of CLOs and rubrics, can help them to focus on what matters most and be better informed about the importance of each criterion. These outcomes should also inform instructors’ overall course map and lesson planning. 

Another important consideration is ensuring that learning outcomes are measurable, which requires rewriting unmeasurable ones that begin with verbs such as understand, learn, appreciate, or grasp. A plethora of resources are available online to assist instructors and course designers who want to improve the measurability of their learning outcomes. These include our own Ecampus-created Bloom’s Taxonomy Revisited and a chart of active and measurable verbs from the OSU Center for Teaching and Learning that fit each taxonomy level.

Step 3: Provide Formative Practice & Assessments

The third step reminds us that student learning is also a cycle, overlapping and informing our feedback cycle. When Ecampus instructional designers build courses, we try to ensure instructors provide active learning opportunities that engage students and teach the content and skills needed to meet our learning objectives. We need to follow that up with ample practice assignments and assessments, such as low-stakes quizzes, discussions, and other activities to allow students to apply what they have learned. This in turn allows instructors to provide formative feedback that should ideally inform our students’ study time and guide them to correct errors or revisit content before being formally or summatively graded. Giving preliminary feedback also gives us time to adjust our teaching based on how students perform and hone in on what toreview before assessments. Providing practice tests or assignments or using exam wrappers, exit cards, or “muddiest point” surveys to collect your students’ feedback can also be an important practice that can help us improve our teaching.

Step 4: Make Feedback Timely and Actionable

Step four is two-fold, as both the timeliness and quality of the feedback we give are important. The best time to give feedback is when the student can still use it to improve future performance. When planning your term schedule, it can be useful to predict when you will need to block off time to provide feedback on crucial assignments and quizzes, as a delay for the instructor equates to a delay for students. Having clear due dates, reminding students of them,  and sticking to the timetable by giving feedback promptly are important aspects of giving feedback.

To be effective, feedback must focus on moving learning forward. It should target the identified learning gap and suggest specific steps for the student to improve.. For a suggestion to be actionable, it should describe actions that will help the student do better without overloading them with too much information- choose a few actionable areas to focus on each time. Comments that praise students’ abilities, attitudes, or personalities are not as helpful as ones that give them concrete ways to improve their work.

Step 5: Give Time to Use Feedback and Incentive it

The last step in the cycle, giving students time to use the feedback provided, is often relegated to homework or ignored altogether. Feedback is most useful when students are required to view it and preferably do something with it, and by skipping this important step, the feedback might be ignored or glanced over perfunctorily and promptly forgotten. To close the loop, students must put the feedback to use. This can be the point where your feedback cycle sputters out, so be sure to make time to prioritize this final step. Students may need assistance in applying your feedback. Guiding students through the process, and providing scaffolds and models for using your feedback can be beneficial, especially during the initial attempts.

In my experience, it never hurts to incentivize this step: this can be as simple as adding points to an assignment for reflecting on the feedback given or giving extra credit opportunities around redone work. As a writing teacher, I required rewrites for work that scored below passing and offered to regrade any rewritten essays incorporating my detailed feedback. This proved to be a good solution, and while marking essays was definitely labor intensive, I was rewarded with very positive feedback from my students, often commenting that they learned a lot and improved significantly in my courses.

Considerations

A robust feedback cycle often includes opportunities for students to develop their own feedback skills by performing self-assessments and peer reviews. Self-assessment helps students in several ways, promoting metacognition and helping them learn to identify their own strengths and weaknesses. It also allows students to reflect on their study habits and motivation, manage self-directed learning, and develop transferable skills. Peer review also provides valuable practice honing their evaluative skills, using feedback techniques, and giving and receiving feedback, all skills they will find useful throughout adulthood. Both self-assessment and peer review give students a deeper understanding of the criteria teachers use to evaluate work, which can help them fine-tune their performance. 

Resources for learning more:

Feedback

Learning Outcomes

Self-assessment

Peer review

Improving the Feedback Cycle, Part 1

Posted on by | Leave a reply
graphic image of the five steps in the feedback cycle

Giving and receiving feedback effectively is a key skill we all develop as we grow, and it helps us reflect on our performance, guide our future behavior, and fine-tune our practices. Later in life, feedback continues to be vital as we move into work and careers, getting feedback from the people we work for and with. As teachers, the most important aspect of our job is giving feedback that informs students how to improve and meet the learning outcomes to pass our courses.  We soon learn, however, that giving feedback can be difficult for several reasons. Despite it being one of our primary job duties as educators, we may have received little training on how to give feedback or what effective feedback looks like. We also realize how time-consuming it can be to provide detailed feedback students need to improve. To make matters worse, we may find that students don’t do much with the feedback we spend so much time providing. Additionally, students may not respond well to feedback- they might become defensive, feel misunderstood, or worse, ignore the feedback altogether. This can set us up for an ineffective feedback process, which can be frustrating for both sides. 

I taught ESL to international students from around the world for more than 10 years and have given a fair amount of feedback. Over many cycles, I developed a detailed and systematic approach for providing feedback that looked like this.

Gaps in this cycle can lead to frustration from both sides. Each step in the cycle is essential, so we’ll look at each in greater depth in this blog series. Today, we will focus on starting strong by preparing students to receive feedback, a crucial beginning that sets the stage for a healthy cycle.

Step 1: Prepare Students to Receive Feedback

An effective feedback cycle starts before the feedback is given by laying careful groundwork. The first and often-overlooked step in the cycle is preparing students to receive feedback, which takes planned, ongoing work. Various factors may influence whether students welcome feedback, including their self-confidence going into your course, their own self-concept and mindset as a learner, their working memory and learning capacity, how they view your feedback, and whether they feel they can trust you. Outside factors such as motivation and working memory are often beyond our control, but creating an atmosphere of trust and safety in the classroom can positively support students. Student confidence and mindset are areas in which  teachers can play a crucial supporting role. 

Researcher Carol Dweck coined the term “growth mindset” after noticing that some students showed remarkable resilience when faced with hardship or failure. In contrast, others tended to easily become frustrated and angry, and tended to give up on tasks. She developed her theory of growth vs. fixed mindsets to explain and expound on the differences between these two mindsets. The chart below shows some of the features of each extreme, and we can easily see how a fixed mindset can limit students’ resilience and persistence when faced with difficulties. 

graphic of brain with growth mindset hallmarks on the left and fixed mindset ideas on the right.

Mindset directly impacts how students receive feedback. Research has shown that students who believe that their intelligence and abilities can be developed through hard work and dedication are more likely to put in the effort and persist through difficult tasks, while those who see intelligence as a fixed, unchangeable quality are more likely to see feedback as criticism and give up. 

Developing a growth mindset can have transformative results for students, especially if they have grown up in a particularly fixed mindset environment. People with a growth mindset are more likely to seek out feedback and use it to improve their performance, while those with a fixed mindset may be more likely to ignore feedback or become defensive when receiving it. Those who receive praise for their effort and hard work, rather than just their innate abilities, are more likely to develop a growth mindset. This is because they come to see themselves as capable of improving through their own efforts, rather than just relying on their natural talents. A growth mindset also helps students learn to deal with failure and reframe it positively. It can be very difficult to receive a critique without tying our performance to our identity. Students must  have some level of assurance that they will be safe taking risks and trying, without fear of being punished for failing. 

Additionally, our own mindset affects how we view student effort, and we often, purposefully or not, convey those messages to students. Teachers with growth mindsets have a positive and statistically significant association with the development of their students’ growth mindsets. Our own mindset affects the type of feedback we are likely to provide, the amount of time we spend on giving feedback, and the way we view the abilities of our students. 

These data suggest that taking the time to learn about and foster a growth mindset in ourselves and our students results in benefits for all. Teachers need to address the value of feedback early on in the learning process and repeatedly throughout the term or year, and couching our messaging to students in positive, growth-oriented language can bolster the feedback process and start students off on the right foot, prepared to improve. 

Here are some concrete steps you can take to improve how your students will receive feedback:

  • Model a growth mindset through language and actions 
  • Include growth-oriented statements in early messaging
  • Provide resources for students to learn more about growth vs. fixed mindsets
  • Discuss the value of feedback and incorporate it into lessons
  • Create an atmosphere of trust and safety that helps students feel comfortable trying new things 
  • Teach that feedback is NOT a judgment of the person, but rather a judgment on the product or process
  • Ensure the feedback we give focuses on the product or process rather than the individual
  • Praise effort rather than intelligence
  • Make it clear that failure is part of learning and that feedback helps improve performance
  • Provide students with tools and strategies to plan, monitor, and evaluate their learning 

Resources for learning more about growth mindset and how it relates to feedback:

Stay tuned for part 2, covering the remaining steps in the feedback cycle. 

Debunking Myths: Memory, Attention, and Technology in Education

Posted on by | Leave a reply

In our hyper-connected world, it’s tempting to think that technology like Google, Generative Artificial Intelligence, and our smartphones have rendered memory obsolete. But is that really true?

I recently participated in a book club offered by Oregon State University’s Center for Teaching and Learning. The book we read, Remembering and Forgetting in the Age of Technology: Teaching, Learning, and the Science of Memory in a Wired World by Michelle D. Miller, challenges misconceptions about how technology affects our memory and attention and offers valuable insights for educators. Let’s explore some key takeaways.

Memory Still Matters

There has been a growing backlash against memorization in education, with critics claiming it’s outdated and harmful to creativity and critical thinking. But here’s the kicker: memory actually supports robust, transferable thinking skills. Memory and thinking aren’t enemies – they’re complementary partners in learning.

Despite the “Google it” mentality, memory remains crucial. It’s not just about recalling facts; it’s about building a foundation for critical thinking and creativity. For one thing, it’s impossible in certain situations to stop and look things up (think emergency room doctors or lawyers during a trial). But more than that, our own memorized knowledge in a discipline allows us to consider context and practice skills fluently.

We’re all familiar with Bloom’s taxonomy and its bottom level: “Remembering”. Michelle Miller recommends that, instead of viewing memory as the “lowest” level of thinking, consider it the foundation. Higher-order thinking skills interact with and reinforce memory, creating a two-way street of learning.

The Power of Testing

Contrary to popular belief, quizzes and tests aren’t the enemy. Research shows that retrieval practice actually strengthens long-term retention, supports complex skills, and can even reduce test anxiety. It’s not about memorizing for the test; it’s about reinforcing learning.

In addition, “pre-quizzing” – that is, giving a quiz before introducing the material (ungraded or graded for participation only) – has been shown to help activate prior knowledge, integrate new information into existing schemas, and identify gaps or misconceptions that instructors can address.

Attention Spans: Not What You Think

The idea that “attention spans are shrinking” isn’t backed by solid science. In fact, in attention research there’s no such thing as “attention span”! And that “Students can only pay attention for 10 minutes at a time” idea? It’s based on outdated, poorly designed studies.

What about the idea that technology worsens our attention? There is no strong evidence that technology is affecting our ability to pay attention. While people often report this phenomenon (about themselves or others), a more likely explanation seems to be our decreased tolerance for boredom rather than our actual ability. However, smartphones can indeed be very distracting, and they can also affect memory negatively through the “I can Google it” effect – the expectation that information will be available online anytime can reduce our memory encoding.

Handwriting vs. Typing: It’s Complicated

The debate over handwritten versus typed notes isn’t as clear-cut as you might think. What matters most is your note-taking strategy. The best notes, regardless of medium, involve synthesizing ideas rather than transcribing verbatim.

Enhancing Memory in the Classroom

The good news is that there are many things an educator can do to help students remember essential content. Here are some strategies:

  1. Create meaning and structure: When we process information deeply and evaluate it for meaning we remember it better than when we perform shallow processing. Organizational schemes like narrative structures help information stick, and active learning techniques such as project-based learning ensure a deeper level of engagement with the content.
  2. Connect to prior knowledge: Ask questions to elicit information, draw explicit connections with previous material, and use pre-quizzing to help students see the gaps and stimulate curiosity.
  3. Embrace visualization: We’re visual creatures – use this to engage your audience. Create and ask students to create mind-maps, infographics, or other visual representations.
  4. Engage emotions: Both positive and negative emotions can enhance memory, but aim for a supportive atmosphere, which has been shown to improve learning outcomes. The emotion of surprise is a powerful memory enhancer.
  5. Connect to goals: Show how information is relevant to students’ immediate objectives.
  6. Use the self-reference effect: Relating information to oneself boosts memory. Ask students to bring their own experience or interests into the learning process through personalized assignments.
  7. Implement retrieval practice: Regular quizzing with immediate feedback can significantly boost retention.
  8. Space it out: Distribute practice over time instead of cramming.

Conclusion

In this age of information overload, understanding how memory works is more crucial than ever. By debunking myths and implementing evidence-based strategies, we can help students navigate the digital landscape while building strong, adaptable minds. I’ve only touched on a few points, but this book is chock-full of interesting information that’s useful not just for educators but for everyone!

What myths about memory and technology have you encountered in your teaching? How might you incorporate these insights into your classroom? Share your thoughts in the comments below!

References

Miller, M. D. (2022). Remembering and forgetting in the age of technology: teaching, learning, and the science of memory in a wired world (1st ed.). West Virginia University Press.

The Other AI – Fostering Academic Integrity in Online Courses

Posted on by | Leave a reply
This image is part of the Transformation Projects at the Ars Electronica Kepler's Garden at the JUK. The installation AI Truth Machine deals with the chances and challenges of finding truth through a machine.

All the buzz recently has been about Generative AI, and for good reason. These new tools are reshaping the way we learn and work. Within the many conversations about Artificial Intelligence in Higher Ed a common thread has been appearing regarding the other AI–Academic Integrity. Creating and maintaining academic integrity in online courses is a crucial part of quality online education. It ensures that learners are held to ethical standards and encourages a fair, honest, and respectful learning environment. Here are some strategies to promote academic integrity and foster a culture of ethical behavior throughout your online courses, even in the age of generative AI.

Create an Academic Integrity Plan

Having a clear academic integrity plan is essential for any course. Create an instructor-only page within your course that details a clear strategy for maintaining academic integrity. This plan might include a schedule for revising exam question banks to prevent cheating, as well as specific measures to detect and address academic dishonesty (plagiarism or proctoring software). In this guide, make note of other assignments or places in the course where academic integrity is mentioned (in the syllabus and/or particular assignments), so these pages can be easily located and updated as needed. By having a plan, you can ensure a consistent approach across the course.

Exemplify Integrity Throughout the Course

It is important to weave academic integrity into the fabric of your course. Begin by introducing the concept in your Start Here module. Provide an overview of what integrity means in your course, including specific examples of acceptable and unacceptable behavior. This sets the tone for the rest of the course and establishes clear expectations. On this page, you might:

  • Offer resources and educational materials on academic integrity for learners, such as guides on proper citation and paraphrasing.
  • Include definitions of academic dishonesty, such as plagiarism, cheating, and falsification.
  • Provide guidance on how learners might use generative AI within the class, including what is and is not considered acceptable.
  • Add scenarios or case studies that allow learners to discuss and understand academic integrity issues, specifically related to the use of generative AI.
  • Connect academic integrity with ethical behavior in the larger field.
  • Provide a place for learners to reflect on what it means for them to participate in the course in a way that maximizes their learning while maintaining academic integrity.

Throughout the course, continue to reinforce these ideas. Reminders about academic integrity can be integrated into various lessons and modules. By articulating the integrity expectations at the activity and assignment level, you provide learners with a deeper understanding of how these principles apply to their work. 

Set Clear Expectations for Assignments

When designing assignments, it is important to be explicit about your expectations for academic integrity. Outline what learners should and should not do when completing the task. For instance, if you do not want them to collaborate on a particular assignment, state that clearly. Provide examples and resources to guide learners on how to properly cite sources or avoid plagiarism. Be specific with your expectations and share why you have specific policies in place. For instance, if you want to discourage the use of generative AI in particular assignments, call out the ways it can and cannot be used. As an example, you might tell learners they can use generative AI to help form an outline or check their grammar in their finished assignment, but not to generate the body text. Share the purpose behind the policy, in this case it might be something about how a writing assignment is their opportunity to synthesize their learning and cement specific course concepts. This kind of transparency shows respect for the tools and the learning process, while also clearly outlining for learners what is acceptable.

Encourage Conversations About Integrity

Creating opportunities for learners to engage in discussions about academic integrity can help solidify these concepts in their minds. You can incorporate forums or discussion boards where learners can share their thoughts and experiences related to integrity. This also gives them a chance to ask questions and seek clarification on any concerns they may have. Encourage open dialogue between instructors and learners regarding academic integrity and any related concerns. These conversations can also extend beyond the classroom, exploring how integrity applies in your field or career paths. By connecting academic integrity to real-world scenarios, you help learners understand its relevance and importance in their professional lives.

Foster a Supportive Learning Environment

A supportive learning environment can help reinforce academic integrity by making learners feel comfortable asking questions and seeking guidance. Offer resources like definitions, guides, or access to mentors who can provide additional support. When learners know they have access to help, they are more likely to adhere to integrity standards. With generative AI in the learning landscape, we will inevitably encounter more “gray areas” in academic integrity. Be honest with your learners about your concerns and your hopes. Being open to conversations can only enhance the learning experience and the integrity in your courses.

We all play a role in cultivating a culture of academic integrity in online courses. By documenting a clear plan, weaving integrity into the course content, setting clear expectations, encouraging conversations, and providing support, you can create an environment where honesty and ethical behavior are valued and upheld. This not only benefits learners during their academic journey but also helps them develop skills and values that will serve them well in their future careers.

Want to create a memorable experience for your students?

Posted on by | Leave a reply

I was recently reminded of a conference keynote that I attended a few years ago, and the beginning of an academic term seems like an appropriate time to revisit it on this blog.

In 2019, Dan Heath, a bestselling author and senior fellow at Duke University’s CASE Center, gave a presentation at InstructureCon, a conference for Canvas users, where he talked about how memories are formed. He explained that memories are composed of moments. Moments, according to Heath, are “mostly forgettable and occasionally remarkable.” To illustrate, most of what I’ve done today–dropping my kids off at spring break camp, replying to emails, going to a lunchtime yoga class, and writing this blog post–will largely be forgotten by next month. There is nothing remarkable about today. Unremarkable is often a desirable state because it means that an experience occurred without any hiccups or challenges.

Heath went on to describe what it is that makes great experiences memorable. His answer: Great experiences consist of “peaks,” and peaks consist of at least one of the following elements: elevation, insight, pride, or connection. He argued that we need to create more academic peaks in education. Creating peaks, he contends, will lead to more memorable learning experiences.

So, how do we create these peaks that will lead to memorable experiences? Let’s explore some ideas through the four approaches outlined by Heath.

Elevation. Elevation refers to moments that bring us joy and make us feel good. You might bring this element into your course by directly asking students to share what is bringing them joy, perhaps as an icebreaker. Sharing their experiences might also lead to connection, which is another way (see below) to create peaks that lead to memorable experiences. 

Insight. Insight occurs when new knowledge allows us to see something differently. Moments of insight are often sparked by reflection. You might consider making space for reflection in your courses. Creativity is another way to spark new insights. How might students engage with course concepts in new, creative ways? To list off a few ideas, perhaps students can create a meme, record a podcast, engage in a role play, or write a poem.

Pride. People often feel a sense of pride when their accomplishments are celebrated. To spark feelings of accomplishment in your students, I encourage you to go beyond offering positive feedback and consider sharing particularly strong examples of student work with the class (after getting permission–of course!) Showcasing the hard work of students can help students to feel proud of their efforts and may even lead to moments of joyful elevation.

Connection. Connection refers to our ties with other people. Experiencing connection with others can feel deeply rewarding. As I mentioned above, asking students to share their experiences with peers is one way to foster connection. In Ecampus courses, we aim to foster student-student and student-teacher connection, but I encourage you to explore other opportunities for students to make meaningful connections. Perhaps students can get involved with their communities or with colleagues, if they happen to have a job outside of classes. Students could connect with their academic advisors or the writing center to support their work in a course. There are many ways to foster connections that support students in their learning!

It’s easy to focus on delivering content, especially in online courses. This was one of Heath’s overarching points. The key, however, to creating memorable learning experiences is to take a student-centered approach to designing and facilitating your course. 

I invite you to start the term off by asking yourself: How can I create more moments of elevation, insight, pride, and connection for my students? It might be easier than you think.

References:

Heath, D. (2019, July 10). Keynote. InstructureCon. Long Beach, CA.

Assessment Design: The Case Against Extra Credit

Posted on by | Leave a reply

As a follow-up to discussing equity in grading and group work, Feldman (2019) offers a compelling case against the use of extra credit. “But wait a minute,” I can hear you saying, “Extra credit is optional—students have to opt-in if they want to do it! And it can be fun! What’s wrong with that?” Many instructors may think of extra credit as a way to benefit students and give them extra opportunities in a course, especially at the end of a term, to improve their grade, take on additional challenges, and demonstrate additional skills they have learned. (I know I thought about extra credit that way at one time!) However, there is more at play with extra credit than you might think. Let’s return to Feldman’s three pillars of equitable grades:

  1. “They are mathematically accurate, validly reflecting a student’s academic performance.
  2. They are bias-resistant, preventing biased subjectivity from infecting our grades.
  3. They motivate students to strive for academic success, persevere, accept struggles and setbacks, and to gain critical lifelong skills” (Feldman, p. 71).

With these three pillars in mind, let’s examine some potential issues with extra credit:

  1. Accuracy: There are many ways extra credit can obscure what information a grade includes. First, it can be used to incentivize certain behaviors, which obscures a grade by not assessing academic performance or learning. (For example, extra credit for turning things in on time.) Second, it can obscure whether a grade reflects what students know by turning grades into a commodity (more about this below). In this way, grades are a reflection of how many points students are able to accumulate, not necessarily how much they have learned or whether they have met all of a course’s learning outcomes.This kind of extra credit can unintentionally signal to students that their behavior and non-academic performance in a course is more important than their learning.
  2. Bias: Sometimes extra credit is awarded to incentivize students to participate in extra events or opportunities, like attending a webinar, guest lecture, local event, etc. However, in addition to treating grades like a commodity, this kind of incentive also makes it difficult for students without outside resources or help to engage. What about students without the money for event tickets, transportation, child or family care, and/or without the time away from work, family, etc.? They are unable to participate, even if they want to, due to external factors outside of their control. And often these are the students who could potentially benefit the most from additional points if they are already struggling because of these exact conditions. For extra credit that provides extra challenges beyond the course materials, only the students already doing well will be able to participate and benefit from the opportunity, additionally shutting out students who are already behind.
  3. Motivation: Having extra credit, especially at the end of the course, can also be damaging to student motivation, as it places an emphasis on grades and points instead of learning. For example, some students may prioritize obtaining a desired grade above learning important content, while other students may use extra credit to bolster a weak area they were unable to fully grasp, thereby giving up on learning that material entirely. Both of these potential mindsets set students up to focus on a product (grade) more than learning and any future perspectives they might have about their learning.

One additional issue of extra credit to consider is the additional work and time on instructors for both designing additional assignments and grading the extra work, especially at the end of a term when there is usually a plethora of assignments, exams, and projects to grade.

“If the work is important, require it; if it’s not, don’t include it in the grade.”

Feldman, p. 122.

So, what options can we give students that are more equitable as an alternative to extra credit? Instead of creating additional assignments, allow students to revise and resubmit work. This shift can help support students by encouraging them to learn from past mistakes, build on their learning, and see their growth over time. Revisions and resubmissions don’t have to only happen at the end of the term, so instructors can also consider timing of revisions based on course design, formative and summative assessment timing, and their own workloads. It also helps students who may be struggling with outside barriers to have additional attempts to complete work they may have missed. It also means that students cannot opt-out of important work or concepts because they cannot substitute those points from other areas of the course. Lastly, it saves the instructor time from designing and implementing additional assignments and complicated grading setups at the end of a term when instructors are often the busiest. While the use of extra credit is often from a place of good intentions, I hope this brief outline helps recontextualize how it may have a larger, negative impact in your course than you may have initially thought, as well as a strategy for replacing it in your course designs.

References

Feldman, J. (2019). Grading for equity: What it is, why it matters, and how it can transform schools and classrooms. Thousand Oaks, CA: Corwin.

5 Aspects of a Great Welcome Message

Posted on by | Leave a reply
Wooden sign with the word welcome on it.
Wooden sign with the word welcome on it.

“You never get a second chance to make a first impression.” ~ Will Rogers

As Winter Break has begun it’s rapid decent into the start of a new term, it’s time to take a look at how we will welcome our students back to school in the new year. Winter term brings new beginnings for students as their papers now contain the date 2024. Maybe they’ve made resolutions to do homework on time, or read every last page you request, or just be more present, whatever it is, that first message or impression from you in the new term sets the tone for the class. I’m sure that everyone wants to start a class off on a positive note, so let’s look at 5 ways you can create an informational, welcoming, and inclusive message to start the term/semester off right.

  1. Welcoming tone
  2. Talk about your class
  3. Offer support (and remind them to review the syllabus!)
  4. How to get started
  5. Inspire them

Create a Welcoming Tone

I don’t know about you but when I think back to the professors and teachers that I enjoyed learning from, I remember who they were and how they communicated with the class. They weren’t just an educated, knowledgable, and smart person, they were personable too. Empathy for their students, calling out the fact that we all have a bad day from time to time or might have just missed a deadline made it not seem daunting if we had to come “begging” for an extension. It didn’t seem like begging, it was known and called out that it could happen. Give your students the ease as you recognize them as people and not just a name on a roster.

Talk About the Class

Just think, a brand new set of classes, so many new syllabi to read and materials to devour. Hype your class up by talking about exciting topics, real world applications, and maybe mention an assignment or two that they’ll be working on.

Offer Support

We know that each of our students begins our class with a different set of circumstances on the other side of that screen. With that in mind, including a reference to support for these students can be helpful in letting them know the resources are there and it’s ok to use them. Mention your syllabus, the getting started or introduction module, and make sure they know resources are listed and available in all of those places and not only for your class but for all those other things that life tosses their way.

How to Get Started

So much information is available at the start of a new term. Sometimes it’s hard to know where to start! Wait, what happens when it’s before the term starts? Can we help our students prepare for their classes ahead of time and maybe ease their mind a little bit? How about a Canvas email to your students that introduces them before the term starts to their upcoming class. You could include information about if the class is published already, even if it’s just the welcome page and what OSU Ecampus calls the “Start Here” module that includes information about the class (syllabus) and resources that they have access to as Ecampus students. In that same email, you can help them to figure out where they should start. By telling them directly, and maybe even providing a link, you can give them the information to get started with less anxiety as they know they’re starting where you think they should.

Inspire them

Your excitement about working with them often evokes excitement and positive anticipation of a great class. Share with them a quote or why you love this topic and maybe give them an interesting fact that can pique their curiosity. The point here is to get them inspired and excited to learn.

Example

Dear Students,

Welcome to QLT 123: Introduction to Quilting! My name is Professor Seam and I’ll be your instructor for this online course. We are going to learn so much this term, the first three months of quilting are simply mind-blowing as you move from not knowing how to start to drafting a mockup of one you’d like to make, and finishing your first quilt! We’ll explore the basics, you’ll have opportunities to show off your success and funny failures (because guess what, they happen!) and in the end, you’ll get to showcase all of your hard work in your finished quilt. Guess what? There are no textbooks for this class! Instead, you get order in some fun fabric (but not yet!) Hop into our Canvas site and take a look at the syllabus, find resources for support if you are in need, introduce yourself in the first discussion board and take a look at what’s in the first module. We’ll start next week when the term begins so get ready to sew the seams of creativity because you’ve just started the most sew-perb quilting class and I can’t wait to embark on this journey with you.
-Professor Seam

Share out!

Got a great welcome message? Share with us in the comments!

Media Literacy in the Age of AI, Part II: A Review of Verified

Posted on by | Leave a reply

For the first part of this post, please see Media Literacy in the Age of AI, Part I: “You Will Need to Check It All.”

Just how, exactly, we’re supposed to follow Ethan Mollick’s caution to “check it all” happens to be the subject of a lively, forthcoming collaboration from two education researchers who have been following the intersection of new media and misinformation for decades.

In Verified: How to Think Straight, Get Duped Less, and Make Better Decisions about What to Believe Online (University of Chicago Press, November 2023), Mike Caulfield and Sam Wineburg provide a kind of user’s manual to the modern internet. The authors’ central concern is that students—and, by extension, their teachers—have been going about the process of verifying online claims and sources all wrong—usually by applying the same rhetorical skills activated in reading a deep-dive on Elon Musk or Yevgeny Prigozhin, to borrow from last month’s headlines. Academic readers, that is, traditionally keep their attention fixed on the text—applying comprehension strategies such as prior knowledge, persisting through moments of confusion, and analyzing the narrative and its various claims about technological innovation or armed rebellion in discipline-specific ways.

The Problem with Checklists

Now, anyone who has tried to hold a dialogue on more than a few pages of assigned reading at the college level knows that sustained focus and critical thinking can be challenging, even for experienced readers. (A majority of high school seniors are not prepared for reading in college, according to 2019 data.) And so instructors, partnering with librarians, have long championed checklists as one antidote to passive consumption, first among them the CRAAP test, which stands for currency, relevance, authority, accuracy, and purpose. (Flashbacks to English 101, anyone?) The problem with checklists, argue Caulfield and Wineburg, is that in today’s media landscape—awash in questionable sources—they’re a waste of time. Such routines might easily keep a reader focused on critically evaluating “gameable signals of credibility” such as functional hyperlinks, a well-designed homepage, airtight prose, digital badges, and other supposedly telling markers of authority that can be manufactured with minimal effort or purchased at little expense, right down to the blue checkmark made infamous by Musk’s platform-formerly-known-as-Twitter.

Three Contexts for Lateral Reading

One of the delights in reading Verified is drawing back the curtains on a parade of little-known hoaxes, rumors, actors, and half-truths at work in the shadows of the information age—ranging from a sugar industry front group posing as a scientific think tank to headlines in mid-2022 warning that clouds of “palm-sized flying spiders” were about to descend on the East Coast. In the face of such wild ideas, Caulfield and Wineburg offer a helpful, three-point heuristic for navigating the web—and a sharp rejoinder to the source-specific checklists of the early aughts. (You will have to read the book to fact-check the spider story, or as the authors encourage, you can do it yourself after reading, say, the first chapter!) “The first task when confronted with the unfamiliar is not analysis. It is the gathering of context” (p. 10). More specifically:

  • The context of the source — What’s the reputation of the source of information that you arrive at, whether through a social feed, a shared link, or a Google search result?
  • The context of the claim — What have others said about the claim? If it’s a story, what’s the larger story? If a statistic, what’s the larger context?
  • Finally, the context of you — What is your level of expertise in the area? What is your interest in the claim? What makes such a claim or source compelling to you, and what could change that?
“The Three Contexts” from Verified (2023)

At a regional conference of librarians in May, Wineburg shared video clips from his scenario-based research, juxtaposing student sleuths with professional fact checkers. His conclusion? By simply trying to gather the necessary context, learners with supposedly low media literacy can be quickly transformed into “strong critical thinkers, without any additional training in logic or analysis” (Caulfield and Wineburg, p. 10). What does this look like in practice? Wineburg describes a shift from “vertical” to “lateral reading” or “using the web to read the web” (p. 81). To investigate a source like a pro, readers must first leave the source, often by opening new browser tabs, running nuanced searches about its contents, and pausing to reflect on the results. Again, such findings hold significant implications for how we train students in verification and, more broadly, in media literacy. Successful information gathering, in other words, depends not only on keywords and critical perspective but also on the ability to engage in metacognitive conversations with the web and its architecture. Or, channeling our eight-legged friends again: “If you wanted to understand how spiders catch their prey, you wouldn’t just look at a single strand” (p. 87).

SIFT graphic by Mike Caulfield with icons for stop, investigate the source, find better coverage, and trace claims, quotes, and media to the original context.

Image 2: Mike Caulfield’s “four moves”

Reconstructing Context

Much of Verified is devoted to unpacking how to gain such perspective while also building self-awareness of our relationships with the information we seek. As a companion to Wineburg’s research on lateral reading, Caulfield has refined a series of higher-order tasks for vetting sources called SIFT, or “The Four Moves” (see Image 2). By (1) Stopping to take a breath and get a look around, (2) Investigating the source and its reputation, (3) Finding better sources of journalism or research, and (4) Tracing surprising claims or other rhetorical artifacts back to their origins, readers can more quickly make decisions about how to manage their time online. You can learn more about the why behind “reconstructing context” at Caulfield’s blog, Hapgood, and as part of the OSU Libraries’ guide to media literacy. (Full disclosure: Mike is a former colleague from Washington State University Vancouver.)

If I have one complaint about Caulfield and Wineburg’s book, it’s that it dwells at length on the particulars of analyzing Google search results, which fill pages of accompanying figures and a whole chapter on the search engine as “the bestie you thought you knew” (p. 49). To be sure, Google still occupies a large share of the time students and faculty spend online. But as in my quest for learning norms protocols, readers are already turning to large language model tools for help in deciding what to believe online. In that respect, I find other chapters in Verified (on scholarly sources, the rise of Wikipedia, deceptive videos, and so-called native advertising) more useful. And if you go there, don’t miss the author’s final take on the power of emotion in finding the truth—a line that sounds counterintuitive, but in context adds another, rather moving dimension to the case against checklists.

Given the acceleration of machine learning, will lateral reading and SIFTing hold up in the age of AI? Caulfield and Wineburg certainly think so. Building out context becomes all the more necessary, they write in a postscript on the future of verification, “when the prose on the other side is crafted by a convincing machine” (p. 221). On that note, I invite you and your students to try out some of these moves on your favorite chatbot.

Another Postscript

The other day, I gave Microsoft’s AI-powered search engine a few versions of the same prompt I had put to ChatGPT. In “balanced” mode, Bing dutifully recommended resources from Stanford, Cornell, and Harvard on introducing norms for learning in online college classes. Over in “creative” mode, Bing’s synthesis was slightly more offbeat—including an early-pandemic blog post on setting norms for middle school faculty meetings in rural Vermont. More importantly, the bot wasn’t hallucinating. Most of the sources it suggested seemed worth investigating. Pausing before each rabbit hole, I took a deep breath.

Related Resource

Oregon State Ecampus recently rolled out its own AI toolkit for faculty, based on an emerging consensus that developing capacities for using this technology will be necessary in many areas of life. Of particular relevance to this post is a section on AI literacy, conceptualized as “a broad set of skills that is not confined to technical disciplines.” As with Verified, I find the toolkit’s frameworks and recommendations on teaching AI literacy particularly helpful. For instance, if students are allowed to use ChatGPT or Bing to brainstorm and evaluate possible topics for a writing assignment, “faculty might provide an effective example of how to ask an AI tool to help, ideally situating explanation in the context of what would be appropriate and ethical in that discipline or profession.”

References

Caulfield, M., & Wineburg, S. (2023). Verified: How to think straight, get duped less, and make better decisions about what to believe online. University of Chicago Press.

Mollick, E. (2023, July 15). How to use AI to do stuff: An opinionated guide. One Useful Thing.

Oregon State Ecampus. (2023). Artificial Intelligence Tools.

Media Literacy in the Age of AI, Part I: “You Will Need to Check It All”

Posted on by | Leave a reply

Have you found yourself worried or overwhelmed in thinking about the implications of artificial intelligence for your discipline? Whether, for example, your department’s approaches to teaching basic skills such as library research and source evaluation still hold up? You’re not alone. As we enter another school year, many educators continue to think deeply about questions of truth and misinformation, creativity, and how large language model (LLM) tools such as chatbots are reshaping higher education. Along with our students, faculty (oh, and instructional designers) must consider new paradigms for our collective media literacy.

Here’s a quick backstory for this two-part post. In late spring, shortly after the “stable release” of ChatGPT to iOS, I started chatting with bot model GPT-3.5, which innovator Ethan Mollick describes as “very fast and pretty solid at writing and coding tasks,” if a bit lacking in personality. Other, internet-connected models, such as Bing, have made headlines for their resourcefulness and darker, erratic tendencies. But so far, access to GPT-4 remains limited, and I wanted to better understand the more popular engine’s capabilities. At the time, I was preparing a workshop for a creative writing conference. So, I asked ChatGPT to write a short story in the modern style of George Saunders, based in part on historical events. The chatbot’s response, a brief burst of prose it titled “Language Unleashed,” read almost nothing like Saunders. Still, it got my participants talking about questions of authorship, originality, representation, etc. Check, check, check.

The next time I sat down with the GPT-3.5, things went a little more off-script.

One faculty developer working with Ecampus had asked our team about establishing learning norms in a 200-level course dealing with sensitive subject matter. As a writing instructor, I had bookmarked a few resources in this vein, including strategies from the University of Colorado Boulder. So, I asked ChatGPT to create a bibliographic citation of Creating Collaborative Classroom Norms, which it did with the usual lightning speed. Then I got curious about what else this AI model could do, as my colleagues Philip Chambers and Nadia Jaramillo Cherrez have been exploring. Could ChatGPT point me to some good resources for faculty on setting norms for learning in online college classes?

“Certainly!” came the cheery reply, along with a summary of five sources that would provide me with “valuable information and guidance” (see Image 1). Noting OpenAI’s fine-print caveat (“ChatGPT may produce inaccurate information about people, places, or facts”), I began opening each link, expecting to be teleported to university teaching centers across the country. Except none of the tabs would load properly.

“Sorry we can’t find what you’re looking for,” reported Inside Higher Ed. “Try these resources instead,” suggested Stanford’s Teaching Commons. A closer look with Internet Archive’s Wayback Machine confirmed that the five sources in question were, like “Language Unleashed,” entirely fictitious.

An early chat with ChatGPT-3.5, asking whether the chatbot can point the author to some good resources for faculty on setting classroom norms for learning in online college classes. "Certainly," replies ChatGPT, in recommending five sources that "should provide you with valuable information and guidance."

Image 1: An early, hallucinatory chat with ChatGPT-3.5

As Mollick would explain months later: “it is very easy for the AI to ‘hallucinate’ and generate plausible facts. It can generate entirely false content that is utterly convincing. Let me emphasize that: AI lies continuously and well. Every fact or piece of information it tells you may be incorrect. You will need to check it all.”

The fabrications and limitations of chatbots lacking real-time access to the ever-expanding web have by now been well-documented. But as an early adopter, the speed and confidence ChatGPT brought to the task of inventing and describing fake sources felt unnerving. And without better guideposts for verification, I expect students less familiar with the evolution of AI will continue to experience confusion, or worse. As the Post recently reported, chatbots can easily say offensive things and act in culturally-biased ways—”a reminder that they’ve ingested some of the ugliest material the internet has to offer, and they lack the independent judgment to filter that out.”

Just how, exactly, we’re supposed to “check it all” happens to be the subject of a lively, forthcoming collaboration from two education researchers who have been following the intersection of new media and misinformation for decades.

Stay tuned for an upcoming post with the second installment of “Media Literacy in the Age of AI,” a review of Verified: How to Think Straight, Get Duped Less, and Make Better Decisions about What to Believe Online by Mike Caulfield and Sam Wineburg (University of Chicago Press, November 2023).

References

Mollick, E. (2023, July 15). How to use AI to do stuff: An opinionated guide. One Useful Thing.

Wroe, T., & Volckens, J. (2022, January). Creating collaborative classroom norms. Office of Faculty Affairs, University of Colorado Boulder.

Yu Chen, S., Tenjarla, R., Oremus , W., & Harris, T. (2023, August 31). How to talk to an AI chatbot. The Washington Post.

Valuable Skills for Online Students and Online Instructors

Posted on by | Leave a reply

By Cat Turk and Mary Ellen Dello Stritto

In this time of rapid change in online education, we can benefit from leveraging the expertise of faculty who have experienced the evolution of online education. At the Oregon State University (OSU) Ecampus Research Unit, we have been learning from a group of instructors who have taught online for ten years or more. A review of recent research uncovered that these instructors are an untapped resource. Their insights can provide valuable guidance for instructors who are just beginning their careers or instructors who may be preparing to teach online for the first time. Further, their perspectives can also be enlightening for online students.

In 2018-2019 we conducted interviews with 33 OSU faculty who had been teaching online for 10 years or more as a part of a larger study. Two of the questions we asked them were the following:

  1. What skills do you think are most valuable for online instructors to have?
  2. What skills do you think are most valuable for online students to have?

We will share some of the results of a qualitative analysis of these questions and highlight the similarities and differences.

When asked about the most valuable skills for online instructors, three key skills emerged: communication, organization, and time management. When asked about the most valuable skills for online students to have, the same skills were among the most frequently mentioned by these instructors.

As the table below shows, in the responses about skills for online instructors, communication emerged as the most prominent skill, with 85% of instructors in the study emphasizing its importance, while time management and organization were split evenly at 45%. In their response about skills for students, 64% of the instructors emphasized both communication and time management, while 42% discussed organization. When discussing communication for instructors, they indicated that effective communication is essential for building rapport with students, providing clear instructions, and facilitating meaningful interactions in the online environment. Organization (such as structuring course materials or their weekly work process) and time management skills (such as scheduling availability to connect with students) were also highly valued by these instructors. Read more about the analysis of instructor skills here.

 Skills for InstructorsSkills for Students
Communication    28 responses (85%)   21 responses (64%)
Time Management15 responses (45%)  21 responses (64%)
Organization15 responses (45%)   14 responses (42%)
Self-Motivation   —21 responses (64%)            
Frequency of responses of skills for instructors and students.

The responses to both questions emphasized the significance of communication skills in written assignments and in proactive connections within the scope of the online learning environment. Instructors articulated that online students needed to be proactive communicators themselves. Examples of this include contacting their instructors about questions and clarification in a timely way, interacting with their peers in a respectful manner, and turning in quality written assignments that demonstrate comprehension of their learning material. For students, clear and effective communication ensures understanding and engagement, while organization facilitates seamless navigation through course materials, and time management ensures that students are able to make the most of the asynchronous environment.

While time management and organization were both considered by instructors to be just as crucial for students, their responses demonstrated that these skills were needed for different reasons than would be the case for instructors. Instructors personally valued time management and organization due to the nature of facilitating courses online. When the online classroom can travel from place to place, setting blocks of intentional time and structuring hours accordingly were considered essential to instructors for maintaining a work-life balance and so tasks would not be missed.

On the other hand, according to these instructors, students need time management and organization due to the asynchronous and sometimes isolating nature of online courses. One instructor stressed that:

 “[Students] do need to be more organized than on-ground students, because there’s not that weekly meeting to keep students on track.”

These instructors indicated some online students may need to structure their study time to accommodate a different time zone, while others may need to structure their academic pursuits around careers or children. Another instructor emphasized that:

“A lot of our [online students] actually work full-time, so they have families and kids and have to be much more organized too.”

While there were overlaps with the responses to the two questions, a notable difference was the emergence of another skill for students: self-motivation. This concept of self-motivation emerged from the instructor responses about students’ capacity to persevere in online courses. This included their level of motivation, capacity to learn on their own, and comfort with self-paced learning.

One instructor said the following about students’ self-motivation,

“Some people would say it’s self-discipline, but I think it’s more of they have to have a purpose for that class.”

Self-motivation was not mentioned by the instructors as a skill for online instructors, suggesting that these instructors perceive this as more pertinent to students for success in managing their own learning process. It is worth noting that proactive communication was highlighted as an essential aspect of self-motivation, with instructors emphasizing that students who take the initiative in reaching out to them tend to be more successful. This observation suggests that self-motivated individuals are more likely to actively seek support and clarification, which can enhance their learning experience and overall success. 

Another noteworthy aspect was the need for students to be comfortable with learning in physical isolation. Instructors acknowledged that online learners must navigate the challenges of studying independently without the immediate presence of peers and instructors. For online students specifically,

“They need to be motivated because they’re not going to have peers sitting in a classroom with them, and they don’t have a place that they have to physically go every week.”

This finding underscores the importance of maintaining motivation and engagement, as students ideally possess an intrinsic drive to succeed despite the absence of a physical connection to the university and their classmates.

The findings from this study highlight the importance of certain similar skills for both online instructors and students. Effective communication, organization, and time management are vital for success in the online learning environment for both instructors and students. We found this to be an interesting connection that online students might benefit from understanding: these are key skills that students and instructors have in common.

Our findings about self-motivation may be useful for online instructors. Consider incorporating strategies that foster student self-motivation, such as goal-setting exercises, regular check-ins, and providing opportunities for self-reflection. By empowering students to take ownership of their learning, instructors might enhance student engagement and success in the online environment.

Further, students can learn from the instructors’ emphasis on communication, organization, and time management skills. They can intentionally work on improving their communication skills, seeking clarification when needed, and actively participating in online discussions. Developing effective organization and time management strategies, such as creating schedules, prioritizing tasks, and breaking them down into manageable chunks, may significantly enhance their online learning experience.

The field of online education is evolving rapidly, and here we can see how educators and students alike are adapting to these changes. The experiences of long-term online instructors provide valuable insights into the skills necessary for success in the online learning environment. In the future, what answers would we find if we asked students the same question: what do online students think are the skills needed to succeed in the online classroom? By understanding the shared and distinct perspectives of instructors and students, educators can design effective online courses and support systems that foster meaningful learning experiences and empower students to succeed.