Tag Archives: ecampus

Self-Determination Theory and Online Education: Thinking About Grades

Posted on by | Leave a reply

red lightbulb

Photo by Terry Vlisidis on Unsplash

Last Time on SDT & Online Education…

This post is a continuation of my previous blog posts on Self-Determination Theory (SDT) and Online Education and a companion post to Chris Lindberg’s series of posts, Games as a Model for Motivation and Engagement.

In my last post, I posed some difficult questions to consider as you start thinking about how you use grades and motivation in your courses. In case you missed that post, here are the questions—I invite you to spend a few minutes, hours, or days with these questions before moving on with the rest of this blog post:

  • Do you use grades to create external regulation of behavior in your course?
    • Are you grading a behavior or the demonstration of a skill?
  • Do you want to emphasize performance goals or mastery goals?
  • Are there ways to help students identify and integrate the activities and assessments in your course?
  • Do you need to grade this activity/assessment/task?

Why are you grading?

“The troubling truth is that rewards and punishments are not opposites at all; they are two sides of the same coin. And it is a coin that does not buy very much.” (Kohn, 1993, p. 50)

When I first started teaching, I remember asking a colleague if they would review my syllabus draft. They read the attendance policy and asked me something along the lines of, “Why are you grading this? Does it have anything to do with the outcomes of your course?” I probably spewed the usual talking points that students do better in class when they attend, I wanted them to come to class, etc. The reply: “So, do you want to grade learning, or behavior?” That question rocked my world as a young teacher. And made me question everything.

Why do we use grades? Numerous studies have shown that grades and rewards, especially for intrinsically motivating activities such as learning, have detrimental effects. And what do these grades communicate? In terms of SDT, “grading in educational contexts has two functions. One is providing competence-relevant feedback to students, presumably as an aid to enhancing subsequent performance … A second is gatekeeping. Grades can be used to make sure that only students who have mastered material and are thus qualified are eligible for higher training…” (Ryan & Deci, 2017, p. 371). What does an A, B or F communicate to you? For Ryan & Deci, grades by themselves provide little in the way of relevant feedback. (For more on effective feedback, see Wiggins, 2012.)

So can a “grade” be useful? In the context of SDT, there needs to be important information communicated to students about how they’re doing and where they need to spend more attention and effort. In order for this to be autonomy-supportive, it should be informative for the learning process and not judgmental, pressure-inducing, or a social comparison, both in terms of being a reward or a punishment. For example, “Great work. You might consider adding an example in your third paragraph.” is not informative toward the learning process; “You do a great job of defining the problem in your third paragraph, which is an improvement from your first draft. Adding an example would do even more to help your readers relate to this problem.” is an example of feedback that informs a student about where they have come from and where they still need to go.

Performance vs. Mastery

“There do, indeed, seem to be few empirical or theoretical supports for the motivational or competence-building advantages of classical grading schemes. Yet, in most school settings, grades and evaluations are employed as if they were the key to motivation, when, in fact, especially for those who need competence supports, they are likely to be undermining influences.” (Ryan & Deci, 2017, p. 371)

Is it possible to see a letter grade of your work in a course outside the context of social comparison? How often is a B simply viewed as “better than average” or “in the top half of the class”? Focusing on performing a certain way relative to others is a performance goal, while focusing on increasing competence or learning is a mastery goal. (For more on this topic, see Elliot, 2005.) Additionally, each category of goal has an approach type (seeking to achieve something) and an avoidance type (seeking to avoid something). Multiple studies have found that the performance-avoidance combination has the most detrimental outcomes for both learning and student well being, and that this combination is adopted most when students have expectations of being graded (Ryan & Deci, 2017, p. 373).

Ungrading

“…the grading system that higher education in the United States has relied on for many decades has serious problems. It does not work in anyone’s interests, and it genuinely hurts those most directly associated with it: the faculty and the students. In fact, the system is broken.” (Nilson, 2015, p. 23)

At this point you might be asking, “what am I supposed to do?” There are numerous tools, resources, alternatives, and considerations when thinking about using or eliminating grades in a course, such as self-assessment, student-created rubrics, or specifications or criterion-based grading. (Several more are listed in the Reference & Resources section below). One option is to eliminate grading all together, which some institutions have done. If you aren’t ready to eliminate all your grades, try focusing on providing students with feedback in an autonomy-supportive way and empowering them to learn the valuable skill of self-assessment. Without rewards and punishments, students will feel a greater sense of competence; self-assessment and valuable and informative feedback will give students a greater sense of autonomy—that they’re in the driver’s seat for their own learning; with an increased focus on communication about learning, students will also gain a greater sense of relatedness.

There is much more to the topic of grading and ungrading than can be covered in a single blog post, so I’d like to invite you to check out the references and resources below, add your comments, suggestions, and experiences in the comments, contact your instructional designer, or keep an eye out for other opportunities to continue the discussion at various upcoming Ecampus events!

References & Resources

Center for Self-Determination Theory (CSDT). (2019).

  • This website is a treasure-trove of resources on SDT and its application in numerous fields, including education.

Elliot, A. J. (2005). A conceptual history of the achievement goal construct. In Elliot, A. J., & Dweck, C. S. (Eds.) Handbook of competence and motivation (52–72). New York: Guilford Press.

Flaherty, C. (2019). When grading less is more. Inside Higher Ed.

Kohn, A. (2018). Rewards are still bad news (25 years later). New York Times.

Kohn, A. (2011). The case against grades. Educational Leadership.

Kohn, A. (1993). Punished by rewards: The trouble with gold stars, incentive plans, A’s, praise, and other bribes. Boston: Houghton Mifflin.

Nilson, L. (2015). Specifications grading: Restoring rigor, motivating students, and saving faculty time. Serling, VA: Stylus.

Ryan, R. M., & Deci, E. L. (2017). Self-Determination Theory: Basic psychological needs in motivation, development, and wellness. New York: Guilford Press.

Stommel, J. (2018). How to ungrade.

Wiggins, G. (2012). Seven keys to effective feedback. Educational Leadership 70(1), 10–16.

Accessibility, Universal Design for Learning (UDL), and Inclusive Design: What Do They Really Mean?

Posted on by | Leave a reply

The other day, my six-year-old asked me what the word “industrious” means, and I was overcome with pride and, moments later, mild panic as I tried to answer his question and couldn’t clearly articulate the meaning of the word.

This experience ended well (thanks, Alexa), but prompted me to think about how often we use words without fully understanding what they mean. We don’t question the meaning of these words when they are used in our work or daily interactions. We may use these words ourselves on occasion–or with regularity–but when we stop and try to define these words, the proper associations and descriptions don’t come immediately to mind.

In my work as an instructional designer, it’s common to talk about universal design or inclusive design, and in many cases, to use these descriptors interchangeably, when talking about design that is usable by a wide range of people. To a lesser extent, accessibility is used in a similar way, but, I think, our shared understanding of this term is more reliable.

For this blog post, I would like to spend some time defining and distinguishing these terms and grounding them in a historical context to more fully convey the nuances and layers of meaning ascribed to each term. I’ll wrap up with some strategies for designing courses to better meet the needs of all learners.

Accessibility

According to the Web Accessibility Initiative (WAI), “Web accessibility means that websites, tools, and technologies are designed and developed so that people with disabilities can use them.” It’s clear from this definition that accessibility is intended to address the needs of users with disabilities, so let’s consider disability. 

Prior to 2001, the World Health Organization (WHO) defined disability as a personal health condition. This definition placed emphasis on the individual. However, in 2001, the WHO redefined disability as a mismatched interaction between a person and their environment. This new definition places emphasis on the environment, rather than the individual. As a result, the onus is no longer only on the disabled individual to manage their health condition; rather, those who have influence over the environment need to make changes to the environment to better accommodate everyone who is interacting with it. In our case, the learning environment is the web, or more specifically, online courses. 

Unlike the other two design approaches we’ll consider, accessibility is intended to address the needs of users with disabilities. Another distinguishing feature of accessibility is that it describes an end goal. Our web content should be presented in such a way that the end result is an accessible website or technology. While this post will not go into the how of making web content accessible, here are some elements you may be familiar with: alternative text (alt tags), headings (H1, H2, H3, etc.), color contrast, captions and/or transcripts, reading order, keyboard navigation, and descriptive URLs are all examples of accessibility elements. All of these elements define what our design should look like, not how to get there.

Another distinguishing feature is that accessibility is required by law. We won’t delve into the specifics here, but it’s important to recognize that accessibility is a legal compliance issue.

Universal Design for Learning (UDL)

While accessibility addresses specific features of a website or online learning environment, Universal Design for Learning (UDL) takes a broader approach. UDL guidelines still emphasize accessibility, but the emphasis is not solely on making disability accommodations or complying with the law. The goal of UDL is to provide the greatest degree of access and usability for the widest range of individuals.

UDL includes a framework with three general principles, each of which includes multiple guidelines and checkpoints for actual practice. A UDL approach is structured and practical and, similar to accessibility, UDL defines an end goal: a product that is usable by the widest range of individuals possible. The framework, however, emphasizes the design, which is only one aspect of creating an online course.

To broaden our understanding of UDL, it’s important to understand that UDL emerged from universal design, which is an architectural concept. Architecture, unlike the web, is physically fixed, and as such, the emphasis is on a single design that works for everyone. 

Inclusive Design

While UDL emerged from architecture, inclusive design was “born out of digital environments,” and, while architecture is fixed, the web is flexible and ever-changing. As such, inclusive design emphasizes flexibility and process. Inclusive design is iterative. With an emphasis on iteration and process, inclusive design cannot be separated from the lived experience of actual users. In other words, if the users (in our case, students) are contributing to and evaluating the design, then we can no longer separate the design and delivery–the creation and facilitation activities.

With a focus on process, inclusive design emphasizes co-creation and frequent feedback from multiple developers as well as end users. In particular, seeking contributions from excluded communities during the entire design and evaluation process is critical to an inclusive process.

Unlike accessibility and UDL, inclusive design is focused on process and iteration. To help illustrate how we see these three design approaches working together, my colleague, Elisabeth McBrien and I created the figure below (figure 1).

Three circles. The outer circle represents inclusive design. The middle circle represents UDL. And the smallest circle represents accessibility.
Figure 1. An inclusive design process will always include UDL and accessibility as end goals.

We see accessibility compliance as core to any design. UDL goes beyond the requirements of accessibility to meet the needs of all users. In an inclusive design process, UDL and accessibility are always the end goal, but inclusive design emphasizes the importance of feedback and iteration. We can always improve and we always have more work to do.

In Practice

Now that we have a better understanding how accessibility, UDL, and inclusive design work together to contribute to a learning environment that meets the needs of all learners, how do we apply them and improve? Ecampus has many guidelines and templates that help us to meet the goals of accessibility and UDL, but how can we be more inclusive throughout this process? 

Here are some inclusive approaches that you might consider integrating into your course facilitation and teaching:

  • Build rapport with students. This is accomplished by infusing instructor presence whenever possible. Respond to Q&A questions and emails within 24-48 hours. Share resources. Deliver feedback promptly. An important element of rapport and presence is showing your personality, so consider using video to welcome students and to encourage them throughout the course.
  • Solicit feedback. One of the easiest ways to solicit feedback from your students is to use a survey. Keep surveys short and consider asking students to share in a few words how the course is going or what they find most challenging.
  • Establish clear criteria and structure. Rubrics, templates, examples, and consistent naming and organization of course materials are just a few ways to provide clarity and structure.
  • Acknowledge student contributions. Praise is an instant confidence booster. Do you have a student–particularly, an underrepresented student–who did an exceptional job on one of your assignments? Let them know. Consider sharing their work as an example–with their permission, of course.
  • Feature counter-stereotypical examples of people in your field. One common barrier to success for underrepresented students is that they don’t see themselves reflected in a particular discipline. Make sure your readings, examples, and other course materials represent a variety of identities. If there’s a lack of diversity in your field, find a way to acknowledge this to your students.
  • Promote student agency and autonomy by giving them choice, whenever possible. Providing choice and promoting agency allow students to connect your course to their own experiences and values.
  • Emphasize real world applications of course work. Often, we assume that our students understand the purpose of course activities, but this is not always the case. Sharing real world applications will help students to see the value and greater purpose of their studies.

Final Thoughts

We’ve covered a lot in this post, and I hope that we’ve come away with a better understanding of disability, accessibility, Universal Design for Learning (UDL), and inclusive design. One of the most important takeaways is that inclusive design is an ongoing process of feedback and iteration. As our student body changes, so do their needs. In an upcoming blog post, Elisabeth McBrien will share more details about student needs and how you might use student personas to design more inclusively.  

As we continue the challenging–yet meaningful–work of creating welcoming online learning environments, it’s important that we have a shared understanding of what that work entails, what work we have done, and what work we have yet to do.

Resources

  1. Appert, L. et al. (2018) Guide for Inclusive Teaching at Columbia. Columbia University: Center for Teaching and Learning.
  2. Gannon, Kevin. (2018) The case for inclusive teaching. Chronicle of Higher Education.
  3. Hogan, Kelly A. and Sathy, Viji. (2019, July 22) “Want to Reach All of Your Students? Here’s How to Make Your Teaching More Inclusive: Advice Guide.” Chronicle of Higher Education.
  4. The inclusive design guide. Inclusive Design Research Centre at OCAD University. CC-BY 3.0.
  5. Inclusive Teaching: Supporting All Students in the College Classroom. EdX course from Columbia University.

Digital Storytelling for Higher Education

Video

About halfway through earning a master’s in education, I took a summer session class on digital storytelling. It ran over the course of three half-day sessions during which we were required to complete two digital stories. I had no great academic ambitions in my approach to these assignments. I was trying to satisfy a degree requirement in a way that worked with my schedule as a single mother of two teenagers working full time while earning a graduate degree.

My first story was a self-introduction. I loved this assignment. Even though I had one evening to complete it, I spent hours tweaking it. I enjoyed learning the tools. I enjoyed sharing my story with my classmates. Even after it was graded, I kept finding ways to improve it.

After completing the course, I began to study the use of digital stories in education. My personal experience had shown me that in completing my assignment I had to become comfortable with technology as well as practiced my writing, speaking and presentation skills. I also felt a stronger connection to my classmates after sharing my video and watching their videos.

Literature

The research on digital storytelling echoes my own experience. Dr. Bernard Robin, an Associate Professor of Learning, Design, & Technology at the University of Houston, discussed the pedagogical benefits of digital storytelling assignments in a 2016 article,  The Power of Digital Storytelling to Support Teaching and Learning. His research found that both student engagement and creativity increased in higher education courses when students were given the opportunity to use multimedia tools to communicate their ideas. Students “develop enhanced communication skills by learning to organize their ideas, ask questions, express opinions, and construct narratives” (Robin, 2016). Bernard’s experience also finds that by sharing their work with peers, students learn to give and accept critique, fostering social learning and emotional intelligence.

Digital Storytelling as Educators

Digital Storytelling in online education shouldn’t be thought of as only a means of creating an engaging student assignment. Educators who are adept at telling stories have a tremendous advantage in capturing their student’s attention. In the following short video, Sir Ian McKellen shares why stories have so much power. Illustrated in the form of a story, he shares that stories are powerful for four reasons. They are a vessel for information, create an emotional connection, display cultural identity, and gives us happiness.

The Power of Storytelling, with Sir Ian McKellen

McKellen is a compelling narrator with a great voice. This story is beautifully illustrated. It reminds me of how I want my learners to feel when they are consuming the content I create. Even if for a moment, so engrossed, that they forget that they are learning. Learning becomes effortless. As he points out, a good storyteller can make the listener feel as if they are also living the story.

Digital Storytelling Assignments

There are lots of ways to integrate digital stories across a broad set of academic subjects. Creating personal narratives, historical documentaries, informational and instructional videos or a combination of these styles all have educational benefits. One of the simplest ways to introduce this form of assessment to your course is to start with a single image digital story assignment.

Here’s an example I created using a trial version of one of many digital story making tools available online:

Single Image Digital Story Example

Digital Story Making Process

The process of creating a digital story lends itself well for staged student projects. Here’s an example of some story making stages:

  1. Select a topic
  2. Conduct research
  3. Find resources and content
  4. Create a storyboard
  5. Script the video
  6. Narrate the video
  7. Edit the final project

I created an animated digital story to illustrate the process of creating a digital story using another freely available tool online.

Digital Storytelling Process Movie link

Recommended Resources & Tools

You will find hundreds of tools available for recording media with a simple search. Any recommended tool should be considered for privacy policies, accessibility and cost to students.

Adobe Express (previously Adobe Spark)

Adobe offers a free online video editor which provides easy ways to add text, embed videos, add background music and narration. The resulting videos can be easily shared online via a link or by downloading and reposting somewhere else. While the tool doesn’t offer tremendous flexibility in design, the user interface is very friendly.

Canvas

Canvas has built-in tools to allow students to record and share media within a Canvas course. Instructions are documented in the OSU Ecampus student-facing quick reference guide.

Audacity

Audacity is a free, open-source cross-platform software for recording and editing audio. It has a steeper learning curve than some of the other tools used for multimedia content creation. It will allow you to export your audio file in a format that you can easily add to a digital story.

Padlet

Padlet allows you to create collaborative web pages. It supports lots of content types. It is a great place to have students submit their video stories. You have a lot of control during setup. You can keep a board private, you can enable comments, and you can choose to moderate content prior to posting. Padlet allows for embedding in other sites – and the free version at the time of writing allows users to create three padlets the site will retain.

Storyboarding Tools

A note first about storyboarding. Storyboarding is an essential step in creating a digital story. It is a visual blueprint of how a video will look and feel. It is time to think about mood, flow and gather feedback.
Students and teachers alike benefit from visualizing how they want a final project to look. It doesn’t have to be fancy. It is much easier to think about how you want a shot to look at this stage than while you are shooting and producing your video. A storyboard is also a good step in a staged, longer-term project in a course to gauge if students are on the right track.

Storyboard That

This is a storyboard creation tool. The free account allows for three and six frame stories. In each frame, you can choose from a wide selection of scenes, characters, and props. Each element allows you to customize color, position, and size. Here’s a sample I created:

The Boords

This site has several free to use templates in multiple formats to support this process. Here is one that I have used before:

A4-landscape-6-storyboard-template

Looking for Inspiration?

Start with Matthew Dicks. Dicks is the author of Storyworthy: Engage, Teach, Persuade and Change Your Life through the Power of Storytelling. He is a teacher. He is a five-time winner of the Moth GrandSlam championship.
His book is wonderful, but to just get a taste, start with the podcast he cohosts with his wife. Each week they include a well-vetted and rehearsed story told during a competition. They then highlight the strengths and areas for improvement. You will walk away with ideas and the motivation to become a better storyteller. Here’s the first episode, and one of my favorites.

Conclusion

When pressed for time to develop course content, we tend to over-rely on text-based assignments such as essays and written discussion posts. Students, when working on Digital Storytelling assignments, get the opportunity to experiment, think creatively and practice communication and presentation skills.

For educators, moving away from presenting learning materials in narrated bulleted slides is likely to make classes more engaging and exciting for their students leading to better learning outcomes. Teachers work every day to connect with students and capture their attention. A good story can inspire your students and help them engage with the content.

I was uncomfortable when I received my first digital storytelling assignment. I didn’t really know how to use the tools, wasn’t confident I knew how or what to capture. I was sure it would feel awkward to narrate a video. But These assignments turned out to be engaging, meaningful, and the process is pretty straight forward. Introduce digital storytelling into your courses, even by starting small, and you are sure to feel the same way.

Peer Review: Providing a Rationale for the Process

Posted on by | Leave a reply

As online educators, we strive for a balance of learning activities that incorporate three types of engagement: learner-to-content, learner-to-instructor, and learner-to-learner.  The learner-to-learner component is often filled through discussion boards or group projects, but an underutilized and undervalued option is peer review.

The Rationale

There are many ways peer review benefits students, among them Cornell University Center for Teaching Innovation lists:

  • Empower students to take responsibility for and manage their own learning.
  • Enable students to learn to assess and give others constructive feedback to develop lifelong assessment skills.
  • Enhance students’ learning through knowledge diffusion and exchange of ideas.
  • Motivate students to engage with course material more deeply.

More broadly, the authors of The Knowledge Illusion argue that our individual capacity for knowledge is often much more limited than we realize and that our true depth of knowledge is held collectively.  They remind us that, “when you put it all together, human thought is incredibly impressive.  But it is a product of a community, not of any individual alone” (page 5).  In our increasingly complex world, some evidence of a shift towards building knowledge collectively can be seen in research. For example, in the MEDLINE database, “the average number of authors per article has nearly quadrupled from about 1.5 in 1950 to 5.5 in 2014” (page 226).  This is just one of many examples the authors use to illustrate how essential collaboration and relationship skills have become.  In nearly every field, students need to be prepared to be more than individual achievers, but rather to contribute effectively to a group.  Peer review provides students an opportunity to give and receive feedback with the goal of creating a better end product, but it is also an opportunity for students to practice and build their teamwork skills.

Moreover, International Society for Technology in Education (ISTE) Standard 3b emphasizes the need for students to, “evaluate the accuracy, perspective, credibility and relevance of information, media, data or other resources.”  Peer review is a great way for us to meet this standard and to combat against misinformation, by teaching students to evaluate and challenge claims.  In Weaponized Lies: How to Think Critically in the Post-Truth Era author Daniel J. Levitin shares strategies for how we can think more critically and evaluate the trustworthiness of what we are being told.  He notes that, “sometimes the people giving you the facts are hoping you’ll draw the wrong conclusion; sometimes they don’t know the difference themselves” (page xx).  If your students are in either of these groups, it benefits them to have an attentive reader review their work and provide respectful suggestions for improvement prior to a final assignment submission.  This may help you as the instructor to avoid catching errors too late in the process when students cannot revise their work.

The Explanation

However, students may not see the value of peer review on their own.  The Teaching Center at Washington University in St. Louis describes many reasons students may express uncertainty around peer review as, “Many students do not perceive feedback from peers as relevant to the process… students are likely to assume that it is only the instructor’s feedback that ‘counts.’”  Therefore, it is important that we explain to students why we are asking them to engage in peer review explicitly.

It can be helpful to explain specifically how this will relate to industry or field of study requirements as a student advances as a professional and scholar – it looks different for a researcher than it does for a project manager, so motivate students by sharing with them how they will engage in similar activities in the future as this gives them an opportunity to practice what Starting Point: Teaching Entry Level Geoscience describes as, “key skills such as abstracting, developing arguments, describing, assessing, criticizing, analyzing, and reviewing.”  As Faculty Focus advises, we can’t assume that students will implicitly understand the purpose of peer review.  When we craft a peer review assignment, we need to think carefully about how we will articulate the benefits of the process to students.  It can be helpful to answer questions like, “Why am I having students do this?” and “Why should students be excited about this process?”  Or, to take it a step further, we can anticipate the questions from our students’ perspective and proactively address the purpose and logistics in the assignment description, by answering questions like, “Why am I doing peer review?” and “How am I supposed to review my peer’s work?”  Make sure the technology needed and processes are clear and that resources are provided for students that need more guidance.

The Process

Remember, knowing why students are peer reviewing and being able to peer review are two totally different skills.  If you are an Ecampus instructor, talk with your instructional designer about strategies that can help your peer review process be more successful.  Some of the best practices suggested by Center for Instructional Technology & Training at the University of Florida include:

  • Clarify expectations in advance
  • Check your students have all the tools they will need
  • Provide enough time in the peer review process so that students can meaningfully engage – this may span more than one module
  • Model the type of feedback you want your students to use
  • Create a quality rubric as a guide

Your instructional designer can also talk to you about digital tools or strategies that can be used to introduce students to peer review. For example, you can discuss whether it makes more sense to use Canvas Peer Review or another tool, like Peerceptiv, which is research-validated peer assessment technology available for Ecampus courses.

Remember, students need opportunities to practice peer review, as they may never have done it before.  That means they have to get familiar with both the tools and the process.  It’s best if they can practice with the technology on a low stakes assignment before using it for a high stakes assignment, so that they can familiarize themselves with a peer review process without the added anxiety of a major grade on the line.  It will also take time for you as the instructor to get familiar with the process, but it is a completely worthwhile investment!

I invite you to consider some concluding thoughts from Levitin, “Information gathering and research that used to take anywhere from hours to weeks now takes just seconds… The implicit bargain that we all need to make explicit is that we will use just some of that time we saved in information acquisition to perform proper information verification” (page 253).  Let’s reinvest some of the time our students saved researching to engage them in verifying claims, evaluating evidence, offering commentary, and incorporating feedback – all of which support the development of a stronger student work and the building of a collective knowledge.

Virtual Reality makes animation easy & speedy

Video

The Ecampus multimedia team creates animations to bring your thoughts and words to life. In virtual reality, creating these 3D objects and animations has become incredibly easy and fast.

The old ways … of power tool juggling

Developing “multimedia” often means using small aspects of many different tools. “Media” being a means of communication and the plural of medium: a means of doing something. To create an animation for your class, we quickly run through a long list of media.

Here’s an exhaustive run through of how the process works at the moment (feel free to skip to the next section! This is detailed): You would typically type up and email over a script that I take into Google Drive to edit and comment upon. You’d record audio in one of our sound booths, and I’d take the resulting sound files into Adobe Audition to equalize levels and remove background noise(s). Then I’d grab a pencil and sketch out a quick storyboard for each sentence to suggest visuals that could emphasize your point(s). Photographs of these sketches are edited in Photoshop and injected into another file on Google Drive.

And that is just the easy preparation portion. Depending on the animation style we’re going after, I’d dive deep into obscure programs I’ve learned to use over the past few decades – like Autodesk Maya / Mudbox / MotionBuilder / Meshmixer, Adobe Illustrator / Animate / Character Animator / Fuse / Dimension, Unity3D, the Procreate iPad app, Agisoft Photoscan, MeshLab, Instant Meshes, Mixamo, etc. … Simply trying to list the most commonly used apps is exhausting (much less all the other emerging apps we investigate, or the ones we mastered that went away. I still love you HyperCard, Director, and Flash!). Phew.

However the pieces of animation are generated, we still end up spitting out thousands of images or video files that have to be lined up in Adobe After Effects / Premiere / Media Encoder to assemble the final video that we can upload to YouTube or Kaltura and send to you.

What I’m saying here is: this whole process usually takes weeks or months. Or… we can just do it all in VR in an afternoon.

 

The new reality… of easy bake dreams

Tvori is an amazing tool to easily puppet objects and characters around in VR. You can record audio in directly, and export 4K videos, 360 videos, or animation data for all those old programs i mentioned above. The main reason I set out to write this blog post: was to promote Tvori. It offers an all-in-one easy pathway to making your own animatons in mere minutes. This amazing program runs about 20 bucks, and unlike the other (free) VR tools I’ll mention below – Tvori isn’t backed by a major corporation (*yet). I expect to be generating much more animation work for instructors with it, and hope to be advising you all on how to use it yourselves as you step into VR through your own office computers.

I’d say Tvori offers a level of animation comparable to an “animatic” – a movie industry term for quick and dirty approximations of what the final multi-million dollar film could look like. There’s a good chance animatics will be good enough for the bulk of concepts we wish to impart to students at the university level, with the added bonus that we can generate many of them in a single term. That said, maybe you’re curious what other creative tools are emerging in VR these days?

1) Whiteboard animations are a common request at Ecampus. Oculus Quill lets us draw and animate in this cartoon style in 3D (so it’s like our current 2D drawing tools, but we can move the camera around freely at any time, zoom-in endlessly,). This free tool for Oculus Rift users was updated last month to add a ton of new useful tricks.

We’ve already made fly-bys of 3D drawings in Google Tiltbrush, but we couldn’t actually animate the drawings directly (we just started recording, and moved our head through space). But both these programs are free and worth looking into.

2) In Oculus Medium, anyone can sculpt objects in the air at high resolution with weightless clay. If you own the Oculus Rift, this is an free and amazing tool for creating 3D objects. Now we can make things extremely fast and bring them into those old programs we’ve used for years.

Google Blocks is a similar free tool to quickly make solid low-resolution objects (it’s like Google Sketchup with VR ease and benefits). Upload them to Google Poly to share with the world (a service very similar to SketchFab or Microsoft’s Remix 3D). With these sculpting tools, and repositories of free creations, it’s a snap to gather the building blocks needed to start complicated animation projects. For example, we can bring any of these sculpted objects right into Tvori…

3) Final thought: you can use Google Earth VR to walk around any location on earth, while scaling up to Godzilla height or even zooming in and out from space. The multimedia team can record what you’re seeing and pointing at, along with your narration. While this isn’t a feature of the software (yet), we have the magic means to do it for you. (And we can also go back into Google Earth Studio to make a more polished and precise version of the path you traveled).

I hope this inspires you to go get a VR headset, come by our offices and try it out, or let us don the gear for you. We look forward to making your imagination a reality for students worldwide!

On Good Design

Posted on by | Leave a reply

Introduction

For those who work in higher education, it may not come as a surprise that the field of instructional design has grown in tandem with the expansion of online programs and courses. Evidence of this growth abounds. While the discipline of instructional design has expanded rapidly in recent years, the history of instructional design is not well known by those outside of the field.

This post will cover a brief history of instructional design with a particular emphasis on design: What influences design? How are design decisions made? How has the way we approached design changed over time? We’ll also consider how instructional designers actually design courses and the importance of course structure as an inclusive practice.

Instructional Design: Theory and History

Every instructional design curriculum teaches three general theories or theoretical frameworks for learning: behaviorism, cognitivism, and constructivism. While an instructional designer (ID) probably wouldn’t call herself a cognitivist or a behaviorist, for example, these theories influence instructional design and the way IDs approach the design process.

The field of instructional design is widely believed to have originated during World War II, when training videos like this one were created to prepare soldiers with the knowledge and skills they would need in battle. This form of audio-visual instruction, although embraced by the military, was not initially embraced by schools.

B.F. Skinner
“B.F. Skinner” Portrait Art Print
by Xiquid

In the 1950s, behaviorists, such as B.F. Skinner, dominated popular thought on how to teach and design instruction. For behaviorists, learning results in an observable change in behavior. The optimal design of a learning environment from a behaviorist perspective would be an environment that increases student motivation for learning, provides reinforcement for demonstrating learning, and removes distractions. Behaviorists are always designing for a specific response, and instruction is intended to teach discrete knowledge and skills. For behaviorists, motivation is critical, but only important to the extent that it elicits the desired behavior. 

Cognitivism was largely a response to behaviorism. Cognitivists emphasized the role of cognition and the mind; they acknowledged that, when designing learning environments, there is more to consider than the content to be learned. More than environmental factors and instructional components, the learners’ own readiness, or prior knowledge, along with their beliefs and attitudes, require consideration. Design, from a cognitivist approach, often emphasizes preparedness and self-awareness. Scaffolding learning and teaching study skills and time-management (metacognitive skills) are practices grounded in a cognitivist framework.

While cognitivists emphasize the learner experience, and in particular, acknowledge that learners’ existing knowledge and past histories influence their experience, the learner is still receiving information and acting on it–responding to carefully designed learning environments.

Constructivism, the most current of the three frameworks, on the other hand, emphasizes that the learner is constructing their own understanding of the world, not just responding to it. Learners are activity creating knowledge as they engage with the learning environment.

All–or nearly all–modern pedagogical approaches are influenced by these theoretical frameworks for learning.

Design Approaches

“A single course can be seen as a microcosm of theoretical frameworks, historical models, and value-laden judgements of pedagogical approaches“

Learning theories are important because they influence our design models, but by no means are learning theories the only factor guiding design decisions. In our daily work, IDs rely on many different tools and resources. Often, IDs will use multiple tools to make decisions and overcome design challenges. So, how do we accomplish this work in practice?

  1. We look to established learning outcomes. We talk about learning goals and activities with faculty. We ask questions to guide decision making about how to meet course learning outcomes through our course design.
  2. We look to research-based frameworks and pedagogical approaches such as universal design for learning (UDL), inclusive design, active learning, student-centered design, and many other models. These models may be influenced by learning theory, but they are more practical in nature.
  3. We look to human models. We often heed advice and follow the examples our more experienced peers.
  4. We look to our own past experiences and solutions that have worked in similar situations, and we apply what we learned to future situations.
  5. We make professional judgements; judgements rooted in our tacit knowledge of what we believe “good design” looks like. For better or for worse, we follow our intuition. Our gut.

Over time, one can see that instructional design has evolved from an emphasis on teaching discrete knowledge and skills that can be easily measured (behaviorism) to an emphasis on guiding unique learners to actively create their own understanding (constructivism). Design approaches, however, are not as straightforward as simply taking a theory and applying it to a learning situation or some course material. Instructional design is nuanced. It is art and science. A single course can be seen as a microcosm of theoretical frameworks, historical models, and value-laden judgements of pedagogical approaches–as well as value-laden judgements of disciplinary knowledge and its importance. But. That’s another blog post.

Design Structure to Meet Diverse Needs

“Meeting diverse needs, however, does not necessitate complexity in course design“

If learners are unique, if learning can’t be programmed, if learning environments must be adaptable, if learners are constructing their own knowledge, how is all of this accommodated in a course design?

Designing from a modern constructivist perspective, from the viewpoint that students have vastly different backgrounds, past experiences, and world-views, requires that many diverse needs be accommodated in a single course. Meeting diverse needs, however, does not necessitate complexity in course design. Meeting diverse needs means that we need to provide support, so that it is there for those who need it, but not distracting to those who don’t need it. Design needs to be intuitive and seamless for the user.

Recent research on inclusive practices in design and teaching identify structure as an inclusive practice. Design can be viewed as a way of applying, or ensuring, a course structure is present. In that way, working with an instructional designer will make your course more inclusive. But, I digress. Or, do I?

Sathy and Hogan contend, in their guide, that structure benefits all students, but some, particularly those from underrepresented groups, benefit disproportionately. Conversely, not enough structure, leaves too many students behind. Since many of the same students who benefit from additional course structure also succeed a lower rates, providing course structure may also help to close the achievement gap.

How are We Doing This?

The good news is that Ecampus is invested in creating courses that are designed–or structured–in a way that meets the needs of many different learners. Working with an Ecampus instructional designer will ensure that your course materials are clearly presented to your students. In fact, many of the resources we provide–course planning templates, rubrics, module outlines, consistent navigation in Canvas, course banners and other icons and visual cues–are intended to ensure that your students navigate your course materials and find what they need, when they need it.

References

Icons made by phatplus and Freepik from www.flaticon.com are licensed by CC 3.0 BY

Boling, E., Alangari, H., Hajdu, I. M., Guo, M., Gyabak, K., Khlaif, Z., . . . Techawitthayachinda, R. (2017). Core Judgments of Instructional Designers in Practice. Performance Improvement Quarterly, 30(3), 199-219. doi:10.1002/piq.21250

Eddy, S.L. and Hogan, K. A. (2017) “Getting Under the Hood: How and for Whom Does Increasing Course Structure Work?” CBE—Life Sciences Education. Retrieved from https://www.lifescied.org/doi/10.1187/cbe.14-03-0050

Sathy, V. and Hogan, K.A. (2019). “Want to Reach All of Your Students? Here’s How to Make Your Teaching More Inclusive: Advice Guide. Chronicle of Higher Education. Retrieved from https://www.chronicle.com/interactives/20190719_inclusive_teaching

Tanner, K.D. (2013) “Structure Matters: Twenty-One Teaching Strategies to Promote Student Engagement and Cultivate Classroom Equity,” CBE—Life Sciences Education. Retrieved from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3762997/

Report Reader Checklist

Posted on by | Leave a reply

""

Are you interested in reading about research in the field of online teaching and learning? Could you use some help in reading and digesting the results of various research reports in the field? Would you like to be able to identify the strengths and weakness of the study reports that you read? If you answered “yes” to one or more of these questions then you might be interested in the  Ecampus Research Unit’s new resource: the Report Reader Checklist.

The Report Reader Checklist includes a comprehensive set of criteria that offers you a guide to evaluate the quality and rigor of study reports. The checklist is intended to provide an overview of the foundational elements that should be included when reporting on the results of a study. You can apply each checklist criterion to a report to see whether that element has been included or not.

Here is an overview of the six areas of the checklist and the criterion in each area:

  1. Context: Does the report describe the larger purpose of the study? Does it explain the history or theoretical framework? Does the report include research goals and suggestions for further research?
  2. Methodology: Does the report have a methodology section? Is it clear how data were collected and analyzed? If the study used statistics, were they named? If coding was used, was the procedure described?
  3. Sample: Are the study participants described in detail? Is it clear how participants were recruited? Does the sample represent an appropriate level of diversity? Are subgroups appropriately identified?
  4. Reporting Results: Are all numbers in the report easy to comprehend? Is the “N” provided? Does the report identify missing data? Is it clear where study findings fit with the study’s purpose? Do data visualizations enhance your understanding of the results?
  5. Transparency: Are raw data included in the report? Are instruments or study protocols provided in the report? Are the authors clear about any conflicts of interest? Is the discussion rooted in data results?
  6. Reader Experience: Does the report use language that is easy to understand? Is the report ADA accessible? Does it include a summary or abstract? Is the study an appropriate length?

There are no “points” or “weighting” within the checklist, but if you find one area (e.g., “Context” or “Methodology”) that is missing several criteria within a report, that would indicate that a report is weaker in that particular area.

You can download a one-page PDF of the checklist or visit our supplementary website that provides more details on each of the criterion. Further, the site includes sample reports for each criterion so that you can learn more about areas that you are unfamiliar with.

We hope you find this resource useful for reading and evaluating reports in the field. We also hope it helps you make data-driven decisions for your work.

About the Oregon State University Ecampus Research Unit: The Oregon State University Ecampus Research Unit makes research actionable through the creation of evidence-based resources related to effective online teaching, learning and program administration. The OSU Ecampus Research Unit is part of Oregon State Ecampus, the university’s top-ranked online education provider. Learn more at ecampus.oregonstate.edu/research.

 

Rubrics Markers of Quality –Tips and Best Practices (Part 2)

Posted on by | Leave a reply

There are many benefits to using rubrics for both instructors and students, as discussed in Rubrics Markers of Quality Part 1 – Unlock the Benefits. Effective rubrics serve as a tool to foster excellence in teaching and learning, so let’s take a look at some best practices and tips to get you started.

Best Practices

Alignment

Rubrics should articulate a clear connection between how students demonstrate learning and the (CLO) Course Learning Outcomes. Solely scoring gateway criteria, the minimum expectations for a task, (e.g., word count, number of discussion responses) can be alluring. Consider a rubric design to move past minimum expectations and assess what students should be able to do after completing a task.

Detailed, Measurable, and Observable

Clear and specific rubrics have the potential to communicate to how to demonstrate learning, how performance evaluation measures, and markers of excellence. The details provide students with a tool to self-assess their progress and level up their performance autonomously.

Language Use

Rubrics create the opportunity to foster an inclusive learning environment. Application of clear and consistent language takes into consideration a diverse student composition. Online students hail from around the world and speak various native languages. Learners may interpret the meaning of different words differently. Use simple terms with specific and detailed descriptions. Doing so creates space for students to focus on learning instead of decoding expectations. Additionally, consider the application of parallel language consistently. The use of similar language (e.g. demonstrates, mostly demonstrates, and doesn’t demonstrate) across each criterion can be helpful to differentiate between each performance level.

Tips of the Trade!

Suitability

Consider the instructional aim, learning outcomes, and the purpose of a task when choosing the best rubric for your course.

  • Analytic Rubrics: The hallmark design of an analytic rubric evaluates performance criteria separately. Characteristically this rubric’s structure is a grid, and evaluation of performance scores are on a continuum of levels. Analytic rubrics are detailed, specific, measurable, and observable. Therefore, this rubric type is an excellent tool for formative feedback and assessment of learning outcomes.
  • Holistic Rubrics: Holistic rubrics evaluate criteria together in one general description for each performance level. Ideally, this rubric design evaluates the overall quality of a task.  Consider the application of a holistic rubric can when an exact answer isn’t needed, when deviation or errors are allowed, and for interpretive/exploratory activities.
  • General Rubrics: Generalized rubrics can be leveraged to assess multiple tasks that have the same learning outcomes (e.g., reflection paper, journal). Performance dimensions focus solely on outcomes versus discrete task features.

Explicit Expectations

Demystifying expectations can be challenging.  Consider articulating performance expectations in the task description before deploying a learning task. Refrain from using rubrics as a standalone vehicle to communicate expectations. Unfortunately, students may miss the rubric all together and fail to meet expectations. Secondly, make the implicit explicit! Be transparent. Provide students with all the information and tools they need to be successful from the outset.

Iterate

A continuous improvement process is a key to developing high-quality assessment rubrics. Consider multiple tests and revisions of the rubric. There are several strategies for testing a rubric. 1) Consider asking students, teaching assistants, or professional colleagues to score a range of work samples with a rubric. 2) Integrate opportunities for students to conduct self-assessments. 3) Consider assessing a task with the same rubric between course sections and academic terms. Reflect on how effectively and accurately the rubric performed, after testing is complete. Revise and redeploy as needed.

Customize

Save some time, and don’t reinvent the wheel. Leverage existing samples and templates. Keep in mind that existing resources weren’t designed with your course in mind. Customization will be needed to ensure the accuracy and effectiveness of the rubric.

Are you interested in learning more about rubrics and how they can enrich your course? Your Instructional Designer can help you craft effective rubrics that will be the best fit for your unique course.

References

Additional Resources

The Basics
Best Practices
Creating and Designing Rubrics

Ten Course Design Strategies to Minimize Cheating

Posted on by | 2 Replies

One of the most common questions I get as an Instructional Designer is, “How do I prevent cheating in my online course?” Instructors are looking for detection strategies and often punitive measures to catch, report, and punish academic cheaters. Their concerns are understandable—searching Google for the phrase “take my test for me,” returns pages and pages of results from services with names like “Online Class Hero” and “Noneedtostudy.com” that promise to use “American Experts” to help pass your course with “flying grades.” 1 But by focusing only on what detection measures we can implement and the means and methods by which students are cheating, we are asking the wrong questions. Instead let’s consider what we can do to understand why students cheat, and how careful course and assessment design might reduce their motivation to do so.

A new study published in Computers & Education identified five specified themes in analyzing the reasons students provided when seeking help from contract cheating services (Amigud & Lancaster, 2019):

  • Academic Aptitude – “Please teach me how to write an essay.”
  • Perseverance – “I can’t look at it anymore.”
  • Personal Issues – “I have such a bad migraine.”
  • Competing Objectives – “I work so I don’t have time.”
  • Self-Discipline – “I procrastinated until today.”

Their results showed that students don’t begin a course with the intention of academic misconduct. Rather, they reach a point, often after initially attempting the work, when the perception of pressures, lack of skills, or lack of resources removes their will to complete the course themselves. Online students may be more likely to have external obligations and involvement in non-academic activities. According to a 2016 study, a significant majority of online students are often juggling other obligations, including raising children and working while earning their degrees (Clinefelter & Aslanian, 2016).

While issues with cheating are never going to be completely eliminated, several strategies have emerged in recent research that focus on reducing cheating from a lens of design rather than one of punishment. Here are ten of my favorite approaches that speak to the justifications identified by students that led to cheating:

  1. Make sure that students are aware of academic support services (Yu, Glanzer, Johnson, Sriram, & Moore, 2018). Oregon State, like many universities, offers writing help, subject-area tutors and for Ecampus students, a Student Success team that can help identify resources and provide coaching on academic skills. Encourage students, leading up to exams or big assessment projects, to reach out during online office hours or via email if they feel they need assistance.
  2. Have students create study guides as a precursor assignment to an exam—perhaps using online tools to create mindmaps or flashcards. Students who are better prepared for assessments have a reduced incentive to cheat. Study guides can be a non-graded activity, like a game or practice quiz, or provided as a learning resource.
  3. Ensure that students understand the benefits of producing their own work and that the assessment is designed to help them develop and demonstrate subject knowledge (Lancaster & Clarke, 2015). Clarify for students the relevance of a particular assessment and how it relates to the weekly and larger course learning outcomes.
  4. Provide examples of work that meets your expectations along with specific evaluation criteria. Students need to understand how they are being graded and be able to judge the quality of their own work. A student feeling in the dark about what is expected from them may be more likely to turn to outside help.
  5. Provide students with opportunities throughout the course to participate in activities, such as discussions and assignments, that will prepare them for summative assessments (Morris, 2018).
  6. Allow students to use external sources of information while taking tests. Assessments in which students are allowed to leverage the materials they have learned from to construct a response do a better job of assessing higher order learning. Memorizing and repeating information is rarely what we hope students to achieve at the end of instruction.
  7. Introduce alternative forms of assessment. Creative instructors can design learning activities that require students to develop a deeper understanding and take on more challenging assignments. Examples of these include recorded presentations, debates, case studies, portfolios, and research projects.
  8. Rather than a large summative exam at the end of a course, focus on more frequent smaller, formative assessments (Lancaster & Clarke, 2015). Provide students with an ongoing opportunity to demonstrate their knowledge without the pressure introduced by a final exam that accounts for a substantial portion of their grade.
  9. Create a course environment that is safe to make and learn from mistakes. Build into a course non-graded activities in which students can practice the skills they will need to demonstrate during an exam.
  10. Build a relationship with students. When instructors are responsive to student questions, provide substantive feedback throughout a course and find other ways to interact with students — they are less likely to cheat. It matters if students believe an instructor cares about them (Bluestein, 2015).

No single strategy is guaranteed to immunize your course against the possibility that a student will use some form of cheating. Almost any type of assignment can be purchased quickly online. The goal of any assessment should be to ensure that students have met the learning outcomes—not to see if we can catch them cheating. Instead, focus on understanding pressures a student might face to succeed in a course, and the obstacles they could encounter in doing so. Work hard to connect with your students during course delivery and humanize the experience of learning online. Thoughtful design strategies, those that prioritize supporting student academic progress, can alleviate the conditions that lead to academic integrity issues.

1 This search was suggested by an article published in the New England Board of Higher Education on cheating in online programs. (Berkey & Halfond, 2015)

References

Amigud, A., & Lancaster, T. (2019). 246 reasons to cheat: An analysis of students’ reasons for seeking to outsource academic work. Computers & Education, 134, 98–107. https://doi.org/10.1016/j.compedu.2019.01.017

Berkey, D., & Halfond, J. (2015). Cheating, student authentication and proctoring in online programs.

Bluestein, S. A. (2015). Connecting Student-Faculty Interaction to Academic Dishonesty. Community College Journal of Research and Practice, 39(2), 179–191. https://doi.org/10.1080/10668926.2013.848176

Clinefelter, D. D. L., & Aslanian, C. B. (2016). Comprehensive Data on Demands and Preferences. 60.

Lancaster, T., & Clarke, R. (2015). Contract Cheating: The Outsourcing of Assessed Student Work. In T. A. Bretag (Ed.), Handbook of Academic Integrity (pp. 1–14). https://doi.org/10.1007/978-981-287-079-7_17-1

Morris, E. J. (2018). Academic integrity matters: five considerations for addressing contract cheating. International Journal for Educational Integrity, 14(1), 15. https://doi.org/10.1007/s40979-018-0038-5

Yu, H., Glanzer, P. L., Johnson, B. R., Sriram, R., & Moore, B. (2018). Why College Students Cheat: A Conceptual Model of Five Factors. The Review of Higher Education, 41(4), 549–576. https://doi.org/10.1353/rhe.2018.0025

13 pieces of advice from unsuccessful online students & How instructors can help

Posted on by | Leave a reply

“As a stranger give it welcome” – Shakespeare

Students need tactics for when they encounter strange people or strange ideas.(Wilson, 2018) If you think of a first time online student, this is very true as they are entering a new learning environment, likely extremely different from their previous educational experiences. Welcoming that strange experience should include a little bit of information gathering. Look for positive and negatives so that you can decide for yourself how you view it, most of all, have an open mind.

To help potential online students make decisions, and hopefully be more successful should they chose to take an online course, Marie Fetzner asked unsuccessful online students; “What advice would you give to students who are considering registering for an online course?”

Their top 13 responses:

  1. Stay up with the course activities—don’t get behind
  2. Use good time management skills
  3. Use good organizational skills
  4. Set aside specific times during each week for your online class
  5. Know how to get technical help
  6. A lot of online writing is required
  7. There is a lot of reading in the textbook and in online discussions—be prepared
  8. Regular online communications are needed
  9. Ask the professor if you have questions
  10. Carefully read the course syllabus
  11. Be sure you understand the requirements of the online course discussions
  12. Understand how much each online activity is worth toward your grade
  13. Go to the online student orientation, if possible

This needs to raise the question, how can we better help our students? There are obviously struggling students and we want our students to be successful. So, what can we do?

  1. Reach out to students who seem to be lagging behind. A quick email is sometimes all it takes to open up that line of communication between you and the student.
  2. Provide approximate times for course materials and activities. Students can use this to better plan for the requirements that week.
  3. Keep your course organized so students can spend more time with the content instead of search for the content.
  4. Remind students about where to access help and support services.
  5. Develop a Q&A discussion board for student questions about the course. Often, more than one student has the same question and often other students might already know the answer. Have this be something you check daily to answer questions quickly so students can continue with their learning.
  6. Use rubrics for grading. By giving the students rubrics, they will know what is expected, you will get responses closer to your expectations, and it makes grading easier!

Welcome these ideas as you would a new experience. Give it a little try, jump right in, confer with colleagues, or chose your own path. Know that as an instructor or developer for an online course, you have the ability to help your students be successful!

References

Fetzner, Marie. (2013). What Do Unsuccessful Online Students Want Us to Know? Journal of Asynchronous Learning Networks, 17(1), 13-27.

Wilson, J. (2018). “As a stranger give it welcome”: Shakespeare’s Advice for First-Year College Students. Change, 50(5), 60.