A trigger warning in a college course alerts students to the presence of material that may provoke a traumatic response. It might sound something like this:
As a reminder, this week’s reading contains an account of suicide. Please prepare accordingly and employ self‐care throughout the in‐class discussion. One self‐care option is to make use of the Monsour Counseling Center (Sample Syllabus Language, Claremont Colleges CTL).
The usage of trigger warnings has been debated by faculty, administration, students, and researchers, and after spending time reading the arguments and research, I am uncertain whether I would recommend them to an instructor who asked for my advice on the matter. So, rather than advocating for or against trigger warnings, this guide presents several resources for instructors exploring their usage.
Among my instructional design colleagues, trigger warnings have some obvious appeal, perhaps because they dovetail well with the UDL checkpoints that direct us to “facilitate personal coping skills and strategies” and “minimize threats and distractions” in our courses, but their utility is contested. The American Association of University Professors (AAUP), in their report “On Trigger Warnings” outlines some of the issues. Trigger warnings might stifle free and open discussion of difficult topics, prejudice students against engaging with instructional materials critically or encourage avoidance, and interfere with academic freedom. However, in “Teaching with Trauma: Trigger Warnings, Feminism, and Disability Pedagogy,” Carter (2019) asserts that the AAUP misunderstands the goal of trigger warnings and who they’re for – they aren’t intended to protect students in general from adverse learning experiences but rather to provide students who experience trauma and anxiety with the means to engage – in other words, trigger warnings are a question of access and accommodation. Indeed, students themselves are requesting trigger warnings or complaining when they’re not used, as found by the National Coalition Against Censorship in its survey of 800 faculty.
What do we know from experimental research about the effects of trigger warnings? Jones et al. (2020) in their article “Helping or Harming? The Effect of Trigger Warnings on Individuals With Trauma Histories” describe how they presented reading passages that either did or did not contain trigger warnings to over 400 non-students who self-reported trauma. The trigger warnings did not reduce anxiety and instead seemed to cause participants to view traumatic life experiences as even more central to their life stories. Because trauma survivors who ascribe more importance to their trauma are at greater risk for PTSD, this research would suggest that trigger warnings are harming the students we most want to help.
Bentley (2017) in her article “Trigger warnings and the student experience” investigates the reactions of about 60 undergraduates taking 2nd and 3rd year courses that included trigger warnings related to the topics of war and terrorism. Notably, students who didn’t self-report a mental health condition actually experienced more anxiety. The 3rd year students, perhaps because they were further along in their degree, were more likely to perceive trigger warnings as an affront to their self-competence as learners. On the other hand, some students found the warnings helped them explore difficult topics more freely, because they were given time to frame their thoughts and feelings within an academic, rather than a reactionary or personal, context. Other students found the warnings useful because, without them, the triggering nature of course topics would not have been immediately obvious.
For instructors looking for practical tips on how, when, and where to employ a trigger warning, the University of Michigan has prepared a comprehensive “Introduction to Content Warnings and Trigger Warnings”. While content featuring sexual assault may be an obvious trigger, this guide lists 20 other potential triggers that instructors might not have considered, such as classism or fat phobia, and for which students might appreciate a warning. The guide also suggests that, since what triggers others can be hard to predict, instructors should consider inviting students to request which specific types of content they’d like to be flagged. Rather than infantilizing students, the guide argues, trigger warnings empower students to prepare to engage with difficult topics, because with the knowledge of potential triggers, students can work with a therapist or schedule more time to engage with materials, thereby making them more responsible for their learning, not less. The guide also details options for implementation, like flagging individual learning materials in the course schedule by triggering topic, or by issuing blanket warnings in the course description for a course that is largely composed of potentially triggering material. This is a must-read for anyone who has decided to implement trigger warnings.
At a recent faculty professional development workshop series, I became aware of faculty’s concerns about addressing the learning needs of students from different cultural and linguistic backgrounds. Students with multilingual and multicultural identities are oftentimes perceived as deficient (Almon, 2014; Flores & Rosa, 2015) and might feel they hold an outsider status (Merryfield, 2000). In my personal experience navigating multiple identities that intersect culture and language, and in my work supporting faculty in their learning design and instructional decisions, I began examining ways in which blended and online learning spaces can offer more welcoming opportunities for students. One of these ways is using a cultural lens and mindset towards inclusive learning design.
Culturally Responsive Approaches
There have been several culturally responsive approaches to teaching and learning. By and large these approaches advocate for the recognition of students’ cultural backgrounds as critical to their learning success (Gay, 2013; Ladson-Bilings, 1994). In fact, a culturally responsive pedagogy (CRP) aims to promote the integration of students’ culture to support their learning experiences. In blended and online learning, this pedagogy can create an environment that “acknowledges, celebrates, and builds upon the cultural capital that learners and teachers bring to the online classroom” (Woodley, Hernandez, Parra, & Nagash, 2017, p.1).
For students whose first language is not English, we first should focus on their strengths and not their deficiencies. These students bring their cultural backgrounds, values, experiences, and language diversity with them to the online learning environment. It is important to recognize that culture is central to teaching and learning; therefore, advancing online and blended learning design should be grounded on dimensions for cultural sensitivity where students’ diverse identities, cultures, languages, and backgrounds are seen through an asset-based lens. This means, recognizing the value in the cultural backgrounds, experiences, and languages of students; and embracing these students’ traits as assets. This asset-base approach can be the first step in developing a mindset for designing and teaching in ways that promote social, academic, and emotional learning for these and ALL students.
Culturally responsive approaches have been mapped out to the three principles of Universal Design for Learning to offer (1) multiple means of engagement, (2) multiple means of representation, and (3) multiple means of action and expression (UDL, n.d.). UDL and CRP can help instructors amplify the opportunities for students from different cultural backgrounds to demonstrate their knowledge when given strategies that incorporate multiple perspectives, experiences, connections to the real world, and choices (Bass & Lawrence-Riddell, 2020; Kieran & Anderson, 2018)
The connection of UDL and CRP offers consideration to inform instructional design choices. Yet, these considerations appear to be adds-on to the design of the learning experience. How can we expand the UDL and CRP connection to embrace a mindset to move towards an inclusive learning design where the cultural and linguistic traits of students are seen from an asset-based perspective? A few dimensions from research and praxis would get us started to help achieve this goal.
Dimensions for Learning Design
The following dimensions for learning design, that expand the connections between UDL and CRP, should be considered whenever possible in the design of blended or online learning experiences. Following are the six dimensions.
Instructor’s reflection
Visual design
Linguistic domain
Content
Interaction
Technology
Identity and Experience
Instructor identity and experience relates to the practice reflection –inner analysis to reveal assumptions about teaching and learning (Jaramillo Cherrez & Jin, 2020). Through these reflections, instructors can identify ways to humanize the learning experience. Instructional designers (IDs) can help instructors engage in a (self) dialogue to explore how the instructor’s identity informs or impacts their teaching and instructional decisions, how they respond to students’ cultural differences and embrace them as strengths, and how instructors could also learn from students.
Design
The visual design of the course and learning materials can have a profound impact on students’ learning experience (Hedberg & Brown, 2002). For students whose first language is other than English in particular, it is important to be aware that these students may come from different cultures and social groups, and thus, visual representations may have positive or negative consequences to their success in the course. Visuals should be carefully chosen because the variety of images, colors, and symbols may affect the message students receive in the class. When using images from pop culture, it is helpful to add context to give more clarity to the instructional purpose. The visual design also relates to the readability of the content and how it is presented and structured. Asking a colleague or friend to read the instructions and descriptions of assignments can help clarify expectations and requirements for students. Bear in mind that what is clear to one is not always clear to others, especially when using complex sentences and terminology of a discipline.
Linguistic Variability
Many students might have a first language different from English. Also, keep in mind that different cultures may have different ways of writing, usually influenced by rhetorical and social contexts (Almuhailib, 2019). There may also be linguistic and cognitive differences in the way that students interpret the information given to them. For some cultures, direct descriptions are fine, whereas for others the context is important before addressing a specific perspective. Some cultures may characterize themselves for being more individualistic and others more holistic, and students, including those whose first language is other than English, can find themselves moving along that continuum. In designing culturally responsive blended or online courses, language matters because of the transactional distance characteristic of asynchronous spaces. Many students may already be pressured to demonstrate “good”, “academic”, “professional” English. One way to be aware of linguistic diversity is to be more explicit with instructions. For example, indicate clearly the use of naming conventions, abbreviations, acronyms, and descriptors in activities and assignments.
Content
The fourth consideration is content. The main suggestion is to try to diversify the curriculum with resources from around the world (e.g., content from scholars from diverse cultures and linguistic backgrounds). Allow students to see themselves represented in the materials. Create activities and assignments that help students explore the concepts in connection to their own backgrounds and communities(e.g., linguistic, cultural) and experiences, and that allow students to move from low to high cognitive tasks (e.g., staged projects). Yet, diversifying the curriculum goes far from bringing into the course content perspectives that are commonly ignored. It involves explicit acknowledgement of the value of the different perspectives and modes of knowledge.
Interaction
Interaction also can benefit from a culturally responsive mindset in that instructors can vary the modes of interaction by using audio/video communication(e.g., assignment feedback, DB, announcements). It is also important to guide and scaffold group activities with resources such as guidelines, group contracts, teamwork guidelines, group rapport activities, conflict resolution resources). Particularly for teamwork, instructors can build group activities early in the course to promote collaborative learning. For online discussions, instructors could allow students to select the tools that they feel more comfortable with using, bearing in mind that many students from different cultural backgrounds might not be familiar or have experience participating in discussion activities. Another suggestion is to promote student-led discussions to help students move from the individual task to the group task. This will allow to vary the cognitive demands that can foster meaningful knowledge construction and organization while also addressing different audiences, styles of writing and analysis, and communication modes.
Technology
It is important to recognize that technology is not neutral. Clearly, it is important to select tools and evaluate them for intended and unintended consequences for students, such as the cost, the technical support, the pedagogical affordances, and the availability in other geographic areas. It will be helpful to consider the different levels of technology skills that students may have and plan on developing guidelines and technical resources (e.g., links to providers, manuals, accessibility and privacy policies) that can help students. Additionally, in considering digital tools it is important to review whether the affordances the tools offer are available to all students, in the different browsers and devices (e.g., tablets, smart phones, browsers). In using digital tools, careful attention should be given to the kinds of data that the tools require students and instructors to share. It is important to read carefully the terms of use, data privacy, and the information that is being collected as a way to understand how the users can trust the tools and their procedures for sharing or not with others the data collected.
These dimensions underscore the need to approach learning design with a mindset that not only acknowledges student multilingual and multicultural identities, but also catalyzes these identities to help students be valued and successful. I consider these dimensions in my instructional design work, and I would like to invite you to consider them next time you design an online or blended learning experience.
Sources
Almon, C. (2015). College persistence and engagement in light of a mature English language learner (ELL) student’s voice. Community College Journal of Research and Practice, 39(5), 461-472.
Almuhailib, B. (2019). Analyzing Cross-Cultural Writing Differences using Contrastive Rhetoric: A Critical Review. Advances in Language and Literary Studies, 10(2), 102-106.
Bass, G., & Lawrence-Riddell, M. (2020). Culturally Responsive Teaching and UDL. Faculty Focus. https://www.facultyfocus.com/articles/equality-inclusion-and-diversity/culturally-responsive-teaching-and-udl/
Dougherty, E. (2012). Assignments matter: Making the connections that help students meet standards. Alexandria, VA: ASCD.
Kieran, L., & Anderson, C. (2019). Connecting universal design for learning with culturally responsive teaching. Education and Urban Society, 51(9), 1202-1216.
Gay, G. (2013). Teaching to and through cultural diversity. Curriculum Inquiry, 43(1), 48-70.
Hedberg, J. G., & Brown, I. (2002). Understanding cross-cultural meaning through visual media. Educational Media International, 39(1), 23-30.
Ladson-Billings, G. (1994). What we can learn from multicultural education research. Educational Leadership, 51(8), 22-26.
Merryfield, M. M. (2000). Why aren’t teachers being prepared to teach for diversity, equity, and global interconnectedness? A study of lived experiences in the making of multicultural and global educators. Teaching and Teacher Education, 16(4), 429-443.
Flores, N., & Rosa, J. (2015). Undoing appropriateness: Raciolinguistic ideologies and language diversity in education. Harvard Educational Review, 85(2), 149-171.
Reflection assignments as an active learning strategy are commonly seen in humanities courses. The purpose of this writing is to share an example of how simple reflection activities can make a huge impact in two math courses.
MTH 251 Differential Calculus covers five units, with one exam for each unit, counting 14% of the final grade. Before students attempt to take the unit exam, they are assigned to read textbook readings, watch instructor-created lecture videos, work on Canvas-based homework assignment and Adaptive Learning based practice assignments in Knewton Lab online platform. After assignment due date expires, students are assigned to complete a weekly written homework reflection. The weekly homework and the weekly homework reflection together count for 14% of final grade in this course, weighing the same as each of the unit exams.
MTH 341 Linear Algebra I has ten weekly modules. Each week, students read textbook assigned readings, watch lecture videos created by the instructor (Dr. ), complete post-reading questions in quiz format, work on graded group discussion questions to solve math problems in small groups, complete written homework individually, and in the following week, complete a written homework response activity individually in discussion format.
The written homework reflection in MATH 251 and the written homework response in MATH 341 are both reflection activities designed to optimize student learning success, through comparing their own homework solutions with answer keys and evaluate whether they did it correctly or incorrectly and analyze where they did it wrong and how to get it right. The purpose of such weekly reflection is to help students develop meta-cognitive skills related to their learning. By looking back at students’ own work and learning from their mistakes, they develop an understanding of what is the proper way to solve a problem and what is not the proper way for solving a particular math problem. It also prompts students to plan for proper action in the future and exercises students’ executive functioning skills (CAST, 2018).
Here is what the instructions for the weekly reflection look like: 1. First answer the weekly prompt: Reflecting on the Unit 1 module, which topics did you struggle with the most? 2. Download the written homework solutions PDF: (Solution for each written homework in pdf format is attached here.) 3. Look over the solutions and compare to your submitted homework. Look for any problems where your solution differs from the posted solution.
If your solutions had one or more incorrect problems then in the discussion board please discuss the following:
why you struggled with certain problems
why each solution makes sense now
what your misunderstanding was
what will you do in the future when solving problems similar to these?
what strategies will help you?
what did you learn by making a mistake?
what did you learn from looking at the solutions?
If you are still confused about a problem, ask a question. DO NOT simply list which problems you got wrong.
If your solutions are all correct then in the discussion board please discuss the problem that you found the most challenging. Describe what specific tasks helped you to complete that problem. Be as detailed as you can about your solution process.
Students not only posted their own reflections, but they also comment on or answer other students’ reflections as well. Additionally, the instructor and the four TAs in the course responded actively to students’ reflections, which makes the reflection more valuable since students get encouragement, praises, or corrections from the instructor and teaching assistants. Again, feedback from experts is critical in the success of a reflection activity (Vandenbussche, 2018)
Image 1: How reflection usually looks like and How reflection should look like (Image Source)
Many students were reflecting on what they did wrong and asked for help. Some were reflecting on their time management in completing the homework assignments. And we were glad to see students completing homework, evaluating their own work, analyzing where they did wrong, and planning for future improvement. Overall, the purpose of this assignment is accomplished!
A great benefit that comes from these weekly reflection activities is increased or sustained homework completion rate. For MTH 251 winter 2021 week 1 to week 7, over 85% of students completed the weekly homework and the reflection activity on average. For MTH 341 Fall 20 week 1 to week 7, over 90% of students on average completed the weekly homework and the reflection assignments. All math teachers love to see their students practice with homework assignments before they attempt to take the quizzes or exams! And evidence-based research tells us that deliberate practice with targeted feedback promotes mastery learning (Ambrose et al., 2010).
So, if it works in math courses, it will work in Chemistry, Biology, Physics, Engineering and other STEM courses too! If you’re interested in implementing this technique in your teaching and have questions about setting it up, feel free to contact us. We’d love to help you figure out the easiest way to set it up in your course.
References
Ambrose, S.A., Bridges, M.W., DiPietro, M., Lovettt, M.C. , Norman, M.K., & The Eberly Center for Teaching Excellence at Carnegie Mellon University. (2010). How learning works: Seven research-based principles for smart teaching. San Francisco, CA: Jossey-Bass
Instructors and course designers often use quizzes or forms for assessment, retrieval practice, self-checks, or collecting information from students. Did you know that Qualtrics surveys can take your interaction game to an even higher level of sophistication?
Qualtrics surveys can easily be linked to or embedded in a page in your Learning Management System. They can also be added as an assignment through the LTI integration.
The LTI integration has recently become an available feature for Oregon State University Canvas users. The integration links the survey to the student’s LMS account and is useful for awarding points automatically for completing the survey. In addition, several types of questions can be scored; thus, a survey can be used as a quiz and the integration tool will send the points to the gradebook.
If your LMS doesn’t have a Qualtrics LTI integration, or you don’t want to go through all the steps of setting it up, you can still use Qualtrics activities, but you will have to add any points manually in your gradebook.
Ideas for Qualtrics activities
Here are a few ways to use a Qualtrics survey:
Self-check activity / formative assessment / quiz: design a survey to increase active learning or assess content. Qualtrics can be your tool of choice because:
It’s more versatile than a quiz or Google form (e.g. more types of questions, complex branching possible based on answer).
It can be customized with different colors, fonts, and backgrounds.
The instructor can access student answers and use this information to provide individualized support or improve course materials.
Class pulse: Send a survey during the term to ask students how they are doing.
Suggestion box: Have a permanent page in your course where students can submit suggestions.
Voting ballot / poll: Create a survey to allow students to vote on a topic, favorite presentation, meeting time, etc. or to answer a poll.
Topic selection tool: Provide an easy way for students to claim their topic through a survey that eliminates an option once it’s chosen.
Muddiest point survey: Gather students’ input on the week’s materials: which concepts were unclear? Which information was particularly compelling?
Team member evaluation: In group work, it can be a good idea to have students evaluate their team members, to increase accountability and make sure that everyone is pulling their weight. You can create a survey asking students to rate their peers on specific criteria and provide comments on performance.
How to create a survey
Creating a survey in Qualtrics is very straightforward. Log into your account and create a new project. You can choose from a variety of question types, including multiple choice, ranking, slider, matrix, etc. Make sure to check which questions are accessible to screen-reading programs. If you’d like to track or manage the time a student spends on a page, you can use a timing question.
For Oregon State University users, the default look is the OSU theme. Through the Look and Feel menu section, you can choose a different theme or customize the layout, style, background, colors and text size to fit your needs and your course aesthetic.
How to link a survey
Linking to a survey is the easiest way to include it in your course. In your survey, go to Distributions and choose the Anonymous link. If you need the student’s identification information, make sure to add a question asking for their name or email.
How to embed a survey
Embedding a survey instead of linking it can make for a smoother learning experience by integrating the questions with other learning material on that page. To embed a survey on a page, use a simple iframe like this: <iframe src=”insert survey link here” width=”1000px” height=”500px”></iframe> and adjust the dimensions or style it as desired.
How to integrate a survey via LTI
Integrating via LTI is a bit more complex and will depend on your LMS and your organization’s settings. For Oregon State University users, instructions are provided in this article: Use Qualtrics in Canvas.
Conclusion
Qualtrics is a useful tool for adding more interactivity into your course. Setting up the surveys can be very simple or more involved depending on the task. Watch out for future posts in which we will give examples and details on how to design and create some of the more complex types of Qualtrics activities.
This post was written in collaboration by Deborah Mundorff and Dana Simionescu.
This post is Part I of a two-part series on video selection and use in online courses. Part I provides the reasoning behind understanding course videos selection by course developers as a curatorial process. Part II will explore video curation in practice in course development and provide a course design perspective on video presentation and management issues.
Recent Video Use Trends
In September of 2020 the enterprise video company Kaltura Inc. conducted its seventh annual State of Video in Education 2020 report. The report included responses from across the education system spectrum with higher education institutions making up 53% of all respondents (Figure 1.).
This report described how remote teaching-driven course changes impacted video adoption and use in education. Remote teaching and learning was the most common use of video (83% of respondents). Lecture captured as video was used by 69% of the responding institutions.
The executive summary identified a number of key insights and trends related to changes in video use in education. A select few can be seen below:
Use of video for remote teaching and learning grew by 28% over 2019.
Video use is viewed as positive. Respondents (84%) saw video as having a positive impact on student satisfaction, 73% seeing video increase student achievements and 76% believe it increased instructor satisfaction.
Students as creators of video increased by 13% from 2019 to 2020.
In higher education there was rising video use for remote teaching, lecture capture, and flipping the classroom.
Actual growth in the use of video for remote teaching and learning grew by 28%.
A majority of respondents (68%) want to continue to blend traditional teaching with today’s virtual innovations; such as video.
In some ways this is not surprising. This past year forced many instructors in higher education to convert face-to-face courses to remote instruction. Much of that transition was accomplished with synchronous sessions via ZOOM or some other video conferencing program. Live video conference sessions, if recorded, also served as a support resource for students. In response to the challenges of the past year both live and recorded video were adopted to make remote learning doable. Fully online courses do not have this live element as they are asynchronous and did not have to adapt in this way.
In asynchronous courses at Oregon State University our Ecampus course developers utilize video differently. Video is as a key media element in delivering course content to learners, promoting faculty presence, and to build depth into projects and assignments. Video content may be produced internally by course developers (e.g., instructors) and used in courses via an enterprise video system (e.g., Kaltura). Video content may also be sourced from external video-based social media sites (e.g., YouTube and Vimeo) or educational and commercial collections (e.g., Kanopy or Amazon) and via syndicated video sources (e.g., podcasts and Twitter).
Given the plethora of video available and a trend toward increased video integration into instruction the challenge to course developers is the selecting, managing, and presenting video content to support and compliment course learning outcomes. Ultimately this also becomes a course design challenge for instructional designers who must adapt to manage the integration of increasing levels of video in the course in a way that makes sense from a pedagogical perspective as well as visual design aesthetic.
Course Developers as Media Curators
What is a Curator?
The growing value of video in the experience of a course suggests that course developers (e.g., instructors) consider a new way of thinking about how video is selected, managed and presented. In essence, I am suggesting that for a given course the course developer serves as a curator of video content.
But what is curator? Should a course developer really think like a curator? How might curated media shape course development and instructional design?
In order to explore this notion of course developers as media curators a bit more I would like to share the definition of what a curator is from the American Alliance of Museum (AAM) Curators Committee (2009). The preamble to the curator core competencies of a curator defined the term curator as:
Curators are highly knowledgeable, experienced, or educated
in a disciplinerelevant to the museum’s purpose or mission.
Curators are further described as having nine core competencies and related applied skills. The competencies are:
Collection planning Scholary Research Exhibition Development
Collecting Object Research Education
Collection Care Applied Research Outreach & Advocacy
In Figure 2. we see these same foundational roles expressed by the AAM coupled with a definition of curator and description of the work of a curator.Also included is the domain of the work. Those domains are preservation, research, and communication. The global context of curation is, in this definition, a museum. The more discrete context is the exhibition, or exhibit application. Yet it is all part of a curator’s work.
What we see in this definition in Figure 2. is the premise that curators select, gather, care for, and prepare presentations of single items that in aggregate make up a curated collection. That collection becomes a resource and object of education, outreach, advocacy and presentation.
This makes the act of curatorship a scholarly and creative practice that is deeply intentional and based upon the definitional parameters of the organization doing the work.
Course Developers – Curators of Video Collections
Now let us think about what an online course developer is and what they do. At Ecampus course developers collaborate with instructional designers to plan an online course. Instructional designers advise and take content selected by the course developer and build that content into Canvas, our learning management system. The created courses are then shared with students. Course developers are considered content experts much like museum curators are. Let’s look at that a bit more closely.
In Figure 3. below we can see a comparison between the definitional role and duties of a museum curator and course developer. There are striking parallels between these roles. So much so that it would seem reasonable to think about what a course developer does as also a curatorial practice. A practice focused on the learning content, including video, for a given course.
Perhaps the greatest difference between these to two curatorial practices is the context of each. In asynchronous course development it is not uncommon for instructors to perform many of these same functions as museum curators but on a more discrete scale. The scope and context of their focus is obviously different.
In essence a course developer actively gathers and in may cases, creates unique course elements that form the curated media collection for a course. That collection of texts (readings), images, web resources and video is then used for education, research, and perhaps outreach with a constant eye on student access to media. Ultimately a course media collection is intended to permit the course developer to fulfill the purpose of the course and guide students in achieving the course learning outcomes.
The physical design of the course, with its media collection, is the domain of the instructional designer. The collaboration between the course developer and instructional designer are key in preparing the course as an “education exhibition” of sorts that has clear learning outcomes.
Course Video Selection: The Art of Curatorship
We began this discussion with the importance of video in online course development and design. With that in mind it is logical that video curation is an important element of course-wide media collection identification.
Video collection, cataloging, arranging and assembling for display in a course fits quite well within the parameters of curating. Any curation is also about a level of storying, opportunities for engagement, information sharing and perspective sharing (Potter, 2017). In course development these processes as applied to course media, and in particular video, have the potential to create and shape the nature, experience, and associated learning in an online course.
In making decisions about video use in online courses, a course developer would apply their knowledge and expertise to curate the selections. Clear learning outcomes provide a pedagogical and content structure to the video curation process. Once a video collection is established other decisions may come into play that reference an aesthetic for the collection. This is the art of curatorship.
The art of curatorship has been viewed as closely aligned to a design process (Shuey, 2014) and may be guided by an interpretation of the universal visual design principles as conceptual guides to the education exhibition that is the online course. In this sense the curator is not thinking as much about the collection items per se but more about how the collection fits together to provide and support a narrative, flow, or education scaffolding for the course.
Thinking Like A Curator
As an exercise in curatorial thinking let’s take some re-interpreted concepts of visual design and see if they help us think through how we curate not only individual videos but also a video collection. This brief list includes accompanying questions that are informed by the identified principle and may shape the curation of video. In these examples found videos are outside video sources where created videos are those made by the course developer.
Balance: What is the intended balance between: Created and found curated videos? Permanent video and temporary (single-use) video content?
Emphasis: How does found video reinforce or extend created video? Is there a particular focus or intention of video use?
Movement: Is there a scaffolding of curated video that matches the scaffolding of the course progression? How does the video curation contribute to that progression?
Pattern: Is curated content focused, more general in nature, or quite diverse in source, topic or message?
Rhythm: Does video use and viewing support or promote a rhythm of engagement for the course that compliments course objectives?
Repetition: Are curated videos reinforcing similar ideas or concepts? Are videos used consistently for certain aspects of the course (i.e., narrated lectures)?
Proportion: Does the video collection time commitment fit within the time expectations for the course? What is the ideal proportion of video to text, image, and other course media?
Variety: Are curated videos from different content sources and types? What is the ideal balance for the course?
Unity: Does the video collection promote a sense of wholeness to the course? Could the video collection, on its own, communicate identifiable ideas, patterns of ideas, or a range of perspectives on a topic?
Does video accessibility contribute to the overall course accessibility?
In working through this exercise, we begin to move beyond video collecting by subject toward a more complete analysis of video collection selection and use that includes intertwined pedagogic and aesthetic considerations. This helps create a video collection that is intentional in its item selection, organization and use.
Final Thoughts
Recent research by Kaltura Inc. indicates that video use in education is on the rise in the past year. A continued growth of access to video and ability to create video coupled with an interest in integrating video in education efforts suggests course developers have a challenging task regarding media selection and use.
This article presents the idea that course developers, whether obvious or not, are actively engaged in a curatorial process regarding media selection and use. In addition, because of the importance and prevalence of video, its curation is presented as a key element of the larger course media curation effort. Lastly, we have explored how video collections contribute to academic and aesthetic value of a course and provided some key considerations based upon extending classic visual design principles to a curatorial practice.
It is interesting that the term curation has Latin roots in the verb curare; which means to take care of. Course developers conducting intentional video curation contribute to meaningful media curation for a course. This engagement in the practice of a curator is truly a professional act of caring about the quality of course development and the impact on student learning.
In Part II of this series we will address the practice of video curation in the context of an online course and explore instructional design considerations for video use that balance and complement a sample course video collection.
References
American Alliance of Museums. (2009). Curators Committee (CurCom): Curator’s core competencies. https://www.aam-us.org/professional-networks/curators-committee/
Kaltura Inc. (2020) The state of video in education 2020: Insights and trends [seventh edition].
https: //corp.kaltura.com/resources/the-state-of-video-in-education-2020/
Potter, J. (2017). Curation. In K. Peppler (Ed.), The SAGE encyclopedia of out of school learning (pp. 4-6). SAGE Publications Inc., Thousand Oaks, CA.
Shuey, G. (2014, October 21). The art of content curation. RELEVANCE.
https: //www.relevance.com/the-art-of-content-curation/
Wikipedia (n.d.). Definition of term collection.
https://en.wikipedia.org/wiki/Collection_(artwork)
Wikipedia (n.d.). Definition of term curator.
https://en.wikipedia.org/wiki/Curator
The LMS Canvas by Instructure comes with a decent set of styled elements to start with, but diving into the HTML editor is where you can really modify content, giving it a specific look and feel. Recently I have found that I am going to these customized elements more often to help achieve learning outcomes and provide a different look and feel for accessible course pages.
It is not limitless, however, or even as open as regular web development would be. Canvas has an HTML Editor Allowlist for elements, styles and classes (though some absent from this list will work if you give it a go!). Many of these are activated by using in-line class or style, but other attributes are also available.
Without further ado, here are three of the more popular elements I have been drawn to when creating courses over the past few terms.
Accessible Rich Internet Applications (ARIA)
Defined as
a set of attributes that define ways to make web content and web applications more accessible to people with disabilities Source
These attributes are some of the most popular because they help with accessibility (particularly, screen readers) on the course site. Where native HTML5 elements are not available, these ARIA attributes help to explain what a particular piece of content does and how a learner should interact with it. By using these, we help to make courses open to a wider set of learners.
You want to include an element on your course site that expands to reveal more content. You will need to make a screen reader aware that the content is there, and what it does. Using the following should get you off to a good start:
<spanclass="element_toggler" role="button" aria-controls="something"
aria-label="longer description of the element" aria-expanded="false">
Click here to see the explanation</span>
<divid="something" style="display: none;">
The explanation.
</div>
aria-controls="something"
combines with id="something" later on in the code. The value must match the id value for it to work correctly. This is used to interact with the element.
aria-label="longer description of the element"
used to describe the functionality of the element if it is not explained prior to the interaction.
aria-expanded="false
used to tell the screen reader the button is initially closed.
Example 2: Descriptions
You have a particularly visual element on the page, and you want to write a larger piece of text for a screen reader to explain this. You can use aria-describedby and then link it to the id of an element (in the <span> below):
<p><imgsrc="close_up.jpg" aria-describedby="close_up">
<br>
<spanid="close_up">A close-up view of the rock target named "Máaz" from the SuperCam
instrument on NASA's Perseverance Mars rover.</span>
Analysis of SuperCam data shows that Máaz has a basaltic composition.
It is either an igneous rock or consists of fine grains of igneous material
that were cemented together in a watery environment.<br>
Full image and caption from
<ahref="https://www.jpl.nasa.gov/images/supercam-close-up-of-maaz">
NASA Jet Propulsion Labratory.</a> NASA/JPL-Caltech/LANL/CNES/CNRS
</p>
Device specific content
Next up, is hidden content. So you added the element_toggler above, but your learners with the Canvas Mobile App let you know they cannot click it!
Some of the projects I work on with these elements require an entirely different way of accessing the content on a mobile device.
A potential fix
Create different versions of the content by hiding each one depending on the device.
To do this, you will need to divide the content using two containers. Using the same element_toggler code from above, we can easily add a separate, but hidden part underneath for Canvas app users.
<spanclass="element_toggler" role="button" aria-controls="something"
aria-label="longer description of the element" aria-expanded="false">
View the explanation</span>
<divid="something" style="display: none;">
The explanation.
</div>
<divclass="hidden-desktop hidden-tablet hidden-phone">
The explanation.
</div>
The addition of the class="hidden-desktop hidden-tablet hidden-phone" attributes will hide this container for most users. As it is sitting outside of the element toggler, however, mobile app users do not need to click the element toggler to see the explanation! This provides a more accessible option for users of those devices.
Note: if you have access to the stylesheet for your institution, it would be more beneficial to add these changes there than on a per-page basis.
Anchoring to part of a page
If you have ever seen text content that says something similar to this…
As we discussed before…
As I mentioned previously…
Back in Module 3, we talked about…
…then you need to use this simple feature of the anchor element!
I use this a lot on course content that requires students to refer to previous material. Everyone will have heard of a hyperlink using the <a> tag, but you can also use this anchor to link to a certain part of the page. I regularly use it to send learners to particular headings or content that they would find relevant for assignments. If you set up your course from the start with this in mind, it can be a fast way to group revision material from certain parts of a page, or create more accessible navigation menus.
Give an element an id, like this:
<h3 id="section_2">Section 2</h3>
Then, when you want to send a learner back to that part of the page, just reference it by adding the id to the end of the page link with a `#`. For example:
This will take the learner directly to the heading with the id of ‘section_2’, which you set up before.
You can even do this within the same page to jump to that part of the page. Just link it like this without the rest of the URL.
<a href="#section_2”>Section 2</a>
Conclusion
These are a sample of the elements, classes, and styles I have used to enhance content over the last few terms. With each, accessibility has been a must, which requires a bit of reflection on how learners would interact with the content. There are a lot more available, and you have a list in the Canvas HTML Editor Allowlist to start experimenting. By thinking of accessibility from the early stages of course design, more users can appreciate these page elements and content.
By Susan Fein, Instructional Designer, susan.fein@oregonstate.edu
In my role as an instructional designer, the faculty I work with are often looking for ways to increase student engagement and add a “wow” factor to their online course. One way to do that is to add or increase active learning practices.
Active learning requires students to do something and think about what they are doing, rather than simply listening, as with a passive-learning lecture (Bonwell & Eison, 1991). Active learning brings positive and lasting outcomes to students, including better retention and grasp of concepts, and is particularly evident when students work together to develop solutions (Chickering & Gamson, 1987).
Tackling Discussions
In 2019, I worked with an instructor developing a biochemistry/biophysics course for Ecampus. The instructor loved the peer-to-peer interaction intended for discussions, but was discouraged by the often lackluster exchange commonly demonstrated in the posts. She wanted to liven up these conversations, not only to increase the strength of the community but also to have an impact on the value of the learning that took place.
Enter knowledge boards! With a simple but creative retooling of the predictable initial-post-and-two-replies format, the instructor found a way to reimagine the often mundane discussion board and transform it into a lively and highly engaging conversation and exchange of knowledge.
How did she do this? Rather than compel all students to respond to a narrow or artificially-constructed prompt, the instructor instead posted several relevant topics or short questions extracted from the concepts presented during that week’s lectures and readings. Topics might be a single word or a short phrase, and the questions were tightly focused and direct.
Choice and Agency
From this list of 5 to 10 conversation starters that give breadth to the topics, the students can choose which they want to respond to, often selecting what’s of greatest interest to them. These posts could be anything related to the topic or question, so students are free to approach from any perspective or direction.
The instructor found that the students more freely contributed ideas, insights, understandings, questions, confusion, and commentary. They were encouraged to ask questions of each other to delve into significant points. Students could engage in as many conversations as desired, at their discretion. As a result, they tended to be more actively involved, not only with the content and concepts from that week’s materials, but also with each other, producing a strong community of inquiry.
This simple change transformed the tired and (dare I say it?) potentially boring weekly discussion into a meaningful opportunity for a lively and valuable knowledge exchange. The instructor explained that students also report that this knowledge board becomes a study guide, summarizing multiple approaches and insightful content they use for studying, so many revisit the posts even after that week is over as a way to review.
But Wait…There’s More!
The instructor didn’t stop at discussions in her pursuit of increased engagement and active learning. Her next “trick” was to evaluate how the assessments, especially homework problems, were presented.
A typical format in many Ecampus courses is to have students complete homework assignments individually, and these are generally graded on the correctness of the answers. But once again, this instructor redesigned a conventional activity by applying principles of active learning and collaborative pedagogy to improve learning outcomes.
In the new version, students first answer and submit solutions to the homework individually, and this initial phase is graded on proper application of concepts, rather than on the correctness of the answer. Next, students work together in small groups of 3 or 4 to discuss the same set of problems and, as a group, arrive at consensus of the correct answers.
The active learning “magic” occurs during this critical second phase. If one student is confident about an answer, they present evidence from the lectures and readings to persuade their peers. And when a student is not certain that they correctly grasped the concepts, they discuss the problem and relevant principles, learning from each other through this review, hearing different perspectives and interpretations of the materials. It is through these vital peer-to-peer interactions that the active learning takes place.
As the last phase of the activity, the group submits their answers, which are graded for correctness.
This reshaping of a classic homework activity results in deeper levels of understanding and stronger knowledge retention (Weimer, 2012). And there’s an added benefit for the instructor, too. Since there are fewer papers to grade, formatting homework as a group submission means extra time to offer more and better feedback than would be feasible when grading each student individually. A win-win bonus!
Benefits of Active Learning
These are just two simple but ingenious ways to reformat classic forms of interaction and assessment.
Do you have an idea of how you can alter an activity in your course to make it more interesting and engaging? If you sense that your online course could use a boost, consider incorporating more active learning principles to add the extra oomph that could transform your teaching content from mundane to magical!
So let’s close this post in true active learning style and take a moment to reflect. What kinds of active learning practices have you tried in your course? How did those go? We’d love to hear your thoughts and experiences, so please share in comments.
References
Bonwell, C. C., & Eison, J. A. (1991). Active Learning; Creating Excitement in the Classroom (Vol. Education Report No. 1). Washington, D.C.: The George Washington University, School of Education and Human Development.
Chickering, A. W., & Gamson, Z. F. (1987, March). Seven Principles for Good Practice. AAHE Bulletin 39, 3-7.
Weimer, M. (2012, March 27). Five Key Principles of Active Learning. Retrieved from Faculty Focus: https://www.facultyfocus.com/articles/teaching-and-learning/five-key-principles-of-active-learning/
Is it okay to use YouTube videos in your course? What about copyright? I get inquiries like this often. Here I’ll share the most common questions from instructors and the answers I provide.
Q: Should I be concerned about relying on a link to a YouTube video for essential course content? There are quite a few YouTube videos on a topic I cover in my course, and all of them are better than what I could put together on my own, given the constraints on my time and technical expertise.
A: There are several considerations when using YouTube videos:
YouTube videos may be taken down at some later date, and this would be a problem if you are relying on them for essential course content. However, you say there are “quite a few” videos on this topic. If the video you select for the course were taken down, would you be comfortable using a comparable video? A related consideration is, does the YouTube channel that posted the video own the rights to it? Or, have they pirated someone else’s content? We don’t want to share pirated videos with students because this models inappropriate intellectual property practices and because these videos are more likely to be removed by YouTube for copyright violation.
Another consideration is that students have come to your course with the expectation that you will offer a unique educational experience tailored to the context of their university and the degree program they’re enrolled in. When presented with YouTube videos, some students may ask, why am I paying for a course delivered by a professional university instructor if I can get the content for free on YouTube? Students may not be aware of the time and attention that you have put into finding, sequencing, and providing context around external videos. Consider balancing the use of external videos with your own materials so that you are still able to communicate your individual teaching presence.
Q: Am I infringing on copyright in some way by including YouTube videos in my course?
A: By linking to or embedding YouTube videos on your course site, you aren’t infringing on copyright. The YouTube video channel still controls the linked content, not you; you haven’t downloaded or made a copy of the video, nor have you stored it on your own device or the university’s servers. By driving traffic to YouTube’s website, you are actually helping YouTube and the content creator make money and/or get views. You may have heard of programs that allow you to download a YouTube video so you can retain a copy to share with students, just in case it gets taken down. Doing so would very likely infringe on copyright and would be a violation of YouTube’s terms of service. So stick to sharing links or embedding!
Q: How can I determine if a video has been pirated?
A: Take a closer look at the channel that uploaded the video. You can find the channel’s name listed beneath the video title. Do you recognize an institutional entity that would logically be the owner/creator of the video? Or, is the channel title just some person’s nickname? Click on the channel’s hyperlinked name so that you can browse the other videos and playlists the channel offers, as well as any information provided on its About page. If you find a random list of videos that don’t have a common theme, or no description is available on the About page, the channel may have pirated the video you had planned on using.
Q: I understand that linking to a pirated YouTube video isn’t a great thing to model to students, but what if this is the only video on my topic? Can I get in trouble for pointing students to pirated content? And what are the chances that YouTube or the true content owner will succeed in getting this pirated video taken down?
A: You haven’t pirated the video, but you could be liable for contributory copyright infringement…so this isn’t recommended. Still, you may be surprised to learn that YouTube will often retain pirated content. If the content owner agrees, YouTube monetizes the video with ads and it continues to be hosted on the pirating channel with the revenue going to the true owner (and in some cases a portion to the pirating channel). In 2017 most copyright claims resulted in monetization, so those pirated videos you’re interested in might not be taken down after all. That said, there’s no easy way to know if a pirated video has been monetized and sanctioned by YouTube and the content owner; ads will appear on videos that haven’t been monetized as well as on those that have. Conclusion: you’d be better off finding a video from a legitimate source or creating your own content!
Over the last several years, research on online education has been growing rapidly. There has been an increased demand for quality research online teaching and learning. This demand now seems more urgent as teaching modalities are changing due to the COVID-19 pandemic. Since 2016, the Ecampus Research Unit has been funding OSU faculty-led research on online and hybrid education through the Ecampus Research Fellows Program. The goals of the program are the following:
To fund research that is actionable and that impacts students’ learning online;
To provide the resources and support to “seed” pilot research leading to external grant applications;
To promote effective assessment of online learning at the course and program-levels at OSU;
To encourage the development of a robust research pipeline on online teaching and learning at OSU.
Ecampus Research Fellows are funded for one year to engage in an independent research project on a topic related to online teaching and learning. Fellows may apply for up to $20,000 to support their research project. Up to 5 projects are funded each year. The program follows a cohort model in which fellows meet on a quarterly basis as a group to discuss their projects and receive support from the Research Unit. Each fellow completes an Institutional Review Board (IRB)-approved independent research project, and they are required to write a white paper based on their project results. The program’s white papers are published by the Ecampus Research Unit.
Actionable research impacting online education
In the past five years, the program has funded 24 projects with 34 faculty from across the university. The funded research has been conducted in anthropology, biology, chemistry, education, engineering, geography, mathematics, philosophy, physics, psychology public health, rangeland science, sociology, statistics and veterinary medicine. The faculty have benefitted from having dedicated time and resources to undertake these research projects. Their fellows’ projects are significant for their own research pipelines, and their findings are valuable Ecampus as we continue to innovate in our development of online courses. An example is geography instructor, Damien Hommel’s project, which led to a larger effort toward expanding experiential education for Ecampus courses beyond his discipline. Other fellows’ projects are providing valuable information about peer influence, inclusive teaching, hybrid laboratories, video segmentation, online research platforms, and more.
Becoming a research fellow
Are you an OSU faculty member interested in doing research on online education in your discipline? Previous experience with classroom-based or human subjects research is not a requirement. The Ecampus Research Unit is available to support you with your application and the research design process. We will be accepting our 6th cohort in 2021. The application is available now and is due on November 1st. Funded projects will be notified by December 1st.
If you have questions about the program contact Mary Ellen Dello Stritto (maryellen.dellostritto@oregonstate.edu), the director of research for OSU Ecampus. Additionally, attend an information session on Tuesday, September 29, 2020 at 1p.m. or Friday, October 2, 2020 at 11a.m. To register for one of these information sessions email: maryellen.dellostritto@oregonstate.edu.
About the Oregon State University Ecampus Research Unit
The Oregon State University Ecampus Research Unit responds to and forecasts the needs and challenges of the online education field through conducting original research; fostering strategic collaborations; and creating evidence-based resources and tools that contribute to effective online teaching, learning and program administration. The OSU Ecampus Research Unit is part of Oregon State Ecampus, the university’s top-ranked online education provider. Learn more at ecampus.oregonstate.edu/research.
Assignments are an integral component of the educational experience to guide the teaching and learning processes. In fact, Dougherty (2012) contends that assignments are instructional events that aim to teach for learning, that is “recipes for instructional events— lessons in the best sense— and their main function is to create a context for teaching new content and skills and practicing learned ones.” (p. 23). Assignments as instructional plans provide students with the opportunities to apply concepts they studied in the class. Further, through assignments, students can demonstrate the skills developed in a unit of content in more concrete ways and aligned to the goals of the course.
In my consultations with instructors I often hear them raise concerns about course assignments. These concerns range from making assignments more practical and relevant, clarifying the purpose and instructions, integrating problem-solving and critical thinking, to including authentic and experiential tasks. In addition, I hear instructors mention that some assignments that students submit are incomplete, offer superficial and unsubstantiated arguments (i.e., written reports), focus on tangential ideas, have been googled, reflect bias, and are simple opinions using non-credible sources. These concerns are very valid and it is important to examine the assignments deeper. What I have noticed is that some assignment descriptions lack a purpose and clarity. In a word, assignments need to be transparent.
Determining the structure of an assignment bears the questions of how can instructors make the assignments learning events that are clear and relevant enough for students? how can students not only demonstrate what they learn, but also use the assignments as catalysts for further intellectual and academic challenges? Let’s take a closer look at transparency.
Transparency
The first time I heard about transparency in assignment design was at the Wakonse Teaching and Learning conference a few years go. Several sessions and small group activities at the conference showed us that the assignments need to have a clear structure, detailed instructions, and a grading criteria. Obviously! I said to myself at the time. However, the reality is that assignments tend to be reduced to a list of instructions, tasks that students need to complete and submit for a grade. In some cases these instructions vaguely indicate the grading criteria in terms of the format and style (i.e., number of words, font size, spacing).
The underlying framework for transparent assignments is a structure that clearly describes the purpose of the assignment, the instructions or tasks, and the grading criteria (Dougherty, 2012; Winkelmes, 2013; Winkelmes, Bernacki, Butler, Zochowski, Golanics, & Weavil, 2016). Winkelmess and colleagues (2016) draw from three theoretical bases to support the three-stage framework: metacognition, agency, and performance monitoring. Contrastively, Dougherty (2012) draws from instructional strategies informed by backward design and alignment to outcomes to set the assignment structure. In this framework, instructors deliberately design the assignment for high quality learning experience and relevance to students. In their research study, Winkelmess and colleagues (2016) found that students who received transparent assignments showed evidence of greater learning in three areas related to student success: academic confidence, sense of belonging, and mastery of skills.
Designing transparent assignments involve creating a clear and coherent architecture. Through this structure students can think deeper about the concepts studied, focus their attention on particular topics, make connections to real-world contexts, and see the relevance for their future lives and goals (Dougherty, 2012). In doing so, instructors need to create a harmonious structure that clearly explains why students need to do an assignment, what is the assignment about, how to do the assignment, and how they will be graded on it.
When I presented this architecture to one instructor, he replied “you are asking me to tell students the answer! Why would I need to hand-hold students in this way when I want them to be problem-solvers and critical thinkers?” While this comment is valid, and also paralyzed me for a few seconds, I engaged the instructor in discussing what the assignments need to be clear. For instance, we talked about how students will know what to do, why students should care about completing the assignment (besides the grade), and how students will meet the expectations if they don’t know the purpose and the way to complete it. In addition, I said “you want students to be problem-solvers of the content and topics, not problem-solvers of the assignment design.”
A transparent assignment should have the following three basic components: purpose, task, and grading criteria.
Purpose
The starting point in an assignment is to be able to answer the question of why? Why will students learn from this assignment? Why will students need to complete this assignment? Why is this assignment important in students’ learning? Stating the purpose of the assignment serves a two-fold objective. First, it gives the instructor a frame of reference for creating an activity that is relevant and meaningful to students, and that connects to the learning outcomes. Second, the purpose of the assignment gives students a focus and a sense of direction.
Winkelmes (2013) suggests establishing the purpose in terms of the skills students will practice and the knowledge they will gain. In addition, the purpose can also be determined by contextualizing the learning outcomes in practical ways within the activity.
Task
You can call it tasks, details, instructions, steps, or other. In this structure, the instructor describes what students need to do, what resources they can use, and the expectations of the assignments. Having a clear set of instructions makes the assignment more rigorous and helps students produce more high-quality work.
Grading Criteria
Providing the criteria of how the assignment will be graded will also give students a sense of clarity and direction. Clear expectations through a rubric or grading guidelines helps students adhere to the outcomes of the assignment. Winkelmes (2013) suggests including several examples of real-world problems so students can see how the application of knowledge and skills will look like.
Remarks
A transparent assignment should have a well-structured framework or an architecture of steps. Transparency in assignments is a mindset, a way of thinking, the vision that students are given clear and relevant learning events that allow them to demonstrate their learning, and foster their engagement. Transparent assignments can be designed as stand-alone pieces or as a multi-stage assignment. Multi-stage assignments can build on cognitive complexity, include multiple skills, and extend learning to outside the class. In our next blog, I will look at how to design multi-stage assignments.
Sources
Dougherty, E. (2012). Assignments matter: Making the connections that help students meet standards. Alexandria, VA: ASCD.
Winkelmes, M. 2013. “Transparency in Learning and Teaching: Faculty and Students Benefit Directly from a Shared Focus on Learning and Teaching Processes.” NEA Higher Education Advocate, 30(1), 6-9.
Winkelmes, M. A., Bernacki, M., Butler, J., Zochowski, M., Golanics, J., & Weavil, K. H. (2016). A teaching intervention that increases underserved college students’ success. Peer Review, 18(1/2), 31-36.