“Annotation provides information, making knowledge more accessible. Annotation shares commentary, making both expert opinion and everyday perspective more transparent. Annotation sparks conversation, making our dialogue – about art, religion, culture, politics, and research – more interactive. Annotation expresses power, making civic life more robust and participatory. And annotation aids learning, augmenting our intellect, cognition, and collaboration. This is why annotation matters.” 

                                          -Kalir and Garcia

Annotation 

When you think back to your early college years, you may remember your professor assigning a text to annotate. Annotating a text has long been a common task in higher education, one that ideally promotes deeper reading, interaction with, and comprehension of important texts. Annotation assignments vary widely but the traditional paper-based type of annotation asks readers to respond to a text as it is read, physically marking or highlighting the text itself and perhaps writing in the margins. This approach allows students to enter into a dialogue with the text by recording their responses to the text, adding reflections or critiques, and anchoring those reactions to a specific place in the text. When students annotate a text, they are working their way through skills that span the levels of Bloom’s Taxonomy, from remembering to predicting, connecting, analysing, and evaluating. Annotation, at its best, encourages active engagement with a text beyond the surface level, promoting deeper critical thinking and stronger retention of concepts. 

While this is, of course, fantastic individual practice, the nature of traditional annotation assignments is primarily solitary. Today’s classrooms place more of an emphasis on 21st century skills such as group and collaborative study, and new digital tools have been developed that have revolutionized what, how, and with whom we can annotate. So-called social annotation has picked up speed with the growing popularity of two major players, Perusall and Hypothes.is, bolstered by the sudden shift to remote learning in 2020. Online instructors seeking ways to replicate the back and forth, robust discussion of a face-to-face class have found these tools a fitting substitute, and the asynchronous format of the discussion means these tools have a place in all modalities. 

Equity, Inclusion, & Community

“As a teaching method, critical social annotation allows for equitable conversations to unfold in-line with the knowledge being presented in course texts. In this way, it can potentially subvert or even redress instances of inequity in course content.” 

                                                                                                         – Brown and Croft

Social annotation platforms increase equity and inclusion in a course in several ways. Digital annotation platforms offer students a variety of ways to connect with material, allowing students to post links, images, video, and more in response to the text, their peers, and other annotators. By putting students’ ideas front and center, social annotation can empower learners to take initiative and experience more feelings of control over their educational process. Unlike the fast paced back and forth of traditional face-to-face discussions, the nature of digital social annotation allows students more time to engage with the text and to take as long as they need to post and respond (within the assignment boundaries). Additionally, the major platforms discussed in this post feature easy-to-use controls that require little technical expertise to use. They also boast comprehensive accessibility features that combine to provide inclusivity to a wide range of student needs. 

Social Annotation as Collective Construction of Meaning

One major difference between today’s digital social annotation and traditional solitary practice is that when students in a particular class collectively annotate a text using one of the digital platforms available today, they are actively building knowledge and understanding as a group. By sharing the document for collective annotation, the act of annotating itself becomes a social activity and contributes to the interaction of individuals within the group.  Socially annotating a text is one of the best ways to encourage close and active reading skills, with many studies reporting higher levels of student comprehension of socially annotated materials. Students who collectively annotate a text are entering into an exchange of questions, opinions, perspectives, and reactions to a text, engaging in a discourse with their peers (and facilitator, usually) and by extension learning from and with them. The process of a social annotation assignment allows students to see knowledge creation in action and become co-creators. 

Use of social annotation in asynchronous online courses can also increase sociability within an otherwise geographically remote, disparate group of students. Asynchronous instructors sometimes struggle to provide opportunities for real social interaction and building of community given the limits of the modality. An often unstated goal of higher education is to socialize students to academic community norms, and social annotation allows students to experience and practice some of these. For example, students annotating collectively learn appropriate language for responding to peers’ ideas and criticisms, develop online academic social identities, and gain experience with navigating power dynamics within the higher education classroom. 

Ready to Try It Out?

Adding social annotation to a course involves matching the task to your learning outcomes, deciding which readings would be best suited to annotation, and choosing your online annotation platform. 

Assignments can be tailored to meet a variety of instructional purposes and goals:

  • Recognizing formatting of various documents
  • Providing background or contextual information 
  • Learning academic norms for responding to peers- supporting, agreeing, disagreeing
  • Drafting questions and responses that are rigorous and meaningful
  • Determining main points vs. supporting details
  • Distinguishing fact from opinion
  • Identifying themes, tone, biases, author’s purpose, rhetorical devices, etc.
  • Learning and practicing discipline-specific writing and reading conventions 
  • Connecting the material to the field of study, to their own practice, or to other course materials
  • Developing evaluative and analytical skills
  • Considering differing perspectives and viewpoints in constructing knowledge
  • Facilitating a deeper understanding of difficult passages

Some best practices to consider when using collective annotation online:

  • Remind students that they have already practiced annotation in their everyday lives (reading and making your own notes in your inherited cookbook, reading your teacher’s remarks on your essay, leaving comments on a colleague’s report)
  • Model annotation with a fun text first
  • Seed the reading with your own comments, questions, and notes to help guide students 
  • Situate the social annotation assignment within the context of the course and make clear the intentions you have for the activity
  • If the activity is to be graded, be sure students know the grading criteria, preferably by providing a rubric
  • Annotation assignments are ideal for small group activities, and some platforms automatically create groups
  • Be prepared to provide guidelines for behavior and etiquette among students and to need to enforce these guidelines if students step out of line
  • Monitor the discussion and provide nudges, likes, upvotes, or validations, and otherwise engage with the dialogue throughout the assignment
  • If the platform allows tagging, do so- students get notified when someone responds to their post or asks a question, a convenience which increases the likelihood of them returning to the assignment for further interaction 

Social Annotation Tools: The Major Players

Perusall (stand-alone site/integrated into various LMS, including canvas)

Perusall is a collective annotation platform developed by Harvard University following a major research initiative into online collective annotation. Perusall offers free accounts for teachers and students at the basic level with options for institutions to integrate the tool into their LMS. The platform allows educators to use Perusall directly for stand-alone courses and upload their own materials for annotation as well as partner with their textbook catalog to purchase and annotate textbooks directly. For integrated LMS users, Perusall offers seamless grade pass back and options for pass/no pass grading as well as a robust automatic AI grading system that saves time and effort. Some instructors have also used Perusall for peer review to great effect using student-uploaded documents. *recommended tool for Ecampus courses

Sample Perusall annotation assignment

Hypothes.is (Google Chrome browser extension)

Hypothes.is is a groundbreaking new tool that bypasses restrictions of the classroom and enables anyone anywhere to annotate any webpage via a unique delivery system- as a browser extension that creates a layer over any webpage. This open source, free tool can revolutionize how we view and interact with web pages as well as texts by allowing us to save our annotations privately as well as publicly, inviting the world at large to socially annotate with us. Hypothes.is is also available as an integrated tool in most LMSs. The company also hosts the AnnotatED community, a group of users that hosts events, studies, and conferences to learn best practices for the tool. *recommended tool for research with a wider audience.

Hypothes.is Introduction Video

Sources

Adapting to Disciplinary Literacy Conventions – Open English @ SLCC

Home : Hypothesis

Innovation | Cégep Vanier College

Kalir, Remi H., and Garcia, Antero. Annotation. United States, MIT Press, 2021.

https://www.google.com/books/edition/Annotation/ejoiEAAAQBAJ?hl=en&gbpv=0

Pedagogy | ANNOTATION TOOLS

Perusall

Social Annotation | Center for Teaching Innovation

Social Annotation – Pedagogical Support and Innovation Pedagogical Support and 

Social Annotation and an Inclusive Praxis for Open Pedagogy in the College Classroom

Tools for Social Annotation in the Digital Age

Traditional learning materials such as textbooks can limit access to innovative teaching and learning practices. With Open Educational Resources (OERs), teachers and students are freed from the constraints of these materials and are empowered to adapt, use, and share learning materials created by others. This is a series of two blogs that will explore the importance of OERs and the resources needed for creating our own open resources for language learning?.  

First, let’s take a brief look at what makes OERs appealing, yet challenging to adapt and create in language education.

OER is sharing
Open educational resources. Source: Giulia Forsythe on Flickr, Public domain CC0 1.0

A Brief Overview

Open Educational Resources (OERs) are a key component of an approach to learning known as Open Pedagogy, which aims to leverage the use of shared resources to improve educational outcomes. Simply put, OERs include “any educational resources (including curriculum maps, course materials, textbooks, streaming videos, multimedia applications, podcasts, and any other materials that have been designed for use in teaching and learning) that are openly available for use by educators and students, without an accompanying need to pay royalties or license fees” (Butcher, 2015, p.5). OERs are usually shared under a Creative Commons license which allows users to revise, remix, retain, reuse and redistribute these materials without incurring any copyright infringement (The 5R activities).

“Going open is more a philosophy than a skill. But, obviously, it takes a handful of skills to be able to apply this philosophy in the classroom”

Małgorzata Kurek Anna Skowron

Language instructors and researchers have recognized the potentials that OERs bring to the language classroom. We call these potentials the ecology of OERs for the language classroom—the complex connections and relations that exist in the process of teaching and learning another language and its cultural foundations. In this ecology, we find benefits including adapting authentic materials, merging literacy and culture, and fostering multiliteracies (e.g., digital, information). Yet instructors and researchers also acknowledge the barriers to widely adopting open resources. 

Opportunities

OERs can engender creative and innovative practices for making language teaching and learning more meaningful, enjoyable, authentic, and democratic. Open resources can be game-changers that reshape the classroom ecology and its dynamics—fostering a hub for new social learning. These resources can challenge the social norms and behaviors expected in the language classroom, making instructors and students collaborators. Both students and instructors can become active producers of content, transforming the language class into more democratic and participatory. A participatory approach to making students content creators can promote opportunities for students to be exposed to authentic uses of the language and, thus, increase their motivation to learn and use the language in more meaningful and relatable ways (Blyth & Thoms, 2021).

OERs create opportunities for adapting and repurposing content to fit particular contexts and uses, levels of skills, student characteristics, instructors’ competencies, and available technologies. Both students and instructors can engage in higher-order cognitive processes as they retain, revise, remix, reuse, redistribute, and evaluate copyrightable works. OERs often come in different formats such as videos, interactive content, gamified practices, animated presentations, audio effects, etc. making the content and learning experience more engaging as well as connected to students’ language learning interests and needs. In addition, OERs are easily adapted, foster language and literacy skills for students, and are beneficial for the professional development of instructors. OERs can promote the development of digital multiliteracies for instructors (Mitsikopoulou, 2019), who could eventually integrate multiliteracies into their teaching practices organically. 

Commercial textbooks can become outdated quickly, and updating them can take a long time. In addition, instructors might find more challenges adapting or reusing these textbooks due to copyright laws. The open nature of OERs offers instructors the opportunity to adapt multiple resources to innovate their teaching practices and expose students to more realistic content that is current and relevant. Even further, using OERs in the language classroom may contribute to going beyond the goal of language education—from a communicative perspective where learners are expected to develop the language skills to communicate with other speakers of the target language to a learning experience that fosters literacy (Thoms & Thoms, 2014).

In broadening language teaching goals, instructors can become content-generators and create their own OERs. Instructor-generated OERs afford the opportunity for instructors to rethink their pedagogical content and practices in a way that can broaden their understanding and perspectives of the world. Instructors can integrate more content from the language and culture of diverse communities around the globe, decentering the language usage of a particular dominant group within the community of speakers. For instance, many Spanish textbooks in the U.S. focus on the Spanish language and culture from Spain, failing to embrace the multifaceted nature, complexity, and nuances of the language and culture in the other 20 Spanish-speaking countries in the world. 

Challenges

While interest in and implementation of OERs has grown across disciplines since the early days of the open education movement, adoption of these resources among foreign language educators has been slower and continues to present a number of challenges that may limit the efforts to integrate them into some educational contexts. Persisting barriers may include reluctance to reuse material created by others and share resources more broadly (Rolfe, 2012; Weller, 2011); lack of guidelines on the use and evaluation of OERs for quality and accuracy of the content (Adams et al., 2013); technical difficulties in access, development, and delivery of content; need for a sustainable team for development and authoring; and compliance with accessibility standards (Baker, 2012). It is notable that many of the challenges identified here represent a historical perspective of the OER movement. However, these potential obstacles, along with “a lack of research which investigates the benefits and challenges of FL learning and teaching in open environments” (Blyth and Thoms, 2021), continue to hinder the widespread use and creation of open resources among foreign language educators.

Supporting Efforts to Incorporate OERs in the Language Teaching and Learning

The benefits of OERs across disciplines has been by now well-documented. Language programs and educators weighing the barriers to creating OERs should not be discouraged. To the contrary, it is critical to support efforts to democratize education through the use of OERs and open education initiatives. These efforts include: (1) providing research-based and empirical evidence of the benefits and impact on language education, (2) grounding the development of OERs on theoretical and practical frameworks to ensure quality of learning experiences, (3) training users and developers of OERs on how to find, adopt, adapt, evaluate and create open resources, (4) supporting the use of technologies and Creative Commons licensing for OERs, and (5) creating clear guidelines for instructional practices (Zapata & Ribota, 2021). An important piece in adopting OERs and advocating for the open pedagogy movement is to support instructors who want to venture into creating their own OERs. How do we get started with our own OER project? What considerations are critical for this kind of project? What resources are needed and available? Who will be involved and how will their different areas of expertise be integrated? We believe it is necessary to discuss these questions (and possibly others). In Part 2 of this series, we outline a detailed process and structure for language programs to determine the appropriate scope and sequence within the larger curriculum, author rich thematic content, weave cultural and social justice topics into language skills content, promote multiliteracies, and produce media objects or search for existing media and images in the public domain.

References

Adams, A., Liyanagunawardena, T., Rassool, N., & Williams, S. (2013). Use of open educational resources in higher education. British Journal of Educational Technology, 44, 149– 150. doi:https://doi.org/10.1111/bjet.12014 

Baker, J. (2012). Introduction to open educational resources. Connexions. http://cnx.org/content/col10413/1.3

Blyth, C. S., & Thoms, J. J. (Eds.). (2021). Open education and second language learning and teaching: The rise of a new knowledge ecology. Multilingual Matters. https://www.multilingual-matters.com/page/detail/?k=9781800411005

Butcher, N. (2015). A basic guide to open educational resources (OER). Commonwealth of Learning (COL).

Wiley, D. (n.d.). Defining the “Open” in Open Content and Open Educational Resources. Creative Commons Attribution 4.0 license 

Lesko, I. (2013). The use and production of OER and OCW in teaching in South African higher education institutions. Open Praxis, 5(2), 103-121. https://www.openpraxis.org/articles/abstract/10.5944/openpraxis.5.2.52/

Mitsikopoulou, B. (2019). Multimodal and digital literacies in the English classroom: Interactive textbooks open educational resources and a social platform. In N. Vasta., & A. Baldry. (Eds.). Multiliteracy Advances and Multimodal Challenges in ELT Environments, (pp. 98-110). Udine.

Rolfe, V. (2012). Open educational resources: Staff attitudes and awareness. Research in Learning Technology, 20, 1–13.https://doi.org/10.3402/rlt.v20i0.14395 

Thoms, J. J., & Thoms, B. L. (2014). Open educational resources in the United States: Insights from university foreign language directors. Systems. http://www.tesl-ej.org/wordpress/issues/volume22/ej86/ej86a2/

Weller, M., De los Arcos, B., Farrow, R., Pitt, B., & McAndrew, P. (2015). The impact of OER on teaching and learning practice. Open Praxis, 7(4), 351-361.

Zapata, G., & Ribota. (2021). Open educational resources in heritage and L2 Spanish classrooms: Design, development and implementation. Open Education and Second, 25.

Each year, the Oregon State University Ecampus Research Unit funds projects, up to $20,000 each, to support the research, development and scholarship efforts of faculty and/or departments in the area of online education through the OSU Ecampus Research Fellows program.

This program aims to:

  • Fund research that is actionable and impacts student online learning
  • Provide resources and support for research leading to external grant applications
  • Promote effective assessment of online learning
  • Encourage the development of a robust research pipeline on online teaching and learning at Oregon State

Fellows program applications are due Nov. 1 each year. If you are interested in submitting an application, reach out to Naomi Aguiar, the OSU Ecampus assistant director of research. Research Unit staff are available to help you design a quality research project and maximize your potential for funding.

Many Oregon State colleagues have had transformative experiences in this program.  A Fellows study funded in 2020 highlights the ways in which these projects have advanced research in online/hybrid education, as well as Fellows’ programs of research.

Fellows program highlight

Funding recipients expand the inclusivity mindset of computer science students

Lara Letaw, an experienced online instructor and lead researcher from Oregon State’s School of Electrical Engineering and Computer Science, partnered with Heather Garcia, an OSU Ecampus inclusive instructional designer on a research study called “Impacting the Inclusivity Mindset of Online Computer Science Students.”

Together with their team, Letaw and Garcia implemented an intervention that was designed to improve feelings of gender inclusivity among online computer science students and to train these students to develop more gender-inclusive software applications.

In this intervention, online computer science students experienced new curriculum developed by Letaw and Garcia’s team. The curriculum was based on GenderMag, a software inspection method for identifying and correcting gender biases in software. Curriculum for teaching GenderMag concepts can be found on the GenderMag Teach website. Students completed a set of assignments and, if they chose to participate in the research study, questionnaires about inclusivity climate, both in the course and in the computer science major. Students’ software design work was also evaluated for the use of gender-inclusive principles.

The image below shows examples of the cognitive facet values people (e.g., Letaw and Garcia) bring to their use of software, shown across the spectra of GenderMag facets (information processing style, learning style, motivations, attitude toward risk, and computer self-efficacy).

examples of the cognitive facet values people (e.g., Letaw and Garcia) bring to their use of software, shown across the spectra of GenderMag facets (information processing style, learning style, motivations, attitude toward risk, and computer self-efficacy).

Computer science students in the Ecampus courses Letaw and Garcia modified learned about their own cognitive styles and those of their teammates. They also built software that supports the cognitive diversity of software users. One student reflected, “Identifying my facet values was tremendously helpful [for articulating what had] been abstract… I feel much more confident.”

The results of their study showed that, overall, students felt included by the GenderMag curriculum (nobody felt excluded by it), it increased their interest in computer science, and it had positive effects on their team dynamics and self-acceptance. Students who completed the GenderMag intervention were also more effective in developing gender-inclusive software designs, and they reported greater recognition and respect for the diversity of software users.

The image below highlights what students considered when designing a software user interface before (left) and after (right) learning GenderMag concepts. As one student put it, “Now when I think of users using a piece of software I don’t picture them … just jumping in and tinkering … I am more aware that there are [people whose] interests in using a software … might not align with mine.”

what students considered when designing a software user interface before (left) and after (right) learning GenderMag concepts

As a result of this project, Letaw and Garcia published a paper in the ACM’s International Computing Education Research conference proceedings in 2021. This project contributed to a $300,000 National Science Foundation grant awarded to Oregon State’s Margaret Burnett, Letaw, and Kean University. With this funding from the NSF, they will partner on a project entitled, “Embedding Equitable Design through Undergraduate Computing Curricula.”

This Fellows project has also provided research opportunities for two female Ecampus computer science students (Rosalinda Garcia and Aishwarya Vellanki), a group that is typically underrepresented in STEM fields. Rosalinda Garcia successfully defended her honors thesis with these data in the spring of 2021, and Vellanki is currently working on her own.

Join the Ecampus Research Fellows Program

Learn more about the Fellows Program and what materials are needed to prepare your proposal.

Last fall, my colleague featured the Ecampus Research Fellows (ECRF) program in her blog post. The ECRF program, which began in 2016, funds OSU faculty-led research on online and hybrid education. Each year, approximately five projects are selected to receive funding. One unique aspect of the program is that, in the past few years, 1-2 members of the Ecampus Course Development and Training (CDT) team are paired with the faculty on funded research projects. The CDT team includes instructional designers and media developers. These professionals have expressed interest in conducting research, but in most cases, have had few opportunities to engage in formal research projects. Similar to faculty, CDT fellows have to apply to the ECRF program.

For this blog post, I’d like to share some takeaways from my experience as a CDT research fellow, as well as some takeaways my CDT colleagues have shared with me. I will also share some feedback from faculty fellows who have had CDT colleagues join their research teams. But before I dig into these valuable takeaways from past participants, let me first address the importance of this program for instructional designers and related disciplines.

In 2017, the Ecampus Research Unit published a report titled “Research Preparation and Engagement of Instructional Designers in U.S. Higher Education.” This report was the result of a national study of instructional designers working in higher education environments. Among the many findings of this study, one compelling finding was that more than half (55%) of respondents indicated that instructional designers need more training in research methods to fulfill their role. Instructional designers also indicated why they think it is important to gain more experience in research. Among the reasons, respondents indicated that research skill development would allow them to grow professionally, further their discipline, better understand the needs of students and faculty, and collaborate with faculty.

The Ecampus Research Unit (ECRU) answers this call through their CDT research fellows program.

In the summer of 2020 at the NWeLearn conference, three CDT fellows reflected upon their participation in the program, sharing valuable insights and experience. I, Heather Garcia, was one of them. The other participants were Susan Fein and Tianhong Shi. The full recording can be viewed on YouTube at this link, but I’ll summarize some highlights from the session in the following paragraphs.

The projects undertaken by CDT research fellows in partnership with faculty spanned disciplines from computer science to field-based courses. 

When asked why they were interested in being research fellows, all three participants indicated that they were pursuing additional graduate education at the time they applied. One participant also indicated that acquiring more knowledge and experience with research would allow faculty to see course design suggestions as “more convincing and easily accepted,” giving her additional credibility when recommending new design approaches to faculty.

The fellows also shared details about their contributions to the research projects they were working on. All of the instructional designers spoke to ways their existing expertise was valued by the researchers. They gave examples of the expertise they offered, which ranged from reviewing course design and educational technologies to designing surveys to offering a fresh perspective and a critical eye. In addition to contributing their design expertise to the research projects, CDT research fellows contributed to the research processes as well, through data analysis and research paper writing and reviewing.

All of the CDT research fellows indicated that they learned a lot from their experiences partnering with faculty on research. One particular highlight in this area is that fellows learned that they contribute diverse perspectives to the research process; they have different backgrounds, experiences, and areas of expertise, and everyone on the team contributes something valuable. CDT fellows also indicated that they learned about the IRB process and the importance of asking questions. Perhaps most importantly, they learned that their expertise is valuable to research teams.

Faculty fellows were also given the opportunity to share how having a CDT fellow on their research team enhanced the research experience, and their feedback was shared in the conference session. They expressed many positive sentiments about the experience including the following:

  • “Our research team started as a group of inspired but like-minded computer scientists wanting to make better online classrooms for diverse students. After she joined the team as an instructional design fellow, the work became credentialed, interdisciplinary, and stronger. She brings expertise and sees what we miss—she not only makes us better able to serve the students we hope to, she makes our team better by adding diversity of thought.”
  • “The combined knowledge and experience of teaching faculty and an instructional designer is incredibly powerful.”
  • “She viewed the scope of the research and content of the courses involved through a different lens than I did.”
  • “The instructional designer provided valuable input on areas of my project merging the instructional design with the research.”
  • “My work with the instructional designer let me explore very practical logistic issues that are often not included in the literature.”

Altogether, it becomes clear that many instructional designers are eager to participate on research projects and they are valuable contributors to the research process. The questions I have now are: How can we continue these partnerships into the future? And, how can we create more research partnership opportunities for other instructional designers and teaching and learning professionals, who aren’t traditionally involved in research?

References

Dello Stritto, M.E., Fein, S., Garcia, H., Shi, T. (2020). Instructional Designers and Faculty Partnerships in Online Teaching Research. NWeLearn 2020 Conference.

Linder, K. & Dello Stritto, M.E. (2017). Research Preparation and Engagement of Instructional Designers in U.S. Higher Education. Corvallis, OR: Oregon State University Ecampus Research Unit.

Loftin, D. (2020). Ecampus Research Fellows Program. Ecampus CDT Blog.