Banner for Inviting Art into Online Course Design

How it Begins

As an instructional designer one of my most important tasks is to hold an initial meeting  with an instructor, or subject matter expert (SME). During that first opportunity to collaborate on an online course design project the conversation typically focuses on  key course design elements. Commonly we discuss the broad approach to the course, anticipated assignments, narrated lecture needs, assessment, video production and support, the mechanics of the development process and more. Rarely does art come up in the conversation. 

Chasing Images

Now, that may seem obvious why art is not outwardly discussed. However in the first meeting we do address the topic of look and feel for the course, and images for course banners and any special subject matter art that may need to be displayed. So, visual images are addressed as a way of supporting the learning focus for the course. Finding images that are copyright free and support the general course topic are fairly easy to find in the more obvious online image repositories like Unsplash.com, Pixabay.com, and Pexels.com. 

For courses with education, agriculture, forestry, medicine, and other more general themes finding usable images is pretty straight forward. If your institution also owns licensing for GettyImages.com, the largest stock image collection in the world, you have really nice access to images. Even so, sometimes we don’t have access to the right images for the right course.

In those cases I have found myself chasing down images or building visual metaphors using multiple images to create one image that communicates the theme, unique message, or topic of a given course. Scrambling to create images that support a course can be a challenge for instructional designers. We can do it, but it is not ideal.

For those courses where stock images are not helpful there is a need to re-imagine the image sourcing process. Key to this is recognizing two important factors that will influence your new thinking; 1)The need to find images that do not require copyright clearance or purchase and 2) the need to have images that reflect the unique theme required for the course. How might this be done?

Asking the Question

Sometimes the answer to finding the right image for a course is not about the image but the artist who made it. Every college community has dozens of artist who produce many pieces of art. Some might just be what you need for your course. If you found the right artist would you be willing to invite them to contribute their artistic creations to your course? Would you ask an artist to be part of your course design?

That question came up while working with a course instructor, Dr. Mark Edwards, on the development of his sociology course addressing welfare and social services in 2019. In addressing this issue we knew finding stock art for this topic would be difficult and perhaps inappropriate. During our discussion the instructor said he had seen some examples online of street art addressing homelessness that he though might fit the course. I asked him if he would be willing to reach out to the artist and ask him if we could get permission to use his art in the course. Dr. Edwards said yes.

To our surprise and delight the artist responded positively by granting written permission to use photographs of his art in the course (see Figure 1. below). The artist participated knowing the art would be used for this particular course and would be behind a password protected site in Canvas. We also agreed to credit his work and link back to his art source page.

Figure 1. Banner image from SOC 439/539 featuring art from Michael Aaron Williams.

Course Artist-in Residence

Asking an artist to share their work in this way may be a challenging ask on both ends of the question. We did not know what the outcome would be. Some artists vigorously and rightly protect their work. Some correctly want compensation. Some artists see their work differently and are willing to share their creative efforts in the right circumstance or to support the right cause. In this case, I felt it was best for the instructor to make the ask as he could best communicate how the art might dovetail with the outcomes of the course. So, in this sociology course example the ask worked.

In the summer of 2021 I collaborated again with Dr. Edwards. His new course was a graduate course on research methods in the public policy program. At our first meeting he shared that he had already been in discussion with a colleague in Equador who was a chef and artist. The instructor thought about using images from a series of bread baking images from the chef /photographer for the course. The course theme was organized around the analogy of baking bread as a way to explain the art and science of social research methods. We would use the images (see Figure 2. below) to spur and reinforce understanding about what students were learning.

Figure 2. Dropdown content featuring Course AIR photographs and instructor comments.
Figure 2. Dropdown content featuring Course AIR photographs and instructor comments.

With the development of this second course the concept of a course artist-in-residence became intentional. There are a number of benefits and also limits that come along with this approach to image sourcing and use (see Figure 3.).

Figure 3: Benefits and limitations of a Course AIR approach.
Figure 3: Benefits and limitations of a Course AIR approach.

Traditionally artist-in residence (AIR) programs are a way for artists to find a place and unfettered time to extend their creative efforts. There are hundreds of such art programs throughout the country and many can be found listed at the Artist Communities Alliance. A wide variety of artists are served by these program.

The Course AIR described here is quite different from traditional AIR programs. Where an AIR participant might create a piece of art as part of their AIR experience the Course AIR is intentionally sharing artistic creations within a course space to help foster the objectives of the course. Depending upon the level of integration of the art with the course activities the role of the Course AIR may vary from contributor to collaborator.

Final Thoughts

The role of an instructional designer in this process is to first assist the instructor in vetting art appropriate for the course. Secondly, the instructional designer helps shape the application or use of the art in the course then designs course pages to showcase and compliment the artist-course connection.

The Course AIR concept has been a happy accident that holds interesting potential. Art comes in various form and is experienced through various senses. What music, photographs, video, illustrations, or other types of art might be just right for your next online course? 

Would a Course Artis-in-Residence contribute to achieving the course learning outcomes for a course you are developing? If our experience is any type of guide you will never know unless you ask the question and invite art into the online course design.

Recognition

A special thanks to Dr. Mark Edwards for his work on the courses, willingness to make the ask, and support for this post. Thank you also to my colleague Chris Lindberg for his contributions to this post.

Part I: Role of Course Developer as Media Curator 

This post is Part I of a two-part series on video selection and use in online courses. Part I provides the reasoning behind understanding course videos selection by course developers as a curatorial process. Part II will explore video curation in practice in course development and provide a course design perspective on video presentation and management issues.

Recent Video Use Trends

In September of 2020 the enterprise video company Kaltura Inc. conducted its seventh annual State of Video in Education 2020 report. The report included responses from across the education system spectrum with higher education institutions making up 53% of all respondents (Figure 1.).

Chart showing percentages of educator sectors in response to Kaltura survey.
Figure 1. Percentage of respondents to video survey by education sector.

This report described how remote teaching-driven course changes impacted video adoption and use in education. Remote teaching and learning was the most common use of video (83% of respondents). Lecture captured as video was used by 69% of the responding institutions.

The executive summary identified a number of key insights and trends related to changes in video use in education. A select few can be seen below:

  • Use of video for remote teaching and learning grew by 28% over 2019.
  • Video use is viewed as positive. Respondents (84%) saw video as having a positive impact on student satisfaction, 73% seeing video increase student achievements and 76% believe it increased instructor satisfaction.
  • Students as creators of video increased by 13% from 2019 to 2020.
  • In higher education there was rising video use for remote teaching, lecture capture, and flipping the classroom.
  • Actual growth in the use of video for remote teaching and learning grew by 28%.
  • A majority of respondents (68%) want to continue to blend traditional teaching with today’s virtual innovations; such as video.

In some ways this is not surprising. This past year forced many instructors in higher education to convert face-to-face courses to remote instruction. Much of that transition was accomplished with synchronous sessions via ZOOM or some other video conferencing program. Live video conference sessions, if recorded, also served as a support resource for students. In response to the challenges of the past year both live and recorded video were adopted to make remote learning doable. Fully online courses do not have this live element as they are asynchronous and did not have to adapt in this way.

In asynchronous courses at Oregon State University our Ecampus course developers utilize video differently. Video is as a key media element in delivering course content to learners, promoting faculty presence, and to build depth into projects and assignments. Video content may be produced internally by course developers (e.g., instructors) and used in courses via an enterprise video system (e.g., Kaltura). Video content may also be sourced from external video-based social media sites (e.g., YouTube and Vimeo) or educational and commercial collections (e.g., Kanopy or Amazon) and via syndicated video sources (e.g., podcasts and Twitter).

Given the plethora of video available and a trend toward increased video integration into instruction the challenge to course developers is the selecting, managing, and presenting video content to support and compliment course learning outcomes. Ultimately this also becomes a course design challenge for instructional designers who must adapt to manage the integration of increasing levels of video in the course in a way that makes sense from a pedagogical perspective as well as visual design aesthetic.

Course Developers as Media Curators

What is a Curator?

The growing value of video in the experience of a course suggests that course developers (e.g., instructors) consider a new way of thinking about how video is selected, managed and presented. In essence, I am suggesting that for a given course the course developer serves as a curator of video content.

But what is curator? Should a course developer really think like a curator? How might curated media shape course development and instructional design?

In order to explore this notion of course developers as media curators a bit more I would like to share the definition of what a curator is from the American Alliance of Museum (AAM) Curators Committee (2009). The preamble to the curator core competencies of a curator defined the term curator as:

Curators are highly knowledgeable, experienced, or educated
in a discipline
relevant to the museum’s purpose or mission. 

Curators are further described as having nine core competencies and related applied skills. The competencies are:

Collection planning       Scholary Research              Exhibition Development
Collecting                        Object Research                  Education
Collection Care               Applied Research               Outreach & Advocacy

In Figure 2. we see these same foundational roles expressed by the AAM coupled with a definition of curator and description of the work of a curator. Also included is the domain of the work. Those domains are preservation, research, and communication. The global context of curation is, in this definition, a museum. The more discrete context is the exhibition, or exhibit application. Yet it is all part of a curator’s work.

Curator defined with context.
Figure 2. Definition of the term curator and select context example.

What we see in this definition in Figure 2. is the premise that curators select, gather, care for, and prepare presentations of single items that in aggregate make up a curated collection. That collection becomes a resource and object of education, outreach, advocacy and presentation.

This makes the act of curatorship a scholarly and creative practice that is deeply intentional and based upon the definitional parameters of the organization doing the work.

Course Developers – Curators of Video Collections

Now let us think about what an online course developer is and what they do. At Ecampus course developers collaborate with instructional designers to plan an online course. Instructional designers advise and take content selected by the course developer and build that content into Canvas, our learning management system.  The created courses are then shared with students. Course developers are considered content experts much like museum curators are. Let’s look at that a bit more closely.

In Figure 3. below we can see a comparison between the definitional role and duties of a museum curator and course developer. There are striking parallels between these roles. So much so that it would seem reasonable to think about what a course developer does as also a curatorial practice. A practice focused on the learning content, including video, for a given course.

Perhaps the greatest difference between these to two curatorial practices is the context of each. In asynchronous course development it is not uncommon for instructors to perform many of these same functions as museum curators but on a more discrete scale. The scope and context of their focus is obviously different.

In essence a course developer actively gathers and in may cases, creates unique course elements that form the curated media collection for a course. That collection of texts (readings), images, web resources and video is then used for education, research, and perhaps outreach with a constant eye on student access to media. Ultimately a course media collection is intended to permit the course developer to fulfill the purpose of the course and guide students in achieving the course learning outcomes.

The physical design of the course, with its media collection, is the domain of the instructional designer. The collaboration between the course developer and instructional designer are key in preparing the course as an “education exhibition” of sorts that has clear learning outcomes.

Course Video Selection: The Art of Curatorship

We began this discussion with the importance of video in online course development and design. With that in mind it is logical that video curation is an important element of course-wide media collection identification.

Video collection, cataloging, arranging and assembling for display in a course fits quite well within the parameters of curating. Any curation is also about a level of storying, opportunities for engagement, information sharing and perspective sharing (Potter, 2017). In course development these processes as applied to course media, and in particular video, have the potential to create and shape the nature, experience, and associated learning in an online course.

In making decisions about video use in online courses, a course developer would apply their knowledge and expertise to curate the selections. Clear learning outcomes provide a pedagogical and content structure to the video curation process. Once a video collection is established other decisions may come into play that reference an aesthetic for the collection. This is the art of curatorship.

The art of curatorship has been viewed as closely aligned  to a design process (Shuey, 2014) and may be guided by an interpretation of the universal visual design principles as conceptual guides to the education exhibition that is the online course. In this sense the curator is not thinking as much about the collection items per se but more about how the collection fits together to provide and support a narrative, flow, or education scaffolding for the course.

Thinking Like A Curator 

As an exercise in curatorial thinking let’s take some re-interpreted concepts of visual design and see if they help us think through how we curate not only individual videos but also a video collection. This brief list includes accompanying questions that are informed by the identified principle and may shape the curation of video. In these examples found videos are outside video sources where created videos are those made by the course developer.

  • Balance: What is the intended balance between: Created and found curated videos? Permanent video and temporary (single-use) video content?
  • Emphasis: How does found video reinforce or extend created video? Is there a particular focus or intention of video use?
  • Movement: Is there a scaffolding of curated video that matches the scaffolding of the course progression? How does the video curation contribute to that progression?
  • Pattern: Is curated content focused, more general in nature, or quite diverse in source, topic or message? 
  • Rhythm: Does video use and viewing support or promote a rhythm of engagement for the course that compliments course objectives?
  • Repetition: Are curated videos reinforcing similar ideas or concepts? Are videos used consistently for certain aspects of the course (i.e., narrated lectures)?
  • Proportion: Does the video collection time commitment fit within the time expectations for the course? What is the ideal proportion of video to text, image, and other course media?
  • Variety: Are curated videos from different content sources and types? What is the ideal balance for the course?
  • Unity: Does the video collection promote a sense of wholeness to the course? Could the video collection, on its own, communicate identifiable ideas, patterns of ideas, or a range of perspectives on a topic?
    Does video accessibility contribute to the overall course accessibility?

In working through this exercise, we begin to move beyond video collecting by subject toward a more complete analysis of video collection selection and use that includes intertwined pedagogic and aesthetic considerations. This helps create a video collection that is intentional in its item selection, organization and use.

Final Thoughts

Recent research by Kaltura Inc. indicates that video use in education is on the rise in the past year. A continued growth of access to video and ability to create video coupled with an interest in integrating video in education efforts suggests course developers have a challenging task regarding media selection and use.

This article presents the idea that course developers, whether obvious or not, are actively engaged in a curatorial process regarding media selection and use. In addition, because of the importance and prevalence of video, its curation is presented as a key element of the larger course media curation effort. Lastly, we have explored how video collections contribute to academic and aesthetic value of a course and provided some key considerations based upon extending classic visual design principles to a curatorial practice.

It is interesting that the term curation has Latin roots in the verb curare; which means to take care of. Course developers conducting intentional video curation contribute to meaningful media curation for a course. This engagement in the practice of a curator is truly a professional act of caring about the quality of course development and the impact on student learning.

In Part II of this series we will address the practice of video curation in the context of an online course and explore instructional design considerations for video use that balance and complement a sample course video collection.

References

American Alliance of Museums. (2009). Curators Committee (CurCom): Curator’s core competencies. https://www.aam-us.org/professional-networks/curators-committee/ 

Kaltura Inc. (2020) The state of video in education 2020: Insights and trends [seventh edition].
https: //corp.kaltura.com/resources/the-state-of-video-in-education-2020/

Potter, J. (2017). Curation. In K. Peppler (Ed.), The SAGE encyclopedia of out of school learning (pp. 4-6). SAGE Publications Inc., Thousand Oaks, CA.

Shuey, G. (2014, October 21). The art of content curation. RELEVANCE.
https: //www.relevance.com/the-art-of-content-curation/

Wikipedia (n.d.). Definition of term collection.
https://en.wikipedia.org/wiki/Collection_(artwork)

Wikipedia (n.d.). Definition of term curator.
https://en.wikipedia.org/wiki/Curator

Video Resources 

Special thanks for the following individuals for their contributions to this article.

  • Chris Lindberg, Instructional Design Specialist, Oregon State University, Ecampus, Corvallis, Oregon.
  • Cody Rademacher, Curator, Holocaust Museum & Cohen Education Center. Naples, Florida.

Audio in Online Learning banner.

Audio is a term we all understand on some level. Commonly we think of audio as the transmission, reception, or reproduction of sound. Audible sound is what we hear. So, when we consider audio as an element of course design we are thinking about how sound can be used to communicate or support learning in an online course environment. Integrating audio in course delivery can be quite powerful if done well.

Perhaps the most common method of using sound in an asynchronous online course is via narrated lecture. The narrated lecture is typically a voice over a slide presentation or screencast. It can be an essential tool of instruction if designed effectively.

Another way the voice of an instructor can be incorporated into a course is via audio feedback on student assignments. These are short audio recordings that have been found to help build a sense of instructor presence in an online course.

Highly focused use of audio is also utilized in subjects where audio is, in essence, the topic at hand. Here we are considering language, music, and media arts courses as examples.

Other valued voices are often brought into the online learning experience via guest interviews in either audio or video format. Not to be left out, the voices of students are increasingly present in online course via tools such as VoiceThread and university provided video portals such as Kaltura Media Space. And with tools such as Zoom recording audio interviews and voice overs is easier than ever. With the availability of media platforms such as YouTube, Vimeo, Amazon Prime, Audible, and Apple Music and Podcasts the ability to bring external audio resources into the online experience seems almost limitless.

Audio is also used as a supporting resource for text-based content in online courses. In this case screen readers may typically provide the audio support. When using audio as a primary learning resource it is necessary to provide text-based transcripts as accessibility options. A fuller description of making audio accessible can be found at the W3C website.

The examples listed above are common ways we integrate audio elements into online learning. Are there other perhaps different ways we might consider? In the next few paragraphs we will explore a few ideas of how we might use audio in specialized ways in course design.

Specialized Audio Use

Orientation & Review Audio

Audio is a great tool to use when smaller segments of media should be used to orient students to a part of an online course. Think about short, more ephemeral, voice messages that can be easily produced and updated from term to term as the course changes. These audio segments need not be highly produced but should be of good quality. This type of audio segment reconnects students with the instructor via voice.

Listen to the orientation audio sample below that was used in an online course: RE 270 – Outdoor Recreation Resources, Behavior and Values | Module III Orientation by Dr. Craig Rademacher; Northern Michigan University c. 2012. (00:02:56).  [download orientation audio transcript  from Temi.com]

Similar short segments of audio may be used to review sections of content. The review audio may be produced by instructors or students. These audio reviews may be used in preparation for an exam, major project, or collaborations within the course. The goal of such reviews may vary but certainly one goal would be to re-focus the listener to the task at hand while providing timely tips or learning objectives.

One of the things you may have noticed about the audio clip above is the integration of music to the orientation message. Purposeful music selections can support the emotional feel of a course or module being introduced. Music can also serve as an audio cue, or audio branding, for a course. So, selecting audio stingers, or music introductions, can highlight that a particular message or topic is coming or reinforce an emotional tone if carefully planned.

The primary benefit of using audio for orientation and review is that audio is less production intensive making it a quick way to provide feedback. Audio is also fairly easy to edit with a free cross-platform audio tool such as Audacity.

Narrative

The oral traditions of learning go back centuries. Prior to print, learning was interwoven in spoken traditions, legends, and cultural stories. Today story remains a potent vehicle for learning. As you might imagine audio is a great vehicle for story.

An example of this is an Oregon State University political science course titled Governing after the Zombie Apocalypse which was designed and taught by Dr. Rorie Solberg. The story that underpins this course is that a natural disaster has caused the breakdown of the U.S. government. In response citizens must create a new government including a bill of rights and constitution. Students become the citizens creating that new government taking into account marginal populations such as the surviving zombies which are called “blues”due to their virus-caused color.

Audio is used creatively in the course by periodically inserting radio broadcasts about odd happenings around the country. Although not the heart of the effort of the course, these audio presentations, really imagined radio newscasts, provide situational tenor and decision points as students go about creating a new government. Listen to a segment of a mock radio broadcast below.

Mock radio broadcast excerpt: Story by Dr. Rorie Solberg. Produced by Oregon State University Ecampus. Voice acting credit: Warren Blyth (00:02:04)

This segment highlights how audio can be used to shape and carry a narrative through an online course. You might imagine how different narrative audio presentations may support history, literature, or science courses.

Soundscapes & Nature Sounds

Experiencing authentic places or environments is believed to be a valuable form of learning. This idea is a driving force behind field-based learning and experiential learning. Audio soundscapes provide access to authentic acoustic environments that can support online learning about the context of an environment. The environment may be urban, rural, or perhaps in a wilderness-like setting. Soundscapes may also be used to create sense of cognitive and emotional world building that can be used in instruction. Soundscapes typically feature a molar perspective of the acoustic environment.

Listen to an example of such a soundscape titled Elk Rut and Rain Shower — Rocky Mountain National Park in Colorado by Gayi immersions (00:28:03) at SoundCloud. (link will open in a new tab)

Other, more specific sounds of nature are potentially positive resources for online instruction. Below is a sound sample of the call of a common raven. Listen to the raven’s call.

Audio recorded in the Beaver Basin Wilderness at Pictured Rocks National Lakeshore in Michigan in 2010 | Craig Rademacher. (00:00:26)

Now imagine how this simple recording may be utilized in a course. It might be used to help identify ravens from crows in an ornithology course. Perhaps this audio clip could be used to help communicate a sense of isolation for listeners studying wilderness values. Or, perhaps it could be used to introduce the poem by Edgar Allen Poe titled The Raven. In each case the audio would be used intentionally to deepen the context or experience of the learner.

Fidelity Matters

Sound quality is an important factor when selecting and using audio in an online course. Audio files need to be of sufficient quality to clearly indicate what you are expecting students to hear. Poor audio, or a confusing sound recording, is experienced as distracting and student will likely tune out. Recording and editing audio does require some knowledge and practice. And there are many places where you can learn to produce audio. LinkedIn Learning offers courses in audio production, podcasting, and even how to select a microphone. So, if you are interested give it a try.

If you are not inclined to produce your own audio content there are resources available where you can find high quality audio for use in courses. Some of these resources are royalty free. Others may require licensing of audio for use.

Final Thoughts

We have reviewed how audio is commonly used in online courses and how we might think about new ways of integrating audio. As you explore the links to resources below start to think about your next course design. How can you augment the text and video you normally use with audio? How might you leverage voice, narrative, or soundscapes to connect online students to the context, authenticity, and humanity of learning? You might want to experiment with audio at first. Start small. If it works, then you will have truly found a sound idea for online course design.

Select Audio Resources

Royalty free online resources:

Podcast Resources
There are several ways to find audio podcasts to review for inclusion in a course. Apple Podcasts is a dominant resource in this area. Apple streams over 750,000 podcast shows with over 20 million episodes. Google Play Music is another good resource. Podcast feeds can also be found simply by browsing for podcasts online.

Audiobooks
Audiobooks are found in many online book seller sites such as Amazon (Audible.com). Additionally some more specific sites such as audiobooks.com also provide resources.

Soundscapes and Nature Sound Resources

 

**Special thank to Matt Djubasak and Chris Lindberg for their contributions to this post.

Awe – A Shared Uncommon Human Experience

Can you recall the last time you experienced awe? It is likely you can because awe is an emotion that tends to be a positive memorable experience. What were you doing during your awe experience? Did you learn anything from it? Do you still think about it? This post will profile the nature of awe and will conceptualize how we may integrate awe in learning design for online instruction. We will begin with exploring what awe is and how it occurs. Then our focus will turn to how awe might impact cognition and therefore learning. Lastly some examples of how awe integration might be conceptualized for online instruction and remote experiential learning.

 

Photo of the North Shore of Lakes Superior by Lawren Harris.
Figure 1. North Shore of Lake Superior by Lawren Harris (1926). Paintings are examples of art that may elicit the awe response. Photographed in situ by Craig Rademacher.

It is understood that awe is a common feeling associated with experiencing art, music, panoramic views, and other beauty (Keltner & Haidt, 2003). Awe is considered a positive emotion with a prototypical facial display (Shiota, Campos, and Keltner, 2003). Awe is a state experience that is differentiated from other positive emotions such as amusement, interest, love, joy, contentment, and  pride (Campos et al., 2013). As an emotional state it is transient but may produce feelings of transformation, or openness, due to its impact on cognition (Danvers & Shiota, 2017). Course developers and instructional designers often value new ways of creating learning experiences in course design. The nature of awe suggests it may be useful in that regard. Before we can integrate awe into online course design we must have a better understanding of how it occurs.

 

What Makes Awe Happen?

The awe experience is elicited by two key features in a stimulus: perceptual vastness and need for acommodation (Shiota & Keltner, 2007). Although perceptual vastness is often experienced when viewing grand landscapes, vastness may also be found in any stimulus that expands a person’s accustomed frame of reference.

From this perspective vastness may be understood as a function of space, time, number, complexity, ability, or the mass of human experience. Shiota and Keltner (2007) further suggest vastness may be implied by a stimulus, making even a mathematic equation feel vast due to its ability to explain a large number of phenomena. Even people like Henry Ford, Rachel Carson, Queen Elizabeth II, Nelson Mandela, and Bill Gates might elicit a sense of vastness due to their understood expansive impact on the lives of others and society.

 

Panoramic photo of a lone person standing in the vast landscape of Bad Water Basin in Death Valley National Park in California.
Figure 2. A hiker stands alone in the vast landscape of  Death Valley. Encountering vast landscapes like those in Death Valley National Park have the potential to elicit awe in park visitors.   Image by Craig Rademacher.

When facing this sense of vastness that challenges personal understanding, we adapt. Cognitive accommodation is a process of changing our thinking patterns, or frames of reference, in the face of perceptually vast stimuli. This differs from assimilation which brings a new experience in line with existing schemas or experiences. In contrast, accommodation stimuli reshape or alter existing cognitive schema. This sense of a need for accommodation is the second key feature of the stimuli that elicit awe.

 

How Awe Impacts Us

From a cognitive perspective awe occurs during the engagement with novel, complex, patterned information that is accessible yet, as previously has been stated, is outside a normal understanding of the world (Keltner & Haidt, 1999). This cognitive challenge creates a feeling of wonder and astonishment and humans respond (Shiota et al., 2017). Rather than depend on default cognitive frames of references  or scripts, awe encourages cognitive accommodation, prompting the taking in of new information to update understanding.

The accommodation process fostered by awe focuses a more detailed analysis of the information-rich stimulus under consideration. In this process individuals in awe shift their awareness away from normal concerns. In a sense, awe changes our vantage point to something greater than ourselves and opens the mind to new information, perspectives, and understandings.

Awe not only leads to new ways of processing information it also changes how we see the world, making life a richer experience. Research has shown that awe elicits self- relevant thoughts and connectedness leading to an experience of a “small self” (Nelson-Coffey et al., 2019). These self-transcendent feelings are positive and contribute to awe being an emotion that is pleasant and calming and inspires an interest in social responsibility.

 

Integrating Awe in Online Instruction

After an awe experience it is likely we have changed our thinking, feeling, and perhaps behaivor. Isn’t this one of the great purposes of education and a goal of learning? How might we leverage this awe in online instruction?

A recent op-ed by Goldie Blumenstyk in The Chronicle of Higher Education (2020) addressed the topic of what kind of higher education is needed now and beyond the current pandemic. Blumenstyk  identified a number of issues. Two are salient to a discussion of integrating awe into online learning. In brief these were:

  • A need for more applied learning that can be evaluated through guided reflection and mentoring to prepare students for careers of purpose in society.
  • Customized education, leveraging the online environment and technology that is both values-based and experiential.

As we have seen in the research, awe theory addresses the needs identified by Blumenstyk. Awe is a positive emotional experience that fosters personal reflection. It is individualistic, or personally customized, and inspires consideration of ideas and actions outside the self and increases prosocial behavior (Piff et al, 2015). It is clearly experiential in nature. Awe as a goal and vehicle for learning seems worth exploring. How might we integrate awe into course design and development of online instruction. Let’s look at three different examples as a starting point.

Example #1: Referencing Awe Experiences in Learning

One of the most obvious and perhaps easiest way to bring awe into online instruction is to have learners reference past awe experiences as part of their course work. This may seem daunting to faculty who cannot identify or manage what experiences will be brought forward. However, that is part of the benefit. Referencing awe experiences is a personal application of learned experience to the online environment. As an example, an instructor may post a discussion prompt that might look like this.

Discussion Prompt – Topic: Poverty and the Social Safety Net
For this assignment I would like you to recall a time you experienced awe. Where were you? How did you feel in that moment of awe? Did it change your perspective in any way? Once you have thought about your awe experience post a response to the following questions:

What ideas or feelings about your role in society are related to your awe experience? Are your beliefs about poverty and the role of government in providing a social safety net informed by your perceived role in society? How is your perspective aligned with government policies concerning social aide?

Although not completely fleshed out in terms of response posts or a rubric this discussion prompt encourages individualized learning related to the course topic of poverty in the local community. It encourages reflection, analysis, and logical comparison. It brings awe into the discussion as an individualized reflective element.

Example #2: Stimulate Awe Experiences in Learning

Research on awe has used writing about awe and video viewing to stimulate awe in study subjects. Stimuli that creates a sense of perceptual vastness and accommodation shapes the awe emotional response. Can we create these opportunities for students? Below is an example to consider.

Interactive Timeline – Topic: Anthropology and Early Human Migration
At Oregon State University we often use a proprietary timeline tool in online courses. The scale of this timeline can be varied and it typically is media enriched with images, video, text, and links. Any timeline can be built entirely by the instructor or students can contribute to the timeline as part of an assignment.

In this example of a senior level Anthropology course the instructor provides a timeline chronicling physical appearance of the Bering Land Bridge and the migration of humans across the land bridge into North America. The assignment may read something like what is seen below:

 

Illustration of the Beringia gene flow map.
Figure 3. Map of Gene Flow in Beringia. Some concepts include vast ideas such as the scale of geologic time. This too can elicit awe in learners. Erika Tamm et al / CC BY (https://creativecommons.org/licenses/by/2.5)

Paper Assignment Prompt

For this assignment review the contents of the Bering Land Bridge timeline that addresses the migration of humans in the Beringia region during the Ice Age. In your review pay close attention to the process of glaciation and how it impacts both the land bridge and human and animal migration patterns. Note the length of this time period.

Once your review is complete write a paper about Beringia and the scale of both the time period and human/animal migration. What impressed you about the history and geography of the migration? How does this migration inform your thinking about how species adapt to survive?

Although a cursory assignment, it illustrates an intent to engage students with the vastness of geology and geography and immense physical/cultural change over time. It also asks learners to reflect on new information and how it may inform current thinking about the human experience and nature. It is designed with an awe experience in mind. And it is presented and completed entirely online.

Example #3: Awe In Experiential Learning – Art Appreciation

In an earlier post on this site Rademacher (2019) described the process of experiential learning. That process is depicted in the experiential learning model below (Kolb & Kolb, 2018).

 

Model of the Experiential Learning Cycle.
Figure 4. Model of the Experiential Learning Cycle. Model depicts the four stages of the experiential learning cycle.

The starting point of the experiential learning process is the concrete experience. Incorporating awe into experiential learning is about designing learning that integrates an awe eliciting concrete experience. Once that is complete, then the experiential learning cycle can be completed. Interestingly, the four stages of the experiential learning cycle seem to parallel the awe experience process. In the table below, you can see the parallels that might be conceptualized. This teases the idea that awe may be an archetype of experiential learning.

 

Image showing the parallels between the Experiential Learning Cycle and the Awe Experience Process
Figure 5. Conceptual Parallels: The Experiential Learning Cycle and The Awe Experience Process.

So in this example the goal is to create a remote learning experience where students seek out a setting where they may, or have, experienced awe. As various forms of art elicit awe let’s use an art example.

Experiential Learning Assignment Description

The major assignment for this term is to examine the purpose of art in the human experience. Your assignment is to visit a local art gallery or museum of your choice. During your visit identify several art pieces that you feel inspired by. Spend focused time looking over and reading about your favorite piece of art. If permitted, take a photograph of that piece of art for future reference.

Compose a paper about your art experience. Before you write, reflect on how the artwork you photographed inspired you. With that in mind provide answers to the following questions:

  • Describe your thoughts and feelings about experiencing the artwork in person?
  • Did your understanding of art change from this experience? How?
  • How might you approach viewing art differently in the future?
  • How do you think your experience might be like that of other people viewing this art?
  • Describe how your art experience affirms or contrasts the purpose of art as defined by the authors of the course text.

Submit your paper via the learning management system by…

These three examples were provided as a way to begin thinking about how we might integrate awe as part of online instruction. Each example is incomplete and would need further details. Each does, however, provide a kernel of an idea of how awe integration might be pursued.

 

Final Thoughts

Awe is a common human emotion that has been shown to be important from the perspectives of spirituality, philosophy, health, wellness, and defining ourselves (Keltner, 2016; TED, 2016). This article posits that awe may also be valuable as a vehicle for online instruction and learning. As course designers we often look for ways to connect real life experience with the online learning environments. The conceptual parallels between awe and the experiential learning cycle highlighted earlier may be worth examining in greater depth.

In her 2016 TED Talk, awe researcher Lani Shiota defined awe:

Awe is an emotional response to physically or conceptually extraordinary stimuli that challenge our normal frame of reference and are not already integrated in our understanding of the world.

Shiota’s definition suggests that awe serves as a form of new learning originating from things we do not readily understand. Yet it is not simply taking in new knowledge, it is adapting to ideas and physical stimuli that we perceived as vastly bigger than our selves. It may prove valuable for course developers and designers to think about what awe opportunities might exist in the design of online instruction. We might begin that process by better understanding how awe shapes cognition and emotion. Integrating awe into online instruction could very well help online learners find the vastness and beauty of new subjects, new ideas, or new experiences.

 

References

Blumenstyk, G. (2020, April, 22). The higher ed we need now. Leadership & Governance | The Chronicle of Higher Education. Retrieved from https://www.chronicle.com/article/The-Higher-Ed-We-Need-Now/248591

Campos, B., Shiota, M.N., Keltner, D., Gonzaga, G.C., & Goetz, J.L. (2013) What is shared, what is different? Core relational themes and expressive displays of eight positive emotions. Cognition and Emotion, 27 (1), 37-52.

Danvers, A.F. & Shiota, M.N. (2017). Going off script: Effects of awe on memory for script-typical and irrelevant narrative detail. Emotion, 17 (6), 938-952.

Keltner, D. (2016, May 10). Why do we feel awe?. Greater Good Magazine.
Retrieved from https://greatergood.berkeley.edu/article/item/why_do_we_feel_awe

Keltner, D., & Haidt, J. (1999). The social functions of emotions at four levels of analysis. Cognition and Emotion, 13, 505–522.

Keltner, D. & Haidt, J. (2003). Approaching awe, a moral, spiritual and aesthetic emotion. Cognition and Emotion, 17 (2), 297-314.

Kolb, A. & Kolb, D. (2018). Eight important things to know about The Experience Learning Cycle. Australian Educational Leader, 40 (3), 8-14.

Nelson-Coffey, S.K., Ruberton, P.M., Chancellor, J. Cornick, J.E. & Lyubomirsky, J. (2019). The proximal experience of awe. Public Library of Science (PLoS One), 14 (5), p. e0216780.

Piff, P.K., Dietz, P., Feinberg, M., Stancato, D.M., & Keltner, D. (2015). Awe, the small self, and prosocial behavior.Journal of Personality and Social Psychology, 108(6), 883-889.

Rademacher, C. (2019, February 16). Experiential learning in online instruction. Ecampus Course Development & Training (Oregon State University). Retrieved from http://blogs.oregonstate.edu/inspire/2019/02/06/experiential-learning-in-online-instruction/

Shiota, M.N., Campos, B., and Keltner, D. (2003). The faces of positive emotion: Prototype displays of awe, amusement, and price. Annals New York Academy of Science, 1000, 296-299.

Shiota, M.N. & Keltner, D. (2007). The nature of awe: Elicitors, appraisals, and effects on self-concept. Cognition and Emotion 21 (5), 944-963.

Shiota, M.N., Thrash, T.M., Danvers, A.F., & Dombrowski, J.T. (2017). Transcending the self: Awe, elevation, and inspiration. In M. Tugade, M. N. Shiota & L. Kirby  (Eds.), Handbook of positive emotion (pp. 362–395). New York, NY: Guilford Press.

TED (2016). Why awe is such an important emotion | Dacher Keltner [Video] YouTube. https://www.youtube.com/watch?v=ysAJQycTw-0

TED (2016). Why awe is such an important emotion | Lani Shiota [Video] YouTube. https://www.youtube.com/watch?v=uW8h3JIMmVQ

The use of PowerPoint and other similar presentation software, as a visual foundation for recorded narrated lectures for use in online courses is pretty common. These slide-based presentations typically present a series of individual slides that contain titles, visuals, and descriptive text or lists of bullet points with an accompanying voice-over recording. Using this approach to online content presentation seems familiar as it is a technology enabled extension of the traditional slide-based presentations instructors have used in a live classroom lecture. But narrated lecture for online presentation has some structural differences.

Whether transitioning a classroom lecture, or creating a new narrated lecture for online use, instructors at Ecampus are also encouraged to rethink their slide-based presentations. The recommendation is to create highly focused content and keep the duration of an individual narrated lecture presentation to about 10 minutes. This means a typical 50 minute classroom lecture may transition to several online narrated slide presentations as it is distilled down to 2-3 highly focused segments. 

Including voice-over with a slide-based presentation builds instructor presence in an online course. Narrated lectures also incorporate best practices in accessibility, copyright, and visual formatting. In essence, this process takes a PowerPoint presentation, incorporates best practice elements, and adds narration. This new instructor narrated presentation becomes a multimedia learning element for their course that is delivered in video format.

Multimedia Learning Theory Redux

On the surface, all the previous work in creating a narrated lecture seems sufficient. However if we incorporate research on multimedia learning we may choose to do more with this staple of the online course; the narrated lecture.

In my previous article on the value of images in online learning I explained how online presentations that combine text, images, and titles are considered multimedia-based learning objects. Using written words with images on a PowerPoint slide with voiceover is also a form of multimedia learning. Given this it may be useful to revisit theory related to multimedia learning to see how it related to narrated lecture design. The model below illustrates how the Cognitive Theory of Multimedia Learning (Clark & Mayer , 2016) informs our understanding of multimedia-based learning.

Model of cognitive model of multimedia learning.
Figure 1. Model of the Cognitive Theory of Multimedia Learning

The model indicates that people (i.e., learners) have two channels of cognitive processing: 1) for processing visual/pictorial material and 2) one for auditory/verbal material. Additionally, humans can only process a few bits, or pieces, of information in each channel at the same time. Learner engagement with pictorial and verbal information is linked to an individual’s ability to parse information from the multimedia and ultimately integrate it with prior knowledge…creating new learning. That parsing is linked to two things: 

  1. How we structure and deliver information during the design of multimedia and 
  2. The learner’s ability to engage the information in a way that compliments learning.

Let’s stop here for a moment.

Now think about what you just did in reading the text above and looking at the illustration provided. In this instance you called upon a single information channel, the visual channel of cognitive processing, to interpret the meaning of the text description of the visual model. Was that an easy process for you?

How hard would it be for students to process similar information acquisition through one channel….vision only? With the cognitive theory of multimedia learning in mind ask yourself this…How would adding audio narration impact cognitive processing? How would that impact learning? Let’s explore these ideas in the context of narrated lecture design.

Five Guiding Multimedia Principles

In an article titled Information Design with Teaching and Learning in Mind, Rune Petterson and Maria Avgerinou (2016) identify 12 important principles teachers should take into account when designing multimedia-based learning experiences. I have organized these multimedia-based learning principles into three sections in the table below. As you read through these 12 principles it becomes clear that not all of these apply to narrated lecture design.

Listing of the 12 principles of multimedia-based learning.
Figure 2. Twelve Principles of Multimedia – Based Learning Design

Principles 1-4 address more general, or global, understandings about multimedia design and learning. Principles 5-7 address design factors directly related to combining text and images without narration in multimedia-base learning. The last five principles (i.e., 8-12) address how the spoken word is best integrated into multimedia design to be consistent with the cognitive theory of multimedia learning. Although all the principles are important to multimedia design for learning, the last five guiding multimedia principles are the most salient for narrated lecture design.

From Theory To Practice

Remember, the goal for instructors is to develop narrated lectures that enhance the multimedia-based learning experience. It is not simply to create a replication of the in-class lecture. Let’s look at the five guiding multimedia principles and how the ideas in the principles might shape how you can prepare your narrated lectures as online multimedia learning elements.

Temporal Contiguity Principle

This principle suggests that the most effective designs using narration and graphics place those two elements in temporal proximity. They are seen and heard at the same time. Seems obvious. But you must think through this principle and plan the sequencing and duration of  slides and narration accordingly. You must know what you want to say and when to say it in the context of the visual elements you have on your slides.

Modality Principle

This principle affirms that presenting words as audio narration is more impactful than written text in describing graphics on a slide. They are particularly impactful when paired with animations.

In essence this principle helps guide design that takes advantage of both channels of information processing. This also helps manage cognitive load by freeing learners from trying to interpret written text and images via the visual channel only. If you absolutely have to use text with graphics on your PowerPoint slides keep text in short phrase form to avoid extensive reading and any potential cognitive overload.

Redundancy Principle

This principle proposes addresses presenting narration and written text that says the same thing combined with images. The redundancy principles guides designers to select either narration or written text with the image on a slide for the best learning experience. Choose one method of delivering the word-based description of the image. Don’t use both. 

Once again this principle is about managing, through design, the cognitive load of the media element. There are some complex scenarios where text only is a best option…see the Control of Processing definition.

Coherence Principle

This principle simply states that adding interesting, but non-essential, visual or word content can hurt learning. Narrated lecture design should avoid placing funny phrases, decorative images, excess lines, colors and sound effects and music that does not directly relate to the learning at hand of any particular slide. 

Instructors should know what they want to say and design to maintain keep cognitive focus on that learning. We sometimes think these extra element keep attention but actually the opposite is true…they clutter and create distracting cognitive load.

Sometimes this principle is not fulfilled through good intentions. It often occurs when instructors wish to have multiple images of something on the same slide. Then they talk about each image individually in narration. It is much better design to put those extra images on a new slide and talk about it when it is the focus of the learning. This avoids visual overload and helps keep the pace of your presentation moving.

Personalization Principle

Creating a social conversation with learners softens the experience of learning via devices. It also helps build instructor presence in a lesson and the course. One of the best ways of achieving this via narration is to use a conversational tone.

Conversational tone in everyday life comes from an interaction that is authentic and casual. That is difficult to achieve in narration. Professional actors train to do this. Faculty at Ecampus are often provided with narration tips to help in this regard. Narrators are encouraged to have notes that guide their presentation but not encouraged to read a script verbatim. Not surprisingly, reading a narration is easily detected by the listener’s ear. You can personalize your narrated lectures by knowing what you want to say, practice it so you know when to say it, then just be yourself and let your personality come through.

Applying the personalization principle in design means thinking through and planning your conversation with the remote audience. Then practicing the delivery so it feels conversational. Learners will benefit from this narration design strategy.

Final Thoughts

Earlier in this article we posited that new learning is predicated upon the structure and delivery method of information to learners as well as the learner being able to engage with the provided information in a way that supports learning. In a very simple way we are saying that good design for learning presents content clearly and does not create barriers to information engagement by leaners.

Instructors are correct that it is good to focus initial narrated lecture design on the slide presentation preparation that reflect best practices in accessibility, visual formatting, copyright, and more. It is also valuable to think through the narrated lecture design in terms of cognitive load, potential barriers to learning, and how to positively impact the learner’s information processing.

The five guiding principles for narrated lectures help instructors identify ways in which they can design and intentionally use audio narration with text and images that compliments an understanding of cognitive learning theory. In doing so they create online narrated lectures that are more effective as multimedia-based learning experiences.

References

Clark, R. C., & Mayer, R. E. (2016). E-learning and the science of instruction : Proven guidelines for consumers and designers of multimedia learning. Retrieved from http://ebookcentral.proquest.com

Rune Pettersson & Maria D. Avgerinou (2016) Information design with teaching and learning in mind, Journal of Visual Literacy, 35:4, 253-267, DOI: 10.1080/1051144X.2016.1278341

What’s An Image’s Value?

Image of postcard with a picture is worth a thousand words written on it.

Have you ever created an online course without using images? No?

That is not surprising as images can convey emotions, ideas, and much more. Their value is often captured in an old adage: A picture is worth a thousand words.

This article will discuss the value of images in online course design and how using visuals to accompany instruction via text or narration might contribute to or detract from an online learning experience. Let’s begin.

Multimedia Learning: Images, Text, and More

Online learning is a modern form of multimedia learning. Richard Mayer (2009) described multimedia learning as that learning that integrates the use of words and pictures. In traditional classrooms these learning resources might be experienced as: 

  • Textbooks:  Text and illustrations.
  • Computer-based lessons: Narration w/animation
  • Face-to-face slide presentations: Graphics and audio.

In online learning multimedia may also include:

  • eBooks: Text and digital images 
  • Video: Text, images, animations, coupled with audio.
  • Interactives: Maps, images, and video.
  • Digital Visual Representations: Virtual worlds and 3D models.
  • Screencasts: Software demos, faculty video feedback, and more.
  • Audio: Enhanced podcasts or narrated lectures.

These two short lists, although not exhaustive, demonstrates the importance of visual elements to multimedia based learning in online courses. There are many reasons why we might include any one of these multimedia learning experiences in an online course. For our purposes we will explore a bit more the instructional value of visuals to online learning.

So, how do words and pictures work together to help shape learning? Given that this is perhaps the most common learning object used in an online course it would seem useful to understand what may be considered this simple interpretation of visual literacy for learning (Aisami, 2015).

Visual Engagement Of A Learning Object

In a recent study of how people acquire knowledge from an instructional web page Ludvik Eger (2018) used eye tracking technology to examine a simple learning object composed of a title (headline), a visual element (i.e., diagram), and a box of written text. With no audio support for the learning object in this study, participants engaged the content via visual engagement alone. Results indicated that the majority of students started their learning process at the headline or the headline and visual element. The box of information, in text form, was the third part of the learning object engaged.

Within this context eye movement analysis indicates a learning process that is dependent upon a consistent visual flow. Purposely connecting the title, visual element and information text of a learning object may best reinforce learning. By doing this the course designer/instructor becomes a sort of cognitive guide either focusing or not-focusing learning via the meaning structure of the various learning object elements. In our case we want to use visual elements to support performance and achievement of learning tasks.

Choosing Visual Elements

In order to explore the choice of visual elements in an online learning experience it is helpful to understand how we process that experience from a cognitive science perspective.

Clark and Mayer (2016) describe that cognitive science suggests knowledge construction is based upon three principles: Dual channels, limited capacity and active processing. Let’s briefly examine what these are.

Dual channels:

People have two channesl of cognitive processing 1) for processing visual/pictorial material and 2) one for auditory/verbal material. See Figure 1.  below.

 

Model of cognitive model of multimedia learning.
Figure 1.: Model of the Cognitive Theory of Multimedia Learning

Limited capacity:

Humans can only process a few bits of pieces of information in each channel at the same time.

Active processing:

Learning occurs as people engage in cognitive processing during learning. This may include attending to relevant material, organizing that material into a coherent structure, and integrating that material with prior knowledge.

Due to the limits on any learner’s processing capability it is paramount that we select visual images that help manage the learning process. Our goal is to limit excessive processing that clutters the learning experience, build visual support for representing the core learning process, and provide visual support that fosters deeper understanding of the learning at hand. What does this mean in practice?

Managing Processing Via Image Use

Making decisions about image selection and use is a key to managing this learning process. Understanding the meaning of images to select is also key and is really a function of literacy in one’s field and visual literacy in general (Kennedy, 2013).

In practice we can use the following guidelines to make decisions about image use in multimedia-based online learning. 

  • Control Visual Elements – Too many images on a web page or slide may force extraneous cognitive processing that does not support the instructional objective. 
  • Select Visual Elements Carefully – Images difficult to discern are likely to negatively impact learning. Think about good visual quality, emotional and intellectual message of the image, information value, and readability.
  • Use Focused Visual Elements – Target selection of visual support to those images that represent the core learning material and/or provide access to deeper understanding of that core content.

Other Image Tips

Emotional Tone: Emotional design elements (e.g., visuals) can play important roles in motivating learners and achievement of learning outcomes (Mayer, 2013).

Interest: Decorative images may boost learner interest but do not contribute to higher performance in testing (Mayer, 2013). Use decorative images prudently so they do not contribute to extraneous learning processing (Pettersson & Avgerinou, 2016).

Challenge: Making image selections that contribute to a degree of confusion may challenge learnings to dive more deeply into core learning. This is a tenuous decision in that challenge in sense making may prove to foster excessive processing.

Access: Images must be presented in a format that is viewable to users to be practical. This involves an understanding of technical features of image formats, download capability, mobile use, and universal design techniques.

Final Thoughts

It is valuable to remember that visuals communicate non verbally. They are most effectively used when carefully selected and paired with text or audio narration. Visuals appeal to the sense of sight. They have different classifications and could be pictures, symbols, signs, maps graphs, diagrams, charts, models, and photographs. Knowing their form, meaning, and application is part of being a visually literate course developer or instructional designer.

Web Resources

References

Aisami, R. S. (2015). Learning Styles and Visual Literacy for Learning and Performance. Procedia – Social and Behavioral Sciences, 176, 538-545. doi:10.1016/j.sbspro.2015.01.508

Clark, R. C., & Mayer, R. E. (2016). E-learning and the science of instruction : Proven guidelines for consumers and designers of multimedia learning. Retrieved from http://ebookcentral.proquest.com

Eger, L. (2018). How people acquire knowledge from a web page: An eye tracking study. Knowledge Management & E-Learning: An International Journal 10(3), 350-366.

Kennedy, B. (2013, November 19). What is visual literacy?. [Video file]. Retrieved from https://www.youtube.com/watch?time_continue=1&v=O39niAzuapc

Mayer, R. E. (2009). Multimedia learning (2nd ed.). New York: Cambridge University Press.

Mayer, R. E. (2014). Incorporating motivation into multimedia learning. Learning and Instruction, 29, 171-173. doi:10.1016/j.learninstruc.2013.04.003

Rune Pettersson & Maria D. Avgerinou (2016) Information design with teaching and learning in mind, Journal of Visual Literacy, 35:4, 253-267, DOI: 10.1080/1051144X.2016.1278341

 

Credit: Embedded image by Kelly Sikkema on Unsplash.com

Image of mountaineers with quote by John Dewey.

What is Experiential Learning?

You may have heard the terms experiential education and experiential learning. Both terms identify learning through experience as a foundational understanding. However, experiential learning is associated with individual learning.

Traditionally experience-based learning in higher education has been presented as educational opportunities complimentary to classroom instruction. These experiences might include clinical experiences, cooperative education experiences, apprenticeships, fellowships, field work, volunteerism, study abroad, practicum and internships, service learning, and student teaching experiences. These types of learning experiences are offered in and across many different disciplines (Giesen, 2012). These familiar experiential education programs demonstrate the value of individual experiential learning. But, the question remains: Is experiential learning a viable approach for online instruction?

Understanding the potential for experiential learning for online courses turns upon recognizing experiential learning as a process. The experiential learning process has been described as a cycle of learning (Kolb and Kolb, 2018). The model below illustrates The Experiential Learning Cycle.

Model of experiential learning showing sequence of Concrete Experience, Reflective Observation, Abstract Conceptualization, and Active Experimentation.

Experiential learning is understood as constructive pedagogy approach that is highly student centered. The Experience Learning Cycle begins with a concrete experience of some kind. Commonly we think of this as a real world event. That experience is followed by reflective observation of the experience, abstract conceptualization of what was learned, and the application of new learning via active experimentation. That experimentation is integrated as part of the next concrete experience.

The interactive and progressive nature of the experiential learning cycle is considered a driver of personal growth and development. The dialectics between concrete experience and abstract conceptualization as well as reflective observation and active experimentation are theorized to drive motivation for learning. 

Online Experiential Learning In Practice 

Problem-based learning, case-based learning, and  project-based learning are examples of design models that may include learning via experience in the real world (Bates, 2014). These models are often used as a way of bringing engagement into online instruction. So, if you have been incorporating these models of learning in an online course you are engaged at some level with experiential learning. But, what if you wanted to design an experiential learning assignment that does not fall within one of these models?  What might that look like?

Let’s examine the application of the experiential learning cycle to an online learning experience in a course recently offered through Ecampus at Oregon State University. The asynchronous course, Introduction to Organic Agriculture Systems, is a survey style course with an enrollment of students from Oregon and more distant.

Let’s step through The Cycle of Experiential Learning with an assignment from this course as our sample context. Hopefully it will reveal some insights into both the process of experiential learning and its practice.

1. Concrete Experience

The concrete experience for this course was an organic scavenger hunt assignment that was to be completed in the first week of the course. Although the overt activity of was a guided scavenger hunt the learning experience focus was to begin to learn systems thinking in organic agriculture. This is important to identify, as it is the authentic learning goal of the experiential learning.

As the professor framed this assignment: “This introductory activity will provide you the opportunity to explore organic availability, marketing, and farming in your community.”This concrete experience is the direct experience of organics in the student’s community.

The objectives of the scavenger hunt were to:

  • Identify organic products and marketing techniques that differentiate organic from conventional products
  • Conduct a survey of organic availability in your local store and region
  • Participate in hands-on exploration of different components of the organic system

Students were provided with a detail scavenger hunt instruction set and told to complete there first part of the assignment in a local store using an organic scavenger hunt questionnaire-work sheet. Time estimates for completion of the scavenger hunt was up to three hours at the store site. Completed work sheets were turned in to the instructor.

The key to this assignment is the real life exploration of the local organic system. Although this will be elaborated on in subsequent weeks of the course, this concrete experience will become a touchstone students can reference as they build new knowledge and skills in systems thinking in organic agriculture.

2. Reflective Observation

Part 2 of the scavenger hunt assignment includes independent student work guided by questions that ask about the presence of organic farms in the student’s area, type of organic farms, scale of the farms and evidence of their independent research work.

This element of the assignment encourages students to search for, identify, and reflect upon gaps in the local organic system in their own backyard. This work encourages students to reflect upon their own concrete experience, the quality of their work, and its linkage to understanding systems thinking.

3. Abstract Conceptualization

In week three of the course students were assigned a course discussion to share their findings from the scavenger hunt with peers. Here they compare and contrast their scavenger hunt findings and observations. In particular, students were asked to connect the social, environmental and economic dimensions of sustainability in organic agriculture to their observations taken from the scavenger hunt experience. Additionally students were asked to review other student work from different locals and explore common understandings about organic agriculture systems.

The value of this exercise from an experiential learning perspective is the application of concrete experience to more abstract concepts described by others or found in other agricultural regions. This provides opportunities for the re-conceptualizing of prior experiences with the goal of expanding on the process of organic agriculture systems thinking.

4. Active Experimentation

The Cycle of Experiential Learning rounds out with planning and applying new learning about organic agriculture systems thinking to a future concrete experience. Abstract conceptualization completed in the previous discussion will contribute to the formulation of new questions and ways of examining a local organic agriculture system. Students will likely apply these ideas to ongoing organic agriculture systems thinking in the course. In this way prior reflective observation becomes the root of new questions and predicted results for the next learning experience in organic agriculture systems thinking.
 

Final Thoughts

The final project of this course is the production of an organic systems map that explains the relationships between organic system stages (i.e., production, processing, distribution/marketing, consumption, and waste) and the dimensions of sustainability (ie. social, environmental, and economic).

In order to complete the final project students learn a great deal between their initial scavenger hunt and the final project. Their original concrete experience in systems thinking will likely inform decisions about how to re-apply new organic agriculture systems thinking.

The experiential learning assignment we just examined only works if students perceive that moving through the cycle of experiential learning addresses an authentic learning need. As the course is focused on introducing organic agriculture systems the idea of learning systems thinking makes sense. It captures the fundamental truth of what is expected to be learned (Jacobson, 2017) making the learning appropriate.

What Now?

As you explore the possibility of using experiential learning in your online course it is valuable for you to first consider formulating answers to a number of questions.

  • What is the authentic learning needed?
  • What concrete experience provides students with access to that learning? 
  • How will students carry that concrete experience through the cycle of experiential learning?
  • How will you provide the opportunity for concrete experiences for remote learners in a way that fosters individual learning and contributes to large scale learning in the course?

As you explore experiential learning for your online course revisit the model shared in this article. For help in this process contact your Ecampus instructional designer. They can help focus the key questions and suggest instructional strategies and tools to help you achieve your online experiential learning goals.

 

References

Bates, T. (2014). Can you do experiential learning online? Assessing design models for experiential learning. Retrieved from https://www.tonybates.ca/2014/12/01/can-you-do-experiential-learning-online-assessing-design-models-for-experiential-learning/

Dewey, J. (1938). Experience and Education. New York: Simon and Schuster.

Giesen, J. (2012). Experiential Learning. Faculty Development and Instructional Design Center, Northern Illinois University. Retrieved from https://www.niu.edu/facdev/_pdf/guide/strategies/experiential_learning.pdf

Jacobson, J. (2017). Authenticity in Immersive Design for Education. In Virtual, Augmented, and Mixed Realities (Ch 3). Singapore, Springer Nature.
Retrieved from https://link.springer.com/book/10.1007%2F978-981-10-5490-7

Kolb, A. & Kolb, D. (2018). Eight important things to know about The Experience Learning Cycle. Australian Educational Leader, 40 (3), 8-14.


Experiential Education Resources

Association for Experiential Education
http://www.aee.org/ 

Journal of Experiential Education
http://www.aee.org/publications/jee 

Experience Based Learning Systems Inc.
https://learningfromexperience.com

Experiential Learning & Experiential Education
http://www.wilderdom.com/experiential/

One of the common ideas instructors have to bolster student-content engagement in a course is to add media. Podcasts are a type of media element that can support learning in a number of ways. It is relatively easy to link to an established podcast. Planning and producing your own podcast is more involved. This post explores the idea of producing a podcast for your online course. Is it something you should consider?

Prior to diving into the value and purpose of podcasts it is useful to understand what a podcast is…and what it isn’t.

The term podcast is a portmanteau of “iPod” and “broadcast”. This blended word says a lot because a podcast is a digital recording that is produced for distribution to a computer or mobile device (e.g., the iPod in 2005). Podcasts are distributed via RSS feeds that users subscribe to. Podcast directories, like iTunes®, allow users to find and subscribe to a podcast. Generally podcasts are episodic and often serial in nature with new episodes delivered automatically to subscribed users as the new content becomes available.

So, you can see a course podcast is more than an audio or video file embedded in an online course that students click on to engage with. In its ideal form, a podcast is a method of delivering course content to a learner’s mobile device via the podcast subscription process. Learners can engage with that content at any time and any place they have their mobile device.

Banner showing cover art from four OSU podcasts
Sample cover art from select Oregon State University podcasts.

Audio, Video, or Enhanced Podcasts

There a three primary formats of podcasts. Links to examples of each type of podcast are provide at the end of this article.

  • Audio: This type of podcast distributes digital audio files to listeners
  • Video (vodcast): This podcast type distributes a digital video file to podcast watchers.
  • Enhanced: The enhanced podcasts distributes a media file that displays images synchronized with audio. 

Instructional Use & Value
With mobile devices pervasive in college audiences, being able to distribute educational content to those devices is very attractive. The use of podcasts in online learning environments is common and spans many disciplines (Supanakor-Davila & Bollinger, 2014). Podcasting has also been applied in traditional college courses (McGarr, 2009) and in graduate teaching (Luna & Cullen, 2011). Fernandez, Sallan and Simo (2015) recognized podcasting as a major phenomenon in education with the primary purpose being the distribution of course content.

The purpose of podcasts in instruction varies by podcast type and author. Podcasts can be used to inform, provide analysis, develop skills and knowledge, motivate, mediate and more (Carvalho et al., 2009). Common types of podcasts produced for educational use include:

  • Informative: Description fo concepts, analysis, synthesis, readings etc.
  • Feedback: Audio or video feed back for student work or group work.
  • Guides: Helpful media content addressing field or practical work, studying, group dynamics and reflective or experiential learning.
  • Authentic: Original media contend such as news, interviews, radio programming and others.

The production of podcasts can be faculty, student, or outside expert driven. Like any good media production it should have excellent production value and a structure to hold attention and enhance learning. Since podcasts are serial in nature shorter media segments are encouraged. Episodes of 15 minutes or less will likely promote better engagement with podcast content. Although a very engaging podcast can be longer.

The benefits of podcasts in online courses are tied to the nature of the media and distribution process. Audio podcast are popular because they can be listened to while doing other tasks. Additionally the speed of media playback can be controlled by the listener. Video podcasts are ideal when visual support is necessary to foster understanding of the course content. As mobile media podcasts may be used to facilitate and support remote field work by students or even tours of remote places. The ability to watch or listen to podcasts via WiFi or downloaded and used on-demand makes podcast a convenient asynchronous media adjunct to an online course.

So, as a course content delivery mechanism podcasts are a unique tool if applied thoughtfully. Understanding podcast types, formats, and their delivery mechanism helps you make better decisions about podcast application.

Research in Action sound wave image.
Visit the Research in Action podcast website at Oregon State University to listen to this episode and see how transcripts are shared.

Accessibility
Making content accessible when using podcast requires some planning and also reflects the nature of the podcast media you plan to use. For audio podcasts it is important to provide transcripts to support all learners. 

Video podcasts are best paired with well synchronized captions. When planning video podcast you may also want to think about providing audio descriptions of content that provides important information that is shown as a visual in the video.

Podcast Consumers: Is This Your Audience?
This is an important question. If you produce a podcast are learners likely to engage with it? Is podcasting on the radar of potential learners?  The Edison Research survey on The Podcast Consumer (2018) indicates that 26% of those surveyed listen to podcasts monthly. The podcasting audience by age shows that  30% of  12-24 year olds, 32% of 25-54 year olds, and 13% of 55 + year olds have listened to a podcast in the last month. Male and female listeners are about evenly split in podcast engagement. Smartphone and other mobile devices make up 76% of podcast listening devices with computers making up 24% of podcast engagement. The top three locations of podcast engagement are at home (82%), followed by in a car/truck (54%), and walking or on foot (41%). Podcasting seems well suited to reach audiences that are remote, mobile, and consume media in an asynchronous fashion. These are also common descriptors of online learning audiences.

A Podcast For Your Course?
If a podcast sounds interesting to you contact your instructional designer at Ecampus. They can help you understand more about this mobile media opportunity and help think through strategies for effective podcast use. They will also work with Ecampus multimedia developers to help facilitate the production and distribution of your podcast. 

So, what do you think? Can you imagine your students engaging with course content as a podcast? Could a podcast work in your online course?

Links to sample podcasts in iTunes

Notes: 

  1. Enhanced podcasts are best viewed on a mobile device although they can be viewed in iTunes once downloaded.
  2. Prior to 2017 educational podcasts were distributed by Apple via iTunes U. With changes in iTunes educational podcasts now appear in the podcast section of iTunes and iTunes U was discontinued.


References

Carvalho, A. A., Aguiar, C., Santos, H., Oliveira, L., Marques, A., & Maciel, R. (2009). Podcasts in higher education: Students’ and lecturers’ perspectives. In A. Tatnall & A. Jones (Eds.), Education and technology for a better world (pp. 417-426). Boston: Springer Berlin Heidelberg. doi:10.1007/978-3- 642-03115-1_44.

Fernandez, V.; Sallan, J.; Simo, Pep. Past, present, and future of podcasting in higher education. In L., Many & Y. Zhao (Eds.). Exploring learning & teaching in higher education pp. 305-330. Berlin: Springer, 2015,.

Luna, Gaye, & Cullen, Deborah. (2011). Podcasting as Complement to Graduate Teaching: Does It Accommodate Adult Learning Theories? International Journal of Teaching and Learning in Higher Education, 23(1), 40-47.

McGarr, Oliver. (2009). A Review of Podcasting in Higher Education: Its Influence on the Traditional Lecture. Australasian Journal of Educational Technology, 25(3), 309-321.

Supanakorn-Davila, S., & Bolliger, D. (2014). Instructor Utilization Of Podcasts In The Online Learning Environment. Journal of Online Learning and Teaching, 10(3), N/a.

Webster, T. (2018). The Podcast Consumer. Retrieved from http://www.edisonresearch.com/podcast-consumer-2018/

 

Guest Expert Video: Post Production

Having a guest expert video in your Ecampus course provides a number of learning benefits. One important benefit is to introduce a second, collaborative voice to instruction (Last, 2015). In Part I of this two-part article series we address interview planning decisions and their relationship to producing an engaging guest expert video.  In Part II we explore the value of instructors collaborating in the post production stage of guest expert interview video editing.

Staging the video capture of an outside expert voice was the focus of the first article on this topic in a previous blog post. Once primary and B-roll video is captured it needs to be compiled and arranged into a coherent presentation for your course. This is where working with an Ecampus video editor comes into play.

Students see an enormous amount of video in their academic experience. Developing video content that is focused, tightly packaged, and presented in an interesting fashion makes your guest expert video worth watching. The ultimate purpose of editing your guest expert video is to ensure it contributes to the learning objectives of your course. This is why faculty, as subject matter experts, become valued collaborators in the editing process.

Editing Is….Editing

Faculty have extensive experience in editing of papers and manuscripts. These familiar skill can translate to video editing. Let’s look at some of the primary roles of a video editor. A video editor…

  • Uses an mixture of artistic and technical skills to assemble shots into a coherent whole.
  • Has a strong sense of pace, rhythm, and storytelling.
  • Works creatively to layer together images, story, dialogue, and music.
  • Reorders and tweaks content to ensure the logical sequence and smooth running of the final video product.
  • Determines the quality and delivery of the final product.
  • Serves as a fresh pair of eyes on shot material. (Wadsworth, 2016)

Instructors are engaged in similar processes when planning lectures or writing manuscripts. They often are making decisions about coherent writing, related pace and rhythm, creative approaches to communicating complex ideas, the logic of a narrative, quality of communication, and have developed a careful eye for the effectiveness of the final product. What faculty may not bring to the video editing process is an understanding of the technical nature of video editing or the language of screen-based video communication.

Instructor as Co-Editor

Once your guest expert interview video clips are recorded Ecampus videographers coordinate the editing process. An Ecampus video editor compiles the final video sequence, optimizes sound, and perhaps music, graphics, and text elements are added. Decisions about these video elements is a creative and interactive exchange of ideas as editors and faculty collaborate through Frame.io. Frame.io is a post production tool that permits precise editing and video annotation at the frame level of a video. A sample of a Frame.io editing session can be seen in the screenshot below.

Using the web-based interface of Frame.io an instructor is invited to contribute comments or edits for specific locations in a video timeline. Ecampus editors then incorporate suggested changes and pose other suggestions. The progression of this collaboration is seen by both participants and the process leverages the skills and knowledge of video editors and content experts. In essence the course instructor becomes a co-editor of the video being edited.

The Final Product

In Part I of this series a course designed by Dr. Hilary Boudet was involved in planning a guest expert video for her course. Dr. Boudet used Frame.io to help Ecampus editors shape the final video presentation for her course. Watch the PPOL 441/541 guest expert video again. Before you do think about the role a video editor plays in creating the final guest expert video. Also consider what Dr. Boudet might bring to the editing process as a subject matter expert. Can you see evidence of this collaboration in the final video product?

In a well planned and edited video production the skill sets of videographer and content expert blend to create a coherent narrative video that presents a focused and quality viewing experience. As course instructors Ecampus faculty are engaged in the planning and staging of a guest expert video. It is in the post production process of video editing that the initial vision of the guest expert video content, as a series of carefully planned video recordings, comes to life and helps fulfill the learning outcomes of a course.

Resources:

  • Laist, R. (2015). Getting the Most out of Guest Experts Who Speak to Your Class. Faculty FocusHigher Ed Teaching & Learning. Retrieved from https://www.facultyfocus.com/articles/curriculum-development/getting-the-most-out-of-guest-experts-who-speak-to-your-class/
  • Wadworth, C. (2016). The editors’s toolkit: A hands-on guide to the craft of film and TV editing. New York: Focal Press – Taylor & Francis Group.(Available in the Valley Library as an ebook)
  • Frame.io video review and collaboration software.

 

 

This article is the first of a two-part series on producing video interviews featuring guest experts for online courses. Part I focuses on planning while Part II will address the faculty role in the video interview production process.

Part I: Planning With A Purpose

Interviews of guest experts are valuable forms of course media because they can serve a number of instructional purposes. Traditionally classroom instructors might consider including guest experts as part of instruction to…

  • Connect learning with an authority in the field.
  • Communicate what the practices are in a given field.
  • Describe the nature of work of a professional in a given field.
  • Show important work environments or processes.
  • Introduce a second, collaborative voice to instruction (Laist, 2015).

One of the common ways instructors incorporate the expert’s voice into a course is by inviting a guest speaker into the classroom. Or, class members might travel to a field location where the person being interviewed works. In both cases the experience of the guest expert interview is live and located where the interview occurs. The synchronous live interview, a staple of on-campus courses, is problematic for online instruction.

Online instruction is shaped by the nature of the online environment. Asynchronous class sessions, the remoteness of learners, and limited access to field sites would seem to limit the use of guest experts. Ecampus instructors are moving beyond those limitations by creating carefully planned and professionally produced video interviews of guest experts in order to leverage the instructional benefits of interviews for their online courses. An example of this is a media project produced for Dr. Hilary Boudet’s course PPOL 441/541 Energy and Society, offered by Oregon State University’s School of Public Policy.

Dr. Boudet worked with the Ecampus video team to re-imagine a traditional live field site visit to the O.H. Hinsdale Wave Research Lab at Oregon State University as a series of guest expert video interviews. Dr. Boudet carefully planned the interview process and served as the on-camera host in the video interview series. Three OSU scientists served as the guest experts in the on-site interviews. Because of careful planning, primary interviews and recording were completed in half a day.

The guest expert interview recordings, and subsequent video editing, resulted in the production of four videos ranging in length from ten to twenty minutes each. The interviews represent approximately one hour of video content for the PPOL 441/541 Energy and Society course. You can view the first of the four video interviews by clicking on the image from the video below.

 

Image of Dr. Boudet and Pedro Lomónaco
Hilary Boudet interviews guest expert Pedro Lomónaco.  Click on image to watch the video.

 

As the video interview planner, Dr. Boudet made a number of key decisions regarding video interview structure and content. We will highlight these decisions as answers to the 5 W’s of video interviews: Who, What, When, Where, Why and also How.

You may want to think through answers to these questions when you plan a similar project. Let’s take a look at each of these questions in the context of the PPOL 441/551 video.


Why are you doing the video interview?

In the case of PPOL 441/541, Dr. Boudet wanted to capture the instructional value of a field site visit and conversations with scientists related to that site. So being on location was essential. She wanted to show the O.H. Hinsdale Wave Research Lab and use it as a vehicle to discuss how the lab and Oregon State University researchers contribute to the larger social conversation about wave energy and social issues related to its use in coastal communities.


What is the subject of the video interview (s)?
Dr. Boudet identified four independent but related topics she wanted to address with the guest experts. The topics are listed below.

  • Introduction to the O.H. Hinsdale Wave Research Lab
  • Introduction to Wave Energy Technology
  • Human Dimensions of Wave Energy
  • Community Outreach and Engagement

Each of these topics fits well within the learning outcomes for the Energy and Society course. In this instance, Dr. Boudet had a clear story arc in mind when selecting topics. She structured the video segments to address each topic and conducted each interview as its own story that supported the larger learning arc. Having a clear vision for the use of guest expert video interviews helps guide video production on-site and also informs the final video editing process.


Where will the interview be recorded?
Prior field visits to the O.H. Hinsdale Wave Research Lab helped Dr. Boudet work with both the guest experts and video production team in thinking through locations for interviews and what needed to appear in the video. Understanding the O.H. Hinsdale Wave Research Lab also helped in deciding what aspects of the lab and props would be ideal to record for each video interview. It is clear What and Where are two closely related planning questions. In general on-site video production requires a large space for staging and a quiet space for recording. The interview recording site must also be relevant to the subject being addressed. If you do not have a recording space available Ecampus has a studio facility that can be used.


Who is to be interviewed?
Dr. Boudet had a clear plan to bring expert voices into the video interview. The guests to the class served as scientific experts as well as guides to the facility being visited. In the case of the PPOL 441/541 video interviews, Dr. Boudet chose to have the scientists appear on screen and to also appear herself. This is a key decision that shapes the planning and production process of the video interviews. As you might imagine, the technical demands of having one person on camera is different from having two people. Recording equipment needs and subsequent editing approaches are impacted by the number of people included “on camera” in any interview scenario.


When will the interview occur?

Scheduling interview recording involves coordinating your own schedule with Ecampus video staff and your guest expert(s). In the case of PPOL 441/541, Dr. Boudet arranged to have all interviews recorded at the same facility but in different spaces. Additionally, the interview times were coordinated to facilitate the video production team being present for a large block of time when all guest expert interviews could be recorded. After primary recording, the video production staff returned briefly to the O.H. Hinsdale Wave Research Lab to record b-roll content; shots of the facility without any people. This is a common process in video production.

The last important question to be asked is…


How will you prepare?
Part of preparation for a video interview is embedded in the answer to our previous questions. But preparing the content of the actual interview also requires planning. Dr. Boudet prepared a list of questions that she wanted to have addressed as part of the interview. She shared the purpose of the interview and her questions with the guest experts in advance. This collaborative effort contributed to a clear understanding of the intent of learning for all parties.

Sharing your questions with interviewees can be helpful. Asking guest experts not to memorize answers but to prepare with bullet points in mind will help the interview feel spontaneous.

There are obvious types of questions you will want to avoid. For instance, yes or no type questions can stunt an interview. Remember, the idea is get the instructional information you need. Be prepared to ask a question again if it is not answered the first time. Or, ask for clarifications to a response as part of the interview. Also provide opportunities at the end of the interview for experts to add anything they like. Remember you might get some great information and if it is not useful it can be edited out.

Preparing the physical interview space and interviewees is part of what the Ecampus video team does. They can provide tips on how to dress for a given interview, where to stand, where to look, and how to stage the interview space.

Now that we have answered some of the key questions in the video interview planning process watch the sample video posted above again. Can you see or hear the answers to the questions we have addressed?

About Part II:

Planning a guest expert video interview with a clear purpose in mind will shape the relevance, structure, and focus of the final video interview. In Part II of this video interview series, we will address the second half of video interview creation process; faculty collaboration with Ecampus video staff in the final stages of video interview production

References

Laist, R. (2015). Getting the Most out of Guest Experts Who Speak to Your Class. Faculty FocusHigher Ed Teaching & Learning. Retrieved from https://www.facultyfocus.com/articles/curriculum-development/getting-the-most-out-of-guest-experts-who-speak-to-your-class/

 

Special thanks to Hilary Boudet, Heather Doherty, Rick Henry, Chris Lindberg, and Drew Olson for their contributions to this article.