Tag: drone footage

The costs and benefits of automated behavior classification

Clara Bird, PhD Student, OSU Department of Fisheries, Wildlife, and Conservation Sciences, Geospatial Ecology of Marine Megafauna Lab

“Why don’t you just automate it?” This is a question I am frequently asked when I tell someone about my work. My thesis involves watching many hours of drone footage of gray whales and meticulously coding behaviors, and there are plenty of days when I have asked myself that very same question. Streamlining my process is certainly appealing and given how wide-spread and effective machine learning methods have become, it is a tempting option to pursue. That said, machine learning is only appropriate for certain research questions and scales, and it’s important to consider these before investing in using a new tool.

The application of machine learning methods to behavioral ecology is called computational ethology (Anderson & Perona, 2014). To identify behaviors from videos, the model tracks individuals across video frames and identifies patterns of movement that form a behavior. This concept is similar to the way we identify a whale as traveling if it’s moving in a straight line and as foraging if it’s swimming in circles within a small area (Mayo & Marx, 1990, check out this blog to learn more). The level of behavioral detail that the model is able to track  depends on the chosen method (Figure 1, Pereira et al., 2020). These methods range from tracking each animal as a simple single point (called a centroid) to tracking the animal’s body positioning in 3D (this method is called pose estimation), which range from providing less detailed to more detailed behavior definitions. For example, tracking an individual as a centroid could be used to classify traveling and foraging behaviors, while pose estimation could identify specific foraging tactics. 

Figure 1. Figure from Pereira et al. (2020) illustrating the different methods of animal behavior tracking that are possible using machine learning.

Pose estimation involves training the machine learning algorithm to track individual anatomical features of an individual (e.g., the head, legs, and tail of a rat), meaning that it can define behaviors in great detail. A behavior state could be defined as a combination of the angle between the tail and the head, and the stride length. 

For example, Mearns et al. (2020) used pose estimation to study how zebrafish larvae in a lab captured their prey. They tracked the tail movements of individual larvae when presented with prey and classified these movements into separate behaviors that allowed them to associate specific behaviors with prey capture (Figure 2). The authors found that these behaviors occurred in a specific sequence, that the behaviors kept the prey within the larvae’s line of sight, and that the sequence was triggered by visual cues.  In fact, when they removed the visual cue of the prey, the larvae terminated the behavior sequence, meaning that the larvae are continually choosing to do each behavior in the sequence, rather than the sequence being one long behavior event that is triggered only by the initial visual cue. This study is a good example of the applicability of machine learning models for questions aimed at kinematics and fine-scale movements. Pose estimation has also been used to study the role of facial expression and body language in rat social communication (Ebbesen & Froemke, 2021). 

Figure 2. Excerpt from figure 1 of Mearns et al. (2020) illustrating (A) the camera set up for their experiment, (B) how the model tracked the eye angles and tail of the larvae fish, (C) the kinematics extracted from the footage. In panel (C) the top plot shows how the eyes converged on the same object (the prey) during prey capture event, the middle plot shows when the tail was curved to the left or the right, and the bottom plot shows the angle of the tail tip relative to the body.

While previous machine learning methods to track animal movements required individuals to be physically marked, the current methods can perform markerless tracking (Pereira et al., 2020). This improvement has broadened the kinds of studies that are possible. For example, Bozek et al., (2021) developed a model that tracked individuals throughout an entire honeybee colony and showed that certain individual behaviors were spatially distributed within the colony (Figure 3). Machine learning enabled the researchers to track over 1000 individual bees over several months, a task that would be infeasible for someone to do by hand. 

Figure 3. Excerpt from figure 1 of Bozek et al., (2021) showing how individual bees and their trajectories were tracked.

These studies highlight that the potential benefits of using machine learning when studying fine scale behaviors (like kinematics) or when tracking large groups of individuals. Furthermore, once it’s trained, the model can process large quantities of data in a standardized way to free up time for the scientists to focus on other tasks.

While machine learning is an exciting and enticing tool, automating behavior detection via machine learning could be its own PhD dissertation. Like most things in life, there are costs and benefits to using this technique. It is a technically difficult tool, and while applications exist to make it more accessible, knowledge of the computer science behind it is necessary to apply it effectively and correctly. Secondly, it can be tedious and time consuming to create a training dataset for the model to “learn” what each behavior looks like, as this step involves manually labeling examples for the model to use. 

As I’ve mentioned in a previous blog, I came quite close to trying to study the kinematics of gray whale foraging behaviors but ultimately decided that counting fluke beats wasn’t necessary to answer my behavioral research questions. It was important to consider the scale of my questions (as described in Allison’s blog) and I think that diving into more fine-scale kinematics questions could be a fascinating follow-up to the questions I’m asking in my PhD. 

For instance, it would be interesting to quantify how gray whales use their flukes for different behavior tactics. Do gray whales in better body condition beat their flukes more frequently while headstanding? Does the size of the fluke affect how efficiently they can perform certain tactics? While these analyses would help quantify the energetic costs of different behaviors in better detail, they aren’t necessary for my broad scale questions. Consequently, taking the time to develop and train a pose estimation machine learning model is not the best use of my time.

That being said, I am interested in applying machine learning methods to a specific subset of my dataset. In social behavior, it is not only useful to quantify the behaviors exhibited by each individual but also the distance between them. For example, the distance between a mom and her calf can be indicative of the calves’ dependence on its mom (Nielsen et al., 2019). However, continuously measuring the distance between two individuals throughout a video is tedious and time intensive, so training a machine learning model could be an effective use of time. I plan to work with an intern this summer to develop a machine learning model to track the distance between pairs of gray whales in our drone footage and then relate this distance data with the manually coded behaviors to examine patterns in social behavior (Figure 4).  Stay tuned to learn more about our progress!

Figure 4. A mom and calf pair surfacing together. Image collected under NOAA/NMFS permit #21678

Did you enjoy this blog? Want to learn more about marine life, research, and conservation? Subscribe to our blog and get a weekly alert when we make a new post! Just add your name into the subscribe box on the left panel.  

References

Anderson, D. J., & Perona, P. (2014). Toward a Science of Computational Ethology. Neuron, 84(1), 18–31. https://doi.org/10.1016/j.neuron.2014.09.005

Bozek, K., Hebert, L., Portugal, Y., Mikheyev, A. S., & Stephens, G. J. (2021). Markerless tracking of an entire honey bee colony. Nature Communications, 12(1), 1733. https://doi.org/10.1038/s41467-021-21769-1

Ebbesen, C. L., & Froemke, R. C. (2021). Body language signals for rodent social communication. Current Opinion in Neurobiology, 68, 91–106. https://doi.org/10.1016/j.conb.2021.01.008

Mayo, C. A., & Marx, M. K. (1990). Surface foraging behaviour of the North Atlantic right whale, Eubalaena glacialis , and associated zooplankton characteristics. Canadian Journal of Zoology, 68(10), 2214–2220. https://doi.org/10.1139/z90-308

Mearns, D. S., Donovan, J. C., Fernandes, A. M., Semmelhack, J. L., & Baier, H. (2020). Deconstructing Hunting Behavior Reveals a Tightly Coupled Stimulus-Response Loop. Current Biology, 30(1), 54-69.e9. https://doi.org/10.1016/j.cub.2019.11.022

Nielsen, M., Sprogis, K., Bejder, L., Madsen, P., & Christiansen, F. (2019). Behavioural development in southern right whale calves. Marine Ecology Progress Series, 629, 219–234. https://doi.org/10.3354/meps13125

Pereira, T. D., Shaevitz, J. W., & Murthy, M. (2020). Quantifying behavior to understand the brain. Nature Neuroscience, 23(12), 1537–1549. https://doi.org/10.1038/s41593-020-00734-z

Memoirs from above: drone observations of blue, humpback, Antarctic minke, and gray whales

By KC Bierlich, Postdoctoral Scholar, OSU Department of Fisheries, Wildlife, & Conservation Sciences, Geospatial Ecology of Marine Megafauna Lab

With the GRANITE field season officially over, we are now processing all of the data we collected this summer. For me, I am starting to go through all the drone videos to take snapshots of each whale to measure their body condition. As I go through these videos, I am reflecting on the different experiences I am fortunate enough to have with flying different drones, in different environments, over different species of baleen whales: blue, humpback, Antarctic minke, and now gray whales. Each of these species have a different morphological design and body shape (Woodward et al., 2006), which leads to different behaviors that are noticeable from the drone. Drones create immense opportunity to learn how whales thrive in their natural environments [see previous blog for a quick history], and below are some of my memories from above. 

I first learned how drones could be used to study the morphology and behavior of large marine mammals during my master’s degree at Duke University, and was inspired by the early works of John Durban (Durban et al., 2015, 2016) Fredrick Christiansen (Christiansen et al., 2016) and Leigh Torres (Torres et al., 2018). I immediately recognized the value and utility of this technology as a new tool to better monitor the health of marine mammals. This revelation led me to pursue a PhD with the Duke University Marine Robotics and Remote Sensing (MaRRS) Lab led by Dr. Dave Johnston where I helped further develop tools and methods for collecting drone-based imagery on a range of species in different habitats. 

When flying drones over whales, there are a lot of moving parts; you’re on a boat that is moving, flying something that is moving, following something that is moving. These moving elements are a lot to think about, so I trained hard, so I did not have to think about each step and flying felt intuitive and natural. I did not grow up playing video games, so reaching this level of comfort with the controls took a lot of practice. I practiced for hours over the course of months before my first field excursion and received some excellent mentorship and training from Julian Dale, the lead engineer in the MaRRS Lab. Working with Julian and the many hours of training helped me establish a solid foundation in my piloting skills and feel confident working in various environments on different species. 

Blue whales offshore of Monterey, California. 

In 2017 and 2018 I was involved in collaborative project with the MaRRS Lab and Goldbogen Lab at Stanford University, where we tagged and flew drones over blue whales offshore of Monterey, California. We traveled about an hour offshore and reliably found groups of blue whales actively feeding. Working offshore typically brought a large swell, which can often make landing the drone back into your field partner’s hands tricky as everything is bobbing up and down with the oscillations of the swell. Fortunately, we worked from a larger research vessel (~56 ft) and quickly learned that landing the drone in the stern helped dampen the effects of bobbing up and down. The blue whales we encountered often dove to a depth of around 200 m for about 20-minute intervals, then come to the surface for only a few minutes. This short surface period provided only a brief window to locate the whale once it surfaced and quickly fly over it to collect the imagery needed before it repeated its dive cycle. We learned to be patient and get a sense of the animal’s dive cycle before launch in order to time our flights so the drone would be in the air a couple of minutes before the whale surfaced. 

Once over the whales, the streamlined body of the blue whales was noticeable, with their small, high aspect ratio flippers and fluke that make them so well adapted for fast swimming in the open ocean (Fig. 1) (Woodward et al., 2006). I also noticed that because these whales are so large (often 21 – 24 m), I often flew at higher altitudes to be able fit them within the field of view of the camera. It was also always shocking to see how small the tagging boat (~8 m) looked when next to Earth’s largest creatures. 

Figure 1. Two blue whales surface after a deep dive offshore of Monterey, Ca. (Image credit: Duke University Marine Robotics and Remote Sensing under NOAA permit 14809-03)

Antarctic minke whales and humpback whales along the Western Antarctic PeninsulaA lot of the data included in my dissertation came from work along the Western Antarctic Peninsula (WAP), which had a huge range of weather conditions, from warm and sunny days to cold and snowy/foggy/rainy/windy/icy days. A big focus was often trying to keep my hands warm, as it was often easier to fly without gloves in order to better feel the controls. One of the coldest days I remember was late in the season in mid-June (almost winter!) in Wilhemina Bay where ice completely covered the bay in just a couple hours, pushing the whales out into the Gerlache Strait; I suspect this was the last ice-free day of the season. Surprisingly though, the WAP also brought some of the best conditions I have ever flown in. Humpback and Antarctic minke whales are often found deep within the bays along the peninsula, which provided protection from the wind. So, there were times where it would be blowing 40 mph in the Gerlache Strait, but calm and still in the bays, such as Andvord Bay, which allowed for some incredible conditions for flying. Working from small zodiacs (~7 m) allowed us more maneuverability for navigating around or through the ice deep in the bays (Fig. 2) 

Figure 2. Navigating through ice-flows along the Western Antarctic Peninsula. (Image credit: Duke University Marine Robotics and Remote Sensing under NOAA permit 14809-03 and ACA permits 2015-011 and 2020-016.)

Flying over Antarctic minke whale was always rewarding, as they are very sneaky and can quickly disappear under ice flows or in the deep, dark water. Flying over them often felt like a high-speed chase, as their small streamlined bodies makes them incredibly quick and maneuverable, doing barrel rolls, quick banked turns, and swimming under and around ice flows (Fig. 3). There would often be a group between 3-7 individuals and it felt like they were playing tag with each other – or perhaps with me!  

Figure 3. Two Antarctic minke whales swimming together along the Western Antarctic Peninsula. (Image credit: Duke University Marine Robotics and Remote Sensing under NOAA permit 14809-03 and ACA permits 2015-011 and 2020-016.)

Humpbacks displayed a wide range of behaviors along the WAP. Early in the season they continuously fed throughout the entire day, often bubble net feeding in groups typically of 2-5 animals (Fig. 4). For as large as they are, it was truly amazing to see how they use their pectoral fins to perform quick accelerations and high-speed maneuvering for tight synchronized turns to form bubble nets, which corral and trap their krill, their main food source (Fig. 4) (Woodward et al., 2006). Later in the season, humpbacks switched to more resting behavior in the day and mostly fed at night, taking advantage of the diel vertical migration of krill. This behavior meant we often found humpbacks snoozing at the surface after a short dive, as if they were in a food coma. They also seemed to be more curious and playful with each other and with us later in the season (Fig. 5).

We also encountered a lot of mom and calf pairs along the WAP. Moms were noticeably skinny compared to their plump calf in the beginning of the season due to the high energetic cost of lactation (Fig. 6). It is important for moms to regain this lost energy throughout the feeding season and begin to wean their calves. I often saw moms refusing to give milk to their nudging calf and instead led teaching lessons for feeding on their own.

Figure 4. Two humpback whales bubble-net feeding early in the feeding season (December) along the Western Antarctic Peninsula. (Image credit: Duke University Marine Robotics and Remote Sensing under NOAA permit 14809-03 and ACA permits 2015-011 and 2020-016.)
Figure 5. A curious humpback whale dives behind our Zodiac along the Western Antarctic Peninsula. (Image credit: Duke University Marine Robotics and Remote Sensing under NOAA permit 14809-03 and ACA permits 2015-011 and 2020-016.)
Figure 6. A mom and her calf rest at the surface along the Western Antarctic Peninsula. Note how the mom looks skinnier compared to her plump calf, as lactation is the most energetically costly phase of the reproductive cycle. (Image credit: Duke University Marine Robotics and Remote Sensing under NOAA permit 14809-03 and ACA permits 2015-011 and 2020-016.)

Gray whales off Newport, Oregon

All of these past experiences helped me quickly get up to speed and jump into action with the GRANITE field team when I officially joined the GEMM Lab this year in June. I had never flown a DJI Inspire quadcopter before (the drone used by the GEMM Lab), but with my foundation piloting different drones, some excellent guidance from Todd and Clara, and several hours of practice to get comfortable with the new setup, I was flying over my first gray whale by day three of the job. 

The Oregon coast brings all sorts of weather, and some days I strangely found myself wearing a similar number of layers as I did in Antarctica. Fog, wind, and swell could all change within the hour, so I learned to make the most of weather breaks when they came. I was most surprised by how noticeably different gray whales behave compared to the blue, Antarctic minke, and humpback whales I had grown familiar with watching from above. For one, it is absolutely incredible to see how these huge whales use their low-aspect ratio flippers and flukes (Woodward et al., 2006) to perform low-speed, highly dynamic maneuvers to swim in very shallow water (5-10 m) so close to shore (<1m sometimes!) and through kelp forest or surf zones close to the beach. They have amazing proprioception, or the body’s ability to sense its movement, action, and position, as gray whales often use their pectoral fins and fluke to stay in a head standing position (see Clara Bird’s blog) to feed in the bottom sediment layer, all while staying in the same position and resisting the surge of waves that could smash them against the rocks (Video 1) . It is also remarkable how the GEMM Lab knows each individual whale based on natural skin marks, and I started to get a better sense of each whale’s behavior, including where certain individuals typically like to feed, or what their dive cycle might be depending on their feeding behavior. 

Video 1. Two Pacific Coast Feeding Group (PCFG) gray whales “head-standing” in shallow waters off the coast of Newport, Oregon. NOAA/NMFS permit #21678

I feel very fortunate to be a part of the GRANITE field team and to contribute to data collection efforts. I look forward to the data analysis phase to see what we learn about how the morphology and behavior of these gray whales to help them thrive in their environment. 

References: 

Christiansen, F., Dujon, A. M., Sprogis, K. R., Arnould, J. P. Y., and Bejder, L. (2016).Noninvasive unmanned aerial vehicle provides estimates of the energetic cost of reproduction in humpback whales. Ecosphere 7, e01468–18.

Durban, J. W., Fearnbach, H., Barrett-Lennard, L. G., Perryman, W. L., & Leroi, D. J. (2015). Photogrammetry of killer whales using a small hexacopter launched at sea. Journal of Unmanned Vehicle Systems, 3(3), 131-135.

Durban, J. W., Moore, M. J., Chiang, G., Hickmott, L. S., Bocconcelli, A., Howes, G., et al.(2016). Photogrammetry of blue whales with an unmanned hexacopter. Mar. Mammal Sci. 32, 1510–1515.

Torres, L. G., Nieukirk, S. L., Lemos, L., & Chandler, T. E. (2018). Drone up! Quantifying whale behavior from a new perspective improves observational capacity. Frontiers in Marine Science, 5, 319.

Woodward, B. L., Winn, J. P., and Fish, F. E. (2006). Morphological specializations of baleen whales associated with hydrodynamic performance and ecological niche. J. Morphol. 267, 1284–1294.

The learning curve never stops as the GRANITE project begins its seventh field season

Clara Bird, PhD Student, OSU Department of Fisheries, Wildlife, and Conservation Sciences, Geospatial Ecology of Marine Megafauna Lab

When I thought about what doing fieldwork would be like, before having done it myself, I imagined that it would be a challenging, but rewarding and fun experience (which it is). However, I underestimated both ends of the spectrum. I simultaneously did not expect just how hard it would be and could not imagine the thrill of working so close to whales in a beautiful place. One part that I really did not consider was the pre-season phase. Before we actually get out on the boats, we spend months preparing for the work. This prep work involves buying gear, revising and developing protocols, hiring new people, equipment maintenance and testing, and training new skills. Regardless of how many successful seasons came before a project, there are always new tasks and challenges in the preparation phase.

For example, as the GEMM Lab GRANITE project team geared up for its seventh field season, we had a few new components to prepare for. Just to remind you, the GRANITE (Gray whale Response to Ambient Noise Informed by Technology and Ecology) project’s field season typically takes place from June to mid-October of each year. Throughout this time period the field team goes out on a small RHIB (rigid hull inflatable boat), whenever the weather is good enough, to collect photo-ID data, fecal samples, and drone imagery of the Pacific Coast Feeding Group (PCFG) gray whales foraging near Newport, OR, USA. We use the data to assess the health, ecology and population dynamics of these whales, with our ultimate goal being to understand the effect of ambient noise on the population. As previous blogs have described, a typical field day involves long hours on the water looking for whales and collecting data. This year, one of our exciting new updates is that we are going out on two boats for the first part of the field season and starting our season 10 days early (our first day was May 20th). These updates are happening because a National Science Foundation funded seismic survey is being conducted within our study area starting in June. The aim of this survey is to assess geophysical structures but provides us with an opportunity to assess the effect of seismic noise on our study group by collecting data before, during, and after the survey. So, we started our season early in order to capture the “before seismic survey” data and we are using a two-boat approach to maximize our data collection ability.

While this is a cool opportunistic project, implementing the two-boat approach came with a new set of challenges. We had to find a second boat to use, buy a new set of gear for the second boat, figure out the best way to set up our gear on a boat we had not used before, and update our data processing protocols to include data collected from two boats on the same day. Using two boats also means that everyone on the core field team works every day. This core team includes Leigh (lab director/fearless leader), Todd (research assistant), Lisa (PhD student), Ale (new post-doc), and me (Clara, PhD student). Leigh and Todd are our experts in boat driving and working with whales, Todd is our experienced drone pilot, I am our newly certified drone pilot, and Lisa, Ale, and myself are boat drivers. Something I am particularly excited about this season is that Lisa, Ale, and I all have at least one field season under our belts, which means that we get to become more involved in the process. We are learning how to trailer and drive the boats, fly the drones, and handling more of the post-field work data processing. We are becoming more involved in every step of a field day from start to finish, and while it means taking on more responsibility, it feels really exciting. Throughout most of graduate school, we grow as researchers as we develop our analytical and writing skills. But it’s just as valuable to build our skillset for field work. The ocean conditions were not ideal on the first day of the field season, so we spent our first day practicing our field skills.

For our “dry run” of a field day, we went through the process of a typical day, which mostly involved a lot of learning from Leigh and Todd. Lisa practiced her trailering and launching of the boat (figure 1), Ale and Lisa practiced driving the boat, and I practiced flying the drone (figure 2). Even though we never left the bay or saw any whales, I thoroughly enjoyed our dry run. It was useful to run through our routine, without rushing, to get all the kinks out, and it also felt wonderful to be learning in a supportive environment. Practicing new skills is stressful to say the least, especially when there is expensive equipment involved, and no one wants to mess up when they’re being watched. But our group was full of support and appreciation for the challenges of learning. We cheered for successful boat launchings and dockings, and drone landings. I left that day feeling good about practicing and improving my drone piloting skills, full of gratitude for our team and excited for the season ahead.

Figure 1. Lisa (driving the truck) launching the boat.
Figure 2. Clara (seated, wearing a black jacket) landing the drone in Ale’s hands.

All the diligent prep work paid off on Saturday with a great first day (figure 3). We conducted five GoPro drops (figure 4), collected seven fecal samples from four different whales (figure 5), and flew four drone flights over three individuals including our star from last season, Sole. Combined, we collected two trifectas (photo-ID images, fecal samples, and drone footage)! Our goal is to get as many trifectas as possible because we use them to study the relationship between the drone data (body condition and behavior) and the fecal sample data (hormones). We were all exhausted after 10 hours on the water, but we were all very excited to kick-start our field season with a great day.

Figure 3. Lisa on the bow pulpit during our first sighting of the day.
Figure 4. Lisa doing a GoPro drop, she’s lowering the GoPro into the water using the line in her hands.
Figure 5. Clara and Ale collecting a fecal sample.

On Sunday, just one boat went out to collect more data from Sole after a rainy morning and I successfully flew over her from launching to landing! We have a long season ahead, but I am excited to learn and see what data we collect. Stay tuned for more updates from team GRANITE as our season progresses!

Defining Behaviors

Clara Bird, PhD Student, OSU Department of Fisheries and Wildlife, Geospatial Ecology of Marine Megafauna Lab

When I started working on my thesis, I anticipated many challenges related to studying the behavioral ecology of gray whales. From processing five-plus years of drone footage to data analysis, there has been no shortage of anticipated and unexpected issues. I recently hit an unexpected challenge when I started video processing that piqued my interest. As I’ve discussed in a previous blog, ethograms are lists of defined behaviors that help us properly and consistently collect data in a standardized approach. Ethograms form a crucial foundation of any behavior study as the behaviors defined ultimately affect what questions can be asked and what patterns are detected. Since I am working off of the thorough ethogram of Oregon gray whales from Torres et al. (2018), I had not given much thought to the process of adding behaviors to the ethogram. But, while processing the first chunk of drone videos, I noticed some behaviors that were not in the original ethogram and struggled to decide whether or not to add them. I learned that ethogram development can lead down several rabbit holes. The instinct to try and identify every movement is strong but dangerous. Every minute movement does not necessarily need to be included and it’s important to remember the ultimate goal of the analysis to avoid getting bogged down.

Fundamental behavior questions cannot be answered without ethograms. For example, Baker et al. (2017) developed an ethogram for bottlenose dolphins in Ireland in order to conduct an initial quantitative behavior analysis. They did so by reviewing published ethograms for bottlenose dolphins, consulting with multiple experts, and revising the ethogram throughout the study. They then used their data to test inter-observer variability, calculate activity budgets, and analyze how the activity budgets varied across space and time.

Howe et al. (2015) also developed an ethogram in order to conduct quantitative behavior analyses. Their goals were to use the ethogram and subsequent analyses to better understand the behavior of beluga whales in Cook Inlet, AK, USA and to inform conservation. They started by writing down all behaviors they observed in the field, then they consolidated their notes into a formal ethogram that they used and refined during subsequent field seasons. They used their data to analyze how the frequencies of different behaviors varied throughout the study area at different times. This study served as an initial analysis investigating the effect of anthropogenic disturbance and was refined in future studies.

My research is similarly geared towards understanding behavior patterns to ultimately inform conservation. The primary questions of my thesis involve individual specialization, patterns of behavior across space, the relationship between behavior and body condition, and social behavior (check out this blog to learn more). While deciding what behaviors to add to my ethogram I’ve had to remind myself of these main questions and the bigger picture. The drone footage lets us see so much detail that it’s tempting to try to define every movement we can observe. One rabbit hole I’ve had to avoid a few times is locomotion. From the footage, it is possible to document fluke beats and pectoral fin strokes. While it could be interesting to investigate how different whales move in different ways, it could easily become a complicated mess of classifying different movements and take me deep into the world of whale locomotion. Talking through what that work would look like reminded me that we cannot answer every question and trying to assess all exciting side projects can cause us to lose focus on the main questions.

While I avoided going down the locomotion rabbit hole, there were some new behaviors that I did add to my ethogram. I’ll illustrate the process with the examples of two new behaviors I recently added: fluke swish and pass under (Clips 1 and 2). Clip 1 shows a whale rapidly moving its fluke to the side. I chose to add fluke swish because it’s such a distinct movement and I’m curious to see if there’s a pattern across space, time, individual, or nearby human activity that might explain its function. Clip 2 shows a calf passing under its mom.  It’s not nursing because the calf doesn’t spend time under its mom, it just crosses underneath her. The calf pass under behavior could be a type of mom-calf tactile interaction. Analyzing how the frequency of this behavior changes over time could show how a calf’s dependency on its mom changes over as it ages.

In defining these behaviors, I had to consider how many different variations of this behavior would be included in the definition. This process involves considering at what point a variation of that behavior could serve a different function, even without knowing the function of the original behavior. For fluke swish this process involved deciding to only count a behavior as a fluke swish if it was a big, fast movement. A small and slow movement of the fluke a little to the side could serve a different function, such as turning, or be a random movement.

Clip 1: Fluke swish behavior (Video filmed under NOAA/NMFS research permit #16111​​ by certified drone pilot Todd Chandler).
Clip 2: Pass under behavior (Video filmed under NOAA/NMFS research permit #16111​​ by certified drone pilot Todd Chandler).

The next step involved deciding if the behavior would be a ‘state’ or ‘point’ event. A state event is a behavior with a start and stop moment; a point event is instantaneous and assigned to just a point in time. I would categorize a behavior as a state event if I was interested in questions about its duration. For example, I could ask “what percentage of the total observation time was spent in a certain behavior state?” A point event would be a behavior where duration is not applicable, but I could ask a question like “Did whale 1 perform more point event A than whale 2?”. Both fluke swish and pass under are point events because they only happen for an instant. In a pass under the calf is passing under its mom for just a brief point in time, making it a point event. The final step was to name the behavior. As I discussed in this blog, the name of the behavior does not matter as much as the definition but it is important that the name is clear and descriptive. We chose the name fluke swish because the fluke rapidly moves from side to side and pass under because the calf crosses under its mom.

Frankly, in the beginning, I was a bit overwhelmed by the realization that the content of my ethogram would ultimately control the questions I could answer. I could not help but worry that after processing all the videos, I would end up regretting not defining more behaviors. However, after reading some of the literature, chatting with Leigh, and reviewing the initial chunk of videos several times, I am more confidence in my judgment and my ethogram. I have accepted the fact that I can’t anticipate everything, and I am confident that the behaviors I need to answer my research questions are included. The process of reviewing and updating my ethogram has been a rewarding challenge that resulted in a valuable lesson that I will take with me for the rest of my career.

References

Baker, I., O’Brien, J., McHugh, K., & Berrow, S. (2017). An ethogram for bottlenose dolphins (Tursiops truncatus) in the Shannon Estuary, Ireland. Aquatic Mammals, 43(6), 594–613. https://doi.org/10.1578/AM.43.6.2017.594

Howe, M., Castellote, M., Garner, C., McKee, P., Small, R. J., & Hobbs, R. (2015). Beluga, Delphinapterus leucas, ethogram: A tool for cook inlet beluga conservation? Marine Fisheries Review, 77(1), 32–40. https://doi.org/10.7755/MFR.77.1.3

Torres, L. G., Nieukirk, S. L., Lemos, L., & Chandler, T. E. (2018). Drone up! Quantifying whale behavior from a new perspective improves observational capacity. Frontiers in Marine Science, 5(SEP). https://doi.org/10.3389/fmars.2018.00319

Milling around in definitions

Clara Bird, Masters Student, OSU Department of Fisheries and Wildlife, Geospatial Ecology of Marine Megafauna Lab

A big part of graduate school involves extensive reading to learn about the previous research conducted in the field you are joining and the embedded foundational theories. A firm understanding of this background literature is needed in order to establish where your research fits. Science is a constructive process; to advance our disciplines we must recognize and build upon previous work. Hence, I’ve been reading up on the central topic of my thesis: behavioral ecology. It is equally important to study the methods used in these studies as to understand the findings. As discussed in a previous blog, ethograms are a central component of the methodology for studying behavior. Ethograms are lists of defined behaviors that help us properly and consistently collect data in a standardized approach. It is especially important in a project that spans years to know that the data collected at the beginning was collected in the same way as the data collected at the end of the project.

While ethograms and standardized methods are commonly used within a study, I’ve noticed from reading through studies on cetaceans, a lack of standardization across studies. Not all behaviors that are named the same way have matching definitions, and not all behaviors with similar definitions have matching names. Of all the behaviors, “milling” may be the least standardized.

While milling is not in our ethogram (Leigh believes this term is a “cheat” for when behavior is actually “unknown”), we occasionally use “milling” in the field to describe when the gray whales are swimming around in an area, not foraging, but not in any other primary behavior state (travel, social, or rest). Sometimes we use when we think the whale may be searching, but we aren’t 100% sure yet. A recent conversation during a lab meeting on the confusing nature of the term “milling” inspired me to dig into the literature for this blog. I searched through the papers I’ve saved for my literature review and found 18 papers that used the term milling. It was fascinating to read how variably the term has been defined and used.

When milling was defined in these papers, it was most commonly described as numerous directional changes in movement within a restricted area 1–8. Milling often co-occurred with other behavior states. Five of these eight studies described milling as co-occurring with foraging behavior 3–6,8. In one case, milling was associated with foraging and slow movement 8. While another study described milling as passive, slow, nondirectional movement 9.

Eight studies used the term milling without defining the behavior 10–17. Of these, five described milling as being associated with other behavior states. Three studies described milling as co-occurring with foraging 10,14,16, one said that it co-occurred with social behavior 13, and another described milling as being associated with resting/slow movement 12.

In addition to this variety of definitions and behavior associations, there were also inconsistencies with the placement of “milling” within ethograms. In nine studies, milling was listed as a primary state 1,2,4,7–9,15,17,18. But, in two studies that mentioned milling and used an ethogram, milling was not included in the ethogram 6,14.

Diving into the associations between milling and foraging reveal how varied the use of milling has been within the cetacean literature. For example, two studies simply described milling as occurring near foraging in time 10,16. While another two studies explained that milling was applied in situations where there was evidence of feeding without feeding being directly observed 8,14. Bobkov et al. (2019) described milling as occurring between feeding cycles along with breathing. Lastly, two studies describe milling as a behavior within the foraging primary state 3,5, while another study described feeding as a behavior within milling 4.

It’s all rather confusing, huh? Across these studies, milling has been defined, mentioned without being defined, included in ethograms as a primary state, included in ethograms as a sub-behavior, and excluded from ethograms. Milling has also been associated with multiple primary behavior states (foraging, resting, and socializing). It has been described as both passive 9 and slow 12, and strong 16 and active 5.

It appears that milling is often used to describe behaviors that the observer cannot distinctly classify or describe its function. I have also struggled to define these times when a whale is in between behavior states; I often end up calling it “just being a whale”, which includes time spent breathing at the surface, or just swimming around.

As I’ve said above, Leigh thinks that this term is a “cheat” for when a behavior is actually “unknown”. I think we have trouble equating “milling” with “unknown” because it seems like “unknown” should refer to a behavior where we can’t quite tell what the whale is doing. However, during milling, we can see that the whale is swimming at the surface. But here’s the thing, while we can see what the whale is doing, the function of the behavior is still unknown. Instead of using an indistinct term, we should use a term that better describes the behavior.  If it’s swimming at the surface, name the behavior “swimming at the surface”. If we can’t tell what the whale is doing because we can’t quite see what it’s doing, then name the behavior “unknown-partially visible”. Instead of using vague terminology, we should use clear names for behaviors and embrace using the term “unknown”.

I am most certainly not criticizing these studies as they all provided valuable contributions and interesting results. The studies that asked questions about behavioral ecology defined milling. The term was mentioned without being defined in studies focused on other topics. So, defining behaviors mentioned was less important.

With this exploration into the use of “milling” in studies, I am not implying that all behavioral ecologists need to agree on the use of the same behavior terms. However, I have learned clear definitions are critical. This lesson is also important outside of behavioral ecology. Different labs, and different people, use different terms for the same things. As I dig into my thesis, I am keeping a list of terminology I use and how I define those terms, because as I learn more, my terminology evolves and changes. For example, at the beginning of my thesis I used “sub-behavior” to refer to behaviors within the primary state categories. But, now after chatting with Leigh and learning more, I’ve decided to use the term “tactic” instead as these are often processes or events that contribute to the broader behavior state. My running list of terminology helps me remember what I meant when I used a certain word, so that when I read my notes from three months ago, I can know what I meant.  Digging into the literature for this blog reminded me of the importance of clearly defining all terminology and never assuming that everyone uses the same term in the same way.

Check out these videos to see some of the behaviors we observe:

References

1.        Mallonee, J. S. Behaviour of gray whales (Eschrichtius robustus) summering off the northern California coast, from Patrick’s Point to Crescent City. Can. J. Zool. 69, 681–690 (1991).

2.        Clarke, J. T., Moore, S. E. & Ljungblad, D. K. Observations on gray whale (Eschrichtius robustus) utilization patterns in the northeastern Chukchi Sea. Can. J. Zool 67, (1988).

3.        Ingram, S. N., Walshe, L., Johnston, D. & Rogan, E. Habitat partitioning and the influence of benthic topography and oceanography on the distribution of fin and minke whales in the Bay of Fundy, Canada. J. Mar. Biol. Assoc. United Kingdom 87, 149–156 (2007).

4.        Lomac-MacNair, K. & Smultea, M. A. Blue Whale (Balaenoptera musculus) Behavior and Group Dynamics as Observed from an Aircraft off Southern California. Anim. Behav. Cogn. 3, 1–21 (2016).

5.        Lusseau, D., Bain, D. E., Williams, R. & Smith, J. C. Vessel traffic disrupts the foraging behavior of southern resident killer whales Orcinus orca. Endanger. Species Res. 6, 211–221 (2009).

6.        Bobkov, A. V., Vladimirov, V. A. & Vertyankin, V. V. Some features of the bottom activity of gray whales (Eschrichtius robustus) off the northeastern coast of Sakhalin Island. 1, 46–58 (2019).

7.        Howe, M. et al. Beluga, Delphinapterus leucas, ethogram: A tool for cook inlet beluga conservation? Mar. Fish. Rev. 77, 32–40 (2015).

8.        Clarke, J. T., Christman, C. L., Brower, A. A. & Ferguson, M. C. Distribution and Relative Abundance of Marine Mammals in the northeastern Chukchi and western Beaufort Seas, 2012. Annu. Report, OCS Study BOEM 117, 96349–98115 (2013).

9.        Barendse, J. & Best, P. B. Shore-based observations of seasonality, movements, and group behavior of southern right whales in a nonnursery area on the South African west coast. Mar. Mammal Sci. 30, 1358–1382 (2014).

10.      Le Boeuf, B. J., M., H. P.-C., R., J. U. & U., B. R. M. and F. O. High gray whale mortality and low recruitment in 1999: Potential causes and implications. (Eschrichtius robustus). J. Cetacean Res. Manag. 2, 85–99 (2000).

11.      Calambokidis, J. et al. Abundance, range and movements of a feeding aggregation of gray whales (Eschrictius robustus) from California to southeastern Alaska in 1998. J. Cetacean Res. Manag. 4, 267–276 (2002).

12.      Harvey, J. T. & Mate, B. R. Dive Characteristics and Movements of Radio-Tagged Gray Whales in San Ignacio Lagoon, Baja California Sur, Mexico. in The Gray Whale: Eschrichtius Robustus (eds. Jones, M. Lou, Folkens, P. A., Leatherwood, S. & Swartz, S. L.) 561–575 (Academic Press, 1984).

13.      Lagerquist, B. A. et al. Feeding home ranges of pacific coast feeding group gray whales. J. Wildl. Manage. 83, 925–937 (2019).

14.      Barrett-Lennard, L. G., Matkin, C. O., Durban, J. W., Saulitis, E. L. & Ellifrit, D. Predation on gray whales and prolonged feeding on submerged carcasses by transient killer whales at Unimak Island, Alaska. Mar. Ecol. Prog. Ser. 421, 229–241 (2011).

15.      Luksenburg, J. A. Prevalence of External Injuries in Small Cetaceans in Aruban Waters, Southern Caribbean. PLoS One 9, e88988 (2014).

16.      Findlay, K. P. et al. Humpback whale “super-groups” – A novel low-latitude feeding behaviour of Southern Hemisphere humpback whales (Megaptera novaeangliae) in the Benguela Upwelling System. PLoS One 12, e0172002 (2017).

17.      Villegas-Amtmann, S., Schwarz, L. K., Gailey, G., Sychenko, O. & Costa, D. P. East or west: The energetic cost of being a gray whale and the consequence of losing energy to disturbance. Endanger. Species Res. 34, 167–183 (2017).

18.      Brower, A. A., Ferguson, M. C., Schonberg, S. V., Jewett, S. C. & Clarke, J. T. Gray whale distribution relative to benthic invertebrate biomass and abundance: Northeastern Chukchi Sea 2009–2012. Deep. Res. Part II Top. Stud. Oceanogr. 144, 156–174 (2017).

How we plan to follow whales

Clara Bird, Masters Student, OSU Department of Fisheries and Wildlife, Geospatial Ecology of Marine Megafauna Lab

The GEMM Lab gray whale team is in the midst of preparing for our fifth field season studying the Pacific Coast Foraging Group (PCFG): whales that forage off the coast of Newport, OR, USA each summer. On any given good weather day from June to October, our team is out on the water in a small zodiac looking for gray whales (Figure 1). When we find a gray whale, we try to collect photo ID data, fecal samples, drone data, and behavioral data. We use the drone data to study both the whale’s body condition and their behavior. In a previous blog, I described ethograms and how I would like to use the behavior data from drone videos to classify behaviors, with the ultimate goal of understanding how gray whale behavior varies across space, time, and by individual. However, this explanation of studying whale behavior is actually a bit incomplete. Before we start fieldwork, we first need to decide how to collect that data.

Figure 1. Image of GEMM lab team collecting gray whale UAS data. Image taken under NOAA/NMFS permit #16111

As observers, we are far from omnipresent and there is no way to know what the animals are doing all of the time. In any environment, scientists have to decide when and where to observe their animals and what behaviors they are interested in recording. In many studies, behavior is recorded live by an observer. In those studies, other limitations need to be taken into account, such as human error and observer fatigue. Collecting behavioral data is particularly challenging in the marine environment. Cetaceans spend most of their lives out of sight from humans, their time at the surface is brief, and when they appear together in large groups it can be very difficult to keep track of who is doing what when. Imagine being in a boat trying to keep track of what three different whales are doing without a pre-determined method – the task could quickly become overwhelming and biased. This is why we need a methodology for collecting and classifying behavior. We cannot study behavior without acknowledging these limitations and the potential biases that come with the methods we choose. Different data collection methods are better suited to address different questions.

The use of drones gives us the ability to record cetacean behavior non-invasively, from a perspective that allows greater observation (Figure 2, Torres et al. 2018), and for later review, which is a significant improvement. However, as we prepare to collect more behavior data, we need to study the methods and understand the benefits and disadvantages of each approach so that we capture the information we need without bias. Altmann (1974) provides a thorough overview of behavioral sampling methods.

Figure 2. Diagram illustrating “whale surface time” relative to “whale visible time” data as collected from an unmanned aerial systems (UAS) aircraft flying over a gray whale as it moves sequentially (from right to left) from “headstand” foraging to surfacing. Figure from Torres et al. (2018).

Ad libitum behavioral sampling has no structure and occurs when we find a group of whales and just write down everything they are doing. This method is a good first step, however it comes with bias.  Without structure, we cannot be sure that there was an equal probability of detecting each kind of behavior; this problem is called detectability bias. This type of bias is an issue if we are trying to answer questions about how often a behavior occurs, or what percent of time is spent in each behavior state. This is a bias to be especially concerned about when it comes to cetaceans because there are many examples of behaviors with different levels of detectability. An extreme example would be the detectability of breaching versus a behavior that takes place under the surface. A breaching whale is easier to spot and more exciting, which could lead to results suggesting that whales breach more often than they do relative to underwater behaviors. While it’s impossible to eliminate detectability bias, other sampling methods employ decision rules to try and reduce its effect. Many decision rules revolve around time, such as setting a minimum or maximum observation time interval. Other time rules involve recording the behavior state at set intervals of time (e.g., every 5 minutes). Setting observation boundaries helps standardize the methods and the data being collected.

In a structured sampling plan, the first big decision that needs to be addressed is the need to know the duration of behaviors. Point events do not include duration data but can be used to study the frequencies of behaviors. For example, if my research question was “Do whales perform “headstands” in a specific habitat type?”, then I would need point events of headstanding behavior. But, if I wanted to ask, “Do whales spend more time spent headstanding in a specific habitat type than in other habitat types?”, I would need headstanding to be a state event. State events are events with associated duration information and can be used for activity budgets. Activity budgets show how much time an animal spends in each behavior state. Some sampling methods focus on collecting only point events. However, to get the most complete understanding of behavior I think it’s important to collect both. Focal animal follows are another method of collecting more detailed data and is commonly used in cetacean studies.

The explanation of a focal follow method is in the name.  We focus on one individual, follow it, and record all of its behaviors. When employing this method, decisions are made about how an individual is chosen and how long it is followed. In some cases, the behavior of this animal is used as a proxy for the behavior of an entire group. I essentially use the focal follow method in my research. While I review drone footage to record behavioral data instead of recording behaviors live in the field, I focus on one individual a time as I go through the videos. To do this I use a software called BORIS (Friard and Gamba 2016) to mark the time of each behavior per individual (Figure 3). If there are three individuals in a video, I’ll review the footage three times to record behaviors once per individual, focusing on each in turn.

Figure 3. Screenshot of BORIS layout.

While the drone footage brings the advantages of time to review and a better view of the whale, we are constrained by the duration of a flight. Focal follows would ideally last longer than the ~15 minutes of battery life per drone flight. Our previously collected footage gives us snapshots of behavior, and this makes it challenging to compare and analyze durations of behaviors. Therefore, I am excited that we are going to try conducting drone focal follows this summer by swapping out drones when power runs low to achieve longer periods of video coverage of whale behavior. I’ll be able to use these data to move from snapshots to analyzing longer clips and better understanding the behavioral ecology of gray whales. As exciting as this opportunity is, it also presents the challenge of method development. So, I now need to develop decision rules and data collection methods to answer the questions that I have been eagerly asking.

References

Altmann, Jeanne. 1974. “Observational Study of Behavior: Sampling Methods.” Behaviour 49 (3–4): 227–66. https://doi.org/10.1163/156853974X00534.

Friard, Olivier, and Marco Gamba. 2016. “BORIS: A Free, Versatile Open-Source Event-Logging Software for Video/Audio Coding and Live Observations.” Methods in Ecology and Evolution 7 (11): 1325–30. https://doi.org/10.1111/2041-210X.12584.

Torres, Leigh G., Sharon L. Nieukirk, Leila Lemos, and Todd E. Chandler. 2018. “Drone up! Quantifying Whale Behavior from a New Perspective Improves Observational Capacity.” Frontiers in Marine Science 5 (SEP). https://doi.org/10.3389/fmars.2018.00319.

You can’t build a pyramid without the base: diving into the foundations of behavioral ecology to understand cetacean foraging

By Lisa Hildebrand, MSc student, OSU Department of Fisheries & Wildlife, Marine Mammal Institute, Geospatial Ecology of Marine Megafauna Lab

The last two months have been challenging for everyone across the world. While I have also experienced lows and disappointments during this time, I always try to see the positives and to appreciate the good things every day, even if they are small. One thing that I have been extremely grateful and excited about every week is when the clock strikes 9:58 am every Thursday. At that time, I click a Zoom link and after a few seconds of waiting, I am greeted by the smiling faces of the GEMM Lab. This spring term, our Principal Investigator Dr. Leigh Torres is teaching a reading and conference class entitled ‘Cetacean Behavioral Ecology’. Every week there are 2-3 readings (a mix of book chapters and scientific papers) focused on a particular aspect of behavioral ecology in cetaceans. During the first week we took a deep dive into the foundations of behavioral ecology (much of which is terrestrial-based) and we have now transitioned into applying the theories to more cetacean-centric literature, with a different branch of behavior and ecology addressed each week.

Leigh dedicated four weeks of the class to discussing foraging behavior, which is particularly relevant (and exciting) to me since my Master’s thesis focuses on the fine-scale foraging ecology of gray whales. Trying to understand the foraging behavior of cetaceans is not an easy feat since there are so many variables that influence the decisions made by an individual on where and when to forage, and what to forage on. While we can attempt to measure these variables (e.g., prey, environment, disturbance, competition, an individual’s health), it is almost impossible to quantify all of them at the same time while also tracking the behavior of the individual of interest. Time, money, and unworkable weather conditions are the typical culprits of making such work difficult. However, on top of these barriers is the added complication of scale. We still know so little about the scales at which cetaceans operate on, or, more importantly, the scales at which the aforementioned variables have an effect on and drive the behavior of cetaceans. For instance, does it matter if a predator is 10 km away, or just when it is 1 km away? Is a whale able to sense a patch of prey 100 m away, or just 10 m away? The same questions can be asked in terms of temporal scale too.

What is that gray whale doing in the kelp? Source: F. Sullivan.

As such, cetacean field work will always involve some compromise in data collection between these factors. A project might address cetacean movements across large swaths of the ocean (e.g., the entire U.S. west coast) to locate foraging hotspots, but it would be logistically complicated to simultaneously collect data on prey distribution and abundance, disturbance and competitors across this same scale at the same time. Alternatively, a project could focus on a small, fixed area, making simultaneous measurements of multiple variables more feasible, but this means that only individuals using the study area are studied. My field work in Port Orford falls into the latter category. The project is unique in that we have high-resolution data on prey (zooplankton) and predators (gray whales), and that these datasets have high spatial and temporal overlap (collected at nearly the same time and place). However, once a whale leaves the study area, I do not know where it goes and what it does once it leaves. As I said, it is a game of compromises and trade-offs.

Ironically, the species and systems that we study also live a life of compromises and trade-offs. In one of this week’s readings, Mridula Srinivasan very eloquently starts her chapter entitled ‘Predator/Prey Decisions and the Ecology of Fear’ in Bernd Würsig’s ‘Ethology and Behavioral Ecology of Odontocetes’ with the following two sentences: “Animal behaviors are governed by the intrinsic need to survive and reproduce. Even when sophisticated predators and prey are involved, these tenets of behavioral ecology hold.”. Every day, animals must walk the tightrope of finding and consuming enough food to survive and ensure a level of fitness required to reproduce, while concurrently making sure that they do not fall prey to a predator themselves. Krebs & Davies (2012) very ingeniously use the idea of economic analysis of costs and benefits to understand foraging behavior (but also behavior in general). While foraging, individuals not only have to assess potential risk (Fig. 1) but also decide whether a certain prey patch or item is profitable enough to invest energy into obtaining it (Fig. 2).

Leigh’s class has been great, not only to learn about foundational theories but to then also apply them to each of our study species and systems. It has been exciting to construct hypotheses based on the readings and then dissect them as a group. As an example, Sih’s 1984 paper on the behavioral response race of predators and prey prompted a discussion on responses of predators and prey to one another and how this affects their spatial distributions. Sih posits that since predators target areas with high prey densities, and prey will therefore avoid areas that predators frequent, their responses are in conflict with one another. Resultantly, there will be different outcomes depending on whichever response dominates. If the predator’s response dominates (i.e. predators are able to seek out areas of high prey density before prey can respond), then predators and prey will have positively correlated spatial distributions. However, if the prey responses dominate, then the spatial distributions of the two should be negatively correlated, as predators will essentially always be ‘one step behind’ the prey. Movement is most often the determinant factor to describe the strength of these relationships.

Video 1. Zooplankton closest to the camera will jump or dart away from it. Source: GEMM Lab.

So, let us think about this for gray whales and their zooplankton prey. The latter are relatively immobile. Even though they dart around in the water column (I have seen them ‘jump’ away from the GoPro when we lower it from the kayak on several occasions; Video 1), they do not have the ability to maneuver away fast or far enough to evade a gray whale predator moving much faster. As such, the predator response will most likely always be the strongest since gray whales operate at a scale that is several orders of magnitude greater than the zooplankton. However, the zooplankton may not be as helpless as I have made them seem. Based on our field observations, it seems that zooplankton often aggregate beneath or around kelp. This behavior could potentially be an attempt to evade predators as the kelp and reef crevices may serve as a refuge. So, in areas with a lot of refuges, the prey response may in fact dominate the relationship between gray whales and zooplankton. This example demonstrates the importance of habitat in shaping predator-prey interactions and behavior. However, we have often observed gray whales perform “bubble blasts” in or near kelp (Video 2). We hypothesize that this behavior could be a foraging tactic to tip the see-saw of predator-prey response strength back into their favor. If this is the case, then I would imagine that gray whales must decide whether the energetic benefit of eating zooplankton hidden in kelp refuges outweighs the energy required to pursue them (Fig. 2). On top of all these choices, are the potential risks and threats of boat traffic, fishing gear, noise, and potential killer whale predation (Fig. 1). Bringing us back to the analogy of economic analysis of costs and benefits to predator-prey relationships. I never realized it so clearly before, but gray whales sure do have a lot of decisions to make in a day!

Video 2. Drone footage of a gray whale foraging in kelp and performing a “bubble blast” at 00:40. Footage captured under NMFS permit #21678. Source: GEMM Lab.

Trying to tease apart these nuanced dynamics is not easy when I am unable to simply ask my study subjects (gray whales) why they decided to abandon a patch of zooplankton (Were the zooplankton too hard to obtain because they sought refuge in kelp, or was the patch unprofitable because there were too few or the wrong kind of zooplankton?). Or, why do gray whales in Oregon risk foraging in such nearshore coastal reefs where there is high boat traffic (Does their need for food near the reefs outweigh this risk, or do they not perceive the boats as a risk?). So, instead, we must set up specific hypotheses and use these to construct a thought-out and informed study design to best answer our questions (Mann 2000). For the past few weeks, I have spent a lot of time familiarizing myself with spatial packages and functions in R to start investigating the relationships between zooplankton and kelp hidden in the data we have collected over 4 years, to ultimately relate these patterns to gray whale foraging. I still have a long and steep journey before I reach the peak but once I do, I hope to have answers to some of the questions that the Cetacean Behavioral Ecology class has inspired.

Literature cited

Krebs, J. R., and N. B. Davies. 2012. Economic decisions and the individual in Davies, N. B. et al., eds. An introduction to behavioral ecology. John Wiley & Sons, Oxford.

Mann, J. 2000. Unraveling the dynamics of social life: long-term studies and observational methods in Mann, J., ed. Cetacean societies: field studies of dolphins and whales. University of Chicago Press, Chicago.

Sih, A. 1984. The behavioral response race between predator and prey. The American Naturalist 123:143-150.

Srinivasan, M. 2019. Predator/prey decisions and the ecology of fear in Würsig, B., ed. Ethology and ecology of odontocetes. Springer Nature, Switzerland. 

Whale blow: good for more than spotting whales

Clara Bird, Masters Student, OSU Department of Fisheries and Wildlife, Geospatial Ecology of Marine Megafauna Lab

Whale blow, the puff of air mixed with moisture that a whale releases when it comes to the surface, is a famously thrilling indicator of the presence of a whale. From shore, spotting whale blow brings the excitement of knowing that there are whales nearby. During boat-based field work, seeing or hearing blow brings the rush of adrenaline meaning that it’s game time. Whale blow can also be used to identify different species of whales, for example gray whale blow is heart shaped (Figure 1). However, whale blow can be used for more than just spotting and identifying whales. We can use the time between blows to study energetics.

Figure 1. Gray whale blow is often heart shaped (when there is very little wind). Source: https://www.lajollalight.com/sdljl-natural-la-jolla-winter-wildlife-2015jan08-story.html

A blow interval is the time between consecutive blows when a whale is at the surface (Stelle, Megill, and Kinzel 2008). These are also known as short breath holds, whereas long breath holds are times between surfacings (Sumich 1983).  Sumich (1983) hypothesized that short breath holds lead to efficient rates of oxygen use. The body uses oxygen to create energy, so “efficient rate of oxygen use” means that longer breath holds do not use much more oxygen and subsequently do not produce more energy.  Surfacings, during which short blow intervals occur, are often thought of as recovery periods for whales. Think of it this way, when you sprint, immediately afterwards you typically need to take a break to just breathe and recover.

We hypothesize that we can use blow intervals as a measure of how strenuous an activity is; shorter blow intervals may indicate that an activity is more energetically demanding (Wursig, Wells, and Croll 1986). Let’s go back to the sprinting analogy and compare the energetic demands of walking and running. Imagine I asked you to walk for five minutes, stop and measure the time between each breath, and then run for five minutes and do the same; after running, you would likely breathe more heavily and take more breaths with less time between them. This result indicates that running is more demanding, which we already know because we can do other experiments with humans to study metabolic rate and related metrics. In the case of gray whales, we cannot do experiments in the same way, but we can use the same analogy. Several studies have examined how blow intervals differ between travelling and foraging.

Wursig, Wells, and Croll (1986) measured blow interval, surfacing time, and estimated dive depth and duration of gray whales in Alaska from a boat during the foraging season. They found that blow intervals were shorter during feeding. They also found that the number of blows per surfacing increased with increasing depth. Overall these findings suggest that during the foraging season, feeding is more strenuous than other behaviors and that deeper dives may be more physiologically stressful.

Stelle, Megill, and Kinzel (2008) studied gray whales foraging off of British Columbia, Canada. They found shorter blow intervals during foraging, intermediate blow intervals during searching, and longer blow intervals during travelling. Interestingly, within feeding behaviors, they found a difference between whales feeding on mysids (krill-like animals that swim in the water column) and whales feeding benthically on amphipods. They found that whales feeding on mysids made more frequent but shorter dives with short blow intervals at surface, while whales feeding benthically had longer dives with longer blow intervals. They hypothesized that this difference in surfacing pattern is because mysids might scatter when disturbed, so gray whales surface more often to allow the mysids swarm to reform. These studies inspired me to start investigating these same questions with my drone video data.

As I review the drone footage and code the behaviors I also mark the time of each blow. I’ve done some initial video coding and using this data I have started to look into differences in blow intervals. As it turns out, we see a similar difference in blow interval relative to behavior state in our data: whales that are foraging have shorter blow intervals than when traveling (Figure 2). It is encouraging to see that our data shows similar patterns.

Figure 2. Boxplot of mean blow interval per sighting of foraging whales and travelling whales.

Next, I would like to examine how blow intervals differ between foraging tactics. A significant part of my thesis is dedicated to studying specific foraging tactics. The perspective from the drone allows us to identify behaviors in greater detail than studies from shore or boat (Torres et al. 2018), allowing us to dig into the differences between the different foraging behaviors. The purpose of foraging is to gain energy. However, this gain is a net gain. To understand the different energetic “values” of each tactic we need to understand the cost of each behavior, i.e. how much energy is required to perform the behavior. Given previous studies, maybe blow intervals could help us measure this cost or at least compare the energetic demands of the behaviors relative to each other. Furthermore, because different behaviors are likely associated with different prey types (Dunham and Duffus 2001), we also need to understand the different energetic gains of each prey type (this is something that Lisa is studying right now, check out the COZI project to learn more). By understanding both of these components – the gains and costs – we can understand the energetic tradeoffs of the different foraging tactics.

Another interesting component to this energetic balance is a whale’s health and body condition. If a whale is in poor health, can it afford the energetic costs of certain behaviors? If whales in poor body condition engage in different behavior patterns than whales in good body condition, are these patterns explained by the energetic costs of the different foraging behaviors? All together this line of investigation is leading to an understanding of why a whale may choose to use different foraging behaviors in different situations. We may never get the full picture; however, I find it really exciting that something as simple and non-invasive as measuring the time between breaths can contribute such a valuable data stream to this project.

References

Dunham, Jason S., and David A. Duffus. 2001. “Foraging Patterns of Gray Whales in Central Clayoquot Sound, British Columbia, Canada.” Marine Ecology Progress Series 223 (November): 299–310. https://doi.org/10.3354/meps223299.

Stelle, Lei Lani, William M. Megill, and Michelle R. Kinzel. 2008. “Activity Budget and Diving Behavior of Gray Whales (Eschrichtius Robustus) in Feeding Grounds off Coastal British Columbia.” Marine Mammal Science 24 (3): 462–78. https://doi.org/10.1111/j.1748-7692.2008.00205.x.

Sumich, James L. 1983. “Swimming Velocities, Breathing Patterns, and Estimated Costs of Locomotion in Migrating Gray Whales, Eschrichtius Robustus.” Canadian Journal of Zoology 61 (3): 647–52. https://doi.org/10.1139/z83-086.

Torres, Leigh G., Sharon L. Nieukirk, Leila Lemos, and Todd E. Chandler. 2018. “Drone up! Quantifying Whale Behavior from a New Perspective Improves Observational Capacity.” Frontiers in Marine Science 5 (SEP). https://doi.org/10.3389/fmars.2018.00319.

Wursig, B., R. S. Wells, and D. A. Croll. 1986. “Behavior of Gray Whales Summering near St. Lawrence Island, Bering Sea.” Canadian Journal of Zoology 64 (3): 611–21. https://doi.org/10.1139/z86-091.

The complex relationship between behavior and body condition

Clara Bird, Masters Student, OSU Department of Fisheries and Wildlife, Geospatial Ecology of Marine Megafauna Lab

Imagine that you are a wild foraging animal: In order to forage enough food to survive and be healthy you need to be healthy enough to move around to find and eat your food. Do you see the paradox? You need to be in good condition to forage, and you need to forage to be in good condition. This complex relationship between body condition and behavior is a central aspect of my thesis.

One of the great benefits of having drone data is that we can simultaneously collect data on the body condition of the whale and on its behavior. The GEMM lab has been measuring and monitoring the body condition of gray whales for several years (check out Leila’s blog on photogrammetry for a refresher on her research). However, there is not much research linking the body condition of whales to their behavior. Hence, I have expanded my background research beyond the marine world to looked for papers that tried to understand this connection between the two factors in non-cetaceans. The literature shows that there are examples of both, so let’s go through some case studies.

Ransom et al. (2010) studied the effect of a specific type of contraception on the behavior of a population of feral horses using a mixed model. Aside from looking at the effect of the treatment (a type of contraception), they also considered the effect of body condition. There was no difference in body condition between the treatment and control groups, however, they found that body condition was a strong predictor of feeding, resting, maintenance, and social behaviors. Females with better body condition spent less time foraging than females with poorer body condition. While it was not the main question of the study, these results provide a great example of taking into account the relationship between body condition and behavior when researching any disturbance effect.

While Ransom et al. (2010) did not find that body condition affected response to treatment, Beale and Monaghan (2004) found that body condition affected the response of seabirds to human disturbance. They altered the body condition of birds at different sites by providing extra food for several days leading up to a standardized disturbance. Then the authors recorded a set of response variables to a disturbance event, such as flush distance (the distance from the disturbance when the birds leave their location). Interestingly, they found that birds with better body condition responded earlier to the disturbance (i.e., when the disturbance was farther away) than birds with poorer body condition (Figure 1). The authors suggest that this was because individuals with better body condition could afford to respond sooner to a disturbance, while individuals with poorer body condition could not afford to stop foraging and move away, and therefore did not show a behavioral response. I emphasize behavioral response because it would have been interesting to monitor the vital rates of the birds during the experiment; maybe the birds’ heart rates increased even though they did not move away. This finding is important when evaluating disturbance effects and management approaches because it demonstrates the importance of considering body condition when evaluating impacts: animals that are in the worst condition, and therefore the individuals that are most vulnerable, may appear to be undisturbed when in reality they tolerate the disturbance because they cannot afford the energy or time to move away.

Figure 1.  Figure showing flush distance of birds that were fed (good body condition) and unfed (poor body condition).

These two studies are examples of body condition affecting behavior. However, a study on the effect of habitat deterioration on lizards showed that behavior can also affect body condition. To study this effect, Amo et al. (2007) compared the behavior and body condition of lizards in ski slopes to those in natural areas. They found that habitat deterioration led to an increased perceived risk of predation, which led to an increase in movement speed when crossing these deteriorated, “risky”, areas. In turn, this elevated movement cost led to a decrease in body condition (Figure 2). Hence, the lizard’s behavior affected their body condition.


Figure 2. Figure showing the difference in body condition of lizards in natural and deteriorated habitats.

Together, these case studies provide an interesting overview of the potential answers to the question: does body condition affect behavior or does behavior affect body condition? The answer is that the relationship can go both ways. Ransom et al. (2004) showed that regardless of the treatment, behavior of female horses differed between body conditions, indicating that regardless of a disturbance, body condition affects behavior. Beale and Monaghan (2004) demonstrated that seabird reactions to disturbance differed between body conditions, indicating that disturbance studies should take body condition into account. And, Amo et al. (2007) showed that disturbance affects behavior, which consequently affects body condition.

Looking at the results from these three studies, I can envision finding similar results in my gray whale research. I hypothesize that gray whale behavior varies by body condition in everyday circumstances and when the whale is disturbed. Yet, I also hypothesize that being disturbed will affect gray whale behavior and subsequently their body condition. Therefore, what I anticipate based on these studies is a circular relationship between behavior and body condition of gray whales: if an increase in perceived risk affects behavior and then body condition, maybe those affected individuals with poor body condition will respond differently to the disturbance. It is yet to be determined if a sequence like this could ever be detected, but I think that it is important to investigate.

Reading through these studies, I am ready and eager to start digging into these hypotheses with our data. I am especially excited that I will be able to perform this investigation on an individual level because we have identified the whales in each drone video. I am confident that this work will lead to some interesting and important results connecting behavior and health, thus opening avenues for further investigations to improve conservation studies.

References

Beale, Colin M, and Pat Monaghan. 2004. “Behavioural Responses to Human Disturbance: A Matter of Choice?” Animal Behaviour 68 (5): 1065–69. https://doi.org/10.1016/j.anbehav.2004.07.002.

Ransom, Jason I, Brian S Cade, and N. Thompson Hobbs. 2010. “Influences of Immunocontraception on Time Budgets, Social Behavior, and Body Condition in Feral Horses.” Applied Animal Behaviour Science 124 (1–2): 51–60. https://doi.org/10.1016/j.applanim.2010.01.015.

Amo, Luisa, Pilar López, and José Martín. 2007. “Habitat Deterioration Affects Body Condition of Lizards: A Behavioral Approach with Iberolacerta Cyreni Lizards Inhabiting Ski Resorts.” Biological Conservation 135 (1): 77–85. https://doi.org/10.1016/j.biocon.2006.09.020.

Classifying cetacean behavior

Clara Bird, Masters Student, OSU Department of Fisheries and Wildlife, Geospatial Ecology of Marine Megafauna Lab

The GEMM lab recently completed its fourth field season studying gray whales along the Oregon coast. The 2019 field season was an especially exciting one, we collected rare footage of several interesting gray whale behaviors including GoPro footage of a gray whale feeding on the seafloor, drone footage of a gray whale breaching, and drone footage of surface feeding (check out our recently released highlight video here). For my master’s thesis, I’ll use the drone footage to analyze gray whale behavior and how it varies across space, time, and individual. But before I ask how behavior is related to other variables, I need to understand how to best classify the behaviors.

How do we collect data on behavior?

One of the most important tools in behavioral ecology is an ‘ethogram’. An ethogram is a list of defined behaviors that the researcher expects to see based on prior knowledge. It is important because it provides a standardized list of behaviors so the data can be properly analyzed. For example, without an ethogram, someone observing human behavior could say that their subject was walking on one occasion, but then say strolling on a different occasion when they actually meant walking. It is important to pre-determine how behaviors will be recorded so that data classification is consistent throughout the study. Table 1 provides a sample from the ethogram I use to analyze gray whale behavior. The specificity of the behaviors depends on how the data is collected.

Table 1. Sample from gray whale ethogram. Based on ethogram from Torres et al. (2018).

In marine mammal ecology, it is challenging to define specific behaviors because from the traditional viewpoint of a boat, we can only see what the individuals are doing at the surface. The most common method of collecting behavioral data is called a ‘focal follow’. In focal follows an individual, or group, is followed for a set period of time and its behavioral state is recorded at set intervals.  For example, a researcher might decide to follow an animal for an hour and record its behavioral state at each minute (Mann 1999). In some studies, they also recorded the location of the whale at each time point. When we use drones our methods are a little different; we collect behavioral data in the form of continuous 15-minute videos of the whale. While we collect data for a shorter amount of time than a typical focal follow, we can analyze the whole video and record what the whale was doing at each second with the added benefit of being able to review the video to ensure accuracy. Additionally, from the drone’s perspective, we can see what the whales are doing below the surface, which can dramatically improve our ability to identify and describe behaviors (Torres et al. 2018).

Categorizing Behaviors

In our ethogram, the behaviors are already categorized into primary states. Primary states are the broadest behavioral states, and in my study, they are foraging, traveling, socializing, and resting. We categorize the specific behaviors we observe in the drone videos into these categories because they are associated with the function of a behavior. While our categorization is based on prior knowledge and critical evaluation, this process can still be somewhat subjective.  Quantitative methods provide an objective interpretation of the behaviors that can confirm our broad categorization and provide insight into relationships between categories.  These methods include path characterization, cluster analysis, and sequence analysis.

Path characterization classifies behaviors using characteristics of their track line, this method is similar to the RST method that fellow GEMM lab graduate student Lisa Hildebrand described in a recent blog. Mayo and Marx (1990) analyzed the paths of surface foraging North Atlantic Right Whales and were able to classify the paths into primary states; they found that the path of a traveling whale was more linear and then paths of foraging or socializing whales that were more convoluted (Fig 1). I plan to analyze the drone GPS track line as a proxy for the whale’s track line to help distinguish between traveling and foraging in the cases where the 15-minute snapshot does not provide enough context.

Figure 1. Figure from Mayo and Marx (1990) showing different track lines symbolized by behavior category.

Cluster analysis looks for natural groupings in behavior. For example, Hastie et al. (2004) used cluster analysis to find that there were four natural groupings of bottlenose dolphin surface behaviors (Fig. 2). I am considering using this method to see if there are natural groupings of behaviors within the foraging primary state that might relate to different prey types or habitat. This process is analogous to breaking human foraging down into sub-categories like fishing or farming by looking for different foraging behaviors that typically occur together.

Figure 2. Figure from Hastie et al. (2004) showing the results of a hierarchical cluster analysis.

Lastly, sequence analysis also looks for groupings of behaviors but, unlike cluster analysis, it also uses the order in which behaviors occur. Slooten (1994) used this method to classify Hector’s dolphin surface behaviors and found that there were five classes of behaviors and certain behaviors connected the different categories (Fig. 3). This method is interesting because if there are certain behaviors that are consistently in the same order then that indicates that the order of events is important. What function does a specific sequence of behaviors provide that the behaviors out of that order do not?

Figure 3. Figure from Slooten (1994) showing the results of sequence analysis.

Think about harvesting fruits and vegetables from a garden: the order of how things are done matters and you might use different methods to harvest different kinds of produce. Without knowing what food was being harvested, these methods could detect that there were different harvesting methods for different fruits or veggies. By then studying when and where the different methods were used and by whom, we could gain insight into the different functions and patterns associated with the different behaviors. We might be able to detect that some methods were always used in certain habitat types or that different methods were consistently used at different times of the year.

Behavior classification methods such as these described provide a more refined and detailed analysis of categories that can then be used to identify patterns of gray whale behaviors. While our ultimate goal is to understand how gray whales will be affected by a changing environment, a comprehensive understanding of their current behavior serves as a baseline for that future study.

References

Burnett, J. D., Lemos, L., Barlow, D., Wing, M. G., Chandler, T., & Torres, L. G. (2019). Estimating morphometric attributes of baleen whales with photogrammetry from small UASs: A case study with blue and gray whales. Marine Mammal Science, 35(1), 108–139. https://doi.org/10.1111/mms.12527

Darling, J. D., Keogh, K. E., & Steeves, T. E. (1998). Gray whale (Eschrichtius robustus) habitat utilization and prey species off Vancouver Island, B.C. Marine Mammal Science, 14(4), 692–720. https://doi.org/10.1111/j.1748-7692.1998.tb00757.x

Hastie, G. D., Wilson, B., Wilson, L. J., Parsons, K. M., & Thompson, P. M. (2004). Functional mechanisms underlying cetacean distribution patterns: Hotspots for bottlenose dolphins are linked to foraging. Marine Biology, 144(2), 397–403. https://doi.org/10.1007/s00227-003-1195-4

Mann, J. (1999). Behavioral sampling methods for cetaceans: A review and critique. Marine Mammal Science, 15(1), 102–122. https://doi.org/10.1111/j.1748-7692.1999.tb00784.x

Slooten, E. (1994). Behavior of Hector’s Dolphin: Classifying Behavior by Sequence Analysis. Journal of Mammalogy, 75(4), 956–964. https://doi.org/10.2307/1382477

Torres, L. G., Nieukirk, S. L., Lemos, L., & Chandler, T. E. (2018). Drone up! Quantifying whale behavior from a new perspective improves observational capacity. Frontiers in Marine Science, 5(SEP). https://doi.org/10.3389/fmars.2018.00319

Mayo, C. A., & Marx, M. K. (1990). Surface foraging behaviour of the North Atlantic right whale, Eubalaena glacialis, and associated zooplankton characteristics. Canadian Journal of Zoology, 68(10), 2214–2220. https://doi.org/10.1139/z90-308