Little whale, big whale, swimming in the water: A quick history on how aerial photogrammetry has revolutionized the ability to obtain non-invasive measurements of whales

Dr. KC Bierlich, Postdoctoral Scholar, OSU Department of Fisheries, Wildlife, & Conservation Sciences, Geospatial Ecology of Marine Megafauna Lab

The morphology and body size of an animal is one of the most fundamental factors for understanding a species ecology. For instance, fish body size and fin shape can influence its habitat use, foraging behavior, prey type, physiological performance, and predator avoidance strategies (Fig 1). Morphology and body size can thus reflect details of an individual’s current health, likelihood of survival, and potential reproductive success, which directly influences a species life history patterns, such as reproductive status, growth rate, and energetic requirements. Collecting accurate morphological measurements of individuals is often essential for monitoring populations, and recent studies have demonstrated how animal morphology has profound implications for conservation and management decisions, especially for populations inhabiting anthropogenically-altered environments (Miles 2020) (Fig. 1). For example, in a study on the critically endangered European eel, De Meyer et al. (2020) found that different skulls sizes were associated with different ecomorphs (a local variety of a species whose appearance is determined by its ecological environment), which predicted different diet types and resulted with some ecomorphs having a greater exposure to pollutants and toxins than others. However, obtaining manual measurements of wild animal populations can be logistically challenging, limited by accessibility, cost, danger, and animal disturbance. These challenges are especially true for large elusive animals, such as whales that are often in remote locations, spend little time at the surface of the water, and their large size can preclude safe capture and live handling.

Figure 1. Top) A pathway framework depicting how the morphology of an animal influences its habitat use, behavior, foraging, physiology, and performance. These traits all affect how successful an animal is in its environment and can reflect an individual’s current health, likelihood of survival, and potential reproductive success. This individual success can then be scaled up to assess overall population health, which in turn can have direct implications for conservation. Bottom) an example of morphological differences in fish body size and fin shape from Walker et al. (2013). Fineness ratio (f) = length of body ­÷ max body width. 

Photogrammetry is a non-invasive method for obtaining accurate morphological measurements of animals from photographs. The two main types of photogrammetry methods used in wildlife biology are 1) single camera photogrammetry, where a known scale factor is applied to a single image to measure 2D distances and angles and 2) stereo-photogrammetry, where two or more images (from a single or multiple cameras) are used to recreate 3D models. These techniques have been used on domestic animals to measure body condition and estimate weight of dairy cows and lactating Mediterranean buffaloes (Negretti et al., 2008; Gaudioso et al., 2014) and on wild animals to measure sexual dimorphism in Western gorillas (Breuer et al., 2007), shoulder heights of elephants (Schrader et al., 2006), nutritional status of Japanese macaques (Kurita et al., 2012), and the body condition of brown bears (Shirane et al., 2020). Over 70 years ago, Leedy (1948) encouraged wildlife biologists to use aerial photogrammetry from aircraft for censusing wild animal populations and their habitats, where photographs can be collected at nadir (straight down) or an oblique angle, and the scale can be calculated by dividing the focal length of the camera by the altitude or by using a ratio of selected points in an image of a known size. Indeed, aerial photogrammetry has been wildly adopted by wildlife biologists and has proven useful in obtaining measurements in large vertebrates, such as elephants and whales.

Whitehead & Payne (1978) first demonstrated the utility of using aerial photogrammetry from airplanes and helicopters as a non-invasive technique for estimating the body length of southern right whales. Prior to this technique, measurements of whales were traditionally limited to assessing carcasses collected from scientific whaling operations, or opportunistically from commercial whaling, subsistence hunting, stranding events, and bycatch. Importantly, aerial photogrammetry provides a method to collect measurements of whales without killing them. This approach has been widely adopted to obtain body length measurements on a variety of whale and dolphin species, including bowhead whales (Cubbage & Calambokidis, 1987), southern right whales (Best & Rüther, 1992), fin whales (Ratnaswamy and Wynn, 1993), common dolphins (Perryman and Lynn, 1993), spinner dolphins (Perryman & Westlake 1998), and killer whales (Fearnbach et al. 2012). Aerial photogrammetry has also been used to measure body widths to estimate nutritive condition related to reproduction in gray whales (Perryman and Lynn, 2002) and northern and southern right whales (Miller et al., 2012). However, these studies collected photographs from airplanes and helicopters, which can be costly, limited by weather and infrastructure to support aircraft research efforts and, importantly, presents a potential risk to wildlife biologists (Sasse 2003). 

The recent advancement and commercialization of unoccupied aircraft systems (UAS, or drones) has revolutionized the ability to obtain morphological measurements from high resolution aerial photogrammetry across a variety of ecosystems (Fig. 2). Drones ultimately bring five transformative qualities to conservation science compared to airplanes and helicopters: affordability, immediacy, quality, efficiency, and safety of data collection. Durban et al. (2015) first demonstrated the utility of using drones for non-invasively obtaining morphological measurements of killer whales in remote environments. Since then, drone-based morphological measurements have been applied to a wide range of studies that have increased our understanding on different whale populations. For example, Leslie et al. (2020) used drone-based measurements of the skull to distinguish a unique sub-species of blue whales off the coast of Chile. Groskreutz et al. (2019) demonstrated how long-term nutritional stress has limited body growth in northern resident killer whales, while Stewart et al. (2021) found a decrease in body length of North Atlantic Right whales since 1981 that was associated with entanglements from fishing gear and may be a contributing factor to the decrease in reproductive success for this endangered population. 

Drone imagery is commonly used to estimate the body condition of baleen whales by measuring the body length and width of individuals. Recently, the GEMM Lab used body length and width measurements to quantify intra- and inter-seasonal changes in body condition across individual gray whales (Lemos et al., 2020). Drones have also been used to measure body condition loss in humpback whales during the breeding season (Christiansen et al., 2016) and to compare the healthy southern right whales to the skinnier, endangered North Atlantic right whales (Christiansen et al., 2020). Drone-based assessments of body condition have even been used to measure how calf growth rate is directly related to maternal loss during suckling (Christiansen et al., 2018), and even estimate body mass (Christiansen et al., 2019). 

Drone-based morphological measurements can also be combined with whale-borne inertial sensing tag data to study the functional morphology across several different baleen whale species. Kahane-Rapport et al. (2020) used drone measurements of tagged whales to analyze the biomechanics of how larger whales require longer times for filtering the water through their baleen when feeding. Gough et al. (2019) used size measurements from drones and swimming speeds from tags to determine that a whale’s “walking speed” is 2 meters per second – whether the largest of the whales, a blue whale, or the smallest of the baleen whales, an Antarctic minke whale. Size measurements and tag data were combined by Segre et al. (2019) to quantify the energetic costs of different sized whales when breaching. 

Taken together, drones have revolutionized our ability to obtain morphological measurements of whales, greatly increasing our capacity to better understand how these animals function and perform in their environments. These advancements in marine science are particularly important as these methods provide greater opportunity to monitor the health of populations, especially as they face increased threats from anthropogenic stressors (such as vessel traffic, ocean noise, pollution, fishing entanglement, etc.) and climate change. 

Drone-based photogrammetry is one of the main focuses of the GEMM Lab’s project on Gray whale Response to Ambient Noise Informed by Technology and Ecology (GRANITE). This summer we have been collecting drone videos to measure the body condition of gray whales feeding off the coast of Newport, Oregon (Fig. 2). As we try to understand the physiological stress response of gray whales to noise and other potential stressors, we have to account for the impacts of overall nutritional state of each individual whale’s physiology, which we infer from these body condition estimates. 

Figure 2. Drones can help collect images of whales to obtain morphological measurements using photogrammetry and help us fill knowledge gaps for how these animals interact in their environment and to assess their current health. Bottom photo is an image collected by the GEMM Lab of a gray whale being measured in MorphoMetriX software to estimate its body condition. 

References

Best, P. B., & Rüther, H. (1992). Aerial photogrammetry of southern right whales, Eubalaena australis. Journal of Zoology228(4), 595-614.

Breuer, T., Robbins, M. M., & Boesch, C. (2007). Using photogrammetry and color scoring to assess sexual dimorphism in wild western gorillas (Gorilla gorilla). American Journal of Physical Anthropology134(3), 369–382. https://doi.org/10.1002/ajpa.20678 

Christiansen, F., Vivier, F., Charlton, C., Ward, R., Amerson, A., Burnell, S., & Bejder, L. (2018). Maternal body size and condition determine calf growth rates in southern right whales. Marine Ecology Progress Series592, 267–281. 

Christiansen, F. (2020). A population comparison of right whale body condition reveals poor state of North Atlantic right whale, 1–43. 

Christiansen, F., Dujon, A. M., Sprogis, K. R., Arnould, J. P. Y., & Bejder, L. (2016). Noninvasive unmanned aerial vehicle provides estimates of the energetic cost of reproduction in humpback whales. Ecosphere7(10), e01468–18. 

Christiansen, F., Sironi, M., Moore, M. J., Di Martino, M., Ricciardi, M., Warick, H. A., … Uhart, M. M. (2019). Estimating body mass of free-living whales using aerial photogrammetry and 3D volumetrics. Methods in Ecology and Evolution10(12), 2034–2044. 

Cubbage, J. C., & Calambokidis, J. (1987). Size-class segregation of bowhead whales discerned through aerial stereo-photogrammetry. Marine Mammal Science3(2), 179–185. 

De Meyer, J., Verhelst, P., & Adriaens, D. (2020). Saving the European Eel: How Morphological Research Can Help in Effective Conservation Management. Integrative and Comparative Biology23, 347–349. 

Gaudioso, V., Sanz-Ablanedo, E., Lomillos, J. M., Alonso, M. E., Javares-Morillo, L., & Rodr\’\iguez, P. (2014). “Photozoometer”: A new photogrammetric system for obtaining morphometric measurements of elusive animals, 1–10.

Gough, W. T., Segre, P. S., Bierlich, K. C., Cade, D. E., Potvin, J., Fish, F. E., … Goldbogen, J. A. (2019). Scaling of swimming performance in baleen whales. Journal of Experimental Biology222(20), jeb204172–11. 

Groskreutz, M. J., Durban, J. W., Fearnbach, H., Barrett-Lennard, L. G., Towers, J. R., & Ford, J. K. B. (2019). Decadal changes in adult size of salmon-eating killer whales in the eastern North Pacific. Endangered Species Research40, 1 

Kahane-Rapport, S. R., Savoca, M. S., Cade, D. E., Segre, P. S., Bierlich, K. C., Calambokidis, J., … Goldbogen, J. A. (2020). Lunge filter feeding biomechanics constrain rorqual foraging ecology across scale. Journal of Experimental Biology223(20), jeb224196–8. 

Leedy, D. L. (1948). Aerial Photographs, Their Interpretation and Suggested Uses in Wildlife Management. The Journal of Wildlife Management12(2), 191. 

Lemos, L. S., Burnett, J. D., Chandler, T. E., Sumich, J. L., and Torres, L. G. (2020). Intra- and inter-annual variation in gray whale body condition on a foraging ground. Ecosphere 11.

Leslie, M. S., Perkins-Taylor, C. M., Durban, J. W., Moore, M. J., Miller, C. A., Chanarat, P., … Apprill, A. (2020). Body size data collected non-invasively from drone images indicate a morphologically distinct Chilean blue whale (Balaenoptera musculus) taxon. Endangered Species Research43, 291–304. 

Miles, D. B. (2020). Can Morphology Predict the Conservation Status of Iguanian Lizards? Integrative and Comparative Biology

Miller, C. A., Best, P. B., Perryman, W. L., Baumgartner, M. F., & Moore, M. J. (2012). Body shape changes associated with reproductive status, nutritive condition and growth in right whales Eubalaena glacialis and E. australis. Marine Ecology Progress Series459, 135–156. 

Negretti, P., Bianconi, G., Bartocci, S., Terramoccia, S., & Verna, M. (2008). Determination of live weight and body condition score in lactating Mediterranean buffalo by Visual Image Analysis. Livestock Science113(1), 1–7. https://doi.org/10.1016/j.livsci.2007.05.018 

Ratnaswamy, M. J., & Winn, H. E. (1993). Photogrammetric Estimates of Allometry and Calf Production in Fin Whales, \emph{Balaenoptera physalus}. American Society of Mammalogists74, 323–330. 

Perryman, W. L., & Lynn, M. S. (1993). Idendification of geographic forms of common dolphin(\emph{Delphinus Delphis}) from aerial photogrammetry. Marine Mammal Science9(2), 119–137. 

Perryman, W. L., & Lynn, M. S. (2002). Evaluation of nutritive condition and reproductive status of migrating gray whales (\emph{Eschrichtius robustus}) based on analysisof photogrammetric data. Journal Cetacean Research and Management4(2), 155–164. 

Perryman, W. L., & Westlake, R. L. (1998). A new geographic form of the spinner dolphin, stenella longirostris, detected with aerial photogrammetry. Marine Mammal Science14(1), 38–50. 

Sasse, B. (2003). Job-Related Mortality of Wildlife Workers in the United States, 1937- 2000, 1015–1020. 

Segre, P. S., Potvin, J., Cade, D. E., Calambokidis, J., Di Clemente, J., Fish, F. E., … & Goldbogen, J. A. (2020). Energetic and physical limitations on the breaching performance of large whales. Elife9, e51760.

Shirane, Y., Mori, F., Yamanaka, M., Nakanishi, M., Ishinazaka, T., Mano, T., … Shimozuru, M. (2020). Development of a noninvasive photograph-based method for the evaluation of body condition in free-ranging brown bears. PeerJ8, e9982. https://doi.org/10.7717/peerj.9982 

Shrader, A. M., M, F. S., & Van Aarde, R. J. (2006). Digital photogrammetry and laser rangefinder techniques to measure African elephants, 1–7. 

Stewart, J. D., Durban, J. W., Knowlton, A. R., Lynn, M. S., Fearnbach, H., Barbaro, J., … & Moore, M. J. (2021). Decreasing body lengths in North Atlantic right whales. Current Biology.

Walker, J. A., Alfaro, M. E., Noble, M. M., & Fulton, C. J. (2013). Body fineness ratio as a predictor of maximum prolonged-swimming speed in coral reef fishes. PloS one8(10), e75422.

Marine Mammal Observing: Standardization is key

By: Alexa Kownacki, Ph.D. Student, OSU Department of Fisheries and Wildlife, Geospatial Ecology of Marine Megafauna Lab

For the past two years, I’ve had the opportunity to be the marine mammal observer aboard the NOAA ship Bell M. Shimada for 10 days in May. Both trips covered transects in the Northern California Current Ecosystem during the same time of year, but things looked very different from my chair on the fly bridge. This trip, in particular, highlighted the importance of standardization, seeing as it was the second replicate of the same area. Other scientists and crew members repeatedly asked me the same questions that made me realize just how important it is to have standards in scientific practices and communicating them.

Northern right whale dolphin porpoising out of the water beside the ship while in transit. May 2019. Image source: Alexa Kownacki

The questions:

  1. What do you actually do here and why are you doing it?
  2. Is this year the same as last year in terms of weather, sightings, and transect locations?
  3. Did you expect to see greater or fewer sightings (number and diversity)?
  4. What is this Beaufort Sea State scale that you keep referring to?

All of these are important scientific questions that influence our hypothesis-testing research, survey methods, expected results, and potential conclusions. Although the entire science party aboard the ship conducted marine science, we all had our own specialties and sometimes only knew the basics, if that, about what the other person was doing. It became a perfect opportunity to share our science and standards across similar, but different fields.

Now, to answer those questions:

  1. a) What do you actually do here and b) why are you doing it?

a) As the only marine mammal observer, I stand watch during favorable weather conditions while the ship is in transit, scanning from 0 to 90 degrees off the starboard side (from the front of the ship to a right angle towards the right side when facing forwards). Meanwhile, an application on an iPad called SeaScribe, records the ship’s exact location every 15 seconds, even when no animal is sighted. This process allows for the collection of absence data, that is, data when no animals are present. The SeaScribe program records the survey lines, along with manual inputs that I add, including weather and observer information. When I spot a marine mammal, I immediately mark an exact location on a hand held GPS, use my binoculars to identify the species, and add information to the sighting on the SeaScribe program, such as species, distance to the sighted animal(s), the degree (angle) to the sighting, number of animals in a group, behavior, and direction if traveling.

b) Marine mammal observing serves many different purposes. In this case, observing collects information about what species are where at what time. By piggy-backing on these large-scale, offshore oceanographic NOAA surveys, we have the unique opportunity to survey along standardized transect lines during different times of the year. From replicate survey data, we can start to form an idea of which species use which areas and what oceanographic conditions may impact species distributions. Currently there is not much consistent marine mammal data collected over these offshore areas between Northern California and Washington State, so our work is aiming to fill this knowledge gap.

Alexa observing on the R/V Shimada in May 2019, all bundled up. Image Source: Alexa Kownacki

  1. What is this Beaufort Sea State scale that you keep referring to?

Great question! It took me a while to realize that this standard measuring tool to estimate wind speeds and sea conditions, is not commonly recognized even among other sea-goers. The Beaufort Sea State, or BSS, uses an empirical scale that ranges from 0-12 with 0 being no wind and calm seas, to 12 being hurricane-force winds with 45+ ft seas. It is frequently referenced by scientists in oceanography, marine science, and climate science as a universally-understood metric. The BSS was created in 1805 by Francis Beaufort, a hydrographer in the Royal Navy, to standardize weather conditions across the fleet of vessels. By the mid-1850s, the BSS was standardized to non-naval use for sailing vessels, and in 1916, expanded to include information specific to the seas and not the sails1. We in the marine mammal observation field constantly collect BSS information while on survey to measure the quality of survey conditions that may impact our observations. BSS data allows us to measure the extent of our survey range, both in the distance that we are likely to sight animals and also the likelihood of sighting anything. Therefore, the BSS scale gives us an important indication of how much absence data we have collected, in addition to presence data.

A description of the Beaufort Sea State Scale. Image source: National Weather Service.

 

  1. Is this year the same as last year in terms of weather, sightings, and transect locations?

The short answer is no. Observed differences in marine mammal sightings in terms of both species diversity and number of animals between years can be normal. There are many potential explanatory variables, from differences in currents, upwelling strength, El Nino index levels, water temperatures, or, what was obvious in this case: sighting conditions. The weather in May 2019 varied greatly from that in May 2018. Last year, I observed for nearly every day because the Beaufort Sea State (BSS) was frequently less than a four. However, this year, more often than not, the BSS greater than or equal to five. A BSS of 5 equates to approximately 17-21 knots of breeze with 6-foot waves and the water appears to have many “white horses” or pronounced white caps with sea spray. Additionally, mechanical issue with winches delayed and altered our transect locations. Therefore, although multiple transects from May 2018 were also surveyed during May 2019, there were a few lines that do not have data for both cruises.

May 2018 with a BSS 1

May 2019 with a BSS 6

 

 

 

 

 

  1. Did you expect to see greater or fewer sightings (number and diversity)?

Knowing that I had less favorable sighting conditions and less amount of effort observing this year, it is not surprising that I observed fewer marine mammals in total count and in species diversity. Even less surprising is that on the day with the best weather, where the BSS was less than a five, I recorded the most sightings with the highest species count. May 2018 felt a bit like a tropical vacation because we had surprisingly sunny days with mild winds, and during May 2019 we had some rough seas with gale force winds. Additionally, as an observer, I need to remove as much bias as possible. So, yes, I had hoped to see beaked whales or orca like I did in May 2018, but I was still pleasantly surprised when I spotted fin whales feeding in May 2019.

Marine Mammal Species Number of Sightings
May 2018 May 2019
Humpback whale 31 6
Northern right whale dolphin 1 2
Pacific white-sided dolphin 3 6
UNID beaked whale 1 0
Cuvier’s beaked whale 1 0
Gray whale 4 1
Minke whale 1 1
Fin whale 4 1
Blue whale 1 0
Transient killer whale 1 0
Dall’s porpoise 2 0
Northern fur seal 1 0
California sea lion 0 1

Pacific white-sided dolphin. Image source: Alexa Kownacki

Standardization is a common theme. Observing between years on standard transects, at set speeds, in different conditions using standardized tools is critical to collecting high quality data that is comparable across different periods. Scientists constantly think about quality control. We look for trends and patterns, similarities and differences, but none of those could be understood without having standard metrics.

The entire science party aboard the R/V Shimada in May 2019, including a marine mammal scientist, phytoplankton scientists, zooplankton scientists, and fisheries scientists, and oceanographers. Image Source: Alexa Kownacki

Literature Cited:

1Oliver, John E. (2005). Encyclopedia of world climatology. Springer.