Mapmaking: Part 3

Posted on December 12, 2015 by Ryan

In the first two parts of this series, I introduced Lightroom, the Lightroom plugins LR/Transporter and FTP Publisher, and the programming languages AWK and R. With those tools, I organized my photos and got some of their metadata into a format that I can easily manipulate with R code.

After getting the photo information organized, I had a few more pieces of metadata to get together. In particular, I wanted to organize the map based on the taxonomy of the corals, and I wanted to include some information about the site of collection that wasn’t included in my sample metadata file. We are keeping this information in separate files, for a couple of reasons. Over the course of the project, multiple people have collected replicates of the same species of coral in different locations. Every time we collect a coral, we need to fill in a line of data in the sample metadata table. Right now, we have 57 columns in that table, meaning we have to manually fill in 57 pieces of information for each sample. On a whirlwind trip where we collect 50 samples, that adds up quickly to 2850 values, or 2850 opportunities to make a typo or some other error.

If any two columns in our table are highly repetitive and are dependent on each other, we should be able to allow the computer to fill one in based on the other. For example, we could create seven columns in the sample metadata file that detail each sample’s species, genus, family, order, phylogenetic clade, NCBI taxonomy ID number, and perhaps some published physiological data. However, all of these pieces of information are dependent on the first value: the species of coral sampled. If we collect the same species, say, Porites lobata, 25 times throughout the project, all the information associated with that species is going to be repeated again and again in our metadata sheet. However, if instead we create a single column in our sample metadata table for the species ID, we can then create a separate table for all the other information, with only one row per species. We cut down on the amount of manual data entry we have to do by 144 values for that species alone!* Not only does that save time; it helps to avoid errors. The same general principle applies to each site we’ve visited: certain values are consistent and prone to repetition and error, such as various scales of geographical information, measurements of water temperature and visibility, and locally relevant collaborators. So we created another table for ‘sites’. **

Excerpt from 'species' metadata table

genus_species	genus	species	family	clade	TAXON_ID	NCBI_blast_name
Tubastrea coccinea	Tubastrea	coccinea	Dendrophyllidae	II	46700	stony corals
Turbinaria reniformis	Turbinaria	reniformis	Dendrophyllidae	II	1381352	stony corals
Porites astreoides	Porites	astreoides	Poritidae	III	104758	stony corals
Acropora palmata	Acropora	palmata	Acroporidae	VI	6131	stony corals
Pavona maldivensis	Pavona	maldivensis	Agaricidae	VII	1387077	stony corals
Herpolitha limax	Herpolitha	limax	Fungiidae	XI	371667	stony corals
Diploastrea heliopora	Diploastrea	heliopora	Diploastreidae	XV	214969	stony corals
Symphyllia erythraea	Symphyllia	erythraea	Lobophyllidae	XIX	1328287	stony corals
Heliopora coerulea	Heliopora	coerulea	Helioporaceae	Outgroup	86515	blue corals
Stylaster roseous	Stylaster	roseous	Stylasteridae	Outgroup	520406	stony corals

Excerpt from 'sites' metadata table

reef_name	date	reef_type	site_name	country	collected_by	relevant_collaborators	visibility
Big Vickie	20140728	Midshelf inshore reef	Lizard Island	Australia	Ryan McMinds	David Bourne, Katia Nicolet, Kathy Morrow, and many others at JCU, AIMS, and LIRS	12
Horseshoe	20140731	Midshelf inshore reef	Lizard Island	Australia	Ryan McMinds	David Bourne, Katia Nicolet, Kathy Morrow, and many others at JCU, AIMS, and LIRS	15
Al Fahal	20150311	Offshore reef	KAUST House Reefs	Saudi Arabia	Ryan McMinds, Jesse Zaneveld	Chris Voolstra, Maren Ziegler, Anna Roik, and many others at KAUST	Unknown
Far Flats	20150630	Fringing Reef	Lord Howe Island	Australia	Joe Pollock		15
Raffles Lighthouse	20150723	Inshore Reef	Singapore	Singapore	Jesse Zaneveld, Monica Medina	Danwei Huang	4.5
Trou d'Eau	20150817	Lagoon Patch Reef	Reunion West	France	Ryan McMinds, Amelia Foster, Jerome Payet	Le Club de Plongee Suwan Macha, Jean-Pascal Quod	10
LTER_1_Fringing	20151109	Fringing Reef	Moorea	French Polynesia	Ryan McMinds, Becky Vega Thurber	the Burkepile Lab	>35

Thus, after loading and processing the sample and photo metadata files as in the last post, I needed to load these two extra files and merge them with our sample table. This is almost trivial, using commands that are essentially in English:

sites <- read.table('sites_metadata_file.txt',header=T,sep='\t',quote="\"")
data <- merge(samples,sites)
species_data <- read.table('species_metadata_file.txt',header=T,sep='\t',quote="\"")
data <- merge(data,species_data)

And we now have a fully expanded table.

A couple of commands are needed to account for empty values that are awaiting completion when we get the time:

data$relevant_collaborators[is.na(data$relevant_collaborators)] <- 'many collaborators'
data$photo_name[is.na(data$photo_name)] <- 'no_image'

These commands subset the table to just rows that had empty values for collaborators and photos, and assign to the subset a consistent and useful value. Empty collaborator cells aren’t accurate – we’ve gotten lots of help everywhere we’ve gone, and just haven’t pulled all the information from all the teams together yet! As for samples without images, I created a default image with the filename ‘no_image.jpg’ and uploaded it to the server as a stand-in.

Default image shown when a sample has no pictures.

Now I need to introduce the R package that I used to build my map: Leaflet for R. Leaflet is actually an extensive Javascript package, but the R wrapper makes it convenient to integrate my data. The package allows considerable control of the map within R, but the final product can be saved as an HTML file that sources the online Javascript libraries. Once it’s created, I just upload it to our webpage and direct you there!

Note that although I usually use R from the Terminal, it’s very convenient to use the application RStudio with this package, because you can see the product progress as it’s built, and then easily export it at the end.

To make my map more interesting, I took advantage of the fact that each marker on the Leaflet map can have a popup with its own arbitrary HTML-coded content. Thus, for each sample I integrated all my selected metadata into an organized graphical format. The potential uses for this are exciting to me; it means I could put more markers on the map, with tables, charts, interactive media, or lots of other things that can be specified with HTML. For now, though, I decided I wanted the popups to look like this, with just some organized text, links, and a photo:

Acanthastrea echinata: E13.20.Aca.echi.1.20151110

Site: LTER_1_Backreef

Date: 20151110

Country: French Polynesia

Collected by Ryan McMinds, Becky Vega Thurber with the help of the Burkepile Lab.

So, I wrote the HTML and then used R’s paste0() function to plug in the sample-specific data in between HTML strings.

data$html <- paste0('300px; overflow:auto;">',
'<div width="100%" style="clear:both;">',
'<p>',
'<a href="https://www.flickr.com/search/?text=GCMP%20AND%20',data$genus_species,'"target="_blank">',data$genus_species,'</a>: ',
'<a href="https://www.flickr.com/search/?text=',gsub('.','',data$sample_name,fixed=T),'"target="_blank">',data$sample_name,'</a>',
'</p>',
'</div>',
'<div width="100%" style="float:left;clear:both;">',
'<img src="http://files.cgrb.oregonstate.edu/Thurber_Lab/GCMP/photos/sample_photos/processed/small/',data$photo_title,'.jpg" width="50%" style="float:left;">',
'<div width="50%" style="float:left; margin-left:10px; max-width:140px;">',
'Site: <a href="https://www.flickr.com/search/?text=GCMP%20AND%20',data$reef_name,'" target="_blank">',data$reef_name,'</a>',
'<p>Date: <a href="https://www.flickr.com/search/?text=GCMP%20AND%20',data$date,'"target="_blank">',data$date,'</a></p>',
'<p>Country: <a href="https://www.flickr.com/search/?text=GCMP%20AND%20',data$country,'"target="_blank">',data$country,'</a></p>',
'</div>',
'</div>',
'<div width="100%" style="float:left;">',
'<p>',
'Collected by <a href="https://www.flickr.com/search/?text=GCMP%20AND%20(',gsub(', ','%20OR%20',data$collected_by,fixed=T),')"target="_blank">',data$collected_by,'</a>',
' with the help of ',data$relevant_collaborators,'.',
'</p>',
'</div>',
'<div style="clear:both;"></div>',
'</div>')

Yeesh! I hate HTML. It definitely makes it uglier having to build the code within an R function, but hey, it works. If you want, we can go over that rat’s nest in more detail another time, but for now, the basics: I’ve created another column in our sample metadata table (data$html) that contains a unique string of HTML code on each row. In blue, I create a container for the first line of the popup, which contains the species name and sample name, stitched together into a link to their photos on Flickr. In orange, I paste together a source call to the sample’s photo on our server. In green, I create a container with metadata information (and links to all photos associated with that metadata on Flickr), which sits next to the image. And in purple, I stitch together some text and links to acknowledge the people who worked to collect that particular sample. Looking at that code right now, I’m marveling at how much nicer it looks now that I’ve cleaned it up for presentation…

And now that I’ve gotten all the metadata together and prepared the popups, the only thing left to do is create the map itself. However, I’ll leave that for just one more post in the series.

*math not thoroughly verified.

**edit: My father points out that we are essentially building a relational database of our metadata. In fact, I did initially intend to do that explicitly by loading these separate tables into a MySQL database. For now, however, our data isn’t all that complex or extensive, and separate tables that can be merged with simple R or Python code are working just fine. I’m sure someday we will return to a discussion of databases, but that day is not today.

Mapmaking: Part 2

Posted on December 11, 2015 by Ryan

No, you didn’t miss Mapmaking: Part 1. Before getting interrupted by last-minute extra fieldwork with the Waitt Foundation (which was awesome!), I gave an intro to photo management in Lightroom. Today I’ll expand on that, beginning a series of posts explaining how I created this map. On the way, I’ll introduce a little bit of…

*shudder*

coding.

Some really ugly code that I once wrote.

If you’ve been following my blog just to look at pretty beach pictures, I apologize. But I encourage you to keep reading. If any of the code makes you go cross-eyed, don’t worry; it does the same to me. I would love to field some questions in the comment section to make things clearer.

So. I have all of my photos keyworded to oblivion, and those keywords include sample IDs. How did I get them into my map? First, I needed to make sure I could link a given sample with its photos programmatically. I have a machine-readable metadata table that stores all our sample information, which we’ll be using later for data analysis. Metadata just refers to ‘extra’ information about the samples, and by machine-readable, I mean it’s stored in a format that is easy to parse with code. I used this table to build the map because it specifies GPS coordinates and provides things like the site name to fill in the pop-ups. But I didn’t have any photo filenames in this table, because it’s easier to organize the photos by tagging them with their sample IDs, like I explained last post. I simply needed to extract sample IDs from the photos’ keywords and add the their filenames to my sample metadata table. And not by hand.

Excerpt from sample metadata table

sample_name	reef_name	date	time	genus_species	latitude	longitude
E1.3.Por.loba.1.20140724	Lagoon entrance	20140724	11:23	Porites lobata	-14.689414	145.468137
E1.19.Sym.sp.1.20140724	Lagoon entrance	20140724	11:26	Symphyllia sp	-14.689414	145.468137
E1.6.Acr.sp.1.20140726	Trawler	20140726	10:35	Acropora sp	-14.683931	145.466483
E1.15.Dip.heli.1.20140726	Trawler	20140726	10:38	Diploastrea heliopora	-14.683931	145.466483
E1.3.Por.loba.1.20140726	Trawler	20140726	10:41	Porites lobata	-14.683931	145.466483

A popup from the map on our webpage, displaying the sample ID, selected metadata information, and a photo.

To get started, I installed a Lightroom plugin called LR/Transporter. This plugin contains many functions for programmatically messing with photo metadata. Using it, I created a ‘title’ for all of my photos with a sequence of numbers in the order that they were taken. The first sample photo from the project was one that Katia took while I was working in Australia, and it’s now called ‘GCMP_sample_photo_1’. Katia and I also took 17 other photos that contained this same sample, incrementing up to ‘GCMP_sample_photo_18’. The last photo I have from the project is one from my last trip, to Mo’orea, and it now has the title ‘GCMP_sample_photo_3893’.

Then, I exported small versions of all my photos to a publicly accessible internet server that our lab uses for data. I did this with another Lightroom plugin called FTP Publisher, from the same company that made LR/Transporter. Each photo was uploaded to a specific folder and given a filename based on its new arbitrary title. Thus my first photo, GCMP_sample_photo_1, is now easily located at:

http://files.cgrb.oregonstate.edu/Thurber_Lab/GCMP/photos/sample_photos/processed/small/GCMP_sample_photo_1.jpg

Next, I used LR/Transporter to export a machine-readable file where the first item in every line is the new title of the photo, and the second item is a comma-separated list of all the photo’s keywords, which include sample IDs.

Excerpt from Lightroom photo metadata table

GCMP_sample_photo_1	E1.3.Por.loba.1.20140724, Fieldwork, GCMP Sample, ID by Ryan McMinds, Lagoon Entrance, Pacific Ocean
GCMP_sample_photo_2	E1.3.Por.loba.1.20140724, Fieldwork, GCMP Sample, ID by Ryan McMinds, Lagoon Entrance, Pacific Ocean, Ryan McMinds
GCMP_sample_photo_124	20140807, E1.5.Gal.astr.1.20140807, GCMP Sample, ID by Ryan McMinds, Pacific Ocean, Trawler Reef
GCMP_sample_photo_1051	Al Fahal, E4.3.Por.lute.1.20150311, GCMP Sample, ID by Ryan McMinds, KAUST, Red Sea
GCMP_sample_photo_3893	E13.Out.Mil.plat.1.20151111, GCMP Sample, Mo'orea

Now comes the fun part.

To associate each sample with a URL for one of its photos, I needed to search for its ID in the photo keywords and retrieve the corresponding photo titles, then paste one of these titles to the end of the server URL. The only way I know to do this automatically is by coding, or maybe in Excel if I were a wizard. I’ve learned how to code almost 100% through Google searches and trial-and-error, so when I write something, it’s a mashing-together of what I’ve learned so far, and it’s made for results, not beauty. The first programming language I learned that was good for parsing tables was AWK, because I do a lot of work in the shell on the Mac terminal. I thus tackled my problem with that language first, in an excellent example of an inefficient method to get results:

while read -r line; do
search=$(awk '{print $1}' <<< $line)
awk -v search=$search 'BEGIN {list=""}
$0 ~ search && list != "" {list = list","$1}
$0 ~ search && list == "" {list = $1}
END {print search"\t"list}' photo-metadata-file.txt
done < sample-metadata-file.txt > output-file.txt

Ew.

I’ve been issuing my AWK commands from within the shell, which is a completely separate programming language. For the life of me, I couldn’t remember how to use AWK to read two separate files simultaneously while I was writing this code. I know I’ve done it before, but I couldn’t find any old scripts with examples, and rather than re-learn the efficient, correct way, I mashed together commands from two different languages. I then decided I needed to go back and do it the right way, so I rewrote the code entirely in AWK. That code snippet isn’t very long, but it took a lot of re-learning for me to figure it out. So it was about a week or so before I realized that since my map-making had to occur in yet another language (called R), it was ridiculous for me to be messing with AWK in the first place…

So I came to my senses and started over.

In R, I simply import the two tables, like so:

samples <- read.table('sample-metadata-file.txt',header=T,sep='\t',fill=T,quote="\"")
photo_data <- read.table('photo-metadata-file.txt',header=F,sep='\t',quote="\"")

Then use a similar process as in AWK to create a new column of photo titles in the sample metadata table (this time I simply add the first photo instead of the whole list):

samples$photo_name <- as.character(sapply(samples$sample_name, function(x) { photo_data[grep(x,photo_data[,2])[1],1] }))

And now, I have a single table that tells me the coordinates, metadata, and photo titles of each sample. With this, I can make the map, with one point drawn for each line in the table. I’ll continue explaining this process in another post.

Excerpt from sample metadata table

sample_name	reef_name	date	time	genus_species	latitude	longitude	photo_title
E1.3.Por.loba.1.20140724	Lagoon entrance	20140724	11:23	Porites lobata	-14.689414	145.468137	GCMP_sample_photo_1
E1.19.Sym.sp.1.20140724	Lagoon entrance	20140724	11:26	Symphyllia sp	-14.689414	145.468137	GCMP_sample_photo_17
E1.6.Acr.sp.1.20140726	Trawler	20140726	10:35	Acropora sp	-14.683931	145.466483	GCMP_sample_photo_37
E1.15.Dip.heli.1.20140726	Trawler	20140726	10:38	Diploastrea heliopora	-14.683931	145.466483	GCMP_sample_photo_37
E1.3.Por.loba.1.20140726	Trawler	20140726	10:41	Porites lobata	-14.683931	145.466483	GCMP_sample_photo_40

By the way, I am working on translating my blog into Spanish and French, to make it more accessible and just to help myself learn. Si quieres ayudarme, puedes encontrar la traducción activa de esta entrada y otras en el sitio Duolingo. ¡Gracias!

Frequent Flier

Posted on October 12, 2015 by Ryan

Well, I just hit 50,000 miles that I’ve flown for this project. Since March. And to think, I laughed when Becky ‘warned’ me that the job would require a lot of travel…

Oh, btw, I’m in Montserrat. The volcanic island in the Caribbean that inspired Jimmy Buffett’s timeless classic ‘Volcano’. YouTube it.

Hopped on another little plane and landed on another little island.

I’m helping the Waitt Institute out with some ecological surveys, and in return, I hope to be able to get some samples for my project. But I found out about this just 7 days ago and am only just settling in to my accommodations. Such fun!

Because why not

Photo management

Posted on September 12, 2015 by Ryan

First off, go play with this interactive map of our sampling locations on our project homepage, because I’ve been working on it for the last week and I’m very proud of it :).

Now, I have a confession to make.

Despite the singular focus of my prior blog posts, my work is not entirely composed of swimming around in the tropics. In fact, most months of the year, you can find me right here, bathing instead in the light of my computer screen.

I’ve been meaning to write more posts while stateside, but the subject matter is a bit more difficult to ‘spice up’. So I’ve put it off. Today, however, I think I’ve got an interesting topic that will begin a new theme of post regarding the most interesting and time-consuming part of my job: computer work.

Since we returned from Reunion a couple of weeks ago, I’ve spent a considerable amount of time preparing the photos and data from our trips so that they are organized, useful, and publicly accessible. So far, the team has collected over 3,000 photos of more than 550 coral samples. Keeping these organized can become very difficult as we progress, so I’ve been working with a variety of tools to make it easier. When we’re in the field, we take tons of photos of each individual coral, from closeups that show small morphological details, to wide-angle photos that we can use later to determine the surroundings of the coral. We also take photos of the reef, photos of each other, and photos of that awesome creature that I’ve never seen before and it’s so close and so colorful and sooo cool and look at it feeding, it’s waving its antennae around and catching things and it’s so awesome!!

Seriously, this mantis shrimp was freaking cool

At the end of the day, I have hundreds of photos. Some are pretty, some need post-processing work to become pretty, some are definitely not pretty but can be used as data, and some might be useable as data with some post-processing of their own. Each photo might have one or multiple samples in it, or could be a great example of a particular disease, or maybe just it just has one of us making a funny face. To be useful, I need a way to find these photos again, somewhere in the midst of the 47,000 other photos on my hard drive (seriously).

Ummm… data?

The primary tool I use to manage the mess is Adobe Lightroom. Lightroom enables me to process my photos in bulk and add keywords to the photos so I can easily search for them later. When I import all the photos from a particular dive, for instance, I have Lightroom automatically add the GPS coordinates for the dive and keywords for the site name, project, photographer, etc. Then I go through the photos and add keywords to each one that include sample identification codes and everything interesting in the picture, like fish, diseases, or divers. Now, there are two very neat aspects about Lightroom keywords that I take advantage of. The first is that you can establish keyword synonyms so that every time you tag a photo with one word, its synonyms will automatically also be attached. I can tag a photo with ‘lionfish’, and that’s all well and good. But later, I might be thinking all sciency and want to find all my photos with ‘Pterois radiata‘ in them. If I have previously told Lightroom that the scientific name and common name are synonyms, my search will find exactly what I need.

But what if I want to find all photos of fish that belong to Scorpaeniformes (the group that includes both lionfish and stonefish)? The second handy aspect of Lightroom keywords comes in here: they can be placed in a hierarchy. I’ve placed the keyword ‘Pterois radiata‘ within ‘Pterois‘, within ‘Scorpaeniformes’, so every time I tag a photo with the simple term ‘lionfish’, it’s also tagged with its higher-level taxonomic groupings. For our samples, I even put the sample ID keyword within its corresponding species. In fact, I’ve set up an entire taxonomic tree of organism names within my keywords, so every time I tag a simple sample ID, the photo is made searchable with terms corresponding to all the different levels of the tree of life. It’s awwwesommmmeee.

Manual keywords (5): E10.17.Cyp.sera.1.20150628, North Bay, Octopus, Photo by Joe Pollock, GCMP Sample
Resulting keywords (29): Animal, Anthozoan, Australia, Cephalopoda, Cnidaria, Cnidarian, Cyphastrea, Cyphastrea serailia, E10.17.Cyp.sera.1.20150628, GCMP, GCMP Sample, Hard coral, Hexacorallian, Indo-Pacific, LH_282, Lord Howe Island, Merulinidae, Metazoan, Mollusc, North Bay, Octopus, Pacific Ocean, Photo by Joe Pollock, Protostome, Robust, Scleractinian, Stony Coral, XVII, AU

The next stage of photo management for me is post-processing. I am nowhere close to an expert photographer or image editor, but I’m learning. It’s still amazing to me how much a photo can be improved with a couple quick adjustments of exposure and levels. Most of the time, photos seem to come ‘off the camera’ with a washed-out and low-contrast look. Underwater photos always have their colors messed up. When we take photos of samples, we generally put a standard color card and CoralWatch Coral Health Chart in the frame so that we can make the right adjustments later. Fixing the color and exposure doesn’t just make the photos prettier, it can help us to understand the corals. It’s tough to spot patches of disease or the presence of bleaching when the whole photo is various dark shades of green. The best thing about Lightroom (at least compared to Photoshop and a number of other image editing programs)* is the ability to make adjustments in bulk. Often, a particular series of photos were all taken in very similar conditions. Say, all the photos from a single dive, where we were at 30 ft with a particular amount of visibility and cloud cover. I can play around with just one of the photos, getting the adjustments just right, then simply copy those adjustments and paste them to the rest of the photos from the dive. Voila! Hundreds of photos edited.

Before adjustments

After adjustments

Aaaand before

Aaaannd after

Once I’ve got the photos edited and organized, I can do fun things with them, like export them to Flickr for your browsing pleasure, or embed them in the map you explored at the beginning of the post. But explaining that is for another day…

*A note about software. The next-best photo software I’ve used is Google’s free (free!) Picasa. Picasa will also allow you to batch-edit photos, and had facial recognition long before Lightroom. iPhoto also has these features. But as far as I know, the keywording in Picasa and iPhoto doesn’t support hierarchies or synonyms.

Merci Beaucoup!

Posted on September 8, 2015 by Ryan

Although we generally like to post all the fun details of our project, doing fieldwork internationally is hard. Mountains of paperwork and preparation go into our trips (much of it often stressful and last-minute), and when we arrive, we generally don’t know the local corals very well, don’t know the language as well as we think we do, and don’t know the area at all. We’re learning as we go about all the best ways to make our trips go smoothly.

But for now, as I sit in the Paris airport on my way home, I’d like to give a shout-out to all the people who have helped make this particular trip happen. One of the first contacts Jerome made on the island was with Le Club de Plongee Suwan Macha – an organization of SCUBA divers that works like a co-op, buying and maintaining resources that are shared by members at a very affordable price. This system worked great for us as a way to get many customized dives in and seems like an awesome set-up for scientific diving in general. We even borrowed a few tanks of air for some of our ‘labwork’, unrelated to diving. After we joined the club, the acting president, Pierre Grisoni, volunteered his time to drive the boat and refill tanks for us for all the dives we did on the West coast of the island. These dives were essential to our collections and formed the core of our trip! Merci beaucoup à Pierre and the rest of the club!

Thanks, Pierre and Suwan Macha!

Another important contact was Dr. Jean-Pascal Quod, president of Reef Check France and manager of Pareto Ecoconsult. Jean-Pascal and the diving club SUBEST were instrumental in our collections on the East side of the island, and showed us some really great reefs over there.

Perhaps the most important local entity was The Natural Marine Reserve of La Réunion (RNMR), which provided us with local collections permits and prepared our CITES export permits. Dealing with this paperwork is often the most difficult part of our work, and being able to work with the local management authority is essential to our project.

Many other people have been helpful on this particular trip. For starters, I bummed a ride to and from the Portland airport with my parents, which is excellent. I also left my car with them and got lots of other help from them before leaving. I believe Amelia’s mother also took her and Jerome to the airport, after quickly sewing together my BCD weight pocket for me. Ummm, awesome!! Then there’s Jerome’s mom, who on multiple occasions hosted us all for outstanding dinners while we were in Reunion. Everything’s easier in life with parents like these!

Les parents McMinds: merci for all you do

We also met many of Jerome’s friends and family while there, and a number of them provided us with delicious food, too. Thank you to all of you for showing us your island and making the trip great!

Since we first started planning the trip, there has been one person who made the right contacts, spoke the right language, and put in a lot of effort to get all the permitting and paperwork done on the French end of things: our postdoc Dr. Jerome Payet. In addition to pre-trip organization, he also acted as our guide, facilitator, translator, and co-director throughout the trip. I’ve worked with Jerome a lot in the last couple years, and he has been an integral part of the lab for a bit longer than me, but working on this particular project was generous of him. This trip came at a special time for Jerome, as well, since he is now moving on to work with a different lab at OSU. The work he put into it is thus very much appreciated. Thank you – we will miss you!!

Au revoir, Jerome

Intro to Sampling Strategy

Posted on August 20, 2015 by Ryan

The sampling is ramping up here in Reunion, and the checkboxes are filling up next to target corals. In the last three days, we have collected samples from 27 corals, representing 22 species from 16 genera, 11 families, and 2 classes. Since the actual physical taking of a sample involves just rubbing a syringe against it and breaking off a tiny chunk, our number may not actually seem very high. However, there are a few things that make the process take longer than theory would predict. As Amelia mentioned in the last post, one thing that’s slowing us down is the environment. We’ve discovered before that working in shallow water is not easy. In the lagoon here on Reunion, the water is often so shallow that we are trying to spot live corals in ankle-deep water, then having to find a way to lie down to examine them without crushing the reef or sitting on a poisonous stonefish. In other places, the water is about waist-deep, and the huge waves breaking on the crest continue into the back-reef, sloshing us around amongst the sharp corals and stinging fire-corals, and making it very difficult to stay steady enough for photos and sampling. Plus, it’s winter here, and the water is ‘cold’. 76 degrees Fahrenheit seems warm at first, but after ~4 hours of being submersed in it, the water still saps out all of our body heat. We’re getting cold, sunburned, and beat up!

But if that was the only problem, I’d say we’d just have to suck it up and get the work done! But another, bigger problem is that we have to find the corals. Not just any, but a relatively specific list of coral types. We’re only planning to take a small number of samples from each type while we’re here, and I’d prefer not to take them all from the same location at the same time. I mentioned before that confounding factors can make it difficult to determine which variable is responsible for a given trend. If all we found on Day 1 were Porites and Acropora, and we immediately took all of the trip’s samples for those species, we would have confounded our species variable with time and location. Later, if we took all of our Fungia samples on a single, different day, it would be hard to be confident that differences in the microbes between our Porites and Fungia samples were actually attributable to host specificity. An equally good alternative explanation would be that microbes on corals on Day 1 were different than microbes on corals on Day 5, no matter which species we sampled on each day. This is likely to be true for many microbes due to differences in disease prevalence, tidal height, current direction, light level, etc. To be confident that differences are due to coral species, we need to have a clear sampling plan. A solution is to find and sample replicates from many different coral species on the same day. Differences among these samples would be more confidently attributable to individual colonies and, through replication, to coral species. So we are doing our best to find locations that have high levels of diversity. High diversity reefs were easy to find at Lizard Island and KAUST and made our sampling there go great!

We are not having problems finding Porites (massive) and Acropora (branching)…

This Fungia, however, is the only one we’ve found, so far.

The first couple of days that we were here in Reunion, we spent a lot of time exploring the lagoon just down the street from our rental house. We chose the house hoping that the majority of our sampling could be just a short walk and swim away. However, we weren’t finding much in those reefs. Of the ~16 families of corals that we hoped to find here, only 2 were common, and we only found 5 there in total. So after a weekend of exploring the island for fun (escaping the critical eyes of the heavy crowds at the beach), we began our sampling in the lagoon of Trou d’Eau, a short drive south of us. The reefs there were, if anything, less abundant and diverse than the ones here. We got samples from 5 families. So the next day we went even further south, to Saint-Leu, to see if our luck would be better. Indeed, we found a reef that had much more cover and much more diversity than those up north. We collected samples from 8 families, 5 of which were new! Still, with a total of 10 families, we were still missing a few that have been very common and conspicuous in other wide-ranging Indo-Pacific reefs that I have sampled. So we decided yesterday to try a different environment and brave the shark-infested fore-reefs via scuba. The day was great – I absolutely love the feeling of being on a boat in the tropics, and the feeling of breathing clean, cool air through a regulator while suspended underwater. Plus, the sampling is way easier while diving under the waves, and doesn’t tend to get us all beat up. But the reef wasn’t very diverse. We found 5 families of corals – only 1 of them new.

Ahh, I love being on the water!

Thought this was a Montipora – closer inspection reveals it’s just another species of Porites!

Weekend getaway

Cold mists of the volcano

As the trip reaches its half-way point, we are ready to buckle down and get going on replicates of what we already have. We’ll keep our eyes out for the missing coral families, but would be relatively satisfied with the current repertoire if it’s all we wind up finding. Today, we head south again, this time diving on the fore-reef, where we hope to find a beautiful combination of easy sampling and diverse corals.

Finding the moon and meeting Tiki

Posted on August 19, 2015 by fosteram

We had spent the weekend with Jerome’s family and after an evening of food and laughter we were ready to explore the island. Réunion has many different microclimates with landscapes ranging from arid forests to tropical beaches. On our way to the Piton de la Fournaise volcano we reflected on how these different microclimates reminded us of a mixture of places across the globe. We even found the moon!

Mountain or moon?

Piton de la Fournaise is a shield volcano and is one of the world’s most active volcanoes. It is around 530,000 years old and 2,631m high. Piton de la Fournaise is one of two volcanoes, the other being Piton des Neiges, that make up Réunion. Up until a few weeks ago, it’s most recent eruption was in 1986. Due to its activity, the hikes circling its peak were closed, but we were still able to get an awesome view of it!

Piton de la Fournaise!

Of course, we couldn’t have done any of this without our awesome matching hats!

Jerome’s mom outfitted us with matching hats to protect us from the sun.

Now that the weekend is over it’s time to get down to business. Monday came bright and early with birds chirping and the smell of science in the air! Like all good scientists we had our ritual morning coffee and then rolled out into the field. Spending the majority of the day sampling we were able to see most of the lagoon in Saint-Gilles. In the lagoon alone we were able to find five different clades of coral, a plethora of sea cucumbers and zero sharks.

A snapshot of some of the corals we collected! (Montipora sp., Porites cylindrica and Porites lichen)

The main thing that I have to say about Monday is this: weight belts. Even though we were in a shallow lagoon our buoyant weight kept on pushing us up, making it difficult – but not impossible – to sample. From shore I’m sure we looked like two poorly coordinated synchronized swimmers with our feet flapping in the air as we tried to stay down.

Today, we hopped in the car and went to a different section of the island in hopes of finding a more biodiverse reef. We struck gold and were met by beautiful reefs in crystal clear water. But there was one catch: strong currents (everyone’s favorite). The currents quickly introduced Ryan and I to the fire corals in the surrounding area and by the end of the field day I’d say we all became good friends.

Fortunately, we had brought Tiki with us so we weren’t scathed too badly. Tiki is the good luck charm of the Vega-Thurber lab and has been on almost every field trip the lab has gone on. That being said, Tiki has traveled a lot and spent many days in the sea (his black hair turned blond is proof). I’ll allow Tiki to introduce himself:

https://www.flickr.com/photos/131967103@N02/20690925201/in/album-72157651381609701/

And so folks, that concludes the past few days in Réunion!

Bienvenue à la Réunion!

Posted on August 15, 2015 by fosteram

Hi guys! My name is Amelia Foster. I’m currently an undergrad in Becky’s lab though I graduate soon (woo!). By the end of this summer, in fact, I will have finished my majors in Microbiology and International Studies. I started volunteering in Becky’s lab as a sophomore in 2012. Under her mentorship I have learned important molecular biology techniques associated with coral reef ecology. Recently, I have been given the opportunity to learn fieldwork techniques with Ryan and Jerome in Réunion Island, France.

Our flight pattern from Oregon to Réunion

After 30+ hours of flying, an inordinate amount of babies crying and lots of bread and cheese we arrived in Réunion just as the sun was coming up over the water. Originally named Bourbon, Réunion is a French department located in the Indian Ocean just east of Madagascar. Volcanic eruptions beginning 5 million years ago formed the island that today houses around 850,000 people. The island was uninhabited until 1643 when the French sent twelve convicts there into exile. In the mid 17^th century the island was further colonized. The settlers recruited a large amount of slave labor, from Africa, Madagascar, India and Tamil until the year 1848, which marked the abolition of slavery. Now, Réunion has a multi-cultural identity with people from all over the world.

Since arriving on the island just a few short days ago we have become fully immersed (though I still can’t speak at all) in French and have begun setting up field studies. From the house to the market to the beach, my daily life has become a game of charades. Picking up a few words here and there I can currently string together a few sentences that are inapplicable to almost all situations:

Je ne sais pas et jáime l´pomme et l´chat.

Ryan is doing much better than I am and can almost carry a conversation in French. But Jerome, who is from Réunion, remains our savior in almost every situation.

Hanging out with Jerome’s family

Jerome has not only introduced us to his family and friends on the island but has told us of the terrifying homme-coq. The homme-coq has the body of a chicken and the legs of a man. It roams around the island, terrorizing the people and stealing children. So, we better watch out.

But even in the face of the perilous homme-coq -and not to mention the bull sharks– we have been able to begin the preliminary steps in setting up our fieldwork. Ryan has already given me a crash course in coral identification as we were scouring the lagoon near our house in Saint Gilles for different genera of corals. And the other night we helped Jerome collect water samples to later analyze for viral content.

La bobine beach, where we are currently sampling

Today, we are coordinating with local dive shops to acquire tanks and begin sampling a few of the corals we identified.

A Day in the Life

Posted on March 24, 2015 by Ryan

Errrrgggg. I could tell you all about the dull, monotonous, and mind-numbing labwork portion of my trip, or we could sit and watch this video together. Remember the good ol’ days of fieldwork!

That there video was produced by Oregon State University’s media department. I am very pleased with how it turned out. The university is using this for advertisement purposes; however, the guys behind it are using the experiences and footage for a lot more. Media is an exciting aspect of the GCMP. We are doing our best to open our project, data, and experiences to colleagues and the public, and part of our funding is allocated toward ‘outreach’. For us, the outreach aspect is important, so we are working with the university media guys to produce a number of these short videos, a few online and magazine articles, and, most excitingly, a feature-length film about the decline of coral reefs and the consequences for the people who depend on them. Here’s a trailer (with most of the footage again from Lizard Island):

I briefly mentioned the media guys David and Justin in a previous post, because they came with us on this trip to Saudi Arabia. Having them around was great! Nothing helps clarify the purposes of a project like discussing it with ‘outsiders’.

But seriously, this labwork… For every day diving, I’ve spent two in the lab. And a day in the lab has been ~9:00 AM – ~11:00 PM on average. I DO NOT REMEMBER THIS TAKING SO LONG IN AUSTRALIA!

The GCMP

Posted on March 17, 2015 by Ryan

Turbinaria stellulata. Family Dendrophylliidae (“Clade II”)^[1]

In my last post, I mentioned that I was continuing the project I started last summer at Lizard Island, Australia. That’s true, but in my haste to get a post out about my current trip, I neglected some important updates. First and foremost: thanks to an NSF grant through the Dimensions of Biodiversity program, our project is official, and we have a name! The Global Coral Microbiome Project, or GCMP. The team consists of members of the Vega Thurber Lab at Oregon State University and the Medina Lab at Penn State University. Along with more money and a bigger team, the goals of the project have expanded a bit. We’re still aiming to understand how different corals have evolved to structure their microbial communities, but, as the new name implies, we are now also looking at how these communities differ geographically in corals around the world. We know that corals that are related to each other can inhabit vastly different environments, so describing the microbes they associate with in only a subset of those environments wouldn’t get the whole picture. For example, corals that look like this:

Porites lobata, Pocillopora verrucosa, and Pocillopora …?

can be found in places as wide ranging as the cold, nutrient-rich, upwelling-fueled waters of the Eastern Pacific, the calm waters of the Society Islands in the South Pacific (where I took this photo), and the crystal clear, positively balmy waters of the Red Sea, from whence I am writing this post. Most taxonomists place individuals from either end of their range into the same species, but at some point that is an arbitrary decision. There are clear physiological differences within coral species that are correlated with geography. If you transplanted a colony of Pocillopora damicornis from Panama to Saudi Arabia, the elevated water temperatures would almost certainly cause it to bleach and die. Why? Dunno. Some researchers, such as the Meyer lab at OSU, are trying to figure that out by looking at genetic differences in the corals. Others suggest that corals can gradually acclimate to such extremes in temperature. We think those hypotheses are part of the story, but that the microbes that live with corals might tell another important part. After all, the interactions with microbes through disease and bleaching are the most common causes of coral death. If we compare the differences in microbes across a host species’ range of environments to the differences explainable by the coral’s evolutionary history, we might be able to explain why some corals are more tolerant of variation in the environment than others.

Reveal your secrets to me, oh corals!

As I procrastinate on my mountains of queued labwork, I am happily organizing and editing my photos from the field. We have photographed each sampled coral colony, hoping to use the collection as a backup for the metadata that we collected simultaneously. The photo at the top of the page depicts the last coral we sampled on this trip – one that had me pumping my fists underwater in excitement! It’s not a particularly rare species, but Jesse and I had a long wish list, a short span of time, and a limited number of reefs to explore. In order to describe the broad levels of variation in the coral microbiome, we are trying to sample at least two species from each coral family we come across, in each location. After we visit a number of reefs around the world, we hope to have enough replication within each family to describe how they differ from one another. As our tanks of air slowly got lower on gas, we still hadn’t found a symbiont-bearing representative of the Dendrophylliidae, though we knew it was around here somewhere! Just as I had given up on it, I spotted that yellow rock. And to be honest, the excitement I felt at that moment is the real reason that I do what I do.

The prize is won.

The Cnidae Gritty

Searching for details in the study of coral microbiology

Category Archives: GCMP Update