We’ve recently been prototyping a new exhibit with standard on-the-ground methods, and now we’re going to use the cameras to do a sort of reverse ground-truthing. Over our busy Whale Watch Week between Christmas and New Year’s, Laura set up a camera on the exhibit to collect data on people using the exhibit at times when we didn’t have an observer in place. So in this case, instead of ground-truthing the cameras, we’re sort of doing the opposite, and checking what we found with the in-person observer.

However, the camera will be on at the same time that the researcher is there, too. It almost sounds like we’ll be spying on our researcher and “checking up,” but it will be an interesting check of both our earlier observations without the camera in place, as well as a chance to observe a) people using the new exhibit without a researcher in place, b) people using it *with* a researcher observing them (and maybe noticing the observer, or possibly not), and c) whether people behave differently as well as how much we can capture with a different camera angle than the on-the-ground observer will have.

Some expectations:

The camera should have the advantage of replay which the in-person observer won’t, so we can get an idea of how much might be missed, especially detail-wise.

The camera audio might be better than a researcher standing a ways away, but as our earlier blog posts have mentioned, the audio testing is very much a work in progress.

The camera angle, especially since it’s a single, fixed camera at this point, will be worse than the flexible researcher-in-place, as it will be at a higher angle, and the visitors may block what they’re doing a good portion of the time.

 

As we go forward and check the automated collection of our system with in-place observers, rather than the other way around, these are the sorts of things we’ll be checking for, advantages and disadvantages.

What else do you all expect the camera might provide better or worse than a in-person researcher?

 

In the last couple of weeks Katie and I have been testing some options for capturing better quality visitor conversation for the camera system using external mics.

As Katie mentioned last month, each camera’s built-in microphones are proving to be a little unfruitful in capturing good quality audio for the eventual voice recognition system in “hot-spot” areas such as the touch tanks and front desk. As a result, we purchased some pre-amplified omni-directional microphones and set about testing their placement and audio quality in these areas. This has been no easy process, as the temporary wiring we put in place to hook the mics to the cameras is  not as aesthetically pleasing in a public setting as one might hope, and we discovered that the fake touch tank rocks are duct-tape’s arch enemy. Plus the mics have been put through their paces through various visitor kicks, bumps and water splashes.

As well as the issue of keeping the mics in place, testing has also meant a steep learning curve about mic level adjustment. When we initially wired them up, I adjusted each mic (via a mixer) one by one to reduce “crackly” noises and distortion during loud conversations. However, I later realized the adjustment overlooked necessary camera audio setup changes, and gain adjustments, affecting just how close a visitor has to get to one of the mics to actually hear them, particularly over the constant noise of running water around tanks.

So today I am embarking on a technical adventure. Wearing wireless headphones and brandishing a flathead screwdriver, I am going to reset all the relevant cameras’ audio settings to a zero gain, adjust the mic levels for mic balance (there are multiple mics per camera) rather than crackly noises, and adjust the gain until the sample audio I pull from the camera system comes out cleaner. I’m not expecting to output audio with the clarity of a seastar squeak, but I will attempt to get output that allows us to capture focal areas of clear conversation, even with the quietest of visitors. Avast me hearties, I be a sound buccaneer!

Do visitors use STEM reasoning when describing their work in a build-and-test exhibit? This is one of the first research questions we’re investigating as part of the Cyberlab grant, besides whether or not we can make this technology integration work. As with many other parts of this grant, we’re designing the exhibit around the ability to ask and answer this question, so Laura and I are working on designing a video reflection booth for visitors to tell us about what happened to the structures they build and knock down in the tsunami tank. Using footage from the overhead camera, visitors will be able to review what happens, and hopefully tell us about why they created what they did, whether or not they expected it to survive or fail, and how the actual result fit or didn’t match what they hoped for.

We have a couple of video review and share your thoughts examples we drew from; The Utah Museum of Natural History has an earthquake shake table where you build and test a structure and then can review footage of it going through the simulated quake. The California Science Center’s traveling exhibit Goosebumps: the Science of Fear also allows visitors to view video of expressions of fear from themselves and other visitors filmed while they are “falling”. However, we want to take these a step farther and add the visitor reflection piece, and then allow visitors to choose to share their reflections with other visitors as well.

As often happens, we find ourselves with a lot of creative ways to implement this, and ideas for layer upon layer of interactivity that may ultimately complicate things, so we have to rein our ideas in a bit to start with a (relatively) simple interaction to see if the opportunity to reflect is fundamentally appealing to visitors. Especially when one of our options is around $12K – no need to go spending money without some basic questions answered. Will visitors be too shy to record anything, too unclear about the instructions to record anything meaningful, or just interested in mooning/flipping off/making silly faces at the camera? Will they be too protective of their thoughts to share them with researchers? Will they remain at the build-and-test part forever and be uninterested in even viewing the replay of what happened to their structures? Avoiding getting ahead of ourselves and designing something fancy before we’ve answered these basic questions is what makes prototyping so valuable. So our original design will need some testing with probably a simple camera setup and some mockups of how the program will work for visitors to give us feedback before we go any farther with the guts of the software design. And then eventually, we might have an exhibit that allows us to investigate our ultimate research question.

Pulling it all together and making sense of things proves one of the hardest tasks for Julie:

“I can’t believe this summer is about over.  I only have 3 days left at Hatfield.  Those 3 days will be filled with frantic work getting the rest of my exhibit proposal pulled together as well as my Sea Grant portfolio and presentation done for Friday.  I go home Saturday morning and I haven’t even figured out when I’m going to pack.  Eek.

But back to the point at hand.  Doing social science has been such a fun experience.  I really loved talking to people to get their feedback and opinions on Climate Change and the exhibit.  I’m so excited for this exhibit.  I want it to be fantastic and I’ve been working very hard on it.  I am stoked to visit next summer to see it in the flesh!

One thing that I find really challenging about doing this kind of research though, is pulling together the data and putting it into a readable format for something like my End of Summer Final Presentation on Friday!  The big survey I did, for instance, was 16 questions and the data collected is very qualitative and doesn’t fit neatly into a table on a power point slide.  So I have to determine which things to pull out to show and exactly how to do it.  I feel confident that I’ll get it down, it’s just going to perhaps rob me of some sleep the next couple days.

Today (Tuesday) I finally got to do something that I should’ve done long ago.  Mark took me into the “spy room” as some call it and showed me all the awesome video footage being recorded in the visitor center.  It’s really incredible!  I was able to download a few videos of myself interpreting at the touch tank which Mark suggested would be a good addition to my portfolio.  Now I feel like a real member of the Free Choice Learning crew.”

This summer has given me a wealth of experiences that will really benefit my future…I can’t wait to see what that future holds.

Our Summer Scholars’ time is drawing to a close at the end of the month, so we’re hearing some final words, at least for the moment, from some of them, starting with Diana:

“These past weeks have been filled with things that I never thought would happen and have surprised me in the most spectacular ways.  First, I went on vacation to Vancouver, BC and Seattle, WA which was a memorable experience.  I was able to see behind the scenes tanks and animals at the Vancouver Aquarium and even got to see Leonardo Da Vinci’s works in person as well as King Tutankhamen’s burial chamber items.  This vacation was a nice break from the craziness of the visitor’s center and refreshed me for another few weeks as an education intern.  The moment I returned many volunteers and other workers at Hatfield were asking about my vacation.  Even this little thing made me feel fully welcomed into the Hatfield family.  One of the first things that occurred when I returned was that many unannounced summer camps came into the visitor’s center which is always an experience.  Yet, one of the most progressive things I did was creating new signs for me shoreline erosion tank.  This time one of my mentors Mark Farley and I created 2 different signs compared to one long sign.  One sign said “The Erosion Problem” with photos of me showing how to use the paddle to create waves and see the erosion of the sand.  The second sign said “The Erosion Solution” and gave the visitors a chance to try 1 of 3 different protective strategies for beach/shoreline erosion.  These new larger signs seem to be working well for now.  I can already see a difference in the behavior of children and families when they come to wave tank; instead of sand castle building, they actually read the sings and follow the directions.

The visitor’s center also had some crazy moments.  We had Micro A and Micro B tanks overflow into the VC overnight and leave a lake in the surrounding area an inch deep.  That lake was an interesting mess to clean, but created a wonderful learning moment.  I was able to watch the aquarists and learn how to put on new filter bags as well as rework the tanks.  I was challenged to follow the pipes and figure out where the water went such as the outflow and inflow pipes.  Other crazy moments that occurred were people trying to put their whole hand inside of anemones or trying to crawl inside of the touch tank to touch the different fish.  While all of this was going on I also got to have some spectacular moments in the VC.

These spectacular moments occurred when the Aquarists took me under their wing and showed me some impressive things.  First, I got to see a fish necropsy which was highly informative and taught me new dissections skills.  I was also taught how to kill invasive coral apitasia with lemon juice.  I was able to inject a few micrometers of lemon juice into each invasive apitasia, which kills it almost instantaneously.  The apitasia tries as a defensive mechanism to spit its own guts out, but the lemon juice is too acidic.  I also learned through this process how to siphon a tank and change out the water while balancing the acidity in the water with baking soda, thus making the seawater more neutral.  Yet, the most spectacular thing I learned with the aquarists was how to feed all the animals in the Hatfield Marine Science Center.  I learned how and what to feed each animal except the octopus in the visitor’s center, which took a long time but was completely worth it.  The amount of knowledge I learned during that time was amazing and I will not forget anytime soon.  This entire summer has been a learning experience, but definitely a fun one that I shall remember for the rest of my life.”

 

Summer Sea Grant Scholar Julie catches us up on her prototyping for the climate change exhibit:

“Would you like to take a survey?”  Yes, I have said that very phrase or a variation of it many times this week.  I have talked to more than 50 people and received some good feedback for my exhibit.  I also began working on my exhibit proposal and visuals to go along with it.  This is so fun!  I love that I get to create this, and my proposal will be used to pitch the plan to whatever company they get to make the exhibit program.  How sweet is that?

So, the plan is to have a big multi-touch table – here is what it looks like, from the ideum website:

 

You can’t see very well from that picture but people can grab photos or videos or other digital objects, resize and move them around and place them wherever they want using swipe, pinch, and other gestures as with tablets and multitouch smartphones.  It allows multiple users to surround the table as well and work together or independently. This is a video showing this table tested here at Hatfield- it has a lot of narration about Free Choice Learning, and you can see the table in action a little bit.

People will be able to learn about climate change and then create their own “story” about what they think is important about climate change or global warming.  My concept of the interface for this has gone through a metamorphosis.  Here are the various transformations the interface has gone through:

Stage 1: My initial messy drawing to get my thoughts on paper and make sure I was on the same page with the exhibit team.  At this point I thought we would just have a simple touch screen kiosk.

 

Stage 2: Mock-up made by Allison the graphic designer, using stage 1 as a guide.  I showed this to people as I interviewed them so they’d have an idea of what the heck I was talking about.

 

Stage 3: My own digital version I’m currently working on, now more in sync with the touch table.  The final version will go into my exhibit proposal.

 

Here’s what it looks like with a folder opened – upon touching a file, an animation would show the file opening and spilling the contents on the workspace to end up kind of like this:

 

This is a very exciting project to work on, and I’m glad to get to use and hone my skills in creativity, organization, and attention to detail.  This exhibit proposal will certainly need a lot of all 3 of those things.  It’s also very interesting to interview people- I find my preconceptions dashed often, which is very refreshing.  And it’s great to be able to tailor the exhibit to several different audiences, in hopes that the message will be well received by all, no matter where they currently stand in relation to the issue of climate change/ global warming.  Talking with folks helps me know for sure what kind of material each group wants, so I can maximize the success of the exhibit with that group.  I can’t wait to see this thing in the flesh – I have already decided I will have to take a vacation out here next summer just to check it out!