Summer is flying by and the hard work in the Cyberlab continues.  If you have been keeping up with previous posts, we have had researchers in residence as part of our Cyber Scholar program, movement on our facial recognition camera installations, and conference presentations taking place around the country and internationally.  Sometimes I forget just how amazing the implementation of unobtrusive audio and video collection methods are to the field of visitor research and exhibit evaluation until I talk to another researcher or educator working at another informal learning center.  The methods and tools we are applying have huge implications to streamlining these types of projects.  It is exciting to be a part of an innovative project in an effort to understand free choice learning and after a year in the lab, I have gained several new skills, particularly learning by doing.

As with any research, or project in general, there are highs and lows with trying to get things done and working.  Ideally, everything will work the first time (or when plugged in), there are no delays, and moving forward is the only direction.  Of course in reality there are tool constraints, pieces to reconsider and reconfigure, and several starts and stops in an effort to figure it out.  There is no Cyberlab “manual” – we are creating it as we go – and this has been a great lesson for me personally when it comes to my approach to both personal and professional experiences, particularly with future opportunities in research.

Speaking of research, this past week I started the data that will go towards my Master’s thesis.  As I am looking at family interactions and evidence of learning behaviors around the Ideum touchtable, I am getting the chance to use the tools of the Cyberlab, but also gain experience recruiting and interviewing visitors.  My data collection will last throughout the month of August, as I perform sampling during morning and afternoon hours on every day of the week.  This will allow for a broad spectrum of visitors, though I am purposively sampling “multi-generational” family groups, or at least one adult and one child using the exhibit.  After at least one minute of table use, I am interviewing the group about their experience using the touch table, and will be looking at the footage to further analyze what types of learning behaviors may be occurring.

During my observations, I have been reflecting on my time as an undergraduate conducting research in marine biology.  At that point, I was looking at distribution and feeding habitats of orange sea cucumbers in the Puget Sound.  Now the “wildlife” I am studying is the human species and as I sit and observe from a distance, I think about how wildlife biologists wait in the brush for the animal they are studying to approach, interact, and depart the area.  Over the course of my sampling sessions I am waiting for a family group to approach, interact, and depart the gallery.  There are so many questions that I have been thinking about with regards to family behavior in a public science center.  How do they move through the space, what exhibits attract particular age groups, how long do they decide to stay in any particular area, and what do they discuss while they are there?  I am excited to begin analyzing the data I will get.  No doubt it will likely lead to more questions…

Last week, Katie Stofer and Lisa Anthony from the University of Florida spent a week in residence at Hatfield Marine Science Center as part of the Cyberscholars program. Here is their account of their week:

We are interested in investigating how people learn science in informal settings such as the science center, in this case, specifically through interactions with visualizations of global ocean data. During the week in residence, we observed users interacting with exhibits on an Ideum multi-touch table, the same multi-touch screen mounted on the wall, and a traditional touch screen kiosk that controls a 3-foot spherical Magic Planet display. We also conducted semistructured interviews with visitors to understand how the exhibits were working for them or falling short and how the exhibits could be improved. Lisa got acquainted with the Cyberlab setup at HMSC, including the camera system and its synchronized audio stream, and Katie got re-acquainted — she actually worked on the installation of the system as a graduate student. Jenny had created a custom view of the eight cameras focusing on the exhibits of interest. In all, we collected roughly 50 visitor observations and around 20 interviews, and we also created workable prototype exhibits to continue collecting data once we leave to supplement and compare with the in-person data we collected.

Our collaboration combines the traditions of informal science learning with human-computer interaction to investigate the whole exhibit experience from the touch interaction to the resulting meaning-making. After returning home to Florida, we will continue remote observations of the exhibits to analyze more patterns of use by a broader cross-section of users. Ultimately we may design new programs for these exhibits to harness the power of touch interaction to invite users to deeply investigate the patterns in these visualizations, while presenting the visualizations in forms that we know best facilitate meaning-making by many users.

Lisa is an Assistant Professor in the Department of Computer & Information Science & Engineering (CISE) at UF, and works on human-computer interaction questions of natural input modalities (e.,g., touch, gesture, and speech) for kids and learning. She is interested in designing for exhibits at HMSC because interfaces in public settings need to be very robust and intelligent to be able to handle the diverse visitors who may be using them. Information seeking, navigation, and understanding can be either enabled or challenged depending on the efficacy of the interaction. Lisa earned her PhD from Carnegie Mellon in Human Computer Interaction in 2008.

Katie is now Research Assistant Professor of STEM Education and Outreach at the University of Florida in the Department of Agricultural Education and Communication, after earning her PhD as part of the Free-Choice Learning Lab at Oregon State University in 2013. She wants to help publics gather, make sense of, and use the results of current research for decision-making at personal, societal, and global levels through public engagement with science. In particular, visualizations of data can harness the powerful human visual system if designed to make use of, rather than compete with, perceptual and cultural systems. Katie is also interested in agriculture as a context for engaging with many contemporary science and engineering issues.

 

Spring Quarter is now upon us and with that there is plenty of “spring cleaning” to get done in the Cyberlab prior to the surge of visitors to Newport over the summer months.  For a free-choice learning geek like me, this period of data collection will be exciting as I work on my research for my graduate program.

The monitoring and maintenance of the audio and video recording devices continues!  Working with this technology is a great opportunity to troubleshoot and consider effective placement around exhibits.  I am getting more practice with camera installation and ensuring that data is being recorded and archived on our servers.  We are also thinking about how we can rapidly deploy cameras for guest researchers based on their project needs.  If other museums, aquariums, or science centers consider a similar method to collect audio and video data, I know we can offer insight as we continue to try things and re-adjust.  At this point I don’t take these collection methods for granted!  Reading through published visitor research projects, there was consideration for how to minimize the effect of an observer or a large camera recording nearby and how this influenced behavior.  Now cameras are smaller and can be mounted in ways that they blend in with the surroundings.  This helps us see more natural behaviors as people explore the exhibits.  This is important to me because I will be using the audio and video equipment to look for patterns of behavior around the multi-touch interactive tabletop exhibit.

Based on comments from our volunteers, the touchtable has received a lot of attention from visitors.  At this time we have a couple different programs installed on the table.  One program from Open Exhibits has content about the electromagnetic spectrum where users can drag an image of an object through the different sections of the spectrum, including infrared, visible, ultraviolet, and x-ray, while providing information about each category.  Another program is called Valcamonica, which has puzzles and content about prehistoric petroglyphs found in Northern Italy.  I am curious as to the conversations people are having around the table and whether they are verbalizing the content they see or how to use the technology.  If there are different ages within the group, is someone taking the role as the “expert” on how to use it?  Are they modeling and showing others how to navigate through the software?  Are visitors also spending time at other exhibits near the table?  There are live animal exhibits within 15 feet of the table and are they getting attention?  I am thinking about all of these questions as I design my research project that will be conducted this summer.  Which means…time to get back to work!

It is official, I have been in graduate school too long. It has started to change the way I think about the world!

Last night, I was at a local Science Pub event. This in and of itself, might trigger the “nerd” label for some people, but as a fairly educated person before starting this PhD, and living in a liberal, college town, lots of types of people attend these events now.  Science Pubs are almost trendy these days. Our local one is often standing room only, and takes place in a venue that is used frequently for concerts, fund-raisers and shows of all kinds.  Even the name of the venue is cool- Cozmic Pizza- you can have pizza and a beer and listen to smart people talk.  Not a bad way to spend an weekday evening.  Also, the topic was not even that fringe- “You Are What You Eat: The Evolutionary Importance of Diet in Mammals”.  The talk was given by a local professor, Dr. Samantha Hopkins, who is in the Geology Department at the University of Oregon. While her work is often in paleontology, she is a self-described “mammal geek” and her talk was peppered with lots of funny anecdotes and plenty of cute photos of mammals (none of which my partner would agree to let me get as a pet… sigh…)

All of this was a pleasant experience. I learned a few things, laughed a few times, and enjoyed a glass of Kombucha. However, it was during the question and answer phase that the wheels in my head started spinning.  While gender issues in science are not a particular area of study for me, it does come up in my department on a fairly regular basis, and both my daughters are just starting to explore gender issues through courses in their own college experience, so it is on my radar. Yet, it took me a bit to realize, “hmm… so far, all of the people who have asked questions are guys” and I thought, “I am going to pay attention to this and see if it continues.”  It is probably no big surprise to anyone that it did continue.  Out of around 12 questions (I didn’t start counting until I had my observation, so I had to make a best guess about the total number), only 2 were asked by women, much later in the Q & A session. To make matters even sadder, one of the women qualified her question by stating “this is probably a dumb question” as she asked it.  So, I did a scan of the room, and while I did not do a full head count, it seemed that pretty close to 50% of the audience was female.  Furthermore, this was a completely free-choice experience, in a social setting, with alcohol available to loosen social inhibitions, and the topic was even more focused on biology- an area females typically express a slightly higher interest in than males.

While I may have previously made an observation like this, and possibly gone on a slight feminist rant about it, what was truly surprising to me was my next thought.  Where my mind went next was “it would be pretty easy to design a research project to explore this more in depth.” We could have people do gender counts when people walk in the door and then keep track of how many questions were asked by each (notice I am also consciously using gender as opposed to sex, as we could only make a best guess by appearances, without doing a more involved study- grad school is teaching me so much about so many things!).  We could compare this data across different locations, different topics of Science Pubs, we could try to look at different age groups- there are all kinds of interesting questions to explore! And the fact that I now think of more explicit ways to explore them, instead of just a curious observation, was a sign to me that I just might have been in grad school too long.

PS- and the next sign was that my first thought about it this morning was, “and I could write a Blog post about it”!

To follow on last week’s discussion of vygotsky, another central tenet of Vygotsky’s work is that in order to understand development (and therefore learning), the researcher has to observe it in the process rather than in its products.  He faulted the standard methods of psychological research of his day for focusing too much on training subjects to do particular tasks and then using those tasks to study cognition and development.  His basic claim was that by the time the subject had mastered the task, the researcher had missed the development and learning and was now documenting some sort of fossilized action instead.  He suggested alternative methods for creating conditions where learning, particularly the appropriation of meditational means and the development of concepts, could be brought into observation by the researcher working closely with research participants.

Those methods could be the subjects of future blog posts, but given last week’s topic of documenting personal sense making and how standardized ways of learning, testing, and research are not effective in generating or documenting personal sense, it’s interesting today to think about what sort of changes to research it would really take to arrive at rigorous ways of documenting the development of personal sense, including the role of emotions, values, beliefs, and biography in that development.

It seems that in part this kind of research itself still requires a substantial paradigm shift for researchers to stop “chasing” results/outputs as the key to understanding learning and to start encouraging this very chase itself as the subject of research.  In our theory group right now, we are reading Jerome Bruner’s Acts of Meaning. Bruner outlines where the cognitive revolution veered away from being able to really understand the road map where development takes place, especially given the role of emotional patterns and their relationship to reflective states of mind.  Bruner suggests that meaning cannot be pre assigned, so, like Vygotsky, he believes that meaning itself cannot be measured as an outcome of learning, but that learning can be seen in the process of making meaning.  He suggests further that meaning making is different from information processing. This does not discount the importance of understanding how human beings process information.  It does mean that education and learning have to be more than simply the business of training humans to use the tools that are necessary for life. Meaning, rather than knowing, should be the business of education as the ultimate way of “being.” This is very similar to Dewey’s arguments about the purposes of education in leading development.  Like Dewey and Vygotksy, Bruner is talking about cultural shift in education, but also in research.

Bruner turned to the exploration of how everyday thinking tools (or meditational means more accurately) were appropriated for complex meaning making that included both public, shared meaning and personal sense. In Acts of Meaning, he describes the role of narrative, especially jointly constructed narratives, in shaping individual biography and identity over time.  Retelling, re-narrating our experiences is in essence a reflective exercise in personal sense making, which also generates both public and shared meaning under the right circumstances. It is an exercise that brings to bear the very problematic of the so-called transformative education implicit in many of the other texts our group has been reading: the subjectivism, situatedness, and relativism circling human thinking and action and challenging the role of cognitive research. Accounting for such relativism and subjectivism not as gibberish or nonsense but as essential characteristics of human development, learning and behavior is to recognize the construction of meaning as transformative not authoritative. With that in mind, not only learning is a reflective state of mind but research itself should also be. What would a reflective research encompass? Perhaps it would be the type of research where its applied and flexible methodology consists of mediational means that lead to and promote a larger joint reflection between participants and researchers, allowing for a true dialogicality that moves quickly beyond the search for understanding of “fossilized” actions to the kind of active transformation of the research and learning situation that people like Dewey, Freire, and Vygotsky call for.

Such paradigmatic shift in the view of education and education research is nothing short of a “philosophical” debate between philosophy and science, our customary ways of knowing and seeking knowledge and how they came to be. The positivist characteristics of today’s research hindering the possibility for true dialogicality reflects nothing less than the human need to find some absolute truth and find it quickly. We can’t stand not knowing, not being able to trace down a beginning, middle and end for everything under some logical explanation. Embracing subjectivism and relativism as important pieces of the puzzle is recognizing there is no absolute truth when it comes to the human mind; it is to decrease the role of logic in favor of increasing the role of wonder in the process of knowing. This requires a cultural shift to assign reflective states of mind as the valued goal of education and research concerned with meaning making. Everything else would fall into place. Logicality can be unidirectional and give us tools for information processing, but dialogicality can’t. It requires exchange of reflections into retold narratives for it is the only way to unravel meaning making and acts of meaning.

Thanks to Susan O’Brien for her significant contributions to this post!

Meaning making is an idea that seems to resonate with lots of people studying learning or creating contexts for learning.  We want visitors or students to make meaning of their experiences.  As a construct, meaning making seems to be a way to capture the active elements of learning as well as the uniqueness of each learner’s prior experience and knowledge and the open ended nature of free-choice learning experiences in general.

But what do we really mean by meaning making?  And how should we approach operationalizing it for research? For Vygotsky, meaning had two components – meaning proper and personal sense.  The component of meaning in Vygotsky’s work focuses attention on the shared, distributed, what Bakhtin would call repeatable, and “public” denotations of a word, gesture, action or event.  This is largely the aspect of meaning making that researchers have in mind when they are thinking about education. This approach to meaning encourages researchers to ask whether the students and learners are making the “right” meaning? Are the meanings that they are making recognizable and shareable with us, with more expert others, and with each other? Are they getting the content and ideas and concepts right? But this shared, public aspect is only a part of the whole of meaning that person makes.

For Vygotksy and generations of Activity Theorists, a more primary aspect of this shared, public, testable, and authoritative meaning is personal sense.  The construct of personal sense attempts to capture the very personal, biographical, embodied, situated connotations of words, gestures, actions and events. This is the realm of what those things mean for us as part of our personal narratives about ourselves, our experiences, sense of place or even sense of ourselves.  It is about how they resonate (or not) with our values, beliefs, judgments and knowledge.  As learning researchers, we often discount or ignore this hugely important aspect of meaning making, and yet when people visit a museum or learn something new, this element of personal sense may be in the forefront of the experience.  The realm of personal sense is where emotional experiences get burned into memory, where motivations and identities are negotiated, tried on, and appropriated or rejected. This is also the realm where we need the most help from learners as co-researchers.  We can measure and document the meaning aspect of their meaning making relatively easily, but we rely on them to report about the personal sense they are making. As researchers, we should add to our documenting of the development of accurate and sharable meaning and develop serious ways to embrace the notion of reflection instead. Experiences that support meaning making as personal sense making are effective in supporting the overall learning process because they are essentially reflective.

What kinds of dialogues with learners most support that reporting are an open question to me right now.  I’d welcome ideas here!