Art inspires strong feelings – and feelings work on the brain in very specific ways. So in theory, art should make a good tool for anyone who wants to explore not just art but also emotions and neurology. Absolutely, reckon British artist Helen Storey and American psychologist and neuroscientist Jim Coan. Earlier this year, they worked with a British secondary school for the pilot of an art-science experiment called Eye and I that they hoped would add fresh insights into the relationship between facial expressions and emotions.
Storey and Coan hope to bring something unique to the area by involving everyone from the people looking at the art to the researchers themselves in an open-ended experiment. That way, they feel, everyone wins. Individuals are enriched by discovering new things about themselves; artists and scientists gain insights they couldn’t get any other way.
And there’s a big picture, too: if we can learn more about our minds and emotions, we may be less vulnerable to manipulation by others.
Advertisement
The pair are well placed to pull it off. Storey has been involved with art-science collaborations for nearly a decade, but for a scientist like Coan, this is more of a challenge. Fortunately he’s no stranger to controversy, with a career that brought him celebrity even in his undergraduate years. Liz Else asked Coan to explain what they are up to.
What was Eye and I?
It was a darkened room with slots about the size of letter boxes randomly arranged on the walls. Behind the slots were actors making facial expressions reflecting anger, sadness, happiness and so on. People who went into the room could only see the actors’ eyes. Kids and teachers came in groups or alone, and we invited some local people too.
What were the reactions like?
It was fascinating. We had an audience that ranged between 3 and 80 years old. Some people said they felt uncomfortable, like they were being watched by the actors rather than doing the watching. Others felt unhappy – when they looked at the slot with sad eyes, for example. They found it claustrophobic, intense, intimate or exhilarating. One autistic child was far more verbal than usual: he was clearly stimulated by it and could respond to expressions delivered that way. Overall, the boys seemed a bit more intimidated than the girls.
Why eyes?
Our brain activity and our reports of our experiences change in response to the emotional expression on our faces. So if you’re making a joyful face and the left frontal area of the brain is very active, you’re more likely to report that you’re feeling happiness. Now, the expression of the eyes is very important for triggering this. We plan to redo some of the early studies into expression to see what we can remove from pictures of facial expressions and still get the same emotional and neurophysiological effects when we look at brains using the latest functional MRI scanners.
How did the actors find the experience?
Making facial expressions and holding them for a long time generated quite intense emotional experiences. Before every performance, Helen had the extraordinary good sense to provide pens and put up “graffiti walls” backstage to help the actors express themselves. They would make an anger expression for five minutes, for example, then come back and curse on paper. Or they’d make a sad expression and write how profound the experience was of weeping in front of people.
So because no one said “cut”, the actors were left with real feelings?
Yes. They were having such profound experiences that they cornered me on my last day in London and ordered me to record one of my training sessions so they could use all they had learned from Eye and I in their acting afterwards. They had been trained mainly as method actors, where they had to think themselves into character. They weren’t aware of the simple but powerful effects on your emotional state of just being told to move your face into a certain expression. They were quite shocked by the intensity.
Are you going to do more Eye and I installations?
Yes. But in future we want to keep better track of the emotional expressions of the visitors and what’s going on inside the installation at the time. We are currently looking for other venues and partners.
What inspired Eye and I?
Helen was very taken by work done at the University of California, Berkeley, where researchers assessed the happiness of women in their 50s compared with the apparent happiness of their facial expressions in photos from their college yearbooks. They found that the ones who had smiled a genuine smile in the early photo, rather than a staged smile, were the ones who ended up with happier lives. The muscles around the eye involved in the smile gave the game away – there’s a special set involved in authentic smiling. Helen wondered whether expressions could be a major factor in affecting what happened to you in life. I was studying other things to do with facial expression and outcome, so when we met we found we had a lot in common.
Would you like to use art to look at other big ideas in neurobiology?
I’d like to generate art exhibits that offer an intense emotional stimulus of some sort, such as people staring at you, or watching ghastly or wonderful films. One of the things that we talked about was getting people to pay attention to their own experiences as they interact with these art stimuli, so it is more active, dynamic and interactive – in a way, they would become part of the art. And we could offer people ideas about how to experiment.
Such as?
I’ve got some new research that strongly implies that hand-holding influences how you experience images. So we could get people to visit in groups and pairs, and experiment with how they feel while they are dealing with a particular stimulus. I expect that who they are with – a partner, a friend, a family member or an acquaintance – will create real differences in how they experience the art and I couldn’t get at that information any other way.
People think science is entirely about strictly controlled experiments, and although experimentation may be the best way to isolate important causal relationships, reliance on experimentation alone reflects a very limited view of science. Projects such as Eye and I offer the potential for casting a wider net in generating testable hypotheses that we may not previously have thought of.
Any other ideas?
One of the amazing things is that when people are told to make expressions, you essentially have a context-free emotional stimulus. Our brains are not designed to have an emotional experience without context, so people go to work creating an imaginary one – it’s called confabulation. We could experiment with it.
“Brains are not designed to have a context-free emotional experience”
What about using false memory?
We could – but I rather feel I’ve been there already! I started my career with Elizabeth Loftus, one of the leading lights in false memory research. I did a study called “Lost in a Shopping Mall” in 1992 – it was my undergraduate thesis. I designed a method for getting people to “remember” complex autobiographical memories for things that never happened. My first subject was my brother Chris: I asked him to write, over the course of six days, about four different events that had happened to us about 10 years previously. Except that one was completely made up – the “lost in the shopping mall” scenario. In the first few days, he recalled nothing, but then on the fourth or fifth day, he had an “aha!” experience in which he “remembered” the things I suggested. By the end of the experiment, he was filling out the details from that “experience”. When I told him later that one of the memories was false, and asked him to guess which one it was, he guessed wrongly.
So people can be easily manipulated. You don’t need the CIA, just someone with a bit of knowledge…
That’s right.
Didn’t you also get involved in some other controversial research into expressions?
Yes. I did some work with one of my first mentors, John Gottman, on couples, some of whom were facing divorce. Among other things, we found that couples who were not going to make it did a particular kind of eye roll when they were talking to each other – it was very dismissive and lethal to the relationship.
Would you design a public art experiment to alert people to the implications of all this?
Absolutely. Helen and I have talked a lot about it. Her major goal is to give the information away so the public can use it to enrich their lives and their understanding.
Profiles
Jim Coan is assistant professor of psychology at the University of Virginia in Charlottesville. His website is .
Helen Storey is a visiting professor at King’s College London and an honorary professor at Heriot-Watt University, Edinburgh, Scotland. In the 1980s and 90s, Storey created a stir with designs for Madonna and Prince, later moving on to equally provocative collaborations with her sister Kate, a developmental biologist. One of those, a textile collection called Primitive Streak, is based on the first 1000 hours of life and has been seen by nearly 3 million people worldwide. For the past seven years she has worked on international science and art collaborations. A documentary about Eye and I is available on DVD from cchstorey@lineone.net, and the Helen Storey Foundation’s website is .