
In a corner of a laboratory in Sydney, Australia, a disembodied lizard tail is flicking. The tail is a three-dimensional animation on a screen, but the Jacky dragon facing the monitor clearly has no idea it doesn’t belong to a real lizard. Rooted to the spot, it slowly waves its arms in an effort to appease the animated figure.
This interaction between real and virtual Jacky dragon is part of a recent explosion in research using sophisticated animation and robotics to better understand how animals use movement and posture to communicate.
For decades researchers have recorded and replayed animal calls to investigate their meaning, or probed the impact of variations in the shape or colour of a body ornament on prospective mates or rivals. Yet animal movement and posture has been almost completely neglected, says Chris Evans at Macquarie University in Sydney. “That’s because until recently the technology hasn’t been available to manipulate it.”
Advertisement
Now, by controlling the actions of a robot or animated creature, and even creating signals that don’t exist in nature, researchers can take part in a visual “conversation” with an animal, just as with Evans’s Jacky dragon. Combining this visual work with studies of sound signals then gives researchers a much clearer picture of how animals communicate in the wild.
At the University of California, Davis, Gail Patricelli and her team are using robots to study signalling in birds. They have developed a robot sage grouse to investigate interactions between males and females during courtship displays. The radio-controlled, stuffed female grouse moves around the mating ground or “lek” on model train tracks. She can glance back and forth, swivel to face another grouse spotted via her on-board camera, and crouch downwards – a movement that indicates she’s interested in a displaying male.
Real sage grouse readily accept the impostor. In preliminary tests male grouse courted the robot, while a female spent time with her, suggesting she perceived it as real. “That’s encouraging,” says Patricelli. “Females are the choosy sex, so they are harder to fool.”
Full-scale experiments to test the males’ responses will begin in a few months, and will build on Patricelli’s earlier tests with satin bowerbirds. Here the team found that a male bowerbird would intensify his elaborate courtship display if the robo-female performed a forward crouch, from which they concluded this must indicate interest.
The sage grouse experiments will incorporate an array of 24 microphones positioned around the lek. Using software developed at the University of Washington in Seattle, Patricelli’s team will be able to measure the differences in time taken by each male call to reach at least three microphones, allowing them to triangulate the location of each call to within 40 centimetres.
These measurements will be combined with the robot’s own microphone recordings plus its position to reveal whether some males are better at “aiming” their signals at a female as she moves around. By integrating the movement and sound data, the researchers will also get a clearer picture of how the birds combine different types of signalling.
“Until recently we couldn’t play back behaviours like movement and courtship dances, but video animations and robots have changed that,” says Patricelli. “The questions we’ll be able to ask and answer will expand as robot technology improves and gets more affordable.”
Evans has also used robots to study how brush turkey chicks, which hatch alone, recognise other brush turkeys. In 2004 he and colleague Ann Göth created remote-controlled robot brush turkey chicks using the skins of dead chicks. By varying the appearance and behaviour of the robots, he discovered that newly hatched chicks will approach only those birds that make a distinctive jerky pecking movement, and have splashes of blue on their beak and legs. He believes that the birds start out with a crude template of what another brush turkey looks like, and then use interaction with others to pick up on the details that will ultimately guide their choice of mate.
The main advantage of using robots is that they can be used in the field to interact with animals in their natural habitat. For those species that can be easily observed in the lab, such as fish, animation rather than robotics can create a greater range of movements and visual signals from which to study how the animals respond.
“The advantage of robots is that they can interact with animals in their natural habitat”
Molly Morris at the University of Ohio in Athens is studying the evolution of vertical pigment bars that appear on the bodies of some species of northern swordtails. By creating a simple animation of male swordtails with different bar patterns, and studying how long females spend swimming alongside them, she has found that younger females prefer symmetrical bars on males while larger, older females prefer asymmetrical bars.
“We have discovered that experience plays a role in female preference for bar symmetry, and so with this lead we are considering the possibility of differences among symmetrical versus asymmetrical males in aggression and male preferences for larger females,” Morris says.
Meanwhile Evans’s Jacky dragon cyber-tail is a more complex 3D animation, designed to reproduce the range of visual signals used by the Australian reptiles to try to assert their dominance. On encountering another male, the reptiles perform a series of tail flicks, push-ups and arm waves. These appear to allow each to size up the other’s status and strength, and so determine a victor, without engaging in a fight.
Evans’s colleague, Richard Peters, used high-definition digital video recordings of real Jacky displays to precisely map the movement of different points on the animals’ bodies. He then used animation software to create the 3D cyber-tail. Experiments are ongoing, but the team has already found that the duration of a tail-flicking display, rather than its speed, is crucial for coming out on top.
Animation also allows researchers to create virtual creatures that behave unlike any real-life counterpart, so they can monitor the effect of this strange behaviour on animals. Dave Clark at Alma College in Michigan is studying communication in wolf spiders, which use both visual signals and vibrations to attract females. Clark has developed computer animations of tufted and grey male wolf spiders, which do not look alike and have very different courtship behaviours. By producing animations of tufted spiders that behave like grey spiders, and vice versa, he has discovered that for tufted spiders behaviour is more important than appearance in attracting females, but the reverse is true for grey wolf spiders.
Clark is taking this a step further to recreate extinct forms of the spiders to investigate their evolution. He believes tufted wolf spiders evolved their black and white stripes to stand out more clearly and so attract females. He is creating animations of grey wolf spiders with stripes that use the same visual signals as tufted spiders, to see how females react. “We can create transitional forms of behaviour and morphology and get a much more comprehensive picture of the evolution of the species in question,” says Clark. “We have never been able to do this before.”
Behavioural school
Robots can be used to investigate everything from how to train animals to understanding their group behaviour.
Hiroyuki Ishii at Waseda University in Tokyo and colleagues have created a robot rat that they have programmed to teach real rats a simple task. The small white robot runs on two wheels and interacts with the subject rat to teach it to press a lever on the robot’s front.
It starts by regularly moving towards a feeding machine, at which point the machine releases a pellet. This attracts the rat’s attention, and the robot then modifies its strategy to move towards the feeding machine only when the rat approaches the robot. The robot then allows the rat to get ever closer each time, until the rat finally begins pushing the lever.
In 2006 a team led by Jean-Louis Deneubourg at the Free University of Brussels (ULB) in Belgium created a robotic cockroach that can influence the behaviour of real cockroaches. The experiment was designed to investigate how collective intelligence emerges in a group of cockroaches.
The robot was fitted with an on-board computer linked to a camera and infrared proximity sensors, to allow it to identify obstacles and other roaches. Programmed to behave like a cockroach, and doused in roach pheromones to blend in, the robot managed to lead the dark-loving insects into bright light.