Imagine having your own humanoid robot. It is great at its job so your floors and windows are gleaming and spotless, but it has an annoying habit of vacuuming the living room when you have a headache, or offering you a meal just as you are drifting off to sleep on the sofa.
If you sometimes have difficulty reading other people鈥檚 expressions and emotions, imagine how difficult it will be for silicon-brained robots. They will only ever be able to respond to us in an appropriate way if they can understand human moods.
What robots need is kansei. The Japanese term encompasses a raft of emotional notions, including feeling, mood, intuitiveness and sensibility. Without kansei, says Shuji Hashimoto, director of the humanoid robotics centre at Waseda University in Tokyo, the service robots being developed around the world will not be able to acquire the social skills they will need to get along with tetchy, emotional humans.
Advertisement
Last week Hashimoto told a conference on socially intelligent robots at the University of Hertfordshire in Hatfield, UK, that unless researchers start incorporating such emotional concepts into their robots鈥 programming we will be interacting with some pretty insensitive brutes in our living rooms. 鈥淓motion is one of the most crucial factors influencing the success or failure of communication between humans,鈥 he says. 鈥淩obots are going to need similar emotional capabilities if they are to cooperate smoothly and flexibly with humans in our residential environments.鈥
Hashimoto sees emotive robotics engineering as an essential follow-up to the brute force of today鈥檚 artificial-intelligence-based programming techniques, in which simple rules are applied to signals generated by a robot鈥檚 sensors. For instance, when one of today鈥檚 floor-crawling robotic vacuum cleaners senses it has reached the wall, its computer brain knows it is time to cut its motor and set a new course. Its AI simply pairs sensed situations with a set of pre-programmed actions.
Generating an appropriate response to someone鈥檚 mood is a much more complicated task, so kansei-enabled robots will need to make use of sensors worn by their owner to spot signs of stress. These could include galvanic skin sensors that detect sweat by measuring the conductivity of the skin, and pulse monitors. Neural networks, which can interpret large amounts of data, will then be able to decide how best to react to the person. Hashimoto鈥檚 hope is that in this way robots will at least appear capable of intuitive behaviour. So if a robot鈥檚 owner is sweating and has a racing pulse, say, the robot will sense this and decide that now might not be the time to offer them the TV guide or tonight鈥檚 dinner menu.
鈥淚f a person is stressed, the robot will decide now is not the time to bring the TV guide鈥
This is no pipe dream, says Elizabeth Croft, a robotics researcher at the University of British Columbia in Vancouver, Canada. She says researchers are already using such physiological sensors alongside face and gesture recognition systems to study the emotional state of people when a robot is present. Her group has monitored how volunteers interact with a robot while they are wired-up with skin conductance, heart rate and facial muscle sensors (see 鈥淪ensors and sensibility鈥). They found that the very arrival of a robot can be enough to affect people. 鈥淭he behaviour of the robot elicits a measurable physiological response from the user, such as surprise, calm, fear or interest. We can integrate this information into the robot鈥檚 controller to allow the robot to respond in an appropriate manner,鈥 she says.
鈥淭he very arrival of a robot can be enough to affect the way that people behave鈥
Hashimoto admits that even this level of complexity is merely technological play-acting. 鈥Kansei robots will seem to understand human feeling to some extent and will appeal to us with their reactions. But they are not machines with a heart; they just look like they have a heart.鈥
Faking it this way is not only philosophically unattractive to roboticists but also has a serious engineering downside: the more a robot attempts to cater for every conceivable human emotional state with appropriate reactions, the more complex its software becomes. This will ultimately make programming robots an immensely complex process, and render their software dangerously untestable.
One way around this programming nightmare, Hashimoto suggests, would be to let robots learn from their environment and construct their own sets of rules. This would force some robotics researchers to free themselves from the self-imposed shackles of the late Isaac Asimov鈥檚 three 鈥渓aws鈥 of robotics. Coined in a 1942 short story called Runaround, these laws impose heavy constraints on a robot鈥檚 software. Asimov鈥檚 first law says that robots cannot harm a human or let a human come to any harm; the second says robots must always obey humans, unless that infringes the first law; and the third says robots must always protect themselves, unless that infringes the first or second laws. These rules demand enormous complexity from a robot鈥檚 software, as every new situation must take them into account.
Instead of instilling this 鈥渕oral framework鈥 from the outset, Hashimoto thinks a robot鈥檚 intelligence should grow as it ages, learning through trial and error much like a child goes from babyhood through to toddling and eventually to adolescence. 鈥淲e have to design environments where human and robot learn together,鈥 Hashimoto says. Such a move would be controversial, placing robots in many ways on a par with humans. 鈥淏ut humans should not stand at the centre of everything. We need to establish a new relationship between human and machine.鈥
Ditching Asimov would be a major wrench for robot makers, particularly those developing safety-critical domestic service robots, but Hashimoto is sticking to his guns: 鈥淎s long as we obey Asimov鈥檚 laws, we will never have a machine that is a true partner for a human,鈥 he says.
Sensors and sensibility
How do you measure a person鈥檚 emotional reactions to robotic faux pas, such as invading personal space? Could robots be developed that can sense these feelings and react accordingly? These were the questions being asked at the socially intelligent robots conference in the UK last week at the University of Hertfordshire. Researchers are approaching the problem in a variety of ways, from analysing a person鈥檚 body language as they interact with a robot, to detecting physical signs of stress.
BODY LANGUAGE SAYS IT ALL
Dana Kulic麓 and Elizabeth Croft at the University of British Columbia in Vancouver, Canada, want robots to respond to our body language. As a first step towards this, they are trying to find out how a robot鈥檚 actions affect our mood and what kind of sensors a robot can make use of to suss out how we feel. The pair wired up 36 volunteers with various sensors, then used statistical analysis to work out which of a robotic arm鈥檚 motions and activities made them feel calm, anxious or surprised. It seems that facial expressions are not a useful indicator of mood. More helpful would be to monitor the direction a person鈥檚 head is facing or gazing in, as a droid will not have to worry so much about its actions if its owner鈥檚 attention has wandered.
SIGNS OF FEAR
Until wireless sensing is perfected, one option for robot owners hoping to attune their droid to their mood might be to wear a lightweight armband sensor. Christine Lisetti鈥檚 team at the Eurecom Institute in Sophia Antipolis, France, has been fitting volunteers with an armband capable of sensing up to six physiological and environmental parameters. The SenseWear armband measures galvanic skin response, heart rate, skin temperature, the rate at which heat is lost from the skin, and ambient temperature. After showing 29 volunteers a 45-minute slide show of emotive images and sounds, the researchers were able to determine sadness, anger, fear, surprise, frustration and amusement with varying but pretty high degrees of accuracy. Fear was recognised with 86 per cent accuracy, so robots will know when it鈥檚 time to back off.
APPROACHING FUSSY OWNERS
Kerstin Dautenhahn, professor of artificial intelligence at the University of Hertfordshire, has been running tests with 1.3-metre-high robots (pictured) trundling around an apartment to see how volunteers react to their presence. 鈥淚magine you have a robot assistant in your home 24/7. How should it approach you? How should it attract your attention? That鈥檚 what we are investigating,鈥 she says.
Her group was surprised to find that people dislike it not only when robots approach them from behind, but also when they approach from the front. This reaction was more pronounced when people were sitting down. It also emerged that extroverts tolerate bad robot behaviour much better than introverts.
IMITATION GAMES
It is 2025 and you have just removed the bubble wrap from your new domestic robot. Now you need to teach it how best to serve you. Sylvain Calinon and Aude Billard at the Ecole Polytechnique F茅d茅rale de Lausanne in Switzerland believe we should sit down opposite our domestic droid and play an imitation game with it. By strapping five motion sensors to each of their arms and making actions for a miniature humanoid robot to mimic, the pair trained the robot to make complex motions. This not only taught the robot to move in a more human-like way, but volunteers had so much fun that they wrongly told their droid it had made a mistake so they could keep playing.