Video: Kevin Spacey could control your face
FANCY yourself as a puppeteer? No? How about if the puppet were House of Cards star Kevin Spacey?
Cheap, controllable 3D CGI models of people’s faces can now be created simply using publicly available photos online. What’s more, their expressions can be manipulated using other people’s facial tics. One day, this could let us interact with avatars that look and act like people we know.
Currently, making such CGI models of a human face is expensive and requires laser scanning and motion capture.
Advertisement
But a team at the University of Washington in Seattle reasoned that, for celebrities at least, there are more than enough paparazzi photographs online to capture digitally what they look like from just about every possible angle.
“The idea was to create realistic virtual models of people just from photos rather than complex lab set-ups,” says researcher Ira Kemelmacher-Shlizerman.
So a team led by Supasorn Suwajanakorn collected around 200 photos each of various famous people – including Spacey – from Google Images, taken in different poses and at varying angles. The photos were analysed using face-tracking software, and a realistic 3D model for their face and head created. Further analysis added wrinkles and textures that appear and disappear as expressions change.

The face of your digital PA? (Image: Netflix)
“The result is a full 3D model you can turn right around,” says Suwajanakorn.
As well as being able to manipulate the digital puppets any way they wanted, the team found they could realistically switch an actor’s face with that of another – allowing them to be replaced throughout an entire TV show or movie, for example.
“The team could switch one actor’s face with another, replacing them in an entire TV show, for example”
They created puppets of Arnold Schwarzenegger, Hillary Clinton and Barack Obama, for example, and gave them the facial expressions and tics of other people, such as George W. Bush. ().
One commercial application could be to provide famous animated faces for visual versions of Siri-like assistants, says Suwajanakorn. Another might be to automatically create 3D faces for telepresence robots, says Nicole Carey at humanoid robot maker Engineered Arts in Penryn, UK. “Don’t underestimate how much people want to be someone else,” she says.
But plundering large digital image collections suggests an even more interesting, or creepy, application: “Creating a version of someone who’s close to you but no longer alive,” says Kemelmacher-Shlizerman.
The face of someone who has died could be recreated and driven with one of the emerging breed of chatbots trained – using the deceased’s tweets and emails – to converse like them. “Our model could bring back your memories of the people you care about,” says Suwajanakorn.
This article appeared in print under the headline “Your own Kevin Spacey”