èƵ

AI trick could make people’s hair in video games look more realistic

A neural network trained on hundreds of images of hair styles can render hair so it actually looks realistic, which could be a boon for video games and animated films

People’s hair in animated movies and video games could start to look far more realistic, thanks to artificial intelligence.

For decades, hair in video games and animated movies has looked unnatural because of the complexity of modelling its movement. “Almost all works that exist today consider hair as a mesh,” says Vanessa Sklyarova at the in Moscow, Russia. The graphical texture is then laid on top of this mesh, she says.

Sklyarova and her colleagues have come up with a way to make hair look natural by using a type of artificial intelligence called a neural network.

Their system takes smartphone photos of someone’s hair from multiple angles while they are stood still. The images are then processed in two stages. The first stage scans everything to identify where the head, shoulders and hair are, providing a rough outline.

The second stage uses a neural network trained on 343 images of hair styles to try to more accurately render the individual strands. While the resultant digital representation of the head (see video, above) shows the hair as multicoloured, this is to demonstrate how the neural network perceives the individual strands of hair. When the imagery is finalised, or rendered, the hair is its true colour. The technique also worked when using a smartphone video circling someone’s head.

Digital reconstruction of someone's hair
A neural network can help reconstruct people’s hair in a realistic manner, including individual strands
Courtesy of Vanessa Sklyarova/Samsung AI Centre, Moscow

“I just think that this is a great tool that could be used for character creation,” says Sklyarova. “It could simplify work a lot.”

Shaping the hair digitally isn’t quick, though. It takes three days on a standard computer graphics card that costs around £1500 ($1900): one day for the first stage, and two more for the second.

“The results look really nice, and they’re solving a real problem, as anyone who has played a game – or watched a computer-animated movie – with atrociously animated hair can attest to,” says at New York University. “Hair is intrinsically hard to capture and render. It’s just a very different shape to the rest of the body because of the many small strands.”

Reference

arXiv