èƵ

Rats can move objects in virtual reality using only their thoughts

By reading a rat's intentions from its brain patterns, an AI can help the rodent move objects in a virtual environment
BFA2A1 Fancy Rat, Brown rat (Rattus norvegicus domesticus, Rattus norvegicus domestica), six weeks old animal held in one hand
In VR, rats can exert control with their minds
blickwinkel/Schmidt-Roeger/Alamy

Rats can move objects in virtual reality just by thinking of where they want them to go, thanks to an artificial intelligence that reads their intentions in the brain.

A mental map of our local surroundings is stored in a brain region called the hippocampus, which contains neurons called “place cells”. These cells fire different patterns of electrical impulses depending on where you are.

However, it has been unclear whether this activity in the hippocampus can be consciously controlled by imagining travelling to relevant locations or recalling places we have been.

To investigate, at the Howard Hughes Medical Institute in Virginia and his colleagues created a brain-machine interface, which they used to record the electrical activity in the hippocampi of four rats as they ran on top of a spherical treadmill.

The rotation of the ball, which could go in any direction, controlled where the rats were in a 1-square-metre virtual environment projected onto a screen surrounding the animals. On reaching a tall virtual column, the rats were rewarded with a sip of water.

As the tasks proceeded, the researchers trained an AI to learn any links between the brain activity of the rats and the animals’ locations in the virtual environment.

Lee and his colleagues then placed the rats on the treadmill, but disconnected it from the projected environment, so the animals couldn’t get to where they wanted to go by moving the ball. Instead, the AI translated the rats’ brain activity to work out their intended destination and take them there in the VR world, so they could get their reward. The technique worked for three of the four rats.

The researchers also trained the rats to move a virtual object to get a reward and, again, the AI could use the brain-machine interface to work out what three of the rats were trying to do and move objects for them in VR.

The findings suggest that rats can recall and imagine moving to remote locations, which changes their brain activity in identifiable ways, say the researchers.

“Previous work has suggested a role for the hippocampus in imagination, but demonstrating this at a cellular level is quite challenging and a major achievement,” says at University College London.

Similar brain-machine interfaces could potentially be used by people with paralysis to control devices that help them move, says Bendor. However, the AI would need to be trained to decode brain signals for any new environment, he says.

Reference

bioRxiv

Topics: Neuroscience / virtual reality