Fighter pilots in training are having their brainwaves read by AI as they fly in virtual reality to measure how difficult they find tasks and ramp up the complexity if needed. Experiments show that trainee fighter pilots prefer this adaptive system to a rigid, pre-programmed alternative, but that it doesn鈥檛 necessarily improve their skills.
Training pilots in simulators and virtual reality is cheaper and safer than real flights, but these teaching scenarios need to be adjusted in real time so tasks sit in the sweet spot between comfort and overload.
at the Royal Netherlands Aerospace Centre, Amsterdam, and her colleagues used a brain-computer interface to read student pilots鈥� brainwaves via electrodes attached to the scalp. An AI model analysed that data to determine how difficult the pilots were finding the task.
Advertisement
鈥淲e are continuously working on improving [pilot] training, and what that looks like can be very different,鈥� says van Weelden. 鈥淚f you鈥檙e not in the field, it sounds very sci-fi, I guess. But, for me, it鈥檚 really normal because I just see data.鈥�
Fifteen Royal Netherlands Air Force pilots went through training while the system switched between five different levels of difficulty 鈥� accomplished by increasing or decreasing the visibility within the simulation 鈥� depending on how hard the AI model determined they were finding missions.
In later interviews, none of the pilots reported noticing that the system was altering the difficulty in real time, but 10 of the 15 pilots said they preferred the changing tests to a pre-programmed exercise where difficulty ramped up incrementally in regular steps.
But crucially, none of the pilots showed any improvement in terms of how well they accomplished tasks within the adaptive simulation compared with a rigid one. In short, pilots liked the mind-reading set-up, but it didn鈥檛 make them better pilots.
The problem could be the unique nature of people鈥檚 brains, says van Weelden. The AI model was trained on data from another group of novice pilots, then tested on the 15 study participants. But it is notoriously hard to get AI models that analyse brainwaves to work on the whole population. Six of the pilots in the test showed little change in difficulty level readings, indicating that the AI system may not have correctly interpreted their brain data.
at Cranfield University, UK, says similar technology is being studied for use in real aircraft to ensure pilots are in control. 鈥淭hey鈥檝e looked at whether we can detect startle 鈥� like being in a bit of a panic 鈥� and what the aircraft might then do to calm you and then reorientate you,鈥� says Blundell. 鈥淪o you鈥檙e upside down, [and the aircraft might say] you really need to look at the attitudes, you need to look at the information that鈥檚 down here, that鈥檚 going to bring you back to straight and level.鈥�
These systems have shown promise in isolated scenarios, but it remains to be seen whether brain-reading technology can be used to improve safety in aeroplanes. 鈥淭here鈥檚 a long way to go [in order to achieve that],鈥� says Blundell.
arXiv
