èƵ

Virtual ‘answering machine’ records the real world while you are in VR

People using virtual reality at work could use a new system to capture what happens around them and play back a 3D reconstruction later
Young woman sitting at desk and wearing a VR headset, she is interacting with virtual reality; Shutterstock ID 2121732383; purchase_order: -; job: -; client: -; other: -
Virtual reality could be a feature of workplaces in the future
Stock-Asso/Shutterstock

A virtual reality (VR) “answering machine” can record changes in a person’s immediate environment while they are immersed in virtual worlds and play them back later.

In workplaces of the future, people may have to focus on tasks in virtual environments, making them unavailable for real-time communication with colleagues.

“The challenge is: Can we create a reality where we can still talk naturally even though the other person might, at that very moment, not be available?” says at ETH Zürich in Switzerland.

He and , also at ETH Zürich, developed a system called AsyncReality, which records events in the real world and replays them virtually at a later point.

It uses four depth-perceiving cameras that can tell how far away an object is and reconstruct the room in 3D. While the worker is in “focus mode”, the system records changes in the environment and detects events that are causally related to each other, so they can be played back in a sequence later.

Fender and Holz presented the work at the in New Orleans, Louisiana, on 2 May.

In one scenario, a colleague enters an office worker’s room while he is working in a VR environment, so she leaves an object on his table and records a message. When the worker finishes his virtual task, he can see and pick up the object in virtual space to see how it got there and the message left for him.

Fender says this is a basic example, but the system can assist with more complex scenarios. “The whole [office] arrangement in the future might be completely different because it’s intertwined with the virtual world which we interact with at the same time.” It could also be useful when someone isn’t in the office at all, but working remotely, he says.

“The overall system is really interesting because it’s a logical extension of record-and-replay-it answering systems,” says at University College London.

Apart from replaying missed visits from colleagues, AsyncReality could recreate other events, such as a group whiteboard session, says Steed. “You can see not only what’s there when you come back in, but perhaps how it got constructed – it may support hybrid working.”

It could also be useful for people working on complex, choreographed procedures, such as in medicine or manufacturing, so they can replay what happens when they have to step out of the room, says Steed. But the need to constantly record work environments might lead to privacy concerns, he adds.

Topics: virtual reality