
Police can access a trove of data from smart speakers found at crime scenes that could be invaluable in solving murders or burglaries, say researchers. Data on recently recognised faces, internet searches and any voice commands received could be extracted even without the owner’s permission or assistance from the manufacturer.
Jona Crasselt and at the University of Erlangen-Nuremberg in Germany decided to explore how much information can be pulled from these devices after seeing news coverage of .
“We were happy to [find] that we not only obtained access to the local data, but also were able to access the data stored in the cloud,” says Pugliese. “Because, in such a way, forensic investigators would be able to access the data themselves without relying on Amazon to provide it to them.”
Advertisement
The researchers focused on Amazon’s Echo Show 15, a smart assistant equipped with a large display screen, a camera, six microphones and an ambient light sensor.
Their first tactic was to probe inside the Echo Show with a device designed to test what signals or data are flowing at various points on a circuit board. They were able to gain access to the unencrypted file system of the Echo Show, revealing logs of detected movement and faces recognised by the built-in camera and artificial intelligence.
In this file system, they also found a “refresh token”, which is used to access data stored in the cloud. This was encrypted, but with a key found elsewhere on the device in an unencrypted file and information gleaned from open-source code published online, they were able to easily decrypt the token and access anything that the device was authorised to access. This approach revealed details of voice requests, calendars, contacts, conversations, photos and videos.
“It requires some technical knowledge to obtain the local data, but it was surprising that the file system was not encrypted,” says Pugliese. “It’s the common cat-and-mouse game in security research: the vendor will probably change some things in the future, and then new [security] examinations will be necessary for the next generation of devices, and so on.”
An Amazon spokesperson told èƵ: “The security of our devices and customer data is a top priority. In this case, the researcher’s findings required direct physical access to the Echo device and specialised expertise to extract data from internal device components. We appreciate the work the security research community does to help us further improve our devices.”
Criminologist , an emeritus professor at Birmingham City University, UK, says that the use of technology and science in murder investigations is far less prevalent than television crime dramas would suggest: less than 2 per cent of murder trials rely on DNA evidence, for example.
“There’s a sense that it’s technological advances, it’s forensic science that’s going to really drive the solutions to these crimes, and it’s not – it’s a simple human reality that you’re most likely to be murdered by someone you know,” says Wilson. “We already have access to information from those domestic settings through mobile phones, Facebook, Instagram posts. It’s the first thing that often takes place in a murder investigation – check the Facebook, who are they friends with?”
Wilson says that while smart speaker evidence could conceivably be useful in a small number of cases, there are also concerns about the privacy trade-off this would bring. “There are creeping human rights issues about these technological advances that we would do well to not ignore,” he says. “I think it’s right that Amazon would be a bit reluctant to release that information, because there are privacy issues.”
arXiv