Skip to main content

Human faces can be accurately recreated from monkey brain signals

tokyo 2020 olympics facial recognition
Artem Oleshko/Shutterstock
Researchers at the California Institute of Technology have demonstrated that it is possible to recreate images of human face based on the monitoring of macaque monkey brain cells. The work shines a light on how exactly faces are processed by the brain.

Using functional magnetic resonance imaging (fMRI) technology, six areas of the brain were shown to be involved with the identification process. The team referred to the neurons in these areas as “face cells.”

In an experiment that involved inserting electrodes into the brains of monkeys to record their physical response to looking at images, the researchers found that 205 neurons encode different characteristics of a face. When these are combined using some smart machine learning technology, it’s possible to reconstruct the face the monkey had been looking at in a way that was strikingly close to the original image.

“The face cells we are studying are at the highest level of the visual system,” Steven Le Chang, a researcher on the project, told Digital Trends. “Normally people think the code for neurons at this level should be rather complicated. However, our result shows that once we find the appropriate coordinates for faces, the code of faces could be understandable. Using this code, we are able to reconstruct the face the monkey saw and predict responses of face cells to an arbitrary face.”

Doris Tsao
Doris Tsao

But as interesting as the work is from a biological perspective, is there any possible real world application for it? Quite possibly yes, Le Chang explained.

“Potentially, if we could decode faces from neural activity in the human brain [as well as the monkey one], there will be a lot of real world applications,” he said. “In general, that will helps human subjects convey concepts which are otherwise difficult. For example, a witness of a crime scene may have a hard time describing the face of the criminal. If we could directly decode the face based on the witness’ memory, we can extract the criminal’s face in a much more objective and quick way. Of course, whether memory activates the same population of cells as seeing the face is still an open question.”

Next up, the researchers wish to extend their study from neutral faces to expressive faces, as well as other types of object. As noted, they also want to investigate how imagination or memory of faces affects the representation in face patches.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
This AI cloned my voice using just three minutes of audio
acapela group voice cloning ad

There's a scene in Mission Impossible 3 that you might recall. In it, our hero Ethan Hunt (Tom Cruise) tackles the movie's villain, holds him at gunpoint, and forces him to read a bizarre series of sentences aloud.

"The pleasure of Busby's company is what I most enjoy," he reluctantly reads. "He put a tack on Miss Yancy's chair, and she called him a horrible boy. At the end of the month, he was flinging two kittens across the width of the room ..."

Read more
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more