Cracking The Code That Lets The Brain ID Any Face, Fast

Jun 1, 2017
Originally published on June 1, 2017 4:14 pm

Most people have an uncanny ability to tell one face from another, even though the differences are extremely small. Now scientists think they know how our brains do this.

In macaque monkeys, which share humans' skill with faces, groups of specialized neurons in the brain called face cells appeared to divide up the task of assessing a face, a team at the California Institute of Technology reports Thursday in the journal Cell.

"The cells were coding faces in a very simple way," says Doris Tsao, an author of the study and a professor of biology at Caltech. "Each neuron was coding a different aspect of the face."

The actual coding involves some complicated math. But the approach is a bit like having one cell measure a variable like the distance between a person's eyes while another cell looks at skin texture, Tsao says.

And the system is so efficient that the team was able to accurately reconstruct the face a monkey was seeing using the signals from just 205 neurons. When placed side by side, the pictures the monkey saw and the reconstructed images are "almost indistinguishable," Tsao says.

The finding helps explain primates' "exquisite ability to distinguish faces," says Ed Connor, a professor of neuroscience at Johns Hopkins University who was not involved in the study. "Neuroscience really gets exciting when it shows you physically what is happening that gives rise to an experience," he says.

The study is the result of nearly 15 years of research by Tsao and her team. They had previously shown that macaque monkeys, like people, have brains with six separate areas that specialize in processing faces.

Then they began trying to solve the mystery of how the cells in these brain areas tell us whether we're looking at our grandmother or a complete stranger. "The reason why this is such a big mystery is that, as we all know, it seems like there's an infinite number of possible faces," Tsao says.

Tsao thought the brain must be using some sort of code to represent each face it encounters. So her team studied two monkeys as they looked at pictures of human faces, focusing on the electrical activity of just 205 brain cells in two of the six brain areas that process faces.

Connor says the coding system Tsao discovered helps explain something that has puzzled him for a long time. "Matt Damon and Chris Pratt look very different to me," he says. "But I cannot tell you what it is that makes Matt Damon look like Matt Damon and Chris Pratt look like Chris Pratt."

Now Connor thinks he understands why. "The process of differentiating faces is so highly developed in the brain, it's invisible to us," he says.

The research also suggests the possibility of some mind-blowing applications, Connor says.

For example, he says, if researchers could stimulate the right cells in the brain of a blind person, it should be possible to give that person the experience of seeing a face, though they wouldn't actually be seeing someone with their eyes.

Copyright 2017 NPR. To see more, visit http://www.npr.org/.

ROBERT SIEGEL, HOST:

Most people have an uncanny ability to tell one face from another. And now scientists think they know how we do this. A team from Caltech says they've cracked the code that lets the brain quickly size up any face. NPR's Jon Hamilton brings us the story.

JON HAMILTON, BYLINE: Faces are so important to humans and other primates that our brains have six different areas that specialize in facial perception. Doris Tsao and a team at Caltech have spent nearly 15 years trying to solve the mystery of how these brain areas tell us whether we're looking at mom or a stranger.

DORIS TSAO: And the reason why this is such a big mystery is that, as we all know, it seems like there's an infinite number of possible faces.

HAMILTON: Tsao thought the brain must be using some sort of code to represent each face it encounters, so her team studied two monkeys as they looked at pictures of human faces. Tsao says the researchers focused on the electrical activity of just 200 brain cells from 2 of the 6 specialized areas.

TSAO: And what we discovered was that the cells were coding faces in a very simple way.

HAMILTON: Each cell was measuring just one aspect of a face. The process is a bit like assigning one cell to check the distance between a person's eyes while another looks at skin texture. And once the team thought they understood the system, they checked to see if they had it right by working backwards. Tsao says they took the signals coming from a monkey's brain and used a computer to decode them.

TSAO: With this model, we could actually reconstruct what face the monkey was seeing.

HAMILTON: Tsao says she and co-author Steven Le Chang were blown away when they compared the pictures the monkey actually saw to the pictures produced by electrical signals coming from the animal's brain.

TSAO: They look almost indistinguishable. In fact, when Steven first showed this figure to me, I asked him, are you sure you didn't make a mistake and just copy column one to column two 'cause they look so similar.

HAMILTON: The results, published in the journal Cell, could represent a big leap in our understanding of how the brain identifies faces. Until now, many researchers thought specific faces were assigned to individual brain cells. Ed Connor of Johns Hopkins University says the new study explains something that has puzzled him for a long time.

ED CONNOR: Matt Damon and Chris Pratt look very different to me, but I cannot tell you what it is that makes Matt Damon look like Matt Damon and Chris Pratt look like Chris Pratt.

HAMILTON: Connor says the results suggest that's because the process of differentiating faces is so highly developed in the brain, it's invisible to us. He says the research also offers a rare glimpse of how electrical signals in the brain create our perception of the world.

CONNOR: Neuroscience really gets exciting when it shows you physically what is happening that gives rise to an experience.

HAMILTON: And Connor says in this case, there could be some mind-blowing applications. For example, he says, by stimulating the right cells in the brain of a blind person, it should be possible to give them the experience of seeing a face. Jon Hamilton, NPR News. Transcript provided by NPR, Copyright NPR.