SC Connecticut News

Yale Scientists Uncover Clues to Memory Formation

By Bill Hathaway

May 13, 2024

The human brain filters through a flood of experiences to create specific memories. Why do some experiences in this deluge of sensory information become “memorable,” while most are discarded by the brain? A computational model and behavioral study developed by Yale scientists suggests a new clue to this age-old question, as reported in the journal Nature Human Behavior.

“The mind prioritizes remembering things that it is not able to explain very well,” said Ilker Yildirim, an assistant professor of psychology in Yale’s Faculty of Arts and Sciences and senior author of the paper. “If a scene is predictable, and not surprising, it might be ignored.”

For example, a person may be briefly confused by the presence of a fire hydrant in a remote natural environment, making the image difficult to interpret and therefore more memorable. “Our study explored the question of which visual information is memorable by pairing a computational model of scene complexity with a behavioral study,” said Yildirim.

For the study, led by Yildirim and John Lafferty, the John C. Malone Professor of Statistics and Data Science at Yale, researchers developed a computational model addressing two steps in memory formation: the compression of visual signals and their reconstruction.

Based on this model, they designed experiments where participants were asked if they remembered specific images from a sequence shown in rapid succession. The Yale team found that the harder it was for the computational model to reconstruct an image, the more likely it would be remembered by participants.

“We used an AI model to try to shed light on perception of scenes by people — this understanding could help in developing more efficient memory systems for AI in the future,” said Lafferty, who is also director of the Center for Neurocomputation and Machine Intelligence at Yale's Wu Tsai Institute.

Former Yale graduate students Qi Lin (Psychology) and Zifan Lin (Statistics and Data Science) are co-first authors of the paper.