Navigation Links
MIT research: What makes an image memorable?
Date:5/24/2011

CAMBRIDGE, Mass. -- Next time you go on vacation, you may want to think twice before shooting hundreds of photos of that scenic mountain or lake.

A new study from MIT neuroscientists shows that the most memorable photos are those that contain people, followed by static indoor scenes and human-scale objects. Landscapes? They may be beautiful, but they are, in most cases, utterly forgettable.

"Pleasantness and memorability are not the same," says MIT graduate student Phillip Isola, one of the lead authors of the paper, which will be presented at the IEEE Conference on Computer Vision and Pattern Recognition, taking place June 20-25 in Colorado Springs.

The new paper is the first to model what makes an image memorable a trait long thought to be impenetrable to scientific study, because visual memory can be so subjective. "People did not think it was possible to find anything consistent," says Aude Oliva, associate professor of cognitive science and a senior author of the paper.

However, the MIT team, which also included Antonio Torralba, the Esther and Harold E. Edgerton Associate Professor of Electrical Engineering and Computer Science, and one of his graduate students, Jianxiong Xiao, was surprised to see remarkable consistency among hundreds of people who participated in the memory experiments.

Using their findings from humans, the researchers developed a computer algorithm that can rank images based on memorability. Such an algorithm could be useful to graphic designers, photo editors, or anyone trying to decide which of their vacation photos to post on Facebook, Oliva says.

Why we remember

Oliva's previous research has shown that the human brain can remember thousands of images, with a surprising level of detail. However, not all images are equally memorable.

For the new study, the researchers built a collection of about 10,000 images of all kinds interior-design photos, nature scenes, streetscapes and others. Human subjects in the study (who participated through Amazon's Mechanical Turk program, which farms tasks out to people sitting at their own computers) were shown a series of images, some of which were repeated. Their task was to indicate, by pressing a key on their keyboard, when an image appeared that they had already seen.

Each image's memorability rating was determined by how many participants correctly remembered seeing it.

In general, different research subjects tended to produce similar memorability ratings. "There are always differences between observers, but on average, there is very high consistency," says Oliva, who is also a principal investigator in the computer vision group at MIT's Computer Science and Artificial Intelligence Laboratory.

After gathering their data, the researchers made "memorability maps" of each image by asking people to label all the objects in the images. A computer model can then analyze those maps to determine which objects make an image memorable.

In general, images with people in them are the most memorable, followed by images of human-scale space such as the produce aisle of a grocery store and close-ups of objects. Least memorable are natural landscapes, although those can be memorable if they feature an unexpected element, such as shrubbery trimmed into an unusual shape.

Alexei Efros, associate professor of computer science at Carnegie Mellon University, says the study offers a novel way to characterize images.

"There has been a lot of work in trying to understand what makes an image interesting, or appealing, or what makes people like a particular image. But all of those questions are really hard to answer," says Efros, who was not involved in this research. "What [the MIT researchers] did was basically approach the problem from a very scientific point of view and say that one thing we can measure is memorability."

Predicting memorability

The researchers then used machine-learning techniques (a type of statistical analysis that allows computers to identify patterns in data) to create a computational model that analyzed the images and their memorability as rated by humans. For each image, the computational model analyzed various statistics such as color, or the distribution of edges and correlated them with the image's memorability.

That allowed the researchers to generate an algorithm that can predict memorability of images the computational model hasn't "seen" before. Such an algorithm could be used by book publishers to evaluate cover art, or news editors looking for the most memorable photograph to feature on their website.

Oliva believes the algorithm might also be of interest to camera manufacturers, and Isola is thinking about designing an iPhone app that could immediately tell users how memorable the photo they just took will be. For that application, the main challenge is getting the algorithm to work fast enough, Isola says.

Other possible applications are clinical memory tests that more precisely reveal what aspects of visual memory are deficient in specific psychological or brain disorders, and games to help train the memory.

The researchers are now doing a follow-up study to test longer-term memorability of images. They are also working on adding more detailed descriptions of image content, such as "two people shaking hands," or "people looking at each other," to each image's memorability map, in an effort to find out more about what makes the image memorable.


'/>"/>

Contact: Caroline McCall
cmccall5@mit.edu
Massachusetts Institute of Technology
Source:Eurekalert

Related medicine news :

1. Research: How you think about your age may affect how you age
2. National Event Addresses Breakthroughs in Crohn's & Colitis Research: National Expert & Researcher Answers Key Questions on Interactive Webcast/Teleconference
3. Research: Major breakthrough will revolutionize the screening and treatment of genetic diseases
4. Implementing comparative effectiveness research: Lessons from the mammography screening controversy
5. Research: Schwartz Center Rounds encourage compassionate health care and better teamwork
6. Health care research: $1.6 million in new funding for University of Montreal
7. Womens health research: IOM releases progress report Sept. 23
8. Most Americans Back Embryonic Stem Cell Research: Poll
9. Lombardi research: Robotic radiosurgery offers palliative care for hilar lung tumors
10. Addiction research: Key findings every month
11. New research: Un-growth hormone increases longevity
Post Your Comments:
*Name:
*Comment:
*Email:
(Date:4/29/2016)... ... April 29, 2016 , ... Dr. ... of best seller "LOVE, MEDICINE and MIRACLES") addresses touchy topics related to Death ... podcasted thereafter . Dr. Bernie Siegel, author of a plethora of essential ...
(Date:4/29/2016)... ... April 29, 2016 , ... Spine Team Texas, a comprehensive spine ... announce one of their physicians has been invited to be a featured speaker at ... Practice Review conference on April 30, 2016. , Dr. R. Scott McPherson, a ...
(Date:4/29/2016)... ... 29, 2016 , ... Melanoma is the deadliest type of skin cancer. Although only about 1 ... skin cancer deaths. More than 10,000 people are expected to die of melanoma this year. ... is the one of the most commonly diagnosed cancers in young women. A recent breakthrough ...
(Date:4/29/2016)... ... 29, 2016 , ... Jvion, the market leader in clinical ... Eastside Partners, with participation from existing investor Martin Ventures. The funds will ... technology and product roadmap. , “Jvion is experiencing significant growth and ...
(Date:4/29/2016)... (PRWEB) , ... April 29, 2016 , ... Nike Softball ... softball camp from July 24th – 27th for girls aged 10-18. All facets of ... held at the beautiful Clark V. Whited Complex, one of the finest softball facilities ...
Breaking Medicine News(10 mins):
(Date:4/27/2016)... , April 27, 2016 Shire plc ... Jeff Poulton , Chief Financial Officer, will present at the ... Boston, MA on Wednesday, May 04, 2016, 10:00 ... will be available on the Presentations and Webcasts section of ... of the webcast will be available on this same website ...
(Date:4/27/2016)... , April 27, 2016 ... over USD 2.14 billion by 2022, according to ...      (Logo: http://photos.prnewswire.com/prnh/20150105/723757 ) ... advancement affecting the efficiency and accuracy delivered by ... persistent demand for novel urinalysis instruments and consumables. ...
(Date:4/26/2016)... , April 26, 2016 Diplomat Pharmacy, ... of Jennifer Hagerman , Pharm D., to Vice ... growing role at Diplomat, Hagerman will continue to lead ... company that delivers custom education and training to Diplomat ... specialty pharmacy industry. Diplomat University also houses the quality ...
Breaking Medicine Technology: