Estimating scene typicality from human ratings and image features

Scenes, like objects, are visual entities that can be categorized into functional and semantic groups. One of the core concepts of human categorization is the idea that category membership is graded: some exemplars are more typical than others. Here, we obtain human typicality rankings for more than...

Full description

Bibliographic Details
Main Authors: Ehinger, Krista A. (Contributor), Xiao, Jianxiong (Contributor), Torralba, Antonio (Contributor), Oliva, Aude (Contributor)
Other Authors: Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory (Contributor), Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences (Contributor), Massachusetts Institute of Technology. Department of Civil and Environmental Engineering (Contributor), Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science (Contributor)
Format: Article
Language:English
Published: Cognitive Science Society, Inc., 2012-06-21T17:01:07Z.
Subjects:
Online Access:Get fulltext
Description
Summary:Scenes, like objects, are visual entities that can be categorized into functional and semantic groups. One of the core concepts of human categorization is the idea that category membership is graded: some exemplars are more typical than others. Here, we obtain human typicality rankings for more than 120,000 images from 706 scene categories through an online rating task on Amazon Mechanical Turk. We use these rankings to identify the most typical examples of each scene category. Using computational models of scene classification based on global image features, we find that images which are rated as more typical examples of their category are more likely to be classified correctly. This indicates that the most typical scene examples contain the diagnostic visual features that are relevant for their categorization. Objectless, holistic representations of scenes might serve as a good basis for understanding how semantic categories are defined in term of perceptual representations.
National Science Foundation (U.S.) (NSF-CAREER Award (0546262)
National Science Foundation (U.S.) (grant 0705677)
National Science Foundation (U.S.) (grant 1016862)
Nuclear Energy Institute (grant EY02484)
National Science Foundation (U.S.) (Career Award (0747120))
Google (Firm) (Research Award)