Giving good directions: order of mention reflects visual salience
In complex stimuli, there are many different possible ways to refer to a specified target. Previousstudies have shown that when people are faced with such a task, the content of their referringexpression reflects visual properties such as size, salience and clutter. Here, we extend thesefindings and...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2015-12-01
|
Series: | Frontiers in Psychology |
Subjects: | |
Online Access: | http://journal.frontiersin.org/Journal/10.3389/fpsyg.2015.01793/full |
id |
doaj-144d9e60ddbe4784bbcd981712888660 |
---|---|
record_format |
Article |
spelling |
doaj-144d9e60ddbe4784bbcd9817128886602020-11-25T00:21:42ZengFrontiers Media S.A.Frontiers in Psychology1664-10782015-12-01610.3389/fpsyg.2015.01793165150Giving good directions: order of mention reflects visual salienceAlasdair Daniel Francis Clarke0Micha eElsner1Hannah eRohde2University of AberdeenOhio State UniversityUniversity of EdinburghIn complex stimuli, there are many different possible ways to refer to a specified target. Previousstudies have shown that when people are faced with such a task, the content of their referringexpression reflects visual properties such as size, salience and clutter. Here, we extend thesefindings and present evidence that (i) the influence of visual perception on sentence constructiongoes beyond content selection and in part determines the order in which different objects arementioned and (ii) order of mention influences comprehension. Study 1 (a corpus study ofreference productions) shows that when a speaker uses a relational description to mention asalient object, that object is treated as being in the common ground and is more likely to bementioned first. Study 2 (a visual search study) asks participants to listen to referring expressionsand find the specified target; in keeping with the above result, we find that search for easy-to-findtargets is faster when the target is mentioned first, while search for harder-to-find targets isfacilitated by mentioning the target later, after a landmark in a relational description. Our findingsshow that seemingly low-level and disparate mental modules like perception and sentenceplanning interact at a high level and in task-dependent ways.http://journal.frontiersin.org/Journal/10.3389/fpsyg.2015.01793/fullvisual searchinformation structureaudience designreferring expression generationvisual salience |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Alasdair Daniel Francis Clarke Micha eElsner Hannah eRohde |
spellingShingle |
Alasdair Daniel Francis Clarke Micha eElsner Hannah eRohde Giving good directions: order of mention reflects visual salience Frontiers in Psychology visual search information structure audience design referring expression generation visual salience |
author_facet |
Alasdair Daniel Francis Clarke Micha eElsner Hannah eRohde |
author_sort |
Alasdair Daniel Francis Clarke |
title |
Giving good directions: order of mention reflects visual salience |
title_short |
Giving good directions: order of mention reflects visual salience |
title_full |
Giving good directions: order of mention reflects visual salience |
title_fullStr |
Giving good directions: order of mention reflects visual salience |
title_full_unstemmed |
Giving good directions: order of mention reflects visual salience |
title_sort |
giving good directions: order of mention reflects visual salience |
publisher |
Frontiers Media S.A. |
series |
Frontiers in Psychology |
issn |
1664-1078 |
publishDate |
2015-12-01 |
description |
In complex stimuli, there are many different possible ways to refer to a specified target. Previousstudies have shown that when people are faced with such a task, the content of their referringexpression reflects visual properties such as size, salience and clutter. Here, we extend thesefindings and present evidence that (i) the influence of visual perception on sentence constructiongoes beyond content selection and in part determines the order in which different objects arementioned and (ii) order of mention influences comprehension. Study 1 (a corpus study ofreference productions) shows that when a speaker uses a relational description to mention asalient object, that object is treated as being in the common ground and is more likely to bementioned first. Study 2 (a visual search study) asks participants to listen to referring expressionsand find the specified target; in keeping with the above result, we find that search for easy-to-findtargets is faster when the target is mentioned first, while search for harder-to-find targets isfacilitated by mentioning the target later, after a landmark in a relational description. Our findingsshow that seemingly low-level and disparate mental modules like perception and sentenceplanning interact at a high level and in task-dependent ways. |
topic |
visual search information structure audience design referring expression generation visual salience |
url |
http://journal.frontiersin.org/Journal/10.3389/fpsyg.2015.01793/full |
work_keys_str_mv |
AT alasdairdanielfrancisclarke givinggooddirectionsorderofmentionreflectsvisualsalience AT michaeelsner givinggooddirectionsorderofmentionreflectsvisualsalience AT hannaherohde givinggooddirectionsorderofmentionreflectsvisualsalience |
_version_ |
1725361337598476288 |