The modulation of savouring by prediction error and its effects on choice

• Main Authors: Kiyohito Iigaya, Giles W Story, Zeb Kurth-Nelson, Raymond J Dolan, Peter Dayan
• Format: Article
• Language: English
• Published: eLife Sciences Publications Ltd 2016-04-01
• Series: eLife
• Subjects: reward; anticipation; prediction error; decision-making; reinforcement-learning
• Online Access: https://elifesciences.org/articles/13747

When people anticipate uncertain future outcomes, they often prefer to know their fate in advance. Inspired by an idea in behavioral economics that the anticipation of rewards is itself attractive, we hypothesized that this preference of advance information arises because reward prediction errors carried by such information can boost the level of anticipation. We designed new empirical behavioral studies to test this proposal, and confirmed that subjects preferred advance reward information more strongly when they had to wait for rewards for a longer time. We formulated our proposal in a reinforcement-learning model, and we showed that our model could account for a wide range of existing neuronal and behavioral data, without appealing to ambiguous notions such as an explicit value for information. We suggest that such boosted anticipation significantly drives risk-seeking behaviors, most pertinently in gambling.