Emotional Sophistication: Studies of Facial Expressions in Games
Decision-making is a complex process. Monetary incentives constitute one of the forces driving it, however the motivational space of decision-makers is much broader. We care about other people, we experience emotional reactions, and sometimes we make mistakes. Such social motivations (Sanfey, 2007)...
Main Author: | |
---|---|
Other Authors: | |
Language: | en |
Published: |
The University of Arizona.
2012
|
Subjects: | |
Online Access: | http://hdl.handle.net/10150/268514 |
id |
ndltd-arizona.edu-oai-arizona.openrepository.com-10150-268514 |
---|---|
record_format |
oai_dc |
spelling |
ndltd-arizona.edu-oai-arizona.openrepository.com-10150-2685142015-10-23T04:59:12Z Emotional Sophistication: Studies of Facial Expressions in Games Rossi, Filippo Nadel, Lynn Piatteli Palmarini, Massimo Morrison, Clayton Sanfey, Alan Fasel, Ian game theory machine learning neuroeconomics Psychology emotions facial expressions Decision-making is a complex process. Monetary incentives constitute one of the forces driving it, however the motivational space of decision-makers is much broader. We care about other people, we experience emotional reactions, and sometimes we make mistakes. Such social motivations (Sanfey, 2007) drive our own decisions, as well as affect our beliefs about what motivates others' decisions. Behavioral and brain sciences have started addressing the role of social motivations in economic games (Camerer, 2004; Glimcher et al., 2009), however several aspects of social decisions, such as the process of thinking about others' emotional states - emotional sophistication - have been rarely investigated. The goal of this project is to use automatic measurements of dynamic facial expressions to investigate non-monetary motivations and emotional sophistication. The core of our approach is to use state-of-the-art computer vision techniques to extract facial actions from videos in real-time (based on the Facial Action Coding System of Ekman and Friesen (1978)), while participants are playing economic games. We will use powerful statistical machine learning techniques to make inferences about participants internal emotional states during these interactions. These inferences will be used (a) to predict behavior; (b) to explain why a decision is made in terms of the hidden forces driving it; and (c) to investigate the ways in which people construct their beliefs about other people's future actions. The contributions of this targeted interdisciplinary project are threefold. First, it develops new methodologies to study decision processes. Second, it uses these methods to test hypotheses about the role of first order beliefs about social motivations. Finally, our statistical approach sets the ground for "affectively aware" systems, that can use facial expressions to assess the internal states of their users, thus improving human-machine interactions. 2012 text Electronic Dissertation http://hdl.handle.net/10150/268514 en Copyright © is held by the author. Digital access to this material is made possible by the University Libraries, University of Arizona. Further transmission, reproduction or presentation (such as public display or performance) of protected items is prohibited except with permission of the author. The University of Arizona. |
collection |
NDLTD |
language |
en |
sources |
NDLTD |
topic |
game theory machine learning neuroeconomics Psychology emotions facial expressions |
spellingShingle |
game theory machine learning neuroeconomics Psychology emotions facial expressions Rossi, Filippo Emotional Sophistication: Studies of Facial Expressions in Games |
description |
Decision-making is a complex process. Monetary incentives constitute one of the forces driving it, however the motivational space of decision-makers is much broader. We care about other people, we experience emotional reactions, and sometimes we make mistakes. Such social motivations (Sanfey, 2007) drive our own decisions, as well as affect our beliefs about what motivates others' decisions. Behavioral and brain sciences have started addressing the role of social motivations in economic games (Camerer, 2004; Glimcher et al., 2009), however several aspects of social decisions, such as the process of thinking about others' emotional states - emotional sophistication - have been rarely investigated. The goal of this project is to use automatic measurements of dynamic facial expressions to investigate non-monetary motivations and emotional sophistication. The core of our approach is to use state-of-the-art computer vision techniques to extract facial actions from videos in real-time (based on the Facial Action Coding System of Ekman and Friesen (1978)), while participants are playing economic games. We will use powerful statistical machine learning techniques to make inferences about participants internal emotional states during these interactions. These inferences will be used (a) to predict behavior; (b) to explain why a decision is made in terms of the hidden forces driving it; and (c) to investigate the ways in which people construct their beliefs about other people's future actions. The contributions of this targeted interdisciplinary project are threefold. First, it develops new methodologies to study decision processes. Second, it uses these methods to test hypotheses about the role of first order beliefs about social motivations. Finally, our statistical approach sets the ground for "affectively aware" systems, that can use facial expressions to assess the internal states of their users, thus improving human-machine interactions. |
author2 |
Nadel, Lynn |
author_facet |
Nadel, Lynn Rossi, Filippo |
author |
Rossi, Filippo |
author_sort |
Rossi, Filippo |
title |
Emotional Sophistication: Studies of Facial Expressions in Games |
title_short |
Emotional Sophistication: Studies of Facial Expressions in Games |
title_full |
Emotional Sophistication: Studies of Facial Expressions in Games |
title_fullStr |
Emotional Sophistication: Studies of Facial Expressions in Games |
title_full_unstemmed |
Emotional Sophistication: Studies of Facial Expressions in Games |
title_sort |
emotional sophistication: studies of facial expressions in games |
publisher |
The University of Arizona. |
publishDate |
2012 |
url |
http://hdl.handle.net/10150/268514 |
work_keys_str_mv |
AT rossifilippo emotionalsophisticationstudiesoffacialexpressionsingames |
_version_ |
1718101902040760320 |