Predicting Performances on Processing and Memorizing East Asian Faces from Brain Activities in Face-Selective Regions: A Neurocomputational Approach

For more than two decades, a network of face-selective brain regions has been identified as the core system for face processing, including occipital face area (OFA), fusiform face area (FFA), and posterior region of superior temporal sulcus (pSTS). Moreover, recent studies have suggested that the ve...

Full description

Bibliographic Details
Main Authors: Gary C.-W. Shyi, Peter K.-H. Cheng, S.-T. Tina Huang, C.-C. Lee, Felix F.-S. Tsai, Wan-Ting Hsieh, Becky Y.-C. Chen
Format: Article
Language:English
Published: Frontiers Media S.A. 2020-07-01
Series:Frontiers in Human Neuroscience
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/fnhum.2020.00269/full
id doaj-eea94a0d37de41c39496c0b4114829a7
record_format Article
spelling doaj-eea94a0d37de41c39496c0b4114829a72020-11-25T03:37:40ZengFrontiers Media S.A.Frontiers in Human Neuroscience1662-51612020-07-011410.3389/fnhum.2020.00269529277Predicting Performances on Processing and Memorizing East Asian Faces from Brain Activities in Face-Selective Regions: A Neurocomputational ApproachGary C.-W. Shyi0Gary C.-W. Shyi1Peter K.-H. Cheng2Peter K.-H. Cheng3S.-T. Tina Huang4C.-C. Lee5Felix F.-S. Tsai6Wan-Ting Hsieh7Becky Y.-C. Chen8Department of Psychology and Center for Research in Cognitive Sciences, National Chung Cheng University, Chiayi, TaiwanAdvanced Institute of Manufacturing with High-tech Innovations, National Chung Cheng University, Chiayi, TaiwanDepartment of Psychology and Center for Research in Cognitive Sciences, National Chung Cheng University, Chiayi, TaiwanResearch Center for Education and Mind Sciences, National Tsing Hua University, Hsinchu, TaiwanDepartment of Psychology and Center for Research in Cognitive Sciences, National Chung Cheng University, Chiayi, TaiwanDepartment of Electrical Engineering, National Tsing Hua University, Hsinchu, TaiwanDepartment of Electrical Engineering, National Tsing Hua University, Hsinchu, TaiwanDepartment of Electrical Engineering, National Tsing Hua University, Hsinchu, TaiwanDepartment of Psychology and Center for Research in Cognitive Sciences, National Chung Cheng University, Chiayi, TaiwanFor more than two decades, a network of face-selective brain regions has been identified as the core system for face processing, including occipital face area (OFA), fusiform face area (FFA), and posterior region of superior temporal sulcus (pSTS). Moreover, recent studies have suggested that the ventral route of face processing and memory should end at the anterior temporal lobes (i.e., vATLs), which may play an important role bridging face perception and face memory. It is not entirely clear, however, the extent to which neural activities in these face-selective regions can effectively predict behavioral performance on tasks that are frequently used to investigate face processing and face memory test that requires recognition beyond variation in pose and lighting, especially when non-Caucasian East Asian faces are involved. To address these questions, we first identified during a functional scan the core face network by asking participants to perform a one-back task, while viewing either static images or dynamic videos. Dynamic localizers were effective in identifying regions of interest (ROIs) in the core face-processing system. We then correlated the brain activities of core ROIs with performances on face-processing tasks (component, configural, and composite) and face memory test (Taiwanese Face Memory Test, TFMT) and found evidence for limited predictability. We next adopted an multi-voxel pattern analysis (MVPA) approach to further explore the predictability of face-selective brain regions on TFMT performance and found evidence suggesting that a basic visual processing area such as calcarine and an area for structural face processing such as OFA may play an even greater role in memorizing faces. Implications regarding how differences in processing demands between behavioral and neuroimaging tasks and cultural specificity in face-processing and memory strategies among participants may have contributed to the findings reported here are discussed.https://www.frontiersin.org/article/10.3389/fnhum.2020.00269/fullface processingface memoryface selective brain regionsMVPASVM classifier
collection DOAJ
language English
format Article
sources DOAJ
author Gary C.-W. Shyi
Gary C.-W. Shyi
Peter K.-H. Cheng
Peter K.-H. Cheng
S.-T. Tina Huang
C.-C. Lee
Felix F.-S. Tsai
Wan-Ting Hsieh
Becky Y.-C. Chen
spellingShingle Gary C.-W. Shyi
Gary C.-W. Shyi
Peter K.-H. Cheng
Peter K.-H. Cheng
S.-T. Tina Huang
C.-C. Lee
Felix F.-S. Tsai
Wan-Ting Hsieh
Becky Y.-C. Chen
Predicting Performances on Processing and Memorizing East Asian Faces from Brain Activities in Face-Selective Regions: A Neurocomputational Approach
Frontiers in Human Neuroscience
face processing
face memory
face selective brain regions
MVPA
SVM classifier
author_facet Gary C.-W. Shyi
Gary C.-W. Shyi
Peter K.-H. Cheng
Peter K.-H. Cheng
S.-T. Tina Huang
C.-C. Lee
Felix F.-S. Tsai
Wan-Ting Hsieh
Becky Y.-C. Chen
author_sort Gary C.-W. Shyi
title Predicting Performances on Processing and Memorizing East Asian Faces from Brain Activities in Face-Selective Regions: A Neurocomputational Approach
title_short Predicting Performances on Processing and Memorizing East Asian Faces from Brain Activities in Face-Selective Regions: A Neurocomputational Approach
title_full Predicting Performances on Processing and Memorizing East Asian Faces from Brain Activities in Face-Selective Regions: A Neurocomputational Approach
title_fullStr Predicting Performances on Processing and Memorizing East Asian Faces from Brain Activities in Face-Selective Regions: A Neurocomputational Approach
title_full_unstemmed Predicting Performances on Processing and Memorizing East Asian Faces from Brain Activities in Face-Selective Regions: A Neurocomputational Approach
title_sort predicting performances on processing and memorizing east asian faces from brain activities in face-selective regions: a neurocomputational approach
publisher Frontiers Media S.A.
series Frontiers in Human Neuroscience
issn 1662-5161
publishDate 2020-07-01
description For more than two decades, a network of face-selective brain regions has been identified as the core system for face processing, including occipital face area (OFA), fusiform face area (FFA), and posterior region of superior temporal sulcus (pSTS). Moreover, recent studies have suggested that the ventral route of face processing and memory should end at the anterior temporal lobes (i.e., vATLs), which may play an important role bridging face perception and face memory. It is not entirely clear, however, the extent to which neural activities in these face-selective regions can effectively predict behavioral performance on tasks that are frequently used to investigate face processing and face memory test that requires recognition beyond variation in pose and lighting, especially when non-Caucasian East Asian faces are involved. To address these questions, we first identified during a functional scan the core face network by asking participants to perform a one-back task, while viewing either static images or dynamic videos. Dynamic localizers were effective in identifying regions of interest (ROIs) in the core face-processing system. We then correlated the brain activities of core ROIs with performances on face-processing tasks (component, configural, and composite) and face memory test (Taiwanese Face Memory Test, TFMT) and found evidence for limited predictability. We next adopted an multi-voxel pattern analysis (MVPA) approach to further explore the predictability of face-selective brain regions on TFMT performance and found evidence suggesting that a basic visual processing area such as calcarine and an area for structural face processing such as OFA may play an even greater role in memorizing faces. Implications regarding how differences in processing demands between behavioral and neuroimaging tasks and cultural specificity in face-processing and memory strategies among participants may have contributed to the findings reported here are discussed.
topic face processing
face memory
face selective brain regions
MVPA
SVM classifier
url https://www.frontiersin.org/article/10.3389/fnhum.2020.00269/full
work_keys_str_mv AT garycwshyi predictingperformancesonprocessingandmemorizingeastasianfacesfrombrainactivitiesinfaceselectiveregionsaneurocomputationalapproach
AT garycwshyi predictingperformancesonprocessingandmemorizingeastasianfacesfrombrainactivitiesinfaceselectiveregionsaneurocomputationalapproach
AT peterkhcheng predictingperformancesonprocessingandmemorizingeastasianfacesfrombrainactivitiesinfaceselectiveregionsaneurocomputationalapproach
AT peterkhcheng predictingperformancesonprocessingandmemorizingeastasianfacesfrombrainactivitiesinfaceselectiveregionsaneurocomputationalapproach
AT sttinahuang predictingperformancesonprocessingandmemorizingeastasianfacesfrombrainactivitiesinfaceselectiveregionsaneurocomputationalapproach
AT cclee predictingperformancesonprocessingandmemorizingeastasianfacesfrombrainactivitiesinfaceselectiveregionsaneurocomputationalapproach
AT felixfstsai predictingperformancesonprocessingandmemorizingeastasianfacesfrombrainactivitiesinfaceselectiveregionsaneurocomputationalapproach
AT wantinghsieh predictingperformancesonprocessingandmemorizingeastasianfacesfrombrainactivitiesinfaceselectiveregionsaneurocomputationalapproach
AT beckyycchen predictingperformancesonprocessingandmemorizingeastasianfacesfrombrainactivitiesinfaceselectiveregionsaneurocomputationalapproach
_version_ 1724544557506363392