Task Rebalancing: Improving Multilingual Communication with Native Speakers-Generated Highlights on Automated Transcripts

• Main Authors: Pan, Mei Hua, 潘玫樺
• Other Authors: Wang, Hao Chuan
• Format: Others
• Language: en_US
• Published: 2016
• Online Access: http://ndltd.ncl.edu.tw/handle/34371561410441408758

碩士 === 國立清華大學 === 資訊工程學系 === 104 === In multilingual communication through a common language among both native speakers (NS) and non-native speakers (NNS), NNS may encounter problems in comprehending the messages of NS or following conversations. Even though automated speech recognition (ASR) transcripts provide support to NNS, such transcripts may contain errors and impose the need to simultaneously listen and read. To reduce this burden, we propose adding another channel (i.e., highlighting) through which NS can help NNS by highlighting the critical parts of transcripts, thus making them more useful to NNS. In a laboratory study involving 14 triads (two NS and one NNS in each triad), participants engaged in collaborative discussions under two conditions: audio conferencing plus ASR transcripts with and without the highlighting function. NS showed various motivations to perform the extra task of highlighting. The highlighting efforts helped NS themselves focus on the discussion and enhanced their task performance while increasing the clarity and comfort perceived by NNS during communication. Having NS generating highlights can benefit both NS and NNS, but in different ways. We discuss the implications for research and design of multilingual collaborative work.