Task Rebalancing: Improving Multilingual Communication with Native Speakers-Generated Highlights on Automated Transcripts
碩士 === 國立清華大學 === 資訊工程學系 === 104 === In multilingual communication through a common language among both native speakers (NS) and non-native speakers (NNS), NNS may encounter problems in comprehending the messages of NS or following conversations. Even though automated speech recognition (ASR) transc...
Main Authors: | , |
---|---|
Other Authors: | |
Format: | Others |
Language: | en_US |
Published: |
2016
|
Online Access: | http://ndltd.ncl.edu.tw/handle/34371561410441408758 |
id |
ndltd-TW-104NTHU5392155 |
---|---|
record_format |
oai_dc |
spelling |
ndltd-TW-104NTHU53921552017-08-27T04:30:36Z http://ndltd.ncl.edu.tw/handle/34371561410441408758 Task Rebalancing: Improving Multilingual Communication with Native Speakers-Generated Highlights on Automated Transcripts 由英語為母語者即時標註自動生成字幕來輔助跨語言溝通 Pan, Mei Hua 潘玫樺 碩士 國立清華大學 資訊工程學系 104 In multilingual communication through a common language among both native speakers (NS) and non-native speakers (NNS), NNS may encounter problems in comprehending the messages of NS or following conversations. Even though automated speech recognition (ASR) transcripts provide support to NNS, such transcripts may contain errors and impose the need to simultaneously listen and read. To reduce this burden, we propose adding another channel (i.e., highlighting) through which NS can help NNS by highlighting the critical parts of transcripts, thus making them more useful to NNS. In a laboratory study involving 14 triads (two NS and one NNS in each triad), participants engaged in collaborative discussions under two conditions: audio conferencing plus ASR transcripts with and without the highlighting function. NS showed various motivations to perform the extra task of highlighting. The highlighting efforts helped NS themselves focus on the discussion and enhanced their task performance while increasing the clarity and comfort perceived by NNS during communication. Having NS generating highlights can benefit both NS and NNS, but in different ways. We discuss the implications for research and design of multilingual collaborative work. Wang, Hao Chuan Naomi Yamashita 王浩全 山下直美 2016 學位論文 ; thesis 38 en_US |
collection |
NDLTD |
language |
en_US |
format |
Others
|
sources |
NDLTD |
description |
碩士 === 國立清華大學 === 資訊工程學系 === 104 === In multilingual communication through a common language among both native speakers (NS) and non-native speakers (NNS), NNS may encounter problems in comprehending the messages of NS or following conversations. Even though automated speech recognition (ASR) transcripts provide support to NNS, such transcripts may contain errors and impose the need to simultaneously listen and read. To reduce this burden, we propose adding another channel (i.e., highlighting) through which NS can help NNS by highlighting the critical parts of transcripts, thus making them more useful to NNS. In a laboratory study involving 14 triads (two NS and one NNS in each triad), participants engaged in collaborative discussions under two conditions: audio conferencing plus ASR transcripts with and without the highlighting function. NS showed various motivations to perform the extra task of highlighting. The highlighting efforts helped NS themselves focus on the discussion and enhanced their task performance while increasing the clarity and comfort perceived by NNS during communication. Having NS generating highlights can benefit both NS and NNS, but in different ways. We discuss the implications for research and design of multilingual collaborative work.
|
author2 |
Wang, Hao Chuan |
author_facet |
Wang, Hao Chuan Pan, Mei Hua 潘玫樺 |
author |
Pan, Mei Hua 潘玫樺 |
spellingShingle |
Pan, Mei Hua 潘玫樺 Task Rebalancing: Improving Multilingual Communication with Native Speakers-Generated Highlights on Automated Transcripts |
author_sort |
Pan, Mei Hua |
title |
Task Rebalancing: Improving Multilingual Communication with Native Speakers-Generated Highlights on Automated Transcripts |
title_short |
Task Rebalancing: Improving Multilingual Communication with Native Speakers-Generated Highlights on Automated Transcripts |
title_full |
Task Rebalancing: Improving Multilingual Communication with Native Speakers-Generated Highlights on Automated Transcripts |
title_fullStr |
Task Rebalancing: Improving Multilingual Communication with Native Speakers-Generated Highlights on Automated Transcripts |
title_full_unstemmed |
Task Rebalancing: Improving Multilingual Communication with Native Speakers-Generated Highlights on Automated Transcripts |
title_sort |
task rebalancing: improving multilingual communication with native speakers-generated highlights on automated transcripts |
publishDate |
2016 |
url |
http://ndltd.ncl.edu.tw/handle/34371561410441408758 |
work_keys_str_mv |
AT panmeihua taskrebalancingimprovingmultilingualcommunicationwithnativespeakersgeneratedhighlightsonautomatedtranscripts AT pānméihuà taskrebalancingimprovingmultilingualcommunicationwithnativespeakersgeneratedhighlightsonautomatedtranscripts AT panmeihua yóuyīngyǔwèimǔyǔzhějíshíbiāozhùzìdòngshēngchéngzìmùláifǔzhùkuàyǔyángōutōng AT pānméihuà yóuyīngyǔwèimǔyǔzhějíshíbiāozhùzìdòngshēngchéngzìmùláifǔzhùkuàyǔyángōutōng |
_version_ |
1718520167880720384 |