An Evaluation of Chinese Human-Computer Dialogue Technology
The human-computer dialogue has recently attracted extensive attention from both academia and industry as an important branch in the field of artificial intelligence (AI). However, there are few studies on the evaluation of large-scale Chinese human-computer dialogue systems. I...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
The MIT Press
2019-05-01
|
Series: | Data Intelligence |
Online Access: | https://www.mitpressjournals.org/doi/abs/10.1162/dint_a_00007 |
id |
doaj-b56762fbff2d407abdfea065d4934d08 |
---|---|
record_format |
Article |
spelling |
doaj-b56762fbff2d407abdfea065d4934d082020-11-25T03:24:57ZengThe MIT PressData Intelligence2641-435X2019-05-011218720010.1162/dint_a_00007An Evaluation of Chinese Human-Computer Dialogue TechnologyZhao, ZhengyuZhang, WeinanChe, WanxiangChen, ZhigangZhang, Yibo The human-computer dialogue has recently attracted extensive attention from both academia and industry as an important branch in the field of artificial intelligence (AI). However, there are few studies on the evaluation of large-scale Chinese human-computer dialogue systems. In this paper, we introduce the Second Evaluation of Chinese Human-Computer Dialogue Technology, which focuses on the identification of a user's intents and intelligent processing of intent words. The Evaluation consists of user intent classification (Task 1) and online testing of task-oriented dialogues (Task 2), the data sets of which are provided by iFLYTEK Corporation. The evaluation tasks and data sets are introduced in detail, and meanwhile, the evaluation results and the existing problems in the evaluation are discussed. https://www.mitpressjournals.org/doi/abs/10.1162/dint_a_00007 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Zhao, Zhengyu Zhang, Weinan Che, Wanxiang Chen, Zhigang Zhang, Yibo |
spellingShingle |
Zhao, Zhengyu Zhang, Weinan Che, Wanxiang Chen, Zhigang Zhang, Yibo An Evaluation of Chinese Human-Computer Dialogue Technology Data Intelligence |
author_facet |
Zhao, Zhengyu Zhang, Weinan Che, Wanxiang Chen, Zhigang Zhang, Yibo |
author_sort |
Zhao, Zhengyu |
title |
An Evaluation of Chinese Human-Computer Dialogue Technology |
title_short |
An Evaluation of Chinese Human-Computer Dialogue Technology |
title_full |
An Evaluation of Chinese Human-Computer Dialogue Technology |
title_fullStr |
An Evaluation of Chinese Human-Computer Dialogue Technology |
title_full_unstemmed |
An Evaluation of Chinese Human-Computer Dialogue Technology |
title_sort |
evaluation of chinese human-computer dialogue technology |
publisher |
The MIT Press |
series |
Data Intelligence |
issn |
2641-435X |
publishDate |
2019-05-01 |
description |
The human-computer dialogue has recently attracted extensive attention from both academia and industry as an important branch in the field of artificial intelligence (AI). However, there are few studies on the evaluation of large-scale Chinese human-computer dialogue systems. In this paper, we introduce the Second Evaluation of Chinese Human-Computer Dialogue Technology, which focuses on the identification of a user's intents and intelligent processing of intent words. The Evaluation consists of user intent classification (Task 1) and online testing of task-oriented dialogues (Task 2), the data sets of which are provided by iFLYTEK Corporation. The evaluation tasks and data sets are introduced in detail, and meanwhile, the evaluation results and the existing problems in the evaluation are discussed. |
url |
https://www.mitpressjournals.org/doi/abs/10.1162/dint_a_00007 |
work_keys_str_mv |
AT zhaozhengyu anevaluationofchinesehumancomputerdialoguetechnology AT zhangweinan anevaluationofchinesehumancomputerdialoguetechnology AT chewanxiang anevaluationofchinesehumancomputerdialoguetechnology AT chenzhigang anevaluationofchinesehumancomputerdialoguetechnology AT zhangyibo anevaluationofchinesehumancomputerdialoguetechnology AT zhaozhengyu evaluationofchinesehumancomputerdialoguetechnology AT zhangweinan evaluationofchinesehumancomputerdialoguetechnology AT chewanxiang evaluationofchinesehumancomputerdialoguetechnology AT chenzhigang evaluationofchinesehumancomputerdialoguetechnology AT zhangyibo evaluationofchinesehumancomputerdialoguetechnology |
_version_ |
1724598932304035840 |