Grammatical Error Identification for Learners of Chinese as a Foreign Language

• Main Author: Xiang, Yang
• Format: Others
• Language: English
• Published: Uppsala universitet, Institutionen för lingvistik och filologi 2018
• Subjects: Chinese; grammatical error identification; Languages and Literature; Språk och litteratur
• Online Access: http://urn.kb.se/resolve?urn=urn:nbn:se:uu:diva-361927

This thesis aims to build a system to tackle the task of diagnosing the grammatical errors in sentences written by learners of Chinese as a foreign language with the help of the CRF model (Conditional Random Field). The goal of this task is threefold:  1) identify if the sentence is correct or not, 2) identify the specific error types in the sentence, 3) find out the location of the identified errors. In this thesis, the task of Chinese grammatical error diagnosis is approached as a sequence tagging problem. The data and evaluation tool come from the previous shared tasks on Chinese Grammatical Error Diagnosis in 2016 and 2017. First, we use characters and POS tags as features to train the model and build the baseline system. We then notice that there are overlapping errors in the data. To solve this problem, we adopt three approaches: filtering out the problematic data, assigning encoding to characters with more than one label and building separate classifiers for each error type. We continue to increase the amount of training data and include syntactic features. The results show that both filtering out the problematic data and including syntactic features have a positive impact on the results. In addition, difference between domains of training data and test data can hurt performance to a large extent.