Named Entity Correction in Neural Machine Translation Using the Attention Alignment Map

• Main Authors: Jangwon Lee, Jungi Lee , Minho Lee , Gil-Jin Jang
• Format: Article
• Language: English
• Published: MDPI AG 2021-07-01
• Series: Applied Sciences
• Subjects: neural networks; recurrent neural networks; natural language processing; neural machine translation; named entity recognition
• Online Access: https://www.mdpi.com/2076-3417/11/15/7026

Neural machine translation (NMT) methods based on various artificial neural network models have shown remarkable performance in diverse tasks and have become mainstream for machine translation currently. Despite the recent successes of NMT applications, a predefined vocabulary is still required, meaning that it cannot cope with out-of-vocabulary (OOV) or rarely occurring words. In this paper, we propose a postprocessing method for correcting machine translation outputs using a named entity recognition (NER) model to overcome the problem of OOV words in NMT tasks. We use attention alignment mapping (AAM) between the named entities of input and output sentences, and mistranslated named entities are corrected using word look-up tables. The proposed method corrects named entities only, so it does not require retraining of existing NMT models. We carried out translation experiments on a Chinese-to-Korean translation task for Korean historical documents, and the evaluation results demonstrated that the proposed method improved the bilingual evaluation understudy (BLEU) score by 3.70 from the baseline.