Analysis Methods in Neural Language Processing: A Survey

The field of natural language processing has seen impressive progress in recent years, with neural network models replacing many of the traditional systems. A plethora of new models have been proposed, many of which are thought to be opaque compared to their feature-rich counte...

Full description

Bibliographic Details
Main Authors: Belinkov, Yonatan, Glass, James
Format: Article
Language:English
Published: The MIT Press 2019-11-01
Series:Transactions of the Association for Computational Linguistics
Online Access:https://www.mitpressjournals.org/doi/abs/10.1162/tacl_a_00254
id doaj-d4e965bc8a214ff1b5b7cf21dae4c0c9
record_format Article
spelling doaj-d4e965bc8a214ff1b5b7cf21dae4c0c92020-11-25T01:26:58ZengThe MIT PressTransactions of the Association for Computational Linguistics2307-387X2019-11-017497210.1162/tacl_a_00254Analysis Methods in Neural Language Processing: A SurveyBelinkov, YonatanGlass, James The field of natural language processing has seen impressive progress in recent years, with neural network models replacing many of the traditional systems. A plethora of new models have been proposed, many of which are thought to be opaque compared to their feature-rich counterparts. This has led researchers to analyze, interpret, and evaluate neural networks in novel and more fine-grained ways. In this survey paper, we review analysis methods in neural language processing, categorize them according to prominent research trends, highlight existing limitations, and point to potential directions for future work. https://www.mitpressjournals.org/doi/abs/10.1162/tacl_a_00254
collection DOAJ
language English
format Article
sources DOAJ
author Belinkov, Yonatan
Glass, James
spellingShingle Belinkov, Yonatan
Glass, James
Analysis Methods in Neural Language Processing: A Survey
Transactions of the Association for Computational Linguistics
author_facet Belinkov, Yonatan
Glass, James
author_sort Belinkov, Yonatan
title Analysis Methods in Neural Language Processing: A Survey
title_short Analysis Methods in Neural Language Processing: A Survey
title_full Analysis Methods in Neural Language Processing: A Survey
title_fullStr Analysis Methods in Neural Language Processing: A Survey
title_full_unstemmed Analysis Methods in Neural Language Processing: A Survey
title_sort analysis methods in neural language processing: a survey
publisher The MIT Press
series Transactions of the Association for Computational Linguistics
issn 2307-387X
publishDate 2019-11-01
description The field of natural language processing has seen impressive progress in recent years, with neural network models replacing many of the traditional systems. A plethora of new models have been proposed, many of which are thought to be opaque compared to their feature-rich counterparts. This has led researchers to analyze, interpret, and evaluate neural networks in novel and more fine-grained ways. In this survey paper, we review analysis methods in neural language processing, categorize them according to prominent research trends, highlight existing limitations, and point to potential directions for future work.
url https://www.mitpressjournals.org/doi/abs/10.1162/tacl_a_00254
work_keys_str_mv AT belinkovyonatan analysismethodsinneurallanguageprocessingasurvey
AT glassjames analysismethodsinneurallanguageprocessingasurvey
_version_ 1725107717118361600