Deep Learning Approach for Negation Handling in Sentiment Analysis
Negation handling is an important sub-task in Sentiment Analysis. Negation plays a significant role in written text. Negation terms in sentence often changes the polarity of entire sentence from positive to negative or vice versa, resulting in the opposite meaning of the sentence than what is observ...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2021-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9475960/ |
id |
doaj-8bbbfd6ba8d94b028842117893d320fc |
---|---|
record_format |
Article |
spelling |
doaj-8bbbfd6ba8d94b028842117893d320fc2021-07-26T23:01:09ZengIEEEIEEE Access2169-35362021-01-01910257910259210.1109/ACCESS.2021.30954129475960Deep Learning Approach for Negation Handling in Sentiment AnalysisPrakash Kumar Singh0https://orcid.org/0000-0002-6762-2280Sanchita Paul1Birla Institute of Technology, Mesra, Ranchi, Jharkhand, IndiaBirla Institute of Technology, Mesra, Ranchi, Jharkhand, IndiaNegation handling is an important sub-task in Sentiment Analysis. Negation plays a significant role in written text. Negation terms in sentence often changes the polarity of entire sentence from positive to negative or vice versa, resulting in the opposite meaning of the sentence than what is observed by the machine learning based linguistic model. As automatic opinion mining has become very important in this digital era, proper handling of negation term is the need of the hour. In any natural language negations can be formulated both explicitly or implicitly while their use is very much domain-specific. Existing negation handling techniques follow rule-based approach and mainly used in medical domain. Due to the complex syntactic structure of negation, it is hard to build general purpose machine learning based negation handling model on user review or conversational text data. In this paper, we investigate negation components i.e., cue and scope in a sentence which determine the polarity shift in sentence. We propose LSTM based deep neural network model for negation handling task where the model automatically learns the negation features from labeled input training dataset. We used <italic>ConanDoyle</italic> story corpus for model training and testing, which is pre-annotated with negation information. The proposed model first identify negation cues in each sentence and then using bidirectional LSTM extracts the relationship between cue and other words to identify scope of the cue in sentences. We derived word level features for model training to determine correct polarity of the sentence. Result shows that the LSTM based nonlinear language models perform comparatively better than the traditional state of the art SVM, HMM or CRF based models. BiLSTM achieved best result, F1 measures 93.34%, outperform traditional rule based model in negation handling task.https://ieeexplore.ieee.org/document/9475960/Negation cuescopesentiment analysisfeature embeddingrecurrent neural networkLSTM |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Prakash Kumar Singh Sanchita Paul |
spellingShingle |
Prakash Kumar Singh Sanchita Paul Deep Learning Approach for Negation Handling in Sentiment Analysis IEEE Access Negation cue scope sentiment analysis feature embedding recurrent neural network LSTM |
author_facet |
Prakash Kumar Singh Sanchita Paul |
author_sort |
Prakash Kumar Singh |
title |
Deep Learning Approach for Negation Handling in Sentiment Analysis |
title_short |
Deep Learning Approach for Negation Handling in Sentiment Analysis |
title_full |
Deep Learning Approach for Negation Handling in Sentiment Analysis |
title_fullStr |
Deep Learning Approach for Negation Handling in Sentiment Analysis |
title_full_unstemmed |
Deep Learning Approach for Negation Handling in Sentiment Analysis |
title_sort |
deep learning approach for negation handling in sentiment analysis |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2021-01-01 |
description |
Negation handling is an important sub-task in Sentiment Analysis. Negation plays a significant role in written text. Negation terms in sentence often changes the polarity of entire sentence from positive to negative or vice versa, resulting in the opposite meaning of the sentence than what is observed by the machine learning based linguistic model. As automatic opinion mining has become very important in this digital era, proper handling of negation term is the need of the hour. In any natural language negations can be formulated both explicitly or implicitly while their use is very much domain-specific. Existing negation handling techniques follow rule-based approach and mainly used in medical domain. Due to the complex syntactic structure of negation, it is hard to build general purpose machine learning based negation handling model on user review or conversational text data. In this paper, we investigate negation components i.e., cue and scope in a sentence which determine the polarity shift in sentence. We propose LSTM based deep neural network model for negation handling task where the model automatically learns the negation features from labeled input training dataset. We used <italic>ConanDoyle</italic> story corpus for model training and testing, which is pre-annotated with negation information. The proposed model first identify negation cues in each sentence and then using bidirectional LSTM extracts the relationship between cue and other words to identify scope of the cue in sentences. We derived word level features for model training to determine correct polarity of the sentence. Result shows that the LSTM based nonlinear language models perform comparatively better than the traditional state of the art SVM, HMM or CRF based models. BiLSTM achieved best result, F1 measures 93.34%, outperform traditional rule based model in negation handling task. |
topic |
Negation cue scope sentiment analysis feature embedding recurrent neural network LSTM |
url |
https://ieeexplore.ieee.org/document/9475960/ |
work_keys_str_mv |
AT prakashkumarsingh deeplearningapproachfornegationhandlinginsentimentanalysis AT sanchitapaul deeplearningapproachfornegationhandlinginsentimentanalysis |
_version_ |
1721280439565418496 |