Title: Enhancement of SentiWordNet using contextual valence shifters

Authors: Poornima Mehta; Satish Chandra

Addresses: Department of CSE and IT, Jaypee Institute of Information Technology, Noida, UP, India ' Department of CSE and IT, Jaypee Institute of Information Technology, Noida, UP, India

Abstract: Sentence structure has a considerable impact on the sentiment polarity of a sentence. In the presence of contextual valence shifters like conjunctions, conditionals and intensifiers some parts of the sentence are more relevant to determine the sentence polarity. In this work we have used valence shifters in sentences to enhance the sentiment lexicon SentiWordNet in a given document set. They have also been used to improve the sentiment analysis at document level. In the near past, micro blogging services like Twitter have become an important data source for sentiment analysis. Tweets, being restricted to 140 characters have slangs, are grammatically incorrect, have spelling mistakes and have informal expressions. The method is aimed at noisy and unstructured data like tweets on which computationally intensive tools like dependency parsers are not very successful. Our proposed system works better on both noisy (Stanford and airlines datasets of Twitter) and structured (movie review) datasets.

Keywords: sentiment analysis; SentiWordNet; contextual valence shifters; micro-blogs; discourse; Twitter; Lexicon enhancement; SentiWordNet enhancement; sentence level polarity.

DOI: 10.1504/IJDATS.2019.103758

International Journal of Data Analysis Techniques and Strategies, 2019 Vol.11 No.4, pp.337 - 355

Received: 21 Jan 2017
Accepted: 18 Dec 2017

Published online: 27 Nov 2019 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article