Authors: Žunić, Anastazia 
Corcoran, Padraig
Spasić, Irena
Affiliations: Computer Science 
Mathematical Institute of the Serbian Academy of Sciences and Arts 
Title: The Case of Aspect in Sentiment Analysis: Seeking Attention or Co-Dependency?
Journal: Machine Learning and Knowledge Extraction
Volume: 4
Issue: 2
First page: 474
Last page: 487
Issue Date: 2022
ISSN: 2504-4990
DOI: 10.3390/make4020021
(1) Background: Aspect-based sentiment analysis (SA) is a natural language processing task, the aim of which is to classify the sentiment associated with a specific aspect of a written text. The performance of SA methods applied to texts related to health and well-being lags behind that of other domains. (2) Methods: In this study, we present an approach to aspect-based SA of drug reviews. Specifically, we analysed signs and symptoms, which were extracted automatically using the Unified Medical Language System. This information was then passed onto the BERT language model, which was extended by two layers to fine-tune the model for aspect-based SA. The interpretability of the model was analysed using an axiomatic attribution method. We performed a correlation analysis between the attribution scores and syntactic dependencies. (3) Results: Our fine-tuned model achieved accuracy of approximately (Formula presented.) on a well-balanced test set. It outperformed our previous approach, which used syntactic information to guide the operation of a neural network and achieved an accuracy of approximately (Formula presented.). (4) Conclusions: We demonstrated that a BERT-based model of SA overcomes the negative bias associated with health-related aspects and closes the performance gap against the state-of-the-art in other domains.
Keywords: deep learning | natural language processing | sentiment analysis | syntactic dependencies | transformers
Publisher: MDPI

Files in This Item:
File Description SizeFormat
AZunic.pdf804.74 kBAdobe PDFView/Open
Show full item record


checked on May 28, 2024

Page view(s)

checked on May 9, 2024


checked on May 9, 2024

Google ScholarTM




This item is licensed under a Creative Commons License Creative Commons