Sentiment interpretability analysis on Chinese texts employing multi-task and knowledge base.

attention mechanism interpretability analysis knowledge base multi-task training sentiment classification

Journal

Frontiers in artificial intelligence
ISSN: 2624-8212
Titre abrégé: Front Artif Intell
Pays: Switzerland
ID NLM: 101770551

Informations de publication

Date de publication:
2023
Historique:
received: 21 11 2022
accepted: 20 11 2023
medline: 22 1 2024
pubmed: 22 1 2024
entrez: 22 1 2024
Statut: epublish

Résumé

With the rapid development of deep learning techniques, the applications have become increasingly widespread in various domains. However, traditional deep learning methods are often referred to as "black box" models with low interpretability of their results, posing challenges for their application in certain critical domains. In this study, we propose a comprehensive method for the interpretability analysis of sentiment models. The proposed method encompasses two main aspects: attention-based analysis and external knowledge integration. First, we train the model within sentiment classification and generation tasks to capture attention scores from multiple perspectives. This multi-angle approach reduces bias and provides a more comprehensive understanding of the underlying sentiment. Second, we incorporate an external knowledge base to improve evidence extraction. By leveraging character scores, we retrieve complete sentiment evidence phrases, addressing the challenge of incomplete evidence extraction in Chinese texts. Experimental results on a sentiment interpretability evaluation dataset demonstrate the effectiveness of our method. We observe a notable increase in accuracy by 1.3%, Macro-F1 by 13%, and MAP by 23%. Overall, our approach offers a robust solution for enhancing the interpretability of sentiment models by combining attention-based analysis and the integration of external knowledge.

Identifiants

pubmed: 38249791
doi: 10.3389/frai.2023.1104064
pmc: PMC10797098
doi:

Types de publication

Journal Article

Langues

eng

Pagination

1104064

Informations de copyright

Copyright © 2024 Quan, Xie and Liu.

Déclaration de conflit d'intérêts

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Auteurs

Xinyue Quan (X)

Beijing Institute of Technology, Beijijng, China.

Xiang Xie (X)

Beijing Institute of Technology, Beijijng, China.

Yang Liu (Y)

Beijing Institute of Technology, Beijijng, China.

Classifications MeSH