Sentiment interpretability analysis on Chinese texts employing multi-task and knowledge base.
attention mechanism
interpretability analysis
knowledge base
multi-task training
sentiment classification
Journal
Frontiers in artificial intelligence
ISSN: 2624-8212
Titre abrégé: Front Artif Intell
Pays: Switzerland
ID NLM: 101770551
Informations de publication
Date de publication:
2023
2023
Historique:
received:
21
11
2022
accepted:
20
11
2023
medline:
22
1
2024
pubmed:
22
1
2024
entrez:
22
1
2024
Statut:
epublish
Résumé
With the rapid development of deep learning techniques, the applications have become increasingly widespread in various domains. However, traditional deep learning methods are often referred to as "black box" models with low interpretability of their results, posing challenges for their application in certain critical domains. In this study, we propose a comprehensive method for the interpretability analysis of sentiment models. The proposed method encompasses two main aspects: attention-based analysis and external knowledge integration. First, we train the model within sentiment classification and generation tasks to capture attention scores from multiple perspectives. This multi-angle approach reduces bias and provides a more comprehensive understanding of the underlying sentiment. Second, we incorporate an external knowledge base to improve evidence extraction. By leveraging character scores, we retrieve complete sentiment evidence phrases, addressing the challenge of incomplete evidence extraction in Chinese texts. Experimental results on a sentiment interpretability evaluation dataset demonstrate the effectiveness of our method. We observe a notable increase in accuracy by 1.3%, Macro-F1 by 13%, and MAP by 23%. Overall, our approach offers a robust solution for enhancing the interpretability of sentiment models by combining attention-based analysis and the integration of external knowledge.
Identifiants
pubmed: 38249791
doi: 10.3389/frai.2023.1104064
pmc: PMC10797098
doi:
Types de publication
Journal Article
Langues
eng
Pagination
1104064Informations de copyright
Copyright © 2024 Quan, Xie and Liu.
Déclaration de conflit d'intérêts
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.