A Modified Long Short-Term Memory Cell.
BERT
LSTM
text classification
transformer models
Journal
International journal of neural systems
ISSN: 1793-6462
Titre abrégé: Int J Neural Syst
Pays: Singapore
ID NLM: 9100527
Informations de publication
Date de publication:
Jul 2023
Jul 2023
Historique:
medline:
19
7
2023
pubmed:
10
6
2023
entrez:
10
6
2023
Statut:
ppublish
Résumé
Machine Learning (ML), among other things, facilitates Text Classification, the task of assigning classes to textual items. Classification performance in ML has been significantly improved due to recent developments, including the rise of Recurrent Neural Networks (RNNs), Long Short-Term Memory (LSTM), Gated Recurrent Units (GRUs), and Transformer Models. Internal memory states with dynamic temporal behavior can be found in these kinds of cells. This temporal behavior in the LSTM cell is stored in two different states: "Current" and "Hidden". In this work, we define a modification layer within the LSTM cell which allows us to perform additional state adjustments for either state, or even simultaneously alter both. We perform 17 state alterations. Out of these 17 single-state alteration experiments, 12 involve the Current state whereas five involve the Hidden one. These alterations are evaluated using seven datasets related to sentiment analysis, document classification, hate speech detection, and human-to-robot interaction. Our results showed that the highest performing alteration for Current and Hidden state can achieve an average
Identifiants
pubmed: 37300815
doi: 10.1142/S0129065723500399
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM