A Modified Long Short-Term Memory Cell.


Journal

International journal of neural systems
ISSN: 1793-6462
Titre abrégé: Int J Neural Syst
Pays: Singapore
ID NLM: 9100527

Informations de publication

Date de publication:
Jul 2023
Historique:
medline: 19 7 2023
pubmed: 10 6 2023
entrez: 10 6 2023
Statut: ppublish

Résumé

Machine Learning (ML), among other things, facilitates Text Classification, the task of assigning classes to textual items. Classification performance in ML has been significantly improved due to recent developments, including the rise of Recurrent Neural Networks (RNNs), Long Short-Term Memory (LSTM), Gated Recurrent Units (GRUs), and Transformer Models. Internal memory states with dynamic temporal behavior can be found in these kinds of cells. This temporal behavior in the LSTM cell is stored in two different states: "Current" and "Hidden". In this work, we define a modification layer within the LSTM cell which allows us to perform additional state adjustments for either state, or even simultaneously alter both. We perform 17 state alterations. Out of these 17 single-state alteration experiments, 12 involve the Current state whereas five involve the Hidden one. These alterations are evaluated using seven datasets related to sentiment analysis, document classification, hate speech detection, and human-to-robot interaction. Our results showed that the highest performing alteration for Current and Hidden state can achieve an average

Identifiants

pubmed: 37300815
doi: 10.1142/S0129065723500399
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

2350039

Auteurs

Giannis Haralabopoulos (G)

Business Informatics Systems & Accounting Department, Henley Business School, University of Reading, Reading, UK.

Gerasimos Razis (G)

Department of Computer Science and Biomedical Informatics, School of Science, University of Thessaly, Lamia, Greece.

Ioannis Anagnostopoulos (I)

Department of Computer Science and Biomedical Informatics, School of Science, University of Thessaly, Lamia, Greece.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH