{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T20:48:00Z","timestamp":1773694080246,"version":"3.50.1"},"reference-count":57,"publisher":"World Scientific Pub Co Pte Ltd","issue":"07","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Neur. Syst."],"published-print":{"date-parts":[[2023,7]]},"abstract":"<jats:p> Machine Learning (ML), among other things, facilitates Text Classification, the task of assigning classes to textual items. Classification performance in ML has been significantly improved due to recent developments, including the rise of Recurrent Neural Networks (RNNs), Long Short-Term Memory (LSTM), Gated Recurrent Units (GRUs), and Transformer Models. Internal memory states with dynamic temporal behavior can be found in these kinds of cells. This temporal behavior in the LSTM cell is stored in two different states: \u201cCurrent\u201d and \u201cHidden\u201d. In this work, we define a modification layer within the LSTM cell which allows us to perform additional state adjustments for either state, or even simultaneously alter both. We perform 17 state alterations. Out of these 17 single-state alteration experiments, 12 involve the Current state whereas five involve the Hidden one. These alterations are evaluated using seven datasets related to sentiment analysis, document classification, hate speech detection, and human-to-robot interaction. Our results showed that the highest performing alteration for Current and Hidden state can achieve an average F1 improvement of 0.5% and 0.3%, respectively. We also compare our modified cell performance to two Transformer models, where our modified LSTM cell is outperformed in classification metrics in 4\/6 datasets, but improves upon the simple Transformer model and clearly has a better cost efficiency than both Transformer models. <\/jats:p>","DOI":"10.1142\/s0129065723500399","type":"journal-article","created":{"date-parts":[[2023,4,30]],"date-time":"2023-04-30T07:48:55Z","timestamp":1682840935000},"source":"Crossref","is-referenced-by-count":5,"title":["A Modified Long Short-Term Memory Cell"],"prefix":"10.1142","volume":"33","author":[{"given":"Giannis","family":"Haralabopoulos","sequence":"first","affiliation":[{"name":"Business Informatics Systems & Accounting Department, Henley Business School, University of Reading, Reading, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gerasimos","family":"Razis","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Biomedical Informatics, School of Science, University of Thessaly, Lamia, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ioannis","family":"Anagnostopoulos","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Biomedical Informatics, School of Science, University of Thessaly, Lamia, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2023,6,9]]},"reference":[{"key":"S0129065723500399BIB001","doi-asserted-by":"crossref","first-page":"8675","DOI":"10.1007\/s00521-019-04359-7","volume":"32","author":"Alam K. M. R.","year":"2020","journal-title":"Neural Comput. Appl."},{"issue":"6","key":"S0129065723500399BIB002","doi-asserted-by":"crossref","first-page":"273","DOI":"10.3390\/info13060273","volume":"13","author":"Alkomah F.","year":"2022","journal-title":"Information"},{"key":"S0129065723500399BIB003","doi-asserted-by":"crossref","first-page":"100079","DOI":"10.1016\/j.osnem.2020.100079","volume":"18","author":"Alom Z.","year":"2020","journal-title":"Online Soc. Netw. Media"},{"issue":"03","key":"S0129065723500399BIB004","doi-asserted-by":"crossref","first-page":"2250007","DOI":"10.1142\/S0129065722500071","volume":"32","author":"Arco J. E.","year":"2022","journal-title":"Int. J. Neural Syst."},{"key":"S0129065723500399BIB006","doi-asserted-by":"crossref","first-page":"1724","DOI":"10.3115\/v1\/D14-1179","volume-title":"Proc. 2014 Conf. Empirical Methods in Natural Language Processing (EMNLP)","author":"Cho K.","year":"2014"},{"key":"S0129065723500399BIB007","first-page":"1","volume-title":"Proc. Stanford CS224d Deep Learning for NLP Final Project","author":"Chopra S.","year":"2017"},{"issue":"3","key":"S0129065723500399BIB008","doi-asserted-by":"crossref","first-page":"102481","DOI":"10.1016\/j.ipm.2020.102481","volume":"58","author":"Cunha W.","year":"2021","journal-title":"Inf. Process. Manage."},{"issue":"05","key":"S0129065723500399BIB009","doi-asserted-by":"crossref","first-page":"2150005","DOI":"10.1142\/S0129065721500052","volume":"31","author":"Cura O. K.","year":"2021","journal-title":"Int. J. Neural Syst."},{"key":"S0129065723500399BIB010","doi-asserted-by":"crossref","first-page":"138872","DOI":"10.1109\/ACCESS.2019.2941376","volume":"7","author":"Dai J.","year":"2019","journal-title":"IEEE Access"},{"key":"S0129065723500399BIB011","doi-asserted-by":"crossref","first-page":"38287","DOI":"10.1109\/ACCESS.2019.2907000","volume":"7","author":"Dai S.","year":"2019","journal-title":"IEEE Access"},{"issue":"3","key":"S0129065723500399BIB012","doi-asserted-by":"crossref","first-page":"483","DOI":"10.3390\/electronics9030483","volume":"9","author":"Dang N. C.","year":"2020","journal-title":"Electronics"},{"key":"S0129065723500399BIB016","doi-asserted-by":"crossref","first-page":"101060","DOI":"10.1016\/j.aei.2020.101060","volume":"44","author":"Fang W.","year":"2020","journal-title":"Adv. Eng. Inf."},{"key":"S0129065723500399BIB017","doi-asserted-by":"crossref","first-page":"2451","DOI":"10.1162\/089976600300015015","volume":"12","author":"Gers F. A.","year":"1999","journal-title":"Neural Comput."},{"key":"S0129065723500399BIB018","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1007\/978-3-540-27835-1_10","volume-title":"Int. Workshop Biologically Inspired Approaches to Advanced Information Technology","author":"Graves A.","year":"2004"},{"issue":"5","key":"S0129065723500399BIB019","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1109\/TPAMI.2008.137","volume":"31","author":"Graves A.","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"issue":"5","key":"S0129065723500399BIB020","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1016\/j.neunet.2005.06.042","volume":"18","author":"Graves A.","year":"2005","journal-title":"Neural Netw."},{"issue":"4","key":"S0129065723500399BIB022","doi-asserted-by":"crossref","first-page":"83","DOI":"10.3390\/a13040083","volume":"13","author":"Haralabopoulos G.","year":"2020","journal-title":"Algorithms"},{"key":"S0129065723500399BIB023","doi-asserted-by":"crossref","first-page":"114769","DOI":"10.1016\/j.eswa.2021.114769","volume":"177","author":"Haralabopoulos G.","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"S0129065723500399BIB024","first-page":"355","volume-title":"2018 Fifth Int. Conf. Social Networks Analysis, Management and Security (SNAMS)","author":"Haralabopoulos G.","year":"2018"},{"issue":"10","key":"S0129065723500399BIB025","doi-asserted-by":"crossref","first-page":"3088","DOI":"10.1073\/pnas.81.10.3088","volume":"81","author":"Hopfield J. J.","year":"1984","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"S0129065723500399BIB026","doi-asserted-by":"crossref","first-page":"34020","DOI":"10.1109\/ACCESS.2019.2896621","volume":"7","author":"Hu Y.","year":"2019","journal-title":"IEEE Access"},{"key":"S0129065723500399BIB027","doi-asserted-by":"crossref","first-page":"4332","DOI":"10.1109\/TNNLS.2021.3056664","volume":"33","author":"Huang F.","year":"2021","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"S0129065723500399BIB028","first-page":"2310","volume-title":"Proc. IEEE Conf. Computer Vision and Pattern Recognition","author":"Huang Y.","year":"2017"},{"key":"S0129065723500399BIB029","first-page":"4329","volume-title":"2017 IEEE Int. Conf. Big Data (Big Data)","author":"Jansson P.","year":"2017"},{"issue":"12","key":"S0129065723500399BIB031","doi-asserted-by":"crossref","first-page":"2250058","DOI":"10.1142\/S0129065722500587","volume":"32","author":"Kasseropoulos D. P.","year":"2022","journal-title":"Int. J. Neural Syst."},{"key":"S0129065723500399BIB032","first-page":"241","volume-title":"2008 15th Int. Conf. Systems, Signals and Image Processing","author":"Levada A. L.","year":"2008"},{"key":"S0129065723500399BIB033","first-page":"890","volume-title":"2018 9th Int. Conf. Information Technology in Medicine and Education (ITME)","author":"Li C.","year":"2018"},{"key":"S0129065723500399BIB034","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1016\/j.neucom.2019.01.078","volume":"337","author":"Liu G.","year":"2019","journal-title":"Neurocomputing"},{"issue":"06","key":"S0129065723500399BIB035","doi-asserted-by":"crossref","first-page":"2150051","DOI":"10.1142\/S0129065721500519","volume":"32","author":"Liu G.","year":"2022","journal-title":"Int. J. Neural Syst."},{"key":"S0129065723500399BIB036","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1016\/j.future.2020.03.004","volume":"108","author":"Makkar A.","year":"2020","journal-title":"Future Gener. Comput. Syst."},{"key":"S0129065723500399BIB037","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1145\/3368567.3368584","volume-title":"Proc. 11th Forum for Information Retrieval Evaluation","author":"Mandl T.","year":"2019"},{"issue":"16","key":"S0129065723500399BIB038","doi-asserted-by":"crossref","first-page":"7056","DOI":"10.1109\/JSEN.2019.2909837","volume":"19","author":"Mittal A.","year":"2019","journal-title":"IEEE Sens. J."},{"key":"S0129065723500399BIB039","first-page":"1","volume-title":"Proc. 12th Int. Workshop Semantic Evaluation","author":"Mohammad S.","year":"2018"},{"key":"S0129065723500399BIB040","doi-asserted-by":"crossref","first-page":"2250049","DOI":"10.1142\/S0129065722500496","volume":"32","author":"Nandi A.","year":"2022","journal-title":"Int. J. Neural Syst."},{"key":"S0129065723500399BIB041","first-page":"1881","volume-title":"Proc. IEEE Int. Conf. Computer Vision","author":"Niu Z.","year":"2017"},{"key":"S0129065723500399BIB042","first-page":"4675","volume-title":"Proc. 2019 Conf. Empirical Methods in Natural Language Processing and 9th Int. Joint Conf. Natural Language Processing (EMNLP\u2013IJCNLP)","author":"Ousidhoum N.","year":"2019"},{"issue":"4","key":"S0129065723500399BIB043","doi-asserted-by":"crossref","first-page":"694","DOI":"10.1109\/TASLP.2016.2520371","volume":"24","author":"Palangi H.","year":"2016","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"issue":"6","key":"S0129065723500399BIB044","first-page":"44","volume":"10","author":"Pawade D.","year":"2018","journal-title":"Int. J. Inf. Technol. Comput. Sci."},{"key":"S0129065723500399BIB045","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1109\/IJCNN.2017.7965940","volume-title":"2017 Int. Joint Conf. Neural Networks (IJCNN)","author":"Pulver A.","year":"2017"},{"key":"S0129065723500399BIB046","first-page":"1","volume-title":"ICC 2019-2019 IEEE Int. Conf. Communications (ICC)","author":"Qiu D.","year":"2019"},{"issue":"12","key":"S0129065723500399BIB047","doi-asserted-by":"crossref","first-page":"3074","DOI":"10.1109\/TNNLS.2017.2682102","volume":"28","author":"Rafiei M. H.","year":"2017","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"S0129065723500399BIB048","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.neucom.2018.04.045","volume":"308","author":"Rao G.","year":"2018","journal-title":"Neurocomputing"},{"issue":"11","key":"S0129065723500399BIB049","doi-asserted-by":"crossref","first-page":"e0240663","DOI":"10.1371\/journal.pone.0240663","volume":"15","author":"Ren B.","year":"2020","journal-title":"PLoS One"},{"key":"S0129065723500399BIB051","first-page":"194","volume-title":"Thirteenth Annual Conf. Int. Speech Communication Association (ISCA, 2012)","author":"Sundermeyer M."},{"key":"S0129065723500399BIB052","doi-asserted-by":"crossref","first-page":"156695","DOI":"10.1109\/ACCESS.2020.3019735","volume":"8","author":"Umer M.","year":"2020","journal-title":"IEEE Access"},{"key":"S0129065723500399BIB053","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1007\/978-3-030-36708-4_61","volume-title":"Int. Conf. Neural Information Processing","author":"Wang L.-N.","year":"2019"},{"issue":"02","key":"S0129065723500399BIB054","doi-asserted-by":"crossref","first-page":"2150048","DOI":"10.1142\/S0129065721500489","volume":"32","author":"Wang X.","year":"2022","journal-title":"Int. J. Neural Syst."},{"key":"S0129065723500399BIB055","first-page":"1794","volume":"51","author":"Wen S.","year":"2019","journal-title":"IEEE Trans. Syst. Man Cybern., Syst."},{"key":"S0129065723500399BIB056","doi-asserted-by":"crossref","first-page":"227","DOI":"10.3233\/ICA-220680","volume":"29","author":"Wolyn S.","year":"2022","journal-title":"Integr. Comput.-Aided Eng."},{"key":"S0129065723500399BIB057","first-page":"2864","volume-title":"Proc. 30th Conf. Advances in Neural Information Processing Systems","volume":"29","author":"Wu Y.","year":"2016"},{"issue":"6","key":"S0129065723500399BIB058","doi-asserted-by":"crossref","first-page":"4335","DOI":"10.1007\/s10462-019-09794-5","volume":"53","author":"Yadav A.","year":"2020","journal-title":"Artif. Intell. Rev."},{"key":"S0129065723500399BIB059","doi-asserted-by":"crossref","first-page":"3430","DOI":"10.1109\/ACCESS.2018.2885698","volume":"7","author":"Yao L.","year":"2018","journal-title":"IEEE Access"},{"key":"S0129065723500399BIB060","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.media.2019.04.006","volume":"55","author":"Ye C.","year":"2019","journal-title":"Med. Image Anal."},{"issue":"6","key":"S0129065723500399BIB061","doi-asserted-by":"crossref","first-page":"283","DOI":"10.3390\/e19060283","volume":"19","author":"Zeng D.","year":"2017","journal-title":"Entropy"},{"issue":"08","key":"S0129065723500399BIB062","doi-asserted-by":"crossref","first-page":"2250023","DOI":"10.1142\/S012906572250023X","volume":"32","author":"Zhang G.","year":"2022","journal-title":"Int. J. Neural Syst."},{"key":"S0129065723500399BIB063","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1016\/j.knosys.2019.03.007","volume":"174","author":"Zhang W.","year":"2019","journal-title":"Knowl.-Based Syst."},{"key":"S0129065723500399BIB064","first-page":"649","volume-title":"Proc. 28th Advances in Neural Information Processing Systems","author":"Zhang X.","year":"2015"}],"container-title":["International Journal of Neural Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0129065723500399","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,18]],"date-time":"2023-07-18T07:20:56Z","timestamp":1689664856000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0129065723500399"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,9]]},"references-count":57,"journal-issue":{"issue":"07","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["10.1142\/S0129065723500399"],"URL":"https:\/\/doi.org\/10.1142\/s0129065723500399","relation":{},"ISSN":["0129-0657","1793-6462"],"issn-type":[{"value":"0129-0657","type":"print"},{"value":"1793-6462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,9]]},"article-number":"2350039"}}