{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,20]],"date-time":"2026-07-20T04:03:13Z","timestamp":1784520193283,"version":"3.55.0"},"reference-count":100,"publisher":"Springer Science and Business Media LLC","issue":"13","license":[{"start":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T00:00:00Z","timestamp":1782518400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T00:00:00Z","timestamp":1782518400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001773","name":"University of New South Wales","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001773","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Comput &amp; Applic"],"published-print":{"date-parts":[[2026,7]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Large language models (LLMs) have been prominent in various tasks, including text generation and summarisation. The applicability of LLMs to the generation of product reviews is gaining momentum, paving the way for the generation of movie reviews. In this study, we propose a framework that generates movie reviews using three LLMs (GPT-4o, DeepSeek-V3, and Gemini-2.0), and evaluate their performance by comparing the generated outputs with IMDb user reviews. We use movie subtitles and screenplays as input to the LLMs and investigate how they affect the quality of reviews generated. We review the LLM-based movie reviews in terms of vocabulary, sentiment polarity, similarity, and thematic consistency in comparison to IMDB user reviews. The results demonstrate that LLMs are capable of generating syntactically fluent and structurally complete movie reviews. \u00a0Nevertheless, we find a noticeable gap in emotional richness and stylistic coherence between LLM-generated and IMDb reviews, suggesting that further refinement is needed to improve the overall quality of movie review generation. We finally conduct a survey-based human analysis, where participants distinguish between LLM and IMDb user reviews. The results show that LLM-generated reviews were generally difficult to distinguish from IMDB user reviews. We find that DeepSeek-V3 produced the most balanced reviews, closely matching IMDb reviews. GPT-4o overemphasised positive emotions, while Gemini-2.0 captured negative emotions better but showed excessive emotional intensity.<\/jats:p>","DOI":"10.1007\/s00521-026-12247-0","type":"journal-article","created":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T06:03:42Z","timestamp":1782540222000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["An evaluation of LLMs for generating movie reviews: GPT-4o, Gemini-2.0 and DeepSeek-V3"],"prefix":"10.1007","volume":"38","author":[{"given":"Brendan","family":"Sands","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yining","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenhao","family":"Xu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuxuan","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lai","family":"Wei","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rohitash","family":"Chandra","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,6,27]]},"reference":[{"issue":"3","key":"12247_CR1","first-page":"70","volume":"3","author":"F Fearing","year":"1947","unstructured":"Fearing F (1947) Influence of the movies on attitudes and behavior. J Soc Issues 3(3):70\u201380","journal-title":"J Soc Issues"},{"key":"12247_CR2","doi-asserted-by":"publisher","DOI":"10.4324\/9781315678863","volume-title":"The Routledge Companion to Cinema and Politics","author":"Y Tzioumakis","year":"2016","unstructured":"Tzioumakis Y, Molloy C (2016) The Routledge Companion to Cinema and Politics. Routledge, London and New York"},{"issue":"5","key":"12247_CR3","doi-asserted-by":"publisher","first-page":"503","DOI":"10.1080\/10253866.2017.1306207","volume":"21","author":"F Kerrigan","year":"2018","unstructured":"Kerrigan F (2018) Movies. Consumption Markets & Culture 21(5):503\u2013509","journal-title":"Consumption Markets & Culture"},{"key":"12247_CR4","unstructured":"Ross SJ (2014) Movies and American Society. John Wiley & Sons,"},{"issue":"1","key":"12247_CR5","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1300\/J082v44n01_09","volume":"44","author":"MA Mazur","year":"2003","unstructured":"Mazur MA, Emmers-Sommer TM (2003) The effect of movie portrayals on audience attitudes about nontraditional families and sexual orientation. J Homosex 44(1):157\u2013181","journal-title":"J Homosex"},{"key":"12247_CR6","doi-asserted-by":"crossref","unstructured":"Chowdhary KR (2020) \u201cNatural language processing,\u201d in Fundamentals of Artificial Intelligence. Springer, 603\u2013649","DOI":"10.1007\/978-81-322-3972-7_19"},{"issue":"3","key":"12247_CR7","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1093\/jamia\/ocz200","volume":"27","author":"S Wu","year":"2020","unstructured":"Wu S, Roberts K, Datta S, Du J, Ji Z, Si Y, Soni S, Wang Q, Wei Q, Xiang Yea et al (2020) Deep learning in clinical natural language processing: a methodical review. J Am Med Inform Assoc 27(3):457\u2013470","journal-title":"J Am Med Inform Assoc"},{"key":"12247_CR8","doi-asserted-by":"crossref","unstructured":"Mankolli E, Guliashki V (2020) Machine learning and natural language processing: Review of models and optimization problems, in ICT Innovations, Machine Learning and Applications. Springer International Publishing 2020:71\u201386","DOI":"10.1007\/978-3-030-62098-1_7"},{"key":"12247_CR9","first-page":"1877","volume":"33","author":"T Brown","year":"2020","unstructured":"Brown T, Mann B, Ryder N, Subbiah M, Kaplan J, Dhariwal P, Neelakantan A, Shyam P, Sastry G, Askell A et al (2020) Language models are few-shot learners. Adv Neural Inf Process Syst 33:1877\u20131901","journal-title":"Adv Neural Inf Process Syst"},{"issue":"5","key":"12247_CR10","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1038\/s42254-023-00581-4","volume":"5","author":"A Birhane","year":"2023","unstructured":"Birhane A, Kasirzadeh A, Leslie D, Wachter S (2023) Science in the age of large language models. Nature Reviews Physics 5(5):277\u2013280","journal-title":"Nature Reviews Physics"},{"key":"12247_CR11","doi-asserted-by":"crossref","unstructured":"Sengar SS, Hasan AB, Kumar S, Carroll F (2024) \u201cGenerative artificial intelligence: a systematic review and applications,\u201d Multimedia Tools and Applications, 1\u201340","DOI":"10.1007\/s11042-024-20016-1"},{"issue":"1","key":"12247_CR12","doi-asserted-by":"publisher","first-page":"52","DOI":"10.61969\/jai.1337500","volume":"7","author":"D Baidoo-Anu","year":"2023","unstructured":"Baidoo-Anu D, Ansah LO (2023) Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Journal of AI 7(1):52\u201362","journal-title":"Journal of AI"},{"key":"12247_CR13","doi-asserted-by":"crossref","unstructured":"Zhuang L, Jing F, Zhu X-Y (2006) \u201cMovie review mining and summarization,\u201d in Proceedings of the 15th ACM International Conference on Information and Knowledge Management, 2006, 43\u201350","DOI":"10.1145\/1183614.1183625"},{"issue":"6","key":"12247_CR14","doi-asserted-by":"publisher","first-page":"823","DOI":"10.1177\/0165551510388123","volume":"36","author":"TT Thet","year":"2010","unstructured":"Thet TT, Na J-C, Khoo CSG (2010) Aspect-based sentiment analysis of movie reviews on discussion boards. J Inf Sci 36(6):823\u2013848","journal-title":"J Inf Sci"},{"key":"12247_CR15","first-page":"293","volume":"2010","author":"M Joshi","year":"2010","unstructured":"Joshi M, Das D, Gimpel K, Smith NA (2010) Movie reviews and revenues: An experiment in text regression, in Human Language Technologies: The. Annual Conference of the North American Chapter of the Association for Computational Linguistics 2010:293\u2013296","journal-title":"Annual Conference of the North American Chapter of the Association for Computational Linguistics"},{"issue":"3","key":"12247_CR16","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1109\/TSMCC.2011.2136334","volume":"42","author":"C-L Liu","year":"2011","unstructured":"Liu C-L, Hsaio W-H, Lee C-H, Lu G-C, Jou E (2011) Movie rating and review summarization in mobile environment. IEEE Transactions on Systems Man and Cybernetics Part C 42(3):397\u2013407","journal-title":"IEEE Transactions on Systems Man and Cybernetics Part C"},{"issue":"3","key":"12247_CR17","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1109\/MIS.2013.34","volume":"28","author":"M W\u00f6llmer","year":"2013","unstructured":"W\u00f6llmer M, Weninger F, Knaup T, Schuller B, Sun C, Sagae K, Morency L-P (2013) YouTube movie reviews: Sentiment analysis in an audio-visual context. IEEE Intell Syst 28(3):46\u201353","journal-title":"IEEE Intell Syst"},{"key":"12247_CR18","doi-asserted-by":"crossref","unstructured":"Topal K, Ozsoyoglu G (2016) \u201cMovie review analysis: Emotion analysis of IMDb movie reviews,\u201d in 2016 IEEE\/ACM International Conference on Advances in Social Networks Analysis and Mining.IEEE, 1170\u20131176","DOI":"10.1109\/ASONAM.2016.7752387"},{"key":"12247_CR19","unstructured":"Zhang Y, Jin H, Meng D et al (2024) \u201cA comprehensive survey on process-oriented automatic text summarization with exploration of LLM-based methods,\u201d arXiv preprint arXiv:2403.02901"},{"key":"12247_CR20","unstructured":"Zhou L, Zhang R, Dai X, Hershcovich D, Li H (2025) \u201cLarge language models penetration in scholarly writing and peer review,\u201d arXiv preprint arXiv:2502.11193"},{"issue":"11","key":"12247_CR21","doi-asserted-by":"publisher","first-page":"1276","DOI":"10.1111\/medu.15402","volume":"58","author":"HC Lucas","year":"2024","unstructured":"Lucas HC, Upperman JS, Robinson JR (2024) A systematic review of large language models and their implications in medical education. Med Educ 58(11):1276\u20131285","journal-title":"Med Educ"},{"key":"12247_CR22","doi-asserted-by":"crossref","unstructured":"Raiaan MAK, Mukta MSH, Fatema K, Fahad NM, Sakib S, Mim MMJ, Ahmad J, Ali ME, Azam S (2024) \u201cA review on large language models: Architectures, applications, taxonomies, open issues and challenges,\u201d IEEE Access, 12, 26\u00a0839\u201326\u00a0874,","DOI":"10.1109\/ACCESS.2024.3365742"},{"key":"12247_CR23","unstructured":"Huang Y, Xu J, Lai J et al (2023) \u201cAdvancing transformer architecture in long-context large language models: A comprehensive survey,\u201d arXiv preprint arXiv:2311.12351"},{"key":"12247_CR24","doi-asserted-by":"crossref","unstructured":"Chandra R, Ren G (2025) \u201cLongitudinal abuse and sentiment analysis of hollywood movie dialogues using LLMs,\u201d arXiv preprint arXiv:2310.07039","DOI":"10.1016\/j.mlwa.2025.100749"},{"key":"12247_CR25","doi-asserted-by":"crossref","unstructured":"Hadi MU, Qureshi R, Shah A et al (2023) \u201cLarge language models: a comprehensive survey of its applications, challenges, limitations, and future prospects,\u201d Authorea Preprints","DOI":"10.36227\/techrxiv.23589741"},{"key":"12247_CR26","doi-asserted-by":"crossref","unstructured":"DiStefano PV, Patterson JD, Beaty RE (2024) \u201cAutomatic scoring of metaphor creativity with large language models,\u201d Creativity Research Journal, 1\u201315,","DOI":"10.31234\/osf.io\/6jtxb"},{"issue":"8","key":"12247_CR27","doi-asserted-by":"publisher","first-page":"677","DOI":"10.1002\/(SICI)1520-6793(199912)16:8<677::AID-MAR4>3.0.CO;2-T","volume":"16","author":"A D\u2019Astous","year":"1999","unstructured":"D\u2019Astous A, Touil N (1999) Consumer evaluations of movies on the basis of critics\u2019 judgments. Psychology & Marketing 16(8):677\u2013694","journal-title":"Psychology & Marketing"},{"issue":"1","key":"12247_CR28","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1509\/jmkg.74.1.108","volume":"74","author":"S Moon","year":"2010","unstructured":"Moon S, Bergey PK, Iacobucci D (2010) Dynamic effects among movie ratings, movie revenues, and viewer satisfaction. J Mark 74(1):108\u2013121","journal-title":"J Mark"},{"key":"12247_CR29","doi-asserted-by":"crossref","unstructured":"Kerrigan F, Marketing F (2017). Elsevier,","DOI":"10.4324\/9781315795287"},{"issue":"1","key":"12247_CR30","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1287\/isre.1100.0336","volume":"23","author":"N Sahoo","year":"2012","unstructured":"Sahoo N, Krishnan R, Duncan G, Callan J (2012) The halo effect in multicomponent ratings and its implications for recommender systems. Inf Syst Res 23(1):231\u2013246","journal-title":"Inf Syst Res"},{"issue":"2","key":"12247_CR31","first-page":"239","volume":"12","author":"S Moon","year":"2018","unstructured":"Moon S, Kim H-D (2018) Online viewer reviews and box office performance: The role of sentiment analysis. Serv Bus 12(2):239\u2013257","journal-title":"Serv Bus"},{"key":"12247_CR32","doi-asserted-by":"crossref","unstructured":"Birhane A, Ruane E, Laurent T, Brown MS, Flowers J, Ventresque A, Dancy CL (2022) \u201cThe forgotten margins of AI ethics,\u201d in Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency, 2022, 948\u2013958","DOI":"10.1145\/3531146.3533157"},{"key":"12247_CR33","unstructured":"Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I (2019) \u201cLanguage models are unsupervised multitask learners,\u201d OpenAI Blog, available at: https:\/\/openai.com\/research\/better-language-models"},{"key":"12247_CR34","doi-asserted-by":"crossref","unstructured":"Sheng E, Chang K-W, Natarajan P, Peng N (2019) \u201cThe woman worked as a babysitter: On biases in language generation,\u201d in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing, 3407\u20133412","DOI":"10.18653\/v1\/D19-1339"},{"key":"12247_CR35","unstructured":"Qin L, Chen Q, Feng X, Wu Y, Zhang Y, Li Y, Li M, Che W, Yu PS (2024) \u201cLarge language models meet NLP: A survey,\u201d arXiv preprint arXiv:2405.12819"},{"key":"12247_CR36","doi-asserted-by":"publisher","DOI":"10.1016\/j.hcc.2024.100211","author":"Y Yao","year":"2024","unstructured":"Yao Y, Duan J, Xu K, Cai Y, Sun Z, Zhang Y (2024) A survey on large language model (LLM) security and privacy: the good, the bad, and the ugly. High-Confidence Computing. https:\/\/doi.org\/10.1016\/j.hcc.2024.100211","journal-title":"High-Confidence Computing"},{"key":"12247_CR37","doi-asserted-by":"publisher","DOI":"10.1016\/j.jretconser.2024.103975","volume":"81","author":"SV Praveen","year":"2024","unstructured":"Praveen SV, Gajjar P, Ray RK (2024) Crafting clarity: Leveraging large language models to decode consumer reviews. J Retail Consum Serv 81:103975","journal-title":"J Retail Consum Serv"},{"issue":"4","key":"12247_CR38","doi-asserted-by":"publisher","first-page":"351","DOI":"10.4258\/hir.2016.22.4.351","volume":"22","author":"KG Kim","year":"2016","unstructured":"Kim KG (2016) Book review: Deep learning. Healthcare Informatics Research 22(4):351\u2013354","journal-title":"Healthcare Informatics Research"},{"issue":"7553","key":"12247_CR39","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436\u2013444","journal-title":"Nature"},{"issue":"8","key":"12247_CR40","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735\u20131780","journal-title":"Neural Comput"},{"key":"12247_CR41","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141, Polosukhin I (2017) \u201cAttention is all you need,\u201d Advances in Neural Information Processing Systems, 30,"},{"key":"12247_CR42","unstructured":"Hariri W (2023) \u201cUnlocking the potential of ChatGPT: A comprehensive exploration of its applications, advantages, limitations, and future directions in natural language processing,\u201d arXiv preprint arXiv:2304.02017"},{"key":"12247_CR43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.csl.2016.04.001","volume":"40","author":"AO Bayer","year":"2016","unstructured":"Bayer AO, Riccardi G (2016) Semantic language models with deep neural networks. Computer Speech & Language 40:1\u201322","journal-title":"Computer Speech & Language"},{"issue":"3","key":"12247_CR44","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1016\/j.eng.2019.12.014","volume":"6","author":"M Zhou","year":"2020","unstructured":"Zhou M, Duan N, Liu Sea et al (2020) Progress in neural NLP: modeling, learning, and reasoning. Engineering 6(3):275\u2013290","journal-title":"Engineering"},{"key":"12247_CR45","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1016\/j.inffus.2022.10.023","volume":"91","author":"D Fern\u00e1ndez-Gonz\u00e1lez","year":"2023","unstructured":"Fern\u00e1ndez-Gonz\u00e1lez D, G\u00f3mez-Rodr\u00edguez C (2023) Dependency parsing with bottom-up hierarchical pointer networks. Information Fusion 91:494\u2013503","journal-title":"Information Fusion"},{"key":"12247_CR46","doi-asserted-by":"crossref","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K (2019) \u201cBERT: Pre-training of deep bidirectional transformers for language understanding,\u201d Proceedings of NAACL-HLT, 4171\u20134186","DOI":"10.18653\/v1\/N19-1423"},{"key":"12247_CR47","unstructured":"Radford A, Narasimhan K, Salimans T, Sutskever I (2018) \u201cImproving language understanding by generative pre-training,\u201d OpenAI Blog"},{"key":"12247_CR48","first-page":"201","volume":"9","author":"D Erhan","year":"2010","unstructured":"Erhan D, Courville A, Bengio Y, Vincent P (2010) Why does unsupervised pre-training help deep learning? Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics 9:201\u2013208","journal-title":"Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics"},{"key":"12247_CR49","unstructured":"Liu Y, Ott M, Goyal N et al (2019) \u201cRoBERTa: A robustly optimized BERT pretraining approach,\u201d arXiv preprint arXiv:1907.11692"},{"key":"12247_CR50","unstructured":"Ren G (2025) \u201cHollywood movie subtitle dataset: Oscar nominations and top 10 blockbusters (1950\u20132024),\u201d https:\/\/www.kaggle.com\/datasets\/mlopssss\/subtitles, accessed:"},{"key":"12247_CR51","unstructured":"Ren G (2025) \u201cIMDb movie reviews grouped by ratings,\u201d https:\/\/www.kaggle.com\/datasets\/mlopssss\/imdb-movie-reviews-grouped-by-ratings, 2025, accessed:"},{"issue":"1","key":"12247_CR52","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1093\/screen\/44.1.119","volume":"44","author":"J Stringer","year":"2003","unstructured":"Stringer J (2003) Asia pacific cinema: The flows and contradictions of a regional form. Screen 44(1):119\u2013124","journal-title":"Screen"},{"key":"12247_CR53","volume-title":"Natural Language Processing with Python","author":"S Bird","year":"2009","unstructured":"Bird S, Klein E, Loper E (2009) Natural Language Processing with Python. O\u2019Reilly Media, Sebastopol, CA"},{"key":"12247_CR54","doi-asserted-by":"crossref","unstructured":"Bollmann M (2019) \u201cA large-scale comparison of historical text normalization systems,\u201d in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 3885\u20133898. [Online]. Available: https:\/\/aclanthology.org\/N19-1391","DOI":"10.18653\/v1\/N19-1389"},{"key":"12247_CR55","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511809071","volume-title":"Introduction to Information Retrieval","author":"CD Manning","year":"2008","unstructured":"Manning CD, Raghavan P, Sch\u00fctze H (2008) Introduction to Information Retrieval. Cambridge University Press, Cambridge, UK"},{"key":"12247_CR56","unstructured":"OpenAI (2024) \u201cGPT-4o technical report,\u201d https:\/\/openai.com\/index\/gpt-4o, accessed: 2024-05-15"},{"key":"12247_CR57","unstructured":"OpenAI (2023) \u201cChatGPT: Optimizing language models for dialogue,\u201d https:\/\/openai.com\/blog\/chatgpt, accessed: 2024-05-15"},{"key":"12247_CR58","unstructured":"OpenAI (2023) \u201cGPT-4 technical report,\u201d. [Online]. Available: arXiv: 2303.08774"},{"key":"12247_CR59","unstructured":"Chen Y et al (2023) \u201cExploring the multilingual capabilities of large language models: Evaluation and insights,\u201d arXiv preprint arXiv:2311.07575"},{"key":"12247_CR60","unstructured":"DeepSeek-AI (2024) \u201cDeepSeek-V3 technical report,\u201d. [Online]. Available: https:\/\/arxiv.org\/abs\/2412.19437"},{"key":"12247_CR61","unstructured":"Gloeckle F, Idrissi BY, Rozi\u00e8re B, Lopez-Paz D, Synnaeve G (2024) \u201cBetter & faster large language models via multi-token prediction,\u201d arXiv preprint arXiv:2404.19737"},{"key":"12247_CR62","unstructured":"Borji A (2024) \u201cA review of Gemini: Google DeepMind\u2019s multimodal large language model,\u201d arXiv preprint arXiv:2401.10020, [Online]. Available: https:\/\/arxiv.org\/abs\/2401.10020"},{"key":"12247_CR63","doi-asserted-by":"crossref","unstructured":"Zheng L, Chiang W-L, Sheng Y, Zhuang S, Wu Z, Zhuang Y, Lin Z, Li Z, Li D, Xing E et al (2024) \u201cJudging LLM-as-a-judge with MT-Bench and Chatbot Arena,\u201d Advances in Neural Information Processing Systems, 36,","DOI":"10.52202\/075280-2020"},{"key":"12247_CR64","unstructured":"Cavnar WB, Trenkle JM (1994) \u201cN-gram-based text categorization,\u201d in Proceedings of SDAIR-94, 3rd Annual Symposium on Document Analysis and Information Retrieval. Ann Arbor, Michigan, 161\u2013175"},{"key":"12247_CR65","unstructured":"Jurafsky D, Martin JH (2025) Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition with Language Models, 3rd ed. Pearson, 2025, online manuscript released 12. [Online]. Available: https:\/\/web.stanford.edu\/~jurafsky\/slp3\/"},{"key":"12247_CR66","doi-asserted-by":"publisher","first-page":"805","DOI":"10.1007\/s10115-017-1055-z","volume":"53","author":"A Tripathy","year":"2017","unstructured":"Tripathy A, Anand A, Rath SK (2017) Document-level sentiment classification using hybrid machine learning approach. Knowl Inf Syst 53:805\u2013831","journal-title":"Knowl Inf Syst"},{"issue":"3","key":"12247_CR67","doi-asserted-by":"publisher","first-page":"853","DOI":"10.1016\/j.eswa.2013.08.015","volume":"41","author":"G Sidorov","year":"2014","unstructured":"Sidorov G, Velasquez F, Stamatatos E, Gelbukh A, Chanona-Hern\u00e1ndez L (2014) Syntactic n-grams as machine learning features for natural language processing. Expert Syst Appl 41(3):853\u2013860","journal-title":"Expert Syst Appl"},{"issue":"4","key":"12247_CR68","doi-asserted-by":"crossref","first-page":"1644","DOI":"10.3390\/app11041644","volume":"11","author":"J-H Lee","year":"2021","unstructured":"Lee J-H, Park S-H (2021) Sentiment classification with RoBERTa and data augmentation techniques. Appl Sci 11(4):1644","journal-title":"Appl Sci"},{"key":"12247_CR69","unstructured":"Chen Y, Skiena S (2020) \u201cA survey on sentiment and emotion analysis for computational literary studies,\u201d arXiv preprint arXiv:2009.07297"},{"key":"12247_CR70","doi-asserted-by":"crossref","unstructured":"Barbieri F, Camacho-Collados J, Espinosa-Anke L, Neves L (2020) \u201cTweetEval: Unified benchmark and comparative evaluation for tweet classification,\u201d in Findings of the 2020 Conference on Empirical Methods in Natural Language Processing, 1644\u20131650. [Online]. Available: https:\/\/aclanthology.org\/2020.findings-emnlp.148","DOI":"10.18653\/v1\/2020.findings-emnlp.148"},{"key":"12247_CR71","doi-asserted-by":"crossref","unstructured":"Demszky D, Movshovitz-Attias D, Ko J, Cowen A, Nemade G, Ravi S (2020) \u201cGoEmotions: A dataset of fine-grained emotions,\u201d in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 4040\u20134054. [Online]. Available: https:\/\/aclanthology.org\/2020.acl-main.372","DOI":"10.18653\/v1\/2020.acl-main.372"},{"key":"12247_CR72","unstructured":"Zellers R, Holtzman A, Rashkin H, Bisk Y, Farhadi A, Roesner F, Choi Y (2019) \u201cDefending against neural fake news,\u201d in Advances in Neural Information Processing Systems, [Online]. Available: https:\/\/papers.nips.cc\/paper_files\/paper\/2019\/hash\/21e1f9a4e0b0b6f4205c6a4878736e5b-Abstract.html"},{"key":"12247_CR73","unstructured":"Liu X, Ou J, Wang Z, Zhang S, Wang X, Neubig G (2023) \u201cWhat makes good in-context examples for GPT-3?\u201d in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics, 10\u00a0753\u201310\u00a0776. [Online]. Available: https:\/\/aclanthology.org\/2023.acl-long.599"},{"key":"12247_CR74","unstructured":"Lee S, Kang D, Park M, Cho K (2023) \u201cTowards standardizing AI bias exploration,\u201d in Findings of the Association for Computational Linguistics: ACL 2023"},{"key":"12247_CR75","unstructured":"Zhang X, Li J, Ye Y et al (2022) \u201cSentiment analysis for long movie reviews using hierarchical transformer models,\u201d arXiv preprint arXiv:2212.09561"},{"key":"12247_CR76","unstructured":"Maas A, Daly R, Pham P, Huang D, Ng A, Potts C (2011) \u201cLearning word vectors for sentiment analysis,\u201d in Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics, 142\u2013150"},{"key":"12247_CR77","unstructured":"Stilwell S (2024) \u201cExplainable prompt learning for movie review sentiment analysis,\u201d Master\u2019s thesis, University of Ottawa.[Online]. Available: https:\/\/ruor.uottawa.ca\/server\/api\/core\/bitstreams\/e6811e0b-7aed-46fb-a7a5-f29be4246ca7\/content"},{"key":"12247_CR78","doi-asserted-by":"crossref","unstructured":"Hartmann J, Schwenzow J, Witte M (2023) The political ideology of conversational AI: Converging evidence on ChatGPT\u2019s pro-environmental, left-libertarian orientation.arXiv:2301.01768 arXiv preprint","DOI":"10.2139\/ssrn.4316084"},{"key":"12247_CR79","unstructured":"Li C, Wang J, Zhang Y, Zhu K, Hou W, Lian J, Luo F, Yang Q, Xie X (2023) \u201cEnhancing emotional generation capability of large language models with emotional chain-of-thought,\u201d arXiv preprint arXiv:2401.06836"},{"issue":"4","key":"12247_CR80","first-page":"1205","volume":"39","author":"J Hartmann","year":"2022","unstructured":"Hartmann J, Heitmann M, Siebert C, Schamp C (2022) More than a feeling: Accuracy and application of emotion analysis. Int J Res Mark 39(4):1205\u20131223","journal-title":"Int J Res Mark"},{"key":"12247_CR81","unstructured":"Sun X, Li X, Zhang S, Wang S, Wu F, Li J, Zhang T, Wang G (2023) \u201cSentiment analysis through LLM negotiations,\u201d arXiv preprint arXiv:2311.01876"},{"key":"12247_CR82","doi-asserted-by":"crossref","unstructured":"Chu W-T, Roy D (2017) \u201cAudio-visual sentiment analysis for learning emotional arcs in movies,\u201d in Proceedings of the IEEE International Conference on Data Mining. IEEE, 829\u2013834","DOI":"10.1109\/ICDM.2017.100"},{"key":"12247_CR83","unstructured":"Thao PT, Yang H-J, Kim S (2019) \u201cMultimodal deep models for predicting affective responses evoked by movies,\u201d IEEE Access, 7, 209\u00a0616\u2013209\u00a0628,"},{"key":"12247_CR84","unstructured":"Zhang X, Sheng E, Yin D, Wang WY (2023) \u201cDetecting LLM-generated text in computing education,\u201d arXiv preprint arXiv:2307.07411"},{"key":"12247_CR85","doi-asserted-by":"crossref","first-page":"929","DOI":"10.1162\/tacl_a_00405","volume":"9","author":"E Clark","year":"2021","unstructured":"Clark E, Celikyilmaz A, Smith NA (2021) All that\u2019s \u2018human\u2019 is not gold: Evaluating human evaluation of generated text. Transactions of the Association for Computational Linguistics 9:929\u2013944","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"12247_CR86","unstructured":"Chen M, Tworek J, Jun H, Yuan Q, Pinto HPDO, Kaplan J et al (2021) \u201cEvaluating large language models trained on code,\u201d arXiv preprint arXiv:2107.03374"},{"issue":"10","key":"12247_CR87","doi-asserted-by":"publisher","first-page":"731","DOI":"10.1111\/j.1749-818X.2011.00306.x","volume":"5","author":"J Good","year":"2011","unstructured":"Good J (2011) The typology of templates. Language and Linguistics Compass 5(10):731\u2013747","journal-title":"Language and Linguistics Compass"},{"key":"12247_CR88","unstructured":"Wu Y, Hee MS, Hu Z, Lee RK-W (2024) \u201cLongGenBench: Benchmarking long-form generation in long context LLMs,\u201d arXiv preprint arXiv:2409.02076"},{"key":"12247_CR89","doi-asserted-by":"crossref","unstructured":"Zhang W, Deng Y, Liu B, Pan SJ, Bing L (2023) \u201cSentiment analysis in the era of large language models: A reality check,\u201d arXiv preprint arXiv:2305.15005","DOI":"10.18653\/v1\/2024.findings-naacl.246"},{"issue":"13s","key":"12247_CR90","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3586075","volume":"55","author":"R Das","year":"2023","unstructured":"Das R, Singh TD (2023) Multimodal sentiment analysis: a survey of methods, trends, and challenges. ACM Comput Surv 55(13s):1\u201338","journal-title":"ACM Comput Surv"},{"key":"12247_CR91","first-page":"200","volume":"34","author":"M Tsimpoukelli","year":"2021","unstructured":"Tsimpoukelli M, Menick JL, Cabi S, Eslami SM, Vinyals O, Hill F (2021) Multimodal few-shot learning with frozen language models. Adv Neural Inf Process Syst 34:200\u2013212","journal-title":"Adv Neural Inf Process Syst"},{"key":"12247_CR92","doi-asserted-by":"crossref","unstructured":"Yang H, Zhao Y, Wu Y, Wang S, Zheng T, Zhang H, Ma Z, Che W, Qin B (2024) \u201cLarge language models meet text-centric multimodal sentiment analysis: A survey,\u201d arXiv preprint arXiv:2406.08068","DOI":"10.1007\/s11432-024-4593-8"},{"issue":"2s","key":"12247_CR93","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3545572","volume":"19","author":"S Jabeen","year":"2023","unstructured":"Jabeen S, Li X, Amin MS, Bourahla O, Li S, Jabbar A (2023) A review on methods and applications in multimodal deep learning. ACM Trans Multimed Comput Commun Appl 19(2s):1\u201341","journal-title":"ACM Trans Multimed Comput Commun Appl"},{"key":"12247_CR94","doi-asserted-by":"crossref","unstructured":"Myung J, Lee N, Zhou Y, Jin J, Putri R et al (2024) \u201cBLEND: A benchmark for LLMs on everyday knowledge in diverse cultures and languages,\u201d Advances in Neural Information Processing Systems, 37, 78\u00a0104\u201378\u00a0146,","DOI":"10.52202\/079017-2483"},{"key":"12247_CR95","unstructured":"Pawar S, Park J, Jin J, Arora A, Myung J et al (2024) \u201cSurvey of cultural awareness in language models: Text and beyond,\u201d arXiv preprint arXiv:2411.00860"},{"key":"12247_CR96","doi-asserted-by":"crossref","unstructured":"Etxaniz J, Azkune G, Soroa A, Lacalle O, Artetxe M (2024) \u201cBERTAQA: How much do language models know about local culture?\u201d Advances in Neural Information Processing Systems, 37, 34\u00a0077\u201334\u00a0097","DOI":"10.52202\/079017-1073"},{"key":"12247_CR97","doi-asserted-by":"crossref","unstructured":"Hada R, Gumma V, de Wynter A, Diddee H, Ahmed M, Choudhury M, Bali K, Sitaram S (2023) \u201cAre large language model-based evaluators the solution to scaling up multilingual evaluation?\u201d arXiv preprint arXiv:2309.07462","DOI":"10.18653\/v1\/2024.findings-eacl.71"},{"issue":"3","key":"12247_CR98","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1108\/JCM-02-2018-2570","volume":"36","author":"AI Rynarzewska","year":"2019","unstructured":"Rynarzewska AI (2019) It\u2019s not fake, it\u2019s biased: insights into morality of incentivized reviewers. J Consum Mark 36(3):401\u2013409","journal-title":"J Consum Mark"},{"issue":"1","key":"12247_CR99","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0316093","volume":"20","author":"J Doughman","year":"2025","unstructured":"Doughman J, Khreich W (2025) Beyond the spotlight: Unveiling the gender bias curtain in movie reviews. PLoS ONE 20(1):e0316093","journal-title":"PLoS ONE"},{"key":"12247_CR100","doi-asserted-by":"crossref","unstructured":"Sahu S, Singh SK (2019) \u201cEthics in AI: collaborative filtering based approach to alleviate strong user biases and prejudices,\u201d in 2019 Twelfth International Conference on Contemporary Computing (IC3). IEEE, 1\u20136","DOI":"10.1109\/IC3.2019.8844875"}],"container-title":["Neural Computing and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-026-12247-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00521-026-12247-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-026-12247-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,20]],"date-time":"2026-07-20T03:38:23Z","timestamp":1784518703000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00521-026-12247-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,27]]},"references-count":100,"journal-issue":{"issue":"13","published-print":{"date-parts":[[2026,7]]}},"alternative-id":["12247"],"URL":"https:\/\/doi.org\/10.1007\/s00521-026-12247-0","relation":{},"ISSN":["0941-0643","1433-3058"],"issn-type":[{"value":"0941-0643","type":"print"},{"value":"1433-3058","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,27]]},"assertion":[{"value":"11 July 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 May 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 June 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have influenced this study.","order":1,"name":"Ethics","label":"Conflicts of interest","group":{"name":"EthicsHeading","label":"Declarations"}}],"article-number":"556"}}