{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T16:27:24Z","timestamp":1782491244991,"version":"3.54.5"},"reference-count":84,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2024,10,21]],"date-time":"2024-10-21T00:00:00Z","timestamp":1729468800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2024,10,31]]},"abstract":"<jats:p>Large language models (LLMs), such as OpenAI's Generative Pre-trained Transformer (GPT), are a class of language models that have demonstrated outstanding performance across a range of natural language processing (NLP) tasks. LLMs have become a highly sought-after research area because of their ability to generate human-like language and their potential to revolutionize science and technology. In this study, we conduct bibliometric and discourse analyses of scholarly literature on LLMs. Synthesizing over 5,000 publications, this article serves as a roadmap for researchers, practitioners, and policymakers to navigate the current landscape of LLMs research. We present the research trends from 2017 to early 2023, identifying patterns in research paradigms and collaborations. We start with analyzing the core algorithm developments and NLP tasks that are fundamental in LLMs research. We then investigate the applications of LLMs in various fields and domains, including medicine, engineering, social science, and humanities. Our review also reveals the dynamic, fast-paced evolution of LLMs research. Overall, this article offers valuable insights into the current state, impact, and potential of LLMs research and its applications.<\/jats:p>","DOI":"10.1145\/3664930","type":"journal-article","created":{"date-parts":[[2024,5,13]],"date-time":"2024-05-13T10:37:48Z","timestamp":1715596668000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":121,"title":["A Bibliometric Review of Large Language Models Research from 2017 to 2023"],"prefix":"10.1145","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7962-9113","authenticated-orcid":false,"given":"Lizhou","family":"Fan","sequence":"first","affiliation":[{"name":"School of Information, University of Michigan, Ann Arbor, MI, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5888-8311","authenticated-orcid":false,"given":"Lingyao","family":"Li","sequence":"additional","affiliation":[{"name":"School of Information, University of Michigan, Ann Arbor, MI, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2836-280X","authenticated-orcid":false,"given":"Zihui","family":"Ma","sequence":"additional","affiliation":[{"name":"Department of Civil and Environmental Engineering, University of Maryland, College Park, MD, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-6260-072X","authenticated-orcid":false,"given":"Sanggyu","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Civil and Environmental Engineering, University of Maryland, College Park, MD, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3776-9211","authenticated-orcid":false,"given":"Huizi","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Public Health, University of Michigan, Ann Arbor, MI, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3793-7281","authenticated-orcid":false,"given":"Libby","family":"Hemphill","sequence":"additional","affiliation":[{"name":"School of Information, University of Michigan, Ann Arbor, MI, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,10,21]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462624"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1002\/job.719"},{"key":"e_1_3_1_4_2","unstructured":"D. Araci. 2019. FinBERT: Financial sentiment analysis with pre-trained language models. arXiv:1908.10063. Retrieved from http:\/\/arxiv.org\/abs\/1908.10063"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1371"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445922"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1162\/qss_a_00018"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1214\/07-AOAS114"},{"key":"e_1_3_1_9_2","unstructured":"R. Bommasani D. A. Hudson E. Adeli R. Altman S. Arora S. von Arx M. S. Bernstein J. Bohg A. Bosselut E. Brunskill . 2021. On the opportunities and risks of foundation models. arXiv:2108.07258."},{"key":"e_1_3_1_10_2","unstructured":"T. B. Brown B. Mann N. Ryder M. Subbiah J. Kaplan P. Dhariwal A. Neelakantan P. Shyam G. Sastry A. Askell S. Agarwal A. Herbert-Voss G. Krueger T. Henighan R. Child A. Ramesh D. M. Ziegler J. Wu C. Winter and D. Amodei. 2020. Language models are few-shot learners. arXiv:2005.14165. Retrieved from http:\/\/arxiv.org\/abs\/2005.14165"},{"key":"e_1_3_1_11_2","unstructured":"N. Carlini F. Tramer E. Wallace M. Jagielski A. Herbert-Voss K. Lee A. Roberts T. Brown D. Song U. Erlingsson A. Oprea and C. Raffel. 2020. Extracting Training Data from Large Language Models. In USENIX Security Symposium. Retrieved from https:\/\/www.usenix.org\/system\/files\/sec21-carlini-extracting.pdf"},{"key":"e_1_3_1_12_2","unstructured":"C. Chen. 2016. CiteSpace: A practical guide for mapping scientific literature. Retrieved from http:\/\/www.dobraca.com\/wp-content\/uploads\/2019\/03\/CiteSpacePracticalGuide-Nova-Sample1-50pp.pdf"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.21309"},{"key":"e_1_3_1_14_2","unstructured":"J. Devlin M. -W. Chang K. Lee and K. Toutanova. 2018. BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805. Retrieved from http:\/\/arxiv.org\/abs\/1810.04805"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10489-022-04346-x"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbusres.2021.04.070"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.3389\/fsoc.2022.886498"},{"key":"e_1_3_1_18_2","unstructured":"T. Eloundou S. Manning P. Mishkin and D. Rock. 2023. GPTs are GPTs: An early look at the labor market impact potential of large language models. arXiv:2303.10130. http:\/\/arxiv.org\/abs\/2303.10130"},{"key":"e_1_3_1_19_2","doi-asserted-by":"crossref","unstructured":"L. Fan W. Hua L. Li H. Ling and Y. Zhang. 2023. Nphardeval: Dynamic benchmark on reasoning ability of large language models via complexity classes. arXiv:2312.14890.","DOI":"10.18653\/v1\/2024.acl-long.225"},{"key":"e_1_3_1_20_2","unstructured":"L. Fan W. Hua X. Li K. Zhu M. Jin L. Li H. Ling J. Chi J. Wang X. Ma and Y. Zhang. 2024. NPHardEval4V: A dynamic reasoning benchmark of multimodal large language models. arXiv:2403.01777."},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","unstructured":"Leo (Lizhou) Fan. 2024. casmlab\/LLMs \\(\\_\\) bib: v1.0.0. DOI: 10.5281\/zenodo.10612307","DOI":"10.5281\/zenodo.10612307"},{"key":"e_1_3_1_22_2","unstructured":"L. Fridman. 2023. Sam Altman: OpenAI CEO on GPT-4 ChatGPT and the future of AI. YouTube. Retrieved March 25 2023 from https:\/\/www.youtube.com\/watch?v=L_Guz73e6fw"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3462741.3466809"},{"key":"e_1_3_1_24_2","unstructured":"M. Grootendorst. 2022. BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv:2203.05794. Retrieved from http:\/\/arxiv.org\/abs\/2203.05794"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3458754"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1080\/08839514.2022.2037254"},{"key":"e_1_3_1_27_2","unstructured":"J. Hu and M. Sun. 2020. Generating major types of Chinese classical poetry in a uniformed framework. arXiv:2003.11528. Retrieved from http:\/\/arxiv.org\/abs\/2003.11528"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.naacl-main.400"},{"key":"e_1_3_1_29_2","unstructured":"W. Hua L. Fan L. Li K. Mei J. Ji Y. Ge L. Hemphill and Y. Zhang. 2023. War and peace (waragent): Large language model-based multi-agent simulation of world wars. arXiv:2311.17227."},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1155\/2022\/6546913"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6311"},{"key":"e_1_3_1_32_2","unstructured":"M. Jin Q. Yu D. Shu C. Zhang L. Fan W. Hua S. Zhu Y. Meng Z. Wang M. Du and Y. Zhang. 2024. Health-LLM: Personalized retrieval-augmented disease prediction system. arXiv:2402.00746."},{"key":"e_1_3_1_33_2","unstructured":"D. Jurafsky and J. H. Martin. 2023. Speech and Language Processing: An Introduction to Natural Language Processing Computational Linguistics and Speech Recognition. Retrieved from https:\/\/web.stanford.edu\/jurafsky\/slp3\/ed3book_jan72023.pdf"},{"key":"e_1_3_1_34_2","unstructured":"R. Jurowetzki D. Hain J. Mateos-Garcia and K. Stathoulopoulos. 2021. The Privatization of AI Research(-ers): Causes and potential consequences \u2013 From university-industry interaction to public research brain-drain? arXiv:2102.01648. Retrieved from http:\/\/arxiv.org\/abs\/2102.01648"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData52589.2021.9671646"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISBI48211.2021.9434063"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.274"},{"key":"e_1_3_1_38_2","volume-title":"Content Analysis: An Introduction to Its Methodology","author":"Krippendorff K.","year":"2018","unstructured":"K. Krippendorff. 2018. Content Analysis: An Introduction to Its Methodology. SAGE Publications."},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000198"},{"key":"e_1_3_1_40_2","unstructured":"H. Le L. Vial J. Frej V. Segonne M. Coavoux B. Lecouteux A. Allauzen B. Crabb\u00e9 L. Besacier and D. Schwab. 2019. FlauBERT: Unsupervised language model pre-training for French. arXiv:1912.05372."},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3643829"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-020-05411-7"},{"key":"e_1_3_1_43_2","author":"Lin S.","year":"2024","unstructured":"S. Lin, W. Hua, L. Li, C. Chang, L. Fan, J. Ji, H. Hua, M. Jin, J. Luo, and Y. Zhang. 2024. BattleAgent: Multi-modal dynamic emulation on historical battles to complement historical analysis. arXiv:2404.15532.","journal-title":"BattleAgent: Multi-modal dynamic emulation on historical battles to complement historical analysis"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i17.17744"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1080\/27678490.2022.2153629"},{"key":"e_1_3_1_46_2","unstructured":"Y. Liu M. Ott N. Goyal J. Du M. Joshi D. Chen O. Levy M. Lewis L. Zettlemoyer and V. Stoyanov. 2019. RoBERTa: A robustly optimized BERT pretraining approach. arXiv:1907.11692."},{"key":"e_1_3_1_47_2","unstructured":"J. W. Maarten Bosma. 2021. Introducing FLAN: More generalizable language models with instruction fine-tuning. Retrieved from https:\/\/ai.googleblog.com\/2021\/10\/introducing-flan-more-generalizable.html"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1162\/daed_a_01905"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.21105\/joss.00861"},{"key":"e_1_3_1_50_2","unstructured":"A. I. Meta. 2023. Introducing LLaMA: A foundational 65-billion-parameter large language model. Retrieved from https:\/\/ai.facebook.com\/blog\/large-language-model-llama-meta-ai\/."},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.dravidianlangtech-1.31"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-demos.2"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.3390\/land11081259"},{"key":"e_1_3_1_54_2","unstructured":"Future of Life Institute. 2023. Pause giant AI experiments: An open letter. Retrieved from https:\/\/futureoflife.org\/open-letter\/pause-giant-ai-experiments\/"},{"key":"e_1_3_1_55_2","unstructured":"J. Okerlund E. Klasky E. Middha S. Kim H. Rosenfeld M. Kleinman and S. Parthasarathy. 2022. What's in the Chatterbox? Large Language Models Why They Matter and What We Should Do About Them. Technical Report. University of Michigan. Retrieved from https:\/\/stpp.fordschool.umich.edu\/sites\/stpp\/files\/2022-05\/large-language-models-TAP-2022-final-051622.pdf"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00167-023-07372-5"},{"key":"e_1_3_1_57_2","unstructured":"OpenAI. 2023. GPT-4 Technical Report. Technical Report. Retrieved from http:\/\/arxiv.org\/abs\/2303.08774"},{"key":"e_1_3_1_58_2","unstructured":"S. Pichai. 2023. An important next step on our AI journey. Retrieved from https:\/\/blog.google\/technology\/ai\/bard-google-ai-search-updates\/"},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1115\/1.4054203"},{"key":"e_1_3_1_60_2","unstructured":"A. Radford K. Narasimhan T. Salimans and I. Sutskever. 2018. Improving language understanding by generative pre-training. Retrieved from https:\/\/cdn.openai.com\/research-covers\/language-unsupervised\/language_understanding_paper.pdf"},{"key":"e_1_3_1_61_2","unstructured":"A. Radford J. Wu R. Child D. Luan D. Amodei and I. Sutskever. 2019. Language models are unsupervised multitask learners. Retrieved from https:\/\/d4mucfpksywv.cloudfront.net\/better-language-models\/language_models_are_unsupervised_multitask_learners.pdf"},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-021-00455-y"},{"key":"e_1_3_1_63_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1410"},{"key":"e_1_3_1_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411763.3451760"},{"key":"e_1_3_1_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigDataSecurity-HPSC-IDS49724.2020.00052"},{"key":"e_1_3_1_66_2","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-023-00816-5"},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/825"},{"key":"e_1_3_1_68_2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.230163"},{"key":"e_1_3_1_69_2","unstructured":"Y. Shen K. Song X. Tan D. Li W. Lu and Y. Zhuang. 2023c. HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in HuggingFace. arXiv:2303.17580. Retrieved from http:\/\/arxiv.org\/abs\/2303.17580"},{"issue":"1","key":"e_1_3_1_70_2","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.scijus.2022.10.005","article-title":"Mapping the Knowledge of Traffic Collision Reconstruction: A Scientometric Analysis in CiteSpace, VOSviewer, and SciMAT","volume":"63","author":"Shen Z.","year":"2023","unstructured":"Z. Shen, W. Ji, S. Yu, G. Cheng, Q. Yuan, Z. Han, H. Liu, and T. Yang. 2023b. Mapping the Knowledge of Traffic Collision Reconstruction: A Scientometric Analysis in CiteSpace, VOSviewer, and SciMAT. Science & Justice: Journal of the Forensic Science Society 63, 1 (2023), 19\u201337.","journal-title":"Science & Justice: Journal of the Forensic Science Society"},{"key":"e_1_3_1_71_2","unstructured":"M. Shoeybi M. Patwary R. Puri P. LeGresley J. Casper and B. Catanzaro. 2019. Megatron-LM: Training multi-billion parameter language models using model parallelism. arXiv:1909.08053. Retrieved from http:\/\/arxiv.org\/abs\/1909.08053"},{"key":"e_1_3_1_72_2","unstructured":"M. Steyvers. 2007. Probabilistic topic models. Retrieved from taylorfrancis.com. taylorfrancis.com. https:\/\/doi.org\/10.4324\/9780203936399-29\/probabilistic-topic-models-mark-steyvers-tom-griffiths"},{"key":"e_1_3_1_73_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICHI52183.2021.00055"},{"key":"e_1_3_1_74_2","unstructured":"R. Taori I. Gulrajani T. Zhang Y. Dubois X. Li C. Guestrin P. Liang and T. B. Hashimoto. 2023. Alpaca: A strong replicable instruction-following model. Retrieved from https:\/\/crfm.stanford.edu\/2023\/03\/13\/alpaca.html"},{"key":"e_1_3_1_75_2","unstructured":"R. Thoppilan D. De Freitas J. Hall N. Shazeer A. Kulshreshtha H. -T. Cheng A. Jin T. Bos L. Baker Y. Du Y. Li H. Lee H. S. Zheng A. Ghafouri M. Menegali Y. Huang M. Krikun D. Lepikhin J. Qin and Q. Le. 2022. LaMDA: Language models for dialog applications. arXiv:2201.08239. Retrieved from: http:\/\/arxiv.org\/abs\/2201.08239"},{"key":"e_1_3_1_76_2","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS\u201917)","volume":"30","author":"Vaswani A.","year":"2017","unstructured":"A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin. 2017. Attention is All You Need. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS\u201917), Vol. 30. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/7181-attention-is-all"},{"key":"e_1_3_1_77_2","unstructured":"J. Wei Y. Tay R. Bommasani C. Raffel B. Zoph S. Borgeaud D. Yogatama M. Bosma D. Zhou D. Metzler E. H. Chi T. Hashimoto O. Vinyals P. Liang J. Dean and W. Fedus. 2022. Emergent Abilities of Large Language Models. Transactions on Machine Learning Research. Retrieved from http:\/\/arxiv.org\/abs\/2206.07682"},{"key":"e_1_3_1_78_2","unstructured":"L. Weidinger J. Mellor M. Rauh C. Griffin J. Uesato P. S. Huang M. Cheng M. Glaese B. Balle A. Kasirzadeh Z. Kenton S. Brown W. Hawkins T. Stepleton C. Biles A. Birhane J. Haas L. Rimell L. A. Hendricks W. Isaac S. Legassick G. Irving and I. Gabriel. 2021. Ethical and social risks of harm from Language Models. arXiv:2112.04359. Retrieved from http:\/\/arxiv.org\/abs\/2112.04359"},{"key":"e_1_3_1_79_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jisa.2020.102722"},{"key":"e_1_3_1_80_2","doi-asserted-by":"publisher","unstructured":"D. U. Yang B. Kim S. H. Lee Y. H. Ahn and H. Y. Kim. 2022. AutoDefect: Defect Text Classification in Residential Buildings Using a Multi-task Channel Attention Network. Sustainable Cities and Society 80 (2022) 103803. DOI: 10.1016\/j.scs.2022.103803","DOI":"10.1016\/j.scs.2022.103803"},{"key":"e_1_3_1_81_2","unstructured":"Z. Yang Z. Dai Y. Yang J. Carbonell R. R. Salakhutdinov and Q. V. Le. 2019. XLNet: Generalized Autoregressive Pretraining for Language Understanding. In Proceedings of the 33rd International Conference on Neural Information Processing Systems (NIPS\u201919). Vol. 32. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2019\/hash\/dc6a7e655d7e5840e66733e9ee67cc69-Abstract.html"},{"key":"e_1_3_1_82_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12889-022-14783-5"},{"key":"e_1_3_1_83_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K19-1074"},{"key":"e_1_3_1_84_2","doi-asserted-by":"publisher","DOI":"10.1007\/s13042-010-0001-0"},{"key":"e_1_3_1_85_2","unstructured":"W. X. Zhao K. Zhou J. Li T. Tang X. Wang Y. Hou Y. Min B. Zhang J. Zhang Z. Dong Y. Du C. Yang Y. Chen Z. Chen J. Jiang R. Ren Y. Li X. Tang Z. Liu and J. -R. Wen. 2023. A Survey of Large Language Models. arXiv:2303.18223. Retrieved from http:\/\/arxiv.org\/abs\/2303.18223"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3664930","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3664930","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:03:47Z","timestamp":1750291427000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3664930"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,21]]},"references-count":84,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,10,31]]}},"alternative-id":["10.1145\/3664930"],"URL":"https:\/\/doi.org\/10.1145\/3664930","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,21]]},"assertion":[{"value":"2023-08-10","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-04-15","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-10-21","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}