{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T08:59:36Z","timestamp":1773392376690,"version":"3.50.1"},"reference-count":76,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2025,3,26]],"date-time":"2025-03-26T00:00:00Z","timestamp":1742947200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100004440","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["226044\/Z\/22\/Z"],"award-info":[{"award-number":["226044\/Z\/22\/Z"]}],"id":[{"id":"10.13039\/100004440","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>As climate change transforms our environment and human intrusion into natural ecosystems escalates, there is a growing demand for disease spread models to forecast and plan for the next zoonotic disease outbreak. Accurate parametrization of these models requires data from diverse sources, including the scientific literature. Despite the abundance of scientific publications, the manual extraction of these data via systematic literature reviews remains a significant bottleneck, requiring extensive time and resources, and is susceptible to human error. This study examines the application of a large language model (LLM) as an assessor for screening prioritisation in climate-sensitive zoonotic disease research. By framing the selection criteria of articles as a question\u2013answer task and utilising zero-shot chain-of-thought prompting, the proposed method achieves a saving of at least 70% work effort compared to manual screening at a recall level of 95% (NWSS@95%). This was validated across four datasets containing four distinct zoonotic diseases and a critical climate variable (rainfall). The approach additionally produces explainable AI rationales for each ranked article. The effectiveness of the approach across multiple diseases demonstrates the potential for broad application in systematic literature reviews. The substantial reduction in screening effort, along with the provision of explainable AI rationales, marks an important step toward automated parameter extraction from the scientific literature.<\/jats:p>","DOI":"10.3390\/make7020028","type":"journal-article","created":{"date-parts":[[2025,3,28]],"date-time":"2025-03-28T04:11:40Z","timestamp":1743135100000},"page":"28","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Accelerating Disease Model Parameter Extraction: An LLM-Based Ranking Approach to Select Initial Studies for Literature Review Automation"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-6053-6097","authenticated-orcid":false,"given":"Masood","family":"Sujau","sequence":"first","affiliation":[{"name":"School of Veterinary Science, Massey University, Palmerston North 4442, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1186-9364","authenticated-orcid":false,"given":"Masako","family":"Wada","sequence":"additional","affiliation":[{"name":"School of Veterinary Science, Massey University, Palmerston North 4442, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3145-5468","authenticated-orcid":false,"given":"Emilie","family":"Vall\u00e9e","sequence":"additional","affiliation":[{"name":"School of Veterinary Science, Massey University, Palmerston North 4442, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Natalie","family":"Hillis","sequence":"additional","affiliation":[{"name":"School of Veterinary Science, Massey University, Palmerston North 4442, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9416-1435","authenticated-orcid":false,"given":"Teo","family":"Su\u0161njak","sequence":"additional","affiliation":[{"name":"School of Mathematical and Computational Sciences, Massey University, Auckland 0632, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,3,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"e527","DOI":"10.1016\/S2542-5196(23)00056-6","article-title":"The Current Landscape of Software Tools for the Climate-Sensitive Infectious Disease Modelling Community","volume":"7","author":"Ryan","year":"2023","journal-title":"Lancet Planet. Health"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1124","DOI":"10.1038\/s41467-017-00923-8","article-title":"Global Hotspots and Correlates of Emerging Zoonotic Diseases","volume":"8","author":"Allen","year":"2017","journal-title":"Nat. Commun."},{"key":"ref_3","unstructured":"Grace, D., Mutua, F.K., Ochungo, P., Kruska, R.L., Jones, K., Brierley, L., Lapar, M.L., Said, M.Y., Herrero, M.T., and Phuc, P.M. (2012). Mapping of Poverty and Likely Zoonoses Hotspots, International Livestock Research Institute. Technical Report."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1098\/rsif.2007.1110","article-title":"Assessing the Risk of Bluetongue to UK Livestock: Uncertainty and Sensitivity Analyses of a Temperature-Dependent Model for the Basic Reproduction Number","volume":"5","author":"Gubbins","year":"2008","journal-title":"J. R. Soc. Interface"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1098\/rsif.2011.0255","article-title":"Modelling the Effects of Past and Future Climate on the Risk of Bluetongue Emergence in Europe","volume":"9","author":"Guis","year":"2011","journal-title":"J. R. Soc. Interface"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Dekkers, R., Carey, L.D., and Langhorne, P. (2023). Making Literature Reviews Work: A Multidisciplinary Guide to Systematic Approaches, Springer.","DOI":"10.1007\/978-3-030-90025-0"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Higgins, J.P.T., Thomas, J., Chandler, J., Cumpston, M., Li, T., Page, M.J., and Welch, V.A. (2019). Cochrane Handbook for Systematic Reviews of Interventions, Wiley-Blackwell. [2nd ed.].","DOI":"10.1002\/9781119536604"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2049","DOI":"10.1016\/j.infsof.2013.07.010","article-title":"A systematic review of systematic review process research in software engineering","volume":"55","author":"Kitchenham","year":"2013","journal-title":"Inf. Softw. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Tricco, A.C., Brehaut, J., Chen, M.H., and Moher, D. (2008). Following 411 Cochrane Protocols to Completion: A Retrospective Cohort Study. PLoS ONE, 3.","DOI":"10.1371\/journal.pone.0003684"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"100443","DOI":"10.1016\/j.conctc.2019.100443","article-title":"The Significant Cost of Systematic Reviews and Meta-Analyses: A Call for Greater Involvement of Machine Learning to Assess the Promise of Clinical Trials","volume":"16","author":"Michelson","year":"2019","journal-title":"Contemp. Clin. Trials Commun."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1057\/s41599-021-00903-w","article-title":"Growth Rates of Modern Science: A Latent Piecewise Growth Curve Approach to Model Publication Numbers from Established and New Literature Databases","volume":"8","author":"Bornmann","year":"2021","journal-title":"Humanit. Soc. Sci. Commun."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1186\/s13643-018-0856-9","article-title":"Time-to-Update of Systematic Reviews Relative to the Availability of New Evidence","volume":"7","author":"Bashir","year":"2018","journal-title":"Syst. Rev."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"8399","DOI":"10.1073\/pnas.1208059110","article-title":"Zoonosis Emergence Linked to Agricultural Intensification and Environmental Change","volume":"110","author":"Jones","year":"2013","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Shaheen, M.N.F. (2022). The Concept of One Health Applied to the Problem of Zoonotic Diseases. Rev. Med. Virol., 32.","DOI":"10.1002\/rmv.2326"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"990","DOI":"10.1038\/nature06536","article-title":"Global Trends in Emerging Infectious Diseases","volume":"451","author":"Jones","year":"2008","journal-title":"Nature"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Liao, H., Lyon, C.J., Ying, B., and Hu, T. (2025). Climate Change, Its Impact on Emerging Infectious Diseases and New Technologies to Combat the Challenge. Emerg. Microbes Infect., 13.","DOI":"10.1080\/22221751.2024.2356143"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1186\/s40249-023-01102-2","article-title":"Climate Change and Infectious Disease: A Review of Evidence and Research Trends","volume":"12","author":"Escobar","year":"2023","journal-title":"Infect. Dis. Poverty"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"514","DOI":"10.1126\/science.1239401","article-title":"Climate Change and Infectious Diseases: From Evidence to a Predictive Framework","volume":"341","author":"Altizer","year":"2013","journal-title":"Science"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Clark, J., McFarlane, C., Cleo, G., Ishikawa Ramos, C., and Marshall, S. (2021). The Impact of Systematic Review Automation Tools on Methodological Quality and Time Taken to Complete Systematic Review Tasks: Case Study. JMIR Med. Educ., 7.","DOI":"10.2196\/24418"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1016\/j.jclinepi.2020.11.003","article-title":"Machine Learning Reduced Workload with Minimal Risk of Missing Studies: Development and Evaluation of a Randomized Controlled Trial Classifier for Cochrane Reviews","volume":"133","author":"Thomas","year":"2021","journal-title":"J. Clin. Epidemiol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1186\/2046-4053-3-74","article-title":"Systematic Review Automation Technologies","volume":"3","author":"Tsafnat","year":"2014","journal-title":"Syst. Rev."},{"key":"ref_22","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. Proceedings of the Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Santos, \u00c1.O.D., Da Silva, E.S., Couto, L.M., Reis, G.V.L., and Belo, V.S. (2023). The Use of Artificial Intelligence for Automating or Semi-Automating Biomedical Literature Analyses: A Scoping Review. J. Biomed. Inform., 142.","DOI":"10.1016\/j.jbi.2023.104389"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1007\/s10462-024-10902-3","article-title":"Artificial Intelligence for Literature Reviews: Opportunities and Challenges","volume":"57","author":"Bolanos","year":"2024","journal-title":"Artif. Intell. Rev."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Guo, E., Gupta, M., Deng, J., Park, Y.J., Paget, M., and Naugler, C. (2024). Automated Paper Screening for Clinical Reviews Using Large Language Models: Data Analysis Study. J. Med. Internet Res., 26.","DOI":"10.2196\/48996"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Issaiy, M., Ghanaati, H., Kolahi, S., Shakiba, M., Jalali, A., Zarei, D., Kazemian, S., Avanaki, M., and Firouznia, K. (2024). Methodological Insights into ChatGPT\u2019s Screening Performance in Systematic Reviews. BMC Med. Res. Methodol., 24.","DOI":"10.1186\/s12874-024-02203-8"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Cao, C., Sang, J., Arora, R., Kloosterman, R., Cecere, M., Gorla, J., Saleh, R., Chen, D., Drennan, I., and Teja, B. (2024). Prompting Is All You Need: LLMs for Systematic Review Screening. medRxiv.","DOI":"10.1101\/2024.06.01.24308323"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Alshami, A., Elsayed, M., Ali, E., Eltoukhy, A.E.E., and Zayed, T. (2023). Harnessing the Power of ChatGPT for Automating Systematic Review Process: Methodology, Case Study, Limitations, and Future Directions. Systems, 11.","DOI":"10.3390\/systems11070351"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Fernandes Torres, J.P., Mulligan, C., Jorge, J., and Moreira, C. (2024). PROMPTHEUS: A Human-Centered Pipeline to Streamline Slrs with Llms. arXiv.","DOI":"10.21203\/rs.3.rs-5304624\/v1"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"401","DOI":"10.12688\/f1000research.51117.2","article-title":"Data Extraction Methods for Systematic Review (Semi)Automation: Update of a Living Systematic Review","volume":"10","author":"Schmidt","year":"2023","journal-title":"F1000Research"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1569","DOI":"10.1038\/s41467-024-45914-8","article-title":"Extracting Accurate Materials Data from Research Papers with Conversational Language Models and Prompt Engineering","volume":"15","author":"Polak","year":"2024","journal-title":"Nat. Commun."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Nicholson Thomas, I., Roche, P., and Gr\u00eat-Regamey, A. (2024). Harnessing Artificial Intelligence for Efficient Systematic Reviews: A Case Study in Ecosystem Condition Indicators. Ecol. Inform., 83.","DOI":"10.1016\/j.ecoinf.2024.102819"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Susnjak, T., Hwang, P., Reyes, N.H., Barczak, A.L.C., McIntosh, T.R., and Ranathunga, S. (2024). Automating Research Synthesis with Domain-Specific Large Language Model Fine-Tuning. arXiv.","DOI":"10.1145\/3715964"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Ji, Z., Yu, T., Xu, Y., Lee, N., Ishii, E., and Fung, P. (2023). Towards Mitigating Hallucination in Large Language Models via Self-Reflection. arXiv.","DOI":"10.18653\/v1\/2023.findings-emnlp.123"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"e12","DOI":"10.1016\/S2589-7500(23)00225-X","article-title":"Assessing the Potential of GPT-4 to Perpetuate Racial and Gender Biases in Health Care: A Model Evaluation Study","volume":"6","author":"Zack","year":"2024","journal-title":"Lancet Digit. Health"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"20:1","DOI":"10.1145\/3639372","article-title":"Explainability for Large Language Models: A Survey","volume":"15","author":"Zhao","year":"2024","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"39:1","DOI":"10.1145\/3641289","article-title":"A Survey on Evaluation of Large Language Models","volume":"15","author":"Chang","year":"2024","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_38","first-page":"24824","article-title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","volume":"Volume 35","author":"Wei","year":"2022","journal-title":"Advances in Neural Information Processing Systems 35 (NeurIPS 2022)"},{"key":"ref_39","first-page":"9459","article-title":"Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks","volume":"Volume 33","author":"Lewis","year":"2020","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.jclinepi.2021.06.030","article-title":"Systematic Review Automation Tools Improve Efficiency but Lack of Knowledge Impedes Their Adoption: A Survey","volume":"138","author":"Scott","year":"2021","journal-title":"J. Clin. Epidemiol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1002\/jrsm.1354","article-title":"Best Practice Guidelines for Abstract Screening Large-Evidence Systematic Reviews and Meta-Analyses","volume":"10","author":"Polanin","year":"2019","journal-title":"Res. Synth. Methods"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1002\/jrsm.42","article-title":"Precision of Healthcare Systematic Review Searches in a Cross-sectional Sample","volume":"2","author":"Sampson","year":"2011","journal-title":"Res. Synth. Methods"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Wang, S., Scells, H., Koopman, B., and Zuccon, G. (2022, January 15\u201316). Neural Rankers for Effective Screening Prioritisation in Medical Systematic Review Literature Search. Proceedings of the26th Australasian Document Computing Symposium, ADCS\u201922, Adelaide, SA, Australia.","DOI":"10.1145\/3572960.3572980"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Mitrov, G., Stanoev, B., Gievska, S., Mirceva, G., and Zdravevski, E. (2024). Combining Semantic Matching, Word Embeddings, Transformers, and LLMs for Enhanced Document Ranking: Application in Systematic Reviews. Big Data Cogn. Comput., 8.","DOI":"10.3390\/bdcc8090110"},{"key":"ref_45","unstructured":"Mao, X., Zhuang, S., Koopman, B., and Zuccon, G. (July, January 14\u2013). Dense Retrieval with Continuous Explicit Feedback for Systematic Review Screening Prioritisation. Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, Washington, DC, USA."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1561\/1500000019","article-title":"The Probabilistic Relevance Framework: BM25 and Beyond","volume":"3","author":"Robertson","year":"2009","journal-title":"Found. Trends\u00ae Inf. Retr."},{"key":"ref_47","unstructured":"Yang, E., MacAvaney, S., Lewis, D.D., and Frieder, O. Goldilocks: Just-Right Tuning of BERT for Technology-Assisted Review. Proceedings of the Advances in Information Retrieval."},{"key":"ref_48","unstructured":"Burstein, J., Doran, C., and Solorio, T. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Association for Computational Linguistics."},{"key":"ref_49","unstructured":"Radford, A., Narasimhan, K., Salimans, T., and Sutskever, I. (2018). Improving language understanding by generative pre-training. OpenAI Tech Report, OpenAI Research."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1007\/s11280-024-01291-2","article-title":"A Survey on Large Language Models for Recommendation","volume":"27","author":"Wu","year":"2024","journal-title":"World Wide Web"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1136\/bmjebm-2023-112678","article-title":"Enhancing Title and Abstract Screening for Systematic Reviews with GPT-3.5 Turbo","volume":"29","author":"Mahmoudi","year":"2024","journal-title":"BMJ Evid.-Based Med."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Matsui, K., Utsumi, T., Aoki, Y., Maruki, T., Takeshima, M., and Takaesu, Y. (2024). Human-Comparable Sensitivity of Large Language Models in Identifying Eligible Studies Through Title and Abstract Screening: 3-Layer Strategy Using GPT-3.5 and GPT-4 for Systematic Reviews. J. Med. Internet Res., 26.","DOI":"10.2196\/52758"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Sanghera, R., Thirunavukarasu, A.J., Khoury, M.E., O\u2019Logbon, J., Chen, Y., Watt, A., Mahmood, M., Butt, H., Nishimura, G., and Soltan, A. (2024). High-Performance Automated Abstract Screening with Large Language Model Ensembles. arXiv.","DOI":"10.1093\/jamia\/ocaf050"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Wang, S., Scells, H., Koopman, B., Potthast, M., and Zuccon, G. (2023, January 26\u201328). Generating Natural Language Queries for More Effective Systematic Review Screening Prioritisation. Proceedings of the SIGIR-AP 2023\u2014Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region, Beijing, China.","DOI":"10.1145\/3624918.3625322"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1939","DOI":"10.1093\/jamia\/ocae166","article-title":"A Question-Answering Framework for Automated Abstract Screening Using Large Language Models","volume":"31","author":"Akinseloyin","year":"2024","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_56","first-page":"23468","article-title":"CSMeD: Bridging the Dataset Gap in Automated Citation Screening for Systematic Literature Reviews","volume":"36","author":"Kusa","year":"2023","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_57","unstructured":"Goharian, N., Tonellotto, N., He, Y., Lipani, A., McDonald, G., Macdonald, C., and Ounis, I. Large Language Models Are Zero-Shot Rankers for Recommender Systems. Proceedings of the Advances in Information Retrieval."},{"key":"ref_58","unstructured":"Duh, K., Gomez, H., and Bethard, S. (2024). Beyond Yes and No: Improving Zero-Shot LLM Rankers via Scoring Fine-Grained Relevance Labels. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers), Association for Computational Linguistics."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Faggioli, G., Dietz, L., Clarke, C.L.A., Demartini, G., Hagen, M., Hauff, C., Kando, N., Kanoulas, E., Potthast, M., and Stein, B. (2023, January 23). Perspectives on Large Language Models for Relevance Judgment. Proceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR \u201923, Taipei, Taiwan.","DOI":"10.1145\/3578337.3605136"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Thomas, P., Spielman, S., Craswell, N., and Mitra, B. (2024, January 14\u201318). Large Language Models Can Accurately Predict Searcher Preferences. Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR \u201924, Washington, DC, USA.","DOI":"10.1145\/3626772.3657707"},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Syriani, E., David, I., and Kumar, G. (2024). Screening Articles for Systematic Reviews with ChatGPT. J. Comput. Lang., 80.","DOI":"10.1016\/j.cola.2024.101287"},{"key":"ref_62","unstructured":"Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., and Askell, A. (2020). Language Models Are Few-Shot Learners. arXiv."},{"key":"ref_63","first-page":"2:1","article-title":"Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing","volume":"3","author":"Gu","year":"2021","journal-title":"ACM Trans. Comput. Healthc."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Huotala, A., Kuutila, M., Ralph, P., and M\u00e4ntyl\u00e4, M. (2024, January 18\u201321). The Promise and Challenges of Using LLMs to Accelerate the Screening Process of Systematic Reviews. Proceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering, EASE \u201924, Salerno, Italy.","DOI":"10.1145\/3661167.3661172"},{"key":"ref_65","unstructured":"Kojima, T., Gu, S.S., Reid, M., Matsuo, Y., and Iwasawa, Y. (December, January 28). Large Language Models Are Zero-Shot Reasoners. Proceedings of the 36th International Conference on Neural Information Processing Systems, NIPS \u201922, New Orleans, LA, USA."},{"key":"ref_66","unstructured":"Al-Onaizan, Y., Bansal, M., and Chen, Y.N. Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024."},{"key":"ref_67","unstructured":"Liu, D., Nassereldine, A., Yang, Z., Xu, C., Hu, Y., Li, J., Kumar, U., Lee, C., Qin, R., and Shi, Y. (2024). Large Language Models Have Intrinsic Self-Correction Ability. arXiv."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Spillias, S., Tuohy, P., Andreotta, M., Annand-Jones, R., Boschetti, F., Cvitanovic, C., Duggan, J., Fulton, E., Karcher, D., and Paris, C. (2024). Human-AI Collaboration to Identify Literature for Evidence Synthesis. Cell Rep. Sustain., 1.","DOI":"10.1016\/j.crsus.2024.100132"},{"key":"ref_69","unstructured":"Wang, W., Wei, F., Dong, L., Bao, H., Yang, N., and Zhou, M. (2020). MINILM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers. Advances in Neural Information Processing Systems 33 (NeurIPS 2020), Neural Information Processing Systems Foundation, Inc. (NeurIPS)."},{"key":"ref_70","unstructured":"(2024, December 29). SentenceTransformers Documentation\u2014Sentence Transformers Documentation. Available online: https:\/\/www.sbert.net\/."},{"key":"ref_71","unstructured":"(2024, December 26). OpenAI Platform. Available online: https:\/\/platform.openai.com."},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Manning, C.D., Raghavan, P., and Sch\u00fctze, H. (2008). Introduction to Information Retrieval, Cambridge University Press.","DOI":"10.1017\/CBO9780511809071"},{"key":"ref_73","doi-asserted-by":"crossref","unstructured":"Kusa, W., Lipani, A., Knoth, P., and Hanbury, A. (2023). An Analysis of Work Saved over Sampling in the Evaluation of Automated Citation Screening in Systematic Literature Reviews. Intell. Syst. Appl., 18.","DOI":"10.1016\/j.iswa.2023.200193"},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"1425","DOI":"10.1093\/jamia\/ocac066","article-title":"Automated Medical Literature Screening Using Artificial Intelligence: A Systematic Review and Meta-Analysis","volume":"29","author":"Feng","year":"2022","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_75","unstructured":"Kanoulas, E., Li, D., Azzopardi, L., and Spijker, R. (2017, January 11\u201314). CLEF 2017 Technologically Assisted Reviews in Empirical Medicine Overview. Proceedings of the 8th International Conference of the CLEF Association, CLEF 2017, Dublin, Ireland."},{"key":"ref_76","doi-asserted-by":"crossref","unstructured":"Linzbach, S., Tressel, T., Kallmeyer, L., Dietze, S., and Jabeen, H. (2023\u20134, January 30). Decoding Prompt Syntax: Analysing Its Impact on Knowledge Retrieval in Large Language Models. Proceedings of the Companion Proceedings of the ACM Web Conference 2023, WWW \u201923 Companion, Austin, TX, USA.","DOI":"10.1145\/3543873.3587655"}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/7\/2\/28\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:02:36Z","timestamp":1760029356000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/7\/2\/28"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,26]]},"references-count":76,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,6]]}},"alternative-id":["make7020028"],"URL":"https:\/\/doi.org\/10.3390\/make7020028","relation":{},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,26]]}}}