{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,31]],"date-time":"2026-01-31T06:15:28Z","timestamp":1769840128384,"version":"3.49.0"},"reference-count":85,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2025,12,22]],"date-time":"2025-12-22T00:00:00Z","timestamp":1766361600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>This study investigates whether incorporating highlighted information in discharge notes improves the quality of the summaries generated by Large Language Models (LLMs). Specifically, it evaluates the effect of using highlighted versus unhighlighted inputs for fine-tuning LLaMA2-13B model for summarization tasks. We fine-tuned LlaMA2-13B in two variants using MIMIC-IV-Ext-BHC dataset: one variant fine-tuned with the highlighted discharge notes (H-LLaMA), and the other on the same set of notes without highlighting (U-LLaMA). Highlighting was performed automatically using a Cardiology Interface Terminology (CIT) presented in our previous work. H-LLaMA and U-LLaMA were evaluated on a randomly selected test set of 100 discharge notes using multiple metrics (including BERTScore, ROUGE-L, BLEU, and SummaC_CONV). Additionally, LLM-based judgment via ChatGPT-4o rated coherence, fluency, conciseness, and correctness, alongside a manual completeness evaluation on a random sample of 40 notes. H-LLaMA consistently outperformed U-LLaMA across all metrics. H-summaries, generated using H-LLaMA, in comparison to U-summaries, generated using U-LLaMA, achieved higher BERTScore (63.75 vs. 59.61), ROUGE-L (23.43 vs. 21.82), BLEU (10.4 vs. 8.41), and SummaC_CONV (67.7 vs. 40.2). Manual review also showed improved completeness for H-summaries (54.8% vs. 47.6%). All improvements were statistically significant (p &lt; 0.05). Moreover, LLM-based evaluation indicated higher average ratings across coherence, correctness, and conciseness.<\/jats:p>","DOI":"10.3390\/bdcc10010004","type":"journal-article","created":{"date-parts":[[2025,12,22]],"date-time":"2025-12-22T16:19:26Z","timestamp":1766420366000},"page":"4","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Fine-Tuning LLaMA2 for Summarizing Discharge Notes: Evaluating the Role of Highlighted Information"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3489-0892","authenticated-orcid":false,"given":"Mahshad","family":"Koohi Habibi Dehkordi","sequence":"first","affiliation":[{"name":"Department of Computer Science, Ying Wu College of Computing, New Jersey Institute of Technology, Newark, NJ 07102, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yehoshua","family":"Perl","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Ying Wu College of Computing, New Jersey Institute of Technology, Newark, NJ 07102, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fadi P.","family":"Deek","sequence":"additional","affiliation":[{"name":"Department of Informatics, Ying Wu College of Computing, New Jersey Institute of Technology, Newark, NJ 07102, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1975-1272","authenticated-orcid":false,"given":"Hao","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Montclair State University, Montclair, NJ 07043, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,12,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"47","DOI":"10.2147\/RMHP.S12985","article-title":"Benefits and drawbacks of electronic health record systems","volume":"4","author":"Menachemi","year":"2011","journal-title":"Risk Manag. Healthc. Policy"},{"key":"ref_2","unstructured":"Madzime, R., and Nyirenda, C. (2024). Enhanced Electronic Health Records Text Summarization Using Large Language Models. arXiv."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zhou, S., Liu, H., Sen, P., Perl, Y., and Dehkordi, M.K. (2025, January 19\u201321). CFC annotator: A cluster-focused combination algorithm for annotating electronic health records by referencing interface terminology. Proceedings of the 18th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2025), Porto, Portugal.","DOI":"10.5220\/0013244500003911"},{"key":"ref_4","unstructured":"Bowman, S. (2013). Impact of electronic health record systems on information integrity: Quality and safety implications. Perspect. Health Inf. Manag., 10."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1007\/s11606-009-1195-2","article-title":"Are electronic medical records helpful for care coordination? Experiences of physician practices","volume":"25","author":"Grossman","year":"2010","journal-title":"J. Gen. Intern. Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"674","DOI":"10.1111\/1475-6773.14097","article-title":"Documentation dynamics: Note composition, burden, and physician efficiency","volume":"58","author":"Apathy","year":"2023","journal-title":"Health Serv. Res."},{"key":"ref_7","unstructured":"Zhao, W.X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., and Dong, Z. (2023). A survey of large language models. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1930","DOI":"10.1038\/s41591-023-02448-8","article-title":"Large language models in medicine","volume":"29","author":"Thirunavukarasu","year":"2023","journal-title":"Nat. Med."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Hadi, M.U., Qureshi, R., Shah, A., Irfan, M., Zafar, A., Shaikh, M.B., Akhtar, N., Wu, J., and Mirjalili, S. (2023). A survey on large language models: Applications, challenges, limitations, and practical usage. Authorea Prepr.","DOI":"10.36227\/techrxiv.23589741.v1"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kwag, K.H., Gonz\u00e1lez-Lorenzo, M., Banzi, R., Bonovas, S., and Moja, L. (2016). Providing doctors with high-quality information: An updated evaluation of web-based point-of-care information summaries. J. Med. Internet Res., 18.","DOI":"10.2196\/jmir.5234"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"38889","DOI":"10.1109\/ACCESS.2025.3546700","article-title":"Finetuning large language models for vulnerability detection","volume":"13","author":"Shestov","year":"2025","journal-title":"IEEE Access"},{"key":"ref_12","unstructured":"Rallapalli, S., Gallagher, S., Mellinger, A.O., Ratchford, J., Sinha, A., Brooks, T., Nichols, W.R., Winski, N., and Brown, B. (2025). Fine-Tuning LLMs for Report Summarization: Analysis on Supervised and Unsupervised Data. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"938","DOI":"10.1093\/jamia\/ocv032","article-title":"Automated methods for the summarization of electronic health records","volume":"22","author":"Pivovarov","year":"2015","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1136\/bmjqs-2015-005201","article-title":"Opportunities to improve clinical summaries for patients at hospital discharge","volume":"26","author":"Sarzynski","year":"2017","journal-title":"BMJ Qual. Saf."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1146\/annurev-publhealth-032315-021353","article-title":"Using electronic health records for population health research: A review of methods and applications","volume":"37","author":"Casey","year":"2016","journal-title":"Annu. Rev. Public Health"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wu, X.-K., Chen, M., Li, W., Wang, R., Lu, L., Liu, J., Hwang, K., Hao, Y., Pan, Y., and Meng, Q. (2025). LLM Fine-Tuning: Concepts, Opportunities, and Challenges. Big Data Cogn. Comput., 9.","DOI":"10.3390\/bdcc9040087"},{"key":"ref_17","unstructured":"Hu, M., He, B., Wang, Y., Li, L., Ma, C., and King, I. (2024). Mitigating large language model hallucination with faithful finetuning. arXiv."},{"key":"ref_18","unstructured":"Rumiantsau, M., Vertsel, A., Hrytsuk, I., and Ballah, I. (2024). Beyond Fine-Tuning: Effective Strategies for Mitigating Hallucinations in Large Language Models for Data Analytics. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liu, C., Sun, K., Zhou, Q., Duan, Y., Shu, J., Kan, H., Gu, Z., and Hu, J. (2024). CPMI-ChatGLM: Parameter-efficient fine-tuning ChatGLM with Chinese patent medicine instructions. Sci. Rep., 14.","DOI":"10.1038\/s41598-024-56874-w"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hamzah, F., and Sulaiman, N. (2025, July 01). Optimizing Llama 7B for Medical Question Answering: A Study on Fine-Tuning Strategies and Performance on the MultiMedQA Dataset. Available online: https:\/\/osf.io\/preprints\/osf\/g5aes_v1.","DOI":"10.31219\/osf.io\/g5aes"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Li, I., Pan, J., Goldwasser, J., Verma, N., Wong, W.P., Nuzumlal\u0131, M.Y., Rosand, B., Li, Y., Zhang, M., and Chang, D. (2022). Neural natural language processing for unstructured data in electronic health records: A review. Comput. Sci. Rev., 46.","DOI":"10.1016\/j.cosrev.2022.100511"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Perkovi\u0107, G., Drobnjak, A., and Boti\u010dki, I. (2024, January 20\u201324). Hallucinations in llms: Understanding and addressing challenges. Proceedings of the 2024 47th MIPRO ICT and Electronics Convention (MIPRO), Opatija, Croatia.","DOI":"10.1109\/MIPRO60963.2024.10569238"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Jha, S., Jha, S.K., Lincoln, P., Bastian, N.D., Velasquez, A., and Neema, S. (2023, January 6\u20138). Dehallucinating large language models using formal methods guided iterative prompting. Proceedings of the 2023 IEEE International Conference on Assured Autonomy (ICAA), Laurel, MD, USA.","DOI":"10.1109\/ICAA58325.2023.00029"},{"key":"ref_24","unstructured":"Parthasarathy, V.B., Zafar, A., Khan, A., and Shahid, A. (2024). The ultimate guide to fine-tuning llms from basics to breakthroughs: An exhaustive review of technologies, research, best practices, applied research challenges and opportunities. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ahmad, P.N., Liu, Y., Khan, K., Jiang, T., and Burhan, U. (2023). BIR: Biomedical Information Retrieval System for Cancer Treatment in Electronic Health Record Using Transformers. Sensors, 23.","DOI":"10.3390\/s23239355"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1055\/s-0043-1768732","article-title":"Enriching real-world data with social determinants of health for health outcomes and health equity: Successes, challenges, and opportunities","volume":"32","author":"He","year":"2023","journal-title":"Yearb. Med. Inform."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Majdik, Z.P., Graham, S.S., Shiva Edward, J.C., Rodriguez, S.N., Karnes, M.S., Jensen, J.T., Barbour, J.B., and Rousseau, J.F. (2024). Sample Size Considerations for Fine-Tuning Large Language Models for Named Entity Recognition Tasks: Methodological Study. JMIR AI, 3.","DOI":"10.2196\/52095"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Aali, A., Van Veen, D., Arefeen, Y.I., Hom, J., Bluethgen, C., Reis, E.P., Gatidis, S., Clifford, N., Daws, J., and Tehrani, A.S. (2024). A dataset and benchmark for hospital course summarization with adapted large language models. J. Am. Med. Inform. Assoc., 32.","DOI":"10.1093\/jamia\/ocae312"},{"key":"ref_29","unstructured":"Aali, A., Van Veen, D., Arefeen, Y.I., Hom, J., Bluethgen, C., Reis, E.P., Gatidis, S., Clifford, N., Daws, J., and Tehrani, A.S. (2025, July 01). MIMIC-IV-Ext-BHC: Labeled Clinical Notes Dataset for Hospital Course Summarization. Available online: https:\/\/physionet.org\/content\/labelled-notes-hospital-course\/1.1.0\/."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Du, X., Zhou, Z., Wang, Y., Chuang, Y.-W., Yang, R., Zhang, W., Wang, X., Zhang, R., Hong, P., and Bates, D.W. (2024). Generative large language models in electronic health records for patient care since 2023: A systematic review. medRxiv.","DOI":"10.1101\/2024.08.11.24311828"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Acharya, A., Shrestha, S., Chen, A., Conte, J., Avramovic, S., Sikdar, S., Anastasopoulos, A., and Das, S. (2024). Clinical risk prediction using language models: Benefits and considerations. J. Am. Med. Inform. Assoc., 31.","DOI":"10.1093\/jamia\/ocae030"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Koohi Habibi Dehkordi, M., Perl, Y., Deek, F.P., He, Z., Keloth, V.K., Liu, H., Elhanan, G., and Einstein, A.J. (2025). Improving Large Language Models\u2019 Summarization Accuracy by Adding Highlights to Discharge Notes: Comparative Evaluation. JMIR Med. Inform., 13.","DOI":"10.2196\/66476"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Dehkordi, M.K.H., Einstein, A.J., Zhou, S., Elhanan, G., Perl, Y., Keloth, V.K., Geller, J., and Liu, H. (2023, January 5\u20138). Using annotation for computerized support for fast skimming of cardiology electronic health record notes. Proceedings of the 2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Istanbul, Turkey.","DOI":"10.1109\/BIBM58861.2023.10385289"},{"key":"ref_34","unstructured":"Dehkordi, M.K.H., Kollapally, N.M., Perl, Y., Geller, J., Deek, F.P., Liu, H., Keloth, V.K., Elhanan, G., and Einstein, A.J. (2024, January 21\u201323). Skimming of Electronic Health Records Highlighted by an Interface Terminology Curated with Machine Learning Mining. Proceedings of the 17th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2024), Rome, Italy."},{"key":"ref_35","unstructured":"Dehkordi, M.K., Kollapally, N.M., Perl, Y., Geller, J., Deek, F.P., Liu, H., Keloth, V.K., Elhanan, G., and Einstein, A.J. (2024, January 21\u201323). Curation of a Cardiology Interface Terminology for Highlighting Electronic Health Records using Machine Learning. Proceedings of the 17th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2024), Rome, Italy."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Ahmed, I., Islam, S., Datta, P.P., Kabir, I., Chowdhury, N.U.R., and Haque, A. (2025). Qwen 2.5: A comprehensive review of the leading resource-efficient llm with potentioal to surpass all competitors. TechRxiv.","DOI":"10.36227\/techrxiv.174060306.65738406\/v1"},{"key":"ref_37","unstructured":"Jin, H., Zhang, Y., Meng, D., Wang, J., and Tan, J. (2024). A comprehensive survey on process-oriented automatic text summarization with exploration of llm-based methods. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zhong, M., Liu, P., Chen, Y., Wang, D., Qiu, X., and Huang, X. (2020). Extractive summarization as text matching. arXiv.","DOI":"10.18653\/v1\/2020.acl-main.552"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.eswa.2018.12.011","article-title":"Abstractive summarization: An overview of the state of the art","volume":"121","author":"Gupta","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1134","DOI":"10.1038\/s41591-024-02855-5","article-title":"Adapted large language models can outperform medical experts in clinical text summarization","volume":"30","author":"Blankemeier","year":"2024","journal-title":"Nat. Med."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"4163","DOI":"10.1109\/TAI.2024.3364586","article-title":"An Iterative Optimizing Framework for Radiology Report Summarization with ChatGPT","volume":"5","author":"Ma","year":"2024","journal-title":"IEEE Trans. Artif. Intell."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1370\/afm.3075","article-title":"Quality, Accuracy, and Bias in ChatGPT-Based Summarization of Medical Abstracts","volume":"22","author":"Hake","year":"2024","journal-title":"Ann. Fam. Med."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., and Funtowicz, M. (2019). Huggingface\u2019s transformers: State-of-the-art natural language processing. arXiv.","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Luo, Z. (2023, January 23\u201325). Knowledge-guided aspect-based summarization. Proceedings of the 2023 International conference on communications, computing and artificial intelligence (CCCAI), Shanghai, China.","DOI":"10.1109\/CCCAI59026.2023.00012"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1007\/s40747-023-01170-9","article-title":"Cross-modal knowledge guided model for abstractive summarization","volume":"10","author":"Wang","year":"2024","journal-title":"Complex Intell. Syst."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ming, S., Guo, Y., and Kilicoglu, H. (2025, January 3\u20134). Towards Knowledge-Guided Biomedical Lay Summarization using Large Language Models. Proceedings of the Second Workshop on Patient-Oriented Language Processing (CL4Health), Albuquerque, NM, USA.","DOI":"10.18653\/v1\/2025.cl4health-1.24"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Li, C.-Y., Chun, S.A., and Geller, J. (2025). Perspective-Based Microblog Summarization. Information, 16.","DOI":"10.20944\/preprints202502.1889.v1"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"D267","DOI":"10.1093\/nar\/gkh061","article-title":"The unified medical language system (UMLS): Integrating biomedical terminology","volume":"32","author":"Bodenreider","year":"2004","journal-title":"Nucleic Acids Res."},{"key":"ref_49","unstructured":"Donnelly, K. (2006). SNOMED-CT: The advanced terminology and coding system for eHealth. Stud. Health Technol. Inf., 121."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Johnson, A.E., Bulgarelli, L., Shen, L., Gayles, A., Shammout, A., Horng, S., Pollard, T.J., Hao, S., Moody, B., and Gow, B. (2023). MIMIC-IV, a freely accessible electronic health record dataset. Sci. Data, 10.","DOI":"10.1038\/s41597-022-01899-x"},{"key":"ref_51","unstructured":"Johnson, A., Bulgarelli, L., Pollard, T., Horng, S., Celi, L.A., and Mark, R. (2021, August 23). Mimic-iv. PhysioNet. Available online: https:\/\/physionet.org\/content\/mimiciv\/1.0\/."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1148","DOI":"10.1378\/chest.15-0706","article-title":"Institutional review boards: Purpose and challenges","volume":"148","author":"Grady","year":"2015","journal-title":"Chest"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Dehkordi, M.K.H., Zhou, S., Perl, Y., Deek, F.P., Einstein, A.J., Elhanan, G., He, Z., and Liu, H. (2024, January 3\u20136). Enhancing patient Comprehension: An effective sequential prompting approach to simplifying EHRs using LLMs. Proceedings of the 2024 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Lisbon, Portugal.","DOI":"10.1109\/BIBM62325.2024.10822313"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Kollapally, N.M., Dehkordi, M.K.H., Perl, Y., Geller, J., Deek, F.P., Liu, H., Keloth, V.K., Elhanan, G., Einstein, A.J., and Zhou, S. (2024, January 3\u20136). Using clinical entity recognition for curating an interface terminology to aid fast skimming of EHRs. Proceedings of the 2024 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Lisbon, Portugal.","DOI":"10.1109\/BIBM62325.2024.10822845"},{"key":"ref_55","unstructured":"Dehkordi, M.K.H., Lu, J., Perl, Y., and Deek, F.P. (2024, January 15\u201318). Enhancing Patient Comprehension of Discharge Notes with a Retrieval-Augmented LLM Approach. Proceedings of the 2025 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Wuhan, China."},{"key":"ref_56","unstructured":"Dehkordi, M.K.H., Perl, Y., and Deek, F.P. (2024, January 15\u201318). Optimizing Manual Review Using Machine Learning in Interface Terminology Curation for Automatic EHR Highlighting. Proceedings of the 2025 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Wuhan, China."},{"key":"ref_57","unstructured":"(2025, December 17). SNOMED International Homepage. Available online: http:\/\/www.snomed.org\/."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Alsentzer, E., Murphy, J.R., Boag, W., Weng, W.-H., Jin, D., Naumann, T., and McDermott, M. (2019). Publicly available clinical BERT embeddings. arXiv.","DOI":"10.18653\/v1\/W19-1909"},{"key":"ref_59","unstructured":"Liashchynskyi, P., and Liashchynskyi, P. (2019). Grid search, random search, genetic algorithm: A big comparison for NAS. arXiv."},{"key":"ref_60","unstructured":"Agarap, A.F. (2018). Deep learning using rectified linear units (relu). arXiv."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"41","DOI":"10.17977\/um018v2i12019p41-46","article-title":"Adam optimization algorithm for wide and deep neural network","volume":"2","author":"Jais","year":"2019","journal-title":"Knowl. Eng. Data Sci."},{"key":"ref_62","unstructured":"Zhou, S., Dehkordi, M.K.H., Perl, Y., Deek, F.P., and Liu, H. (2025). Enhancing Electronic Health Records Annotation with a Cluster-Focused Combination Algorithm and Interface Terminologies. Springer Book of HEALTHINF, Proceedings of the 18th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2025), Porto, Portugal, 20\u201322 February 2025, Springer Nature."},{"key":"ref_63","unstructured":"Han, Z., Gao, C., Liu, J., Zhang, J., and Zhang, S.Q. (2024). Parameter-efficient fine-tuning for large models: A comprehensive survey. arXiv."},{"key":"ref_64","unstructured":"Hu, E.J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., and Chen, W. (2022). Lora: Low-rank adaptation of large language models. ICLR, 1."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Llugsi, R., El Yacoubi, S., Fontaine, A., and Lupera, P. (2021, January 12\u201315). Comparison between Adam, AdaMax and Adam W optimizers to implement a Weather Forecast based on Neural Networks for the Andean city of Quito. Proceedings of the 2021 IEEE Fifth Ecuador Technical Chapters Meeting (ETCM), Cuenca, Ecuador.","DOI":"10.1109\/ETCM53643.2021.9590681"},{"key":"ref_66","unstructured":"Zhang, R., Han, J., Liu, C., Gao, P., Zhou, A., Hu, X., Yan, S., Lu, P., Li, H., and Qiao, Y. (2023). Llama-adapter: Efficient fine-tuning of language models with zero-init attention. arXiv."},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Gema, A., Minervini, P., Daines, L., Hope, T., and Alex, B. (2024, January 21). Parameter-efficient fine-tuning of llama for the clinical domain. Proceedings of the 6th Clinical Natural Language Processing Workshop, Mexico City, Mexico.","DOI":"10.18653\/v1\/2024.clinicalnlp-1.9"},{"key":"ref_68","unstructured":"Lermen, S., Rogers-Smith, C., and Ladish, J. (2023). Lora fine-tuning efficiently undoes safety training in llama 2-chat 70b. arXiv."},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Kora\u015f, O.A., Bahnan, R., Kleesiek, J., and Dada, A. (2025). Towards Conditioning Clinical Text Generation for User Control. arXiv.","DOI":"10.18653\/v1\/2025.findings-acl.549"},{"key":"ref_70","first-page":"21548","article-title":"A contrastive framework for neural text generation","volume":"35","author":"Su","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Peng, C., Yang, X., Chen, A., Smith, K.E., PourNejatian, N., Costa, A.B., Martin, C., Flores, M.G., Zhang, Y., and Magoc, T. (2023). A study of generative large language model for medical research and healthcare. npj Digit. Med., 6.","DOI":"10.1038\/s41746-023-00958-w"},{"key":"ref_72","unstructured":"Holtzman, A., Buys, J., Du, L., Forbes, M., and Choi, Y. (2019). The curious case of neural text degeneration. arXiv."},{"key":"ref_73","unstructured":"Zhang, T., Kishore, V., Wu, F., Weinberger, K.Q., and Artzi, Y. (2019). Bertscore: Evaluating text generation with bert. arXiv."},{"key":"ref_74","unstructured":"Lin, C.-Y. (2004). Rouge: A package for automatic evaluation of summaries. Text Summarization Branches Out, Association for Computational Linguistics."},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"Papineni, K., Roukos, S., Ward, T., and Zhu, W.-J. (2002, January 6\u201312). Bleu: A method for automatic evaluation of machine translation. Proceedings of the 40th annual meeting of the Association for Computational Linguistics, Philadelphia, PA, USA.","DOI":"10.3115\/1073083.1073135"},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1162\/tacl_a_00453","article-title":"SummaC: Re-visiting NLI-based models for inconsistency detection in summarization","volume":"10","author":"Laban","year":"2022","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_77","unstructured":"MacCartney, B. (2009). Natural Language Inference. [Ph.D. Thesis, Stanford University]."},{"key":"ref_78","first-page":"2511","article-title":"Principle-driven self-alignment of language models from scratch with minimal human supervision","volume":"36","author":"Sun","year":"2024","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_79","doi-asserted-by":"crossref","unstructured":"He, Z., Bhasuran, B., Jin, Q., Tian, S., Hanna, K., Shavor, C., Arguello, L.G., Murray, P., and Lu, Z. (2024). Quality of Answers of Generative Large Language Models vs Peer Patients for Interpreting Lab Test Results for Lay Patients: Evaluation Study. arXiv.","DOI":"10.2196\/preprints.56655"},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"395","DOI":"10.2307\/2982890","article-title":"Fisher\u2019s exact test","volume":"155","author":"Upton","year":"1992","journal-title":"J. R. Stat. Soc. Ser. A Stat. Soc."},{"key":"ref_81","unstructured":"Test, F.E. (2025, July 01). Fisher Exact Test. Available online: https:\/\/www.socscistatistics.com\/tests\/fisher\/default2.aspx."},{"key":"ref_82","unstructured":"Adams, G., Zuckerg, J., and Elhadad, N. (2023, January 11\u201312). A meta-evaluation of faithfulness metrics for long-form hospital-course summarization. Proceedings of the Machine Learning for Healthcare Conference, New York, NY, USA."},{"key":"ref_83","doi-asserted-by":"crossref","unstructured":"Adams, G., Alsentzer, E., Ketenci, M., Zucker, J., and Elhadad, N. (2021, January 6\u201311). What\u2019s in a summary? Laying the groundwork for advances in hospital-course summarization. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Virtual.","DOI":"10.18653\/v1\/2021.naacl-main.382"},{"key":"ref_84","doi-asserted-by":"crossref","unstructured":"Searle, T., Ibrahim, Z., Teo, J., and Dobson, R.J. (2023). Discharge summary hospital course summarisation of in patient electronic health record text with clinical concept guided deep pre-trained transformer models. J. Biomed. Inform., 141.","DOI":"10.1016\/j.jbi.2023.104358"},{"key":"ref_85","unstructured":"Adams, G. (2024). Generating Faithful and Complete Hospital-Course Summaries from the Electronic Health Record. [Ph.D. Thesis, Columbia University]."}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/10\/1\/4\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,22]],"date-time":"2025-12-22T16:37:52Z","timestamp":1766421472000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/10\/1\/4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,22]]},"references-count":85,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1]]}},"alternative-id":["bdcc10010004"],"URL":"https:\/\/doi.org\/10.3390\/bdcc10010004","relation":{},"ISSN":["2504-2289"],"issn-type":[{"value":"2504-2289","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,22]]}}}