{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,27]],"date-time":"2026-07-27T01:21:01Z","timestamp":1785115261675,"version":"3.55.0"},"reference-count":37,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR AI"],"abstract":"\n Background<\/jats:title>\n Machine learning (ML) can be used to predict clinical outcomes. Training predictive models typically requires data for hundreds or thousands of patients. Lowering this requirement to a few tens of patients would enable new applications in clinical trials (eg, optimizing the design of a phase III trial by training a predictive model on phase II data and applying it to synthetic phase III patients) or in clinical decision support systems (for rare diseases or narrow indications). Large language models (LLMs) have recently been shown to outperform conventional ML algorithms for predictions on tabular data when the train dataset is small.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aims to investigate the advantage of LLMs compared with conventional ML for predicting clinical outcomes by applying state-of-the-art models to recently published clinical datasets.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n We compared 2 LLMs, 1 proprietary (from OpenAI) and 1 open source (from the Meta Llama family), with conventional ML classification algorithms to predict clinical outcomes using 3 recently published clinical datasets spanning distinct conditions (sepsis, gastric cancer, and acute leukemia). Datasets were chosen such that their publication date was after the LLM knowledge cutoff date to ensure that models were never exposed to these data during pretraining. Datasets were sampled to vary the training size.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n On average, the 2 tested LLMs perform better than conventional ML for training sizes below 50 patients, using the receiver operating characteristic area under the curve, the F1-score, the average precision, and the balanced accuracy as metrics. Contextual information was found to be key to this advantage.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n These preliminary results may be further optimized. They already show the potential of LLM-based ML to enable new clinical use cases when data are available for only a few tens of patients.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/83853","type":"journal-article","created":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T20:45:08Z","timestamp":1775076308000},"page":"e83853","source":"Crossref","is-referenced-by-count":1,"title":["Performance of Large Language Models vs Conventional Machine Learning for Predicting Clinical Outcomes With Limited Data: Comparative Study"],"prefix":"10.2196","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-6012-2697","authenticated-orcid":false,"given":"Erwan","family":"Bigan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-7161-0665","authenticated-orcid":false,"given":"St\u00e9phane","family":"Dufour","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,4,1]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","DOI":"10.1186\/s13054-019-2351-7"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.1016\/j.medj.2021.04.006"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-023-00963-z"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1093\/braincomms\/fcae445"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.2147\/DDDT.S76135"},{"key":"ref6","unstructured":"HegselmannSBuendiaALangHAgrawalMJiangXSontagDTabLLM: few-shot classification of tabular data with large language models2023Proceedings of the 26th International Conference on Artificial Intelligence and Statistics (AISTATS)April 25-27, 2023Palau de Congressos"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0296456"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2024-098476"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1016\/S2589-7500(24)00044-X"},{"key":"ref10","author":"Parsons, VL","year":"2017","journal-title":"Wiley StatsRef: Statistics Reference Online"},{"issue":"3","key":"ref11","doi-asserted-by":"crossref","first-page":"837","DOI":"10.2307\/2531595","volume":"44","author":"DeLong, ER","year":"1988","journal-title":"Biometrics"},{"key":"ref12","unstructured":"scikit-learn: machine learning in Python; scikit-learn 1.6.1 documentationscikit-learn2025-07-30https:\/\/scikit-learn.org\/stable\/"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-024-08328-6"},{"key":"ref14","unstructured":"Qu JHolzm\u00fcllerDVaroquauxGMorvanMLTabICL: A tabular foundation model for in-context learning on large data2025Proceedings of the Forty-Second International Conference on Machine Learning (ICML 2025)July 13-19, 2025Vancouver1319"},{"key":"ref15","unstructured":"GPT-4o2026-01-31OpenAIhttps:\/\/platform.openai.com\/docs\/models\/gpt-4o"},{"key":"ref16","unstructured":"Llama-3.3-70B-Instruct2026-01-31Metahttps:\/\/huggingface.co\/meta-llama\/Llama-3.3-70B-Instruct"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.1145\/3600006.3613165"},{"key":"ref18","unstructured":"vLLM documentation2025-07-30vLLMhttps:\/\/docs.vllm.ai\/en\/stable\/"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.5555\/3495724.3495883"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.52202\/068431-2011"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775151"},{"key":"ref22","doi-asserted-by":"crossref","first-page":"61","DOI":"10.7551\/mitpress\/1113.003.0008","author":"Platt, J","year":"2000","journal-title":"Advances in Large Margin Classifiers"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.1214\/17-ejs1338si"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X06295361"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.3390\/cancers17050869"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.1186\/s12879-023-08045-x"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.5555\/3000292.3000304"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.1016\/s0169-7439(00)00122-2"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295230"},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11491"},{"key":"ref32","author":"Hinton, G","year":"2015","journal-title":"ArXiv. Preprint posted online on March 9, 2015"},{"key":"ref33","unstructured":"FrantarEStockPAlistarhDGPTQ: accurate post-training quantization for generative transformers2023Proceedings of the 11th International Conference on Learning Representations (ICLR 2023)May 4, 2023Kigali"},{"key":"ref34","doi-asserted-by":"publisher","DOI":"10.5555\/3618408.3619203"},{"key":"ref35","unstructured":"PopeRDouglasSChowdheryADevlinJBradburyJLevskayaAEfficiently scaling transformer inference2023Proceedings of the 6th Conference on Machine Learning and Systems (MLSys 2023)June 4-8, 2023Miami Beach"},{"key":"ref36","unstructured":"Runpod2026-01-31https:\/\/www.runpod.io\/pricing"},{"key":"ref37","doi-asserted-by":"publisher","DOI":"10.1038\/s43018-020-00169-2"}],"container-title":["JMIR AI"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/ai.jmir.org\/2026\/1\/e83853","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:18:02Z","timestamp":1782843482000},"score":1,"resource":{"primary":{"URL":"https:\/\/ai.jmir.org\/2026\/1\/e83853"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,1]]},"references-count":37,"URL":"https:\/\/doi.org\/10.2196\/83853","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.83853","asserted-by":"object"}]},"ISSN":["2817-1705"],"issn-type":[{"value":"2817-1705","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,1]]}}}