{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T21:03:34Z","timestamp":1777669414141,"version":"3.51.4"},"reference-count":61,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,3,30]],"date-time":"2023-03-30T00:00:00Z","timestamp":1680134400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,30]],"date-time":"2023-03-30T00:00:00Z","timestamp":1680134400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Oral cancer may arise from oral leukoplakia and oral lichenoid mucositis (oral lichen planus and oral lichenoid lesions) subtypes of oral potentially malignant disorders. As not all patients will develop oral cancer\u00a0in their lifetime, the availability of malignant\u00a0transformation predictive platforms would assist in the individualized treatment planning and formulation of optimal follow-up regimens for these patients. Therefore, this study aims to compare and select optimal machine learning (ML)-based models for stratifying the malignant transformation status of patients with oral leukoplakia and oral lichenoid mucositis. One thousand one hundred and eighty-seven patients with oral leukoplakia and oral lichenoid mucositis treated at three tertiary health institutions in Hong Kong, Newcastle UK, and Lagos Nigeria were included in the study. Demographic, clinical, pathological, and treatment-based factors obtained at diagnosis and during follow-up were used to populate and compare forty-six machine learning-based models. These were implemented as a set of twenty-six predictors for centers with substantial data quantity and fifteen predictors for centers with insufficient data. Two best models were selected according to the number of variables. We found that the optimal ML-based risk models with twenty-six and fifteen predictors achieved an accuracy of 97% and 94% respectively following model testing. Upon external validation, both models achieved a sensitivity, specificity, and F1-score of 1, 0.88, and 0.67 on consecutive patients treated after the construction of the models. Furthermore, the 15-predictor ML model for centers with reduced data achieved a higher sensitivity for identifying oral leukoplakia and oral lichenoid mucositis patients that developed malignancies in other treatment settings compared to the binary oral epithelial dysplasia system for risk stratification (0.96 vs 0.82). These findings suggest that machine learning-based models could be useful potentially to stratify patients with oral leukoplakia and oral lichenoid mucositis according to their risk of malignant transformation in different settings.<\/jats:p>","DOI":"10.1186\/s40537-023-00714-7","type":"journal-article","created":{"date-parts":[[2023,3,31]],"date-time":"2023-03-31T04:03:04Z","timestamp":1680235384000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Predicting oral cancer risk in patients with oral leukoplakia and oral lichenoid mucositis using machine learning"],"prefix":"10.1186","volume":"10","author":[{"given":"John","family":"Adeoye","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohamad","family":"Koohi-Moghadam","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Siu-Wai","family":"Choi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Li-Wu","family":"Zheng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anthony Wing Ip","family":"Lo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raymond King-Yin","family":"Tsang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Velda Ling Yu","family":"Chow","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Abdulwarith","family":"Akinshipo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Thomson","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu-Xiong","family":"Su","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,3,30]]},"reference":[{"issue":"3","key":"714_CR1","doi-asserted-by":"publisher","first-page":"209","DOI":"10.3322\/caac.21660","volume":"71","author":"H Sung","year":"2021","unstructured":"Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global cancer statistics 2020: globocan estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2021;71(3):209\u201349.","journal-title":"CA Cancer J Clin"},{"issue":"4\u20135","key":"714_CR2","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1016\/j.oraloncology.2008.06.002","volume":"45","author":"S Warnakulasuriya","year":"2009","unstructured":"Warnakulasuriya S. Global epidemiology of oral and oropharyngeal cancer. Oral Oncol. 2009;45(4\u20135):309\u201316.","journal-title":"Oral Oncol"},{"issue":"3","key":"714_CR3","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1308\/rcsfdj.2020.97","volume":"11","author":"J Adeoye","year":"2020","unstructured":"Adeoye J, Thomson P. Strategies to improve diagnosis and risk assessment for oral cancer patients. Fac Dental J. 2020;11(3):122\u20137.","journal-title":"Fac Dental J"},{"issue":"2","key":"714_CR4","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1007\/s12663-011-0195-z","volume":"10","author":"H Ram","year":"2011","unstructured":"Ram H, Sarkar J, Kumar H, Konwar R, Bhatt MLB, Mohammad S. Oral cancer: risk factors and molecular pathogenesis. J Maxill Oral Surg. 2011;10(2):132\u20137.","journal-title":"J Maxill Oral Surg"},{"key":"714_CR5","doi-asserted-by":"publisher","first-page":"3662","DOI":"10.1002\/hed.26824","volume":"43","author":"J Adeoye","year":"2021","unstructured":"Adeoye J, Tan JY, Ip CM, Choi S-W, Thomson P. \u201cFact or fiction?\u201d: Oral cavity cancer in nonsmoking, nonalcohol drinking patients as a distinct entity\u2014scoping review. Head Neck. 2021;43:3662.","journal-title":"Head Neck."},{"issue":"Suppl 1","key":"714_CR6","first-page":"31","volume":"10","author":"PM Speight","year":"1993","unstructured":"Speight PM, Morgan PR. The natural history and pathology of oral cancer and precancer. Community Dent Health. 1993;10(Suppl 1):31\u201341.","journal-title":"Community Dent Health"},{"issue":"10","key":"714_CR7","doi-asserted-by":"publisher","first-page":"575","DOI":"10.1111\/j.1600-0714.2007.00582.x","volume":"36","author":"S Warnakulasuriya","year":"2007","unstructured":"Warnakulasuriya S, Johnson NW, van der Waal I. Nomenclature and classification of potentially malignant disorders of the oral mucosa. J Oral Pathol Med. 2007;36(10):575\u201380.","journal-title":"J Oral Pathol Med"},{"issue":"8","key":"714_CR8","doi-asserted-by":"publisher","first-page":"1862","DOI":"10.1111\/odi.13704","volume":"27","author":"S Warnakulasuriya","year":"2021","unstructured":"Warnakulasuriya S, Kujan O, Aguirre-Urizar JM, Bagan JV, Gonz\u00e1lez-Moles M, Kerr AR, et al. Oral potentially malignant disorders: a consensus report from an international seminar on nomenclature and classification, convened by the WHO collaborating centre for oral cancer. Oral Dis. 2021;27(8):1862\u201380.","journal-title":"Oral Dis"},{"issue":"7","key":"714_CR9","doi-asserted-by":"publisher","first-page":"538","DOI":"10.1111\/jop.12904","volume":"48","author":"K Shearston","year":"2019","unstructured":"Shearston K, Fateh B, Tai S, Hove D, Farah CS. Oral lichenoid dysplasia and not oral lichen planus undergoes malignant transformation at high rates. J Oral Pathol Med. 2019;48(7):538\u201345.","journal-title":"J Oral Pathol Med"},{"issue":"4","key":"714_CR10","doi-asserted-by":"publisher","first-page":"e386","DOI":"10.4317\/medoral.20205","volume":"19","author":"I van der Waal","year":"2014","unstructured":"van der Waal I. Oral potentially malignant disorders: is malignant transformation predictable and preventable? Med Oral Patol Oral Cir Bucal. 2014;19(4):e386\u201390.","journal-title":"Med Oral Patol Oral Cir Bucal"},{"issue":"6","key":"714_CR11","doi-asserted-by":"publisher","first-page":"612","DOI":"10.1016\/j.oooo.2017.12.011","volume":"125","author":"PM Speight","year":"2018","unstructured":"Speight PM, Khurram SA, Kujan O. Oral potentially malignant disorders: risk of progression to malignancy. Oral Surg Oral Med Oral Pathol Oral Radiol. 2018;125(6):612\u201327.","journal-title":"Oral Surg Oral Med Oral Pathol Oral Radiol"},{"issue":"3","key":"714_CR12","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1002\/hed.26006","volume":"42","author":"O Iocca","year":"2020","unstructured":"Iocca O, Sollecito TP, Alawi F, Weinstein GS, Newman JG, De Virgilio A, et al. Potentially malignant disorders of the oral cavity and oral dysplasia: a systematic review and meta-analysis of malignant transformation rate by subtype. Head Neck. 2020;42(3):539\u201355.","journal-title":"Head Neck"},{"issue":"8","key":"714_CR13","doi-asserted-by":"publisher","first-page":"1881","DOI":"10.1111\/odi.13810","volume":"27","author":"JM Aguirre-Urizar","year":"2021","unstructured":"Aguirre-Urizar JM, Lafuente-Ib\u00e1\u00f1ez de Mendoza I, Warnakulasuriya S. Malignant transformation of oral leukoplakia: systematic review and meta-analysis of the last 5 years. Oral Diseases. 2021;27(8):1881\u201395.","journal-title":"Oral Diseases"},{"issue":"3","key":"714_CR14","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1111\/jop.12339","volume":"45","author":"S Warnakulasuriya","year":"2016","unstructured":"Warnakulasuriya S, Ariyawardana A. Malignant transformation of oral leukoplakia: a systematic review of observational studies. J Oral Pathol Med. 2016;45(3):155\u201366.","journal-title":"J Oral Pathol Med"},{"issue":"8","key":"714_CR15","doi-asserted-by":"publisher","first-page":"1908","DOI":"10.1111\/odi.13741","volume":"27","author":"M Gonz\u00e1lez-Moles","year":"2021","unstructured":"Gonz\u00e1lez-Moles M, Ramos-Garc\u00eda P, Warnakulasuriya S. An appraisal of highest quality studies reporting malignant transformation of oral lichen planus based on a systematic review. Oral Dis. 2021;27(8):1908\u201318.","journal-title":"Oral Dis"},{"key":"714_CR16","doi-asserted-by":"publisher","DOI":"10.1111\/jop.13262","author":"HP Sathasivam","year":"2021","unstructured":"Sathasivam HP, Sloan P, Thomson PJ, Robinson M. The clinical utility of contemporary oral epithelial dysplasia grading systems. J Oral Pathol Med. 2021. https:\/\/doi.org\/10.1111\/jop.13262.","journal-title":"J Oral Pathol Med"},{"issue":"7","key":"714_CR17","doi-asserted-by":"publisher","first-page":"4329","DOI":"10.1007\/s00784-021-04008-1","volume":"25","author":"BS de Freitas Silva","year":"2021","unstructured":"de Freitas Silva BS, Batista DCR, de Souza Roriz CF, Silva LR, Normando AGC, dos Santos Silva AR, et al. Binary and WHO dysplasia grading systems for the prediction of malignant transformation of oral leukoplakia and erythroplakia: a systematic review and meta-analysis. Clin Oral Invest. 2021;25(7):4329\u201340.","journal-title":"Clin Oral Invest"},{"issue":"3","key":"714_CR18","doi-asserted-by":"publisher","first-page":"413","DOI":"10.1038\/s41416-021-01411-z","volume":"125","author":"HP Sathasivam","year":"2021","unstructured":"Sathasivam HP, Kist R, Sloan P, Thomson P, Nugent M, Alexander J, et al. Predicting the clinical outcome of oral potentially malignant disorders using transcriptomic-based molecular pathology. Br J Cancer. 2021;125(3):413\u201321.","journal-title":"Br J Cancer"},{"issue":"4","key":"714_CR19","doi-asserted-by":"publisher","first-page":"e173","DOI":"10.1016\/S1470-2045(14)71116-7","volume":"16","author":"VP Balachandran","year":"2015","unstructured":"Balachandran VP, Gonen M, Smith JJ, DeMatteo RP. Nomograms in oncology: more than meets the eye. Lancet Oncol. 2015;16(4):e173\u201380.","journal-title":"Lancet Oncol"},{"issue":"14","key":"714_CR20","doi-asserted-by":"publisher","first-page":"2543","DOI":"10.7150\/jca.24431","volume":"9","author":"F Chen","year":"2018","unstructured":"Chen F, Lin L, Yan L, Liu F, Qiu Y, Wang J, et al. Nomograms and risk scores for predicting the risk of oral cancer in different sexes: a large-scale case-control study. J Cancer. 2018;9(14):2543\u20138.","journal-title":"J Cancer"},{"issue":"6","key":"714_CR21","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1111\/jop.12862","volume":"48","author":"T Wang","year":"2019","unstructured":"Wang T, Wang L, Yang H, Lu H, Zhang J, Li N, et al. Development and validation of nomogram for prediction of malignant transformation in oral leukoplakia: a large-scale cohort study. J Oral Pathol Med. 2019;48(6):491\u20138.","journal-title":"J Oral Pathol Med"},{"issue":"8","key":"714_CR22","doi-asserted-by":"publisher","first-page":"662","DOI":"10.1111\/jop.12881","volume":"48","author":"ML Goodson","year":"2019","unstructured":"Goodson ML, Smith DR, Thomson PJ. The\"newcastle nomogram\"-statistical modelling predicts malignant transformation in potentially malignant disorders. J Oral Pathol Med. 2019;48(8):662\u20138.","journal-title":"J Oral Pathol Med"},{"key":"714_CR23","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2021.104557","volume":"154","author":"J Adeoye","year":"2021","unstructured":"Adeoye J, Tan JY, Choi S-W, Thomson P. Prediction models applying machine learning to oral cavity cancer outcomes: a systematic review. Int J Med Informatics. 2021;154: 104557.","journal-title":"Int J Med Informatics"},{"key":"714_CR24","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2021.102060","volume":"115","author":"RO Alabi","year":"2021","unstructured":"Alabi RO, Youssef O, Pirinen M, Elmusrati M, M\u00e4kitie AA, Leivo I, et al. Machine learning in oral squamous cell carcinoma: current status, clinical concerns and prospects for future\u2014a systematic review. Artif Intell Med. 2021;115: 102060.","journal-title":"Artif Intell Med"},{"issue":"2","key":"714_CR25","doi-asserted-by":"publisher","first-page":"94","DOI":"10.7861\/futurehosp.6-2-94","volume":"6","author":"T Davenport","year":"2019","unstructured":"Davenport T, Kalakota R. The potential for artificial intelligence in healthcare. Future Healthc J. 2019;6(2):94\u20138.","journal-title":"Future Healthc J"},{"issue":"1","key":"714_CR26","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1038\/s41591-018-0316-z","volume":"25","author":"A Esteva","year":"2019","unstructured":"Esteva A, Robicquet A, Ramsundar B, Kuleshov V, DePristo M, Chou K, et al. A guide to deep learning in healthcare. Nat Med. 2019;25(1):24\u20139.","journal-title":"Nat Med"},{"issue":"8","key":"714_CR27","doi-asserted-by":"publisher","first-page":"1881","DOI":"10.1111\/odi.13810","volume":"27","author":"JM Aguirre-Urizar","year":"2021","unstructured":"Aguirre-Urizar JM, Lafuente-Ib\u00e1\u00f1ez de Mendoza I, Warnakulasuriya S. Malignant transformation of oral leukoplakia: systematic review and meta-analysis of the last 5 years. Oral Dis. 2021;27(8):1881\u201395.","journal-title":"Oral Dis"},{"issue":"8","key":"714_CR28","doi-asserted-by":"publisher","first-page":"1919","DOI":"10.1111\/odi.13812","volume":"27","author":"P Ramos-Garc\u00eda","year":"2021","unstructured":"Ramos-Garc\u00eda P, Gonz\u00e1lez-Moles M, Warnakulasuriya S. Oral cancer development in lichen planus and related conditions-3.0 evidence level: a systematic review of systematic reviews. Oral Dis. 2021;27(8):1919\u201335.","journal-title":"Oral Dis"},{"issue":"23","key":"714_CR29","doi-asserted-by":"publisher","first-page":"6054","DOI":"10.3390\/cancers13236054","volume":"13","author":"J Adeoye","year":"2021","unstructured":"Adeoye J, Koohi-Moghadam M, Lo AWI, Tsang RK-Y, Chow VLY, Zheng L-W, et al. Deep learning predicts the malignant-transformation-free survival of oral potentially malignant disorders. Cancers. 2021;13(23):6054.","journal-title":"Cancers."},{"issue":"10","key":"714_CR30","doi-asserted-by":"crossref","first-page":"888","DOI":"10.1111\/jop.12625","volume":"46","author":"PJ Thomson","year":"2017","unstructured":"Thomson PJ, Goodson ML, Smith DR. Profiling cancer risk in oral potentially malignant disorders\u2014a patient cohort study. J Oral Pathol Med. 2017;46(10):888\u201395.","journal-title":"J Oral Pathol Med"},{"issue":"6","key":"714_CR31","doi-asserted-by":"publisher","first-page":"557","DOI":"10.1111\/jop.12716","volume":"47","author":"PJ Thomson","year":"2018","unstructured":"Thomson PJ, Goodson ML, Smith DR. Potentially malignant disorders revisited-The lichenoid lesion\/proliferative verrucous leukoplakia conundrum. J Oral Pathol Med. 2018;47(6):557\u201365.","journal-title":"J Oral Pathol Med"},{"issue":"3","key":"714_CR32","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1016\/j.ijom.2016.11.001","volume":"46","author":"PJ Thomson","year":"2017","unstructured":"Thomson PJ, Goodson ML, Cocks K, Turner JE. Interventional laser surgery for oral potentially malignant disorders: a longitudinal patient cohort study. Int J Oral Maxillofac Surg. 2017;46(3):337\u201342.","journal-title":"Int J Oral Maxillofac Surg"},{"issue":"3","key":"714_CR33","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1111\/jop.12339","volume":"45","author":"S Warnakulasuriya","year":"2016","unstructured":"Warnakulasuriya S, Ariyawardana A. Malignant transformation of oral leukoplakia: a systematic review of observational studies. J Oral Pathol Med. 2016;45(3):155\u201366.","journal-title":"J Oral Pathol Med"},{"issue":"3","key":"714_CR34","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1111\/jop.12996","volume":"50","author":"M Idrees","year":"2021","unstructured":"Idrees M, Kujan O, Shearston K, Farah CS. Oral lichen planus has a very low malignant transformation rate: a systematic review and meta-analysis using strict diagnostic and inclusion criteria. J Oral Pathol Med. 2021;50(3):287\u201398.","journal-title":"J Oral Pathol Med"},{"issue":"3","key":"714_CR35","doi-asserted-by":"publisher","first-page":"693","DOI":"10.1111\/odi.12885","volume":"25","author":"M Giuliani","year":"2019","unstructured":"Giuliani M, Troiano G, Cordaro M, Corsalini M, Gioco G, Lo Muzio L, et al. Rate of malignant transformation of oral lichen planus: a systematic review. Oral Dis. 2019;25(3):693\u2013709.","journal-title":"Oral Dis"},{"issue":"7","key":"714_CR36","first-page":"CD001829","volume":"7","author":"G Lodi","year":"2016","unstructured":"Lodi G, Franchini R, Warnakulasuriya S, Varoni EM, Sardella A, Kerr AR, et al. Interventions for treating oral leukoplakia to prevent oral cancer. Cochrane Database Syst Rev. 2016;7(7):CD001829.","journal-title":"Cochrane Database Syst Rev"},{"issue":"10","key":"714_CR37","doi-asserted-by":"publisher","first-page":"1047","DOI":"10.1093\/jnci\/djz238","volume":"112","author":"AK Chaturvedi","year":"2020","unstructured":"Chaturvedi AK, Udaltsova N, Engels EA, Katzel JA, Yanik EL, Katki HA, et al. Oral leukoplakia and risk of progression to oral cancer: a population-based cohort study. J Natl Cancer Inst. 2020;112(10):1047\u201354.","journal-title":"J Natl Cancer Inst"},{"key":"714_CR38","doi-asserted-by":"publisher","DOI":"10.1111\/odi.13784","author":"J Adeoye","year":"2021","unstructured":"Adeoye J, Thomson P. A call for an established oral cancer classification by etiology and revision of related terminology. Oral Diseases. 2021. https:\/\/doi.org\/10.1111\/odi.13784.","journal-title":"Oral Diseases"},{"issue":"10","key":"714_CR39","doi-asserted-by":"publisher","first-page":"977","DOI":"10.1111\/jop.13089","volume":"49","author":"CS Chu","year":"2020","unstructured":"Chu CS, Lee NP, Adeoye J, Thomson P, Choi S-W. Machine learning and treatment outcome prediction for oral cancer. J Oral Pathol Med. 2020;49(10):977\u201385.","journal-title":"J Oral Pathol Med"},{"key":"714_CR40","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1007\/s10115-006-0040-8","volume":"12","author":"A Kalousis","year":"2007","unstructured":"Kalousis A, Prados J, Hilario M. Stability of feature selection algorithms: a study on high-dimensional spaces. Knowl Inf Syst. 2007;12:95\u2013116.","journal-title":"Knowl Inf Syst"},{"key":"714_CR41","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.604","author":"P Gnip","year":"2021","unstructured":"Gnip P, Vokorokos L, Drot\u00e1r P. Selective oversampling approach for strongly imbalanced data. PeerJ Comput Sci. 2021. https:\/\/doi.org\/10.7717\/peerj-cs.604.","journal-title":"PeerJ Comput Sci."},{"issue":"10","key":"714_CR42","doi-asserted-by":"publisher","first-page":"987","DOI":"10.1016\/j.oraloncology.2005.12.014","volume":"42","author":"O Kujan","year":"2006","unstructured":"Kujan O, Oliver RJ, Khattab A, Roberts SA, Thakker N, Sloan P. Evaluation of a new binary system of grading oral epithelial dysplasia for prediction of malignant transformation. Oral Oncol. 2006;42(10):987\u201393.","journal-title":"Oral Oncol"},{"key":"714_CR43","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1177\/10668969211070171","volume":"30","author":"ZH Khoury","year":"2022","unstructured":"Khoury ZH, Sultan M, Sultan AS. Oral epithelial dysplasia grading systems: a systematic review & meta-analysis. Int J Surg Pathol. 2022;30:499.","journal-title":"Int J Surg Pathol"},{"key":"714_CR44","doi-asserted-by":"publisher","DOI":"10.1016\/j.oraloncology.2021.105469","volume":"121","author":"F J\u00e4wert","year":"2021","unstructured":"J\u00e4wert F, Nyman J, Olsson E, Adok C, Helmersson M, \u00d6hman J. Regular clinical follow-up of oral potentially malignant disorders results in improved survival for patients who develop oral cancer. Oral Oncol. 2021;121: 105469.","journal-title":"Oral Oncol"},{"key":"714_CR45","unstructured":"Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. Advances in neural information processing systems. 2017. 30."},{"issue":"6","key":"714_CR46","doi-asserted-by":"publisher","first-page":"565","DOI":"10.1177\/0272989X06295361","volume":"26","author":"AJ Vickers","year":"2006","unstructured":"Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making. 2006;26(6):565\u201374.","journal-title":"Med Decis Making"},{"key":"714_CR47","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn machine learning in python. J Machine Learn Res. 2011;12:2825\u201330.","journal-title":"J Machine Learn Res"},{"key":"714_CR48","unstructured":"Grinberg M. Flask web development: developing web applications with python: \u2018\u2018O'Reilly Media, Inc.\u2019\u2019. 2018."},{"issue":"2","key":"714_CR49","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1038\/bjc.2014.639","volume":"112","author":"GS Collins","year":"2015","unstructured":"Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Br J Cancer. 2015;112(2):251\u20139.","journal-title":"Br J Cancer"},{"key":"714_CR50","unstructured":"He H, Bai Y, Garcia EA, Li S, editors. ADASYN. Adaptive synthetic sampling approach for imbalanced learning. 2008 IEEE international joint conference on neural networks (IEEE world congress on computational intelligence); 2008. IEEE."},{"key":"714_CR51","first-page":"201004326","volume":"2010","author":"RA Danquah","year":"2020","unstructured":"Danquah RA. Handling imbalanced data: a case study for binary class problems. arXiv Preprint arXiv. 2020;2010:201004326.","journal-title":"arXiv Preprint arXiv"},{"key":"714_CR52","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1613\/jair.614","volume":"11","author":"D Opitz","year":"1999","unstructured":"Opitz D, Maclin R. Popular ensemble methods: An empirical study. J Artif Intell Res. 1999;11:169\u201398.","journal-title":"J Artif Intell Res"},{"key":"714_CR53","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1007\/s11704-019-8208-z","volume":"14","author":"X Dong","year":"2020","unstructured":"Dong X, Yu Z, Cao W, Shi Y, Ma Q. A survey on ensemble learning. Front Comp Sci. 2020;14:241\u201358.","journal-title":"Front Comp Sci"},{"key":"714_CR54","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2019.104068","volume":"136","author":"RO Alabi","year":"2020","unstructured":"Alabi RO, Elmusrati M, Sawazaki-Calone I, Kowalski LP, Haglund C, Coletta RD, et al. Comparison of supervised machine learning classification techniques in prediction of locoregional recurrences in early oral tongue cancer. Int J Med Inform. 2020;136: 104068.","journal-title":"Int J Med Inform"},{"issue":"5","key":"714_CR55","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1111\/jop.12983","volume":"49","author":"X Wang","year":"2020","unstructured":"Wang X, Yang J, Wei C, Zhou G, Wu L, Gao Q, et al. A personalized computational model predicts cancer risk level of oral potentially malignant disorders and its web application for promotion of non-invasive screening. J Oral Pathol Med. 2020;49(5):417\u201326.","journal-title":"J Oral Pathol Med"},{"key":"714_CR56","doi-asserted-by":"publisher","DOI":"10.1016\/j.oraloncology.2022.106278","volume":"136","author":"J Adeoye","year":"2023","unstructured":"Adeoye J, Zheng L-W, Thomson P, Choi S-W, Su Y-X. Explainable ensemble learning model improves identification of candidates for oral cancer screening. Oral Oncol. 2023;136: 106278.","journal-title":"Oral Oncol"},{"issue":"28","key":"714_CR57","doi-asserted-by":"publisher","first-page":"46057","DOI":"10.18632\/oncotarget.17550","volume":"8","author":"Y Liu","year":"2017","unstructured":"Liu Y, Li Y, Fu Y, Liu T, Liu X, Zhang X, et al. Quantitative prediction of oral cancer risk in patients with oral leukoplakia. Oncotarget. 2017;8(28):46057\u201364.","journal-title":"Oncotarget"},{"key":"714_CR58","first-page":"4893","volume":"12","author":"WK Shams","year":"2017","unstructured":"Shams WK, Htike ZZ. Oral cancer prediction using gene expression profiling and machine learning. Int J Appl Eng Res. 2017;12:4893\u20138.","journal-title":"Int J Appl Eng Res"},{"issue":"8","key":"714_CR59","doi-asserted-by":"publisher","first-page":"1993","DOI":"10.1111\/odi.13797","volume":"27","author":"EW Odell","year":"2021","unstructured":"Odell EW. Aneuploidy and loss of heterozygosity as risk markers for malignant transformation in oral mucosa. Oral Dis. 2021;27(8):1993\u20132007.","journal-title":"Oral Dis"},{"issue":"8","key":"714_CR60","doi-asserted-by":"publisher","first-page":"1977","DOI":"10.1111\/odi.13747","volume":"27","author":"L Monteiro","year":"2021","unstructured":"Monteiro L, Mello FW, Warnakulasuriya S. Tissue biomarkers for predicting the risk of oral cancer in patients diagnosed with oral leukoplakia: a systematic review. Oral Dis. 2021;27(8):1977\u201392.","journal-title":"Oral Dis"},{"issue":"1","key":"714_CR61","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1038\/s41746-021-00524-2","volume":"4","author":"Q Zhou","year":"2021","unstructured":"Zhou Q, Chen Z-h, Cao Y-h, Peng S. Clinical impact and quality of randomized controlled trials involving interventions evaluating artificial intelligence prediction tools: a systematic review. Digit Med. 2021;4(1):154.","journal-title":"Digit Med"}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-023-00714-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40537-023-00714-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-023-00714-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,9]],"date-time":"2023-12-09T23:38:09Z","timestamp":1702165089000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-023-00714-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,30]]},"references-count":61,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["714"],"URL":"https:\/\/doi.org\/10.1186\/s40537-023-00714-7","relation":{},"ISSN":["2196-1115"],"issn-type":[{"value":"2196-1115","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,30]]},"assertion":[{"value":"17 May 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 March 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 March 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Approval to conduct this study was granted by the Institutional Review Board of the University of Hong Kong\/Hospital Authority Hong Kong West Cluster (Reference Number UW\u201021-495). Informed consent for patients was waved due to the retrospective nature of this study. All clinical data were anonymized by the researchers, and all potential patient identifiers were removed before data analysis.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"39"}}