{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:03:32Z","timestamp":1760148212801,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2023,4,11]],"date-time":"2023-04-11T00:00:00Z","timestamp":1681171200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000925","name":"Australian Government National Health and Medical Research Council","doi-asserted-by":"publisher","award":["APP1104281"],"award-info":[{"award-number":["APP1104281"]}],"id":[{"id":"10.13039\/501100000925","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJMS"],"abstract":"<jats:p>The biomarker development field within molecular medicine remains limited by the methods that are available for building predictive models. We developed an efficient method for conservatively estimating confidence intervals for the cross validation-derived prediction errors of biomarker models. This new method was investigated for its ability to improve the capacity of our previously developed method, StaVarSel, for selecting stable biomarkers. Compared with the standard cross validation method, StaVarSel markedly improved the estimated generalisable predictive capacity of serum miRNA biomarkers for the detection of disease states that are at increased risk of progressing to oesophageal adenocarcinoma. The incorporation of our new method for conservatively estimating confidence intervals into StaVarSel resulted in the selection of less complex models with increased stability and improved or similar predictive capacities. The methods developed in this study have the potential to improve progress from biomarker discovery to biomarker driven translational research.<\/jats:p>","DOI":"10.3390\/ijms24087068","type":"journal-article","created":{"date-parts":[[2023,4,12]],"date-time":"2023-04-12T02:57:08Z","timestamp":1681268228000},"page":"7068","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A Method for Increasing the Robustness of Stable Feature Selection for Biomarker Discovery in Molecular Medicine Developed Using Serum Small Extracellular Vesicle Associated miRNAs and the Barrett\u2019s Oesophagus Disease Spectrum"],"prefix":"10.3390","volume":"24","author":[{"given":"George C.","family":"Mayne","sequence":"first","affiliation":[{"name":"Flinders Health and Medical Research Institute\u2014Cancer Program, Flinders University, Bedford Park, SA 5042, Australia"},{"name":"Department of Surgery, Flinders Medical Centre, Bedford Park, SA 5042, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4094-1222","authenticated-orcid":false,"given":"Richard J.","family":"Woodman","sequence":"additional","affiliation":[{"name":"Flinders Health and Medical Research Institute\u2014Cancer Program, Flinders University, Bedford Park, SA 5042, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7683-2693","authenticated-orcid":false,"given":"David I.","family":"Watson","sequence":"additional","affiliation":[{"name":"Flinders Health and Medical Research Institute\u2014Cancer Program, Flinders University, Bedford Park, SA 5042, Australia"},{"name":"Department of Surgery, Flinders Medical Centre, Bedford Park, SA 5042, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tim","family":"Bright","sequence":"additional","affiliation":[{"name":"Flinders Health and Medical Research Institute\u2014Cancer Program, Flinders University, Bedford Park, SA 5042, Australia"},{"name":"Department of Surgery, Flinders Medical Centre, Bedford Park, SA 5042, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Susan","family":"Gan","sequence":"additional","affiliation":[{"name":"Department of Surgery, Flinders Medical Centre, Bedford Park, SA 5042, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Reginald V.","family":"Lord","sequence":"additional","affiliation":[{"name":"Gastroesophageal Cancer Research Program, St. Vincent\u2019s Centre for Applied Medical Research, Darlinghurst, NSW 2010, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael J.","family":"Bourke","sequence":"additional","affiliation":[{"name":"Faculty of Medicine and Health, The University of Sydney, Westmead, NSW 2145, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Angelique","family":"Levert-Mignon","sequence":"additional","affiliation":[{"name":"Gastroesophageal Cancer Research Program, St. Vincent\u2019s Centre for Applied Medical Research, Darlinghurst, NSW 2010, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Isabell","family":"Bastian","sequence":"additional","affiliation":[{"name":"Flinders Health and Medical Research Institute\u2014Cancer Program, Flinders University, Bedford Park, SA 5042, Australia"},{"name":"Department of Surgery, Flinders Medical Centre, Bedford Park, SA 5042, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tanya","family":"Irvine","sequence":"additional","affiliation":[{"name":"Department of Surgery, Flinders Medical Centre, Bedford Park, SA 5042, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ann","family":"Schloithe","sequence":"additional","affiliation":[{"name":"Flinders Health and Medical Research Institute\u2014Cancer Program, Flinders University, Bedford Park, SA 5042, Australia"},{"name":"Department of Surgery, Flinders Medical Centre, Bedford Park, SA 5042, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marian","family":"Martin","sequence":"additional","affiliation":[{"name":"Flinders Health and Medical Research Institute\u2014Cancer Program, Flinders University, Bedford Park, SA 5042, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lorraine","family":"Sheehan-Hennessy","sequence":"additional","affiliation":[{"name":"Flinders Health and Medical Research Institute\u2014Cancer Program, Flinders University, Bedford Park, SA 5042, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6121-6740","authenticated-orcid":false,"given":"Damian J.","family":"Hussey","sequence":"additional","affiliation":[{"name":"Flinders Health and Medical Research Institute\u2014Cancer Program, Flinders University, Bedford Park, SA 5042, Australia"},{"name":"Department of Surgery, Flinders Medical Centre, Bedford Park, SA 5042, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,4,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1111\/j.1440-1746.2010.06602.x","article-title":"Barrett\u2019s esophagus","volume":"26","author":"Phillips","year":"2011","journal-title":"J. Gastroenterol. Hepatol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1375","DOI":"10.1056\/NEJMoa1103042","article-title":"Incidence of adenocarcinoma among patients with Barrett\u2019s esophagus","volume":"365","author":"Pedersen","year":"2011","journal-title":"N. Engl. J. Med."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1209","DOI":"10.1001\/jama.2014.2511","article-title":"Radiofrequency ablation vs endoscopic surveillance for patients with Barrett esophagus and low-grade dysplasia: A randomized clinical trial","volume":"311","author":"Phoa","year":"2014","journal-title":"JAMA"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"777","DOI":"10.1016\/j.gie.2008.05.013","article-title":"Low prevalence of submucosal invasive carcinoma at esophagectomy for high-grade dysplasia or intramucosal adenocarcinoma in Barrett\u2019s esophagus: A 20-year experience","volume":"69","author":"Wang","year":"2009","journal-title":"Gastrointest. Endosc."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"7","DOI":"10.3322\/caac.21590","article-title":"Cancer statistics, 2020","volume":"70","author":"Siegel","year":"2020","journal-title":"CA Cancer J. Clin."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1208","DOI":"10.1007\/s11605-015-2829-9","article-title":"Circulating Serum Exosomal miRNAs As Potential Biomarkers for Esophageal Adenocarcinoma","volume":"19","author":"Chiam","year":"2015","journal-title":"J. Gastrointest. Surg."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1016\/S0140-6736(05)17866-0","article-title":"Prediction of cancer outcome with microarrays: A multiple random validation strategy","volume":"365","author":"Michiels","year":"2005","journal-title":"Lancet"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1111\/j.1467-9868.2010.00740.x","article-title":"Stability Selection","volume":"72","author":"Meinshausen","year":"2010","journal-title":"J. R. Stat. Soc. Ser. B (Stat. Methodol.)"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Bach, F.R. (2008, January 5\u20139). Bolasso: Model consistent Lasso estimation through the bootstrap. Proceedings of the 25th International Conference on Machine Learning, Helsinki, Finland.","DOI":"10.1145\/1390156.1390161"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.compbiolchem.2010.07.002","article-title":"Stable feature selection for biomarker discovery","volume":"34","author":"He","year":"2010","journal-title":"Comput. Biol. Chem."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Moon, M., and Nakai, K. (2016). Stable feature selection based on the ensemble L (1) -norm support vector machine for biomarker discovery. BMC Genom., 17.","DOI":"10.1186\/s12864-016-3320-z"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"280","DOI":"10.1186\/s12967-020-02446-1","article-title":"Cross validated serum small extracellular vesicle microRNAs for the detection of oropharyngeal squamous cell carcinoma","volume":"18","author":"Mayne","year":"2020","journal-title":"J. Transl. Med."},{"key":"ref_13","first-page":"1089","article-title":"No Unbiased Estimator of the Variance of K-Fold Cross-Validation","volume":"5","author":"Bengio","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wickenberg-Bolin, U., G\u00f6ransson, H., Frykn\u00e4s, M., Gustafsson, M.G., and Isaksson, A. (2006). Improved variance estimation of classification performance via reduction of bias caused by small sample size. BMC Bioinform., 7.","DOI":"10.1186\/1471-2105-7-127"},{"key":"ref_15","first-page":"273","article-title":"Tutorial on Practical Prediction Theory for Classification","volume":"6","author":"Langford","year":"2005","journal-title":"J. Mach. Learn. Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1960","DOI":"10.1016\/j.patrec.2008.06.018","article-title":"Cross-validation and bootstrapping are unreliable in small sample classification","volume":"29","author":"Isaksson","year":"2008","journal-title":"Pattern Recognit. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1023\/A:1024068626366","article-title":"Inference for the Generalization Error","volume":"52","author":"Nadeau","year":"2003","journal-title":"Mach. Learn."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1080\/00401706.1977.10489550","article-title":"Jackknifing in Unbalanced Situations","volume":"19","author":"Hinkley","year":"1977","journal-title":"Technometrics"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1198\/016214504000001907","article-title":"False Discovery Rate\u2013Adjusted Multiple Confidence Intervals for Selected Parameters","volume":"100","author":"Benjamini","year":"2005","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1016\/j.jbi.2011.02.005","article-title":"An empirical approach to model selection through validation for censored survival data","volume":"44","author":"Choi","year":"2011","journal-title":"J. Biomed. Inf."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1091","DOI":"10.1109\/TCBB.2012.31","article-title":"A hybrid approach to survival model building using integration of clinical and molecular information in censored data","volume":"9","author":"Choi","year":"2012","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinform."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Webb, A., and Copsey, K. (2011). Statistical Pattern Recognition, John Wiley & Sons, Ltd.. [3rd ed.].","DOI":"10.1002\/9781119952954"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hastie, T., Tibshirani, R., and Friedman, J. (2009). The Elements of Statistical Learning: Prediction, Inference and Data Mining, Springer. [2nd ed.].","DOI":"10.1007\/978-0-387-84858-7"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1007\/s10120-021-01267-5","article-title":"miRNAs derived from plasma small extracellular vesicles predict organo-tropic metastasis of gastric cancer","volume":"25","author":"Zhang","year":"2022","journal-title":"Gastric Cancer"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1322","DOI":"10.1016\/j.bbrc.2017.10.003","article-title":"A serum exosomal microRNA panel as a potential biomarker test for gastric cancer","volume":"493","author":"Wang","year":"2017","journal-title":"Biochem. Biophys. Res. Commun."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2570","DOI":"10.3748\/wjg.v26.i20.2570","article-title":"Serum outperforms plasma in small extracellular vesicle microRNA biomarker studies of adenocarcinoma of the esophagus","volume":"26","author":"Chiam","year":"2020","journal-title":"World J. Gastroenterol."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Butz, F., Eichelmann, A.K., Mayne, G.C., Wang, T., Bastian, I., Chiam, K., Marri, S., Sykes, P.J., Wijnhoven, B.P., and Toxopeus, E. (2020). MicroRNA Profiling in Oesophageal Adenocarcinoma Cell Lines and Patient Serum Samples Reveals a Role for miR-451a in Radiation Resistance. Int. J. Mol. Sci., 21.","DOI":"10.3390\/ijms21238898"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1535750","DOI":"10.1080\/20013078.2018.1535750","article-title":"Minimal information for studies of extracellular vesicles 2018 (MISEV2018): A position statement of the International Society for Extracellular Vesicles and update of the MISEV2014 guidelines","volume":"7","author":"Witwer","year":"2018","journal-title":"J. Extracell. Vesicles"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"R25","DOI":"10.1186\/gb-2010-11-3-r25","article-title":"A scaling normalization method for differential expression analysis of RNA-seq data","volume":"11","author":"Robinson","year":"2010","journal-title":"Genome Biol."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kirschner, M.B., Kao, S.C., Edelman, J.J., Armstrong, N.J., Vallely, M.P., van Zandwijk, N., and Reid, G. (2011). Haemolysis during sample preparation alters microRNA content of plasma. PLoS ONE, 6.","DOI":"10.1371\/journal.pone.0024145"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"315","DOI":"10.3892\/ol.2016.5452","article-title":"A methodological procedure for evaluating the impact of hemolysis on circulating microRNAs","volume":"13","author":"Pizzamiglio","year":"2017","journal-title":"Oncol. Lett."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"9546","DOI":"10.1073\/pnas.0914005107","article-title":"Independent filtering increases detection power for high-throughput experiments","volume":"107","author":"Bourgon","year":"2010","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Rosenberg, L.H., Franzen, B., Auer, G., Lehtio, J., and Forshed, J. (2010). Multivariate meta-analysis of proteomics data from human prostate and colon tumours. BMC Bioinform., 11.","DOI":"10.1186\/1471-2105-11-468"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1016\/j.csda.2006.12.019","article-title":"Relaxed Lasso","volume":"52","author":"Meinshausen","year":"2007","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1177\/0962280211428385","article-title":"The cross-validated AUC for MCP-logistic regression with high-dimensional data","volume":"22","author":"Jiang","year":"2013","journal-title":"Stat. Methods Med. Res."},{"key":"ref_36","unstructured":"Horn, R., and Johnson, C. (2013). Matrix Analysis, Cambridge University Press. [2nd ed.]."}],"container-title":["International Journal of Molecular Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1422-0067\/24\/8\/7068\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:14:02Z","timestamp":1760123642000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1422-0067\/24\/8\/7068"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,11]]},"references-count":36,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["ijms24087068"],"URL":"https:\/\/doi.org\/10.3390\/ijms24087068","relation":{},"ISSN":["1422-0067"],"issn-type":[{"type":"electronic","value":"1422-0067"}],"subject":[],"published":{"date-parts":[[2023,4,11]]}}}