{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T08:05:08Z","timestamp":1770710708522,"version":"3.49.0"},"reference-count":52,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2021,2,23]],"date-time":"2021-02-23T00:00:00Z","timestamp":1614038400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,2,23]],"date-time":"2021-02-23T00:00:00Z","timestamp":1614038400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Med Syst"],"published-print":{"date-parts":[[2021,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We present a protocol for integrating two types of biological data \u2013 clinical and molecular \u2013 for more effective classification of patients with cancer. The proposed approach is a hybrid between early and late data integration strategy. In this hybrid protocol, the set of informative clinical features is extended by the classification results based on molecular data sets. The results are then treated as new synthetic variables. The hybrid protocol was applied to METABRIC breast cancer samples and TCGA urothelial bladder carcinoma samples. Various data types were used for clinical endpoint prediction: clinical data, gene expression, somatic copy number aberrations, RNA-Seq, methylation, and reverse phase protein array. The performance of the hybrid data integration was evaluated with a repeated cross validation procedure and compared with other methods of data integration: early integration and late integration via super learning. The hybrid method gave similar results to those obtained by the best of the tested variants of super learning. What is more, the hybrid method allowed for further sensitivity analysis and recursive feature elimination, which led to compact predictive models for cancer clinical endpoints. For breast cancer, the final model consists of eight clinical variables and two synthetic features obtained from molecular data. For urothelial bladder carcinoma, only two clinical features and one synthetic variable were necessary to build the best predictive model. We have shown that the inclusion of the synthetic variables based on the RNA expression levels and copy number alterations can lead to improved quality of prognostic tests. Thus, it should be considered for inclusion in wider medical practice.<\/jats:p>","DOI":"10.1007\/s10916-021-01718-7","type":"journal-article","created":{"date-parts":[[2021,2,23]],"date-time":"2021-02-23T17:10:06Z","timestamp":1614100206000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Robust Data Integration Method for Classification of Biomedical Data"],"prefix":"10.1007","volume":"45","author":[{"given":"Aneta","family":"Polewko-Klim","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Krzysztof","family":"Mnich","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7928-4944","authenticated-orcid":false,"given":"Witold R.","family":"Rudnicki","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,2,23]]},"reference":[{"issue":"1","key":"1718_CR1","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/j.ccr.2012.06.008","volume":"22","author":"JS You","year":"2012","unstructured":"You J.S., Jones P.A.: Cancer genetics and epigenetics: two sides of the same coin? Cancer Cell 22(1):9\u201320, 2012. https:\/\/doi.org\/10.1016\/j.ccr.2012.06.008","journal-title":"Cancer Cell"},{"key":"1718_CR2","first-page":"303","volume":"163","author":"XH Chen","year":"2011","unstructured":"Chen X.H., Huang S., Kerr D.: Biomarkers in clinical medicine. IARC Sci. Publ. 163:303\u201322, 2011","journal-title":"IARC Sci. Publ."},{"key":"1718_CR3","first-page":"433","volume-title":"Predictive models for integrating clinical and genomic data","author":"S Dey","year":"2015","unstructured":"Dey S., Gupta R., Steinbach M., Kumar V.: Predictive models for integrating clinical and genomic data Boca Raton: CRC Press, 2015, pp. 433\u2013465"},{"issue":"5","key":"1718_CR4","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1038\/nrg.2018.4","volume":"19","author":"KJ Karczewski","year":"2018","unstructured":"Karczewski K.J., Snyder M.P.: Integrative omics for health and disease. Nat. Rev. Gen. 19(5):299\u2013310, 2018. https:\/\/doi.org\/10.1038\/nrg.2018.4","journal-title":"Nat. Rev. Gen."},{"key":"1718_CR5","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1016\/j.coisb.2019.03.007","volume":"15","author":"E Noor","year":"2019","unstructured":"Noor E., Cherkaoui S., Sauer U.: Biological insights through omics data integration. Curr. Opinion Syst. Biol. 15:39\u201347, 2019. https:\/\/doi.org\/10.1016\/j.coisb.2019.03.007","journal-title":"Curr. Opinion Syst. Biol."},{"key":"1718_CR6","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1016\/j.clinbiochem.2020.06.008","volume":"84","author":"A Tayanloo-Beik","year":"2020","unstructured":"Tayanloo-Beik A., Sarvari M., Payab M., Gilany K., Alavi-Moghadam S., Gholami M., Goodarzi P., Larijani B., Arjmand B.: OMICS insights into cancer histology; Metabolomics and proteomics approach. Clin. Biochem. 84: 13\u201320, 2020. https:\/\/doi.org\/10.1016\/j.clinbiochem.2020.06.008","journal-title":"Clin. Biochem."},{"issue":"1","key":"1718_CR7","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/S1875-5364(15)60002-4","volume":"13","author":"S-K Yan","year":"2015","unstructured":"Yan S.-K., Liu R.-H., Jin H.-Z., Liu X.-R., Ye J., Shan L., Zhang W.-D.: \u201cOmics\u201d in pharmaceutical research: overview, applications, challenges, and future perspectives. Chin. J. Nat. Med. 13(1):3\u201321, 2015. https:\/\/doi.org\/10.1016\/S1875-5364(15)60002-4","journal-title":"Chin. J. Nat. Med."},{"key":"1718_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/1177932219899051","volume":"14","author":"I Subramanian","year":"2020","unstructured":"Subramanian I., Verma S., Kumar S., Jere A., Anamika K.: Multi-omics Data Integration, Interpretation, and Its application. Bioinform. Biol. Insights 14: 1\u201324, 2020. https:\/\/doi.org\/10.1177\/1177932219899051","journal-title":"Bioinform. Biol. Insights"},{"issue":"3","key":"1718_CR9","doi-asserted-by":"publisher","first-page":"238","DOI":"10.3390\/genes10030238","volume":"10","author":"E L\u00f3pezde Maturana","year":"2019","unstructured":"L\u00f3pezde Maturana E., Alonso L., Alarc\u00f3n P., Mart\u00ed?n-Antoniano I.A., Pineda S., Piorno L., Calle M.L., Malats N.: Challenges in the Integration of Omics and Non-Omics data. Genes 10(3):238, 2019. https:\/\/doi.org\/10.3390\/genes10030238","journal-title":"Genes"},{"key":"1718_CR10","doi-asserted-by":"publisher","unstructured":"Xu C., Jackson S.A. (2019) Machine learning and complex biological data. Genome Biol. 20:76. https:\/\/doi.org\/10.1186\/s13059-019-1689-0","DOI":"10.1186\/s13059-019-1689-0"},{"issue":"1","key":"1718_CR11","doi-asserted-by":"publisher","first-page":"13504","DOI":"10.1038\/s41598-019-49967-4","volume":"9","author":"Z-Y Yang","year":"2019","unstructured":"Yang Z.-Y., Liu X.-Y., Shu J., Zhang H., Ren Y.-Q., Xu Z.-B., Liang Y.: Multi-view based integrative analysis of gene expression data for identifying biomarkers. Sci. Rep. 9(1):13504, 2019. https:\/\/doi.org\/10.1038\/s41598-019-49967-4","journal-title":"Sci. Rep."},{"issue":"2","key":"1718_CR12","doi-asserted-by":"publisher","first-page":"S15","DOI":"10.1186\/s12859-015-0857-9","volume":"17","author":"M Bersanelli","year":"2016","unstructured":"Bersanelli M., Mosca E., Remondini D., Giampieri E., Sala C., Castellani G., Milanesi L.: Methods for the integration of multi-omics data: mathematical aspects. BMC Bioinform. 17(2):S15, 2016. https:\/\/doi.org\/10.1186\/s12859-015-0857-9","journal-title":"BMC Bioinform."},{"issue":"2","key":"1718_CR13","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1093\/bib\/bbw113","volume":"19","author":"Y Li","year":"2018","unstructured":"Li Y., Wu F-X, Ngom A.: A review on machine learning principles for multi-view biological data integration. Brief. Bioinform. 19(2):325\u2013340, 2018. https:\/\/doi.org\/10.1093\/bib\/bbw113","journal-title":"Brief. Bioinform."},{"issue":"2","key":"1718_CR14","doi-asserted-by":"publisher","first-page":"87","DOI":"10.3390\/genes10020087","volume":"10","author":"B Mirza","year":"2019","unstructured":"Mirza B., Wang W., Wang J., Choi H., Chung N.C., Ping P.: Machine learning and integrative analysis of biomedical big data. Genes 10(2):87, 2019. https:\/\/doi.org\/10.3390\/genes10020087","journal-title":"Genes"},{"key":"1718_CR15","doi-asserted-by":"publisher","first-page":"89","DOI":"10.4137\/BIC.S33380","volume":"8","author":"HB Burke","year":"2016","unstructured":"Burke H.B.: Predicting clinical outcomes using molecular biomarkers. Biomarkers Cancer 8:89\u201399, 2016. https:\/\/doi.org\/10.4137\/BIC.S33380","journal-title":"Biomarkers Cancer"},{"key":"1718_CR16","unstructured":"Lu R., Tang R., Huang J.: Clinical Application of Molecular Features in Therapeutic Selection and Drug Development. In: (Fang L., Su C., Eds.) Statistical Methods in Biomarker and Early Clinical Development. Springer, 2019, pp. 137\u2013166"},{"issue":"1","key":"1718_CR17","doi-asserted-by":"publisher","first-page":"16954","DOI":"10.1038\/s41598-017-17031-8","volume":"7","author":"B Zhu","year":"2017","unstructured":"Zhu B., Song N., Shen R., Arora A., Machiela M.J., Song L., Landi M.T., Ghosh D., Chatterjee N., Baladandayuthapani V., Zhao H.: Integrating Clinical and Multiple Omics Data for Prognostic Assessment across Human Cancers. Sci. Rep. 7(1):16954, 2017. https:\/\/doi.org\/10.1038\/s41598-017-17031-8","journal-title":"Sci. Rep."},{"issue":"1","key":"1718_CR18","doi-asserted-by":"publisher","first-page":"351","DOI":"10.1186\/s12885-016-2361-7","volume":"16","author":"E L\u00f3pezde Maturana","year":"2016","unstructured":"L\u00f3pezde Maturana E., Picornell A., Masson-Lecomte A., Kogevinas M., M\u00e1rquez M., Carrato A., Tard\u00f3n A., Lloreta J., Garc\u00ed?a-Closas M., Silverman D., Rothman N., Chanock S., Real F.X., Goddard M.E., Malats N., On behalf of the SBC\/EPICURO Study Investigators: Prediction of non-muscle invasive bladder cancer outcomes assessed by innovative multimarker prognostic models. BMC Cancer 16(1):351, 2016. https:\/\/doi.org\/10.1186\/s12885-016-2361-7","journal-title":"BMC Cancer"},{"key":"1718_CR19","doi-asserted-by":"publisher","unstructured":"Lin E., Lane H-Y Machine learning and systems genomics approaches for multi-omics data. Biomarker Res. 5, 2017. https:\/\/doi.org\/10.1186\/s40364-017-0082-y","DOI":"10.1186\/s40364-017-0082-y"},{"key":"1718_CR20","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1016\/j.inffus.2018.09.012","volume":"50","author":"M Zitnik","year":"2019","unstructured":"Zitnik M., Nguyen F., Wang B., Leskovec J., Goldenberg A., Hoffman M.M.: Machine learning for integrating data in biology and medicine: principles, practice, and opportunities. Inform. Fusion 50:71\u201391, 2019. https:\/\/doi.org\/10.1016\/j.inffus.2018.09.012","journal-title":"Inform. Fusion"},{"issue":"1","key":"1718_CR21","doi-asserted-by":"publisher","first-page":"1174","DOI":"10.3182\/20060329-3-AU-2901.00189","volume":"39","author":"O Gevaert","year":"2006","unstructured":"Gevaert O., De Smet F., Timmerman D., Moreau Y., DeMoor B.: Integration of clinical and microarray data using bayesian networks. IFAC Proc. Vol. 39(1):1174\u20131179, 2006. https:\/\/doi.org\/10.3182\/20060329-3-AU-2901.00189","journal-title":"IFAC Proc. Vol."},{"key":"1718_CR22","doi-asserted-by":"publisher","unstructured":"Daemen A., Gevaert O., De Moor B Integration of clinical and microarray data with kernel methods. Proceedings of the 29th Annual International Conference of IEEE Engineering in Medicine and Biology Society (EMBC\u201907). 5411\u20135415, 2007. https:\/\/doi.org\/10.1109\/IEMBS.2007.4353566","DOI":"10.1109\/IEMBS.2007.4353566"},{"key":"1718_CR23","doi-asserted-by":"publisher","unstructured":"Lesi\u0144ski W., Mnich K., Kitlas Goli\u0144ska A., Rudnicki W.R. (2021) Integration of human cell lines gene expression and chemical properties of drugs for drug induced liver injury prediction. Biol. Direct 16:2. https:\/\/doi.org\/10.1186\/s13062-020-00286-z","DOI":"10.1186\/s13062-020-00286-z"},{"key":"1718_CR24","unstructured":"Polewko-Klim A., Rudnicki W.R.: Data integration strategy for robust classification of biomedical data. In: (Rocha A., Adeli H., Reis L., Costanzo S., Orovic I., Moreira F., Eds.) Advances in Intelligent Systems and Computing. WorldCIST 2020: Trends and Innovations in Information Systems and Technologies. Springer, Cham, 2020, pp. 596\u2013606"},{"key":"1718_CR25","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1186\/1476-4598-9-3","volume":"9","author":"W-J Kim","year":"2010","unstructured":"Kim W.-J., Kim E.-J., Kim S.-K., Kim Y.-J., Ha Y.-S., Jeong P., Kim M.-J., Yun S.-J., Lee K.M., Moon S.-K., Lee S.-C., Cha E.-J., Bae S.-C.: Predictive value of progression-related gene classifier in primary non-muscle invasive bladder cancer. Mol. Cancer 9: 3, 2010. https:\/\/doi.org\/10.1186\/1476-4598-9-3","journal-title":"Mol. Cancer"},{"key":"1718_CR26","doi-asserted-by":"publisher","first-page":"e40385","DOI":"10.1371\/journal.pone.0040385","volume":"7","author":"MH Van Vliet","year":"2012","unstructured":"Van Vliet M.H., Horlings H.M., Van de Vijver M., Reinders M.J.T.: Integration of clinical and gene expression data has a synergetic effect on predicting breast cancer outcome. PLoS ONE 7: e40385\u2013e40358, 2012. https:\/\/doi.org\/10.1371\/journal.pone.0040358","journal-title":"PLoS ONE"},{"key":"1718_CR27","volume-title":"R: A language and environment for statistical computing","author":"R. Core Team","year":"2017","unstructured":"R. Core Team: R: A language and environment for statistical computing Vienna: R Foundation for Statistical Computing, 2017. https:\/\/www.R-project.org\/"},{"issue":"10","key":"1718_CR28","doi-asserted-by":"publisher","first-page":"R80","DOI":"10.1186\/gb-2004-5-10-r80","volume":"5","author":"RC Gentleman","year":"2004","unstructured":"Gentleman R.C., Carey V.J., Bates D.M., Bolstad B., etal.: Bioconductor: open software development for computational biology and bioinformatics. Genome Biol. 5(10):R80, 2004. https:\/\/doi.org\/10.1186\/gb-2004-5-10-r80","journal-title":"Genome Biol."},{"key":"1718_CR29","doi-asserted-by":"publisher","first-page":"11479","DOI":"10.1038\/ncomms11479","volume":"7","author":"B Pereira","year":"2016","unstructured":"Pereira B., Chin S.-F., Rueda O.M., Vollan H.-K.M., Provenzano E., Bardwell H.A., Pugh M., Jones L., Russell R., Sammut S.-J., et al.: The somatic mutation profiles of 2,433 breast cancers refine their genomic and transcriptomic landscapes. Nat. Commun. 7: 11479, 2016. https:\/\/doi.org\/10.1038\/ncomms11479","journal-title":"Nat. Commun."},{"issue":"181","key":"1718_CR30","doi-asserted-by":"publisher","first-page":"181re1","DOI":"10.1126\/scitranslmed.3006112","volume":"5","author":"AA Margolin","year":"2013","unstructured":"Margolin A.A., Bilal E., Huang E., Norman T.C., et al.: Systematic analysis of challenge-driven improvements in molecular prognostic models for breast cancer. Sci. Transl. Med. 5(181):181re1, 2013. https:\/\/doi.org\/10.1126\/scitranslmed.3006112","journal-title":"Sci. Transl. Med."},{"key":"1718_CR31","unstructured":"Gentleman R., Carey V., Huber W., Hahne F. (2017) genefilter: Methods for filtering genes from high-throughput experiments. R package version 1.60.0"},{"key":"1718_CR32","unstructured":"Biosciences B (Accessed 16 January 2019) Robust Statistics in BD FACSDiva Software. https:\/\/www.bdbiosciences.com\/documents\/Robust_Statistics_in_BDFACSDiva.pdf"},{"issue":"7492","key":"1718_CR33","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1038\/nature12965","volume":"507","author":"JN Weinstein","year":"2014","unstructured":"Weinstein J.N., Akbani R., Broom B.M., Wang W., Verhaak R.G.W., McConkey D., Lerner S., Morgan M., Creighton C.J., Smith C., Kwiatkowski D.J., Cherniack A.D., Kim J., Sekhar Pedamallu C., Noble M.S., Al-Ahmadie H.A., Reuter V.E., Rosenberg J.E., Bajorin D.F., Bochner B.H., Solit D.B., Koppie T., Robinsonet E.A.: Comprehensive molecular characterization of urothelial bladder carcinoma. Nature 507 (7492): 315\u2013322, 2014. https:\/\/doi.org\/10.1038\/nature12965","journal-title":"Nature"},{"key":"1718_CR34","unstructured":"Leek J.T., Johnson W.E., Parker H.S., Fertig E.J., Jaffe A.E., Storey J.D., Zhang Y., Torres L.C. (2019) sva: Surrogate variable analysis. R package version 3.30.1"},{"issue":"4","key":"1718_CR35","doi-asserted-by":"publisher","first-page":"271","DOI":"10.3233\/FI-2010-288","volume":"101","author":"MB Kursa","year":"2010","unstructured":"Kursa M.B., Jankowski A., Rudnicki W.R.: Boruta\u2013a system for feature selection. Fund. Inform. 101(4):271\u2013285, 2010. https:\/\/doi.org\/10.3233\/FI-2010-288","journal-title":"Fund. Inform."},{"issue":"11","key":"1718_CR36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v036.i11","volume":"36","author":"MB Kursa","year":"2010","unstructured":"Kursa M.B., Rudnicki W.R., et al.: Feature selection with the boruta package. J. Stat. Softw. 36(11):1\u201313, 2010. https:\/\/doi.org\/10.18637\/jss.v036.i11","journal-title":"J. Stat. Softw."},{"issue":"103375","key":"1718_CR37","doi-asserted-by":"publisher","first-page":"1200","DOI":"10.1109\/MIPRO.2015.7160458","volume":"112","author":"A Jovi\u0107","year":"2015","unstructured":"Jovi\u0107 A., Brki\u0107 K., Bogunovi\u0107 N.: A review of feature selection methods with applications. 2015 38th Int. Convent. Inf. Commun. Technol. Electron. Microelectron. (MIPRO) 112(103375):1200\u20131205, 2015. https:\/\/doi.org\/10.1109\/MIPRO.2015.7160458","journal-title":"2015 38th Int. Convent. Inf. Commun. Technol. Electron. Microelectron. (MIPRO)"},{"issue":"1","key":"1718_CR38","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1214\/aoms\/1177730491","volume":"18","author":"HB Mann","year":"1947","unstructured":"Mann H.B., Whitney D.R.: Controlling the false discovery rate: A practical and powerful approach to multiple testing. Ann. Math. Stat. 18(1):50\u201360, 1947","journal-title":"Ann. Math. Stat."},{"key":"1718_CR39","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1016\/j.ins.2020.03.024","volume":"524","author":"K Mnich","year":"2020","unstructured":"Mnich K., Rudnicki W.R.: All-relevant feature selection using multidimensional filters with exhaustive search. Inf. Sci. 524:277\u2013297, 2020. https:\/\/doi.org\/10.1016\/j.ins.2020.03.024","journal-title":"Inf. Sci."},{"issue":"1","key":"1718_CR40","doi-asserted-by":"publisher","first-page":"198","DOI":"10.32614\/RJ-2019-019","volume":"11","author":"R Piliszek","year":"2019","unstructured":"Piliszek R., Mnich K., Migacz S., Tabaszewski P., Su\u0142ecki A., Polewko-Klim A., Rudnicki W.: MDFS: MultiDimensional Feature Selection in R. R J. 11(1):198\u2013210, 2019. https:\/\/doi.org\/10.32614\/RJ-2019-019","journal-title":"R J."},{"key":"1718_CR41","doi-asserted-by":"publisher","unstructured":"Carvajal-Rodriguez A., U\u00f1a Alvarez J.E.R.-A. (2009) A new multitest correction (sgof) that increases its statistical power when increasing the number of tests. BMC Bioinform. 10(209). https:\/\/doi.org\/10.1186\/1471-2105-10-209","DOI":"10.1186\/1471-2105-10-209"},{"key":"1718_CR42","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L.: Random forests. Mach. Learn. 45: 5\u201332, 2001. https:\/\/doi.org\/10.1023\/A:1010933404324","journal-title":"Mach. Learn."},{"issue":"3","key":"1718_CR43","first-page":"18","volume":"2","author":"L Andy","year":"2002","unstructured":"Andy L., Wiener M.: Classification and regression by randomforest. R News 2(3):18\u201322, 2002","journal-title":"R News"},{"issue":"90","key":"1718_CR44","first-page":"3133","volume":"15","author":"M Fern\u00e1ndez-Delgado","year":"2014","unstructured":"Fern\u00e1ndez-Delgado M., Cernadas E., Barro S., Amorim D.: Do we need hundreds of classifiers to solve real world classification problems? J. Mach. Learn. Res. 15(90):3133\u20133181, 2014","journal-title":"J. Mach. Learn. Res."},{"issue":"2","key":"1718_CR45","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1016\/0005-2795(75)90109-9","volume":"405","author":"B Matthews","year":"1975","unstructured":"Matthews B.: Comparison of the predicted and observed secondary structure of t4 phage lysozyme. Bioch. Biophys. Acta 405(2):442\u2013451, 1975. https:\/\/doi.org\/10.1016\/0005-2795(75)90109-9","journal-title":"Bioch. Biophys. Acta"},{"key":"1718_CR46","doi-asserted-by":"publisher","unstructured":"Van der Laan M.J., Polley E.C., Hubbard A.E. (2007) Super learner. Stat. Appl. Gen. Mol. Biol. 6(1). https:\/\/doi.org\/10.2202\/1544-6115.1309","DOI":"10.2202\/1544-6115.1309"},{"issue":"8","key":"1718_CR47","doi-asserted-by":"publisher","first-page":"796","DOI":"10.1038\/nmeth.2016","volume":"9","author":"D Marbach","year":"2012","unstructured":"Marbach D., Costello J.C., et al.: Wisdom of crowds for robust gene network inference. Nat. Methods 9(8):796\u2013804, 2012. https:\/\/doi.org\/10.1038\/nmeth.2016","journal-title":"Nat. Methods"},{"issue":"12","key":"1718_CR48","doi-asserted-by":"publisher","first-page":"1895","DOI":"10.1007\/s10994-018-5714-4","volume":"107","author":"I Tsamardinos","year":"2018","unstructured":"Tsamardinos I., Greasidou E., et al.: Bootstrapping the out-of-sample predictions for efficient and accurate cross-validation. Mach. Learn 107(12):1895\u20131922, 2018. https:\/\/doi.org\/10.1007\/s10994-018-5714-4","journal-title":"Mach. Learn"},{"key":"1718_CR49","doi-asserted-by":"crossref","unstructured":"Mnich K., Kitlas Goli\u0144ska A., Polewko-Klim A., Rudnicki W.R. (2020) Bootstrap Bias Corrected Cross Validation Applied to Super Learning. In: Krzhizhanovskaya, V. V., Z\u00e1vodszky, G. et al. (Eds.) Computational Science-ICCS 2020, Lecture Notes in Computer Science, pp. 550\u2013563. Cham: Springer International Publishing","DOI":"10.1007\/978-3-030-50420-5_41"},{"key":"1718_CR50","unstructured":"Kursa M.B., Rudnicki W.R. (2018) Boruta:wrapper algorithm for all relevant feature selection. https:\/\/CRAN.R-project.org\/package=Boruta. R package version 5.3.0"},{"key":"1718_CR51","unstructured":"Castro Conde I., U\u00f1a Alvarez J. (2016) sgof: Multiple hypothesis testing. R package version 2.3"},{"issue":"387673","key":"1718_CR52","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2013\/387673","volume":"2013","author":"N Dessi","year":"2013","unstructured":"Dessi N., Pascariello E., Pes B.: A comparative analysis of biomarker selection techniques. BioMed Res. Int. 2013(387673):1\u201310, 2013. https:\/\/doi.org\/10.1155\/2013\/387673","journal-title":"BioMed Res. Int."}],"container-title":["Journal of Medical Systems"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10916-021-01718-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10916-021-01718-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10916-021-01718-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,19]],"date-time":"2021-03-19T10:55:06Z","timestamp":1616151306000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10916-021-01718-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,23]]},"references-count":52,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,4]]}},"alternative-id":["1718"],"URL":"https:\/\/doi.org\/10.1007\/s10916-021-01718-7","relation":{},"ISSN":["0148-5598","1573-689X"],"issn-type":[{"value":"0148-5598","type":"print"},{"value":"1573-689X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,23]]},"assertion":[{"value":"8 October 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 January 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 February 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with Ethical Standards"}},{"value":"All authors declare that they have no conflicts of interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}},{"value":"This article does not contain any studies with human participants or animals performed by any of the authors.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}],"article-number":"45"}}