{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,20]],"date-time":"2026-02-20T00:49:07Z","timestamp":1771548547897,"version":"3.50.1"},"publisher-location":"Cham","reference-count":45,"publisher":"Springer International Publishing","isbn-type":[{"value":"9783030676698","type":"print"},{"value":"9783030676704","type":"electronic"}],"license":[{"start":{"date-parts":[[2021,1,1]],"date-time":"2021-01-01T00:00:00Z","timestamp":1609459200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,2,25]],"date-time":"2021-02-25T00:00:00Z","timestamp":1614211200000},"content-version":"vor","delay-in-days":55,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Machine learning (ML) methods are increasingly being used to predict pathologies and biological traits using neuroimaging data. Here controlling for confounds is essential to get unbiased estimates of generalization performance and to identify the features driving predictions. However, a systematic evaluation of the advantages and disadvantages of available alternatives is lacking. This makes it difficult to compare results across studies and to build deployment quality models. Here, we evaluated two commonly used confound removal schemes\u2013whole data confound regression (WDCR) and cross-validated confound regression (CVCR)\u2013to understand their effectiveness and biases induced in generalization performance estimation. Additionally, we study the interaction of the confound removal schemes with Z-score normalization, a common practice in ML modelling. We applied eight combinations of confound removal schemes and normalization (pipelines) to decode sex from resting-state functional MRI (rfMRI) data while controlling for two confounds, brain size and age. We show that both schemes effectively remove linear univariate and multivariate confounding effects resulting in reduced model performance with CVCR providing better generalization estimates, i.e., closer to out-of-sample performance than WDCR. We found no effect of normalizing before or after confound removal. In the presence of dataset and confound shift, four tested confound removal procedures yielded mixed results, raising new questions. We conclude that CVCR is a better method to control for confounding effects in neuroimaging studies. We believe that our in-depth analyses shed light on choices associated with confound removal and hope that it generates more interest in this problem instrumental to numerous applications.<\/jats:p>","DOI":"10.1007\/978-3-030-67670-4_1","type":"book-chapter","created":{"date-parts":[[2021,2,24]],"date-time":"2021-02-24T17:04:13Z","timestamp":1614186253000},"page":"3-18","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":32,"title":["Confound Removal and Normalization in Practice: A Neuroimaging Based Sex Prediction Case Study"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1272-217X","authenticated-orcid":false,"given":"Shammi","family":"More","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6363-2759","authenticated-orcid":false,"given":"Simon B.","family":"Eickhoff","sequence":"additional","affiliation":[]},{"given":"Julian","family":"Caspers","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0289-5480","authenticated-orcid":false,"given":"Kaustubh R.","family":"Patil","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,2,25]]},"reference":[{"issue":"1","key":"1_CR1","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1002\/wics.51","volume":"2","author":"H Abdi","year":"2010","unstructured":"Abdi, H.: Partial least squares regression and projection on latent structure regression (pls regression). Wiley Interdiscip. Rev. Comput. Stat. 2(1), 97\u2013106 (2010)","journal-title":"Wiley Interdiscip. Rev. Comput. Stat."},{"key":"1_CR2","unstructured":"Adeli, E., Zhao, Q., Pfefferbaum, A., Sullivan, E.V., Fei-Fei, L., Niebles, J.C., et al.: Representation learning with statistical independence to mitigate bias. arXiv:1910.03676 (2019)"},{"issue":"3","key":"1_CR3","doi-asserted-by":"publisher","first-page":"839","DOI":"10.1016\/j.neuroimage.2005.02.018","volume":"26","author":"J Ashburner","year":"2005","unstructured":"Ashburner, J., Friston, K.J.: Unified segmentation. Neuroimage 26(3), 839\u2013851 (2005)","journal-title":"Neuroimage"},{"issue":"4","key":"1_CR4","doi-asserted-by":"publisher","first-page":"1244","DOI":"10.1016\/j.neuroimage.2010.06.025","volume":"53","author":"J Barnes","year":"2010","unstructured":"Barnes, J., Ridgway, G.R., Bartlett, J., Henley, S.M., Lehmann, M., Hobbs, N., et al.: Head size, age and gender adjustment in mri studies: a necessary nuisance? Neuroimage 53(4), 1244\u20131255 (2010)","journal-title":"Neuroimage"},{"key":"1_CR5","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1016\/j.dcn.2013.11.004","volume":"7","author":"M Cao","year":"2014","unstructured":"Cao, M., Wang, J.H., Dai, Z.J., Cao, X.Y., Jiang, L.L., Fan, F.M., et al.: Topological organization of the human brain functional connectome across the lifespan. Developmental Cognitive Neurosci. 7, 76\u201393 (2014)","journal-title":"Developmental Cognitive Neurosci."},{"key":"1_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2174\/1874440001206010001","volume":"6","author":"R Casanova","year":"2012","unstructured":"Casanova, R., Whitlow, C., Wagner, B., Espeland, M., Maldjian, J.: Combining graph and machine learning methods to analyze differences in functional connectivity across sex. The Open Neuroimaging Journal 6, 1 (2012)","journal-title":"The Open Neuroimaging Journal"},{"key":"1_CR7","unstructured":"Cawley, G.C., Talbot, N.L.: On over-fitting in model selection and subsequent selection bias in performance evaluation. J. Machine Learn. Res. 11, 2079\u20132107 (2010)"},{"key":"1_CR8","doi-asserted-by":"publisher","first-page":"1282","DOI":"10.3389\/fnins.2019.01282","volume":"13","author":"C Chen","year":"2019","unstructured":"Chen, C., Cao, X., Tian, L.: Partial least squares regression performs well in mri-based individualized estimations. Front. Neurosci. 13, 1282 (2019)","journal-title":"Front. Neurosci."},{"issue":"3","key":"1_CR9","doi-asserted-by":"publisher","first-page":"282","DOI":"10.1016\/j.biopsych.2019.08.031","volume":"87","author":"J Chen","year":"2020","unstructured":"Chen, J., Patil, K.R., Weis, S., Sim, K., Nickl-Jockschat, T., Zhou, J., et al.: Neurobiological divergence of the positive and negative schizophrenia subtypes identified on a new factor structure of psychopathology using non-negative factorization: An international machine learning study. Biol. Psychiatry 87(3), 282\u2013293 (2020)","journal-title":"Biol. Psychiatry"},{"key":"1_CR10","doi-asserted-by":"crossref","unstructured":"Chyzhyk, D., Varoquaux, G., Thirion, B., Milham, M.: Controlling a confound in predictive models with a test set minimizing its effect. In: 2018 International Workshop on Pattern Recognition in Neuroimaging (PRNI), pp. 1\u20134. IEEE (2018)","DOI":"10.1109\/PRNI.2018.8423961"},{"issue":"5997","key":"1_CR11","doi-asserted-by":"publisher","first-page":"1358","DOI":"10.1126\/science.1194144","volume":"329","author":"NU Dosenbach","year":"2010","unstructured":"Dosenbach, N.U., Nardos, B., Cohen, A.L., Fair, D.A., Power, J.D., Church, J.A., et al.: Prediction of individual brain maturity using FMRI. Science 329(5997), 1358\u20131361 (2010)","journal-title":"Science"},{"issue":"9","key":"1_CR12","doi-asserted-by":"publisher","first-page":"700","DOI":"10.1038\/nrn2201","volume":"8","author":"MD Fox","year":"2007","unstructured":"Fox, M.D., Raichle, M.E.: Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging. Nat. Rev. Neurosci. 8(9), 700\u2013711 (2007)","journal-title":"Nat. Rev. Neurosci."},{"key":"1_CR13","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1016\/j.neuroimage.2014.03.034","volume":"95","author":"L Griffanti","year":"2014","unstructured":"Griffanti, L., Salimi-Khorshidi, G., Beckmann, C.F., Auerbach, E.J., Douaud, G., Sexton, C.E., et al.: Ica-based artefact removal and accelerated FMRI acquisition for improved resting state network imaging. Neuroimage 95, 232\u2013247 (2014)","journal-title":"Neuroimage"},{"issue":"1","key":"1_CR14","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1038\/mp.2016.201","volume":"22","author":"T Hahn","year":"2017","unstructured":"Hahn, T., Nierenberg, A., Whitfield-Gabrieli, S.: Predictive analytics in mental health: applications, guidelines, challenges and perspectives. Molecular Psychiatry 22(1), 37\u201343 (2017)","journal-title":"Molecular Psychiatry"},{"issue":"1","key":"1_CR15","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1080\/00401706.2000.10485983","volume":"42","author":"AE Hoerl","year":"2000","unstructured":"Hoerl, A.E., Kennard, R.W.: Ridge regression: biased estimation for nonorthogonal problems. Technometrics 42(1), 80\u201386 (2000)","journal-title":"Technometrics"},{"key":"1_CR16","unstructured":"Kilbertus, N., Ball, P.J., Kusner, M.J., Weller, A., Silva, R.: The sensitivity of counterfactual fairness to unmeasured confounding. arXiv:1907.01040 (2019)"},{"key":"1_CR17","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1016\/j.neuroimage.2014.04.057","volume":"98","author":"D Kostro","year":"2014","unstructured":"Kostro, D., Abdulkadir, A., Durr, A., Roos, R., Leavitt, B.R., Johnson, H., et al.: Correction of inter-scanner and within-subject variance in structural mri based automated diagnosing. NeuroImage 98, 405\u2013415 (2014)","journal-title":"NeuroImage"},{"key":"1_CR18","unstructured":"Kusner, M.J., Loftus, J., Russell, C., Silva, R.: Counterfactual fairness. In: Advances in Neural Information Processing Systems, pp. 4066\u20134076 (2017)"},{"key":"1_CR19","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1613\/jair.1.11248","volume":"63","author":"V Landeiro","year":"2018","unstructured":"Landeiro, V., Culotta, A.: Robust text classification under confounding shift. J. Artif. Intell. Res. 63, 391\u2013419 (2018)","journal-title":"J. Artif. Intell. Res."},{"key":"1_CR20","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1016\/j.neuroimage.2016.11.005","volume":"148","author":"F Liem","year":"2017","unstructured":"Liem, F., Varoquaux, G., Kynast, J., Beyer, F., Masouleh, S.K., Huntenburg, J.M., et al.: Predicting brain-age from multimodal imaging data captures cognitive impairment. Neuroimage 148, 179\u2013188 (2017)","journal-title":"Neuroimage"},{"issue":"2","key":"1_CR21","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1016\/j.dcn.2010.10.001","volume":"1","author":"MP Lopez-Larson","year":"2011","unstructured":"Lopez-Larson, M.P., Anderson, J.S., Ferguson, M.A., Yurgelun-Todd, D.: Local brain connectivity and associations with gender and age. Dev. Cogn. Neurosci. 1(2), 187\u2013197 (2011)","journal-title":"Dev. Cogn. Neurosci."},{"issue":"1","key":"1_CR22","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1016\/j.tics.2013.10.011","volume":"18","author":"DI Miller","year":"2014","unstructured":"Miller, D.I., Halpern, D.F.: The new science of cognitive sex differences. Trends in Cognitive Sciences 18(1), 37\u201345 (2014)","journal-title":"Trends in Cognitive Sciences"},{"key":"1_CR23","doi-asserted-by":"publisher","first-page":"152","DOI":"10.3389\/fnins.2012.00152","volume":"6","author":"KB Nooner","year":"2012","unstructured":"Nooner, K.B., Colcombe, S., Tobe, R., Mennes, M., Benedict, M., Moreno, A., et al.: The nki-rockland sample: a model for accelerating the pace of discovery science in psychiatry. Front. Neurosci. 6, 152 (2012)","journal-title":"Front. Neurosci."},{"issue":"8","key":"1_CR24","doi-asserted-by":"publisher","first-page":"1194","DOI":"10.1038\/s41431-018-0159-6","volume":"26","author":"O Pain","year":"2018","unstructured":"Pain, O., Dudbridge, F., Ronald, A.: Are your covariates under control? how normalization can re-introduce covariate effects. Euro. J. Hum. Genet. 26(8), 1194\u20131201 (2018)","journal-title":"Euro. J. Hum. Genet."},{"key":"1_CR25","doi-asserted-by":"publisher","first-page":"116604","DOI":"10.1016\/j.neuroimage.2020.116604","volume":"211","author":"U Pervaiz","year":"2020","unstructured":"Pervaiz, U., Vidaurre, D., Woolrich, M.W., Smith, S.M.: Optimising network modelling methods for FMRI. NeuroImage 211, 116604 (2020)","journal-title":"NeuroImage"},{"issue":"11","key":"1_CR26","doi-asserted-by":"publisher","first-page":"649","DOI":"10.11622\/smedj.2016144","volume":"58","author":"L Picco","year":"2017","unstructured":"Picco, L., Subramaniam, M., Abdin, E., Vaingankar, J.A., Chong, S.A.: Gender differences in major depressive disorder: findings from the singapore mental health study. Singapore Med. J. 58(11), 649 (2017)","journal-title":"Singapore Med. J."},{"issue":"2","key":"1_CR27","first-page":"79","volume":"5","author":"MA Pourhoseingholi","year":"2012","unstructured":"Pourhoseingholi, M.A., Baghestani, A.R., Vahedi, M.: How to control confounding effects by statistical analysis. Gastroenterol Hepatol Bed Bench 5(2), 79 (2012)","journal-title":"Gastroenterol Hepatol Bed Bench"},{"key":"1_CR28","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1016\/j.neuroimage.2017.01.066","volume":"150","author":"A Rao","year":"2017","unstructured":"Rao, A., Monteiro, J.M., Mourao-Miranda, J., Initiative, A.D., et al.: Predictive modelling using neuroimaging data in the presence of confounds. NeuroImage 150, 23\u201349 (2017)","journal-title":"NeuroImage"},{"issue":"8","key":"1_CR29","doi-asserted-by":"publisher","first-page":"2959","DOI":"10.1093\/cercor\/bhy109","volume":"28","author":"SJ Ritchie","year":"2018","unstructured":"Ritchie, S.J., Cox, S.R., Shen, X., Lombardo, M.V., Reus, L.M., Alloza, C., et al.: Sex differences in the adult human brain: evidence from 5216 uk biobank participants. Cerebral Cortex 28(8), 2959\u20132975 (2018)","journal-title":"Cerebral Cortex"},{"key":"1_CR30","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1016\/j.neubiorev.2013.12.004","volume":"39","author":"AN Ruigrok","year":"2014","unstructured":"Ruigrok, A.N., et al.: A meta-analysis of sex differences in human brain structure. Neurosci. Biobehav. Rev. 39, 34\u201350 (2014)","journal-title":"Neurosci. Biobehav. Rev."},{"key":"1_CR31","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1016\/j.neuroimage.2013.11.046","volume":"90","author":"G Salimi-Khorshidi","year":"2014","unstructured":"Salimi-Khorshidi, G., Douaud, G., Beckmann, C.F., Glasser, M.F., Griffanti, L., et al.: Automatic denoising of functional mri data: combining independent component analysis and hierarchical fusion of classifiers. Neuroimage 90, 449\u2013468 (2014)","journal-title":"Neuroimage"},{"key":"1_CR32","doi-asserted-by":"publisher","first-page":"240","DOI":"10.1016\/j.neuroimage.2012.08.052","volume":"64","author":"TD Satterthwaite","year":"2013","unstructured":"Satterthwaite, T.D., Elliott, M.A., Gerraty, R.T., Ruparel, K., Loughead, J., Calkins, M.E., et al.: An improved framework for confound regression and filtering for control of motion artifact in the preprocessing of resting-state functional connectivity data. Neuroimage 64, 240\u2013256 (2013)","journal-title":"Neuroimage"},{"issue":"12","key":"1_CR33","doi-asserted-by":"publisher","first-page":"1641","DOI":"10.1176\/ajp.154.12.1641","volume":"154","author":"MV Seeman","year":"1997","unstructured":"Seeman, M.V.: Psychopathology in women and men: focus on female hormones. Am. J. Psychiatry 154(12), 1641\u20131647 (1997)","journal-title":"Am. J. Psychiatry"},{"key":"1_CR34","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1016\/j.neuroimage.2013.05.039","volume":"80","author":"SM Smith","year":"2013","unstructured":"Smith, S.M., Beckmann, C.F., Andersson, J., Auerbach, E.J., Bijsterbosch, J., Douaud, G., et al.: Resting-state FMRI in the human connectome project. Neuroimage 80, 144\u2013168 (2013)","journal-title":"Neuroimage"},{"key":"1_CR35","doi-asserted-by":"publisher","first-page":"741","DOI":"10.1016\/j.neuroimage.2018.09.074","volume":"184","author":"L Snoek","year":"2019","unstructured":"Snoek, L., Mileti\u0107, S., Scholte, H.S.: How to control for confounds in decoding analyses of neuroimaging data. NeuroImage 184, 741\u2013760 (2019)","journal-title":"NeuroImage"},{"key":"1_CR36","doi-asserted-by":"crossref","unstructured":"Stephan, K., Friston, K., Squire, L.: Functional connectivity. Encyclopedia of Neuroscience, pp. 391\u2013397 (2009)","DOI":"10.1016\/B978-008045046-9.00308-9"},{"key":"1_CR37","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1016\/j.neuroimage.2013.03.039","volume":"77","author":"MT Todd","year":"2013","unstructured":"Todd, M.T., Nystrom, L.E., Cohen, J.D.: Confounds in multivariate pattern analysis: theory and rule representation case study. Neuroimage 77, 157\u2013165 (2013)","journal-title":"Neuroimage"},{"issue":"4","key":"1_CR38","doi-asserted-by":"publisher","first-page":"c317","DOI":"10.1159\/000319590","volume":"116","author":"G Tripepi","year":"2010","unstructured":"Tripepi, G., Jager, K.J., Dekker, F.W., Zoccali, C.: Stratification for confounding-part 1: the mantel-haenszel formula. Nephron Clin. Pract. 116(4), c317\u2013c321 (2010)","journal-title":"Nephron Clin. Pract."},{"issue":"4","key":"1_CR39","doi-asserted-by":"publisher","first-page":"2222","DOI":"10.1016\/j.neuroimage.2012.02.018","volume":"62","author":"DC Van Essen","year":"2012","unstructured":"Van Essen, D.C., Ugurbil, K., Auerbach, E., Barch, D., Behrens, T., Bucholz, R., Chang, A., et al.: The human connectome project: a data acquisition perspective. Neuroimage 62(4), 2222\u20132231 (2012)","journal-title":"Neuroimage"},{"key":"1_CR40","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1007\/978-3-030-32251-9_53","volume-title":"Medical Image Computing and Computer Assisted Intervention \u2013 MICCAI 2019","author":"C Wachinger","year":"2019","unstructured":"Wachinger, C., Becker, B.G., Rieckmann, A., P\u00f6lsterl, S.: Quantifying confounding bias in neuroimaging datasets with causal inference. In: Shen, D., Liu, T., Peters, T.M., Staib, L.H., Essert, C., Zhou, S., Yap, P.-T., Khan, A. (eds.) MICCAI 2019. LNCS, vol. 11767, pp. 484\u2013492. Springer, Cham (2019). https:\/\/doi.org\/10.1007\/978-3-030-32251-9_53"},{"issue":"2","key":"1_CR41","doi-asserted-by":"publisher","first-page":"824","DOI":"10.1093\/cercor\/bhz129","volume":"30","author":"S Weis","year":"2020","unstructured":"Weis, S., Patil, K.R., Hoffstaedter, F., Nostro, A., Yeo, B.T., Eickhoff, S.B.: Sex classification by resting state brain connectivity. Cerebral Cortex 30(2), 824\u2013835 (2020)","journal-title":"Cerebral Cortex"},{"issue":"2","key":"1_CR42","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1097\/WCO.0b013e32835ee548","volume":"26","author":"DM Werling","year":"2013","unstructured":"Werling, D.M., Geschwind, D.H.: Sex differences in autism spectrum disorders. Current Opinion Neurol. 26(2), 146 (2013)","journal-title":"Current Opinion Neurol."},{"key":"1_CR43","doi-asserted-by":"crossref","unstructured":"Xu, C., Li, C., Wu, H., Wu, Y., Hu, S., Zhu, Y., et al.: Gender differences in cerebral regional homogeneity of adult healthy volunteers: a resting-state FMRI study. BioMed research international 2015 (2015)","DOI":"10.1155\/2015\/183074"},{"issue":"1","key":"1_CR44","doi-asserted-by":"publisher","first-page":"394","DOI":"10.1016\/j.neuroimage.2003.12.030","volume":"22","author":"Y Zang","year":"2004","unstructured":"Zang, Y., Jiang, T., Lu, Y., He, Y., Tian, L.: Regional homogeneity approach to FMRI data analysis. Neuroimage 22(1), 394\u2013400 (2004)","journal-title":"Neuroimage"},{"issue":"4","key":"1_CR45","doi-asserted-by":"publisher","first-page":"1765","DOI":"10.1002\/hbm.23950","volume":"39","author":"C Zhang","year":"2018","unstructured":"Zhang, C., Dougherty, C.C., Baum, S.A., White, T., Michael, A.M.: Functional connectivity predicts gender: evidence for gender differences in resting brain connectivity. Human Brain Mapp. 39(4), 1765\u20131776 (2018)","journal-title":"Human Brain Mapp."}],"container-title":["Lecture Notes in Computer Science","Machine Learning and Knowledge Discovery in Databases. Applied Data Science and Demo Track"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-67670-4_1","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,23]],"date-time":"2025-02-23T23:08:03Z","timestamp":1740352083000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-030-67670-4_1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"ISBN":["9783030676698","9783030676704"],"references-count":45,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-67670-4_1","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021]]},"assertion":[{"value":"25 February 2021","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"ECML PKDD","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Joint European Conference on Machine Learning and Knowledge Discovery in Databases","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Ghent","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Belgium","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2020","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"14 September 2020","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"18 September 2020","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"ecml2020","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/ecmlpkdd2020.net\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Double-blind","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"EasyChair","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"945","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"195","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"0","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"21% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"4,5","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"4,4","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"No","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"The conference took place virtually due to the COVID-19 pandemic","order":10,"name":"additional_info_on_review_process","label":"Additional Info on Review Process","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}}]}}