{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T22:07:20Z","timestamp":1772489240630,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":28,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,7,25]],"date-time":"2019-07-25T00:00:00Z","timestamp":1564012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Robert Wood Johnson Foundation"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,7,25]]},"DOI":"10.1145\/3292500.3330903","type":"proceedings-article","created":{"date-parts":[[2019,7,26]],"date-time":"2019-07-26T13:17:26Z","timestamp":1564147046000},"page":"54-64","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["A Permutation Approach to Assess Confounding in Machine Learning Applications for Digital Health"],"prefix":"10.1145","author":[{"given":"Elias","family":"Chaibub Neto","sequence":"first","affiliation":[{"name":"Sage Bionetworks, Seattle, WA, USA"}]},{"given":"Abhishek","family":"Pratap","sequence":"additional","affiliation":[{"name":"Sage Bionetworks, Seattle, WA, USA"}]},{"given":"Thanneer M.","family":"Perumal","sequence":"additional","affiliation":[{"name":"Sage Bionetworks, Seattle, WA, USA"}]},{"given":"Meghasyam","family":"Tummalacherla","sequence":"additional","affiliation":[{"name":"Sage Bionetworks, Seattle, WA, USA"}]},{"given":"Brian M.","family":"Bot","sequence":"additional","affiliation":[{"name":"Sage Bionetworks, Seattle, WA, USA"}]},{"given":"Lara","family":"Mangravite","sequence":"additional","affiliation":[{"name":"Sage Bionetworks, Seattle, WA, USA"}]},{"given":"Larsson","family":"Omberg","sequence":"additional","affiliation":[{"name":"Sage Bionetworks, Seattle, WA, USA"}]}],"member":"320","published-online":{"date-parts":[[2019,7,25]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"International Conference on Machine Learning (ICML","author":"Jastrzebski Stanislaw","year":"2017"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/0022-2496(75)90001-2"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.11"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"crossref","unstructured":"in Dai Shilin Ding and Grace Wahba. 2013. Multivariate Bernoulli distribution. Bernoulli textbf19: 1465--1483.  in Dai Shilin Ding and Grace Wahba. 2013. Multivariate Bernoulli distribution. Bernoulli textbf19: 1465--1483.","DOI":"10.3150\/12-BEJSP10"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","unstructured":"lizabeth R. DeLong David M. DeLong and Daniel L. Clarke-Pearson. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics textbf44: 837--845.  lizabeth R. DeLong David M. DeLong and Daniel L. Clarke-Pearson. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics textbf44: 837--845.","DOI":"10.2307\/2531595"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"crossref","unstructured":"ndre Esteva Brett Kuprel Roberto A. Novoa Justin Ko Susan M. Swetter Helen M. Blau and Sebastian Thrun. 2017. Dermatologist-level classification of skin cancer with deep neural networks. Nature textbf542: 115--118.  ndre Esteva Brett Kuprel Roberto A. Novoa Justin Ko Susan M. Swetter Helen M. Blau and Sebastian Thrun. 2017. Dermatologist-level classification of skin cancer with deep neural networks. Nature textbf542: 115--118.","DOI":"10.1038\/nature21056"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"crossref","unstructured":"effrey Alan Golden. 2017. Deep learning algorithms for detection of lymph node metastases from breast cancer: helping artificial intelligence be seen. Jama textbf318: 2184--2186.  effrey Alan Golden. 2017. Deep learning algorithms for detection of lymph node metastases from breast cancer: helping artificial intelligence be seen. Jama textbf318: 2184--2186.","DOI":"10.1001\/jama.2017.14580"},{"key":"e_1_3_2_1_9_1","volume-title":"Permutation tests: a practical guide to resampling methods for testing hypothesis","edition":"2"},{"key":"e_1_3_2_1_10_1","volume-title":"Webster","author":"Peng Lily","year":"2016"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Annals of Mathematical Statistics textbf19: 293--325. 1948 A class of statistics with asymptotically normal distribution","DOI":"10.1214\/aoms\/1177730196"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","unstructured":"eung-uk Ko Magdalena I. Tolea Jeffrey M. Hausdorff and Luigi Ferrucci. 2011. Sex-specific differences in gait patterns of healthy older adults: results from the Baltimore longitudinal study of aging. Journal of Biomechanics textbf44: 1974--1979.  eung-uk Ko Magdalena I. Tolea Jeffrey M. Hausdorff and Luigi Ferrucci. 2011. Sex-specific differences in gait patterns of healthy older adults: results from the Baltimore longitudinal study of aging. Journal of Biomechanics textbf44: 1974--1979.","DOI":"10.1016\/j.jbiomech.2011.05.005"},{"key":"e_1_3_2_1_13_1","volume-title":"Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence (AAAI-16)","author":"Culotta Aron","year":"2016"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1002\/sim.3782"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177729639"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btr204"},{"key":"e_1_3_2_1_17_1","unstructured":"ndy Liaw and Matthew Wiener. 2002. Classification and regression by randomForest. R News textbf2 18--22.  ndy Liaw and Matthew Wiener. 2002. Classification and regression by randomForest. R News textbf2 18--22."},{"key":"e_1_3_2_1_18_1","volume-title":"Shinohara","author":"Linn A.","year":"2016"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1256\/003590002320603584"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"crossref","unstructured":"omain Pirracchio Maya L. Petersen and Mark van der Laan. 2014. Improving propensity scores estimators' robustness to model misspecification using super learner. American Journal of Epidemiology textbf181: 108--119.  omain Pirracchio Maya L. Petersen and Mark van der Laan. 2014. Improving propensity scores estimators' robustness to model misspecification using super learner. American Journal of Epidemiology textbf181: 108--119.","DOI":"10.1093\/aje\/kwu253"},{"key":"e_1_3_2_1_21_1","volume-title":"R: A language and environment for statistical computing","author":"Team Core","year":"2018"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"crossref","unstructured":"nil Rao Joao M. Monteiro Janaina Mourao-Miranda. 2017. Predictive modelling using neuroimaging data in the presence of confounds. NeuroImage textbf150: 23--49.  nil Rao Joao M. Monteiro Janaina Mourao-Miranda. 2017. Predictive modelling using neuroimaging data in the presence of confounds. NeuroImage textbf150: 23--49.","DOI":"10.1016\/j.neuroimage.2017.01.066"},{"key":"e_1_3_2_1_23_1","unstructured":"avier Robin Natacha Turck Alexandre Hainard Natalia Tiberti Frederique Lisacek Jean-Charles Sanchez and Markus Muller. pROC: an open-source package for R and S  avier Robin Natacha Turck Alexandre Hainard Natalia Tiberti Frederique Lisacek Jean-Charles Sanchez and Markus Muller. pROC: an open-source package for R and S"},{"key":"e_1_3_2_1_24_1","unstructured":"to analyze and compare ROC curves. BMC Bioinformatics textbf12 77.  to analyze and compare ROC curves. BMC Bioinformatics textbf12 77."},{"key":"e_1_3_2_1_25_1","volume-title":"Rubin","author":"Rosenbaum R.","year":"1983"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"crossref","volume-title":"Approximation theorems of mathematical statistics","author":"Serfling J.","DOI":"10.1002\/9780470316481"},{"key":"e_1_3_2_1_27_1","volume-title":"Friend","author":"Trister D.","year":"2016"},{"key":"e_1_3_2_1_28_1","volume-title":"International Conference on Learning Representations (ICRL","author":"Bengio Samy","year":"2017"}],"event":{"name":"KDD '19: The 25th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","location":"Anchorage AK USA","acronym":"KDD '19","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3292500.3330903","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3292500.3330903","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:26:03Z","timestamp":1750206363000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3292500.3330903"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,25]]},"references-count":28,"alternative-id":["10.1145\/3292500.3330903","10.1145\/3292500"],"URL":"https:\/\/doi.org\/10.1145\/3292500.3330903","relation":{},"subject":[],"published":{"date-parts":[[2019,7,25]]},"assertion":[{"value":"2019-07-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}