{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T23:43:19Z","timestamp":1773013399320,"version":"3.50.1"},"reference-count":40,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2026,2,18]],"date-time":"2026-02-18T00:00:00Z","timestamp":1771372800000},"content-version":"vor","delay-in-days":17,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T00:00:00Z","timestamp":1769904000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"funder":[{"DOI":"10.13039\/100019827","name":"Meta","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100019827","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Stat Anal Data Min: An ASA Data Sci Journal"],"published-print":{"date-parts":[[2026,2]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:p>Paired samples are observations from two populations, commonly with each observed response from one population corresponding to an observed response from the other population at the same value of an ordinal covariate. Such pairs of responses at the same covariate values are called \u201cmatched pairs.\u201d Graphing cumulative differences between the two populations reveals differences in responses as a function of the covariate. The slope of the secant line connecting two points on the graph displays the average difference over the wide interval of covariate values between the points. (\u201cAverage\u201d means \u201cweighted average\u201d if the samples are weighted.) A Kuiper\u2010style statistic summarizes into a single scalar the differences over all covariate values. Kuiper's metric is the absolute value of the total difference in responses between the two populations, totaled over the interval of covariate values for which the absolute value is greatest. Dividing the total difference by the total weight ensures this normalized total becomes the (weighted) average over all covariate values when taking the total over the entire range of the covariate. These cumulative statistics are notably nonparametric, unlike traditional methods such as reliability diagrams or parametric or semi\u2010parametric regressions, which typically obscure significant differences due to their parameter settings.<\/jats:p>","DOI":"10.1002\/sam.70067","type":"journal-article","created":{"date-parts":[[2026,2,18]],"date-time":"2026-02-18T19:33:09Z","timestamp":1771443189000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Cumulative Differences Between Paired Samples"],"prefix":"10.1002","volume":"19","author":[{"given":"Isabel","family":"Kloumann","sequence":"first","affiliation":[{"name":"Fundamental Artificial Intelligence Research and Meta Super\u2010Intelligence Labs, Meta Platforms  Menlo Park California USA"}]},{"given":"Hannah","family":"Korevaar","sequence":"additional","affiliation":[{"name":"Fundamental Artificial Intelligence Research and Meta Super\u2010Intelligence Labs, Meta Platforms  Menlo Park California USA"}]},{"given":"Chris","family":"McConnell","sequence":"additional","affiliation":[{"name":"Fundamental Artificial Intelligence Research and Meta Super\u2010Intelligence Labs, Meta Platforms  Menlo Park California USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6389-799X","authenticated-orcid":false,"given":"Mark","family":"Tygert","sequence":"additional","affiliation":[{"name":"Fundamental Artificial Intelligence Research and Meta Super\u2010Intelligence Labs, Meta Platforms  Menlo Park California USA"}]},{"given":"Jessica","family":"Zhao","sequence":"additional","affiliation":[{"name":"Fundamental Artificial Intelligence Research and Meta Super\u2010Intelligence Labs, Meta Platforms  Menlo Park California USA"}]}],"member":"311","published-online":{"date-parts":[[2026,2,18]]},"reference":[{"key":"e_1_2_10_2_1","unstructured":"M.Tygert \u201cControlling for Multiple Covariates \u201d2021 Tech. rept. 2112.00672 arXiv https:\/\/arxiv.org\/abs\/2112.00672."},{"key":"e_1_2_10_3_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529684"},{"key":"e_1_2_10_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-6419.2007.00527.x"},{"key":"e_1_2_10_5_1","doi-asserted-by":"publisher","DOI":"10.1080\/00273171.2011.568786"},{"key":"e_1_2_10_6_1","doi-asserted-by":"publisher","DOI":"10.1201\/9781420035834"},{"key":"e_1_2_10_7_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2021.1883437"},{"key":"e_1_2_10_8_1","volume-title":"Statistics: A Biomedical Introduction","author":"Brown B. W.","year":"2007"},{"key":"e_1_2_10_9_1","first-page":"38","article-title":"Tests Concerning Random Points on a Circle","volume":"63","author":"Kuiper N. H.","year":"1962","journal-title":"Proceedings of the Koninklijke Nederlandse Akademie van Wetenschappen Series A"},{"key":"e_1_2_10_10_1","doi-asserted-by":"publisher","DOI":"10.2307\/3001968"},{"key":"e_1_2_10_11_1","volume-title":"Nonparametric Statistical Methods","author":"Hollander M.","year":"2014"},{"key":"e_1_2_10_12_1","doi-asserted-by":"publisher","DOI":"10.1002\/9781118625590"},{"key":"e_1_2_10_13_1","doi-asserted-by":"publisher","DOI":"10.1002\/9781118548387"},{"key":"e_1_2_10_14_1","first-page":"1","article-title":"Metrics of Calibration for Probabilistic Predictions","volume":"23","author":"Arrieta Ibarra I.","year":"2022","journal-title":"Journal of Machine Learning Research"},{"issue":"117","key":"e_1_2_10_15_1","first-page":"1","article-title":"Cumulative Deviation of a Subpopulation From the Full Population","volume":"8","author":"Tygert M.","year":"2021","journal-title":"Journal of Big Data"},{"issue":"158","key":"e_1_2_10_16_1","first-page":"1","article-title":"A Graphical Method of Cumulative Differences Between Two Subpopulations","volume":"8","author":"Tygert M.","year":"2021","journal-title":"Journal of Big Data"},{"issue":"70","key":"e_1_2_10_17_1","first-page":"1","article-title":"Calibration of P\u2010Values for Calibration and for Deviation of a Subpopulation From the Full Population","volume":"49","author":"Tygert M.","year":"2023","journal-title":"Advances in Computational Mathematics"},{"key":"e_1_2_10_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-7152(93)90167-H"},{"key":"e_1_2_10_19_1","doi-asserted-by":"publisher","DOI":"10.2307\/1401917"},{"key":"e_1_2_10_20_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177729437"},{"key":"e_1_2_10_21_1","doi-asserted-by":"publisher","DOI":"10.1175\/WAF993.1"},{"key":"e_1_2_10_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01199438"},{"key":"e_1_2_10_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01199431"},{"key":"e_1_2_10_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/69.908985"},{"key":"e_1_2_10_25_1","volume-title":"Introduction to Algorithms","author":"Cormen T. H.","year":"2009"},{"key":"e_1_2_10_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cam.2022.114494"},{"key":"e_1_2_10_27_1","doi-asserted-by":"publisher","DOI":"10.1175\/2008MWR2329.1"},{"key":"e_1_2_10_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-385022-5.00008-7"},{"key":"e_1_2_10_29_1","doi-asserted-by":"publisher","DOI":"10.1002\/sim.8281"},{"key":"e_1_2_10_30_1","doi-asserted-by":"publisher","DOI":"10.1137\/1109020"},{"issue":"4","key":"e_1_2_10_31_1","first-page":"359","article-title":"Smooth Regression Analysis","volume":"26","author":"Watson G. S.","year":"1964","journal-title":"Sankhya Series A"},{"key":"e_1_2_10_32_1","doi-asserted-by":"publisher","DOI":"10.1021\/ac60214a047"},{"key":"e_1_2_10_33_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1988.10478639"},{"key":"e_1_2_10_34_1","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1177013604"},{"key":"e_1_2_10_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01404567"},{"key":"e_1_2_10_36_1","volume-title":"Classification and Regression Trees","author":"Breiman L.","year":"1984"},{"key":"e_1_2_10_37_1","doi-asserted-by":"publisher","DOI":"10.2113\/gsecongeo.58.8.1246"},{"key":"e_1_2_10_38_1","doi-asserted-by":"publisher","DOI":"10.1017\/pan.2019.11"},{"key":"e_1_2_10_39_1","doi-asserted-by":"publisher","DOI":"10.1177\/1077558710361486"},{"key":"e_1_2_10_40_1","doi-asserted-by":"publisher","DOI":"10.1093\/ndt\/gfh104"},{"key":"e_1_2_10_41_1","first-page":"1","article-title":"T\u2010Cal: An Optimal Test for the Calibration of Predictive Models","volume":"24","author":"Lee D.","year":"2023","journal-title":"Journal of Machine Learning Research"}],"container-title":["Statistical Analysis and Data Mining: An ASA Data Science Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/sam.70067","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/sam.70067","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/sam.70067","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T22:26:38Z","timestamp":1773008798000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/sam.70067"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,2]]}},"alternative-id":["10.1002\/sam.70067"],"URL":"https:\/\/doi.org\/10.1002\/sam.70067","archive":["Portico"],"relation":{},"ISSN":["1932-1864","1932-1872"],"issn-type":[{"value":"1932-1864","type":"print"},{"value":"1932-1872","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2]]},"assertion":[{"value":"2024-10-28","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-01-30","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-02-18","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70067"}}