{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,17]],"date-time":"2026-02-17T12:13:05Z","timestamp":1771330385697,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":50,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,6,2]],"date-time":"2023-06-02T00:00:00Z","timestamp":1685664000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF (National Science Foundation)","doi-asserted-by":"publisher","award":["IIS-1908774"],"award-info":[{"award-number":["IIS-1908774"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,6,2]]},"DOI":"10.1145\/3564246.3585182","type":"proceedings-article","created":{"date-parts":[[2023,5,16]],"date-time":"2023-05-16T17:34:20Z","timestamp":1684258460000},"page":"1727-1740","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["A Unifying Theory of Distance from Calibration"],"prefix":"10.1145","author":[{"given":"Jaros\u0142aw","family":"B\u0142asiok","sequence":"first","affiliation":[{"name":"Columbia University, USA"}]},{"given":"Parikshit","family":"Gopalan","sequence":"additional","affiliation":[{"name":"Apple, USA"}]},{"given":"Lunjia","family":"Hu","sequence":"additional","affiliation":[{"name":"Stanford University, USA"}]},{"given":"Preetum","family":"Nakkiran","sequence":"additional","affiliation":[{"name":"Apple, USA"}]}],"member":"320","published-online":{"date-parts":[[2023,6,2]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Imanol Arrieta-Ibarra Paman Gujral Jonathan Tannen Mark Tygert and Cherie Xu. 2022. Metrics of calibration for probabilistic predictions. arXiv preprint arXiv:2205.09680. \t\t\t\t  Imanol Arrieta-Ibarra Paman Gujral Jonathan Tannen Mark Tygert and Cherie Xu. 2022. Metrics of calibration for probabilistic predictions. arXiv preprint arXiv:2205.09680."},{"key":"e_1_3_2_1_2_1","unstructured":"A. Berlinet and C. Thomas-Agnan. 2011. Reproducing Kernel Hilbert Spaces in Probability and Statistics. Springer US. isbn:9781441990969 lccn:2003064182 https:\/\/books.google.com\/books?id=bX3TBwAAQBAJ \t\t\t\t  A. Berlinet and C. Thomas-Agnan. 2011. Reproducing Kernel Hilbert Spaces in Probability and Statistics. Springer US. isbn:9781441990969 lccn:2003064182 https:\/\/books.google.com\/books?id=bX3TBwAAQBAJ"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/100216.100225"},{"key":"e_1_3_2_1_4_1","volume-title":"Verification of forecasts expressed in terms of probability. Monthly weather review, 78, 1","author":"Brier Glenn W","year":"1950","unstructured":"Glenn W Brier . 1950. Verification of forecasts expressed in terms of probability. Monthly weather review, 78, 1 ( 1950 ), 1\u20133. Glenn W Brier. 1950. Verification of forecasts expressed in terms of probability. Monthly weather review, 78, 1 (1950), 1\u20133."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Jaros\u0142aw B\u0142asiok Parikshit Gopalan Lunjia Hu and Preetum Nakkiran. 2022. A Unifying Theory of Distance from Calibration. arxiv:2211.16886. \t\t\t\t  Jaros\u0142aw B\u0142asiok Parikshit Gopalan Lunjia Hu and Preetum Nakkiran. 2022. A Unifying Theory of Distance from Calibration. arxiv:2211.16886.","DOI":"10.1145\/3564246.3585182"},{"key":"e_1_3_2_1_6_1","volume-title":"Assessing calibration of prognostic risk scores. Statistical methods in medical research, 25, 4","author":"Crowson Cynthia S","year":"2016","unstructured":"Cynthia S Crowson , Elizabeth J Atkinson , and Terry M Therneau . 2016. Assessing calibration of prognostic risk scores. Statistical methods in medical research, 25, 4 ( 2016 ), 1692\u20131706. Cynthia S Crowson, Elizabeth J Atkinson, and Terry M Therneau. 2016. Assessing calibration of prognostic risk scores. Statistical methods in medical research, 25, 4 (2016), 1692\u20131706."},{"key":"e_1_3_2_1_7_1","volume-title":"Objective Probability Forecasts","author":"Dawid A. P.","unstructured":"A. P. Dawid . 1982. Objective Probability Forecasts . University College London, Dept. of Statistical Science . Research Report 14. A. P. Dawid. 1982. Objective Probability Forecasts. University College London, Dept. of Statistical Science. Research Report 14."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1982.10477856"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.2307\/2981683"},{"key":"e_1_3_2_1_10_1","first-page":"1251","article-title":"Calibration-based empirical probability","author":"Dawid A Philip","year":"1985","unstructured":"A Philip Dawid . 1985 . Calibration-based empirical probability . The Annals of Statistics , 1251 \u2013 1274 . A Philip Dawid. 1985. Calibration-based empirical probability. The Annals of Statistics, 1251\u20131274.","journal-title":"The Annals of Statistics"},{"key":"e_1_3_2_1_11_1","first-page":"1","article-title":"The comparison and evaluation of forecasters","volume":"32","author":"DeGroot Morris H","year":"1983","unstructured":"Morris H DeGroot and Stephen E Fienberg . 1983 . The comparison and evaluation of forecasters . Journal of the Royal Statistical Society: Series D (The Statistician) , 32 , 1 - 2 (1983), 12\u201322. Morris H DeGroot and Stephen E Fienberg. 1983. The comparison and evaluation of forecasters. Journal of the Royal Statistical Society: Series D (The Statistician), 32, 1-2 (1983), 12\u201322.","journal-title":"Journal of the Royal Statistical Society: Series D (The Statistician)"},{"key":"e_1_3_2_1_12_1","volume-title":"Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Computerized medical imaging and graphics, 31, 4-5","author":"Doi Kunio","year":"2007","unstructured":"Kunio Doi . 2007. Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Computerized medical imaging and graphics, 31, 4-5 ( 2007 ), 198\u2013211. Kunio Doi. 2007. Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Computerized medical imaging and graphics, 31, 4-5 (2007), 198\u2013211."},{"key":"e_1_3_2_1_13_1","volume-title":"Outcome Indistinguishability. In ACM Symposium on Theory of Computing (STOC\u201921)","author":"Dwork Cynthia","year":"2021","unstructured":"Cynthia Dwork , Michael P. Kim , Omer Reingold , Guy N. Rothblum , and Gal Yona . 2021 . Outcome Indistinguishability. In ACM Symposium on Theory of Computing (STOC\u201921) . arxiv:2011.13426 Cynthia Dwork, Michael P. Kim, Omer Reingold, Guy N. Rothblum, and Gal Yona. 2021. Outcome Indistinguishability. In ACM Symposium on Theory of Computing (STOC\u201921). arxiv:2011.13426"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.geb.2017.12.022"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/85.2.379"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/285055.285060"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.4230\/LIPIcs.ITCS.2023.60"},{"key":"e_1_3_2_1_18_1","volume-title":"Omer Reingold, Vatsal Sharan, and Udi Wieder.","author":"Gopalan Parikshit","year":"2022","unstructured":"Parikshit Gopalan , Adam Tauman Kalai , Omer Reingold, Vatsal Sharan, and Udi Wieder. 2022 . Omnipredictors. In Innovations in Theoretical Computer Science (ITCS\u2019 2022). arxiv:2109.05389 Parikshit Gopalan, Adam Tauman Kalai, Omer Reingold, Vatsal Sharan, and Udi Wieder. 2022. Omnipredictors. In Innovations in Theoretical Computer Science (ITCS\u20192022). arxiv:2109.05389"},{"key":"e_1_3_2_1_19_1","volume-title":"Low-Degree Multicalibration. In Conference on Learning Theory","volume":"3234","author":"Gopalan Parikshit","year":"2022","unstructured":"Parikshit Gopalan , Michael P. Kim , Mihir Singhal , and Shengjia Zhao . 2022 . Low-Degree Multicalibration. In Conference on Learning Theory , 2-5 July 2022, London, UK (Proceedings of Machine Learning Research , Vol. 178). PMLR, 3193\u2013 3234 . Parikshit Gopalan, Michael P. Kim, Mihir Singhal, and Shengjia Zhao. 2022. Low-Degree Multicalibration. In Conference on Learning Theory, 2-5 July 2022, London, UK (Proceedings of Machine Learning Research, Vol. 178). PMLR, 3193\u20133234."},{"key":"e_1_3_2_1_20_1","volume-title":"International Conference on Machine Learning. 1321\u20131330","author":"Guo Chuan","year":"2017","unstructured":"Chuan Guo , Geoff Pleiss , Yu Sun , and Kilian Q Weinberger . 2017 . On calibration of modern neural networks . In International Conference on Machine Learning. 1321\u20131330 . Chuan Guo, Geoff Pleiss, Yu Sun, and Kilian Q Weinberger. 2017. On calibration of modern neural networks. In International Conference on Machine Learning. 1321\u20131330."},{"key":"e_1_3_2_1_21_1","unstructured":"Kartik Gupta Amir Rahimi Thalaiyasingam Ajanthan Thomas Mensink Cristian Sminchisescu and Richard Hartley. 2020. Calibration of neural networks using splines. arXiv preprint arXiv:2006.12800. \t\t\t\t  Kartik Gupta Amir Rahimi Thalaiyasingam Ajanthan Thomas Mensink Cristian Sminchisescu and Richard Hartley. 2020. Calibration of neural networks using splines. arXiv preprint arXiv:2006.12800."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0493(1920)48<645:FPIPOP>2.0.CO;2"},{"key":"e_1_3_2_1_23_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning, ICML.","author":"H\u00e9bert-Johnson \u00darsula","unstructured":"\u00darsula H\u00e9bert-Johnson , Michael P. Kim , Omer Reingold , and Guy N. Rothblum . 2018. Multicalibration: Calibration for the (Computationally-Identifiable) Masses . In Proceedings of the 35th International Conference on Machine Learning, ICML. \u00darsula H\u00e9bert-Johnson, Michael P. Kim, Omer Reingold, and Guy N. Rothblum. 2018. Multicalibration: Calibration for the (Computationally-Identifiable) Masses. In Proceedings of the 35th International Conference on Machine Learning, ICML."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000291"},{"key":"e_1_3_2_1_25_1","volume-title":"Deterministic calibration and Nash equilibrium. J. Comput. System Sci., 74(1)","author":"Kakade Sham","year":"2008","unstructured":"Sham Kakade and Dean Foster . 2008. Deterministic calibration and Nash equilibrium. J. Comput. System Sci., 74(1) ( 2008 ), 115\u2013130. Sham Kakade and Dean Foster. 2008. Deterministic calibration and Nash equilibrium. J. Comput. System Sci., 74(1) (2008), 115\u2013130."},{"key":"e_1_3_2_1_26_1","first-page":"29768","article-title":"Soft calibration objectives for neural networks","volume":"34","author":"Karandikar Archit","year":"2021","unstructured":"Archit Karandikar , Nicholas Cain , Dustin Tran , Balaji Lakshminarayanan , Jonathon Shlens , Michael C Mozer , and Becca Roelofs . 2021 . Soft calibration objectives for neural networks . Advances in Neural Information Processing Systems , 34 (2021), 29768 \u2013 29779 . Archit Karandikar, Nicholas Cain, Dustin Tran, Balaji Lakshminarayanan, Jonathon Shlens, Michael C Mozer, and Becca Roelofs. 2021. Soft calibration objectives for neural networks. Advances in Neural Information Processing Systems, 34 (2021), 29768\u201329779.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_27_1","unstructured":"Michael Kearns Seth Neel Aaron Roth and Zhiwei Steven Wu. 2017. Preventing fairness gerrymandering: Auditing and learning for subgroup fairness. arXiv preprint arXiv:1711.05144. \t\t\t\t  Michael Kearns Seth Neel Aaron Roth and Zhiwei Steven Wu. 2017. Preventing fairness gerrymandering: Auditing and learning for subgroup fairness. arXiv preprint arXiv:1711.05144."},{"key":"e_1_3_2_1_28_1","volume-title":"International Conference on Machine Learning. 2564\u20132572","author":"Kearns Michael","year":"2018","unstructured":"Michael Kearns , Seth Neel , Aaron Roth , and Zhiwei Steven Wu . 2018 . Preventing fairness gerrymandering: Auditing and learning for subgroup fairness . In International Conference on Machine Learning. 2564\u20132572 . Michael Kearns, Seth Neel, Aaron Roth, and Zhiwei Steven Wu. 2018. Preventing fairness gerrymandering: Auditing and learning for subgroup fairness. In International Conference on Machine Learning. 2564\u20132572."},{"key":"e_1_3_2_1_29_1","volume-title":"Inherent Trade-Offs in the Fair Determination of Risk Scores. In 8th Innovations in Theoretical Computer Science Conference, ITCS.","author":"Kleinberg Jon M.","year":"2017","unstructured":"Jon M. Kleinberg , Sendhil Mullainathan , and Manish Raghavan . 2017 . Inherent Trade-Offs in the Fair Determination of Risk Scores. In 8th Innovations in Theoretical Computer Science Conference, ITCS. Jon M. Kleinberg, Sendhil Mullainathan, and Manish Raghavan. 2017. Inherent Trade-Offs in the Fair Determination of Risk Scores. In 8th Innovations in Theoretical Computer Science Conference, ITCS."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-020-00367-3"},{"key":"e_1_3_2_1_31_1","unstructured":"Ananya Kumar Percy S Liang and Tengyu Ma. 2019. Verified uncertainty calibration. In Advances in Neural Information Processing Systems. 3792\u20133803. \t\t\t\t  Ananya Kumar Percy S Liang and Tengyu Ma. 2019. Verified uncertainty calibration. In Advances in Neural Information Processing Systems. 3792\u20133803."},{"key":"e_1_3_2_1_32_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning, Jennifer Dy and Andreas Krause (Eds.) (Proceedings of Machine Learning Research","volume":"2814","author":"Kumar Aviral","year":"2018","unstructured":"Aviral Kumar , Sunita Sarawagi , and Ujjwal Jain . 2018 . Trainable Calibration Measures for Neural Networks from Kernel Mean Embeddings . In Proceedings of the 35th International Conference on Machine Learning, Jennifer Dy and Andreas Krause (Eds.) (Proceedings of Machine Learning Research , Vol. 80). PMLR, 2805\u2013 2814 . https:\/\/proceedings.mlr.press\/v80\/kumar18a.html Aviral Kumar, Sunita Sarawagi, and Ujjwal Jain. 2018. Trainable Calibration Measures for Neural Networks from Kernel Mean Embeddings. In Proceedings of the 35th International Conference on Machine Learning, Jennifer Dy and Andreas Krause (Eds.) (Proceedings of Machine Learning Research, Vol. 80). PMLR, 2805\u20132814. https:\/\/proceedings.mlr.press\/v80\/kumar18a.html"},{"key":"e_1_3_2_1_33_1","unstructured":"Donghwan Lee Xinmeng Huang Hamed Hassani and Edgar Dobriban. 2022. T-Cal: An optimal test for the calibration of predictive models. arXiv preprint arXiv:2203.01850. \t\t\t\t  Donghwan Lee Xinmeng Huang Hamed Hassani and Edgar Dobriban. 2022. T-Cal: An optimal test for the calibration of predictive models. arXiv preprint arXiv:2203.01850."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.2214\/ajr.183.5.1831209"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"crossref","unstructured":"Matthew Mealiffe Renee Stokowski Brian Rhees Ross Prentice Mary Pettinger and David Hinds. 2010. Clinical validity assessment of a breast cancer risk model combining genetic and clinical information. Nature Precedings 1\u20131. \t\t\t\t  Matthew Mealiffe Renee Stokowski Brian Rhees Ross Prentice Mary Pettinger and David Hinds. 2010. Clinical validity assessment of a breast cancer risk model combining genetic and clinical information. Nature Precedings 1\u20131.","DOI":"10.1038\/npre.2010.4295.1"},{"key":"e_1_3_2_1_36_1","first-page":"15682","article-title":"Revisiting the calibration of modern neural networks","volume":"34","author":"Minderer Matthias","year":"2021","unstructured":"Matthias Minderer , Josip Djolonga , Rob Romijnders , Frances Hubis , Xiaohua Zhai , Neil Houlsby , Dustin Tran , and Mario Lucic . 2021 . Revisiting the calibration of modern neural networks . Advances in Neural Information Processing Systems , 34 (2021), 15682 \u2013 15694 . Matthias Minderer, Josip Djolonga, Rob Romijnders, Frances Hubis, Xiaohua Zhai, Neil Houlsby, Dustin Tran, and Mario Lucic. 2021. Revisiting the calibration of modern neural networks. Advances in Neural Information Processing Systems, 34 (2021), 15682\u201315694.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_37_1","volume-title":"The early history of probability forecasts: Some extensions and clarifications. Weather and forecasting, 13, 1","author":"Murphy Allan H","year":"1998","unstructured":"Allan H Murphy . 1998. The early history of probability forecasts: Some extensions and clarifications. Weather and forecasting, 13, 1 ( 1998 ), 5\u201315. Allan H Murphy. 1998. The early history of probability forecasts: Some extensions and clarifications. Weather and forecasting, 13, 1 (1998), 5\u201315."},{"key":"e_1_3_2_1_38_1","first-page":"489","article-title":"Probability forecasting in meteorology","volume":"79","author":"Murphy Allan H","year":"1984","unstructured":"Allan H Murphy and Robert L Winkler . 1984 . Probability forecasting in meteorology . J. Amer. Statist. Assoc. , 79 , 387 (1984), 489 \u2013 500 . Allan H Murphy and Robert L Winkler. 1984. Probability forecasting in meteorology. J. Amer. Statist. Assoc., 79, 387 (1984), 489\u2013500.","journal-title":"J. Amer. Statist. Assoc."},{"key":"e_1_3_2_1_39_1","volume-title":"Marcin Sieniek, Jim Winkens, Yuan Liu, and Peggy Bui.","author":"Mustafa Basil","year":"2021","unstructured":"Basil Mustafa , Aaron Loh , Jan Freyberg , Patricia MacWilliams , Megan Wilson , Scott Mayer McKinney , Marcin Sieniek, Jim Winkens, Yuan Liu, and Peggy Bui. 2021 . Supervised transfer learning at scale for medical imaging. arXiv preprint arXiv:2101.05913. Basil Mustafa, Aaron Loh, Jan Freyberg, Patricia MacWilliams, Megan Wilson, Scott Mayer McKinney, Marcin Sieniek, Jim Winkens, Yuan Liu, and Peggy Bui. 2021. Supervised transfer learning at scale for medical imaging. arXiv preprint arXiv:2101.05913."},{"key":"e_1_3_2_1_40_1","unstructured":"Mahdi Pakdaman Naeini Gregory F Cooper and Milos Hauskrecht. 2014. Binary classifier calibration: Non-parametric approach. arXiv preprint arXiv:1401.3390. \t\t\t\t  Mahdi Pakdaman Naeini Gregory F Cooper and Milos Hauskrecht. 2014. Binary classifier calibration: Non-parametric approach. arXiv preprint arXiv:1401.3390."},{"key":"e_1_3_2_1_41_1","volume-title":"Proceedings of the... AAAI Conference on Artificial Intelligence. AAAI Conference on Artificial Intelligence.","author":"Naeini Mahdi Pakdaman","year":"2015","unstructured":"Mahdi Pakdaman Naeini , Gregory F Cooper , and Milos Hauskrecht . 2015 . Obtaining well calibrated probabilities using bayesian binning . In Proceedings of the... AAAI Conference on Artificial Intelligence. AAAI Conference on Artificial Intelligence. 2015, 2901. Mahdi Pakdaman Naeini, Gregory F Cooper, and Milos Hauskrecht. 2015. Obtaining well calibrated probabilities using bayesian binning. In Proceedings of the... AAAI Conference on Artificial Intelligence. AAAI Conference on Artificial Intelligence. 2015, 2901."},{"key":"e_1_3_2_1_42_1","volume-title":"CVPR Workshops. 2.","author":"Nixon Jeremy","year":"2019","unstructured":"Jeremy Nixon , Michael W Dusenberry , Linchuan Zhang , Ghassen Jerfel , and Dustin Tran . 2019 . Measuring Calibration in Deep Learning .. In CVPR Workshops. 2. Jeremy Nixon, Michael W Dusenberry, Linchuan Zhang, Ghassen Jerfel, and Dustin Tran. 2019. Measuring Calibration in Deep Learning.. In CVPR Workshops. 2."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcss.2006.03.002"},{"key":"e_1_3_2_1_44_1","first-page":"20063","article-title":"Uncertainty quantification and deep ensembles","volume":"34","author":"Rahaman Rahul","year":"2021","unstructured":"Rahul Rahaman . 2021 . Uncertainty quantification and deep ensembles . Advances in Neural Information Processing Systems , 34 (2021), 20063 \u2013 20075 . Rahul Rahaman. 2021. Uncertainty quantification and deep ensembles. Advances in Neural Information Processing Systems, 34 (2021), 20063\u201320075.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_45_1","volume-title":"Advances in Neural Information Processing Systems","author":"Rahimi Ali","year":"2007","unstructured":"Ali Rahimi and Benjamin Recht . 2007. Random Features for Large-Scale Kernel Machines . In Advances in Neural Information Processing Systems , J. Platt, D. Koller, Y. Singer, and S. Roweis (Eds.). 20, Curran Associates, Inc. . https:\/\/proceedings.neurips.cc\/paper\/ 2007 \/file\/013a006f03dbc5392effeb8f18fda755-Paper.pdf Ali Rahimi and Benjamin Recht. 2007. Random Features for Large-Scale Kernel Machines. In Advances in Neural Information Processing Systems, J. Platt, D. Koller, Y. Singer, and S. Roweis (Eds.). 20, Curran Associates, Inc.. https:\/\/proceedings.neurips.cc\/paper\/2007\/file\/013a006f03dbc5392effeb8f18fda755-Paper.pdf"},{"key":"e_1_3_2_1_46_1","volume-title":"International Conference on Artificial Intelligence and Statistics. 4036\u20134054","author":"Roelofs Rebecca","year":"2022","unstructured":"Rebecca Roelofs , Nicholas Cain , Jonathon Shlens , and Michael C Mozer . 2022 . Mitigating bias in calibration error estimation . In International Conference on Artificial Intelligence and Statistics. 4036\u20134054 . Rebecca Roelofs, Nicholas Cain, Jonathon Shlens, and Michael C Mozer. 2022. Mitigating bias in calibration error estimation. In International Conference on Artificial Intelligence and Statistics. 4036\u20134054."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1137\/S0097539793255151"},{"key":"e_1_3_2_1_48_1","volume-title":"Fifth European Conference on Speech Communication and Technology.","author":"Gish Herbert","year":"1997","unstructured":"Man-hung Siu, Herbert Gish , and Fred Richardson . 1997 . Improved estimation, evaluation and applications of confidence measures for speech recognition . In Fifth European Conference on Speech Communication and Technology. Man-hung Siu, Herbert Gish, and Fred Richardson. 1997. Improved estimation, evaluation and applications of confidence measures for speech recognition. In Fifth European Conference on Speech Communication and Technology."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X14547233"},{"key":"e_1_3_2_1_50_1","volume-title":"International conference on machine learning. 11117\u201311128","author":"Zhang Jize","year":"2020","unstructured":"Jize Zhang , Bhavya Kailkhura , and T Yong-Jin Han . 2020 . Mix-n-match: Ensemble and compositional methods for uncertainty calibration in deep learning . In International conference on machine learning. 11117\u201311128 . Jize Zhang, Bhavya Kailkhura, and T Yong-Jin Han. 2020. Mix-n-match: Ensemble and compositional methods for uncertainty calibration in deep learning. In International conference on machine learning. 11117\u201311128."}],"event":{"name":"STOC '23: 55th Annual ACM Symposium on Theory of Computing","location":"Orlando FL USA","acronym":"STOC '23","sponsor":["SIGACT ACM Special Interest Group on Algorithms and Computation Theory"]},"container-title":["Proceedings of the 55th Annual ACM Symposium on Theory of Computing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3564246.3585182","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3564246.3585182","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3564246.3585182","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:47:00Z","timestamp":1750178820000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3564246.3585182"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,2]]},"references-count":50,"alternative-id":["10.1145\/3564246.3585182","10.1145\/3564246"],"URL":"https:\/\/doi.org\/10.1145\/3564246.3585182","relation":{},"subject":[],"published":{"date-parts":[[2023,6,2]]},"assertion":[{"value":"2023-06-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}