{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,4,26]],"date-time":"2023-04-26T04:37:10Z","timestamp":1682483830415},"publisher-location":"New York, NY, USA","reference-count":28,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,4,25]]},"DOI":"10.1145\/3485447.3512096","type":"proceedings-article","created":{"date-parts":[[2022,4,25]],"date-time":"2022-04-25T05:11:23Z","timestamp":1650863483000},"update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["MBCT: Tree-Based Feature-Aware Binning for Individual Uncertainty Calibration"],"prefix":"10.1145","author":[{"given":"Siguang","family":"Huang","sequence":"first","affiliation":[{"name":"Alibaba Group, China"}]},{"given":"Yunli","family":"Wang","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}]},{"given":"Lili","family":"Mou","sequence":"additional","affiliation":[{"name":"Dept Computing Science, Alberta Machine Intelligence Institute (Amii), University of Alberta, Canada"}]},{"given":"Huayue","family":"Zhang","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}]},{"given":"Han","family":"Zhu","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}]},{"given":"Chuan","family":"Yu","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}]},{"given":"Bo","family":"Zheng","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}]}],"member":"320","published-online":{"date-parts":[[2022,4,25]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Moloud Abdar Farhad Pourpanah Sadiq Hussain Dana Rezazadegan Li Liu Mohammad Ghavamzadeh Paul Fieguth Abbas Khosravi U\u00a0Rajendra Acharya Vladimir Makarenkov 2020. A review of uncertainty quantification in deep learning: techniques applications and challenges. arXiv preprint arXiv:2011.06225(2020). Moloud Abdar Farhad Pourpanah Sadiq Hussain Dana Rezazadegan Li Liu Mohammad Ghavamzadeh Paul Fieguth Abbas Khosravi U\u00a0Rajendra Acharya Vladimir Makarenkov 2020. A review of uncertainty quantification in deep learning: techniques applications and challenges. arXiv preprint arXiv:2011.06225(2020)."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3269260"},{"key":"e_1_3_2_1_3_1","first-page":"1512","article-title":"Reliability, sufficiency, and the decomposition of proper scores","volume":"135","author":"Br\u00f6cker Jochen","year":"2009","unstructured":"Jochen Br\u00f6cker . 2009 . Reliability, sufficiency, and the decomposition of proper scores . Journal of the Atmospheric Sciences and Physical Oceanography 135 , 643(2009), 1512 \u2013 1519 . Jochen Br\u00f6cker. 2009. Reliability, sufficiency, and the decomposition of proper scores. Journal of the Atmospheric Sciences and Physical Oceanography 135, 643(2009), 1512\u20131519.","journal-title":"Journal of the Atmospheric Sciences and Physical Oceanography"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_3_2_1_5_1","first-page":"1","article-title":"The comparison and evaluation of forecasters","volume":"32","author":"DeGroot H","year":"1983","unstructured":"Morris\u00a0 H DeGroot and Stephen\u00a0 E Fienberg . 1983 . The comparison and evaluation of forecasters . Journal of the Royal Statistical Society: Series D (The Statistician) 32 , 1 - 2 (1983), 12\u201322. Morris\u00a0H DeGroot and Stephen\u00a0E Fienberg. 1983. The comparison and evaluation of forecasters. Journal of the Royal Statistical Society: Series D (The Statistician) 32, 1-2(1983), 12\u201322.","journal-title":"Journal of the Royal Statistical Society: Series D (The Statistician)"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1006\/jcss.1997.1504"},{"key":"e_1_3_2_1_7_1","volume-title":"Weather forecasting with ensemble methods. Science 310, 5746","author":"Gneiting Tilmann","year":"2005","unstructured":"Tilmann Gneiting and Adrian\u00a0 E Raftery . 2005. Weather forecasting with ensemble methods. Science 310, 5746 ( 2005 ), 248\u2013249. Tilmann Gneiting and Adrian\u00a0E Raftery. 2005. Weather forecasting with ensemble methods. Science 310, 5746 (2005), 248\u2013249."},{"key":"e_1_3_2_1_8_1","volume-title":"International Conference on Machine Learning. 1321\u20131330","author":"Guo Chuan","year":"2017","unstructured":"Chuan Guo , Geoff Pleiss , Yu Sun , and Kilian\u00a0 Q Weinberger . 2017 . On calibration of modern neural networks . In International Conference on Machine Learning. 1321\u20131330 . Chuan Guo, Geoff Pleiss, Yu Sun, and Kilian\u00a0Q Weinberger. 2017. On calibration of modern neural networks. In International Conference on Machine Learning. 1321\u20131330."},{"key":"e_1_3_2_1_9_1","unstructured":"Chirag Gupta Aleksandr Podkopaev and Aaditya Ramdas. 2020. Distribution-free binary classification: prediction sets confidence intervals and calibration. In Advances in Neural Information Processing Systems. Chirag Gupta Aleksandr Podkopaev and Aaditya Ramdas. 2020. Distribution-free binary classification: prediction sets confidence intervals and calibration. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000291"},{"key":"e_1_3_2_1_11_1","unstructured":"Meelis Kull Miquel Perello-Nieto Markus K\u00e4ngsepp Hao Song Peter Flach 2019. Beyond temperature scaling: obtaining well-calibrated multiclass probabilities with dirichlet calibration. arXiv preprint arXiv:1910.12656(2019). Meelis Kull Miquel Perello-Nieto Markus K\u00e4ngsepp Hao Song Peter Flach 2019. Beyond temperature scaling: obtaining well-calibrated multiclass probabilities with dirichlet calibration. arXiv preprint arXiv:1910.12656(2019)."},{"key":"e_1_3_2_1_12_1","unstructured":"Meelis Kull Telmo Silva\u00a0Filho and Peter Flach. 2017. Beta calibration: a well-founded and easily implemented improvement on logistic calibration for binary classifiers. In Artificial Intelligence and Statistics. 623\u2013631. Meelis Kull Telmo Silva\u00a0Filho and Peter Flach. 2017. Beta calibration: a well-founded and easily implemented improvement on logistic calibration for binary classifiers. In Artificial Intelligence and Statistics. 623\u2013631."},{"key":"e_1_3_2_1_13_1","unstructured":"Ananya Kumar Percy Liang and Tengyu Ma. 2019. Verified uncertainty calibration. In Advances in Neural Information Processing Systems. 3787\u20133798. Ananya Kumar Percy Liang and Tengyu Ma. 2019. Verified uncertainty calibration. In Advances in Neural Information Processing Systems. 3787\u20133798."},{"key":"e_1_3_2_1_14_1","unstructured":"Azadeh\u00a0Sadat Mozafari Hugo\u00a0Siqueira Gomes Wilson Le\u00e3o Steeven Janny and Christian Gagn\u00e9. 2018. Attended temperature scaling: a practical approach for calibrating deep neural networks. arXiv preprint arXiv:1810.11586(2018). Azadeh\u00a0Sadat Mozafari Hugo\u00a0Siqueira Gomes Wilson Le\u00e3o Steeven Janny and Christian Gagn\u00e9. 2018. Attended temperature scaling: a practical approach for calibrating deep neural networks. arXiv preprint arXiv:1810.11586(2018)."},{"key":"e_1_3_2_1_15_1","volume-title":"AAAI Conference on Artificial Intelligence, Vol.\u00a029","author":"Naeini Mahdi\u00a0Pakdaman","year":"2015","unstructured":"Mahdi\u00a0Pakdaman Naeini , Gregory Cooper , and Milos Hauskrecht . 2015 . Obtaining well calibrated probabilities using bayesian binning . In AAAI Conference on Artificial Intelligence, Vol.\u00a029 . Mahdi\u00a0Pakdaman Naeini, Gregory Cooper, and Milos Hauskrecht. 2015. Obtaining well calibrated probabilities using bayesian binning. In AAAI Conference on Artificial Intelligence, Vol.\u00a029."},{"key":"e_1_3_2_1_16_1","unstructured":"Mahdi\u00a0Pakdaman Naeini Gregory\u00a0F Cooper and Milos Hauskrecht. 2014. Binary classifier calibration: non-parametric approach. arXiv preprint arXiv:1401.3390(2014). Mahdi\u00a0Pakdaman Naeini Gregory\u00a0F Cooper and Milos Hauskrecht. 2014. Binary classifier calibration: non-parametric approach. arXiv preprint arXiv:1401.3390(2014)."},{"key":"e_1_3_2_1_17_1","first-page":"61","article-title":"Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods","volume":"10","author":"Platt John","year":"1999","unstructured":"John Platt 1999 . Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods . Advances in Large Margin Classifiers 10 , 3 (1999), 61 \u2013 74 . John Platt 1999. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Advances in Large Margin Classifiers 10, 3 (1999), 61\u201374.","journal-title":"Advances in Large Margin Classifiers"},{"key":"e_1_3_2_1_18_1","unstructured":"Amir Rahimi Kartik Gupta Thalaiyasingam Ajanthan Thomas Mensink Cristian Sminchisescu and Richard Hartley. 2020. Post-hoc calibration of neural networks. arXiv preprint arXiv:2006.12807(2020). Amir Rahimi Kartik Gupta Thalaiyasingam Ajanthan Thomas Mensink Cristian Sminchisescu and Richard Hartley. 2020. Post-hoc calibration of neural networks. arXiv preprint arXiv:2006.12807(2020)."},{"key":"e_1_3_2_1_19_1","unstructured":"Rebecca Roelofs Nicholas Cain Jonathon Shlens and Michael\u00a0C Mozer. 2020. Mitigating bias in calibration error estimation. arXiv preprint arXiv:2012.08668(2020). Rebecca Roelofs Nicholas Cain Jonathon Shlens and Michael\u00a0C Mozer. 2020. Mitigating bias in calibration error estimation. arXiv preprint arXiv:2012.08668(2020)."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00924"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3271748"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330681"},{"key":"e_1_3_2_1_23_1","volume-title":"International Conference on Machine Learning. 609\u2013616","author":"Zadrozny Bianca","year":"2001","unstructured":"Bianca Zadrozny and Charles Elkan . 2001 . Obtaining calibrated probability estimates from decision trees and naive Bayesian classifiers . In International Conference on Machine Learning. 609\u2013616 . Bianca Zadrozny and Charles Elkan. 2001. Obtaining calibrated probability estimates from decision trees and naive Bayesian classifiers. In International Conference on Machine Learning. 609\u2013616."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775151"},{"key":"e_1_3_2_1_25_1","volume-title":"International Conference on Machine Learning. 11117\u201311128","author":"Zhang Jize","year":"2020","unstructured":"Jize Zhang , Bhavya Kailkhura , and T\u00a0 Yong-Jin Han . 2020 . Mix-n-match: ensemble and compositional methods for uncertainty calibration in deep learning . In International Conference on Machine Learning. 11117\u201311128 . Jize Zhang, Bhavya Kailkhura, and T\u00a0Yong-Jin Han. 2020. Mix-n-match: ensemble and compositional methods for uncertainty calibration in deep learning. In International Conference on Machine Learning. 11117\u201311128."},{"key":"e_1_3_2_1_26_1","volume-title":"International Conference on Machine Learning. 11387\u201311397","author":"Zhao Shengjia","year":"2020","unstructured":"Shengjia Zhao , Tengyu Ma , and Stefano Ermon . 2020 . Individual calibration with randomized forecasting . In International Conference on Machine Learning. 11387\u201311397 . Shengjia Zhao, Tengyu Ma, and Stefano Ermon. 2020. Individual calibration with randomized forecasting. In International Conference on Machine Learning. 11387\u201311397."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33015941"},{"key":"e_1_3_2_1_28_1","unstructured":"Han Zhu Daqing Chang Ziru Xu Pengye Zhang Xiang Li Jie He Han Li Jian Xu and Kun Gai. 2019. Joint optimization of tree-based index and deep model for recommender systems. In Advances in Neural Information Processing Systems. 3973\u20133982. Han Zhu Daqing Chang Ziru Xu Pengye Zhang Xiang Li Jie He Han Li Jian Xu and Kun Gai. 2019. Joint optimization of tree-based index and deep model for recommender systems. In Advances in Neural Information Processing Systems. 3973\u20133982."}],"event":{"name":"WWW '22: The ACM Web Conference 2022","location":"Virtual Event, Lyon France","acronym":"WWW '22","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"]},"container-title":["Proceedings of the ACM Web Conference 2022"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3485447.3512096","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,25]],"date-time":"2023-04-25T11:53:48Z","timestamp":1682423628000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3485447.3512096"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,25]]},"references-count":28,"alternative-id":["10.1145\/3485447.3512096","10.1145\/3485447"],"URL":"http:\/\/dx.doi.org\/10.1145\/3485447.3512096","relation":{},"published":{"date-parts":[[2022,4,25]]},"assertion":[{"value":"2022-04-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}