{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T16:50:43Z","timestamp":1784134243606,"version":"3.55.0"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"4","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM J. Comput. Sustain. Soc."],"published-print":{"date-parts":[[2025,12,31]]},"abstract":"<jats:p>\n                    Buildings account for approximately one-third of global energy consumption. Research shows that providing an appliance-wise energy consumption breakdown can lead to up to 15% energy savings. Energy disaggregation or Non-Intrusive Load Monitoring (NILM) offers a scalable method by using machine learning to estimate individual appliance usage from total household energy consumption data. In this article, we investigate methods for uncertainty quantification and calibration in the context of energy disaggregation. We utilize homoscedastic and heteroscedastic likelihood for the state-of-the-art Sequence-to-Point (S2P) models and apply various distribution-dependent uncertainty quantification methods, including Monte Carlo (MC) Dropout, Deep Ensemble (DE) and Bootstrap (BS). To address distribution assumptions limitations, we introduce Quantile Regression as a distribution-free uncertainty quantification method for NILM. Additionally, we employ Conformal Prediction\u2014a novel approach for energy disaggregation\u2014and Isotonic Regression for uncertainty calibration. Our experiments are conducted on four publicly available datasets: REDD, Pecan Street, REFIT, and UK-DALE. Detailed analysis is provided for each uncertainty quantification and calibration method, including a comparison of time complexity for training, calibration, and inference. Conformal Prediction and Quantile Regression offer performance better than or comparable to other methods, while significantly reducing computational costs, with up to 10x faster training and 50x faster inference. The code to reproduce our results is available at\n                    <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"url\" xlink:href=\"https:\/\/github.com\/haikookhandor\/conformalNILM\">https:\/\/github.com\/haikookhandor\/conformalNILM<\/jats:ext-link>\n                    .\n                  <\/jats:p>","DOI":"10.1145\/3748334","type":"journal-article","created":{"date-parts":[[2025,7,10]],"date-time":"2025-07-10T15:45:31Z","timestamp":1752162331000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Distribution-Free Uncertainty Quantification and Calibration for Energy Disaggregation"],"prefix":"10.1145","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3282-2909","authenticated-orcid":false,"given":"Haikoo","family":"Khandor","sequence":"first","affiliation":[{"name":"Computer Science and Engineering, IIT Gandhinagar","place":["Gandhinagar, India"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-6696-6287","authenticated-orcid":false,"given":"R Yeeshu","family":"Dhurandhar","sequence":"additional","affiliation":[{"name":"Electrical Engineering, IIT Gandhinagar","place":["Gandhinagar, India"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-5528-9664","authenticated-orcid":false,"given":"Dhairya","family":"Shah","sequence":"additional","affiliation":[{"name":"Computer Science and Engineering, IIT Gandhinagar","place":["Gandhinagar, India"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0736-7169","authenticated-orcid":false,"given":"Nipun","family":"Batra","sequence":"additional","affiliation":[{"name":"IIT Gandhinagar","place":["Gandhinagar, India"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,11,24]]},"reference":[{"key":"e_1_3_4_2_2","doi-asserted-by":"publisher","DOI":"10.1561\/2200000101"},{"key":"e_1_3_4_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3563357.3564063"},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/2602044.2602051"},{"key":"e_1_3_4_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3360322.3360844"},{"key":"e_1_3_4_6_2","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2017.1285773"},{"key":"e_1_3_4_7_2","series-title":"Proceedings of Machine Learning Research","first-page":"1613","volume-title":"Proceedings of the 32nd International Conference on Machine Learning","volume":"37","author":"Blundell Charles","year":"2015","unstructured":"Charles Blundell, Julien Cornebise, Koray Kavukcuoglu, and Daan Wierstra. 2015. Weight uncertainty in neural network. In Proceedings of the 32nd International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol. 37). Francis Bach and David Blei (Eds.). PMLR, Lille, France, 1613\u20131622. Retrieved from https:\/\/proceedings.mlr.press\/v37\/blundell15.html"},{"key":"e_1_3_4_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3530190.3534791"},{"key":"e_1_3_4_9_2","doi-asserted-by":"publisher","unstructured":"Leo Breiman. 1996. Bagging predictors. Mach. Learn. 24 2 (August 1996) 123\u2013140. DOI:10.1023\/A:1018054314350","DOI":"10.1023\/A:1018054314350"},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3608115"},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSG.2021.3112341"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","unstructured":"Fabrizio Ciancetta Giovanni Bucci Edoardo Fiorucci Simone Mari and Andrea Fioravanti. 2020. A new convolutional neural network-based system for NILM applications. IEEE Transactions on Instrumentation and Measurement PP (2020) 1\u20131. DOI:10.1109\/TIM.2020.3035193","DOI":"10.1109\/TIM.2020.3035193"},{"key":"e_1_3_4_13_2","unstructured":"Sarah Darby et\u00a0al. 2006. The effectiveness of feedback on energy consumption. A Review for DEFRA of the Literature on Metering Billing and Direct Displays 486 2006 (2006) 26."},{"issue":"2006","key":"e_1_3_4_14_2","first-page":"26","article-title":"The effectiveness of feedback on energy consumption","volume":"486","author":"Darby Sarah","year":"2006","unstructured":"Sarah Darby et\u00a0al. 2006. The effectiveness of feedback on energy consumption. A Review for DEFRA of the Literature on Metering, Billing and direct Displays 486, 2006 (2006), 26.","journal-title":"A Review for DEFRA of the Literature on Metering, Billing and direct Displays"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.2172\/969737"},{"key":"e_1_3_4_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3427771.3427859"},{"key":"e_1_3_4_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3427771.3427859"},{"key":"e_1_3_4_18_2","first-page":"1050","volume-title":"International Conference on Machine Learning","author":"Gal Yarin","year":"2016","unstructured":"Yarin Gal and Zoubin Ghahramani. 2016. Dropout as a bayesian approximation: Representing model uncertainty in deep learning. In International Conference on Machine Learning. PMLR, 1050\u20131059."},{"key":"e_1_3_4_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8682543"},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/5.192069"},{"key":"e_1_3_4_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSG.2016.2598872"},{"issue":"1","key":"e_1_3_4_22_2","first-page":"1593","article-title":"The No-U-turn sampler: Adaptively setting path lengths in hamiltonian monte carlo.","volume":"15","author":"Hoffman Matthew D","year":"2014","unstructured":"Matthew D Hoffman, Andrew Gelman, et\u00a0al. 2014. The No-U-turn sampler: Adaptively setting path lengths in hamiltonian monte carlo. J. Mach. Learn. Res. 15, 1 (2014), 1593\u20131623.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_4_23_2","doi-asserted-by":"publisher","DOI":"10.3390\/en14092390"},{"key":"e_1_3_4_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/2821650.2821672"},{"key":"e_1_3_4_25_2","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2015.7"},{"key":"e_1_3_4_26_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511754098"},{"key":"e_1_3_4_27_2","unstructured":"J. Zico Kolter Siddarth Batra and Andrew Y. Ng. 2010. Energy disaggregation via discriminative sparse coding. In Proceedings of the 24th International Conference on Neural Information Processing Systems - Volume 1 (NIPS\u201910). Curran Associates Inc. Vancouver British Columbia Canada 1153\u20131161."},{"key":"e_1_3_4_28_2","first-page":"1472","volume-title":"Artificial Intelligence and Statistics","author":"Kolter J Zico","year":"2012","unstructured":"J Zico Kolter and Tommi Jaakkola. 2012. Approximate inference in additive factorial hmms with application to energy disaggregation. In Artificial Intelligence and Statistics. PMLR, 1472\u20131482."},{"key":"e_1_3_4_29_2","first-page":"59","volume-title":"Workshop on Data Mining Applications in Sustainability (SIGKDD), San Diego, CA","author":"Kolter J Zico","year":"2011","unstructured":"J Zico Kolter and Matthew J Johnson. 2011. REDD: A public data set for energy disaggregation research. In Workshop on Data Mining Applications in Sustainability (SIGKDD), San Diego, CA, Vol. 25. Citeseer, 59\u201362."},{"key":"e_1_3_4_30_2","first-page":"2796","volume-title":"International Conference on Machine Learning","author":"Kuleshov Volodymyr","year":"2018","unstructured":"Volodymyr Kuleshov, Nathan Fenner, and Stefano Ermon. 2018. Accurate uncertainties for deep learning using calibrated regression. In International Conference on Machine Learning. PMLR, 2796\u20132804."},{"key":"e_1_3_4_31_2","unstructured":"Balaji Lakshminarayanan Alexander Pritzel and Charles Blundell. 2017. Simple and scalable predictive uncertainty estimation using deep ensembles. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS\u201917) Curran Associates Inc. Long Beach California USA 6405\u20136416."},{"key":"e_1_3_4_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.apenergy.2022.119911"},{"key":"e_1_3_4_33_2","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.122"},{"key":"e_1_3_4_34_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.0006-341X.2004.00184.x"},{"key":"e_1_3_4_35_2","unstructured":"Elias Nehme Omer Yair and Tomer Michaeli. 2023. Uncertainty quantification via neural posterior principal components. In Proceedings of the 37th International Conference on Neural Information Processing Systems (New Orleans LA USA) (NIPS\u201923). Curran Associates Inc. Red Hook NY USA Article 1613 14 pages."},{"key":"e_1_3_4_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2021.10.014"},{"key":"e_1_3_4_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/GlobalSIP.2015.7418187"},{"key":"e_1_3_4_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3588001.3609360"},{"key":"e_1_3_4_39_2","doi-asserted-by":"publisher","unstructured":"Luis P\u00e9rez-Lombard Jos\u00e9 Ortiz and Christine Pout. 2008. A review on buildings energy consumption information. Energy and Buildings 40 3 (2008) 394\u2013398. 10.1016\/j.enbuild.2007.03.007","DOI":"10.1016\/j.enbuild.2007.03.007"},{"key":"e_1_3_4_40_2","unstructured":"Yaniv Romano Evan Patterson and Emmanuel J. Cand\u00e8s. 2019. Conformalized quantile regression. Curran Associates Inc. Red Hook NY USA."},{"key":"e_1_3_4_41_2","doi-asserted-by":"publisher","DOI":"10.3390\/en12112203"},{"key":"e_1_3_4_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSG.2022.3189598"},{"key":"e_1_3_4_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3486611.3486652"},{"key":"e_1_3_4_44_2","unstructured":"Ilya Sutskever Oriol Vinyals and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. In Proceedings of the 28th International Conference on Neural Information Processing Systems - Volume 2 (NIPS\u201914) MIT Press Montreal Canada 3104\u20133112."},{"key":"e_1_3_4_45_2","doi-asserted-by":"publisher","DOI":"10.4236\/ojee.2013.21002"},{"key":"e_1_3_4_46_2","doi-asserted-by":"publisher","DOI":"10.3390\/s23042051"},{"key":"e_1_3_4_47_2","doi-asserted-by":"publisher","DOI":"10.3390\/en14030719"},{"key":"e_1_3_4_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3637209"},{"key":"e_1_3_4_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2022.3163347"},{"key":"e_1_3_4_50_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11873"},{"key":"e_1_3_4_51_2","doi-asserted-by":"publisher","unstructured":"Yuanshi Zhang Wenyan Qian Yujian Ye Yang Li Yi Tang Yu Long and Meimei Duan. 2023. A novel non-intrusive load monitoring method based on ResNet-seq2seq networks for energy disaggregation of distributed energy resources integrated with residential houses. Applied Energy 349 (November 2023) e121703. DOI:10.1016\/j.apenergy.2023.121703","DOI":"10.1016\/j.apenergy.2023.121703"},{"key":"e_1_3_4_52_2","doi-asserted-by":"publisher","DOI":"10.3390\/s23083939"},{"key":"e_1_3_4_53_2","doi-asserted-by":"publisher","unstructured":"Xiaoli Zhao and Yiyang Zhang. 2024. Integrated management of urban resources toward Net-Zero smart cities considering renewable energies uncertainty and modeling in Digital Twin. Sustainable Energy Technologies and Assessments 64 (2024) 103656. DOI:10.1016\/j.seta.2024.103656","DOI":"10.1016\/j.seta.2024.103656"}],"container-title":["ACM Journal on Computing and Sustainable Societies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3748334","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T16:35:11Z","timestamp":1764002111000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3748334"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,24]]},"references-count":52,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,12,31]]}},"alternative-id":["10.1145\/3748334"],"URL":"https:\/\/doi.org\/10.1145\/3748334","relation":{},"ISSN":["2834-5533"],"issn-type":[{"value":"2834-5533","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,24]]},"assertion":[{"value":"2025-01-16","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-06-29","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-11-24","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}