{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T03:33:58Z","timestamp":1782876838728,"version":"3.54.5"},"reference-count":51,"publisher":"Springer Science and Business Media LLC","issue":"S1","license":[{"start":{"date-parts":[[2022,9,7]],"date-time":"2022-09-07T00:00:00Z","timestamp":1662508800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,9,7]],"date-time":"2022-09-07T00:00:00Z","timestamp":1662508800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Energy Inform"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Accurate day-ahead load forecasting is an important task in smart energy communities, as it enables improved energy management and operation of flexibilities. Smart meter data from individual households within the communities can be used to improve such forecasts. In this study, we introduce a novel hybrid bi-directional LSTM-XGBoost model for energy community load forecasting that separately forecasts the general load pattern and peak loads, which are later combined to a holistic forecasting model. The hybrid model outperforms traditional energy community load forecasting based on standard load profiles as well as LSTM-based forecasts. Furthermore, we show that the accuracy of energy community day-ahead forecasts can be significantly improved by using smart meter data as additional input features.<\/jats:p>","DOI":"10.1186\/s42162-022-00212-9","type":"journal-article","created":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T14:02:39Z","timestamp":1662645759000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":85,"title":["Load forecasting for energy communities: a novel LSTM-XGBoost hybrid model based on smart meter data"],"prefix":"10.1186","volume":"5","author":[{"given":"Leo","family":"Semmelmann","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Henni","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christof","family":"Weinhardt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,9,7]]},"reference":[{"key":"212_CR1","unstructured":"Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M, et al. (2016) TensorFlow: A system for Large-Scale machine learning. In: 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), pp 265\u2013283"},{"issue":"10","key":"212_CR2","doi-asserted-by":"publisher","first-page":"1340","DOI":"10.1093\/bioinformatics\/btq134","volume":"26","author":"A Altmann","year":"2010","unstructured":"Altmann A, Tolo\u015fi L, Sander O, Lengauer T (2010) Permutation importance: a corrected feature importance measure. Bioinformatics 26(10):1340\u20131347","journal-title":"Bioinformatics"},{"key":"212_CR3","doi-asserted-by":"publisher","first-page":"106489","DOI":"10.1016\/j.epsr.2020.106489","volume":"187","author":"S Atef","year":"2020","unstructured":"Atef S, Eltawil AB (2020) Assessment of stacked unidirectional and bi-directional long short-term memory networks for electricity load forecasting. Electric Power Syst Res 187:106489","journal-title":"Electric Power Syst Res"},{"key":"212_CR4","unstructured":"Beyertt A, Verwiebe P, Seim S, Milojkovic F, M\u00fcller-Kirchenbauer J (2020) Felduntersuchung zu Behavioral Energy Efficiency Potentialen von privaten Haushalten. An example dataset that accompanies the working paper"},{"issue":"7","key":"212_CR5","doi-asserted-by":"publisher","first-page":"1636","DOI":"10.3390\/en11071636","volume":"11","author":"S Bouktif","year":"2018","unstructured":"Bouktif S, Fiaz A, Ouni A, Serhani MA (2018) Optimal deep learning LSTM model for electric load forecasting using feature selection and genetic algorithm: comparison with machine learning approaches. Energies 11(7):1636","journal-title":"Energies"},{"issue":"2","key":"212_CR6","doi-asserted-by":"publisher","first-page":"391","DOI":"10.3390\/en13020391","volume":"13","author":"S Bouktif","year":"2020","unstructured":"Bouktif S, Fiaz A, Ouni A, Serhani MA (2020) Multi-sequence LSTM-RNN deep learning and metaheuristics for electric load forecasting. Energies 13(2):391","journal-title":"Energies"},{"issue":"3","key":"212_CR7","doi-asserted-by":"publisher","first-page":"503","DOI":"10.1093\/biomet\/76.3.503","volume":"76","author":"P Burman","year":"1989","unstructured":"Burman P (1989) A comparative study of ordinary cross-validation, v-fold cross-validation and the repeated learning-testing methods. Biometrika 76(3):503\u2013514","journal-title":"Biometrika"},{"key":"212_CR8","doi-asserted-by":"crossref","unstructured":"Chen T, Guestrin C (2016) Xgboost: a scalable tree boosting system. In: Proceedings of the 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining, pp. 785\u2013794","DOI":"10.1145\/2939672.2939785"},{"key":"212_CR9","doi-asserted-by":"publisher","first-page":"106956","DOI":"10.1016\/j.ijepes.2021.106956","volume":"131","author":"J Coignard","year":"2021","unstructured":"Coignard J, Janvier M, Debusschere V, Moreau G, Chollet S, Caire R (2021) Evaluating forecasting methods in the context of local energy communities. Int J Electr Power Energy Syst 131:106956","journal-title":"Int J Electr Power Energy Syst"},{"key":"212_CR10","unstructured":"Dube M, Awodele K, Olayiwola O, Akpeji K (2017) Short term load forecasting using arima ann and hybrid ann-dwt. In: Southern African Universities Power Engineering Conference, p. 6"},{"key":"212_CR11","unstructured":"European Parliament and Council of the European Union: Directive 2019\/944 on common rules for the internal market for electricity"},{"key":"212_CR12","doi-asserted-by":"publisher","first-page":"107669","DOI":"10.1016\/j.ijepes.2021.107669","volume":"137","author":"MN Fekri","year":"2022","unstructured":"Fekri MN, Grolinger K, Mir S (2022) Distributed load forecasting using smart meter data: federated learning with recurrent neural networks. Int J Electr Power Energy Syst 137:107669","journal-title":"Int J Electr Power Energy Syst"},{"issue":"9","key":"212_CR13","doi-asserted-by":"publisher","first-page":"2019","DOI":"10.1029\/2019WR026793","volume":"56","author":"D Feng","year":"2020","unstructured":"Feng D, Fang K, Shen C (2020) Enhancing streamflow forecast and extracting insights using long-short term memory networks with data integration at continental scales. Water Resour Res 56(9):2019\u2013026793","journal-title":"Water Resour Res"},{"issue":"24","key":"212_CR14","doi-asserted-by":"publisher","first-page":"4629","DOI":"10.3390\/en12244629","volume":"12","author":"E Ghiani","year":"2019","unstructured":"Ghiani E, Giordano A, Nieddu A, Rosetti L, Pilo F (2019) Planning of a smart local energy community: the case of Berchidda municipality (Italy). Energies 12(24):4629","journal-title":"Energies"},{"key":"212_CR15","unstructured":"Golla A, Henni S, Staudt P, Weinhardt C (2020) Scaling the concept of citizen energy communities through a platform-based decision support system. European Conference on Information Systems 2020, Marakesh"},{"key":"212_CR16","doi-asserted-by":"crossref","unstructured":"Grundmeier N, Hahn A, Ihle N, Runge S, Meyer-Barlag C (2014) A simulation based approach to forecast a demand load curve for a container terminal using battery powered vehicles. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 1711\u20131718. IEEE","DOI":"10.1109\/IJCNN.2014.6889838"},{"issue":"3","key":"212_CR17","doi-asserted-by":"publisher","first-page":"1017","DOI":"10.1016\/j.ijforecast.2015.11.004","volume":"32","author":"S Haben","year":"2016","unstructured":"Haben S, Giasemidis G (2016) A hybrid model of kernel density estimation and quantile regression for gefcom2014 probabilistic load forecasting. Int J Forecast 32(3):1017\u20131022","journal-title":"Int J Forecast"},{"key":"212_CR18","doi-asserted-by":"publisher","first-page":"117798","DOI":"10.1016\/j.apenergy.2021.117798","volume":"304","author":"S Haben","year":"2021","unstructured":"Haben S, Arora S, Giasemidis G, Voss M, Greetham DV (2021) Review of low voltage load forecasting: methods, applications, and recommendations. Appl Energy 304:117798","journal-title":"Appl Energy"},{"key":"212_CR19","doi-asserted-by":"publisher","DOI":"10.1016\/j.apenergy.2021.117351","author":"S Henni","year":"2021","unstructured":"Henni S, Staudt P, Weinhardt C (2021) A sharing economy for residential communities with PV-coupled battery storage: benefits, pricing and participant matching. Appl Energy. https:\/\/doi.org\/10.1016\/j.apenergy.2021.117351","journal-title":"Appl Energy"},{"issue":"8","key":"212_CR20","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735\u20131780","journal-title":"Neural Comput"},{"key":"212_CR21","doi-asserted-by":"crossref","unstructured":"Hor C-L, Watson SJ, Majithia S (2006) Daily load forecasting and maximum demand estimation using arima and garch. In: 2006 International Conference on Probabilistic Methods Applied to Power Systems, pp. 1\u20136. IEEE","DOI":"10.1109\/PMAPS.2006.360237"},{"issue":"10","key":"212_CR22","doi-asserted-by":"publisher","first-page":"767","DOI":"10.3390\/en9100767","volume":"9","author":"N Huang","year":"2016","unstructured":"Huang N, Lu G, Xu D (2016) A permutation importance-based feature selection method for short-term electricity load forecasting using random forest. Energies 9(10):767","journal-title":"Energies"},{"issue":"9","key":"212_CR23","doi-asserted-by":"publisher","first-page":"8298","DOI":"10.1109\/TIE.2020.3009604","volume":"68","author":"H Jahangir","year":"2020","unstructured":"Jahangir H, Tayarani H, Gougheri SS, Golkar MA, Ahmadian A, Elkamel A (2020) Deep learning-based forecasting approach in smart grids with microclustering and bi-directional LSTM network. IEEE Trans Industr Electron 68(9):8298\u20138309","journal-title":"IEEE Trans Industr Electron"},{"key":"212_CR24","doi-asserted-by":"publisher","first-page":"59438","DOI":"10.1109\/ACCESS.2018.2873712","volume":"6","author":"R Jiao","year":"2018","unstructured":"Jiao R, Zhang T, Jiang Y, He H (2018) Short-term non-residential load forecasting based on multiple sequences LSTM recurrent neural network. IEEE Access 6:59438\u201359448","journal-title":"IEEE Access"},{"issue":"4","key":"212_CR25","doi-asserted-by":"publisher","first-page":"1460","DOI":"10.1016\/j.ijforecast.2019.02.005","volume":"35","author":"I Kanda","year":"2019","unstructured":"Kanda I, Veguillas JQ (2019) Data preprocessing and quantile regression for probabilistic load forecasting in the gefcom2017 final match. Int J Forecast 35(4):1460\u20131468","journal-title":"Int J Forecast"},{"issue":"6","key":"212_CR26","doi-asserted-by":"publisher","first-page":"1400","DOI":"10.4209\/aaqr.2018.12.0450","volume":"19","author":"H Karimian","year":"2019","unstructured":"Karimian H, Li Q, Wu C, Qi Y, Mo Y, Chen G, Zhang X, Sachdeva S et al (2019) Evaluation of different machine learning approaches to forecasting pm2. 5 mass concentrations. Aerosol Air Qual Res 19(6):1400\u20131410","journal-title":"Aerosol Air Qual Res"},{"issue":"1","key":"212_CR27","doi-asserted-by":"publisher","first-page":"841","DOI":"10.1109\/TSG.2017.2753802","volume":"10","author":"W Kong","year":"2017","unstructured":"Kong W, Dong ZY, Jia Y, Hill DJ, Xu Y, Zhang Y (2017) Short-term residential load forecasting based on LSTM recurrent neural network. IEEE Trans Smart Grid 10(1):841\u2013851","journal-title":"IEEE Trans Smart Grid"},{"issue":"4","key":"212_CR28","doi-asserted-by":"publisher","first-page":"573","DOI":"10.3390\/electricity2040033","volume":"2","author":"D Kucevic","year":"2021","unstructured":"Kucevic D, Semmelmann L, Collath N, Jossen A, Hesse H (2021) Peak shaving with battery energy storage systems in distribution grids: a novel approach to reduce local and global peak loads. Electricity 2(4):573\u2013589","journal-title":"Electricity"},{"key":"212_CR29","doi-asserted-by":"publisher","first-page":"1040","DOI":"10.1016\/j.enconman.2015.07.041","volume":"103","author":"A Lahouar","year":"2015","unstructured":"Lahouar A, Slama JBH (2015) Day-ahead load forecast using random forest and expert input selection. Energy Convers Manage 103:1040\u20131051","journal-title":"Energy Convers Manage"},{"issue":"5","key":"212_CR30","doi-asserted-by":"publisher","first-page":"5902","DOI":"10.1016\/j.eswa.2010.11.033","volume":"38","author":"C-M Lee","year":"2011","unstructured":"Lee C-M, Ko C-N (2011) Short-term load forecasting using lifting scheme and arima models. Expert Syst Appl 38(5):5902\u20135911","journal-title":"Expert Syst Appl"},{"key":"212_CR31","doi-asserted-by":"crossref","unstructured":"Li C, Chen Z, Liu J, Li D, Gao X, Di F, Li L, Ji X (2019) Power load forecasting based on the combined model of lstm and xgboost. In: Proceedings of the 2019 the International Conference on Pattern Recognition and Artificial Intelligence, pp. 46\u201351","DOI":"10.1145\/3357777.3357792"},{"key":"212_CR32","doi-asserted-by":"crossref","unstructured":"Liu J, Brown LE (2019) Prediction of hour of coincident daily peak load. In: 2019 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT), pp. 1\u20135. IEEE","DOI":"10.1109\/ISGT.2019.8791587"},{"key":"212_CR33","unstructured":"Meier H (2000) Practical application of the vdew standard load profiles. analytical vs. synthetic load profiles; anwendung der vdew-lastprofile. analytisches versus synthetisches verfahren. ET, Energiewirtschaftliche Tagesfragen 50"},{"key":"212_CR34","doi-asserted-by":"publisher","first-page":"2922","DOI":"10.1016\/j.egypro.2019.01.952","volume":"158","author":"S Muzaffar","year":"2019","unstructured":"Muzaffar S, Afshari A (2019) Short-term load forecasts using LSTM networks. Energy Procedia 158:2922\u20132927","journal-title":"Energy Procedia"},{"key":"212_CR35","doi-asserted-by":"crossref","unstructured":"Peters D, V\u00f6lker R, Schuldt F, von Maydell K (2020) Are standard load profiles suitable for modern electricity grid models? In: 2020 17th International Conference on the European Energy Market (EEM), pp. 1\u20136. IEEE","DOI":"10.1109\/EEM49802.2020.9221967"},{"key":"212_CR36","doi-asserted-by":"crossref","unstructured":"Reijnders VM, van der Laan MD, Dijkstra R (2020) Energy communities: a Dutch case study. In: Behind and beyond the meter, pp. 137\u2013155. Elsevier, Amsterdam","DOI":"10.1016\/B978-0-12-819951-0.00006-2"},{"key":"212_CR37","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1016\/j.measurement.2015.09.053","volume":"78","author":"JRG Sarduy","year":"2016","unstructured":"Sarduy JRG, Di Santo KG, Saidel MA (2016) Linear and non-linear methods for prediction of peak load at university of S\u00e3o Paulo. Measurement 78:187\u2013201","journal-title":"Measurement"},{"key":"212_CR38","doi-asserted-by":"crossref","unstructured":"Schlund J, Pflugradt N, Steber D, Muntwyler U, German R (2018) Benefits of virtual community energy storages compared to individual batteries based on behaviour based synthetic load profiles. In: 2018 IEEE PES Innovative Smart Grid Technologies Conference Europe (ISGT-Europe), pp. 1\u20136. IEEE","DOI":"10.1109\/ISGTEurope.2018.8571506"},{"key":"212_CR39","doi-asserted-by":"publisher","first-page":"131911","DOI":"10.1109\/ACCESS.2019.2940751","volume":"7","author":"A Shrestha","year":"2019","unstructured":"Shrestha A, Bishwokarma R, Chapagain A, Banjara S, Aryal S, Mali B, Thapa R, Bista D, Hayes BP, Papadakis A et al (2019) Peer-to-peer energy trading in micro\/mini-grids for local energy communities: a review and case study of Nepal. IEEE Access 7:131911\u2013131928","journal-title":"IEEE Access"},{"key":"212_CR40","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1016\/j.inffus.2021.11.011","volume":"81","author":"R Shwartz-Ziv","year":"2022","unstructured":"Shwartz-Ziv R, Armon A (2022) Tabular data: deep learning is not all you need. Inf Fusion 81:84\u201390","journal-title":"Inf Fusion"},{"key":"212_CR41","unstructured":"Standardlastprofil Haushalt 2019 (Berlin). Stromnetz Berlin GmbH (2019). https:\/\/daten.berlin.de\/datensaetze\/standardlastprofil-haushalt-2019-berlin"},{"issue":"17","key":"212_CR42","doi-asserted-by":"publisher","first-page":"3847","DOI":"10.1049\/iet-gtd.2018.6687","volume":"13","author":"X Tang","year":"2019","unstructured":"Tang X, Dai Y, Wang T, Chen Y (2019) Short-term power load forecasting based on multi-layer bi-directional recurrent neural network. IET Gener Transm Distrib 13(17):3847\u20133854","journal-title":"IET Gener Transm Distrib"},{"key":"212_CR43","doi-asserted-by":"publisher","first-page":"107761","DOI":"10.1016\/j.epsr.2021.107761","volume":"205","author":"X Tang","year":"2022","unstructured":"Tang X, Chen H, Xiang W, Yang J, Zou M (2022) Short-term load forecasting using channel and temporal attention based temporal convolutional network. Electric Power Syst Res 205:107761","journal-title":"Electric Power Syst Res"},{"key":"212_CR44","doi-asserted-by":"publisher","first-page":"470","DOI":"10.1016\/j.ijepes.2019.02.022","volume":"109","author":"S Wang","year":"2019","unstructured":"Wang S, Wang X, Wang S, Wang D (2019) Bi-directional long short-term memory method based on attention mechanism and rolling update for short-term load forecasting. Int J Electr Power Energy Syst 109:470\u2013479","journal-title":"Int J Electr Power Energy Syst"},{"key":"212_CR45","doi-asserted-by":"publisher","first-page":"106830","DOI":"10.1016\/j.ijepes.2021.106830","volume":"129","author":"Y Wang","year":"2021","unstructured":"Wang Y, Sun S, Chen X, Zeng X, Kong Y, Chen J, Guo Y, Wang T (2021) Short-term load forecasting of industrial customers based on SVMD and xgboost. Int J Electr Power Energy Syst 129:106830","journal-title":"Int J Electr Power Energy Syst"},{"key":"212_CR46","doi-asserted-by":"crossref","unstructured":"Wang X, Fang F, Zhang X, Liu Y, Wei L, Shi Y (2019) Lstm-based short-term load forecasting for building electricity consumption. In: 2019 IEEE 28th International Symposium on Industrial Electronics (ISIE), pp. 1418\u20131423. IEEE","DOI":"10.1109\/ISIE.2019.8781349"},{"key":"212_CR47","doi-asserted-by":"crossref","unstructured":"Wang W, Shi Y, Lyu G, Deng W (2017) Electricity consumption prediction using xgboost based on discrete wavelet transform. DEStech Trans. Comput. Sci, Eng","DOI":"10.12783\/dtcse\/aiea2017\/15003"},{"key":"212_CR48","doi-asserted-by":"publisher","first-page":"1053","DOI":"10.1016\/j.energy.2019.01.075","volume":"171","author":"L Wen","year":"2019","unstructured":"Wen L, Zhou K, Yang S, Lu X (2019) Optimal load dispatch of community microgrid with deep learning based solar power and load forecasting. Energy 171:1053\u20131065","journal-title":"Energy"},{"issue":"15","key":"212_CR49","doi-asserted-by":"publisher","first-page":"3019","DOI":"10.3390\/app9153019","volume":"9","author":"H Zheng","year":"2019","unstructured":"Zheng H, Wu Y (2019) A xgboost model with weather similarity analysis and feature engineering for short-term wind power forecasting. Appl Sci 9(15):3019","journal-title":"Appl Sci"},{"issue":"8","key":"212_CR50","doi-asserted-by":"publisher","first-page":"1168","DOI":"10.3390\/en10081168","volume":"10","author":"H Zheng","year":"2017","unstructured":"Zheng H, Yuan J, Chen L (2017) Short-term load forecasting using EMD-LSTM neural networks with a xgboost algorithm for feature importance evaluation. Energies 10(8):1168","journal-title":"Energies"},{"key":"212_CR51","doi-asserted-by":"crossref","unstructured":"Zufferey T, Ulbig A, Koch S, Hug G (2016) Forecasting of smart meter time series based on neural networks. In: International workshop on data analytics for renewable energy integration, pp. 10\u201321. Springer","DOI":"10.1007\/978-3-319-50947-1_2"}],"container-title":["Energy Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s42162-022-00212-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s42162-022-00212-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s42162-022-00212-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T14:02:50Z","timestamp":1662645770000},"score":1,"resource":{"primary":{"URL":"https:\/\/energyinformatics.springeropen.com\/articles\/10.1186\/s42162-022-00212-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,7]]},"references-count":51,"journal-issue":{"issue":"S1","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["212"],"URL":"https:\/\/doi.org\/10.1186\/s42162-022-00212-9","relation":{},"ISSN":["2520-8942"],"issn-type":[{"value":"2520-8942","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,7]]},"assertion":[{"value":"7 September 2022","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"24"}}