{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T06:46:03Z","timestamp":1776408363714,"version":"3.51.2"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2026,3,1]],"date-time":"2026-03-01T00:00:00Z","timestamp":1772323200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T00:00:00Z","timestamp":1773705600000},"content-version":"vor","delay-in-days":16,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004252","name":"Qatar University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004252","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Comput &amp; Applic"],"published-print":{"date-parts":[[2026,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Electricity price has been the focus of electricity market participants from the beginning of electricity markets as the price reflects the prevailing market conditions. Its importance and volatile behavior have motivated many research works in the area of electricity price forecasting. While qualified electricity price forecasting methods have been presented in the literature, prediction of price spikes, as a distinctive and crucial aspect of electricity price time series, has been less researched and still remained as a critical challenge. In this paper, a new deep learning-based framework is proposed for price spike occurrence and value prediction. Three deep generative models, for data generation, rebalanced data clustering, and point value forecasting, are combined in this framework. In the first step, the Rebalancing Variational Autoencoder (RebalVAE) is proposed to rebalance the data using a mixture of discrete and continuous variables. After that, the Clustering Variational Auto-Encoder (ClusVAE) with a new clustering-specific loss term from the mutual information theory is proposed to make an accurate and automatic clustering. Subsequently, a deep diffusion model is applied to each cluster for price value prediction. This model, namely Diffused Predictor Variational Auto Encoder (DiffPredVAE), includes a Transformer Encoder, embedded in both Encoder and Decoder networks of a VAE, and is equipped with a new loss function. Results on two real-world datasets (in five cases) confirm the superiority of the proposed price spike prediction model compared to various other models.<\/jats:p>","DOI":"10.1007\/s00521-025-11784-4","type":"journal-article","created":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T01:21:20Z","timestamp":1773710480000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A deep triplet variational auto-encoder framework for price spike prediction"],"prefix":"10.1007","volume":"38","author":[{"given":"Razieh","family":"Rastgoo","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nima","family":"Amjady","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Atif","family":"Iqbal","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shunfu","family":"Lin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4955-6889","authenticated-orcid":false,"given":"S. M.","family":"Muyeen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2026,3,17]]},"reference":[{"key":"11784_CR1","doi-asserted-by":"publisher","DOI":"10.1002\/047122412X","volume-title":"Market operations in electric power systems","author":"M Shahidehpour","year":"2002","unstructured":"Shahidehpour M, Yamin H, Li Z (2002) Market operations in electric power systems. Wiley, New York"},{"key":"11784_CR2","volume-title":"Electric power systems: advanced forecasting techniques and optimal generation scheduling","author":"N Amjady","year":"2012","unstructured":"Amjady N (2012) Electric power systems: advanced forecasting techniques and optimal generation scheduling, vol 4. CRC Press, Taylor & Francis, Abingdon-on-Thames"},{"key":"11784_CR3","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1109\/MPAE.2006.1597990","volume":"4","author":"N Amjady","year":"2006","unstructured":"Amjady N, Hemmati M (2006) Energy price forecasting, problems and proposals for such predictions. IEEE Power Energy Mag 4:20\u201329","journal-title":"IEEE Power Energy Mag"},{"key":"11784_CR4","first-page":"1662","volume":"17","author":"A Mystakidis","year":"2024","unstructured":"Mystakidis A, Koukaras P, Tsalikidis N, Ioannidis D, Tjortjis C (2024) Energy forecasting: Compr Rev Techniques Technol Energies 17:1662","journal-title":"Energy Forecasting: Compr Rev Techniques Technol Energies"},{"key":"11784_CR5","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1049\/iet-gtd:20060006","volume":"1","author":"S Fan","year":"2007","unstructured":"Fan S, Mao C, Chen L (2007) Next-day electricity-price forecasting using a hybrid network. IET Gen Transm Distrib 1:176\u2013182","journal-title":"IET Gen Transm Distrib"},{"key":"11784_CR6","doi-asserted-by":"publisher","first-page":"318","DOI":"10.1016\/j.epsr.2009.09.015","volume":"80","author":"N Amjady","year":"2010","unstructured":"Amjady N, Keynia F (2010) Electricity market price Spike analysis by a hybrid data model and feature selection technique. Electr Power Syst Res 80:318\u2013327","journal-title":"Electr Power Syst Res"},{"key":"11784_CR7","unstructured":"Saravia C (2003) Speculative trading and market performance: the effect of arbitrageurs on efficiency and market power in the New York electricity market. University of California Energy Institute, CSEM WP121"},{"key":"11784_CR8","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1109\/TPWRS.2006.889139","volume":"22","author":"JH Zao","year":"2007","unstructured":"Zao JH, Dong ZY, Li X, Wong KP (2007) A framework for electricity price Spike analysis with advanced data mining methods. IEEE Trans Power Syst 22:376\u2013385","journal-title":"IEEE Trans Power Syst"},{"key":"11784_CR9","doi-asserted-by":"publisher","first-page":"523","DOI":"10.35833\/MPCE.2021.000196","volume":"11","author":"S Liu","year":"2023","unstructured":"Liu S, Jiang Y, Lin Z, Wen F, Ding Y, Yang Y (2023) Data-driven Two-step Day-ahead electricity price forecasting considering price spikes. J Mod Power Syst Clean Energy 11:523\u2013533","journal-title":"J Mod Power Syst Clean Energy"},{"key":"11784_CR10","doi-asserted-by":"crossref","unstructured":"Zao JH, Dong ZY, Li X Electricity market price Spike forecasting and decision making. IET Gen Transm Distrib 4:647\u2013654","DOI":"10.1049\/iet-gtd:20060217"},{"key":"11784_CR11","doi-asserted-by":"crossref","unstructured":"Yamada K, Mori H (2021) A deep learning technique for electricity price forecasting in consideration of spikes. IEEE Region 10 Conference (TENCON), Auckland, New Zealand","DOI":"10.1109\/TENCON54134.2021.9707319"},{"key":"11784_CR12","doi-asserted-by":"publisher","first-page":"4246","DOI":"10.1016\/j.asoc.2011.03.024","volume":"11","author":"N Amjady","year":"2011","unstructured":"Amjady N, Keynia F (2011) A new prediction strategy for price Spike forecasting of day-ahead electricity markets. Appl Soft Comput 11:4246\u20134256","journal-title":"Appl Soft Comput"},{"key":"11784_CR13","doi-asserted-by":"publisher","first-page":"106834","DOI":"10.1016\/j.eneco.2023.106834","volume":"124","author":"Y Lu","year":"2013","unstructured":"Lu Y, Suthaharan N (2013) Electricity price Spike clustering: a zero-inflated GARX approach. Energy Econ 124:106834","journal-title":"Energy Econ"},{"key":"11784_CR14","doi-asserted-by":"publisher","first-page":"5897","DOI":"10.3390\/en6115897","volume":"6","author":"S Voronin","year":"2013","unstructured":"Voronin S, Partanen J (2013) Price forecasting in the Day-Ahead energy market by an iterative method with separate normal price and price Spike frameworks. Energies 6:5897\u20135920","journal-title":"Energies"},{"key":"11784_CR15","doi-asserted-by":"publisher","first-page":"1570","DOI":"10.3390\/en16041570","volume":"16","author":"B Adlin","year":"2023","unstructured":"Adlin B, Ikeda K (2023) A Hawkes model approach to modeling price spikes in the Japanese electricity market. Energies 16:1570","journal-title":"Energies"},{"key":"11784_CR16","doi-asserted-by":"publisher","first-page":"450","DOI":"10.1016\/j.epsr.2016.08.005","volume":"141","author":"HS Sandhu","year":"2016","unstructured":"Sandhu HS, Fang L, Guan L (2016) Forecasting day-ahead price spikes for the Ontario electricity market. Electr Power Syst Res 141:450\u2013459","journal-title":"Electr Power Syst Res"},{"key":"11784_CR17","doi-asserted-by":"crossref","unstructured":"Sheybanivaziri S, Dreau JL, Kazmi H (2024) Forecasting price spikes in day-ahead electricity markets: techniques, challenges, and the road ahead. Discussion Papers, Norwegian School of Economics, Department of Business and Management Science","DOI":"10.2139\/ssrn.4697863"},{"issue":"12","key":"11784_CR18","doi-asserted-by":"publisher","first-page":"3097","DOI":"10.3390\/en18123097","volume":"18","author":"C O\u2019Connor","year":"2025","unstructured":"O\u2019Connor C, Bahloul M, Prestwich S, Visentin A (2025) A review of electricity price forecasting models in the Day-Ahead, Intra-Day, and balancing markets. Energies 18(12):3097","journal-title":"Energies"},{"key":"11784_CR19","doi-asserted-by":"crossref","unstructured":"Su HY, Liao GZ (2025) A spike-resilient temporal-adaptive neural framework for day-ahead electricity price interval forecasting. IEEE Trans Power Syst pp 1\u20134","DOI":"10.1109\/TPWRS.2025.3581805"},{"key":"11784_CR20","doi-asserted-by":"publisher","first-page":"72062","DOI":"10.1109\/ACCESS.2024.3403422","volume":"12","author":"F Moraglio","year":"2024","unstructured":"Moraglio F, Ragusa CS (2024) Day-ahead electricity price forecasting in the contemporary Italian market. IEEE Access 12:72062\u201372078","journal-title":"IEEE Access"},{"key":"11784_CR21","doi-asserted-by":"publisher","first-page":"10083","DOI":"10.1109\/ACCESS.2025.3528450","volume":"13","author":"Y Osone","year":"2025","unstructured":"Osone Y, Kodaira D (2025) Quantile regression for probabilistic electricity price forecasting in the U.K. electricity market. IEEE Access 13:10083\u201310093","journal-title":"IEEE Access"},{"key":"11784_CR22","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1109\/TPWRS.2023.3235193","volume":"39","author":"C Zhang","year":"2024","unstructured":"Zhang C, Fu Y (2024) Probabilistic electricity price forecast with optimal prediction interval. IEEE Trans Power Syst 39:442\u2013452","journal-title":"IEEE Trans Power Syst"},{"key":"11784_CR23","doi-asserted-by":"publisher","first-page":"2123","DOI":"10.1007\/s00521-015-2011-z","volume":"27","author":"SK Dash","year":"2015","unstructured":"Dash SK, Bisoi R, Dash PK (2015) A hybrid functional link dynamic neural network and evolutionary unscented Kalman filter for short-term electricity price forecasting. Neural Comput Appl 27:2123\u20132140","journal-title":"Neural Comput Application"},{"key":"11784_CR24","doi-asserted-by":"publisher","first-page":"6104","DOI":"10.3390\/en14196104","volume":"14","author":"A Pourdaryaei","year":"2021","unstructured":"Pourdaryaei A, Mohammadi M, Karimi M, Mokhlis H, Kaboli SHA, Ahmad S (2021) Recent development in electricity price forecasting based on computational intelligence techniques in deregulated power market. Energies 14:6104","journal-title":"Energies"},{"key":"11784_CR25","doi-asserted-by":"publisher","first-page":"112107","DOI":"10.1016\/j.asoc.2024.112107","volume":"165","author":"R Rastgoo","year":"2024","unstructured":"Rastgoo R, Amjady N, Zareipour H (2024) A deep generative model for selecting representative periods in renewable energy-integrated power systems. Appl Soft Comput 165:112107","journal-title":"Appl Soft Comput"},{"key":"11784_CR26","doi-asserted-by":"crossref","unstructured":"Chege JK, Grasis MJ, Manina A, Yeredo A, Haardt M (2022) Efficient probability mass function estimation from partially observed data. 56th Asilomar Conference on Signals, Systems, and Computers","DOI":"10.1109\/IEEECONF56349.2022.10052047"},{"key":"11784_CR27","doi-asserted-by":"crossref","unstructured":"Rastgoo R, Amjady N, Lin S, Muyeen SM (2025) Ultra-short-term solar power prediction using Sky image sequences by a residual vision reformer. IEEE Trans Sustain Energy 16:2972\u20132988","DOI":"10.1109\/TSTE.2025.3575520"},{"key":"11784_CR28","unstructured":"Chen RX (2021) A Brief Introduction to Shannon\u2019s Information Theory. arXiv:1612.09316"},{"key":"11784_CR29","doi-asserted-by":"publisher","first-page":"859","DOI":"10.1080\/01621459.2017.1285773","volume":"112","author":"DM Blei","year":"2017","unstructured":"Blei DM, Kucukelbir A, McAuliffe JD (2017) Variational inference: a review for statisticians. J Am Stat Assoc 112:859\u2013877","journal-title":"J Am Stat Assoc"},{"key":"11784_CR30","doi-asserted-by":"crossref","unstructured":"Rastgoo R, Kiani K, Escalera S (2025) Diffusion-based continuous sign language generation with cluster-specific fine-tuning and motion-adapted transformer. In: Proceedings of the computer vision and pattern recognition workshop (CVPRW), US, pp 4088\u20134097","DOI":"10.1109\/CVPRW67362.2025.00393"},{"key":"11784_CR31","unstructured":"Arjovsky M, Chintala S, Bottou L, Wasserstein GAN. arXiv:1701.07875v3"},{"key":"11784_CR32","unstructured":"Python (2024) https:\/\/pytorch.org. Access Aug 2024"},{"key":"11784_CR33","unstructured":"Chen M, Mei S, Fan J, Wang M (2024) An overview of diffusion models: applications, guided generation, statistical rates and optimization. arXiv:2404.07771"},{"key":"11784_CR34","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1561\/2200000056","volume":"12","author":"DP Kingma","year":"2019","unstructured":"Kingma DP, Welling M (2019) An introduction to variational autoencoders. Found Trends Mach Learn 12:307\u2013392","journal-title":"Found Trends Mach Learn"},{"key":"11784_CR35","unstructured":"Li Z, Chen Y, Sommer FT (2019) Learning energy-based models in high-dimensional spaces with multi-scale denoising score matching. arXiv:1910.07762."},{"key":"11784_CR36","doi-asserted-by":"crossref","unstructured":"LeCun Y, Chopra S, Hadsell R, Ranzato M, Huang FJ (2006) A tutorial on energy-based learning. Predicting Structured Data, MIT Press","DOI":"10.7551\/mitpress\/7443.003.0014"},{"key":"11784_CR37","doi-asserted-by":"crossref","unstructured":"Mun J, Housel T (2010) A primer on applying Monte Carlo simulation, real options analysis, knowledge value added, forecasting, and portfolio optimization. Naval Acquisitions Research Conference","DOI":"10.21236\/ADA518628"},{"key":"11784_CR38","unstructured":"PJM Web Site (2024) http:\/\/www.pjm.com. Access Aug 2024"},{"key":"11784_CR39","unstructured":"Queensland electricity market (2024) http:\/\/www.nemmco.com.au\/data. Access July 2024"},{"key":"11784_CR40","doi-asserted-by":"crossref","unstructured":"Shetty AM, Aljunid MF, Manjaiah DH, Shaik Afzal AMS (2023) Hyperparameter optimization of machine learning models using grid search for Amazon review sentiment Analysis, data science and applications. ICDSA, Lecture Notes in Networks and Systems","DOI":"10.1007\/978-981-99-7814-4_36"},{"key":"11784_CR41","doi-asserted-by":"publisher","first-page":"149532","DOI":"10.1109\/ACCESS.2025.3600713","volume":"13","author":"Razieh Rastgoo","year":"2025","unstructured":"Rastgoo R, Amjady N, Shah R, Muyeen SM (2025) A diffusion-based probabilistic ultra-short-term solar power prediction using the sky image sequences. IEEE Access 13:149532\u2013149553. https:\/\/doi.org\/10.1109\/ACCESS.2025.3600713","journal-title":"IEEE Access"},{"key":"11784_CR42","doi-asserted-by":"publisher","first-page":"110627","DOI":"10.1016\/j.ijepes.2025.110627","volume":"167","author":"R Rastgoo","year":"2025","unstructured":"Rastgoo R, Amjady N, Islam S, Kamwa I, Muyeen SM (2025) Extreme outage prediction in power systems using a new deep generative informer model. Int J Electr Power Energy Syst 167:110627","journal-title":"Int J Electr Power Energy Syst"},{"key":"11784_CR43","doi-asserted-by":"crossref","unstructured":"Ding R (2023) Lipschitz Variational Approximation of Total Variation Distance. Proceedings of ICSTA\u201923","DOI":"10.11159\/icsta23.138"},{"key":"11784_CR44","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1016\/j.ins.2022.11.139","volume":"622","author":"AM Ikotun","year":"2023","unstructured":"Ikotun AM, Ezugwu AE, Abualigah L, Abuhaija B, Heming J (2023) K-means clustering algorithms: a comprehensive review, variants analysis, and advances in the era of big data. Inf Sci 622:178\u2013210","journal-title":"Inf Sci"}],"container-title":["Neural Computing and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-025-11784-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00521-025-11784-4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-025-11784-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T05:49:12Z","timestamp":1776404952000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00521-025-11784-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3]]},"references-count":44,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2026,3]]}},"alternative-id":["11784"],"URL":"https:\/\/doi.org\/10.1007\/s00521-025-11784-4","relation":{},"ISSN":["0941-0643","1433-3058"],"issn-type":[{"value":"0941-0643","type":"print"},{"value":"1433-3058","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3]]},"assertion":[{"value":"31 January 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 October 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 March 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors certify that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interest"}}],"article-number":"183"}}