{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T19:41:26Z","timestamp":1773949286387,"version":"3.50.1"},"reference-count":55,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2025,2,13]],"date-time":"2025-02-13T00:00:00Z","timestamp":1739404800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>The increasing adoption of renewable energy resources and the growing need for efficient and adaptable energy management have emphasized the importance of innovative solutions for energy sharing and storage. This study aims to analyze the application of advanced optimization techniques in decentralized energy systems, focusing on strategies that improve energy distribution, adaptability, and reliability. This research employs a comprehensive review methodology, examining reinforcement learning approaches, demand response mechanisms, and the integration of battery energy storage systems to enhance the flexibility and scalability of P2P energy markets. The main findings highlight significant advancements in robust decision-making frameworks, the management of energy storage systems, and real-time optimization for decentralized trading. Additionally, this study identifies key technical and regulatory challenges, such as computational complexity, market uncertainty, and the lack of standardized legal frameworks, while proposing pathways to address them through intelligent energy management and collaborative solutions. The originality of this work lies in its structured analysis of emerging energy trading models, providing valuable insights into the future design of decentralized energy systems that are efficient, sustainable, and resilient.<\/jats:p>","DOI":"10.3390\/computers14020065","type":"journal-article","created":{"date-parts":[[2025,2,13]],"date-time":"2025-02-13T05:10:22Z","timestamp":1739423422000},"page":"65","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Distributed Peer-to-Peer Optimization Based on Robust Reinforcement Learning with Demand Response: A Review"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-6719-7893","authenticated-orcid":false,"given":"Andr\u00e9s","family":"Mart\u00ednez","sequence":"first","affiliation":[{"name":"Faculty of Engineering, Department of Electrical Engineering, Electronics and Telecommunications (DEET), University of Cuenca, Balzay Campus, Cuenca 010107, Azuay, Ecuador"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6721-1326","authenticated-orcid":false,"given":"Paul","family":"Ar\u00e9valo","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, Department of Electrical Engineering, Electronics and Telecommunications (DEET), University of Cuenca, Balzay Campus, Cuenca 010107, Azuay, Ecuador"},{"name":"Department of Electrical Engineering, University of Jaen, EPS Linares, 23700 Jaen, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"100778","DOI":"10.1016\/j.prime.2024.100778","article-title":"Review of Peer-to-Peer Energy Trading: Advances and Challenges","volume":"10","author":"Zedan","year":"2024","journal-title":"E-Prime\u2014Adv. Electr. Eng. Electron. Energy"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"120705","DOI":"10.1016\/j.apenergy.2023.120705","article-title":"A Multi-Agent Reinforcement Learning Approach for Investigating and Optimising Peer-to-Peer Prosumer Energy Markets","volume":"334","author":"May","year":"2023","journal-title":"Appl. Energy"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e36948","DOI":"10.1016\/j.heliyon.2024.e36948","article-title":"EnergyShare AI: Transforming P2P Energy Trading through Advanced Deep Learning","volume":"10","author":"Alghanmi","year":"2024","journal-title":"Heliyon"},{"key":"ref_4","first-page":"2453","article-title":"State-of-the-Art Analysis and Perspectives for Peer-to-Peer Energy Trading Technology in Urban Community Microgrid System","volume":"48","author":"Jia","year":"2022","journal-title":"Gaodianya Jishu-High Volt. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/TIA.2021.3119559","article-title":"Comparison of Centralized and Peer-to-Peer Decentralized Market Designs for Community Markets","volume":"58","author":"Liu","year":"2022","journal-title":"IEEE Trans. Ind. Appl."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"95266","DOI":"10.1109\/ACCESS.2020.2996309","article-title":"Prosumers Matching and Least-Cost Energy Path Optimisation for Peer-to-Peer Energy Trading","volume":"8","author":"Jogunola","year":"2020","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1109\/JSYST.2020.3045370","article-title":"A Peer-to-Peer Energy Trading Framework for Wind Power Producers with Load Serving Entities in Retailing Layer","volume":"16","author":"Siano","year":"2022","journal-title":"IEEE Syst. J."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"6386","DOI":"10.1109\/TPWRS.2024.3360606","article-title":"A Peer-to-Peer Joint Kilowatt and Negawatt Trading Framework Incorporating Battery Cycling Degradation","volume":"39","author":"Zhang","year":"2024","journal-title":"IEEE Trans. Power Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"109547","DOI":"10.1016\/j.ijepes.2023.109547","article-title":"A Real-Time Peer-to-Peer Energy Trading for Prosumers Utilizing Time-Varying Building Virtual Energy Storage","volume":"155","author":"Wang","year":"2024","journal-title":"Int. J. Electr. Power Energy Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1109\/JSYST.2022.3197412","article-title":"A Robust Decentralized Peer-to-Peer Energy Trading in Community of Flexible Microgrids","volume":"17","author":"Saatloo","year":"2023","journal-title":"IEEE Syst. J."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"21686","DOI":"10.1109\/ACCESS.2023.3251645","article-title":"A Scalable and Computational Efficient Peer-to-Peer Energy Management Scheme","volume":"11","author":"Mishra","year":"2023","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1868","DOI":"10.1109\/TPWRS.2021.3111869","article-title":"An Asynchronous Online Negotiation Mechanism for Real-Time Peer-to-Peer Electricity Markets","volume":"37","author":"Guo","year":"2022","journal-title":"IEEE Trans. Power Syst."},{"key":"ref_13","first-page":"198","article-title":"Blockchain-Based Peer-to-Peer Transactive Energy System for Community Microgrid with Demand Response Management","volume":"8","author":"Bokkisam","year":"2022","journal-title":"CSEE J. Power Energy Syst."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Muntasir, F., Chapagain, A., Maharjan, K., Baig, M.J.A., Jamil, M., and Khan, A.A. (2023). Developing an Appropriate Energy Trading Algorithm and Techno-Economic Analysis between Peer-to-Peer within a Partly Independent Microgrid. Energies, 16.","DOI":"10.3390\/en16031549"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4407","DOI":"10.1109\/TTE.2023.3315398","article-title":"Distributed Peer-to-Peer Coordination of Hierarchical Three-Phase Energy Transactions among Electric Vehicle Charging Stations in Constrained Power Distribution and Urban Transportation Networks","volume":"10","author":"Chen","year":"2024","journal-title":"IEEE Trans. Transp. Electrif."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"131573","DOI":"10.1016\/j.jclepro.2022.131573","article-title":"Distributed Peer-to-Peer Energy Trading Based on Game Theory in a Community Microgrid Considering Ownership Complexity of Distributed Energy Resources","volume":"351","author":"Luo","year":"2022","journal-title":"J. Clean. Prod."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"131876","DOI":"10.1016\/j.energy.2024.131876","article-title":"Distributed Peer-to-Peer Energy Trading Framework with Manufacturing Assembly Process and Uncertain Renewable Energy Plants in Multi-Industrial Micro-Grids","volume":"302","author":"Wu","year":"2024","journal-title":"Energy"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"106401","DOI":"10.1016\/j.est.2022.106401","article-title":"Distributed Peer-to-Peer Transactive Residential Energy Management with Cloud Energy Storage","volume":"58","author":"Salehi","year":"2023","journal-title":"J. Energy Storage"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"120216","DOI":"10.1016\/j.apenergy.2022.120216","article-title":"Online Distributed Optimization for Spatio-Temporally Constrained Real-Time Peer-to-Peer Energy Trading","volume":"331","author":"Liu","year":"2023","journal-title":"Appl. Energy"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4622","DOI":"10.1109\/TIA.2024.3357790","article-title":"Optimal Peer-to-Peer Energy Transaction of Distributed Prosumers in High-Penetrated Renewable Distribution Systems","volume":"60","author":"Ma","year":"2024","journal-title":"IEEE Trans. Ind. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"101504","DOI":"10.1016\/j.segan.2024.101504","article-title":"Enhancing Local Energy Sharing Reliability within Peer-to-Peer Prosumer Communities: A Cellular Automata and Deep Learning Approach","volume":"39","author":"Abdennour","year":"2024","journal-title":"Sustain. Energy Grids Netw."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"121234","DOI":"10.1016\/j.apenergy.2023.121234","article-title":"Operating Peer-to-Peer Electricity Markets under Uncertainty via Learning-Based, Distributed Optimal Control","volume":"343","author":"Tsaousoglou","year":"2023","journal-title":"Appl. Energy"},{"key":"ref_23","first-page":"1053","article-title":"Optimal Load Forecasting Model for Peer-to-Peer Energy Trading in Smart Grids","volume":"70","author":"Varghese","year":"2021","journal-title":"Comput. Mater. Contin."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Hao, J., Huang, T., Sun, Y., Zhan, X., Zhang, Y., and Wu, P. (2024). Optimal Prosumer Operation with Consideration for Bounded Rationality in Peer-to-Peer Energy Trading Systems. Energies, 17.","DOI":"10.3390\/en17071724"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"062704","DOI":"10.1063\/5.0172713","article-title":"Peer-to-Peer Energy Trading in a Community Based on Deep Reinforcement Learning","volume":"15","author":"Wang","year":"2023","journal-title":"J. Renew. Sustain. Energy"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"7825","DOI":"10.1016\/j.egyr.2021.09.074","article-title":"Demand Response-Based Peer-to-Peer Energy Trading among the Prosumers and Consumers","volume":"7","author":"Kanakadhurga","year":"2021","journal-title":"Energy Rep."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"26743","DOI":"10.1109\/ACCESS.2022.3151922","article-title":"Designing a Robust Decentralized Energy Transactions Framework for Active Prosumers in Peer-to-Peer Local Electricity Markets","volume":"10","author":"Mehdinejad","year":"2022","journal-title":"IEEE Access"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"109887","DOI":"10.1016\/j.ijepes.2024.109887","article-title":"Multi-Objective Optimization Based Demand Response Program with Network Aware Peer-to-Peer Energy Sharing","volume":"157","author":"Tiwari","year":"2024","journal-title":"Int. J. Electr. Power Energy Syst."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Khazaei, H., Aghamohammadloo, H., Habibi, M., Mehdinejad, M., and Mohammadpour Shotorbani, A. (2023). Novel Decentralized Peer-to-Peer Gas and Electricity Transaction Market between Prosumers and Retailers Considering Integrated Demand Response Programs. Sustainability, 15.","DOI":"10.3390\/su15076165"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"100584","DOI":"10.1016\/j.segan.2021.100584","article-title":"Peer-to-Peer Energy Trading among Smart Homes Considering Responsive Demand and Interactive Visual Interface for Monitoring","volume":"29","year":"2022","journal-title":"Sustain. Energy Grids Netw."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"102466","DOI":"10.1016\/j.asej.2023.102466","article-title":"Peer-to-Peer Trading in Smart Grid with Demand Response and Grid Outage Using Deep Reinforcement Learning","volume":"14","author":"Alsolami","year":"2023","journal-title":"Ain Shams Eng. J."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3603148","article-title":"P2P Energy Trading through Prospect Theory, Differential Evolution, and Reinforcement Learning","volume":"3","author":"Timilsina","year":"2023","journal-title":"ACM Trans. Evol. Learn. Optim."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"105378","DOI":"10.1016\/j.ijepes.2019.105378","article-title":"A Smart Community Energy Management Scheme Considering User Dominated Demand Side Response and P2P Trading","volume":"114","author":"Zhou","year":"2020","journal-title":"Int. J. Electr. Power Energy Syst."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Merrad, Y., Habaebi, M.H., Toha, S.F., Islam, M.R., Gunawan, T.S., and Mesri, M. (2022). Fully Decentralized, Cost-Effective Energy Demand Response Management System with a Smart Contracts-Based Optimal Power Flow Solution for Smart Grids. Energies, 15.","DOI":"10.3390\/en15124461"},{"key":"ref_35","first-page":"54","article-title":"Low-Carbon Operation Strategy for P2P Energy Trading Among Multiple Microgrids Considering Demand Response","volume":"44","author":"Zhao","year":"2023","journal-title":"Dianli Jianshe-Electric Power Constr."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"5167","DOI":"10.1109\/TVT.2022.3225524","article-title":"Blockchain-Based Optimized Energy Trading for E-Mobility Using Quantum Reinforcement Learning","volume":"72","author":"Kumar","year":"2023","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"101393","DOI":"10.1016\/j.pmatsci.2024.101393","article-title":"Advances in Aqueous Zinc-Ion Battery Systems: Cathode Materials and Chemistry","volume":"149","author":"Fan","year":"2025","journal-title":"Prog. Mater. Sci."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"231904","DOI":"10.1016\/j.jpowsour.2022.231904","article-title":"Recent Advances in Porous Electrodes for Vanadium Redox Flow Batteries in Grid-Scale Energy Storage Systems: A Mass Transfer Perspective","volume":"545","author":"Kim","year":"2022","journal-title":"J. Power Sources"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"100117","DOI":"10.1016\/j.enrev.2024.100117","article-title":"Advances in Safety of Lithium-Ion Batteries for Energy Storage: Hazard Characteristics and Active Suppression Techniques","volume":"4","author":"Wang","year":"2025","journal-title":"Energy Rev."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"119223","DOI":"10.1016\/j.enconman.2024.119223","article-title":"Comprehensive Review of Multi-Scale Lithium-Ion Batteries Modeling: From Electro-Chemical Dynamics Up to Heat Transfer in Battery Thermal Management System","volume":"325","author":"Mama","year":"2025","journal-title":"Energy Convers. Manag."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"106036","DOI":"10.1016\/j.scs.2024.106036","article-title":"Optimizing Battery Energy Storage System Placement in Energy Intensive Cities for Sustainable Urban Development Considering Multiple Objectives","volume":"118","author":"An","year":"2025","journal-title":"Sustain. Cities Soc."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"106030","DOI":"10.1016\/j.scs.2024.106030","article-title":"Optimizing Battery Storage for Sustainable Energy Communities: A Multi-Scenario Analysis","volume":"118","author":"Guo","year":"2025","journal-title":"Sustain. Cities Soc."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"101517","DOI":"10.1016\/j.esd.2024.101517","article-title":"Enhancing Battery Energy Storage Systems for Photovoltaic Applications in Extremely Cold Regions: A Brief Review","volume":"81","author":"Li","year":"2024","journal-title":"Energy Sustain. Dev."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"109272","DOI":"10.1016\/j.est.2023.109272","article-title":"Review on Grid-Tied Modular Battery Energy Storage Systems: Configuration Classifications, Control Advances, and Performance Evaluations","volume":"74","author":"Ma","year":"2023","journal-title":"J. Energy Storage"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"103598","DOI":"10.1016\/j.rineng.2024.103598","article-title":"Review of Battery-Supercapacitor Hybrid Energy Storage Systems for Electric Vehicles","volume":"24","author":"Gopi","year":"2024","journal-title":"Results Eng."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Zahedmanesh, A., Muttaqi, K.M., and Sutanto, D. (2018, January 23\u201327). Direct Control of Plug-in Electric Vehicle Charging Load Using an In-house Developed Intermediate Control Unit. Proceedings of the 2018 IEEE Industry Applications Society Annual Meeting (IAS), Portland, OR, USA.","DOI":"10.1109\/IAS.2018.8544626"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Bordin, C., and Tomasgard, A. (2021). Behavioural Change in Green Transportation: Micro-Economics Perspectives and Optimization Strategies. Energies, 14.","DOI":"10.3390\/en14133728"},{"key":"ref_48","first-page":"1797","article-title":"Sizing of Rooftop PV Array and Community-Run Battery Storage for an Energy Cooperative in Prosumer Cluster","volume":"37","author":"Sujikannan","year":"2022","journal-title":"Distrib. Gener. Altern. Energy J."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"111212","DOI":"10.1016\/j.enpol.2019.111212","article-title":"Regulatory Challenges and Opportunities for Collective Renewable Energy Prosumers in the EU","volume":"138","author":"Guilherme","year":"2020","journal-title":"Energy Policy"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"112435","DOI":"10.1016\/j.enpol.2021.112435","article-title":"Implementing a Just Renewable Energy Transition: Policy Advice for Transposing the New European Rules for Renewable Energy Communities","volume":"156","author":"Hoicka","year":"2021","journal-title":"Energy Policy"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"124660","DOI":"10.1016\/j.apenergy.2024.124660","article-title":"Levelling the Playing Field for Smart Renewable Energy Community in the Electricity Market through the High Street Electricity Market Model","volume":"377","author":"Peeren","year":"2025","journal-title":"Appl. Energy"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Junlakarn, S., Kokchang, P., and Audomvongseree, K. (2022). Drivers and Challenges of Peer-to-Peer Energy Trading Development in Thailand. Energies, 15.","DOI":"10.3390\/en15031229"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"103632","DOI":"10.1016\/j.adhoc.2024.103632","article-title":"Blockchain and Quantum Machine Learning Driven Energy Trading for Electric Vehicles","volume":"165","author":"Kashyap","year":"2024","journal-title":"Ad Hoc Netw."},{"key":"ref_54","first-page":"3091074","article-title":"Electric Vehicle Peer-to-Peer Energy Trading Model Based on SMES and Blockchain","volume":"31","author":"Li","year":"2021","journal-title":"IEEE Trans. Appl. Supercond."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"100586","DOI":"10.1016\/j.prime.2024.100586","article-title":"Blockchain Application in Energy Trading for Grid-Connected Prosumers","volume":"8","author":"Maine","year":"2024","journal-title":"E-Prime\u2014Adv. Electr. Eng. Electron. Energy"}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/2\/65\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:32:34Z","timestamp":1760027554000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/2\/65"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,13]]},"references-count":55,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["computers14020065"],"URL":"https:\/\/doi.org\/10.3390\/computers14020065","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,13]]}}}