{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T17:38:01Z","timestamp":1785605881069,"version":"3.56.0"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,8,19]],"date-time":"2023-08-19T00:00:00Z","timestamp":1692403200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,19]],"date-time":"2023-08-19T00:00:00Z","timestamp":1692403200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Cloud Comp"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Under the trend of green development, the traditional fossil fuel and centralized energy management models are no longer applicable, and distributed energy systems that can efficiently utilize clean energy have become the key to research in the energy field nowadays. However, there are still many problems in distributed energy trading systems, such as user privacy protection and mutual trust in trading, how to ensure the high quality and reliability of energy services, and how to motivate energy suppliers to participate in trading. To solve these problems, this paper proposes a blockchain-based smart grid system that enables efficient energy trading and consensus optimization, enabling electricity consumers to obtain high-quality, reliable energy services and electricity suppliers to receive rich rewards, and motivating all parties to actively participate in trading to maintain the balance of the system. We propose a reputation value assessment algorithm to evaluate the reputation of electricity suppliers to ensure that electricity consumers receive quality energy services. To minimize the cost, maximize the benefit for the electricity suppliers and optimize the system, we present an algorithm based on reinforcement learning DDPG to determine the power supplier, power generation capacity, and consensus mechanism between nodes to obtain power trading rights in each round. Simulation results show that the proposed energy trading scheme has good performance in terms of rewards.<\/jats:p>","DOI":"10.1186\/s13677-023-00498-4","type":"journal-article","created":{"date-parts":[[2023,8,19]],"date-time":"2023-08-19T10:02:19Z","timestamp":1692439339000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Joint optimization of energy trading and consensus mechanism in blockchain-empowered smart grids: a reinforcement learning approach"],"prefix":"10.1186","volume":"12","author":[{"given":"Ruohan","family":"Wang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yunlong","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Entang","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lixuan","family":"Che","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongwei","family":"Xin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xueyao","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,8,19]]},"reference":[{"issue":"4","key":"498_CR1","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.epsr.2015.11.024","volume":"37","author":"M Zeng","year":"2016","unstructured":"Zeng M, Zhang X, Wang L (2016) Energy supply side reform promoting based on energy internet thinking. Electric Power Constr 37(4):10\u201315","journal-title":"Electric Power Constr"},{"key":"498_CR2","doi-asserted-by":"publisher","first-page":"63837","DOI":"10.1109\/ACCESS.2019.2906402","volume":"7","author":"A Qazi","year":"2019","unstructured":"Qazi A, Hussain F, Rahim NA, Hardaker G, Alghazzawi D, Shaban K, Haruna K (2019) Towards sustainable energy: a systematic review of renewable energy sources, technologies, and public opinions. IEEE Access 7:63837\u201363851","journal-title":"IEEE Access"},{"issue":"2","key":"498_CR3","first-page":"1","volume":"4","author":"H Qili","year":"2019","unstructured":"Qili H (2019) Development road of green energy. Distrib Energy Resour 4(2):1\u20137","journal-title":"Distrib Energy Resour"},{"key":"498_CR4","doi-asserted-by":"publisher","first-page":"112111","DOI":"10.1016\/j.rser.2022.112111","volume":"158","author":"A Olabi","year":"2022","unstructured":"Olabi A, Abdelkareem MA (2022) Renewable energy and climate change. Renew Sust Energ Rev 158:112111","journal-title":"Renew Sust Energ Rev"},{"key":"498_CR5","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.esr.2019.01.006","volume":"24","author":"D Gielen","year":"2019","unstructured":"Gielen D, Boshell F, Saygin D, Bazilian MD, Wagner N, Gorini R (2019) The role of renewable energy in the global energy transformation. Energy Strateg Rev 24:38\u201350","journal-title":"Energy Strateg Rev"},{"issue":"7","key":"498_CR6","doi-asserted-by":"publisher","first-page":"e04511","DOI":"10.1016\/j.heliyon.2020.e04511","volume":"6","author":"S Soeiro","year":"2020","unstructured":"Soeiro S, Dias MF (2020) Renewable energy community and the european energy market: main motivations. Heliyon 6(7):e04511","journal-title":"Heliyon"},{"key":"498_CR7","doi-asserted-by":"publisher","unstructured":"Hu J, Moorthy SK, Harindranath A, Zhang Z, Zhao Z, Mastronarde N, Bentley ES, Pudlewski S, Guan Z (2023) A mobility- resilient spectrum sharing framework for operating wireless UAVs in the 6 GHz band. IEEE\/ACM Transactions on Networking. https:\/\/doi.org\/10.1109\/TNET.2023.3274354","DOI":"10.1109\/TNET.2023.3274354"},{"key":"498_CR8","doi-asserted-by":"publisher","first-page":"109275","DOI":"10.1016\/j.rser.2019.109275","volume":"113","author":"C Koch","year":"2019","unstructured":"Koch C, Hirth L (2019) Short-term electricity trading for system balancing: An empirical analysis of the role of intraday trading in balancing germany\u2019s electricity system. Renew Sust Energ Rev 113:109275","journal-title":"Renew Sust Energ Rev"},{"issue":"1","key":"498_CR9","first-page":"20","volume":"37","author":"G Chen","year":"2017","unstructured":"Chen G, Li M, Xu T, Liu M (2017) Study on technical bottleneck of new energy development. Proc CSEE 37(1):20\u201326","journal-title":"Proc CSEE"},{"issue":"1","key":"498_CR10","first-page":"52","volume":"4","author":"G Xutao","year":"2019","unstructured":"Xutao G, Jiecong C, Gaoyan H, Na X, Hongkun L (2019) Technologies and development status for distributed energy resources. Distrib Energy Resour 4(1):52\u201359","journal-title":"Distrib Energy Resour"},{"key":"498_CR11","doi-asserted-by":"crossref","unstructured":"Li C, Li Z, Zhu H, Tian Z, Feng W (2020) Study on operation strategy and load forecasting for distributed energy system based on chinese supply-side power grid reform. Energy Built Environ 3(1):113\u2013127","DOI":"10.1016\/j.enbenv.2020.11.005"},{"issue":"1","key":"498_CR12","doi-asserted-by":"publisher","first-page":"186","DOI":"10.3390\/en13010186","volume":"13","author":"PS Georgilakis","year":"2020","unstructured":"Georgilakis PS (2020) Review of computational intelligence methods for local energy markets at the power distribution level to facilitate the integration of distributed energy resources: State-of-the-art and future research. Energies 13(1):186","journal-title":"Energies"},{"key":"498_CR13","doi-asserted-by":"crossref","unstructured":"Bayram IS, Shakir MZ, Abdallah M, Qaraqe K (2014) A survey on energy trading in smart grid. In: 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP). IEEE, pp 258\u2013262","DOI":"10.1109\/GlobalSIP.2014.7032118"},{"issue":"4","key":"498_CR14","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1016\/j.tej.2019.03.002","volume":"32","author":"Y Liu","year":"2019","unstructured":"Liu Y, Wu L, Li J (2019) Peer-to-peer (p2p) electricity trading in distribution systems of the future. Electr J 32(4):2\u20136","journal-title":"Electr J"},{"issue":"6","key":"498_CR15","doi-asserted-by":"publisher","first-page":"1560","DOI":"10.3390\/en11061560","volume":"11","author":"J Abdella","year":"2018","unstructured":"Abdella J, Shuaib K (2018) Peer to peer distributed energy trading in smart grids: A survey. Energies 11(6):1560","journal-title":"Energies"},{"key":"498_CR16","doi-asserted-by":"publisher","first-page":"107100","DOI":"10.1016\/j.ijepes.2021.107100","volume":"131","author":"G Li","year":"2021","unstructured":"Li G, Li Q, Song W, Wang L (2021) Incentivizing distributed energy trading among prosumers: A general nash bargaining approach. Int J Electr Power Energy Syst 131:107100","journal-title":"Int J Electr Power Energy Syst"},{"key":"498_CR17","doi-asserted-by":"publisher","first-page":"1017","DOI":"10.1016\/j.jclepro.2019.04.008","volume":"225","author":"Q Wang","year":"2019","unstructured":"Wang Q, Su M, Li R, Ponce P (2019) The effects of energy prices, urbanization and economic growth on energy consumption per capita in 186 countries. J Clean Prod 225:1017\u20131032","journal-title":"J Clean Prod"},{"issue":"4","key":"498_CR18","doi-asserted-by":"publisher","first-page":"3587","DOI":"10.1109\/JIOT.2022.3222521","volume":"10","author":"Y Fu","year":"2023","unstructured":"Fu Y, Li C, Yu FR, Luan TH, Zhao P, Liu S (2023) A survey of blockchain and intelligent networking for the metaverse. IEEE Internet Things J 10(4):3587\u20133610","journal-title":"IEEE Internet Things J"},{"issue":"10","key":"498_CR19","first-page":"24","volume":"48","author":"W Xiong","year":"2020","unstructured":"Xiong W, Binyou Y, Zhang R et al (2020) Research ondistributedenergytradingmodelbasedonconsortiumchain. SmartPower 48(10):24\u201329","journal-title":"SmartPower"},{"issue":"10","key":"498_CR20","first-page":"56","volume":"47","author":"J Xu","year":"2019","unstructured":"Xu J, Wen M, Zhang K, Chen X (2019) Bidding transaction platform for distributed electrical energy based on blockchain. Xi\u2019an, Smart Power 47(10):56\u201362","journal-title":"Xi\u2019an, Smart Power"},{"issue":"11","key":"498_CR21","first-page":"11","volume":"2","author":"X Shen","year":"2016","unstructured":"Shen X, Pei Q-Q, Liu X-F (2016) Survey of block chain. Chin J Netw Inf Secur 2(11):11\u201320","journal-title":"Chin J Netw Inf Secur"},{"key":"498_CR22","doi-asserted-by":"crossref","unstructured":"Chong PHJ, Seet B-C, Chai M, Rehman SU (2018) Smart Grid and Innovative Frontiers in Telecommunications: Third International Conference, SmartGIFT 2018, Auckland, New Zealand, April 23-24, 2018, Proceedings, vol. 245. Springer","DOI":"10.1007\/978-3-319-94965-9"},{"issue":"15","key":"498_CR23","doi-asserted-by":"publisher","first-page":"2878","DOI":"10.3390\/en12152878","volume":"12","author":"Z Che","year":"2019","unstructured":"Che Z, Wang Y, Zhao J, Qiang Y, Ma Y, Liu J (2019) A distributed energy trading authentication mechanism based on a consortium blockchain. Energies 12(15):2878","journal-title":"Energies"},{"key":"498_CR24","doi-asserted-by":"crossref","unstructured":"Liu C, Chai KK, Lau ET, Chen Y (2018) Blockchain based energy trading model for electric vehicle charging schemes. In: International Conference on Smart Grid Inspired Future Technologies. Springer, pp. 64\u201372","DOI":"10.1007\/978-3-319-94965-9_7"},{"issue":"5","key":"498_CR25","doi-asserted-by":"publisher","first-page":"3220","DOI":"10.1109\/TCOMM.2022.3163439","volume":"70","author":"J Feng","year":"2022","unstructured":"Feng J, Zhang W, Pei Q, Wu J, Lin X (2022) Heterogeneous computation and resource allocation for wireless powered federated edge learning systems. IEEE Trans Commun 70(5):3220\u20133233","journal-title":"IEEE Trans Commun"},{"issue":"11","key":"498_CR26","first-page":"2687","volume":"33","author":"J Feng","year":"2022","unstructured":"Feng J, Liu L, Pei Q, Li K (2022) Min-max cost optimization for efficient hierarchical federated learning in wireless edge networks. IEEE Trans Parallel Distrib Syst 33(11):2687\u20132700","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"498_CR27","unstructured":"Zhang N, Wang Y, Kang C, Cheng J, He D (2016) Blockchain technique in the energy internet: preliminary research framework and typical applications.\u00a0Proceedings of the CSEE 36(15):4011\u20134022"},{"issue":"12","key":"498_CR28","first-page":"3247","volume":"25","author":"Q Wang","year":"2019","unstructured":"Wang Q, Liu C, Zhou B (2019) Trusted transaction method of manufacturing services based on blockchain. Comput Integr Manuf Syst 25(12):3247\u20133257","journal-title":"Comput Integr Manuf Syst"},{"issue":"3","key":"498_CR29","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1109\/MITS.2016.2573178","volume":"8","author":"R Alvaro-Hermana","year":"2016","unstructured":"Alvaro-Hermana R, Fraile-Ardanuy J, Zufiria PJ, Knapen L, Janssens D (2016) Peer to peer energy trading with electric vehicles. IEEE Intell Transp Syst Mag 8(3):33\u201344","journal-title":"IEEE Intell Transp Syst Mag"},{"key":"498_CR30","first-page":"59","volume":"5","author":"X Wang","year":"2018","unstructured":"Wang X, Wang J, Zhang Y et al (2018) Blockchain system for creating digital assets based on reputation value. Netinfo Secur 5:59\u201365","journal-title":"Netinfo Secur"},{"issue":"1","key":"498_CR31","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1109\/TNSE.2021.3068340","volume":"9","author":"J Du","year":"2022","unstructured":"Du J, Cheng W, Lu G, Cao H, Chu X, Zhang Z, Wang J (2022) Resource pricing and allocation in MEC enabled blockchain systems: An a3c deep reinforcement learning approach. IEEE Trans Netw Sci Eng 9(1):33\u201344","journal-title":"IEEE Trans Netw Sci Eng"},{"key":"498_CR32","doi-asserted-by":"crossref","unstructured":"Shi T, Cai Z, Li J, Gao H, Qiu T, Qu W (2022) An efficient processing scheme for concurrent applications in the iot edge. IEEE Trans Mob Comput","DOI":"10.1109\/TMC.2022.3219983"},{"issue":"10","key":"498_CR33","doi-asserted-by":"publisher","first-page":"9517","DOI":"10.1109\/JIOT.2020.3003449","volume":"7","author":"J Du","year":"2020","unstructured":"Du J, Yu FR, Lu G, Wang J, Jiang J, Chu X (2020) MEC-assisted immersive VR video streaming over terahertz wireless networks: A deep reinforcement learning approach. IEEE Internet Things J 7(10):9517\u20139529","journal-title":"IEEE Internet Things J"},{"issue":"2","key":"498_CR34","first-page":"1655","volume":"24","author":"Y Fu","year":"2023","unstructured":"Fu Y, Li C, Yu FR, Luan TH, Zhang Y (2023) A selective federated reinforcement learning strategy for autonomous driving. IEEE Trans Intell Transp Syst 24(2):1655\u20131668","journal-title":"IEEE Trans Intell Transp Syst"},{"issue":"7540","key":"498_CR35","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","volume":"518","author":"V Mnih","year":"2015","unstructured":"Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A, Riedmiller M, Fidjeland AK, Ostrovski G et al (2015) Human-level control through deep reinforcement learning. Nature 518(7540):529\u2013533","journal-title":"Nature"},{"key":"498_CR36","unstructured":"Mnih V, Badia AP, Mirza M, Graves A, Lillicrap T, Harley T, Silver D, Kavukcuoglu K (2016) Asynchronous methods for deep reinforcement learning. In: International conference on machine learning. PMLR, pp 1928\u20131937"},{"key":"498_CR37","unstructured":"Schulman J, Levine S, Abbeel P, Jordan M, Moritz P (2015) Trust region policy optimization. In: International conference on machine learning. PMLR, pp 1889\u20131897"},{"key":"498_CR38","doi-asserted-by":"crossref","unstructured":"Wu M, Yu FR, Liu PX, He Y (2022) A hybrid driving decision-making system integrating markov logic networks and connectionist AI. IEEE Trans Intell Transp Syst","DOI":"10.1109\/TITS.2022.3227122"},{"key":"498_CR39","doi-asserted-by":"crossref","unstructured":"Xiao H, Cai L, Feng J, Pei Q, Shi W (2023) Resource optimization of mab-based reputation management for data trading in vehicular edge computing. IEEE Trans Wirel Commun 1","DOI":"10.1109\/TWC.2022.3233035"},{"key":"498_CR40","doi-asserted-by":"crossref","unstructured":"Fang W, Zhang C, Shi Z, Zhao Q, Shan L (2016) Btres: Beta-based trust and reputation evaluation system for wireless sensor networks. J Netw Comput Appl 59:88\u201394. https:\/\/www.sciencedirect.com\/science\/article\/pii\/S108480451500140X","DOI":"10.1016\/j.jnca.2015.06.013"},{"key":"498_CR41","doi-asserted-by":"crossref","unstructured":"Friedman* EJ, Resnick P, (2001) The social cost of cheap pseudonyms. J Econ Manag Strateg 10(2):173\u2013199","DOI":"10.1162\/105864001300122476"},{"key":"498_CR42","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1016\/j.jnca.2015.06.013","volume":"59","author":"W Fang","year":"2015","unstructured":"Fang W, Zhang C, Shi Z, Zhao Q, Shan L (2015) Btres: Beta-based trust and reputation evaluation system for wireless sensor networks. J Netw Comput Appl 59:88\u201394","journal-title":"J Netw Comput Appl"},{"issue":"6","key":"498_CR43","doi-asserted-by":"publisher","first-page":"3559","DOI":"10.1109\/TII.2019.2897805","volume":"15","author":"M Liu","year":"2019","unstructured":"Liu M, Yu FR, Teng Y, Leung VC, Song M (2019) Performance optimization for blockchain-enabled industrial internet of things (IIOT) systems: A deep reinforcement learning approach. IEEE Trans Ind Inform 15(6):3559\u20133570","journal-title":"IEEE Trans Ind Inform"},{"issue":"6","key":"498_CR44","doi-asserted-by":"publisher","first-page":"5853","DOI":"10.1109\/TVT.2022.3165172","volume":"71","author":"M Wu","year":"2022","unstructured":"Wu M, Yu FR, Liu PX (2022) Intelligence networking for autonomous driving in beyond 5g networks with multi-access edge computing. IEEE Trans Veh Technol 71(6):5853\u20135866","journal-title":"IEEE Trans Veh Technol"},{"issue":"2","key":"498_CR45","doi-asserted-by":"publisher","first-page":"497","DOI":"10.1109\/TNET.2022.3196267","volume":"31","author":"T Shi","year":"2022","unstructured":"Shi T, Cai Z, Li J, Gao H, Chen J, Yang M (2022) Services management and distributed multihop requests routing in mobile edge networks. IEEE\/ACM Trans Networking 31(2):497\u2013510","journal-title":"IEEE\/ACM Trans Networking"}],"container-title":["Journal of Cloud Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-023-00498-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13677-023-00498-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-023-00498-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,19]],"date-time":"2023-11-19T06:09:12Z","timestamp":1700374152000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofcloudcomputing.springeropen.com\/articles\/10.1186\/s13677-023-00498-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,19]]},"references-count":45,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["498"],"URL":"https:\/\/doi.org\/10.1186\/s13677-023-00498-4","relation":{},"ISSN":["2192-113X"],"issn-type":[{"value":"2192-113X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,19]]},"assertion":[{"value":"31 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 August 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"121"}}