{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,23]],"date-time":"2026-02-23T09:32:37Z","timestamp":1771839157236,"version":"3.50.1"},"reference-count":48,"publisher":"EDP Sciences","issue":"1","license":[{"start":{"date-parts":[[2026,2,23]],"date-time":"2026-02-23T00:00:00Z","timestamp":1771804800000},"content-version":"vor","delay-in-days":53,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["NRF-2021R1A6A1A03039981"],"award-info":[{"award-number":["NRF-2021R1A6A1A03039981"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["RAIRO-Oper. Res."],"accepted":{"date-parts":[[2025,12,10]]},"published-print":{"date-parts":[[2026,1]]},"abstract":"<jats:p>In this study, we propose an optimal strategy for managing multiple energy storage systems (ESS) to reduce both electricity expenses and battery degradation costs. Our approach uses a two-stage optimization process for battery management. In the first stage, reinforcement learning (RL) identifies the aggregated optimal amounts for charging and discharging. Then, quadratic programming (QP) distributes these aggregated amounts across multiple batteries. Experiments conducted under different test conditions, including variations in the number of batteries and their remaining lifespans, show that ESS with reused batteries can improve operational efficiency and achieve total cost savings of 1.7% to 11.2% compared to ESS with new batteries.<\/jats:p>","DOI":"10.1051\/ro\/2025164","type":"journal-article","created":{"date-parts":[[2025,12,15]],"date-time":"2025-12-15T08:47:29Z","timestamp":1765788449000},"page":"139-156","source":"Crossref","is-referenced-by-count":0,"title":["Optimal scheduling for multi-ESS considering life-cycle battery degradation"],"prefix":"10.1051","volume":"60","author":[{"given":"Jaemin","family":"Park","sequence":"first","affiliation":[{"name":"Department of Data Science, Seoul National University of Science and Technology","place":["South Korea"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Taekyeong","family":"Jeong","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, Seoul National University of Science and Technology","place":["South Korea"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0616-1449","authenticated-orcid":false,"given":"Min Kyu","family":"Sim","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, Seoul National University of Science and Technology","place":["South Korea"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"250","published-online":{"date-parts":[[2026,2,23]]},"reference":[{"key":"R1","doi-asserted-by":"crossref","first-page":"109739","DOI":"10.1016\/j.rser.2020.109739","volume":"123","author":"Bozorgavari","year":"2020","journal-title":"Renew. Sustainable Energy Rev."},{"key":"R2","doi-asserted-by":"crossref","unstructured":"Chai Q., Zhang C., Dong Z. and Chen W., Optimal daily scheduling of distributed battery energy storage systems considering battery degradation cost, in 2021 IEEE Power & Energy Society General Meeting (PESGM). IEEE (2021) 1\u20135.","DOI":"10.1109\/PESGM46819.2021.9638252"},{"key":"R3","doi-asserted-by":"crossref","first-page":"88534","DOI":"10.1109\/ACCESS.2024.3414450","volume":"12","author":"Choi","year":"2024","journal-title":"IEEE Access"},{"key":"R4","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1108\/IJESM-01-2015-0003","volume":"10","author":"Chua","year":"2016","journal-title":"Int. J. Energy Sector Manage."},{"key":"R5","doi-asserted-by":"crossref","first-page":"2579","DOI":"10.1007\/s11081-022-09786-5","volume":"24","author":"Cox","year":"2023","journal-title":"Optim. Eng."},{"key":"R6","doi-asserted-by":"crossref","unstructured":"Delev A., Zhukova A. and Flerova A., Application of machine learning in the producer\u2019s optimal control problem with non-stable demand, in 2022 8th International Conference on Control, Decision and Information Technologies (CoDIT). Vol. 1. IEEE (2022) 867\u2013871.","DOI":"10.1109\/CoDIT55151.2022.9803997"},{"key":"R7","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1109\/TSTE.2020.3001015","volume":"12","author":"Deng","year":"2020","journal-title":"IEEE Trans. Sustainable Energy"},{"key":"R8","first-page":"1","volume":"17","author":"Diamond","year":"2016","journal-title":"J. Mach. Learn. Res."},{"key":"R9","doi-asserted-by":"crossref","first-page":"49436","DOI":"10.1109\/ACCESS.2020.2979189","volume":"8","author":"Dinh","year":"2020","journal-title":"IEEE Access"},{"key":"R10","doi-asserted-by":"crossref","first-page":"121275","DOI":"10.1016\/j.apenergy.2023.121275","volume":"344","author":"Erdin\u00e7","year":"2023","journal-title":"Appl. Energy"},{"key":"R11","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1002\/nav.3800030109","volume":"3","author":"Frank","year":"1956","journal-title":"Naval Res. Logistics Q."},{"key":"R12","doi-asserted-by":"crossref","first-page":"2859","DOI":"10.1109\/TSG.2016.2602480","volume":"8","author":"Giannitrapani","year":"2016","journal-title":"IEEE Trans. Smart Grid"},{"key":"R13","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1051\/ro\/2019046","volume":"54","author":"Golp^\u0131ra","year":"2020","journal-title":"RAIRO-Oper. Res."},{"key":"R14","unstructured":"Haarnoja T., Zhou A., Abbeel P. and Levine S., Soft actor-critic: off-policy maximum entropy deep reinforcement learning with a stochastic actor, in International Conference on Machine Learning. Pmlr (2018) 1861\u20131870."},{"key":"R15","doi-asserted-by":"crossref","first-page":"110022","DOI":"10.1016\/j.rser.2020.110022","volume":"131","author":"Hannan","year":"2020","journal-title":"Renew. Sustainable Energy Rev."},{"key":"R16","doi-asserted-by":"crossref","unstructured":"Hemdani J., Degaa L., Rizoug N. and Chaari A., State of health prediction of lithium-ion battery using machine learning algorithms, in 2023 9th International Conference on Control, Decision and Information Technologies (CoDIT). IEEE (2023) 2729\u20132733.","DOI":"10.1109\/CoDIT58514.2023.10284459"},{"key":"R17","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1109\/TTE.2020.2980744","volume":"6","author":"Hussain","year":"2020","journal-title":"IEEE Trans. Transp. Electrification"},{"key":"R18","doi-asserted-by":"crossref","first-page":"5633","DOI":"10.3390\/en13215633","volume":"13","author":"Hwang","year":"2020","journal-title":"Energies"},{"key":"R19","doi-asserted-by":"crossref","unstructured":"Jeong T., Park J. and Sim M.K., Optimal scheduling for dual-ESS considering life-cycle degradation, in 2024 10th International Conference on Control, Decision and Information Technologies (CoDIT). IEEE (2024) 2158\u20132163.","DOI":"10.1109\/CoDIT62066.2024.10708492"},{"key":"R20","unstructured":"Korea Electricity Power Corporation, Time-of-use industrial rate plans (2024)."},{"key":"R21","first-page":"447","volume":"24","author":"K\u00fcster","year":"2023","journal-title":"Optim. Eng."},{"key":"R22","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1016\/j.enbuild.2012.09.035","volume":"55","author":"Leadbetter","year":"2012","journal-title":"Energy Buildings"},{"key":"R23","doi-asserted-by":"crossref","first-page":"106382","DOI":"10.1016\/j.est.2022.106382","volume":"58","author":"Li","year":"2023","journal-title":"J. Energy Storage"},{"key":"R24","unstructured":"Mnih V., Kavukcuoglu K., Silver D., Graves A., Antonoglou I., Wierstra D. and Riedmiller M., Playing atari with deep reinforcement learning. Preprint arXiv:1312.5602 (2013)."},{"key":"R25","doi-asserted-by":"crossref","first-page":"8352","DOI":"10.1002\/er.7735","volume":"46","author":"Mohammad","year":"2022","journal-title":"Int. J. Energy Res."},{"key":"R26","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1109\/59.744492","volume":"14","author":"Momoh","year":"1999","journal-title":"IEEE Trans. Power Syst."},{"key":"R27","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1051\/ro\/2023006","volume":"57","author":"Nafarieh","year":"2023","journal-title":"RAIRO-Oper. Res."},{"key":"R28","doi-asserted-by":"crossref","first-page":"118987","DOI":"10.1016\/j.energy.2020.118987","volume":"214","author":"Olabi","year":"2021","journal-title":"Energy"},{"key":"R29","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1109\/TPWRS.2019.2936131","volume":"35","author":"Padmanabhan","year":"2019","journal-title":"IEEE Trans. Power Syst."},{"key":"R30","doi-asserted-by":"crossref","first-page":"107964","DOI":"10.1016\/j.est.2023.107964","volume":"71","author":"Park","year":"2023","journal-title":"J. Energy Storage"},{"key":"R31","doi-asserted-by":"crossref","first-page":"116274","DOI":"10.1016\/j.apenergy.2020.116274","volume":"283","author":"Pusceddu","year":"2021","journal-title":"Appl. Energy"},{"key":"R32","doi-asserted-by":"crossref","first-page":"113295","DOI":"10.1016\/j.enconman.2020.113295","volume":"223","author":"Rahman","year":"2020","journal-title":"Energy Convers. Manage."},{"key":"R33","doi-asserted-by":"crossref","first-page":"104785","DOI":"10.1016\/j.resconrec.2020.104785","volume":"159","author":"Rallo","year":"2020","journal-title":"Resour. Conserv. Recycl."},{"key":"R34","unstructured":"Schulman J., Wolski F., Dhariwal P., Radford A. and Klimov O., Proximal policy optimization algorithms. Preprint arXiv:1707.06347 (2017)."},{"key":"R35","doi-asserted-by":"crossref","first-page":"105939","DOI":"10.1016\/j.est.2022.105939","volume":"56","author":"Song","year":"2022","journal-title":"J. Energy Storage"},{"key":"R36","unstructured":"Southern California Edison, Time-of-use residential rate plans (2024). [Online; accessed 11-August-2024]."},{"key":"R37","unstructured":"Sutton R.S. and Barto A.G., Reinforcement Learning: An Introduction. MIT Press (2018)."},{"key":"R38","doi-asserted-by":"crossref","first-page":"720","DOI":"10.3390\/en14030720","volume":"14","author":"Szott","year":"2021","journal-title":"Energies"},{"key":"R39","doi-asserted-by":"crossref","first-page":"100892","DOI":"10.1016\/j.est.2019.100892","volume":"26","author":"Wong","year":"2019","journal-title":"J. Energy Storage"},{"key":"R40","doi-asserted-by":"crossref","first-page":"120108","DOI":"10.1016\/j.energy.2021.120108","volume":"224","author":"Wu","year":"2021","journal-title":"Energy"},{"key":"R41","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.renene.2021.09.036","volume":"181","author":"Wu","year":"2022","journal-title":"Renew. Energy"},{"key":"R42","doi-asserted-by":"crossref","first-page":"109385","DOI":"10.1016\/j.ijepes.2023.109385","volume":"153","author":"Xiong","year":"2023","journal-title":"Int. J. Electr. Power Energy Syst."},{"key":"R43","doi-asserted-by":"crossref","first-page":"1131","DOI":"10.1109\/TSG.2016.2578950","volume":"9","author":"Xu","year":"2016","journal-title":"IEEE Trans. Smart Grid"},{"key":"R44","doi-asserted-by":"crossref","first-page":"1500","DOI":"10.1049\/iet-rpg.2017.0839","volume":"12","author":"Yan","year":"2018","journal-title":"IET Renew. Power Gener."},{"key":"R45","doi-asserted-by":"crossref","unstructured":"Yetkin M., Augustino B., Lamadrid A.J. and Snyder L.V., Co-optimizing the smart grid and electric public transit bus system. Optim. Eng. (2024) 1\u201348.","DOI":"10.1007\/s11081-023-09878-w"},{"key":"R46","doi-asserted-by":"crossref","unstructured":"Zakeri B. and Syri S., Value of energy storage in the nordic power market-benefits from price arbitrage and ancillary services, in 2016 13th International Conference on the European Energy Market (EEM). IEEE (2016).","DOI":"10.1109\/EEM.2016.7521275"},{"key":"R47","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1016\/j.enconman.2015.07.079","volume":"105","author":"Zhang","year":"2015","journal-title":"Energy Convers. Manage."},{"key":"R48","doi-asserted-by":"crossref","first-page":"8198","DOI":"10.1016\/j.egyr.2021.09.009","volume":"7","author":"Zhang","year":"2021","journal-title":"Energy Rep."}],"container-title":["RAIRO - Operations Research"],"original-title":[],"link":[{"URL":"https:\/\/www.rairo-ro.org\/10.1051\/ro\/2025164\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,23]],"date-time":"2026-02-23T08:47:55Z","timestamp":1771836475000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.rairo-ro.org\/10.1051\/ro\/2025164"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1]]},"references-count":48,"journal-issue":{"issue":"1"},"alternative-id":["ro240852"],"URL":"https:\/\/doi.org\/10.1051\/ro\/2025164","relation":{},"ISSN":["0399-0559","2804-7303"],"issn-type":[{"value":"0399-0559","type":"print"},{"value":"2804-7303","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1]]}}}