{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T01:48:43Z","timestamp":1775699323973,"version":"3.50.1"},"reference-count":66,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T00:00:00Z","timestamp":1773273600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Spatial layout planning is a core issue in architectural design with a significant impact on building performance. Although various artificial intelligence methods have advanced automated spatial layout planning in the construction area, applications of reinforcement learning for existing building renovation, particularly those with performance-based aims, remain limited. This study proposes an automated spatial layout planning framework using deep reinforcement learning to evaluate its viability and efficiency in functional layout renovation targeting sustainable objectives. The agent-based simulation with the queuing theory was employed to capture the occupant patterns, providing a foundation for the performance indicators of the reinforcement learning model. The model was trained and applied to a real case to generate optimized layouts, achieving improvements in energy and occupant circulation compared to the original layout plan. It should be clarified that the above energy-optimization estimation of the model relied on a simplified approximation rather than a dynamic energy simulation. The results demonstrate the advantages of this framework in advancing artificial intelligence-aided design and indicate future research directions for enhancing the design efficiency and quality in automated spatial layout planning.<\/jats:p>","DOI":"10.1093\/jcde\/qwag024","type":"journal-article","created":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T12:50:10Z","timestamp":1773233410000},"page":"135-156","source":"Crossref","is-referenced-by-count":0,"title":["The application of a deep reinforcement learning method in performance-based building renovation"],"prefix":"10.1093","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-6926-2025","authenticated-orcid":false,"given":"Anqi","family":"Dai","sequence":"first","affiliation":[{"name":"The Hong Kong Polytechnic University The Department of Land Surveying and Geo-Informatics, , Hong Kong 999077 ,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-6338-064X","authenticated-orcid":false,"given":"Xinyi","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Architecture, Tianjin University , Tianjin 300072 ,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-8199-8233","authenticated-orcid":false,"given":"Mingchun","family":"Hu","sequence":"additional","affiliation":[{"name":"The Hong Kong Polytechnic University The Department of Land Surveying and Geo-Informatics, , Hong Kong 999077 ,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0921-8159","authenticated-orcid":false,"given":"Xiaohu","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Architecture and Urban Planning, Huazhong University of Science and Technology , Wuhan 430074 ,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2026,3,12]]},"reference":[{"key":"2026040820555980400_bib1","doi-asserted-by":"publisher","first-page":"012068","DOI":"10.1088\/1755-1315\/961\/1\/012068.","article-title":"Investigation of noise pollution in an educational building\u2013case study of babylon university in Iraq","volume-title":"IOP Conference Series: Earth and Environmental Science","author":"Al-Isawi","year":"2022"},{"key":"2026040820555980400_bib2","volume-title":"Evolutionary Computation for Modeling and Optimization","author":"Ashlock","year":"2006"},{"key":"2026040820555980400_bib3","first-page":"59","article-title":"Review on research methods in performance-based building design of high-rise residential property","volume-title":"ICSDEMS 2019: Proceedings of the International Conference on Sustainable Design, Engineering, Management and Sciences","author":"Astarini","year":"2020"},{"key":"2026040820555980400_bib4","doi-asserted-by":"crossref","first-page":"348","DOI":"10.26868\/25746308.2022.C039","article-title":"Development of an occupancy schedule for openstudio prototype college building model","volume-title":"2022 Building Performance Analysis Conference and SimBuild","author":"Bae","year":"2022"},{"key":"2026040820555980400_bib5","doi-asserted-by":"publisher","first-page":"356","DOI":"10.1007\/s12273-008-8527-8","article-title":"Fundamentals of performance-based building design","volume":"1","author":"Becker","year":"2008","journal-title":"Building Simulation"},{"key":"2026040820555980400_bib6","first-page":"679","article-title":"A markovian decision process","volume":"6","author":"Bellman","year":"1957","journal-title":"Journal of Mathematics and Mechanics"},{"key":"2026040820555980400_bib7","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1002\/9781118762745.ch12","article-title":"Multi-method modelling: Anylogic","volume-title":"Discrete-Event Simulation and System Dynamics for Management Decision Making","author":"Borshchev","year":"2014"},{"key":"2026040820555980400_bib8","volume-title":"An Introduction to Queueing Systems","author":"Bose","year":"2013"},{"key":"2026040820555980400_bib9","doi-asserted-by":"publisher","first-page":"4393","DOI":"10.3390\/su12114393","article-title":"Self-organising floor plans in care homes","volume":"12","author":"Carta","year":"2020","journal-title":"Sustainability"},{"key":"2026040820555980400_bib10","doi-asserted-by":"publisher","first-page":"101212","DOI":"10.1016\/j.seta.2021.101212","article-title":"The impacts of occupant behavior on building energy consumption: A review","volume":"45","author":"Chen","year":"2021","journal-title":"Sustainable Energy Technologies and Assessments"},{"key":"2026040820555980400_bib11","doi-asserted-by":"publisher","first-page":"933","DOI":"10.1177\/2399808317690150","article-title":"Urban form, building characteristics, and residential electricity consumption: A case study in tainan city","volume":"45","author":"Chen","year":"2018","journal-title":"Environment and Planning B: Urban Analytics and City Science"},{"key":"2026040820555980400_bib12","doi-asserted-by":"publisher","first-page":"104902","DOI":"10.1016\/j.csite.2024.104902","article-title":"Impact of glazing type, window-to-wall ratio, and orientation on building energy savings quality: A parametric analysis in algerian climatic conditions","volume":"61","author":"Cherier","year":"2024","journal-title":"Case Studies in Thermal Engineering"},{"key":"2026040820555980400_bib13","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.4851123","article-title":"Enhancing energy efficiency in a hypothetical building through analysis of orientation, wwr, shading, window shape, and illuminance intensity","author":"Dagiyan","year":"2024"},{"key":"2026040820555980400_bib14","doi-asserted-by":"publisher","first-page":"1061","DOI":"10.1016\/j.rser.2017.05.264","article-title":"The impact of occupants\u2019 behaviours on building energy analysis: A research review","volume":"80","author":"Delzendeh","year":"2017","journal-title":"Renewable and Sustainable Energy Reviews"},{"key":"2026040820555980400_bib15","article-title":"The optimization potential of floor-plan typologies in early design energy modeling","volume-title":"Proceedings of BS2015: 14th Conference of International Building Performance Simulation Association","author":"Dogan","year":"2015"},{"key":"2026040820555980400_bib16","doi-asserted-by":"publisher","first-page":"101902","DOI":"10.1016\/j.jobe.2020.101902","article-title":"Integrated multi-objective optimization and agent-based building occupancy modeling for space layout planning","volume":"34","author":"Dorrah","year":"2021","journal-title":"Journal of Building Engineering"},{"key":"2026040820555980400_bib17","doi-asserted-by":"publisher","first-page":"1375","DOI":"10.1016\/j.jclepro.2019.05.324","article-title":"Simulation-based evolutionary optimization for energy-efficient layout plan design of high-rise residential buildings","volume":"231","author":"Gan","year":"2019","journal-title":"Journal of Cleaner Production"},{"key":"2026040820555980400_bib18","doi-asserted-by":"publisher","first-page":"4600","DOI":"10.1109\/TSMC.2021.3098451","article-title":"Proximal policy optimization with policy feedback","volume":"52","author":"Gu","year":"2021","journal-title":"IEEE Transactions on Systems, Man, and Cybernetics: Systems"},{"key":"2026040820555980400_bib19","first-page":"134","article-title":"A performance-based urban block generative design using deep reinforcement learning and computer vision","volume-title":"The International Conference on Computational Design and Robotic Fabrication","author":"Han","year":"2020"},{"key":"2026040820555980400_bib66_837_185126","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1007\/s43069-024-00301-3","article-title":"Gym-flp: A python package for training reinforcement learning algorithms on facility layout problems","volume":"5","author":"Heinbach","year":"2024","journal-title":"Operations Research Forum"},{"key":"2026040820555980400_bib20","article-title":"Energy performance of buildings\u2014energy needs for heating and cooling, internal temperatures and sensible and latent heat loads\u2014part 1: Calculation procedures","author":"International Organization for Standardization","year":"2017"},{"key":"2026040820555980400_bib21","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1016\/j.rser.2016.10.011","article-title":"From occupancy to occupant behavior: An analytical survey of data acquisition technologies, modeling methodologies and simulation coupling mechanisms for building energy efficiency","volume":"68","author":"Jia","year":"2017","journal-title":"Renewable and Sustainable Energy Reviews"},{"key":"2026040820555980400_bib22","doi-asserted-by":"publisher","first-page":"100795","DOI":"10.1016\/j.progress.2023.100795","article-title":"Generative urban design: A systematic review on problem formulation, design generation, and decision-making","volume":"180","author":"Jiang","year":"2024","journal-title":"Progress in Planning"},{"key":"2026040820555980400_bib23","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1080\/00038628.1995.9696774","article-title":"A genetic search approach to space layout planning","volume":"38","author":"Jo","year":"1995","journal-title":"Architectural Science Review"},{"key":"2026040820555980400_bib24","doi-asserted-by":"publisher","first-page":"108684","DOI":"10.1016\/j.buildenv.2021.108684","article-title":"Evaluation of simplified building energy models for urban-scale energy analysis of buildings","volume":"211","author":"Johari","year":"2022","journal-title":"Building and Environment"},{"key":"2026040820555980400_bib25","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1613\/jair.301","article-title":"Reinforcement learning: A survey","volume":"4","author":"Kaelbling","year":"1996","journal-title":"Journal of Artificial Intelligence Research"},{"key":"2026040820555980400_bib26","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1093\/jcde\/qwae025","article-title":"Reimagining space layout design through deep reinforcement learning","volume":"11","author":"Kakooee","year":"2024","journal-title":"Journal of Computational Design and Engineering"},{"key":"2026040820555980400_bib27","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1093\/jcde\/qwae109","article-title":"Enhancing architectural space layout design by pretraining deep reinforcement learning agents","volume":"12","author":"Kakooee","year":"2025","journal-title":"Journal of Computational Design and Engineering"},{"key":"2026040820555980400_bib28","doi-asserted-by":"publisher","first-page":"2287","DOI":"10.18280\/ijsdp.170730","article-title":"Design guidelines and standards for iraqi schools-the future prospects","volume":"17","author":"Kazem","year":"2022","journal-title":"International Journal of Sustainable Development and Planning"},{"key":"2026040820555980400_bib29","doi-asserted-by":"publisher","first-page":"950","DOI":"10.3390\/en13040950","article-title":"Development of energy benchmarks for office buildings using the national energy consumption database","volume":"13","author":"Kim","year":"2020","journal-title":"Energies"},{"key":"2026040820555980400_bib65_981_184626","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1016\/j.jmsy.2024.04.007","article-title":"Transferable multi-objective factory layout planning using simulation-based deep reinforcement learning","volume":"74","author":"Klar","year":"2024","journal-title":"Journal of Manufacturing Systems"},{"key":"2026040820555980400_bib30","doi-asserted-by":"publisher","first-page":"105019","DOI":"10.1016\/j.autcon.2023.105019","article-title":"Architectural spatial layout planning using artificial intelligence","volume":"154","author":"Ko","year":"2023","journal-title":"Automation in Construction"},{"key":"2026040820555980400_bib31","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1007\/978-3-030-42227-1_5","article-title":"Multi-layer perceptrons","volume-title":"Computational intelligence: A methodological introduction","author":"Kruse","year":"2022"},{"key":"2026040820555980400_bib32","doi-asserted-by":"publisher","first-page":"2061","DOI":"10.3390\/en4112061","article-title":"Energy-saving potential of building envelope designs in residential houses in taiwan","volume":"4","author":"Lai","year":"2011","journal-title":"Energies"},{"key":"2026040820555980400_bib33","doi-asserted-by":"publisher","first-page":"1157","DOI":"10.1016\/0360-5442(94)90072-8","article-title":"Energy consumption in Hong Kong","volume":"19","author":"Lam","year":"1994","journal-title":"Energy"},{"key":"2026040820555980400_bib34","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1093\/jcde\/qwaf131","article-title":"Optimization of facility layout using reinforcement learning for semiconductor production","volume":"13","author":"Lee","year":"2026","journal-title":"Journal of Computational Design and Engineering"},{"key":"2026040820555980400_bib36","doi-asserted-by":"publisher","first-page":"104091","DOI":"10.1016\/j.inffus.2025.104091","article-title":"Chatassistdesign: A language-interactive framework for iterative vector floorplan generation via conditional diffusion","volume":"130","author":"Li","year":"2025","journal-title":"Information Fusion"},{"key":"2026040820555980400_bib35","doi-asserted-by":"crossref","DOI":"10.1609\/aaai.v29i1.9654","article-title":"Preference planning for markov decision processes","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Li","year":"2015"},{"key":"2026040820555980400_bib37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1882262.1866203","article-title":"Computer-generated residential building layouts","volume-title":"ACM SIGGRAPH Asia 2010 papers","author":"Merrell","year":"2010"},{"key":"2026040820555980400_bib38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1162\/evco.1996.4.1.1","article-title":"Evolutionary algorithms for constrained parameter optimization problems","volume":"4","author":"Michalewicz","year":"1996","journal-title":"Evolutionary Computation"},{"key":"2026040820555980400_bib39","doi-asserted-by":"publisher","DOI":"10.1108\/SASBE-02-2025-0059","article-title":"Redefining design features for mitigating performance gaps in higher education buildings","author":"Nazeer","year":"2025","journal-title":"Smart and Sustainable Built Environment"},{"key":"2026040820555980400_bib40","doi-asserted-by":"publisher","first-page":"110375","DOI":"10.1016\/j.buildenv.2023.110375","article-title":"Data sources and approaches for building occupancy profiles at the urban scale\u2013a review","volume":"238","author":"Nejadshamsi","year":"2023","journal-title":"Building and Environment"},{"key":"2026040820555980400_bib41","first-page":"582","article-title":"Autonet: An application of a neural network simulation as a tool for planning office layout","volume-title":"Proceedings of the Human Factors Society Annual Meeting","author":"O\u2019Neill","year":"1992"},{"key":"2026040820555980400_bib42","doi-asserted-by":"publisher","first-page":"101867","DOI":"10.1016\/j.scs.2019.101867","article-title":"Modeling and urban planning: A systematic review of performance-based approaches","volume":"52","author":"Pelorosso","year":"2020","journal-title":"Sustainable Cities and Society"},{"key":"2026040820555980400_bib43","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1016\/j.ejor.2005.09.014","article-title":"Assignment problems: A golden anniversary survey","volume":"176","author":"Pentico","year":"2007","journal-title":"European Journal of Operational Research"},{"key":"2026040820555980400_bib44","volume-title":"Markov Decision Processes: Discrete Stochastic Dynamic Programming","author":"Puterman","year":"2014"},{"key":"2026040820555980400_bib45","doi-asserted-by":"publisher","first-page":"111220","DOI":"10.1016\/j.jobe.2024.111220","article-title":"Fluid grey 2: How well does generative adversarial network learn deeper topology structure in architecture that matches images?","volume":"98","author":"Qiu","year":"2024","journal-title":"Journal of Building Engineering"},{"key":"2026040820555980400_bib46","doi-asserted-by":"publisher","first-page":"110307","DOI":"10.1016\/j.jobe.2024.110307","article-title":"A systematic review of occupancy pattern in urban building energy modeling: From urban to building-scale","volume":"95","author":"Ren","year":"2024","journal-title":"Journal of Building Engineering"},{"key":"2026040820555980400_bib47","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1007\/s42979-021-00592-x","article-title":"Machine learning: Algorithms, real-world applications and research directions","volume":"2","author":"Sarker","year":"2021","journal-title":"SN Computer Science"},{"key":"2026040820555980400_bib49","article-title":"High-dimensional continuous control using generalized advantage estimation","author":"Schulman","year":"2018"},{"key":"2026040820555980400_bib48","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1707.06347","article-title":"Proximal policy optimization algorithms","author":"Schulman","year":"2017"},{"key":"2026040820555980400_bib50","doi-asserted-by":"publisher","first-page":"1512","DOI":"10.3390\/en16031512","article-title":"A systematic study on reinforcement learning based applications","volume":"16","author":"Sivamayil","year":"2023","journal-title":"Energies"},{"key":"2026040820555980400_bib51","doi-asserted-by":"publisher","first-page":"110815","DOI":"10.1016\/j.enbuild.2021.110815","article-title":"Data-driven optimization of building layouts for energy efficiency","volume":"238","author":"Sonta","year":"2021","journal-title":"Energy and Buildings"},{"key":"2026040820555980400_bib52","doi-asserted-by":"publisher","first-page":"2114884","DOI":"10.1155\/2022\/2114884","article-title":"Design and optimization of indoor space layout based on deep learning","volume":"2022","author":"Sun","year":"2022","journal-title":"Mobile Information Systems"},{"key":"2026040820555980400_bib53","doi-asserted-by":"publisher","first-page":"109434","DOI":"10.1016\/j.enbuild.2019.109434","article-title":"Effect of window-to-wall ratio on measured energy consumption in us office buildings","volume":"203","author":"Troup","year":"2019","journal-title":"Energy and Buildings"},{"key":"2026040820555980400_bib54","doi-asserted-by":"publisher","first-page":"109056","DOI":"10.1016\/j.buildenv.2022.109056","article-title":"Data acquisition for urban building energy modeling: A review","volume":"217","author":"Wang","year":"2022","journal-title":"Building and Environment"},{"key":"2026040820555980400_bib55","doi-asserted-by":"publisher","first-page":"105668","DOI":"10.1016\/j.autcon.2024.105668","article-title":"Automated layout generation from sites to flats using gan and transfer learning","volume":"166","author":"Wang","year":"2024","journal-title":"Automation in Construction"},{"key":"2026040820555980400_bib56","doi-asserted-by":"publisher","first-page":"2420","DOI":"10.3390\/ijerph20032420","article-title":"Achieving carbon neutrality through urban planning and design","volume":"20","author":"Wu","year":"2023","journal-title":"International Journal of Environmental Research and Public Health"},{"key":"2026040820555980400_bib57","doi-asserted-by":"publisher","first-page":"125235","DOI":"10.1109\/ACCESS.2024.3451406","article-title":"Housegandi: A hybrid approach to strike a balance of sampling time and diversity in floorplan generation","volume":"12","author":"Yenew","year":"2024","journal-title":"IEEE Access"},{"key":"2026040820555980400_bib58","doi-asserted-by":"publisher","first-page":"24611","DOI":"10.48550\/arXiv.2103.01955","article-title":"The surprising effectiveness of ppo in cooperative multi-agent games","volume":"35","author":"Yu","year":"2022","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2026040820555980400_bib59","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1061\/(ASCE)CP.1943-5487.0000129","article-title":"Estimating the interior layout of buildings using a shape grammar to capture building style","volume":"26","author":"Yue","year":"2012","journal-title":"Journal of Computing in Civil Engineering"},{"key":"2026040820555980400_bib60","doi-asserted-by":"publisher","first-page":"2777","DOI":"10.1007\/s12273-025-1337-4","article-title":"Ai-based generation and optimization of energy-efficient residential layouts controlled by contour and room number","volume":"18","author":"Zeng","year":"2025","journal-title":"Building Simulation"},{"key":"2026040820555980400_bib61","doi-asserted-by":"publisher","first-page":"105702","DOI":"10.1016\/j.autcon.2024.105702","article-title":"Automated architectural spatial composition via multi-agent deep reinforcement learning for building renovation","volume":"167","author":"Zhang","year":"2024","journal-title":"Automation in Construction"},{"key":"2026040820555980400_bib62","doi-asserted-by":"publisher","first-page":"109815","DOI":"10.1016\/j.buildenv.2022.109815","article-title":"Simulation framework for early design guidance of urban streets to improve outdoor thermal comfort and building energy efficiency in summer","volume":"228","author":"Zheng","year":"2023","journal-title":"Building and Environment"},{"key":"2026040820555980400_bib63","doi-asserted-by":"publisher","first-page":"748","DOI":"10.1038\/s43588-023-00503-5","article-title":"Spatial planning of urban communities via deep reinforcement learning","volume":"3","author":"Zheng","year":"2023","journal-title":"Nature Computational Science"},{"key":"2026040820555980400_bib64","first-page":"14","article-title":"A human\u2013machine collaborative building spatial layout workflow based on spatial adjacency simulation","volume-title":"The International Conference on Computational Design and Robotic Fabrication","author":"Zhong","year":"2022"}],"container-title":["Journal of Computational Design and Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jcde\/advance-article-pdf\/doi\/10.1093\/jcde\/qwag024\/67317720\/qwag024.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jcde\/article-pdf\/13\/4\/135\/67317720\/qwag024.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jcde\/article-pdf\/13\/4\/135\/67317720\/qwag024.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T00:56:10Z","timestamp":1775696170000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jcde\/article\/13\/4\/135\/8516485"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,12]]},"references-count":66,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2026,4,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jcde\/qwag024","relation":{},"ISSN":["2288-5048"],"issn-type":[{"value":"2288-5048","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,4]]},"published":{"date-parts":[[2026,3,12]]}}}