{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T13:04:20Z","timestamp":1775739860014,"version":"3.50.1"},"reference-count":49,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2025,12,8]],"date-time":"2025-12-08T00:00:00Z","timestamp":1765152000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Research on Facility Layout Planning for Semiconductor Production Lines"},{"DOI":"10.13039\/100004358","name":"Samsung Electronics","doi-asserted-by":"publisher","award":["IO230813-06935-01"],"award-info":[{"award-number":["IO230813-06935-01"]}],"id":[{"id":"10.13039\/100004358","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Korea Ministry of SMEs and Startups in 2022","award":["RS-2022-00140261"],"award-info":[{"award-number":["RS-2022-00140261"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,1,2]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The optimization of facility layouts in constrained factory spaces significantly affects operational efficiency and performance. In semiconductor factories, the main facilities are tightly interconnected with various assistive facilities located on separate floors. This complexity requires a comprehensive consideration of the constraints and implicit rules during facility layout planning. However, most factories rely on manual planning by the production managers. To address this problem, we propose a methodology that uses reinforcement learning to optimize the layout of a semiconductor factory. The reinforcement learning method employs the double deep Q-network algorithm to optimize facility layouts while incorporating the unique constraints of semiconductor manufacturing environments. The algorithm enhances layout efficiency and supports the design process by generating multiple optimized layout solutions. Furthermore, these optimized layouts were integrated into the NVIDIA Omniverse platform, enabling users to review and modify their configurations. This study contributes to laying the groundwork for automating facility layout planning in semiconductor factories by exploring reinforcement learning-based approaches under real-world-inspired constraints.<\/jats:p>","DOI":"10.1093\/jcde\/qwaf131","type":"journal-article","created":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T13:10:15Z","timestamp":1764940215000},"page":"174-189","source":"Crossref","is-referenced-by-count":1,"title":["Optimization of facility layout using reinforcement learning for semiconductor production"],"prefix":"10.1093","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-4461-5804","authenticated-orcid":false,"given":"DongHyun","family":"Lee","sequence":"first","affiliation":[{"name":"Sungkyunkwan University Department of Industrial Engineering, , 2066 Seobu-ro, Jangan-gu, Suwon-si, Gyeonggi-do 16419 ,","place":["Republic of Korea"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3337-8782","authenticated-orcid":false,"given":"Goo-Young","family":"Kim","sequence":"additional","affiliation":[{"name":"Sungkyunkwan University Department of Industrial Engineering, , 2066 Seobu-ro, Jangan-gu, Suwon-si, Gyeonggi-do 16419 ,","place":["Republic of Korea"]}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-6655-4804","authenticated-orcid":false,"given":"Jueun","family":"Yoo","sequence":"additional","affiliation":[{"name":"Sungkyunkwan University Department of Industrial Engineering, , 2066 Seobu-ro, Jangan-gu, Suwon-si, Gyeonggi-do 16419 ,","place":["Republic of Korea"]}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-6475-4454","authenticated-orcid":false,"given":"Hyewon","family":"Cho","sequence":"additional","affiliation":[{"name":"Sungkyunkwan University Department of Industrial Engineering, , 2066 Seobu-ro, Jangan-gu, Suwon-si, Gyeonggi-do 16419 ,","place":["Republic of Korea"]}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-6699-6683","authenticated-orcid":false,"given":"Sejin","family":"An","sequence":"additional","affiliation":[{"name":"Sungkyunkwan University Department of Industrial Engineering, , 2066 Seobu-ro, Jangan-gu, Suwon-si, Gyeonggi-do 16419 ,","place":["Republic of Korea"]}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-9702-3788","authenticated-orcid":false,"given":"Seokjin","family":"Youn","sequence":"additional","affiliation":[{"name":"Management Information System Team, Samsung Electronics , 475 Dongtangiheung-ro, Hwaseong-si, Gyeonggi-do 18479 ,","place":["Republic of Korea"]}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5356-2981","authenticated-orcid":false,"given":"Gun Yeon","family":"Kim","sequence":"additional","affiliation":[{"name":"Business Process Innovation Team, Samsung Electronics , 1 Samsungjeonja-ro, Hwaseong-si, Gyeonggi-do 18448 ,","place":["Republic of Korea"]}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-7091-0308","authenticated-orcid":false,"given":"Onyu","family":"Yu","sequence":"additional","affiliation":[{"name":"Management Information System Team, Samsung Electronics , 475 Dongtangiheung-ro, Hwaseong-si, Gyeonggi-do 18479 ,","place":["Republic of Korea"]}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-7025-0417","authenticated-orcid":false,"given":"Youngjun","family":"Jung","sequence":"additional","affiliation":[{"name":"Management Information System Team, Samsung Electronics , 475 Dongtangiheung-ro, Hwaseong-si, Gyeonggi-do 18479 ,","place":["Republic of Korea"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5610-5560","authenticated-orcid":false,"given":"Sang Do","family":"Noh","sequence":"additional","affiliation":[{"name":"Sungkyunkwan University Department of Industrial Engineering, , 2066 Seobu-ro, Jangan-gu, Suwon-si, Gyeonggi-do 16419 ,","place":["Republic of Korea"]}]}],"member":"286","published-online":{"date-parts":[[2025,12,8]]},"reference":[{"key":"2026010520415505500_bib1","doi-asserted-by":"publisher","first-page":"115047","DOI":"10.1016\/j.enconman.2021.115047","article-title":"Wind farm layout optimization using adaptive evolutionary algorithm with Monte Carlo tree search reinforcement learning","volume":"252","author":"Bai","year":"2022","journal-title":"Energy Conversion and Management"},{"key":"2026010520415505500_bib2","doi-asserted-by":"publisher","first-page":"22569","DOI":"10.1109\/access.2021.3054563","article-title":"Bibliometric study on the use of machine learning as resolution technique for facility layout problems","volume":"9","author":"Burggraef","year":"2021","journal-title":"IEEE Access"},{"key":"2026010520415505500_bib3","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1109\/tsm.2016.2587735","article-title":"Overall space effectiveness (OSE) for enhancing fab space productivity","volume":"29","author":"Chien","year":"2016","journal-title":"IEEE Transactions on Semiconductor Manufacturing"},{"key":"2026010520415505500_bib4","doi-asserted-by":"publisher","first-page":"390","DOI":"10.3390\/machines12060390","article-title":"Optimization of the factory layout and production flow using production-simulation-based reinforcement learning","volume":"12","author":"Choi","year":"2024","journal-title":"Machines"},{"key":"2026010520415505500_bib5","doi-asserted-by":"publisher","first-page":"202","DOI":"10.15269\/jksoeh.2015.25.2.202","article-title":"Clean room structure, air conditioning and contamination control systems in the semiconductor fabrication process","volume":"25","author":"Choi","year":"2015","journal-title":"Journal of Korean Society of Occupational and Environmental Hygiene"},{"key":"2026010520415505500_bib6","doi-asserted-by":"publisher","first-page":"04024021","DOI":"10.1061\/jmenea.meeng-5900","article-title":"Dynamic real-time optimization of modular unit allocation to off-site facilities in post-disaster reconstruction using deep reinforcement learning","volume":"40(4)","author":"Deria","year":"2024","journal-title":"Journal of Management in Engineering"},{"key":"2026010520415505500_bib7","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1093\/jcde\/qwae066","article-title":"Automated design and optimization of distributed filter circuits using reinforcement learning","volume":"11","author":"Gao","year":"2024","journal-title":"Journal of Computational Design and Engineering"},{"key":"2026010520415505500_bib8","doi-asserted-by":"publisher","first-page":"100599","DOI":"10.1016\/j.jii.2024.100599","article-title":"Simulation optimization applied to production scheduling in the era of Industry 4.0: A review and future roadmap","volume":"39","author":"Ghasemi","year":"2024","journal-title":"Journal of Industrial Information Integration"},{"key":"2026010520415505500_bib9","doi-asserted-by":"publisher","first-page":"4659","DOI":"10.1080\/00207543.2018.1444805","article-title":"Throughput\/inventory dollar-days: TOC-based measures for supply chain collaboration","volume":"56","author":"Gupta","year":"2018","journal-title":"International Journal of Production Research"},{"key":"2026010520415505500_bib10","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1016\/j.mfglet.2023.09.007","article-title":"Deep reinforcement learning for layout planning\u2013An MDP-based approach for the facility layout problem","volume":"38","author":"Heinbach","year":"2023","journal-title":"Manufacturing Letters"},{"key":"2026010520415505500_bib11","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1007\/s43069-024-00301-3","article-title":"gym-flp: A python package for training reinforcement learning algorithms on facility layout problems","volume":"5","author":"Heinbach","year":"2024","journal-title":"Operations Research Forum"},{"key":"2026010520415505500_bib12","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11694","article-title":"Deep reinforcement learning that matters","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Henderson","year":"2018"},{"key":"2026010520415505500_bib13","first-page":"231","article-title":"A concurrent approach for facility layout and AMHS design in semiconductor manufacturing","volume":"21","author":"Hong","year":"2014","journal-title":"International Journal of Industrial Engineering"},{"key":"2026010520415505500_bib14","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1016\/j.cirp.2013.03.133","article-title":"A novel facility layout planning and optimization methodology","volume":"62","author":"Jiang","year":"2013","journal-title":"CIRP Annals"},{"key":"2026010520415505500_bib15","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1093\/jcde\/qwae025","article-title":"Reimagining space layout design through deep reinforcement learning","volume":"11","author":"Kakooee","year":"2024","journal-title":"Journal of Computational Design and Engineering"},{"key":"2026010520415505500_bib16","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1093\/jcde\/qwae109","article-title":"Enhancing architectural space layout design by pretraining deep reinforcement learning agents","volume":"12","author":"Kakooee","year":"2025","journal-title":"Journal of Computational Design and Engineering"},{"key":"2026010520415505500_bib17","doi-asserted-by":"publisher","first-page":"479","DOI":"10.1109\/cog47356.2020.9231687","article-title":"Action space shaping in deep reinforcement learning","volume-title":"2020 IEEE Conference on Games (CoG)","author":"Kanervisto","year":"2020"},{"key":"2026010520415505500_bib18","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1007\/s40684-016-0015-5","article-title":"Smart manufacturing: Past research, present findings, and future directions","volume":"3","author":"Kang","year":"2016","journal-title":"International Journal of Precision Engineering and Manufacturing-Green Technology"},{"key":"2026010520415505500_bib19","doi-asserted-by":"publisher","first-page":"3917","DOI":"10.1007\/s10845-023-02309-8","article-title":"Multi-agent reinforcement learning for online layout planning and scheduling in flexible assembly systems","volume":"35","author":"Kaven","year":"2024","journal-title":"Journal of Intelligent Manufacturing"},{"key":"2026010520415505500_bib20","doi-asserted-by":"publisher","first-page":"318","DOI":"10.1093\/jcde\/qwad001","article-title":"Application of reinforcement learning based on curriculum learning for the pipe auto-routing of ships","volume":"10","author":"Kim","year":"2023","journal-title":"Journal of Computational Design and Engineering"},{"key":"2026010520415505500_bib21","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2201.11182","article-title":"Hyperparameter tuning for deep reinforcement learning applications","author":"Kiran","year":"2022"},{"key":"2026010520415505500_bib22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.mfglet.2021.08.003","article-title":"An implementation of a reinforcement learning based algorithm for factory layout planning","volume":"30","author":"Klar","year":"2021","journal-title":"Manufacturing Letters"},{"key":"2026010520415505500_bib23","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.cirpj.2023.05.008","article-title":"Performance comparison of reinforcement learning and metaheuristics for factory layout planning","volume":"45","author":"Klar","year":"2023","journal-title":"CIRP Journal of Manufacturing Science and Technology"},{"key":"2026010520415505500_bib24","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1016\/j.procir.2022.04.027","article-title":"Scalability investigation of double deep Q-learning for factory layout planning","volume":"107","author":"Klar","year":"2022","journal-title":"Procedia CIRP"},{"key":"2026010520415505500_bib25","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1016\/j.procir.2022.09.099","article-title":"A framework for automated multiobjective factory layout planning using reinforcement learning","volume":"112","author":"Klar","year":"2022","journal-title":"Procedia CIRP"},{"key":"2026010520415505500_bib26","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1016\/j.jmsy.2023.11.012","article-title":"Explainable generative design in manufacturing for reinforcement learning based factory layout planning","volume":"72","author":"Klar","year":"2024","journal-title":"Journal of Manufacturing Systems"},{"key":"2026010520415505500_bib27","doi-asserted-by":"publisher","first-page":"694","DOI":"10.1093\/jcde\/qwad011","article-title":"Deep-learning-based fault detection and recipe optimization for a plastic injection molding process under the class-imbalance problem","volume":"10","author":"Ko","year":"2023","journal-title":"Journal of Computational Design and Engineering"},{"key":"2026010520415505500_bib28","doi-asserted-by":"publisher","first-page":"233","DOI":"10.7315\/cde.2019.233","article-title":"Modeling & simulation-based assessments of reconfigurability and productivity for automotive module assembly lines","volume":"24","author":"Lee","year":"2019","journal-title":"Korean Journal of Computational Design and Engineering"},{"key":"2026010520415505500_bib29","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1016\/j.eswa.2018.02.035","article-title":"Multi-objective particle swarm optimization algorithm based on objective space division for the unequal-area facility layout problem","volume":"102","author":"Liu","year":"2018","journal-title":"Expert Systems with Applications"},{"key":"2026010520415505500_bib30","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1016\/j.procs.2023.08.140","article-title":"Hyperparameter selection in reinforcement learning using the \u201cdesign of experiments\u201d method","volume":"222","author":"McKenzie","year":"2023","journal-title":"Procedia Computer Science"},{"key":"2026010520415505500_bib31","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"2026010520415505500_bib32","doi-asserted-by":"publisher","first-page":"273","DOI":"10.7763\/ijet.2016.v8.898","article-title":"Predictive models for equipment fault detection in the semiconductor manufacturing process","volume":"8","author":"Munirathinam","year":"2016","journal-title":"International Journal of Engineering and Technology"},{"key":"2026010520415505500_bib33","doi-asserted-by":"publisher","first-page":"1207296","DOI":"10.1080\/23311916.2016.1207296","article-title":"Productivity improvement of a manufacturing facility using systematic layout planning","volume":"3","author":"Naqvi","year":"2016","journal-title":"Cogent Engineering"},{"key":"2026010520415505500_bib34","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1016\/j.jmsy.2013.12.007","article-title":"Simulation for manufacturing system design and operation: Literature review and analysis","volume":"33","author":"Negahban","year":"2014","journal-title":"Journal of Manufacturing Systems"},{"key":"2026010520415505500_bib35","doi-asserted-by":"publisher","first-page":"3777","DOI":"10.1080\/00207543.2021.1897176","article-title":"Facility layout planning: An extended literature review","volume":"59","author":"P\u00e9rez-Gosende","year":"2021","journal-title":"International Journal of Production Research"},{"key":"2026010520415505500_bib36","doi-asserted-by":"publisher","first-page":"3349","DOI":"10.3390\/su12083349","article-title":"Digital facility layout planning","volume":"12","author":"Peron","year":"2020","journal-title":"Sustainability"},{"key":"2026010520415505500_bib37","doi-asserted-by":"publisher","first-page":"360","DOI":"10.1109\/66.618209","article-title":"Integrated facility layout and material handling system design in semiconductor fabrication facilities","volume":"10","author":"Peters","year":"1997","journal-title":"IEEE Transactions on Semiconductor Manufacturing"},{"key":"2026010520415505500_bib38","doi-asserted-by":"publisher","first-page":"117","DOI":"10.3390\/a13050117","article-title":"A novel hybrid metaheuristic algorithm for optimization of construction management site layout planning","volume":"13","author":"Prayogo","year":"2020","journal-title":"Algorithms"},{"key":"2026010520415505500_bib39","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1007\/s10479-020-03704-7","article-title":"Mathematical formulation and hybrid meta-heuristic solution approaches for dynamic single row facility layout problem","volume":"295","author":"\u015eahin","year":"2020","journal-title":"Annals of Operations Research"},{"key":"2026010520415505500_bib40","doi-asserted-by":"publisher","first-page":"46","DOI":"10.25236\/ijfs.2021.031307","article-title":"The analysis of facility layout planning in factories","volume":"3","author":"Sun","year":"2021","journal-title":"International Journal of Frontiers in Sociology"},{"key":"2026010520415505500_bib41","volume-title":"Reinforcement learning: An introduction","author":"Sutton","year":"1998"},{"key":"2026010520415505500_bib42","doi-asserted-by":"publisher","first-page":"1924","DOI":"10.1109\/wsc60868.2023.10407747","article-title":"Semiconductor fab scheduling with self-supervised and reinforcement learning","volume-title":"2023 Winter Simulation Conference (WSC)","author":"Tassel","year":"2023"},{"key":"2026010520415505500_bib43","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10295","article-title":"Deep reinforcement learning with double Q-learning","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Van\u00a0Hasselt","year":"2016"},{"key":"2026010520415505500_bib44","first-page":"1898","article-title":"Enhancing facility layout optimization: A performance analysis of genetic algorithm variants in dynamic facility layout problems","volume":"51","author":"Vineetha","year":"2024","journal-title":"IAENG International Journal of Computer Science"},{"key":"2026010520415505500_bib45","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1007\/bf00992698","article-title":"Q-learning","volume":"8","author":"Watkins","year":"1992","journal-title":"Machine learning"},{"key":"2026010520415505500_bib46","doi-asserted-by":"publisher","first-page":"1016","DOI":"10.1016\/j.compchemeng.2007.05.003","article-title":"A branch-and-bound algorithm for the continuous facility layout problem","volume":"32","author":"Xie","year":"2008","journal-title":"Computers & Chemical Engineering"},{"key":"2026010520415505500_bib47","doi-asserted-by":"publisher","first-page":"3393","DOI":"10.1007\/s10845-023-02209-x","article-title":"Integrating multi-agent reinforcement learning and 3D A* search for facility layout problem considering connector-assembly","volume":"35","author":"Zhang","year":"2024","journal-title":"Journal of Intelligent Manufacturing"},{"key":"2026010520415505500_bib48","doi-asserted-by":"publisher","first-page":"201","DOI":"10.3390\/pr12010201","article-title":"Workshop facility layout optimization based on deep reinforcement learning","volume":"12","author":"Zhao","year":"2024","journal-title":"Processes"},{"key":"2026010520415505500_bib49","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/etfa61755.2024.10710925","article-title":"Flexible control configuration in modular plants via control function library","volume-title":"2024 IEEE 29th International Conference on Emerging Technologies and Factory Automation (ETFA)","author":"Zhao","year":"2024"}],"container-title":["Journal of Computational Design and Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jcde\/advance-article-pdf\/doi\/10.1093\/jcde\/qwaf131\/65800153\/qwaf131.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jcde\/article-pdf\/13\/1\/174\/65800153\/qwaf131.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jcde\/article-pdf\/13\/1\/174\/65800153\/qwaf131.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T01:42:04Z","timestamp":1767663724000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jcde\/article\/13\/1\/174\/8373815"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,8]]},"references-count":49,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1,2]]}},"URL":"https:\/\/doi.org\/10.1093\/jcde\/qwaf131","relation":{},"ISSN":["2288-5048"],"issn-type":[{"value":"2288-5048","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,1]]},"published":{"date-parts":[[2025,12,8]]}}}