{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T18:59:45Z","timestamp":1775069985317,"version":"3.50.1"},"reference-count":20,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2023,1,6]],"date-time":"2023-01-06T00:00:00Z","timestamp":1672963200000},"content-version":"vor","delay-in-days":1,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002635","name":"Inha University","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002635","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,1,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>The pipe routing of ships has been manually performed by experts, and the design quality depends on the competence of the experts. Therefore, studies on pipe-routing automation and optimization are required. In addition, the pipe-routing task in a ship that requires frequent pipe-routing modifications requires a long time to be optimized. In this study, we developed a methodology that enables a rapid response in situations where frequent pipe-routing modifications are required by applying curriculum learning that can be stably learned by gradually solving easy-to-complex problems. In addition, this study aimed to minimize the length of the pipe and number of bends as an objective function. Finally, the proposed methodology was verified by comparing it with existing studies that used the A*, jump point search, and reinforcement-learning algorithms to determine the search speed, number of bends, and length of the path.<\/jats:p>","DOI":"10.1093\/jcde\/qwad001","type":"journal-article","created":{"date-parts":[[2023,1,8]],"date-time":"2023-01-08T04:40:11Z","timestamp":1673152811000},"page":"318-328","source":"Crossref","is-referenced-by-count":19,"title":["Application of reinforcement learning based on curriculum learning for the pipe auto-routing of ships"],"prefix":"10.1093","volume":"10","author":[{"given":"Youngsu","family":"Kim","sequence":"first","affiliation":[{"name":"Department of Naval Architecture & Ocean Engineering, Inha University , Michuhol-gu, Incheon 22212, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kyungho","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Naval Architecture & Ocean Engineering, Inha University , Michuhol-gu, Incheon 22212, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Byeongwook","family":"Nam","sequence":"additional","affiliation":[{"name":"Department of Naval Architecture & Ocean Engineering, Inha University , Michuhol-gu, Incheon 22212, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3033-3327","authenticated-orcid":false,"given":"Youngsoo","family":"Han","sequence":"additional","affiliation":[{"name":"Department of Naval Architecture & Ocean Engineering, Inha University , Michuhol-gu, Incheon 22212, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2023,1,5]]},"reference":[{"key":"2023020309180145800_bib20","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1145\/1553374.1553380","article-title":"Curriculum learning","volume-title":"Proceedings of the 26th Annual International Conference on Machine Learning","author":"Bengio","year":"2009"},{"key":"2023020309180145800_bib14","doi-asserted-by":"crossref","first-page":"1430","DOI":"10.1093\/jcde\/qwac063","article-title":"Automation of crane control for block lifting based on deep reinforcement learning","volume":"9","author":"Chun","year":"2022","journal-title":"Journal of Computational Design and Engineering"},{"key":"2023020309180145800_bib10","first-page":"3103","article-title":"The ant colony optimization for ship pipe route design in 3D space","volume-title":"Proceedings of the 6th World Congress on Intelligent Control and Automation","author":"Fan","year":"2006"},{"key":"2023020309180145800_bib6","first-page":"71","article-title":"Evolutionary approaches to the three-dimensional multi-pipe routing problem: A comparative study using direct encodings","volume-title":"Lecture notes in computer science","author":"Furuholmen","year":"2010"},{"key":"2023020309180145800_bib11","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.oceaneng.2015.04.028","article-title":"A co-evolutionary improved multi-ant colony optimization for ship multiple and branch pipe route design","volume":"102","author":"Jiang","year":"2015","journal-title":"Ocean Engineering"},{"key":"2023020309180145800_bib4","article-title":"Development of an automatic pipe routing system on a shipbuilding CAD environment","author":"Kim","year":"2014"},{"key":"2023020309180145800_bib9","first-page":"93","article-title":"Automatic designing system for piping and instruments arrangement including branches of pipes","volume":"3","author":"Kimura","year":"2011","journal-title":"International Conference on Computer Applications in Shipbuilding"},{"key":"2023020309180145800_bib8","doi-asserted-by":"crossref","first-page":"121","DOI":"10.3940\/rina.iccas.2009.39","article-title":"Automatic design algorithm for pipe arrangement considering valve operationality","volume-title":"Proceedings of the International Conference on Computer Applications in Shipbuilding","author":"Kimura","year":"2009"},{"key":"2023020309180145800_bib17","first-page":"1143","article-title":"OnActor-critic algorithms","volume":"42","author":"Konda","year":"2003","journal-title":"Society for Industrial and Applied Mathematics"},{"key":"2023020309180145800_bib1","doi-asserted-by":"crossref","first-page":"280","DOI":"10.7315\/CDE.2019.280","article-title":"Pipe routing of offshore structure considering space availability","volume":"24","author":"Lee","year":"2019","journal-title":"Korean Journal of Computational Design and Engineering"},{"key":"2023020309180145800_bib5","doi-asserted-by":"crossref","first-page":"596","DOI":"10.1016\/j.ijnaoe.2020.07.004","article-title":"Faster pipe auto-routing using improved jump point search","volume":"12","author":"Min","year":"2020","journal-title":"International Journal of Naval Architecture and Ocean Engineering"},{"key":"2023020309180145800_bib16","article-title":"Playing Atari with deep reinforcement learning","author":"Mnih","year":"2013"},{"key":"2023020309180145800_bib13","first-page":"5195","article-title":"Curriculum learning in reinforcement learning","volume-title":"Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI'17)","author":"Narvekar","year":"2017"},{"issue":"181","key":"2023020309180145800_bib12","first-page":"1","article-title":"Curriculum learning for reinforcement learning domains: A framework and survey","volume":"21","author":"Narvekar","year":"2020","journal-title":"Journal of Machine Learning Research"},{"key":"2023020309180145800_bib15","doi-asserted-by":"crossref","first-page":"1157","DOI":"10.1093\/jcde\/qwac044","article-title":"Distributional reinforcement learning with the independent learners for flexible job shop scheduling problem with high variability","volume":"9","author":"Oh","year":"2022","journal-title":"Journal of Computational Design and Engineering"},{"key":"2023020309180145800_bib2","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1016\/S0957-4174(02)00049-0","article-title":"Pipe-routing algorithm development: Case study of a ship engine room design","volume":"23","author":"Park","year":"2002","journal-title":"Journal of the Expert Systems with Applications"},{"key":"2023020309180145800_bib18","article-title":"Trust region policy optimization","author":"Schulman","year":"2017"},{"key":"2023020309180145800_bib19","article-title":"Proximal policy optimization algorithms","author":"Schulman","year":"2017"},{"key":"2023020309180145800_bib3","doi-asserted-by":"crossref","first-page":"191","DOI":"10.3744\/SNAK.2020.57.4.191","article-title":"Pipe routing using reinforcement learning on initial design stage","volume":"57","author":"Shin","year":"2020","journal-title":"Journal of the Society of Naval Architects of Korea"},{"key":"2023020309180145800_bib7","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1007\/s11465-016-0384-z","article-title":"Branch-pipe-routing approach for ships using improved genetic algorithm","volume":"11","author":"Sui","year":"2016","journal-title":"Frontiers of Mechanical Engineering"}],"container-title":["Journal of Computational Design and Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jcde\/advance-article-pdf\/doi\/10.1093\/jcde\/qwad001\/48518588\/qwad001.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jcde\/article-pdf\/10\/1\/318\/49084797\/qwad001.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jcde\/article-pdf\/10\/1\/318\/49084797\/qwad001.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,3]],"date-time":"2023-02-03T09:18:32Z","timestamp":1675415912000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jcde\/article\/10\/1\/318\/6972374"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,5]]},"references-count":20,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,1,11]]}},"URL":"https:\/\/doi.org\/10.1093\/jcde\/qwad001","relation":{},"ISSN":["2288-5048"],"issn-type":[{"value":"2288-5048","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,2]]},"published":{"date-parts":[[2023,1,5]]}}}