{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T04:06:57Z","timestamp":1779077217114,"version":"3.51.4"},"reference-count":40,"publisher":"World Scientific Pub Co Pte Ltd","issue":"12","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62306280"],"award-info":[{"award-number":["62306280"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J CIRCUIT SYST COMP"],"published-print":{"date-parts":[[2026,7,30]]},"abstract":"<jats:p>3D MPSoC system is a very promising design which largely improves the performance by stacking more processors vertically and lowering the communication delay with the limited chip size. However, the higher integration density also results in much more severe energy and thermal issues, which are equally important for embedded real-time applications. Existing optimization works either aim at 2D MPSoC systems which cannot be simply extended to 3D MPSoC systems due to their distinctive and complex structure, or only focus on partial of the three objectives (performance, energy consumption and temperature) and adopt sequential optimization, which cannot sufficiently explore the optimization space due to the close relationship among the objectives. Further, existing traditional mathematical or evolution-based heuristic methods have failed to effectively and efficiently deal with the complex and large-scale optimization problem in 3D MPSoC systems. To this end, we propose a more intelligent multi-objective constrained task mapping optimization approach with DVFS technique based on reinforcement learning specific for 3D MPSoC systems. Based on the adopted comprehensive models, we first construct the task mapping problem as a Markov decision process, then learn the mapping policy based on reinforcement learning and finally generate the optimal task mapping solution leveraging the well-trained neural network. Extensive experiments conducted on real-world DAG applications with different settings verify the superiority of the proposed intelligent approach from perspectives of generalizability, scalability and flexibility. Three valuable conclusions are also obtained to provide insights for the application of this approach.<\/jats:p>","DOI":"10.1142\/s0218126626500660","type":"journal-article","created":{"date-parts":[[2025,12,10]],"date-time":"2025-12-10T10:11:11Z","timestamp":1765361471000},"source":"Crossref","is-referenced-by-count":0,"title":["Reinforcement-Learning-based Multi-Objective Constrained Optimization of Task Mapping for 3D MPSoC Systems"],"prefix":"10.1142","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2647-2383","authenticated-orcid":false,"given":"Tiantian","family":"Li","sequence":"first","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou City, Zhejiang Province 310023, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liangyu","family":"Lin","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou City, Zhejiang Province 310023, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bin","family":"Cao","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou City, Zhejiang Province 310023, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jing","family":"Fan","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou City, Zhejiang Province 310023, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2026,1,14]]},"reference":[{"key":"S0218126626500660BIB001","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2016.10.002"},{"key":"S0218126626500660BIB002","doi-asserted-by":"publisher","DOI":"10.23919\/DATE.2018.8342221"},{"key":"S0218126626500660BIB003","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2019.01.003"},{"key":"S0218126626500660BIB004","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2015.2501286"},{"key":"S0218126626500660BIB005","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2017.2676183"},{"key":"S0218126626500660BIB006","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2018.08.003"},{"key":"S0218126626500660BIB007","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2019.07.001"},{"key":"S0218126626500660BIB008","doi-asserted-by":"publisher","DOI":"10.1007\/s11265-018-1390-7"},{"key":"S0218126626500660BIB009","doi-asserted-by":"publisher","DOI":"10.1016\/j.micpro.2022.104493"},{"key":"S0218126626500660BIB010","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2021.102311"},{"key":"S0218126626500660BIB011","doi-asserted-by":"publisher","DOI":"10.1109\/71.993206"},{"key":"S0218126626500660BIB012","doi-asserted-by":"publisher","DOI":"10.1109\/PDP.2012.68"},{"key":"S0218126626500660BIB013","doi-asserted-by":"publisher","DOI":"10.1016\/j.compeleceng.2015.12.001"},{"key":"S0218126626500660BIB014","doi-asserted-by":"publisher","DOI":"10.1142\/S021812661640003X"},{"key":"S0218126626500660BIB015","doi-asserted-by":"publisher","DOI":"10.1109\/ASPDAC.2017.7858343"},{"key":"S0218126626500660BIB016","doi-asserted-by":"publisher","DOI":"10.1587\/elex.14.20170900"},{"key":"S0218126626500660BIB017","doi-asserted-by":"publisher","DOI":"10.1016\/j.micpro.2023.104970"},{"key":"S0218126626500660BIB018","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2024.103064"},{"key":"S0218126626500660BIB019","doi-asserted-by":"publisher","DOI":"10.1016\/j.jksuci.2024.102082"},{"key":"S0218126626500660BIB020","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfranklin.2025.108097"},{"key":"S0218126626500660BIB021","doi-asserted-by":"publisher","DOI":"10.1109\/RSP.2014.6966900"},{"key":"S0218126626500660BIB022","doi-asserted-by":"publisher","DOI":"10.1109\/TVLSI.2020.3033658"},{"key":"S0218126626500660BIB023","doi-asserted-by":"publisher","DOI":"10.1109\/TVLSI.2021.3097712"},{"key":"S0218126626500660BIB024","doi-asserted-by":"publisher","DOI":"10.1016\/j.mejo.2024.106323"},{"key":"S0218126626500660BIB025","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2019.2937726"},{"key":"S0218126626500660BIB026","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2005.850860"},{"key":"S0218126626500660BIB027","doi-asserted-by":"publisher","DOI":"10.1109\/DATE.2007.364517"},{"key":"S0218126626500660BIB028","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2017.09.007"},{"key":"S0218126626500660BIB029","doi-asserted-by":"publisher","DOI":"10.1145\/2883612"},{"key":"S0218126626500660BIB030","doi-asserted-by":"publisher","DOI":"10.3390\/mi12101217"},{"key":"S0218126626500660BIB031","doi-asserted-by":"publisher","DOI":"10.3390\/mi14030628"},{"key":"S0218126626500660BIB032","doi-asserted-by":"publisher","DOI":"10.1109\/RTCSA.2012.15"},{"key":"S0218126626500660BIB033","doi-asserted-by":"publisher","DOI":"10.1109\/TVLSI.2010.2058873"},{"key":"S0218126626500660BIB034","doi-asserted-by":"publisher","DOI":"10.1145\/980152.980157"},{"key":"S0218126626500660BIB035","doi-asserted-by":"publisher","DOI":"10.1109\/TCAPT.2009.2020916"},{"key":"S0218126626500660BIB036","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2010.2052057"},{"key":"S0218126626500660BIB037","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"S0218126626500660BIB038","unstructured":"V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra and M. A. Riedmiller, Playing Atari with deep reinforcement learning, preprint (2013), arXiv:abs\/1312.5602."},{"key":"S0218126626500660BIB039","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2012.10.004"},{"key":"S0218126626500660BIB040","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2005.844106"}],"container-title":["Journal of Circuits, Systems and Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218126626500660","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T03:25:35Z","timestamp":1779074735000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218126626500660"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,14]]},"references-count":40,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2026,7,30]]}},"alternative-id":["10.1142\/S0218126626500660"],"URL":"https:\/\/doi.org\/10.1142\/s0218126626500660","relation":{},"ISSN":["0218-1266","1793-6454"],"issn-type":[{"value":"0218-1266","type":"print"},{"value":"1793-6454","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,14]]},"article-number":"2650066"}}