{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T06:16:32Z","timestamp":1783059392197,"version":"3.54.6"},"reference-count":68,"publisher":"SAGE Publications","issue":"8","license":[{"start":{"date-parts":[[2025,10,15]],"date-time":"2025-10-15T00:00:00Z","timestamp":1760486400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["62325211"],"award-info":[{"award-number":["62325211"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["62132021"],"award-info":[{"award-number":["62132021"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["62502347"],"award-info":[{"award-number":["62502347"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["62522219"],"award-info":[{"award-number":["62522219"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["62372457"],"award-info":[{"award-number":["62372457"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["62322207"],"award-info":[{"award-number":["62322207"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["62225113"],"award-info":[{"award-number":["62225113"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Postdoctoral Fellowship Program and China Postdoctoral Science Foundation","award":["BX20250386"],"award-info":[{"award-number":["BX20250386"]}]},{"name":"Major Program of Xiangjiang Laboratory","award":["23XJ01009"],"award-info":[{"award-number":["23XJ01009"]}]},{"name":"Key R&D Program of Wuhan","award":["2024060702030143"],"award-info":[{"award-number":["2024060702030143"]}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2026,7]]},"abstract":"<jats:p>The online 3D Bin Packing Problem (3D-BPP) has widespread applications in industrial automation and has aroused enthusiastic research interest recently. Existing methods usually solve the problem with limited resolution of spatial discretization, and\/or cannot deal with complex practical constraints well. We propose to enhance the practical applicability of online 3D-BPP via learning on a novel hierarchical representation\u2014packing configuration tree (PCT). PCT is a full-fledged description of the state and action space of bin packing which can support packing policy learning based on deep reinforcement learning (DRL). The size of the packing action space is proportional to the number of leaf nodes, that is, candidate placements, making the DRL model easy to train and well-performing even with continuous solution space. We further discover the potential of PCT as tree-based planners in deliberately solving packing problems of industrial significance, including large-scale packing and different variations of the BPP setting. A recursive packing method is proposed to decompose large-scale packing into regular sub-trees while a spatial ensemble mechanism integrates local solutions into a global one. For different BPP variations with additional decision variables, such as lookahead, buffering, and offline packing, we propose a unified planning framework enabling various problem-solving based on a pre-trained PCT model with no additional adaptation. Extensive evaluations demonstrate that our method outperforms existing online BPP baselines and is versatile in incorporating various practical constraints. Driven by PCT, the planning process excels across large-scale problems and diverse problem variations, with performance improving as the problem scales up and the decision variables grow. To verify our method, we develop a real-world packing robot for industrial warehousing, with careful designs accounting for constrained placement and transportation stability. Our packing robot operates reliably and efficiently on unprotected pallets at 9.8 seconds per box. It achieves averagely 19 boxes per pallet with 57.4% space utilization for large-size boxes.<\/jats:p>","DOI":"10.1177\/02783649251380619","type":"journal-article","created":{"date-parts":[[2025,10,15]],"date-time":"2025-10-15T22:32:29Z","timestamp":1760567549000},"page":"1195-1216","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":3,"title":["Deliberate planning of 3D bin packing on packing configuration trees"],"prefix":"10.1177","volume":"45","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0648-9823","authenticated-orcid":false,"given":"Hang","family":"Zhao","sequence":"first","affiliation":[{"name":"Institute of Al for Industries"},{"name":"Wuhan University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5132-238X","authenticated-orcid":false,"given":"Juzhan","family":"Xu","sequence":"additional","affiliation":[{"name":"Shenzhen University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kexiong","family":"Yu","sequence":"additional","affiliation":[{"name":"National University of Defense Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruizhen","family":"Hu","sequence":"additional","affiliation":[{"name":"Shenzhen University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenyang","family":"Zhu","sequence":"additional","affiliation":[{"name":"National University of Defense Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bo","family":"Du","sequence":"additional","affiliation":[{"name":"Wuhan University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kai","family":"Xu","sequence":"additional","affiliation":[{"name":"National University of Defense Technology"},{"name":"Institute of Al for Industries"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2025,10,15]]},"reference":[{"key":"e_1_3_4_2_1","volume-title":"International Conference on Learning Representations","author":"Bello I","year":"2017","unstructured":"Bello I, Pham H, Le QV, et al. (2017) Neural combinatorial optimization with reinforcement learning. In: International Conference on Learning Representations."},{"key":"e_1_3_4_3_1","volume-title":"International Conference on Learning Representations","author":"Bruna J","year":"2014","unstructured":"Bruna J, Zaremba W, Szlam A, et al. (2014) Spectral networks and locally connected networks on graphs. In: International Conference on Learning Representations."},{"key":"e_1_3_4_4_1","volume-title":"Principles of Robot Motion: Theory, Algorithms, and Implementations","author":"Choset H","year":"2005","unstructured":"Choset H, Lynch KM, Hutchinson S, et al. (2005) Principles of Robot Motion: Theory, Algorithms, and Implementations. MIT press."},{"key":"e_1_3_4_5_1","volume-title":"Pybullet, a python Module for Physics Simulation for Games, Robotics and Machine Learning","author":"Coumans E","year":"2016","unstructured":"Coumans E, Bai Y (2016) Pybullet, a python Module for Physics Simulation for Games, Robotics and Machine Learning. https:\/\/pybullet.org"},{"key":"e_1_3_4_6_1","doi-asserted-by":"publisher","DOI":"10.1287\/ijoc.1070.0250"},{"key":"e_1_3_4_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2007.06.063"},{"key":"e_1_3_4_8_1","doi-asserted-by":"publisher","DOI":"10.1111\/1475-3995.00400"},{"key":"e_1_3_4_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01361"},{"key":"e_1_3_4_10_1","volume-title":"Virtual Manufacturing and Automation Competition Workshop at the International Conference of Robotics and Automation","author":"Demisse G","year":"2012","unstructured":"Demisse G, Mihalyi R, Okal B, et al. (2012) Mixed palletizing and task completion for virtual warehouses. In: Virtual Manufacturing and Automation Competition Workshop at the International Conference of Robotics and Automation."},{"key":"e_1_3_4_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544585.3544600"},{"key":"e_1_3_4_12_1","doi-asserted-by":"publisher","DOI":"10.65109\/PHEJ7266"},{"key":"e_1_3_4_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2005.11.063"},{"key":"e_1_3_4_14_1","doi-asserted-by":"publisher","DOI":"10.1287\/ijoc.15.3.267.16080"},{"key":"e_1_3_4_15_1","doi-asserted-by":"publisher","DOI":"10.1177\/02783649241281508"},{"key":"e_1_3_4_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2005.1555942"},{"key":"e_1_3_4_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2019.8793898"},{"key":"e_1_3_4_18_1","volume-title":"Annual ACM-SIAM Symposium on Discrete Algorithms","author":"Grove EF","year":"1995","unstructured":"Grove EF (1995) Online bin packing with lookahead. In: Annual ACM-SIAM Symposium on Discrete Algorithms."},{"key":"e_1_3_4_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2020.04.053"},{"key":"e_1_3_4_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-55792-2_10"},{"key":"e_1_3_4_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSSC.1968.300136"},{"key":"e_1_3_4_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.322"},{"key":"e_1_3_4_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbiomech.2004.03.025"},{"key":"e_1_3_4_24_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20164448"},{"key":"e_1_3_4_25_1","article-title":"Solving a new 3D bin packing problem with deep reinforcement learning method","author":"Hu H","year":"2017","unstructured":"Hu H, Zhang X, Yan X, et al. (2017) Solving a new 3D bin packing problem with deep reinforcement learning method. arXiv preprint arXiv:1708.05930.","journal-title":"arXiv preprint arXiv:1708.05930"},{"key":"e_1_3_4_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417796"},{"key":"e_1_3_4_27_1","doi-asserted-by":"publisher","DOI":"10.1177\/02783649231193048"},{"key":"e_1_3_4_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amc.2012.07.036"},{"key":"e_1_3_4_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30198-1_45"},{"key":"e_1_3_4_30_1","volume-title":"International Conference on Learning Representations","author":"Kool W","year":"2019","unstructured":"Kool W, van Hoof H, Welling M (2019) Attention, learn to solve routing problems. In: International Conference on Learning Representations."},{"key":"e_1_3_4_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(98)00086-1"},{"key":"e_1_3_4_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2021.107683"},{"key":"e_1_3_4_33_1","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2025.XXI.153"},{"key":"e_1_3_4_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-1768-8_11"},{"key":"e_1_3_4_35_1","unstructured":"LLC Gurobi Optimization (2018) Gurobi optimizer reference manual. https:\/\/tinyurl.com\/4uxkx7nw"},{"key":"e_1_3_4_36_1","article-title":"Isaac gym: high performance gpu-based physics simulation for robot learning","author":"Makoviychuk V","year":"2021","unstructured":"Makoviychuk V, Wawrzyniak L, Guo Y, et al. (2021) Isaac gym: high performance gpu-based physics simulation for robot learning. arXiv preprint arXiv:2108.10470.","journal-title":"arXiv preprint arXiv:2108.10470"},{"key":"e_1_3_4_37_1","doi-asserted-by":"publisher","DOI":"10.1287\/opre.48.2.256.12386"},{"key":"e_1_3_4_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1206040.1206047"},{"key":"e_1_3_4_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0005-1098(99)00214-9"},{"key":"e_1_3_4_40_1","volume-title":"IFIP Congress","author":"Newell A","year":"1959","unstructured":"Newell A, Shaw JC, Simon HA (1959) Report on a general problem solving program. In: IFIP Congress."},{"key":"e_1_3_4_41_1","doi-asserted-by":"publisher","DOI":"10.1680\/iicep.1981.1825"},{"key":"e_1_3_4_42_1","doi-asserted-by":"publisher","DOI":"10.52202\/075280-2262"},{"key":"e_1_3_4_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS47612.2022.9982095"},{"key":"e_1_3_4_44_1","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition","author":"Qi CR","year":"2017","unstructured":"Qi CR, Su H, Mo K, et al. (2017) Pointnet: deep learning on point sets for 3D classification and segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_3_4_45_1","doi-asserted-by":"publisher","DOI":"10.52202\/068431-1851"},{"key":"e_1_3_4_46_1","doi-asserted-by":"publisher","DOI":"10.1111\/itor.12124"},{"key":"e_1_3_4_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/585265.585269"},{"key":"e_1_3_4_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2835173"},{"key":"e_1_3_4_49_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature16961"},{"key":"e_1_3_4_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-27645-3_12"},{"key":"e_1_3_4_51_1","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton RS","year":"2018","unstructured":"Sutton RS, Barto AG (2018) Reinforcement Learning: An Introduction. MIT press."},{"key":"e_1_3_4_52_1","volume-title":"Advances in Neural Information Processing Systems","author":"Vaswani A","year":"2017","unstructured":"Vaswani A, Shazeer N, Parmar N, et al. (2017) Attention is all you need. In: Advances in Neural Information Processing Systems."},{"key":"e_1_3_4_53_1","volume-title":"International Conference on Learning Representations","author":"Velickovic P","year":"2018","unstructured":"Velickovic P, Cucurull G, Casanova A, et al. (2018) Graph attention networks. In: International Conference on Learning Representations."},{"key":"e_1_3_4_54_1","article-title":"A generalized reinforcement learning algorithm for online 3D bin-packing","author":"Verma R","year":"2020","unstructured":"Verma R, Singhal A, Khadilkar H, et al. (2020) A generalized reinforcement learning algorithm for online 3D bin-packing. arXiv preprint arXiv:2007.00463.","journal-title":"arXiv preprint arXiv:2007.00463"},{"key":"e_1_3_4_55_1","volume-title":"Advances in Neural Information Processing Systems","author":"Vinyals O","year":"2015","unstructured":"Vinyals O, Fortunato M, Jaitly N (2015) Pointer networks. In: Advances in Neural Information Processing Systems."},{"key":"e_1_3_4_56_1","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2019.XV.035"},{"key":"e_1_3_4_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2019.8794049"},{"key":"e_1_3_4_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2021.3097261"},{"key":"e_1_3_4_59_1","volume-title":"Advances in Neural Information Processing Systems","author":"Wu Y","year":"2017","unstructured":"Wu Y, Mansimov E, Grosse RB, et al. (2017) Scalable trust-region method for deep reinforcement learning using kronecker-factored approximation. In: Advances in Neural Information Processing Systems."},{"key":"e_1_3_4_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3618330"},{"key":"e_1_3_4_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491042"},{"key":"e_1_3_4_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS51168.2021.9635914"},{"key":"e_1_3_4_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3580305.3599527"},{"key":"e_1_3_4_64_1","article-title":"Attend2pack: bin packing through deep reinforcement learning with attention","author":"Zhang J","year":"2021","unstructured":"Zhang J, Zi B, Ge X (2021) Attend2pack: bin packing through deep reinforcement learning with attention. arXiv preprint arXiv:2107.04333.","journal-title":"arXiv preprint arXiv:2107.04333"},{"key":"e_1_3_4_65_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i1.16155"},{"key":"e_1_3_4_66_1","volume-title":"International Conference on Learning Representations","author":"Zhao H","year":"2022","unstructured":"Zhao H, Yu Y, Xu K (2022a) Learning efficient online 3D bin packing on packing configuration trees. In: International Conference on Learning Representations."},{"key":"e_1_3_4_67_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11432-021-3348-6"},{"key":"e_1_3_4_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3603544"},{"key":"e_1_3_4_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gmod.2025.101284"}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649251380619","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/02783649251380619","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649251380619","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T05:24:16Z","timestamp":1783056256000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/02783649251380619"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,15]]},"references-count":68,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2026,7]]}},"alternative-id":["10.1177\/02783649251380619"],"URL":"https:\/\/doi.org\/10.1177\/02783649251380619","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"value":"0278-3649","type":"print"},{"value":"1741-3176","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,15]]}}}