{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,2]],"date-time":"2025-12-02T03:31:04Z","timestamp":1764646264956,"version":"build-2065373602"},"reference-count":27,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2020,8,9]],"date-time":"2020-08-09T00:00:00Z","timestamp":1596931200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper proposes a novel online object-packing system which can measure the dimensions of every incoming object and calculate its desired position in a given container. Existing object-packing systems have the limitations of requiring the exact information of objects in advance or assuming them as boxes. Thus, this paper is mainly focused on the following two points: (1) Real-time calculation of the dimensions and orientation of an object; (2) Online optimization of the object\u2019s position in a container. The dimensions and orientation of the object are obtained using an RGB-D sensor when the object is picked by a manipulator and moved over a certain position. The optimal position of the object is calculated by recognizing the container\u2019s available space using another RGB-D sensor and minimizing the cost function that is formulated by the available space information and the optimization criteria inspired by the way people place things. The experimental results show that the proposed system successfully places the incoming various shaped objects in their proper positions.<\/jats:p>","DOI":"10.3390\/s20164448","type":"journal-article","created":{"date-parts":[[2020,8,10]],"date-time":"2020-08-10T05:07:23Z","timestamp":1597036043000},"page":"4448","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Smart Pack: Online Autonomous Object-Packing System Using RGB-D Sensor Data"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6174-6442","authenticated-orcid":false,"given":"Young-Dae","family":"Hong","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, Ajou University, Suwon 443-749, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Young-Joo","family":"Kim","sequence":"additional","affiliation":[{"name":"Korea Railroad Research Institute, Uiwang 437-757, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ki-Baek","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Kwangwoon University, Seoul 01897, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Matsumoto, E., Saito, M., Kume, A., and Tan, J. (2020). End-to-end learning of object grasp poses in the Amazon Robotics Challenge. Advances on Robotic Item Picking, Springer.","DOI":"10.1007\/978-3-030-35679-8_6"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Le, T., and Chyi-Yeu, L. (2019). Bin-Picking for Planar Objects Based on a Deep Learning Network: A Case Study of USB Packs. Sensors, 19.","DOI":"10.3390\/s19163602"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Jiang, P., Ishihara, Y., Sugiyama, N., Oaki, J., and Tokura, S. (2020). Depth image-based deep learning of grasp planning for textureless planar-faced objects in vision-guided robotic bin-picking. Sensors, 20.","DOI":"10.3390\/s20030706"},{"key":"ref_4","unstructured":"Christensen, H.I., Khan, A., Pokutta, S., and Tetali, P. (2020, August 08). Multidimensional Bin Packing and Other Related Problems: A Survey. Available online: http:\/\/people.math.gatech.edu\/~tetali\/PUBLIS\/CKPT.pdf."},{"key":"ref_5","first-page":"193","article-title":"Guidance and Visualization of Optimized Packing Solutions","volume":"28","author":"Techasarntikul","year":"2020","journal-title":"J. Inf. Process."},{"key":"ref_6","unstructured":"Man, E.C., Garey, M.R., and Johnson, D.S. (1996). Approximation algorithms for bin packing: A survey. Approximation Algorithms for NP-Hard Problems, PWS Publishing Company."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ejor.2012.12.006","article-title":"Constraints in container loading-A state-of-the-art review","volume":"229","author":"Bortfeldt","year":"2013","journal-title":"Eur. J. Oper. Res."},{"key":"ref_8","unstructured":"Levin, M.S. (2016). Towards bin packing (preliminary problem survey, models with multiset estimates). arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1287\/ijoo.2019.0013","article-title":"Three-Dimensional Bin Packing and Mixed-Case Palletization","volume":"1","author":"Elhedhli","year":"2019","journal-title":"Informs J. Optim."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.cosrev.2016.12.001","article-title":"Approximation and online algorithms for multidimensional bin packing: A survey","volume":"24","author":"Christensen","year":"2017","journal-title":"Comput. Sci. Rev."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kundu, O., Dutta, S., and Kumar, S. (2019, January 14\u201318). Deep-Pack: A Vision-Based 2D Online Bin Packing Algorithm with Deep Reinforcement Learning. Proceedings of the 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), New Delhi, India.","DOI":"10.1109\/RO-MAN46459.2019.8956393"},{"key":"ref_12","unstructured":"Hu, H., Zhang, X., Yan, X., Wang, L., and Xu, Y. (2017). Solving a new 3d bin packing problem with deep reinforcement learning method. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Li, H., Wang, Y., Ma, D., Fang, Y., and Lei, Z. (2018, January 23\u201326). Quasi-Monte-Carlo Tree Search for 3D Bin Packing. Proceedings of the Chinese Conference on Pattern Recognition and Computer Vision, Guangzhou, China.","DOI":"10.1007\/978-3-030-03398-9_33"},{"key":"ref_14","first-page":"012041","article-title":"Smart Packing Simulator for 3D Packing Problem Using Genetic Algorithm","volume":"1447","author":"Christensen","year":"2020","journal-title":"J. Phys."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1016\/j.ejor.2020.03.040","article-title":"A beam search algorithm for the biobjective container loading problem","volume":"286","author":"Araya","year":"2020","journal-title":"Eur. J. Oper. Res."},{"key":"ref_16","first-page":"267","article-title":"A complete framework for multi-constrained 3D bin packing optimization using firefly algorithm","volume":"114","author":"Kanna","year":"2017","journal-title":"Int. J. Pure Appl. Math."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ha, C.T., Nguyen, T.T., Bui, L.T., and Wang, R. (2017, January 19\u201321). An online packing heuristic for the three-dimensional container loading problem in dynamic environments and the Physical Internet. Proceedings of the European Conference on the Applications of Evolutionary Computation, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-55792-2_10"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Shome, R. (2019, January 20\u201324). Towards robust product packing with a minimalistic end-effector. Proceedings of the International Conference on Robotics and Automation, Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793966"},{"key":"ref_19","unstructured":"Duan, L., Hu, H., Qian, Y., Gong, Y., Zhang, X., Xu, Y., and Wei, J. (2018). A multi-task selected learning approach for solving 3D flexible bin packing problem. arXiv."},{"key":"ref_20","unstructured":"Verma, R., Singhal, A., Khadilkar, H., Basumatary, A., Nayak, S., Singh, H.V., and Sinha, R. (2007). A Generalized Reinforcement Learning Algorithm for Online 3D Bin-Packing. arXiv."},{"key":"ref_21","unstructured":"Zhao, H., She, Q., Zhu, C., Yang, Y., and Xu, K. (2006). Online 3D Bin Packing with Constrained Deep Reinforcement Learning. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Liu, Z., Zhao, C., Wu, X., and Chen, W. (2017). An effective 3D shape descriptor for object recognition with RGB-D sensors. Sensors, 17.","DOI":"10.3390\/s17030451"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Cao, Y.P., Kobbelt, L., and Hu, S.M. (2018). Real-time High-accuracy Three-Dimensional Reconstruction with Consumer RGB-D Cameras. ACM Trans. Graph., 37.","DOI":"10.1145\/3182157"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Li, S., Li, D., Zhang, C., Wan, J., and Xie, M. (2020). RGB-D Image Processing Algorithm for Target Recognition and Pose Estimation of Visual Servo System. Sensors, 20.","DOI":"10.3390\/s20020430"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1023\/A:1008202821328","article-title":"Differential Evolution - a Simple and Efficient Heuristic for Global Optimization over Continuous Spaces","volume":"11","author":"Storn","year":"1997","journal-title":"J. Glob. Optim."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2827","DOI":"10.1098\/rsta.1999.0469","article-title":"Characterization of structures from X-ray scattering data using genetic algorithms","volume":"357","author":"Wormington","year":"1999","journal-title":"Philos. Trans. R. Soc. Lond. A"},{"key":"ref_27","unstructured":"Lampinen, J. (2002, January 12\u201317). A constraint handling approach for the differential evolution algorithm. Proceedings of the International Congress on Evolutionary Computation, Honolulu, HI, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/16\/4448\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:58:28Z","timestamp":1760176708000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/16\/4448"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,9]]},"references-count":27,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2020,8]]}},"alternative-id":["s20164448"],"URL":"https:\/\/doi.org\/10.3390\/s20164448","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,8,9]]}}}