{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T18:08:25Z","timestamp":1771956505103,"version":"3.50.1"},"reference-count":52,"publisher":"Cambridge University Press (CUP)","issue":"4","license":[{"start":{"date-parts":[[2024,2,13]],"date-time":"2024-02-13T00:00:00Z","timestamp":1707782400000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotica"],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Real-time and efficient path planning is critical for all robotic systems. In particular, it is of greater importance for industrial robots since the overall planning and execution time directly impact the cycle time and automation economics in production lines. While the problem may not be complex in static environments, classical approaches are inefficient in high-dimensional environments in terms of planning time and optimality. Collision checking poses another challenge in obtaining a real-time solution for path planning in complex environments. To address these issues, we propose an end-to-end learning-based framework viz., Path Planning and Collision checking Network (PPCNet). The PPCNet generates the path by computing waypoints sequentially using two networks: the first network generates a waypoint, and the second one determines whether the waypoint is on a collision-free segment of the path. The end-to-end training process is based on imitation learning that uses data aggregation from the experience of an expert planner to train the two networks, simultaneously. We utilize two approaches for training a network that efficiently approximates the exact geometrical collision checking function. Finally, the PPCNet is evaluated in two different simulation environments and a practical implementation on a robotic arm for a bin-picking application. Compared to the state-of-the-art path-planning methods, our results show significant improvement in performance by greatly reducing the planning time with comparable success rates and path lengths.<\/jats:p>","DOI":"10.1017\/s0263574724000109","type":"journal-article","created":{"date-parts":[[2024,2,13]],"date-time":"2024-02-13T10:23:07Z","timestamp":1707819787000},"page":"1094-1112","source":"Crossref","is-referenced-by-count":15,"title":["End-to-end deep learning-based framework for path planning and collision checking: bin-picking application"],"prefix":"10.1017","volume":"42","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8495-0374","authenticated-orcid":false,"given":"Mehran","family":"Ghafarian Tamizi","sequence":"first","affiliation":[]},{"given":"Homayoun","family":"Honari","sequence":"additional","affiliation":[]},{"given":"Aleksey","family":"Nozdryn-Plotnicki","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3550-225X","authenticated-orcid":false,"given":"Homayoun","family":"Najjaran","sequence":"additional","affiliation":[]}],"member":"56","published-online":{"date-parts":[[2024,2,13]]},"reference":[{"key":"S0263574724000109_ref7","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1016\/j.mechatronics.2003.10.001","article-title":"An effective robot trajectory planning method using a genetic algorithm","volume":"14","author":"Tian","year":"2004","journal-title":"Mechatronics"},{"key":"S0263574724000109_ref22","doi-asserted-by":"crossref","unstructured":"[22] Gammell, J. D. , Srinivasa, S. S. and Barfoot, T. D. , \u201cBatch Informed Trees (bit): Sampling-Based Optimal Planning via the Heuristically Guided Search of Implicit Random Geometric Graphs,\u201d In: 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA (IEEE, 2015) pp. 3067\u20133074.","DOI":"10.1109\/ICRA.2015.7139620"},{"key":"S0263574724000109_ref15","doi-asserted-by":"crossref","first-page":"991","DOI":"10.1177\/0278364913487237","article-title":"Motion planning efficient trajectories for industrial bin-picking","volume":"32","author":"Ellekilde","year":"2013","journal-title":"Int J Robot Res"},{"key":"S0263574724000109_ref2","doi-asserted-by":"crossref","unstructured":"[2] Domae, Y. , Okuda, H. , Taguchi, Y. , Sumi, K. and Hirai, T. , \u201cFast Graspability Evaluation on Single Depth Maps for Bin Picking with General Grippers,\u201d In: 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China (IEEE, 2014) pp. 1997\u20132004.","DOI":"10.1109\/ICRA.2014.6907124"},{"key":"S0263574724000109_ref13","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1007\/s10514-011-9232-5","article-title":"Autonomous motion planning of a hand-arm robotic system based on captured human-like hand postures","volume":"31","author":"Rosell","year":"2011","journal-title":"Auton Robot"},{"key":"S0263574724000109_ref39","doi-asserted-by":"crossref","unstructured":"[39] Lawlor, O. S. and Kal\u00e9e, L. V. , \u201cA Voxel-Based Parallel Collision Detection Algorithm,\u201d In: Proceedings of the 16th International Conference on Supercomputing, New York, USA (Association for Computing Machinery, 2002) pp. 285\u2013293.","DOI":"10.1145\/514191.514231"},{"key":"S0263574724000109_ref42","doi-asserted-by":"crossref","unstructured":"[42] Huh, J. and Lee, D. D. , \u201cLearning High-Dimensional Mixture Models for Fast Collision Detection in Rapidly-Exploring Random Trees,\u201d In: 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden (IEEE, 2016) pp. 63\u201369.","DOI":"10.1109\/ICRA.2016.7487116"},{"key":"S0263574724000109_ref49","unstructured":"[49] Kinova Kortex API, GitHub Respository (2019), https:\/\/github.com\/kinovarobotics\/ros_kortex."},{"key":"S0263574724000109_ref47","unstructured":"[47] Garrett, C. R. , Pybullet Planning (2020), https:\/\/pypi.org\/project\/pybullet-planning\/."},{"key":"S0263574724000109_ref8","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1109\/ACCESS.2014.2302442","article-title":"Sampling-based robot motion planning: A review","volume":"2","author":"Elbanhawi","year":"2014","journal-title":"IEEE Access"},{"key":"S0263574724000109_ref31","doi-asserted-by":"crossref","unstructured":"[31] Nair, A. , McGrew, B. , Andrychowicz, M. , Zaremba, W. and Abbeel, P. , \u201cOvercoming Exploration in Reinforcement Learning with Demonstrations,\u201d In: 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia (IEEE, 2018) pp. 6292\u20136299.","DOI":"10.1109\/ICRA.2018.8463162"},{"key":"S0263574724000109_ref9","doi-asserted-by":"crossref","DOI":"10.1017\/9781316661239","volume-title":"Modern Robotics: Mechanics, Planning, and Control","author":"Lynch","year":"2017"},{"key":"S0263574724000109_ref50","doi-asserted-by":"crossref","unstructured":"[50] Boscariol, P. , Caracciolo, R. and Richiedei, D. , \u201cEnergy Optimal Design of Jerk-Continuous Trajectories for Industrial Robots,\u201d In: The International Conference of IFToMM ITALY, Cham (Springer, 2020) pp. 318\u2013325.","DOI":"10.1007\/978-3-030-55807-9_36"},{"key":"S0263574724000109_ref21","doi-asserted-by":"crossref","first-page":"1855","DOI":"10.1017\/S0263574721001417","article-title":"Effective motion planning of manipulator based on SDPS-RRTConnect","volume":"40","author":"Xu","year":"2022","journal-title":"Robotica"},{"key":"S0263574724000109_ref48","unstructured":"[48] Coumans, E. and Bai, Y. , Pybullet, a python module for physics simulation for games, robotics and machine learning, (2016). http:\/\/pybullet.org."},{"key":"S0263574724000109_ref28","first-page":"132","article-title":"Obstacle avoidance of redundant manipulators using neural networks based reinforcement learning","volume":"28","author":"Duguleana","year":"2012","journal-title":"Robot Com-INT Manuf"},{"key":"S0263574724000109_ref6","doi-asserted-by":"crossref","first-page":"1957","DOI":"10.1080\/0305215X.2019.1681986","article-title":"Virtual target point-based obstacle-avoidance method for manipulator systems in a cluttered environment","volume":"52","author":"Long","year":"2020","journal-title":"Eng Optimiz"},{"key":"S0263574724000109_ref26","doi-asserted-by":"crossref","unstructured":"[26] Qureshi, A. H. and Yip, M. C. , \u201cDeeply Informed Neural Sampling for Robot Motion Planning,\u201d In: 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain (IEEE, 2018) pp. 6582\u20136588.","DOI":"10.1109\/IROS.2018.8593772"},{"key":"S0263574724000109_ref4","first-page":"69","volume-title":"Robot Design: From Theory to Service Applications","author":"Boscariol","year":"2022"},{"key":"S0263574724000109_ref32","doi-asserted-by":"crossref","first-page":"105669","DOI":"10.1109\/ACCESS.2019.2932257","article-title":"Deep reinforcement learning with optimized reward functions for robotic trajectory planning","volume":"7","author":"Xie","year":"2019","journal-title":"IEEE Access"},{"key":"S0263574724000109_ref24","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1108\/IR-06-2016-0166","article-title":"Benchmarking motion planning algorithms for bin-picking applications","volume":"44","author":"Iversen","year":"2017","journal-title":"Indus Robot"},{"key":"S0263574724000109_ref3","first-page":"3","volume-title":"Bin-picking, Studies in Systems Decision and Control","author":"Buchholz","year":"2016"},{"key":"S0263574724000109_ref16","doi-asserted-by":"crossref","unstructured":"[16] Rybus, T. and Seweryn, K. , \u201cApplication of Rapidly-Exploring Random Trees (rrt) Algorithm for Trajectory Planning of Free-Floating Space Manipulator,\u201d In: 2015 10th International Workshop On Robot Motion and Control (RoMoCo), Poznan, Poland (IEEE, 2015) pp. 91\u201396.","DOI":"10.1109\/RoMoCo.2015.7219719"},{"key":"S0263574724000109_ref25","doi-asserted-by":"crossref","unstructured":"[25] Cheng, R. , Shankar, K. and Burdick, J. W. , \u201cLearning an Optimal Sampling Distribution for Efficient Motion Planning,\u201d In: 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA (IEEE, 2020) pp. 7485\u20137492.","DOI":"10.1109\/IROS45743.2020.9341245"},{"key":"S0263574724000109_ref1","doi-asserted-by":"crossref","unstructured":"[1] Buchholz, D. , Kubus, D. , Weidauer, I. , Scholz, A. and Wahl, F. M. , \u201cCombining Visual and Inertial Features for Efficient Grasping and Bin-Picking,\u201d In: 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China (IEEE, 2014) pp. 875\u2013882.","DOI":"10.1109\/ICRA.2014.6906957"},{"key":"S0263574724000109_ref36","doi-asserted-by":"crossref","unstructured":"[36] Qureshi, A. H. , Simeonov, A. , Bency, M. J. and Yip, M. C. , \u201cMotion Planning Networks,\u201d In: 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada (IEEE, 2019) pp. 2118\u20132124.","DOI":"10.1109\/ICRA.2019.8793889"},{"key":"S0263574724000109_ref5","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1007\/s41315-023-00274-2","article-title":"A review of recent trend in motion planning of industrial robots","volume":"7","author":"Tamizi","year":"2023","journal-title":"Int J Intel Robot Appl"},{"key":"S0263574724000109_ref40","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1145\/231731.231732","article-title":"Approximating polyhedra with spheres for time-critical collision detection","volume":"15","author":"Hubbard","year":"1996","journal-title":"ACM Trans Graph"},{"key":"S0263574724000109_ref44","doi-asserted-by":"crossref","first-page":"1096","DOI":"10.1109\/TRO.2020.2974094","article-title":"Learning-based proxy collision detection for robot motion planning applications","volume":"36","author":"Das","year":"2020","journal-title":"IEEE Trans Robot"},{"key":"S0263574724000109_ref35","doi-asserted-by":"crossref","unstructured":"[35] Bency, M. J. , Qureshi, A. H. and Yip, M. C. , \u201cNeural Path Planning: Fixed Time, Near-Optimal Path Generation via Oracle Imitation,\u201d In: 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China (IEEE, 2019) pp. 3965\u20133972.","DOI":"10.1109\/IROS40897.2019.8968089"},{"key":"S0263574724000109_ref17","doi-asserted-by":"crossref","first-page":"1381","DOI":"10.3390\/app10041381","article-title":"Collision-free path planning method for robots based on an improved rapidly-exploring random tree algorithm","volume":"10","author":"Wang","year":"2020","journal-title":"Appl Sci"},{"key":"S0263574724000109_ref46","unstructured":"[46] Paszke, A. , Gross, S. , Chintala, S. , Chanan, G. , Yang, E. , DeVito, Z. , Lin, Z. , Desmaison, A. , Antiga, L. and Lerer, A. , Automatic differentiation in pytorch, (2017)."},{"key":"S0263574724000109_ref12","doi-asserted-by":"crossref","first-page":"1816","DOI":"10.1016\/j.robot.2014.07.003","article-title":"Planning manipulation movements of a dual-arm system considering obstacle removing","volume":"62","author":"Rodr\u00edguez","year":"2014","journal-title":"Robot Auton Syst"},{"key":"S0263574724000109_ref43","doi-asserted-by":"crossref","first-page":"1477","DOI":"10.1177\/0278364916640908","article-title":"Fast probabilistic collision checking for sampling-based motion planning using locality-sensitive hashing","volume":"35","author":"Pan","year":"2016","journal-title":"Int J Rob Res"},{"key":"S0263574724000109_ref18","doi-asserted-by":"crossref","first-page":"957","DOI":"10.1017\/S0263574719001176","article-title":"Point-to-point motion planning of a free-floating space manipulator using the rapidly-exploring random trees (RRT) method","volume":"38","author":"Rybus","year":"2020","journal-title":"Robotica"},{"key":"S0263574724000109_ref19","unstructured":"[19] Kuffner, J. J. and LaValle, S. M. , \u201cAn Efficient Approach to Single-Query Path Planning,\u201d In: IEEE International Conference on Robotics and Automation, San Francisco, USA (IEEE, 2000) pp. 473\u2013479."},{"key":"S0263574724000109_ref10","unstructured":"[10] LaValle, S. M. , Rapidly-exploring random trees: A new tool for path planning, (1998). Technical report."},{"key":"S0263574724000109_ref34","unstructured":"[34] Rahmatizadeh, R. , Abolghasemi, P. , Behal, A. and B\u00f6l\u00f6ni, L. , Learning real manipulation tasks from virtual demonstrations using LSTM, (2016). arXiv preprint arXiv: 1603.03833, 2016."},{"key":"S0263574724000109_ref14","doi-asserted-by":"crossref","first-page":"846","DOI":"10.1177\/0278364911406761","article-title":"Sampling-based algorithms for optimal motion planning","volume":"30","author":"Karaman","year":"2011","journal-title":"Int J Robot Res"},{"key":"S0263574724000109_ref11","unstructured":"[11] Kavraki, L. E. and Latombe, J.-C. , Probabilistic roadmaps for robot path planning. Practical motion planning in robotics: Current approaches and future challenges, citeseer, (1998), 33\u201353."},{"key":"S0263574724000109_ref20","doi-asserted-by":"crossref","unstructured":"[20] Riedlinger, M. A. , Tamizi, M. G. , Tikekar, J. and Redeker, M. , \u201cConcept for a Distributed Picking Application Utilizing Robotics and Digital Twins,\u201d In: 2022 IEEE 27th International Conference on Emerging Technologies and Factory Automation (ETFA), Stuttgart, Germany (IEEE, 2022) pp. 1\u20134.","DOI":"10.1109\/ETFA52439.2022.9921659"},{"key":"S0263574724000109_ref52","doi-asserted-by":"crossref","unstructured":"[52] Ichnowski, J. , Danielczuk, M. , Xu, J. , Satish, V. and Goldberg, K. , \u201cGomp: Grasp-Optimized Motion Planning for Bin Picking,\u201d In: 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, Franc (IEEE, 2020) pp. 5270\u20135277.","DOI":"10.1109\/ICRA40945.2020.9197548"},{"key":"S0263574724000109_ref27","doi-asserted-by":"crossref","unstructured":"[27] Aleo, I. , Arena, P. and Patan\u00e9, L. , \u201cSARSA-Based Reinforcement Learning for Motion Planning in Serial Manipulators,\u201d In: The 2010 International Joint Conference on Neural Networks (IJCNN), Barcelona, Spain (IEEE, 2010) pp. 1\u20136.","DOI":"10.1109\/IJCNN.2010.5596282"},{"key":"S0263574724000109_ref37","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1109\/TRO.2020.3006716","article-title":"Motion planning networks: Bridging the gap between learning-based and classical motion planners","volume":"37","author":"Qureshi","year":"2021","journal-title":"IEEE Trans Robot"},{"key":"S0263574724000109_ref45","unstructured":"[45] Ross, S. , Gordon, G. and Bagnell, A. , \u201cA Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning,\u201d In: Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics (2011) pp. 627\u2013635."},{"key":"S0263574724000109_ref29","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1007\/s10514-020-09947-4","article-title":"Reinforcement based mobile robot path planning with improved dynamic window approach in unknown environment","volume":"45","author":"Chang","year":"2021","journal-title":"Auton Robot"},{"key":"S0263574724000109_ref33","doi-asserted-by":"crossref","first-page":"3566","DOI":"10.1109\/TSMC.2022.3228901","article-title":"Deep reinforcement learning with a stage incentive mechanism of dense reward for robotic trajectory planning","volume":"53","author":"Peng","year":"2022","journal-title":"IEEE Trans Sys Man Cyber Syst"},{"key":"S0263574724000109_ref23","doi-asserted-by":"crossref","unstructured":"[23] Gammell, J. D. , Srinivasa, S. S. and Barfoot, T. D. , \u201cInformed RRT*: Optimal Sampling-Based Path Planning Focused via Direct Sampling of an Admissible Ellipsoidal Heuristic,\u201d In: 2014 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA (IEEE, 2014) pp. 2997\u20133004.","DOI":"10.1109\/IROS.2014.6942976"},{"key":"S0263574724000109_ref51","doi-asserted-by":"crossref","unstructured":"[51] Lozer, F. , Scalera, L. , Boscariol, P. and Gasparetto, A. , \u201cAn Experimental Setup to Test Time-Jerk Optimal Trajectories for Robotic Manipulators,\u201d In: International Conference on Robotics in Alpe-Adria Danube Region, Cham (Springer, 2023) pp. 309\u2013316.","DOI":"10.1007\/978-3-031-32606-6_36"},{"key":"S0263574724000109_ref30","doi-asserted-by":"crossref","unstructured":"[30] Li, Z. , Ma, H. , Ding, Y. , Wang, C. and Jin, Y. , \u201cMotion Planning of Six-DOF Arm Robot Based on Improved DDPG Algorithm,\u201d In: 2020 39th Chinese Control Conference (CCC), Shenyang, China (IEEE, 2020) pp. 3954\u20133959.","DOI":"10.23919\/CCC50068.2020.9188521"},{"key":"S0263574724000109_ref38","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1109\/56.2083","article-title":"A fast procedure for computing the distance between complex objects in three-dimensional space","volume":"4","author":"Gilbert","year":"1988","journal-title":"IEEE J Robot Auto"},{"key":"S0263574724000109_ref41","doi-asserted-by":"crossref","first-page":"046","DOI":"10.15302\/J-ENG-2015009","article-title":"Efficient configuration space construction and optimization for motion planning","volume":"1","author":"Pan","year":"2015","journal-title":"Engineering"}],"container-title":["Robotica"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S0263574724000109","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,11]],"date-time":"2024-11-11T04:55:33Z","timestamp":1731300933000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S0263574724000109\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,13]]},"references-count":52,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,4]]}},"alternative-id":["S0263574724000109"],"URL":"https:\/\/doi.org\/10.1017\/s0263574724000109","relation":{},"ISSN":["0263-5747","1469-8668"],"issn-type":[{"value":"0263-5747","type":"print"},{"value":"1469-8668","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,13]]}}}