{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T05:07:26Z","timestamp":1787029646749,"version":"build-2736575974"},"reference-count":40,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2022,3,9]],"date-time":"2022-03-09T00:00:00Z","timestamp":1646784000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002383","name":"King Saud University","doi-asserted-by":"publisher","award":["RSP-2021\/34"],"award-info":[{"award-number":["RSP-2021\/34"]}],"id":[{"id":"10.13039\/501100002383","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Industry 4.0 smart manufacturing systems are equipped with sensors, smart machines, and intelligent robots. The automated in-plant transportation of manufacturing parts through throwing and catching robots is an attempt to accelerate the transportation process and increase productivity by the optimized utilization of in-plant facilities. Such an approach requires intelligent tracking and prediction of the final 3D catching position of thrown objects, while observing their initial flight trajectory in real-time, by catching robot in order to grasp them accurately. Due to non-deterministic nature of such mechanically thrown objects\u2019 flight, accurate prediction of their complete trajectory is only possible if we accurately observe initial trajectory as well as intelligently predict remaining trajectory. The thrown objects in industry can be of any shape but detecting and accurately predicting interception positions of any shape object is an extremely challenging problem that needs to be solved step by step. In this research work, we only considered spherical shape objects as their3D central position can be easily determined. Our work comprised of development of a 3D simulated environment which enabled us to throw object of any mass, diameter, or surface air friction properties in a controlled internal logistics environment. It also enabled us to throw object with any initial velocity and observe its trajectory by placing a simulated pinhole camera at any place within 3D vicinity of internal logistics. We also employed multi-view geometry among simulated cameras in order to observe trajectories more accurately. Hence, it provided us an ample opportunity of precise experimentation in order to create enormous dataset of thrown object trajectories to train an encoder-decoder bidirectional LSTM deep neural network. The trained neural network has given the best results for accurately predicting trajectory of thrown objects in real time.<\/jats:p>","DOI":"10.3390\/s22062113","type":"journal-article","created":{"date-parts":[[2022,3,10]],"date-time":"2022-03-10T02:10:35Z","timestamp":1646878235000},"page":"2113","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Intelligent Tracking of Mechanically Thrown Objects by Industrial Catching Robot for Automated In-Plant Logistics 4.0"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2178-0435","authenticated-orcid":false,"given":"Nauman","family":"Qadeer","sequence":"first","affiliation":[{"name":"Department of Computer Science, Wah Campus, COMSATS University Islamabad, Wah Cantonment 47040, Pakistan"},{"name":"Department of Computer Science, Federal Urdu University of Arts, Science & Technology, Islamabad 45570, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jamal Hussain","family":"Shah","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Wah Campus, COMSATS University Islamabad, Wah Cantonment 47040, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1355-2168","authenticated-orcid":false,"given":"Muhammad","family":"Sharif","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Wah Campus, COMSATS University Islamabad, Wah Cantonment 47040, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6763-2123","authenticated-orcid":false,"given":"Muhammad Attique","family":"Khan","sequence":"additional","affiliation":[{"name":"Department of Computer Science, HITEC University Taxila, Taxila 47080, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9781-3969","authenticated-orcid":false,"given":"Ghulam","family":"Muhammad","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu-Dong","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Informatics, University of Leicester, Leicester LE1 7RH, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,9]]},"reference":[{"key":"ref_1","unstructured":"Black, J.T., and Kohser, R.A. (2020). DeGarmo\u2019s Materials and Processes in Manufacturing, John Wiley & Sons."},{"key":"ref_2","unstructured":"Groover, M.P. (2020). Fundamentals of Modern Manufacturing: Materials, Processes and Systems, John Wiley & Sons."},{"key":"ref_3","unstructured":"Shirai, Y. (2012). Three-Dimensional Computer Vision, Springer Science & Business Media."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"12253","DOI":"10.1109\/ACCESS.2020.2965333","article-title":"Intelligent Role-Based Access Control and Framework Using Semantic Business Roles in Multi-Domain Environments","volume":"8","author":"Ghazal","year":"2020","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ghazal, R., Malik, A.K., Raza, B., Qadeer, N., Qamar, N., and Bhatia, S. (2021). Agent-Based Semantic Role Mining for Intelligent Access Control in Multi-Domain Collaborative Applications of Smart Cities. Sensors, 21.","DOI":"10.3390\/s21134253"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Shi, Z., Xu, M., Pan, Q., Yan, B., and Zhang, H. (2018, January 8\u201313). LSTM-Based Flight Trajectory Prediction. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil.","DOI":"10.1109\/IJCNN.2018.8489734"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1016\/j.ijleo.2017.12.038","article-title":"Applying Deep Bidirectional LSTM and Mixture Density Network for Basketball Trajectory Prediction","volume":"158","author":"Zhao","year":"2018","journal-title":"Optik"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Frank, H., Wellerdick-Wojtasik, N., Hagebeuker, B., Novak, G., and Mahlknecht, S. (2006, January 17\u201320). Throwing Objects\u2014A Bio-Inspired Approach for the Transportation of Parts. Proceedings of the 2006 IEEE International Conference on Robotics and Biomimetics, Kunming, China.","DOI":"10.1109\/ROBIO.2006.340302"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Frank, H., Barteit, D., and Kupzog, F. (2008, January 10\u201311). Throwing or Shooting-a New Technology for Logistic Chains within Production System. Proceedings of the 2008 IEEE International Conference on Technologies for Practical Robot Applications, Woburn, MA, USA.","DOI":"10.1109\/TEPRA.2008.4686674"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Frank, H. (2008, January 13\u201315). Design and Simulation of a Numerical Controlled Throwing Devic. Proceedings of the 2008 Second Asia International Conference on Modelling & Simulation (AMS), Kuala Lumpur, Malaysia.","DOI":"10.1109\/AMS.2008.17"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Smith, C., and Christensen, H.I. (2007, January 10\u201314). Using COTS to Construct a High Performance Robot Arm. Proceedings of the Proceedings 2007 IEEE International Conference on Robotics and Automation, Rome, Italy.","DOI":"10.1109\/ROBOT.2007.364102"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Frank, H., Mittnacht, A., and Scheiermann, J. (2009, January 14\u201317). Throwing of Cylinder-Shaped Objects. Proceedings of the 2009 IEEE\/ASME International Conference on Advanced Intelligent Mechatronics, Singapore.","DOI":"10.1109\/AIM.2009.5230037"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Frank, H., Barteit, D., Meyer, M., Mittnacht, A., Novak, G., and Mahlknecht, S. (2008, January 21\u201324). Optimized Control Methods for Capturing Flying Objects with a Cartesian Robo. Proceedings of the 2008 IEEE Conference on Robotics, Automation and Mechatronics, Chengdu, China.","DOI":"10.1109\/RAMECH.2008.4681368"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Frank, H., Barteit, D., Wellerdick-Wojtasik, N., Frank, T., Novak, G., and Mahlknecht, S. (2007, January 23\u201327). Autonomous Mechanical Controlled Grippers for Capturing Flying Object. Proceedings of the 2007 5th IEEE International Conference on Industrial Informatics, Vienna, Austria.","DOI":"10.1109\/INDIN.2007.4384796"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1049","DOI":"10.1109\/TRO.2014.2316022","article-title":"Catching Objects in Flight","volume":"30","author":"Kim","year":"2014","journal-title":"IEEE Trans. Robot."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/j.opelre.2019.02.003","article-title":"A Deep Learning Ball Tracking System in Soccer Videos","volume":"27","author":"Kamble","year":"2019","journal-title":"Opto-Electron. Rev."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Najeeb, H.D., and Ghani, R.F. (2020, January 16\u201318). Tracking Ball in Soccer Game Video Using Extended KalmanFilte. Proceedings of the 2020 International Conference on Computer Science and Software Engineering (CSASE), Duhok, Iraq.","DOI":"10.1109\/CSASE48920.2020.9142058"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Desai, U.B., Merchant, S.N., Zaveri, M., Ajishna, G., Purohit, M., and Phanish, H. (2005). Small Object Detection and Tracking: Algorithm, Analysis and Applicatio. Lecture Notes in Computer Science, Springer.","DOI":"10.1007\/11590316_14"},{"key":"ref_19","first-page":"30","article-title":"An Efficient Ball Detection Framework for Cricket","volume":"7","author":"Velammal","year":"2010","journal-title":"Int. J. Comput. Sci. Issues"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1016\/j.jvcir.2008.11.008","article-title":"Physics-Based Ball Tracking and 3D Trajectory Reconstruction with Applications to Shooting Location Estimation in Basketball Video","volume":"20","author":"Chen","year":"2009","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1109\/TMM.2014.2380914","article-title":"Tennis Ball Tracking Using a Two-Layered Data Association Approach","volume":"17","author":"Zhou","year":"2014","journal-title":"IEEE Trans. Multimed."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lin, H.-I., Yu, Z., and Huang, Y.-C. (2020). Ball Tracking and Trajectory Prediction for Table-Tennis Robots. Sensors, 20.","DOI":"10.3390\/s20020333"},{"key":"ref_23","unstructured":"Gomez Gonzalez, S. (2020). Real Time Probabilistic Models for Robot Trajectories. [Ph.D. Thesis, Technische Universit\u00e4t Darmstadt]."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"970","DOI":"10.1109\/LRA.2020.2966390","article-title":"Real Time Trajectory Prediction Using Deep Conditional Generative Models","volume":"5","author":"Prokudin","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Gomez-Gonzalez, S., Nemmour, Y., Sch\u00f6lkopf, B., and Peters, J. (2019). Reliable Real-Time Ball Tracking for Robot Table Tennis. Robotics, 8.","DOI":"10.3390\/robotics8040090"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Birbach, O., Frese, U., and B\u00e4uml, B. (2011, January 9\u201313). Realtime Perception for Catching a Flying Ball with a Mobile Humanoid. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980138"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1657","DOI":"10.1109\/TCST.2014.2380175","article-title":"Robotic Ball Catching with an Eye-in-Hand Single-Camera System","volume":"23","author":"Cigliano","year":"2015","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_28","first-page":"8","article-title":"Robust 3D Measurement with PMD Sensors","volume":"7","author":"Kraft","year":"2005","journal-title":"Range Imaging Day"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Barteit, D., Frank, H., and Kupzog, F. (2008, January 13\u201316). Accurate Prediction of Interception Positions for Catching Thrown Objects in Production Systems. Proceedings of the 2008 6th IEEE International Conference on Industrial Informatics, Daejeon, Korea.","DOI":"10.1109\/INDIN.2008.4618228"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Barteit, D., Frank, H., Pongratz, M., and Kupzog, F. (2009, January 23\u201326). Measuring the Intersection of a Thrown Object with a Vertical Plane. Proceedings of the 2009 7th IEEE International Conference on Industrial Informatics, Cardiff, UK.","DOI":"10.1109\/INDIN.2009.5195885"},{"key":"ref_31","unstructured":"Barteit, D.F. (2010). Tracking of Thrown Objects: Catching of Mechanically Thrown Parts for Transport in Manufacturing. [Ph.D. Thesis, Technische Universit\u00e4t Wien]."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Mironov, K., and Pongratz, M. (2016, January 21\u201326). Fast kNN-Based Prediction for the Trajectory of a Thrown Body. Proceedings of the 2016 24th Mediterranean Conference on Control and Automation (MED), Athens, Greece.","DOI":"10.1109\/MED.2016.7536007"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.ifacol.2015.09.155","article-title":"Processing and Forecasting the Trajectory of a Thrown Object Measured by the Stereo Vision System","volume":"48","author":"Mironov","year":"2015","journal-title":"IFAC-PapersOnLine"},{"key":"ref_34","first-page":"33","article-title":"Applying Neural Networks for Prediction of Flying Objects Trajectory","volume":"17","author":"Mironov","year":"2013","journal-title":"Bull. Ufa State Aviat. Tech. Univ."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Gayanov, R., Mironov, K., and Kurennov, D. (2017, January 18\u201320). Estimating the Trajectory of a Thrown Object from Video Signal with Use of Genetic Programmin. Proceedings of the 2017 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Bilbao, Spain.","DOI":"10.1109\/ISSPIT.2017.8388630"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1016\/j.ifacol.2018.11.271","article-title":"Transportation of Small Objects by Robotic Throwing and Catching: Applying Genetic Programming for Trajectory Estimation","volume":"51","author":"Gayanov","year":"2018","journal-title":"IFAC-PapersOnLine"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"248","DOI":"10.25046\/aj040124","article-title":"Observing and Forecasting the Trajectory of the Thrown Body with Use of Genetic Programming","volume":"1","author":"Mironov","year":"2019","journal-title":"Adv. Sci. Technol. Eng. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Mironov, K. (2017, January 16\u201319). Transport by Robotic Throwing and Catching: Accurate Stereo Tracking of the Spherical Object. Proceedings of the 2017 International Conference on Industrial Engineering, Applications and Manufacturing (ICIEAM), St. Petersburg, Russia.","DOI":"10.1109\/ICIEAM.2017.8076490"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1080\/19346182.2008.9648446","article-title":"Review of Tennis Ball Aerodynamics","volume":"1","author":"Mehta","year":"2008","journal-title":"Sports Technol."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Alam, F., Tio, W., Watkins, S., Subic, A., and Naser, J. (2007, January 2\u20137). Effects of Spin on Tennis Ball Aerodynamics: An Experimental and Computational Study. Proceedings of the 16th Australasian Fluid Mechanics Conference Crown Plaza, Gold Coast, Australia.","DOI":"10.1201\/9781439828427.ch63"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/6\/2113\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:33:41Z","timestamp":1760135621000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/6\/2113"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,9]]},"references-count":40,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["s22062113"],"URL":"https:\/\/doi.org\/10.3390\/s22062113","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,9]]}}}