{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T01:41:43Z","timestamp":1773366103106,"version":"3.50.1"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2024,3,16]],"date-time":"2024-03-16T00:00:00Z","timestamp":1710547200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,16]],"date-time":"2024-03-16T00:00:00Z","timestamp":1710547200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004434","name":"Universit\u00e0 degli Studi di Firenze","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004434","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Vis Comput"],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Employing cognitive robots, capable of throwing and catching, is a strategy aimed at expediting the logistics process within Industry 4.0\u2019s smart manufacturing plants, specifically for the transportation of small-sized manufacturing parts. Since the flight of mechanically thrown objects is inherently unpredictable, it is crucial for the catching robot to observe the initial trajectory with utmost precision and intelligently forecast the final catching position to ensure accurate real-time grasping. This study utilizes multi-camera tracking to monitor mechanically thrown objects. It involves the creation of a 3D simulation that facilitates controlled mechanical throwing of objects within the internal logistics environment of Industry 4.0. The developed simulation empowers users to define the attributes of the thrown object and capture its trajectory using a simulated pinhole camera, which can be positioned at any desired location and orientation within the in-plant logistics environment of flexible manufacturing systems. The simulation facilitated ample experimentation to be conducted for determining the optimal camera positions for accurately observing the 3D interception positions of a flying object based on its apparent size on the camera\u2019s sensor plane. Subsequently, a variety of calibrated multi-camera setups were experimented while placing cameras at identified optimal positions. Based on the obtained results, the most effective multi-camera configuration setup is derived. Finally, a training dataset is prepared for 3000 simulated throwing experiments where the initial part of the trajectory consists of observed interception positions, through derived best multi-camera setup, and the final part consists of actual positions. The encoder\u2013decoder Bi-LSTM deep neural network is proposed and trained on this dataset. The trained model outperformed the current state-of-the-art by accurately predicting the final 3D catching point, achieving a mean average error of 5\u00a0mm and a root-mean-square error of 7\u00a0mm in 200 real-world test experiments.<\/jats:p>","DOI":"10.1007\/s00371-024-03296-4","type":"journal-article","created":{"date-parts":[[2024,3,16]],"date-time":"2024-03-16T10:01:46Z","timestamp":1710583306000},"page":"9063-9082","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Multi-camera tracking of mechanically thrown objects for automated in-plant logistics by cognitive robots in Industry 4.0"],"prefix":"10.1007","volume":"40","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2178-0435","authenticated-orcid":false,"given":"Nauman","family":"Qadeer","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7903-9391","authenticated-orcid":false,"given":"Jamal Hussain","family":"Shah","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1355-2168","authenticated-orcid":false,"given":"Muhammad","family":"Sharif","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5975-0696","authenticated-orcid":false,"given":"Fadl","family":"Dahan","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0009-0008-7890-4639","authenticated-orcid":false,"given":"Fahad Ahmed","family":"Khokhar","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2911-2148","authenticated-orcid":false,"given":"Rubina","family":"Ghazal","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,3,16]]},"reference":[{"key":"3296_CR1","unstructured":"Alam, F., Tio, W., Watkins, S., et\u00a0al.: Effects of spin on tennis ball aerodynamics: an experimental and computational study, 324\u2013327 (2007)"},{"key":"3296_CR2","doi-asserted-by":"publisher","first-page":"54923","DOI":"10.1109\/ACCESS.2021.3071169","volume":"9","author":"GJ Ansari","year":"2021","unstructured":"Ansari, G.J., Shah, J.H., Farias, M.C., et al.: An optimized feature selection technique in diversified natural scene text for classification using genetic algorithm. IEEE Access 9, 54923\u201354937 (2021)","journal-title":"IEEE Access"},{"key":"3296_CR3","doi-asserted-by":"crossref","unstructured":"Barteit, D., Frank, H., Kupzog, F.: Accurate prediction of interception positions for catching thrown objects in production systems. In: 2008 6th IEEE International Conference on Industrial Informatics, pp. 893\u2013898. IEEE (2008)","DOI":"10.1109\/INDIN.2008.4618228"},{"key":"3296_CR4","doi-asserted-by":"crossref","unstructured":"Barteit, D., Frank, H., Pongratz, M., et\u00a0al.: Measuring the intersection of a thrown object with a vertical plane. In: 2009 7th IEEE International Conference on Industrial Informatics, pp. 680\u2013685. IEEE (2009)","DOI":"10.1109\/INDIN.2009.5195885"},{"key":"3296_CR5","unstructured":"Barteit, D.F.: Tracking of thrown objects: catching of mechanically thrown parts for transport in manufacturing. PhD thesis, Vienna University of Technology, Austria (2010)"},{"key":"3296_CR6","doi-asserted-by":"crossref","unstructured":"Bauml, B., Wimbock, T., Hirzinger, G.: Kinematically optimal catching a flying ball with a hand-arm-system. In: 2010 IEEE\/RSJ International Conference on Intelligent Robots and Systems, pp. 2592\u20132599. IEEE (2010)","DOI":"10.1109\/IROS.2010.5651175"},{"key":"3296_CR7","doi-asserted-by":"crossref","unstructured":"B\u00e4uml, B., Birbach, O., Wimb\u00f6ck, T., et\u00a0al.: Catching flying balls with a mobile humanoid: system overview and design considerations. In: 2011 11th IEEE-RAS International Conference on Humanoid Robots, pp. 513\u2013520. IEEE (2011)","DOI":"10.1109\/Humanoids.2011.6100837"},{"key":"3296_CR8","volume-title":"DeGarmo\u2019s Materials and Processes in Manufacturing","author":"JT Black","year":"2020","unstructured":"Black, J.T., Kohser, R.A.: DeGarmo\u2019s Materials and Processes in Manufacturing. John Wiley & Sons, Hoboken (2020)"},{"issue":"5","key":"3296_CR9","doi-asserted-by":"publisher","first-page":"1410","DOI":"10.1109\/TCSVT.2019.2902937","volume":"30","author":"Z Chen","year":"2019","unstructured":"Chen, Z., Wang, J., Sheng, B., et al.: Illumination-invariant video cut-out using octagon sensitive optimization. IEEE Trans. Circuits Syst. Video Technol. 30(5), 1410\u20131422 (2019)","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"3296_CR10","doi-asserted-by":"crossref","unstructured":"Frank, H., Wellerdick-Wojtasik, N., Hagebeuker, B., et\u00a0al.: Throwing objects\u2013a bio-inspired approach for the transportation of parts. In: 2006 IEEE International Conference on Robotics and Biomimetics, pp. 91\u201396. IEEE (2006)","DOI":"10.1109\/ROBIO.2006.340302"},{"key":"3296_CR11","doi-asserted-by":"crossref","unstructured":"Frank, H., Barteit, D., Kupzog, F.: Throwing or shooting-a new technology for logistic chains within production systems. In: 2008 IEEE International Conference on Technologies for Practical Robot Applications, pp. 62\u201367. IEEE (2008a)","DOI":"10.1109\/TEPRA.2008.4686674"},{"key":"3296_CR12","doi-asserted-by":"crossref","unstructured":"Frank, H., Barteit, D., Meyer, M., et al.: Optimized control methods for capturing flying objects with a cartesian robot. In: 2008 IEEE Conference on Robotics, Automation and Mechatronics, pp. 160\u2013165. IEEE (2008b)","DOI":"10.1109\/RAMECH.2008.4681368"},{"key":"3296_CR13","doi-asserted-by":"crossref","unstructured":"Gayanov, R., Mironov, K., Kurennov, D.: Estimating the trajectory of a thrown object from video signal with use of genetic programming. In: 2017 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), pp. 134\u2013138. IEEE (2017)","DOI":"10.1109\/ISSPIT.2017.8388630"},{"issue":"30","key":"3296_CR14","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1016\/j.ifacol.2018.11.271","volume":"51","author":"R Gayanov","year":"2018","unstructured":"Gayanov, R., Mironov, K., Mukhametshin, R., et al.: Transportation of small objects by robotic throwing and catching: applying genetic programming for trajectory estimation. IFAC-PapersOnLine 51(30), 533\u2013537 (2018)","journal-title":"IFAC-PapersOnLine"},{"key":"3296_CR15","unstructured":"Gomez\u00a0Gonzalez, S.: Real time probabilistic models for robot trajectories. PhD thesis, Technische Universitat Darmstadt (2019)"},{"issue":"4","key":"3296_CR16","doi-asserted-by":"publisher","first-page":"90","DOI":"10.3390\/robotics8040090","volume":"8","author":"S Gomez-Gonzalez","year":"2019","unstructured":"Gomez-Gonzalez, S., Nemmour, Y., Scholkopf, B., et al.: Reliable real-time ball tracking for robot table tennis. Robotics 8(4), 90 (2019)","journal-title":"Robotics"},{"issue":"2","key":"3296_CR17","doi-asserted-by":"publisher","first-page":"970","DOI":"10.1109\/LRA.2020.2966390","volume":"5","author":"S Gomez-Gonzalez","year":"2020","unstructured":"Gomez-Gonzalez, S., Prokudin, S., Scholkopf, B., et al.: Real time trajectory prediction using deep conditional generative models. IEEE Robot. Autom. Lett. 5(2), 970\u2013976 (2020)","journal-title":"IEEE Robot. Autom. Lett."},{"key":"3296_CR18","volume-title":"Multiple View Geometry in Computer Vision","author":"R Hartley","year":"2003","unstructured":"Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2003)"},{"key":"3296_CR19","unstructured":"IFR.: World robotics report by int. federation of robotics. https:\/\/ifr.org\/ifr-press-releases\/news\/wr-report-all-time-high-with-half-a-million-robots-installed, accessed: 2023-11-29 (2022)"},{"issue":"2","key":"3296_CR20","doi-asserted-by":"publisher","first-page":"333","DOI":"10.3390\/s20020333","volume":"20","author":"HI Lin","year":"2020","unstructured":"Lin, H.I., Yu, Z., Huang, Y.C.: Ball tracking and trajectory prediction for table-tennis robots. Sensors 20(2), 333 (2020)","journal-title":"Sensors"},{"key":"3296_CR21","unstructured":"Lin, X., Sun, S., Huang, W., et\u00a0al.: EAPT: efficient attention pyramid transformer for image processing. IEEE Trans. Multimed., 1\u201313 (2021)"},{"key":"3296_CR22","volume":"26","author":"PKR Maddikunta","year":"2022","unstructured":"Maddikunta, P.K.R., Pham, Q.V., Prabadevi, B., et al.: Industry 5.0: a survey on enabling technologies and potential applications. J. Ind. Inf. Integr. 26, 100257 (2022)","journal-title":"J. Ind. Inf. Integr."},{"issue":"1","key":"3296_CR23","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1080\/19346182.2008.9648446","volume":"1","author":"R Mehta","year":"2008","unstructured":"Mehta, R., Alam, F., Subic, A.: Review of tennis ball aerodynamics. Sports Technol. 1(1), 7\u201316 (2008)","journal-title":"Sports Technol."},{"key":"3296_CR24","doi-asserted-by":"crossref","unstructured":"Mironov, K.: Transport by robotic throwing and catching: Accurate stereo tracking of the spherical object. In: 2017 International Conference on Industrial Engineering, Applications and Manufacturing (ICIEAM), pp. 1\u20136. IEEE (2017)","DOI":"10.1109\/ICIEAM.2017.8076490"},{"key":"3296_CR25","unstructured":"Mironov, K., Pongratz, M.: Applying neural networks for prediction of flying objects trajectory. 17(6):33\u201337 (2013)"},{"key":"3296_CR26","doi-asserted-by":"crossref","unstructured":"Mironov, K., Pongratz, M.: Fast kNN-based prediction for the trajectory of a thrown body. In: 2016 24th Mediterranean Conference on Control and Automation (MED), pp. 512\u2013517. IEEE (2016)","DOI":"10.1109\/MED.2016.7536007"},{"issue":"11","key":"3296_CR27","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1016\/j.ifacol.2015.09.155","volume":"48","author":"K Mironov","year":"2015","unstructured":"Mironov, K., Vladimirova, I., Pongratz, M.: Processing and forecasting the trajectory of a thrown object measured by the stereo vision system. IFAC-PapersOnLine 48(11), 28\u201335 (2015)","journal-title":"IFAC-PapersOnLine"},{"key":"3296_CR28","doi-asserted-by":"crossref","unstructured":"Mironov, K., Gayanov, R., Kurennov, D.: Observing and forecasting the trajectory of the thrown body with use of genetic programming (2019)","DOI":"10.25046\/aj040124"},{"issue":"8","key":"3296_CR29","first-page":"3","volume":"7","author":"T Moller","year":"2005","unstructured":"Moller, T., Kraft, H., Frey, J., et al.: Robust 3D measurement with PMD sensors. Range Imaging Day Zurich 7(8), 3 (2005)","journal-title":"Range Imaging Day Zurich"},{"key":"3296_CR30","doi-asserted-by":"crossref","unstructured":"Nadeem, A., Rizwan, K., Mehmood, A., et\u00a0al.: A smart city application design for efficiently tracking missing person in large gatherings in Madinah using emerging IoT technologies. In: 2021 Mohammad Ali Jinnah University International Conference on Computing (MAJICC), pp. 1\u20137. IEEE (2021)","DOI":"10.1109\/MAJICC53071.2021.9526244"},{"key":"3296_CR31","doi-asserted-by":"crossref","unstructured":"Pongratz, M., Pollhammer, K., Szep, A.: Koros initiative: automatized throwing and catching for material transportation. In: International Symposium On Leveraging Applications of Formal Methods, Verification and Validation, pp. 136\u2013143. Springer (2011)","DOI":"10.1007\/978-3-642-34781-8_10"},{"issue":"6","key":"3296_CR32","doi-asserted-by":"publisher","first-page":"2113","DOI":"10.3390\/s22062113","volume":"22","author":"N Qadeer","year":"2022","unstructured":"Qadeer, N., Shah, J.H., Sharif, M., et al.: Intelligent tracking of mechanically thrown objects by industrial catching robot for automated in-plant logistics 4.0. Sensors 22(6), 2113 (2022)","journal-title":"Sensors"},{"issue":"3\u20134","key":"3296_CR33","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1002\/cav.1465","volume":"23","author":"Y Shen","year":"2012","unstructured":"Shen, Y., Lin, X., Gao, Y., et al.: Video composition by optimized 3D mean-value coordinates. Comput. Animat. Virtual Worlds 23(3\u20134), 179\u2013190 (2012)","journal-title":"Comput. Animat. Virtual Worlds"},{"key":"3296_CR34","doi-asserted-by":"crossref","unstructured":"Zhu, H., Sheng, B., Lin, X., et\u00a0al.: Foreground object sensing for saliency detection. In: Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval, pp. 111\u2013118 (2016)","DOI":"10.1145\/2911996.2912008"}],"container-title":["The Visual Computer"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-024-03296-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00371-024-03296-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-024-03296-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,12]],"date-time":"2024-11-12T09:21:16Z","timestamp":1731403276000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00371-024-03296-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,16]]},"references-count":34,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["3296"],"URL":"https:\/\/doi.org\/10.1007\/s00371-024-03296-4","relation":{},"ISSN":["0178-2789","1432-2315"],"issn-type":[{"value":"0178-2789","type":"print"},{"value":"1432-2315","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,16]]},"assertion":[{"value":"25 January 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 March 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}