{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T15:27:44Z","timestamp":1774884464063,"version":"3.50.1"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,2,3]],"date-time":"2024-02-03T00:00:00Z","timestamp":1706918400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,3]],"date-time":"2024-02-03T00:00:00Z","timestamp":1706918400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010686","name":"H2020 European Institute of Innovation and Technology","doi-asserted-by":"publisher","award":["101004085"],"award-info":[{"award-number":["101004085"]}],"id":[{"id":"10.13039\/100010686","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Intell Robot Syst"],"published-print":{"date-parts":[[2024,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Human-robot collaboration (HRC) is becoming increasingly important in advanced production systems, such as those used in industries and agriculture. This type of collaboration can contribute to productivity increase by reducing physical strain on humans, which can lead to reduced injuries and improved morale. One crucial aspect of HRC is the ability of the robot to follow a specific human operator safely. To address this challenge, a novel methodology is proposed that employs monocular vision and ultra-wideband (UWB) transceivers to determine the relative position of a human target with respect to the robot. UWB transceivers are capable of tracking humans with UWB transceivers but exhibit a significant angular error. To reduce this error, monocular cameras with Deep Learning object detection are used to detect humans. The reduction in angular error is achieved through sensor fusion, combining the outputs of both sensors using a histogram-based filter. This filter projects and intersects the measurements from both sources onto a 2D grid. By combining UWB and monocular vision, a remarkable 66.67% reduction in angular error compared to UWB localization alone is achieved. This approach demonstrates an average processing time of 0.0183s and an average localization error of 0.14 meters when tracking a person walking at an average speed of 0.21 m\/s. This novel algorithm holds promise for enabling efficient and safe human-robot collaboration, providing a valuable contribution to the field of robotics.<\/jats:p>","DOI":"10.1007\/s10846-023-02037-4","type":"journal-article","created":{"date-parts":[[2024,2,3]],"date-time":"2024-02-03T10:02:05Z","timestamp":1706954525000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Fusion of Time-of-Flight Based Sensors with Monocular Cameras for a Robotic Person Follower"],"prefix":"10.1007","volume":"110","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4332-9645","authenticated-orcid":false,"given":"Jos\u00e9","family":"Sarmento","sequence":"first","affiliation":[]},{"given":"Filipe","family":"Neves\u00a0dos\u00a0Santos","sequence":"additional","affiliation":[]},{"given":"Andr\u00e9","family":"Silva\u00a0Aguiar","sequence":"additional","affiliation":[]},{"given":"V\u00edtor","family":"Filipe","sequence":"additional","affiliation":[]},{"given":"Ant\u00f3nio","family":"Valente","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,2,3]]},"reference":[{"issue":"2","key":"2037_CR1","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1109\/MRA.2010.936953","volume":"17","author":"RR Murphy","year":"2010","unstructured":"Murphy, R.R., Nomura, T., Billard, A., Burke, J.L.: Human-robot interaction. IEEE Robot. Autom. Mag. 17(2), 85\u201389 (2010). https:\/\/doi.org\/10.1109\/MRA.2010.936953","journal-title":"IEEE Robot. Autom. Mag."},{"key":"2037_CR2","doi-asserted-by":"publisher","unstructured":"Kosuge, K., Hirata, Y.: Human-robot interaction. In: 2004 IEEE International Conference on Robotics and Biomimetics, pp. 8\u201311 (2004). https:\/\/doi.org\/10.1109\/ROBIO.2004.1521743","DOI":"10.1109\/ROBIO.2004.1521743"},{"issue":"14","key":"2037_CR3","doi-asserted-by":"publisher","first-page":"1581","DOI":"10.1177\/0278364919881683","volume":"38","author":"MJ Islam","year":"2019","unstructured":"Islam, M.J., Hong, J., Sattar, J.: Person-following by autonomous robots: A categorical overview. Int J Robot Res 38(14), 1581\u20131618 (2019). https:\/\/doi.org\/10.1177\/0278364919881683","journal-title":"Int J Robot Res"},{"key":"2037_CR4","doi-asserted-by":"publisher","first-page":"300","DOI":"10.1007\/978-3-319-68345-4_27","volume-title":"Computer Vision Systems","author":"BX Chen","year":"2017","unstructured":"Chen, B.X., Sahdev, R., Tsotsos, J.K.: Integrating stereo vision with a cnn tracker for a person-following robot. In: Liu, M., Chen, H., Vincze, M. (eds.) Computer Vision Systems, pp. 300\u2013313. Springer, Cham (2017)"},{"key":"2037_CR5","doi-asserted-by":"publisher","unstructured":"Sarmento, J., Aguiar, A.S., Santos, F.N.d., Sousa, A.J.: Robot navigation in vineyards based on the visual vanish point concept. In: 2021 International Symposium of Asian Control Association on Intelligent Robotics and Industrial Automation (IRIA), pp. 406\u2013413 (2021). https:\/\/doi.org\/10.1109\/IRIA53009.2021.9588722","DOI":"10.1109\/IRIA53009.2021.9588722"},{"key":"2037_CR6","doi-asserted-by":"crossref","unstructured":"Aguiar, A.S., dos Santos, F.N., Cunha, J.B., Sobreira, H., Sousa, A.J.: Localization and mapping for robots in agriculture and forestry: A survey. Robotics 9(4) (2020)","DOI":"10.3390\/robotics9040097"},{"key":"2037_CR7","doi-asserted-by":"publisher","unstructured":"Deremetz, M., Lenain, R., Laneurit, J., Debain, C., Peynot, T.: Autonomous human tracking using uwb sensors for mobile robots: An observer-based approach to follow the human path. In: 2020 IEEE Conference on Control Technology and Applications (CCTA), pp. 372\u2013379 (2020). https:\/\/doi.org\/10.1109\/CCTA41146.2020.9206153","DOI":"10.1109\/CCTA41146.2020.9206153"},{"key":"2037_CR8","doi-asserted-by":"publisher","unstructured":"Conejero, M.N., Montes, H., Andujar, D., Bengochea-Guevara, J.M., Ribeiro, A.: Collaborative Harvest Robot. Lecture Notes in Networks and Systems 590 LNNS, 415\u2013426 (2023). https:\/\/doi.org\/10.1007\/978-3-031-21062-4_34","DOI":"10.1007\/978-3-031-21062-4_34"},{"key":"2037_CR9","doi-asserted-by":"publisher","unstructured":"Sarmento, J., Santos, F.N.D., Aguiar, A.S., Sobreira, H., Regueiro, C.V., Valente, A.: FollowMe - A Pedestrian Following Algorithm for Agricultural Logistic Robots, pp. 179\u2013185 (2022). https:\/\/doi.org\/10.1109\/ICARSC55462.2022.9784791. Cited by: 0. https:\/\/www.scopus.com\/inward\/record.uri?eid=2-s2.0-85132993872 &doi=10.1109%2fICARSC55462.2022.9784791 &partnerID=40 &md5=7bab52d61c081d0e5b4368e5454cbe42","DOI":"10.1109\/ICARSC55462.2022.9784791"},{"key":"2037_CR10","doi-asserted-by":"publisher","first-page":"104075","DOI":"10.1016\/j.robot.2022.104075","volume":"153","author":"J Montesdeoca","year":"2022","unstructured":"Montesdeoca, J., Toibero, J.M., Jordan, J., Zell, A., Carelli, R.: Person-following controller with socially acceptable robot motion. Robotics and Autonomous Systems 153, 104075 (2022). https:\/\/doi.org\/10.1016\/j.robot.2022.104075","journal-title":"Robotics and Autonomous Systems"},{"key":"2037_CR11","doi-asserted-by":"publisher","first-page":"2680","DOI":"10.1109\/ACCESS.2020.3046730","volume":"9","author":"R Zhang","year":"2021","unstructured":"Zhang, R., Zhang, Y., Zhang, X.: Tracking in-cabin astronauts using deep learning and head motion clues. IEEE Access 9, 2680\u20132693 (2021). https:\/\/doi.org\/10.1109\/ACCESS.2020.3046730","journal-title":"IEEE Access"},{"key":"2037_CR12","doi-asserted-by":"publisher","unstructured":"Algabri, R., Choi, M.T.: Target recovery for robust deep learning-based person following in mobile robots: Online trajectory prediction. Applied Sciences (Switzerland) 11 (2021). https:\/\/doi.org\/10.3390\/app11094165","DOI":"10.3390\/app11094165"},{"key":"2037_CR13","doi-asserted-by":"publisher","unstructured":"Guffanti, D., Brunete, A., Hernando, M., Rueda, J., Navarro, E.: Robogait: A mobile robotic platform for human gait analysis in clinical environments. Sensors 21 (2021). https:\/\/doi.org\/10.3390\/s21206786","DOI":"10.3390\/s21206786"},{"key":"2037_CR14","doi-asserted-by":"publisher","first-page":"1997","DOI":"10.1109\/TMECH.2021.3083594","volume":"26","author":"Z Zhang","year":"2021","unstructured":"Zhang, Z., Yan, J., Kong, X., Zhai, G., Liu, Y.: Efficient motion planning based on kinodynamic model for quadruped robots following persons in confined spaces. IEEE\/ASME Transactions on Mechatronics 26, 1997\u20132006 (2021). https:\/\/doi.org\/10.1109\/TMECH.2021.3083594","journal-title":"IEEE\/ASME Transactions on Mechatronics"},{"key":"2037_CR15","doi-asserted-by":"publisher","first-page":"1299","DOI":"10.1007\/s12541-020-00343-7","volume":"21","author":"D Cha","year":"2020","unstructured":"Cha, D., Chung, W.: Human-leg detection in 3d feature space for a person-following mobile robot using 2d lidars. International Journal of Precision Engineering and Manufacturing 21, 1299\u20131307 (2020). https:\/\/doi.org\/10.1007\/s12541-020-00343-7","journal-title":"International Journal of Precision Engineering and Manufacturing"},{"key":"2037_CR16","doi-asserted-by":"crossref","unstructured":"Chen, X., Liu, J., Wu, J., Wang, C., Song, R.: LoPF : An Online LiDAR-Only Person-Following Framework 71 (2022)","DOI":"10.1109\/TIM.2022.3212521"},{"issue":"2","key":"2037_CR17","doi-asserted-by":"publisher","first-page":"1344","DOI":"10.1109\/TAP.2021.3111308","volume":"70","author":"R Bharadwaj","year":"2022","unstructured":"Bharadwaj, R., Alomainy, A., Koul, S.K.: Experimental Investigation of Body-Centric Indoor Localization Using Compact Wearable Antennas and Machine Learning Algorithms. IEEE Transactions on Antennas and Propagation 70(2), 1344\u20131354 (2022). https:\/\/doi.org\/10.1109\/TAP.2021.3111308","journal-title":"IEEE Transactions on Antennas and Propagation"},{"issue":"23","key":"2037_CR18","doi-asserted-by":"publisher","first-page":"11449","DOI":"10.1109\/JSEN.2019.2935634","volume":"19","author":"T Otim","year":"2019","unstructured":"Otim, T., Bahillo, A., Diez, L.E., Lopez-Iturri, P., Falcone, F.: Impact of Body Wearable Sensor Positions on UWB Ranging. IEEE Sensors Journal 19(23), 11449\u201311457 (2019). https:\/\/doi.org\/10.1109\/JSEN.2019.2935634","journal-title":"IEEE Sensors Journal"},{"issue":"4","key":"2037_CR19","doi-asserted-by":"publisher","first-page":"480","DOI":"10.1007\/s10776-022-00577-4","volume":"29","author":"Z Su","year":"2022","unstructured":"Su, Z., Pahlavan, K., Agu, E., Wei, H.: Proximity Detection During Epidemics: Direct UWB TOA Versus Machine Learning Based RSSI. International Journal of Wireless Information Networks 29(4), 480\u2013490 (2022). https:\/\/doi.org\/10.1007\/s10776-022-00577-4","journal-title":"International Journal of Wireless Information Networks"},{"key":"2037_CR20","doi-asserted-by":"publisher","unstructured":"Guler, S., Jiang, J., Alghamdi, A.A., Masoud, R.I., Shamma, J.S.: Real Time Onboard Ultrawideband Localization Scheme for an Autonomous Two-robot System. 2018 IEEE Conference on Control Technology and Applications, CCTA 2018, 1151\u20131158 (2018). https:\/\/doi.org\/10.1109\/CCTA.2018.8511568","DOI":"10.1109\/CCTA.2018.8511568"},{"key":"2037_CR21","doi-asserted-by":"crossref","unstructured":"Hepp, B., Tobias, N.: Omni-directional person tracking on a flying robot using occlusion-robust ultra-wideband signals (2016)","DOI":"10.1109\/IROS.2016.7759054"},{"key":"2037_CR22","doi-asserted-by":"publisher","unstructured":"Qiu, R., Xu, M., Yan, Y., Smith, J.S.: A methodology review on multi-view pedestrian detection. Studies in Big Data 106, 317\u2013339 (2022). Cited by: 2. https:\/\/doi.org\/10.1007\/978-3-030-95239-6_12","DOI":"10.1007\/978-3-030-95239-6_12"},{"key":"2037_CR23","doi-asserted-by":"publisher","unstructured":"Shen, L., Tao, H., Ni, Y., Wang, Y., Stojanovic, V.: Improved yolov3 model with feature map cropping for multi-scale road object detection. Measurement Science and Technology 34(4), 045406 (2023). https:\/\/doi.org\/10.1088\/1361-6501\/acb075","DOI":"10.1088\/1361-6501\/acb075"},{"issue":"3","key":"2037_CR24","doi-asserted-by":"publisher","DOI":"10.1016\/j.birob.2022.100058","volume":"2","author":"J Liu","year":"2022","unstructured":"Liu, J., Chen, X., Wang, C., Zhang, G., Song, R.: A person-following method based on monocular camera for quadruped robots. Biomimetic Intelligence and Robotics 2(3), 100058 (2022). https:\/\/doi.org\/10.1016\/j.birob.2022.100058","journal-title":"Biomimetic Intelligence and Robotics"},{"key":"2037_CR25","doi-asserted-by":"publisher","unstructured":"Jin, D., Fang, Z., Zeng, J.: A robust autonomous following method for mobile robots in dynamic environments. IEEE Access 8, 150311\u2013150325 (2020). https:\/\/doi.org\/10.1109\/ACCESS.2020.3016472","DOI":"10.1109\/ACCESS.2020.3016472"},{"key":"2037_CR26","doi-asserted-by":"publisher","unstructured":"Liu, F., Zhang, J., Wang, J., Han, H., Yang, D.: An uwb\/vision fusion scheme for determining pedestrians indoor location. Sensors (Switzerland) 20 (2020). https:\/\/doi.org\/10.3390\/s20041139","DOI":"10.3390\/s20041139"},{"key":"2037_CR27","doi-asserted-by":"crossref","unstructured":"Luchetti, A., Carollo, A., Santoro, L., Nardello, M., Brunelli, D., Bosetti, P., Cecco, M.D., Montanini, R.: Acta imeko human identification and tracking using ultra-wideband-vision data fusion in unstructured environments 10 (2021)","DOI":"10.21014\/acta_imeko.v10i4.1139"},{"key":"2037_CR28","doi-asserted-by":"publisher","unstructured":"Furgale, P., Rehder, J., Siegwart, R.: Unified temporal and spatial calibration for multi-sensor systems. In: 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, pp. 1280\u20131286 (2013). https:\/\/doi.org\/10.1109\/IROS.2013.6696514","DOI":"10.1109\/IROS.2013.6696514"},{"key":"2037_CR29","doi-asserted-by":"publisher","unstructured":"Rehder, J., Nikolic, J., Schneider, T., Hinzmann, T., Siegwart, R.: Extending kalibr: Calibrating the extrinsics of multiple imus and of individual axes. In: 2016 IEEE International Conference on Robotics and Automation (ICRA), pp. 4304\u20134311 (2016). https:\/\/doi.org\/10.1109\/ICRA.2016.7487628","DOI":"10.1109\/ICRA.2016.7487628"},{"key":"2037_CR30","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., Chen, L.-C.: MobileNetV2: Inverted Residuals and Linear Bottlenecks (2019)","DOI":"10.1109\/CVPR.2018.00474"},{"key":"2037_CR31","doi-asserted-by":"publisher","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., Berg, A.C.: SSD: Single shot MultiBox detector. In: Computer Vision \u2013 ECCV 2016, pp. 21\u201337. Springer, ??? (2016). https:\/\/doi.org\/10.1007\/978-3-319-46448-0_2","DOI":"10.1007\/978-3-319-46448-0_2"}],"container-title":["Journal of Intelligent &amp; Robotic Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-023-02037-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10846-023-02037-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-023-02037-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,1]],"date-time":"2024-04-01T02:20:44Z","timestamp":1711938044000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10846-023-02037-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,3]]},"references-count":31,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,3]]}},"alternative-id":["2037"],"URL":"https:\/\/doi.org\/10.1007\/s10846-023-02037-4","relation":{},"ISSN":["0921-0296","1573-0409"],"issn-type":[{"value":"0921-0296","type":"print"},{"value":"1573-0409","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,3]]},"assertion":[{"value":"12 April 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 December 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 February 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"Not applicable","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Not applicable","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}],"article-number":"30"}}