{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T06:57:40Z","timestamp":1776927460864,"version":"3.51.2"},"reference-count":41,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2020,5,9]],"date-time":"2020-05-09T00:00:00Z","timestamp":1588982400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Trade, Industry &amp; Energy (MOTIE,Korea)","award":["2000376"],"award-info":[{"award-number":["2000376"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Human following is one of the fundamental functions in human\u2013robot interaction for mobile robots. This paper shows a novel framework with state-machine control in which the robot tracks the target person in occlusion and illumination changes, as well as navigates with obstacle avoidance while following the target to the destination. People are detected and tracked using a deep learning algorithm, called Single Shot MultiBox Detector, and the target person is identified by extracting the color feature using the hue-saturation-value histogram. The robot follows the target safely to the destination using a simultaneous localization and mapping algorithm with the LIDAR sensor for obstacle avoidance. We performed intensive experiments on our human following approach in an indoor environment with multiple people and moderate illumination changes. Experimental results indicated that the robot followed the target well to the destination, showing the effectiveness and practicability of our proposed system in the given environment.<\/jats:p>","DOI":"10.3390\/s20092699","type":"journal-article","created":{"date-parts":[[2020,5,11]],"date-time":"2020-05-11T12:26:30Z","timestamp":1589199990000},"page":"2699","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":70,"title":["Deep-Learning-Based Indoor Human Following of Mobile Robot Using Color Feature"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6151-5935","authenticated-orcid":false,"given":"Redhwan","family":"Algabri","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, Sungkyunkwan University, Suwon 16419, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5025-8785","authenticated-orcid":false,"given":"Mun-Taek","family":"Choi","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Sungkyunkwan University, Suwon 16419, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2020,5,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Triebel, R., Arras, K., Alami, R., Beyer, L., Breuers, S., Chatila, R., Chetouani, M., Cremers, D., Evers, V., and Fiore, M. (2016). Spencer: A Socially Aware Service Robot for Passenger Guidance and Help in Busy Airports, Springer. Field and Service Robotics.","DOI":"10.1007\/978-3-319-27702-8_40"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1994","DOI":"10.1016\/j.procs.2017.08.125","article-title":"A mobile robot for following, watching and detecting falls for elderly care","volume":"112","author":"Tomoya","year":"2017","journal-title":"Procedia Comput. Sci."},{"key":"ref_3","unstructured":"Janai, J., G\u00fcney, F., Behl, A., and Geiger, A. (2017). Computer vision for autonomous vehicles: Problems, datasets and state-of-the-art. arXiv."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1016\/j.eswa.2017.09.029","article-title":"Abnormal behavior recognition for intelligent video surveillance systems: A review","volume":"91","author":"Mabrouk","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.cviu.2017.04.011","article-title":"Computer vision for sports: Current applications and research topics","volume":"159","author":"Thomas","year":"2017","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1177\/0278364914557874","article-title":"Robot navigation in dense human crowds: Statistical models and experimental studies of human\u2013robot cooperation","volume":"34","author":"Trautman","year":"2015","journal-title":"Int. J. Robot. Res."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Schlegel, C., Illmann, J., Jaberg, H., Schuster, M., and W\u00f6rz, R. (1998). Vision Based Person Tracking with a Mobile Robot, BMVC.","DOI":"10.5244\/C.12.42"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"An, N., Sun, S.Y., Zhao, X.G., and Hou, Z.G. (2017, January 12\u201315). Online context-based person re-identification and biometric-based action recognition for service robots. Proceedings of the 2017 29th Chinese Control And Decision Conference (CCDC), Istanbul, Turkey.","DOI":"10.1109\/CCDC.2017.7979088"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1109\/TSMCB.2008.2004050","article-title":"Multisensor-based human detection and tracking for mobile service robots","volume":"39","author":"Bellotto","year":"2008","journal-title":"IEEE Trans. Syst. Man Cybern. Part B"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1007\/s10846-018-0890-9","article-title":"Robot-Assisted ADHD Screening in Diagnostic Process","volume":"95","author":"Choi","year":"2019","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1007\/s41315-019-00113-3","article-title":"Object detection based on color and shape features for service robot in semi-structured indoor environment","volume":"3","author":"Li","year":"2019","journal-title":"Int. J. Intell. Robot. Appl."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ren, Q., Zhao, Q., Qi, H., and Li, L. (2016, January 27\u201329). Real-time target tracking system for person-following robot. Proceedings of the 2016 35th Chinese Control Conference (CCC), Chengdu, China.","DOI":"10.1109\/ChiCC.2016.7554324"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.1109\/TSMC.2016.2616343","article-title":"A novel vision-based tracking algorithm for a human-following mobile robot","volume":"47","author":"Gupta","year":"2016","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1007\/s10514-016-9552-6","article-title":"ROREAS: robot coach for walking and orientation training in clinical post-stroke rehabilitation\u2014Prototype implementation and evaluation in field experiments","volume":"41","author":"Gross","year":"2017","journal-title":"Auton. Robot."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Oishi, S., Kohari, Y., and Miura, J. (2016, January 26\u201331). Toward a robotic attendant adaptively behaving according to human state. Proceedings of the 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), New York, NY, USA.","DOI":"10.1109\/ROMAN.2016.7745236"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1007\/s10514-016-9584-y","article-title":"Robot social-aware navigation framework to accompany people walking side-by-side","volume":"41","author":"Ferrer","year":"2017","journal-title":"Auton. Robot."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.robot.2016.07.004","article-title":"Identification of a specific person using color, height, and gait features for a person following robot","volume":"84","author":"Koide","year":"2016","journal-title":"Robot. Auton. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.neucom.2018.01.092","article-title":"Computer vision and deep learning techniques for pedestrian detection and tracking: A survey","volume":"300","author":"Brunetti","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhao, Z.Q., Zheng, P., Xu, S.T., and Wu, X. (2019). Object detection with deep learning: A review. IEEE Trans. Neural Netw. Learn. Syst.","DOI":"10.1109\/TNNLS.2018.2876865"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.autcon.2018.01.009","article-title":"SLAM-driven robotic mapping and registration of 3D point clouds","volume":"89","author":"Kim","year":"2018","journal-title":"Autom. Constr."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Abdelwhab, A., and Viriri, S. (2018). A survey on soft biometrics for human identification. Mach. Learn. Biom.","DOI":"10.5772\/intechopen.76021"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., and Cousins, S. (2011, January 9\u201313). 3d is here: Point cloud library (pcl). Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980567"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Balsa-Comer\u00f3n, J., Guerrero-Higueras, \u00c1.M., Rodr\u00edguez-Lera, F.J., Fern\u00e1ndez-Llamas, C., and Matell\u00e1n-Olivera, V. (2017). Cybersecurity in Autonomous Systems: Hardening ROS Using Encrypted Communications and Semantic Rules, Springer. Iberian Robotics Conference.","DOI":"10.1007\/978-3-319-70836-2_6"},{"key":"ref_24","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (July, January 26). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_25","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7\u201312). Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016). Ssd: Single Shot Multibox Detector, Springer. European Conference on Computer Vision.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_27","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1007\/s10514-014-9385-0","article-title":"Fast RGB-D people tracking for service robots","volume":"37","author":"Munaro","year":"2014","journal-title":"Auton. Robot."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Lowe, D.G. (1999). Object Recognition From Local Scale-Invariant Features, ICCV.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1007\/s11633-013-0740-y","article-title":"Visual person identification using a distance-dependent appearance model for a person following robot","volume":"10","author":"Satake","year":"2013","journal-title":"Int. J. Autom. Comput."},{"key":"ref_31","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Cheng, X., Jia, Y., Su, J., and Wu, Y. (2019, January 3\u20138). Person-following for Telepresence Robots Using Web Cameras. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.","DOI":"10.1109\/IROS40897.2019.8967645"},{"key":"ref_33","first-page":"1","article-title":"Review on region of interest coding techniques for medical image compression","volume":"134","author":"Jangbari","year":"2016","journal-title":"Int. J. Comput. Appl."},{"key":"ref_34","unstructured":"Kim, M., Arduengo, M., Walker, N., Jiang, Y., Hart, J.W., Stone, P., and Sentis, L. (2018). An architecture for person-following using active target search. arXiv."},{"key":"ref_35","unstructured":"Zisserman, R.H.A. (2004). Multiple View Geometry in Computer Vision, Cambridge University Press."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1177\/0278364911434148","article-title":"RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments","volume":"31","author":"Henry","year":"2012","journal-title":"Int. J. Rob. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1364\/AOP.3.000128","article-title":"Structured-light 3D surface imaging: A tutorial","volume":"3","author":"Geng","year":"2011","journal-title":"Adv. Opt. Photonics"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Foote, T. (2013, January 22\u201323). tf: The transform library. Proceedings of the 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA), Woburn, MA, USA.","DOI":"10.1109\/TePRA.2013.6556373"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/TRO.2006.889486","article-title":"Improved techniques for grid mapping with rao-blackwellized particle filters","volume":"23","author":"Grisetti","year":"2007","journal-title":"IEEE Trans. Robot."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"O\u2019Dwyer, A. (2009). Handbook of PI and PID Controller Tuning Rules, Imperial College Press.","DOI":"10.1142\/9781848162433"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Lee, B.J., Choi, J., Baek, C., and Zhang, B.T. (2018, January 21\u201325). Robust Human Following by Deep Bayesian Trajectory Prediction for Home Service Robots. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8462969"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/9\/2699\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:27:08Z","timestamp":1760174828000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/9\/2699"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,9]]},"references-count":41,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2020,5]]}},"alternative-id":["s20092699"],"URL":"https:\/\/doi.org\/10.3390\/s20092699","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,5,9]]}}}