{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T17:19:14Z","timestamp":1770225554486,"version":"3.49.0"},"reference-count":43,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2020,6,23]],"date-time":"2020-06-23T00:00:00Z","timestamp":1592870400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Robotics Programme under its Robotics Enabling Capabilities and Technologies","award":["RGAST1910"],"award-info":[{"award-number":["RGAST1910"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The role of mobile robots for cleaning and sanitation purposes is increasing worldwide. Disinfection and hygiene are two integral parts of any safe indoor environment, and these factors become more critical in COVID-19-like pandemic situations. Door handles are highly sensitive contact points that are prone to be contamination. Automation of the door-handle cleaning task is not only important for ensuring safety, but also to improve efficiency. This work proposes an AI-enabled framework for automating cleaning tasks through a Human Support Robot (HSR). The overall cleaning process involves mobile base motion, door-handle detection, and control of the HSR manipulator for the completion of the cleaning tasks. The detection part exploits a deep-learning technique to classify the image space, and provides a set of coordinates for the robot. The cooperative control between the spraying and wiping is developed in the Robotic Operating System. The control module uses the information obtained from the detection module to generate a task\/operational space for the robot, along with evaluating the desired position to actuate the manipulators. The complete strategy is validated through numerical simulations, and experiments on a Toyota HSR platform.<\/jats:p>","DOI":"10.3390\/s20123543","type":"journal-article","created":{"date-parts":[[2020,6,23]],"date-time":"2020-06-23T09:05:33Z","timestamp":1592903133000},"page":"3543","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":70,"title":["A Human Support Robot for the Cleaning and Maintenance of Door Handles Using a Deep-Learning Framework"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3243-9814","authenticated-orcid":false,"given":"Balakrishnan","family":"Ramalingam","sequence":"first","affiliation":[{"name":"Engineering Product Development Pillar, Singapore University of Technology and Design (SUTD), Singapore 487372, Singapore"}]},{"given":"Jia","family":"Yin","sequence":"additional","affiliation":[{"name":"Engineering Product Development Pillar, Singapore University of Technology and Design (SUTD), Singapore 487372, Singapore"}]},{"given":"Mohan","family":"Rajesh Elara","sequence":"additional","affiliation":[{"name":"Engineering Product Development Pillar, Singapore University of Technology and Design (SUTD), Singapore 487372, Singapore"}]},{"given":"Yokhesh Krishnasamy","family":"Tamilselvam","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, University of Western Ontario, London, ON N6A 3K7, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4339-4444","authenticated-orcid":false,"given":"Madan","family":"Mohan Rayguru","sequence":"additional","affiliation":[{"name":"Engineering Product Development Pillar, Singapore University of Technology and Design (SUTD), Singapore 487372, Singapore"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3598-5570","authenticated-orcid":false,"given":"M. A. Viraj J.","family":"Muthugala","sequence":"additional","affiliation":[{"name":"Engineering Product Development Pillar, Singapore University of Technology and Design (SUTD), Singapore 487372, Singapore"}]},{"given":"Braulio","family":"F\u00e9lix G\u00f3mez","sequence":"additional","affiliation":[{"name":"Engineering Product Development Pillar, Singapore University of Technology and Design (SUTD), Singapore 487372, Singapore"}]}],"member":"1968","published-online":{"date-parts":[[2020,6,23]]},"reference":[{"key":"ref_1","unstructured":"(2020, May 07). Stop Touching Your Face!. Available online: https:\/\/www.nytimes.com\/2020\/03\/02\/well\/live\/coronavirus-spread-transmission-face-touching-hands.html."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1480085","DOI":"10.1080\/16549716.2018.1480085","article-title":"An invisible workforce: The neglected role of cleaners in patient safety on maternity units","volume":"12","author":"Cross","year":"2019","journal-title":"Glob. Health Action"},{"key":"ref_3","unstructured":"(2020, March 02). Medical Supplies Delivery Robots. Available online: https:\/\/arstechnica.com\/tech-policy\/2020\/04\/delivery-robots-move-medical-supplies-to-help-with-covid-19-response\/."},{"key":"ref_4","unstructured":"(2020, March 02). Food Delivery Robots. Available online: https:\/\/www.unido.org\/stories\/china-robot-delivery-vehicles-deployed-help-covid-19-emergency."},{"key":"ref_5","unstructured":"(2020, March 02). UVD Robots. Available online: https:\/\/spectrum.ieee.org\/automaton\/robotics\/medical-robots\/autonomous-robots-are-helping-kill-coronavirus-in-hospitals."},{"key":"ref_6","unstructured":"King, C.H., Chen, T.L., Jain, A., and Kemp, C.C. (2010, January 18\u201322). Towards an assistive robot that autonomously performs bed baths for patient hygiene. Proceedings of the 2010 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan."},{"key":"ref_7","unstructured":"Cepolina, F.E., and Muscolo, G.G. (2014, January 2\u20133). Design of a robot for hygienization of walls in hospital environments. Proceedings of the ISR\/Robotik 2014, 41st International Symposium on Robotics, Munich, Germany."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.autcon.2018.03.015","article-title":"Floor cleaning robot with reconfigurable mechanism","volume":"91","author":"Prabakaran","year":"2018","journal-title":"Autom. Constr."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2018\/3035128","article-title":"Vision-Based Dirt Detection and Adaptive Tiling Scheme for Selective Area Coverage","volume":"2018","author":"Ramalingam","year":"2018","journal-title":"J. Sens."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wang, K., and Huang, C. (2018, January 28\u201330). Intelligent Robotic Lawn Mower Design. Proceedings of the 2018 International Conference on System Science and Engineering (ICSSE), New Taipei, Taiwan.","DOI":"10.1109\/ICSSE.2018.8520053"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Hayat, A.A., Parween, R., Elara, M.R., Parsuraman, K., and Kandasamy, P.S. (2019, January 20\u201324). Panthera: Design of a reconfigurable pavement sweeping robot. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794268"},{"key":"ref_12","unstructured":"Fu-Cai, Y., Shi-jian, H., Hai-liang, S., and Li-Zhu, W. (2011, January 8\u201311). Design of cleaning robot for swimming pools. Proceedings of the MSIE 2011, Harbin, China."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yin, J., Apuroop, K.G.S., Tamilselvam, Y.K., Mohan, R.E., Ramalingam, B., and Le, A.V. (2020). Table Cleaning Task by Human Support Robot Using Deep Learning Technique. Sensors, 20.","DOI":"10.3390\/s20061698"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"102959","DOI":"10.1016\/j.autcon.2019.102959","article-title":"Self-reconfigurable fa\u00e7ade-cleaning robot equipped with deep-learning-based crack detection based on convolutional neural networks","volume":"108","author":"Kouzehgar","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Muthugala, M.A.V.J., Vega-Heredia, M., Mohan, R.E., and Vishaal, S.R. (2020). Design and Control of a Wall Cleaning Robot with Adhesion-Awareness. Symmetry, 12.","DOI":"10.3390\/sym12010122"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1016\/j.autcon.2019.01.025","article-title":"Design and modelling of a modular window cleaning robot","volume":"103","author":"Mohan","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Chitta, S., Cohen, B., and Likhachev, M. (2012, January 3\u20137). Planning for autonomous door opening with a mobile manipulator. Proceedings of the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA.","DOI":"10.1109\/ROBOT.2010.5509475"},{"key":"ref_18","first-page":"3047","article-title":"Door-Detection Using Computer Vision and Fuzzy Logic","volume":"91","author":"Mu","year":"2004","journal-title":"WSEAS Trans. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Miesenberger, K., Klaus, J., Zagler, W., and Karshmer, A. (2010). Computer Vision-Based Door Detection for Accessibility of Unfamiliar Environments to Blind Persons. Computers Helping People with Special Needs, Springer.","DOI":"10.1007\/978-3-642-14097-6"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2016\/3754918","article-title":"Real-Time Obstacle Detection System in Indoor Environment for the Visually Impaired Using Microsoft Kinect Sensor","volume":"2016","author":"Pham","year":"2016","journal-title":"J. Sens."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Jiang, G., Xu, G., Wu, X., and Krundel, L. (2014, January 25\u201329). Kinect depth image based door detection for autonomous indoor navigation. Proceedings of the 23rd IEEE International Symposium on Robot and Human Interactive Communication, Edinburgh, UK.","DOI":"10.1109\/ROMAN.2014.6926245"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s10846-013-9984-6","article-title":"A Real-time Door Detection System for Domestic Robotic Navigation","volume":"76","author":"Moreno","year":"2014","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhang, W.J., Yang, G., Lin, Y., Ji, C., and Gupta, M.M. (2018, January 3\u20136). On Definition of Deep Learning. Proceedings of the 2018 World Automation Congress (WAC), Stevenson, WA, USA.","DOI":"10.23919\/WAC.2018.8430387"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Caldera, S., Rassau, A., and Chai, D. (2018). Review of Deep Learning Methods in Robotic Grasp Detection. Multimodal Technol. Interact., 2.","DOI":"10.20944\/preprints201805.0484.v1"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.eng.2018.11.030","article-title":"Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring","volume":"5","author":"Spencer","year":"2019","journal-title":"Engineering"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ramalingam, B., Lakshmanan, A.K., Ilyas, M., Le, A.V., and Elara, M.R. (2018). Cascaded Machine-Learning Technique for Debris Classification in Floor-Cleaning Robot Application. Appl. Sci., 8.","DOI":"10.3390\/app8122649"},{"key":"ref_27","unstructured":"Sapp, B., and Zhang, J.J. (2020, June 21). Door Handle Detection for the Stanford AI Robot (STAIR). Available online: http:\/\/cs229.stanford.edu\/proj2005\/SappZhang-DoorHandleDetectionForSTAIR.pdf."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Chen, W., Qu, T., Zhou, Y., Weng, K., Wang, G., and Fu, G. (2014, January 5\u201310). Door recognition and deep learning algorithm for visual based robot navigation. Proceedings of the 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014), Bali, Indonesia.","DOI":"10.1109\/ROBIO.2014.7090595"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Llopart, A., Ravn, O., and Andersen, N.A. (2017, January 22\u201324). Door and cabinet recognition using Convolutional Neural Nets and real-time method fusion for handle detection and grasping. Proceedings of the 2017 3rd International Conference on Control, Automation and Robotics (ICCAR), Nagoya, Japan.","DOI":"10.1109\/ICCAR.2017.7942676"},{"key":"ref_30","unstructured":"Nagatani, K., and Yuta, S. (1996, January 22\u201328). Designing strategy and implementation of mobile manipulator control system for opening door. Proceedings of the IEEE International Conference on Robotics and Automation, Minneapolis, MN, USA."},{"key":"ref_31","unstructured":"Takahama, T., Nagatani, K., and Tanaka, Y. (May, January 26). Motion planning for dual-arm mobile manipulator-realization of \u201ctidying a room motion\u201d. Proceedings of the IEEE International Conference on Robotics and Automation, ICRA\u201904, New Orleans, LA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Yi, J.B., and Yi, S.J. (2019, January 24\u201327). Mobile Manipulation for the HSR Intelligent Home Service Robot. Proceedings of the 2019 16th International Conference on Ubiquitous Robots (UR), Jeju, Korea.","DOI":"10.1109\/URAI.2019.8768782"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Berenstein, R., Fox, R., McKinley, S., Carpin, S., and Goldberg, K. (2018, January 21\u201325). Robustly adjusting indoor drip irrigation emitters with the toyota hsr robot. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.","DOI":"10.1109\/ICRA.2018.8460969"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Naranjo-Torres, J., Mora, M., Hern\u00e1ndez-Garc\u00eda, R., Barrientos, R.J., Fredes, C., and Valenzuela, A. (2020). A Review of Convolutional Neural Network Applied to Fruit Image Processing. Appl. Sci., 10.","DOI":"10.3390\/app10103443"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Almabdy, S., and Elrefaei, L. (2019). Deep Convolutional Neural Network-Based Approaches for Face Recognition. Appl. Sci., 9.","DOI":"10.3390\/app9204397"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Elhassouny, A., and Smarandache, F. (2019, January 22\u201324). Trends in deep convolutional neural Networks architectures: A review. Proceedings of the 2019 International Conference of Computer Science and Renewable Energies (ICCSRE), Agadir, Morocco.","DOI":"10.1109\/ICCSRE.2019.8807741"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Katkar, P., Sridhar, T.N., Sharath, G.M., Sivanantham, S., and Sivasankaran, K. (2015, January 27). VLSI implementation of fast convolution. Proceedings of the 2015 Online International Conference on Green Engineering and Technologies (IC-GET), Coimbatore, India.","DOI":"10.1109\/GET.2015.7453771"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"159402","DOI":"10.1109\/ACCESS.2019.2950675","article-title":"Reconfigurable Pavement Sweeping Robot and Pedestrian Cohabitant Framework by Vision Techniques","volume":"7","author":"Le","year":"2019","journal-title":"IEEE Access"},{"key":"ref_39","unstructured":"Arduengo, M., Torras, C., and Sentis, L. (2020, June 21). Robust and Adaptive Door Operation with a Mobile Manipulator Robot. Available online: https:\/\/arxiv.org\/abs\/1902.09051."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"517","DOI":"10.3182\/20070903-3-FR-2921.00088","article-title":"Door handle identification: A three-stage approach","volume":"40","author":"Jauregi","year":"2007","journal-title":"IFAC Proc. Vol."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Niu, L., Qian, C., Rizzo, J., Hudson, T., Li, Z., Enright, S., Sperling, E., Conti, K., Wong, E., and Fang, Y. (2017, January 22\u201329). A Wearable Assistive Technology for the Visually Impaired with Door Knob Detection and Real-Time Feedback for Hand-to-Handle Manipulation. Proceedings of the 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), Venice, Italy.","DOI":"10.1109\/ICCVW.2017.177"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Klingbeil, E., Saxena, A., and Ng, A.Y. (2010, January 18\u201322). Learning to open new doors. Proceedings of the 2010 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan.","DOI":"10.1109\/IROS.2010.5649847"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1016\/j.cirp.2011.03.041","article-title":"Toward a resilient manufacturing system","volume":"60","author":"Zhang","year":"2011","journal-title":"CIRP Ann."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/12\/3543\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:41:35Z","timestamp":1760175695000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/12\/3543"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,23]]},"references-count":43,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["s20123543"],"URL":"https:\/\/doi.org\/10.3390\/s20123543","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,23]]}}}