{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,28]],"date-time":"2025-11-28T10:06:40Z","timestamp":1764324400314,"version":"3.46.0"},"reference-count":53,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2025,11,27]],"date-time":"2025-11-27T00:00:00Z","timestamp":1764201600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this paper, we present a stair detection algorithm verified on various platforms, including a real quadruped robot. The proposed approach detects dangerous situations, such as proximity to stairs, in real time, enabling the robot to move safely. In our research, we utilized data collected by a moving four-legged robot, recorded in 18 sequences containing more than 26,000 color images from two cameras positioned at different perspectives. To address the challenge, we utilize a deep neural network with RGB inputs for object detection, complemented by preprocessing, and post-processing. A key feature of this approach is its adaptability to varying camera views, including both front and bottom perspectives on the robot, with training that incorporates multi-camera images from both views. We implemented and tested this algorithm on the Unitree Go1 robot, as well as on other embedded platforms. Using the trained YOLO version 11n network on a single sequence and testing on 17 sequences, we achieved an average mAP@50 of 51.30 for images containing only stairs and 87.56 for all images. This method enables early hazard detection during stair navigation. The proposed evaluation scenario tests the model\u2019s adaptation from a single training sequence to multiple unseen sequences, extending existing stair detection methods for quadrupedal robots. The dataset presents high variability in stair appearance due to the robot\u2019s perspective and limited real-time processing capacity.<\/jats:p>","DOI":"10.3390\/s25237247","type":"journal-article","created":{"date-parts":[[2025,11,28]],"date-time":"2025-11-28T09:56:02Z","timestamp":1764323762000},"page":"7247","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["RGB-Based Staircase Detection for Quadrupedal Robots: Implementation and Analysis"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5783-2516","authenticated-orcid":false,"given":"Piotr","family":"Wozniak","sequence":"first","affiliation":[{"name":"Department of Computer and Control Engineering, Rzeszow University of Technology, 35-959 Rzeszow, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5435-6051","authenticated-orcid":false,"given":"Pawe\u0142","family":"Penar","sequence":"additional","affiliation":[{"name":"Department of Applied Mechanics and Robotics, Rzeszow University of Technology, 35-959 Rzeszow, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Damian","family":"Bielecki","sequence":"additional","affiliation":[{"name":"Department of Applied Mechanics and Robotics, Rzeszow University of Technology, 35-959 Rzeszow, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Pappalettera, A., Bottiglione, F., Mantriota, G., and Reina, G. (2023). Watch the Next Step: A Comprehensive Survey of Stair-Climbing Vehicles. Robotics, 12.","DOI":"10.3390\/robotics12030074"},{"key":"ref_2","first-page":"629","article-title":"Robot Design for Stair Navigation","volume":"39","author":"Kagiwada","year":"1996","journal-title":"JSME Int. J. Ser. C Dyn. Control. Robot. Des. Manuf."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"60539","DOI":"10.1109\/ACCESS.2023.3286871","article-title":"Stair-Climbing Robots: A Review on Mechanism, Sensing, and Performance Evaluation","volume":"11","author":"Seo","year":"2023","journal-title":"IEEE Access"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Mihankhah, E., Kalantari, A., Aboosaeedan, E., Taghirad, H., Ali, S., and Moosavian, A. (2009, January 22\u201325). Autonomous staircase detection and stair climbing for a tracked mobile robot using fuzzy controller. Proceedings of the 2008 IEEE International Conference on Robotics and Biomimetics, Bangkok, Thailand.","DOI":"10.1109\/ROBIO.2009.4913304"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"127802","DOI":"10.1016\/j.neucom.2024.127802","article-title":"An autonomous stair climbing method for the crawler robot based on a hybrid reinforcement learning controller","volume":"593","author":"Zhang","year":"2024","journal-title":"Neurocomputing"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Anjum, S., Iqbal, M., Mohiuddin, A., Kumar, N., and Mishra, S. (2024, January 9\u201310). Humanoid Autonomous Self-Balancing Weight Lifting Stair Climbing Robot. Proceedings of the 2024 International Conference on Emerging Systems and Intelligent Computing (ESIC), Bhubaneswar, India.","DOI":"10.1109\/ESIC60604.2024.10481636"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2557","DOI":"10.1007\/s12008-024-01840-z","article-title":"Design and analysis of a stairs-climbing military bot for efficient and stable movement on various terrains","volume":"19","author":"Arora","year":"2024","journal-title":"Int. J. Interact. Des. Manuf."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1536","DOI":"10.1109\/TMECH.2024.3435767","article-title":"CLAW: Cycloidal Legs-Augmented Wheels for Stair and Obstacle Climbing in Mobile Robots","volume":"30","author":"Wei","year":"2025","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Medhioub, M., Bouhamed, S.A., Kallel, I.K., Derbel, N., and Kanoun, O. (2023, January 27\u201329). Staircase Recognition Based on Possibilistic Feature Quality Assessment Method. Proceedings of the International Conference on Computational Collective Intelligence, Budapest, Hungary.","DOI":"10.1007\/978-3-031-41456-5_23"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Choi, Y.J., Rahim, T., Ramatryana, I.N.A., and Shin, S.Y. (February, January 31). Improved CNN-Based Path Planning for Stairs Climbing in Autonomous UAV with LiDAR Sensor. Proceedings of the 2021 International Conference on Electronics, Information, and Communication (ICEIC), Jeju, Republic of Korea.","DOI":"10.1109\/ICEIC51217.2021.9369805"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Li, T.H.S., Su, Y.T., Kuo, C.H., Chen, C.Y., Hsu, C.L., and Lu, M.F. (2007, January 17\u201320). Stair-Climbing Control of Humanoid Robot using Force and Accelerometer Sensors. Proceedings of the SICE Annual Conference 2007, Takamatsu, Japan.","DOI":"10.1109\/SICE.2007.4421336"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"5470","DOI":"10.3390\/s140305470","article-title":"Gait Event Detection during Stair Walking Using a Rate Gyroscope","volume":"14","author":"Formento","year":"2014","journal-title":"Sensors"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Siekmann, J., Green, K., Warila, J., Fern, A., and Hurst, J. (2021). Blind Bipedal Stair Traversal via Sim-to-Real Reinforcement Learning. arXiv.","DOI":"10.15607\/RSS.2021.XVII.061"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Mustafin, M., Tsoy, T., Mart\u00ednez-Garc\u00eda, E.A., Meshcheryakov, R., and Magid, E. (2022, January 9\u201311). Modelling mobile robot navigation in 3D environments: Camera-based stairs recognition in Gazebo. Proceedings of the 2022 Moscow Workshop on Electronic and Networking Technologies (MWENT), Moscow, Russia.","DOI":"10.1109\/MWENT55238.2022.9802368"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Cong, Y., Li, X., Liu, J., and Tang, Y. (2008, January 6\u20138). A Stairway Detection Algorithm based on Vision for UGV Stair Climbing. Proceedings of the 2008 IEEE International Conference on Networking, Sensing and Control, Sanya, China.","DOI":"10.1109\/ICNSC.2008.4525517"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Veerajagadheswar, P., Le, A.V., Kyaw, P.T., Elara, M.R., and Paing, A. (2022, January 23\u201327). An Autonomous Descending-Stair Cleaning Robot with RGB-D based Detection, Approaching, and Area coverage Process. Proceedings of the 2022 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Kyoto, Japan.","DOI":"10.1109\/IROS47612.2022.9982007"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wang, C., Pei, Z., Qiu, S., and Tang, Z. (2023). RGB-D-Based Stair Detection and Estimation Using Deep Learning. Sensors, 23.","DOI":"10.3390\/s23042175"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Harms, H., Rehder, E., Schwarze, T., and Lauer, M. (October, January 28). Detection of ascending stairs using stereo vision. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7353716"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chauhan, R., Ghanshala, K.K., and Joshi, R. (2018, January 15\u201317). Convolutional Neural Network (CNN) for Image Detection and Recognition. Proceedings of the 2018 First International Conference on Secure Cyber Computing and Communication (ICSCCC), Jalandhar, India.","DOI":"10.1109\/ICSCCC.2018.8703316"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kong, W., Tan, Z., Tao, X., Fan, W., Ji, Y., Wang, M., and Xu, X. (2023, January 12\u201314). Object Detection Algorithm of Stairs Based on Multi-information Fusion. Proceedings of the 2023 3rd International Conference on Robotics and Control Engineering, Nanjing, China.","DOI":"10.1145\/3598151.3598187"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Kim, M., Shin, U., and Kim, J.Y. (2024, January 13\u201317). Learning Quadrupedal Locomotion with Impaired Joints Using Random Joint Masking. Proceedings of the 2024 IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan.","DOI":"10.1109\/ICRA57147.2024.10610088"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"S\u00e1nchez-Rojas, J.A., Arias-Aguilar, J.A., Takemura, H., and Petrilli-Barcel\u00f3, A.E. (2021). Staircase Detection, Characterization and Approach Pipeline for Search and Rescue Robots. Appl. Sci., 11.","DOI":"10.3390\/app112210736"},{"key":"ref_23","unstructured":"Kim, J., Jung, S., Kim, S.K., Kim, Y., and Agha-mohammadi, A.A. (2024). Staircase Localization for Autonomous Exploration in Urban Environments. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Cai, S., Ram, A., Gou, Z., Shaikh, M.A.W., Chen, Y.A., Wan, Y., Hara, K., Zhao, S., and Hsu, D. (2024, January 11\u201316). Navigating Real-World Challenges: A Quadruped Robot Guiding System for Visually Impaired People in Diverse Environments. Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3613904.3642227"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Majithia, A., Shah, D., Dave, J., Kumar, A., Rathee, S., Dogra, N., H. M., V., Chiniwar, D.S., and Hiremath, S. (2024). Design, Motions, Capabilities, and Applications of Quadruped Robots: A Comprehensive Review. Front. Mech. Eng., 10.","DOI":"10.3389\/fmech.2024.1448681"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ye, L., Wang, Y., Wang, X., Liu, H., and Liang, B. (2021, January 23\u201327). Optimized Static Gait for Quadruped Robots Walking on Stairs. Proceedings of the 2021 IEEE 17th International Conference on Automation Science and Engineering (CASE), Lyon, France.","DOI":"10.1109\/CASE49439.2021.9551433"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Qi, S., Lin, W., Hong, Z., Chen, H., and Zhang, W. (October, January 27). Perceptive Autonomous Stair Climbing for Quadrupedal Robots. Proceedings of the 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.","DOI":"10.1109\/IROS51168.2021.9636302"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wang, S., and Tian, Y. (2012, January 4\u20137). Detecting stairs and pedestrian crosswalks for the blind by RGBD camera. Proceedings of the 2012 IEEE International Conference on Bioinformatics and Biomedicine Workshops, Philadelphia, PA, USA.","DOI":"10.1109\/BIBMW.2012.6470227"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Lee, K., Kalyanram, V., Zhengl, C., Sane, S., and Lee, K. (2022, January 23\u201327). Vision-based Ascending Staircase Detection with Interpretable Classification Model for Stair Climbing Robots. Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA.","DOI":"10.1109\/ICRA46639.2022.9812456"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.imavis.2008.04.021","article-title":"Automated detection of unusual events on stairs","volume":"27","author":"Snoek","year":"2009","journal-title":"Image Vision Comput."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Jiang, Z., Zhao, Q., and Tomioka, Y. (2019, January 7\u201310). Depth Image-Based Obstacle Avoidance for an In-Door Patrol Robot. Proceedings of the 2019 International Conference on Machine Learning and Cybernetics (ICMLC), Kobe, Japan.","DOI":"10.1109\/ICMLC48188.2019.8949186"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"104799","DOI":"10.1016\/j.robot.2024.104799","article-title":"Robust quadruped jumping via deep reinforcement learning","volume":"182","author":"Bellegarda","year":"2024","journal-title":"Rob. Autom. Syst."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Cruz Ulloa, C., S\u00e1nchez, L., Del Cerro, J., and Barrientos, A. (2023). Deep Learning Vision System for Quadruped Robot Gait Pattern Regulation. Biomimetics, 8.","DOI":"10.3390\/biomimetics8030289"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kurbis, A.G., Kuzmenko, D., Ivanyuk, B., Mihailidis, A., and Laschowski, B. (2024). StairNet: Visual recognition of stairs for human\u2013robot locomotion. Biomed. Eng. Online, 23.","DOI":"10.1186\/s12938-024-01216-0"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"56249","DOI":"10.1109\/ACCESS.2022.3178154","article-title":"Deep-Learning-Based Stair Detection Using 3D Point Cloud Data for Preventing Walking Accidents of the Visually Impaired","volume":"10","author":"Matsumura","year":"2022","journal-title":"IEEE Access"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Kirubakaran, A.P., Kaur, K., Santhosh Kumar, T.C., Jose, R., Vekariya, V., and Maranan, R. (2024, January 15\u201316). AI-Enabled Visual Assistance: Detecting Doors and Stairs to Aid Individuals with Visual Impairments. Proceedings of the 2024 5th International Conference on Innovative Trends in Information Technology (ICITIIT), Kottayam, India.","DOI":"10.1109\/ICITIIT61487.2024.10580367"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wang, C., Pei, Z., Qiu, S., and Tang, Z. (2022). Deep leaning-based ultra-fast stair detection. Sci. Rep., 12.","DOI":"10.1038\/s41598-022-20667-w"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"O\u00dfwald, S., Gutmann, J.S., Hornung, A., and Bennewitz, M. (2011, January 26\u201328). From 3D point clouds to climbing stairs: A comparison of plane segmentation approaches for humanoids. Proceedings of the 2011 11th IEEE-RAS International Conference on Humanoid Robots, Bled, Slovenia.","DOI":"10.1109\/Humanoids.2011.6100836"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.patrec.2023.11.022","article-title":"Saliency-guided stairs detection on wearable RGB-D devices for visually impaired persons with Swin-Transformer","volume":"177","author":"Zheng","year":"2024","journal-title":"Pattern Recognit. Lett."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.cviu.2016.04.007","article-title":"Stairs detection with odometry-aided traversal from a wearable RGB-D camera","volume":"154","author":"Guerrero","year":"2017","journal-title":"Comput. Vis. Image Understanding"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"197","DOI":"10.32604\/cmc.2022.022989","article-title":"Computer-Vision Based Object Detection and Recognition for Service Robot in Indoor Environment","volume":"72","author":"Singh","year":"2022","journal-title":"Comput. Mater. Continua"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Rekhawar, N., Govindani, Y., and Rao, N. (2022, January 6\u20137). Deep Learning based Detection, Segmentation and Vision based Pose Estimation of Staircase. Proceedings of the 2022 1st International Conference on the Paradigm Shifts in Communication, Embedded Systems, Machine Learning and Signal Processing (PCEMS), Nagpur, India.","DOI":"10.1109\/PCEMS55161.2022.9807915"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"47","DOI":"10.5815\/ijigsp.2022.02.05","article-title":"Recent Object Detection Techniques: A Survey","volume":"14","author":"Diwakar","year":"2022","journal-title":"Int. J. Image, Graphics Signal Process."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"110075","DOI":"10.1016\/j.sigpro.2025.110075","article-title":"A comprehensive review of object detection with traditional and deep learning methods","volume":"237","author":"Pagire","year":"2025","journal-title":"Signal Process."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2300783","DOI":"10.1002\/aisy.202300783","article-title":"A Review of Quadruped Robots: Structure, Control, and Autonomous Motion","volume":"6","author":"Fan","year":"2024","journal-title":"Adv. Intell. Syst."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1007\/s42979-025-03890-w","article-title":"SD-YOLOv5: Implementation of Real-Time Staircase Detection on Jetson Nano Board","volume":"6","author":"Fataniya","year":"2025","journal-title":"SN Comput. Sci."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Ali, M.L., and Zhang, Z. (2024). The YOLO Framework: A Comprehensive Review of Evolution, Applications, and Benchmarks in Object Detection. Computers, 13.","DOI":"10.20944\/preprints202410.1785.v1"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Jegham, N., Koh, C.Y., Abdelatti, M., and Hendawi, A. (2024). YOLO Evolution: A Comprehensive Benchmark and Architectural Review of YOLOv12, YOLO11, and Their Previous Versions. arXiv.","DOI":"10.2139\/ssrn.5175639"},{"key":"ref_50","unstructured":"Jocher, G., Chaurasia, A., and Qiu, J. (2025, November 20). Ultralytics YOLOv8. Available online: https:\/\/docs.ultralytics.com\/models\/yolov8\/."},{"key":"ref_51","unstructured":"Jocher, G., and Qiu, J. (2025, November 20). Ultralytics YOLO11. Available online: https:\/\/docs.ultralytics.com\/models\/yolo11\/."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014, January 6\u201312). Microsoft COCO: Common Objects in Context. Proceedings of the European Conference on Computer Vision 2014, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Islam, M.R., Haque, M.R., Imtiaz, M.H., Shen, X., and Sazonov, E. (2023). Vision-Based Recognition of Human Motion Intent during Staircase Approaching. Sensors, 23.","DOI":"10.3390\/s23115355"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/25\/23\/7247\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,28]],"date-time":"2025-11-28T10:04:02Z","timestamp":1764324242000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/25\/23\/7247"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,27]]},"references-count":53,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["s25237247"],"URL":"https:\/\/doi.org\/10.3390\/s25237247","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,27]]}}}