{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,14]],"date-time":"2026-06-14T22:28:59Z","timestamp":1781476139957,"version":"3.54.1"},"reference-count":31,"publisher":"IOP Publishing","issue":"1","license":[{"start":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T00:00:00Z","timestamp":1767312000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/publishingsupport.iopscience.iop.org\/iop-standard\/v1"},{"start":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T00:00:00Z","timestamp":1767312000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"name":"Natural Science Foundation of Beijing Municipality","award":["L233028"],"award-info":[{"award-number":["L233028"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","award":["2024CX06009"],"award-info":[{"award-number":["2024CX06009"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Zhejiang Provincial Natural Science Foundation of China","award":["LY24F010005"],"award-info":[{"award-number":["LY24F010005"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62088101"],"award-info":[{"award-number":["62088101"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Bioinspir. Biomim."],"published-print":{"date-parts":[[2026,2,10]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Environmental perception is a crucial foundation for enhancing the application potential of biomimetic robots. Motivated by the complementary roles of visual and tactile sensing observed in rats, this work proposes a visual-tactile perception for a small-scale bio-inspired robotic rat. The method leverages binocular vision to estimate depth images through an attention-based network and improve perception and localization accuracy by 14.22% based on a dynamic objects removal module. Besides, the whisker sensor is applied to enhance the robot\u2019s ability to identify object contours and environmental boundaries in narrow spaces, with obstacle contour and environment boundary reconstruction goodness of fit exceeding 97.00% and 93.87%, respectively. In addition, by integrating the above individual perception methods, we achieve the fusion of vision and tactile sensing for complex environment perception. To the best of our knowledge, this is the first study to implement vision-tactile fusion perception on a miniature biomimetic robot through physical experiments. The experiments demonstrate that our method exhibits promising results on the robotic rat, reducing localization errors in narrow and dim scenes by an average of 29.14% compared to existing state-of-the-art methods.<\/jats:p>","DOI":"10.1088\/1748-3190\/ae224d","type":"journal-article","created":{"date-parts":[[2025,11,20]],"date-time":"2025-11-20T22:57:03Z","timestamp":1763679423000},"page":"016007","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Visual-tactile perception for a biomimetic robot in constrained environments"],"prefix":"10.1088","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6534-9698","authenticated-orcid":true,"given":"Yulai","family":"Zhang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8461-6309","authenticated-orcid":true,"given":"Zhiqiang","family":"Yu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zuowei","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9914-7314","authenticated-orcid":true,"given":"Qing","family":"Shi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2026,1,2]]},"reference":[{"key":"bbae224dbib1","doi-asserted-by":"publisher","first-page":"eaau5872","DOI":"10.1126\/scirobotics.aau5872","type":"journal-article","article-title":"Learning agile and dynamic motor skills for legged robots","volume":"4","author":"Hwangbo","year":"2019","journal-title":"Sci. Robot."},{"key":"bbae224dbib2","doi-asserted-by":"publisher","first-page":"eabc5986","DOI":"10.1126\/scirobotics.abc5986","type":"journal-article","article-title":"Learning quadrupedal locomotion over challenging terrain","volume":"5","author":"Lee","year":"2020","journal-title":"Sci. Robot."},{"key":"bbae224dbib3","doi-asserted-by":"publisher","first-page":"10822","DOI":"10.3182\/20080706-5-KR-1001.01833","type":"journal-article","article-title":"Bigdog, the rough-terrain quadruped robot","volume":"41","author":"Raibert","year":"2008","journal-title":"IFAC Proc. Vol."},{"key":"bbae224dbib4","doi-asserted-by":"publisher","DOI":"10.1088\/1748-3190\/acb393","type":"journal-article","article-title":"A monocular wide-field speed sensor inspired by the crabs\u2019 visual system for traffic analysis","volume":"18","author":"Guimaraynz","year":"2023","journal-title":"Bioinsp. Biomim."},{"key":"bbae224dbib5","first-page":"pp 337","type":"conference-proceedings","article-title":"Superpoint: self-supervised interest point detection and description","author":"DeTone","year":"2018"},{"key":"bbae224dbib6","first-page":"pp 97","type":"conference-proceedings","article-title":"Vita-slam: a bio-inspired visuo-tactile slam for navigation while interacting with aliased environments","author":"Struckmeier","year":"2019"},{"key":"bbae224dbib7","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1109\/TPAMI.2007.1166","type":"journal-article","article-title":"Stereo processing by semiglobal matching and mutual information","volume":"30","author":"Hirschmuller","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"bbae224dbib8","first-page":"pp 2357","type":"conference-proceedings","article-title":"Robust stereo matching with fast normalized cross-correlation over shape-adaptive regions","author":"Zhang","year":"2009"},{"key":"bbae224dbib9","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1109\/TCSVT.2012.2203197","type":"journal-article","article-title":"Improved census transforms for resource-optimized stereo vision","volume":"23","author":"Fife","year":"2013","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"bbae224dbib10","doi-asserted-by":"publisher","first-page":"1874","DOI":"10.1109\/TRO.2021.3075644","type":"journal-article","article-title":"ORB-SLAM3: an accurate open-source library for visual, visual-inertial and multimap slam","volume":"37","author":"Campos","year":"2021","journal-title":"IEEE Trans. Robot."},{"key":"bbae224dbib11","first-page":"pp 321","type":"conference-proceedings","article-title":"A robust visual slam system for small-scale quadruped robots in dynamic environments","author":"Li","year":"2024"},{"key":"bbae224dbib12","first-page":"pp 2661","type":"conference-proceedings","article-title":"Online global loop closure detection for large-scale multi-session graph-based slam","author":"Labb\u00e9","year":"2014"},{"key":"bbae224dbib13","first-page":"pp 8918","type":"conference-proceedings","article-title":"LofTR: detector-free local feature matching with transformers","author":"Sun","year":"2021"},{"key":"bbae224dbib14","doi-asserted-by":"publisher","DOI":"10.1088\/1748-3190\/accd34","type":"journal-article","article-title":"Proprioceptive wake classification by a body with a passive tail","volume":"18","author":"Rodwell","year":"2023","journal-title":"Bioinsp. Biomim."},{"key":"bbae224dbib15","first-page":"pp 194","type":"conference-proceedings","article-title":"Semi-flexible bionic whisker sensor based on triboelectric nanogenerators","author":"Wang","year":"2021"},{"key":"bbae224dbib16","doi-asserted-by":"publisher","first-page":"3608","DOI":"10.1109\/LRA.2022.3146602","type":"journal-article","article-title":"A tapered whisker-based physical reservoir computing system for mobile robot terrain identification in unstructured environments","volume":"7","author":"Yu","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"bbae224dbib17","doi-asserted-by":"publisher","first-page":"3357","DOI":"10.1109\/LRA.2021.3062816","type":"journal-article","article-title":"Whisksight: a reconfigurable, vision-based, optical whisker sensing array for simultaneous contact, airflow and inertia stimulus detection","volume":"6","author":"Kent","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"bbae224dbib18","first-page":"pp 1330","type":"conference-proceedings","article-title":"A whisker-inspired fin sensor for multi-directional airflow sensing","author":"Kim","year":"2020"},{"key":"bbae224dbib19","doi-asserted-by":"publisher","DOI":"10.1088\/1748-3190\/adcddf","type":"journal-article","article-title":"Biomimetic seal whisker sensors for high-sensitivity wake detection and localization","volume":"20","author":"Geng","year":"2025","journal-title":"Bioinsp. Biomim."},{"key":"bbae224dbib20","doi-asserted-by":"publisher","first-page":"3230","DOI":"10.1002\/adma.201305285","type":"journal-article","article-title":"Bioinspired carbon nanotube fuzzy fiber hair sensor for air-flow detection","volume":"26","author":"Maschmann","year":"2014","journal-title":"Adv. Mater."},{"key":"bbae224dbib21","first-page":"pp 94","type":"conference-proceedings","article-title":"Advanced dual-mode optical whisker sensor for enhancing robot perception","author":"Jing","year":"2024"},{"key":"bbae224dbib22","first-page":"pp 97","type":"conference-proceedings","article-title":"Posture estimation and trajectory tracking for SQuRo: a small-sized quadruped robotic rat","author":"Gao","year":"2023"},{"key":"bbae224dbib23","doi-asserted-by":"publisher","first-page":"3027","DOI":"10.1109\/TRO.2022.3159188","type":"journal-article","article-title":"Development of a small-sized quadruped robotic rat capable of multimodal motions","volume":"38","author":"Shi","year":"2022","journal-title":"IEEE Trans. Robot."},{"key":"bbae224dbib24","first-page":"pp 364","type":"conference-proceedings","article-title":"Approach to the dynamical scanning of object contours using tactile sensors","volume":"vol 1","author":"Merker","year":"2019"},{"key":"bbae224dbib25","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-45387-3_4","type":"book","article-title":"Towards the development of tactile sensors for determination of static friction coefficient to surfaces","volume":"vol 45)","author":"Scharff","year":"2017"},{"key":"bbae224dbib26","first-page":"pp 6037","type":"conference-proceedings","article-title":"Hierarchical discrete distribution decomposition for match density estimation","author":"Yin","year":"2019"},{"key":"bbae224dbib27","first-page":"pp 3268","type":"conference-proceedings","article-title":"Group-wise correlation stereo network","author":"Guo","year":"2019"},{"key":"bbae224dbib28","first-page":"pp 5410","type":"conference-proceedings","article-title":"Pyramid stereo matching network","author":"Chang","year":"2018"},{"key":"bbae224dbib29","first-page":"pp 185","type":"conference-proceedings","article-title":"Ga-net: Guided aggregation net for end-to-end stereo matching","author":"Zhang","year":"2019"},{"key":"bbae224dbib30","article-title":"Domain-invariant stereo matching networks","author":"Zhang","year":"2019","type":"preprint"},{"key":"bbae224dbib31","first-page":"pp 402","type":"conference-proceedings","article-title":"RAFT: Recurrent all-pairs field transforms for optical flow","volume":"vol 16","author":"Teed","year":"2020"}],"container-title":["Bioinspiration &amp; Biomimetics"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ae224d","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ae224d\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ae224d","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ae224d\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ae224d\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ae224d\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ae224d\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ae224d\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T11:05:35Z","timestamp":1767351935000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ae224d"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,2]]},"references-count":31,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1,2]]},"published-print":{"date-parts":[[2026,2,10]]}},"URL":"https:\/\/doi.org\/10.1088\/1748-3190\/ae224d","relation":{},"ISSN":["1748-3182","1748-3190"],"issn-type":[{"value":"1748-3182","type":"print"},{"value":"1748-3190","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,2]]},"assertion":[{"value":"Visual-tactile perception for a biomimetic robot in constrained environments","name":"article_title","label":"Article Title"},{"value":"Bioinspiration & Biomimetics","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2026 IOP Publishing Ltd. All rights, including for text and data mining, AI training, and similar technologies, are reserved.","name":"copyright_information","label":"Copyright Information"},{"value":"2025-04-28","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2025-11-20","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2026-01-02","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}