{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,6]],"date-time":"2026-04-06T10:59:58Z","timestamp":1775473198228,"version":"3.50.1"},"reference-count":29,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,1,7]],"date-time":"2025-01-07T00:00:00Z","timestamp":1736208000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Laboratory automation requires reliable and precise handling of microplates, but existing robotic systems often struggle to achieve this, particularly when navigating around the dynamic and variable nature of laboratory environments. This work introduces a novel method integrating simultaneous localization and mapping (SLAM), computer vision, and tactile feedback for the precise and autonomous placement of microplates. Implemented on a bi-manual mobile robot, the method achieves fine-positioning accuracies of <jats:inline-formula><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" id=\"m1\"><mml:mrow><mml:mo>\u00b1<\/mml:mo><\/mml:mrow><\/mml:math><\/jats:inline-formula>1.2 mm and <jats:inline-formula><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" id=\"m2\"><mml:mrow><mml:mo>\u00b1<\/mml:mo><\/mml:mrow><\/mml:math><\/jats:inline-formula>0.4\u00b0. The approach was validated through experiments using both mockup and real laboratory instruments, demonstrating at least a 95% success rate across varied conditions and robust performance in a multi-stage protocol. Compared to existing methods, our framework effectively generalizes to different instruments without compromising efficiency. These findings highlight the potential for enhanced robotic manipulation in laboratory automation, paving the way for more reliable and reproducible experimental workflows.<\/jats:p>","DOI":"10.3389\/frobt.2024.1462717","type":"journal-article","created":{"date-parts":[[2025,1,7]],"date-time":"2025-01-07T05:35:23Z","timestamp":1736228123000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Reliable and robust robotic handling of microplates via computer vision and touch feedback"],"prefix":"10.3389","volume":"11","author":[{"given":"Vincenzo","family":"Scamarcio","sequence":"first","affiliation":[]},{"given":"Jasper","family":"Tan","sequence":"additional","affiliation":[]},{"given":"Francesco","family":"Stellacci","sequence":"additional","affiliation":[]},{"given":"Josie","family":"Hughes","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2025,1,7]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1038\/s44160-022-00231-0","article-title":"The rise of self-driving labs in chemical and materials sciences","volume":"2","author":"Abolhasani","year":"2023","journal-title":"Nat. Synth."},{"key":"B2","first-page":"1","article-title":"Multiple lab ware manipulation in life science laboratories using mobile robots","author":"Ali","year":"2016"},{"key":"B3","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1038\/533452a","article-title":"Reproducibility crisis","volume":"533","author":"Baker","year":"2016","journal-title":"Nature"},{"key":"B4","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1016\/j.imavis.2019.06.007","article-title":"Stag: a stable fiducial marker system","volume":"89","author":"Benligiray","year":"2019","journal-title":"Image Vis. Comput."},{"key":"B5","doi-asserted-by":"publisher","first-page":"342","DOI":"10.6028\/jres.121.015","article-title":"Survey of research for performance measurement of mobile manipulators","volume":"121","author":"Bostelman","year":"2016","journal-title":"J. Res. Natl. Inst. Stand. Technol."},{"key":"B6","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1038\/s41586-020-2442-2","article-title":"A mobile robotic chemist","volume":"583","author":"Burger","year":"2020","journal-title":"Nature"},{"key":"B7","doi-asserted-by":"publisher","first-page":"890","DOI":"10.1038\/s41586-024-08173-7","article-title":"Autonomous mobile robots for exploratory synthetic chemistry","volume":"635","author":"Dai","year":"2024","journal-title":"Nature"},{"key":"B8","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1016\/j.artint.2018.12.005","article-title":"Unsupervised human activity analysis for intelligent mobile robots","volume":"270","author":"Duckworth","year":"2019","journal-title":"Artif. Intell."},{"key":"B9","volume-title":"Surfactants in consumer products: theory, technology and application","author":"Falbe","year":"2012"},{"key":"B10","doi-asserted-by":"publisher","first-page":"8026","DOI":"10.3390\/s23198026","article-title":"Mobile manipulators in industry 4.0: a review of developments for industrial applications","volume":"23","author":"Ghodsian","year":"2023","journal-title":"Sensors"},{"key":"B11","doi-asserted-by":"publisher","first-page":"571777","DOI":"10.3389\/fbioe.2020.571777","article-title":"Automation in the life science research laboratory","volume":"8","author":"Holland","year":"2020","journal-title":"Front. Bioeng. Biotechnol."},{"key":"B12","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1108\/01439911211201582","article-title":"Autonomous industrial mobile manipulation (aimm): past, present and future","volume":"39","author":"Hvilsh\u00f8j","year":"2012","journal-title":"Industrial Robot An Int. J."},{"key":"B13","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1007\/s10846-020-01307-9","article-title":"Fiducial markers for pose estimation: Overview, applications and experimental comparison of the artag, apriltag, aruco and stag markers","volume":"101","author":"Kalaitzakis","year":"2021","journal-title":"J. Intelligent & Robotic Syst."},{"key":"B14","doi-asserted-by":"publisher","first-page":"154","DOI":"10.2533\/chimia.2023.154","article-title":"Swiss CAT+, a data-driven infrastructure for accelerated catalysts discovery and optimization","volume":"77","author":"Laveille","year":"2023","journal-title":"Chimia"},{"key":"B15","article-title":"An autonomous lab robot for cell culture automation in a normal lab environment","volume-title":"SiLA conference 12","author":"Lieberherr","year":"2021"},{"key":"B16","doi-asserted-by":"publisher","first-page":"2456","DOI":"10.1039\/d3sc06206f","article-title":"Modular, multi-robot integration of laboratories: an autonomous workflow for solid-state chemistry","volume":"15","author":"Lunt","year":"2024","journal-title":"Chem. Sci."},{"key":"B17","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1080\/05704928.2021.1955702","article-title":"Spectroscopic methods for determination of critical micelle concentrations of surfactants; a comprehensive review","volume":"58","author":"Mabrouk","year":"2023","journal-title":"Appl. Spectrosc. Rev."},{"key":"B18","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1108\/ir-09-2014-0390","article-title":"Integration of mobile manipulators in an industrial production","volume":"42","author":"Madsen","year":"2015","journal-title":"Industrial Robot An Int. J."},{"key":"B19","doi-asserted-by":"publisher","first-page":"89","DOI":"10.12700\/aph.21.9.2024.9.7","article-title":"The development of robotic manipulator for automated test tube","volume":"21","author":"Nguyen","year":"2024","journal-title":"Acta Polytech. Hung."},{"key":"B20","volume-title":"Camera calibration","year":"2024"},{"key":"B21","doi-asserted-by":"publisher","first-page":"7898","DOI":"10.3390\/s21237898","article-title":"Path planning for autonomous mobile robots: a review","volume":"21","author":"S\u00e1nchez-Ib\u00e1\u00f1ez","year":"2021","journal-title":"Sensors"},{"key":"B22","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1039\/b208499f","article-title":"2 surfactants and their applications","volume":"99","author":"Schramm","year":"2003","journal-title":"Annu. Rep. Section\u201d C\u201d(Physical Chem.)"},{"key":"B23","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/10_2021_170","article-title":"Automation for life science laboratories","volume-title":"Smart biolabs of the future","author":"Thurow","year":"2021"},{"key":"B24","volume-title":"Automated deliverance of goods by an automated guided vehicle","author":"Wadsten Rex","year":"2019"},{"key":"B25","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1016\/j.slast.2021.11.003","article-title":"Towards robotic laboratory automation plug & play: the \u201clapp\u201d framework","volume":"27","author":"Wolf","year":"2022","journal-title":"SLAS Technol."},{"key":"B26","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1016\/j.slast.2023.01.003","article-title":"Towards robotic laboratory automation plug & play: survey and concept proposal on teaching-free robot integration with the lapp digital twin","volume":"28","author":"Wolf","year":"2023","journal-title":"SLAS Technol."},{"key":"B27","doi-asserted-by":"crossref","DOI":"10.1109\/SISY62279.2024.10737581","article-title":"Towards robotic laboratory automation plug & play: lapp pilot implementation with the mobert mobile manipulator","volume-title":"2024 IEEE 22nd jubilee international symposium on intelligent systems and informatics (SISY)","author":"Wolf","year":"2024"},{"key":"B28","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1007\/s11370-017-0233-x","article-title":"Robotic laboratory automation platform based on mobile agents for clinical chemistry","volume":"10","author":"You","year":"2017","journal-title":"Intell. Serv. Robot."},{"key":"B29","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1038\/s44160-023-00424-1","article-title":"Automated synthesis of oxygen-producing catalysts from martian meteorites by a robotic ai chemist","volume":"3","author":"Zhu","year":"2023","journal-title":"Nat. Synth."}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1462717\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,7]],"date-time":"2025-01-07T05:35:28Z","timestamp":1736228128000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1462717\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,7]]},"references-count":29,"alternative-id":["10.3389\/frobt.2024.1462717"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2024.1462717","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,7]]},"article-number":"1462717"}}