{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,20]],"date-time":"2026-02-20T18:49:23Z","timestamp":1771613363275,"version":"3.50.1"},"reference-count":33,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T00:00:00Z","timestamp":1678838400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Reproducibility of results is, in all research fields, the cornerstone of the scientific method and the minimum standard for assessing the value of scientific claims and conclusions drawn by other scientists. It requires a systematic approach and accurate description of the experimental procedure and data analysis, which allows other scientists to follow the steps described in the published work and obtain the \u201csame results.\u201d In general and in different research contexts with \u201csame\u201d results, we mean different things. It can be almost identical measures in a fully deterministic experiment or \u201cvalidation of a hypothesis\u201d or statistically similar results in a non-deterministic context. Unfortunately, it has been shown by systematic meta-analysis studies that many findings in fields like psychology, sociology, medicine, and economics do not hold up when other researchers try to replicate them. Many scientific fields are experiencing what is generally referred to as a \u201creproducibility crisis,\u201d which undermines the trust in published results, imposes a thorough revision of the methodology in scientific research, and makes progress difficult. In general, the reproducibility of experiments is not a mainstream practice in artificial intelligence and robotics research. Surgical robotics is no exception. There is a need for developing new tools and putting in place a community effort to allow the transition to more reproducible research and hence faster progress in research. Reproducibility, replicability, and benchmarking (operational procedures for the assessment and comparison of research results) are made more complex for medical robotics and surgical systems, due to patenting, safety, and ethical issues. In this review paper, we selected 10 relevant published manuscripts on surgical robotics to analyze their clinical applicability and underline the problems related to reproducibility of the reported experiments, with the aim of finding possible solutions to the challenges that limit the translation of many scientific research studies into real-world applications and slow down research progress.<\/jats:p>","DOI":"10.3389\/frobt.2023.1127972","type":"journal-article","created":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T04:34:31Z","timestamp":1678854871000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Reproducibility challenges in robotic surgery"],"prefix":"10.3389","volume":"10","author":[{"given":"Angela","family":"Faragasso","sequence":"first","affiliation":[]},{"given":"Fabio","family":"Bonsignorio","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,3,15]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1038\/533452a","article-title":"1,500 scientists lift the lid on reproducibility","volume":"533","author":"Baker","year":"2016","journal-title":"Nature"},{"key":"B2","doi-asserted-by":"publisher","first-page":"2590","DOI":"10.1021\/acscatal.6b00183","article-title":"Toward benchmarking in catalysis science: Best practices, challenges, and opportunities","volume":"6","author":"Bligaard","year":"2016","journal-title":"Acs Catal."},{"key":"B3","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-43196-3","volume-title":"Surgical principles of minimally invasive procedures","author":"Bonjer","year":"2017"},{"key":"B4","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1109\/mra.2017.2722918","article-title":"A new kind of article for reproducible research in intelligent robotics [from the field]","volume":"24","author":"Bonsignorio","year":"2017","journal-title":"IEEE Robotics Automation Mag."},{"key":"B5","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1109\/mra.2015.2452073","article-title":"Toward replicable and measurable robotics research [from the guest editors]","volume":"22","author":"Bonsignorio","year":"2015","journal-title":"IEEE Robotics Automation Mag."},{"key":"B6","volume-title":"Good experimental methodology-gem guidelines","author":"Bonsignorio","year":"2007"},{"key":"B7","doi-asserted-by":"publisher","first-page":"1424","DOI":"10.1109\/tie.2013.2258300","article-title":"Inverse transmission model and compensation control of a single-tendon\u2013sheath actuator","volume":"61","author":"Chen","year":"2013","journal-title":"IEEE Trans. Industrial Electron."},{"key":"B8","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1016\/j.ymssp.2013.08.014","article-title":"An investigation of friction-based tendon sheath model appropriate for control purposes","volume":"42","author":"Do","year":"","journal-title":"Mech. Syst. Signal Process."},{"key":"B9","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.mechatronics.2013.11.003","article-title":"Hysteresis modeling and position control of tendon-sheath mechanism in flexible endoscopic systems","volume":"24","author":"Do","year":"","journal-title":"Mechatronics"},{"key":"B10","doi-asserted-by":"publisher","first-page":"eabi8017","DOI":"10.1126\/scirobotics.abi8017","article-title":"A decade retrospective of medical robotics research from 2010 to 2020","volume":"6","author":"Dupont","year":"2021","journal-title":"Sci. Robotics"},{"key":"B11","volume-title":"Artificial intelligence, data science and smart robotics","author":"Getz","year":"2020"},{"key":"B12","doi-asserted-by":"publisher","first-page":"954","DOI":"10.1109\/tbme.2012.2228858","article-title":"Raven-ii: An open platform for surgical robotics research","volume":"60","author":"Hannaford","year":"2012","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"B13","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1089\/soro.2014.0010","article-title":"The soft robotics toolkit: Shared resources for research and design","volume":"1","author":"Holland","year":"2014","journal-title":"Soft Robot."},{"key":"B14","volume-title":"ROS Robotics projects","author":"Joseph","year":"2017"},{"key":"B15","first-page":"6434","article-title":"An open-source research kit for the da vinci\u00ae surgical system","author":"Kazanzides","year":"2014"},{"key":"B16","doi-asserted-by":"publisher","first-page":"909","DOI":"10.1109\/JPROC.2022.3170109","article-title":"Advancement of flexible robot technologies for endoluminal surgeries","volume":"110","author":"Kim","year":"2022","journal-title":"Proc. IEEE"},{"key":"B17","doi-asserted-by":"publisher","first-page":"9604","DOI":"10.1109\/tie.2018.2821626","article-title":"Sensorized surgical forceps for robotic-assisted minimally invasive surgery","volume":"65","author":"Kim","year":"2018","journal-title":"IEEE Trans. Industrial Electron."},{"key":"B18","doi-asserted-by":"publisher","first-page":"5412","DOI":"10.3390\/s21165412","article-title":"Endoscopic image-based skill assessment in robot-assisted minimally invasive surgery","volume":"21","author":"Lajk\u00f3","year":"2021","journal-title":"Sensors"},{"key":"B19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/17579961.2017.1304921","article-title":"Regulatory challenges of robotics: Some guidelines for addressing legal and ethical issues","volume":"9","author":"Leenes","year":"2017","journal-title":"Law, Innovation Technol."},{"key":"B20","doi-asserted-by":"publisher","first-page":"073","DOI":"10.15302\/j-eng-2015011","article-title":"A novel tele-operated flexible robot targeted for minimally invasive robotic surgery","volume":"1","author":"Li","year":"2015","journal-title":"Engineering"},{"key":"B21","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1002\/rcs.1434","article-title":"Master\u2013slave robotic platform and its feasibility study for micro-neurosurgery","volume":"9","author":"Mitsuishi","year":"2013","journal-title":"Int. J. Med. Robotics Comput. Assisted Surg."},{"key":"B22","volume-title":"Handbook for good clinical research practice (gcp): Guidance for implementation","year":"2005"},{"key":"B23","doi-asserted-by":"publisher","first-page":"1226","DOI":"10.1126\/science.1213847","article-title":"Reproducible research in computational science","volume":"334","author":"Peng","year":"2011","journal-title":"Science"},{"key":"B24","doi-asserted-by":"publisher","first-page":"3360","DOI":"10.3390\/cancers14143360","article-title":"Does robotic liver surgery enhance r0 results in liver malignancies during minimally invasive liver surgery?\u2014A systematic review and meta-analysis","volume":"14","author":"Rahimli","year":"2022","journal-title":"Cancers"},{"key":"B25","doi-asserted-by":"publisher","first-page":"909","DOI":"10.1109\/tmech.2016.2643640","article-title":"Modeling and estimation of friction, extension, and coupling effects in multisegment continuum robots","volume":"22","author":"Roy","year":"2016","journal-title":"IEEE\/ASME Trans. Mechatronics"},{"key":"B26","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1533\/9780857097392.276","article-title":"12 - robotic surgery and ethical challenges","volume-title":"Medical robotics","author":"Sharkey","year":"2012"},{"key":"B27","doi-asserted-by":"publisher","first-page":"937","DOI":"10.1109\/tbme.2013.2242070","article-title":"Surgical robot system for single-port surgery with novel joint mechanism","volume":"60","author":"Shin","year":"2013","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"B28","doi-asserted-by":"publisher","first-page":"2915","DOI":"10.1007\/s12555-017-0486-3","article-title":"Safety-enhanced collaborative framework for tele-operated minimally invasive surgery using a 7-dof\u00a0torque-controlled robot","volume":"16","author":"Su","year":"2018","journal-title":"Int. J. Control, Automation Syst."},{"key":"B29","doi-asserted-by":"publisher","first-page":"100544","DOI":"10.1016\/j.ijso.2022.100544","article-title":"Scientometric analysis of global research output in robotic gynecologic surgery","volume":"47","author":"Vidal","year":"2022","journal-title":"Int. J. Surg. Open"},{"key":"B30","doi-asserted-by":"publisher","first-page":"2133","DOI":"10.1109\/tmech.2014.2364625","article-title":"Development of the sjtu unfoldable robotic system (surs) for single port laparoscopy","volume":"20","author":"Xu","year":"2014","journal-title":"IEEE\/ASME Trans. Mechatronics"},{"key":"B31","doi-asserted-by":"publisher","first-page":"eaam8638","DOI":"10.1126\/scirobotics.aam8638","article-title":"Medical robotics-regulatory, ethical, and legal considerations for increasing levels of autonomy","volume":"2","author":"Yang","year":"2017","journal-title":"Sci. Robotics"},{"key":"B32","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/j.asjsur.2021.04.002","article-title":"Top 100 most-cited original articles, systematic reviews\/meta-analyses in robotic surgery: A scientometric study","volume":"45","author":"Zhang","year":"2022","journal-title":"Asian J. Surg."},{"key":"B33","doi-asserted-by":"publisher","first-page":"868682","DOI":"10.3389\/frobt.2022.868682","article-title":"A scientometric review of soft robotics: Intellectual structures and emerging trends analysis (2010\u20132021)","volume":"9","author":"Zhou","year":"2022","journal-title":"Front. Robotics AI"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1127972\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T04:34:38Z","timestamp":1678854878000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1127972\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,15]]},"references-count":33,"alternative-id":["10.3389\/frobt.2023.1127972"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2023.1127972","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,15]]},"article-number":"1127972"}}