{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T06:26:22Z","timestamp":1769581582450,"version":"3.49.0"},"reference-count":41,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,3,18]],"date-time":"2024-03-18T00:00:00Z","timestamp":1710720000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p><jats:bold>Introduction:<\/jats:bold> Collaborative robots, designed to work alongside humans for manipulating end-effectors, greatly benefit from the implementation of active constraints. This process comprises the definition of a boundary, followed by the enforcement of some control algorithm when the robot tooltip interacts with the generated boundary. Contact with the constraint boundary is communicated to the human operator through various potential forms of feedback. In fields like surgical robotics, where patient safety is paramount, implementing active constraints can prevent the robot from interacting with portions of the patient anatomy that shouldn\u2019t be operated on. Despite improvements in orthopaedic surgical robots, however, there exists a gap between bulky systems with haptic feedback capabilities and miniaturised systems that only allow for boundary control, where interaction with the active constraint boundary interrupts robot functions. Generally, active constraint generation relies on optical tracking systems and preoperative imaging techniques.<\/jats:p><jats:p><jats:bold>Methods:<\/jats:bold> This paper presents a refined version of the Signature Robot, a three degrees-of-freedom, hands-on collaborative system for orthopaedic surgery. Additionally, it presents a method for generating and enforcing active constraints \u201con-the-fly\u201d using our previously introduced monocular, RGB, camera-based network, SimPS-Net. The network was deployed in real-time for the purpose of boundary definition. This boundary was subsequently used for constraint enforcement testing. The robot was utilised to test two different active constraints: a safe region and a restricted region.<\/jats:p><jats:p><jats:bold>Results:<\/jats:bold> The network success rate, defined as the ratio of correct over total object localisation results, was calculated to be 54.7% \u00b1 5.2%. In the safe region case, haptic feedback resisted tooltip manipulation beyond the active constraint boundary, with a mean distance from the boundary of 2.70 mm \u00b1 0.37 mm and a mean exit duration of 0.76 s \u00b1 0.11 s. For the restricted-zone constraint, the operator was successfully prevented from penetrating the boundary in 100% of attempts.<\/jats:p><jats:p><jats:bold>Discussion:<\/jats:bold> This paper showcases the viability of the proposed robotic platform and presents promising results of a versatile constraint generation and enforcement pipeline.<\/jats:p>","DOI":"10.3389\/frobt.2024.1365632","type":"journal-article","created":{"date-parts":[[2024,3,18]],"date-time":"2024-03-18T04:56:11Z","timestamp":1710737771000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Real-time active constraint generation and enforcement for surgical tools using 3D detection and localisation network"],"prefix":"10.3389","volume":"11","author":[{"given":"Spyridon","family":"Souipas","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anh","family":"Nguyen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephen G.","family":"Laws","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brian L.","family":"Davies","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ferdinando","family":"Rodriguez y Baena","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2024,3,18]]},"reference":[{"key":"B1","doi-asserted-by":"crossref","DOI":"10.1109\/ROBOT.2003.1242016","article-title":"Virtual fixture architectures for telemanipulation","author":"Abbott","year":"2003"},{"key":"B2","volume-title":"SpryTrack 500 datasheet","year":"2020"},{"key":"B3","doi-asserted-by":"publisher","first-page":"626","DOI":"10.1177\/0954411920911499","article-title":"In vivo evaluation of machining forces, torque, and bone quality during skull bone grinding","volume":"234","author":"Babbar","year":"2020","journal-title":"Proc. Institution Mech. Eng. Part H J. Eng. Med."},{"key":"B4","doi-asserted-by":"publisher","first-page":"953","DOI":"10.1109\/tro.2004.829483","article-title":"Vision-assisted control for manipulation using virtual fixtures","volume":"20","author":"Bettini","year":"2004","journal-title":"IEEE Trans. Robotics"},{"key":"B5","first-page":"5","article-title":"Dynamic frictional constraints in translation and rotation","author":"Bowyer","year":"2014"},{"key":"B6","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1109\/tro.2013.2283410","article-title":"Active constraints\/virtual fixtures: a survey","volume":"30","author":"Bowyer","year":"2014","journal-title":"IEEE Trans. Robotics"},{"key":"B7","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1109\/3516.622971","article-title":"Second-order kinematic control of robot manipulators with jacobian damped least-squares inverse: theory and experiments","volume":"2","author":"Caccavale","year":"1997","journal-title":"IEEE\/ASME Trans. Mechatronics"},{"key":"B8","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1080\/24699322.2018.1519038","article-title":"Accuracy assessment of a novel image-free handheld robot for Total Knee Arthroplasty in a cadaveric study","volume":"23","author":"Casper","year":"2018","journal-title":"Comput. Assist. Surg."},{"key":"B9","doi-asserted-by":"publisher","first-page":"1984","DOI":"10.2106\/jbjs.17.01397","article-title":"Current concepts review: robotic technology in orthopaedic surgery","volume":"100","author":"Chen","year":"2018","journal-title":"J. Bone Jt. Surg. - Am. Volume"},{"key":"B10","doi-asserted-by":"crossref","first-page":"2099","DOI":"10.1007\/s00402-021-04134-1","article-title":"Robotic-assisted knee arthroplasty: an evolution in progress. A concise review of the available systems and the data supporting them","volume":"12","author":"Elliott","year":"2021","journal-title":"Arch. Orthop. Trauma Surg."},{"key":"B11","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1007\/978-981-13-1396-7_4","article-title":"Surgical navigation in orthopedics: workflow and system review","volume":"1093","author":"Ewurum","year":"2018","journal-title":"Adv. Exp. Med. Biol."},{"key":"B12","doi-asserted-by":"publisher","first-page":"1505","DOI":"10.1007\/s00464-007-9683-0","article-title":"Visual clues act as a substitute for haptic feedback in robotic surgery","volume":"22","author":"Hagen","year":"2008","journal-title":"Surg. Endosc. Other Interventional Tech."},{"key":"B13","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1055\/s-0038-1641729","article-title":"Robotic-arm assisted total knee arthroplasty demonstrated greater accuracy and precision to plan compared with manual techniques","volume":"32","author":"Hampp","year":"2019","journal-title":"J. Knee Surg."},{"key":"B14","article-title":"Development of NASA-TLX (task load index) results of empirical and theoretical research","author":"Hart","year":"1998","journal-title":"Adv. Psychol"},{"key":"B15","doi-asserted-by":"publisher","first-page":"386","DOI":"10.1109\/tpami.2018.2844175","article-title":"Mask R-CNN","volume":"42","author":"He","year":"2017","journal-title":"IEEE Trans. Pattern Analysis Mach. Intell."},{"key":"B16","doi-asserted-by":"crossref","first-page":"2035","DOI":"10.1007\/s00402-021-04046-0","article-title":"Robotics in orthopaedic surgery: why, what and how?","volume":"12","author":"Innocenti","year":"2021","journal-title":"Arch. Orthop. Trauma Surg."},{"key":"B17","volume-title":"Depth module D415","year":"2023"},{"key":"B18","doi-asserted-by":"publisher","first-page":"902","DOI":"10.1109\/tra.2003.817510","article-title":"The hands-on orthopaedic robot Acrobot: early clinical trials of total knee replacement surgery","volume":"19","author":"Jakopec","year":"2003","journal-title":"IEEE Trans. Robotics Automation"},{"key":"B19","doi-asserted-by":"crossref","DOI":"10.1109\/ICRA.2019.8793953","article-title":"Guaranteed active constraints enforcement on point cloud-approximated regions for surgical applications","author":"Kastritsi","year":"2019"},{"key":"B20","first-page":"2938","article-title":"PoseNet: a convolutional network for real-time 6-dof camera relocalization","author":"Kendall","year":"2015"},{"key":"B21","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1080\/24699322.2018.1484167","article-title":"Implant orientation accuracy of a hand-held robotic partial knee replacement system over conventional technique in a cadaveric test","volume":"23","author":"Khare","year":"2018","journal-title":"Comput. Assist. Surg."},{"key":"B22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-030-03243-2_649-1","article-title":"Principal component analysis (PCA)","volume-title":"Computer vision","author":"Kurita","year":"2020"},{"key":"B23","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1002\/smmd.20220021","article-title":"Advanced surgical tool: progress in clinical application of intelligent surgical robot","volume":"1","author":"Li","year":"2022","journal-title":"Smart Med."},{"key":"B24","doi-asserted-by":"publisher","first-page":"124503","DOI":"10.1115\/1.4007953","article-title":"Biomechanical measurements of surgical drilling force and torque in human versus artificial femurs","volume":"134","author":"MacAvelia","year":"2012","journal-title":"J. Biomechanical Eng."},{"key":"B25","doi-asserted-by":"publisher","first-page":"339","DOI":"10.2147\/orr.s294369","article-title":"Where are we now and what are we hoping to achieve with robotic total knee arthroplasty? A critical analysis of the current knowledge and future perspectives","volume":"14","author":"Mancino","year":"2022","journal-title":"Orthop. Res. Rev."},{"key":"B26","doi-asserted-by":"publisher","first-page":"1166","DOI":"10.1109\/tro.2019.2920078","article-title":"Dynamic active constraints for surgical robots using vector-field inequalities","volume":"35","author":"Marques Marinho","year":"2019","journal-title":"IEEE Trans. Robotics"},{"key":"B27","doi-asserted-by":"publisher","first-page":"2043","DOI":"10.1007\/s00402-021-04208-0","article-title":"The MAKO robotic-arm knee arthroplasty system","volume":"141","author":"Martin","year":"2021","journal-title":"Archives Orthop. Trauma Surg."},{"key":"B28","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1097\/mou.0b013e32831a478c","article-title":"Haptic feedback in robot-assisted minimally invasive surgery","volume":"19","author":"Okamura","year":"2009","journal-title":"Curr. Opin. Urol."},{"key":"B29","doi-asserted-by":"publisher","first-page":"1061","DOI":"10.1109\/tmi.2008.917246","article-title":"Dynamic 3-D virtual fixtures for minimally invasive beating heart procedures","volume":"27","author":"Ren","year":"2008","journal-title":"IEEE Trans. Med. Imaging"},{"key":"B30","first-page":"11","volume-title":"Orthopaedic models for medical education and training","year":"2019"},{"key":"B31","article-title":"Modelling and control of robot manipulators","volume-title":"Advanced textbooks in control and signal processing","author":"Sciavicco","year":"2001"},{"key":"B32","doi-asserted-by":"publisher","first-page":"6202","DOI":"10.3390\/s23136202","article-title":"Augmented reality (AR) for surgical robotic and autonomous systems: state of the art","volume":"7","author":"Seetohul","year":"2023","journal-title":"Challenges, Solutions"},{"key":"B33","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1115\/1.4049993","article-title":"Virtual fixture generation for task planning with complex geometries","volume":"21","author":"Sharp","year":"2021","journal-title":"J. Comput. Inf. Sci. Eng."},{"key":"B34","doi-asserted-by":"publisher","first-page":"162","DOI":"10.29007\/h469","article-title":"Towards miniaturised collaborative haptic robots for computer aided knee surgery: signature robot","volume":"5","author":"Souipas","year":"2022","journal-title":"Health Sci. EPiC Ser. Health Sci."},{"key":"B35","doi-asserted-by":"publisher","first-page":"614","DOI":"10.1109\/tmrb.2023.3291022","article-title":"SimPS-net: simultaneous pose and segmentation network of surgical tools","volume":"5","author":"Souipas","year":"","journal-title":"IEEE Trans. Med. Robotics Bionics"},{"key":"B36","unstructured":"3dStool - a 3D Surgical Tool dataset for detection and pose estimation\n            SouipasS.\n            NguyenA.\n            StephenL.\n            DaviesB.\n            Ferdinando RodriguezY. B."},{"key":"B37","first-page":"2","volume-title":"Alip, jinu kim, koon Ho rha, and woong kyu han","author":"Sylvia","year":"2022"},{"key":"B38","article-title":"The velystm robotic-assisted solution versus mako \u00ae A comparison of system compactness","author":"Synthes","year":"2021"},{"key":"B39","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1302\/2633-1462.41.bjo-2022-0070.r1","article-title":"Comparative assessment of current robotic-assisted systems in primary total knee arthroplasty","volume":"4","author":"Walgrave","year":"2022","journal-title":"Bone Jt. Open"},{"key":"B40","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.jmbbm.2014.10.017","article-title":"Lughmani, Kaddour Bouazza-Marouf, and Ian Ashcroft. Drilling in cortical bone: a finite element model and experimental investigations","volume":"42","author":"Waqas","year":"2015","journal-title":"J. Mech. Behav. Biomed. Mater."},{"key":"B41","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.oto.2021.100906","article-title":"Seyler. Imageless robotic knee arthroplasty","volume":"31","author":"Wu","year":"2021","journal-title":"Operative Tech. Orthop."}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1365632\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,18]],"date-time":"2024-03-18T04:56:23Z","timestamp":1710737783000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1365632\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,18]]},"references-count":41,"alternative-id":["10.3389\/frobt.2024.1365632"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2024.1365632","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,18]]},"article-number":"1365632"}}