{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T23:37:56Z","timestamp":1771025876561,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2023,9,26]],"date-time":"2023-09-26T00:00:00Z","timestamp":1695686400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Recent advances allow the use of Augmented Reality (AR) for many medical procedures. AR via optical navigators to aid various knee surgery techniques (e.g., femoral and tibial osteotomies, ligament reconstructions or menisci transplants) is becoming increasingly frequent. Accuracy in these procedures is essential, but evaluations of this technology still need to be made. Our study aimed to evaluate the system\u2019s accuracy using an in vitro protocol. We hypothesised that the system\u2019s accuracy was equal to or less than 1 mm and 1\u00b0 for distance and angular measurements, respectively. Our research was an in vitro laboratory with a 316 L steel model. Absolute reliability was assessed according to the Hopkins criteria by seven independent evaluators. Each observer measured the thirty palpation points and the trademarks to acquire direct angular measurements on three occasions separated by at least two weeks. The system\u2019s accuracy in assessing distances had a mean error of 1.203 mm and an uncertainty of 2.062, and for the angular values, a mean error of 0.778\u00b0 and an uncertainty of 1.438. The intraclass correlation coefficient was for all intra-observer and inter-observers, almost perfect or perfect. The mean error for the distance\u2019s determination was statistically larger than 1 mm (1.203 mm) but with a trivial effect size. The mean error assessing angular values was statistically less than 1\u00b0. Our results are similar to those published by other authors in accuracy analyses of AR systems.<\/jats:p>","DOI":"10.3390\/s23198091","type":"journal-article","created":{"date-parts":[[2023,9,26]],"date-time":"2023-09-26T08:58:17Z","timestamp":1695718697000},"page":"8091","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["The Accuracy and Absolute Reliability of a Knee Surgery Assistance System Based on ArUco-Type Sensors"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0429-2579","authenticated-orcid":false,"given":"Vicente J.","family":"Le\u00f3n-Mu\u00f1oz","sequence":"first","affiliation":[{"name":"Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sof\u00eda, 30003 Murcia, Spain"},{"name":"Instituto de Cirug\u00eda Avanzada de la Rodilla (ICAR), 30005 Murcia, Spain"}]},{"given":"Fernando","family":"Santonja-Medina","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery and Traumatology, Hospital Cl\u00ednico Universitario Virgen de la Arrixaca, 30120 Murcia, Spain"},{"name":"Department of Surgery, Paediatrics and Obstetrics & Gynaecology, Faculty of Medicine, University of Murcia, 30120 Murcia, Spain"}]},{"given":"Francisco","family":"Lajara-Marco","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sof\u00eda, 30003 Murcia, Spain"}]},{"given":"Alonso J.","family":"Lis\u00f3n-Almagro","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sof\u00eda, 30003 Murcia, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4831-9830","authenticated-orcid":false,"given":"Jes\u00fas","family":"Jim\u00e9nez-Olivares","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery and Traumatology, Hospital Vega Baja, 03314 Orihuela, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-0551-0341","authenticated-orcid":false,"given":"Carmelo","family":"Mar\u00edn-Mart\u00ednez","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sof\u00eda, 30003 Murcia, Spain"}]},{"given":"Salvador","family":"Amor-Jim\u00e9nez","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sof\u00eda, 30003 Murcia, Spain"}]},{"given":"Elena","family":"Gali\u00e1n-Mu\u00f1oz","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sof\u00eda, 30003 Murcia, Spain"}]},{"given":"Mirian","family":"L\u00f3pez-L\u00f3pez","sequence":"additional","affiliation":[{"name":"Department of Information Technologies, Subdirecci\u00f3n General de Tecnolog\u00edas de la Informaci\u00f3n, Servicio Murciano de Salud, 30100 Murcia, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3520-2521","authenticated-orcid":false,"given":"Joaqu\u00edn","family":"Moya-Angeler","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery and Traumatology, Hospital General Universitario Reina Sof\u00eda, 30003 Murcia, Spain"},{"name":"Instituto de Cirug\u00eda Avanzada de la Rodilla (ICAR), 30005 Murcia, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1097\/01.blo.0000126866.29933.42","article-title":"Computed Tomography-Based Navigation for Hip, Knee, and Spine Surgery","volume":"421","author":"Amiot","year":"2004","journal-title":"Clin. Orthop. Relat. Res."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.knee.2009.12.010","article-title":"The accuracy of acquisition of an imageless computer-assisted system and its implication for knee arthroplasty","volume":"18","author":"Lustig","year":"2011","journal-title":"Knee"},{"key":"ref_3","unstructured":"Marco, L., and Farinella, G.M. (2018). Computer Vision for Assistive Healthcare, Academic Press."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"81","DOI":"10.4103\/jcvjs.JCVJS_48_20","article-title":"Augmented reality and artificial intelligence-assisted surgical navigation: Technique and cadaveric feasibility study","volume":"11","author":"Siemionow","year":"2020","journal-title":"J. Craniovertebral Junction Spine"},{"key":"ref_5","first-page":"1321","article-title":"A taxonomy of mixed reality visual displays","volume":"77","author":"Milgram","year":"1994","journal-title":"IEICE Trans. Inf. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1016\/j.jcot.2021.04.031","article-title":"Opportunities and challenges of using augmented reality and heads-up display in orthopaedic surgery: A narrative review","volume":"18","author":"Ha","year":"2021","journal-title":"J. Clin. Orthop. Trauma"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2280","DOI":"10.1016\/j.patcog.2014.01.005","article-title":"Automatic generation and detection of highly reliable fiducial markers under occlusion","volume":"47","year":"2014","journal-title":"Pattern Recognit."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.imavis.2018.05.004","article-title":"Speeded up detection of squared fiducial markers","volume":"76","year":"2018","journal-title":"Image Vis. Comput."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Le\u00f3n-Mu\u00f1oz, V.J., Moya-Angeler, J., L\u00f3pez-L\u00f3pez, M., Lis\u00f3n-Almagro, A.J., Mart\u00ednez-Mart\u00ednez, F., and Santonja-Medina, F. (2023). Integration of Square Fiducial Markers in Patient-Specific Instrumentation and Their Applicability in Knee Surgery. J. Pers. Med., 13.","DOI":"10.3390\/jpm13050727"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1007\/s12178-021-09699-3","article-title":"Augmented Reality in Orthopedic Surgery Is Emerging from Proof of Concept Towards Clinical Studies: A Literature Review Explaining the Technology and Current State of the Art","volume":"14","author":"Casari","year":"2021","journal-title":"Curr. Rev. Musculoskelet. Med."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1007\/s12178-021-09728-1","article-title":"Augmented Reality (AR) in Orthopedics: Current Applications and Future Directions","volume":"14","author":"Furman","year":"2021","journal-title":"Curr. Rev. Musculoskelet. Med."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Jud, L., Fotouhi, J., Andronic, O., Aichmair, A., Osgood, G., Navab, N., and Farshad, M. (2020). Applicability of augmented reality in orthopedic surgery\u2014A systematic review. BMC Musculoskelet. Disord., 21.","DOI":"10.1186\/s12891-020-3110-2"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1007\/s12178-021-09713-8","article-title":"The Clinical Application of Augmented Reality in Orthopaedics: Where Do We Stand?","volume":"14","author":"Matthews","year":"2021","journal-title":"Curr. Rev. Musculoskelet. Med."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1479","DOI":"10.1302\/0301-620X.101B12.BJJ-2019-0315.R1","article-title":"Augmented reality in orthopaedics: A systematic review and a window on future possibilities","volume":"101-B","author":"Corban","year":"2019","journal-title":"Bone Jt. J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1317","DOI":"10.1109\/TPAMI.2009.146","article-title":"Designing Highly Reliable Fiducial Markers","volume":"32","author":"Fiala","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_16","unstructured":"Fiala, M. (2005, January 20\u201325). ARTag, a fiducial marker system using digital techniques. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"811","DOI":"10.1080\/026404101317015447","article-title":"Selected issues in the design and analysis of sport performance research","volume":"19","author":"Atkinson","year":"2001","journal-title":"J. Sports Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2165\/00007256-200030010-00001","article-title":"Measures of Reliability in Sports Medicine and Science","volume":"30","author":"Hopkins","year":"2000","journal-title":"Sport. Med."},{"key":"ref_19","first-page":"7","article-title":"Factors Impacting Initial Arthroscopy Performance and Skill Progression in Novice Trainees","volume":"39","author":"Cychosz","year":"2019","journal-title":"Iowa Orthop. J."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1328","DOI":"10.1016\/j.arthro.2015.12.047","article-title":"Correlation Between Arthroscopy Simulator and Video Game Performance: A Cross-Sectional Study of 30 Volunteers Comparing 2- and 3-Dimensional Video Games","volume":"32","author":"Jentzsch","year":"2016","journal-title":"Arthrosc. J. Arthrosc. Relat. Surg. Off. Publ. Arthrosc. Assoc. N. Am. Int. Arthrosc. Assoc."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1037\/0033-2909.86.2.420","article-title":"Intraclass correlations: Uses in assessing rater reliability","volume":"86","author":"Shrout","year":"1979","journal-title":"Psychol. Bull."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1249\/MSS.0b013e31818cb278","article-title":"Progressive Statistics for Studies in Sports Medicine and Exercise Science","volume":"41","author":"Hopkins","year":"2009","journal-title":"Med. Sci. Sport. Exerc."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1103","DOI":"10.1037\/0003-066X.50.12.1103","article-title":"The earth is round (p < 0.05): Rejoinder","volume":"50","author":"Cohen","year":"1995","journal-title":"Am. Psychol."},{"key":"ref_25","first-page":"9358369","article-title":"Augmented Reality for Assistance of Total Knee Replacement","volume":"2016","author":"Daniel","year":"2016","journal-title":"J. Electr. Comput. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"e1958","DOI":"10.1002\/rcs.1958","article-title":"A novel augmented reality (AR) scheme for knee replacement surgery by considering cutting error accuracy","volume":"15","author":"Pokhrel","year":"2019","journal-title":"Int. J. Med. Robot."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1186\/s40634-022-00525-4","article-title":"Augmented reality-aided unicompartmental knee arthroplasty","volume":"9","author":"Tsukada","year":"2022","journal-title":"J. Exp. Orthop."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1186\/s40634-019-0212-6","article-title":"Augmented reality-based navigation system applied to tibial bone resection in total knee arthroplasty","volume":"6","author":"Tsukada","year":"2019","journal-title":"J. Exp. Orthop."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"e21","DOI":"10.2106\/JBJS.OA.21.00001","article-title":"Augmented Reality-Assisted Femoral Bone Resection in Total Knee Arthroplasty","volume":"6","author":"Tsukada","year":"2021","journal-title":"JBJS Open Access"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Guerrero, G., da Silva, F.J.M., Fern\u00e1ndez-Caballero, A., and Pereira, A. (2022). Augmented Humanity: A Systematic Mapping Review. Sensors, 22.","DOI":"10.3390\/s22020514"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1636","DOI":"10.1016\/j.arth.2020.01.025","article-title":"Augmented Reality for Acetabular Component Placement in Direct Anterior Total Hip Arthroplasty","volume":"35","author":"Alexander","year":"2020","journal-title":"J. Arthroplast."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"21205","DOI":"10.1117\/1.JMI.5.2.021205","article-title":"Plan in 2-D, execute in 3-D: An augmented reality solution for cup placement in total hip arthroplasty","volume":"5","author":"Fotouhi","year":"2018","journal-title":"J. Med. Imaging"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1595","DOI":"10.1007\/s10439-018-2055-1","article-title":"Augmented Reality Based Navigation for Computer Assisted Hip Resurfacing: A Proof of Concept Study","volume":"46","author":"Liu","year":"2018","journal-title":"Ann. Biomed. Eng."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1833","DOI":"10.1016\/j.arth.2018.01.067","article-title":"A Pilot Study of Augmented Reality Technology Applied to the Acetabular Cup Placement During Total Hip Arthroplasty","volume":"33","author":"Ogawa","year":"2018","journal-title":"J. Arthroplast."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1097\/CORR.0000000000001083","article-title":"Does An Augmented Reality-based Portable Navigation System Improve the Accuracy of Acetabular Component Orientation During THA? A Randomized Controlled Trial","volume":"478","author":"Ogawa","year":"2020","journal-title":"Clin. Orthop. Relat. Res."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2111","DOI":"10.1007\/s11548-016-1426-z","article-title":"An augmented reality C-arm for intraoperative assessment of the mechanical axis: A preclinical study","volume":"11","author":"Fallavollita","year":"2016","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1186\/s40634-021-00374-7","article-title":"The use of augmented reality for limb and component alignment in total knee arthroplasty: Systematic review of the literature and clinical pilot study","volume":"8","author":"Iacono","year":"2021","journal-title":"J. Exp. Orthop."},{"key":"ref_38","first-page":"e34607","article-title":"Augmented Reality Navigation Can Achieve Accurate Coronal Component Alignment During Total Knee Arthroplasty","volume":"15","author":"Bennett","year":"2023","journal-title":"Cureus"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1295","DOI":"10.1109\/TBME.2014.2301191","article-title":"Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery","volume":"61","author":"Wang","year":"2014","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"e1754","DOI":"10.1002\/rcs.1754","article-title":"Video see-through augmented reality for oral and maxillofacial surgery","volume":"13","author":"Wang","year":"2017","journal-title":"Int. J. Med. Robot."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/19\/8091\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:58:46Z","timestamp":1760129926000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/19\/8091"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,26]]},"references-count":40,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["s23198091"],"URL":"https:\/\/doi.org\/10.3390\/s23198091","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,26]]}}}