{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,10]],"date-time":"2026-11-10T17:58:53Z","timestamp":1794333533978,"version":"4.9.0"},"reference-count":34,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2021,4,22]],"date-time":"2021-04-22T00:00:00Z","timestamp":1619049600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61973211"],"award-info":[{"award-number":["61973211"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["51911540479"],"award-info":[{"award-number":["51911540479"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2019YFC0120603"],"award-info":[{"award-number":["2019YFC0120603"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"name":"The Key project of Medical Engineering (Science) cross research fund of Shanghai Jiaotong University","award":["YG2017ZD03"],"award-info":[{"award-number":["YG2017ZD03"]}]},{"name":"The Key project of Medical Engineering (Science) cross research fund of Shanghai Jiaotong University","award":["YG2019ZDA22"],"award-info":[{"award-number":["YG2019ZDA22"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In the medical field, guidance to follow the surgical plan is crucial. Image overlay projection is a solution to link the surgical plan with the patient. It realizes augmented reality (AR) by projecting computer-generated image on the surface of the target through a projector, which can visualize additional information to the scene. By overlaying anatomical information or surgical plans on the surgery area, projection helps to enhance the surgeon\u2019s understanding of the anatomical structure, and intuitively visualizes the surgical target and key structures of the operation, and avoid the surgeon\u2019s sight diversion between monitor and patient. However, it still remains a challenge to project the surgical navigation information on the target precisely and efficiently. In this study, we propose a projector-based surgical navigation system. Through the gray code-based calibration method, the projector can be calibrated with a camera and then be integrated with an optical spatial locator, so that the navigation information of the operation can be accurately projected onto the target area. We validated the projection accuracy of the system through back projection, with average projection error of 3.37 pixels in x direction and 1.51 pixels in y direction, and model projection with an average position error of 1.03 \u00b1 0.43 mm, and carried out puncture experiments using the system with correct rate of 99%, and qualitatively analyzed the system\u2019s performance through the questionnaire. The results demonstrate the efficacy of our proposed AR system.<\/jats:p>","DOI":"10.3390\/s21092931","type":"journal-article","created":{"date-parts":[[2021,4,22]],"date-time":"2021-04-22T21:25:56Z","timestamp":1619126756000},"page":"2931","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery"],"prefix":"10.3390","volume":"21","author":[{"given":"Yuan","family":"Gao","sequence":"first","affiliation":[{"name":"Institute of Forming Technology &amp; Equipment, Shanghai Jiao Tong University, Shanghai 200030, China"},{"name":"Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0422-6077","authenticated-orcid":false,"given":"Yuyun","family":"Zhao","sequence":"additional","affiliation":[{"name":"Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China"},{"name":"School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Le","family":"Xie","sequence":"additional","affiliation":[{"name":"Institute of Forming Technology &amp; Equipment, Shanghai Jiao Tong University, Shanghai 200030, China"},{"name":"Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4173-0379","authenticated-orcid":false,"given":"Guoyan","family":"Zheng","sequence":"additional","affiliation":[{"name":"Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China"},{"name":"School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"e740","DOI":"10.1002\/mp.13058","article-title":"Recent advances on the development of phantoms using 3D printing for imaging with CT, MRI, PET, SPECT, and ultrasound","volume":"45","author":"Filippou","year":"2018","journal-title":"Med. Phys."},{"key":"ref_2","first-page":"229","article-title":"A stereotaxic apparatus for intracerebral surgery","volume":"99","author":"Leksell","year":"1960","journal-title":"Acta Chir. Scand."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"E11","DOI":"10.3171\/2009.6.FOCUS09109","article-title":"Neuronavigation: Geneology, reality, and prospects","volume":"27","author":"Yavor","year":"2009","journal-title":"Neurosurg. Focus"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"631","DOI":"10.3928\/01477447-20130724-10","article-title":"Computer-assisted navigation in orthopedic surgery","volume":"36","author":"Mavrogenis","year":"2013","journal-title":"Orthopedics"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"66","DOI":"10.3389\/fsurg.2015.00066","article-title":"Computer-assisted orthopedic surgery: Current state and future perspective","volume":"2","author":"Zheng","year":"2015","journal-title":"Front. Surg."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TMRB.2019.2957061","article-title":"A review of augmented reality in robotic-assisted surgery","volume":"2","author":"Qian","year":"2019","journal-title":"IEEE Trans. Med. Robot. Bionics"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1162\/pres.1997.6.4.355","article-title":"A survey of augmented reality","volume":"6","author":"Azuma","year":"1997","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Lyu, M.R., King, I., Wong, T.T., Yau, E., and Chan, P.W. (2005, January 5\u201312). ARCADE: Augmented Reality Computing Arena for Digital Entertainment. Proceedings of the 2005 IEEE Aerospace Conference, Big Sky, MT, USA.","DOI":"10.1109\/AERO.2005.1559626"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1007\/s11528-012-0559-3","article-title":"Augmented reality in education and training","volume":"56","author":"Lee","year":"2012","journal-title":"TechTrends"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Livingston, M.A., Rosenblum, L.J., Brown, D.G., Schmidt, G.S., Julier, S.J., Baillot, Y., Swan, J.E., Ai, Z., and Maassel, P. (2011). Military applications of augmented reality. Handbook of Augmented Reality, Springer.","DOI":"10.1007\/978-1-4614-0064-6_31"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Fern\u00e1ndez-Caram\u00e9s, T.M., Fraga-Lamas, P., Su\u00e1rez-Albela, M., and Vilar-Montesinos, M. (2018). A fog computing and cloudlet based augmented reality system for the industry 4.0 shipyard. Sensors, 18.","DOI":"10.3390\/s18061798"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Condino, S., Turini, G., Parchi, P.D., Viglialoro, R.M., Piolanti, N., Gesi, M., Ferrari, M., and Ferrari, V. (2018). How to build a patient-specific hybrid simulator for Orthopaedic open surgery: Benefits and limits of mixed-reality using the Microsoft HoloLens. J. Healthc. Eng., 2018.","DOI":"10.1155\/2018\/5435097"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"883","DOI":"10.1093\/ehjci\/jey184","article-title":"Mixed reality holograms for heart surgery planning: First user experience in congenital heart disease","volume":"20","author":"Brun","year":"2019","journal-title":"Eur. Heart J. Cardiovasc. Imaging"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1007\/s13304-018-0567-8","article-title":"Augmented reality in open surgery","volume":"70","author":"Fida","year":"2018","journal-title":"Updat. Surg."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Bimber, O., and Raskar, R. (2005). Spatial Augmented Reality: Merging Real and Virtual Worlds, CRC Press.","DOI":"10.1201\/b10624"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1016\/j.ics.2005.03.277","article-title":"Clinical and experimental evaluation of an augmented reality system in cranio-maxillofacial surgery","volume":"1281","author":"Mischkowski","year":"2005","journal-title":"Int. Congr. Ser."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1295","DOI":"10.1109\/TBME.2014.2301191","article-title":"Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery","volume":"61","author":"Wang","year":"2014","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_18","first-page":"548","article-title":"Projector-based augmented reality in surgery without calibration","volume":"Volume 1","author":"Tardif","year":"2003","journal-title":"Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No. 03CH37439)"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"944","DOI":"10.1016\/j.ijrobp.2007.10.048","article-title":"Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3D interstitial brachytherapy","volume":"70","author":"Krempien","year":"2008","journal-title":"Int. J. Radiat. Oncol. Biol. Phys."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1007\/s11548-011-0660-7","article-title":"Evaluation of a portable image overlay projector for the visualisation of surgical navigation data: Phantom studies","volume":"7","author":"Gavaghan","year":"2012","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"869","DOI":"10.1016\/j.cmpb.2013.12.021","article-title":"Real-time advanced spinal surgery via visible patient model and augmented reality system","volume":"113","author":"Wu","year":"2014","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Laviole, J., and Hachet, M. (2012). Spatial augmented reality to enhance physical artistic creation. Proceedings of the Adjunct 25th Annual ACM Symposium on User Interface Software and Technology, Association for Computing Machinery.","DOI":"10.1145\/2380296.2380316"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Benko, H., Ofek, E., Zheng, F., and Wilson, A.D. (2015). Fovear: Combining an optically see-through near-eye display with projector-based spatial augmented reality. Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, Association for Computing Machinery.","DOI":"10.1145\/2807442.2807493"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1457","DOI":"10.1109\/TVCG.2018.2793659","article-title":"Hysar: Hybrid material rendering by an optical see-through head-mounted display with spatial augmented reality projection","volume":"24","author":"Hamasaki","year":"2018","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1279","DOI":"10.1109\/TVCG.2015.2459792","article-title":"Softar: Visually manipulating haptic softness perception in spatial augmented reality","volume":"21","author":"Punpongsanon","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_26","unstructured":"Frank, G. (1953). Pulse Code Communication. (2,632,058), U.S. Patent."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Moreno, D., and Taubin, G. (2012, January 13\u201315). Simple, Accurate, and Robust Projector-Camera Calibration. Proceedings of the 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization Transmission, Zurich, Switzerland.","DOI":"10.1109\/3DIMPVT.2012.77"},{"key":"ref_28","unstructured":"Schmalz, C. (2011). Robust Single-Shot Structured Light 3D Scanning. [Ph.D. Thesis, Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU)]."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1016\/j.patcog.2003.10.002","article-title":"Pattern codification strategies in structured light systems","volume":"37","author":"Salvi","year":"2004","journal-title":"Pattern Recognit."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1016\/S0262-8856(03)00137-9","article-title":"Image registration methods: A survey","volume":"21","author":"Zitova","year":"2003","journal-title":"Image Vis. Comput."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1001\/archsurg.139.2.170","article-title":"Augmented reality in surgery","volume":"139","author":"Shuhaiber","year":"2004","journal-title":"Arch. Surg."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Bimber, O., and Raskar, R. (2006). Modern approaches to augmented reality. ACM SIGGRAPH 2006 Courses, ACM.","DOI":"10.1145\/1185657.1185796"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/9\/2931\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:51:15Z","timestamp":1760161875000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/9\/2931"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,22]]},"references-count":34,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["s21092931"],"URL":"https:\/\/doi.org\/10.3390\/s21092931","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,22]]}}}