{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T02:58:14Z","timestamp":1784170694550,"version":"3.55.0"},"reference-count":45,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,1,30]],"date-time":"2022-01-30T00:00:00Z","timestamp":1643500800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council","doi-asserted-by":"publisher","award":["RGPIN-2019-06367"],"award-info":[{"award-number":["RGPIN-2019-06367"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100004411","name":"Heart and Stroke Foundation of Canada","doi-asserted-by":"publisher","award":["National New Investigator"],"award-info":[{"award-number":["National New Investigator"]}],"id":[{"id":"10.13039\/100004411","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>By aligning virtual augmentations with real objects, optical see-through head-mounted display (OST-HMD)-based augmented reality (AR) can enhance user-task performance. Our goal was to compare the perceptual accuracy of several visualization paradigms involving an adjacent monitor, or the Microsoft HoloLens 2 OST-HMD, in a targeted task, as well as to assess the feasibility of displaying imaging-derived virtual models aligned with the injured porcine heart. With 10 participants, we performed a user study to quantify and compare the accuracy, speed, and subjective workload of each paradigm in the completion of a point-and-trace task that simulated surgical targeting. To demonstrate the clinical potential of our system, we assessed its use for the visualization of magnetic resonance imaging (MRI)-based anatomical models, aligned with the surgically exposed heart in a motion-arrested open-chest porcine model. Using the HoloLens 2 with alignment of the ground truth target and our display calibration method, users were able to achieve submillimeter accuracy (0.98 mm) and required 1.42 min for calibration in the point-and-trace task. In the porcine study, we observed good spatial agreement between the MRI-models and target surgical site. The use of an OST-HMD led to improved perceptual accuracy and task-completion times in a simulated targeting task.<\/jats:p>","DOI":"10.3390\/jimaging8020033","type":"journal-article","created":{"date-parts":[[2022,1,31]],"date-time":"2022-01-31T01:46:08Z","timestamp":1643593568000},"page":"33","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Head-Mounted Display-Based Augmented Reality for Image-Guided Media Delivery to the Heart: A Preliminary Investigation of Perceptual Accuracy"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7617-307X","authenticated-orcid":false,"given":"Mitchell","family":"Doughty","sequence":"first","affiliation":[{"name":"Department of Medical Biophysics, University of Toronto, Toronto, ON M5S 1A1, Canada"},{"name":"Schulich Heart Program, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M5, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nilesh R.","family":"Ghugre","sequence":"additional","affiliation":[{"name":"Department of Medical Biophysics, University of Toronto, Toronto, ON M5S 1A1, Canada"},{"name":"Schulich Heart Program, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M5, Canada"},{"name":"Physical Sciences Platform, Sunnybrook Research Institute, Toronto, ON M4N 3M5, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"426","DOI":"10.1161\/CIR.0000000000000558","article-title":"Heart Disease and Stroke Statistics\u20142018 Update: A Report From the American Heart Association","volume":"137","author":"Benjamin","year":"2018","journal-title":"Circulation"},{"key":"ref_2","unstructured":"(2018, March 09). Heart and Stroke, The Burden of Heart Failure. Available online: https:\/\/www.heartandstroke.ca\/-\/media\/pdf-files\/canada\/2017-heart-month\/heartandstroke-reportonhealth-2016.ashx?la=en."},{"key":"ref_3","unstructured":"(2021, December 28). Canadian Organ Replacement Register Annual Report: Treatment of End-Stage Organ Failure in Canada, 2004 to 2013. Heart Transplant. Available online: https:\/\/globalnews.ca\/wp-content\/uploads\/2015\/04\/2015_corr_annualreport_enweb.pdf."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1016\/S0140-6736(11)61126-4","article-title":"The effects of the cardiac myosin activator, omecamtiv mecarbil, on cardiac function in systolic heart failure: A double-blind, placebo-controlled, crossover, dose-ranging phase 2 trial","volume":"378","author":"Cleland","year":"2011","journal-title":"Lancet"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"126","DOI":"10.3389\/fbioe.2020.00126","article-title":"Inducing Endogenous Cardiac Regeneration: Can Biomaterials Connect the Dots?","volume":"8","author":"Bar","year":"2020","journal-title":"Front. Bioeng. Biotechnol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.carpath.2015.02.004","article-title":"The winding road to regenerating the human heart","volume":"24","author":"Gerbin","year":"2015","journal-title":"Cardiovasc. Pathol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"804","DOI":"10.1038\/nbt.2993","article-title":"Clinical imaging in regenerative medicine","volume":"32","author":"Naumova","year":"2014","journal-title":"Nat. Biotechnol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1038\/nature13233","article-title":"Human Embryonic Stem Cell-Derived Cardiomyocytes Regenerate Non-Human Primate Hearts","volume":"510","author":"Chong","year":"2014","journal-title":"Nature"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"6850","DOI":"10.1016\/j.biomaterials.2014.04.114","article-title":"Comparison of biomaterial delivery vehicles for improving acute retention of stem cells in the infarcted heart","volume":"35","author":"Roche","year":"2014","journal-title":"Biomaterials"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1095","DOI":"10.1002\/mrm.24531","article-title":"Quantitative magnetic resonance imaging can distinguish remodeling mechanisms after acute myocardial infarction based on the severity of ischemic insult: Remodeling Mechanisms After AMI With Quantitative MRI","volume":"70","author":"Ghugre","year":"2013","journal-title":"Magn. Reson. Med."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1146\/annurev-bioeng-070909-105249","article-title":"Image-Guided Interventions: Technology Review and Clinical Applications","volume":"12","author":"Cleary","year":"2010","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1032","DOI":"10.1213\/ANE.0b013e3181d3e647","article-title":"Monitoring with Head-Mounted Displays in General Anesthesia: A Clinical Evaluation in the Operating Room","volume":"110","author":"Liu","year":"2010","journal-title":"Anesth. Analg."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1177\/1553350619871787","article-title":"Head-Mounted Display Use in Surgery: A Systematic Review","volume":"27","author":"Rahman","year":"2020","journal-title":"Surg. Innov."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1007\/s10143-016-0732-9","article-title":"Augmented reality in neurosurgery: A systematic review","volume":"40","author":"Meola","year":"2017","journal-title":"Neurosurg. Rev."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Jud, L., Fotouhi, J., Andronic, O., Aichmair, A., Osgood, G., Navab, N., and Farshad, M. (2020). Applicability of augmented reality in orthopedic surgery\u2014A systematic review. BMC Musculoskelet. Disord., 21.","DOI":"10.1186\/s12891-020-3110-2"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.media.2017.01.007","article-title":"The status of augmented reality in laparoscopic surgery as of 2016","volume":"37","author":"Bernhardt","year":"2017","journal-title":"Med. Image Anal."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"179","DOI":"10.5999\/aps.2017.44.3.179","article-title":"Virtual Reality and Augmented Reality in Plastic Surgery: A Review","volume":"44","author":"Kim","year":"2017","journal-title":"Arch. Plast. Surg."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1109\/TBME.2019.2914517","article-title":"Perceptual Limits of Optical See-Through Visors for Augmented Reality Guidance of Manual Tasks","volume":"67","author":"Condino","year":"2020","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_19","unstructured":"Qian, L., Song, T., Unberath, M., and Kazanzides, P. (2020). AR-Loupe: Magnified Augmented Reality by Combining an Optical See-Through Head-Mounted Display and a Loupe. IEEE Trans. Vis. Comput. Graph., 1."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Fischer, M., Leuze, C., Perkins, S., Rosenberg, J., Daniel, B., and Martin-Gomez, A. (2020, January 9\u201313). Evaluation of Different Visualization Techniques for Perception-Based Alignment in Medical AR. Proceedings of the 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Recife, Brazil.","DOI":"10.1109\/ISMAR-Adjunct51615.2020.00027"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2722","DOI":"10.1109\/LRA.2020.2972831","article-title":"Reflective-AR Display: An Interaction Methodology for Virtual-to-Real Alignment in Medical Robotics","volume":"5","author":"Fotouhi","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"e10967","DOI":"10.2196\/10967","article-title":"Augmented Reality in Medicine: Systematic and Bibliographic Review","volume":"7","author":"Eckert","year":"2019","journal-title":"JMIR MHealth UHealth"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1109\/JDT.2008.2001575","article-title":"Advanced Medical Displays: A Literature Review of Augmented Reality","volume":"4","author":"Sielhorst","year":"2008","journal-title":"J. Disp. Technol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1912","DOI":"10.1109\/TVCG.2015.2473855","article-title":"Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays","volume":"22","author":"Kramida","year":"2016","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_25","unstructured":"Doughty, M., Singh, K., and Ghugre, N.R. (October, January 27). SurgeonAssist-Net: Towards Context-Aware Head-Mounted Display-Based Augmented Reality for Surgical Guidance. Proceedings of the Medical Image Computing and Computer Assisted Intervention (MICCAI), Strasbourg, France."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2649","DOI":"10.1109\/TVCG.2017.2754257","article-title":"A Survey of Calibration Methods for Optical See-Through Head-Mounted Displays","volume":"24","author":"Grubert","year":"2018","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_28","unstructured":"Tuceryan, M., and Navab, N. (2000, January 5\u20136). Single point active alignment method (SPAAM) for optical see-through HMD calibration for AR. Proceedings of the IEEE and ACM International Symposium on Augmented Reality (ISAR 2000), Munich, Germany."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Owen, C.B., Zhou, J., Tang, A., and Xiao, F. (2004, January 5). Display-Relative Calibration for Optical See-Through Head-Mounted Displays. Proceedings of the Third IEEE and ACM International Symposium on Mixed and Augmented Reality, Arlington, VA, USA.","DOI":"10.1109\/ISMAR.2004.28"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1109\/TVCG.2015.2391857","article-title":"Corneal-Imaging Calibration for Optical See-Through Head-Mounted Displays","volume":"21","author":"Plopski","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_31","unstructured":"Azimi, E., Qian, L., Navab, N., and Kazanzides, P. (2017). Alignment of the Virtual Scene to the Tracking Space of a Mixed Reality Head-Mounted Display. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1109\/TPAMI.1987.4767965","article-title":"Least-Squares Fitting of Two 3-D Point Sets","volume":"PAMI-9","author":"Arun","year":"1987","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/BF02289451","article-title":"A generalized solution of the orthogonal procrustes problem","volume":"31","year":"1966","journal-title":"Psychometrika"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2280","DOI":"10.1016\/j.patcog.2014.01.005","article-title":"Automatic generation and detection of highly reliable fiducial markers under occlusion","volume":"47","year":"2014","journal-title":"Pattern Recognit."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1109\/RBME.2010.2082522","article-title":"Virtual and Augmented Medical Imaging Environments: Enabling Technology for Minimally Invasive Cardiac Interventional Guidance","volume":"3","author":"Linte","year":"2010","journal-title":"IEEE Rev. Biomed. Eng."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"694","DOI":"10.1109\/42.736021","article-title":"Predicting error in rigid-body point-based registration","volume":"17","author":"Fitzpatrick","year":"1998","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/S0166-4115(08)62386-9","article-title":"Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research","volume":"Volume 52","author":"Hancock","year":"1988","journal-title":"Advances in Psychology"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1093\/biomet\/52.3-4.591","article-title":"An Analysis of Variance Test for Normality (Complete Samples)","volume":"52","author":"Shapiro","year":"1965","journal-title":"Biometrika"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1136\/heartjnl-2014-306963","article-title":"MRI in the assessment of ischaemic heart disease","volume":"102","author":"Dastidar","year":"2016","journal-title":"Heart"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Jolesz, F.A. (2014). 3D Slicer: A Platform for Subject-Specific Image Analysis, Visualization, and Clinical Support. Intraoperative Imaging and Image-Guided Therapy, Springer.","DOI":"10.1007\/978-1-4614-7657-3"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Ballestin, G., Chessa, M., and Solari, F. (2019, January 27\u201328). Assessment of Optical See-Through Head Mounted Display Calibration for Interactive Augmented Reality. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Korea.","DOI":"10.1109\/ICCVW.2019.00546"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Kunz, C., Genten, V., Mei\u00dfner, P., and Hein, B. (2019, January 16\u201321). Metric-based evaluation of fiducial markers for medical procedures. Proceedings of the Medical Imaging 2019: Image-Guided Procedures, Robotic Interventions, and Modeling, San Diego, CA, USA.","DOI":"10.1117\/12.2511720"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1007\/s10334-019-00788-6","article-title":"Measuring geometric accuracy in magnetic resonance imaging with 3D-printed phantom and nonrigid image registration","volume":"33","author":"Nousiainen","year":"2020","journal-title":"Magn. Reson. Mater. Phys. Biol. Med."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1510\/icvts.2004.098517","article-title":"Do cardiac stabilizers really stabilize? Experimental quantitative analysis of mechanical stabilization","volume":"4","author":"Lemma","year":"2005","journal-title":"Interact. Cardiovasc. Thorac. Surg."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2017","DOI":"10.1002\/mrm.27187","article-title":"MR imaging of magnetic ink patterns via off-resonance sensitivity","volume":"80","author":"Perkins","year":"2018","journal-title":"Magn. Reson. Med."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/8\/2\/33\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:11:24Z","timestamp":1760134284000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/8\/2\/33"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,30]]},"references-count":45,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["jimaging8020033"],"URL":"https:\/\/doi.org\/10.3390\/jimaging8020033","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,30]]}}}