{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T09:47:26Z","timestamp":1782899246038,"version":"3.54.5"},"reference-count":51,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2017,10,10]],"date-time":"2017-10-10T00:00:00Z","timestamp":1507593600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Traditionally, rural areas in many countries are limited by a lack of access to health care due to the inherent challenges associated with recruitment and retention of healthcare professionals. Telemedicine, which uses communication technology to deliver medical services over distance, is an economical and potentially effective way to address this problem. In this research, we develop a new telepresence application using an Augmented Reality (AR) system. We explore the use of the Microsoft HoloLens to facilitate and enhance remote medical training. Intrinsic advantages of AR systems enable remote learners to perform complex medical procedures such as Point of Care Ultrasound (PoCUS) without visual interference. This research uses the HoloLens to capture the first-person view of a simulated rural emergency room (ER) through mixed reality capture (MRC) and serves as a novel telemedicine platform with remote pointing capabilities. The mentor\u2019s hand gestures are captured using a Leap Motion and virtually displayed in the AR space of the HoloLens. To explore the feasibility of the developed platform, twelve novice medical trainees were guided by a mentor through a simulated ultrasound exploration in a trauma scenario, as part of a pilot user study. The study explores the utility of the system from the trainees, mentor, and objective observers\u2019 perspectives and compares the findings to that of a more traditional multi-camera telemedicine solution. The results obtained provide valuable insight and guidance for the development of an AR-supported telemedicine platform.<\/jats:p>","DOI":"10.3390\/s17102294","type":"journal-article","created":{"date-parts":[[2017,10,10]],"date-time":"2017-10-10T10:34:29Z","timestamp":1507631669000},"page":"2294","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":185,"title":["Augmented Reality as a Telemedicine Platform for Remote Procedural Training"],"prefix":"10.3390","volume":"17","author":[{"given":"Shiyao","family":"Wang","sequence":"first","affiliation":[{"name":"Department of Computer Science, Memorial University of Newfoundland, St. John\u2019s, NL A1B 3X5, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Parsons","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, Memorial University of Newfoundland, St. John\u2019s, NL A1B 3V6, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jordan","family":"Stone-McLean","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, Memorial University of Newfoundland, St. John\u2019s, NL A1B 3V6, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Rogers","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, Memorial University of Newfoundland, St. John\u2019s, NL A1B 3V6, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Boyd","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, Memorial University of Newfoundland, St. John\u2019s, NL A1B 3V6, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kristopher","family":"Hoover","sequence":"additional","affiliation":[{"name":"Faculty of Engineering and Applied Science, Memorial University of Newfoundland, St. John\u2019s, NL A1B 3X5, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oscar","family":"Meruvia-Pastor","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Memorial University of Newfoundland, St. John\u2019s, NL A1B 3X5, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Minglun","family":"Gong","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Memorial University of Newfoundland, St. John\u2019s, NL A1B 3X5, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6007-2389","authenticated-orcid":false,"given":"Andrew","family":"Smith","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, Memorial University of Newfoundland, St. John\u2019s, NL A1B 3V6, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2017,10,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1186\/1478-4491-4-12","article-title":"Not enough there, too many here: Understanding geographical imbalances in the distribution of the health workforce","volume":"4","author":"Dussault","year":"2006","journal-title":"Hum. Resour. Health"},{"key":"ref_2","unstructured":"(2017, October 09). Rural Health in Rural Hands: Strategic Directions for Rural, Remote, Northern and Aboriginal Communities. Available online: http:\/\/www.ruralontarioinstitute.ca\/file.aspx?id=29b5ba0b-c6ce-489f-bb07-2febfb576daa."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1258\/1357633001935301","article-title":"User satisfaction with teleconsultations for surgery","volume":"6","author":"Aarnio","year":"2000","journal-title":"J. Telemed. Telecare"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1016\/j.ijmedinf.2005.11.001","article-title":"Success factors for telehealth: A case study","volume":"75","author":"Moehr","year":"2006","journal-title":"Int. J. Med. Inform."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1258\/1357633991932379","article-title":"Evaluation of a telepsychiatry pilot project","volume":"5","author":"Doze","year":"1999","journal-title":"J. Telemed. Telecare"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Mendez, I., Jong, M., Keays-White, D., and Turner, G. (2013). The use of remote presence for health care delivery in a northern Inuit community: A feasibility study. Int. J. Circumpolar Health, 72.","DOI":"10.3402\/ijch.v72i0.21112"},{"key":"ref_7","unstructured":"(2017, October 09). Facebook Has Oculus, Google Has Cardboard. Available online: https:\/\/www.cnet.com\/news\/facebook-has-oculus-google-has-cardboard\/."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Taylor, A.G. (2016). Develop Microsoft HoloLens Apps Now, Springer.","DOI":"10.1007\/978-1-4842-2202-7"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Grimshaw, M. (2014). Medical Clinical Uses of Virtual Worlds. The Oxford Handbook of Virtuality, Oxford University Press.","DOI":"10.1093\/oxfordhb\/9780199826162.001.0001"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4605","DOI":"10.1118\/1.2805475","article-title":"Creation and establishment of a respiratory liver motion simulator for liver interventions","volume":"34","author":"Mehrabi","year":"2007","journal-title":"Med. Phys."},{"key":"ref_11","first-page":"47","article-title":"The use of computer-assisted system in ear surgery","volume":"48","author":"Ogata","year":"2005","journal-title":"Oto-Rhino-Laryngol. Tokyo"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Meola, A., Cutolo, F., Carbone, M., Cagnazzo, F., Ferrari, M., and Ferrari, V. (2016). Augmented reality in neurosurgery: A systematic review. Neurosurgical rev., 1\u201312.","DOI":"10.1007\/s10143-016-0732-9"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1001\/jamafacial.2013.316","article-title":"Computer-guided orbital reconstruction to improve outcomes","volume":"15","author":"Bly","year":"2013","journal-title":"JAMA Facial Plast. Surg."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1016\/j.jcms.2014.10.019","article-title":"Precise positioning of an intraoral distractor using augmented reality in patients with hemifacial microsomia","volume":"43","author":"Qu","year":"2015","journal-title":"J. Cranio-Maxillofac. Surg."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1970","DOI":"10.1016\/j.jcms.2014.09.001","article-title":"Augmented reality as an aid in maxillofacial surgery: Validation of a wearable system allowing maxillary repositioning","volume":"42","author":"Badiali","year":"2014","journal-title":"J. Cranio-Maxillofac. Surg."},{"key":"ref_16","first-page":"51","article-title":"Augmented Reality in Medical Education and Training","volume":"13","author":"Herron","year":"2016","journal-title":"J. Electron. Resour. Med. Lib."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1097\/NNE.0000000000000295","article-title":"Virtually Nursing: Emerging Technologies in Nursing Education","volume":"42","author":"Foronda","year":"2017","journal-title":"Nurse Educ."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Alem, L., Tecchia, F., and Huang, W. (2011). HandsOnVideo: Towards a gesture based mobile AR system for remote collaboration. Recent Trends of Mobile Collaborative Augmented Reality Systems, Springer.","DOI":"10.1007\/978-1-4419-9845-3"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Tecchia, F., Alem, L., and Huang, W. (2012, January 2\u20134). 3D helping hands: a gesture based MR system for remote collaboration. Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry, Singapore.","DOI":"10.1145\/2407516.2407590"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Anton, D., Kurillo, G., Yang, A.Y., and Bajcsy, R. (2017, January 4\u20136). Augmented Telemedicine Platform for Real-Time Remote Medical Consultation. Proceedings of the International Conference on Multimedia Modeling, Reykjav\u00edk, Iceland.","DOI":"10.1007\/978-3-319-51811-4_7"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Kurillo, G., Yang, A.Y., Shia, V., Bair, A., and Bajcsy, R. (2016, January 17\u201322). New Emergency Medicine Paradigm via Augmented Telemedicine. Proceedings of the International Conference on Virtual, Augmented and Mixed Reality, Toronto, ON, Canada.","DOI":"10.1007\/978-3-319-39907-2_48"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sundar, S.S. (2015). Leveraging Psychology of Virtual Body for Health and Wellness. The Handbook of the Psychology of Communication Technology, John Wiley & Sons, Ltd.","DOI":"10.1002\/9781118426456"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Carbone, M., Freschi, C., Mascioli, S., Ferrari, V., and Ferrari, M. (2016, January 17\u201322). A Wearable Augmented Reality Platform for Telemedicine. Proceedings of the International Conference on Virtual, Augmented and Mixed Reality, Toronto, ON, Canada.","DOI":"10.1007\/978-3-319-40651-0_8"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"ons200","DOI":"10.1227\/NEU.0b013e3182077efd","article-title":"Virtual interactive presence and augmented reality (VIPAR) for remote surgical assistance","volume":"68","author":"Shenai","year":"2011","journal-title":"Oper. Neurosurg."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.future.2017.05.006","article-title":"Real-time communication for Kinect-based telerehabilitation","volume":"75","author":"Kurillo","year":"2017","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.future.2016.08.012","article-title":"Remote real-time collaboration through synchronous exchange of digitised human\u2013workpiece interactions","volume":"67","author":"Oyekan","year":"2017","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/j.ijsu.2014.02.003","article-title":"Google Glass in pediatric surgery: An exploratory study","volume":"12","author":"Muensterer","year":"2014","journal-title":"Int. J. Surg."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1017\/S1049023X1400140X","article-title":"Do you see what I see? Insights from using google glass for disaster telemedicine triage","volume":"30","author":"Cicero","year":"2015","journal-title":"Prehospital Disaster Med."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Knight, H., Gajendragadkar, P., and Bokhari, A. (2015). Wearable technology: Using Google Glass as a teaching tool. BMJ Case Rep.","DOI":"10.1136\/bcr-2014-208768"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2295","DOI":"10.1002\/lary.25249","article-title":"Using Google Glass to solve communication and surgical education challenges in the operating room","volume":"125","author":"Moshtaghi","year":"2015","journal-title":"Laryngoscope"},{"key":"ref_31","first-page":"1","article-title":"Using Google Glass to enhance pre-hospital care","volume":"30","author":"Widmer","year":"2014","journal-title":"Swiss Med. Inf."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Cui, N., Kharel, P., and Gruev, V. (2017). Augmented reality with Microsoft HoloLens Holograms for Near Infrared Fluorescence Based Image Guided Surgery. Proc. SPIE, 10049.","DOI":"10.1117\/12.2251625"},{"key":"ref_33","unstructured":"Pham, T., and Tang, A. (2017, January 16\u201319). User-Defined Gestures for Holographic Medical Analytics. Proceedings of the Graphics Interface, Edmonton, Alberta."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"616","DOI":"10.1109\/TVCG.2013.33","article-title":"Immersive group-to-group telepresence","volume":"19","author":"Beck","year":"2013","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1109\/MMUL.2013.12","article-title":"Viewport: A distributed, immersive teleconferencing system with infrared dot pattern","volume":"20","author":"Zhang","year":"2013","journal-title":"IEEE Trans. Multimedia"},{"key":"ref_36","unstructured":"Hachman, M. (2017, October 09). We Found 7 Critical HoloLens Details That Microsoft Hid Inside Its Developer Docs. Available online: http:\/\/www.pcworld.com\/article\/3039822\/consumer-electronics\/we-found-7-critical-hololens-details-that-microsoft-hid-inside-its-developer-docs.html."},{"key":"ref_37","unstructured":"Looker, J., and Garvey, T. (2017, October 09). Reaching for Holograms. Available online: http:\/\/www.dbpia.co.kr\/Journal\/ArticleDetail\/NODE06588268."},{"key":"ref_38","unstructured":"Munz, G. (2017, October 09). Microsoft Hololens May Cause Discomfort as It Gets Extremely Hot. Available online: https:\/\/infinityleap.com\/microsoft-hololens-may-cause-discomfort-as-it-gets-extremely-hot\/."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1111\/j.1460-2466.1992.tb00813.x","article-title":"I\u2019m not a real doctor, but I play one in virtual reality: Implications of virtual reality for judgments about reality","volume":"42","author":"Shapiro","year":"1992","journal-title":"J. Commun."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1055\/s-0038-1634953","article-title":"Virtual reality in medicine","volume":"32","author":"Kaltenborn","year":"1993","journal-title":"Methods Inf. Med."},{"key":"ref_41","unstructured":"De Lattre, A., Bilien, J., Daoud, A., Stenac, C., Cellerier, A., and Saman, J.P. (2017, October 09). VideoLAN Streaming Howto. Available online: https:\/\/pdfs.semanticscholar.org\/5124\/351d69bd3cbd95eca1e282fb8da05cd3761c.pdf."},{"key":"ref_42","first-page":"6","article-title":"Expert facilitated development of an objective assessment tool for point-of-care ultrasound performance in undergraduate medical education","volume":"8","author":"Black","year":"2016","journal-title":"Cureus"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1037\/0022-0663.100.1.223","article-title":"A comparison of three measures of cognitive load: Evidence for separable measures of intrinsic, extraneous, and germane load","volume":"100","author":"DeLeeuw","year":"2008","journal-title":"J. Educ. Psychol."},{"key":"ref_44","first-page":"2","article-title":"A Comprehensive Framework for Evaluation of Stereo Correspondence Solutions in Immersive Augmented and Virtual Realities","volume":"13","author":"Pourazar","year":"2016","journal-title":"J. Virtual Reality Broadcast."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Howard, I.P., and Rogers, B.J. (1995). Binocular vision and stereopsis, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780195084764.001.0001"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1145\/3047147","article-title":"Address the consequences of AI in advance","volume":"60","author":"Staff","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"93","DOI":"10.3109\/10929080500228654","article-title":"The impact of latency on surgical precision and task completion during robotic-assisted remote telepresence surgery","volume":"10","author":"Anvari","year":"2005","journal-title":"Comput. Aided Surg."},{"key":"ref_48","unstructured":"Geelhoed, E., Parker, A., Williams, D.J., and Groen, M. (2017, October 09). Effects of Latency on Telepresence. Available online: http:\/\/shiftleft.com\/mirrors\/www.hpl.hp.com\/techreports\/2009\/HPL-2009-120.pdf."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"946","DOI":"10.4338\/ACI-2016-06-LE-0094","article-title":"Patient Perceptions of Wearable Face-Mounted Computing Technology and the Effect on the Doctor-Patient Relationship","volume":"7","author":"Prochaska","year":"2016","journal-title":"Appl. Clin. Inf."},{"key":"ref_50","unstructured":"Microsoft (2017, October 09). Mixed Reality Capture for Developers. Available online: https:\/\/developer.microsoft.com\/en-us\/windows\/mixed-reality\/mixed_reality_capture_for_developers."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Aloman, A., Ispas, A., Ciot\u00eernae, P., Sanchez-Iborra, R., and Cano, M.D. (2015, January 5\u20137). Performance evaluation of video streaming using MPEG DASH, RTSP, and RTMP in mobile networks. Proceedings of the IFIP Wireless and Mobile Networking Conference (WMNC), Munich, Germany.","DOI":"10.1109\/WMNC.2015.12"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/10\/2294\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:46:51Z","timestamp":1760208411000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/10\/2294"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,10,10]]},"references-count":51,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2017,10]]}},"alternative-id":["s17102294"],"URL":"https:\/\/doi.org\/10.3390\/s17102294","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,10,10]]}}}