{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,17]],"date-time":"2026-05-17T17:37:53Z","timestamp":1779039473351,"version":"3.51.4"},"reference-count":17,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,12,29]],"date-time":"2022-12-29T00:00:00Z","timestamp":1672272000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Wellcome\/EPSRC Centre for Interventional and Surgical Sciences (WEISS)","doi-asserted-by":"publisher","award":["203145Z\/16\/z"],"award-info":[{"award-number":["203145Z\/16\/z"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Wellcome\/EPSRC Centre for Interventional and Surgical Sciences (WEISS)","doi-asserted-by":"publisher","award":["EP\/P027938\/1"],"award-info":[{"award-number":["EP\/P027938\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Wellcome\/EPSRC Centre for Interventional and Surgical Sciences (WEISS)","doi-asserted-by":"publisher","award":["EP\/R004080\/1"],"award-info":[{"award-number":["EP\/R004080\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Wellcome\/EPSRC Centre for Interventional and Surgical Sciences (WEISS)","doi-asserted-by":"publisher","award":["EP\/P012841\/1"],"award-info":[{"award-number":["EP\/P012841\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Wellcome\/EPSRC Centre for Interventional and Surgical Sciences (WEISS)","doi-asserted-by":"publisher","award":["GA 863146"],"award-info":[{"award-number":["GA 863146"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Royal Academy of Engineering Chair in Emerging Technologies","award":["203145Z\/16\/z"],"award-info":[{"award-number":["203145Z\/16\/z"]}]},{"name":"Royal Academy of Engineering Chair in Emerging Technologies","award":["EP\/P027938\/1"],"award-info":[{"award-number":["EP\/P027938\/1"]}]},{"name":"Royal Academy of Engineering Chair in Emerging Technologies","award":["EP\/R004080\/1"],"award-info":[{"award-number":["EP\/R004080\/1"]}]},{"name":"Royal Academy of Engineering Chair in Emerging Technologies","award":["EP\/P012841\/1"],"award-info":[{"award-number":["EP\/P012841\/1"]}]},{"name":"Royal Academy of Engineering Chair in Emerging Technologies","award":["GA 863146"],"award-info":[{"award-number":["GA 863146"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Obstetric ultrasound (US) training teaches the relationship between foetal anatomy and the viewed US slice to enable navigation to standardised anatomical planes (head, abdomen and femur) where diagnostic measurements are taken. This process is difficult to learn, and results in considerable inter-operator variability. We propose the CAL-Tutor system for US training based on a US scanner and phantom, where a model of both the baby and the US slice are displayed to the trainee in its physical location using the HoloLens 2. The intention is that AR guidance will shorten the learning curve for US trainees and improve spatial awareness. In addition to the AR guidance, we also record many data streams to assess user motion and the learning process. The HoloLens 2 provides eye gaze, head and hand position, ARToolkit and NDI Aurora tracking gives the US probe positions and an external camera records the overall scene. These data can provide a rich source for further analysis, such as distinguishing expert from novice motion. We have demonstrated the system in a sample of engineers. Feedback suggests that the system helps novice users navigate the US probe to the standard plane. The data capture is successful and initial data visualisations show that meaningful information about user behaviour can be captured. Initial feedback is encouraging and shows improved user assessment where AR guidance is provided.<\/jats:p>","DOI":"10.3390\/jimaging9010006","type":"journal-article","created":{"date-parts":[[2022,12,29]],"date-time":"2022-12-29T02:56:50Z","timestamp":1672282610000},"page":"6","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["CAL-Tutor: A HoloLens 2 Application for Training in Obstetric Sonography and User Motion Data Recording"],"prefix":"10.3390","volume":"9","author":[{"given":"Manuel","family":"Birlo","sequence":"first","affiliation":[{"name":"Wellcome\/EPSRC Centre for Interventional and Surgical Sciences (WEISS), Charles Bell House, 43\u201345 Foley Street, London W1W 7TY, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0203-5736","authenticated-orcid":false,"given":"Philip J. Eddie","family":"Edwards","sequence":"additional","affiliation":[{"name":"Wellcome\/EPSRC Centre for Interventional and Surgical Sciences (WEISS), Charles Bell House, 43\u201345 Foley Street, London W1W 7TY, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3681-6784","authenticated-orcid":false,"given":"Soojeong","family":"Yoo","sequence":"additional","affiliation":[{"name":"Wellcome\/EPSRC Centre for Interventional and Surgical Sciences (WEISS), Charles Bell House, 43\u201345 Foley Street, London W1W 7TY, UK"},{"name":"UCL Interaction Centre (UCLIC), University College London, 66-72 Gower Street, London WC1E 6EA, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9494-9724","authenticated-orcid":false,"given":"Brian","family":"Dromey","sequence":"additional","affiliation":[{"name":"Wellcome\/EPSRC Centre for Interventional and Surgical Sciences (WEISS), Charles Bell House, 43\u201345 Foley Street, London W1W 7TY, UK"},{"name":"UCL EGA Institute for Women\u2019s Health, Medical School Building, 74 Huntley Street, London WC1E 6AU, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Francisco","family":"Vasconcelos","sequence":"additional","affiliation":[{"name":"Wellcome\/EPSRC Centre for Interventional and Surgical Sciences (WEISS), Charles Bell House, 43\u201345 Foley Street, London W1W 7TY, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthew J.","family":"Clarkson","sequence":"additional","affiliation":[{"name":"Wellcome\/EPSRC Centre for Interventional and Surgical Sciences (WEISS), Charles Bell House, 43\u201345 Foley Street, London W1W 7TY, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Danail","family":"Stoyanov","sequence":"additional","affiliation":[{"name":"Wellcome\/EPSRC Centre for Interventional and Surgical Sciences (WEISS), Charles Bell House, 43\u201345 Foley Street, London W1W 7TY, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.amjsurg.2015.05.025","article-title":"Transfer from point-of-care ultrasonography training to diagnostic performance on patients\u2014A randomized controlled trial","volume":"211","author":"Todsen","year":"2016","journal-title":"Am. J. Surg."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Rahmatullah, B., Sarris, I., Papageorghiou, A., and Noble, J.A. (April, January 30). Quality control of fetal ultrasound images: Detection of abdomen anatomical landmarks using adaboost. Proceedings of the 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Chicago, IL, USA.","DOI":"10.1109\/ISBI.2011.5872342"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1576","DOI":"10.1109\/TCYB.2017.2685080","article-title":"Ultrasound standard plane detection using a composite neural network framework","volume":"47","author":"Chen","year":"2017","journal-title":"IEEE Trans. Cybern."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"State, A., Livingston, M.A., Garrett, W.F., Hirota, G., Whitton, M.C., Pisano, E.D., and Fuchs, H. (1996, January 4\u20139). Technologies for augmented reality systems: Realizing ultrasound-guided needle biopsies. Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, New Orleans, LA, USA.","DOI":"10.1145\/237170.237283"},{"key":"ref_5","first-page":"1","article-title":"Ultrasound-guided interventions with augmented reality in situ visualisation: A proof-of-mechanism phantom study","volume":"4","author":"Bay","year":"2020","journal-title":"Eur. Radiol. Exp."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"102361","DOI":"10.1016\/j.media.2022.102361","article-title":"Utility of optical see-through head mounted displays in augmented reality-assisted surgery: A systematic review","volume":"77","author":"Birlo","year":"2022","journal-title":"Med. Image Anal."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1097\/SIH.0000000000000485","article-title":"A systematic review and meta-analysis of the use of high-fidelity simulation in obstetric ultrasound","volume":"16","author":"Dromey","year":"2020","journal-title":"Simul. Healthc. J. Soc. Simul. Healthc."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Shao, M.Y., Vagg, T., Seibold, M., and Doughty, M. (2022). Towards a low-cost monitor-based augmented reality training platform for at-home ultrasound skill development. J. Imaging, 8.","DOI":"10.3390\/jimaging8110305"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Costa, J.N., Gomes-Fonseca, J., Valente, S., Ferreira, L., Oliveira, B., Torres, H.R., Morais, P., Alves, V., and Vila\u00e7A, J.L. (2022, January 11\u201315). Ultrasound training simulator using augmented reality glasses: An accuracy and precision assessment study. Proceedings of the 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Glasgow, UK.","DOI":"10.1109\/EMBC48229.2022.9871406"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1002\/uog.12394","article-title":"Usability of virtual-reality simulation training in obstetric ultrasonography: A prospective cohort study","volume":"42","author":"Burden","year":"2013","journal-title":"Ultrasound Obstet. Gynecol."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Blum, T., Heining, S.M., Kutter, O., and Navab, N. (2009, January 19\u201322). Advanced training methods using an augmented reality ultrasound simulator. Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality, Washington, DC, USA.","DOI":"10.1109\/ISMAR.2009.5336476"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1363","DOI":"10.1053\/j.jvca.2017.12.006","article-title":"Augmented reality and ultrasound education: Initial experience","volume":"32","author":"Mahmood","year":"2018","journal-title":"J. Cardiothorac. Vasc. Anesth."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"101762","DOI":"10.1016\/j.media.2020.101762","article-title":"Spatio-temporal visual attention modelling of standard biometry plane-finding navigation","volume":"65","author":"Cai","year":"2020","journal-title":"Med. Image Anal."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.1007\/s11548-022-02642-y","article-title":"Task model-specific operator skill assessment in routine fetal ultrasound scanning","volume":"17","author":"Wang","year":"2022","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, K., Wang, J., Xu, Y., Qin, H., Liu, D., Liu, L., and Meng, M.Q.H. (June, January 30). Autonomous navigation of an ultrasound probe towards standard scan planes with deep reinforcement learning. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an China.","DOI":"10.1109\/ICRA48506.2021.9561295"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1049\/htl.2018.5065","article-title":"Arssist: Augmented reality on a head-mounted display for the first assistant in robotic surgery","volume":"5","author":"Qian","year":"2018","journal-title":"Healthc. Technol. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1109\/TBME.2019.2914517","article-title":"Perceptual limits of optical see-through visors for augmented reality guidance of manual tasks","volume":"67","author":"Condino","year":"2020","journal-title":"IEEE Trans. Biomed. Eng."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/9\/1\/6\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:54:54Z","timestamp":1760147694000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/9\/1\/6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,29]]},"references-count":17,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["jimaging9010006"],"URL":"https:\/\/doi.org\/10.3390\/jimaging9010006","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,29]]}}}