{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T04:27:22Z","timestamp":1772252842455,"version":"3.50.1"},"reference-count":33,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2021,8,19]],"date-time":"2021-08-19T00:00:00Z","timestamp":1629331200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"EPSRC Centre for Doctoral Training in Smart Medical Imaging","award":["EP\/S022104\/1"],"award-info":[{"award-number":["EP\/S022104\/1"]}]},{"name":"Wellcome\/EPSRC Centre for Medical Engineering","award":["WT 203148\/Z\/16\/Z"],"award-info":[{"award-number":["WT 203148\/Z\/16\/Z"]}]},{"name":"NIHR Invention for Innovation","award":["II-LA-0716-20001"],"award-info":[{"award-number":["II-LA-0716-20001"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>The intricate nature of congenital heart disease requires understanding of the complex, patient-specific three-dimensional dynamic anatomy of the heart, from imaging data such as three-dimensional echocardiography for successful outcomes from surgical and interventional procedures. Conventional clinical systems use flat screens, and therefore, display remains two-dimensional, which undermines the full understanding of the three-dimensional dynamic data. Additionally, the control of three-dimensional visualisation with two-dimensional tools is often difficult, so used only by imaging specialists. In this paper, we describe a virtual reality system for immersive surgery planning using dynamic three-dimensional echocardiography, which enables fast prototyping for visualisation such as volume rendering, multiplanar reformatting, flow visualisation and advanced interaction such as three-dimensional cropping, windowing, measurement, haptic feedback, automatic image orientation and multiuser interactions. The available features were evaluated by imaging and nonimaging clinicians, showing that the virtual reality system can help improve the understanding and communication of three-dimensional echocardiography imaging and potentially benefit congenital heart disease treatment.<\/jats:p>","DOI":"10.3390\/jimaging7080151","type":"journal-article","created":{"date-parts":[[2021,8,19]],"date-time":"2021-08-19T09:58:06Z","timestamp":1629367086000},"page":"151","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["A Virtual Reality System for Improved Image-Based Planning of Complex Cardiac Procedures"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9985-2374","authenticated-orcid":false,"given":"Shujie","family":"Deng","sequence":"first","affiliation":[{"name":"School of Biomedical Engineering & Imaging Sciences, King\u2019s College London, London SE1 7EU, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gavin","family":"Wheeler","sequence":"additional","affiliation":[{"name":"School of Biomedical Engineering & Imaging Sciences, King\u2019s College London, London SE1 7EU, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicolas","family":"Toussaint","sequence":"additional","affiliation":[{"name":"School of Biomedical Engineering & Imaging Sciences, King\u2019s College London, London SE1 7EU, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lindsay","family":"Munroe","sequence":"additional","affiliation":[{"name":"School of Biomedical Engineering & Imaging Sciences, King\u2019s College London, London SE1 7EU, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Suryava","family":"Bhattacharya","sequence":"additional","affiliation":[{"name":"School of Biomedical Engineering & Imaging Sciences, King\u2019s College London, London SE1 7EU, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gina","family":"Sajith","sequence":"additional","affiliation":[{"name":"School of Biomedical Engineering & Imaging Sciences, King\u2019s College London, London SE1 7EU, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ei","family":"Lin","sequence":"additional","affiliation":[{"name":"School of Biomedical Engineering & Imaging Sciences, King\u2019s College London, London SE1 7EU, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eeshar","family":"Singh","sequence":"additional","affiliation":[{"name":"School of Biomedical Engineering & Imaging Sciences, King\u2019s College London, London SE1 7EU, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ka Yee Kelly","family":"Chu","sequence":"additional","affiliation":[{"name":"School of Biomedical Engineering & Imaging Sciences, King\u2019s College London, London SE1 7EU, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Saleha","family":"Kabir","sequence":"additional","affiliation":[{"name":"Department of Congenital Heart Disease, Evelina London Children\u2019s Hospital, Guy\u2019s and St Thomas\u2019 National Health Service Foundation Trust, London SE1 7EH, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kuberan","family":"Pushparajah","sequence":"additional","affiliation":[{"name":"School of Biomedical Engineering & Imaging Sciences, King\u2019s College London, London SE1 7EU, UK"},{"name":"Department of Congenital Heart Disease, Evelina London Children\u2019s Hospital, Guy\u2019s and St Thomas\u2019 National Health Service Foundation Trust, London SE1 7EH, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John M.","family":"Simpson","sequence":"additional","affiliation":[{"name":"School of Biomedical Engineering & Imaging Sciences, King\u2019s College London, London SE1 7EU, UK"},{"name":"Department of Congenital Heart Disease, Evelina London Children\u2019s Hospital, Guy\u2019s and St Thomas\u2019 National Health Service Foundation Trust, London SE1 7EH, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julia A.","family":"Schnabel","sequence":"additional","affiliation":[{"name":"School of Biomedical Engineering & Imaging Sciences, King\u2019s College London, London SE1 7EU, UK"},{"name":"Department of Informatics, Technische Universit\u00e4t M\u00fcnchen, 85748 Garching, Germany"},{"name":"Helmholtz Zentrum M\u00fcnchen\u2014German Research Center for Environmental Health, 85764 Neuherberg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7897-7589","authenticated-orcid":false,"given":"Alberto","family":"Gomez","sequence":"additional","affiliation":[{"name":"School of Biomedical Engineering & Imaging Sciences, King\u2019s College London, London SE1 7EU, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1139","DOI":"10.1093\/ejcts\/ezx208","article-title":"Three-dimensional printed models for surgical planning of complex congenital heart defects: An international multicentre study","volume":"52","author":"Valverde","year":"2017","journal-title":"Eur. J. Cardio Thorac. Surg."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1558\/cam.28455","article-title":"Involving patients, families and medical staff in the evaluation of 3D printing models of congenital heart disease","volume":"12","author":"Biglino","year":"2016","journal-title":"Commun. Med."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1111\/chd.12587","article-title":"Role of virtual reality in congenital heart disease","volume":"13","author":"Ong","year":"2018","journal-title":"Congenit. Heart Dis."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1002\/ca.23292","article-title":"Virtual reality and cardiac anatomy: Exploring immersive three-dimensional cardiac imaging, a pilot study in undergraduate medical anatomy education","volume":"32","author":"Maresky","year":"2019","journal-title":"Clin. Anat."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Falah, J., Khan, S., Alfalah, T., Alfalah, S.F.M., Chan, W., Harrison, D.K., and Charissis, V. (2014). Virtual Reality Medical Training System for Anatomy Education, IEEE.","DOI":"10.1109\/SAI.2014.6918271"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ba, R.K.T.A., Cai, Y., and Guan, Y. (2018, January 10\u201312). Augmented Reality Simulation of Cardiac Circulation Using APPLearn (Heart). Proceedings of the IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), Taichung, Taiwan.","DOI":"10.1109\/AIVR.2018.00055"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1152\/advan.00137.2019","article-title":"Augmented reality-based learning for the comprehension of cardiac physiology in undergraduate biomedical students","volume":"44","author":"Gonzalez","year":"2020","journal-title":"Adv. Physiol. Educ."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1016\/j.jacbts.2017.11.009","article-title":"Emerging Applications of Virtual Reality in Cardiovascular Medicine","volume":"3","author":"Silva","year":"2018","journal-title":"JACC Basic Transl. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"883","DOI":"10.1093\/ehjci\/jey184","article-title":"Mixed reality holograms for heart surgery planning: First user experience in congenital heart disease","volume":"20","author":"Brun","year":"2019","journal-title":"Eur. Heart J. Cardiovasc. Imaging"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Jang, J., Tschabrunn, C.M., Barkagan, M., Anter, E., Menze, B., and Nezafat, R. (2018). Three-dimensional holographic visualization of high-resolution myocardial scar on HoloLens. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0205188"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Egger, J., Gall, M., Wallner, J., Boechat, P., Hann, A., Li, X., Chen, X., and Schmalstieg, D. (2017). HTC Vive MeVisLab integration via OpenVR for medical applications. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0173972"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1158","DOI":"10.1016\/j.echo.2018.06.011","article-title":"Interaction with Volume-Rendered Three-Dimensional Echocardiographic Images in Virtual Reality","volume":"31","author":"Lasso","year":"2018","journal-title":"J. Am. Soc. Echocardiogr."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1109\/TMRB.2020.2983199","article-title":"SlicerVR for medical intervention training and planning in immersive virtual reality","volume":"2","author":"Pinter","year":"2020","journal-title":"IEEE Trans. Med. Robot. Bionics"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"732","DOI":"10.1053\/j.jvca.2018.08.013","article-title":"Validation of quantitative 3-dimensional transesophageal echocardiography mitral valve analysis using stereoscopic display","volume":"33","author":"Ballocca","year":"2019","journal-title":"J. Cardiothorac. Vasc. Anesth."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"e12008","DOI":"10.2196\/12008","article-title":"Advancing cardiac surgery case planning and case review conferences using virtual reality in medical libraries: Evaluation of the usability of two virtual reality apps","volume":"6","author":"Napa","year":"2019","journal-title":"JMIR Hum. Factors"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fcvm.2020.00025","article-title":"Deep Learning for Cardiac Image Segmentation: A Review","volume":"7","author":"Chen","year":"2020","journal-title":"Front. Cardiovasc. Med."},{"key":"ref_17","first-page":"1","article-title":"A systematic review of image segmentation methodology, used in the additive manufacture of patient-specific 3D printed models of the cardiovascular system","volume":"5","author":"Byrne","year":"2016","journal-title":"JRSM Cardiovasc. Dis."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.echo.2016.08.022","article-title":"Three-dimensional Echocardiography in Congenital Heart Disease: An Expert Consensus Document from the European Association of Cardiovascular Imaging and the American Society of Echocardiography","volume":"30","author":"Simpson","year":"2017","journal-title":"J. Am. Soc. Echocardiogr."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4214","DOI":"10.1093\/eurheartj\/ehaa654","article-title":"3D hybrid printed models in complex congenital heart disease: 3D echocardiography and cardiovascular magnetic resonance imaging fusion","volume":"41","author":"Gomez","year":"2020","journal-title":"Eur. Heart J."},{"key":"ref_20","first-page":"A15358","article-title":"Improving visualization and interaction during transcatheter ablation using an augmented reality system: First-in-human experience","volume":"136","author":"Silva","year":"2017","journal-title":"Circulation"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/j.jsurg.2017.06.016","article-title":"Using touch surgery to improve surgical education in low-and middle-income settings: A randomized control trial","volume":"75","author":"Bunogerane","year":"2018","journal-title":"J. Surg. Educ."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1049\/htl.2018.5064","article-title":"Virtual interaction and visualisation of 3D medical imaging data with VTK and Unity","volume":"5","author":"Wheeler","year":"2018","journal-title":"Healthc. Technol. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.pbiomolbio.2014.08.010","article-title":"Towards a fast and efficient approach for modelling the patient-specific ventricular haemodynamics","volume":"116","author":"Gomez","year":"2014","journal-title":"Prog. Biophys. Mol. Biol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"jeaa356","DOI":"10.1093\/ehjci\/jeaa356.408","article-title":"Immersive visualisation of intracardiac blood flow in virtual reality on a patient with HLHS","volume":"22","author":"Bhattacharya","year":"2021","journal-title":"Eur. Heart J. Cardiovasc. Imaging"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1007\/s10278-017-9985-2","article-title":"A semi-automated approach to improve the efficiency of medical imaging segmentation for haptic rendering","volume":"30","author":"Banerjee","year":"2017","journal-title":"J. Digit. Imaging"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"jez319","DOI":"10.1093\/ehjci\/jez319.986","article-title":"P1566 Evaluation of haptic feedback for interaction with volumetric image data in virtual reality","volume":"21","author":"Deng","year":"2020","journal-title":"Eur. Heart J. Cardiovasc. Imaging"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"jeaa356","DOI":"10.1093\/ehjci\/jeaa356.407","article-title":"Automatic orientation cues for intuitive immersive interrogation of 3D echocardiographic images in virtual reality using deep learning","volume":"22","author":"Munroe","year":"2021","journal-title":"Eur. Heart J. Cardiovasc. Imaging"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Munroe, L., Sajith, G., Lin, E., Bhattacharya, S., Pushparajah, K., Simpson, J., Schnabel, J., Wheeler, G., Gomez, A., and Deng, S. (2021, January 12\u201314). Automatic Re-orientation of 3D Echocardiographic Images in Virtual Reality using Deep Learning. Proceedings of the Annual Conference on Medical Image Understanding and Analysis, Oxford, UK.","DOI":"10.1007\/978-3-030-80432-9_14"},{"key":"ref_29","unstructured":"Wheeler, G., Deng, S., Toussaint, N., Pushparajah, K., Schnabel, J.A., Peters, T., Simpson, J.M., and Gomez, A. (2019). Unity and VTK for VR Medical Image Analysis\u2014An Initial Clinical Evaluation, IPCAI."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"jez319","DOI":"10.1093\/ehjci\/jez319.849","article-title":"P1417 Acceptability of a virtual reality system for examination of congenital heart disease patients","volume":"21","author":"Wheeler","year":"2020","journal-title":"Eur. Heart J. Cardiovasc. Imaging"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1049\/htl.2019.0074","article-title":"Virtual linear measurement system for accurate quantification of medical images","volume":"6","author":"Wheeler","year":"2019","journal-title":"Healthc. Technol. Lett."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"jez319","DOI":"10.1093\/ehjci\/jez319.457","article-title":"P801 A virtual reality tool for measurement of 3D echocardiographic images","volume":"21","author":"Wheeler","year":"2020","journal-title":"Eur. Heart J. Cardiovasc. Imaging"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.xjtc.2021.02.044","article-title":"Virtual reality three-dimensional echocardiographic imaging for planning surgical atrioventricular valve repair","volume":"21","author":"Pushparajah","year":"2021","journal-title":"JTCVS Tech."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/7\/8\/151\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:47:21Z","timestamp":1760165241000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/7\/8\/151"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,19]]},"references-count":33,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["jimaging7080151"],"URL":"https:\/\/doi.org\/10.3390\/jimaging7080151","relation":{"has-preprint":[{"id-type":"doi","id":"10.20944\/preprints202106.0114.v2","asserted-by":"object"},{"id-type":"doi","id":"10.20944\/preprints202106.0114.v1","asserted-by":"object"}]},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,19]]}}}