{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T20:45:58Z","timestamp":1777409158086,"version":"3.51.4"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2021,4,8]],"date-time":"2021-04-08T00:00:00Z","timestamp":1617840000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,4,8]],"date-time":"2021-04-08T00:00:00Z","timestamp":1617840000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100013348","name":"Innosuisse - Schweizerische Agentur f\u00fcr Innovationsf\u00f6rderung","doi-asserted-by":"publisher","award":["25540 PFLS"],"award-info":[{"award-number":["25540 PFLS"]}],"id":[{"id":"10.13039\/501100013348","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"published-print":{"date-parts":[[2021,5]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>Given the high level of expertise required for navigation and interpretation of ultrasound images, computational simulations can facilitate the training of such skills in virtual reality. With ray-tracing based simulations, realistic ultrasound images can be generated. However, due to computational constraints for interactivity, image quality typically needs to be compromised.\n<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>We propose herein to bypass any rendering and simulation process at interactive time, by conducting such simulations during a non-time-critical offline stage and then learning image translation from cross-sectional model slices to such simulated frames. We use a generative adversarial framework with a dedicated generator architecture and input feeding scheme, which both substantially improve image quality without increase in network parameters. Integral attenuation maps derived from cross-sectional model slices, texture-friendly strided convolutions, providing stochastic noise and input maps to intermediate layers in order to preserve locality are all shown herein to greatly facilitate such translation task.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Given several quality metrics, the proposed method with only tissue maps as input is shown to provide comparable or superior results to a state-of-the-art that uses additional images of low-quality ultrasound renderings. An extensive ablation study shows the need and benefits from the individual contributions utilized in this work, based on qualitative examples and quantitative ultrasound similarity metrics. To that end, a local histogram statistics based error metric is proposed and demonstrated for visualization of local dissimilarities between ultrasound images.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>A deep-learning based direct transformation from interactive tissue slices to likeness of high quality renderings allow to obviate any complex rendering process in real-time, which could enable extremely realistic ultrasound simulations on consumer-hardware by moving the time-intensive processes to a one-time, offline, preprocessing data preparation stage that can be performed on dedicated high-end hardware.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-021-02349-6","type":"journal-article","created":{"date-parts":[[2021,4,8]],"date-time":"2021-04-08T17:02:53Z","timestamp":1617901373000},"page":"721-730","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Learning ultrasound rendering from cross-sectional model slices for simulated training"],"prefix":"10.1007","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5245-4766","authenticated-orcid":false,"given":"Lin","family":"Zhang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tiziano","family":"Portenier","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8639-7373","authenticated-orcid":false,"given":"Orcun","family":"Goksel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,4,8]]},"reference":[{"issue":"9","key":"2349_CR1","doi-asserted-by":"publisher","first-page":"1427","DOI":"10.1007\/s11548-020-02203-1","volume":"15","author":"L Bargsten","year":"2020","unstructured":"Bargsten L, Schlaefer A (2020) SpeckleGan: a generative adversarial network with an adaptive speckle layer to augment limited training data for ultrasound image processing. International journal of computer assisted radiology and surgery 15(9):1427\u20131436","journal-title":"International journal of computer assisted radiology and surgery"},{"issue":"2","key":"2349_CR2","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1097\/SIH.0b013e31827ac273","volume":"8","author":"T Blum","year":"2013","unstructured":"Blum T, Rieger A, Navab N, Friess H, Martignoni M (2013) A review of computer-based simulators for ultrasound training. Simulat Healthcare 8(2):98\u2013108","journal-title":"Simulat Healthcare"},{"issue":"3","key":"2349_CR3","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1109\/TMI.2012.2234474","volume":"32","author":"B Burger","year":"2013","unstructured":"Burger B, Bettinghausen S, Radle M, Hesser J (2013) Real-time GPU-based ultrasound simulation using deformable mesh models. IEEE Trans Med Imag 32(3):609\u2013618","journal-title":"IEEE Trans Med Imag"},{"issue":"11","key":"2349_CR4","doi-asserted-by":"publisher","first-page":"1657","DOI":"10.1109\/TMI.2009.2016561","volume":"28","author":"O Goksel","year":"2009","unstructured":"Goksel O, Salcudean SE (2009) B-mode ultrasound image simulation in deformable 3-D medium. IEEE Trans med imag 28(11):1657\u20131669","journal-title":"IEEE Trans med imag"},{"key":"2349_CR5","unstructured":"Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio, Y (2014) Generative adversarial nets. In: Advances in neural information processing systems, pp. 2672\u20132680"},{"key":"2349_CR6","unstructured":"Guo K, Zeng S, Yu J, Wang Y, Yang H (2017) A survey of fpga-based neural network accelerator. ACM Trans. Reconfig. Technol. Syst. 9(4), 11:1\u201326"},{"key":"2349_CR7","unstructured":"Heusel M, Ramsauer H, Unterthiner T, Nessler B, Hochreiter S (2017) Gans trained by a two time-scale update rule converge to a local nash equilibrium. In: Advances in neural information processing systems, pp. 6626\u20136637"},{"key":"2349_CR8","doi-asserted-by":"crossref","unstructured":"Hu Y, Gibson E, Lee LL, Xie W, Barratt DC, Vercauteren T, Noble JA (2017) Freehand ultrasound image simulation with spatially-conditioned generative adversarial networks. In: Molecular imaging, reconstruction and analysis of moving body organs, and stroke imaging and treatment, pp. 105\u2013115","DOI":"10.1007\/978-3-319-67564-0_11"},{"key":"2349_CR9","doi-asserted-by":"crossref","unstructured":"Jafari MH, Girgis H, Van\u00a0Woudenberg N, Moulson N, Luong C, Fung A, Balthazaar S, Jue J, Tsang M, Nair P, Gin K, Rohling R, Abolmaesumi P, Tsang T (2020) Cardiac point-of-care to cart-based ultrasound translation using constrained CycleGAN. International Journal of Computer Assisted Radiology and Surgery pp. 1\u201310","DOI":"10.1007\/s11548-020-02141-y"},{"key":"2349_CR10","doi-asserted-by":"crossref","unstructured":"Karras T, Laine S, Aila T (2019) A style-based generator architecture for generative adversarial networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4401\u20134410","DOI":"10.1109\/CVPR.2019.00453"},{"key":"2349_CR11","unstructured":"Kingma DP, Ba J (2015) Adam: A method for stochastic optimization. In: International Conference on Learning Representations, pp. 1\u201315"},{"key":"2349_CR12","doi-asserted-by":"crossref","unstructured":"Magnetti C, Zimmer V, Ghavami N, Skelton E, Matthew J, Lloyd K, Hajnal J, Schnabel JA, Gomez A (2020) Deep generative models to simulate 2D patient-specific ultrasound images in real time. In: Annual Conference on Medical Image Understanding and Analysis, pp. 423\u2013435","DOI":"10.1007\/978-3-030-52791-4_33"},{"issue":"5","key":"2349_CR13","doi-asserted-by":"publisher","first-page":"743","DOI":"10.1016\/0301-5629(85)90108-5","volume":"11","author":"GE Mailloux","year":"1985","unstructured":"Mailloux GE, Bertrand M, Stampfler R, Ethier S (1985) Local histogram information content of ultrasound B-mode echographic texture. Ultrasound med & biology 11(5):743\u2013750","journal-title":"Ultrasound med & biology"},{"key":"2349_CR14","doi-asserted-by":"crossref","unstructured":"Mattausch O, Goksel O (2015) Scatterer reconstruction and parametrization of homogeneous tissue for ultrasound image simulation. In: IEEE Engineering in Medicine and Biology Society (EMBC), pp. 6350\u20136353","DOI":"10.1109\/EMBC.2015.7319845"},{"key":"2349_CR15","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1111\/cgf.13260","volume":"37","author":"O Mattausch","year":"2018","unstructured":"Mattausch O, Makhinya M, Goksel O (2018) Realistic ultrasound simulation of complex surface models using interactive monte-carlo path tracing. Comput Graph Forum 37:202\u2013213","journal-title":"Comput Graph Forum"},{"issue":"10","key":"2349_CR16","doi-asserted-by":"publisher","first-page":"e3","DOI":"10.23915\/distill.00003","volume":"1","author":"A Odena","year":"2016","unstructured":"Odena A, Dumoulin V, Olah C (2016) Deconvolution and checkerboard artifacts. Distill 1(10):e3","journal-title":"Distill"},{"issue":"6","key":"2349_CR17","doi-asserted-by":"publisher","first-page":"3210","DOI":"10.1007\/s00330-018-5923-z","volume":"29","author":"ML \u00d8stergaard","year":"2019","unstructured":"\u00d8stergaard ML, Nielsen KR, Albrecht-Beste E, Ersb\u00f8ll AK, Konge L, Nielsen MB (2019) Simulator training improves ultrasound scanning performance on patients: A randomized controlled trial. Eur radiol 29(6):3210\u20133218","journal-title":"Eur radiol"},{"key":"2349_CR18","doi-asserted-by":"crossref","unstructured":"Park T, Liu MY, Wang TC, Zhu JY (2019) Semantic image synthesis with spatially-adaptive normalization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2337\u20132346","DOI":"10.1109\/CVPR.2019.00244"},{"key":"2349_CR19","doi-asserted-by":"crossref","unstructured":"Ramaiah SD, Ray KA, Reindollar RH (2020) Simulation training for embryo transfer: findings from the american society for reproductive medicine embryo transfer certificate course. Fertility and Sterility","DOI":"10.1016\/j.fertnstert.2020.10.056"},{"key":"2349_CR20","doi-asserted-by":"crossref","unstructured":"Salehi M, Ahmadi SA, Prevost R, Navab N, Wein W (2015) Patient-specific 3D ultrasound simulation based on convolutional ray-tracing and appearance optimization. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 510\u2013518","DOI":"10.1007\/978-3-319-24571-3_61"},{"key":"2349_CR21","doi-asserted-by":"crossref","unstructured":"Shams R, Hartley R, Navab N (2008) Real-time simulation of medical ultrasound from CT images. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 734\u2013741","DOI":"10.1007\/978-3-540-85990-1_88"},{"issue":"4","key":"2349_CR22","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1109\/42.251119","volume":"12","author":"PM Shankar","year":"1993","unstructured":"Shankar PM, Reid JM, Ortega H, Piccoli CW, Goldberg BB (1993) Use of non-rayleigh statistics for the identification of tumors in ultrasonic B-scans of the breast. IEEE Trans Med Imag 12(4):687\u2013692","journal-title":"IEEE Trans Med Imag"},{"key":"2349_CR23","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1016\/j.cag.2019.05.005","volume":"82","author":"R Starkov","year":"2019","unstructured":"Starkov R, Tanner C, Bajka M, Goksel O (2019) Ultrasound simulation with animated anatomical models and on-the-fly fusion with real images via path-tracing. Comput & Graph 82:44\u201352","journal-title":"Comput & Graph"},{"issue":"9","key":"2349_CR24","doi-asserted-by":"publisher","first-page":"1589","DOI":"10.1007\/s11548-019-02054-5","volume":"14","author":"R Starkov","year":"2019","unstructured":"Starkov R, Zhang L, Bajka M, Tanner C, Goksel O (2019) Ultrasound simulation with deformable and patient-specific scatterer maps. International Journal of Computer Assisted Radiology and Surgery 14(9):1589\u20131599","journal-title":"International Journal of Computer Assisted Radiology and Surgery"},{"issue":"3","key":"2349_CR25","first-page":"328","volume":"5","author":"B Sun","year":"2011","unstructured":"Sun B, McKenzie F (2011) Real-time sonography simulation for medical training. Int J Edu Info Technol 5(3):328\u2013335","journal-title":"Int J Edu Info Technol"},{"key":"2349_CR26","doi-asserted-by":"crossref","unstructured":"Tom F, Sheet D (2018) Simulating patho-realistic ultrasound images using deep generative networks with adversarial learning. In: International Symposium on Biomedical Imaging (ISBI), pp. 1174\u20131177","DOI":"10.1109\/ISBI.2018.8363780"},{"key":"2349_CR27","doi-asserted-by":"crossref","unstructured":"Vitale S, Orlando JI, Iarussi E, Larrabide I (2019) Improving realism in patient-specific abdominal ultrasound simulation using CycleGANs. Int J Comput Assisted Radiol Surg. 1\u201310","DOI":"10.1007\/s11548-019-02046-5"},{"key":"2349_CR28","doi-asserted-by":"crossref","unstructured":"Zhang L, Portenier T, Paulus C, Goksel O (2020) Deep image translation for enhancing simulated ultrasound images. In: Medical Ultrasound, and Preterm, Perinatal and Paediatric Image Analysis, pp. 85\u201394","DOI":"10.1007\/978-3-030-60334-2_9"},{"key":"2349_CR29","doi-asserted-by":"crossref","unstructured":"Zhu JY, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE international conference on computer vision, pp. 2223\u20132232","DOI":"10.1109\/ICCV.2017.244"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-021-02349-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-021-02349-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-021-02349-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,20]],"date-time":"2021-05-20T08:58:02Z","timestamp":1621501082000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-021-02349-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,8]]},"references-count":29,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021,5]]}},"alternative-id":["2349"],"URL":"https:\/\/doi.org\/10.1007\/s11548-021-02349-6","relation":{},"ISSN":["1861-6410","1861-6429"],"issn-type":[{"value":"1861-6410","type":"print"},{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,8]]},"assertion":[{"value":"19 January 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 March 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 April 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Being based on synthetic models and simulated data, no ethical approval nor consent was required for this work.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and Informed Consent"}}]}}