{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T06:19:44Z","timestamp":1769581184164,"version":"3.49.0"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2023,10,27]],"date-time":"2023-10-27T00:00:00Z","timestamp":1698364800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,27]],"date-time":"2023-10-27T00:00:00Z","timestamp":1698364800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005711","name":"Universit\u00e4t Hamburg","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005711","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Multimodal User Interfaces"],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Interactive Sonification is a well-known guidance method in navigation tasks. Researchers have repeatedly suggested the use of interactive sonification in neuronavigation and image-guided surgery. The hope is to reduce clinicians\u2019 cognitive load through a relief of the visual channel, while preserving the precision provided through image guidance. In this paper, we present a surgical use case, simulating a craniotomy preparation with a skull phantom. Through auditory, visual, and audiovisual guidance, non-clinicians successfully find targets on a skull that provides hardly any visual or haptic landmarks. The results show that interactive sonification enables novice users to navigate through three-dimensional space with a high precision. The precision along the depth axis is highest in the audiovisual guidance mode, but adding audio leads to higher durations and longer motion trajectories.<\/jats:p>","DOI":"10.1007\/s12193-023-00422-9","type":"journal-article","created":{"date-parts":[[2023,10,27]],"date-time":"2023-10-27T13:02:38Z","timestamp":1698411758000},"page":"253-262","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Three-dimensional sonification as a surgical guidance tool"],"prefix":"10.1007","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6821-7327","authenticated-orcid":false,"given":"Tim","family":"Ziemer","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,10,27]]},"reference":[{"issue":"4","key":"422_CR1","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1002\/rcs.1630","volume":"11","author":"MM Arnolli","year":"2015","unstructured":"Arnolli MM, Hanumara NC, Franken M, Brouwer DM, Broeders IAMJ (2015) An overview of systems for ct- and mri-guided percutaneous needle placement in the thorax and abdomen. Int J Med Robot Comput Assist Surg 11(4):458\u2013475. https:\/\/doi.org\/10.1002\/rcs.1630","journal-title":"Int J Med Robot Comput Assist Surg"},{"issue":"12","key":"422_CR2","doi-asserted-by":"publisher","first-page":"476","DOI":"10.1067\/j.cpsurg.2015.10.001","volume":"52","author":"DE Azagury","year":"2015","unstructured":"Azagury DE, Dua MM, Barrese JC, Henderson JM, Buchs NC, Ris F, Cloyd JM, Martinie JB, Razzaque S, Nicolau S, Soler L, Marescaux J, Visser BC (2015) Image-guided surgery. Curr Probl Surg 52(12):476\u2013520. https:\/\/doi.org\/10.1067\/j.cpsurg.2015.10.001","journal-title":"Curr Probl Surg"},{"issue":"9","key":"422_CR3","doi-asserted-by":"publisher","first-page":"730","DOI":"10.1067\/j.cpsurg.2009.04.001","volume":"46","author":"DP Perrin","year":"2009","unstructured":"Perrin DP, Vasilyev NV, Novotny P, Stoll J, Howe RD, Dupont PE, Salgo IS, del Nido PJ (2009) Image guided surgical interventions. Curr Probl Surg 46(9):730\u2013766. https:\/\/doi.org\/10.1067\/j.cpsurg.2009.04.001","journal-title":"Curr Probl Surg"},{"key":"422_CR4","doi-asserted-by":"publisher","first-page":"450","DOI":"10.3233\/978-1-60750-883-0-450","volume-title":"Medicine meets virtual reality: global healthcare grid. Studies in health technology and informatics","author":"CM Wegner","year":"1997","unstructured":"Wegner CM, Karron DB (1997) Surgical navigation using audio feedback. In: Morgan KS, Hoffman HM, Stredney D, Weghorst SJ (eds) Medicine meets virtual reality: global healthcare grid. Studies in health technology and informatics, vol 39. IOS Press, Ohmsha, Washington D.C., pp 450\u2013458. https:\/\/doi.org\/10.3233\/978-1-60750-883-0-450"},{"key":"422_CR5","doi-asserted-by":"crossref","unstructured":"Jovanov E, Starcevic D, Wegner K, Karron D, Radivojevic V (1998) Acoustic Rendering as Support for Sustained Attention During Biomedical Procedures. In: ICAD, Glasgow. http:\/\/hdl.handle.net\/1853\/50712","DOI":"10.14236\/ewic\/AD1998.17"},{"key":"422_CR6","doi-asserted-by":"publisher","first-page":"13","DOI":"10.5281\/zenodo.398801","volume-title":"XVIII European annual conference on human decision making and manual control","author":"P Vickers","year":"1999","unstructured":"Vickers P, Imam A (1999) The use of audio in minimal access surgery. In: Alty J (ed) XVIII European annual conference on human decision making and manual control. Group D Publications, Loughborough, pp 13\u201322. https:\/\/doi.org\/10.5281\/zenodo.398801"},{"key":"422_CR7","unstructured":"Ziemer T, Nuchprayoon N, Schultheis H (2020) Psychoacoustic sonification as user interface for human-machine interaction. In: International journal of informatics society, vol 12, pp 3\u201316. http:\/\/www.infsoc.org\/journal\/vol12\/12-1"},{"key":"422_CR8","unstructured":"Black D, Plazak J (2017) Guiding clinicians with sound: investigating auditory display in the operating room. In: ISCAS cutting edge. http:\/\/news.iscas.co\/guiding-clinicians-sound-investigating-auditory-display-operating-room\/ Accessed 2019-02-19"},{"key":"422_CR9","doi-asserted-by":"publisher","unstructured":"Miljic O, Bardosi Z, Freysinger W (2019). Audio guidance for optimal placement of an auditory brainstem implant with magnetic navigation and maximum clinical application accuracy. In: International Conference on Auditory Display (ICAD2019), Newcastle Upon Tyne, pp 313\u2013316. https:\/\/doi.org\/10.21785\/icad2019.075","DOI":"10.21785\/icad2019.075"},{"key":"422_CR10","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1016\/j.cogsys.2020.07.005","volume":"64","author":"T Vajsbaher","year":"2020","unstructured":"Vajsbaher T, Ziemer T, Schultheis H (2020) A multi-modal approach to cognitive training and assistance in minimally invasive surgery. Cogn Syst Res 64:57\u201372. https:\/\/doi.org\/10.1016\/j.cogsys.2020.07.005","journal-title":"Cogn Syst Res"},{"key":"422_CR11","unstructured":"Black D, Ziemer T, Rieder C, Hahn H, Kikinis R (2017) Auditorydisplay for supporting image-guided medical instrument navigationin tunnel-like scenarios. In: Proceedings of image-guided interventions (IGIC), Magdeburg, Germany"},{"key":"422_CR12","unstructured":"Black D, Issawi JA, Hansen C, Rieder C, Hahn H (2013) Auditory Support for Navigated Radiofrequency Ablation. In: Freysinger W (ed) CURAC\u201412. Jahrestagung der Deutschen Gesellschaft F\u00fcr Computer- und Roboter Assistierte Chirurgie, Innsbruck, pp 30\u201333"},{"issue":"9","key":"422_CR13","doi-asserted-by":"publisher","first-page":"1655","DOI":"10.1007\/s11548-017-1537-1","volume":"12","author":"D Black","year":"2017","unstructured":"Black D, Hettig J, Luz M, Hansen C, Kikinis R, Hahn H (2017) Auditory feedback to support image-guided medical needle placement. Int J Comput Assist Radiol Surg 12(9):1655\u20131663. https:\/\/doi.org\/10.1007\/s11548-017-1537-1","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"422_CR14","doi-asserted-by":"publisher","first-page":"5930","DOI":"10.1038\/s41598-023-32778-z","volume":"13","author":"S Matinfar","year":"2023","unstructured":"Matinfar S, Salehi M, Suter D, Seibold M, Navab N, Dehghani S, Wanivenhaus F, F\u00fcrnstahl P, Farshad M, Navab N (2023) Sonification as a reliable alternative to conventional visual surgical navigation. Sci Rep 13:5930","journal-title":"Sci Rep"},{"issue":"1","key":"422_CR15","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1002\/rcs.1466","volume":"9","author":"C Hansen","year":"2013","unstructured":"Hansen C, Black D, Lange C, Rieber F, Lamad\u00e9 W, Donati M, Oldhafer KJ, Hahn HK (2013) Auditory support for resection guidance in navigated liver surgery. Int J Med Robot Comput Assist Surg 9(1):36\u201343. https:\/\/doi.org\/10.1002\/rcs.1466","journal-title":"Int J Med Robot Comput Assist Surg"},{"issue":"8","key":"422_CR16","doi-asserted-by":"publisher","first-page":"1431","DOI":"10.1007\/s11548-019-01970-w","volume":"14","author":"J Plazak","year":"2019","unstructured":"Plazak J, DiGiovanni DA, Collins DL, Kersten-Oertel M (2019) Cognitive load associations when utilizing auditory display within image-guided neurosurgery. Int J Comput Assist Radiol Surg 14(8):1431\u20131438. https:\/\/doi.org\/10.1007\/s11548-019-01970-w","journal-title":"Int J Comput Assist Radiol Surg"},{"issue":"5","key":"422_CR17","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1049\/htl.2017.0074","volume":"4","author":"J Plazak","year":"2017","unstructured":"Plazak J, Drouin S, Collins L, Kersten-Oertel M (2017) Distance sonification in image-guided neurosurgery. Healthc Technol Lett 4(5):199\u2013203","journal-title":"Healthc Technol Lett"},{"issue":"5","key":"422_CR18","doi-asserted-by":"publisher","first-page":"470","DOI":"10.1007\/s00106-010-2237-0","volume":"59","author":"G Strau\u00df","year":"2011","unstructured":"Strau\u00df G, Schaller S, Zaminer B, Heininger S, Hofer M, Manzey D, Meixensberger J, Dietz A, L\u00fcth TC (2011) Klinische erfahrungen mit einem kollisionswarnsystem. HNO 59(5):470\u2013479. https:\/\/doi.org\/10.1007\/s00106-010-2237-0","journal-title":"HNO"},{"key":"422_CR19","doi-asserted-by":"publisher","first-page":"769659-7","DOI":"10.1155\/2014\/769659","volume":"2014","author":"B Cho","year":"2014","unstructured":"Cho B, Matsumoto N, Komune S, Hashizume M (2014) A surgical navigation system for guiding exact cochleostomy using auditory feedback: a clinical feasibility study. Biomed Res Int 2014:769659\u20137. https:\/\/doi.org\/10.1155\/2014\/769659","journal-title":"Biomed Res Int"},{"issue":"3","key":"422_CR20","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1007\/s11548-012-0797-z","volume":"8","author":"B Cho","year":"2013","unstructured":"Cho B, Oka M, Matsumoto N, Ouchida R, Hong J, Hashizume M (2013) Warning navigation system using real-time safe region monitoring for otologic surgery. Int J Comput Assist Radiol Surg 8(3):395-405. https:\/\/doi.org\/10.1007\/s11548-012-0797-z","journal-title":"Int J Comput Assist Radiol Surg"},{"issue":"9","key":"422_CR21","doi-asserted-by":"publisher","first-page":"1665","DOI":"10.1007\/s11548-017-1547-z","volume":"12","author":"D Black","year":"2017","unstructured":"Black D, Hansen C, Nabavi A, Kikinis R, Hahn H (2017) A survey of auditory display in image-guided interventions. Int J Comput Assist Radiol Surg 12(9):1665\u20131676. https:\/\/doi.org\/10.1007\/s11548-017-1547-z","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"422_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1121\/2.0000557","volume":"30","author":"T Ziemer","year":"2017","unstructured":"Ziemer T, Black D, Schultheis H (2017) Psychoacoustic sonification design for navigation in surgical interventions. Proc Meet Acoust 30:1. https:\/\/doi.org\/10.1121\/2.0000557","journal-title":"Proc Meet Acoust"},{"key":"422_CR23","doi-asserted-by":"publisher","unstructured":"Batmaz AU, de Mathelin M, Dresp-Langley B (2016) Getting nowhere fast: trade-off between speed and precision in training to execute image-guided hand-tool movements. BMC Psychol. https:\/\/doi.org\/10.1186\/s40359-016-0161-0","DOI":"10.1186\/s40359-016-0161-0"},{"key":"422_CR24","doi-asserted-by":"publisher","unstructured":"Ziemer T (2023) Three-dimensional sonification for image-guided surgery. In: International Conference on Auditory Display (ICAD2023), Norrk\u00f6ping, Sweden, pp 8\u201314. https:\/\/doi.org\/10.21785\/icad2023.2324","DOI":"10.21785\/icad2023.2324"},{"key":"422_CR25","doi-asserted-by":"publisher","unstructured":"Ziemer T, Schultheis H (2018) A psychoacoustic auditory display for navigation. In: 24th International conference on auditory displays (ICAD2018), Houghton, MI, pp 136\u2013144. https:\/\/doi.org\/10.21785\/icad2018.007","DOI":"10.21785\/icad2018.007"},{"key":"422_CR26","doi-asserted-by":"publisher","unstructured":"Asendorf M, Kienzle M, Ringe R, Ahmadi F, Bhowmik D, Chen J, Huynh K, Kleinert S, Kruesilp J, Lee YY, Wang X, Luo W, Jadid NM, Awadin A, Raval V, Schade EES, Jaman H, Sharma K, Weber C, Winkler H, Ziemer T (2021) Tiltification\u2014an accessible app to popularize sonification. In: Proceedings of the 26th international conference on auditory display (ICAD2021), Virtual Conference, pp 184\u2013191. https:\/\/doi.org\/10.21785\/icad2021.025","DOI":"10.21785\/icad2021.025"},{"key":"422_CR27","doi-asserted-by":"publisher","unstructured":"Ziemer T, Schultheis H (2019) Psychoacoustical signal processing for three-dimensional sonification. In: 25th international conference on auditory displays (ICAD2019), Newcastle, pp 277\u2013284. https:\/\/doi.org\/10.21785\/icad2019.018","DOI":"10.21785\/icad2019.018"},{"key":"422_CR28","doi-asserted-by":"publisher","unstructured":"Ziemer T, Schultheis H (2019) Three orthogonal dimensions for psychoacoustic sonification. ArXiv Preprint. https:\/\/doi.org\/10.48550\/arXiv.1912.00766","DOI":"10.48550\/arXiv.1912.00766"},{"issue":"12","key":"422_CR29","doi-asserted-by":"publisher","first-page":"2346","DOI":"10.1121\/1.1919362","volume":"36","author":"RN Shepard","year":"1964","unstructured":"Shepard RN (1964) Circularity in judgments of relative pitch. J Acoust Soc Am 36(12):2346\u20132353. https:\/\/doi.org\/10.1121\/1.1919362","journal-title":"J Acoust Soc Am"},{"key":"422_CR30","doi-asserted-by":"publisher","unstructured":"Ziemer T, Schultheis H (2020) Psychoakustische sonifikation zur navigation in bildgef\u00fchrter chirurgie. In: Jaeschke N, Grotjahn R (eds) Freie Beitr\u00e4ge zur Jahrestagung der Gesellschaft F\u00fcr Musikforschung 2019, vol 1, pp 347\u2013358. https:\/\/doi.org\/10.25366\/2020.42","DOI":"10.25366\/2020.42"},{"key":"422_CR31","doi-asserted-by":"publisher","unstructured":"Ziemer T, Schultheis H (2021) The CURAT sonification game: gamification for remote sonification evaluation. In: 26th international conference on auditory display (ICAD2021), Virtual conference, pp 233\u2013240. https:\/\/doi.org\/10.21785\/icad2021.026","DOI":"10.21785\/icad2021.026"},{"key":"422_CR32","doi-asserted-by":"publisher","unstructured":"Asendorf M, Kienzle M, Ringe R, Ahmadi F, Bhowmik D, Chen J, Hyunh K, Kleinert S, Kruesilp J, Wang X, Lin YY, Luo W, Mirzayousef\u00a0Jadid N, Awadin A, Raval V, Schade EES, Jaman H, Sharma K, Weber C, Winkler H, Ziemer T (2021) Tiltification\/sonic-tilt: first release of sonic tilt. In: https:\/\/github.com\/Tiltification\/sonic-tilt. https:\/\/doi.org\/10.5281\/zenodo.5543983","DOI":"10.5281\/zenodo.5543983"}],"container-title":["Journal on Multimodal User Interfaces"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-023-00422-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12193-023-00422-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-023-00422-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,14]],"date-time":"2023-11-14T11:09:59Z","timestamp":1699960199000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12193-023-00422-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,27]]},"references-count":32,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["422"],"URL":"https:\/\/doi.org\/10.1007\/s12193-023-00422-9","relation":{},"ISSN":["1783-7677","1783-8738"],"issn-type":[{"value":"1783-7677","type":"print"},{"value":"1783-8738","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,27]]},"assertion":[{"value":"13 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 October 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}