{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T02:26:33Z","timestamp":1783131993236,"version":"3.54.6"},"reference-count":26,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2024,6,11]],"date-time":"2024-06-11T00:00:00Z","timestamp":1718064000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,6,11]],"date-time":"2024-06-11T00:00:00Z","timestamp":1718064000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005713","name":"Technische Universit\u00e4t M\u00fcnchen","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005713","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>Even though workflow analysis in the operating room has come a long way, current systems are still limited to research. In the quest for a robust, universal setup, hardly any attention has been given to the dimension of audio despite its numerous advantages, such as low costs, location, and sight independence, or little required processing power.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methodology<\/jats:title>\n                <jats:p>We present an approach for audio-based event detection that solely relies on two microphones capturing the sound in the operating room. Therefore, a new data set was created with over 63\u00a0h of audio recorded and annotated at the University Hospital rechts der Isar. Sound files were labeled, preprocessed, augmented, and subsequently converted to log-mel-spectrograms that served as a visual input for an event classification using pretrained convolutional neural networks.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Comparing multiple architectures, we were able to show that even lightweight models, such as MobileNet, can already provide promising results. Data augmentation additionally improved the classification of 11 defined classes, including inter alia different types of coagulation, operating table movements as well as an idle class. With the newly created audio data set, an overall accuracy of 90%, a precision of 91% and a <jats:italic>F<\/jats:italic>1-score of 91% were achieved, demonstrating the feasibility of an audio-based event recognition in the operating room.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>With this first proof of concept, we demonstrated that audio events can serve as a meaningful source of information that goes beyond spoken language and can easily be integrated into future workflow recognition pipelines using computational inexpensive architectures.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-024-03211-1","type":"journal-article","created":{"date-parts":[[2024,6,11]],"date-time":"2024-06-11T17:02:16Z","timestamp":1718125336000},"page":"2381-2387","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Audio-based event detection in the operating room"],"prefix":"10.1007","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0257-1571","authenticated-orcid":false,"given":"Jonas","family":"Fuchtmann","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas","family":"Riedel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maximilian","family":"Berlet","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alissa","family":"Jell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luca","family":"Wegener","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lars","family":"Wagner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Simone","family":"Graf","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dirk","family":"Wilhelm","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Ostler-Mildner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,6,11]]},"reference":[{"issue":"9","key":"3211_CR1","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1038\/s41551-017-0132-7","volume":"1","author":"L Maier-Hein","year":"2017","unstructured":"Maier-Hein L, Vedula SS, Speidel S, Navab N, Kikinis R, Park A, Eisenmann M, Feussner H, Forestier G, Giannarou S, Hashizume M, Katic D, Kenngott H, Kranzfelder M, Malpani A, M\u00e4rz K, Neumuth T, Padoy N, Pugh C, Schoch N, Stoyanov D, Taylor R, Wagner M, Hager G, Jannin P (2017) Surgical data science for next-generation interventions. Nat Biomed Eng 1(9):691\u2013696","journal-title":"Nat Biomed Eng"},{"key":"3211_CR2","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1007\/s11548-008-0239-0","volume":"3","author":"T Blum","year":"2008","unstructured":"Blum T, Padoy N, Feu\u00dfner H, Navab N (2008) Workflow mining for visualization and analysis of surgeries. Int J Comput Assist Radiol Surg 3:379\u2013386","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"3211_CR3","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2023.3311628","author":"KC Demir","year":"2023","unstructured":"Demir KC, Schieber H, WeiseRoth T, May M, Maier A, Yang SH (2023) Deep learning in surgical workflow analysis: a review of phase and step recognition. IEEE J Biomed Health Inf. https:\/\/doi.org\/10.1109\/JBHI.2023.3311628","journal-title":"IEEE J Biomed Health Inf"},{"key":"3211_CR4","doi-asserted-by":"publisher","first-page":"941","DOI":"10.1007\/s11548-014-0986-z","volume":"9","author":"M Kranzfelder","year":"2014","unstructured":"Kranzfelder M, Schneider A, Fiolka A, Koller S, Reiser S, Vogel T, Wilhelm D, Feussner H (2014) Reliability of sensor-based real-time workflow recognition in laparoscopic cholecystectomy. Int J Comput Assist Radiol Surg 9:941\u2013948","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"3211_CR5","unstructured":"DiPietro R, Stauder R, Kayis E, Schneider A, Kranzfelder M, Feussner H, Hager GD, Navab N (2015) Automated surgical-phase recognition using rapidly-deployable sensors. In Proc MICCAI Workshop M2CAI"},{"issue":"1","key":"3211_CR6","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1515\/bmt-2017-0020","volume":"63","author":"M Kasparick","year":"2018","unstructured":"Kasparick M, Schmitz M, Andersen B, Rockstroh M, Franke S, Schlichting S, Golatowski F, Timmermann D (2018) OR.NET a service-oriented architecture for safe and dynamic medical device interoperability. Biomed Eng\/Biomedizinische Technik 63(1):11\u201330","journal-title":"Biomed Eng\/Biomedizinische Technik"},{"key":"3211_CR7","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1007\/978-981-16-4325-5_53","volume-title":"Multidisciplinary computational anatomy","author":"Y Muragaki","year":"2022","unstructured":"Muragaki Y, Okamoto J, Masamune K, Iseki H (2022) Smart Cyber operating theater (SCOT): strategy for future OR. In: Hashizume M (ed) Multidisciplinary computational anatomy. Springer, Singapore, pp 389\u2013393"},{"key":"3211_CR8","doi-asserted-by":"publisher","first-page":"1521","DOI":"10.1007\/s00464-020-08168-1","volume":"35","author":"R Anteby","year":"2021","unstructured":"Anteby R, Horesh N, Soffer S, Zager Y, Barash Y, Amiel I, Rosin D, Gutman M, Klang E (2021) Deep learning visual analysis in laparoscopic surgery: a systematic review and diagnostic test accuracy meta-analysis. Surg Endosc 35:1521\u20131533","journal-title":"Surg Endosc"},{"key":"3211_CR9","doi-asserted-by":"crossref","unstructured":"\u00d6zsoy E, \u00d6rnek EP, Eck U, Czempiel T, Tombari F, Navab N (2022) 4d-or: Semantic scene graphs for or domain modeling. In: Medical image computing and computer assisted intervention\u2013miccai 2022: 25th international conference, Singapore, September 18\u201322, 2022, proceedings, part VII. Springer Nature Switzerland, Cham. pp 475\u2013485","DOI":"10.1007\/978-3-031-16449-1_45"},{"key":"3211_CR10","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/j.jss.2022.08.006","volume":"281","author":"AS Mattingly","year":"2023","unstructured":"Mattingly AS, Chen MM, Divi V, Holsinger FC, Saraswathula A (2023) Minimally invasive surgery in the United States, 2022: understanding its value using new datasets. J Surg Res 281:33\u201336","journal-title":"J Surg Res"},{"issue":"2","key":"3211_CR11","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1080\/13645706.2019.1584116","volume":"28","author":"N Padoy","year":"2019","unstructured":"Padoy N (2019) Machine and deep learning for workflow recognition during surgery. Minim Invasive Ther Allied Technol 28(2):82\u201390","journal-title":"Minim Invasive Ther Allied Technol"},{"key":"3211_CR12","doi-asserted-by":"crossref","unstructured":"Volkov M, Hashimoto DA, Rosman G, Meireles OR, Rus D (2017) Machine learning and coresets for automated real-time video segmentation of laparoscopic and robot-assisted surgery. In 2017 IEEE international conference on robotics and automation (ICRA) pp. 754\u2013759","DOI":"10.1109\/ICRA.2017.7989093"},{"key":"3211_CR13","doi-asserted-by":"crossref","unstructured":"Blum T, Feu\u00dfne, H, Navab N (2010) Modeling and segmentation of surgical workflow from laparoscopic video. In: Medical image computing and computer-assisted intervention\u2013MICCAI 2010: 13th international conference, Beijing, China, September 20\u201324, 2010, proceedings, part III 13. Springer Berlin Heidelberg. pp. 400\u2013407","DOI":"10.1007\/978-3-642-15711-0_50"},{"issue":"2","key":"3211_CR14","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1109\/JSTSP.2019.2908700","volume":"13","author":"H Purwins","year":"2019","unstructured":"Purwins H, Li B, Virtanen T, Schl\u00fcter J, Chang SY, Sainath T (2019) Deep learning for audio signal processing. IEEE J Sel Top Signal Process 13(2):206\u2013219","journal-title":"IEEE J Sel Top Signal Process"},{"issue":"3","key":"3211_CR15","doi-asserted-by":"publisher","first-page":"329","DOI":"10.2307\/1417526","volume":"53","author":"SS Stevens","year":"1940","unstructured":"Stevens SS, Volkmann J (1940) The relation of pitch to frequency: a revised scale. Am J Psychol 53(3):329\u2013353","journal-title":"Am J Psychol"},{"issue":"4","key":"3211_CR16","doi-asserted-by":"publisher","first-page":"356","DOI":"10.1038\/nn831","volume":"5","author":"MS Lewicki","year":"2002","unstructured":"Lewicki MS (2002) Efficient coding of natural sounds. Nat Neurosci 5(4):356\u2013363","journal-title":"Nat Neurosci"},{"key":"3211_CR17","unstructured":"Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, Corrado GS, Davis A, Dean J, Devin M, Ghemawat S, Goodfellow I, Harp A, Irving G, Isard M, Jia Y, Jozefowicz R, Kaiser L, Kudlur M, Levenberg J, Mane D, Monga R, Moore S, Murray, Chris Olah D, Schuster M, Shlens J, Steiner B, Sutskever I, Talwar K, Tucker P, Vanhoucke V, Vasudevan V, Viegas F, Vinyals O, Warden P, Wattenberg M, Wicke M, Yu Y, Zheng X (2016) Tensorflow: large-scale machine learning on heterogeneous distributed systems. In: Proceedings of the 12th USENIX symposium on operating systems design and implementation,\u00a0OSDI 16. pp 265\u2013283"},{"key":"3211_CR18","unstructured":"Chollet F (2015) Keras. [online] https:\/\/github.com\/fchollet\/keras. Accessed 20 Apr 2024"},{"key":"3211_CR19","doi-asserted-by":"crossref","unstructured":"Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009).Imagenet: a large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition. IEEE. pp 248\u2013255","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"3211_CR20","doi-asserted-by":"crossref","unstructured":"Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition. pp 2818\u20132826","DOI":"10.1109\/CVPR.2016.308"},{"key":"3211_CR21","unstructured":"Majumdar S (2017) MobileNet v1 models for Keras [online] https:\/\/github.com\/fchollet\/deep-learning-models\/blob\/master\/mobilenet.py. Accessed 20 Apr 2024"},{"key":"3211_CR22","doi-asserted-by":"crossref","unstructured":"Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 4700\u20134708","DOI":"10.1109\/CVPR.2017.243"},{"issue":"1","key":"3211_CR23","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1109\/TMI.2016.2593957","volume":"36","author":"AP Twinanda","year":"2016","unstructured":"Twinanda AP, Shehata S, Mutter D, Marescaux J, De Mathelin M, Padoy N (2016) Endonet: a deep architecture for recognition tasks on laparoscopic videos. IEEE Trans Med Imaging 36(1):86\u201397","journal-title":"IEEE Trans Med Imaging"},{"key":"3211_CR24","unstructured":"Tan M, Le Q (2019) Efficientnet: rethinking model scaling for convolutional neural networks. In: International conference on machine learning. PMLR. pp 6105\u20136114"},{"key":"3211_CR25","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 770\u2013778)","DOI":"10.1109\/CVPR.2016.90"},{"key":"3211_CR26","unstructured":"Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. In: Proceedings of the 3rd international conference on learning representations (ICLR 2015). Computational and Biological Learning Society 2015"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03211-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-024-03211-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03211-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,29]],"date-time":"2024-11-29T15:14:26Z","timestamp":1732893266000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-024-03211-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,11]]},"references-count":26,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["3211"],"URL":"https:\/\/doi.org\/10.1007\/s11548-024-03211-1","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,11]]},"assertion":[{"value":"9 January 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 June 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 June 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Jonas Fuchtmann, Thomas Riedel, Daniel Ostler, Maximilian Berlet, Alissa Jell, Luca Wegener, Lars Wagner, Simone Graf, Dirk Wilhelm declares no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The study including the human participants was approved by the ethical board of Klinikum rechts der Isar, of the Technical University Munich (application number 337\/21 S-EB).","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"This article does not contain patient data.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}