{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,14]],"date-time":"2026-02-14T02:23:10Z","timestamp":1771035790254,"version":"3.50.1"},"reference-count":18,"publisher":"Springer Science and Business Media LLC","issue":"10","license":[{"start":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T00:00:00Z","timestamp":1721001600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T00:00:00Z","timestamp":1721001600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["16KISK002"],"award-info":[{"award-number":["16KISK002"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100020639","name":"Bayerische Staatsministerium f\u00fcr Wirtschaft, Landesentwicklung und Energie","doi-asserted-by":"publisher","award":["DIK0372"],"award-info":[{"award-number":["DIK0372"]}],"id":[{"id":"10.13039\/501100020639","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>Video-based intra-abdominal instrument tracking for laparoscopic surgeries is a common research area. However, the tracking can only be done with instruments that are actually visible in the laparoscopic image. By using extra-abdominal cameras to detect trocars and classify their occupancy state, additional information about the instrument location, whether an instrument is still in the abdomen or not, can be obtained. This can enhance laparoscopic workflow understanding and enrich already existing intra-abdominal solutions.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>A data set of four laparoscopic surgeries recorded with two time-synchronized extra-abdominal 2D cameras was generated. The preprocessed and annotated data were used to train a deep learning-based network architecture consisting of a trocar detection, a centroid tracker and a temporal model to provide the occupancy state of all trocars during the surgery.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The trocar detection model achieves an F1 score of <jats:inline-formula><jats:alternatives><jats:tex-math>$$95.06\\pm 0.88\\%$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                    <mml:mrow>\n                      <mml:mn>95.06<\/mml:mn>\n                      <mml:mo>\u00b1<\/mml:mo>\n                      <mml:mn>0.88<\/mml:mn>\n                      <mml:mo>%<\/mml:mo>\n                    <\/mml:mrow>\n                  <\/mml:math><\/jats:alternatives><\/jats:inline-formula>. The prediction of the occupancy state yields an F1 score of <jats:inline-formula><jats:alternatives><jats:tex-math>$$89.29\\pm 5.29\\%$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                    <mml:mrow>\n                      <mml:mn>89.29<\/mml:mn>\n                      <mml:mo>\u00b1<\/mml:mo>\n                      <mml:mn>5.29<\/mml:mn>\n                      <mml:mo>%<\/mml:mo>\n                    <\/mml:mrow>\n                  <\/mml:math><\/jats:alternatives><\/jats:inline-formula>, providing a first step towards enhanced surgical workflow understanding.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>The current method shows promising results for the extra-abdominal tracking of trocars and their occupancy state. Future advancements include the enlargement of the data set and incorporation of intra-abdominal imaging to facilitate accurate assignment of instruments to trocars.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-024-03220-0","type":"journal-article","created":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T11:02:40Z","timestamp":1721041360000},"page":"1939-1945","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Extra-abdominal trocar and instrument detection for enhanced surgical workflow understanding"],"prefix":"10.1007","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9974-6886","authenticated-orcid":false,"given":"Franziska","family":"Jurosch","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3021-4152","authenticated-orcid":false,"given":"Lars","family":"Wagner","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7153-3803","authenticated-orcid":false,"given":"Alissa","family":"Jell","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Esra","family":"Islertas","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dirk","family":"Wilhelm","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4652-0904","authenticated-orcid":false,"given":"Maximilian","family":"Berlet","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,7,15]]},"reference":[{"issue":"9","key":"3220_CR1","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1038\/s41551-017-0132-7","volume":"1","author":"L Maier-Hein","year":"2017","unstructured":"Maier-Hein L, Vedula SS, Speidel S, Navab N, Kikinis R, Park A, Eisenmann M, Feussner H, Forestier G, Giannarou S, Hashizume M, Katic D, Kenngott H, Kranzfelder M, Malpani A, M\u00e4rz K, Neumuth T, Padoy N, Pugh C, Schoch N, Stoyanov D, Taylor R, Wagner M, Hager GD, Jannin P (2017) Surgical data science for next-generation interventions. Nat Biomed Eng 1(9):691\u2013696","journal-title":"Nat Biomed Eng"},{"key":"3220_CR2","doi-asserted-by":"crossref","unstructured":"Demir KC, Schieber H, Weise T, Roth D, May M, Maier A, Yang SH (2023) Deep learning in surgical workflow analysis: a review of phase and step recognition. IEEE J Biomed Health Inform","DOI":"10.36227\/techrxiv.19665717"},{"key":"3220_CR3","first-page":"442","volume-title":"Medical image computing and computer assisted intervention\u2014MICCAI 2022","author":"N Valderrama","year":"2022","unstructured":"Valderrama N, Ruiz Puentes P, Hern\u00e1ndez I, Ayobi N, Verlyck M, Santander J, Caicedo J, Fern\u00e1ndez N, Arbel\u00e1ez P (2022) Towards holistic surgical scene understanding. In: Wang L, Dou Q, Fletcher PT, Speidel S, Li S (eds) Medical image computing and computer assisted intervention\u2014MICCAI 2022. Springer, Cham, pp 442\u2013452"},{"key":"3220_CR4","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2020.101920","volume":"70","author":"T Ro\u00df","year":"2021","unstructured":"Ro\u00df T, Reinke A, Full PM, Wagner M, Kenngott H, Apitz M, Hempe H, Mindroc-Filimon D, Scholz P, Tran TN, Bruno P, Arbel\u00e1ez P, Bian G-B, Bodenstedt S, Bolmgren JL, Bravo-S\u00e1nchez L, Chen H-B, Gonz\u00e1lez C, Guo D, Halvorsen P, Heng P-A, Hosgor E, Hou Z-G, Isensee F, Jha D, Jiang T, Jin Y, Kirtac K, Kletz S, Leger S, Li Z, Maier-Hein KH, Ni Z-L, Riegler MA, Schoeffmann K, Shi R, Speidel S, Stenzel M, Twick I, Wang G, Wang J, Wang L, Wang L, Zhang Y, Zhou Y-J, Zhu L, Wiesenfarth M, Kopp-Schneider A, M\u00fcller-Stich BP, Maier-Hein L (2021) Comparative validation of multi-instance instrument segmentation in endoscopy: results of the robust-mis 2019 challenge. Med Image Anal 70:101920","journal-title":"Med Image Anal"},{"key":"3220_CR5","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2021.103945","volume":"149","author":"Y Wang","year":"2022","unstructured":"Wang Y, Sun Q, Liu Z, Gu L (2022) Visual detection and tracking algorithms for minimally invasive surgical instruments: a comprehensive review of the state-of-the-art. Robot Auton Syst 149:103945. https:\/\/doi.org\/10.1016\/j.robot.2021.103945","journal-title":"Robot Auton Syst"},{"issue":"1","key":"3220_CR6","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1109\/TMI.2016.2593957","volume":"36","author":"AP Twinanda","year":"2017","unstructured":"Twinanda AP, Shehata S, Mutter D, Marescaux J, de Mathelin M, Padoy N (2017) Endonet: a deep architecture for recognition tasks on laparoscopic videos. IEEE Trans Med Imaging 36(1):86\u201397. https:\/\/doi.org\/10.1109\/TMI.2016.2593957","journal-title":"IEEE Trans Med Imaging"},{"key":"3220_CR7","doi-asserted-by":"crossref","unstructured":"Boonkong A, Hormdee D, Sonsilphong S, Khampitak K (2022) Surgical instrument detection for laparoscopic surgery using deep learning. In: 2022 19th international conference on electrical engineering\/electronics, computer, telecommunications and information technology (ECTI-CON). IEEE, pp 1\u20134","DOI":"10.1109\/ECTI-CON54298.2022.9795561"},{"key":"3220_CR8","doi-asserted-by":"publisher","first-page":"102801","DOI":"10.1016\/j.bspc.2021.102801","volume":"68","author":"TA Alshirbaji","year":"2021","unstructured":"Alshirbaji TA, Jalal NA, Docherty PD, Neumuth T, M\u00f6ller K (2021) A deep learning spatial-temporal framework for detecting surgical tools in laparoscopic videos. Biomed Signal Process Control 68:102801. https:\/\/doi.org\/10.1016\/j.bspc.2021.102801","journal-title":"Biomed Signal Process Control"},{"issue":"2","key":"3220_CR9","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1007\/s11548-014-1071-3","volume":"10","author":"B Rosa","year":"2024","unstructured":"Rosa B, Gruijthuijsen C, Van Cleynenbreugel B, Sloten JV, Reynaerts D, Poorten EV (2024) Estimation of optimal pivot point for remote center of motion alignment in surgery. Int J Comput Assist Radiol Surg 10(2):205\u2013215. https:\/\/doi.org\/10.1007\/s11548-014-1071-3","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"3220_CR10","doi-asserted-by":"crossref","unstructured":"Birch J, Da Cruz L, Rhode K, Bergeles C (2024) Trocar localisation for robot-assisted vitreoretinal surgery. Int J Comput Assist Radiol Surg 19(2):191\u2013198","DOI":"10.1007\/s11548-023-02987-y"},{"key":"3220_CR11","doi-asserted-by":"crossref","unstructured":"Dehghani S, Sommersperger M, Yang J, Salehi M, Busam B, Huang K, Gehlbach P, Iordachita I, Navab N, Nasseri MA (2022) Colibridoc: an eye-in-hand autonomous trocar docking system. In: 2022 International conference on robotics and automation (ICRA). IEEE, pp 7717\u20137723","DOI":"10.1109\/ICRA46639.2022.9811364"},{"key":"3220_CR12","doi-asserted-by":"publisher","unstructured":"Shimizu T, Hachiuma R, Kajita H, Takatsume Y, Saito H (2021) Hand motion-aware surgical tool localization and classification from an egocentric camera. J Imaging 7(2):15. https:\/\/doi.org\/10.3390\/jimaging7020015","DOI":"10.3390\/jimaging7020015"},{"key":"3220_CR13","unstructured":"Jocher G, Chaurasia A, Qiu J. Ultralytics YOLOv8. Accessed 11 Jun 2023. https:\/\/github.com\/ultralytics\/ultralytics"},{"key":"3220_CR14","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"issue":"8","key":"3220_CR15","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735\u20131780","journal-title":"Neural Comput"},{"key":"3220_CR16","unstructured":"Chung J, Gulcehre C, Cho K, Bengio Y (2014) Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555"},{"key":"3220_CR17","doi-asserted-by":"crossref","unstructured":"Farha YA, Gall J (2019) Ms-tcn: Multi-stage temporal convolutional network for action segmentation. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 3575\u20133584","DOI":"10.1109\/CVPR.2019.00369"},{"key":"3220_CR18","doi-asserted-by":"crossref","unstructured":"Lin T-Y, Goyal P, Girshick R, He K, Doll\u00e1r P (2017) Focal loss for dense object detection. In: Proceedings of the IEEE international conference on computer vision, pp 2980\u20132988","DOI":"10.1109\/ICCV.2017.324"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03220-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-024-03220-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03220-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,30]],"date-time":"2024-09-30T17:09:24Z","timestamp":1727716164000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-024-03220-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,15]]},"references-count":18,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2024,10]]}},"alternative-id":["3220"],"URL":"https:\/\/doi.org\/10.1007\/s11548-024-03220-0","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,15]]},"assertion":[{"value":"9 January 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 June 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 July 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no conflict of interest to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Patient data were used with ethical approval and informed consent. Approval was granted by the Ethics Committee of the University Hospital rechts der Isar (No. 337\/21\u00a0S). This study was performed in line with the principles of the Declaration of Helsinki.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}