{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T08:32:00Z","timestamp":1777710720465,"version":"3.51.4"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2024,1,29]],"date-time":"2024-01-29T00:00:00Z","timestamp":1706486400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,1,29]],"date-time":"2024-01-29T00:00:00Z","timestamp":1706486400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100007316","name":"Klaus Tschira Stiftung","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100007316","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>Machine learning approaches can only be reliably evaluated if training, validation, and test data splits are representative and not affected by the absence of classes. Surgical workflow and instrument recognition are two tasks that are complicated in this manner, because of heavy data imbalances resulting from different length of phases and their potential erratic occurrences. Furthermore, sub-properties like instrument (co-)occurrence are usually not particularly considered when defining the split.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>We present a publicly available data visualization tool that enables interactive exploration of dataset partitions for surgical phase and instrument recognition. The application focuses on the visualization of the occurrence of phases, phase transitions, instruments, and instrument combinations across sets. Particularly, it facilitates assessment of dataset splits, especially regarding identification of sub-optimal dataset splits.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We performed analysis of the datasets Cholec80, CATARACTS, CaDIS, M2CAI-workflow, and M2CAI-tool using the proposed application. We were able to uncover phase transitions, individual instruments, and combinations of surgical instruments that were not represented in one of the sets. Addressing these issues, we identify possible improvements in the splits using our tool. A user study with ten participants demonstrated that the participants were able to successfully solve a selection of data exploration tasks.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>In highly unbalanced class distributions, special care should be taken with respect to the selection of an appropriate dataset split because it can greatly influence the assessments of machine learning approaches. Our interactive tool allows for determination of better splits to improve current practices in the field. The live application is available at <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/cardio-ai.github.io\/endovis-ml\/\">https:\/\/cardio-ai.github.io\/endovis-ml\/<\/jats:ext-link>.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-024-03063-9","type":"journal-article","created":{"date-parts":[[2024,1,29]],"date-time":"2024-01-29T15:03:11Z","timestamp":1706540591000},"page":"699-711","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Surgical phase and instrument recognition: how to identify appropriate dataset splits"],"prefix":"10.1007","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-5907-9839","authenticated-orcid":false,"given":"Georgii","family":"Kostiuchik","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0835-042X","authenticated-orcid":false,"given":"Lalith","family":"Sharan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3450-9556","authenticated-orcid":false,"given":"Benedikt","family":"Mayer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6519-6484","authenticated-orcid":false,"given":"Ivo","family":"Wolf","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9826-9478","authenticated-orcid":false,"given":"Bernhard","family":"Preim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8816-7654","authenticated-orcid":false,"given":"Sandy","family":"Engelhardt","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,1,29]]},"reference":[{"issue":"9","key":"3063_CR1","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1038\/s41551-017-0132-7","volume":"1","author":"L Maier-Hein","year":"2017","unstructured":"Maier-Hein L, Vedula SS, Speidel S, Navab N, Kikinis R, Park A, Eisenmann M, Feussner H, Forestier G, Giannarou S, Hashizume M, Katic D, Kenngott H, Kranzfelder M, Malpani A, M\u00e4rz K, Neumuth T, Padoy N, Pugh C, Schoch N, Stoyanov D, Taylor R, Wagner M, Hager GD, Jannin P (2017) Surgical data science for next-generation interventions. Nat Biomed Eng 1(9):691\u2013696. https:\/\/doi.org\/10.1038\/s41551-017-0132-7","journal-title":"Nat Biomed Eng"},{"issue":"4","key":"3063_CR2","doi-asserted-by":"publisher","first-page":"684","DOI":"10.1097\/SLA.0000000000004425","volume":"273","author":"CR Garrow","year":"2021","unstructured":"Garrow CR, Kowalewski K-F, Li L, Wagner M, Schmidt MW, Engelhardt S, Hashimoto DA, Kenngott HG, Bodenstedt S, Speidel S, M\u00fcller-Stich BP, Nickel F (2021) Machine learning for surgical phase recognition: a systematic review. Ann Surg 273(4):684. https:\/\/doi.org\/10.1097\/SLA.0000000000004425","journal-title":"Ann Surg"},{"issue":"11","key":"3063_CR3","doi-asserted-by":"publisher","first-page":"5405","DOI":"10.1109\/JBHI.2023.3311628","volume":"27","author":"KC Demir","year":"2023","unstructured":"Demir KC, Schieber H, Weise T, Roth D, May M, Maier A, Yang SH (2023) Deep learning in surgical workflow analysis: a review of phase and step recognition. IEEE J Biomed Health Inform 27(11):5405\u20135417. https:\/\/doi.org\/10.1109\/JBHI.2023.3311628","journal-title":"IEEE J Biomed Health Inform"},{"key":"3063_CR4","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2023.102888","volume":"89","author":"CI Nwoye","year":"2023","unstructured":"Nwoye CI, Yu T, Sharma S, Murali A, Alapatt D, Vardazaryan A, Yuan K, Hajek J, Reiter W, Yamlahi A, Smidt F-H, Zou X, Zheng G, Oliveira B, Torres HR, Kondo S, Kasai S, Holm F, \u00d6zsoy E, Gui S, Li H, Raviteja S, Sathish R, Poudel P, Bhattarai B, Wang Z, Rui G, Schellenberg M, Vila\u00e7a JL, Czempiel T, Wang Z, Sheet D, Thapa SK, Berniker M, Godau P, Morais P, Regmi S, Tran TN, Fonseca J, N\u00f6lke J-H, Lima E, Vazquez E, Maier-Hein L, Navab N, Mascagni P, Seeliger B, Gonzalez C, Mutter D, Padoy N (2023) CholecTriplet2022: show me a tool and tell me the triplet\u2013an endoscopic vision challenge for surgical action triplet detection. Med Image Anal 89:102888. https:\/\/doi.org\/10.1016\/j.media.2023.102888","journal-title":"Med Image Anal"},{"key":"3063_CR5","doi-asserted-by":"publisher","unstructured":"Huaulm\u00e9 A, Harada K, Nguyen Q-M, Park B, Hong S, Choi M-K, Peven M, Li Y, Long Y, Dou Q, Kumar S, Lalithkumar S, Hongliang R, Matsuzaki H, Ishikawa Y, Harai Y, Kondo S, Mitsuishi M, Jannin P (April 2023) PEg TRAnsfer Workflow recognition challenge report: does multi-modal data improve recognition? Technical report. https:\/\/doi.org\/10.48550\/arXiv.2202.05821. arXiv:2202.05821 [cs] type: article","DOI":"10.48550\/arXiv.2202.05821"},{"issue":"1","key":"3063_CR6","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1038\/s41597-021-00882-2","volume":"8","author":"L Maier-Hein","year":"2021","unstructured":"Maier-Hein L, Wagner M, Ross T, Reinke A, Bodenstedt S, Full PM, Hempe H, Mindroc-Filimon D, Scholz P, Tran TN, Bruno P, Kisilenko A, M\u00fcller B, Davitashvili T, Capek M, Tizabi MD, Eisenmann M, Adler TJ, Gr\u00f6hl J, Schellenberg M, Seidlitz S, Lai TYE, Pekdemir B, Roethlingshoefer V, Both F, Bittel S, Mengler M, M\u00fcndermann L, Apitz M, Kopp-Schneider A, Speidel S, Nickel F, Probst P, Kenngott HG, M\u00fcller-Stich BP (2021) Heidelberg colorectal data set for surgical data science in the sensor operating room. Sci Data 8(1):101. https:\/\/doi.org\/10.1038\/s41597-021-00882-2","journal-title":"Sci Data"},{"issue":"1","key":"3063_CR7","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1109\/TMI.2016.2593957","volume":"36","author":"AP Twinanda","year":"2017","unstructured":"Twinanda AP, Shehata S, Mutter D, Marescaux J, de Mathelin M, Padoy N (2017) EndoNet: a deep architecture for recognition tasks on laparoscopic videos. IEEE Trans Med Imaging 36(1):86\u201397. https:\/\/doi.org\/10.1109\/TMI.2016.2593957","journal-title":"IEEE Trans Med Imaging"},{"issue":"6","key":"3063_CR8","doi-asserted-by":"publisher","first-page":"1013","DOI":"10.1007\/s11548-017-1565-x","volume":"12","author":"M Sahu","year":"2017","unstructured":"Sahu M, Mukhopadhyay A, Szengel A, Zachow S (2017) Addressing multi-label imbalance problem of surgical tool detection using CNN. Int J Comput Assist Radiol Surg 12(6):1013\u20131020. https:\/\/doi.org\/10.1007\/s11548-017-1565-x","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"3063_CR9","doi-asserted-by":"publisher","unstructured":"Zisimopoulos O, Flouty E, Luengo I, Giataganas P, Nehme J, Chow A, Stoyanov D (2018) DeepPhase: surgical phase recognition in CATARACTS videos. In: Medical image computing and computer assisted intervention\u2014MICCAI 2018. Lecture notes in computer science. Springer, Cham, pp 265\u2013272. https:\/\/doi.org\/10.1007\/978-3-030-00937-3_31","DOI":"10.1007\/978-3-030-00937-3_31"},{"key":"3063_CR10","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1016\/j.media.2018.11.008","volume":"52","author":"H Al Hajj","year":"2019","unstructured":"Al Hajj H, Lamard M, Conze P-H, Roychowdhury S, Hu X, Mar\u0161alkait\u0117 G, Zisimopoulos O, Dedmari MA, Zhao F, Prellberg J, Sahu M, Galdran A, Ara\u00fajo T, Vo DM, Panda C, Dahiya N, Kondo S, Bian Z, Vahdat A, Bialopetravi\u010dius J, Flouty E, Qiu C, Dill S, Mukhopadhyay A, Costa P, Aresta G, Ramamurthy S, Lee S-W, Campilho A, Zachow S, Xia S, Conjeti S, Stoyanov D, Armaitis J, Heng P-A, Macready WG, Cochener B, Quellec G (2019) CATARACTS: challenge on automatic tool annotation for cataRACT surgery. Med Image Anal 52:24\u201341. https:\/\/doi.org\/10.1016\/j.media.2018.11.008","journal-title":"Med Image Anal"},{"key":"3063_CR11","doi-asserted-by":"publisher","unstructured":"Czempiel T, Paschali M, Keicher M, Simson W, Feussner H, Kim ST, Navab N (2020) TeCNO: surgical phase recognition with multi-stage temporal convolutional networks. In: Medical image computing and computer assisted intervention\u2014MICCAI 2020. Lecture notes in computer science. Springer, Cham, pp 343\u2013352. https:\/\/doi.org\/10.1007\/978-3-030-59716-0_33","DOI":"10.1007\/978-3-030-59716-0_33"},{"key":"3063_CR12","doi-asserted-by":"publisher","unstructured":"Czempiel T, Paschali M, Ostler D, Kim ST, Busam B, Navab N (2021) OperA: attention-regularized transformers for surgical phase recognition. In: Medical image computing and computer assisted intervention\u2014MICCAI 2021, vol 12904 , pp 604\u2013614. https:\/\/doi.org\/10.1007\/978-3-030-87202-1_58","DOI":"10.1007\/978-3-030-87202-1_58"},{"issue":"7","key":"3063_CR13","doi-asserted-by":"publisher","first-page":"1111","DOI":"10.1007\/s11548-021-02388-z","volume":"16","author":"S Ramesh","year":"2021","unstructured":"Ramesh S, Dall\u2019Alba D, Gonzalez C, Yu T, Mascagni P, Mutter D, Marescaux J, Fiorini P, Padoy N (2021) Multi-task temporal convolutional networks for joint recognition of surgical phases and steps in gastric bypass procedures. Int J Comput Assist Radiol Surg 16(7):1111\u20131119. https:\/\/doi.org\/10.1007\/s11548-021-02388-z","journal-title":"Int J Comput Assist Radiol Surg"},{"issue":"11","key":"3063_CR14","doi-asserted-by":"publisher","first-page":"2029","DOI":"10.1007\/s11548-021-02473-3","volume":"16","author":"B Zhang","year":"2021","unstructured":"Zhang B, Ghanem A, Simes A, Choi H, Yoo A (2021) Surgical workflow recognition with 3DCNN for Sleeve Gastrectomy. Int J Comput Assist Radiol Surg 16(11):2029\u20132036. https:\/\/doi.org\/10.1007\/s11548-021-02473-3","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"3063_CR15","doi-asserted-by":"publisher","unstructured":"Funke I, Rivoir D, Speidel S (May 2023) Metrics matter in surgical phase recognition. Technical report. https:\/\/doi.org\/10.48550\/arXiv.2305.13961","DOI":"10.48550\/arXiv.2305.13961"},{"issue":"9","key":"3063_CR16","doi-asserted-by":"publisher","first-page":"1263","DOI":"10.1109\/TKDE.2008.239","volume":"21","author":"H He","year":"2009","unstructured":"He H, Garcia EA (2009) Learning from imbalanced data. IEEE Trans Knowl Data Eng 21(9):1263\u20131284. https:\/\/doi.org\/10.1109\/TKDE.2008.239","journal-title":"IEEE Trans Knowl Data Eng"},{"issue":"3","key":"3063_CR17","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1007\/s11548-021-02544-5","volume":"17","author":"Y Zhang","year":"2022","unstructured":"Zhang Y, Bano S, Page A-S, Deprest J, Stoyanov D, Vasconcelos F (2022) Large-scale surgical workflow segmentation for laparoscopic sacrocolpopexy. Int J Comput Assist Radiol Surg 17(3):467\u2013477. https:\/\/doi.org\/10.1007\/s11548-021-02544-5","journal-title":"Int J Comput Assist Radiol Surg"},{"issue":"3","key":"3063_CR18","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1515\/iss-2017-0005","volume":"2","author":"T Neumuth","year":"2017","unstructured":"Neumuth T (2017) Surgical process modeling. Innov Surg Sci 2(3):123\u2013137. https:\/\/doi.org\/10.1515\/iss-2017-0005","journal-title":"Innov Surg Sci"},{"key":"3063_CR19","doi-asserted-by":"publisher","unstructured":"Ahmadi S-A, Sielhorst T, Stauder R, Horn M, Feussner H, Navab N (2006) Recovery of surgical workflow without explicit models. In: Larsen R, Nielsen M, Sporring J (eds) Medical image computing and computer-assisted intervention\u2014MICCAI 2006. Lecture notes in computer science. Springer, Berlin, Heidelberg, pp 420\u2013428. https:\/\/doi.org\/10.1007\/11866565_52","DOI":"10.1007\/11866565_52"},{"issue":"3","key":"3063_CR20","doi-asserted-by":"publisher","first-page":"632","DOI":"10.1016\/j.media.2010.10.001","volume":"16","author":"N Padoy","year":"2012","unstructured":"Padoy N, Blum T, Ahmadi S-A, Feussner H, Berger M-O, Navab N (2012) Statistical modeling and recognition of surgical workflow. Med Image Anal 16(3):632\u2013641. https:\/\/doi.org\/10.1016\/j.media.2010.10.001","journal-title":"Med Image Anal"},{"key":"3063_CR21","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2023.102770","volume":"86","author":"M Wagner","year":"2023","unstructured":"Wagner M, M\u00fcller-Stich B-P, Kisilenko A, Tran D, Heger P, M\u00fcndermann L, Lubotsky DM, M\u00fcller B, Davitashvili T, Capek M, Reinke A, Reid C, Yu T, Vardazaryan A, Nwoye CI, Padoy N, Liu X, Lee E-J, Disch C, Meine H, Xia T, Jia F, Kondo S, Reiter W, Jin Y, Long Y, Jiang M, Dou Q, Heng PA, Twick I, Kirtac K, Hosgor E, Bolmgren JL, Stenzel M, von Siemens B, Zhao L, Ge Z, Sun H, Xie D, Guo M, Liu D, Kenngott HG, Nickel F, Frankenberg Mv, Mathis-Ullrich F, Kopp-Schneider A, Maier-Hein L, Speidel S, Bodenstedt S (2023) Comparative validation of machine learning algorithms for surgical workflow and skill analysis with the HeiChole benchmark. Med Image Anal 86:102770. https:\/\/doi.org\/10.1016\/j.media.2023.102770","journal-title":"Med Image Anal"},{"issue":"5","key":"3063_CR22","doi-asserted-by":"publisher","first-page":"1114","DOI":"10.1109\/TMI.2017.2787657","volume":"37","author":"Y Jin","year":"2018","unstructured":"Jin Y, Dou Q, Chen H, Yu L, Qin J, Fu C-W, Heng P-A (2018) SV-RCNet: workflow recognition from surgical videos using recurrent convolutional network. IEEE Trans Med Imaging 37(5):1114\u20131126. https:\/\/doi.org\/10.1109\/TMI.2017.2787657","journal-title":"IEEE Trans Med Imaging"},{"key":"3063_CR23","doi-asserted-by":"publisher","unstructured":"Gao X, Jin Y, Long Y, Dou Q, Heng P-A (2021) Trans-SVNet: accurate phase recognition from surgical videos via hybrid embedding aggregation transformer. In: Medical image computing and computer assisted intervention\u2014MICCAI 2021. Lecture notes in computer science. Springer, Cham, pp 593\u2013603 (2021). https:\/\/doi.org\/10.1007\/978-3-030-87202-1_57","DOI":"10.1007\/978-3-030-87202-1_57"},{"issue":"12","key":"3063_CR24","doi-asserted-by":"publisher","first-page":"2193","DOI":"10.1007\/s11548-022-02743-8","volume":"17","author":"Y Jin","year":"2022","unstructured":"Jin Y, Long Y, Gao X, Stoyanov D, Dou Q, Heng P-A (2022) Trans-SVNet: hybrid embedding aggregation Transformer for surgical workflow analysis. Int J Comput Assist Radiol Surg 17(12):2193\u20132202. https:\/\/doi.org\/10.1007\/s11548-022-02743-8","journal-title":"Int J Comput Assist Radiol Surg"},{"issue":"4","key":"3063_CR25","doi-asserted-by":"publisher","first-page":"1012","DOI":"10.1080\/21681163.2022.2145238","volume":"11","author":"X Zou","year":"2023","unstructured":"Zou X, Liu W, Wang J, Tao R, Zheng G (2023) ARST: auto-regressive surgical transformer for phase recognition from laparoscopic videos. Comput Methods Biomech Biomed Eng Imaging Vis 11(4):1012\u20131018. https:\/\/doi.org\/10.1080\/21681163.2022.2145238","journal-title":"Comput Methods Biomech Biomed Eng Imaging Vis"},{"issue":"1","key":"3063_CR26","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1007\/s11548-022-02785-y","volume":"18","author":"X Pan","year":"2023","unstructured":"Pan X, Gao X, Wang H, Zhang W, Mu Y, He X (2023) Temporal-based Swin Transformer network for workflow recognition of surgical video. Int J Comput Assist Radiol Surg 18(1):139\u2013147. https:\/\/doi.org\/10.1007\/s11548-022-02785-y","journal-title":"Int J Comput Assist Radiol Surg"},{"issue":"5","key":"3063_CR27","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1007\/s11548-008-0239-0","volume":"3","author":"T Blum","year":"2008","unstructured":"Blum T, Padoy N, Feu\u00dfner H, Navab N (2008) Workflow mining for visualization and analysis of surgeries. Int J Comput Assist Radiol Surg 3(5):379\u2013386. https:\/\/doi.org\/10.1007\/s11548-008-0239-0","journal-title":"Int J Comput Assist Radiol Surg"},{"issue":"1","key":"3063_CR28","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1007\/s11548-022-02758-1","volume":"18","author":"B Mayer","year":"2023","unstructured":"Mayer B, Meuschke M, Chen J, M\u00fcller-Stich BP, Wagner M, Preim B, Engelhardt S (2023) Interactive visual exploration of surgical process data. Int J Comput Assist Radiol Surg 18(1):127\u2013137. https:\/\/doi.org\/10.1007\/s11548-022-02758-1","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"3063_CR29","doi-asserted-by":"publisher","unstructured":"Fox M, Schoeffmann K (2022) The impact of dataset splits on classification performance in medical videos. In: Proceedings of the 2022 international conference on multimedia retrieval. ICMR \u201922. Association for Computing Machinery, New York, NY, USA, pp 6\u201310. https:\/\/doi.org\/10.1145\/3512527.3531424","DOI":"10.1145\/3512527.3531424"},{"key":"3063_CR30","doi-asserted-by":"publisher","unstructured":"Bostock M, Ogievetsky V, Heer J (2011) D$$^{3}$$ data-driven documents. IEEE Trans Visual Comput Gr 17(12):2301\u20132309. https:\/\/doi.org\/10.1109\/TVCG.2011.185 pg","DOI":"10.1109\/TVCG.2011.185"},{"key":"3063_CR31","doi-asserted-by":"publisher","unstructured":"Wattenberg M (2002) Arc diagrams: visualizing structure in strings. In: IEEE symposium on information visualization, 2002. INFOVIS 2002, pp 110\u2013116. https:\/\/doi.org\/10.1109\/INFVIS.2002.1173155. ISSN: 1522-404X","DOI":"10.1109\/INFVIS.2002.1173155"},{"issue":"12","key":"3063_CR32","doi-asserted-by":"publisher","first-page":"2496","DOI":"10.1109\/TVCG.2013.184","volume":"19","author":"B Alsallakh","year":"2013","unstructured":"Alsallakh B, Aigner W, Miksch S, Hauser H (2013) Radial sets: interactive visual analysis of large overlapping sets. IEEE Trans Visual Comput Gr 19(12):2496\u20132505. https:\/\/doi.org\/10.1109\/TVCG.2013.184","journal-title":"IEEE Trans Visual Comput Gr"},{"key":"3063_CR33","doi-asserted-by":"publisher","unstructured":"Brooke J (1996) SUS: a \u2019quick and dirty\u2019 usability scale. Usability evaluation in industry, pp 207\u2013212. https:\/\/doi.org\/10.1201\/9781498710411-35","DOI":"10.1201\/9781498710411-35"},{"key":"3063_CR34","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.102053","volume":"71","author":"M Grammatikopoulou","year":"2021","unstructured":"Grammatikopoulou M, Flouty E, Kadkhodamohammadi A, Quellec G, Chow A, Nehme J, Luengo I, Stoyanov D (2021) CaDIS: cataract dataset for surgical RGB-image segmentation. Med Image Anal 71:102053. https:\/\/doi.org\/10.1016\/j.media.2021.102053","journal-title":"Med Image Anal"},{"key":"3063_CR35","doi-asserted-by":"publisher","unstructured":"Stauder R, Ostler D, Kranzfelder M, Koller S, Feu\u00dfner H, Navab N (August 2017) The TUM LapChole dataset for the M2CAI 2016 workflow challenge. Technical report. https:\/\/doi.org\/10.48550\/arXiv.1610.09278. arXiv:1610.09278 [cs] type: article","DOI":"10.48550\/arXiv.1610.09278"},{"key":"3063_CR36","doi-asserted-by":"publisher","unstructured":"Chen W, Feng J, Lu J, Zhou J (2018) Endo3D: online workflow analysis for endoscopic surgeries based on 3D CNN and LSTM. In: OR 2.0 context-aware operating theaters, computer assisted robotic endoscopy, clinical image-based procedures, and skin image analysis. Lecture notes in computer science. Springer, Cham, pp 97\u2013107. https:\/\/doi.org\/10.1007\/978-3-030-01201-4_12","DOI":"10.1007\/978-3-030-01201-4_12"},{"key":"3063_CR37","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2019.101572","volume":"59","author":"Y Jin","year":"2020","unstructured":"Jin Y, Li H, Dou Q, Chen H, Qin J, Fu C-W, Heng P-A (2020) Multi-task recurrent convolutional network with correlation loss for surgical video analysis. Med Image Anal 59:101572. https:\/\/doi.org\/10.1016\/j.media.2019.101572","journal-title":"Med Image Anal"},{"key":"3063_CR38","doi-asserted-by":"publisher","unstructured":"Rivoir D, Funke I, Speidel S (March 2023) On the pitfalls of batch normalization for end-to-end video learning: a study on surgical workflow analysis. Technical report. https:\/\/doi.org\/10.48550\/arXiv.2203.07976","DOI":"10.48550\/arXiv.2203.07976"},{"issue":"5","key":"3063_CR39","doi-asserted-by":"publisher","first-page":"598","DOI":"10.1002\/sam.11574","volume":"15","author":"A Vakayil","year":"2022","unstructured":"Vakayil A, Joseph VR (2022) Data twinning. Stat Anal Data Min ASA Data Sci J 15(5):598\u2013610. https:\/\/doi.org\/10.1002\/sam.11574","journal-title":"Stat Anal Data Min ASA Data Sci J"},{"issue":"6","key":"3063_CR40","doi-asserted-by":"publisher","first-page":"1053","DOI":"10.1007\/s11548-023-02914-1","volume":"18","author":"S Sharma","year":"2023","unstructured":"Sharma S, Nwoye CI, Mutter D, Padoy N (2023) Rendezvous in time: an attention-based temporal fusion approach for surgical triplet recognition. Int J Comput Assist Radiol Surg 18(6):1053\u20131059. https:\/\/doi.org\/10.1007\/s11548-023-02914-1","journal-title":"Int J Comput Assist Radiol Surg"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03063-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-024-03063-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03063-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,28]],"date-time":"2024-03-28T02:21:16Z","timestamp":1711592476000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-024-03063-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,29]]},"references-count":40,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,4]]}},"alternative-id":["3063"],"URL":"https:\/\/doi.org\/10.1007\/s11548-024-03063-9","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,29]]},"assertion":[{"value":"1 September 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 January 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 January 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 February 2024","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Update","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Incorrect link in the code availability section has been updated.","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and\/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Informed consent was obtained from all individual participants of the user study.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}