{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T13:32:07Z","timestamp":1773840727953,"version":"3.50.1"},"reference-count":17,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2024,4,27]],"date-time":"2024-04-27T00:00:00Z","timestamp":1714176000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,27]],"date-time":"2024-04-27T00:00:00Z","timestamp":1714176000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003107","name":"Bundesministerium f\u00fcr Gesundheit","doi-asserted-by":"publisher","award":["BMG 2520DAT82"],"award-info":[{"award-number":["BMG 2520DAT82"]}],"id":[{"id":"10.13039\/501100003107","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100008658","name":"Deutsches Krebsforschungszentrum","doi-asserted-by":"publisher","award":["CoBot 2.0"],"award-info":[{"award-number":["CoBot 2.0"]}],"id":[{"id":"10.13039\/100008658","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["390696704"],"award-info":[{"award-number":["390696704"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["101092644"],"award-info":[{"award-number":["101092644"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100008662","name":"Joachim Herz Stiftung","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100008662","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>Understanding surgical scenes is crucial for computer-assisted surgery systems to provide intelligent assistance functionality. One way of achieving this is via scene segmentation using machine learning (ML). However, such ML models require large amounts of annotated training data, containing examples of all relevant object classes, which are rarely available. In this work, we propose a method to combine multiple partially annotated datasets, providing complementary annotations, into one model, enabling better scene segmentation and the use of multiple readily available datasets.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>Our method aims to combine available data with complementary labels by leveraging mutual exclusive properties to maximize information. Specifically, we propose to use positive annotations of other classes as negative samples and to exclude background pixels of these binary annotations, as we cannot tell if a positive prediction by the model is correct.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We evaluate our method by training a DeepLabV3 model on the publicly available Dresden Surgical Anatomy Dataset, which provides multiple subsets of binary segmented anatomical structures. Our approach successfully combines 6 classes into one model, significantly increasing the overall Dice Score by 4.4% compared to an ensemble of models trained on the classes individually. By including information on multiple classes, we were able to reduce the confusion between classes, e.g. a 24% drop for stomach and colon.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>By leveraging multiple datasets and applying mutual exclusion constraints, we developed a method that improves surgical scene segmentation performance without the need for fully annotated datasets. Our results demonstrate the feasibility of training a model on multiple complementary datasets. This paves the way for future work further alleviating the need for one specialized large, fully segmented dataset but instead the use of already existing datasets.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-024-03145-8","type":"journal-article","created":{"date-parts":[[2024,4,27]],"date-time":"2024-04-27T18:01:59Z","timestamp":1714240919000},"page":"1233-1241","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["One model to use them all: training a segmentation model with complementary datasets"],"prefix":"10.1007","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4675-417X","authenticated-orcid":false,"given":"Alexander C.","family":"Jenke","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sebastian","family":"Bodenstedt","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fiona R.","family":"Kolbinger","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marius","family":"Distler","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J\u00fcrgen","family":"Weitz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefanie","family":"Speidel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,4,27]]},"reference":[{"issue":"11","key":"3145_CR1","doi-asserted-by":"publisher","first-page":"2991","DOI":"10.1109\/TMI.2022.3177077","volume":"41","author":"Y Jin","year":"2022","unstructured":"Jin Y, Yu Y, Chen C, Zhao Z, Heng P-A, Stoyanov D (2022) Exploring intra- and inter-video relation for surgical semantic scene segmentation. IEEE Trans Med Imaging 41(11):2991\u20133002. https:\/\/doi.org\/10.1109\/TMI.2022.3177077","journal-title":"IEEE Trans Med Imaging"},{"key":"3145_CR2","doi-asserted-by":"publisher","unstructured":"Mohammed A, Yildirim S, Farup I, Pedersen M, Hovde \u00d8 (2019) StreoScenNet: surgical stereo robotic scene segmentation. In: Medical imaging 2019: image-guided procedures, robotic interventions, and modeling, vol 10951, p 109510. SPIE. https:\/\/doi.org\/10.1117\/12.2512518. International Society for Optics and Photonics","DOI":"10.1117\/12.2512518"},{"key":"3145_CR3","doi-asserted-by":"crossref","unstructured":"Yoon J, Hong S, Hong S, Lee J, Shin S, Park B, Sung N, Yu H, Kim S, Park S, Hyung WJ, Choi M-K (2022) Surgical scene segmentation using semantic image synthesis with a virtual surgery environment. In: Medical image computing and computer assisted intervention\u2014MICCAI 2022. Springer, Cham, pp 551\u2013561","DOI":"10.1007\/978-3-031-16449-1_53"},{"key":"3145_CR4","doi-asserted-by":"crossref","unstructured":"Fuentes-Hurtado F, Kadkhodamohammadi A, Flouty E, Barbarisi S, Luengo I, Stoyanov D (2019) Easylabels: weak labels for scene segmentation in laparoscopic videos. Int J Comput Assist Radiol Surg 14(7):1247\u20131257","DOI":"10.1007\/s11548-019-02003-2"},{"key":"3145_CR5","doi-asserted-by":"publisher","unstructured":"Allan M, Kondo S, Bodenstedt S, Leger S, Kadkhodamohammadi R, Luengo I, Fuentes F, Flouty E, Mohammed A, Pedersen M, Kori A, Alex V, Krishnamurthi G, Rauber D, Mendel R, Palm C, Bano S, Saibro G, Shih C-S, Chiang H-A, Zhuang J, Yang J, Iglovikov V, Dobrenkii A, Reddiboina M, Reddy A, Liu X, Gao C, Unberath M, Kim M, Kim C, Kim C, Kim H, Lee G, Ullah I, Luna M, Park SH, Azizian M, Stoyanov D, Maier-Hein L, Speidel S (2020) 2018 robotic scene segmentation challenge. https:\/\/doi.org\/10.48550\/ARXIV.2001.11190","DOI":"10.48550\/ARXIV.2001.11190"},{"key":"3145_CR6","unstructured":"HeiChole Surgical Workflow Analysis and Full Scene Segmentation (HeiSurF), EndoVis Subchallenge 2021. https:\/\/www.synapse.org\/#!Synapse:syn25101790\/wiki\/608802. Accessed 14 Nov 2022"},{"key":"3145_CR7","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.102306","volume":"76","author":"L Maier-Hein","year":"2022","unstructured":"Maier-Hein L, Eisenmann M, Sarikaya D, M\u00e4rz K, Collins T, Malpani A, Fallert J, Feussner H, Giannarou S, Mascagni P, Nakawala H, Park A, Pugh C, Stoyanov D, Vedula SS, Cleary K, Fichtinger G, Forestier G, Gibaud B, Grantcharov T, Hashizume M, Heckmann-N\u00f6tzel D, Kenngott HG, Kikinis R, M\u00fcndermann L, Navab N, Onogur S, Ro\u00df T, Sznitman R, Taylor RH, Tizabi MD, Wagner M, Hager GD, Neumuth T, Padoy N, Collins J, Gockel I, Goedeke J, Hashimoto DA, Joyeux L, Lam K, Leff DR, Madani A, Marcus HJ, Meireles O, Seitel A, Teber D, \u00dcckert F, M\u00fcller-Stich BP, Jannin P, Speidel S (2022) Surgical data science: from concepts toward clinical translation. Med Image Anal 76:102306. https:\/\/doi.org\/10.1016\/j.media.2021.102306","journal-title":"Med Image Anal"},{"issue":"1","key":"3145_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41597-022-01719-2","volume":"10","author":"M Carstens","year":"2023","unstructured":"Carstens M, Rinner FM, Bodenstedt S, Jenke AC, Weitz J, Distler M, Speidel S, Kolbinger FR (2023) The Dresden surgical anatomy dataset for abdominal organ segmentation in surgical data science. Sci Data 10(1):1\u20138. https:\/\/doi.org\/10.1038\/s41597-022-01719-2","journal-title":"Sci Data"},{"key":"3145_CR9","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.101979","volume":"70","author":"G Shi","year":"2021","unstructured":"Shi G, Xiao L, Chen Y, Zhou SK (2021) Marginal loss and exclusion loss for partially supervised multi-organ segmentation. Med Image Anal 70:101979. https:\/\/doi.org\/10.1016\/j.media.2021.101979","journal-title":"Med Image Anal"},{"key":"3145_CR10","doi-asserted-by":"crossref","unstructured":"Ulrich C, Isensee F, Wald T, Zenk M, Baumgartner M, Maier-Hein KH (2023) Multitalent: a multi-dataset approach to medical image segmentation. In: Medical image computing and computer assisted intervention: MICCAI 2023. Springer, Cham, pp 648\u2013658","DOI":"10.1007\/978-3-031-43898-1_62"},{"key":"3145_CR11","doi-asserted-by":"crossref","unstructured":"Dmitriev K, Kaufman AE (2019) Learning multi-class segmentations from single-class datasets. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 9501\u20139511","DOI":"10.1109\/CVPR.2019.00973"},{"issue":"10","key":"3145_CR12","doi-asserted-by":"publisher","first-page":"2759","DOI":"10.1109\/TMI.2020.3047598","volume":"40","author":"K Yan","year":"2020","unstructured":"Yan K, Cai J, Zheng Y, Harrison AP, Jin D, Tang Y, Tang Y, Huang L, Xiao J, Lu L (2020) Learning from multiple datasets with heterogeneous and partial labels for universal lesion detection in CT. IEEE Trans Med Imaging 40(10):2759\u20132770","journal-title":"IEEE Trans Med Imaging"},{"issue":"3","key":"3145_CR13","doi-asserted-by":"publisher","first-page":"297","DOI":"10.2307\/1932409","volume":"26","author":"LR Dice","year":"1945","unstructured":"Dice LR (1945) Measures of the amount of ecologic association between species. Ecology 26(3):297\u2013302. https:\/\/doi.org\/10.2307\/1932409","journal-title":"Ecology"},{"issue":"10","key":"3145_CR14","doi-asserted-by":"publisher","first-page":"2962","DOI":"10.1097\/JS9.0000000000000595","volume":"109","author":"FR Kolbinger","year":"2023","unstructured":"Kolbinger FR, Rinner FM, Jenke AC, Carstens M, Krell S, Leger S, Distler M, Weitz J, Speidel S, Bodenstedt S (2023) Anatomy segmentation in laparoscopic surgery: comparison of machine learning and human expertise-an experimental study. Int J Surg 109(10):2962\u20132974. https:\/\/doi.org\/10.1097\/JS9.0000000000000595","journal-title":"Int J Surg"},{"key":"3145_CR15","doi-asserted-by":"publisher","unstructured":"Chen L-C, Papandreou G, Schroff F, Adam H (2017) Rethinking atrous convolution for semantic image segmentation. https:\/\/doi.org\/10.48550\/arXiv.1706.05587","DOI":"10.48550\/arXiv.1706.05587"},{"key":"3145_CR16","doi-asserted-by":"publisher","unstructured":"Lin T-Y, Maire M, Belongie S, Bourdev L, Girshick R, Hays J, Perona P, Ramanan D, Zitnick CL, Doll\u00e1r P (2014) Microsoft COCO: common objects in context. https:\/\/doi.org\/10.48550\/arxiv.1405.0312","DOI":"10.48550\/arxiv.1405.0312"},{"key":"3145_CR17","doi-asserted-by":"publisher","unstructured":"Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Killeen T, Lin Z, Gimelshein N, Antiga L, Desmaison A, K\u00f6pf A, Yang E, DeVito Z, Raison M, Tejani A, Chilamkurthy S, Steiner B, Fang L, Bai J, Chintala S (2019) PyTorch: an imperative style, high-performance deep learning library. https:\/\/doi.org\/10.48550\/arxiv.1912.01703","DOI":"10.48550\/arxiv.1912.01703"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03145-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-024-03145-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03145-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,14]],"date-time":"2024-06-14T11:27:18Z","timestamp":1718364438000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-024-03145-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,27]]},"references-count":17,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["3145"],"URL":"https:\/\/doi.org\/10.1007\/s11548-024-03145-8","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,27]]},"assertion":[{"value":"28 February 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 April 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"For this type of study, formal consent is not required.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"This article contains patient data from publicly available datasets.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}