{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,6]],"date-time":"2025-05-06T13:10:01Z","timestamp":1746537001375,"version":"3.40.5"},"reference-count":22,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2025,4,5]],"date-time":"2025-04-05T00:00:00Z","timestamp":1743811200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,4,5]],"date-time":"2025-04-05T00:00:00Z","timestamp":1743811200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002241","name":"Japan Science and Technology Agency","doi-asserted-by":"publisher","award":["JPMJCR20D5"],"award-info":[{"award-number":["JPMJCR20D5"]}],"id":[{"id":"10.13039\/501100002241","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["17H00867","21K19898"],"award-info":[{"award-number":["17H00867","21K19898"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Purpose<\/jats:title>\n            <jats:p>Semantic segmentation of laparoscopic images is a key problem in surgical scene understanding. Creating ground truth labels for semantic segmentation tasks is time consuming, and in the medical field a need for medical training of annotators adds further complications, leading to reliance on a small pool of experts. Previous research has focused on reducing the time to author datasets, by using spatially weak labels, pseudolabels, and synthetic data. In this paper, we address the difficulties caused by the need for medically trained annotators, hoping to enable non-medical annotators to participate in medical annotation tasks, to ease the creation of large datasets.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods<\/jats:title>\n            <jats:p>We propose simplified labels, labels that are semantically weak. Our labels allow non-medical annotators to participate in medical dataset authoring, by lowering the need for medical expertise. We simulate authoring processes with mixtures of medical and non-medical annotators and measure the impact adding non-medical annotators has on accuracy. We also show that simplified labels offer a simple formulation for multi-dataset training.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>We show that simplified labels are a viable approach to dataset authoring. Including non-medical annotators in the authoring process is beneficial, but medically trained annotators are worth multiple non-medical annotators, with maximal Dice score increases of 9.3% for 1 medically trained annotator and 6.9% for 3 non-medical annotators. We also show that the labels offer a simple formulation for multi-dataset training, even with no overlapping classes. We find that converting the labels of a secondary incompatible dataset into simplified labels and jointly training on both datasets improves performance.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>Simplified labels offer a framework that can be applied both to dataset authoring and to multi-dataset training. Using the proposed method, non-medical annotators can participate in semantic segmentation dataset authoring. Labels of incompatible datasets can be converted into simplified datasets, enabling multi-dataset training.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1007\/s11548-024-03314-9","type":"journal-article","created":{"date-parts":[[2025,4,6]],"date-time":"2025-04-06T02:28:48Z","timestamp":1743906528000},"page":"1003-1013","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Semantic segmentation dataset authoring with simplified labels"],"prefix":"10.1007","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-8795-7906","authenticated-orcid":false,"given":"Leo","family":"Uramoto","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuichiro","family":"Hayashi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7714-422X","authenticated-orcid":false,"given":"Masahiro","family":"Oda","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Takayuki","family":"Kitasaka","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0100-4797","authenticated-orcid":false,"given":"Kensaku","family":"Mori","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,4,5]]},"reference":[{"issue":"2","key":"3314_CR1","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1097\/SLA.0000000000004594","volume":"276","author":"A Madani","year":"2020","unstructured":"Madani A, Namazi B, Altieri MS, Hashimoto DA, Rivera AM, Pucher PH, Navarrete-Welton A, Sankaranarayanan G, Brunt LM, Okrainec A et al (2020) Artificial intelligence for intraoperative guidance: using semantic segmentation to identify surgical anatomy during laparoscopic cholecystectomy. Ann Surg. 276(2):363\u2013369. https:\/\/doi.org\/10.1097\/SLA.0000000000004594","journal-title":"Ann Surg."},{"issue":"1","key":"3314_CR2","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1038\/s41597-022-01719-2","volume":"10","author":"M Carstens","year":"2023","unstructured":"Carstens M, Rinner FM, Bodenstedt S, Jenke AC, Weitz J, Distler M, Speidel S, Kolbinger FR (2023) The dresden surgical anatomy dataset for abdominal organ segmentation in surgical data science. Sci Data 10(1):3","journal-title":"Sci Data"},{"key":"3314_CR3","unstructured":"Hong W-Y, Kao C-L, Kuo Y-H, Wang J-R, Chang W-L, Shih C-S (2020) CholecSeg8k: a semantic segmentation dataset for laparoscopic cholecystectomy based on cholec80. Preprint at arXiv:2012.12453"},{"key":"3314_CR4","unstructured":"Allan M, Kondo S, Bodenstedt S, Leger S, Kadkhodamohammadi R, Luengo I, Fuentes F, Flouty E, Mohammed A, Pedersen M et\u00a0al (2018) Robotic scene segmentation challenge. Preprint at arXiv:2001.11190 (2020)"},{"key":"3314_CR5","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1007\/s11548-018-1882-8","volume":"14","author":"H Nakawala","year":"2019","unstructured":"Nakawala H, Bianchi R, Pescatori LE, De Cobelli O, Ferrigno G, De Momi E (2019) \u201cDeep-Onto\u201d network for surgical workflow and context recognition. Int J Comput Assist Radiol Surg 14:685\u2013696","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"3314_CR6","doi-asserted-by":"crossref","unstructured":"Kirillov A, Mintun E, Ravi N, Mao H, Rolland C, Gustafson L, Xiao T, Whitehead S, Berg AC, Lo W-Y et\u00a0al (2023) Segment anything. In: Proceedings of the IEEE\/CVF international conference on computer vision, pp 4015\u20134026","DOI":"10.1109\/ICCV51070.2023.00371"},{"key":"3314_CR7","unstructured":"Pel\u00e1ez-Vegas A, Mesejo P, Luengo J (2023) A survey on semi-supervised semantic segmentation. Preprint at arXiv:2302.09899"},{"issue":"15","key":"3314_CR8","doi-asserted-by":"publisher","first-page":"5163","DOI":"10.3390\/s21155163","volume":"21","author":"Y-H Su","year":"2021","unstructured":"Su Y-H, Jiang W, Chitrakar D, Huang K, Peng H, Hannaford B (2021) Local style preservation in improved gan-driven synthetic image generation for endoscopic tool segmentation. Sensors 21(15):5163","journal-title":"Sensors"},{"key":"3314_CR9","doi-asserted-by":"crossref","unstructured":"Zhao Z, Jin Y, Gao X, Dou Q, Heng P-A (2020) Learning motion flows for semi-supervised instrument segmentation from robotic surgical video. In: Medical image computing and computer assisted intervention\u2013MICCAI 2020: 23rd International Conference, Lima, Peru, October 4\u20138, 2020, Proceedings, Part III 23, pp 679\u2013689. Springer","DOI":"10.1007\/978-3-030-59716-0_65"},{"key":"3314_CR10","doi-asserted-by":"publisher","first-page":"280","DOI":"10.1016\/j.media.2019.03.009","volume":"54","author":"V Cheplygina","year":"2019","unstructured":"Cheplygina V, Bruijne M, Pluim JP (2019) Not-so-supervised: a survey of semi-supervised, multi-instance, and transfer learning in medical image analysis. Med Image Anal 54:280\u2013296","journal-title":"Med Image Anal"},{"issue":"2","key":"3314_CR11","doi-asserted-by":"publisher","first-page":"674","DOI":"10.1109\/TMI.2016.2621185","volume":"36","author":"M Rajchl","year":"2016","unstructured":"Rajchl M, Lee MC, Oktay O, Kamnitsas K, Passerat-Palmbach J, Bai W, Damodaram M, Rutherford MA, Hajnal JV, Kainz B et al (2016) DeepCut: object segmentation from bounding box annotations using convolutional neural networks. IEEE Trans Med Imaging 36(2):674\u2013683","journal-title":"IEEE Trans Med Imaging"},{"issue":"2","key":"3314_CR12","doi-asserted-by":"publisher","first-page":"507","DOI":"10.3390\/make3020026","volume":"3","author":"HR Roth","year":"2021","unstructured":"Roth HR, Yang D, Xu Z, Wang X, Xu D (2021) Going to extremes: weakly supervised medical image segmentation. Mach Learn Knowl Extr 3(2):507\u2013524","journal-title":"Mach Learn Knowl Extr"},{"key":"3314_CR13","doi-asserted-by":"publisher","first-page":"1247","DOI":"10.1007\/s11548-019-02003-2","volume":"14","author":"F Fuentes-Hurtado","year":"2019","unstructured":"Fuentes-Hurtado F, Kadkhodamohammadi A, Flouty E, Barbarisi S, Luengo I, Stoyanov D (2019) EasyLabels: weak labels for scene segmentation in laparoscopic videos. Int J Comput Assist Radiol Surg 14:1247\u20131257","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"3314_CR14","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2021.108341","volume":"122","author":"X Liu","year":"2022","unstructured":"Liu X, Yuan Q, Gao Y, He K, Wang S, Tang X, Tang J, Shen D (2022) Weakly supervised segmentation of COVID19 infection with scribble annotation on CT images. Pattern Recogn 122:108341","journal-title":"Pattern Recogn"},{"key":"3314_CR15","doi-asserted-by":"crossref","unstructured":"Meletis P, Dubbelman G (2018) Training of convolutional networks on multiple heterogeneous datasets for street scene semantic segmentation. In: 2018 IEEE Intelligent Vehicles Symposium (IV), pp 1045\u20131050 . IEEE","DOI":"10.1109\/IVS.2018.8500398"},{"key":"3314_CR16","doi-asserted-by":"crossref","unstructured":"Kim D, Tsai Y-H, Suh Y, Faraki M, Garg S, Chandraker M, Han B (2022) Learning semantic segmentation from multiple datasets with label shifts. In: European conference on computer vision, pp 20\u201336. Springer","DOI":"10.1007\/978-3-031-19815-1_2"},{"key":"3314_CR17","unstructured":"Uramoto L, Hayashi Y, Oda M, Mori K (2023) Semantic segmentation dataset authoring with simpler labels. Int J Comput Assist Radiol Surg 18(Suppl 1):26\u201327"},{"key":"3314_CR18","unstructured":"Chen L-C, Papandreou G, Schroff F, Adam H (2017) Rethinking atrous convolution for semantic image segmentation. Preprint at arXiv:1706.05587"},{"key":"3314_CR19","doi-asserted-by":"crossref","unstructured":"Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431\u20133440","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"3314_CR20","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"3314_CR21","unstructured":"Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. In: 3rd international conference on learning representations, ICLR 2015"},{"key":"3314_CR22","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1016\/j.compmedimag.2019.04.005","volume":"75","author":"SA Taghanaki","year":"2019","unstructured":"Taghanaki SA, Zheng Y, Zhou SK, Georgescu B, Sharma P, Xu D, Comaniciu D, Hamarneh G (2019) Combo loss: handling input and output imbalance in multi-organ segmentation. Comput Med Imaging Graph 75:24\u201333","journal-title":"Comput Med Imaging Graph"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03314-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-024-03314-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03314-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,6]],"date-time":"2025-05-06T12:51:45Z","timestamp":1746535905000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-024-03314-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,5]]},"references-count":22,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2025,5]]}},"alternative-id":["3314"],"URL":"https:\/\/doi.org\/10.1007\/s11548-024-03314-9","relation":{},"ISSN":["1861-6429"],"issn-type":[{"type":"electronic","value":"1861-6429"}],"subject":[],"published":{"date-parts":[[2025,4,5]]},"assertion":[{"value":"14 January 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 December 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 April 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"This article does not contain any studies with human participants performed by any of the authors. Only data in public databases were used in this study.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}]}}