{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T16:24:02Z","timestamp":1779380642781,"version":"3.53.1"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,1,12]],"date-time":"2022-01-12T00:00:00Z","timestamp":1641945600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,1,12]],"date-time":"2022-01-12T00:00:00Z","timestamp":1641945600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Imaging"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Retinal vessel segmentation benefits significantly from deep learning. Its performance relies on sufficient training images with accurate ground-truth segmentation, which are usually manually annotated in the form of binary pixel-wise label maps. Manually annotated ground-truth label maps, more or less, contain errors for part of the pixels. Due to the thin structure of retina vessels, such errors are more frequent and serious in manual annotations, which negatively affect deep learning performance.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>In this paper, we develop a new method to automatically and iteratively identify and correct such noisy segmentation labels in the process of network training. We consider historical predicted label maps of network-in-training from different epochs and jointly use them to self-supervise the predicted labels during training and dynamically correct the supervised labels with noises.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We conducted experiments on the three datasets of DRIVE, STARE and CHASE-DB1 with synthetic noises, pseudo-labeled noises, and manually labeled noises. For synthetic noise, the proposed method corrects the original noisy label maps to a more accurate label map by 4.0\u2013<jats:inline-formula><jats:alternatives><jats:tex-math>$$9.8\\%$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                    <mml:mrow>\n                      <mml:mn>9.8<\/mml:mn>\n                      <mml:mo>%<\/mml:mo>\n                    <\/mml:mrow>\n                  <\/mml:math><\/jats:alternatives><\/jats:inline-formula> on <jats:inline-formula><jats:alternatives><jats:tex-math>$$F_1$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                    <mml:msub>\n                      <mml:mi>F<\/mml:mi>\n                      <mml:mn>1<\/mml:mn>\n                    <\/mml:msub>\n                  <\/mml:math><\/jats:alternatives><\/jats:inline-formula> and 10.7\u2013<jats:inline-formula><jats:alternatives><jats:tex-math>$$16.8\\%$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                    <mml:mrow>\n                      <mml:mn>16.8<\/mml:mn>\n                      <mml:mo>%<\/mml:mo>\n                    <\/mml:mrow>\n                  <\/mml:math><\/jats:alternatives><\/jats:inline-formula> on PR on three testing datasets. For the other two types of noise, the method could also improve the label map quality.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Experiment results verified that the proposed method could achieve better retinal image segmentation performance than many existing methods by simultaneously correcting the noise in the initial label map.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12880-021-00732-y","type":"journal-article","created":{"date-parts":[[2022,1,12]],"date-time":"2022-01-12T08:02:56Z","timestamp":1641974576000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Self-relabeling for noise-tolerant retina vessel segmentation through label reliability estimation"],"prefix":"10.1186","volume":"22","author":[{"given":"Jiacheng","family":"Li","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruirui","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruize","family":"Han","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Song","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,1,12]]},"reference":[{"key":"732_CR1","doi-asserted-by":"crossref","unstructured":"Zhou Z, Siddiquee MMR, Tajbakhsh N, Liang J. Unet++: a nested u-net architecture for medical image segmentation. In: Deep learning in medical image analysis and multimodal learning for clinical decision support. Cham: Springer; 2018. p. 3\u2013 11.","DOI":"10.1007\/978-3-030-00889-5_1"},{"key":"732_CR2","doi-asserted-by":"crossref","unstructured":"Ronneberger O, Fischer P, Brox T. U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention; 2015. p. 234\u201341.","DOI":"10.1007\/978-3-319-24574-4_28"},{"issue":"2","key":"732_CR3","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1038\/s41592-020-01008-z","volume":"18","author":"F Isensee","year":"2021","unstructured":"Isensee F, Jaeger PF, Kohl SA, Petersen J, Maier-Hein KH. nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation. Nat Methods. 2021;18(2):203\u201311.","journal-title":"Nat Methods"},{"key":"732_CR4","unstructured":"Jiang L, Zhou Z, Leung T, Li L-J, Fei-Fei L. Mentornet: learning data-driven curriculum for very deep neural networks on corrupted labels. In: International conference on machine learning; 2018. p. 2304\u201313."},{"key":"732_CR5","doi-asserted-by":"crossref","unstructured":"Tanaka D, Ikami D, Yamasaki T, Aizawa K. Joint optimization framework for learning with noisy labels. In: IEEE conference on computer vision and pattern recognition; 2018.","DOI":"10.1109\/CVPR.2018.00582"},{"key":"732_CR6","unstructured":"Menon A, Van\u00a0Rooyen B, Ong CS, Williamson B. Learning from corrupted binary labels via class-probability estimation. In: International conference on machine learning; 2015."},{"key":"732_CR7","unstructured":"Han B, Yao Q, Yu X, Niu G, Xu M, Hu W, Tsang I, Sugiyama M. Co-teaching: robust training of deep neural networks with extremely noisy labels. In: Advances in neural information processing systems; 2018. p. 8527\u201337."},{"key":"732_CR8","doi-asserted-by":"crossref","unstructured":"Yi K, Wu J. Probabilistic end-to-end noise correction for learning with noisy labels. In: IEEE\/CVF conference on computer vision and pattern recognition; 2019.","DOI":"10.1109\/CVPR.2019.00718"},{"key":"732_CR9","doi-asserted-by":"crossref","unstructured":"Mirikharaji Z, Yan Y, Hamarneh G. Learning to segment skin lesions from noisy annotations. In: Domain adaptation and representation transfer and medical image learning with less labels and imperfect data; 2019. p. 207\u201315.","DOI":"10.1007\/978-3-030-33391-1_24"},{"key":"732_CR10","doi-asserted-by":"crossref","unstructured":"Nie D, Gao Y, Wang L, Shen D. Asdnet: attention based semi-supervised deep networks for medical image segmentation. In: International conference on medical image computing and computer-assisted intervention; 2018. p. 370\u20138.","DOI":"10.1007\/978-3-030-00937-3_43"},{"key":"732_CR11","doi-asserted-by":"crossref","unstructured":"Xue C, Deng Q, Li X, Dou Q, Heng P-A. Cascaded robust learning at imperfect labels for chest x-ray segmentation. In: International conference on medical image computing and computer-assisted intervention; 2020. p. 579\u201388.","DOI":"10.1007\/978-3-030-59725-2_56"},{"key":"732_CR12","doi-asserted-by":"crossref","unstructured":"Li P, Xu Y, Wei Y, Yang Y. Self-correction for human parsing. IEEE Trans Pattern Anal Mach Intell. 2020.","DOI":"10.1109\/TPAMI.2020.3048039"},{"key":"732_CR13","doi-asserted-by":"crossref","unstructured":"Liu J, Li R, Sun C. Co-correcting: noise-tolerant medical image classification via mutual label correction. IEEE Trans. Med. Imaging. 2021.","DOI":"10.1109\/TMI.2021.3091178"},{"key":"732_CR14","doi-asserted-by":"crossref","unstructured":"Zhang T, Yu L, Hu N, Lv S, Gu S. Robust medical image segmentation from non-expert annotations with tri-network. In: International Conference on medical image computing and computer-assisted intervention; 2020.","DOI":"10.1007\/978-3-030-59719-1_25"},{"key":"732_CR15","unstructured":"Athiwaratkun B, Finzi M, Izmailov P, Wilson AG. There are many consistent explanations of unlabeled data: why you should average. In: International conference on learning representations; 2019."},{"key":"732_CR16","unstructured":"Izmailov P, Podoprikhin D, Garipov T, Vetrov D, Wilson AG. Averaging weights leads to wider optima and better generalization; 2018."},{"issue":"4","key":"732_CR17","doi-asserted-by":"publisher","first-page":"501","DOI":"10.1109\/TMI.2004.825627","volume":"23","author":"J Staal","year":"2004","unstructured":"Staal J, Abr\u00e0moff MD, Niemeijer M, Viergever MA, Van Ginneken B. Ridge-based vessel segmentation in color images of the retina. IEEE Trans Med Imaging. 2004;23(4):501\u20139.","journal-title":"IEEE Trans Med Imaging"},{"issue":"9","key":"732_CR18","doi-asserted-by":"publisher","first-page":"1214","DOI":"10.1109\/TMI.2006.879967","volume":"25","author":"JV Soares","year":"2006","unstructured":"Soares JV, Leandro JJ, Cesar RM, Jelinek HF, Cree MJ. Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification. IEEE Trans Med Imaging. 2006;25(9):1214\u201322.","journal-title":"IEEE Trans Med Imaging"},{"key":"732_CR19","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1016\/j.knosys.2019.04.025","volume":"178","author":"Q Jin","year":"2019","unstructured":"Jin Q, Meng Z, Pham TD, Chen Q, Wei L, Su R. Dunet: a deformable network for retinal vessel segmentation. Knowl-Based Syst. 2019;178:149\u201362.","journal-title":"Knowl-Based Syst"},{"issue":"4","key":"732_CR20","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1007\/s10916-017-0719-2","volume":"41","author":"CL Srinidhi","year":"2017","unstructured":"Srinidhi CL, Aparna P, Rajan J. Recent advancements in retinal vessel segmentation. J Med Syst. 2017;41(4):70.","journal-title":"J Med Syst"},{"issue":"3","key":"732_CR21","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1109\/42.845178","volume":"19","author":"A Hoover","year":"2000","unstructured":"Hoover A, Kouznetsova V, Goldbaum M. Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response. IEEE Trans Med Imaging. 2000;19(3):203\u201310.","journal-title":"IEEE Trans Med Imaging"},{"issue":"5","key":"732_CR22","doi-asserted-by":"publisher","first-page":"2004","DOI":"10.1167\/iovs.08-3018","volume":"50","author":"CG Owen","year":"2009","unstructured":"Owen CG, Rudnicka AR, Mullen R, Barman SA, Monekosso D, Whincup PH, Ng J, Paterson C. Measuring retinal vessel tortuosity in 10-year-old children: validation of the computer-assisted image analysis of the retina (CAIAR) program. Investig Ophthalmol Vis Sci. 2009;50(5):2004\u201310.","journal-title":"Investig Ophthalmol Vis Sci"},{"key":"732_CR23","unstructured":"Arpit D, Jastrz\u0119bski S, Ballas N, Krueger D, Bengio E, Kanwal MS, Maharaj T, Fischer A, Courville A, Bengio Y, et al. A closer look at memorization in deep networks. In: International conference on machine learning; 2017. p. 233\u201342."},{"key":"732_CR24","doi-asserted-by":"publisher","first-page":"101693","DOI":"10.1016\/j.media.2020.101693","volume":"63","author":"N Tajbakhsh","year":"2020","unstructured":"Tajbakhsh N, Jeyaseelan L, Li Q, Chiang JN, Wu Z, Ding X. Embracing imperfect datasets: a review of deep learning solutions for medical image segmentation. Med Image Anal. 2020;63:101693.","journal-title":"Med Image Anal"},{"key":"732_CR25","unstructured":"Li W, Wang L, Li W, Agustsson E, Van\u00a0Gool L. Webvision database: visual learning and understanding from web data; 2017. arXiv:1708.02862."},{"key":"732_CR26","unstructured":"Malach E, Shalev-Shwartz S. Decoupling\u201c when to update\u201d from \u201c how to update\u201d; 2017. arXiv:1706.02613."},{"key":"732_CR27","unstructured":"Chang H-S, Learned-Miller E, McCallum A. Active bias: training more accurate neural networks by emphasizing high variance samples; 2017. arXiv:1704.07433."},{"key":"732_CR28","unstructured":"Gao J, Jagadish H, Ooi BC. Active sampler: light-weight accelerator for complex data analytics at scale; 2015. arXiv:1512.03880."},{"issue":"1","key":"732_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-018-35501-5","volume":"8","author":"A Kapil","year":"2018","unstructured":"Kapil A, Meier A, Zuraw A, Steele KE, Rebelatto MC, Schmidt G, Brieu N. Deep semi supervised generative learning for automated tumor proportion scoring on NSCLC tissue needle biopsies. Sci Rep. 2018;8(1):1\u201310.","journal-title":"Sci Rep"},{"key":"732_CR30","doi-asserted-by":"crossref","unstructured":"Liu Y, Deng G, Zeng X, Wu S, Yu Z, Wong H-S. Regularizing discriminative capability of cgans for semi-supervised generative learning. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition; 2020. p. 5720\u20139.","DOI":"10.1109\/CVPR42600.2020.00576"},{"key":"732_CR31","unstructured":"Inoue N, Goto K. Semi-supervised contrastive learning with generalized contrastive loss and its application to speaker recognition. In: 2020 Asia-Pacific signal and information processing association annual summit and conference (APSIPA ASC); 2020. p. 1641\u20136."},{"key":"732_CR32","unstructured":"Grandvalet Y, Bengio Y, et al. Semi-supervised learning by entropy minimization. In: CAP; 2005. p. 281\u2013 296."},{"key":"732_CR33","unstructured":"Tarvainen A, Valpola H. Weight-averaged, consistency targets improve semi-supervised deep learning results. CoRR, 1780; vol. abs\/1703 (2017)."},{"key":"732_CR34","doi-asserted-by":"crossref","unstructured":"Perone CS, Cohen-Adad J. Deep semi-supervised segmentation with weight-averaged consistency targets. In: Deep learning in medical image analysis and multimodal learning for clinical decision support; 2018. p. 12\u20139.","DOI":"10.1007\/978-3-030-00889-5_2"},{"key":"732_CR35","doi-asserted-by":"crossref","unstructured":"Xie Q, Luong M-T, Hovy E, Le QV. Self-training with noisy student improves imagenet classification. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition; 2020. p. 10687\u201398.","DOI":"10.1109\/CVPR42600.2020.01070"},{"key":"732_CR36","doi-asserted-by":"crossref","unstructured":"Zhang P, Zhang B, Zhang T, Chen D, Wen F. Robust mutual learning for semi-supervised semantic segmentation. 2021.","DOI":"10.1109\/ICIP40778.2020.9190911"},{"key":"732_CR37","doi-asserted-by":"crossref","unstructured":"Ke Z, Di\u00a0Qiu KL, Yan Q, Lau RW. Guided collaborative training for pixel-wise semi-supervised learning. In: European conference on computer vision, vol. 2; 2020. p. 6.","DOI":"10.1007\/978-3-030-58601-0_26"},{"key":"732_CR38","unstructured":"Kingma DP, Ba J. Adam: a method for stochastic optimization. 2014."},{"key":"732_CR39","unstructured":"Loshchilov I, Hutter F. Sgdr: stochastic gradient descent with warm restarts. 2016."},{"issue":"9","key":"732_CR40","doi-asserted-by":"publisher","first-page":"1912","DOI":"10.1109\/TBME.2018.2828137","volume":"65","author":"Z Yan","year":"2018","unstructured":"Yan Z, Yang X, Cheng K-T. Joint segment-level and pixel-wise losses for deep learning based retinal vessel segmentation. IEEE Trans Biomed Eng. 2018;65(9):1912\u201323.","journal-title":"IEEE Trans Biomed Eng"}],"container-title":["BMC Medical Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-021-00732-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12880-021-00732-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-021-00732-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,12]],"date-time":"2022-01-12T08:04:33Z","timestamp":1641974673000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedimaging.biomedcentral.com\/articles\/10.1186\/s12880-021-00732-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,12]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["732"],"URL":"https:\/\/doi.org\/10.1186\/s12880-021-00732-y","relation":{},"ISSN":["1471-2342"],"issn-type":[{"value":"1471-2342","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,12]]},"assertion":[{"value":"15 September 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 December 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 January 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"As this is a case report, no ethics approval was necessary. Written informed consent was obtained from the patients for publication of this case report and any accompanying images.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Written informed consent was obtained from the patients for publication of this case report and any accompanying images.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"8"}}