{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T16:52:32Z","timestamp":1776876752177,"version":"3.51.2"},"reference-count":26,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2024,5,15]],"date-time":"2024-05-15T00:00:00Z","timestamp":1715731200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,15]],"date-time":"2024-05-15T00:00:00Z","timestamp":1715731200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Machine Vision and Applications"],"published-print":{"date-parts":[[2024,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Deep neural network models for image segmentation can be a powerful tool for the automation of motor claims handling processes in the insurance industry. A crucial aspect is the reliability of the model outputs when facing adverse conditions, such as low quality photos taken by claimants to document damages. We explore the use of a meta-classification model to empirically assess the precision of segments predicted by a model trained for the semantic segmentation of car body parts. Different sets of features correlated with the quality of a segment are compared, and an AUROC score of 0.915 is achieved for distinguishing between high- and low-quality segments. By removing low-quality segments, the average <jats:inline-formula><jats:alternatives><jats:tex-math>$$m{\\textit{IoU}} $$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                  <mml:mrow>\n                    <mml:mi>m<\/mml:mi>\n                    <mml:mi>IoU<\/mml:mi>\n                  <\/mml:mrow>\n                <\/mml:math><\/jats:alternatives><\/jats:inline-formula> of the segmentation output is improved by 16 percentage points and the number of wrongly predicted segments is reduced by 77%.\n<\/jats:p>","DOI":"10.1007\/s00138-024-01541-3","type":"journal-article","created":{"date-parts":[[2024,5,15]],"date-time":"2024-05-15T19:01:45Z","timestamp":1715799705000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Uncertainty estimates for semantic segmentation: providing enhanced reliability for automated motor claims handling"],"prefix":"10.1007","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9087-6230","authenticated-orcid":false,"given":"Jan","family":"K\u00fcchler","sequence":"first","affiliation":[]},{"given":"Daniel","family":"Kr\u00f6ll","sequence":"additional","affiliation":[]},{"given":"Sebastian","family":"Schoenen","sequence":"additional","affiliation":[]},{"given":"Andreas","family":"Witte","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,5,15]]},"reference":[{"key":"1541_CR1","doi-asserted-by":"publisher","unstructured":"Shotton, J., Winn, J., Rother, C., Criminisi, A.: TextonBoost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) Computer Vision\u2014ECCV 2006, pp. 1\u201315. Springer, Berlin (2006). https:\/\/doi.org\/10.1007\/11744023_1","DOI":"10.1007\/11744023_1"},{"issue":"10","key":"1541_CR2","doi-asserted-by":"publisher","first-page":"3349","DOI":"10.1109\/TPAMI.2020.2983686","volume":"43","author":"J Wang","year":"2021","unstructured":"Wang, J., Sun, K., Cheng, T., Jiang, B., Deng, C., Zhao, Y., Liu, D., Mu, Y., Tan, M., Wang, X., Liu, W., Xiao, B.: Deep high-resolution representation learning for visual recognition. IEEE Trans. Pattern Anal. Mach. Intell. 43(10), 3349\u20133364 (2021). https:\/\/doi.org\/10.1109\/TPAMI.2020.2983686","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"1541_CR3","doi-asserted-by":"publisher","DOI":"10.3390\/electronics12051199","author":"Y Yu","year":"2023","unstructured":"Yu, Y., Wang, C., Fu, Q., Kou, R., Huang, F., Yang, B., Yang, T., Gao, M.: Techniques and challenges of image segmentation: a review. Electronics (2023). https:\/\/doi.org\/10.3390\/electronics12051199","journal-title":"Electronics"},{"key":"1541_CR4","doi-asserted-by":"publisher","unstructured":"Jorge, P., Volpi, R., Torr, P.H.S., Rogez, G.: Reliability in semantic segmentation: are we on the right track? In: 2023 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7173\u20137182 (2023). https:\/\/doi.org\/10.1109\/CVPR52729.2023.00693","DOI":"10.1109\/CVPR52729.2023.00693"},{"issue":"12","key":"1541_CR5","doi-asserted-by":"publisher","first-page":"3868","DOI":"10.1109\/tmi.2020.3006437","volume":"39","author":"A Mehrtash","year":"2020","unstructured":"Mehrtash, A., Wells, W.M., Tempany, C.M., Abolmaesumi, P., Kapur, T.: Confidence calibration and predictive uncertainty estimation for deep medical image segmentation. IEEE Trans. Med. Imaging 39(12), 3868\u20133878 (2020). https:\/\/doi.org\/10.1109\/tmi.2020.3006437","journal-title":"IEEE Trans. Med. Imaging"},{"key":"1541_CR6","doi-asserted-by":"publisher","unstructured":"Hein, M., Andriushchenko, M., Bitterwolf, J.: Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problem. In: 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, pp. 41\u201350 (2019). https:\/\/doi.org\/10.1109\/CVPR.2019.00013","DOI":"10.1109\/CVPR.2019.00013"},{"key":"1541_CR7","unstructured":"Guo, C., Pleiss, G., Sun, Y., Weinberger, K.Q.: On calibration of modern neural networks. In: Proceedings of the 34th International Conference on Machine Learning\u2014Volume 70. ICML\u201917, pp. 1321\u20131330. JMLR.org, Sydney, NSW, Australia (2017)"},{"key":"1541_CR8","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1016\/j.inffus.2021.05.008","volume":"76","author":"M Abdar","year":"2021","unstructured":"Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U.R., Makarenkov, V., Nahavandi, S.: A review of uncertainty quantification in deep learning: techniques, applications and challenges. Inf. Fusion 76, 243\u2013297 (2021). https:\/\/doi.org\/10.1016\/j.inffus.2021.05.008","journal-title":"Inf. Fusion"},{"key":"1541_CR9","doi-asserted-by":"publisher","unstructured":"Dechesne, C., Lassalle, P., Lef\u00e8vre, S.: Bayesian U-Net: estimating uncertainty in semantic segmentation of earth observation images. Remote Sens. (2021). https:\/\/doi.org\/10.3390\/rs13193836","DOI":"10.3390\/rs13193836"},{"key":"1541_CR10","doi-asserted-by":"publisher","unstructured":"Kendall, A., Badrinarayananm, V., Cipolla, R.: Bayesian SegNet: model Uncertainty in deep convolutional encoder\u2013decoder architectures for scene understanding. In: Kim, T.-K., Zafeiriou, S., Brostow, G., Mikolajczyk, K. (eds.) Proceedings of the British Machine Vision Conference (BMVC), pp. 1\u201312. BMVA Press, London (2017). https:\/\/doi.org\/10.5244\/C.31.57","DOI":"10.5244\/C.31.57"},{"key":"1541_CR11","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1016\/j.neucom.2019.01.103","volume":"338","author":"G Wang","year":"2019","unstructured":"Wang, G., Li, W., Aertsen, M., Deprest, J., Ourselin, S., Vercauteren, T.: Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networks. Neurocomputing 338, 34\u201345 (2019). https:\/\/doi.org\/10.1016\/j.neucom.2019.01.103","journal-title":"Neurocomputing"},{"key":"1541_CR12","unstructured":"Blundell, C., Cornebise, J., Kavukcuoglu, K., Wierstra, D.: Weight uncertainty in neural network. In: Bach, F., Blei, D. (eds.) Proceedings of the 32nd International Conference on Machine Learning. Proceedings of Machine Learning Research, vol. 37, pp. 1613\u20131622. PMLR, Lille (2015)"},{"key":"1541_CR13","unstructured":"Lee, H.J., Kim, S.T., Lee, H., Navab, N., Ro, Y.M.: Efficient ensemble model generation for uncertainty estimation with bayesian approximation in segmentation (2020)"},{"issue":"6","key":"1541_CR14","doi-asserted-by":"publisher","first-page":"1955","DOI":"10.1109\/TBME.2022.3232730","volume":"70","author":"M Ng","year":"2023","unstructured":"Ng, M., Guo, F., Biswas, L., Petersen, S.E., Piechnik, S.K., Neubauer, S., Wright, G.: Estimating uncertainty in neural networks for cardiac MRI segmentation: a benchmark study. IEEE Trans. Biomed. Eng. 70(6), 1955\u20131966 (2023). https:\/\/doi.org\/10.1109\/TBME.2022.3232730","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"1541_CR15","doi-asserted-by":"crossref","unstructured":"Landgraf, S., Wursthorn, K., Hillemann, M., Ulrich, M.: DUDES: Deep uncertainty distillation using ensembles for semantic segmentation (2023). arXiv:2303.09843","DOI":"10.1007\/s41064-024-00280-4"},{"key":"1541_CR16","doi-asserted-by":"publisher","unstructured":"Holder, C.J., Shafique, M.: Efficient uncertainty estimation in semantic segmentation via distillation. In: 2021 IEEE\/CVF International Conference on Computer Vision Workshops (ICCVW), pp. 3080\u20133087 (2021). https:\/\/doi.org\/10.1109\/ICCVW54120.2021.00343","DOI":"10.1109\/ICCVW54120.2021.00343"},{"key":"1541_CR17","doi-asserted-by":"publisher","unstructured":"Lin, W.-H., Hauptmann, A.: Meta-classification: combining multimodal classifiers. In: Za\u00efane, O.R., Simoff, S.J., Djeraba, C. (eds.) Mining Multimedia and Complex Data, pp. 217\u2013231. Springer, Berlin (2003). https:\/\/doi.org\/10.1007\/978-3-540-39666-6_14","DOI":"10.1007\/978-3-540-39666-6_14"},{"key":"1541_CR18","doi-asserted-by":"publisher","unstructured":"Rottmann, M., Colling, P., Paul\u00a0Hack, T., Chan, R., Huger, F., Schlicht, P., Gottschalk, H.: Prediction error meta classification in semantic segmentation: Detection via aggregated dispersion measures of softmax probabilities. In: 2020 International Joint Conference on Neural Networks (IJCNN). IEEE, Glasgow (2020). https:\/\/doi.org\/10.1109\/IJCNN48605.2020.9206659","DOI":"10.1109\/IJCNN48605.2020.9206659"},{"key":"1541_CR19","unstructured":"Hendrycks, D., Gimpel, K.: A baseline for detecting misclassified and out-of-distribution examples in neural networks. In: 5th International Conference on Learning Representations, ICLR 2017. OpenReview.net, Toulon (2017). https:\/\/openreview.net\/forum?id=Hkg4TI9xl"},{"key":"1541_CR20","doi-asserted-by":"crossref","unstructured":"Maag, K., Riedlinger, T.: Pixel-wise gradient uncertainty for convolutional neural networks applied to out-of-distribution segmentation (2023). arXiv:2303.06920","DOI":"10.5220\/0012353300003660"},{"key":"1541_CR21","doi-asserted-by":"crossref","unstructured":"Grci\u0107, M., \u0160ari\u0107, J., \u0160egvi\u0107, S.: On advantages of mask-level recognition for outlier-aware segmentation (2023). arXiv:2301.03407","DOI":"10.1109\/CVPRW59228.2023.00295"},{"issue":"2","key":"1541_CR22","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1111\/j.1469-8137.1912.tb05611.x","volume":"11","author":"P Jaccard","year":"1912","unstructured":"Jaccard, P.: The distribution of the flora in the alpine zone. New Phytol. 11(2), 37\u201350 (1912). https:\/\/doi.org\/10.1111\/j.1469-8137.1912.tb05611.x","journal-title":"New Phytol."},{"key":"1541_CR23","doi-asserted-by":"publisher","unstructured":"Chen, T., Guestrin, C.: XGBoost. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, New York (2016). https:\/\/doi.org\/10.1145\/2939672.2939785","DOI":"10.1145\/2939672.2939785"},{"key":"1541_CR24","doi-asserted-by":"publisher","unstructured":"Shwartz-Ziv, R., Armon, A.: Tabular data: deep learning is not all you need. Inf. Fusion 81, 84\u201390 (2022). https:\/\/doi.org\/10.1016\/j.inffus.2021.11.011","DOI":"10.1016\/j.inffus.2021.11.011"},{"key":"1541_CR25","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825\u20132830 (2011). arxiv:1201.0490","journal-title":"J. Mach. Learn. Res."},{"key":"1541_CR26","doi-asserted-by":"publisher","unstructured":"Davis, J., Goadrich, M.: The relationship between precision-recall and ROC curves. In: Proceedings of the 23rd International Conference on Machine Learning. ICML\u201906, pp. 233\u2013240. Association for Computing Machinery, New York (2006). https:\/\/doi.org\/10.1145\/1143844.1143874","DOI":"10.1145\/1143844.1143874"}],"container-title":["Machine Vision and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00138-024-01541-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00138-024-01541-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00138-024-01541-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,31]],"date-time":"2024-07-31T19:09:38Z","timestamp":1722452978000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00138-024-01541-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,15]]},"references-count":26,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,7]]}},"alternative-id":["1541"],"URL":"https:\/\/doi.org\/10.1007\/s00138-024-01541-3","relation":{},"ISSN":["0932-8092","1432-1769"],"issn-type":[{"value":"0932-8092","type":"print"},{"value":"1432-1769","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,15]]},"assertion":[{"value":"23 November 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 March 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 April 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 May 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"66"}}