{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T16:38:51Z","timestamp":1791304731923,"version":"4.3.1"},"reference-count":74,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2023,6,23]],"date-time":"2023-06-23T00:00:00Z","timestamp":1687478400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,6,23]],"date-time":"2023-06-23T00:00:00Z","timestamp":1687478400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000995","name":"Australian National University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000995","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Vis Comput"],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In this paper, we extend Open-set Semantic Segmentation (OSS) into a new image segmentation task called Generalized Open-set Semantic Segmentation (GOSS). Previously, with well-known OSS, the intelligent agents only detect unknown regions without further processing, limiting their perception capacity of the environment. It stands to reason that further analysis of the detected unknown pixels would be beneficial for agents\u2019 decision-making. Therefore, we propose GOSS, which holistically unifies the abilities of two well-defined segmentation tasks, i.e. OSS and generic segmentation. Specifically, GOSS classifies pixels as belonging to known classes, and clusters (or groups) of pixels of unknown class are labelled as such. We propose a metric that balances the pixel classification and clustering aspects to evaluate this newly expanded task. Moreover, we build benchmark tests on existing datasets and propose neural architectures as baselines. Our experiments on multiple benchmarks demonstrate the effectiveness of our baselines. Code is made available at <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/github.com\/JHome1\/GOSS_Segmentor\">https:\/\/github.com\/JHome1\/GOSS_Segmentor<\/jats:ext-link>.<\/jats:p>","DOI":"10.1007\/s00371-023-02925-8","type":"journal-article","created":{"date-parts":[[2023,6,24]],"date-time":"2023-06-24T06:46:21Z","timestamp":1687589181000},"page":"2391-2404","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["GOSS: towards generalized open-set semantic segmentation"],"prefix":"10.1007","volume":"40","author":[{"given":"Jie","family":"Hong","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weihao","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junlin","family":"Han","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiyang","family":"Zheng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pengfei","family":"Fang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mehrtash","family":"Harandi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lars","family":"Petersson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,6,23]]},"reference":[{"key":"2925_CR1","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431\u20133440 (2015)","DOI":"10.1109\/CVPR.2015.7298965"},{"issue":"4","key":"2925_CR2","doi-asserted-by":"publisher","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","volume":"40","author":"L-C Chen","year":"2017","unstructured":"Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L.: Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans. Pattern Anal. Mach. Intell. 40(4), 834\u2013848 (2017)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"2925_CR3","unstructured":"Chen, L.-C., Papandreou, G., Schroff, F., Adam, H.: Rethinking Atrous Convolution for Semantic Image Segmentation. arXiv preprint arXiv:1706.05587 (2017)"},{"key":"2925_CR4","doi-asserted-by":"crossref","unstructured":"Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 801\u2013818 (2018)","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"2925_CR5","first-page":"17864","volume":"34","author":"B Cheng","year":"2021","unstructured":"Cheng, B., Schwing, A., Kirillov, A.: Per-pixel classification is not all you need for semantic segmentation. Adv. Neural Inform. Process. Syst. 34, 17864 (2021)","journal-title":"Adv. Neural Inform. Process. Syst."},{"key":"2925_CR6","doi-asserted-by":"crossref","unstructured":"Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., Torr, P.H., et al.: Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp 6881\u20136890 (2021)","DOI":"10.1109\/CVPR46437.2021.00681"},{"key":"2925_CR7","doi-asserted-by":"crossref","unstructured":"Cheng, B., Misra, I., Schwing, A.G., Kirillov, A., Girdhar, R.: Masked-attention mask transformer for universal image segmentation. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 1290\u20131299 (2022)","DOI":"10.1109\/CVPR52688.2022.00135"},{"key":"2925_CR8","doi-asserted-by":"crossref","unstructured":"Shotton, J., Winn, J., Rother, C., Criminisi, A.: Textonboost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation. In: European Conference on Computer Vision, pp. 1\u201315 (2006)","DOI":"10.1007\/11744023_1"},{"key":"2925_CR9","doi-asserted-by":"crossref","unstructured":"Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., Schiele, B.: The cityscapes dataset for semantic urban scene understanding. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3213\u20133223 (2016)","DOI":"10.1109\/CVPR.2016.350"},{"key":"2925_CR10","doi-asserted-by":"crossref","unstructured":"Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., Torralba, A.: Scene parsing through ade20k dataset. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 633\u2013641 (2017)","DOI":"10.1109\/CVPR.2017.544"},{"key":"2925_CR11","doi-asserted-by":"crossref","unstructured":"Caesar, H., Uijlings, J., Ferrari, V.: Coco-stuff: Thing and stuff classes in context. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1209\u20131218 (2018)","DOI":"10.1109\/CVPR.2018.00132"},{"key":"2925_CR12","unstructured":"Hendrycks, D., Basart, S., Mazeika, M., Zou, A., Kwon, J., Mostajabi, M., Steinhardt, J., Song, D.: Scaling out-of-distribution detection for real-world settings. In: Proceedings of the 39th International Conference on Machine Learning (ICML), pp. 8759\u20138773 (2022)"},{"key":"2925_CR13","doi-asserted-by":"crossref","unstructured":"Lis, K., Nakka, K., Fua, P., Salzmann, M.: Detecting the unexpected via image resynthesis. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp. 2152\u20132161 (2019)","DOI":"10.1109\/ICCV.2019.00224"},{"key":"2925_CR14","doi-asserted-by":"crossref","unstructured":"Cen, J., Yun, P., Cai, J., Wang, M.Y., Liu, M.: Deep metric learning for open world semantic segmentation. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), pp. 15333\u201315342 (2021)","DOI":"10.1109\/ICCV48922.2021.01505"},{"issue":"7","key":"2925_CR15","doi-asserted-by":"publisher","first-page":"1457","DOI":"10.1007\/s00371-019-01751-1","volume":"36","author":"J Yu","year":"2020","unstructured":"Yu, J., Kim, D.Y., Yoon, Y., Jeon, M.: Action matching network: open-set action recognition using spatio-temporal representation matching. Vis. Comput. 36(7), 1457\u20131471 (2020)","journal-title":"Vis. Comput."},{"key":"2925_CR16","unstructured":"Chan, R., Lis, K., Uhlemeyer, S., Blum, H., Honari, S., Siegwart, R., Salzmann, M., Fua, P., Rottmann, M.: Segmentmeifyoucan: A benchmark for anomaly segmentation. In: Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track (2021)"},{"key":"2925_CR17","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2022.104490","volume":"124","author":"P Bevandi\u0107","year":"2022","unstructured":"Bevandi\u0107, P., Kre\u0161o, I., Or\u0161i\u0107, M., \u0160egvi\u0107, S.: Dense open-set recognition based on training with noisy negative images. Image Vision Comput. 124, 104490 (2022)","journal-title":"Image Vision Comput."},{"issue":"8","key":"2925_CR18","doi-asserted-by":"publisher","first-page":"888","DOI":"10.1109\/34.868688","volume":"22","author":"J Shi","year":"2000","unstructured":"Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 888\u2013905 (2000)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"issue":"5","key":"2925_CR19","doi-asserted-by":"publisher","first-page":"603","DOI":"10.1109\/34.1000236","volume":"24","author":"D Comaniciu","year":"2002","unstructured":"Comaniciu, D., Meer, P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 603\u2013619 (2002)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"issue":"2","key":"2925_CR20","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1023\/B:VISI.0000022288.19776.77","volume":"59","author":"PF Felzenszwalb","year":"2004","unstructured":"Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph-based image segmentation. Int. J. Comput. Vision 59(2), 167\u2013181 (2004)","journal-title":"Int. J. Comput. Vision"},{"issue":"5","key":"2925_CR21","doi-asserted-by":"publisher","first-page":"898","DOI":"10.1109\/TPAMI.2010.161","volume":"33","author":"P Arbelaez","year":"2010","unstructured":"Arbelaez, P., Maire, M., Fowlkes, C., Malik, J.: Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 898\u2013916 (2010)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"2925_CR22","doi-asserted-by":"crossref","unstructured":"Isaacs, O., Shayer, O., Lindenbaum, M.: Enhancing generic segmentation with learned region representations. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 12946\u201312955 (2020)","DOI":"10.1109\/CVPR42600.2020.01296"},{"key":"2925_CR23","doi-asserted-by":"crossref","unstructured":"Wan, J., Liu, Y., Wei, D., Bai, X., Xu, Y.: Super-bpd: Super boundary-to-pixel direction for fast image segmentation. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 9253\u20139262 (2020)","DOI":"10.1109\/CVPR42600.2020.00927"},{"key":"2925_CR24","doi-asserted-by":"crossref","unstructured":"Jung, S., Lee, J., Gwak, D., Choi, S., Choo, J.: Standardized max logits: A simple yet effective approach for identifying unexpected road obstacles in urban-scene segmentation. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp. 15425\u201315434 (2021)","DOI":"10.1109\/ICCV48922.2021.01514"},{"key":"2925_CR25","doi-asserted-by":"crossref","unstructured":"Chan, R., Rottmann, M., Gottschalk, H.: Entropy maximization and meta classification for out-of-distribution detection in semantic segmentation. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp. 5128\u20135137 (2021)","DOI":"10.1109\/ICCV48922.2021.00508"},{"key":"2925_CR26","doi-asserted-by":"crossref","unstructured":"Xia, Y., Zhang, Y., Liu, F., Shen, W., Yuille, A.L.: Synthesize then compare: Detecting failures and anomalies for semantic segmentation. In: European Conference on Computer Vision, pp. 145\u2013161 (2020). Springer","DOI":"10.1007\/978-3-030-58452-8_9"},{"key":"2925_CR27","doi-asserted-by":"crossref","unstructured":"Di\u00a0Biase, G., Blum, H., Siegwart, R., Cadena, C.: Pixel-wise anomaly detection in complex driving scenes. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 16918\u201316927 (2021)","DOI":"10.1109\/CVPR46437.2021.01664"},{"key":"2925_CR28","doi-asserted-by":"crossref","unstructured":"Vojir, T., \u0160ipka, T., Aljundi, R., Chumerin, N., Reino, D.O., Matas, J.: Road anomaly detection by partial image reconstruction with segmentation coupling. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp. 15651\u201315660 (2021)","DOI":"10.1109\/ICCV48922.2021.01536"},{"key":"2925_CR29","doi-asserted-by":"crossref","unstructured":"Kong, S., Ramanan, D.: Opengan: Open-set recognition via open data generation. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp. 813\u2013822 (2021)","DOI":"10.1109\/ICCV48922.2021.00085"},{"key":"2925_CR30","doi-asserted-by":"crossref","unstructured":"Szeliski, R.: Computer vision: algorithms and applications. Springer Nature (2022)","DOI":"10.1007\/978-3-030-34372-9"},{"issue":"11","key":"2925_CR31","doi-asserted-by":"publisher","first-page":"1768","DOI":"10.1109\/TPAMI.2006.233","volume":"28","author":"L Grady","year":"2006","unstructured":"Grady, L.: Random walks for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 28(11), 1768\u20131783 (2006)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"2925_CR32","doi-asserted-by":"crossref","unstructured":"Liu, Y., Jiang, P.-T., Petrosyan, V., Li, S.-J., Bian, J., 0001, L.Z., Cheng, M.-M.: Del: Deep embedding learning for efficient image segmentation. IJCAI 864, 870 (2018)","DOI":"10.24963\/ijcai.2018\/120"},{"key":"2925_CR33","unstructured":"Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, vol. 2, pp. 416\u2013423 (2001). IEEE"},{"key":"2925_CR34","doi-asserted-by":"crossref","unstructured":"Eigen, D., Fergus, R.: Predicting depth, surface normals and semantic labels with a common multi-scale convolutional architecture. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2650\u20132658 (2015)","DOI":"10.1109\/ICCV.2015.304"},{"key":"2925_CR35","doi-asserted-by":"crossref","unstructured":"Jafari, O.H., Groth, O., Kirillov, A., Yang, M.Y., Rother, C.: Analyzing modular cnn architectures for joint depth prediction and semantic segmentation. In: 2017 IEEE International Conference on Robotics and Automation (ICRA), pp. 4620\u20134627 (2017). IEEE","DOI":"10.1109\/ICRA.2017.7989537"},{"key":"2925_CR36","doi-asserted-by":"crossref","unstructured":"Kokkinos, I.: Ubernet: Training a universal convolutional neural network for low-, mid-, and high-level vision using diverse datasets and limited memory. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6129\u20136138 (2017)","DOI":"10.1109\/CVPR.2017.579"},{"key":"2925_CR37","doi-asserted-by":"crossref","unstructured":"Bleyer, M., Rother, C., Kohli, P., Scharstein, D., Sinha, S.: Object stereo\u2013joint stereo matching and object segmentation. In: CVPR 2011, pp. 3081\u20133088 (2011)","DOI":"10.1109\/CVPR.2011.5995581"},{"key":"2925_CR38","doi-asserted-by":"crossref","unstructured":"Yamaguchi, K., McAllester, D., Urtasun, R.: Efficient joint segmentation, occlusion labeling, stereo and flow estimation. In: European Conference on Computer Vision, pp. 756\u2013771 (2014). Springer","DOI":"10.1007\/978-3-319-10602-1_49"},{"key":"2925_CR39","unstructured":"Sun, D., Sudderth, E.B., Black, M.J.: Layered segmentation and optical flow estimation over time. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1768\u20131775 (2012)"},{"key":"2925_CR40","doi-asserted-by":"crossref","unstructured":"Sevilla-Lara, L., Sun, D., Jampani, V., Black, M.J.: Optical flow with semantic segmentation and localized layers. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3889\u20133898 (2016)","DOI":"10.1109\/CVPR.2016.422"},{"key":"2925_CR41","doi-asserted-by":"crossref","unstructured":"Hane, C., Zach, C., Cohen, A., Angst, R., Pollefeys, M.: Joint 3d scene reconstruction and class segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 97\u2013104 (2013)","DOI":"10.1109\/CVPR.2013.20"},{"key":"2925_CR42","doi-asserted-by":"crossref","unstructured":"Hu, Y., Hugonot, J., Fua, P., Salzmann, M.: Segmentation-driven 6d object pose estimation. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 3385\u20133394 (2019)","DOI":"10.1109\/CVPR.2019.00350"},{"key":"2925_CR43","doi-asserted-by":"crossref","unstructured":"Kirillov, A., He, K., Girshick, R., Rother, C., Doll\u00e1r, P.: Panoptic segmentation. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 9404\u20139413 (2019)","DOI":"10.1109\/CVPR.2019.00963"},{"key":"2925_CR44","doi-asserted-by":"crossref","unstructured":"Kirillov, A., Girshick, R., He, K., Doll\u00e1r, P.: Panoptic feature pyramid networks. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 6399\u20136408 (2019)","DOI":"10.1109\/CVPR.2019.00656"},{"key":"2925_CR45","doi-asserted-by":"crossref","unstructured":"Hwang, J., Oh, S.W., Lee, J.-Y., Han, B.: Exemplar-based open-set panoptic segmentation network. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1175\u20131184 (2021)","DOI":"10.1109\/CVPR46437.2021.00123"},{"key":"2925_CR46","doi-asserted-by":"crossref","unstructured":"Cheng, B., Girshick, R., Doll\u00e1r, P., Berg, A.C., Kirillov, A.: Boundary iou: Improving object-centric image segmentation evaluation. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 15334\u201315342 (2021)","DOI":"10.1109\/CVPR46437.2021.01508"},{"key":"2925_CR47","doi-asserted-by":"crossref","unstructured":"Everingham, M., Van\u00a0Gool, L., Williams, C.K., Winn, J., Zisserman, A.: The pascal visual object classes (voc) challenge. IJCV (2010)","DOI":"10.1007\/s11263-009-0275-4"},{"key":"2925_CR48","doi-asserted-by":"crossref","unstructured":"Davis, J., Goadrich, M.: The relationship between precision-recall and roc curves. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 233\u2013240 (2006)","DOI":"10.1145\/1143844.1143874"},{"issue":"8","key":"2925_CR49","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1016\/j.patrec.2005.10.010","volume":"27","author":"T Fawcett","year":"2006","unstructured":"Fawcett, T.: An introduction to roc analysis. Pattern Recogn. Lett. 27(8), 861\u2013874 (2006)","journal-title":"Pattern Recogn. Lett."},{"key":"2925_CR50","unstructured":"Manning, C., Schutze, H.: Foundations of Statistical Natural Language Processing, (1999)"},{"issue":"3","key":"2925_CR51","doi-asserted-by":"publisher","first-page":"0118432","DOI":"10.1371\/journal.pone.0118432","volume":"10","author":"T Saito","year":"2015","unstructured":"Saito, T., Rehmsmeier, M.: The precision-recall plot is more informative than the roc plot when evaluating binary classifiers on imbalanced datasets. PLoS ONE 10(3), 0118432 (2015)","journal-title":"PLoS ONE"},{"key":"2925_CR52","doi-asserted-by":"crossref","unstructured":"Meila, M.: Comparing clusterings: an axiomatic view. In: Proceedings of the 22nd International Conference on Machine Learning, pp. 577\u2013584 (2005)","DOI":"10.1145\/1102351.1102424"},{"issue":"336","key":"2925_CR53","doi-asserted-by":"publisher","first-page":"846","DOI":"10.1080\/01621459.1971.10482356","volume":"66","author":"WM Rand","year":"1971","unstructured":"Rand, W.M.: Objective criteria for the evaluation of clustering methods. J. Am. Stat. Assoc. 66(336), 846\u2013850 (1971)","journal-title":"J. Am. Stat. Assoc."},{"issue":"5","key":"2925_CR54","doi-asserted-by":"publisher","first-page":"530","DOI":"10.1109\/TPAMI.2004.1273918","volume":"26","author":"DR Martin","year":"2004","unstructured":"Martin, D.R., Fowlkes, C.C., Malik, J.: Learning to detect natural image boundaries using local brightness, color, and texture cues. IEEE Trans. Pattern Anal. Mach. Intell. 26(5), 530\u2013549 (2004)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"2925_CR55","unstructured":"Hendrycks, D., Gimpel, K.: A baseline for detecting misclassified and out-of-distribution examples in neural networks. In: International Conference on Learning Representations (ICLR) (2017)"},{"key":"2925_CR56","unstructured":"DeVries, T., Taylor, G.W.: Learning Confidence for Out-of-Distribution Detection in Neural Networks. arXiv preprint arXiv:1802.04865 (2018)"},{"key":"2925_CR57","unstructured":"Corbi\u00e8re, C., Thome, N., Bar-Hen, A., Cord, M., P\u00e9rez, P.: Addressing failure prediction by learning model confidence. In: Advances in Neural Information Processing Systems (NeurIPS) (2019)"},{"key":"2925_CR58","doi-asserted-by":"crossref","unstructured":"Wang, W., Zhou, T., Yu, F., Dai, J., Konukoglu, E., Van\u00a0Gool, L.: Exploring cross-image pixel contrast for semantic segmentation. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), pp. 7303\u20137313 (2021)","DOI":"10.1109\/ICCV48922.2021.00721"},{"key":"2925_CR59","unstructured":"Sohn, K.: Improved deep metric learning with multi-class n-pair loss objective. In: Advances in Neural Information Processing Systems, pp. 1857\u20131865 (2016)"},{"key":"2925_CR60","doi-asserted-by":"crossref","unstructured":"Harley, A.W., Derpanis, K.G., Kokkinos, I.: Segmentation-aware convolutional networks using local attention masks. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 5038\u20135047 (2017)","DOI":"10.1109\/ICCV.2017.539"},{"key":"2925_CR61","doi-asserted-by":"crossref","unstructured":"De\u00a0Brabandere, B., Neven, D., Van\u00a0Gool, L.: Semantic instance segmentation with a discriminative loss function. arXiv preprint arXiv:1708.02551 (2017)","DOI":"10.1109\/CVPRW.2017.66"},{"key":"2925_CR62","doi-asserted-by":"crossref","unstructured":"Hwang, J.-J., Yu, S.X., Shi, J., Collins, M.D., Yang, T.-J., Zhang, X., Chen, L.-C.: Segsort: Segmentation by discriminative sorting of segments. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV) (2019)","DOI":"10.1109\/ICCV.2019.00743"},{"key":"2925_CR63","unstructured":"Zhao, S., Wang, Y., Yang, Z., Cai, D.: Region mutual information loss for semantic segmentation. arXiv preprint arXiv:1910.12037 (2019)"},{"key":"2925_CR64","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., Zitnick, C.L.: Microsoft coco: Common objects in context. In: European Conference on Computer Vision, pp. 740\u2013755 (2014). Springer","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"2925_CR65","unstructured":"O Pinheiro, P.O., Collobert, R., Dollar, P.: Learning to segment object candidates. In: Advances in neural information processing systems (NeurIPS) (2015)"},{"key":"2925_CR66","doi-asserted-by":"crossref","unstructured":"Hu, R., Doll\u00e1r, P., He, K., Darrell, T., Girshick, R.: Learning to segment every thing. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4233-4241 (2018)","DOI":"10.1109\/CVPR.2018.00445"},{"key":"2925_CR67","doi-asserted-by":"crossref","unstructured":"Dhamija, A., Gunther, M., Ventura, J., Boult, T.: The overlooked elephant of object detection: Open set. In: Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, pp. 1021\u20131030 (2020)","DOI":"10.1109\/WACV45572.2020.9093355"},{"key":"2925_CR68","doi-asserted-by":"crossref","unstructured":"Joseph, K., Khan, S., Khan, F.S., Balasubramanian, V.N.: Towards open world object detection. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 5830\u20135840 (2021)","DOI":"10.1109\/CVPR46437.2021.00577"},{"key":"2925_CR69","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770\u2013778 (2016)","DOI":"10.1109\/CVPR.2016.90"},{"key":"2925_CR70","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L.: Imagenet: A large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248\u2013255 (2009). Ieee","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"2925_CR71","unstructured":"Liu, W., Rabinovich, A., Berg, A.C.: Parsenet: Looking Wider to See Better. arXiv preprint arXiv:1506.04579 (2015)"},{"key":"2925_CR72","unstructured":"Kingma, D.P., Ba, J.: Adam: A Method for Stochastic Optimization. arXiv preprint arXiv:1412.6980 (2014)"},{"key":"2925_CR73","first-page":"8026","volume":"32","author":"A Paszke","year":"2019","unstructured":"Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al.: Pytorch: an imperative style, high-performance deep learning library. Adv. Neural. Inf. Process. Syst. 32, 8026\u20138037 (2019)","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"2925_CR74","doi-asserted-by":"publisher","first-page":"8055","DOI":"10.1109\/TIP.2020.3011269","volume":"29","author":"W Kim","year":"2020","unstructured":"Kim, W., Kanezaki, A., Tanaka, M.: Unsupervised learning of image segmentation based on differentiable feature clustering. IEEE Trans. Image Process. 29, 8055\u20138068 (2020)","journal-title":"IEEE Trans. Image Process."}],"updated-by":[{"DOI":"10.1007\/s00371-023-03020-8","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2023,7,24]],"date-time":"2023-07-24T00:00:00Z","timestamp":1690156800000}}],"container-title":["The Visual Computer"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-023-02925-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00371-023-02925-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-023-02925-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,5]],"date-time":"2024-04-05T17:04:56Z","timestamp":1712336696000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00371-023-02925-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,23]]},"references-count":74,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,4]]}},"alternative-id":["2925"],"URL":"https:\/\/doi.org\/10.1007\/s00371-023-02925-8","relation":{"correction":[{"id-type":"doi","id":"10.1007\/s00371-023-03020-8","asserted-by":"object"}]},"ISSN":["0178-2789","1432-2315"],"issn-type":[{"value":"0178-2789","type":"print"},{"value":"1432-2315","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,23]]},"assertion":[{"value":"26 May 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 June 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 July 2023","order":3,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":4,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":5,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s00371-023-03020-8","URL":"https:\/\/doi.org\/10.1007\/s00371-023-03020-8","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}