{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T17:05:46Z","timestamp":1777655146723,"version":"3.51.4"},"publisher-location":"Cham","reference-count":27,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783031731129","type":"print"},{"value":"9783031731136","type":"electronic"}],"license":[{"start":{"date-parts":[[2024,11,21]],"date-time":"2024-11-21T00:00:00Z","timestamp":1732147200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,11,21]],"date-time":"2024-11-21T00:00:00Z","timestamp":1732147200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The field of visual Industrial Anomaly Detection (IAD) has brought forth many new semi-supervised learning methods in recent years. At the same time, there have been few new datasets for benchmarking the methods. The most popular dataset is MVTec-AD dataset, because of its diversity of categories and availability of industrial objects. But many methods already achieve AUROC scores of more than 99 % on the MVTec-AD dataset. The defects of the categories that the dataset provides appear to be easily detectable. Furthermore, there is no existing approach to statistically describe the defects that need to be found in IAD datasets. This paper presents a new dataset for visual industrial anomaly detection and a novel approach for Anomaly Detection Dataset Difficulty assessment with the AD3 score. The new dataset named VIADUCT contains 49 categories and 10,986 high resolution images from eleven different sectors. Through the support of several manufacturing companies, numerous real inspection problems are presented through the dataset. It contains a large number of different defects with detailed pixel-wise annotations. The VIADUCT dataset is compared with other state of the art datasets to underline its added value. Therefore, we provide an overview for each dataset regarding the number of categories, images, defect categories and defects. In addition to these obvious comparisons the defects of the datasets are described with the AD3 score. This novel score is used to analyze the size of the defects and the similarity between the defect and its corresponding object. Using seven selected methods from industrial anomaly detection, a benchmark is performed on the new dataset, showing that there is still potential for improvement. It is shown that the VIADUCT dataset is the largest dataset in the field of image-based industrial anomaly detection. In addition to its very small defects which are hard to recognize, the dataset also offers the greatest variance of possible defects and the most defect classes. Describing the datasets with AD3 score it can be found that VIADUCT dataset have the most inconspicuous defects. With the AD3 score we are able to create a-priori knowledge for every single defect in IAD datasets. The AD3 score correlates with the results of the IAD method benchmark, showing that it can be used to estimate defect detection difficulty. In the future, new objects can be assessed to see whether defects can be recognized using IAD methods before an energy-intensive benchmark is performed. The simple calculation of the AD3 score generates valuable a-priori knowledge and can save resources.<\/jats:p>","DOI":"10.1007\/978-3-031-73113-6_26","type":"book-chapter","created":{"date-parts":[[2024,11,20]],"date-time":"2024-11-20T08:50:21Z","timestamp":1732092621000},"page":"449-464","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["AD3: Introducing a\u00a0Score for\u00a0Anomaly Detection Dataset Difficulty Assessment Using VIADUCT Dataset"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3392-0108","authenticated-orcid":false,"given":"Jan","family":"Lehr","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-2523-5610","authenticated-orcid":false,"given":"Jan","family":"Philipps","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-4327-0747","authenticated-orcid":false,"given":"Alik","family":"Sargsyan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7351-9813","authenticated-orcid":false,"given":"Martin","family":"Pape","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5138-0793","authenticated-orcid":false,"given":"J\u00f6rg","family":"Kr\u00fcger","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,11,21]]},"reference":[{"key":"26_CR1","doi-asserted-by":"crossref","unstructured":"Batzner, K., Heckler, L., K\u00f6nig, R.: EfficientAD: accurate visual anomaly detection at millisecond-level latencies. arXiv preprint arXiv:2303.14535 (2023)","DOI":"10.1109\/WACV57701.2024.00020"},{"key":"26_CR2","doi-asserted-by":"crossref","unstructured":"Bergmann, P., Batzner, K., Fauser, M., Sattlegger, D., Steger, C.: Beyond dents and scratches: logical constraints in unsupervised anomaly detection and localization. Int. J. Comput. Vis. 130, 947 \u2013 969 (2022). https:\/\/api.semanticscholar.org\/CorpusID:247063535","DOI":"10.1007\/s11263-022-01578-9"},{"key":"26_CR3","doi-asserted-by":"publisher","unstructured":"Bergmann, P., Fauser, M., Sattlegger, D., Steger, C.: MVTec AD \u2014 a comprehensive real-world dataset for unsupervised anomaly detection. In: 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 9584\u20139592 (2019). https:\/\/doi.org\/10.1109\/CVPR.2019.00982","DOI":"10.1109\/CVPR.2019.00982"},{"key":"26_CR4","doi-asserted-by":"publisher","unstructured":"Deng, H., Li, X.: Anomaly detection via reverse distillation from one-class embedding. In: 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 9727\u20139736 (2022). https:\/\/doi.org\/10.1109\/CVPR52688.2022.00951","DOI":"10.1109\/CVPR52688.2022.00951"},{"key":"26_CR5","unstructured":"Ding, K., Ma, K., Wang, S., Simoncelli, E.P.: Image quality assessment: unifying structure and texture similarity. IEEE Trans. Pattern Anal. Mach. Intell. 44(5), 2567\u20132581 (2020). https:\/\/api.semanticscholar.org\/CorpusID:215785896"},{"key":"26_CR6","unstructured":"Han, S., Hu, X., Huang, H., Jiang, M., Zhao, Y.: ADBench: anomaly detection benchmark. In: Koyejo, S., Mohamed, S., Agarwal, A., Belgrave, D., Cho, K., Oh, A. (eds.) Advances Neural Information Processing Systems, vol.\u00a035, pp. 32142\u201332159. Curran Associates, Inc. (2022). https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2022\/file\/cf93972b116ca5268827d575f2cc226b-Paper-Datasets_and_Benchmarks.pdf"},{"key":"26_CR7","doi-asserted-by":"crossref","unstructured":"Li, H., Hu, J., Li, B., Chen, H., Zheng, Y., Shen, C.: Target before shooting: accurate anomaly detection and localization under one millisecond via cascade patch retrieval. arXiv preprint arxiv:2308.06748 (2023)","DOI":"10.1109\/TIP.2024.3448263"},{"key":"26_CR8","unstructured":"Huang, W., Wei, P.: A PCB dataset for defects detection and classification. arXiv preprint arXiv:1901.08204 (2019)"},{"key":"26_CR9","doi-asserted-by":"crossref","unstructured":"Hyun, J., Kim, S., Jeon, G., Kim, S.H., Bae, K., Kang, B.: ReConPatch : contrastive patch representation learning for industrial anomaly detection. In: 2024 IEEE\/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 2041\u20132050 (2023). https:\/\/api.semanticscholar.org\/CorpusID:258947528","DOI":"10.1109\/WACV57701.2024.00205"},{"key":"26_CR10","doi-asserted-by":"crossref","unstructured":"Bae, J., Lee, J.H. and Kim, S.: PNI : industrial anomaly detection using position and neighborhood information. arXiv preprint arXiv:2211.12634 (2023)","DOI":"10.1109\/ICCV51070.2023.00586"},{"key":"26_CR11","unstructured":"Lehr, J., et al.: VIADUCT: multisector data set for visual industrial anomaly detection (2024). http:\/\/dx.doi.org\/10.24406\/fordatis\/305"},{"key":"26_CR12","doi-asserted-by":"publisher","unstructured":"Kumar, B., Ghosh, S.: Detection of concrete cracks using dual-channel deep convolutional network. In: 2020 11th International Conference on Computing, Communication and Networking Technologies (ICCCNT), pp.\u00a01\u20137 (2020). https:\/\/doi.org\/10.1109\/ICCCNT49239.2020.9225391","DOI":"10.1109\/ICCCNT49239.2020.9225391"},{"key":"26_CR13","doi-asserted-by":"crossref","unstructured":"Kumar, R.M.V., Moyal, V.: Visual image quality assessment technique using FSIM. Int. J. Comput. Appl. Technol. Res. 2, 250\u2013254 (2013). https:\/\/api.semanticscholar.org\/CorpusID:11692573","DOI":"10.7753\/IJCATR0203.1008"},{"key":"26_CR14","doi-asserted-by":"publisher","unstructured":"Lee, S., Lee, S., Song, B.C.: CFA: coupled-hypersphere-based feature adaptation for target-oriented anomaly localization. IEEE Access 10 (2022). https:\/\/doi.org\/10.1109\/ACCESS.2022.3193699","DOI":"10.1109\/ACCESS.2022.3193699"},{"key":"26_CR15","doi-asserted-by":"publisher","unstructured":"Liu, J., Song, K., Feng, M., Yan, Y., Tu, Z., Zhu, L.: Semi-supervised anomaly detection with dual prototypes autoencoder for industrial surface inspection. Opt. Lasers Eng. 136, 106324 (2021). https:\/\/doi.org\/10.1016\/j.optlaseng.2020.106324","DOI":"10.1016\/j.optlaseng.2020.106324"},{"key":"26_CR16","doi-asserted-by":"crossref","unstructured":"Mishra, P., Verk, R., Fornasier, D., Piciarelli, C., Foresti, G.L.: VT-ADL: a vision transformer network for image anomaly detection and localization. In: 2021 IEEE 30th International Symposium on Industrial Electronics (ISIE), pp. 01\u201306 (2021). https:\/\/api.semanticscholar.org\/CorpusID:233307063","DOI":"10.1109\/ISIE45552.2021.9576231"},{"key":"26_CR17","doi-asserted-by":"publisher","unstructured":"Racki, D., Tomazevic, D., Skocaj, D.: A compact convolutional neural network for textured surface anomaly detection. In: 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1331\u20131339 (2018). https:\/\/doi.org\/10.1109\/WACV.2018.00150","DOI":"10.1109\/WACV.2018.00150"},{"key":"26_CR18","doi-asserted-by":"crossref","unstructured":"Roth, K., Pemula, L., Zepeda, J., Scholkopf, B., Brox, T., Gehler, P.: Towards total recall in industrial anomaly detection. In: 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 14298\u201314308 (2021). https:\/\/api.semanticscholar.org\/CorpusID:235436036","DOI":"10.1109\/CVPR52688.2022.01392"},{"key":"26_CR19","doi-asserted-by":"crossref","unstructured":"Schlegl, T., Seeb\u00f6ck, P., Waldstein, S.M., Schmidt-Erfurth, U.M., Langs, G.: Unsupervised anomaly detection with generative adversarial networks to guide marker discovery. In: Information Processing in Medical Imaging (2017). https:\/\/api.semanticscholar.org\/CorpusID:17427022","DOI":"10.1007\/978-3-319-59050-9_12"},{"key":"26_CR20","doi-asserted-by":"crossref","unstructured":"Tang, T., Kuo, W.H., Lan, J.H., Ding, C.F., Hsu, H., Young, H.T.: Anomaly detection neural network with dual auto-encoders GAN and its industrial inspection applications. Sensors 20 (2020). https:\/\/api.semanticscholar.org\/CorpusID:219726774","DOI":"10.3390\/s20123336"},{"key":"26_CR21","doi-asserted-by":"crossref","unstructured":"Tao, X., Zhang, D., Ma, W., Liu, X., Xu, D.: Automatic metallic surface defect detection and recognition with convolutional neural networks. Appl. Sci. 8(9), 1575 (2018). https:\/\/api.semanticscholar.org\/CorpusID:116025664","DOI":"10.3390\/app8091575"},{"key":"26_CR22","doi-asserted-by":"publisher","unstructured":"Yang, M., Wu, P., Feng, H.: MemSeg: a semi-supervised method for image surface defect detection using differences and commonalities. Eng. Appl. Artif. Intell. 119, 105835 (2023). https:\/\/doi.org\/10.1016\/j.engappai.2023.105835","DOI":"10.1016\/j.engappai.2023.105835"},{"key":"26_CR23","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Xu, X., Song, J., Shen, F., Shen, H.T.: MSFlow: multi-scale flow-based framework for unsupervised anomaly detection. arXiv preprint arXiv:2308.15300 (2023)","DOI":"10.1109\/TNNLS.2023.3344118"},{"key":"26_CR24","unstructured":"Yu1, J., et al.: FastFlow: unsupervised anomaly detection and localization via 2D normalizing flows. arXiv preprint arXiv:2111.07677 (2021)"},{"key":"26_CR25","doi-asserted-by":"publisher","unstructured":"Zavrtanik, V., Kristan, M., Sko\u010daj, D.: Dr\u00c6m \u2013 a discriminatively trained reconstruction embedding for surface anomaly detection. In: 2021 IEEE\/CVF International Conference on Computer Vision (ICCV), pp. 8310\u20138319 (2021). https:\/\/doi.org\/10.1109\/ICCV48922.2021.00822","DOI":"10.1109\/ICCV48922.2021.00822"},{"key":"26_CR26","doi-asserted-by":"crossref","unstructured":"Zhang, R., Isola, P., Efros, A.A., Shechtman, E., Wang, O.: The unreasonable effectiveness of deep features as a perceptual metric. In: 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 586\u2013595 (2018). https:\/\/api.semanticscholar.org\/CorpusID:4766599","DOI":"10.1109\/CVPR.2018.00068"},{"key":"26_CR27","doi-asserted-by":"crossref","unstructured":"Zou, Y., Jeong, J., Pemula, L., Zhang, D., Dabeer, O.: Spot-the-difference self-supervised pre-training for anomaly detection and segmentation. In: European Conference on Computer Vision (2022). https:\/\/api.semanticscholar.org\/CorpusID:251196850","DOI":"10.1007\/978-3-031-20056-4_23"}],"container-title":["Lecture Notes in Computer Science","Computer Vision \u2013 ECCV 2024"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-73113-6_26","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,20]],"date-time":"2024-11-20T10:14:53Z","timestamp":1732097693000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-73113-6_26"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,21]]},"ISBN":["9783031731129","9783031731136"],"references-count":27,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-73113-6_26","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,21]]},"assertion":[{"value":"21 November 2024","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"ECCV","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"European Conference on Computer Vision","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Milan","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Italy","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2024","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"29 September 2024","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"4 October 2024","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"18","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"eccv2024","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/eccv2024.ecva.net\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}