{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T09:03:11Z","timestamp":1758272591121,"version":"3.41.0"},"reference-count":27,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,12,11]],"date-time":"2021-12-11T00:00:00Z","timestamp":1639180800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Data and Information Quality"],"published-print":{"date-parts":[[2022,6,30]]},"abstract":"<jats:p>\n            Large-scale adoption of Artificial Intelligence and Machine Learning (AI-ML) models fed by heterogeneous, possibly untrustworthy data sources has spurred interest in estimating degradation of such models due to spurious, adversarial, or low-quality data assets. We propose a quantitative estimate of the\n            <jats:italic>severity<\/jats:italic>\n            of classifiers\u2019 training set degradation: an index expressing the deformation of the convex hulls of the classes computed on a\n            <jats:italic>held-out<\/jats:italic>\n            dataset generated via an unsupervised technique. We show that our index is computationally light, can be calculated incrementally and complements well existing ML data assets\u2019 quality measures. As an experimentation, we present the computation of our index on a benchmark convolutional image classifier.\n          <\/jats:p>","DOI":"10.1145\/3446331","type":"journal-article","created":{"date-parts":[[2021,12,11]],"date-time":"2021-12-11T19:53:02Z","timestamp":1639252382000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Estimating Degradation of Machine Learning Data Assets"],"prefix":"10.1145","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4024-1015","authenticated-orcid":false,"given":"Lara","family":"Mauri","sequence":"first","affiliation":[{"name":"Computer Science Department, Universit\u00e0 degli Studi di Milano, Milano MI, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9557-6496","authenticated-orcid":false,"given":"Ernesto","family":"Damiani","sequence":"additional","affiliation":[{"name":"Center for Cyber-Physical Systems (C2PS), Khalifa University, Abu Dhabi"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,12,11]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_3_2_2_2","DOI":"10.1145\/235815.235821"},{"doi-asserted-by":"publisher","key":"e_1_3_2_3_2","DOI":"10.1007\/s10994-010-5188-5"},{"doi-asserted-by":"publisher","key":"e_1_3_2_4_2","DOI":"10.1016\/j.patcog.2018.07.023"},{"doi-asserted-by":"publisher","key":"e_1_3_2_5_2","DOI":"10.1177\/027836498900800304"},{"key":"e_1_3_2_6_2","first-page":"86","volume-title":"Proceedings of the 8th International Conference on Probabilistic Graphical Models. Vol. 52","author":"Cattaneo Marco E. G. V.","year":"2016","unstructured":"Marco E. G. V. Cattaneo. 2016. Conditional probability estimation. In Proceedings of the 8th International Conference on Probabilistic Graphical Models. Vol. 52. JMLR.org, 86\u201397. Retrieved from http:\/\/proceedings.mlr.press\/v52\/cattaneo16.html."},{"doi-asserted-by":"publisher","key":"e_1_3_2_7_2","DOI":"10.1145\/3318464.3389772"},{"doi-asserted-by":"publisher","key":"e_1_3_2_8_2","DOI":"10.5555\/2887965.2888073"},{"key":"e_1_3_2_9_2","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/978-3-030-38919-2_1","volume-title":"SOFSEM 2020: Theory and Practice of Computer Science","author":"Damiani Ernesto","year":"2020","unstructured":"Ernesto Damiani and Claudio A. Ardagna. 2020. Certified machine-learning models. SOFSEM 2020: Theory and Practice of Computer Science. Springer International Publishing, Cham, 3\u201315."},{"doi-asserted-by":"publisher","key":"e_1_3_2_10_2","DOI":"10.1016\/j.chb.2015.02.045"},{"doi-asserted-by":"publisher","key":"e_1_3_2_11_2","DOI":"10.1016\/j.entcs.2005.09.036"},{"unstructured":"ENISA. December 2020. AI Cybersecurity Challenges \u2013 Threat Landscape for Artificial Intelligence. Retrieved 15 Dec. 2020 from https:\/\/www.enisa.europa.eu\/publications\/artificial-intelligence-cybersecurity-challenges.","key":"e_1_3_2_12_2"},{"doi-asserted-by":"publisher","key":"e_1_3_2_13_2","DOI":"10.1093\/biomet\/61.2.215"},{"doi-asserted-by":"publisher","key":"e_1_3_2_14_2","DOI":"10.1017\/CBO9780511790423"},{"doi-asserted-by":"publisher","key":"e_1_3_2_15_2","DOI":"10.1016\/j.jnca.2016.08.002"},{"key":"e_1_3_2_16_2","article-title":"Studies in social psychology in world war II Vol. IV: Measurement and prediction","author":"Lazarsfeld Paul F.","year":"1950","unstructured":"Paul F. Lazarsfeld. 1950. Studies in social psychology in world war II Vol. IV: Measurement and prediction. Journal of Information Security and Applications 45, 3 (1950), 934\u2013935. DOI:10.1017\/S0003055400062882","journal-title":"Journal of Information Security and Applications"},{"key":"e_1_3_2_17_2","article-title":"A soft-margin convex polyhedron classifier for nonlinear task with noise tolerance","author":"Leng Qiangkui","year":"2020","unstructured":"Qiangkui Leng, Zuowei He, Yuqing Liu, Yuping Qin, and Yujian Li. 2020. A soft-margin convex polyhedron classifier for nonlinear task with noise tolerance. Applied Intelligence 51, 1 (2020), 453\u2013466. DOI:https:\/\/doi.org\/10.1007\/s10489-020-01854-6","journal-title":"Applied Intelligence"},{"doi-asserted-by":"publisher","key":"e_1_3_2_18_2","DOI":"10.1007\/978-3-030-32409-4_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_19_2","DOI":"10.1109\/CLOUD49709.2020.00021"},{"key":"e_1_3_2_20_2","first-page":"47","volume-title":"The Security of Machine Learning Systems","author":"Mu\u00f1oz-Gonz\u00e1lez Luis","year":"2019","unstructured":"Luis Mu\u00f1oz-Gonz\u00e1lez and Emil C. Lupu. 2019. The Security of Machine Learning Systems. Springer International Publishing, Cham, 47\u201379. DOI:https:\/\/doi.org\/10.1007\/978-3-319-98842-9_3"},{"doi-asserted-by":"publisher","key":"e_1_3_2_21_2","DOI":"10.1109\/TSMC.1979.4310076"},{"doi-asserted-by":"publisher","key":"e_1_3_2_22_2","DOI":"10.1016\/j.compeleceng.2020.106907"},{"doi-asserted-by":"publisher","key":"e_1_3_2_23_2","DOI":"10.18653\/v1\/W15-2612"},{"doi-asserted-by":"publisher","key":"e_1_3_2_24_2","DOI":"10.1016\/j.jisa.2017.10.006"},{"doi-asserted-by":"publisher","key":"e_1_3_2_25_2","DOI":"10.1017\/S0305004100023185"},{"doi-asserted-by":"publisher","key":"e_1_3_2_26_2","DOI":"10.1109\/IACC.2016.25"},{"doi-asserted-by":"publisher","key":"e_1_3_2_27_2","DOI":"10.1109\/21.87068"},{"key":"e_1_3_2_28_2","volume-title":"Robotics: Science and Systems II. University of Pennsylvania, Philadelphia, Pennsylvania","author":"Zhang Wei","year":"2006","unstructured":"Wei Zhang and Jana Kosecka. 2006. A new inlier identification scheme for robust estimation problems. Robotics: Science and Systems II. University of Pennsylvania, Philadelphia, Pennsylvania. The MIT Press. DOI:https:\/\/doi.org\/10.15607\/RSS.2006.II.018"}],"container-title":["Journal of Data and Information Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3446331","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3446331","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:05Z","timestamp":1750193225000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3446331"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,11]]},"references-count":27,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,6,30]]}},"alternative-id":["10.1145\/3446331"],"URL":"https:\/\/doi.org\/10.1145\/3446331","relation":{},"ISSN":["1936-1955","1936-1963"],"issn-type":[{"type":"print","value":"1936-1955"},{"type":"electronic","value":"1936-1963"}],"subject":[],"published":{"date-parts":[[2021,12,11]]},"assertion":[{"value":"2020-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}