{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,24]],"date-time":"2026-01-24T14:59:59Z","timestamp":1769266799428,"version":"3.49.0"},"reference-count":42,"publisher":"World Scientific Pub Co Pte Ltd","issue":"04","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62472209"],"award-info":[{"award-number":["62472209"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100004608","name":"Natural Science Foundation of Jiangsu Province","doi-asserted-by":"crossref","award":["BK20221439"],"award-info":[{"award-number":["BK20221439"]}],"id":[{"id":"10.13039\/501100004608","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100013058","name":"Primary Research and Development Plan of Jiangsu Province","doi-asserted-by":"crossref","award":["BE2023025-2"],"award-info":[{"award-number":["BE2023025-2"]}],"id":[{"id":"10.13039\/501100013058","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Soft. Eng. Knowl. Eng."],"published-print":{"date-parts":[[2026,3,30]]},"abstract":"<jats:p>Metamorphic testing (MT) has emerged as a widely adopted technique for validating deep learning (DL) models in the absence of explicit test oracles. A key challenge in MT is the efficient selection of metamorphic groups (MGs), i.e. the source and follow-up test inputs, that are more likely to expose faults. To address this challenge, we propose UGD, a novel MT approach that integrates two complementary criteria, input uncertainty and geometric dispersion. In UGD, source inputs with high uncertainty are prioritized for testing, as these inputs are more likely to lie near decision boundaries and thereby reveal erroneous behaviors. For each selected source, a convex hull-based strategy is applied to choose follow-up inputs that are both distant from the source input and well-dispersed from each other. This design ensures that the generated MGs are diverse and fault-revealing. Extensive experiments demonstrate that UGD consistently outperforms existing baseline methods in terms of the number of violated MGs and unique faults detected, particularly on complex datasets such as ImageNet under limited test budgets. The results confirm that uncertainty is a reliable indicator for selecting fault-prone source inputs. Furthermore, geometric dispersion, guided by convex hulls, enhances fault detection by ensuring that follow-up inputs are sufficiently different from the source and diverse among themselves.<\/jats:p>","DOI":"10.1142\/s0218194025500846","type":"journal-article","created":{"date-parts":[[2025,10,23]],"date-time":"2025-10-23T09:44:36Z","timestamp":1761212676000},"page":"595-619","source":"Crossref","is-referenced-by-count":0,"title":["Uncertainty and Geometric Dispersion-Driven Metamorphic Testing for DNN-Based Systems"],"prefix":"10.1142","volume":"36","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-9995-1496","authenticated-orcid":false,"given":"Shengyou","family":"Hu","sequence":"first","affiliation":[{"name":"School of Computer Science, State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, Jiangsu Province 210023, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-9007-3110","authenticated-orcid":false,"given":"Wenyang","family":"Lyu","sequence":"additional","affiliation":[{"name":"School of Computer Science, State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, Jiangsu Province 210023, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1383-5421","authenticated-orcid":false,"given":"Huayao","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Computer Science, State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, Jiangsu Province 210023, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5786-0894","authenticated-orcid":false,"given":"Xintao","family":"Niu","sequence":"additional","affiliation":[{"name":"School of Computer Science, State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, Jiangsu Province 210023, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9575-1012","authenticated-orcid":false,"given":"Changhai","family":"Nie","sequence":"additional","affiliation":[{"name":"School of Computer Science, State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, Jiangsu Province 210023, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2025,11,29]]},"reference":[{"key":"S0218194025500846BIB001","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.07.053"},{"key":"S0218194025500846BIB002","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2021.3114365"},{"key":"S0218194025500846BIB003","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2024.103201"},{"key":"S0218194025500846BIB004","doi-asserted-by":"publisher","DOI":"10.1002\/rob.21918"},{"key":"S0218194025500846BIB005","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416584"},{"key":"S0218194025500846BIB006","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2962027"},{"key":"S0218194025500846BIB007","unstructured":"T. Chen, S. Cheung and S. Yiu, Metamorphic testing: A new approach for generating next test cases, Technical Report HKUST-CS98-01, Department of Computer Science, The Hong Kong University of Science and Technology (1998), arXiv:abs\/2002.12543."},{"key":"S0218194025500846BIB008","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2372785"},{"key":"S0218194025500846BIB009","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-017-9392-4"},{"key":"S0218194025500846BIB010","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2020.106470"},{"key":"S0218194025500846BIB011","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2532875"},{"key":"S0218194025500846BIB012","doi-asserted-by":"publisher","DOI":"10.1145\/2975954.2975959"},{"key":"S0218194025500846BIB013","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2021.3106389"},{"key":"S0218194025500846BIB014","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2024.107528"},{"key":"S0218194025500846BIB015","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.111091"},{"key":"S0218194025500846BIB016","first-page":"569","volume-title":"Proc. 4th Ibero-American Symp. Software Engineering and Knowledge Engineering","author":"Chen T. Y.","year":"2004"},{"key":"S0218194025500846BIB017","doi-asserted-by":"publisher","DOI":"10.1109\/SSIRI.2011.21"},{"key":"S0218194025500846BIB018","doi-asserted-by":"publisher","DOI":"10.1145\/3533314"},{"key":"S0218194025500846BIB019","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3556919"},{"key":"S0218194025500846BIB020","doi-asserted-by":"publisher","DOI":"10.1109\/QRS-C63300.2024.00071"},{"key":"S0218194025500846BIB021","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2020.110574"},{"key":"S0218194025500846BIB022","doi-asserted-by":"publisher","DOI":"10.1145\/3679006.3685070"},{"key":"S0218194025500846BIB023","doi-asserted-by":"publisher","DOI":"10.1145\/3512290.3528697"},{"key":"S0218194025500846BIB024","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2023.3243522"},{"key":"S0218194025500846BIB025","doi-asserted-by":"publisher","DOI":"10.1145\/3644388"},{"key":"S0218194025500846BIB026","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510232"},{"issue":"1","key":"S0218194025500846BIB027","first-page":"4:1","volume":"51","author":"Chen T. Y.","year":"2018","journal-title":"ACM Comput. Surv."},{"key":"S0218194025500846BIB028","unstructured":"B. Settles, Active learning literature survey, Computer Sciences Technical Report, University of Wisconsin\u2013Madison (2009)."},{"key":"S0218194025500846BIB029","doi-asserted-by":"publisher","DOI":"10.1145\/3395363.3397357"},{"key":"S0218194025500846BIB030","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416621"},{"key":"S0218194025500846BIB031","doi-asserted-by":"publisher","DOI":"10.1145\/3417330"},{"key":"S0218194025500846BIB032","doi-asserted-by":"publisher","DOI":"10.1145\/3511598"},{"key":"S0218194025500846BIB033","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2023.3330982"},{"key":"S0218194025500846BIB034","doi-asserted-by":"publisher","DOI":"10.1109\/STEP.2003.18"},{"key":"S0218194025500846BIB035","doi-asserted-by":"publisher","DOI":"10.1109\/QSIC.2013.43"},{"key":"S0218194025500846BIB036","doi-asserted-by":"publisher","DOI":"10.1145\/3293882.3330579"},{"key":"S0218194025500846BIB037","unstructured":"Y. LeCun, C. Cortes and C. J. C. Burges, The MNIST database of handwritten digits (1998), http:\/\/yann.lecun.com\/exdb\/mnist\/."},{"key":"S0218194025500846BIB038","unstructured":"A. Krizhevsky, V. Nair and G. Hinton, The CIFAR-10 dataset (2014), http:\/\/www.cs.toronto.edu\/kriz\/cifar.html."},{"key":"S0218194025500846BIB039","first-page":"1097","volume-title":"NIPS'12","author":"Krizhevsky A.","year":"2012"},{"key":"S0218194025500846BIB040","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.3009698"},{"key":"S0218194025500846BIB041","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180220"},{"key":"S0218194025500846BIB042","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.244"}],"container-title":["International Journal of Software Engineering and Knowledge Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218194025500846","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T07:39:16Z","timestamp":1769153956000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218194025500846"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,29]]},"references-count":42,"journal-issue":{"issue":"04","published-print":{"date-parts":[[2026,3,30]]}},"alternative-id":["10.1142\/S0218194025500846"],"URL":"https:\/\/doi.org\/10.1142\/s0218194025500846","relation":{},"ISSN":["0218-1940","1793-6403"],"issn-type":[{"value":"0218-1940","type":"print"},{"value":"1793-6403","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,29]]}}}