{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,6]],"date-time":"2026-02-06T00:26:54Z","timestamp":1770337614058,"version":"3.49.0"},"reference-count":26,"publisher":"World Scientific Pub Co Pte Ltd","issue":"11","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Patt. Recogn. Artif. Intell."],"published-print":{"date-parts":[[2024,9,15]]},"abstract":"<jats:p> This paper presents a quantitative analysis of the nonlinearities of the positive predictive value (PPV) and its effect in evaluating two-class pattern classification models with imbalanced datasets. The analysis is made through an expression of the PPV as a function of two other classification ratios that are invariant to the data imbalance \u2014the true positive rate (TPR) and false positive rate (FPR), and [Formula: see text] \u2014 the imbalance ratio (IR) of the dataset such that PPV [Formula: see text]TPR\/([Formula: see text]TPR[Formula: see text]FPR). The curvatures of PPV in the three-dimensional TPR\u2013FPR\u2013[Formula: see text] space are studied using the Hessian matrix, from which a saddle-shaped 3D surface in the space is revealed. This paper explores the nonlinear behaviors of PPV around the critical points, identified at FPR [Formula: see text]TPR on the saddle surface, along with its scaling and sensitivity issues as performance measurements in model evaluation. The effect of the nonlinearities of PPV for the F1 and MCC metrics on imbalanced datasets is also studied. It is warned through the results of this study that the evaluations of classification models could be misleading if without an awareness and understanding of the nonlinearities associated with the PPV and its relevant metrics on imbalanced datasets. <\/jats:p>","DOI":"10.1142\/s0218001424590110","type":"journal-article","created":{"date-parts":[[2024,6,21]],"date-time":"2024-06-21T08:38:31Z","timestamp":1718959111000},"source":"Crossref","is-referenced-by-count":1,"title":["On Quantification of the Nonlinearity of PPV in Model Evaluation with Imbalanced Datasets"],"prefix":"10.1142","volume":"38","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5059-4308","authenticated-orcid":false,"given":"Qiuming","family":"Zhu","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Nebraska at Omaha, Omaha, NE 68182, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2024,8,15]]},"reference":[{"key":"S0218001424590110BIB001","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0177678"},{"key":"S0218001424590110BIB003","volume-title":"Differential Geometry of Curves and Surfaces","author":"Carmo M. P.","year":"2016","edition":"2"},{"key":"S0218001424590110BIB004","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-6419-7"},{"issue":"1","key":"S0218001424590110BIB005","first-page":"11","volume":"13","author":"Gong M.","year":"2021","journal-title":"Int. J. Manag. Inf. Technol."},{"issue":"3","key":"S0218001424590110BIB006","first-page":"895","volume":"18","author":"Guven \u00d6.","year":"2022","journal-title":"Int. J. Manag. Econ. Bus."},{"key":"S0218001424590110BIB008","doi-asserted-by":"publisher","DOI":"10.1007\/s11222-017-9746-6"},{"issue":"1","key":"S0218001424590110BIB009","first-page":"2813","volume":"13","author":"Hern\u00e1ndez-Orallo J.","year":"2012","journal-title":"J. Mach. Learn. Res."},{"key":"S0218001424590110BIB010","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-5477-9"},{"key":"S0218001424590110BIB011","doi-asserted-by":"publisher","DOI":"10.5121\/ijdkp.2015.5201"},{"key":"S0218001424590110BIB012","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2013.47"},{"key":"S0218001424590110BIB013","series-title":"Applied Mathematical Sciences","volume-title":"Multiple Scale and Singular Perturbation Methods","volume":"114","author":"Kevorkian J. K.","year":"2012"},{"key":"S0218001424590110BIB014","doi-asserted-by":"publisher","DOI":"10.1038\/nmeth.3945"},{"key":"S0218001424590110BIB015","doi-asserted-by":"publisher","DOI":"10.4018\/IJMCMC.2014100102"},{"key":"S0218001424590110BIB016","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2019.02.023"},{"issue":"9","key":"S0218001424590110BIB017","first-page":"2267","volume":"13","author":"Madasamy K.","year":"2017","journal-title":"Int. J. Comput. Intell. Res"},{"key":"S0218001424590110BIB018","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2013.04.016"},{"issue":"1","key":"S0218001424590110BIB019","first-page":"39","volume":"7","author":"Novakovi\u0107 J. D.","year":"2017","journal-title":"Theory Appl. Math. Comput. Sci."},{"key":"S0218001424590110BIB020","volume-title":"Elementary Differential Geometry","author":"O\u2019Neill B.","year":"2006","edition":"2"},{"issue":"1","key":"S0218001424590110BIB021","first-page":"37","volume":"2","author":"Powers D.","year":"2011","journal-title":"J. Mach. Learn. Technol."},{"key":"S0218001424590110BIB022","volume-title":"Data Science for Business: What You Need to Know about Data Mining and Data-Analytic Thinking","author":"Provost F.","year":"2013","edition":"1"},{"key":"S0218001424590110BIB023","doi-asserted-by":"publisher","DOI":"10.7763\/IJMLC.2013.V3.307"},{"key":"S0218001424590110BIB024","doi-asserted-by":"publisher","DOI":"10.17148\/IJARCCE.2016.5890"},{"key":"S0218001424590110BIB025","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.eval4nlp-1.9"},{"key":"S0218001424590110BIB026","doi-asserted-by":"publisher","DOI":"10.3390\/electronics10050593"},{"key":"S0218001424590110BIB027","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2020.03.030"},{"key":"S0218001424590110BIB028","doi-asserted-by":"publisher","DOI":"10.1016\/j.bdr.2015.12.001"}],"container-title":["International Journal of Pattern Recognition and Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218001424590110","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,2]],"date-time":"2024-09-02T03:41:04Z","timestamp":1725248464000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218001424590110"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,15]]},"references-count":26,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2024,9,15]]}},"alternative-id":["10.1142\/S0218001424590110"],"URL":"https:\/\/doi.org\/10.1142\/s0218001424590110","relation":{},"ISSN":["0218-0014","1793-6381"],"issn-type":[{"value":"0218-0014","type":"print"},{"value":"1793-6381","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,15]]},"article-number":"2459011"}}