{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T04:32:34Z","timestamp":1792125154524,"version":"4.4.0"},"reference-count":20,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2021,3,1]],"date-time":"2021-03-01T00:00:00Z","timestamp":1614556800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,3,15]],"date-time":"2021-03-15T00:00:00Z","timestamp":1615766400000},"content-version":"vor","delay-in-days":14,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2021,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The F-measure, also known as the F1-score, is widely used to assess the performance of classification algorithms. However, some researchers find it lacking in intuitive interpretation, questioning the appropriateness of combining two aspects of performance as conceptually distinct as precision and recall, and also questioning whether the harmonic mean is the best way to combine them. To ease this concern, we describe a simple transformation of the F-measure, which we call <jats:inline-formula><jats:alternatives><jats:tex-math>$$F^*$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                  <mml:msup>\n                    <mml:mi>F<\/mml:mi>\n                    <mml:mo>\u2217<\/mml:mo>\n                  <\/mml:msup>\n                <\/mml:math><\/jats:alternatives><\/jats:inline-formula> (F-star), which has an immediate practical interpretation.<\/jats:p>","DOI":"10.1007\/s10994-021-05964-1","type":"journal-article","created":{"date-parts":[[2021,3,15]],"date-time":"2021-03-15T15:03:40Z","timestamp":1615820620000},"page":"451-456","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":218,"title":["F*: an interpretable transformation of the F-measure"],"prefix":"10.1007","volume":"110","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4649-5622","authenticated-orcid":false,"given":"David J.","family":"Hand","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3435-2015","authenticated-orcid":false,"given":"Peter","family":"Christen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6503-0302","authenticated-orcid":false,"given":"Nishadi","family":"Kirielle","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,3,15]]},"reference":[{"key":"5964_CR1","doi-asserted-by":"publisher","DOI":"10.1002\/9781119146841","volume-title":"Fraud analytics using descriptive, predictive, and social network techniques: A guide to data science for fraud detection","author":"B Baesens","year":"2015","unstructured":"Baesens, B., Van Vlasselaer, V., & Verbeke, W. (2015). Fraud analytics using descriptive, predictive, and social network techniques: A guide to data science for fraud detection. New York: Wiley."},{"key":"5964_CR2","unstructured":"Boyd, K., Eng, K. H., & Page, C. D. (2013). Area under the precision\u2013recall curve: Point estimates and confidence intervals. In Joint European conference on machine learning and knowledge discovery in databases, Prague (pp. 451\u2013466)."},{"issue":"1","key":"5964_CR3","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1186\/s12864-019-6413-7","volume":"21","author":"D Chicco","year":"2020","unstructured":"Chicco, D., & Jurman, G. (2020). The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation. BMC Genomics, 21(1), 6.","journal-title":"BMC Genomics"},{"key":"5964_CR4","doi-asserted-by":"crossref","unstructured":"Davis, J., & Goadrich, M. (2006). The relationship between precision\u2013recall and ROC curves. In International conference on machine learning, Pittsburgh (pp. 233\u2013240).","DOI":"10.1145\/1143844.1143874"},{"issue":"Jan","key":"5964_CR5","first-page":"1","volume":"7","author":"J Dem\u0161ar","year":"2006","unstructured":"Dem\u0161ar, J. (2006). Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, 7(Jan), 1\u201330.","journal-title":"Journal of Machine Learning Research"},{"key":"5964_CR6","volume-title":"An introduction to numerical taxonomy","author":"G Dunn","year":"1982","unstructured":"Dunn, G., & Everitt, B. (1982). An introduction to numerical taxonomy. Cambridge: Cambridge University Press."},{"issue":"1","key":"5964_CR7","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1016\/j.patrec.2008.08.010","volume":"30","author":"C Ferri","year":"2009","unstructured":"Ferri, C., Hern\u00e1ndez-Orallo, J., & Modroiu, R. (2009). An experimental comparison of performance measures for classification. Pattern Recognition Letters, 30(1), 27\u201338.","journal-title":"Pattern Recognition Letters"},{"key":"5964_CR8","unstructured":"Flach, P., & Kull, M. (2015). Precision\u2013recall\u2013gain curves: PR analysis done right. In Advances in Neural Information Processing Systems, Montreal (Vol. 28, pp. 838\u2013846). Neural Information Processing Systems Foundation."},{"key":"5964_CR9","doi-asserted-by":"crossref","unstructured":"Goutte, C., & Gaussier, E. (2005). A probabilistic interpretation of precision, recall and F-score, with implication for evaluation. In European conference on information retrieval (pp. 345\u2013359). Santiago de Compostela.","DOI":"10.1007\/978-3-540-31865-1_25"},{"issue":"1","key":"5964_CR10","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1007\/s10994-009-5119-5","volume":"77","author":"DJ Hand","year":"2009","unstructured":"Hand, D. J. (2009). Measuring classifier performance: A coherent alternative to the area under the ROC curve. Machine Learning, 77(1), 103\u2013123.","journal-title":"Machine Learning"},{"issue":"3","key":"5964_CR11","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1111\/j.1751-5823.2012.00183.x","volume":"80","author":"DJ Hand","year":"2012","unstructured":"Hand, D. J. (2012). Assessing the performance of classification methods. International Statistical Review, 80(3), 400\u2013414.","journal-title":"International Statistical Review"},{"key":"5964_CR12","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1016\/j.patrec.2013.12.011","volume":"40","author":"DJ Hand","year":"2014","unstructured":"Hand, D. J., & Anagnostopoulos, C. (2014). A better Beta for the H-measure of classification performance. Pattern Recognition Letters, 40, 41\u201346.","journal-title":"Pattern Recognition Letters"},{"issue":"3","key":"5964_CR13","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1007\/s11222-017-9746-6","volume":"28","author":"DJ Hand","year":"2018","unstructured":"Hand, D. J., & Christen, P. (2018). A note on using the F-measure for evaluating record linkage algorithms. Statistics and Computing, 28(3), 539\u2013547.","journal-title":"Statistics and Computing"},{"key":"5964_CR14","first-page":"223","volume":"44","author":"P Jaccard","year":"1908","unstructured":"Jaccard, P. (1908). Nouvelles recherches sur la distribution florale. Bulletin de la Soci\u00e9t\u00e9 Vaudoise des Sciences Naturelles, 44, 223\u2013270.","journal-title":"Bulletin de la Soci\u00e9t\u00e9 Vaudoise des Sciences Naturelles"},{"key":"5964_CR15","unstructured":"Lichman M. (2013). UCI Machine learning repository. Retrieved November 3, 2020, from\u00a0https:\/\/archive.ics.uci.edu\/ml."},{"issue":"Oct","key":"5964_CR16","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., et al. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12(Oct), 2825\u20132830.","journal-title":"Journal of Machine Learning Research"},{"issue":"1","key":"5964_CR17","first-page":"37","volume":"2","author":"DMW Powers","year":"2011","unstructured":"Powers, D. M. W. (2011). Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation. International Journal of Machine Learning Technology, 2(1), 37\u201363.","journal-title":"International Journal of Machine Learning Technology"},{"issue":"4","key":"5964_CR18","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1016\/j.ipm.2009.03.002","volume":"45","author":"M Sokolova","year":"2009","unstructured":"Sokolova, M., & Lapalme, G. (2009). A systematic analysis of performance measures for classification tasks. Information Processing and Management, 45(4), 427\u2013437.","journal-title":"Information Processing and Management"},{"key":"5964_CR19","unstructured":"Stack Exchange. (2013). https:\/\/stats.stackexchange.com\/questions\/49226\/how-to-interpret-fmeasure-values."},{"key":"5964_CR20","volume-title":"Information retrieval","author":"CJ Van Rijsbergen","year":"1979","unstructured":"Van Rijsbergen, C. J. (1979). Information retrieval. London: Butterworth and Co."}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-021-05964-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10994-021-05964-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-021-05964-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,23]],"date-time":"2021-03-23T17:10:15Z","timestamp":1616519415000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10994-021-05964-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3]]},"references-count":20,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,3]]}},"alternative-id":["5964"],"URL":"https:\/\/doi.org\/10.1007\/s10994-021-05964-1","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3]]},"assertion":[{"value":"12 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 November 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 November 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 March 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}