{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,22]],"date-time":"2026-02-22T19:27:08Z","timestamp":1771788428840,"version":"3.50.1"},"reference-count":12,"publisher":"MIT Press - Journals","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2014,1]]},"abstract":"<jats:p> In the research of machine learning algorithms for classification tasks, the comparison of the performances of algorithms is extremely important, and a statistical test of significance for generalization error is often used to perform it in the machine learning literature. In view of the randomness of partitions in cross-validation, a new blocked 3\u00d72 cross-validation is proposed to estimate generalization error in this letter. We then conduct an analysis of variance of the blocked 3\u00d72 cross-validated estimator. A relatively conservative variance estimator that considers the correlation between any two two-fold cross-validations, and was previously neglected in 5\u00d72 cross-validated t and F-tests is put forward. A corresponding test using this variance estimator is presented to compare the performances of algorithms. Simulated results show that the performance of our test is comparable with that of 5\u00d72 cross-validated tests but with less computation complexity. <\/jats:p>","DOI":"10.1162\/neco_a_00532","type":"journal-article","created":{"date-parts":[[2013,10,8]],"date-time":"2013-10-08T15:42:59Z","timestamp":1381246979000},"page":"208-235","source":"Crossref","is-referenced-by-count":23,"title":["Blocked 3\u00d72 Cross-Validated <i>t<\/i>-Test for Comparing Supervised Classification Learning Algorithms"],"prefix":"10.1162","volume":"26","author":[{"given":"Wang","family":"Yu","sequence":"first","affiliation":[{"name":"Computer Center of Shanxi University, Taiyuan 030006, P.R.C."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wang","family":"Ruibo","sequence":"additional","affiliation":[{"name":"Computer Center of Shanxi University, Taiyuan 030006, P.R.C."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jia","family":"Huichen","sequence":"additional","affiliation":[{"name":"School of Mathematical Sciences, Shanxi University, Taiyuan 030006, P.R.C."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Li","family":"Jihong","sequence":"additional","affiliation":[{"name":"Computer Center of Shanxi University, Taiyuan 030006, P.R.C"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1162\/089976699300016007"},{"key":"B2","volume-title":"Introduction to machine learning","author":"Alpaydin E.","year":"2010","edition":"2"},{"key":"B3","first-page":"1089","volume":"5","author":"Bengio Y.","year":"2004","journal-title":"Journal of Machine Learning Research"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-24775-3_3"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2011.12.024"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1162\/089976698300017197"},{"key":"B8","volume-title":"Hypothesis testing for cross-validation","author":"Grandvalet Y.","year":"2006"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.3724\/SP.J.1001.2010.03756"},{"key":"B11","first-page":"1127","volume":"6","author":"Markatou M.","year":"2005","journal-title":"Journal of Machine Learning Research"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1023\/A:1024068626366"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1145\/312624.312647"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2012.155"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/NECO_a_00532","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:40:08Z","timestamp":1615585208000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/26\/1\/208-235\/7938"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,1]]},"references-count":12,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2014,1]]}},"alternative-id":["10.1162\/NECO_a_00532"],"URL":"https:\/\/doi.org\/10.1162\/neco_a_00532","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,1]]}}}