{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,2]],"date-time":"2025-03-02T05:40:18Z","timestamp":1740894018898,"version":"3.38.0"},"reference-count":30,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2017,12,1]],"date-time":"2017-12-01T00:00:00Z","timestamp":1512086400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Stat Methods Med Res"],"published-print":{"date-parts":[[2017,12]]},"abstract":"<jats:p> A fundamental question that often occurs in statistical tests is the normality of distributions. Countless distributions exist in science and life, but one distribution that is obtained via permutations, usually referred to as permutation distribution, is interesting. Although a permutation distribution should behave in accord with the central limit theorem, if both the independence condition and the identical distribution condition are fulfilled, no studies have corroborated this concurrence in functional magnetic resonance imaging data. In this work, we used Anderson\u2013Darling test to evaluate the accordance level of permutation distributions of classification accuracies to normality expected under central limit theorem. A simulation study has been carried out using functional magnetic resonance imaging data collected, while human subjects responded to visual stimulation paradigms. Two scrambling schemes are evaluated: the first based on permuting both the training and the testing sets and the second on permuting only the testing set. The results showed that, while a normal distribution does not adequately fit to permutation distributions most of the times, it tends to be quite well acceptable when mean classification accuracies averaged over a set of different classifiers is considered. The results also showed that permutation distributions can be probabilistically affected by performing motion correction to functional magnetic resonance imaging data, and thus may weaken the approximation of permutation distributions to a normal law. Such findings, however, have no relation to univariate\/univoxel analysis of functional magnetic resonance imaging data. Overall, the results revealed a strong dependence across the folds of cross-validation and across functional magnetic resonance imaging runs and that may hinder the reliability of using cross-validation. The obtained p-values and the drawn confidence level intervals exhibited beyond doubt that different permutation schemes may beget different permutation distributions as well as different levels of accord with central limit theorem. We also found that different permutation schemes can lead to different permutation distributions and that may lead to different assessment of the statistical significance of classification accuracy. <\/jats:p>","DOI":"10.1177\/0962280215601707","type":"journal-article","created":{"date-parts":[[2017,12,18]],"date-time":"2017-12-18T12:16:25Z","timestamp":1513599385000},"page":"2567-2585","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1,"title":["Permutations of functional magnetic resonance imaging classification may not be normally distributed"],"prefix":"10.1177","volume":"26","author":[{"given":"Mohammed S","family":"Al-Rawi","sequence":"first","affiliation":[{"name":"The Institute of Nuclear Sciences Applied to Health, University of Coimbra, Coimbra, Portugal"},{"name":"Visual Neuroscience Laboratory, IBILI \u2013 Institute for Biomedical Imaging and Life Sciences, Faculty of Medicine, University of Coimbra, Coimbra, Portugal"}]},{"given":"Adelaide","family":"Freitas","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Center for Research & Development in Mathematics and Applications, University of Aveiro, Aveiro, Portugal"}]},{"given":"Jo\u00e3o V","family":"Duarte","sequence":"additional","affiliation":[{"name":"Visual Neuroscience Laboratory, IBILI \u2013 Institute for Biomedical Imaging and Life Sciences, Faculty of Medicine, University of Coimbra, Coimbra, Portugal"}]},{"given":"Joao P","family":"Cunha","sequence":"additional","affiliation":[{"name":"IEETA, University of Aveiro, Aveiro, Portugal"},{"name":"Department of Electrical and Computer Engineering, University of Porto, Porto, Portugal"}]},{"given":"Miguel","family":"Castelo-Branco","sequence":"additional","affiliation":[{"name":"The Institute of Nuclear Sciences Applied to Health, University of Coimbra, Coimbra, Portugal"},{"name":"Visual Neuroscience Laboratory, IBILI \u2013 Institute for Biomedical Imaging and Life Sciences, Faculty of Medicine, University of Coimbra, Coimbra, Portugal"}]}],"member":"179","published-online":{"date-parts":[[2017,12,18]]},"reference":[{"key":"bibr1-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1126\/science.1063736"},{"key":"bibr2-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1016\/j.brainres.2009.05.090"},{"key":"bibr3-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1162\/jocn.2003.15.5.704"},{"key":"bibr4-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2008.11.007"},{"key":"bibr5-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2013.02.057"},{"key":"bibr6-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2012.09.063"},{"key":"bibr7-0962280215601707","unstructured":"Fisher RA. Statistical methods for research workers. Edinburgh: Oliver and Boyd, 1954."},{"key":"bibr8-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.1058"},{"key":"bibr9-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1007\/11503415_34"},{"key":"bibr10-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1016\/j.nicl.2014.04.004"},{"key":"bibr11-0962280215601707","first-page":"1833","volume":"11","author":"Ojala M","year":"2010","journal-title":"J Mach Learn Res"},{"key":"bibr12-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2011.11.007"},{"key":"bibr13-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177729437"},{"key":"bibr14-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1954.10501232"},{"key":"bibr15-0962280215601707","unstructured":"D\u2019Agostino RB. Tests for the normal distribution. In: Ralph B, Agostino D' and Stephens MA (eds) Goodness-of-fit techniques. New York: Marcel Dekker, 1986, pp. 367\u2013413."},{"key":"bibr16-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1974.10480196"},{"key":"bibr17-0962280215601707","unstructured":"Rice JA. Mathematical statistics and data analysis. 2nd ed. Belmont, CA: Wadsworth Publishing Co Inc, 1994."},{"key":"bibr18-0962280215601707","unstructured":"Billingsley, P. Probability and measure New York John Wiley & Sons."},{"key":"bibr19-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-45087-0_28"},{"key":"bibr20-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btq399"},{"key":"bibr21-0962280215601707","unstructured":"Pfeiffer PE. Concepts of probability theory. New York: Dover Publications, 1978."},{"key":"bibr22-0962280215601707","doi-asserted-by":"crossref","unstructured":"NETLAB. Netlab neural network software, www1.aston.ac.uk\/eas\/research\/groups\/ncrg\/resources\/netlab\/ (accessed 1 August 2015).","DOI":"10.1109\/INVENTIVE.2016.7830192"},{"key":"bibr23-0962280215601707","unstructured":"Joachims T. SVM light, www.cs.cornell.edu\/people\/tj\/svm_light\/svm_multiclass.html (accessed 1 August 2015)."},{"key":"bibr24-0962280215601707","first-page":"169","volume-title":"In: Bernhard Sch\u00f6lkopf, Christopher JC Burges, Alexander J Smola (eds) Advances in Kernel Methods","author":"Joachims T","year":"1999"},{"key":"bibr25-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2006.07.005"},{"key":"bibr26-0962280215601707","unstructured":"Princeton Multi-Voxel Pattern Analysis (MVPA) Toolbox, www.csbmb.princeton.edu\/mvpa\/ (accessed 1 August 2015)."},{"key":"bibr27-0962280215601707","unstructured":"SPM8. Statistical parametric mapping, www.fil.ion.ucl.ac.uk\/spm\/ (accessed 1 August 2015)."},{"key":"bibr28-0962280215601707","doi-asserted-by":"crossref","unstructured":"Etzel JA and Braver TS. MVPA permutation schemes permutation testing in the land of cross-validation. In: 2013 3rd International workshop on pattern recognition in neuroimaging. Philadelphia: IEEE publications, 2013, pp.140\u2013143.","DOI":"10.1109\/PRNI.2013.44"},{"key":"bibr29-0962280215601707","unstructured":"Haxby et\u00a0al. Faces and objects in ventral temporal cortex (fMRI), http:\/\/dev.pymvpa.org\/datadb\/haxby2001.html (accessed 1 August 2015)."},{"key":"bibr30-0962280215601707","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2010.08.050"}],"container-title":["Statistical Methods in Medical Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0962280215601707","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0962280215601707","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0962280215601707","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,1]],"date-time":"2025-03-01T11:43:02Z","timestamp":1740829382000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0962280215601707"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,12]]},"references-count":30,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2017,12]]}},"alternative-id":["10.1177\/0962280215601707"],"URL":"https:\/\/doi.org\/10.1177\/0962280215601707","relation":{},"ISSN":["0962-2802","1477-0334"],"issn-type":[{"type":"print","value":"0962-2802"},{"type":"electronic","value":"1477-0334"}],"subject":[],"published":{"date-parts":[[2017,12]]}}}