{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,29]],"date-time":"2026-08-29T17:26:31Z","timestamp":1788024391142,"version":"build-2784847793"},"reference-count":49,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2021,2,24]],"date-time":"2021-02-24T00:00:00Z","timestamp":1614124800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100008914","name":"Ontario Brain Institute","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100008914","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000024","name":"Canadian Institutes of Health Research","doi-asserted-by":"publisher","award":["MOP201403"],"award-info":[{"award-number":["MOP201403"]}],"id":[{"id":"10.13039\/501100000024","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100017562","name":"Temerty Family Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100017562","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100016468","name":"Bruy\u00e8re Research Institute","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100016468","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010523","name":"Centre for Addiction and Mental Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100010523","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006127","name":"Faculty of Health Sciences, Queen's University","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100006127","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100008459","name":"University of Calgary","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100008459","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005247","name":"University of British Columbia","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100005247","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychiatry"],"abstract":"<jats:p>With improvements to both scan quality and facial recognition software, there is an increased risk of participants being identified by a 3D render of their structural neuroimaging scans, even when all other personal information has been removed. To prevent this, facial features should be removed before data are shared or openly released, but while there are several publicly available software algorithms to do this, there has been no comprehensive review of their accuracy within the general population. To address this, we tested multiple algorithms on 300 scans from three neuroscience research projects, funded in part by the Ontario Brain Institute, to cover a wide range of ages (3\u201385 years) and multiple patient cohorts. While skull stripping is more thorough at removing identifiable features, we focused mainly on defacing software, as skull stripping also removes potentially useful information, which may be required for future analyses. We tested six publicly available algorithms (afni_refacer, deepdefacer, mri_deface, mridefacer, pydeface, quickshear), with one skull stripper (FreeSurfer) included for comparison. Accuracy was measured through a pass\/fail system with two criteria; one, that all facial features had been removed and two, that no brain tissue was removed in the process. A subset of defaced scans were also run through several preprocessing pipelines to ensure that none of the algorithms would alter the resulting outputs. We found that the success rates varied strongly between defacers, with afni_refacer (89%) and pydeface (83%) having the highest rates, overall. In both cases, the primary source of failure came from a single dataset that the defacer appeared to struggle with - the youngest cohort (3\u201320 years) for afni_refacer and the oldest (44\u201385 years) for pydeface, demonstrating that defacer performance not only depends on the data provided, but that this effect varies between algorithms. While there were some very minor differences between the preprocessing results for defaced and original scans, none of these were significant and were within the range of variation between using different NIfTI converters, or using raw DICOM files.<\/jats:p>","DOI":"10.3389\/fpsyt.2021.617997","type":"journal-article","created":{"date-parts":[[2021,2,24]],"date-time":"2021-02-24T00:58:20Z","timestamp":1614128300000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":50,"title":["Multisite Comparison of MRI Defacing Software Across Multiple Cohorts"],"prefix":"10.3389","volume":"12","author":[{"given":"Athena E.","family":"Theyers","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mojdeh","family":"Zamyadi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark","family":"O'Reilly","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Bartha","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sean","family":"Symons","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Glenda M.","family":"MacQueen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefanie","family":"Hassel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason P.","family":"Lerch","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Evdokia","family":"Anagnostou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raymond W.","family":"Lam","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benicio N.","family":"Frey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roumen","family":"Milev","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel J.","family":"M\u00fcller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sidney H.","family":"Kennedy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher J. M.","family":"Scott","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephen C.","family":"Strother","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephen R.","family":"Arnott","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2021,2,24]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1684","DOI":"10.1056\/NEJMc1908881","article-title":"Identification of anonymous MRI research participants with face-recognition software","volume":"381","author":"Schwarz","year":"2019","journal-title":"N Engl J Med."},{"key":"B2","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1007\/s10278-011-9429-3","article-title":"Facial recognition software success rates for the identification of 3D surface reconstructed facial images: implications for patient privacy and security","volume":"25","author":"Mazura","year":"2012","journal-title":"J Digit Imaging."},{"key":"B3","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1016\/j.artd.2018.10.001","article-title":"Patients, pictures, and privacy: managing clinical photographs in the smartphone era","volume":"5","author":"Nettrour","year":"2019","journal-title":"Arthroplast Today."},{"key":"B4","doi-asserted-by":"publisher","first-page":"S625","DOI":"10.1016\/s1053-8119(00)91555-6","article-title":"Robust automated brain extraction","volume":"11","author":"Smith","year":"2000","journal-title":"NeuroImage."},{"key":"B5","doi-asserted-by":"publisher","first-page":"1617","DOI":"10.1109\/TMI.2011.2138152","article-title":"Robust brain extraction across datasets and comparison with publicly available methods","volume":"30","author":"Iglesias","year":"2011","journal-title":"IEEE Trans Med Imaging."},{"key":"B6","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1006\/cbmr.1996.0014","article-title":"AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages","volume":"29","author":"Cox","year":"1996","journal-title":"Comput Biomed Res."},{"key":"B7","doi-asserted-by":"publisher","first-page":"856","DOI":"10.1006\/nimg.2000.0730","article-title":"Magnetic resonance image tissue classification using a partial volume model","volume":"13","author":"Shattuck","year":"2001","journal-title":"NeuroImage."},{"key":"B8","doi-asserted-by":"publisher","first-page":"2033","DOI":"10.1016\/j.neuroimage.2010.09.025","article-title":"A reproducible evaluation of ANTs similarity metric performance in brain image registration","volume":"54","author":"Avants","year":"2011","journal-title":"Neuroimage."},{"key":"B9","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1016\/j.neuroimage.2012.01.021","article-title":"FreeSurfer","volume":"62","author":"Fischl","year":"2012","journal-title":"NeuroImage"},{"key":"B10","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1007\/s10278-015-9847-8","article-title":"Methods on skull stripping of MRI head scan images\u2014a review","volume":"29","author":"Kalavathi","year":"2016","journal-title":"J Digital Imaging."},{"key":"B11","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1109\/memb.2006.1657787","article-title":"Integration of EEG\/MEG with MRI and fMRI","volume":"25","author":"Liu","year":"2006","journal-title":"IEEE Eng Med Biol Mag."},{"key":"B12","doi-asserted-by":"publisher","first-page":"1225","DOI":"10.1016\/j.neuroimage.2007.03.066","article-title":"The advantage of combining MEG and EEG: comparison to fMRI in focally stimulated visual cortex","volume":"36","author":"Sharon","year":"2007","journal-title":"Neuroimage."},{"key":"B13","doi-asserted-by":"publisher","first-page":"892","DOI":"10.1002\/hbm.20312","article-title":"A technique for the deidentification of structural brain MR images","volume":"28","author":"Bischoff-Grethe","year":"2007","journal-title":"Hum Brain Mapp."},{"key":"B14","doi-asserted-by":"publisher","first-page":"1450","DOI":"10.3174\/ajnr.A4299","article-title":"How does the accuracy of intracranial volume measurements affect normalized brain volumes? Sample size estimates based on 966 subjects from the HUNT MRI cohort","volume":"36","author":"Hansen","year":"2015","journal-title":"AJNR Am J Neuroradiol."},{"key":"B15","doi-asserted-by":"publisher","first-page":"439","DOI":"10.3389\/fnins.2016.00439","article-title":"Inter-method discrepancies in brain volume estimation may drive inconsistent findings in autism","volume":"10","author":"Katuwal","year":"2016","journal-title":"Front Neurosci."},{"key":"B16","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1016\/j.neuroimage.2017.10.034","article-title":"Image processing and quality control for the first 10,000 brain imaging datasets from UK Biobank","volume":"166","author":"Alfaro-Almagro","year":"2018","journal-title":"Neuroimage."},{"key":"B17","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1016\/j.neuroimage.2013.05.041","article-title":"The WU-Minn Human Connectome Project: an overview","volume":"80","author":"Van Essen","year":"2013","journal-title":"Neuroimage."},{"key":"B18","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1016\/j.media.2007.10.008","article-title":"Preventing facial recognition when rendering MR images of the head in three dimensions","volume":"12","author":"Budin","year":"2008","journal-title":"Med Image Anal."},{"key":"B19","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1007\/s12021-012-9160-3","article-title":"Obscuring surface anatomy in volumetric imaging data","volume":"11","author":"Milchenko","year":"2013","journal-title":"Neuroinformatics."},{"key":"B20","doi-asserted-by":"crossref","DOI":"10.1109\/ISBI.2019.8759515","article-title":"Refacing: reconstructing anonymized facial features using gans","volume-title":"IEEE International Symposium on Biomedical Imaging","author":"Abramian","year":"2019"},{"key":"B21","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1007\/978-3-642-22348-8_26","article-title":"Preserving privacy in structural neuroimages","volume-title":"Data and Applications Security and Privacy XXV Lecture Notes in Computer Science","author":"Schimke","year":"2011"},{"key":"B22","article-title":"DeepDefacer: automatic removal of facial features from MR scans via U-net image segmentation","author":"Khazane","year":"2019","journal-title":"arXiv."},{"key":"B23","volume-title":"poldracklab\/pydeface: v2.0.0 (Version v2.0.0)","author":"Gulban","year":"2019"},{"key":"B24","doi-asserted-by":"publisher","first-page":"63","DOI":"10.4018\/jcmam.2012040104","article-title":"Systematic redaction for neuroimage data","volume":"3","author":"Matlock","year":"2012","journal-title":"Int J Comput Models Algorithms Med."},{"key":"B25","doi-asserted-by":"publisher","first-page":"683","DOI":"10.1017\/cjn.2014.36","article-title":"The Ontario Brain Institute: completing the circle","volume":"41","author":"Stuss","year":"2014","journal-title":"Can J Neurol Sci."},{"key":"B26","doi-asserted-by":"publisher","first-page":"28","DOI":"10.3389\/fninf.2018.00028","article-title":"Brain-CODE: a secure neuroinformatics platform for management, federation, sharing and analysis of multi-dimensional neuroscience data","volume":"12","author":"Vaccarino","year":"2018","journal-title":"Front Neuroinform."},{"key":"B27","doi-asserted-by":"publisher","first-page":"191","DOI":"10.3389\/fgene.2019.00191","article-title":"Big data needs big governance: best practices from brain-CODE, the Ontario-Brain Institute's Neuroinformatics platform","volume":"10","author":"Lefaivre","year":"2019","journal-title":"Front Genet."},{"key":"B28","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1017\/cjn.2016.415","article-title":"The Ontario neurodegenerative disease research initiative (ONDRI)","volume":"44","author":"Farhan","year":"2017","journal-title":"Can J Neurol Sci."},{"key":"B29","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1186\/s12888-016-0785-x","article-title":"Discovering biomarkers for antidepressant response: protocol from the Canadian biomarker integration network in depression (CAN-BIND) and clinical characteristics of the first patient cohort","volume":"16","author":"Lam","year":"2016","journal-title":"BMC Psychiatry."},{"key":"B30","doi-asserted-by":"publisher","first-page":"18m12202","DOI":"10.4088\/JCP.18m12202","article-title":"Symptomatic and functional outcomes and early prediction of response to escitalopram monotherapy and sequential adjunctive aripiprazole therapy in patients with major depressive disorder: a CAN-BIND-1 Report","volume":"80","author":"Kennedy","year":"2019","journal-title":"J Clin Psychiatry."},{"key":"B31","doi-asserted-by":"publisher","first-page":"1213","DOI":"10.1176\/appi.ajp.2016.15111435","article-title":"A diffusion tensor imaging study in children with ADHD, autism spectrum disorder, OCD, and matched controls: distinct and non-distinct white matter disruption and dimensional brain-behavior relationships","volume":"173","author":"Ameis","year":"2016","journal-title":"Am J Psychiatry."},{"key":"B32","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1038\/s41398-019-0382-0","article-title":"Structural neuroimaging correlates of social deficits are similar in autism spectrum disorder and attention-deficit\/hyperactivity disorder: analysis from the POND Network","volume":"9","author":"Baribeau","year":"2019","journal-title":"Transl Psychiatry."},{"key":"B33","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1503\/jpn.180036","article-title":"The Canadian Biomarker Integration Network in Depression (CAN-BIND): magnetic resonance imaging protocols","volume":"44","author":"MacQueen","year":"2019","journal-title":"J Psychiatry Neurosci."},{"key":"B34","unstructured":"LancasterJL\n            MartinezMJ\n          Multi-image Analysis GUI (Mango)2015"},{"key":"B35","unstructured":"KroonD-J\n          Viewer3D2016"},{"key":"B36","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1177\/001316448104100307","article-title":"Coefficient kappa: some uses, misuses, and alternatives","volume":"41","author":"Brennan","year":"1981","journal-title":"Educ. Psychol. Measur."},{"key":"B37","article-title":"Free-marginal multirater kappa: an alternative to Fleiss' fixed-marginal multirater kappa","volume-title":"Joensuu University Learning and Instruction Symposium 2005","author":"Randolph","year":"2005"},{"key":"B38","unstructured":"BradskiG\n          The OpenCV Library2000"},{"key":"B39","volume-title":"Python 3 Reference Manual: (Python Documentation Manual Part 2)","author":"Van Rossum","year":"2009"},{"key":"B40","doi-asserted-by":"publisher","first-page":"847","DOI":"10.1101\/2019.12.13.875823","article-title":"Ontario neurodegenerative disease research initiative (ONDRI): structural MRI methods & outcome measures","volume":"11","author":"Ramirez","year":"2019","journal-title":"bioRxiv"},{"key":"B41","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1016\/j.jneumeth.2016.03.001","article-title":"The first step for neuroimaging data analysis: DICOM to NIfTI conversion","volume":"264","author":"Li","year":"2016","journal-title":"J Neurosci Methods."},{"key":"B42","unstructured":"IcometrixNV\n          dicom2nifti2017"},{"key":"B43","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1002\/hbm.21238","article-title":"Optimizing preprocessing and analysis pipelines for single-subject fMRI. I. Standard temporal motion and physiological noise correction methods","volume":"33","author":"Churchill","year":"2012","journal-title":"Hum Brain Mapp."},{"key":"B44","doi-asserted-by":"publisher","first-page":"e31147","DOI":"10.1371\/journal.pone.0031147","article-title":"Optimizing preprocessing and analysis pipelines for single-subject fMRI: 2. Interactions with ICA, PCA, task contrast and inter-subject heterogeneity","volume":"7","author":"Churchill","year":"2012","journal-title":"PLoS ONE."},{"key":"B45","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1016\/j.neuroimage.2014.01.060","article-title":"Permutation inference for the general linear model","volume":"92","author":"Winkler","year":"2014","journal-title":"Neuroimage."},{"key":"B46","doi-asserted-by":"publisher","first-page":"825","DOI":"10.1016\/s1053-8119(02)91132-8","article-title":"Improved optimization for the robust and accurate linear registration and motion correction of brain images","volume":"17","author":"Jenkinson","year":"2002","journal-title":"NeuroImage."},{"key":"B47","volume-title":"mwaskom\/seaborn: v0.10.0 (January 2020) (Version v0.10.0)","author":"Waskom","year":"2020"},{"key":"B48","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-98141-3","volume-title":"ggplot2: Elegant Graphics for Data Analysis","author":"Wickham","year":"2009"},{"key":"B49","unstructured":"R: A Language and Environment for Statistical Computing2020"}],"container-title":["Frontiers in Psychiatry"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2021.617997\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T16:03:08Z","timestamp":1773331388000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2021.617997\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,24]]},"references-count":49,"alternative-id":["10.3389\/fpsyt.2021.617997"],"URL":"https:\/\/doi.org\/10.3389\/fpsyt.2021.617997","relation":{},"ISSN":["1664-0640"],"issn-type":[{"value":"1664-0640","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,24]]},"article-number":"617997"}}