{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,11]],"date-time":"2026-02-11T14:04:20Z","timestamp":1770818660969,"version":"3.50.1"},"reference-count":48,"publisher":"Wiley","issue":"2","license":[{"start":{"date-parts":[[2024,3,19]],"date-time":"2024-03-19T00:00:00Z","timestamp":1710806400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010349","name":"Linacre College, University of Oxford","doi-asserted-by":"publisher","award":["220204\/Z\/20\/Z"],"award-info":[{"award-number":["220204\/Z\/20\/Z"]}],"id":[{"id":"10.13039\/100010349","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006417","name":"Fundo de Apoio ao Ensino, \u00e0 Pesquisa e Extens\u00e3o, Universidade Estadual de Campinas","doi-asserted-by":"publisher","award":["2589\/23"],"award-info":[{"award-number":["2589\/23"]}],"id":[{"id":"10.13039\/501100006417","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001826","name":"ZonMw","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001826","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["Sir Henry Dale Fellowship 220204\/Z\/20\/Z"],"award-info":[{"award-number":["Sir Henry Dale Fellowship 220204\/Z\/20\/Z"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001807","name":"Funda\u00e7\u00e3o de Amparo \u00e0 Pesquisa do Estado de S\u00e3o Paulo","doi-asserted-by":"publisher","award":["2022\/06496\u20107"],"award-info":[{"award-number":["2022\/06496\u20107"]}],"id":[{"id":"10.13039\/501100001807","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100013405","name":"Rijksdienst voor Ondernemend Nederland","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100013405","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100002129","name":"THF","doi-asserted-by":"publisher","award":["03\u2010004\u20102020\u2010T049"],"award-info":[{"award-number":["03\u2010004\u20102020\u2010T049"]}],"id":[{"id":"10.13039\/100002129","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["PTDC\/EMD\/EMD\/29686\/2017"],"award-info":[{"award-number":["PTDC\/EMD\/EMD\/29686\/2017"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["SFRH\/BD\/120006\/2016"],"award-info":[{"award-number":["SFRH\/BD\/120006\/2016"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["DOI: 10.54499\/LA\/P\/0083\/2020"],"award-info":[{"award-number":["DOI: 10.54499\/LA\/P\/0083\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["10.54499\/UIDP\/50009\/2020"],"award-info":[{"award-number":["10.54499\/UIDP\/50009\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["10.54499\/UIDB\/50009\/2020"],"award-info":[{"award-number":["10.54499\/UIDB\/50009\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010434","name":"Caixa Foundation","doi-asserted-by":"publisher","award":["LCF\/PR\/HP22\/0053"],"award-info":[{"award-number":["LCF\/PR\/HP22\/0053"]}],"id":[{"id":"10.13039\/100010434","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Magnetic Resonance in Med"],"published-print":{"date-parts":[[2024,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Purpose<\/jats:title><jats:p>Arterial spin labeling (ASL) is a widely used contrast\u2010free MRI method for assessing cerebral blood flow (CBF). Despite the generally adopted ASL acquisition guidelines, there is still wide variability in ASL analysis. We explored this variability through the ISMRM\u2010OSIPI ASL\u2010MRI Challenge, aiming to establish best practices for more reproducible ASL analysis.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>Eight teams analyzed the challenge data, which included a high\u2010resolution T1\u2010weighted anatomical image and 10 pseudo\u2010continuous ASL datasets simulated using a digital reference object to generate ground\u2010truth CBF values in normal and pathological states. We compared the accuracy of CBF quantification from each team's analysis to the ground truth across all voxels and within predefined brain regions. Reproducibility of CBF across analysis pipelines was assessed using the intra\u2010class correlation coefficient (ICC), limits of agreement (LOA), and replicability of generating similar CBF estimates from different processing approaches.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Absolute errors in CBF estimates compared to ground\u2010truth synthetic data ranged from 18.36 to 48.12\u2009mL\/100\u2009g\/min. Realistic motion incorporated into three datasets produced the largest absolute error and variability between teams, with the least agreement (ICC and LOA) with ground\u2010truth results. Fifty percent of the submissions were replicated, and one produced three times larger CBF errors (46.59\u2009mL\/100\u2009g\/min) compared to submitted results.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Variability in CBF measurements, influenced by differences in image processing, especially to compensate for motion, highlights the significance of standardizing ASL analysis workflows. We provide a recommendation for ASL processing based on top\u2010performing approaches as a step toward ASL standardization.<\/jats:p><\/jats:sec>","DOI":"10.1002\/mrm.30081","type":"journal-article","created":{"date-parts":[[2024,3,19]],"date-time":"2024-03-19T15:11:52Z","timestamp":1710861112000},"page":"836-852","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Reproducibility of arterial spin labeling cerebral blood flow image processing: A report of the ISMRM open science initiative for perfusion imaging (OSIPI) and the ASL MRI challenge"],"prefix":"10.1002","volume":"92","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8269-711X","authenticated-orcid":false,"given":"Andre M.","family":"Paschoal","sequence":"first","affiliation":[{"name":"Institute of Physics, University of Campinas   Campinas Brazil"},{"name":"LIM44, Institute of Radiology, Department of Radiology and Oncology of Clinical Hospital University of Sao Paulo  Sao Paulo Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0329-824X","authenticated-orcid":false,"given":"Joseph G.","family":"Woods","sequence":"additional","affiliation":[{"name":"Wellcome Centre for Integrative Neuroimaging University of Oxford  Oxford UK"},{"name":"Department of Radiology, Center for Functional Magnetic Resonance Imaging University of California, San Diego  La Jolla California USA"}]},{"given":"Joana","family":"Pinto","sequence":"additional","affiliation":[{"name":"Institute of Biomedical Engineering, Department of Engineering Science University of Oxford  Oxford UK"}]},{"given":"Esther E.","family":"Bron","sequence":"additional","affiliation":[{"name":"Department of Radiology &amp; Nuclear Medicine Erasmus MC\u2013University Medical Center Rotterdam  Rotterdam the Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3201-6002","authenticated-orcid":false,"given":"Jan","family":"Petr","sequence":"additional","affiliation":[{"name":"Helmholtz\u2010Zentrum Dresden\u2010Rossendorf Institute of Radiopharmaceutical Cancer Research  Dresden Germany"}]},{"given":"Flora A.","family":"Kennedy McConnell","sequence":"additional","affiliation":[{"name":"Radiological Sciences, Division of Clinical Neuroscience, School of Medicine University of Nottingham  Nottingham UK"},{"name":"Sir Peter Mansfield Imaging Centre, School of Medicine University of Nottingham  Nottingham UK"},{"name":"Nottingham Biomedical Research Centre Queens Medical Centre  Nottingham UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8164-8324","authenticated-orcid":false,"given":"Laura","family":"Bell","sequence":"additional","affiliation":[{"name":"Clinical Imaging Group, Genentech, Inc.  South San Francisco California USA"}]},{"given":"Maria\u2010Eleni","family":"Dounavi","sequence":"additional","affiliation":[{"name":"Department of Psychiatry University of Cambridge  Cambridge UK"}]},{"given":"Cassandra Gould","family":"van Praag","sequence":"additional","affiliation":[{"name":"Wellcome Centre for Integrative Neuroimaging University of Oxford  Oxford UK"},{"name":"Department of Psychiatry University of Oxford  Oxford UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0894-0307","authenticated-orcid":false,"given":"Henk J. M. M.","family":"Mutsaerts","sequence":"additional","affiliation":[{"name":"Department of Radiology and Nuclear Medicine Vrije Universiteit Amsterdam, Amsterdam UMC Location VUmc  Amsterdam the Netherlands"},{"name":"Amsterdam Neuroscience, Brain Imaging  Amsterdam the Netherlands"}]},{"given":"Aaron Oliver","family":"Taylor","sequence":"additional","affiliation":[{"name":"Gold Standard Phantoms Limited  London UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0210-7739","authenticated-orcid":false,"given":"Moss Y.","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Radiology Stanford University  Stanford California USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1936-8687","authenticated-orcid":false,"given":"Ir\u00e8ne","family":"Brumer","sequence":"additional","affiliation":[{"name":"Computer Assisted Clinical Medicine, Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim Heidelberg University  Heidelberg Germany"}]},{"given":"Wei Siang Marcus","family":"Chan","sequence":"additional","affiliation":[{"name":"Computer Assisted Clinical Medicine, Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim Heidelberg University  Heidelberg Germany"}]},{"given":"Jack","family":"Toner","sequence":"additional","affiliation":[{"name":"Sir Peter Mansfield Imaging Centre, School of Medicine University of Nottingham  Nottingham UK"},{"name":"Mental Health &amp; Clinical Neurosciences, School of Medicine University of Nottingham  Nottingham UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0946-9617","authenticated-orcid":false,"given":"Jian","family":"Hu","sequence":"additional","affiliation":[{"name":"Sir Peter Mansfield Imaging Centre, School of Medicine University of Nottingham  Nottingham UK"},{"name":"Mental Health &amp; Clinical Neurosciences, School of Medicine University of Nottingham  Nottingham UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1484-3992","authenticated-orcid":false,"given":"Logan X.","family":"Zhang","sequence":"additional","affiliation":[{"name":"Institute of Biomedical Engineering, Department of Engineering Science University of Oxford  Oxford UK"}]},{"given":"Catarina","family":"Domingos","sequence":"additional","affiliation":[{"name":"Institute for Systems and Robotics\u2010Lisboa and Department of Bioengineering Instituto Superior T\u00e9cnico\u2013Universidade de Lisboa  Lisbon Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2530-5535","authenticated-orcid":false,"given":"Sara P.","family":"Monteiro","sequence":"additional","affiliation":[{"name":"Institute for Systems and Robotics\u2010Lisboa and Department of Bioengineering Instituto Superior T\u00e9cnico\u2013Universidade de Lisboa  Lisbon Portugal"}]},{"given":"Patr\u00edcia","family":"Figueiredo","sequence":"additional","affiliation":[{"name":"Institute for Systems and Robotics\u2010Lisboa and Department of Bioengineering Instituto Superior T\u00e9cnico\u2013Universidade de Lisboa  Lisbon Portugal"}]},{"given":"Alexander G. J.","family":"Harms","sequence":"additional","affiliation":[{"name":"Department of Radiology &amp; Nuclear Medicine Erasmus MC\u2013University Medical Center Rotterdam  Rotterdam the Netherlands"}]},{"given":"Beatriz E.","family":"Padrela","sequence":"additional","affiliation":[{"name":"Department of Radiology and Nuclear Medicine Vrije Universiteit Amsterdam, Amsterdam UMC Location VUmc  Amsterdam the Netherlands"},{"name":"Amsterdam Neuroscience, Brain Imaging  Amsterdam the Netherlands"}]},{"given":"Channelle","family":"Tham","sequence":"additional","affiliation":[{"name":"Department of Cognitive Neuroscience Radboud University Medical Center  Nijmegen the Netherlands"}]},{"given":"Ahmed","family":"Abdalle","sequence":"additional","affiliation":[{"name":"Schulich School of Medicine and Dentistry Western University  London Ontario Canada"}]},{"given":"Paula L.","family":"Croal","sequence":"additional","affiliation":[{"name":"Radiological Sciences, Division of Clinical Neuroscience, School of Medicine University of Nottingham  Nottingham UK"},{"name":"Sir Peter Mansfield Imaging Centre, School of Medicine University of Nottingham  Nottingham UK"}]},{"given":"Udunna","family":"Anazodo","sequence":"additional","affiliation":[{"name":"Department of Neurology and Neurosurgery, Montreal Neurological Institute McGill University  Montreal Qu\u00e9bec Canada"}]}],"member":"311","published-online":{"date-parts":[[2024,3,19]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"publisher","DOI":"10.1002\/mrm.1910230106"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1002\/mrm.25197"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/jon.12283"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1002\/mrm.26512"},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1002\/jmri.26794"},{"key":"e_1_2_8_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.mri.2018.11.014"},{"key":"e_1_2_8_8_1","doi-asserted-by":"publisher","DOI":"10.1177\/0271678X211015101"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2022.119327"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2020.116601"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1708272114"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586\u2010020\u20102314\u20109"},{"key":"e_1_2_8_13_1","first-page":"1","volume-title":"Proceedings of the 29th Annual Meeting of the International Society of Magnetic Resonance in Medicine. Vol c","author":"Anazodo U","year":"2021"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.3389\/fradi.2022.929533"},{"key":"e_1_2_8_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/mrm.21790"},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41597\u2010022\u201001615\u20109"},{"key":"e_1_2_8_17_1","unstructured":"AnazodoU CroalP PaschoalAM.OSIPI ASL MRI Challenge.2021. doi:10.17605\/OSF.IO\/6XYU3"},{"key":"e_1_2_8_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.nicl.2022.103106"},{"key":"e_1_2_8_19_1","volume-title":"Proceedings of the 29th Annual Meeting of the International Society of Magnetic Resonance in Medicine","author":"Oliver\u2010Taylor AM"},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2013.05.041"},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24277-4"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.17226\/21915"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.3390\/diagnostics10050334"},{"key":"e_1_2_8_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcm.2016.02.012"},{"key":"e_1_2_8_25_1","unstructured":"R Core Team.R: A Language and Environment for Statistical Computing. Foundation for Statistical Computinghttps:\/\/www.r\u2010project.org\/;https:\/\/www.r\u2010project.org\/2020."},{"key":"e_1_2_8_26_1","doi-asserted-by":"publisher","DOI":"10.1038\/nn.4500"},{"key":"e_1_2_8_27_1","unstructured":"PraagCGV.COBIDAS reporting breakdown."},{"key":"e_1_2_8_28_1","unstructured":"O'KeefeS.Calculating document quality (QUACK). Scriptorium. Accessed November 9 2023.https:\/\/www.scriptorium.com\/2010\/05\/calculating\u2010document\u2010quality\u2010quack\/. Published May 14 2010"},{"key":"e_1_2_8_29_1","doi-asserted-by":"publisher","DOI":"10.1002\/mrm.1910400308"},{"key":"e_1_2_8_30_1","unstructured":"ASL Analysis Tab\u2014Quantiphyse documentation. Accessed November 9 2023.https:\/\/quantiphyse.readthedocs.io\/en\/latest\/asl\/asl_analysis.html"},{"key":"e_1_2_8_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2008.2005752"},{"key":"e_1_2_8_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2020.117031"},{"key":"e_1_2_8_33_1","unstructured":"MRIcloud. Accessed November 9 2023.https:\/\/braingps.mricloud.org\/docs\/Manual_ASL_processing.v2.pdf."},{"key":"e_1_2_8_34_1","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.22522"},{"key":"e_1_2_8_35_1","volume-title":"LOFT_ASL_toolbox","author":"Zhao C.","year":"2022"},{"key":"e_1_2_8_36_1","doi-asserted-by":"publisher","DOI":"10.1002\/mrm.29869"},{"key":"e_1_2_8_37_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41592\u2010022\u201001458\u20107"},{"key":"e_1_2_8_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.mri.2007.07.003"},{"key":"e_1_2_8_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2008.12.027"},{"key":"e_1_2_8_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.mri.2017.09.004"},{"key":"e_1_2_8_41_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0164112"},{"key":"e_1_2_8_42_1","unstructured":"COBIDAS checklist.July 2019. 10.17605\/OSF.IO\/ANVQY."},{"key":"e_1_2_8_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.nicl.2019.101897"},{"key":"e_1_2_8_44_1","doi-asserted-by":"publisher","DOI":"10.1002\/jmri.25807"},{"key":"e_1_2_8_45_1","doi-asserted-by":"publisher","DOI":"10.1002\/jmri.25751"},{"key":"e_1_2_8_46_1","doi-asserted-by":"publisher","DOI":"10.3389\/fninf.2016.00024"},{"key":"e_1_2_8_47_1","first-page":"13","article-title":"Quantitative comparison of SPM, FSL, and Brainsuite for brain MR image segmentation","volume":"4","author":"Kazemi K","year":"2014","journal-title":"J Biomed Phys Eng"},{"key":"e_1_2_8_48_1","doi-asserted-by":"publisher","DOI":"10.1111\/jon.12521"},{"key":"e_1_2_8_49_1","doi-asserted-by":"publisher","DOI":"10.1002\/mrm.28942"}],"container-title":["Magnetic Resonance in Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/mrm.30081","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,31]],"date-time":"2024-05-31T20:02:33Z","timestamp":1717185753000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/mrm.30081"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,19]]},"references-count":48,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,8]]}},"alternative-id":["10.1002\/mrm.30081"],"URL":"https:\/\/doi.org\/10.1002\/mrm.30081","archive":["Portico"],"relation":{},"ISSN":["0740-3194","1522-2594"],"issn-type":[{"value":"0740-3194","type":"print"},{"value":"1522-2594","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,19]]},"assertion":[{"value":"2023-04-28","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-02-21","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-03-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}