{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T12:26:25Z","timestamp":1775910385303,"version":"3.50.1"},"reference-count":45,"publisher":"Wiley","license":[{"start":{"date-parts":[[2015,1,1]],"date-time":"2015-01-01T00:00:00Z","timestamp":1420070400000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001826","name":"ZonMw","doi-asserted-by":"publisher","award":["104002002"],"award-info":[{"award-number":["104002002"]}],"id":[{"id":"10.13039\/501100001826","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001826","name":"ZonMw","doi-asserted-by":"publisher","award":["2010T073"],"award-info":[{"award-number":["2010T073"]}],"id":[{"id":"10.13039\/501100001826","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Netherlands Heart Foundation","award":["104002002"],"award-info":[{"award-number":["104002002"]}]},{"name":"Netherlands Heart Foundation","award":["2010T073"],"award-info":[{"award-number":["2010T073"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computational Intelligence and Neuroscience"],"published-print":{"date-parts":[[2015]]},"abstract":"<jats:p>Many methods have been proposed for tissue segmentation in brain MRI scans. The multitude of methods proposed complicates the choice of one method above others. We have therefore established the MRBrainS online evaluation framework for evaluating (semi)automatic algorithms that segment gray matter (GM), white matter (WM), and cerebrospinal fluid (CSF) on 3T brain MRI scans of elderly subjects (65\u201380 y). Participants apply their algorithms to the provided data, after which their results are evaluated and ranked. Full manual segmentations of GM, WM, and CSF are available for all scans and used as the reference standard. Five datasets are provided for training and fifteen for testing. The evaluated methods are ranked based on their overall performance to segment GM, WM, and CSF and evaluated using three evaluation metrics (Dice, H95, and AVD) and the results are published on the MRBrainS13 website. We present the results of eleven segmentation algorithms that participated in the MRBrainS13 challenge workshop at MICCAI, where the framework was launched, and three commonly used freeware packages: FreeSurfer, FSL, and SPM. The MRBrainS evaluation framework provides an objective and direct comparison of all evaluated algorithms and can aid in selecting the best performing method for the segmentation goal at hand.<\/jats:p>","DOI":"10.1155\/2015\/813696","type":"journal-article","created":{"date-parts":[[2015,12,2]],"date-time":"2015-12-02T16:03:36Z","timestamp":1449072216000},"page":"1-16","source":"Crossref","is-referenced-by-count":206,"title":["MRBrainS Challenge: Online Evaluation Framework for Brain Image Segmentation in 3T MRI Scans"],"prefix":"10.1155","volume":"2015","author":[{"given":"Adri\u00ebnne M.","family":"Mendrik","sequence":"first","affiliation":[{"name":"Image Sciences Institute, University Medical Center Utrecht, 3584 CX Utrecht, Netherlands"}]},{"given":"Koen L.","family":"Vincken","sequence":"additional","affiliation":[{"name":"Image Sciences Institute, University Medical Center Utrecht, 3584 CX Utrecht, Netherlands"}]},{"given":"Hugo J.","family":"Kuijf","sequence":"additional","affiliation":[{"name":"Image Sciences Institute, University Medical Center Utrecht, 3584 CX Utrecht, Netherlands"}]},{"given":"Marcel","family":"Breeuwer","sequence":"additional","affiliation":[{"name":"Philips Healthcare, 5680 DA Best, Netherlands"},{"name":"Faculty of Biomedical Engineering, Eindhoven University of Technology, 5600 MB Eindhoven, Netherlands"}]},{"given":"Willem H.","family":"Bouvy","sequence":"additional","affiliation":[{"name":"Department of Neurology, Brain Center Rudolf Magnus, University Medical Center Utrecht, 3584 CX Utrecht, Netherlands"}]},{"given":"Jeroen","family":"de Bresser","sequence":"additional","affiliation":[{"name":"Department of Radiology, University Medical Center Utrecht, 3584 CX Utrecht, Netherlands"}]},{"given":"Amir","family":"Alansary","sequence":"additional","affiliation":[{"name":"BioImaging Laboratory, Bioengineering Department, University of Louisville, Louisville, KY 40292, USA"}]},{"given":"Marleen","family":"de Bruijne","sequence":"additional","affiliation":[{"name":"Biomedical Imaging Group Rotterdam, Departments of Medical Informatics and Radiology, Erasmus MC, 3015 CN Rotterdam, Netherlands"},{"name":"Department of Computer Science, University of Copenhagen, 2100 Copenhagen, Denmark"}]},{"given":"Aaron","family":"Carass","sequence":"additional","affiliation":[{"name":"Image Analysis and Communications Laboratory, Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD 21218, USA"}]},{"given":"Ayman","family":"El-Baz","sequence":"additional","affiliation":[{"name":"BioImaging Laboratory, Bioengineering Department, University of Louisville, Louisville, KY 40292, USA"}]},{"given":"Amod","family":"Jog","sequence":"additional","affiliation":[{"name":"Image Analysis and Communications Laboratory, Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD 21218, USA"}]},{"given":"Ranveer","family":"Katyal","sequence":"additional","affiliation":[{"name":"Department of Electronics and Communication Engineering, The LNM Institute of Information Technology, Jaipur 302031, India"}]},{"given":"Ali R.","family":"Khan","sequence":"additional","affiliation":[{"name":"Imaging Laboratories, Robarts Research Institute, London, ON, Canada N6A 5B7"},{"name":"Department of Medical Biophysics, Western University, London, ON, Canada N6A 3K7"}]},{"given":"Fedde","family":"van der Lijn","sequence":"additional","affiliation":[{"name":"Biomedical Imaging Group Rotterdam, Departments of Medical Informatics and Radiology, Erasmus MC, 3015 CN Rotterdam, Netherlands"}]},{"given":"Qaiser","family":"Mahmood","sequence":"additional","affiliation":[{"name":"Signals and Systems, Chalmers University of Technology, 41296 Gothenburg, Sweden"}]},{"given":"Ryan","family":"Mukherjee","sequence":"additional","affiliation":[{"name":"Applied Physics Laboratory, Johns Hopkins University, Laurel, MD 20723, USA"}]},{"given":"Annegreet","family":"van Opbroek","sequence":"additional","affiliation":[{"name":"Biomedical Imaging Group Rotterdam, Departments of Medical Informatics and Radiology, Erasmus MC, 3015 CN Rotterdam, Netherlands"}]},{"given":"Sahil","family":"Paneri","sequence":"additional","affiliation":[{"name":"Department of Electronics and Communication Engineering, The LNM Institute of Information Technology, Jaipur 302031, India"}]},{"given":"S\u00e9rgio","family":"Pereira","sequence":"additional","affiliation":[{"name":"Department of Electronics, University of Minho, 4800-058 Guimar\u00e3es, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1335-2377","authenticated-orcid":true,"given":"Mikael","family":"Persson","sequence":"additional","affiliation":[{"name":"Signals and Systems, Chalmers University of Technology, 41296 Gothenburg, Sweden"}]},{"given":"Martin","family":"Rajchl","sequence":"additional","affiliation":[{"name":"Imaging Laboratories, Robarts Research Institute, London, ON, Canada N6A 5B7"},{"name":"Department of Computing, Imperial College London, London SW7 2AZ, UK"}]},{"given":"Duygu","family":"Sarikaya","sequence":"additional","affiliation":[{"name":"Computer Science and Engineering Department, State University of New York at Buffalo, Buffalo, NY 14260-2500, USA"}]},{"given":"\u00d6rjan","family":"Smedby","sequence":"additional","affiliation":[{"name":"Center for Medical Imaging Science and Visualization, Link\u00f6ping University, 58185 Link\u00f6ping, Sweden"},{"name":"Department of Radiology and Department of Medical and Health Sciences, Link\u00f6ping University, 58185 Link\u00f6ping, Sweden"}]},{"given":"Carlos A.","family":"Silva","sequence":"additional","affiliation":[{"name":"Department of Electronics, University of Minho, 4800-058 Guimar\u00e3es, Portugal"}]},{"given":"Henri A.","family":"Vrooman","sequence":"additional","affiliation":[{"name":"Biomedical Imaging Group Rotterdam, Departments of Medical Informatics and Radiology, Erasmus MC, 3015 CN Rotterdam, Netherlands"}]},{"given":"Saurabh","family":"Vyas","sequence":"additional","affiliation":[{"name":"Applied Physics Laboratory, Johns Hopkins University, Laurel, MD 20723, USA"}]},{"given":"Chunliang","family":"Wang","sequence":"additional","affiliation":[{"name":"Center for Medical Imaging Science and Visualization, Link\u00f6ping University, 58185 Link\u00f6ping, Sweden"},{"name":"Department of Radiology and Department of Medical and Health Sciences, Link\u00f6ping University, 58185 Link\u00f6ping, Sweden"}]},{"given":"Liang","family":"Zhao","sequence":"additional","affiliation":[{"name":"Computer Science and Engineering Department, State University of New York at Buffalo, Buffalo, NY 14260-2500, USA"}]},{"given":"Geert Jan","family":"Biessels","sequence":"additional","affiliation":[{"name":"Department of Neurology, Brain Center Rudolf Magnus, University Medical Center Utrecht, 3584 CX Utrecht, Netherlands"}]},{"given":"Max A.","family":"Viergever","sequence":"additional","affiliation":[{"name":"Image Sciences Institute, University Medical Center Utrecht, 3584 CX Utrecht, Netherlands"}]}],"member":"311","reference":[{"key":"16","doi-asserted-by":"publisher","DOI":"10.1212\/WNL.0b013e3181a82634"},{"key":"18","doi-asserted-by":"publisher","DOI":"10.1024\/1662-9647\/a000074"},{"key":"24","doi-asserted-by":"publisher","DOI":"10.1016\/j.neurobiolaging.2006.12.012"},{"key":"22","doi-asserted-by":"publisher","DOI":"10.1002\/jmri.23671"},{"key":"54","doi-asserted-by":"publisher","DOI":"10.1148\/radiology.154.1.3964938"},{"key":"5","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-010-9155-0"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1118\/1.597000"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.1016\/0730-725x(94)00124-l"},{"key":"15","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2004.07.027"},{"key":"41","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.bioeng.2.1.315"},{"issue":"4-5","key":"48","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1002\/(SICI)1099-1492(199806\/08)11:4\/5<157::AID-NBM528>3.0.CO;2-L","volume":"11","year":"1998","journal-title":"NMR in Biomedicine"},{"key":"53","doi-asserted-by":"publisher","DOI":"10.1007\/s100440200005"},{"issue":"5-6","key":"62","first-page":"401","volume":"22","year":"1994","journal-title":"Critical Reviews in Biomedical Engineering"},{"key":"43","doi-asserted-by":"publisher","DOI":"10.1016\/0734-189x(86)90083-6"},{"key":"7","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2010.03.012"},{"key":"8","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2010.09.060"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2005.857652"},{"key":"31","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.20599"},{"key":"63","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2006.05.031"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1093\/schbul\/sbm120"},{"key":"33","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2012.00171"},{"key":"13","doi-asserted-by":"publisher","DOI":"10.1006\/nimg.1998.0395"},{"key":"17","doi-asserted-by":"publisher","DOI":"10.1006\/nimg.1998.0396"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2011.09.015"},{"key":"3","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2005.02.018"},{"key":"46","doi-asserted-by":"publisher","DOI":"10.2337\/db12-1644"},{"key":"32","doi-asserted-by":"publisher","DOI":"10.1109\/tmi.2009.2035616"},{"key":"20","year":"2011"},{"key":"47","doi-asserted-by":"publisher","DOI":"10.1109\/mpul.2011.942929"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.2307\/1932409"},{"key":"23","doi-asserted-by":"publisher","DOI":"10.1109\/34.232073"},{"key":"11","doi-asserted-by":"publisher","DOI":"10.1007\/BF00994018"},{"key":"56","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2007.05.018"},{"key":"58","doi-asserted-by":"publisher","DOI":"10.1118\/1.4881315"},{"key":"51","doi-asserted-by":"publisher","DOI":"10.1109\/42.668698"},{"key":"9","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2011.03.045"},{"key":"36","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2009.09.002"},{"key":"45","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2013.2282932"},{"key":"42","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2012.03.074"},{"issue":"8","key":"61","first-page":"1483","volume":"22","year":"2001","journal-title":"American Journal of Neuroradiology"},{"key":"52","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.10062"},{"key":"50","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2008.10.066"},{"issue":"1","key":"25","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.media.2014.11.001","volume":"20","year":"2015","journal-title":"Medical Image Analysis"},{"key":"37","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2015.06.007"},{"key":"60","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2014.12.042"}],"container-title":["Computational Intelligence and Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2015\/813696.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2015\/813696.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2015\/813696.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2017,6,23]],"date-time":"2017-06-23T20:55:15Z","timestamp":1498251315000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.hindawi.com\/journals\/cin\/2015\/813696\/"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015]]},"references-count":45,"alternative-id":["813696","813696"],"URL":"https:\/\/doi.org\/10.1155\/2015\/813696","relation":{},"ISSN":["1687-5265","1687-5273"],"issn-type":[{"value":"1687-5265","type":"print"},{"value":"1687-5273","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015]]}}}