{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T23:15:53Z","timestamp":1792106153326,"version":"4.4.0"},"reference-count":12,"publisher":"Wiley","issue":"3","license":[{"start":{"date-parts":[[2025,4,1]],"date-time":"2025-04-01T00:00:00Z","timestamp":1743465600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Epilepsia Open"],"published-print":{"date-parts":[[2025,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>This study aims to report human performance in the detection of Focal Cortical Dysplasias (FCDs) using an openly available dataset. Additionally, it defines a subset of this data as a \u201cdifficult\u201d test set to establish a public baseline benchmark against which new methods for automated FCD detection can be evaluated.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>The performance of 28 human readers with varying levels of expertise in detecting FCDs was originally analyzed using 146 subjects (not all of which are openly available), we analyzed the openly available subset of 85 cases. Performance was measured based on the overlap between predicted regions of interest (ROIs) and ground\u2010truth lesion masks, using the Dice\u2010Soerensen coefficient (DSC). The benchmark test set was chosen to consist of 15 subjects most predictive for human performance and 13 subjects identified by at most 3 of the 28 readers.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Expert readers achieved an average detection rate of 68%, compared to 45% for non\u2010experts and 27% for laypersons. Neuroradiologists detected the highest percentage of lesions (64%), while psychiatrists detected the least (34%). Neurosurgeons had the highest ROI sensitivity (0.70), and psychiatrists had the highest ROI precision (0.78). The benchmark test set revealed an expert detection rate of 49%.<\/jats:p><\/jats:sec><jats:sec><jats:title>Significance<\/jats:title><jats:p>Reporting human performance in FCD detection provides a critical baseline for assessing the effectiveness of automated detection methods in a clinically relevant context. The defined benchmark test set serves as a useful indicator for evaluating advancements in computer\u2010aided FCD detection approaches.<\/jats:p><\/jats:sec><jats:sec><jats:title>Plain Language Summary<\/jats:title><jats:p>Focal cortical dysplasias (FCDs) are malformations of cortical development and one of the most common causes of drug\u2010resistant focal epilepsy. Once found, FCDs can be neurosurgically resected, which leads to seizure freedom in many cases. However, FCDs are difficult to detect in the visual assessment of magnetic resonance imaging. A myriad of algorithms for automated FCD detection have been developed, but their true clinical value remains unclear since there is no benchmark dataset for evaluation and comparison to human performance. Here, we use human FCD detection performance to define a benchmark dataset with which new methods for automated detection can be evaluated.<\/jats:p><\/jats:sec>","DOI":"10.1002\/epi4.70028","type":"journal-article","created":{"date-parts":[[2025,4,2]],"date-time":"2025-04-02T15:09:57Z","timestamp":1743606597000},"page":"778-786","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["A public benchmark for human performance in the detection of focal cortical dysplasia"],"prefix":"10.1002","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3300-6877","authenticated-orcid":false,"given":"Lennart","family":"Walger","sequence":"first","affiliation":[{"name":"Department of Neuroradiology University Hospital Bonn  Bonn Germany"},{"name":"Department of Epileptology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthias H.","family":"Schmitz","sequence":"additional","affiliation":[{"name":"Department of Neuroradiology University Hospital Bonn  Bonn Germany"},{"name":"Department of Epileptology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0555-6214","authenticated-orcid":false,"given":"Tobias","family":"Bauer","sequence":"additional","affiliation":[{"name":"Department of Neuroradiology University Hospital Bonn  Bonn Germany"},{"name":"Department of Epileptology University Hospital Bonn  Bonn Germany"},{"name":"German Center for Neurodegenerative Diseases (DZNE)  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"K\u00fcgler","sequence":"additional","affiliation":[{"name":"German Center for Neurodegenerative Diseases (DZNE)  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fabiane","family":"Schuch","sequence":"additional","affiliation":[{"name":"Department of Epileptology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christophe","family":"Arendt","sequence":"additional","affiliation":[{"name":"Department of Neuroradiology Goethe University Frankfurt  Frankfurt Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5935-9841","authenticated-orcid":false,"given":"Tobias","family":"Baumgartner","sequence":"additional","affiliation":[{"name":"Department of Epileptology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Johannes","family":"Birkenheier","sequence":"additional","affiliation":[{"name":"Department of Neurology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5905-4121","authenticated-orcid":false,"given":"Valeri","family":"Borger","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christoph","family":"Endler","sequence":"additional","affiliation":[{"name":"Department of Diagnostic and Interventional Radiology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Franziska","family":"Grau","sequence":"additional","affiliation":[{"name":"Department of Neuroradiology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Immanuel","sequence":"additional","affiliation":[{"name":"Department of Diagnostic and Interventional Radiology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Markus","family":"K\u00f6lle","sequence":"additional","affiliation":[{"name":"Department of Psychiatry and Psychotherapy University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patrick","family":"Kupczyk","sequence":"additional","affiliation":[{"name":"Department of Diagnostic and Interventional Radiology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Asadeh","family":"Lakghomi","sequence":"additional","affiliation":[{"name":"Department of Neuroradiology University Hospital Bonn  Bonn Germany"},{"name":"Department of Diagnostic and Interventional Radiology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Mackert","sequence":"additional","affiliation":[{"name":"Department of Psychiatry and Psychotherapy University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elisabeth","family":"Neuhaus","sequence":"additional","affiliation":[{"name":"Department of Neuroradiology Goethe University Frankfurt  Frankfurt Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julia","family":"Nordsiek","sequence":"additional","affiliation":[{"name":"Department of Neurology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna\u2010Maria","family":"Odenthal","sequence":"additional","affiliation":[{"name":"Department of Diagnostic and Interventional Radiology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Karmele Olaciregui","family":"Dague","sequence":"additional","affiliation":[{"name":"Department of Epileptology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"Ostermann","sequence":"additional","affiliation":[{"name":"Department of Epileptology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8280-6475","authenticated-orcid":false,"given":"Jan","family":"Pukropski","sequence":"additional","affiliation":[{"name":"Department of Epileptology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Attila","family":"Racz","sequence":"additional","affiliation":[{"name":"Department of Epileptology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Klaus","family":"von der Ropp","sequence":"additional","affiliation":[{"name":"Department of Epileptology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Frederic Carsten","family":"Schmeel","sequence":"additional","affiliation":[{"name":"Department of Neuroradiology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Felix","family":"Schrader","sequence":"additional","affiliation":[{"name":"Department of Psychiatry and Psychotherapy University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aileen","family":"Sitter","sequence":"additional","affiliation":[{"name":"Department of Psychiatry and Psychotherapy University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Unruh\u2010Pinheiro","sequence":"additional","affiliation":[{"name":"Department of Epileptology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marilia","family":"Voigt","sequence":"additional","affiliation":[{"name":"Department of Diagnostic and Interventional Radiology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martin","family":"Vychopen","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Philip","family":"von Wedel","sequence":"additional","affiliation":[{"name":"Department of Epileptology University Hospital Bonn  Bonn Germany"},{"name":"Chair of Economic &amp; Social Policy WHU \u2010 Otto Beisheim School of Management  Vallendar Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9430-5037","authenticated-orcid":false,"given":"Randi","family":"von Wrede","sequence":"additional","affiliation":[{"name":"Department of Epileptology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ulrike","family":"Attenberger","sequence":"additional","affiliation":[{"name":"Department of Diagnostic and Interventional Radiology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hartmut","family":"Vatter","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandra","family":"Philipsen","sequence":"additional","affiliation":[{"name":"Department of Psychiatry and Psychotherapy University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Albert","family":"Becker","sequence":"additional","affiliation":[{"name":"Department of Neuropathology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martin","family":"Reuter","sequence":"additional","affiliation":[{"name":"German Center for Neurodegenerative Diseases (DZNE)  Bonn Germany"},{"name":"A. A. Martinos Center for Biomedical Imaging Massachusetts General Hospital  Charlestown Massachusetts USA"},{"name":"Department of Radiology Harvard Medical School  Boston Massachusetts USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elke","family":"Hattingen","sequence":"additional","affiliation":[{"name":"Department of Neuroradiology Goethe University Frankfurt  Frankfurt Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Radbruch","sequence":"additional","affiliation":[{"name":"Department of Neuroradiology University Hospital Bonn  Bonn Germany"},{"name":"German Center for Neurodegenerative Diseases (DZNE)  Bonn Germany"},{"name":"Center for Medical Data Usability and Translation University of Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3177-8582","authenticated-orcid":false,"given":"Rainer","family":"Surges","sequence":"additional","affiliation":[{"name":"Department of Epileptology University Hospital Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6180-7671","authenticated-orcid":false,"given":"Theodor","family":"R\u00fcber","sequence":"additional","affiliation":[{"name":"Department of Neuroradiology University Hospital Bonn  Bonn Germany"},{"name":"Department of Epileptology University Hospital Bonn  Bonn Germany"},{"name":"German Center for Neurodegenerative Diseases (DZNE)  Bonn Germany"},{"name":"Center for Medical Data Usability and Translation University of Bonn  Bonn Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2025,4]]},"reference":[{"key":"e_1_2_11_2_1","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa1703784"},{"key":"e_1_2_11_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1474\u20104422(20)30220\u20109"},{"key":"e_1_2_11_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/epi.17130"},{"key":"e_1_2_11_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eplepsyres.2010.02.007"},{"key":"e_1_2_11_6_1","doi-asserted-by":"publisher","DOI":"10.1093\/neuros\/nyx239"},{"key":"e_1_2_11_7_1","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/awf175"},{"key":"e_1_2_11_8_1","doi-asserted-by":"publisher","DOI":"10.1097\/RLI.0000000000001125"},{"key":"e_1_2_11_9_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41597\u2010023\u201002386\u20107"},{"key":"e_1_2_11_10_1","doi-asserted-by":"publisher","DOI":"10.3389\/fninf.2014.00089"},{"key":"e_1_2_11_11_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Naeini MP","year":"2015"},{"key":"e_1_2_11_12_1","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1176344552"},{"key":"e_1_2_11_13_1","doi-asserted-by":"publisher","DOI":"10.1080\/07038992.2017.1259557"}],"container-title":["Epilepsia Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/epi4.70028","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,13]],"date-time":"2025-06-13T09:08:04Z","timestamp":1749805684000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/epi4.70028"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4]]},"references-count":12,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,6]]}},"alternative-id":["10.1002\/epi4.70028"],"URL":"https:\/\/doi.org\/10.1002\/epi4.70028","archive":["Portico"],"relation":{},"ISSN":["2470-9239","2470-9239"],"issn-type":[{"value":"2470-9239","type":"print"},{"value":"2470-9239","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4]]},"assertion":[{"value":"2024-12-17","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-03-10","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-04-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}