{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T16:02:31Z","timestamp":1790352151300,"version":"4.1.0"},"reference-count":50,"publisher":"Wiley","license":[{"start":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T00:00:00Z","timestamp":1790294400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"},{"start":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T00:00:00Z","timestamp":1790294400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Epilepsia"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>Interictal epileptiform discharges (IEDs) are a key diagnostic finding in first seizure, early epilepsy, and acute brain dysfunction. Variability in visual electroencephalographic (EEG) analysis contributes to diagnostic uncertainty. We performed a systematic review of the reproducibility of IED detection in clinical EEG.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We updated a systematic review. We searched four databases (Pubmed, Embase, PsycInfo, Cochrane) for studies reporting interrater or intrarater reproducibility of clinical scalp EEG interpretation, covering records until April 2025. Four raters independently screened 4841 citations and 119 full texts in duplicate. Study quality was assessed using Guidelines for Reporting Reliability and Agreement Studies. Studies reporting data on IED detection were analyzed. This study is registered with PROSPERO (Prospective Register of Systematic Reviews; number CRD42018099318).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Thirty\u2010two studies reported reproducibility of IED detection (25 interrater, seven intrarater). No other IED\u2010related EEG feature was examined in more than two studies. Ten studies met criteria for high clinical relevance, defined as relatively unselected patient populations without enrichment for epilepsy or IED occurrence. Reproducibility was highly variable across studies. For whole\u2010EEG assessment, percent agreement was approximately 80% in first seizure; kappa\u2010type statistics were higher in known epilepsy (interrater\n                      <jats:italic>\u03ba<\/jats:italic>\n                      \u2248 .8) than in acute brain dysfunction (\n                      <jats:italic>\u03ba<\/jats:italic>\n                      \u2248 .5) and first seizure (interrater\n                      <jats:italic>\u03ba<\/jats:italic>\n                      \u2248 .4\u2013.6). Short EEG clips showed consistently lower reproducibility than whole\u2010EEG assessments. Among studies reporting both intra\u2010 and interrater data with the same metric, intrarater reproducibility was equal to or higher than interrater, indicating intrarater disagreement accounts for a substantial share of interrater disagreement. \u201cParoxysmal\u201d was used inconsistently.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Significance<\/jats:title>\n                    <jats:p>\n                      IED detection has moderate reproducibility in unselected clinical populations (\n                      <jats:italic>\u03ba<\/jats:italic>\n                      \u2248 .4\u2013.6), higher in known epilepsy settings (\n                      <jats:italic>\u03ba<\/jats:italic>\n                      \u2248 .8), and moderate to fair in acute brain dysfunction (\n                      <jats:italic>\u03ba<\/jats:italic>\n                      \u2248 .3\u2013.5). Intrarater reproducibility is understudied and likely contributes substantially to interrater variability. Some traditional EEG terminologies (\u201cEEG dialects\u201d) are mutually incompatible. Future studies should use consecutive unselected populations and standard nomenclature, standardize rater experience, and be designed for cross\u2010study comparability.\n                    <\/jats:p>\n                  <\/jats:sec>","DOI":"10.1002\/epi.70502","type":"journal-article","created":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T15:26:11Z","timestamp":1790349971000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Interictal epileptiform discharges on scalp electroencephalography: Reproducibility of visual interpretation\u2014A systematic review"],"prefix":"10.1002","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6679-7241","authenticated-orcid":false,"given":"Jan","family":"Brogger","sequence":"first","affiliation":[{"name":"Department of Clinical Neurophysiology Haukeland University Hospital  Bergen Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1323-1660","authenticated-orcid":false,"given":"Eivind","family":"Aanestad","sequence":"additional","affiliation":[{"name":"Department of Clinical Neurophysiology Haukeland University Hospital  Bergen Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6035-6581","authenticated-orcid":false,"given":"S\u00e1ndor","family":"Beniczky","sequence":"additional","affiliation":[{"name":"Department of Clinical Neurophysiology Danish Epilepsy Center Filadelfia  Dianalund Denmark"},{"name":"Department of Clinical Neurophysiology Copenhagen University Hospital Rigshospitalet  Copenhagen Denmark"},{"name":"Department of Clinical Medicine University of Copenhagen  Copenhagen Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Viljami","family":"Kemppi","sequence":"additional","affiliation":[{"name":"Department of Clinical Neurophysiology Turku University Hospital  Turku Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4014-0425","authenticated-orcid":false,"given":"Bekir Burak","family":"K\u0131lboz","sequence":"additional","affiliation":[{"name":"Department of Neurology Bilecik Research and Training Hospital  Bilecik Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,9,25]]},"reference":[{"issue":"1","key":"e_1_2_12_2_1","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1002\/epi4.12375","article-title":"The evolution of the concepts of seizures and epilepsy: What's in a name?","volume":"5","author":"Patel P","year":"2020","journal-title":"Epilepsia Open"},{"issue":"5","key":"e_1_2_12_3_1","doi-asserted-by":"crossref","first-page":"1056","DOI":"10.1016\/j.clinph.2018.01.019","article-title":"Clinical utility of EEG in diagnosing and monitoring epilepsy in adults","volume":"129","author":"Tatum WO","year":"2018","journal-title":"Clin Neurophysiol"},{"key":"e_1_2_12_4_1","doi-asserted-by":"crossref","DOI":"10.1891\/9781617051807","volume-title":"Handbook of EEG interpretation","author":"Tatum W","year":"2014"},{"issue":"1","key":"e_1_2_12_5_1","first-page":"S52","article-title":"How not to read an EEG: concluding statements","volume":"80","author":"Tatum WO","year":"2013","journal-title":"Neurology"},{"issue":"5","key":"e_1_2_12_6_1","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1159\/000115641","article-title":"Errors in EEG interpretation and misdiagnosis of epilepsy. Which EEG patterns are overread?","volume":"59","author":"Benbadis SR","year":"2008","journal-title":"Eur Neurol"},{"key":"e_1_2_12_7_1","doi-asserted-by":"publisher","DOI":"10.1212\/WNL.0000000000009439"},{"issue":"9","key":"e_1_2_12_8_1","doi-asserted-by":"crossref","first-page":"2250","DOI":"10.1016\/j.clinph.2020.06.026","article-title":"Optimized set of criteria for defining interictal epileptiform EEG discharges","volume":"131","author":"Kural MA","year":"2020","journal-title":"Clin Neurophysiol"},{"issue":"7","key":"e_1_2_12_9_1","doi-asserted-by":"crossref","first-page":"1543","DOI":"10.1016\/j.clinph.2021.03.045","article-title":"The influence of the abundance and morphology of epileptiform discharges on diagnostic accuracy: how many spikes you need to spot in an EEG","volume":"132","author":"Kural MA","year":"2021","journal-title":"Clin Neurophysiol"},{"key":"e_1_2_12_10_1","doi-asserted-by":"crossref","DOI":"10.3389\/fneur.2023.1165592","article-title":"Spike count and morphology in the classification of epileptiform discharges","volume":"14","author":"Aanestad E","year":"2023","journal-title":"Front Neurol"},{"key":"e_1_2_12_11_1","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1016\/j.cnp.2017.07.002","article-title":"A revised glossary of terms most commonly used by clinical electroencephalographers and updated proposal for the report format of the EEG findings","volume":"2","author":"Kane N","year":"2017","journal-title":"Clin Neurophysiol Pract"},{"key":"e_1_2_12_12_1","first-page":"21","article-title":"A glossary of terms most commonly used by clinical electroencephalographers and proposal for the report form for the EEG findings. The international federation of clinical neurophysiology","volume":"52","author":"Noachtar S","year":"1999","journal-title":"Electroencephalogr Clin Neurophysiol Suppl"},{"issue":"5","key":"e_1_2_12_13_1","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1016\/0013-4694(74)90099-6","article-title":"A glossary of terms most commonly used by clinical electroencephalographers","volume":"37","author":"Chatrian G","year":"1974","journal-title":"Electroencephalogr Clin Neurophysiol"},{"key":"e_1_2_12_14_1","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1002\/epd2.20291","article-title":"Unveiling variability: a systematic review of reproducibility in visual EEG analysis, with focus on seizures","volume":"26","author":"Aanestad E","year":"2024","journal-title":"Epileptic Disord"},{"issue":"8","key":"e_1_2_12_15_1","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1001\/jamaneurol.2023.1645","article-title":"Automated interpretation of clinical electroencephalograms using artificial intelligence","volume":"80","author":"Tveit J","year":"2023","journal-title":"JAMA Neurol"},{"issue":"5","key":"e_1_2_12_16_1","doi-asserted-by":"crossref","first-page":"1064","DOI":"10.1111\/epi.17206","article-title":"Accurate identification of EEG recordings with interictal epileptiform discharges using a hybrid approach: artificial intelligence supervised by human experts","volume":"63","author":"Kural MA","year":"2022","journal-title":"Epilepsia"},{"key":"e_1_2_12_17_1","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1111\/epi.18164","article-title":"Expert level of detection of interictal discharges with a deep neural network","volume":"66","author":"Tjepkema\u2010Cloostermans MC","year":"2024","journal-title":"Epilepsia"},{"issue":"3","key":"e_1_2_12_18_1","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1001\/archneur.1992.00530270045017","article-title":"Value of the electroencephalogram in adult patients with untreated idiopathic first seizures","volume":"49","author":"Donselaar CA","year":"1992","journal-title":"Arch Neurol"},{"issue":"5","key":"e_1_2_12_19_1","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1017\/S0012162206000806","article-title":"Interobserver reliability of visual interpretation of electroencephalograms in children with newly diagnosed seizures","volume":"48","author":"Stroink H","year":"2006","journal-title":"Dev Med Child Neurol"},{"key":"e_1_2_12_20_1","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis JR","year":"1977","journal-title":"Biometrics"},{"issue":"5","key":"e_1_2_12_21_1","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1046\/j.1440-1819.2003.01152.x","article-title":"An intervention to improve the interrater reliability of clinical EEG interpretations","volume":"57","author":"Azuma H","year":"2003","journal-title":"Psychiatry Clin Neurosci"},{"key":"e_1_2_12_22_1","doi-asserted-by":"publisher","DOI":"10.4172\/2161\u20100665.1000151"},{"issue":"4","key":"e_1_2_12_23_1","first-page":"376","article-title":"Intra and inter\u2010observer reliability of electroencephalogram interpretation in pediatric patients with neurological alterations","volume":"52","author":"Ramirez\u2010Campos J","year":"2014","journal-title":"Rev Med Inst Mex Seguro Soc"},{"issue":"4","key":"e_1_2_12_24_1","doi-asserted-by":"crossref","first-page":"365","DOI":"10.33588\/rn.3204.2000513","article-title":"Diagn\u00f3stico electroencefalogr\u00e1fico de las epilepsias generalizadas idiop\u00e1ticas de la infancia","volume":"32","author":"Bauzano\u2010Poley E","year":"2001","journal-title":"Rev Neurol"},{"issue":"9","key":"e_1_2_12_25_1","first-page":"253","article-title":"Normal variants with an epileptiform appearance in electroencephalograms. A literature review and clinical implications","volume":"78","author":"Saiz\u2010D\u00edaz RA","year":"2024","journal-title":"Rev Neurol"},{"key":"e_1_2_12_26_1","first-page":"166","article-title":"Posibilidades de error al interpretar las variaciones transitorias del electroencefalograma interictal del paciente epil\u00e9ptico","volume":"39","author":"Figueredo P","year":"2000","journal-title":"Rev Cubana Med"},{"issue":"1","key":"e_1_2_12_27_1","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1097\/WNP.0b013e3182051123","article-title":"Interobserver reproducibility of electroencephalogram interpretation in critically ill children","volume":"28","author":"Abend NS","year":"2011","journal-title":"J Clin Neurophysiol"},{"issue":"10","key":"e_1_2_12_28_1","doi-asserted-by":"crossref","first-page":"3217","DOI":"10.1016\/j.clinph.2016.07.014","article-title":"Etiological associations and outcome predictors of acute electroencephalography in childhood encephalitis","volume":"127","author":"Mohammad SS","year":"2016","journal-title":"Clin Neurophysiol"},{"key":"e_1_2_12_29_1","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.cnp.2018.12.001","article-title":"Sources of interrater variability and prognostic value of standardized EEG features in post\u2010anoxic coma after resuscitated cardiac arrest","volume":"4","author":"Benarous L","year":"2019","journal-title":"Clin Neurophysiol Pract"},{"issue":"9","key":"e_1_2_12_30_1","doi-asserted-by":"crossref","first-page":"2216","DOI":"10.1016\/j.clinph.2020.06.021","article-title":"Reduced EEG montage has a high accuracy in the post cardiac arrest setting","volume":"131","author":"Backman S","year":"2020","journal-title":"Clin Neurophysiol"},{"key":"e_1_2_12_31_1","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.pediatrneurol.2020.10.016","article-title":"Electroencephalography technologist inter\u2010rater agreement and interpretation of pediatric critical care electroencephalography","volume":"115","author":"Ahrens S","year":"2021","journal-title":"Pediatr Neurol"},{"key":"e_1_2_12_32_1","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.clinph.2022.11.007","article-title":"Quantitative artifact reduction and pharmacologic paralysis improve detection of EEG epileptiform activity in critically ill patients","volume":"145","author":"Kulick\u2010Soper CV","year":"2023","journal-title":"Clin Neurophysiol"},{"key":"e_1_2_12_33_1","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1001\/jamaneurol.2019.3531","article-title":"Interrater reliability of experts in identifying interictal epileptiform discharges in electroencephalograms","volume":"77","author":"Jing J","year":"2019","journal-title":"JAMA Neurol"},{"issue":"1","key":"e_1_2_12_34_1","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/j.clinph.2016.11.005","article-title":"Spike detection: inter\u2010reader agreement and a statistical Turing test on a large data set","volume":"128","author":"Scheuer ML","year":"2017","journal-title":"Clin Neurophysiol"},{"issue":"5","key":"e_1_2_12_35_1","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1097\/WNP.0000000000000492","article-title":"Interictal epileptiform discharge detection in EEG in different practice settings","volume":"35","author":"Halford JJ","year":"2018","journal-title":"J Clin Neurophysiol"},{"issue":"10","key":"e_1_2_12_36_1","doi-asserted-by":"crossref","first-page":"1994","DOI":"10.1016\/j.clinph.2017.06.252","article-title":"Interictal epileptiform discharge characteristics underlying expert interrater agreement","volume":"128","author":"Bagheri E","year":"2017","journal-title":"Clin Neurophysiol"},{"issue":"9","key":"e_1_2_12_37_1","doi-asserted-by":"crossref","first-page":"e124","DOI":"10.1111\/epi.16655","article-title":"Interrater agreement of classification of photoparoxysmal electroencephalographic response","volume":"61","author":"Beniczky S","year":"2020","journal-title":"Epilepsia"},{"issue":"1","key":"e_1_2_12_38_1","doi-asserted-by":"crossref","first-page":"13406","DOI":"10.1038\/s41598-021-92827-3","article-title":"Prospective evaluation of interrater agreement between EEG technologists and neurophysiologists","volume":"11","author":"Beuchat I","year":"2021","journal-title":"Sci Rep"},{"issue":"1","key":"e_1_2_12_39_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0013-4694(92)90126-3","article-title":"Assessment of a computer\u2010program to detect epileptiform spikes","volume":"83","author":"Hostetler WE","year":"1992","journal-title":"Electroencephalogr Clin Neurophysiol"},{"issue":"6","key":"e_1_2_12_40_1","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1016\/0013-4694(93)90149-P","article-title":"Automatic EEG spike detection: what should the computer imitate?","volume":"87","author":"Webber WR","year":"1993","journal-title":"Electroencephalogr Clin Neurophysiol"},{"issue":"6","key":"e_1_2_12_41_1","doi-asserted-by":"crossref","first-page":"819","DOI":"10.1017\/S0317167100051507","article-title":"Audit of EEG reporting temporal abnormalities","volume":"37","author":"Nguyen DK","year":"2010","journal-title":"Can J Neurol Sci"},{"issue":"2","key":"e_1_2_12_42_1","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1016\/j.jneumeth.2012.11.005","article-title":"Standardized database development for EEG epileptiform transient detection: EEGnet scoring system and machine learning analysis","volume":"212","author":"Halford JJ","year":"2013","journal-title":"J Neurosci Methods"},{"key":"e_1_2_12_43_1","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1016\/j.clinph.2025.02.275","article-title":"Utility of the IFCN criteria for identifying interictal epileptiform discharges by experts: a decision hygiene approach to improve inter\u2010rater reliability","volume":"173","author":"Yuan D","year":"2025","journal-title":"Clin Neurophysiol"},{"issue":"3","key":"e_1_2_12_44_1","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1177\/155005940003100304","article-title":"Real\u2010time detection of epileptiform activity in the EEG: a blinded clinical trial","volume":"31","author":"Black MA","year":"2000","journal-title":"Clin Electroencephalogr"},{"issue":"2","key":"e_1_2_12_45_1","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1017\/cjn.2015.391","article-title":"StatNet electroencephalogram: a fast and reliable option to diagnose nonconvulsive status epilepticus in emergency setting","volume":"43","author":"Ladino LD","year":"2016","journal-title":"Can J Neurol Sci"},{"key":"e_1_2_12_46_1","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1097\/WNP.0000000000000849","article-title":"A new Score for sharp discharges in the EEG predicts epilepsy","volume":"40","author":"Aanestad E","year":"2021","journal-title":"J Clin Neurophysiol"},{"key":"e_1_2_12_47_1","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.seizure.2021.12.012","article-title":"Automated spike detection: which software package?","volume":"95","author":"Reus E","year":"2022","journal-title":"Seizure"},{"issue":"2","key":"e_1_2_12_48_1","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1097\/WNP.0000000000000344","article-title":"Characteristics of EEG interpreters associated with higher interrater agreement","volume":"34","author":"Halford JJ","year":"2017","journal-title":"J Clin Neurophysiol"},{"issue":"10","key":"e_1_2_12_49_1","doi-asserted-by":"crossref","first-page":"3028","DOI":"10.1111\/epi.18082","article-title":"Generalizability of electroencephalographic interpretation using artificial intelligence: an external validation study","volume":"65","author":"Mansilla D","year":"2024","journal-title":"Epilepsia"},{"issue":"1","key":"e_1_2_12_50_1","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.eplepsyres.2005.07.004","article-title":"Inter\u2010rater reliability of the EEG reading in patients with childhood idiopathic epilepsy","volume":"66","author":"Piccinelli P","year":"2005","journal-title":"Epilepsy Res"},{"issue":"11","key":"e_1_2_12_51_1","doi-asserted-by":"crossref","first-page":"2334","DOI":"10.1016\/j.clinph.2017.07.418","article-title":"Standardized computer\u2010based organized reporting of EEG: SCORE\u2013second version","volume":"128","author":"Beniczky S","year":"2017","journal-title":"Clin Neurophysiol"}],"container-title":["Epilepsia"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/epi.70502","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/epi.70502","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/epi.70502","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T15:26:18Z","timestamp":1790349978000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/epi.70502"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,25]]},"references-count":50,"alternative-id":["10.1002\/epi.70502"],"URL":"https:\/\/doi.org\/10.1002\/epi.70502","archive":["Portico"],"relation":{},"ISSN":["0013-9580","1528-1167"],"issn-type":[{"value":"0013-9580","type":"print"},{"value":"1528-1167","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,25]]},"assertion":[{"value":"2026-06-25","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-04","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-25","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"epi.70502"}}