{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,16]],"date-time":"2026-11-16T20:27:44Z","timestamp":1794860864719,"version":"4.9.1"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,6,12]],"date-time":"2020-06-12T00:00:00Z","timestamp":1591920000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,6,12]],"date-time":"2020-06-12T00:00:00Z","timestamp":1591920000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Headache Pain"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>This study evaluates the accuracy of an automated classification tool of single attacks of the two major primary headache disorders migraine and tension-type headache used in an electronic headache diary.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>One hundred two randomly selected reported headache attacks from an electronic headache-diary of patients using the medical app M-sense were classified by both a neurologist with specialisation in headache medicine and an algorithm, constructed based on the ICHD-3 criteria for migraine and tension-type headache. The level of agreement between the headache specialist and the algorithm was compared by using a kappa statistic. Cases of disagreement were analysed in a disagreement validity assessment.<\/jats:p><\/jats:sec><jats:sec><jats:title>Result<\/jats:title><jats:p>The neurologist and the algorithm classified migraines with aura (MA), migraines without aura (MO), tension-type headaches (TTH) and non-migraine or non-TTH events. Of the 102 headache reports, 86 cases were fully agreed on, and 16 cases not, making the level of agreement unweighted kappa 0.74 and representing a substantial level of agreement. Most cases of disagreement (12 out of 16) were due to inadvertent mistakes of the neurologist identified in the disagreement validity assessment. The second most common reason (3 out of 16) was insufficient information for classification by the neurologist.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The substantial level of agreement indicates that the classification tool is a valuable instrument for automated evaluation of electronic headache diaries, which can thereby support the diagnostic and therapeutic clinical processes. Based on this study\u2019s results, additional diagnostic functionalities of primary headache management apps can be implemented. Finally, future research can use this classification algorithm for large scale database analysis for epidemiological studies.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s10194-020-01139-w","type":"journal-article","created":{"date-parts":[[2020,6,12]],"date-time":"2020-06-12T09:04:12Z","timestamp":1591952652000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":42,"title":["Validation of an algorithm for automated classification of migraine and tension-type headache attacks in an electronic headache diary"],"prefix":"10.1186","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7311-8283","authenticated-orcid":false,"given":"Aaron","family":"Roesch","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Markus A","family":"Dahlem","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lars","family":"Neeb","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tobias","family":"Kurth","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,6,12]]},"reference":[{"issue":"1","key":"1139_CR1","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1186\/s10194-018-0839-1","volume":"19","author":"Z Katsarava","year":"2018","unstructured":"Katsarava Z, Mania M, Lampl C, Herberhold J, Steiner TJ (2018) Poor medical care for people with migraine in Europe \u2013 evidence from the Eurolight study. J Headache Pain 19(1):10","journal-title":"J Headache Pain"},{"issue":"3","key":"1139_CR2","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1111\/j.1468-2982.2007.01288.x","volume":"27","author":"L Stovner","year":"2007","unstructured":"Stovner L, Hagen K, Jensen R, Katsarava Z, Lipton R, Scher A et al (2007) The global burden of headache: a documentation of headache prevalence and disability worldwide. Cephalalgia 27(3):193\u2013210","journal-title":"Cephalalgia"},{"issue":"5","key":"1139_CR3","doi-asserted-by":"publisher","first-page":"396","DOI":"10.1016\/S1474-4422(18)30085-1","volume":"17","author":"J Olesen","year":"2018","unstructured":"Olesen J (2018) International classification of headache disorders. Lancet Neurol 17(5):396\u2013397","journal-title":"Lancet Neurol"},{"issue":"9","key":"1139_CR4","doi-asserted-by":"publisher","first-page":"1471","DOI":"10.1111\/head.13089","volume":"57","author":"WJ Becker","year":"2017","unstructured":"Becker WJ (2017) The diagnosis and Management of Chronic Migraine in primary care. Headache 57(9):1471\u20131481","journal-title":"Headache"},{"issue":"6","key":"1139_CR5","doi-asserted-by":"publisher","first-page":"553","DOI":"10.1056\/NEJMcp1605502","volume":"377","author":"A Charles","year":"2017","unstructured":"Charles A (2017) Migraine. N Engl J Med 377(6):553\u2013561","journal-title":"N Engl J Med"},{"issue":"1","key":"1139_CR6","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1111\/j.1526-4610.2012.02265.x","volume":"53","author":"RB Lipton","year":"2013","unstructured":"Lipton RB, Serrano D, Holland S, Fanning KM, Reed ML, Buse DC (2013) Barriers to the diagnosis and treatment of migraine: effects of sex, income, and headache features. Headache 53(1):81\u201392","journal-title":"Headache"},{"issue":"5","key":"1139_CR7","doi-asserted-by":"publisher","first-page":"821","DOI":"10.1111\/head.12774","volume":"56","author":"DW Dodick","year":"2016","unstructured":"Dodick DW, Loder EW, Manack Adams A, Buse DC, Fanning KM, Reed ML et al (2016) Assessing barriers to chronic migraine consultation, diagnosis, and treatment: results from the chronic migraine epidemiology and outcomes (CaMEO) study. Headache 56(5):821\u2013834","journal-title":"Headache"},{"issue":"1","key":"1139_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/j.1468-2982.2007.01239.x","volume":"27","author":"D Phillip","year":"2007","unstructured":"Phillip D, Lyngberg A, Jensen R (2007) Assessment of headache diagnosis. A comparative population study of a clinical interview with a diagnostic headache diary. Cephalalgia 27(1):1\u20138","journal-title":"Cephalalgia"},{"issue":"6","key":"1139_CR9","doi-asserted-by":"publisher","first-page":"761","DOI":"10.1177\/0333102418806864","volume":"39","author":"R Potter","year":"2019","unstructured":"Potter R, Probyn K, Bernstein C, Pincus T, Underwood M, Matharu M (2019) Diagnostic and classification tools for chronic headache disorders: a systematic review. Cephalalgia 39(6):761\u2013784","journal-title":"Cephalalgia"},{"issue":"8","key":"1139_CR10","doi-asserted-by":"publisher","first-page":"472","DOI":"10.1177\/1357633X16673275","volume":"22","author":"M Mosadeghi-Nik","year":"2016","unstructured":"Mosadeghi-Nik M, Askari MS, Fatehi F (2016) Mobile health (mHealth) for headache disorders: a review of the evidence base. J Telemed Telecare 22(8):472\u2013477","journal-title":"J Telemed Telecare"},{"issue":"3","key":"1139_CR11","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.3452","volume":"2","author":"AS Hundert","year":"2014","unstructured":"Hundert AS, Huguet A, McGrath PJ, Stinson JN, Wheaton M (2014) Commercially available mobile phone headache diary apps: a systematic review. JMIR Mhealth Uhealth 2(3):e36","journal-title":"JMIR Mhealth Uhealth"},{"issue":"2","key":"1139_CR12","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1007\/s15006-018-0153-5","volume":"160","author":"MA Dahlem","year":"2018","unstructured":"Dahlem MA, Roesch A, Neeb L, Kropp P, Dresler T (2018) What do migraine apps offer? MMW Fortschr Med 160(2):51\u201354","journal-title":"MMW Fortschr Med"},{"issue":"7","key":"1139_CR13","doi-asserted-by":"publisher","first-page":"1014","DOI":"10.1111\/head.13341","volume":"58","author":"MT Minen","year":"2018","unstructured":"Minen MT, Stieglitz EJ, Sciortino R, Torous J (2018) Privacy issues in smartphone applications: an analysis of headache\/migraine applications. Headache 58(7):1014\u20131027","journal-title":"Headache"},{"issue":"3","key":"1139_CR14","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1007\/s00103-017-2683-x","volume":"61","author":"A Terhechte","year":"2018","unstructured":"Terhechte A (2018) Medizinische software\/medical apps. Bundesgesundheitsbl Gesundheitsforsch Gesundheitsschutz 61(3):321\u2013327","journal-title":"Bundesgesundheitsbl Gesundheitsforsch Gesundheitsschutz"},{"key":"1139_CR15","unstructured":"Bundesregierung. Digitale-Versorgung-Gesetz \u2013 DVG 2019 . Available from: https:\/\/www.bundesgesundheitsministerium.de\/fileadmin\/Dateien\/3_Downloads\/Gesetze_und_Verordnungen\/GuV\/D\/Digitale-Versorgung-Gesetz_DVG_Kabinett.pdf."},{"issue":"11","key":"1139_CR16","first-page":"55","volume":"9","author":"M McCaffery","year":"1994","unstructured":"McCaffery M, Mosby AB (1994) Pain: clinical manual for nursing practice Pain: clinical manual for nursing practice. Nurs Stand 9(11):55","journal-title":"Nurs Stand"},{"key":"1139_CR17","doi-asserted-by":"publisher","DOI":"10.1177\/001316446002000104","volume-title":"a coefficient of agreement for nominal scales","author":"J Cohen","year":"1960","unstructured":"Cohen J (1960) a coefficient of agreement for nominal scales"},{"issue":"1","key":"1139_CR18","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1046\/j.1468-2982.1994.1401016.x","volume":"14","author":"F Granella","year":"1994","unstructured":"Granella F, D'Alessandro R, Manzoni GC, Cerbo R, Colucci D'Amato C, Pini LA et al (1994) International headache society classification: interobserver reliability in the diagnosis of primary headaches. Cephalalgia 14(1):16\u201320","journal-title":"Cephalalgia"},{"key":"1139_CR19","unstructured":"DMKG. Headache Diary 2019 [Available from: http:\/\/www.dmkg.de\/files\/dmkg.de\/patienten\/Kalender\/Kopfschmerzkalender_Englisch.pdf."},{"issue":"1","key":"1139_CR20","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1016\/0020-7101(92)90050-3","volume":"31","author":"ME Andrew","year":"1992","unstructured":"Andrew ME, Penzien DB, Rains JC, Knowlton GE, McAnulty RD (1992) Development of a computer application for headache diagnosis: the headache diagnostic system. Int J Biomed Comput 31(1):17\u201324","journal-title":"Int J Biomed Comput"},{"issue":"Suppl 2","key":"1139_CR21","doi-asserted-by":"publisher","first-page":"S213","DOI":"10.1007\/s10072-007-0779-z","volume":"28","author":"R De Simone","year":"2007","unstructured":"De Simone R, Coppola G, Ranieri A, Bussone G, Cortelli P, D'Amico D et al (2007) Validation of AIDA Cefalee, a computer-assisted diagnosis database for the management of headache patients. Neurol Sci 28(Suppl 2):S213\u2013S216","journal-title":"Neurol Sci"},{"key":"1139_CR22","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1111\/j.1526-4610.2007.00651.x","volume":"47","author":"P Sarchielli","year":"2007","unstructured":"Sarchielli P, Pedini M, Coppola F, Rossi C, Baldi A, Corbelli I et al (2007) Application of the ICHD-II criteria to the diagnosis of primary chronic headaches via a computerized structured record. Headache 47:38\u201344","journal-title":"Headache"},{"key":"1139_CR23","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1186\/1129-2377-15-40","volume":"15","author":"Z Dong","year":"2014","unstructured":"Dong Z, Yin Z, He M, Chen X, Lv X, Yu S (2014) Validation of a guideline-based decision support system for the diagnosis of primary headache disorders based on ICHD-3 beta. J Headache Pain 15:40","journal-title":"J Headache Pain"},{"issue":"1","key":"1139_CR24","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1111\/j.1526-4610.2007.00918.x","volume":"48","author":"M Maizels","year":"2008","unstructured":"Maizels M, Wolfe WJ (2008) An expert system for headache diagnosis: the computerized headache assessment tool (CHAT). Headache 48(1):72\u201378","journal-title":"Headache"},{"key":"1139_CR25","doi-asserted-by":"publisher","unstructured":"Kaiser EA, Igdalova A, Aguirre GK, Cucchiara B (2019) A web-based, branching logic questionnaire for the automated classification of migraine. Cephalalgia 39(10):1257\u20131266. https:\/\/doi.org\/10.1177\/0333102419847749","DOI":"10.1177\/0333102419847749"},{"key":"1139_CR26","doi-asserted-by":"publisher","first-page":"4200","DOI":"10.3906\/elk-1612-178","volume":"25","author":"U Celik","year":"2017","unstructured":"Celik U, Yurtay N (2017) An ant colony optimization algorithm-based classification for the diagnosis of primary headaches using a website questionnaire expert system. Turk J Electrical Eng Comput Sci 25:4200\u20134210","journal-title":"Turk J Electrical Eng Comput Sci"},{"issue":"10","key":"1139_CR27","doi-asserted-by":"publisher","first-page":"801","DOI":"10.1111\/j.1468-2982.2005.00955.x","volume":"25","author":"MK Eriksen","year":"2005","unstructured":"Eriksen MK, Thomsen LL, Olesen J (2005) The visual Aura rating scale (VARS) for migraine aura diagnosis. Cephalalgia 25(10):801\u2013810","journal-title":"Cephalalgia"},{"issue":"6","key":"1139_CR28","doi-asserted-by":"publisher","first-page":"369","DOI":"10.1111\/j.1468-2982.1992.00369.x","volume":"12","author":"MB Russell","year":"1992","unstructured":"Russell MB, Rasmussen BK, Brennum J, Iversen HK, Jensen RA, Olesen J (1992) Presentation of a new instrument: the diagnostic headache diary. Cephalalgia 12(6):369\u2013374","journal-title":"Cephalalgia"},{"key":"1139_CR29","volume-title":"Handbook of headache - the use of diaries in the Management of Headache","author":"TJS Paolo Martelletti","year":"2011","unstructured":"Paolo Martelletti TJS (2011) Handbook of headache - the use of diaries in the Management of Headache"},{"issue":"8","key":"1139_CR30","doi-asserted-by":"publisher","first-page":"905","DOI":"10.1111\/j.1468-2982.2006.01155.x","volume":"26","author":"G Nappi","year":"2006","unstructured":"Nappi G, Jensen R, Nappi RE, Sances G, Torelli P, Olesen J (2006) Diaries and calendars for migraine. A review. Cephalalgia 26(8):905\u2013916","journal-title":"Cephalalgia"},{"issue":"7347","key":"1139_CR31","doi-asserted-by":"publisher","first-page":"1193","DOI":"10.1136\/bmj.324.7347.1193","volume":"324","author":"AA Stone","year":"2002","unstructured":"Stone AA, Shiffman S, Schwartz JE, Broderick JE, Hufford MR (2002) Patient non-compliance with paper diaries. BMJ 324(7347):1193\u20131194","journal-title":"BMJ"},{"issue":"2","key":"1139_CR32","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1016\/S0197-2456(02)00320-3","volume":"24","author":"AA Stone","year":"2003","unstructured":"Stone AA, Shiffman S, Schwartz JE, Broderick JE, Hufford MR (2003) Patient compliance with paper and electronic diaries. Control Clin Trials 24(2):182\u2013199","journal-title":"Control Clin Trials"},{"issue":"2","key":"1139_CR33","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1046\/j.1468-2982.2000.00030.x","volume":"20","author":"R Luciani","year":"2000","unstructured":"Luciani R, Carter D, Mannix L, Hemphill M, Diamond M, Cady R (2000) Prevention of migraine during prodrome with naratriptan. Cephalalgia 20(2):122\u2013126","journal-title":"Cephalalgia"},{"issue":"7","key":"1139_CR34","doi-asserted-by":"publisher","first-page":"1041","DOI":"10.1111\/head.13137","volume":"57","author":"TT Houle","year":"2017","unstructured":"Houle TT, Turner DP, Golding AN, Porter JAH, Martin VT, Penzien DB et al (2017) Forecasting individual headache attacks using perceived stress: development of a multivariable prediction model for persons with episodic migraine. Headache 57(7):1041\u20131050","journal-title":"Headache"},{"key":"1139_CR35","doi-asserted-by":"publisher","unstructured":"Coravos A, Khozin S, Mandl KD (2019) Developing and adopting safe and effective digital biomarkers to improve patient outcomes. NPJ Digit Med 2(14). https:\/\/doi.org\/10.1177\/0333102419847749","DOI":"10.1177\/0333102419847749"},{"key":"1139_CR36","first-page":"99","volume":"8","author":"A Agarwal","year":"2015","unstructured":"Agarwal A, Ressler D, Snyder G (2015) The current and future state of companion diagnostics. Pharmgenomics Pers Med 8:99\u2013110","journal-title":"Pharmgenomics Pers Med"},{"issue":"7","key":"1139_CR37","doi-asserted-by":"publisher","first-page":"1200","DOI":"10.1097\/j.pain.0000000000000157","volume":"156","author":"DP Turner","year":"2015","unstructured":"Turner DP, Smitherman TA, Black AK, Penzien DB, Porter JA, Lofland KR et al (2015) Are migraine and tension-type headache diagnostic types or points on a severity continuum? An exploration of the latent taxometric structure of headache. Pain 156(7):1200\u20131207","journal-title":"Pain"},{"issue":"6","key":"1139_CR38","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1007\/s11916-008-0073-7","volume":"12","author":"BB Vargas","year":"2008","unstructured":"Vargas BB (2008) Tension-type headache and migraine: two points on a continuum? Curr Pain Headache Rep 12(6):433\u2013436","journal-title":"Curr Pain Headache Rep"},{"issue":"3","key":"1139_CR39","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1046\/j.1526-4610.1999.3903181.x","volume":"39","author":"S Bruehl","year":"1999","unstructured":"Bruehl S, Lofland KR, Semenchuk EM, Rokicki LA, Penzien DB (1999) Use of cluster analysis to validate IHS diagnostic criteria for migraine and tension-type headache. Headache 39(3):181\u2013189","journal-title":"Headache"},{"issue":"12","key":"1139_CR40","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1007\/s11916-018-0733-1","volume":"22","author":"A Tinsley","year":"2018","unstructured":"Tinsley A, Rothrock JF (2018) What are we missing in the diagnostic criteria for migraine? Curr Pain Headache Rep 22(12):84","journal-title":"Curr Pain Headache Rep"}],"container-title":["The Journal of Headache and Pain"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s10194-020-01139-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s10194-020-01139-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s10194-020-01139-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,7]],"date-time":"2024-08-07T13:26:26Z","timestamp":1723037186000},"score":1,"resource":{"primary":{"URL":"https:\/\/thejournalofheadacheandpain.biomedcentral.com\/articles\/10.1186\/s10194-020-01139-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,12]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["1139"],"URL":"https:\/\/doi.org\/10.1186\/s10194-020-01139-w","relation":{},"ISSN":["1129-2369","1129-2377"],"issn-type":[{"value":"1129-2369","type":"print"},{"value":"1129-2377","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,12]]},"assertion":[{"value":"28 March 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 May 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 June 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Patient data used in this study was anonymized prior to use for research purposes. All subjects consented to the App M-sense\u2019s terms of service and data protection declaration that abides by the General Data Protection Regulation (GDPR). Further, the study has been approved by Charit\u00e9 \u2013 Universit\u00e4tsmedizin Berlin\u2019s institutional ethics committee (project number: EA2\/232\/18).","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"AR was employed at Newsenselab GmbH (App M-sense) as an intern prior to his research at the Institute of Public Health Berlin until September 2017.MD is a Co-founder and shareholder of the Newsenselab GmbH.TK reports having contributed to an advisory board of CoLucid and a research project funded by Amgen, for which the Charit\u00e9 \u2013 Universit\u00e4tsmedizin Berlin received an unrestricted compensation. He further reports having received honoraria from Lilly, Newsenselab, and Total for providing methodological advice, from Novartis and from Daiichi Sankyo for providing a lecture on neuroepidemiology and research methods, and from the BMJ for editorial services.LN contributed to advisory boards of Hormosan, Lilly and Novartis. He received speaking fees from Allergan, Biogen, Hormosan, Lilly, Novartis and TEVA.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"75"}}