{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,10]],"date-time":"2026-11-10T17:52:30Z","timestamp":1794333150191,"version":"4.9.0"},"reference-count":18,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T00:00:00Z","timestamp":1597881600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T00:00:00Z","timestamp":1597881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["NRF-2020M3E5D2A01084892"],"award-info":[{"award-number":["NRF-2020M3E5D2A01084892"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Classification of headache disorders is dependent on a subjective self-report from patients and its interpretation by physicians. We aimed to apply objective data-driven machine learning approaches to analyze patient-reported symptoms and test the feasibility of the automated classification of headache disorders. The self-report data of 2162 patients were analyzed. Headache disorders were merged into five major entities. The patients were divided into training (n\u2009=\u20091286) and test (n\u2009=\u2009876) cohorts. We trained a stacked classifier model with four layers of XGBoost classifiers. The first layer classified between migraine and others, the second layer classified between tension-type headache (TTH) and others, and the third layer classified between trigeminal autonomic cephalalgia (TAC) and others, and the fourth layer classified between epicranial and thunderclap headaches. Each layer selected different features from the self-reports by using least absolute shrinkage and selection operator. In the test cohort, our stacked classifier obtained accuracy of 81%, sensitivity of 88%, 69%, 65%, 53%, and 51%, and specificity of 95%, 55%, 46%, 48%, and 51% for migraine, TTH, TAC, epicranial headache, and thunderclap headaches, respectively. We showed that a machine-learning based approach is applicable in analyzing patient-reported questionnaires. Our result could serve as a baseline for future studies in headache research.<\/jats:p>","DOI":"10.1038\/s41598-020-70992-1","type":"journal-article","created":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T06:07:20Z","timestamp":1597903640000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":60,"title":["Machine learning-based automated classification of headache disorders using patient-reported questionnaires"],"prefix":"10.1038","volume":"10","author":[{"given":"Junmo","family":"Kwon","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hyebin","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Soohyun","family":"Cho","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chin-Sang","family":"Chung","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mi Ji","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hyunjin","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,8,20]]},"reference":[{"key":"70992_CR1","first-page":"1","volume":"38","author":"J Olesen","year":"2018","unstructured":"Olesen, J. Headache Classification Committee of the International Headache Society (IHS) The International Classification of Headache Disorders. Cephalalgia 38, 1\u2013211 (2018).","journal-title":"Cephalalgia"},{"key":"70992_CR2","doi-asserted-by":"publisher","first-page":"1143","DOI":"10.1177\/0333102419839975","volume":"39","author":"B Zhu","year":"2019","unstructured":"Zhu, B., Coppola, G. & Shoaran, M. Migraine classification using somatosensory evoked potentials. Cephalalgia 39, 1143\u20131155 (2019).","journal-title":"Cephalalgia"},{"key":"70992_CR3","doi-asserted-by":"publisher","first-page":"2776","DOI":"10.1097\/j.pain.0000000000001676","volume":"160","author":"MJ Lee","year":"2019","unstructured":"Lee, M. J. et al. Dynamic functional connectivity of the migraine brain: a resting-state functional magnetic resonance imaging study. Pain 160, 2776\u20132786 (2019).","journal-title":"Pain"},{"key":"70992_CR4","doi-asserted-by":"publisher","first-page":"828","DOI":"10.1177\/0333102416652091","volume":"37","author":"CD Chong","year":"2017","unstructured":"Chong, C. D. et al. Migraine classification using magnetic resonance imaging resting-state functional connectivity data. Cephalalgia 37, 828\u2013844 (2017).","journal-title":"Cephalalgia"},{"key":"70992_CR5","doi-asserted-by":"publisher","first-page":"1191","DOI":"10.1212\/WNL.0b013e3182a6cb72","volume":"81","author":"E Cernuda-Moroll\u00f3n","year":"2013","unstructured":"Cernuda-Moroll\u00f3n, E. et al. Interictal increase of CGRP levels in peripheral blood as a biomarker for chronic migraine. Neurology 81, 1191\u20131196 (2013).","journal-title":"Neurology"},{"key":"70992_CR6","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1186\/s10194-018-0883-x","volume":"19","author":"MJ Lee","year":"2018","unstructured":"Lee, M. J., Lee, S. Y., Cho, S., Kang, E. S. & Chung, C. S. Feasibility of serum CGRP measurement as a biomarker of chronic migraine: a critical reappraisal. J. Headache Pain 19, 53 (2018).","journal-title":"J. Headache Pain"},{"key":"70992_CR7","first-page":"157","volume":"8","author":"B Krawczyk","year":"2013","unstructured":"Krawczyk, B., Simi\u0107, D., Simi\u0107, S. & Wo\u017aniak, M. Automatic diagnosis of primary headaches by machine learning methods. Cent. Eur. J. Med. 8, 157\u2013165 (2013).","journal-title":"Cent. Eur. J. Med."},{"key":"70992_CR8","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1186\/s12911-017-0434-4","volume":"17","author":"Y Garcia-Chimeno","year":"2017","unstructured":"Garcia-Chimeno, Y., Garcia-Zapirain, B., Gomez-Beldarrain, M., Fernandez-Ruanova, B. & Garcia-Monco, J. C. Automatic migraine classification via feature selection committee and machine learning techniques over imaging and questionnaire data. BMC Med. Inf. Decis. Mak. 17, 38 (2017).","journal-title":"BMC Med. Inf. Decis. Mak."},{"key":"70992_CR9","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1212\/01.WNL.0000078940.53438.83","volume":"61","author":"RB Lipton","year":"2003","unstructured":"Lipton, R. B. et al. A self-administered screener for migraine in primary care: the ID migraineTM validation study. Neurology 61, 375\u2013382 (2003).","journal-title":"Neurology"},{"key":"70992_CR10","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1016\/j.ejrad.2017.11.024","volume":"98","author":"BK Patel","year":"2018","unstructured":"Patel, B. K. et al. Computer-aided diagnosis of contrast-enhanced spectral mammography: a feasibility study. Eur. J. Radiol. 98, 207\u2013213 (2018).","journal-title":"Eur. J. Radiol."},{"key":"70992_CR11","doi-asserted-by":"publisher","first-page":"991","DOI":"10.1109\/TMI.2018.2876510","volume":"38","author":"Y Xie","year":"2019","unstructured":"Xie, Y. et al. Knowledge-based collaborative deep learning for benign-malignant lung nodule classification on chest CT. IEEE Trans. Med. Imaging 38, 991\u20131004 (2019).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"70992_CR12","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1007\/s13534-017-0047-y","volume":"8","author":"RF Mansour","year":"2018","unstructured":"Mansour, R. F. Deep-learning-based automatic computer-aided diagnosis system for diabetic retinopathy. Biomed. Eng. Lett. 8, 41\u201357 (2018).","journal-title":"Biomed. Eng. Lett."},{"key":"70992_CR13","doi-asserted-by":"publisher","unstructured":"Chen, T. & Guestrin, C. XGBoost: a scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining-KDD\u2019 16 785\u2013794. https:\/\/doi.org\/10.1145\/2939672.2939785 (ACM, 2016).","DOI":"10.1145\/2939672.2939785"},{"key":"70992_CR14","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","volume":"58","author":"R Tibshirani","year":"1996","unstructured":"Tibshirani, R. Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B 58, 267\u2013288 (1996).","journal-title":"J. R. Stat. Soc. Ser. B"},{"key":"70992_CR15","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1023\/A:1012487302797","volume":"46","author":"I Guyon","year":"2002","unstructured":"Guyon, I., Weston, J., Barnhill, S. & Vapnik, V. Gene selection for cancer classification using support vector machines. Mach. Learn. 46, 389\u2013422 (2002).","journal-title":"Mach. Learn."},{"key":"70992_CR16","doi-asserted-by":"publisher","first-page":"1226","DOI":"10.1109\/TPAMI.2005.159","volume":"27","author":"H Peng","year":"2005","unstructured":"Peng, H., Long, F. & Ding, C. Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell. 27, 1226\u20131238 (2005).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"70992_CR17","doi-asserted-by":"publisher","first-page":"1116","DOI":"10.1136\/jnnp.2008.157743","volume":"80","author":"TH Lai","year":"2009","unstructured":"Lai, T. H., Fuh, J. L. & Wang, S. J. Cranial autonomic symptoms in migraine: characteristics and comparison with cluster headache. J. Neurol. Neurosurg. Psychiatry 80, 1116\u20131119 (2009).","journal-title":"J. Neurol. Neurosurg. Psychiatry"},{"key":"70992_CR18","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1007\/s13534-017-0055-y","volume":"8","author":"D Dey","year":"2018","unstructured":"Dey, D., Chaudhuri, S. & Munshi, S. Obstructive sleep apnoea detection using convolutional neural network based deep learning framework. Biomed. Eng. Lett. 8, 95\u2013100 (2018).","journal-title":"Biomed. Eng. Lett."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-70992-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-70992-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-70992-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,12]],"date-time":"2024-08-12T02:11:28Z","timestamp":1723428688000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-70992-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,20]]},"references-count":18,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["70992"],"URL":"https:\/\/doi.org\/10.1038\/s41598-020-70992-1","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,20]]},"assertion":[{"value":"17 March 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 August 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 August 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"14062"}}