{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T16:19:47Z","timestamp":1791908387387,"version":"4.3.4"},"reference-count":27,"publisher":"PeerJ","license":[{"start":{"date-parts":[[2022,1,11]],"date-time":"2022-01-11T00:00:00Z","timestamp":1641859200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100008092","name":"Jinhua Science and Technology Bureau","doi-asserted-by":"crossref","award":["2020-3-036"],"award-info":[{"award-number":["2020-3-036"]}],"id":[{"id":"10.13039\/501100008092","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003399","name":"Shanghai Science and Technology Commission","doi-asserted-by":"crossref","award":["14411972200"],"award-info":[{"award-number":["14411972200"]}],"id":[{"id":"10.13039\/501100003399","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Primary headache is a disorder with a high incidence and low diagnostic accuracy; the incidence of migraine and tension-type headache ranks first among primary headaches. Artificial intelligence (AI) decision support systems have shown great potential in the medical field. Therefore, we attempt to use machine learning to build a clinical decision-making system for primary headaches.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The demographic data and headache characteristics of 173 patients were collected by questionnaires. Decision tree, random forest, gradient boosting algorithm and support vector machine (SVM) models were used to construct a discriminant model and a confusion matrix was used to calculate the evaluation indicators of the models. Furthermore, we have carried out feature selection through univariate statistical analysis and machine learning.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>In the models, the accuracy, F1 score were calculated through the confusion matrix. The logistic regression model has the best discrimination effect, with the accuracy reaching 0.84 and the area under the ROC curve also being the largest at 0.90. Furthermore, we identified the most important factors for distinguishing the two disorders through statistical analysis and machine learning: nausea\/vomiting and photophobia\/phonophobia. These two factors represent potential independent factors for the identification of migraines and tension-type headaches, with the accuracy reaching 0.74 and the area under the ROC curve being at 0.74.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Applying machine learning to the decision-making system for primary headaches can achieve a high diagnostic accuracy. Among them, the discrimination effect obtained by the integrated algorithm is significantly better than that of a single learner. Second, nausea\/vomiting, photophobia\/phonophobia may be the most important factors for distinguishing migraine from tension-type headaches.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.7717\/peerj.12743","type":"journal-article","created":{"date-parts":[[2022,1,11]],"date-time":"2022-01-11T04:52:15Z","timestamp":1641876735000},"page":"e12743","source":"Crossref","is-referenced-by-count":24,"title":["A decision support system for primary headache developed through machine learning"],"prefix":"10.7717","volume":"10","author":[{"given":"Fangfang","family":"Liu","sequence":"first","affiliation":[{"name":"Shanghai Jiao Tong University, School of Medicine, Shanghai Ninth People\u2019s Hospital, Shanghai, Huangpuqu, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guanshui","family":"Bao","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, School of Medicine, Shanghai Ninth People\u2019s Hospital, Shanghai, Huangpuqu, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mengxia","family":"Yan","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, School of Medicine, Shanghai Ninth People\u2019s Hospital, Shanghai, Huangpuqu, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guiming","family":"Lin","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, School of Medicine, Shanghai Ninth People\u2019s Hospital, Shanghai, Huangpuqu, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"4443","published-online":{"date-parts":[[2022,1,11]]},"reference":[{"key":"10.7717\/peerj.12743\/ref-1","doi-asserted-by":"publisher","first-page":"2037","DOI":"10.1111\/epi.16333","article-title":"Machine learning applications in epilepsy","volume":"60","author":"Abbasi","year":"2019","journal-title":"Epilepsia"},{"key":"10.7717\/peerj.12743\/ref-2","doi-asserted-by":"publisher","first-page":"e17216","DOI":"10.2196\/17216","article-title":"Development and clinical evaluation of a web-based upper limb home rehabilitation system using a smartwatch and machine learning model for chronic stroke survivors: prospective comparative study","volume":"8","author":"Chae","year":"2020","journal-title":"JMIR Mhealth Uhealth"},{"key":"10.7717\/peerj.12743\/ref-3","doi-asserted-by":"crossref","DOI":"10.1017\/S1471068420000290","article-title":"A logic-based decision support system for the diagnosis of headache disorders according to the ICHD-3 international classification","author":"Costabile","year":"2020"},{"issue":"2","key":"10.7717\/peerj.12743\/ref-4","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1111\/j.1526-4610.2010.01828.x","article-title":"Characteristics of the first 1000 headaches in an outpatient headache clinic registry","volume":"51","author":"Guerrero","year":"2011","journal-title":"Headache: The Journal of Head and Face Pain"},{"key":"10.7717\/peerj.12743\/ref-5","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1186\/s10194-018-0854-2","article-title":"The epidemiology of headache disorders: a face-to-face interview of participants in HUNT4","volume":"19","author":"Hagen","year":"2018","journal-title":"Headache"},{"issue":"1","key":"10.7717\/peerj.12743\/ref-6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/0333102417738202","article-title":"Celphalagia","volume":"38","author":"Headache Classification Committee of the International Headache Society (IHS)","year":"2018"},{"issue":"1","key":"10.7717\/peerj.12743\/ref-7","doi-asserted-by":"publisher","first-page":"e0161501","DOI":"10.1371\/journal.pone.0161501","article-title":"SVM and SVM ensembles in breast cancer prediction","volume":"12","author":"Huang","year":"2017","journal-title":"PLOS ONE"},{"key":"10.7717\/peerj.12743\/ref-8","doi-asserted-by":"crossref","DOI":"10.1007\/978-981-10-3187-8_53","article-title":"Clinical application of decision support system for treatment of migraine","author":"Hui","year":"2018"},{"key":"10.7717\/peerj.12743\/ref-9","doi-asserted-by":"publisher","first-page":"174","DOI":"10.4103\/jmss.JMSS_47_18","article-title":"Diagnosis of common headaches using hybrid expert-based systems","volume":"9","author":"Khayamnia","year":"2019","journal-title":"Journal of Medical Signals & Sensors"},{"key":"10.7717\/peerj.12743\/ref-10","doi-asserted-by":"publisher","first-page":"856","DOI":"10.1007\/s00066-020-01626-8","article-title":"Applications of radiomics and machine learning for radiotherapy of malignant brain tumors","volume":"196","author":"Kocher","year":"2020","journal-title":"Strahlentherapie und Onkologie"},{"key":"10.7717\/peerj.12743\/ref-11","doi-asserted-by":"publisher","first-page":"157","DOI":"10.2478\/s11536-012-0098-5","article-title":"Automatic diagnosis of primary headaches by machine learning methods","volume":"8","author":"Krawczyk","year":"2013","journal-title":"Open Medicine"},{"key":"10.7717\/peerj.12743\/ref-12","doi-asserted-by":"publisher","first-page":"16057","DOI":"10.1038\/s41598-020-72685-1","article-title":"Machine learning prediction in cardiovascular diseases: a meta-analysis","volume":"10","author":"Krittanawong","year":"2020","journal-title":"Scientific Reports"},{"key":"10.7717\/peerj.12743\/ref-13","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1016\/j.ejrad.2017.11.001","article-title":"Support Vector Machines (SVM) classification of prostate cancer Gleason score in central gland using multiparametric magnetic resonance images: a cross-validated study","volume":"98","author":"Li","year":"2018","journal-title":"European Journal of Radiology"},{"key":"10.7717\/peerj.12743\/ref-14","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1212\/01.wnl.0000078940.53438.83","article-title":"A self-administered screener for migraine in primary care: the ID Migraine validation study","volume":"61","author":"Lipton","year":"2003","journal-title":"Neurology"},{"key":"10.7717\/peerj.12743\/ref-15","doi-asserted-by":"publisher","first-page":"1733","DOI":"10.2147\/jpr.S165263","article-title":"The role of psychosocial risk factors in the burden of headache","volume":"12","author":"Malmberg-Ceder","year":"2019","journal-title":"Journal of Pain Research"},{"key":"10.7717\/peerj.12743\/ref-16","doi-asserted-by":"publisher","first-page":"1102","DOI":"10.1111\/j.1526-4610.2005.00234.x","article-title":"The predictive value of abbreviated migraine diagnostic criteria","volume":"45","author":"Martin","year":"2005","journal-title":"Headache"},{"key":"10.7717\/peerj.12743\/ref-17","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1007\/s41669-018-0105-0","article-title":"Costs of acute headache medication use and productivity losses among patients with migraine: insights from three randomized controlled trials","volume":"3","author":"Porter","year":"2019","journal-title":"PharmacoEconomics - Open"},{"key":"10.7717\/peerj.12743\/ref-18","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1186\/s10194-020-01139-w","article-title":"Validation of an algorithm for automated classification of migraine and tension-type headache attacks in an electronic headache diary","volume":"21","author":"Roesch","year":"2020","journal-title":"The Journal of Headache and Pain"},{"key":"10.7717\/peerj.12743\/ref-19","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1055\/s-0038-1646946","article-title":"The global burden of headache","volume":"38","author":"Saylor","year":"2018","journal-title":"Seminars in Neurology"},{"key":"10.7717\/peerj.12743\/ref-20","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1093\/neuros\/nyx384","article-title":"Natural and artificial intelligence in neurosurgery: a systematic review","volume":"83","author":"Senders","year":"2018","journal-title":"Neurosurgery"},{"key":"10.7717\/peerj.12743\/ref-21","doi-asserted-by":"publisher","first-page":"738","DOI":"10.1109\/EMBC.2018.8512398","article-title":"Decision supporting model for one-year conversion probability from MCI to AD using CNN and SVM","author":"Shen","year":"2018"},{"issue":"4","key":"10.7717\/peerj.12743\/ref-22","doi-asserted-by":"publisher","first-page":"1890","DOI":"10.3390\/ijerph18041890","article-title":"An application of a hybrid intelligent system for diagnosing primary headaches","volume":"18","author":"Simi\u0107","year":"2021","journal-title":"International Journal of Environmental Research and Public Health"},{"key":"10.7717\/peerj.12743\/ref-23","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1186\/s10194-019-1062-4","article-title":"Prevalence, burden, and clinical management of migraine in China, Japan, and South Korea: a comprehensive review of the literature","volume":"20","author":"Takeshima","year":"2019","journal-title":"The Journal of Headache and Pain"},{"key":"10.7717\/peerj.12743\/ref-24","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1186\/s12911-018-0679-6","article-title":"A decision support system to follow up and diagnose primary headache patients using semantically enriched data","volume":"18","author":"Vandewiele","year":"2018","journal-title":"BMC Medical Informatics and Decision Making"},{"issue":"2","key":"10.7717\/peerj.12743\/ref-25","first-page":"461","article-title":"Assistant decision-making system based on international diagnostic criteria for primary headache disorders","volume":"36","author":"Xiangyong","year":"2019","journal-title":"Application Research of Computers"},{"key":"10.7717\/peerj.12743\/ref-26","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1186\/s10194-019-1048-2","article-title":"Burden of headache disorders in China, 1990-2017: findings from the Global Burden of Disease Study 2017","volume":"20","author":"Yao","year":"2019","journal-title":"The Journal of Headache and Pain"},{"key":"10.7717\/peerj.12743\/ref-27","doi-asserted-by":"publisher","first-page":"582","DOI":"10.1111\/j.1526-4610.2011.02061.x","article-title":"The prevalence and burden of primary headaches in China: a population-based door-to-door survey","volume":"52","author":"Yu","year":"2012","journal-title":"Headache"}],"container-title":["PeerJ"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/peerj.com\/articles\/12743.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/12743.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/12743.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/12743.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,11]],"date-time":"2022-01-11T04:52:24Z","timestamp":1641876744000},"score":1,"resource":{"primary":{"URL":"https:\/\/peerj.com\/articles\/12743"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,11]]},"references-count":27,"alternative-id":["10.7717\/peerj.12743"],"URL":"https:\/\/doi.org\/10.7717\/peerj.12743","archive":["CLOCKSS","LOCKSS","Portico"],"relation":{"has-review":[{"id-type":"doi","id":"10.7287\/peerj.12743v0.3\/reviews\/1","asserted-by":"object"},{"id-type":"doi","id":"10.7287\/peerj.12743v0.1\/reviews\/2","asserted-by":"object"},{"id-type":"doi","id":"10.7287\/peerj.12743v0.1\/reviews\/1","asserted-by":"object"},{"id-type":"doi","id":"10.7287\/peerj.12743v0.2\/reviews\/1","asserted-by":"object"}]},"ISSN":["2167-8359"],"issn-type":[{"value":"2167-8359","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,11]]},"article-number":"e12743"}}