{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,6]],"date-time":"2026-11-06T17:32:37Z","timestamp":1793986357558,"version":"4.8.0"},"reference-count":24,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T00:00:00Z","timestamp":1684800000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T00:00:00Z","timestamp":1684800000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Headache Pain"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Although headache disorders are common, the current diagnostic approach is unsatisfactory. Previously, we designed a guideline-based clinical decision support system (CDSS 1.0) for diagnosing headache disorders. However, the system requires doctors to enter electronic information, which may limit widespread use.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>In this study, we developed the updated CDSS 2.0, which handles clinical information acquisition via human\u2013computer conversations conducted on personal mobile devices in an outpatient setting. We tested CDSS 2.0 at headache clinics in 16 hospitals in 14 provinces of China.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Of the 653 patients recruited, 18.68% (122\/652) were suspected by specialists to have secondary headaches. According to \u201cred-flag\u201d responses, all these participants were warned of potential secondary risks by CDSS 2.0. For the remaining 531 patients, we compared the diagnostic accuracy of assessments made using only electronic data firstly. In Comparison A, the system correctly recognized 115\/129 (89.15%) cases of migraine without aura (MO), 32\/32 (100%) cases of migraine with aura (MA), 10\/10 (100%) cases of chronic migraine (CM), 77\/95 (81.05%) cases of probable migraine (PM), 11\/11 (100%) cases of infrequent episodic tension-type headache (iETTH), 36\/45 (80.00%) cases of frequent episodic tension-type headache (fETTH), 23\/25 (92.00%) cases of chronic tension-type headache (CTTH), 53\/60 (88.33%) cases of probable tension-type headache (PTTH), 8\/9 (88.89%) cases of cluster headache (CH), 5\/5 (100%) cases of new daily persistent headache (NDPH), and 28\/29 (96.55%) cases of medication overuse headache (MOH). In Comparison B, after combining outpatient medical records, the correct recognition rates of MO (76.03%), MA (96.15%), CM (90%), PM (75.29%), iETTH (88.89%), fETTH (72.73%), CTTH (95.65%), PTTH (79.66%), CH (77.78%), NDPH (80%), and MOH (84.85%) were still satisfactory. A patient satisfaction survey indicated that the conversational questionnaire was very well accepted, with high levels of satisfaction reported by 852 patients.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>The CDSS 2.0 achieved high diagnostic accuracy for most primary and some secondary headaches. Human\u2013computer conversation data were well integrated into the diagnostic process, and the system was well accepted by patients. The follow-up process and doctor\u2013client interactions will be future areas of research for the development of CDSS for headaches.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s10194-023-01586-1","type":"journal-article","created":{"date-parts":[[2023,5,22]],"date-time":"2023-05-22T23:02:49Z","timestamp":1684796569000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Verification of a clinical decision support system for the diagnosis of headache disorders based on patient\u2013computer interactions: a multi-center study"],"prefix":"10.1186","volume":"24","author":[{"given":"Xun","family":"Han","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dongjun","family":"Wan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuhua","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ziming","family":"Yin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Siyang","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fengbo","family":"Xie","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junhong","family":"Guo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongli","family":"Qu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuanrong","family":"Yao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huifang","family":"Xu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dongfang","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sufen","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Faming","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hebo","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chunfu","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qiu","family":"He","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ming","family":"Dong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qi","family":"Wan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanmei","family":"Xu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Min","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fanhong","family":"Yan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaolin","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rongfei","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mingjie","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ye","family":"Ran","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhihua","family":"Jia","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yinglu","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoyan","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lei","family":"Hou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dengfa","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4581-2569","authenticated-orcid":false,"given":"Zhao","family":"Dong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8933-088X","authenticated-orcid":false,"given":"Shengyuan","family":"Yu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,5,23]]},"reference":[{"issue":"11","key":"1586_CR1","doi-asserted-by":"publisher","first-page":"954","DOI":"10.1016\/S1474-4422(18)30322-3","volume":"17","author":"GBDH Collaborators","year":"2018","unstructured":"Collaborators GBDH (2018) Global, regional, and national burden of migraine and tension-type headache, 1990\u20132016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet Neurol 17(11):954\u2013976","journal-title":"Lancet Neurol"},{"issue":"4","key":"1586_CR2","doi-asserted-by":"publisher","first-page":"582","DOI":"10.1111\/j.1526-4610.2011.02061.x","volume":"52","author":"S Yu","year":"2012","unstructured":"Yu S, Liu R, Zhao G, Yang X, Qiao X, Feng J, Fang Y, Cao X, He M, Steiner T (2012) The prevalence and burden of primary headaches in China: a population-based door-to-door survey. Headache 52(4):582\u2013591","journal-title":"Headache"},{"issue":"1","key":"1586_CR3","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1186\/s10194-019-1048-2","volume":"20","author":"C Yao","year":"2019","unstructured":"Yao C, Wang Y, Wang L, Liu Y, Liu J, Qi J, Lin Y, Yin P, Zhou M (2019) Burden of headache disorders in China, 1990\u20132017: findings from the Global Burden of Disease Study 2017. J Headache Pain 20(1):102","journal-title":"J Headache Pain"},{"issue":"1","key":"1586_CR4","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1186\/1129-2377-14-47","volume":"14","author":"R Liu","year":"2013","unstructured":"Liu R, Yu S, He M, Zhao G, Yang X, Qiao X, Feng J, Fang Y, Cao X, Steiner TJ (2013) Health-care utilization for primary headache disorders in China: a population-based door-to-door survey. J Headache Pain 14(1):47","journal-title":"J Headache Pain"},{"issue":"1","key":"1586_CR5","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1186\/s10194-019-1062-4","volume":"20","author":"T Takeshima","year":"2019","unstructured":"Takeshima T, Wan Q, Zhang Y, Komori M, Stretton S, Rajan N, Treuer T, Ueda K (2019) Prevalence, burden, and clinical management of migraine in China, Japan, and South Korea: a comprehensive review of the literature. J Headache Pain 20(1):111","journal-title":"J Headache Pain"},{"issue":"1","key":"1586_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/0333102417738202","volume":"38","author":"Headache Classification Committee of the International Headache Society (IHS)","year":"2018","unstructured":"Headache Classification Committee of the International Headache Society (IHS) (2018) The International Classification of Headache Disorders, 3rd edition. Cephalalgia. 38(1):1\u2013211","journal-title":"Cephalalgia."},{"issue":"1","key":"1586_CR7","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1186\/1129-2377-15-40","volume":"15","author":"Z Dong","year":"2014","unstructured":"Dong Z, Yin Z, He M, Chen X, Lv X, Yu S (2014) Validation of a guideline-based decision support system for the diagnosis of primary headache disorders based on ICHD-3 beta. J Headache Pain 15(1):40","journal-title":"J Headache Pain"},{"key":"1586_CR8","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1186\/s10194-015-0512-x","volume":"16","author":"Z Yin","year":"2015","unstructured":"Yin Z, Dong Z, Lu X, Yu S, Chen X, Duan H (2015) A clinical decision support system for the diagnosis of probable migraine and probable tension-type headache based on case-based reasoning. J Headache Pain 16:29","journal-title":"J Headache Pain"},{"issue":"3","key":"1586_CR9","doi-asserted-by":"publisher","first-page":"134","DOI":"10.1212\/WNL.0000000000006697","volume":"92","author":"TP Do","year":"2019","unstructured":"Do TP, Remmers A, Schytz HW, Schankin C, Nelson SE, Obermann M, Hansen JM, Sinclair AJ, Gantenbein AR, Schoonman GG (2019) Red and orange flags for secondary headaches in clinical practice: SNNOOP10 list. Neurology 92(3):134\u2013144","journal-title":"Neurology"},{"issue":"9","key":"1586_CR10","doi-asserted-by":"publisher","first-page":"991","DOI":"10.1177\/0333102421997850","volume":"41","author":"X Wang","year":"2021","unstructured":"Wang X, Yin Z, Lian Y, Xu Y, Li Y, Liu J, Gu Q, Yan F, Ge Z, Lian Y et al (2021) Premonitory symptoms in migraine from China: A multi-clinic study of 4821 patients. Cephalalgia 41(9):991\u20131003","journal-title":"Cephalalgia"},{"issue":"1","key":"1586_CR11","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1186\/s10194-022-01389-w","volume":"23","author":"N Karsan","year":"2022","unstructured":"Karsan N, Nagaraj K, Goadsby PJ (2022) Cranial autonomic symptoms: prevalence, phenotype and laterality in migraine and two potentially new symptoms. J Headache Pain 23(1):18","journal-title":"J Headache Pain"},{"issue":"2","key":"1586_CR12","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1111\/head.12971","volume":"57","author":"A Taga","year":"2017","unstructured":"Taga A, Russo M, Manzoni GC, Torelli P (2017) Cluster Headache With Accompanying Migraine-Like Features: A Possible Clinical Phenotype. Headache 57(2):290\u2013297","journal-title":"Headache"},{"issue":"1","key":"1586_CR13","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1186\/s10194-022-01490-0","volume":"23","author":"N Vandenbussche","year":"2022","unstructured":"Vandenbussche N, Van Hee C, Hoste V, Paemeleire K (2022) Using natural language processing to automatically classify written self-reported narratives by patients with migraine or cluster headache. J Headache Pain 23(1):129","journal-title":"J Headache Pain"},{"issue":"1","key":"1586_CR14","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1186\/s10194-022-01461-5","volume":"23","author":"Y Ran","year":"2022","unstructured":"Ran Y, Yin Z, Lian Y, Xu Y, Li Y, Liu J, Gu Q, Yan F, Ge Z, Lian Y et al (2022) Gradually shifting clinical phenomics in migraine spectrum: a cross-sectional, multicenter study of 5438 patients. J Headache Pain 23(1):89","journal-title":"J Headache Pain"},{"key":"1586_CR15","doi-asserted-by":"publisher","first-page":"e12743","DOI":"10.7717\/peerj.12743","volume":"10","author":"F Liu","year":"2022","unstructured":"Liu F, Bao G, Yan M, Lin G (2022) A decision support system for primary headache developed through machine learning. PeerJ 10:e12743","journal-title":"PeerJ"},{"issue":"12","key":"1586_CR16","doi-asserted-by":"publisher","first-page":"e50898","DOI":"10.1371\/journal.pone.0050898","volume":"7","author":"Z Dong","year":"2012","unstructured":"Dong Z, Di H, Dai W, Liang J, Pan M, Zhang M, Zhou Z, Li Z, Liu R, Yu S (2012) Application of ICHD-II criteria in a headache clinic of China. PLoS ONE 7(12):e50898","journal-title":"PLoS ONE"},{"issue":"1","key":"1586_CR17","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1111\/head.13397","volume":"59","author":"R Wang","year":"2019","unstructured":"Wang R, Liu R, Dong Z, Su H, Ao R, Liu Y, Wang Y, Ma L, Yu S (2019) Unnecessary Neuroimaging for Patients With Primary Headaches. Headache 59(1):63\u201368","journal-title":"Headache"},{"issue":"1","key":"1586_CR18","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1186\/s10194-018-0875-x","volume":"19","author":"N Vandenbussche","year":"2018","unstructured":"Vandenbussche N, Laterza D, Lisicki M, Lloyd J, Lupi C, Tischler H, Toom K, Vandervorst F, Quintana S, Paemeleire K et al (2018) Medication-overuse headache: a widely recognized entity amidst ongoing debate. J Headache Pain 19(1):50","journal-title":"J Headache Pain"},{"issue":"1","key":"1586_CR19","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1186\/s12911-018-0679-6","volume":"18","author":"G Vandewiele","year":"2018","unstructured":"Vandewiele G, De Backere F, Lannoye K, VandenBerghe M, Janssens O, Van Hoecke S, Keereman V, Paemeleire K, Ongenae F, De Turck F (2018) A decision support system to follow up and diagnose primary headache patients using semantically enriched data. BMC Med Inform Decis Mak 18(1):98","journal-title":"BMC Med Inform Decis Mak"},{"issue":"3","key":"1586_CR20","doi-asserted-by":"publisher","first-page":"174","DOI":"10.4103\/jmss.JMSS_47_18","volume":"9","author":"M Khayamnia","year":"2019","unstructured":"Khayamnia M, Yazdchi M, Heidari A, Foroughipour M (2019) Diagnosis of Common Headaches Using Hybrid Expert-Based Systems. J Med Signals Sens 9(3):174\u2013180","journal-title":"J Med Signals Sens"},{"issue":"4","key":"1586_CR21","doi-asserted-by":"publisher","first-page":"1890","DOI":"10.3390\/ijerph18041890","volume":"18","author":"S Simic","year":"2021","unstructured":"Simic S, Villar JR, Calvo-Rolle JL, Sekulic SR, Simic SD, Simic D (2021) An application of a hybrid intelligent system for diagnosing primary headaches. Int J Environ Res Public Health 18(4):1890","journal-title":"Int J Environ Res Public Health"},{"issue":"2","key":"1586_CR22","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1007\/s40120-023-00438-z","volume":"12","author":"E Bentivegna","year":"2023","unstructured":"Bentivegna E, Onan D, Martelletti P (2023) Unmet needs in preventive treatment of migraine. Neurol Ther 12(2):337\u2013342","journal-title":"Neurol Ther"},{"issue":"1","key":"1586_CR23","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1186\/s10194-022-01460-6","volume":"23","author":"TP Do","year":"2022","unstructured":"Do TP, Stefansen S, Domgaard M, Steiner TJ, Ashina M (2022) One-quarter of individuals with weekly headache have never consulted a medical doctor: a Danish nationwide cross-sectional survey. J Headache Pain 23(1):84","journal-title":"J Headache Pain"},{"issue":"9","key":"1586_CR24","doi-asserted-by":"publisher","first-page":"1358","DOI":"10.1111\/head.13426","volume":"58","author":"DW Dodick","year":"2018","unstructured":"Dodick DW, Tepper SJ, Lipton RB, Buse DC, Stewart WF, Bayliss M, Desai P, Sapra S, Anderson K, McInerney-Prichard E (2018) Improving medical communication in migraine management: a modified Delphi study to develop a digital migraine tracker. Headache 58(9):1358\u20131372","journal-title":"Headache"}],"container-title":["The Journal of Headache and Pain"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s10194-023-01586-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s10194-023-01586-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s10194-023-01586-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,22]],"date-time":"2023-05-22T23:02:51Z","timestamp":1684796571000},"score":1,"resource":{"primary":{"URL":"https:\/\/thejournalofheadacheandpain.biomedcentral.com\/articles\/10.1186\/s10194-023-01586-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,23]]},"references-count":24,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["1586"],"URL":"https:\/\/doi.org\/10.1186\/s10194-023-01586-1","relation":{},"ISSN":["1129-2377"],"issn-type":[{"value":"1129-2377","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,23]]},"assertion":[{"value":"3 April 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 April 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 May 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The research protocol was approved by the Ethics Committee of the Chinese PLA General Hospital. The Institutional Review Board of each participating hospital approved this study.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"57"}}