{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T21:23:37Z","timestamp":1790717017497,"version":"4.1.0"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,8,9]],"date-time":"2022-08-09T00:00:00Z","timestamp":1660003200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,8,9]],"date-time":"2022-08-09T00:00:00Z","timestamp":1660003200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Prim. Care"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Primary Sj\u00f6gren\u2019s Syndrome (pSS) is a rare autoimmune disease that is difficult to diagnose due to a variety of clinical presentations, resulting in misdiagnosis and late referral to specialists. To improve early-stage disease recognition, this study aimed to develop an algorithm to identify possible pSS patients in primary care. We built a machine learning algorithm which was based on combined healthcare data as a first step towards a clinical decision support system.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Method<\/jats:title>\n                <jats:p>Routine healthcare data, consisting of primary care electronic health records (EHRs) data and hospital claims data (HCD), were linked on patient level and consisted of 1411 pSS and 929,179 non-pSS patients. Logistic regression (LR) and random forest (RF) models were used to classify patients using age, gender, diseases and symptoms, prescriptions and GP visits.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The LR and RF models had an AUC of 0.82 and 0.84, respectively. Many actual pSS patients were found (sensitivity LR\u2009=\u200972.3%, RF\u2009=\u200970.1%), specificity was 74.0% (LR) and 77.9% (RF) and the negative predictive value was 99.9% for both models. However, most patients classified as pSS patients did not have a diagnosis of pSS in secondary care (positive predictive value LR\u2009=\u20090.4%, RF\u2009=\u20090.5%).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>This is the first study to use machine learning to classify patients with pSS in primary care using GP EHR data. Our algorithm has the potential to support the early recognition of pSS in primary care and should be validated and optimized in clinical practice. To further enhance the algorithm in detecting pSS in primary care, we suggest it is improved by working with experienced clinicians.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12875-022-01804-w","type":"journal-article","created":{"date-parts":[[2022,8,9]],"date-time":"2022-08-09T05:02:42Z","timestamp":1660021362000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Detection of primary Sj\u00f6gren\u2019s syndrome in primary care: developing a classification model with the use of routine healthcare data and machine learning"],"prefix":"10.1186","volume":"23","author":[{"given":"Jesper T.","family":"Dros","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Isabelle","family":"Bos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Frank C.","family":"Bennis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sytske","family":"Wiegersma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Paget","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chiara","family":"Seghieri","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jaime","family":"Barrio Cort\u00e9s","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert A.","family":"Verheij","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,8,9]]},"reference":[{"key":"1804_CR1","doi-asserted-by":"crossref","unstructured":"Daniels T, Fox. Salivary and oral components of Sj\u00f6gren\u2019s syndrome. Rheum Dis Clin North Am. 1992:571\u2013589.","DOI":"10.1016\/S0889-857X(21)00317-3"},{"key":"1804_CR2","doi-asserted-by":"publisher","unstructured":"Vivino FB. Sjogren's syndrome: Clinical aspects. Clin Immunol. 2017;182:48-54. https:\/\/doi.org\/10.1016\/j.clim.2017.04.005.","DOI":"10.1016\/j.clim.2017.04.005"},{"key":"1804_CR3","doi-asserted-by":"publisher","unstructured":"Qin B, Wang J, Yang Z, Yang M, Ma N, Huang F, Zhong R. Epidemiology of primary Sj\u00f6gren's syndrome: a systematic review and meta-analysis. Ann Rheum Dis. 2015;74(11):1983-9. https:\/\/doi.org\/10.1136\/annrheumdis-2014-205375.","DOI":"10.1136\/annrheumdis-2014-205375"},{"key":"1804_CR4","doi-asserted-by":"publisher","unstructured":"Wiegersma S, Flinterman LE, Seghieri C, et al. Fitness for purpose of routinely recorded health data to identify patients with complex diseases: the case of Sj\u00f6gren\u2019s syndrome. Learn Health Syst. 2020;4(4). https:\/\/doi.org\/10.1002\/lrh2.10242.","DOI":"10.1002\/lrh2.10242"},{"issue":"2","key":"1804_CR5","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1016\/S1474-4422(17)30406-4","volume":"17","author":"JHL Ypinga","year":"2018","unstructured":"Ypinga JHL, de Vries NM, Boonen LHHM, et al. Effectiveness and costs of specialised physiotherapy given via ParkinsonNet: a retrospective analysis of medical claims data. Lancet Neurol. 2018;17(2):153\u201361. https:\/\/doi.org\/10.1016\/S1474-4422(17)30406-4.","journal-title":"Lancet Neurol"},{"key":"1804_CR6","unstructured":"Baldini C, Ferro F, Luciano N, Bombardieri S, Grossi E. Artificial neural networks help to identify disease subsets and to predict lymphoma in primary Sj\u00f6gren's syndrome. Clin Exp Rheumatol. 2018;36 Suppl 112(3):137-44."},{"issue":"1","key":"1804_CR7","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1038\/s41746-020-0221-y","volume":"3","author":"RT Sutton","year":"2020","unstructured":"Sutton RT, Pincock D, Baumgart DC, Sadowski DC, Fedorak RN, Kroeker KI. An overview of clinical decision support systems: benefits, risks, and strategies for success. Npj Digit Med. 2020;3(1):17. https:\/\/doi.org\/10.1038\/s41746-020-0221-y.","journal-title":"Npj Digit Med"},{"key":"1804_CR8","unstructured":"Acar-Denizli N, Kostov B, Ramos-Casals M; Sj\u00f6gren Big Data Consortium. The Big Data Sj\u00f6gren Consortium: a project for a new data science era. Clin Exp Rheumatol. 2019;37 Suppl 118(3):19-23."},{"key":"1804_CR9","doi-asserted-by":"crossref","unstructured":"Ronicke S. Can a decision support system accelerate rare disease diagnosis? Evaluating the potential impact of Ada DX in a retrospective study. 2019;12.","DOI":"10.1136\/annrheumdis-2019-eular.6866"},{"issue":"12","key":"1804_CR10","doi-asserted-by":"publisher","first-page":"941","DOI":"10.1016\/j.ijmedinf.2014.08.009","volume":"83","author":"W Kuchinke","year":"2014","unstructured":"Kuchinke W, Ohmann C, Verheij RA, et al. A standardised graphic method for describing data privacy frameworks in primary care research using a flexible zone model. Int J Med Inf. 2014;83(12):941\u201357. https:\/\/doi.org\/10.1016\/j.ijmedinf.2014.08.009.","journal-title":"Int J Med Inf"},{"key":"1804_CR11","unstructured":"Hasaart F. Incentives in the diagnosis treatment combination payment system for specialist medical care: a study about behavioral responses of medical specialists and hospitals in the Netherlands. Maastricht University; 2011."},{"key":"1804_CR12","unstructured":"Nederlands Huisartsen Genootschap. NHG-Tabel ICPC classificatie. Accessed 3 Feb 2021. https:\/\/www.nhg.org\/themas\/artikelen\/icpc."},{"key":"1804_CR13","unstructured":"World Health Organisation. The Anatomical Therapeutic Chemical classification system. Accessed 3 Feb 2021. https:\/\/www.whocc.no\/atc_ddd_index\/."},{"key":"1804_CR14","unstructured":"Althuis. NHG-Tabel Verrichtingen. Accessed 3 Feb 2021. https:\/\/www.nhg.org\/themas\/artikelen\/nhg-tabel-verrichtingen."},{"key":"1804_CR15","doi-asserted-by":"publisher","unstructured":"Verheij RA, Curcin V, Delaney BC, McGilchrist MM. Possible Sources of Bias in Primary Care Electronic Health Record Data Use and Reuse. J Med Internet Res. 2018;20(5):e185. https:\/\/doi.org\/10.2196\/jmir.9134.","DOI":"10.2196\/jmir.9134"},{"issue":"1","key":"1804_CR16","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1093\/jamia\/ocw054","volume":"24","author":"S van der Bij","year":"2017","unstructured":"van der Bij S, Khan N, ten Veen P, de Bakker DH, Verheij RA. Improving the quality of EHR recording in primary care: a data quality feedback tool. J Am Med Inform Assoc. 2017;24(1):81\u20137. https:\/\/doi.org\/10.1093\/jamia\/ocw054.","journal-title":"J Am Med Inform Assoc"},{"key":"1804_CR17","unstructured":"World Health Organisation. International Classification of Diseases ICD-10. Accessed 3 Feb 2021. https:\/\/www.who.int\/classifications\/classification-of-diseases."},{"issue":"3","key":"1804_CR18","doi-asserted-by":"publisher","DOI":"10.2196\/11929","volume":"7","author":"MMJ Nielen","year":"2019","unstructured":"Nielen MMJ, Spronk I, Davids R, et al. Estimating morbidity rates based on routine electronic health Records in Primary Care: observational study. JMIR Med Inform. 2019;7(3):e11929. https:\/\/doi.org\/10.2196\/11929.","journal-title":"JMIR Med Inform"},{"issue":"12","key":"1804_CR19","doi-asserted-by":"publisher","first-page":"1373","DOI":"10.1016\/S0895-4356(96)00236-3","volume":"49","author":"P Peduzzi","year":"1996","unstructured":"Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49(12):1373\u20139. https:\/\/doi.org\/10.1016\/S0895-4356(96)00236-3.","journal-title":"J Clin Epidemiol"},{"key":"1804_CR20","doi-asserted-by":"crossref","unstructured":"Aikake H. A new look at the statistical model identification. IEEE Trans Autom Control. 1974;19(6):716\u201323. 10.1109.","DOI":"10.1109\/TAC.1974.1100705"},{"key":"1804_CR21","unstructured":"National Health System. Menopause. Accessed 3 Feb 2021. https:\/\/www.nhs.uk\/conditions\/menopause\/#:~:text=The%20menopause%20is%20a%20natural%20before%2040%20years%20of%20age."},{"key":"1804_CR22","unstructured":"Lutgendorf MA, Stoll KA. Why 99% may not be as good as you think it is: limitations of screening for rare diseases. 4."},{"key":"1804_CR23","doi-asserted-by":"publisher","DOI":"10.1016\/j.invent.2020.100337","volume":"21","author":"K van Mens","year":"2020","unstructured":"van Mens K, Elzinga E, Nielen M, et al. Applying machine learning on health record data from general practitioners to predict suicidality. Internet Interv. 2020;21:100337. https:\/\/doi.org\/10.1016\/j.invent.2020.100337.","journal-title":"Internet Interv"},{"issue":"1","key":"1804_CR24","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1002\/art.39859","volume":"69","author":"CH Shiboski","year":"2017","unstructured":"Shiboski CH, Shiboski SC, Seror R, et al. 2016 American College of Rheumatology\/European league against rheumatism classification criteria for primary Sj\u00f6gren\u2019s syndrome: a consensus and data-driven methodology involving three international patient cohorts. Arthritis Rheumatol. 2017;69(1):35\u201345. https:\/\/doi.org\/10.1002\/art.39859.","journal-title":"Arthritis Rheumatol"},{"issue":"6","key":"1804_CR25","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1002\/widm.1072","volume":"2","author":"AL Boulesteix","year":"2012","unstructured":"Boulesteix AL, Janitza S, Kruppa J, K\u00f6nig IR. Overview of random forest methodology and practical guidance with emphasis on computational biology and bioinformatics: random forests in bioinformatics. Wiley Interdiscip Rev Data Min Knowl Discov. 2012;2(6):493\u2013507. https:\/\/doi.org\/10.1002\/widm.1072.","journal-title":"Wiley Interdiscip Rev Data Min Knowl Discov"},{"issue":"12","key":"1804_CR26","doi-asserted-by":"publisher","first-page":"e677","DOI":"10.1016\/S2589-7500(20)30200-4","volume":"2","author":"J Wilkinson","year":"2020","unstructured":"Wilkinson J, Arnold KF, Murray EJ, et al. Time to reality check the promises of machine learning-powered precision medicine. Lancet Digit Health. 2020;2(12):e677\u201380. https:\/\/doi.org\/10.1016\/S2589-7500(20)30200-4.","journal-title":"Lancet Digit Health"},{"key":"1804_CR27","unstructured":"Argyropoulou OD, Valentini E, Ferro F, Leone MC, Cafaro G, Bartoloni E, Baldini C. One year in review 2018: Sj\u00f6gren's syndrome. Clin Exp Rheumatol. 2018;36 Suppl 112(3):14-26."},{"issue":"9","key":"1804_CR28","doi-asserted-by":"publisher","first-page":"1768","DOI":"10.1111\/1756-185X.13641","volume":"22","author":"P Sandhya","year":"2019","unstructured":"Sandhya P, Janardana R, Sudarsanam T, Mahasampath G, Prakash JAJ, Danda D. Determinants of diagnosis and disease course in primary Sj\u00f6gren\u2019s syndrome: results from datamining of electronic health records. Int J Rheum Dis. 2019;22(9):1768\u201374. https:\/\/doi.org\/10.1111\/1756-185X.13641.","journal-title":"Int J Rheum Dis"},{"key":"1804_CR29","doi-asserted-by":"publisher","unstructured":"Foulquier N, Redou P, Le Gal C, Rouvi\u00e8re B, Pers JO, Saraux A. Pathogenesis-based treatments in primary Sjogren\u2019s syndrome using artificial intelligence and advanced machine learning techniques: a systematic literature review. Hum Vaccines Immunother. , 2018:1\u20136. doi:https:\/\/doi.org\/10.1080\/21645515.2018.1475872.","DOI":"10.1080\/21645515.2018.1475872"},{"key":"1804_CR30","doi-asserted-by":"publisher","unstructured":"Damen JAAG, Hooft L, Schuit E, et al. Prediction models for cardiovascular disease risk in the general population: systematic review. BMJ.\u00a02016:i2416. doi:https:\/\/doi.org\/10.1136\/bmj.i2416","DOI":"10.1136\/bmj.i2416"},{"issue":"1","key":"1804_CR31","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1186\/s13023-020-01424-6","volume":"15","author":"J Schaefer","year":"2020","unstructured":"Schaefer J, Lehne M, Schepers J, Prasser F, Thun S. The use of machine learning in rare diseases: a scoping review. Orphanet J Rare Dis. 2020;15(1):145. https:\/\/doi.org\/10.1186\/s13023-020-01424-6.","journal-title":"Orphanet J Rare Dis"}],"container-title":["BMC Primary Care"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12875-022-01804-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12875-022-01804-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12875-022-01804-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,27]],"date-time":"2022-08-27T18:02:47Z","timestamp":1661623367000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcfampract.biomedcentral.com\/articles\/10.1186\/s12875-022-01804-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,9]]},"references-count":31,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["1804"],"URL":"https:\/\/doi.org\/10.1186\/s12875-022-01804-w","relation":{},"ISSN":["2731-4553"],"issn-type":[{"value":"2731-4553","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,9]]},"assertion":[{"value":"17 December 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 July 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 August 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 August 2022","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Update","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"In the original publication, the surname Cort\u00e9s of author Jaime Barrio Cort\u00e9s was incorrect. It should be Barrio Cort\u00e9s.","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Study methods were carried out in accordance with the Declaration of Helsinki and other relevant regulations and guidelines. According to Dutch legislation, no informed consent nor approval by medical ethics committees are needed for these types of observational studies. However, within the Nivel PCD, GPs are obliged to inform their patients about their participation in Nivel PCD and the option to opt out if patients object to inclusion of their data in the database. This project was approved by the governance bodies of Nivel PCD under no. NZR-00317.057.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors do not have any financial or non-financial conflicts of interest to declare.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"199"}}