{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T16:01:36Z","timestamp":1791302496943,"version":"4.1.0"},"reference-count":44,"publisher":"Royal College of General Practitioners","issue":"756","license":[{"start":{"date-parts":[[2019,2,12]],"date-time":"2019-02-12T00:00:00Z","timestamp":1549929600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Br J Gen Pract"],"accepted":{"date-parts":[[2024,12,9]]},"published-print":{"date-parts":[[2025,7]]},"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Shortness of breath often prompts calls to out-of-hours primary care and is the prime reason for home visits by GPs. However, a diagnostic prediction model in this setting is lacking.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Aim<\/jats:title>\n                    <jats:p>To develop and internally validate a model predicting life-threatening events for out-of-hours primary care callers with shortness of breath.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design and setting<\/jats:title>\n                    <jats:p>This cross-sectional study includes data from 1952 patients with shortness of breath who called Dutch out-of-hours primary care between September 2020 and August 2021. The trial was registered with the Netherlands Trial Register, number: NL9682.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Method<\/jats:title>\n                    <jats:p>Four logistic regression models were developed with life-threatening events as the outcome. The first model included age and gender (model 1) and then, successively, call characteristics (calling at night and someone else calling on behalf of the patient; model 2), symptoms (cough, fever, inability to speak full sentences and wheezing; model 3), and medical history and medication use (cardiovascular and\/or pulmonary; model 4) were added. The models were internally validated using optimism correction via bootstrap with 1000 repetitions. Performance measures of discrimination (c-statistic) and calibration (calibration intercept and slope) were determined.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Approximately 17% (329\/1952) of callers with shortness of breath had a life-threatening event. Model 3 performed best. This model exhibited good discriminative ability (internal validation c-statistic of 0.76, 95% confidence interval = 0.74 to 0.79) and was well calibrated. All models had a high net benefit compared with using no model. Models 3 and 4 had a higher net benefit compared with models 1 and 2. As models 3 and 4 were similar in terms of net benefit, the model with fewer parameters (model 3) is preferred.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>A prediction model consisting of age, gender, call characteristics, and symptoms holds promise for improving telephone triage of callers to out-of-hours primary care with shortness of breath. However, as the study period coincided with the COVID-19 pandemic, temporal validation is necessary before widespread implementation.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3399\/bjgp.2024.0538","type":"journal-article","created":{"date-parts":[[2025,1,21]],"date-time":"2025-01-21T07:25:14Z","timestamp":1737444314000},"page":"e500-e508","source":"Crossref","is-referenced-by-count":2,"title":["Development and internal validation of a diagnostic prediction model for life-threatening events in callers with shortness of breath: a cross-sectional study in out-of-hours primary care"],"prefix":"10.3399","volume":"75","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5914-4231","authenticated-orcid":false,"given":"Michelle","family":"Spek","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1446-9614","authenticated-orcid":false,"given":"Roderick P","family":"Venekamp","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3473-3398","authenticated-orcid":false,"given":"Anne AH","family":"de Hond","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0388-385X","authenticated-orcid":false,"given":"Esther","family":"de Groot","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6976-9844","authenticated-orcid":false,"given":"Geert-Jan","family":"Geersing","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9084-122X","authenticated-orcid":false,"given":"Anna SM","family":"Dobbe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-7582-2343","authenticated-orcid":false,"given":"Math\u00e9","family":"Delissen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5052-7332","authenticated-orcid":false,"given":"Frans H","family":"Rutten","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5529-1541","authenticated-orcid":false,"given":"Maarten","family":"van Smeden","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0098-4882","authenticated-orcid":false,"given":"Dorien L","family":"Zwart","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1987","published-online":{"date-parts":[[2025,1,21]]},"reference":[{"key":"2026100608352315000_75.756.e500.1","doi-asserted-by":"publisher","DOI":"10.7326\/M16-2776"},{"key":"2026100608352315000_75.756.e500.2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2648.2012.06052.x"},{"key":"2026100608352315000_75.756.e500.3","doi-asserted-by":"publisher","DOI":"10.1093\/fampra\/cmx121"},{"key":"2026100608352315000_75.756.e500.4","unstructured":"Overbeek L (2025) Nivel-cijfers Zorg verleend door huisarts, huisartsenspoedpost, fysiotherapeut, oefentherapeut, di\u00ebtist, logopedist, https:\/\/www.nivel.nl\/nl\/zorg-en-ziekte-in-cijfers\/cijfers-zorgverleners-eerste-lijn . accessed 15 Apr 2025. Nivel figures Care provided by general practitioners, emergency GPs, physiotherapists, exercise therapists, dieticians, speech therapists."},{"key":"2026100608352315000_75.756.e500.5","doi-asserted-by":"publisher","DOI":"10.1093\/fampra\/cmw048"},{"issue":"11","key":"2026100608352315000_75.756.e500.6","doi-asserted-by":"crossref","first-page":"1227","DOI":"10.1111\/acem.13448","article-title":"Causes of shortness of breath in the acute patient: a national study","volume":"25","author":"Hale","year":"2018","journal-title":"Acad Emerg Med"},{"issue":"33\u201334","key":"2026100608352315000_75.756.e500.7","first-page":"563","article-title":"Shortness of breath and cough in patients in palliative care","volume":"110","author":"Bausewein","year":"2013","journal-title":"Dtsch Arztebl Int"},{"key":"2026100608352315000_75.756.e500.8","doi-asserted-by":"publisher","DOI":"10.1007\/s12445-018-0062-y"},{"key":"2026100608352315000_75.756.e500.9","unstructured":"Nederlandse Triage Standaard (2021) Netherlands Triage Standard (Nederlandse Triage Standaard), https:\/\/www.de-nts.nl . accessed 3 Apr 2025."},{"key":"2026100608352315000_75.756.e500.10","doi-asserted-by":"crossref","first-page":"e10","DOI":"10.1017\/S1463423620000122","article-title":"Rationale and design of a cohort study evaluating triage of acute chest pain in out-of-hours primary care in the Netherlands (TRACE)","volume":"21","author":"Manten","year":"2020","journal-title":"Prim Health Care Res Dev"},{"key":"2026100608352315000_75.756.e500.11","doi-asserted-by":"publisher","DOI":"10.1093\/fampra\/cmq097"},{"issue":"1","key":"2026100608352315000_75.756.e500.12","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1186\/s12875-024-02347-y","article-title":"Accuracy of urgency allocation in patients with shortness of breath calling out-of-hours primary care: a cross-sectional study","volume":"25","author":"Spek","year":"2024","journal-title":"BMC Primary Care"},{"key":"2026100608352315000_75.756.e500.13","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacc.2012.06.040"},{"issue":"1","key":"2026100608352315000_75.756.e500.14","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1111\/j.1742-6723.2009.01254.x","article-title":"Verbal dyspnoea score predicts emergency department departure status in patients with shortness of breath","volume":"22","author":"Saracino","year":"2010","journal-title":"Emerg Med Australas"},{"issue":"1","key":"2026100608352315000_75.756.e500.15","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.ijcard.2007.03.119","article-title":"Multimarker strategy for risk prediction in patients presenting with acute dyspnea to the emergency department","volume":"126","author":"Christ","year":"2008","journal-title":"Int J Cardiol"},{"key":"2026100608352315000_75.756.e500.16","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2021-059549"},{"key":"2026100608352315000_75.756.e500.17","unstructured":"(2021) HUS in 2021 (Utrecht Stad), https:\/\/husjaarverslag.pageflow.io\/husin2021#330908 . accessed 15 Apr 2025. Annual report, Huisartsen general practitioners."},{"key":"2026100608352315000_75.756.e500.18","unstructured":"UNICUM Huisartsenzorg (2021) Annual report, UNICUM 2021. UNICUM Huisartsenzorg, https:\/\/www.unicum-huisartsenzorg.nl\/assets\/uploads\/downloads\/Jaarverslag-UNICUM-2021.pdf . accessed 3 Apr 2025."},{"key":"2026100608352315000_75.756.e500.19","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.m441"},{"key":"2026100608352315000_75.756.e500.20","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2022-064402"},{"key":"2026100608352315000_75.756.e500.21","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0294557"},{"key":"2026100608352315000_75.756.e500.22","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btr597"},{"key":"2026100608352315000_75.756.e500.23","doi-asserted-by":"publisher","DOI":"10.1093\/aje\/kwt312"},{"key":"2026100608352315000_75.756.e500.24","doi-asserted-by":"crossref","unstructured":"Harrell FE (2001) Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis (Springer, New York).","DOI":"10.1007\/978-1-4757-3462-1"},{"key":"2026100608352315000_75.756.e500.25","doi-asserted-by":"publisher","DOI":"10.1093\/eurheartj\/ehu207"},{"key":"2026100608352315000_75.756.e500.26","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X06295361"},{"issue":"1","key":"2026100608352315000_75.756.e500.27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s41512-019-0064-7","article-title":"A simple, step-by-step guide to interpreting decision curve analysis","volume":"3","author":"Vickers","year":"2019","journal-title":"Diagn Progn Res"},{"key":"2026100608352315000_75.756.e500.28","doi-asserted-by":"crossref","unstructured":"Harrell FE (2015) Regression modeling strategies with applications to linear models, logistic and ordinal regression, and survival analysis. Springer Series in Statistics (Springer, New York), 2nd edn.","DOI":"10.1007\/978-3-319-19425-7"},{"key":"2026100608352315000_75.756.e500.29","doi-asserted-by":"publisher","DOI":"10.1136\/bmj-2022-073538"},{"issue":"1","key":"2026100608352315000_75.756.e500.30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40900-020-00188-4","article-title":"Designing a tool to support patient and public involvement in research projects: the involvement matrix","volume":"6","author":"Smits","year":"2020","journal-title":"Res Involv Engagem"},{"key":"2026100608352315000_75.756.e500.31","unstructured":"Council for International Organizations of Medical Sciences (2016) International ethical guidelines for health-related research involving humans (CIOMS, Geneva)."},{"key":"2026100608352315000_75.756.e500.32","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2013.281053"},{"key":"2026100608352315000_75.756.e500.33","doi-asserted-by":"publisher","DOI":"10.1093\/fampra\/cmaa064"},{"issue":"1","key":"2026100608352315000_75.756.e500.34","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1055\/s-0042-1759889","article-title":"Clinical features of COVID-19 and differentiation from other causes of CAP","volume":"44","author":"Gao","year":"2023","journal-title":"Semin Respir Crit Care Med"},{"issue":"1","key":"2026100608352315000_75.756.e500.35","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1002\/jmv.27321","article-title":"Fewer non-COVID-19 respiratory tract infections and gastrointestinal infections during the COVID-19 pandemic","volume":"94","author":"Tanislav","year":"2022","journal-title":"J Med Virol"},{"issue":"1","key":"2026100608352315000_75.756.e500.36","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1186\/s41512-017-0012-3","article-title":"Validation of prediction models: examining temporal and geographic stability of baseline risk and estimated covariate effects","volume":"1","author":"Austin","year":"2017","journal-title":"Diagn Progn Res"},{"key":"2026100608352315000_75.756.e500.37","doi-asserted-by":"publisher","DOI":"10.1016\/S0965-2302(98)90077-7"},{"key":"2026100608352315000_75.756.e500.38","doi-asserted-by":"publisher","DOI":"10.1136\/qshc.2006.018846"},{"key":"2026100608352315000_75.756.e500.39","doi-asserted-by":"publisher","DOI":"10.1177\/152715440100200312"},{"key":"2026100608352315000_75.756.e500.40","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-017-2564-x"},{"issue":"3","key":"2026100608352315000_75.756.e500.41","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1002\/emp2.12036","article-title":"Predicting outcome for ambulance patients with dyspnea: a prospective cohort study","volume":"1","author":"Lindskou","year":"2020","journal-title":"JACEP Open"},{"issue":"4","key":"2026100608352315000_75.756.e500.42","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1080\/13814788.2016.1213809","article-title":"The frequency and outcome of acute dyspnoea in primary care: an observational study","volume":"22","author":"von Winckelmann","year":"2016","journal-title":"Eur J Gen Pract"},{"key":"2026100608352315000_75.756.e500.43","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1186\/1756-0500-5-420","article-title":"Likelihood of acute coronary syndrome in emergency department chest pain patients varies with time of presentation","volume":"5","author":"Ekelund","year":"2012","journal-title":"BMC Res Notes"},{"issue":"1","key":"2026100608352315000_75.756.e500.44","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1080\/02813432.2019.1569427","article-title":"Giving callers the option to bypass the telephone waiting line in out-of-hours services: a comparative intervention study","volume":"37","author":"Ebert","year":"2019","journal-title":"Scand J Prim Health Care"}],"container-title":["British Journal of General Practice"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.3399\/BJGP.2024.0538","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T15:35:47Z","timestamp":1791300947000},"score":1,"resource":{"primary":{"URL":"http:\/\/bjgp.org\/lookup\/doi\/10.3399\/BJGP.2024.0538"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,21]]},"references-count":44,"journal-issue":{"issue":"756","published-online":{"date-parts":[[2025,6,26]]},"published-print":{"date-parts":[[2025,7]]}},"alternative-id":["10.3399\/BJGP.2024.0538"],"URL":"https:\/\/doi.org\/10.3399\/bjgp.2024.0538","relation":{},"ISSN":["0960-1643","1478-5242"],"issn-type":[{"value":"0960-1643","type":"print"},{"value":"1478-5242","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,21]]}}}