{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T05:34:24Z","timestamp":1783575264015,"version":"3.55.0"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,10,29]],"date-time":"2022-10-29T00:00:00Z","timestamp":1667001600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,10,29]],"date-time":"2022-10-29T00:00:00Z","timestamp":1667001600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006041","name":"Innovate UK","doi-asserted-by":"publisher","award":["105411"],"award-info":[{"award-number":["105411"]}],"id":[{"id":"10.13039\/501100006041","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006041","name":"Innovate UK","doi-asserted-by":"publisher","award":["105411"],"award-info":[{"award-number":["105411"]}],"id":[{"id":"10.13039\/501100006041","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006041","name":"Innovate UK","doi-asserted-by":"publisher","award":["105411"],"award-info":[{"award-number":["105411"]}],"id":[{"id":"10.13039\/501100006041","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006041","name":"Innovate UK","doi-asserted-by":"publisher","award":["105411"],"award-info":[{"award-number":["105411"]}],"id":[{"id":"10.13039\/501100006041","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006041","name":"Innovate UK","doi-asserted-by":"publisher","award":["105411"],"award-info":[{"award-number":["105411"]}],"id":[{"id":"10.13039\/501100006041","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006041","name":"Innovate UK","doi-asserted-by":"publisher","award":["105411"],"award-info":[{"award-number":["105411"]}],"id":[{"id":"10.13039\/501100006041","id-type":"DOI","asserted-by":"publisher"}]},{"name":"NIHR Leeds In-Vitro Diagnostics Evidence Co-operative"},{"name":"CRUK CanTest Collaborative","award":["C8640\/A23385"],"award-info":[{"award-number":["C8640\/A23385"]}]},{"name":"CRUK CanTest Collaborative","award":["C8640\/A23385"],"award-info":[{"award-number":["C8640\/A23385"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Health Serv Res"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Breast cancer clinics across the UK have long been struggling to cope with high demand. Novel risk prediction tools \u2013 such as the PinPoint test \u2013 could help to reduce unnecessary clinic referrals. Using early data on the expected accuracy of the test, we explore the potential impact of PinPoint on: (a) the percentage of patients meeting the two-week referral target, and (b) the number of clinic \u2018overspill\u2019 appointments generated (i.e. patients having to return to the clinic to complete their required investigations).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>A simulation model was built to reflect the annual flow of patients through a single UK clinic. Due to current uncertainty around the exact impact of PinPoint testing on standard care, two primary scenarios were assessed. Scenario 1 assumed complete GP adherence to testing, with only non-referred cancerous cases returning for delayed referral. Scenario 2 assumed GPs would overrule 20% of low-risk results, and that 10% of non-referred non-cancerous cases would also return for delayed referral. A range of sensitivity analyses were conducted to explore the impact of key uncertainties on the model results. Service reconfiguration scenarios, removing individual weekly clinics from the clinic schedule, were also explored.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Under standard care, 66.3% (95% CI: 66.0 to 66.5) of patients met the referral target, with 1,685 (1,648 to 1,722) overspill appointments. Under both PinPoint scenarios, &gt;\u200998% of patients met the referral target, with overspill appointments reduced to between 727 (707 to 746) [Scenario 1] and 886 (861 to 911) [Scenario 2]. The reduced clinic demand was sufficient to allow removal of one weekly low-capacity clinic [N\u2009=\u200910], and the results were robust to sensitivity analyses.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>The findings from this early analysis indicate that risk prediction tools could have the potential to alleviate pressure on cancer clinics, and are expected to have increased utility in the wake of heightened pressures resulting from the COVID-19 pandemic. Further research is required to validate these findings with real world evidence; evaluate the broader clinical and economic impact of the test; and to determine outcomes and risks for patients deemed to be low-risk on the PinPoint test and therefore not initially referred.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12913-022-08665-0","type":"journal-article","created":{"date-parts":[[2022,10,29]],"date-time":"2022-10-29T09:11:02Z","timestamp":1667034662000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["An exploratory assessment of the impact of a novel risk assessment test on breast cancer clinic waiting times and workflow: a discrete event simulation model"],"prefix":"10.1186","volume":"22","author":[{"given":"Alison F.","family":"Smith","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Samuel N.","family":"Frempong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nisha","family":"Sharma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard D.","family":"Neal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Louise","family":"Hick","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bethany","family":"Shinkins","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,10,29]]},"reference":[{"issue":"7614","key":"8665_CR1","doi-asserted-by":"publisher","first-page":"288","DOI":"10.1136\/bmj.39258.688553.55","volume":"335","author":"S Potter","year":"2007","unstructured":"Potter S, Govindarajulu S, Shere M, Braddon F, Curran G, Greenwood R, et al. Referral patterns, cancer diagnoses, and waiting times after introduction of two week wait rule for breast cancer: prospective cohort study. BMJ. 2007;335(7614):288.","journal-title":"BMJ"},{"issue":"3","key":"8665_CR2","doi-asserted-by":"publisher","first-page":"262","DOI":"10.1054\/brst.2001.0390","volume":"11","author":"P Sauven","year":"2002","unstructured":"Sauven P. Impact of the \u20182 week wait\u2019 on referrals to breast units in the UK. The Breast. 2002;11(3):262\u20134.","journal-title":"The Breast"},{"key":"8665_CR3","unstructured":"National Collaborating Centre for Cancer. Suspected cancer: recognition and referral. NICE Guideline [NG12]. https:\/\/www.nice.org.uk\/guidance\/ng12. Accessed April 2021."},{"key":"8665_CR4","unstructured":"NHS England. Annual NHS cancer checks top two million for the first time. https:\/\/www.england.nhs.uk\/2019\/04\/annual-nhs-cancer-checks-top-two-million-for-the-first-time\/. Accessed April 2021."},{"key":"8665_CR5","unstructured":"NHS England. Cancer Waiting Times Annual Report, 2015-16. https:\/\/www.england.nhs.uk\/statistics\/statistical-work-areas\/cancer-waiting-times\/cwt-annual-reports\/cwt-annual-report-2015-16\/. Accessed April 2021."},{"key":"8665_CR6","unstructured":"NHS England. Cancer Waiting Times Annual Report, 2019-20. https:\/\/www.england.nhs.uk\/statistics\/statistical-work-areas\/cancer-waiting-times\/cwt-annual-reports\/cancer-waiting-times-annual-report-2019-20\/. Accessed April 2021."},{"key":"8665_CR7","unstructured":"NHS England. Cancer Waiting Times Annual Report, 2017-18. https:\/\/www.england.nhs.uk\/statistics\/statistical-work-areas\/cancer-waiting-times\/cwt-annual-reports\/cancer-waiting-times-annual-report-2017-18\/. Accessed April 2021."},{"key":"8665_CR8","unstructured":"NHS England. Cancer Waiting Times Annual Report, 2018-19. https:\/\/www.england.nhs.uk\/statistics\/statistical-work-areas\/cancer-waiting-times\/cwt-annual-reports\/statistical-work-areas-cancer-waiting-times-cwt-annual-reports-cancer-waiting-times-annual-report-2018-19\/. Accessed April 2021."},{"key":"8665_CR9","unstructured":"Nuffield Trust & The Health Foundation. Cancer waiting times. https:\/\/www.nuffieldtrust.org.uk\/resource\/cancer-waiting-time-targets#background. Accessed April 2021."},{"key":"8665_CR10","unstructured":"NHS England. Cancer Waiting Time Statistics. http:\/\/www.england.nhs.uk\/statistics\/statistical-work-areas\/cancer-waiting-times. Accessed April 2021."},{"key":"8665_CR11","unstructured":"PinPoint Data Science Ltd. Early Cancer Detection. https:\/\/www.pinpointdatascience.com\/. Accessed April 2021."},{"issue":"4","key":"8665_CR12","doi-asserted-by":"publisher","first-page":"e053590","DOI":"10.1136\/bmjopen-2021-053590","volume":"12","author":"R Savage","year":"2022","unstructured":"Savage R, Messenger M, Neal RD, Ferguson R, Johnston C, Lloyd KL, et al. Development and validation of multivariable machine learning algorithms to predict risk of cancer in symptomatic patients referred urgently from primary care: a diagnostic accuracy study. BMJ Open. 2022;12(4):e053590.","journal-title":"BMJ Open"},{"issue":"1","key":"8665_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12913-018-3456-4","volume":"18","author":"X Zhang","year":"2018","unstructured":"Zhang X. Application of discrete event simulation in health care: a systematic review. BMC Health Serv Res. 2018;18(1):1\u201311.","journal-title":"BMC Health Serv Res"},{"issue":"22","key":"8665_CR14","doi-asserted-by":"publisher","first-page":"12262","DOI":"10.3390\/ijerph182212262","volume":"18","author":"JI V\u00e1zquez-Serrano","year":"2021","unstructured":"V\u00e1zquez-Serrano JI, Peimbert-Garc\u00eda RE, C\u00e1rdenas-Barr\u00f3n LE. Discrete-Event Simulation Modeling in Healthcare: A Comprehensive Review. Int J Environ Res Public Health. 2021;18(22):12262.","journal-title":"Int J Environ Res Public Health"},{"issue":"5","key":"8665_CR15","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1017\/S0266462315000598","volume":"31","author":"T Bessen","year":"2015","unstructured":"Bessen T, Keefe DM, Karnon J. Does one size fit all? Cost utility analyses of alternative mammographic follow-up schedules, by risk of recurrence. Int J Technol Assess Health Care. 2015;31(5):281\u20138.","journal-title":"Int J Technol Assess Health Care"},{"issue":"5","key":"8665_CR16","doi-asserted-by":"publisher","first-page":"e97459","DOI":"10.1371\/journal.pone.0097459","volume":"9","author":"M Comas","year":"2014","unstructured":"Comas M, Arrospide A, Mar J, Sala M, Vilapriny\u00f3 E, Hern\u00e1ndez C, et al. Budget impact analysis of switching to digital mammography in a population-based breast cancer screening program: a discrete event simulation model. PLoS ONE. 2014;9(5):e97459.","journal-title":"PLoS ONE"},{"issue":"1","key":"8665_CR17","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1093\/jnci\/djz037","volume":"112","author":"J Furzer","year":"2020","unstructured":"Furzer J, Tessier L, Hodgson D, Cotton C, Nathan PC, Gupta S, et al. Cost-Utility of Early Breast Cancer Surveillance in Survivors of Thoracic Radiation-Treated Adolescent Hodgkin Lymphoma. J Natl Cancer Inst. 2020;112(1):63\u201370.","journal-title":"J Natl Cancer Inst"},{"issue":"3","key":"8665_CR18","doi-asserted-by":"publisher","first-page":"772","DOI":"10.1148\/radiol.14141237","volume":"274","author":"CI Lee","year":"2015","unstructured":"Lee CI, Cevik M, Alagoz O, Sprague BL, Tosteson AN, Miglioretti DL, et al. Comparative effectiveness of combined digital mammography and tomosynthesis screening for women with dense breasts. Radiology. 2015;274(3):772\u201380.","journal-title":"Radiology"},{"issue":"11","key":"8665_CR19","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1093\/jnci\/djj210","volume":"98","author":"NK Stout","year":"2006","unstructured":"Stout NK, Rosenberg MA, Trentham-Dietz A, Smith MA, Robinson SM, Fryback DG. Retrospective Cost-effectiveness Analysis of Screening Mammography. JNCI: J Natl Cancer Inst. 2006;98(11):774\u201382.","journal-title":"JNCI: J Natl Cancer Inst"},{"issue":"3","key":"8665_CR20","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1016\/j.cmpb.2007.05.006","volume":"87","author":"FC Coelli","year":"2007","unstructured":"Coelli FC, Ferreira RB, Almeida RMV, Pereira WCA. Computer simulation and discrete-event models in the analysis of a mammography clinic patient flow. Comput Methods Programs Biomed. 2007;87(3):201\u20137.","journal-title":"Comput Methods Programs Biomed"},{"issue":"2","key":"8665_CR21","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1007\/s10278-018-0159-7","volume":"32","author":"T Amir","year":"2019","unstructured":"Amir T, Lee B, Woods RW, Mullen LA, Harvey SC. A pilot of data-driven modeling to assess potential for improved efficiency in an academic breast-imaging center. J Digit Imaging. 2019;32(2):221\u20137.","journal-title":"J Digit Imaging"},{"issue":"1","key":"8665_CR22","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1080\/17477778.2018.1442155","volume":"13","author":"T Monks","year":"2019","unstructured":"Monks T, Currie CS, Onggo BS, Robinson S, Kunc M, Taylor SJ. Strengthening the reporting of empirical simulation studies: Introducing the STRESS guidelines. J Simul. 2019;13(1):55\u201367.","journal-title":"J Simul"},{"key":"8665_CR23","unstructured":"NHS England. 2018\/19 Monthly Provider Cancer Waiting Times Statistics. https:\/\/www.england.nhs.uk\/statistics\/statistical-work-areas\/cancer-waiting-times\/monthly-prov-cwt\/2018-19-monthly-provider-cancer-waiting-times-statistics\/. Accessed April 2021."},{"issue":"4","key":"8665_CR24","doi-asserted-by":"publisher","first-page":"710","DOI":"10.1038\/s41416-020-01182-z","volume":"124","author":"T Gathani","year":"2021","unstructured":"Gathani T, Clayton G, MacInnes E, Horgan K. The COVID-19 pandemic and impact on breast cancer diagnoses: what happened in England in the first half of 2020. Br J Cancer. 2021;124(4):710\u20132.","journal-title":"Br J Cancer"},{"key":"8665_CR25","doi-asserted-by":"crossref","unstructured":"Dave RV, Kim B, Courtney A, O\u2019Connell R, Rattay T, Taxiarchi VP, et al. Breast cancer management pathways during the COVID-19 pandemic: outcomes from the UK \u2018Alert Level 4\u2019phase of the B-MaP-C study. British Journal of Cancer. 2021:1\u201310.","DOI":"10.1038\/s41416-021-01465-z"},{"key":"8665_CR26","unstructured":"West Yorkshire and Harrogate Cancer Alliance. The PinPoint Test https:\/\/canceralliance.wyhpartnership.co.uk\/our-work\/innovations-programme\/pinpoint-test. Accessed May 2022."},{"issue":"6","key":"8665_CR27","doi-asserted-by":"publisher","first-page":"e18","DOI":"10.1016\/j.ejso.2020.03.068","volume":"46","author":"S Blacker","year":"2020","unstructured":"Blacker S, Jordache R, Pakzad F. P029: Can two week wait breast cancer referrals be triaged to prioritise high risk patients for early diagnosis and treatment? Eur J Surg Oncol. 2020;46(6):e18.","journal-title":"Eur J Surg Oncol"},{"issue":"2","key":"8665_CR28","doi-asserted-by":"publisher","first-page":"zraa023","DOI":"10.1093\/bjsopen\/zraa023","volume":"5","author":"S Ramzi","year":"2021","unstructured":"Ramzi S, Cant P. Comparison of the urgent referral for suspected breast cancer process with patient age and a predictive multivariable model. BJS open. 2021;5(2):zraa023.","journal-title":"BJS open"},{"issue":"1","key":"8665_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2407-14-743","volume":"14","author":"R Galvin","year":"2014","unstructured":"Galvin R, Joyce D, Downey E, Boland F, Fahey T, Hill AK. Development and validation of a clinical prediction rule to identify suspected breast cancer: a prospective cohort study. BMC Cancer. 2014;14(1):1\u20138.","journal-title":"BMC Cancer"}],"container-title":["BMC Health Services Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12913-022-08665-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12913-022-08665-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12913-022-08665-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,29]],"date-time":"2022-10-29T09:11:38Z","timestamp":1667034698000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmchealthservres.biomedcentral.com\/articles\/10.1186\/s12913-022-08665-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,29]]},"references-count":29,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["8665"],"URL":"https:\/\/doi.org\/10.1186\/s12913-022-08665-0","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2022.06.13.22276333","asserted-by":"object"}]},"ISSN":["1472-6963"],"issn-type":[{"value":"1472-6963","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,29]]},"assertion":[{"value":"4 November 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 October 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 October 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable (no human participants were involved in this research).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"AS, SF, RN and BS work at the University of Leeds. NS and LH work at the Leeds Teaching Hospitals NHS Trust (LTHT). Both the University of Leeds and the LTHT have a royalty agreement with PinPoint Data Science Ltd, meaning that those institutions are likely to benefit financially in the event of the PinPoint test being commercially successful.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"1301"}}