{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T04:55:46Z","timestamp":1769576146582,"version":"3.49.0"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2020,5,8]],"date-time":"2020-05-08T00:00:00Z","timestamp":1588896000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,5,8]],"date-time":"2020-05-08T00:00:00Z","timestamp":1588896000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Universit\u00e4t Augsburg"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Med Syst"],"published-print":{"date-parts":[[2020,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Emergency departments need to continuously calculate quality indicators in order to perform structural improvements, improvements in the daily routine, and ad-hoc improvements in everyday life. However, many different actors across multiple disciplines collaborate to provide emergency care. Hence, patient-related data is stored in several information systems, which in turn makes the calculation of quality indicators more difficult. To address this issue, we aim to link and use routinely collected data of the different actors within the emergency care continuum. In order to assess the feasibility of linking and using routinely collected data for quality indicators and whether this approach adds value to the assessment of emergency care quality, we conducted a single case study in a German academic teaching hospital. We analyzed the available data of the existing information systems in the emergency continuum and linked and pre-processed the data. Based on this, we then calculated four quality indicators (Left Without Been Seen, Unplanned Reattendance, Diagnostic Efficiency, and Overload Closure). Lessons learned from the calculation and results of the discussions with staff members that had multiple years of work experience in the emergency department provide a better understanding of the quality of the emergency department, the related challenges during the calculation, and the added value of linking routinely collected data.<\/jats:p>","DOI":"10.1007\/s10916-020-01572-z","type":"journal-article","created":{"date-parts":[[2020,5,8]],"date-time":"2020-05-08T16:03:37Z","timestamp":1588953817000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Assessing healthcare service quality using routinely collected data: Linking information systems in emergency care"],"prefix":"10.1007","volume":"44","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6993-8836","authenticated-orcid":false,"given":"Harald","family":"Dormann","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9256-537X","authenticated-orcid":false,"given":"Patrick Andreas","family":"Eder","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1730-2614","authenticated-orcid":false,"given":"Henner","family":"Gimpel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1163-5656","authenticated-orcid":false,"given":"Oliver","family":"Meindl","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Asarnusch","family":"Rashid","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4226-3402","authenticated-orcid":false,"given":"Christian","family":"Regal","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,5,8]]},"reference":[{"issue":"15","key":"1572_CR1","doi-asserted-by":"publisher","first-page":"261","DOI":"10.3238\/arztebl.2010.0261","volume":"107","author":"H Dormann","year":"2010","unstructured":"Dormann H, Diesch K, Ganslandt T et al. (2010) Numerical parameters and quality indicators in a medical emergency department. Dtsch. Arztebl. Int. 107(15): 261\u2013267. doi: https:\/\/doi.org\/10.3238\/arztebl.2010.0261","journal-title":"Dtsch. Arztebl. Int."},{"key":"1572_CR2","volume-title":"Herausforderung Notfallmedizin","year":"2018","unstructured":"Neumayr A, Baubin M, Schinnerl A (eds) (2018) Herausforderung Notfallmedizin. Springer Berlin Heidelberg, Berlin, Heidelberg"},{"issue":"5","key":"1572_CR3","doi-asserted-by":"publisher","first-page":"409","DOI":"10.1007\/s00063-016-0180-x","volume":"113","author":"A. C. H\u00f6rster","year":"2016","unstructured":"H\u00f6rster AC, Kulla M, Brammen D et al. (2016) Potential for the survey of quality indicators based on a national emergency department registry: a systematic literature search (Potential for the survey of quality indicators based on a national emergency department registry : A systematic literature search). Med Klin Intensivmed Notfmed doi: https:\/\/doi.org\/10.1007\/s00063-016-0180-x","journal-title":"Medizinische Klinik - Intensivmedizin und Notfallmedizin"},{"issue":"4","key":"1572_CR4","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1097\/MEJ.0000000000000454","volume":"25","author":"G Noel","year":"2018","unstructured":"Noel G, Drigues C, Viudes G (2018) Which indicators to include in a crowding scale in an emergency department? A national French Delphi study. Eur J Emerg Med 25(4): 257\u2013263. doi: https:\/\/doi.org\/10.1097\/MEJ.0000000000000454","journal-title":"Eur J Emerg Med"},{"issue":"1","key":"1572_CR5","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1186\/s13049-017-0362-4","volume":"25","author":"H Haugland","year":"2017","unstructured":"Haugland H, Rehn M, Klepstad P et al. (2017) Developing quality indicators for physician-staffed emergency medical services: a consensus process. Scand J Trauma Resusc Emerg Med 25(1): 14. doi: https:\/\/doi.org\/10.1186\/s13049-017-0362-4","journal-title":"Scand J Trauma Resusc Emerg Med"},{"issue":"5","key":"1572_CR6","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1097\/MEJ.0000000000000279","volume":"22","author":"M Madsen","year":"2015","unstructured":"Madsen M, Kiuru S, Castr\u00e8n M et al. (2015) The level of evidence for emergency department performance indicators: Systematic review. Eur J Emerg Med 22(5): 298\u2013305. doi: https:\/\/doi.org\/10.1097\/MEJ.0000000000000279","journal-title":"Eur J Emerg Med"},{"key":"1572_CR7","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1186\/s13049-016-0203-x","volume":"24","author":"MM Madsen","year":"2016","unstructured":"Madsen MM, Eiset AH, Mackenhauer J et al. (2016) Selection of quality indicators for hospital-based emergency care in Denmark, informed by a modified-Delphi process. Scand J Trauma Resusc Emerg Med 24: 11. doi: https:\/\/doi.org\/10.1186\/s13049-016-0203-x","journal-title":"Scand J Trauma Resusc Emerg Med"},{"key":"1572_CR8","doi-asserted-by":"publisher","unstructured":"Mattsson MS, Oettinger M, J\u00f8rsboe H (2013) Health care quality in a new Emergency Department based on the Danish Stroke register data. Scand J Trauma Resusc Emerg Med 21(S2). doi: https:\/\/doi.org\/10.1186\/1757-7241-21-S2-A27","DOI":"10.1186\/1757-7241-21-S2-A27"},{"key":"1572_CR9","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1186\/s13049-014-0060-4","volume":"22","author":"MS Mattsson","year":"2014","unstructured":"Mattsson MS, Mattsson N, J\u00f8rsboe HB (2014) Improvement of clinical quality indicators through reorganization of the acute care by establishing an emergency department-a register study based on data from national indicators. Scand J Trauma Resusc Emerg Med 22: 60. doi: https:\/\/doi.org\/10.1186\/s13049-014-0060-4","journal-title":"Scand J Trauma Resusc Emerg Med"},{"issue":"6","key":"1572_CR10","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1097\/MEJ.0000000000000586","volume":"26","author":"F Lapostolle","year":"2019","unstructured":"Lapostolle F, Bataille S, Loyeau A et al. (2019) Decision to deploy coronary reperfusion is not affected by the volume of ST-segment elevation myocardial infarction patients managed by prehospital emergency medical teams. Eur J Emerg Med 26(6): 423\u2013427. doi: https:\/\/doi.org\/10.1097\/MEJ.0000000000000586","journal-title":"Eur J Emerg Med"},{"issue":"5","key":"1572_CR11","doi-asserted-by":"publisher","first-page":"366","DOI":"10.1097\/MEJ.0000000000000232","volume":"22","author":"J Gorlicki","year":"2015","unstructured":"Gorlicki J, Raynal P-A, Leleu A et al. (2015) Reliability of electronic recording of waiting times in the emergency department: a prospective multicenter study. Eur J Emerg Med 22(5): 366\u2013369. doi: https:\/\/doi.org\/10.1097\/MEJ.0000000000000232","journal-title":"Eur J Emerg Med"},{"issue":"214","key":"1572_CR12","first-page":"77008","volume":"81","author":"Centers for Medicare & Medicaid Services (CMS)","year":"2016","unstructured":"Centers for Medicare & Medicaid Services (CMS), HHS (2016) Medicare Program; Merit-Based Incentive Payment System (MIPS) and Alternative Payment Model (APM) Incentive Under the Physician Fee Schedule, and Criteria for Physician-Focused Payment Models. Final rule with comment period Fed Regist 81(214): 77008\u201377831","journal-title":"Final rule with comment period Fed Regist"},{"key":"1572_CR13","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1186\/1757-7241-21-62","volume":"21","author":"CM S\u00f8rup","year":"2013","unstructured":"S\u00f8rup CM, Jacobsen P, Forberg JL (2013) Evaluation of emergency department performance - a systematic review on recommended performance and quality-in-care measures. Scand J Trauma Resusc Emerg Med 21: 62. doi: https:\/\/doi.org\/10.1186\/1757-7241-21-62","journal-title":"Scand J Trauma Resusc Emerg Med"},{"issue":"8","key":"1572_CR14","doi-asserted-by":"publisher","first-page":"646","DOI":"10.1007\/s10049-016-0236-8","volume":"19","author":"M. Kulla","year":"2016","unstructured":"Kulla M, Goertler M., Somasundaram R. et al. (2016) Bewertung von Qualit\u00e4tsindikatoren f\u00fcr die Notaufnahme. Notfall Rettungsmed 19(8): 646\u2013656. doi: https:\/\/doi.org\/10.1007\/s10049-016-0236-8","journal-title":"Notfall + Rettungsmedizin"},{"key":"1572_CR15","doi-asserted-by":"publisher","unstructured":"Afilal M, Yalaoui F, Dugardin F et al. (2016) Forecasting the Emergency Department Patients Flow. J Med Syst 40(7): 175. doi: https:\/\/doi.org\/10.1007\/s10916-016-0527-0","DOI":"10.1007\/s10916-016-0527-0"},{"key":"1572_CR16","doi-asserted-by":"publisher","unstructured":"Kadri F, Harrou F, Chaabane S et al. (2014) Time series modelling and forecasting of emergency department overcrowding. J Med Syst 38(9): 107. doi: https:\/\/doi.org\/10.1007\/s10916-014-0107-0","DOI":"10.1007\/s10916-014-0107-0"},{"issue":"13","key":"1572_CR17","doi-asserted-by":"publisher","first-page":"1216","DOI":"10.1056\/NEJMp1606181","volume":"375","author":"Ziad Obermeyer","year":"2016","unstructured":"Obermeyer Z, Emanuel EJ (2016) Predicting the Future - Big Data, Machine Learning, and Clinical Medicine. N Engl J Med\u00a0375(13): 1216\u20131219. doi: https:\/\/doi.org\/10.1056\/NEJMp1606181","journal-title":"New England Journal of Medicine"},{"issue":"4","key":"1572_CR18","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1007\/s10049-015-0011-2","volume":"18","author":"J Searle","year":"2015","unstructured":"Searle J, Muller R, Slagman A et al. (2015) \u00dcberf\u00fcllung der Notaufnahmen. Notfall Rettungsmed 18(4): 306\u2013315. https:\/\/doi.org\/10.1007\/s10049-015-0011-2","journal-title":"Notfall Rettungsmed"},{"key":"1572_CR19","doi-asserted-by":"publisher","unstructured":"Starnes JR, Wanderer JP, Ehrenfeld JM (2015) Metadata from data: identifying holidays from anesthesia data. J Med Syst 39(5): 44. https:\/\/doi.org\/10.1007\/s10916-015-0232-4","DOI":"10.1007\/s10916-015-0232-4"},{"issue":"4","key":"1572_CR20","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1097\/MEJ.0b013e328356fa0e","volume":"20","author":"J Crilly","year":"2013","unstructured":"Crilly J, Bost N, Thalib L et al. (2013) Patients who present to the emergency department and leave without being seen: Prevalence, predictors and outcomes. Eur J Emerg Med 20(4): 248\u2013255. doi: https:\/\/doi.org\/10.1097\/MEJ.0b013e328356fa0e","journal-title":"Eur J Emerg Med"},{"issue":"8","key":"1572_CR21","doi-asserted-by":"publisher","first-page":"671","DOI":"10.1007\/s10049-014-1860-9","volume":"17","author":"M Kulla","year":"2014","unstructured":"Kulla M, Baacke M, Sch\u00f6pke T et al. (2014) Kerndatensatz \"Notaufnahme\" der DIVI. Notfall Rettungsmed 17(8): 671\u2013681. doi: https:\/\/doi.org\/10.1007\/s10049-014-1860-9","journal-title":"Notfall Rettungsmed"},{"key":"1572_CR22","doi-asserted-by":"publisher","unstructured":"van der Linden, M. C., Lindeboom R, de Haan R et al. (2014) Unscheduled return visits to a Dutch inner-city emergency department. Int J Emerg Med 7(1): 23. https:\/\/doi.org\/10.1186\/s12245-014-0023-6","DOI":"10.1186\/s12245-014-0023-6"},{"issue":"3","key":"1572_CR23","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1111\/j.1553-2712.2000.tb01066.x","volume":"7","author":"RC Wuerz","year":"2000","unstructured":"Wuerz RC, Milne LW, Eitel DR et al. (2000) Reliability and Validity of a New Five-level Triage Instrument. Acad. Emerg. Med. Off. J. Soc. Acad. Emerg. Med 7(3): 236\u2013242. doi: https:\/\/doi.org\/10.1111\/j.1553-2712.2000.tb01066.x","journal-title":"Acad. Emerg. Med. Off. J. Soc. Acad. Emerg. Med"},{"issue":"3","key":"1572_CR24","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1007\/s10039-013-2004-z","volume":"15","author":"H Hilt","year":"2013","unstructured":"Hilt H (2013) Triage in der Notaufnahme. Trauma Berufskrankh 15(3): 164\u2013169. doi: https:\/\/doi.org\/10.1007\/s10039-013-2004-z","journal-title":"Trauma Berufskrankh"},{"issue":"3","key":"1572_CR25","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1007\/s10049-019-0611-3","volume":"23","author":"F. Wilk","year":"2019","unstructured":"Wilk F, Grosse F, Liebel J et al. (2019) Diagnosen einer Zentralen Notaufnahme als Qualit\u00e4tsindikator. Notfall Rettungsmed\u00a0https:\/\/doi.org\/10.1007\/s10049-019-0611-3","journal-title":"Notfall + Rettungsmedizin"},{"issue":"2","key":"1572_CR26","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1097\/MEJ.0b013e328351e609","volume":"20","author":"M Mockel","year":"2013","unstructured":"Mockel M, Searle J, Muller R et al. (2013) Chief complaints in medical emergencies: do they relate to underlying disease and outcome? The Charit\u00e9 Emergency Medicine Study (CHARITEM). Eur J Emerg Med 20(2): 103\u2013108. doi: https:\/\/doi.org\/10.1097\/MEJ.0b013e328351e609","journal-title":"Eur J Emerg Med"},{"key":"1572_CR27","doi-asserted-by":"publisher","unstructured":"Sa\u011fba\u015f EA, Korukoglu S, Balli S (2020) Stress Detection via Keyboard Typing Behaviors by Using Smartphone Sensors and Machine Learning Techniques. J Med Syst\u00a044(4): 68. doi: https:\/\/doi.org\/10.1007\/s10916-020-1530-z","DOI":"10.1007\/s10916-020-1530-z"},{"issue":"1","key":"1572_CR28","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1197\/j.aem.2003.07.017","volume":"11","author":"SJ Weiss","year":"2004","unstructured":"Weiss SJ, Derlet R, Arndahl J et al. (2004) Estimating the degree of emergency department overcrowding in academic medical centers: results of the National ED Overcrowding Study (NEDOCS). Acad. Emerg. Med. Off. J. Soc. Acad. Emerg. Med 11(1): 38\u201350. doi: https:\/\/doi.org\/10.1197\/j.aem.2003.07.017","journal-title":"Acad. Emerg. Med. Off. J. Soc. Acad. Emerg. Med"},{"issue":"1","key":"1572_CR29","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1109\/JBHI.2017.2698418","volume":"22","author":"Krishan L. Khatri","year":"2018","unstructured":"Khatri KL, Tamil L (2017) Early detection of peak demand days of chronic respiratory diseases emergency department visits using artificial neural networks. IEEE J Biomed Health Inform\nhttps:\/\/doi.org\/10.1109\/JBHI.2017.2698418","journal-title":"IEEE Journal of Biomedical and Health Informatics"}],"container-title":["Journal of Medical Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10916-020-01572-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10916-020-01572-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10916-020-01572-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,8]],"date-time":"2021-05-08T00:40:57Z","timestamp":1620434457000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10916-020-01572-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,8]]},"references-count":29,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2020,6]]}},"alternative-id":["1572"],"URL":"https:\/\/doi.org\/10.1007\/s10916-020-01572-z","relation":{},"ISSN":["0148-5598","1573-689X"],"issn-type":[{"value":"0148-5598","type":"print"},{"value":"1573-689X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,5,8]]},"assertion":[{"value":"2 January 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 March 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 May 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with Ethical Standards"}},{"value":"This article does not contain any studies with human participants performed by any of the authors.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Human Studies"}},{"value":"The authors declare that they have no conflict of interest.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}}],"article-number":"113"}}