{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T21:37:59Z","timestamp":1790804279188,"version":"4.1.0"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,2,25]],"date-time":"2023-02-25T00:00:00Z","timestamp":1677283200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,2,25]],"date-time":"2023-02-25T00:00:00Z","timestamp":1677283200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003793","name":"Hj\u00e4rt-Lungfonden","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003793","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004359","name":"Vetenskapsr\u00e5det","doi-asserted-by":"publisher","award":["2019-00198"],"award-info":[{"award-number":["2019-00198"]}],"id":[{"id":"10.13039\/501100004359","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003252","name":"Lund University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100003252","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scand J Trauma Resusc Emerg Med"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Triage is used as standard of care for prioritization and identification of time-critical patients in the emergency department (ED) globally, but it is unclear what outcomes should be used to evaluate triage. Currently used outcomes do not include important time-critical diagnoses and conditions.\n<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Method<\/jats:title>\n                <jats:p>We used 18 Swedish triage experts to collect and assess outcomes for the evaluation of 5-level triage systems. The experts suggested 68 outcomes which were then tested through a modified Delphi approach in three rounds. The outcomes aimed to identify correctly prioritized red patients (in need of a resuscitation team), and orange patients (other time critical conditions). Consensus was pre-defined as 70% dichotomized (positive\/negative) concordance.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Diagnoses, interventions, mortality, level of care and lab results were included in the outcomes. Positive consensus was reached for 49 outcomes and negative consensus for 7 outcomes, with an 83% response rate. The five most approved outcomes were the interventions <jats:italic>Percutaneous coronary intervention<\/jats:italic>, <jats:italic>Surgical airway<\/jats:italic> and <jats:italic>Massive transfusion<\/jats:italic> together with the diagnoses <jats:italic>Tension pneumothorax<\/jats:italic> and <jats:italic>Intracerebral hemorrhage<\/jats:italic> that received specific interventions. The outcomes with the clearest disapproval included <jats:italic>Admittance to a ward<\/jats:italic>, <jats:italic>Treatment with antihistamines<\/jats:italic> and <jats:italic>The ordering of a head computed tomography scan.<\/jats:italic> The outcomes were considered valid only if occurring in or from the ED.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>This study proposes a standard of 49 outcomes divided into two sets tied to red and orange priority respectively, to be used when evaluating 5-level priority triage systems; Lund Outcome Set for Evaluation of Triage (LOSET). The proposed outcomes include diagnoses, interventions and laboratory results. Before widespread implementation of LOSET, prospective testing is needed, preferably at multiple sites.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s13049-023-01073-1","type":"journal-article","created":{"date-parts":[[2023,2,25]],"date-time":"2023-02-25T07:11:21Z","timestamp":1677309081000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Development of outcomes for evaluating emergency care triage: a Delphi approach"],"prefix":"10.1186","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3500-4832","authenticated-orcid":false,"given":"Andr\u00e9","family":"Johansson","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna","family":"Ekwall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jakob Lundager","family":"Forberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ulf","family":"Ekelund","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,2,25]]},"reference":[{"key":"1073_CR1","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1186\/1757-7241-19-72","volume":"19","author":"N Farrokhnia","year":"2011","unstructured":"Farrokhnia N, G\u00f6ransson KE. Swedish emergency department triage and interventions for improved patient flows: a national update. Scand J Trauma Resusc Emerg Med. 2011;19:72. https:\/\/doi.org\/10.1186\/1757-7241-19-72.","journal-title":"Scand J Trauma Resusc Emerg Med"},{"key":"1073_CR2","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/j.ienj.2017.12.003","volume":"38","author":"SC Wireklint","year":"2018","unstructured":"Wireklint SC, Elmqvist C, Parenti N, G\u00f6ransson KE. A descriptive study of registered nurses\u2019 application of the triage scale RETTS\u00a9; a Swedish reliability study. Int Emerg Nurs. 2018;38:21\u20138. https:\/\/doi.org\/10.1016\/j.ienj.2017.12.003.","journal-title":"Int Emerg Nurs"},{"issue":"9","key":"1073_CR3","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2018-026471","volume":"2019","author":"JM Zachariasse","year":"2019","unstructured":"Zachariasse JM, van der Hagen V, Seiger N, Mackway-Jones K, van Veen M, Moll HA. Performance of triage systems in emergency care: a systematic review and meta-analysis. BMJ Open. 2019;2019(9): e026471. https:\/\/doi.org\/10.1136\/bmjopen-2018-026471.","journal-title":"BMJ Open"},{"key":"1073_CR4","unstructured":"Widgren, B. (2012). RETTS: Akutsjukv\u00e5rd direkt. Studentlitteratur."},{"key":"1073_CR5","unstructured":"Statens beredning f\u00f6r medicinsk och social utv\u00e4rdering. (2010). Triage och fl\u00f6desprocesser p\u00e5 akutmottagningen: En systematisk litteratur\u00f6versikt (SBU-rapport, 197). Stockholm: SBU"},{"issue":"5","key":"1073_CR6","doi-asserted-by":"publisher","first-page":"565","DOI":"10.1016\/j.annemergmed.2017.08.005","volume":"71","author":"S Levin","year":"2018","unstructured":"Levin S, Toerper M, Hamrock E, Hinson JS, Barnes S, Gardner H, Douglas A, Linton B, Kirsch T, Kelen G. Machine-learning-based electronic triage more accurately differentiates patients with respect to clinical outcomes compared with the Emergency Severity Index. Ann Emerg Med. 2018;71(5):565\u201374. https:\/\/doi.org\/10.1016\/j.annemergmed.2017.08.005.","journal-title":"Ann Emerg Med"},{"key":"1073_CR7","unstructured":"Gilboy, N., Tanabe, P., Travers, D., & Rosenau, A. M. (2020) Implementation handbook 2020 edition: ESI Emergency Severity Index. (Version 4). Emergency Nurses Association"},{"key":"1073_CR8","unstructured":"Predicare. (2022). RETTS-online (Version 2022) [Web-app]. Predicare. https:\/\/rettsonline-app.com"},{"key":"1073_CR9","doi-asserted-by":"publisher","first-page":"a1501","DOI":"10.1136\/bmj.a1501","volume":"337","author":"M van Veen","year":"2008","unstructured":"van Veen M, Steyerberg EW, Ruige M, van Meurs AHJ, Roukema J, van der Lei J, Moll HA. Manchester triage system in pediatric emergency care: prospective observational study. BMJ. 2008;337:a1501. https:\/\/doi.org\/10.1136\/bmj.a1501.","journal-title":"BMJ"},{"issue":"17","key":"1073_CR10","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1080\/0144341970170401","volume":"4","author":"MJ Clayton","year":"2006","unstructured":"Clayton MJ. Delphi: a technique to harness expert opinion for critical decision-making tasks in education. Educ Psychol. 2006;4(17):373\u201386. https:\/\/doi.org\/10.1080\/0144341970170401.","journal-title":"Educ Psychol"},{"issue":"3","key":"1073_CR11","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/j.ienj.2013.10.004","volume":"22","author":"J Wihlborg","year":"2014","unstructured":"Wihlborg J, Edgren G, Johansson A, Sivberg B. The desired competence of the Swedish ambulance nurse according to the professionals\u2014a Delphi study. Int Emerg Nurs. 2014;22(3):127\u201333. https:\/\/doi.org\/10.1016\/j.ienj.2013.10.004.","journal-title":"Int Emerg Nurs"},{"issue":"1","key":"1073_CR12","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1186\/s13049-022-01035-z","volume":"30","author":"A Khorram-Manesh","year":"2022","unstructured":"Khorram-Manesh A, Burkle FM, Nordling J, Goniewicz K, Faccincani R, Magnusson C, Merzaai B, Ratnayake A, Carlstr\u00f6m E. Developing a translational triage research tool: part two\u2014evaluating the tool through a Delphi study among experts. Scand J Trauma Resusc Emerg Med. 2022;30(1):48. https:\/\/doi.org\/10.1186\/s13049-022-01035-z.","journal-title":"Scand J Trauma Resusc Emerg Med"},{"issue":"2","key":"1073_CR13","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1016\/j.jbi.2008.08.010","volume":"42","author":"PA Harris","year":"2009","unstructured":"Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)\u2014a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377\u201381. https:\/\/doi.org\/10.1016\/j.jbi.2008.08.010.","journal-title":"J Biomed Inform"},{"key":"1073_CR14","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2019.103208","volume":"95","author":"PA Harris","year":"2019","unstructured":"Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O\u2019Neal L, McLeod L, Delacqua G, Delacqua F, Kirby J, Duda SN. The REDCap consortium: Building an international community of software platform partners. J Biomed Inform. 2019;95: 103208. https:\/\/doi.org\/10.1016\/j.jbi.2019.103208.","journal-title":"J Biomed Inform"},{"key":"1073_CR15","unstructured":"Lundman, B., & H\u00e4llgren Graneheim, U. (2017). Kvalitativ inneh\u00e5llsanalys. B. H\u00f6glund-Nielsen & M. Granesk\u00e4r (Red). Till\u00e4mpad kvalitativ forskning inom h\u00e4lso- och sjukv\u00e5rd. (Tredje upplagan. s. 219\u2013233). Studentlitteratur."},{"key":"1073_CR16","doi-asserted-by":"publisher","first-page":"10","DOI":"10.7275\/PDZ9-TH90","volume":"12","author":"C-C Hsu","year":"2007","unstructured":"Hsu C-C, Sandford BA. The Delphi technique: making sense of consensus. Pract Assess Res Eval. 2007;12:10. https:\/\/doi.org\/10.7275\/PDZ9-TH90.","journal-title":"Pract Assess Res Eval"},{"key":"1073_CR17","doi-asserted-by":"publisher","DOI":"10.1016\/j.ienj.2020.100867","volume":"56","author":"W Varndell","year":"2020","unstructured":"Varndell W, Fry M, Lutze M, Elliott D. Use of the Delphi method to generate guidance in emergency nursing practice: a systematic review. Int Emerg Nurs. 2020;56: 100867. https:\/\/doi.org\/10.1016\/j.ienj.2020.100867.","journal-title":"Int Emerg Nurs"},{"key":"1073_CR18","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1186\/s13049-017-0397-6","volume":"25","author":"LH Hansen","year":"2017","unstructured":"Hansen LH, Mogensen CB, Wittenhoff L, Skj\u00f6t-Arkil H. The danish regions pediatric triage model has a limited ability to detect both critically ill children as well as children to be sent home without treatment\u2014a study of diagnostic accuracy. Scand J Trauma Resusc Emerg Med. 2017;25:55. https:\/\/doi.org\/10.1186\/s13049-017-0397-6.","journal-title":"Scand J Trauma Resusc Emerg Med"},{"issue":"12","key":"1073_CR19","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0226518","volume":"14","author":"D Spangler","year":"2019","unstructured":"Spangler D, Hermansson T, Smekal D, Blomberg H. A validation of machine learning-based risk scores in the prehospital setting. PLoS ONE. 2019;14(12): e0226518. https:\/\/doi.org\/10.1371\/journal.pone.0226518.","journal-title":"PLoS ONE"},{"issue":"3","key":"1073_CR20","doi-asserted-by":"publisher","first-page":"223","DOI":"10.5847\/wjem.j.1920-8642.2017.03.010","volume":"8","author":"K Aeimchanbanjong","year":"2017","unstructured":"Aeimchanbanjong K. Validation of different pediatric triage systems in the emergency department. World J Emerg Med. 2017;8(3):223. https:\/\/doi.org\/10.5847\/wjem.j.1920-8642.2017.03.010.","journal-title":"World J Emerg Med"},{"issue":"1","key":"1073_CR21","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1016\/j.annemergmed.2012.05.024","volume":"61","author":"J Gravel","year":"2013","unstructured":"Gravel J, Fitzpatrick E, Gouin S, Millar K, Curtis S, Joubert G, Boutis K, Guimont C, Goldman RD, Dubrovsky AS, Porter R, Beer D, Doan Q, Osmond MH. Performance of the Canadian triage and acuity scale for children: a multicenter database study. Ann Emerg Med. 2013;61(1):27\u201332. https:\/\/doi.org\/10.1016\/j.annemergmed.2012.05.024.","journal-title":"Ann Emerg Med"},{"issue":"2","key":"1073_CR22","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0088995","volume":"9","author":"I Gr\u00e4ff","year":"2014","unstructured":"Gr\u00e4ff I, Goldschmidt B, Glien P, Bogdanow M, Fimmers R, Hoeft A, Kim S-C, Grigutsch D. The German Version of the Manchester Triage System and its quality criteria\u2014first assessment of validity and reliability. PLoS ONE. 2014;9(2):e88995. https:\/\/doi.org\/10.1371\/journal.pone.0088995.","journal-title":"PLoS ONE"},{"key":"1073_CR23","doi-asserted-by":"publisher","unstructured":"Powell C. The Delphi technique: myths and realities. J Adv Nursing. 2013;41(4):376\u201382. https:\/\/doi.org\/10.1046\/j.1365-2648.2003.02537.x.","DOI":"10.1046\/j.1365-2648.2003.02537.x"}],"container-title":["Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13049-023-01073-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13049-023-01073-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13049-023-01073-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,25]],"date-time":"2023-02-25T07:15:30Z","timestamp":1677309330000},"score":1,"resource":{"primary":{"URL":"https:\/\/sjtrem.biomedcentral.com\/articles\/10.1186\/s13049-023-01073-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,25]]},"references-count":23,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["1073"],"URL":"https:\/\/doi.org\/10.1186\/s13049-023-01073-1","relation":{},"ISSN":["1757-7241"],"issn-type":[{"value":"1757-7241","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,25]]},"assertion":[{"value":"21 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 February 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 February 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All experts were informed about the study in writing before the first interview and again verbally at the first interview. Oral consent was collected from every expert before the start of interviews. In accordance with Swedish law, this study was not subject to review by an ethics review board. Confidentiality was kept through multiple layers. Only the researcher doing the analysis was able to access the data, and the data was kept at a cloud service which required two-part authentication to access. Confidentiality was also kept between experts.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publications"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"10"}}