{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T01:57:29Z","timestamp":1773799049474,"version":"3.50.1"},"reference-count":192,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,10,29]],"date-time":"2019-10-29T00:00:00Z","timestamp":1572307200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2019,10,29]],"date-time":"2019-10-29T00:00:00Z","timestamp":1572307200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Clinical predictive tools quantify contributions of relevant patient characteristics to derive likelihood of diseases or predict clinical outcomes. When selecting predictive tools for implementation at clinical practice or for recommendation in clinical guidelines, clinicians are challenged with an overwhelming and ever-growing number of tools, most of which have never been implemented or assessed for comparative effectiveness. To overcome this challenge, we have developed a conceptual framework to Grade and Assess Predictive tools (GRASP) that can provide clinicians with a standardised, evidence-based system to support their search for and selection of efficient tools.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>A focused review of the literature was conducted to extract criteria along which tools should be evaluated. An initial framework was designed and applied to assess and grade five tools: LACE Index, Centor Score, Well\u2019s Criteria, Modified Early Warning Score, and Ottawa knee rule. After peer review, by six expert clinicians and healthcare researchers, the framework and the grading of the tools were updated.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>GRASP framework grades predictive tools based on published evidence across three dimensions: 1) Phase of evaluation; 2) Level of evidence; and 3) Direction of evidence. The final grade of a tool is based on the highest phase of evaluation, supported by the highest level of positive evidence, or mixed evidence that supports a positive conclusion. Ottawa knee rule had the highest grade since it has demonstrated positive post-implementation impact on healthcare. LACE Index had the lowest grade, having demonstrated only pre-implementation positive predictive performance.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>GRASP framework builds on widely accepted concepts to provide standardised assessment and evidence-based grading of predictive tools. Unlike other methods, GRASP is based on the critical appraisal of published evidence reporting the tools\u2019 predictive performance before implementation, potential effect and usability during implementation, and their post-implementation impact. Implementing the GRASP framework as an online platform can enable clinicians and guideline developers to access standardised and structured reported evidence of existing predictive tools. However, keeping GRASP reports up-to-date would require updating tools\u2019 assessments and grades when new evidence becomes available, which can only be done efficiently by employing semi-automated methods for searching and processing the incoming information.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12911-019-0940-7","type":"journal-article","created":{"date-parts":[[2019,10,30]],"date-time":"2019-10-30T20:44:43Z","timestamp":1572468283000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["Developing a framework for evidence-based grading and assessment of predictive tools for clinical decision support"],"prefix":"10.1186","volume":"19","author":[{"given":"Mohamed","family":"Khalifa","sequence":"first","affiliation":[]},{"given":"Farah","family":"Magrabi","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3704-7975","authenticated-orcid":false,"given":"Blanca","family":"Gallego","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2019,10,29]]},"reference":[{"issue":"e1","key":"940_CR1","doi-asserted-by":"publisher","first-page":"e2","DOI":"10.1136\/amiajnl-2012-001458","volume":"20","author":"B Middleton","year":"2013","unstructured":"Middleton B, et al. Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA. J Am Med Inform Assoc. 2013;20(e1):e2\u20138.","journal-title":"J Am Med Inform Assoc"},{"issue":"7494","key":"940_CR2","doi-asserted-by":"publisher","first-page":"765","DOI":"10.1136\/bmj.38398.500764.8F","volume":"330","author":"K Kawamoto","year":"2005","unstructured":"Kawamoto K, et al. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330(7494):765.","journal-title":"BMJ"},{"key":"940_CR3","doi-asserted-by":"crossref","unstructured":"Osheroff JA. Improving outcomes with clinical decision support: an implementer\u2019s guide. New York: Imprint HIMSS Publishing; 2012.","DOI":"10.4324\/9781498757461"},{"issue":"2","key":"940_CR4","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1197\/jamia.M2334","volume":"14","author":"JA Osheroff","year":"2007","unstructured":"Osheroff JA, et al. A roadmap for national action on clinical decision support. J Am Med Inform Assoc. 2007;14(2):141\u20135.","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"940_CR5","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1093\/intqhc\/mzm031","volume":"19","author":"J \u00d8vretveit","year":"2007","unstructured":"\u00d8vretveit J, et al. Improving quality through effective implementation of information technology in healthcare. Int J Qual Health Care. 2007;19(5):259\u201366.","journal-title":"Int J Qual Health Care"},{"issue":"1","key":"940_CR6","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1186\/s13336-015-0019-3","volume":"5","author":"C Castaneda","year":"2015","unstructured":"Castaneda C, et al. Clinical decision support systems for improving diagnostic accuracy and achieving precision medicine. J Clin Bioinforma. 2015;5(1):4.","journal-title":"J Clin Bioinforma"},{"key":"940_CR7","doi-asserted-by":"crossref","unstructured":"Capobianco E. Data-driven clinical decision processes: it\u2019s time: BioMed Central; 2019.","DOI":"10.1186\/s12967-019-1795-5"},{"key":"940_CR8","doi-asserted-by":"crossref","unstructured":"Musen MA, Middleton B, Greenes RA. Clinical decision-support systems. In: Biomedical informatics: Springer; 2014. p. 643\u201374.","DOI":"10.1007\/978-1-4471-4474-8_22"},{"key":"940_CR9","doi-asserted-by":"crossref","unstructured":"Shortliffe EH, Cimino JJ. Biomedical informatics: computer applications in health care and biomedicine: Springer Science & Business Media; 2013.","DOI":"10.1007\/978-1-4471-4474-8"},{"key":"940_CR10","doi-asserted-by":"publisher","first-page":"d8312","DOI":"10.1136\/bmj.d8312","volume":"344","author":"ST Adams","year":"2012","unstructured":"Adams ST, Leveson SH. Clinical prediction rules. BMJ. 2012;344:d8312.","journal-title":"BMJ"},{"issue":"13","key":"940_CR11","doi-asserted-by":"publisher","first-page":"793","DOI":"10.1056\/NEJM198509263131306","volume":"313","author":"JH Wasson","year":"1985","unstructured":"Wasson JH, et al. Clinical prediction rules: applications and methodological standards. N Engl J Med. 1985;313(13):793\u20139.","journal-title":"N Engl J Med"},{"issue":"3","key":"940_CR12","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1016\/S0004-9514(06)70024-1","volume":"52","author":"P Beattie","year":"2006","unstructured":"Beattie P, Nelson R. Clinical prediction rules: what are they and what do they tell us? Aust J Physiother. 2006;52(3):157\u201363.","journal-title":"Aust J Physiother"},{"key":"940_CR13","unstructured":"Steyerberg EW. Clinical prediction models: a practical approach to development, validation, and updating: Springer Science & Business Media; 2008."},{"issue":"11","key":"940_CR14","doi-asserted-by":"publisher","first-page":"e49864","DOI":"10.1371\/journal.pone.0049864","volume":"7","author":"S Ansari","year":"2012","unstructured":"Ansari S, Rashidian A. Guidelines for guidelines: are they up to the task? A comparative assessment of clinical practice guideline development handbooks. PLoS One. 2012;7(11):e49864.","journal-title":"PLoS One"},{"issue":"6","key":"940_CR15","doi-asserted-by":"publisher","first-page":"851","DOI":"10.1086\/319366","volume":"32","author":"MA Kish","year":"2001","unstructured":"Kish MA. Guide to development of practice guidelines. Clin Infect Dis. 2001;32(6):851\u20134.","journal-title":"Clin Infect Dis"},{"key":"940_CR16","doi-asserted-by":"crossref","unstructured":"Ebell MH. Evidence-based diagnosis: a handbook of clinical prediction rules, vol. 1: Springer Science & Business Media; 2001.","DOI":"10.1007\/978-1-4757-3514-7_1"},{"key":"940_CR17","first-page":"89","volume-title":"Prediction models and decision support","author":"T Kappen","year":"2015","unstructured":"Kappen T, et al. General discussion I: evaluating the impact of the use of prediction models in clinical practice: challenges and recommendations. In: Prediction models and decision support; 2015. p. 89."},{"issue":"10","key":"940_CR18","doi-asserted-by":"publisher","first-page":"e006701","DOI":"10.1136\/bmjopen-2014-006701","volume":"4","author":"M Taljaard","year":"2014","unstructured":"Taljaard M, et al. Cardiovascular disease population risk tool (CVDPoRT): predictive algorithm for assessing CVD risk in the community setting. A study protocol. BMJ Open. 2014;4(10):e006701.","journal-title":"BMJ Open"},{"key":"940_CR19","doi-asserted-by":"crossref","unstructured":"Berner ES. Clinical decision support systems, vol. 233: Springer; 2007.","DOI":"10.1007\/978-0-387-38319-4"},{"key":"940_CR20","doi-asserted-by":"crossref","unstructured":"Friedman CP, Wyatt J. Evaluation methods in biomedical informatics: Springer Science & Business Media; 2005.","DOI":"10.1007\/0-387-30677-3"},{"key":"940_CR21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/0-387-30677-3","volume-title":"Evaluation methods in biomedical informatics","author":"CP Friedman","year":"2006","unstructured":"Friedman CP, Wyatt JC. Challenges of evaluation in biomedical informatics. In: Evaluation methods in biomedical informatics; 2006. p. 1\u201320."},{"key":"940_CR22","doi-asserted-by":"crossref","unstructured":"Lobach DF. Evaluation of clinical decision support. In: Clinical decision support systems: Springer; 2016. p. 147\u201361.","DOI":"10.1007\/978-3-319-31913-1_9"},{"issue":"621","key":"940_CR23","doi-asserted-by":"publisher","first-page":"e233","DOI":"10.3399\/bjgp14X677860","volume":"64","author":"A Pl\u00fcddemann","year":"2014","unstructured":"Pl\u00fcddemann A, et al. Clinical prediction rules in practice: review of clinical guidelines and survey of GPs. Br J Gen Pract. 2014;64(621):e233\u201342.","journal-title":"Br J Gen Pract"},{"issue":"3","key":"940_CR24","doi-asserted-by":"publisher","first-page":"e009957","DOI":"10.1136\/bmjopen-2015-009957","volume":"6","author":"E Wallace","year":"2016","unstructured":"Wallace E, et al. Impact analysis studies of clinical prediction rules relevant to primary care: a systematic review. BMJ Open. 2016;6(3):e009957.","journal-title":"BMJ Open"},{"key":"940_CR25","doi-asserted-by":"publisher","first-page":"b605","DOI":"10.1136\/bmj.b605","volume":"338","author":"DG Altman","year":"2009","unstructured":"Altman DG, et al. Prognosis and prognostic research: validating a prognostic model. BMJ. 2009;338:b605.","journal-title":"BMJ"},{"issue":"5","key":"940_CR26","doi-asserted-by":"publisher","first-page":"e1001221","DOI":"10.1371\/journal.pmed.1001221","volume":"9","author":"W Bouwmeester","year":"2012","unstructured":"Bouwmeester W, et al. Reporting and methods in clinical prediction research: a systematic review. PLoS Med. 2012;9(5):e1001221.","journal-title":"PLoS Med"},{"issue":"s1","key":"940_CR27","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1111\/jth.12262","volume":"11","author":"J Hendriksen","year":"2013","unstructured":"Hendriksen J, et al. Diagnostic and prognostic prediction models. J Thromb Haemost. 2013;11(s1):129\u201341.","journal-title":"J Thromb Haemost"},{"key":"940_CR28","doi-asserted-by":"publisher","first-page":"b375","DOI":"10.1136\/bmj.b375","volume":"338","author":"KG Moons","year":"2009","unstructured":"Moons KG, et al. Prognosis and prognostic research: what, why, and how? BMJ. 2009;338:b375.","journal-title":"BMJ"},{"key":"940_CR29","doi-asserted-by":"publisher","first-page":"203","DOI":"10.2147\/CLEP.S20247","volume":"3","author":"S Christensen","year":"2011","unstructured":"Christensen S, et al. Comparison of Charlson comorbidity index with SAPS and APACHE scores for prediction of mortality following intensive care. Clin Epidemiol. 2011;3:203.","journal-title":"Clin Epidemiol"},{"issue":"1","key":"940_CR30","first-page":"16","volume":"85","author":"K Das","year":"2014","unstructured":"Das K, et al. Comparison of APACHE II, P-POSSUM and SAPS II scoring systems in patients underwent planned laparotomies due to secondary peritonitis. Ann Ital Chir. 2014;85(1):16\u201321.","journal-title":"Ann Ital Chir"},{"issue":"3","key":"940_CR31","doi-asserted-by":"publisher","first-page":"e28","DOI":"10.2196\/medinform.5909","volume":"4","author":"T Desautels","year":"2016","unstructured":"Desautels T, et al. Prediction of sepsis in the intensive care unit with minimal electronic health record data: a machine learning approach. JMIR Med Inform. 2016;4(3):e28.","journal-title":"JMIR Med Inform"},{"issue":"1","key":"940_CR32","doi-asserted-by":"publisher","first-page":"27","DOI":"10.3329\/bccj.v1i1.14362","volume":"1","author":"MO Faruq","year":"2013","unstructured":"Faruq MO, et al. A comparison of severity systems APACHE II and SAPS II in critically ill patients. Bangladesh Crit Care J. 2013;1(1):27\u201332.","journal-title":"Bangladesh Crit Care J"},{"issue":"3","key":"940_CR33","doi-asserted-by":"publisher","first-page":"R102","DOI":"10.1186\/cc12747","volume":"17","author":"FS Hosein","year":"2013","unstructured":"Hosein FS, et al. A systematic review of tools for predicting severe adverse events following patient discharge from intensive care units. Crit Care. 2013;17(3):R102.","journal-title":"Crit Care"},{"issue":"12","key":"940_CR34","doi-asserted-by":"publisher","first-page":"1822","DOI":"10.3346\/jkms.2013.28.12.1822","volume":"28","author":"YH Kim","year":"2013","unstructured":"Kim YH, et al. Performance assessment of the SOFA, APACHE II scoring system, and SAPS II in intensive care unit organophosphate poisoned patients. J Korean Med Sci. 2013;28(12):1822\u20136.","journal-title":"J Korean Med Sci"},{"issue":"6","key":"940_CR35","doi-asserted-by":"publisher","first-page":"761","DOI":"10.4103\/1119-3077.178944","volume":"19","author":"\u00d6 K\u00f6ksal","year":"2016","unstructured":"K\u00f6ksal \u00d6, et al. The comparison of modified early warning score and Glasgow coma scale-age-systolic blood pressure scores in the assessment of nontraumatic critical patients in emergency department. Niger J Clin Pract. 2016;19(6):761\u20135.","journal-title":"Niger J Clin Pract"},{"issue":"1","key":"940_CR36","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1186\/2052-0492-2-40","volume":"2","author":"EM Moseson","year":"2014","unstructured":"Moseson EM, et al. Intensive care unit scoring systems outperform emergency department scoring systems for mortality prediction in critically ill patients: a prospective cohort study. J Intensive Care. 2014;2(1):40.","journal-title":"J Intensive Care"},{"issue":"3","key":"940_CR37","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1097\/EJA.0b013e32835032d8","volume":"29","author":"K Reini","year":"2012","unstructured":"Reini K, Fredrikson M, Oscarsson A. The prognostic value of the modified early warning score in critically ill patients: a prospective, observational study. Eur J Anaesthesiol. 2012;29(3):152\u20137.","journal-title":"Eur J Anaesthesiol"},{"issue":"3","key":"940_CR38","doi-asserted-by":"publisher","first-page":"R132","DOI":"10.1186\/cc13947","volume":"18","author":"S Yu","year":"2014","unstructured":"Yu S, et al. Comparison of risk prediction scoring systems for ward patients: a retrospective nested case-control study. Crit Care. 2014;18(3):R132.","journal-title":"Crit Care"},{"issue":"6","key":"940_CR39","doi-asserted-by":"publisher","first-page":"488","DOI":"10.1001\/jama.1997.03540300056034","volume":"277","author":"A Laupacis","year":"1997","unstructured":"Laupacis A, Sekar N. Clinical prediction rules: a review and suggested modifications of methodological standards. JAMA. 1997;277(6):488\u201394.","journal-title":"JAMA"},{"key":"940_CR40","doi-asserted-by":"publisher","unstructured":"Moons KG, et al. Risk prediction models: II. External validation, model updating, and impact assessment. Heart. 2012. https:\/\/doi.org\/10.1136\/heartjnl-2011-301247 .","DOI":"10.1136\/heartjnl-2011-301247"},{"key":"940_CR41","doi-asserted-by":"crossref","unstructured":"Friedman CP, Wyatt JC. Evaluation of biomedical and health information resources. In: Biomedical informatics: Springer; 2014. p. 355\u201387.","DOI":"10.1007\/978-1-4471-4474-8_11"},{"issue":"6","key":"940_CR42","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1197\/jamia.M1370","volume":"10","author":"DW Bates","year":"2003","unstructured":"Bates DW, et al. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc. 2003;10(6):523\u201330.","journal-title":"J Am Med Inform Assoc"},{"key":"940_CR43","doi-asserted-by":"crossref","unstructured":"Gong Y, Kang H. Usability and clinical decision support. In: Clinical decision support systems: Springer; 2016. p. 69\u201386.","DOI":"10.1007\/978-3-319-31913-1_4"},{"key":"940_CR44","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1016\/j.jclinepi.2015.09.008","volume":"70","author":"TH Kappen","year":"2016","unstructured":"Kappen TH, et al. Barriers and facilitators perceived by physicians when using prediction models in practice. J Clin Epidemiol. 2016;70:136\u201345.","journal-title":"J Clin Epidemiol"},{"issue":"1","key":"940_CR45","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1186\/1472-6947-6-6","volume":"6","author":"DF Sittig","year":"2006","unstructured":"Sittig DF, et al. A survey of factors affecting clinician acceptance of clinical decision support. BMC Med Inform Decis Mak. 2006;6(1):6.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"940_CR46","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1186\/1471-2288-14-40","volume":"14","author":"GS Collins","year":"2014","unstructured":"Collins GS, et al. External validation of multivariable prediction models: a systematic review of methodological conduct and reporting. BMC Med Res Methodol. 2014;14(1):40.","journal-title":"BMC Med Res Methodol"},{"issue":"18","key":"940_CR47","doi-asserted-by":"publisher","first-page":"3158","DOI":"10.1002\/sim.5732","volume":"32","author":"T Debray","year":"2013","unstructured":"Debray T, et al. A framework for developing, implementing, and evaluating clinical prediction models in an individual participant data meta-analysis. Stat Med. 2013;32(18):3158\u201380.","journal-title":"Stat Med"},{"key":"940_CR48","doi-asserted-by":"publisher","first-page":"i6460","DOI":"10.1136\/bmj.i6460","volume":"356","author":"TP Debray","year":"2017","unstructured":"Debray TP, et al. A guide to systematic review and meta-analysis of prediction model performance. BMJ. 2017;356:i6460.","journal-title":"BMJ"},{"issue":"3","key":"940_CR49","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1016\/j.jclinepi.2014.06.018","volume":"68","author":"TP Debray","year":"2015","unstructured":"Debray TP, et al. A new framework to enhance the interpretation of external validation studies of clinical prediction models. J Clin Epidemiol. 2015;68(3):279\u201389.","journal-title":"J Clin Epidemiol"},{"issue":"3","key":"940_CR50","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1097\/SLA.0000000000002023","volume":"265","author":"AH Harris","year":"2017","unstructured":"Harris AH. Path from predictive analytics to improved patient outcomes: a framework to guide use, implementation, and evaluation of accurate surgical predictive models. Ann Surg. 2017;265(3):461\u20133.","journal-title":"Ann Surg"},{"key":"940_CR51","doi-asserted-by":"crossref","unstructured":"Reps JM, Schuemie MJ, Suchard MA, Ryan PB, Rijnbeek PR. Design and implementation of a standardized framework to generate and evaluate patient-level prediction models using observational healthcare data. J Am Med Inform Assoc. 2018;25(8):969\u201375.","DOI":"10.1093\/jamia\/ocy032"},{"issue":"5","key":"940_CR52","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1016\/S0895-4356(03)00047-7","volume":"56","author":"EW Steyerberg","year":"2003","unstructured":"Steyerberg EW, et al. Internal and external validation of predictive models: a simulation study of bias and precision in small samples. J Clin Epidemiol. 2003;56(5):441\u20137.","journal-title":"J Clin Epidemiol"},{"issue":"8","key":"940_CR53","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1016\/S0895-4356(01)00341-9","volume":"54","author":"EW Steyerberg","year":"2001","unstructured":"Steyerberg EW, et al. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol. 2001;54(8):774\u201381.","journal-title":"J Clin Epidemiol"},{"key":"940_CR54","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.jclinepi.2015.04.005","volume":"69","author":"EW Steyerberg","year":"2016","unstructured":"Steyerberg EW, Harrell FE Jr. Prediction models need appropriate internal, internal-external, and external validation. J Clin Epidemiol. 2016;69:245.","journal-title":"J Clin Epidemiol"},{"issue":"29","key":"940_CR55","doi-asserted-by":"publisher","first-page":"1925","DOI":"10.1093\/eurheartj\/ehu207","volume":"35","author":"EW Steyerberg","year":"2014","unstructured":"Steyerberg EW, Vergouwe Y. Towards better clinical prediction models: seven steps for development and an ABCD for validation. Eur Heart J. 2014;35(29):1925\u201331.","journal-title":"Eur Heart J"},{"issue":"1","key":"940_CR56","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1097\/EDE.0b013e3181c30fb2","volume":"21","author":"EW Steyerberg","year":"2010","unstructured":"Steyerberg EW, et al. Assessing the performance of prediction models: a framework for some traditional and novel measures. Epidemiology (Cambridge, Mass.). 2010;21(1):128.","journal-title":"Epidemiology (Cambridge, Mass.)"},{"issue":"11","key":"940_CR57","doi-asserted-by":"publisher","first-page":"1085","DOI":"10.1016\/j.jclinepi.2008.04.008","volume":"61","author":"D Toll","year":"2008","unstructured":"Toll D, et al. Validation, updating and impact of clinical prediction rules: a review. J Clin Epidemiol. 2008;61(11):1085\u201394.","journal-title":"J Clin Epidemiol"},{"key":"940_CR58","doi-asserted-by":"crossref","unstructured":"Vickers AJ, Cronin AM. Traditional statistical methods for evaluating prediction models are uninformative as to clinical value: towards a decision analytic framework. In: Seminars in oncology: Elsevier; 2010.","DOI":"10.1053\/j.seminoncol.2009.12.004"},{"issue":"6","key":"940_CR59","doi-asserted-by":"publisher","first-page":"1298","DOI":"10.1016\/j.urology.2010.06.019","volume":"76","author":"AJ Vickers","year":"2010","unstructured":"Vickers AJ, Cronin AM. Everything you always wanted to know about evaluating prediction models (but were too afraid to ask). Urology. 2010;76(6):1298\u2013301.","journal-title":"Urology"},{"issue":"1","key":"940_CR60","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1186\/1472-6947-11-62","volume":"11","author":"E Wallace","year":"2011","unstructured":"Wallace E, et al. Framework for the impact analysis and implementation of clinical prediction rules (CPRs). BMC Med Inform Decis Mak. 2011;11(1):62.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"940_CR61","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12916-014-0241-z","volume":"13","author":"GS Collins","year":"2015","unstructured":"Collins GS, et al. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMC Med. 2015;13(1):1.","journal-title":"BMC Med"},{"issue":"1","key":"940_CR62","doi-asserted-by":"publisher","first-page":"W1","DOI":"10.7326\/M14-0698","volume":"162","author":"KG Moons","year":"2015","unstructured":"Moons KG, et al. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med. 2015;162(1):W1\u2013W73.","journal-title":"Ann Intern Med"},{"issue":"10","key":"940_CR63","doi-asserted-by":"publisher","first-page":"e1001744","DOI":"10.1371\/journal.pmed.1001744","volume":"11","author":"KG Moons","year":"2014","unstructured":"Moons KG, et al. Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist. PLoS Med. 2014;11(10):e1001744.","journal-title":"PLoS Med"},{"issue":"7454","key":"940_CR64","doi-asserted-by":"publisher","first-page":"1490","DOI":"10.1136\/bmj.328.7454.1490","volume":"328","author":"D Atkins","year":"2004","unstructured":"Atkins D, et al. Grading quality of evidence and strength of recommendations. BMJ (Clinical research ed). 2004;328(7454):1490.","journal-title":"BMJ (Clinical research ed)"},{"issue":"7650","key":"940_CR65","doi-asserted-by":"publisher","first-page":"924","DOI":"10.1136\/bmj.39489.470347.AD","volume":"336","author":"GH Guyatt","year":"2008","unstructured":"Guyatt GH, et al. Rating quality of evidence and strength of recommendations: GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924.","journal-title":"BMJ"},{"issue":"4","key":"940_CR66","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1016\/j.jclinepi.2010.04.026","volume":"64","author":"G Guyatt","year":"2011","unstructured":"Guyatt G, et al. GRADE guidelines: 1. Introduction\u2014GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383\u201394.","journal-title":"J Clin Epidemiol"},{"issue":"4","key":"940_CR67","doi-asserted-by":"publisher","first-page":"380","DOI":"10.1016\/j.jclinepi.2010.09.011","volume":"64","author":"GH Guyatt","year":"2011","unstructured":"Guyatt GH, et al. GRADE guidelines: a new series of articles in the journal of clinical epidemiology. J Clin Epidemiol. 2011;64(4):380\u20132.","journal-title":"J Clin Epidemiol"},{"issue":"1","key":"940_CR68","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1186\/1472-6963-4-38","volume":"4","author":"D Atkins","year":"2004","unstructured":"Atkins D, et al. Systems for grading the quality of evidence and the strength of recommendations I: critical appraisal of existing approaches the GRADE working group. BMC Health Serv Res. 2004;4(1):38.","journal-title":"BMC Health Serv Res"},{"key":"940_CR69","doi-asserted-by":"crossref","unstructured":"Friedman CP, Wyatt JC. Challenges of evaluation in medical informatics. In: Evaluation methods in medical informatics: Springer; 1997. p. 1\u201315.","DOI":"10.1007\/978-1-4757-2685-5_1"},{"issue":"4","key":"940_CR70","doi-asserted-by":"publisher","first-page":"264","DOI":"10.7326\/0003-4819-151-4-200908180-00135","volume":"151","author":"D Moher","year":"2009","unstructured":"Moher D, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264\u20139.","journal-title":"Ann Intern Med"},{"key":"940_CR71","volume-title":"MD+Calc (Medical reference for clinical decision tools and content)","author":"G Walker","year":"2018","unstructured":"Walker, G. and J. Habboushe. MD+Calc (Medical reference for clinical decision tools and content). 2018. Available from: https:\/\/www.mdcalc.com\/ . Cited 15 Sept 2018."},{"key":"940_CR72","unstructured":"Ltd, R.a.I.S. Random.org. 2019. Available from: https:\/\/www.random.org\/ . Cited 1 Jan 2018."},{"key":"940_CR73","doi-asserted-by":"publisher","first-page":"b606","DOI":"10.1136\/bmj.b606","volume":"338","author":"KG Moons","year":"2009","unstructured":"Moons KG, et al. Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ. 2009;338:b606.","journal-title":"BMJ"},{"issue":"1","key":"940_CR74","doi-asserted-by":"publisher","first-page":"29","DOI":"10.7326\/0003-4819-157-1-201207030-00450","volume":"157","author":"TJ Bright","year":"2012","unstructured":"Bright TJ, et al. Effect of clinical decision-support systemsa systematic review. Ann Intern Med. 2012;157(1):29\u201343.","journal-title":"Ann Intern Med"},{"issue":"10","key":"940_CR75","doi-asserted-by":"publisher","first-page":"1223","DOI":"10.1001\/jama.293.10.1223","volume":"293","author":"AX Garg","year":"2005","unstructured":"Garg AX, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005;293(10):1223\u201338.","journal-title":"JAMA"},{"issue":"15","key":"940_CR76","doi-asserted-by":"publisher","first-page":"1339","DOI":"10.1001\/jama.280.15.1339","volume":"280","author":"DL Hunt","year":"1998","unstructured":"Hunt DL, et al. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998;280(15):1339\u201346.","journal-title":"JAMA"},{"issue":"2","key":"940_CR77","doi-asserted-by":"publisher","first-page":"135","DOI":"10.7326\/0003-4819-120-2-199401150-00007","volume":"120","author":"ME Johnston","year":"1994","unstructured":"Johnston ME, et al. Effects of computer-based clinical decision support systems on clinician performance and patient outcome: a critical appraisal of research. Ann Intern Med. 1994;120(2):135\u201342.","journal-title":"Ann Intern Med"},{"issue":"1","key":"940_CR78","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/S1386-5056(01)00183-6","volume":"64","author":"B Kaplan","year":"2001","unstructured":"Kaplan B. Evaluating informatics applications\u2014clinical decision support systems literature review. Int J Med Inform. 2001;64(1):15\u201337.","journal-title":"Int J Med Inform"},{"issue":"12","key":"940_CR79","doi-asserted-by":"publisher","first-page":"1409","DOI":"10.1001\/archinte.163.12.1409","volume":"163","author":"R Kaushal","year":"2003","unstructured":"Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch Intern Med. 2003;163(12):1409\u201316.","journal-title":"Arch Intern Med"},{"issue":"3","key":"940_CR80","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1136\/amiajnl-2011-000185","volume":"19","author":"AB McCoy","year":"2011","unstructured":"McCoy AB, et al. A framework for evaluating the appropriateness of clinical decision support alerts and responses. J Am Med Inform Assoc. 2011;19(3):346\u201352.","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"940_CR81","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1186\/1472-6963-9-154","volume":"9","author":"S-A Pearson","year":"2009","unstructured":"Pearson S-A, et al. Do computerised clinical decision support systems for prescribing change practice? A systematic review of the literature (1990-2007). BMC Health Serv Res. 2009;9(1):154.","journal-title":"BMC Health Serv Res"},{"issue":"6","key":"940_CR82","doi-asserted-by":"publisher","first-page":"982","DOI":"10.1016\/j.jbi.2008.03.009","volume":"41","author":"A Wright","year":"2008","unstructured":"Wright A, Sittig DF. A framework and model for evaluating clinical decision support architectures. J Biomed Inform. 2008;41(6):982\u201390.","journal-title":"J Biomed Inform"},{"issue":"2","key":"940_CR83","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1016\/S1386-5056(03)00131-X","volume":"71","author":"E Ammenwerth","year":"2003","unstructured":"Ammenwerth E, et al. Evaluation of health information systems\u2014problems and challenges. Int J Med Inform. 2003;71(2):125\u201335.","journal-title":"Int J Med Inform"},{"issue":"1","key":"940_CR84","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1186\/1472-6947-6-3","volume":"6","author":"E Ammenwerth","year":"2006","unstructured":"Ammenwerth E, Iller C, Mahler C. IT-adoption and the interaction of task, technology and individuals: a fit framework and a case study. BMC Med Inform Decis Mak. 2006;6(1):3.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"3","key":"940_CR85","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1093\/heapol\/czp010","volume":"24","author":"A Aqil","year":"2009","unstructured":"Aqil A, Lippeveld T, Hozumi D. PRISM framework: a paradigm shift for designing, strengthening and evaluating routine health information systems. Health Policy Plan. 2009;24(3):217\u201328.","journal-title":"Health Policy Plan"},{"issue":"10","key":"940_CR86","doi-asserted-by":"publisher","first-page":"742","DOI":"10.7326\/0003-4819-144-10-200605160-00125","volume":"144","author":"B Chaudhry","year":"2006","unstructured":"Chaudhry B, et al. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med. 2006;144(10):742\u201352.","journal-title":"Ann Intern Med"},{"issue":"15","key":"940_CR87","doi-asserted-by":"publisher","first-page":"1347","DOI":"10.1001\/jama.280.15.1347","volume":"280","author":"WR Hersh","year":"1998","unstructured":"Hersh WR, Hickam DH. How well do physicians use electronic information retrieval systems?: a framework for investigation and systematic review. JAMA. 1998;280(15):1347\u201352.","journal-title":"JAMA"},{"issue":"2","key":"940_CR88","doi-asserted-by":"publisher","first-page":"S37","DOI":"10.1097\/00006199-200603001-00007","volume":"55","author":"D Kaufman","year":"2006","unstructured":"Kaufman D, et al. Applying an evaluation framework for health information system design, development, and implementation. Nurs Res. 2006;55(2):S37\u201342.","journal-title":"Nurs Res"},{"issue":"3","key":"940_CR89","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1016\/S0010-4825(02)00013-6","volume":"32","author":"A Kazanjian","year":"2002","unstructured":"Kazanjian A, Green CJ. Beyond effectiveness: the evaluation of information systems using a comprehensive health technology assessment framework. Comput Biol Med. 2002;32(3):165\u201377.","journal-title":"Comput Biol Med"},{"issue":"1","key":"940_CR90","first-page":"112","volume":"10","author":"F Lau","year":"2007","unstructured":"Lau F, Hagens S, Muttitt S. A proposed benefits evaluation framework for health information systems in Canada. Health Q (Toronto, Ont.). 2007;10(1):112\u20136, 118.","journal-title":"Health Q (Toronto, Ont.)"},{"issue":"6","key":"940_CR91","doi-asserted-by":"publisher","first-page":"386","DOI":"10.1016\/j.ijmedinf.2007.08.011","volume":"77","author":"MM Yusof","year":"2008","unstructured":"Yusof MM, et al. An evaluation framework for health information systems: human, organization and technology-fit factors (HOT-fit). Int J Med Inform. 2008;77(6):386\u201398.","journal-title":"Int J Med Inform"},{"issue":"6","key":"940_CR92","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1016\/j.ijmedinf.2007.08.004","volume":"77","author":"MM Yusof","year":"2008","unstructured":"Yusof MM, et al. Investigating evaluation frameworks for health information systems. Int J Med Inform. 2008;77(6):377\u201385.","journal-title":"Int J Med Inform"},{"key":"940_CR93","doi-asserted-by":"crossref","unstructured":"Yusof MM, Paul RJ, Stergioulas LK. Towards a framework for health information systems evaluation. In: System sciences, 2006. HICSS\u201906. Proceedings of the 39th annual Hawaii international conference on: IEEE; 2006.","DOI":"10.1109\/HICSS.2006.491"},{"issue":"11","key":"940_CR94","doi-asserted-by":"publisher","first-page":"e367","DOI":"10.2196\/jmir.8775","volume":"19","author":"T Greenhalgh","year":"2017","unstructured":"Greenhalgh T, et al. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. 2017;19(11):e367.","journal-title":"J Med Internet Res"},{"issue":"5","key":"940_CR95","doi-asserted-by":"publisher","first-page":"723","DOI":"10.1002\/sim.1621","volume":"23","author":"P Royston","year":"2004","unstructured":"Royston P, Sauerbrei W. A new measure of prognostic separation in survival data. Stat Med. 2004;23(5):723\u201348.","journal-title":"Stat Med"},{"key":"940_CR96","doi-asserted-by":"crossref","unstructured":"Kleinbaum DG, Klein M. Kaplan-Meier survival curves and the log-rank test. In: Survival analysis: Springer; 2012. p. 55\u201396.","DOI":"10.1007\/978-1-4419-6646-9_2"},{"issue":"1","key":"940_CR97","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1016\/j.jclinepi.2007.04.018","volume":"61","author":"K Janssen","year":"2008","unstructured":"Janssen K, et al. Updating methods improved the performance of a clinical prediction model in new patients. J Clin Epidemiol. 2008;61(1):76\u201386.","journal-title":"J Clin Epidemiol"},{"key":"940_CR98","volume-title":"Encyclopedia of biostatistics","author":"CH Schmid","year":"2005","unstructured":"Schmid CH, Griffith JL. Multivariate classification rules: calibration and discrimination. In: Encyclopedia of biostatistics, vol. 5; 2005."},{"issue":"3","key":"940_CR99","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1377\/hlthaff.21.3.80","volume":"21","author":"DM Berwick","year":"2002","unstructured":"Berwick DM. A user\u2019s manual for the IOM\u2019s \u2018Quality Chasm\u2019report. Health Aff. 2002;21(3):80\u201390.","journal-title":"Health Aff"},{"issue":"26","key":"940_CR100","doi-asserted-by":"publisher","first-page":"2477","DOI":"10.1056\/NEJMp1011024","volume":"363","author":"ME Porter","year":"2010","unstructured":"Porter ME. What is value in health care? N Engl J Med. 2010;363(26):2477\u201381.","journal-title":"N Engl J Med"},{"key":"940_CR101","unstructured":"Friedman CP, Wyatt JC. Evaluation methods in medical informatics: Springer Science & Business Media; 2013."},{"issue":"12","key":"940_CR102","doi-asserted-by":"publisher","first-page":"920","DOI":"10.7326\/0003-4819-141-12-200412210-00008","volume":"141","author":"JD Childs","year":"2004","unstructured":"Childs JD, et al. A clinical prediction rule to identify patients with low back pain most likely to benefit from spinal manipulation: a validation study. Ann Intern Med. 2004;141(12):920\u20138.","journal-title":"Ann Intern Med"},{"issue":"5","key":"940_CR103","doi-asserted-by":"publisher","first-page":"721","DOI":"10.1016\/j.jval.2015.04.012","volume":"18","author":"AS Alali","year":"2015","unstructured":"Alali AS, et al. Economic evaluations in the diagnosis and management of traumatic brain injury: a systematic review and analysis of quality. Value Health. 2015;18(5):721\u201334.","journal-title":"Value Health"},{"key":"940_CR104","unstructured":"Barrett J. The use of clinical decision rules to reduce unnecessary head CT scans in pediatric populations: The University of Arizona; 2016."},{"issue":"12","key":"940_CR105","doi-asserted-by":"publisher","first-page":"939","DOI":"10.1136\/archdischild-2012-302820","volume":"98","author":"M Holmes","year":"2013","unstructured":"Holmes M, et al. The cost-effectiveness of diagnostic management strategies for children with minor head injury. Arch Dis Child. 2013;98(12):939\u201344.","journal-title":"Arch Dis Child"},{"issue":"6","key":"940_CR106","doi-asserted-by":"publisher","first-page":"1770","DOI":"10.3906\/sag-1703-206","volume":"47","author":"FD G\u00f6kharman","year":"2017","unstructured":"G\u00f6kharman FD, et al. Pediatric emergency care applied research network head injuryprediction rules: on the basis of cost and effectiveness. Turk J Med Sci. 2017;47(6):1770\u20137.","journal-title":"Turk J Med Sci"},{"issue":"1","key":"940_CR107","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1016\/j.annemergmed.2014.08.019","volume":"65","author":"DK Nishijima","year":"2015","unstructured":"Nishijima DK, et al. Cost-effectiveness of the PECARN rules in children with minor head trauma. Ann Emerg Med. 2015;65(1):72\u201380.e6.","journal-title":"Ann Emerg Med"},{"issue":"2","key":"940_CR108","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1007\/BF00402715","volume":"4","author":"N Bevan","year":"1995","unstructured":"Bevan N. Measuring usability as quality of use. Softw Qual J. 1995;4(2):115\u201330.","journal-title":"Softw Qual J"},{"issue":"1\u20132","key":"940_CR109","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1080\/01449299408914592","volume":"13","author":"N Bevan","year":"1994","unstructured":"Bevan N, Macleod M. Usability measurement in context. Behav Inform Technol. 1994;13(1\u20132):132\u201345.","journal-title":"Behav Inform Technol"},{"key":"940_CR110","doi-asserted-by":"crossref","unstructured":"Bevan N. Usability. In: Encyclopedia of database systems: Springer; 2009. p. 3247\u201351.","DOI":"10.1007\/978-0-387-39940-9_441"},{"key":"940_CR111","doi-asserted-by":"crossref","unstructured":"Dix A. Human-computer interaction. In: Encyclopedia of database systems: Springer; 2009. p. 1327\u201331.","DOI":"10.1007\/978-0-387-39940-9_192"},{"key":"940_CR112","doi-asserted-by":"crossref","unstructured":"Fr\u00f8kj\u00e6r E, Hertzum M, Hornb\u00e6k K. Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? In: Proceedings of the SIGCHI conference on human factors in computing systems: ACM; 2000.","DOI":"10.1145\/332040.332455"},{"issue":"5","key":"940_CR113","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1016\/j.ijmedinf.2011.02.009","volume":"80","author":"R Khajouei","year":"2011","unstructured":"Khajouei R, et al. Clinicians satisfaction with CPOE ease of use and effect on clinicians\u2019 workflow, efficiency and medication safety. Int J Med Inform. 2011;80(5):297\u2013309.","journal-title":"Int J Med Inform"},{"issue":"11","key":"940_CR114","doi-asserted-by":"publisher","first-page":"761","DOI":"10.1016\/j.ijmedinf.2012.02.009","volume":"81","author":"AC Li","year":"2012","unstructured":"Li AC, et al. Integrating usability testing and think-aloud protocol analysis with \u201cnear-live\u201d clinical simulations in evaluating clinical decision support. Int J Med Inform. 2012;81(11):761\u201372.","journal-title":"Int J Med Inform"},{"issue":"5","key":"940_CR115","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1080\/0044929031000","volume":"22","author":"M Van Den Haak","year":"2003","unstructured":"Van Den Haak M, De Jong M, Jan Schellens P. Retrospective vs. concurrent think-aloud protocols: testing the usability of an online library catalogue. Behav Inform Technol. 2003;22(5):339\u201351.","journal-title":"Behav Inform Technol"},{"issue":"01","key":"940_CR116","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1055\/s-0038-1638835","volume":"22","author":"E Borycki","year":"2013","unstructured":"Borycki E, et al. Usability methods for ensuring health information technology safety: evidence-based approaches contribution of the IMIA working group health informatics for patient safety. Yearb Med Inform. 2013;22(01):20\u20137.","journal-title":"Yearb Med Inform"},{"key":"940_CR117","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.ijmedinf.2017.06.003","volume":"106","author":"S Richardson","year":"2017","unstructured":"Richardson S, et al. \u201cThink aloud\u201d and \u201cnear live\u201d usability testing of two complex clinical decision support tools. Int J Med Inform. 2017;106:1\u20138.","journal-title":"Int J Med Inform"},{"issue":"2\u20133","key":"940_CR118","first-page":"96","volume":"55","author":"J Jeng","year":"2005","unstructured":"Jeng J. Usability assessment of academic digital libraries: effectiveness, efficiency, satisfaction, and learnability. Libri. 2005;55(2\u20133):96\u2013121.","journal-title":"Libri"},{"issue":"6","key":"940_CR119","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1109\/MS.1996.8740869","volume":"13","author":"J Nielsen","year":"1996","unstructured":"Nielsen J. Usability metrics: tracking interface improvements. IEEE Softw. 1996;13(6):12.","journal-title":"IEEE Softw"},{"issue":"9696","key":"940_CR120","doi-asserted-by":"publisher","first-page":"1160","DOI":"10.1016\/S0140-6736(09)61558-0","volume":"374","author":"N Kuppermann","year":"2009","unstructured":"Kuppermann N, et al. Identification of children at very low risk of clinically-important brain injuries after head trauma: a prospective cohort study. Lancet. 2009;374(9696):1160\u201370.","journal-title":"Lancet"},{"issue":"4","key":"940_CR121","doi-asserted-by":"publisher","first-page":"384","DOI":"10.1016\/S0196-0644(05)82656-3","volume":"21","author":"IG Stiell","year":"1992","unstructured":"Stiell IG, et al. A study to develop clinical decision rules for the use of radiography in acute ankle injuries. Ann Emerg Med. 1992;21(4):384\u201390.","journal-title":"Ann Emerg Med"},{"issue":"4","key":"940_CR122","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1016\/S0196-0644(95)70106-0","volume":"26","author":"IG Stiell","year":"1995","unstructured":"Stiell IG, et al. Derivation of a decision rule for the use of radiography in acute knee injuries. Ann Emerg Med. 1995;26(4):405\u201313.","journal-title":"Ann Emerg Med"},{"issue":"3","key":"940_CR123","doi-asserted-by":"publisher","first-page":"416","DOI":"10.1055\/s-0037-1613830","volume":"83","author":"PS Wells","year":"2000","unstructured":"Wells PS, et al. Derivation of a simple clinical model to categorize patients probability of pulmonary embolism-increasing the models utility with the SimpliRED D-dimer. Thromb Haemost. 2000;83(3):416\u201320.","journal-title":"Thromb Haemost"},{"issue":"12","key":"940_CR124","doi-asserted-by":"publisher","first-page":"997","DOI":"10.7326\/0003-4819-129-12-199812150-00002","volume":"129","author":"PS Wells","year":"1998","unstructured":"Wells PS, et al. Use of a clinical model for safe management of patients with suspected pulmonary embolism. Ann Intern Med. 1998;129(12):997\u20131005.","journal-title":"Ann Intern Med"},{"issue":"6","key":"940_CR125","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1503\/cmaj.091117","volume":"182","author":"C van Walraven","year":"2010","unstructured":"van Walraven C, et al. Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. Can Med Assoc J. 2010;182(6):551\u20137.","journal-title":"Can Med Assoc J"},{"issue":"3","key":"940_CR126","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1177\/0272989X8100100304","volume":"1","author":"RM Centor","year":"1981","unstructured":"Centor RM, et al. The diagnosis of strep throat in adults in the emergency room. Med Decis Mak. 1981;1(3):239\u201346.","journal-title":"Med Decis Mak"},{"issue":"2","key":"940_CR127","doi-asserted-by":"publisher","first-page":"98","DOI":"10.7326\/0003-4819-135-2-200107170-00010","volume":"135","author":"PS Wells","year":"2001","unstructured":"Wells PS, et al. Excluding pulmonary embolism at the bedside without diagnostic imaging: management of patients with suspected pulmonary embolism presenting to the emergency department by using a simple clinical model and d-dimer. Ann Intern Med. 2001;135(2):98\u2013107.","journal-title":"Ann Intern Med"},{"issue":"10","key":"940_CR128","doi-asserted-by":"publisher","first-page":"521","DOI":"10.1093\/qjmed\/94.10.521","volume":"94","author":"C Subbe","year":"2001","unstructured":"Subbe C, et al. Validation of a modified early warning score in medical admissions. QJM. 2001;94(10):521\u20136.","journal-title":"QJM"},{"issue":"3","key":"940_CR129","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1016\/j.ahj.2012.06.010","volume":"164","author":"AG Au","year":"2012","unstructured":"Au AG, et al. Predicting the risk of unplanned readmission or death within 30 days of discharge after a heart failure hospitalization. Am Heart J. 2012;164(3):365\u201372.","journal-title":"Am Heart J"},{"issue":"2","key":"940_CR130","first-page":"e104","volume":"5","author":"A Gruneir","year":"2011","unstructured":"Gruneir A, et al. Unplanned readmissions after hospital discharge among patients identified as being at high risk for readmission using a validated predictive algorithm. Open Med. 2011;5(2):e104.","journal-title":"Open Med"},{"issue":"6","key":"940_CR131","doi-asserted-by":"publisher","first-page":"784","DOI":"10.1093\/ageing\/afs073","volume":"41","author":"PE Cotter","year":"2012","unstructured":"Cotter PE, et al. Predicting readmissions: poor performance of the LACE index in an older UK population. Age Ageing. 2012;41(6):784\u20139.","journal-title":"Age Ageing"},{"issue":"1","key":"940_CR132","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1186\/1471-2261-14-97","volume":"14","author":"H Wang","year":"2014","unstructured":"Wang H, et al. Using the LACE index to predict hospital readmissions in congestive heart failure patients. BMC Cardiovasc Disord. 2014;14(1):97.","journal-title":"BMC Cardiovasc Disord"},{"key":"940_CR133","first-page":"169870","volume":"2015","author":"LL Low","year":"2015","unstructured":"Low LL, et al. Predicting 30-day readmissions: performance of the LACE index compared with a regression model among general medicine patients in Singapore. Biomed Res Int. 2015;2015:169870.","journal-title":"Biomed Res Int"},{"issue":"2","key":"940_CR134","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/j.artmed.2015.08.005","volume":"65","author":"S Yu","year":"2015","unstructured":"Yu S, et al. Predicting readmission risk with institution-specific prediction models. Artif Intell Med. 2015;65(2):89\u201396.","journal-title":"Artif Intell Med"},{"issue":"1","key":"940_CR135","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1186\/1741-7015-9-67","volume":"9","author":"J Aalbers","year":"2011","unstructured":"Aalbers J, et al. Predicting streptococcal pharyngitis in adults in primary care: a systematic review of the diagnostic accuracy of symptoms and signs and validation of the Centor score. BMC Med. 2011;9(1):67.","journal-title":"BMC Med"},{"issue":"3","key":"940_CR136","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1179\/1973947813Y.0000000071","volume":"25","author":"Z Alper","year":"2013","unstructured":"Alper Z, et al. Diagnosis of acute tonsillopharyngitis in primary care: a new approach for low-resource settings. J Chemother. 2013;25(3):148\u201355.","journal-title":"J Chemother"},{"issue":"22","key":"940_CR137","doi-asserted-by":"publisher","first-page":"2912","DOI":"10.1001\/jama.284.22.2912","volume":"284","author":"MH Ebell","year":"2000","unstructured":"Ebell MH, et al. Does this patient have strep throat? JAMA. 2000;284(22):2912\u20138.","journal-title":"JAMA"},{"issue":"11","key":"940_CR138","doi-asserted-by":"publisher","first-page":"847","DOI":"10.1001\/archinternmed.2012.950","volume":"172","author":"AM Fine","year":"2012","unstructured":"Fine AM, Nizet V, Mandl KD. Large-scale validation of the Centor and McIsaac scores to predict group A streptococcal pharyngitis. Arch Intern Med. 2012;172(11):847\u201352.","journal-title":"Arch Intern Med"},{"issue":"13","key":"940_CR139","doi-asserted-by":"publisher","first-page":"1587","DOI":"10.1001\/jama.291.13.1587","volume":"291","author":"WJ McIsaac","year":"2004","unstructured":"McIsaac WJ, et al. Empirical validation of guidelines for the management of pharyngitis in children and adults. JAMA. 2004;291(13):1587\u201395.","journal-title":"JAMA"},{"issue":"2","key":"940_CR140","doi-asserted-by":"publisher","first-page":"177","DOI":"10.3109\/00365549309008482","volume":"25","author":"E Meland","year":"1993","unstructured":"Meland E, Digranes A, Skj\u00e6rven R. Assessment of clinical features predicting streptococcal pharyngitis. Scand J Infect Dis. 1993;25(2):177\u201383.","journal-title":"Scand J Infect Dis"},{"issue":"4","key":"940_CR141","doi-asserted-by":"publisher","first-page":"586","DOI":"10.7326\/0003-4819-105-4-586","volume":"105","author":"RM Poses","year":"1986","unstructured":"Poses RM, et al. The importance of disease prevalence in transporting clinical prediction rules: the case of streptococcal pharyngitis. Ann Intern Med. 1986;105(4):586\u201391.","journal-title":"Ann Intern Med"},{"issue":"1","key":"940_CR142","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1001\/archinte.1986.00360130103014","volume":"146","author":"RS Wigton","year":"1986","unstructured":"Wigton RS, Connor JL, Centor RM. Transportability of a decision rule for the diagnosis of streptococcal pharyngitis. Arch Intern Med. 1986;146(1):81\u20133.","journal-title":"Arch Intern Med"},{"issue":"1","key":"940_CR143","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1186\/s13012-017-0567-y","volume":"12","author":"DA Feldstein","year":"2017","unstructured":"Feldstein DA, et al. Design and implementation of electronic health record integrated clinical prediction rules (iCPR): a randomized trial in diverse primary care settings. Implement Sci. 2017;12(1):37.","journal-title":"Implement Sci"},{"issue":"2","key":"940_CR144","doi-asserted-by":"publisher","first-page":"220","DOI":"10.1177\/0272989X9801800211","volume":"18","author":"WJ McIsaac","year":"1998","unstructured":"McIsaac WJ, Goel V. Effect of an explicit decision-support tool on decisions to prescribe antibiotics for sore throat. Med Decis Mak. 1998;18(2):220\u20138.","journal-title":"Med Decis Mak"},{"key":"940_CR145","volume-title":"Randomised controlled trial of a clinical score and rapid antigen detection test for sore throats","author":"P Little","year":"2014","unstructured":"Little, P., et al., Randomised controlled trial of a clinical score and rapid antigen detection test for sore throats. 2014."},{"issue":"1","key":"940_CR146","first-page":"75","volume":"158","author":"WJ McIsaac","year":"1998","unstructured":"McIsaac WJ, et al. A clinical score to reduce unnecessary antibiotic use in patients with sore throat. Can Med Assoc J. 1998;158(1):75\u201383.","journal-title":"Can Med Assoc J"},{"issue":"1","key":"940_CR147","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1177\/0272989X9501500110","volume":"15","author":"RM Poses","year":"1995","unstructured":"Poses RM, Cebul RD, Wigton RS. You can lead a horse to water-improving physicians\u2019 knowledge of probabilities may not affect their decisions. Med Decis Mak. 1995;15(1):65\u201375.","journal-title":"Med Decis Mak"},{"issue":"4","key":"940_CR148","first-page":"666","volume":"53","author":"G Worrall","year":"2007","unstructured":"Worrall G, et al. Diagnosing streptococcal sore throat in adults. Can Fam Physician. 2007;53(4):666\u201371.","journal-title":"Can Fam Physician"},{"key":"940_CR149","doi-asserted-by":"publisher","first-page":"e6564","DOI":"10.1136\/bmj.e6564","volume":"345","author":"G-J Geersing","year":"2012","unstructured":"Geersing G-J, et al. Safe exclusion of pulmonary embolism using the Wells rule and qualitative D-dimer testing in primary care: prospective cohort study. BMJ. 2012;345:e6564.","journal-title":"BMJ"},{"issue":"1","key":"940_CR150","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1160\/TH07-05-0321","volume":"99","author":"NS Gibson","year":"2008","unstructured":"Gibson NS, et al. Further validation and simplification of the Wells clinical decision rule in pulmonary embolism. Thromb Haemost. 2008;99(1):229.","journal-title":"Thromb Haemost"},{"issue":"2","key":"940_CR151","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1001\/jama.295.2.211","volume":"295","author":"P Page","year":"2006","unstructured":"Page P. Effectiveness of managing suspected pulmonary embolism using an algorithm combining clinical probability, D-dimer testing, and computed tomography. JAMA. 2006;295(2):172\u20139.","journal-title":"JAMA"},{"issue":"2","key":"940_CR152","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1016\/j.thromres.2013.11.018","volume":"133","author":"ML Posadas-Mart\u00ednez","year":"2014","unstructured":"Posadas-Mart\u00ednez ML, et al. Performance of the Wells score in patients with suspected pulmonary embolism during hospitalization: a delayed-type cross sectional study in a community hospital. Thromb Res. 2014;133(2):177\u201381.","journal-title":"Thromb Res"},{"issue":"1","key":"940_CR153","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1111\/j.1365-2753.2008.00967.x","volume":"15","author":"M S\u00f6derberg","year":"2009","unstructured":"S\u00f6derberg M, et al. The use of d-dimer testing and Wells score in patients with high probability for acute pulmonary embolism. J Eval Clin Pract. 2009;15(1):129\u201333.","journal-title":"J Eval Clin Pract"},{"issue":"07","key":"940_CR154","doi-asserted-by":"publisher","first-page":"731","DOI":"10.4236\/ijcm.2012.37A128","volume":"3","author":"ED Arslan","year":"2013","unstructured":"Arslan ED, et al. Prediction of pretest probability scoring systems in pulmonary embolism: wells, Kline and Geneva. Int J Clin Med. 2013;3(07):731.","journal-title":"Int J Clin Med"},{"issue":"1","key":"940_CR155","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1111\/j.1538-7836.2007.02820.x","volume":"6","author":"F Klok","year":"2008","unstructured":"Klok F, et al. Comparison of the revised Geneva score with the Wells rule for assessing clinical probability of pulmonary embolism. J Thromb Haemost. 2008;6(1):40\u20134.","journal-title":"J Thromb Haemost"},{"issue":"2","key":"940_CR156","doi-asserted-by":"publisher","first-page":"303","DOI":"10.17219\/acem\/35106","volume":"26","author":"O Turan","year":"2017","unstructured":"Turan O, et al. The contribution of clinical assessments to the diagnostic algorithm of pulmonary embolism. Adv Clin Exp Med. 2017;26(2):303.","journal-title":"Adv Clin Exp Med"},{"issue":"2","key":"940_CR157","doi-asserted-by":"publisher","first-page":"e14","DOI":"10.2196\/humanfactors.4537","volume":"2","author":"A Press","year":"2015","unstructured":"Press A, et al. Usability testing of a complex clinical decision support tool in the emergency department: lessons learned. JMIR Hum Factors. 2015;2(2):e14.","journal-title":"JMIR Hum Factors"},{"issue":"1","key":"940_CR158","doi-asserted-by":"publisher","first-page":"62","DOI":"10.7196\/SAMJ.2016.v106i1.9886","volume":"106","author":"C Murthy","year":"2016","unstructured":"Murthy C, et al. The impact of an electronic clinical decision support for pulmonary embolism imaging on the efficiency of computed tomography pulmonary angiography utilisation in a resource-limited setting. S Afr Med J. 2016;106(1):62\u20134.","journal-title":"S Afr Med J"},{"issue":"6","key":"940_CR159","doi-asserted-by":"publisher","first-page":"338","DOI":"10.1097\/MEJ.0b013e3283034222","volume":"15","author":"E Armagan","year":"2008","unstructured":"Armagan E, et al. Predictive value of the modified early warning score in a Turkish emergency department. Eur J Emerg Med. 2008;15(6):338\u201340.","journal-title":"Eur J Emerg Med"},{"issue":"10","key":"940_CR160","doi-asserted-by":"publisher","first-page":"674","DOI":"10.1136\/emj.2007.057661","volume":"25","author":"V Burch","year":"2008","unstructured":"Burch V, Tarr G, Morroni C. Modified early warning score predicts the need for hospital admission and inhospital mortality. Emerg Med J. 2008;25(10):674\u20138.","journal-title":"Emerg Med J"},{"issue":"6","key":"940_CR161","doi-asserted-by":"publisher","first-page":"406","DOI":"10.1097\/MEJ.0000000000000274","volume":"23","author":"ZD Dundar","year":"2016","unstructured":"Dundar ZD, et al. Modified early warning score and VitalPac early warning score in geriatric patients admitted to emergency department. Eur J Emerg Med. 2016;23(6):406\u201312.","journal-title":"Eur J Emerg Med"},{"issue":"6","key":"940_CR162","doi-asserted-by":"publisher","first-page":"571","DOI":"10.1308\/003588406X130615","volume":"88","author":"J Gardner-Thorpe","year":"2006","unstructured":"Gardner-Thorpe J, et al. The value of modified early warning score (MEWS) in surgical in-patients: a prospective observational study. Ann R Coll Surg Engl. 2006;88(6):571\u20135.","journal-title":"Ann R Coll Surg Engl"},{"issue":"5","key":"940_CR163","doi-asserted-by":"publisher","first-page":"e016143","DOI":"10.1136\/bmjopen-2017-016143","volume":"7","author":"K Salottolo","year":"2017","unstructured":"Salottolo K, et al. A retrospective cohort study of the utility of the modified early warning score for interfacility transfer of patients with traumatic injury. BMJ Open. 2017;7(5):e016143.","journal-title":"BMJ Open"},{"issue":"6","key":"940_CR164","doi-asserted-by":"publisher","first-page":"1786","DOI":"10.3906\/sag-1411-101","volume":"46","author":"MD Tanri\u00f6ver","year":"2016","unstructured":"Tanri\u00f6ver MD, et al. Daily surveillance with early warning scores help predict hospital mortality in medical wards. Turk J Med Sci. 2016;46(6):1786\u201391.","journal-title":"Turk J Med Sci"},{"issue":"2","key":"940_CR165","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1016\/j.jfma.2015.10.016","volume":"115","author":"A-Y Wang","year":"2016","unstructured":"Wang A-Y, et al. Periarrest modified early warning score (MEWS) predicts the outcome of in-hospital cardiac arrest. J Formos Med Assoc. 2016;115(2):76\u201382.","journal-title":"J Formos Med Assoc"},{"issue":"6","key":"940_CR166","first-page":"369","volume":"110","author":"D Tirotta","year":"2017","unstructured":"Tirotta D, et al. Evaluation of the threshold value for the modified early warning score (MEWS) in medical septic patients: a secondary analysis of an Italian multicentric prospective cohort (SNOOPII study). QJM. 2017;110(6):369\u201373.","journal-title":"QJM"},{"issue":"8","key":"940_CR167","doi-asserted-by":"publisher","first-page":"797","DOI":"10.1046\/j.1365-2044.2003.03258.x","volume":"58","author":"C Subbe","year":"2003","unstructured":"Subbe C, et al. Effect of introducing the modified early warning score on clinical outcomes, cardio-pulmonary arrests and intensive care utilisation in acute medical admissions. Anaesthesia. 2003;58(8):797\u2013802.","journal-title":"Anaesthesia"},{"issue":"2","key":"940_CR168","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1016\/j.resuscitation.2012.06.017","volume":"84","author":"K De Meester","year":"2013","unstructured":"De Meester K, et al. Impact of a standardized nurse observation protocol including MEWS after intensive care unit discharge. Resuscitation. 2013;84(2):184\u20138.","journal-title":"Resuscitation"},{"issue":"1","key":"940_CR169","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1016\/j.aucc.2012.05.001","volume":"26","author":"NE Hammond","year":"2013","unstructured":"Hammond NE, et al. The effect of implementing a modified early warning scoring (MEWS) system on the adequacy of vital sign documentation. Aust Crit Care. 2013;26(1):18\u201322.","journal-title":"Aust Crit Care"},{"issue":"2","key":"940_CR170","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1016\/j.resuscitation.2010.09.480","volume":"82","author":"A Moon","year":"2011","unstructured":"Moon A, et al. An eight year audit before and after the introduction of modified early warning score (MEWS) charts, of patients admitted to a tertiary referral intensive care unit after CPR. Resuscitation. 2011;82(2):150\u20134.","journal-title":"Resuscitation"},{"issue":"2","key":"940_CR171","doi-asserted-by":"publisher","first-page":"121","DOI":"10.7326\/0003-4819-140-5-200403020-00013","volume":"140","author":"LM Bachmann","year":"2004","unstructured":"Bachmann LM, et al. The accuracy of the Ottawa knee rule to rule out knee fractures A systematic review. Ann Intern Med. 2004;140(2):121\u20134.","journal-title":"Ann Intern Med"},{"issue":"23","key":"940_CR172","doi-asserted-by":"publisher","first-page":"2075","DOI":"10.1001\/jama.1997.03550230051036","volume":"278","author":"IG Stiell","year":"1997","unstructured":"Stiell IG, et al. Implementation of the Ottawa knee rule for the use of radiography in acute knee injuries. JAMA. 1997;278(23):2075\u20139.","journal-title":"JAMA"},{"issue":"4","key":"940_CR173","doi-asserted-by":"publisher","first-page":"438","DOI":"10.1016\/S0196-0644(99)80044-4","volume":"34","author":"G Nichol","year":"1999","unstructured":"Nichol G, et al. An economic analysis of the Ottawa knee rule. Ann Emerg Med. 1999;34(4):438\u201347.","journal-title":"Ann Emerg Med"},{"issue":"12","key":"940_CR174","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1097\/CIN.0000000000000196","volume":"33","author":"PCB Khong","year":"2015","unstructured":"Khong PCB, Holroyd E, Wang W. A critical review of the theoretical frameworks and the conceptual factors in the adoption of clinical decision support systems. Comput Inform Nurs. 2015;33(12):555\u201370.","journal-title":"Comput Inform Nurs"},{"issue":"e1","key":"940_CR175","doi-asserted-by":"publisher","first-page":"e28","DOI":"10.1136\/amiajnl-2013-001762","volume":"21","author":"DW Meeks","year":"2013","unstructured":"Meeks DW, et al. Exploring the sociotechnical intersection of patient safety and electronic health record implementation. J Am Med Inform Assoc. 2013;21(e1):e28\u201334.","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"940_CR176","doi-asserted-by":"publisher","first-page":"905","DOI":"10.1016\/j.jbi.2013.07.005","volume":"46","author":"B Sheehan","year":"2013","unstructured":"Sheehan B, et al. Informing the design of clinical decision support services for evaluation of children with minor blunt head trauma in the emergency department: a sociotechnical analysis. J Biomed Inform. 2013;46(5):905\u201313.","journal-title":"J Biomed Inform"},{"key":"940_CR177","first-page":"200943","volume-title":"Clinical practice improvement and redesign: how change in workflow can be supported by clinical decision support","author":"B-T Karsh","year":"2009","unstructured":"Karsh B-T. Clinical practice improvement and redesign: how change in workflow can be supported by clinical decision support. Rockville: Agency for Healthcare Research and Quality; 2009. p. 200943."},{"issue":"e1","key":"940_CR178","doi-asserted-by":"publisher","first-page":"e9","DOI":"10.1136\/amiajnl-2013-001684","volume":"20","author":"KM Cresswell","year":"2013","unstructured":"Cresswell KM, Bates DW, Sheikh A. Ten key considerations for the successful implementation and adoption of large-scale health information technology. J Am Med Inform Assoc. 2013;20(e1):e9\u2013e13.","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"940_CR179","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1016\/S0169-2607(02)00036-6","volume":"69","author":"C Carroll","year":"2002","unstructured":"Carroll C, et al. Involving users in the design and usability evaluation of a clinical decision support system. Comput Methods Prog Biomed. 2002;69(2):123\u201335.","journal-title":"Comput Methods Prog Biomed"},{"key":"940_CR180","doi-asserted-by":"publisher","first-page":"202","DOI":"10.2174\/1874431101004010202","volume":"4","author":"J Li","year":"2010","unstructured":"Li J. A sociotechnical approach to evaluating the impact of ICT on clinical care environments. Open Med Inform J. 2010;4:202.","journal-title":"Open Med Inform J"},{"issue":"Suppl 3","key":"940_CR181","doi-asserted-by":"publisher","first-page":"i68","DOI":"10.1136\/qshc.2010.042085","volume":"19","author":"DF Sittig","year":"2010","unstructured":"Sittig DF, Singh H. A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Health Care. 2010;19(Suppl 3):i68\u201374.","journal-title":"Qual Saf Health Care"},{"issue":"6","key":"940_CR182","doi-asserted-by":"publisher","first-page":"605","DOI":"10.1136\/heart.89.6.605","volume":"89","author":"ML Bouvy","year":"2003","unstructured":"Bouvy ML, et al. Predicting mortality in patients with heart failure: a pragmatic approach. Heart. 2003;89(6):605\u20139.","journal-title":"Heart"},{"issue":"4","key":"940_CR183","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1056\/NEJM199701233360402","volume":"336","author":"MJ Fine","year":"1997","unstructured":"Fine MJ, et al. A prediction rule to identify low-risk patients with community-acquired pneumonia. N Engl J Med. 1997;336(4):243\u201350.","journal-title":"N Engl J Med"},{"issue":"4","key":"940_CR184","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1016\/0197-2456(87)90155-3","volume":"8","author":"K Dickersin","year":"1987","unstructured":"Dickersin K, et al. Publication bias and clinical trials. Control Clin Trials. 1987;8(4):343\u201353.","journal-title":"Control Clin Trials"},{"issue":"8","key":"940_CR185","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3310\/hta14080","volume":"14","author":"F Song","year":"2010","unstructured":"Song F, et al. Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess. 2010;14(8):1\u2013193.","journal-title":"Health Technol Assess"},{"issue":"1","key":"940_CR186","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1186\/1748-5908-6-109","volume":"6","author":"DM Mann","year":"2011","unstructured":"Mann DM, et al. Rationale, design, and implementation protocol of an electronic health record integrated clinical prediction rule (iCPR) randomized trial in primary care. Implement Sci. 2011;6(1):109.","journal-title":"Implement Sci"},{"key":"940_CR187","first-page":"w14335","volume":"146","author":"CE Aubert","year":"2016","unstructured":"Aubert CE, et al. Prospective validation and adaptation of the HOSPITAL score to predict high risk of unplanned readmission of medical patients. Swiss Med Wkly. 2016;146:w14335.","journal-title":"Swiss Med Wkly"},{"issue":"11","key":"940_CR188","doi-asserted-by":"publisher","first-page":"e0187495","DOI":"10.1371\/journal.pone.0187495","volume":"12","author":"S-K Hung","year":"2017","unstructured":"Hung S-K, et al. Comparison of the mortality in emergency department Sepsis score, modified early warning score, rapid emergency medicine score and rapid acute physiology score for predicting the outcomes of adult splenic abscess patients in the emergency department. PLoS One. 2017;12(11):e0187495.","journal-title":"PLoS One"},{"issue":"5","key":"940_CR189","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1016\/j.cjtee.2016.11.008","volume":"20","author":"CM Keene","year":"2017","unstructured":"Keene CM, et al. The effect of the quality of vital sign recording on clinical decision making in a regional acute care trauma ward. Chin J Traumatol. 2017;20(5):283\u20137.","journal-title":"Chin J Traumatol"},{"issue":"1","key":"940_CR190","doi-asserted-by":"publisher","first-page":"E46","DOI":"10.1002\/jhm.552","volume":"5","author":"CR Heitz","year":"2010","unstructured":"Heitz CR, et al. Performance of the maximum modified early warning score to predict the need for higher care utilization among admitted emergency department patients. J Hosp Med. 2010;5(1):E46\u201352.","journal-title":"J Hosp Med"},{"issue":"1","key":"940_CR191","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1067\/mem.2003.196","volume":"42","author":"B Bulloch","year":"2003","unstructured":"Bulloch B, et al. Validation of the Ottawa knee rule in children: a multicenter study. Ann Emerg Med. 2003;42(1):48\u201355.","journal-title":"Ann Emerg Med"},{"key":"940_CR192","doi-asserted-by":"publisher","unstructured":"Jalili M, Gharebaghi H. Validation of the Ottawa knee rule in Iran: a prospective study. Emerg Med J. 2010. https:\/\/doi.org\/10.1136\/emj.2009.080267 .","DOI":"10.1136\/emj.2009.080267"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-019-0940-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12911-019-0940-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-019-0940-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,22]],"date-time":"2023-09-22T08:38:33Z","timestamp":1695371913000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-019-0940-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,29]]},"references-count":192,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["940"],"URL":"https:\/\/doi.org\/10.1186\/s12911-019-0940-7","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,29]]},"assertion":[{"value":"2 October 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 October 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 October 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"No ethics approval was required for any element of this study.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"207"}}