{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,2]],"date-time":"2025-05-02T14:09:33Z","timestamp":1746194973740,"version":"3.37.3"},"reference-count":40,"publisher":"Oxford University Press (OUP)","issue":"8","license":[{"start":{"date-parts":[[2018,5,14]],"date-time":"2018-05-14T00:00:00Z","timestamp":1526256000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/academic.oup.com\/journals\/pages\/about_us\/legal\/notices"}],"funder":[{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R56LM011925","T15LM007124"],"award-info":[{"award-number":["R56LM011925","T15LM007124"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,8,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Introduction<\/jats:title>\n                  <jats:p>Many electronic health records fail to support information uptake because they impose low-level information organization tasks on users. Clinical concept-oriented views have shown information processing improvements, but the specifics of this organization for critical care are unclear.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>To determine high-level cognitive processes and patient information organization schema in critical care.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>We conducted an open card sort of 29 patient data elements and a modified Delphi card sort of 65 patient data elements. Study participants were 39 clinicians with varied critical care training and experience. We analyzed the open sort with a hierarchical cluster analysis (HCA) and factor analysis (FA). The Delphi sort was split into three initiating groups that resulted in three unique solutions. We compared results between open sort analyses (HCA and FA), between card sorting exercises (open and Delphi), and across the Delphi solutions.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Between the HCA and FA, we observed common constructs including cardiovascular and hemodynamics, infectious disease, medications, neurology, patient overview, respiratory, and vital signs. The more comprehensive Delphi sort solutions also included gastrointestinal, renal, and imaging constructs.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>We identified primarily system-based groupings (e.g., cardiovascular, respiratory). Source-based (e.g., medications, laboratory) groups became apparent when participants were asked to sort a longer list of concepts. These results suggest a hybrid approach to information organization, which may combine systems, source, or problem-based groupings, best supports clinicians\u2019 mental models. These results can contribute to the design of information displays to better support clinicians\u2019 access and interpretation of information for critical care decisions.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocy045","type":"journal-article","created":{"date-parts":[[2018,4,6]],"date-time":"2018-04-06T19:41:23Z","timestamp":1523043683000},"page":"1026-1035","source":"Crossref","is-referenced-by-count":12,"title":["Patient information organization in the intensive care setting: expert knowledge elicitation with card sorting methods"],"prefix":"10.1093","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1081-1670","authenticated-orcid":false,"given":"Thomas","family":"Reese","sequence":"first","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT, USA"}]},{"given":"Noa","family":"Segall","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology, Duke University Medical Center, Durham, NC, USA"}]},{"given":"Paige","family":"Nesbitt","sequence":"additional","affiliation":[{"name":"Trinity Health and Saint Alphonsus Regional Medical Center, Boise, ID, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9954-6799","authenticated-orcid":false,"given":"Guilherme","family":"Del Fiol","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT, USA"}]},{"given":"Rosalie","family":"Waller","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT, USA"}]},{"given":"Brekk C","family":"Macpherson","sequence":"additional","affiliation":[{"name":"School of Nursing, Virginia Commonwealth University, Richmond, VA, USA"}]},{"given":"Joseph E","family":"Tonna","sequence":"additional","affiliation":[{"name":"Department of Surgery, University of Utah School of Medicine, Salt Lake City, UT, USA"}]},{"given":"Melanie C","family":"Wright","sequence":"additional","affiliation":[{"name":"Trinity Health and Saint Alphonsus Regional Medical Center, Boise, ID, USA"}]}],"member":"286","published-online":{"date-parts":[[2018,5,14]]},"reference":[{"issue":"2","key":"2020110612232649300_ocy045-B1","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1097\/00003246-199502000-00015","article-title":"A look into the nature and causes of human errors in the intensive care unit","volume":"23","author":"Donchin","year":"1995","journal-title":"Crit Care Med"},{"issue":"9","key":"2020110612232649300_ocy045-B2","doi-asserted-by":"crossref","first-page":"901","DOI":"10.1001\/jama.2017.0076","article-title":"Addressing physician burnout: the way forward","volume":"317","author":"Shanafelt","year":"2017","journal-title":"JAMA"},{"key":"2020110612232649300_ocy045-B3","first-page":"249","volume-title":"Perspectives on Information Overload","author":"Bawden","year":"1999"},{"issue":"04","key":"2020110612232649300_ocy045-B4","doi-asserted-by":"crossref","first-page":"912","DOI":"10.4338\/ACI-2016-03-RA-0033","article-title":"Toward designing information display to support critical care. a qualitative contextual evaluation and visioning effort","volume":"07","author":"Wright","year":"2016","journal-title":"Appl Clin Inform"},{"issue":"10","key":"2020110612232649300_ocy045-B5","doi-asserted-by":"crossref","first-page":"1061","DOI":"10.1001\/jama.2016.12226","article-title":"Implementation of a value-driven outcomes program to identify high variability in clinical costs and outcomes and association with reduced cost and improved quality","volume":"316","author":"Lee","year":"2016","journal-title":"JAMA"},{"key":"2020110612232649300_ocy045-B6","first-page":"377","article-title":"An object oriented computer-based patient record reference model","author":"Dore","year":"1995","journal-title":"Proc Annu Symp Comput Appl Med Care"},{"issue":"3","key":"2020110612232649300_ocy045-B7","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1197\/jamia.M1008","article-title":"Providing concept-oriented views for clinical data using a knowledge-based system: an evaluation","volume":"9","author":"Zeng","year":"2002","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2020110612232649300_ocy045-B8","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1006\/jbin.2001.1013","article-title":"A knowledge-based, concept-oriented view generation system for clinical data","volume":"34","author":"Zeng","year":"2001","journal-title":"J Biomed Inform"},{"issue":"2","key":"2020110612232649300_ocy045-B9","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1109\/TITB.2012.2186149","article-title":"Context-based electronic health record: toward patient specific healthcare","volume":"16","author":"Hsu","year":"2012","journal-title":"IEEE Trans Inform Technol Biomed"},{"issue":"02","key":"2020110612232649300_ocy045-B10","doi-asserted-by":"crossref","first-page":"116","DOI":"10.4338\/ACI-2009-12-CR-0027","article-title":"Novel representation of clinical information in the ICU: developing user interfaces which reduce information overload","volume":"01","author":"Pickering","year":"2010","journal-title":"Appl Clin Inform"},{"issue":"7","key":"2020110612232649300_ocy045-B11","doi-asserted-by":"crossref","first-page":"1626","DOI":"10.1097\/CCM.0b013e31821858a0","article-title":"The effect of two different electronic health record user interfaces on intensive care provider task load, errors of cognition, and performance","volume":"39","author":"Ahmed","year":"2011","journal-title":"Crit Care Med"},{"issue":"5","key":"2020110612232649300_ocy045-B12","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1016\/j.ijmedinf.2015.01.017","article-title":"The implementation of clinician designed, human-centered electronic medical record viewer in the intensive care unit: a pilot step-wedge cluster randomized trial","volume":"84","author":"Pickering","year":"2015","journal-title":"Int J Med Inform"},{"key":"2020110612232649300_ocy045-B13","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.ijmedinf.2016.01.011","article-title":"User perception and experience of the introduction of a novel critical care patient viewer in the ICU setting","volume":"88","author":"Dziadzko","year":"2016","journal-title":"Int J Med Inform"},{"issue":"12","key":"2020110612232649300_ocy045-B14","doi-asserted-by":"crossref","first-page":"842","DOI":"10.1016\/j.ijmedinf.2012.04.004","article-title":"Evaluation of an integrated graphical display to promote acute change detection in ICU patients","volume":"81","author":"Anders","year":"2012","journal-title":"Int J Med Inform"},{"issue":"3","key":"2020110612232649300_ocy045-B15","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1177\/0018720813499367","article-title":"Evaluation of a configural vital signs display for intensive care unit nurses","volume":"56","author":"Drews","year":"2014","journal-title":"Hum Factors"},{"issue":"6","key":"2020110612232649300_ocy045-B16","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1007\/s10877-012-9370-0","article-title":"Evaluation of an integrated intensive care unit monitoring display by critical care fellow physicians","volume":"26","author":"Gorges","year":"2012","journal-title":"J Clin Monit Comput"},{"issue":"4","key":"2020110612232649300_ocy045-B17","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1136\/amiajnl-2011-000678","article-title":"Intensive care unit nurses\u2019 information needs and recommendations for integrated displays to improve nurses\u2019 situation awareness","volume":"19","author":"Koch","year":"2012","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612232649300_ocy045-B18","first-page":"560","article-title":"Supporting clinical cognition: a human-centered approach to a novel ICU information visualization dashboard","volume":"2015","author":"Faiola","year":"2015","journal-title":"AMIA Annu Symp Proc."},{"key":"2020110612232649300_ocy045-B19","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1007\/s10111-004-0151-5","article-title":"Work domain analysis framework for modelling intensive care unit patients","volume":"6","author":"Miller","year":"2004","journal-title":"Cogn Tech Work"},{"issue":"4","key":"2020110612232649300_ocy045-B20","doi-asserted-by":"crossref","first-page":"753","DOI":"10.1016\/j.apergo.2008.07.004","article-title":"The effects of clinical information presentation on physicians\u2019 and nurses\u2019 decision-making in ICUs","volume":"40","author":"Miller","year":"2009","journal-title":"Appl Ergon"},{"issue":"6","key":"2020110612232649300_ocy045-B21","doi-asserted-by":"crossref","first-page":"1502","DOI":"10.1097\/CCM.0b013e318287f0c0","article-title":"Data utilization for medical decision making at the time of patient admission to ICU","volume":"41","author":"Pickering","year":"2013","journal-title":"Crit Care Med"},{"key":"2020110612232649300_ocy045-B22","volume-title":"Information Dashboard Design","author":"Few","year":"2013","edition":"2nd edn)"},{"year":"2017","author":"Reese","key":"2020110612232649300_ocy045-B23"},{"issue":"7","key":"2020110612232649300_ocy045-B24","doi-asserted-by":"crossref","first-page":"14","DOI":"10.3102\/0013189X033007014","article-title":"Mixed methods research: a research paradigm whose time has come","volume":"33","author":"Johnson","year":"2004","journal-title":"Educ Res"},{"volume-title":"Measuring the User Experience","year":"2008","author":"Tullis","key":"2020110612232649300_ocy045-B25"},{"issue":"3","key":"2020110612232649300_ocy045-B26","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1111\/j.1468-0394.2005.00300.x","article-title":"The sorting techniques: a tutorial paper on card sorts, picture sorts and item sorts","volume":"22","author":"Rugg","year":"2005","journal-title":"Expert Syst"},{"issue":"5","key":"2020110612232649300_ocy045-B27","doi-asserted-by":"crossref","first-page":"691","DOI":"10.1177\/154193120504900512","article-title":"Factor analysis of card sort data: an alternative to hierarchical cluster analysis","volume":"49","author":"Capra","year":"2005","journal-title":"Proc Human Factors Ergon Soc Annu Meet"},{"issue":"1","key":"2020110612232649300_ocy045-B28","first-page":"7","article-title":"Paul CL. A modified delphi approach to a new card sorting methodology","volume":"4","year":"2008","journal-title":"J Usability Stud"},{"issue":"9","key":"2020110612232649300_ocy045-B29","doi-asserted-by":"crossref","first-page":"1695","DOI":"10.1016\/j.techfore.2011.04.005","article-title":"Enhancing rigour in the Delphi technique research","volume":"78","author":"Hasson","year":"2011","journal-title":"Technol Forecast Soc Change"},{"year":"2017","author":"OptimalSort Online Card Sorting Software","key":"2020110612232649300_ocy045-B30"},{"key":"2020110612232649300_ocy045-B31"},{"issue":"4","key":"2020110612232649300_ocy045-B32","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1136\/jamia.2009.000505","article-title":"The design and evaluation of a graphical display for laboratory data","volume":"17","author":"Bauer","year":"2010","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2020110612232649300_ocy045-B33","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1097\/CCM.0b013e3181fa4184","article-title":"Limiting ventilator-induced lung injury through individual electronic medical record surveillance","volume":"39","author":"Herasevich","year":"2011","journal-title":"Crit Care Med"},{"year":"2004","author":"Tullis","key":"2020110612232649300_ocy045-B34"},{"issue":"2","key":"2020110612232649300_ocy045-B35","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1016\/j.evalprogplan.2011.10.003","article-title":"Quality and rigor of the concept mapping methodology: a pooled study analysis","volume":"35","author":"Rosas","year":"2012","journal-title":"Eval Program Plann"},{"year":"2012","key":"2020110612232649300_ocy045-B36"},{"issue":"3","key":"2020110612232649300_ocy045-B37","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1007\/BF02289233","article-title":"The varimax criterion for analytic rotation in factor analysis","volume":"23","author":"Kaiser","year":"1958","journal-title":"Psychometrika"},{"year":"1998","author":"DeCoster","key":"2020110612232649300_ocy045-B38"},{"issue":"12 S1","key":"2020110612232649300_ocy045-B39","first-page":"364","article-title":"Display features that improve interpretation of critical care information: a systematic review","volume":"44","author":"Wright","year":"2017","journal-title":"Crit Care Med"},{"year":"2017","key":"2020110612232649300_ocy045-B40"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/25\/8\/1026\/34150357\/ocy045.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/25\/8\/1026\/34150357\/ocy045.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T17:28:19Z","timestamp":1604683699000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/25\/8\/1026\/4995943"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,5,14]]},"references-count":40,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2018,5,14]]},"published-print":{"date-parts":[[2018,8,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocy045","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"type":"print","value":"1067-5027"},{"type":"electronic","value":"1527-974X"}],"subject":[],"published-other":{"date-parts":[[2018,8]]},"published":{"date-parts":[[2018,5,14]]}}}