{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T18:53:57Z","timestamp":1778180037102,"version":"3.51.4"},"reference-count":48,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"12","license":[{"start":{"date-parts":[[2022,12,1]],"date-time":"2022-12-01T00:00:00Z","timestamp":1669852800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"abstract":"<jats:sec>\n            <jats:title>OBJECTIVE:<\/jats:title>\n            <jats:p>To conduct a systematic review to summarize cognitive instruments being used in long-term outcome studies of survivors of adult critical illness, as well as evaluate whether these measures are reported as using patient demographic norms, specifically race norms.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>DATA SOURCES:<\/jats:title>\n            <jats:p>A comprehensive search was conducted in PubMed (National Center for Biotechnology Information), Excerpta Medica dataBASE (Ovid), Psychological Information Database (ProQuest), and Web of Science (Clarivate) for English language studies published since 2002.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>STUDY SELECTION:<\/jats:title>\n            <jats:p>Studies were eligible if the population included adult ICU survivors assessed for postdischarge cognitive outcomes.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>DATA EXTRACTION:<\/jats:title>\n            <jats:p>Two independent reviewers screened abstracts, examined full text, and extracted data from all eligible articles.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>DATA SYNTHESIS:<\/jats:title>\n            <jats:p>A total of 98 articles (55 unique cohorts: 22 general ICU, 14 Acute respiratory distress syndrome\/Acute respiratory failure\/Sepsis, 19 COVID-19 and other subpopulations) were eligible for data extraction and synthesis. Among general ICU survivors, the majority of studies (<jats:italic toggle=\"yes\">n<\/jats:italic> = 15, 68%) assessed cognition using multiple instruments, of which the most common was the Mini-Mental State Examination. Only nine of the 22 studies (41%) explicitly reported using patient demographic norms for scoring neuropsychological cognitive tests. Of the nine, all reported using age as a norming characteristic, education was reported in eight (89%), sex\/gender was reported in five (55%), and race\/ethnicity was reported in three (33%). Among Acute respiratory distress syndrome\/Acute respiratory failure\/Sepsis survivors, norming characteristics were reported in only four (28%) of the 14 studies, of which all reported using age and none reported using race\/ethnicity.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>CONCLUSIONS:<\/jats:title>\n            <jats:p>Less than half of the studies measuring cognitive outcomes in ICU survivors reported the use of norming characteristics. There is substantial heterogeneity in how studies reported the use of cognitive instruments, and hence, the prevalence of the use of patient norms may be underestimated. These findings are important in the development of appropriate standards for use and reporting of neuropsychological tests among ICU survivors.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1097\/cce.0000000000000830","type":"journal-article","created":{"date-parts":[[2023,2,3]],"date-time":"2023-02-03T00:53:23Z","timestamp":1675385603000},"page":"e0830","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":3,"title":["Instruments Assessing Cognitive Impairment in Survivors of Critical Illness and Reporting of Race Norms: A Systematic Review"],"prefix":"10.1097","volume":"4","author":[{"given":"Rameela","family":"Raman","sequence":"first","affiliation":[{"name":"Department of Biostatistics, Vanderbilt University School of Medicine, Nashville, TN."},{"name":"Critical Illness, Brain Dysfunction, and Survivorship (CIBS) Center, Vanderbilt University Medical Center, Nashville, TN."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Spencer J.","family":"DesAutels","sequence":"additional","affiliation":[{"name":"Center for Knowledge Management (CKM), Vanderbilt University Medical Center, Nashville, TN."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alana M.","family":"Lauck","sequence":"additional","affiliation":[{"name":"Critical Illness, Brain Dysfunction, and Survivorship (CIBS) Center, Vanderbilt University Medical Center, Nashville, TN."},{"name":"Division of Allergy, Pulmonary, and Critical Care Medicine, Vanderbilt University Medical Center, Nashville, TN."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexa M.","family":"Scher","sequence":"additional","affiliation":[{"name":"Critical Illness, Brain Dysfunction, and Survivorship (CIBS) Center, Vanderbilt University Medical Center, Nashville, TN."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rachel L.","family":"Walden","sequence":"additional","affiliation":[{"name":"Annette and Irwin Eskind Family Biomedical Library and Learning Center, Vanderbilt University, Nashville, TN."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amy L.","family":"Kiehl","sequence":"additional","affiliation":[{"name":"Critical Illness, Brain Dysfunction, and Survivorship (CIBS) Center, Vanderbilt University Medical Center, Nashville, TN."},{"name":"Division of Allergy, Pulmonary, and Critical Care Medicine, Vanderbilt University Medical Center, Nashville, TN."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Erin M.","family":"Collar","sequence":"additional","affiliation":[{"name":"Critical Illness, Brain Dysfunction, and Survivorship (CIBS) Center, Vanderbilt University Medical Center, Nashville, TN."},{"name":"Division of Allergy, Pulmonary, and Critical Care Medicine, Vanderbilt University Medical Center, Nashville, TN."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"E. Wesley","family":"Ely","sequence":"additional","affiliation":[{"name":"Critical Illness, Brain Dysfunction, and Survivorship (CIBS) Center, Vanderbilt University Medical Center, Nashville, TN."},{"name":"Division of Allergy, Pulmonary, and Critical Care Medicine, Vanderbilt University Medical Center, Nashville, TN."},{"name":"Geriatric Research, Education, and Clinical Center (GRECC), Tennessee Valley Healthcare System, Nashville, TN."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pratik P.","family":"Pandharipande","sequence":"additional","affiliation":[{"name":"Critical Illness, Brain Dysfunction, and Survivorship (CIBS) Center, Vanderbilt University Medical Center, Nashville, TN."},{"name":"Department of Anesthesiology, Division of Anesthesiology Critical Care Medicine, Vanderbilt University Medical Center, Nashville, TN."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James C.","family":"Jackson","sequence":"additional","affiliation":[{"name":"Critical Illness, Brain Dysfunction, and Survivorship (CIBS) Center, Vanderbilt University Medical Center, Nashville, TN."},{"name":"Division of Allergy, Pulmonary, and Critical Care Medicine, Vanderbilt University Medical Center, Nashville, TN."},{"name":"Geriatric Research, Education, and Clinical Center (GRECC), Tennessee Valley Healthcare System, Nashville, TN."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"276","published-online":{"date-parts":[[2022,12,22]]},"reference":[{"key":"R2-20240807","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1097\/CCM.0b013e3181e47be1","article-title":"Delirium as a predictor of long-term cognitive impairment in survivors of critical illness.","volume":"38","author":"Girard","year":"2010","journal-title":"Crit Care Med"},{"key":"R3-20240807","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1056\/NEJMoa022450","article-title":"One-year outcomes in survivors of the acute respiratory distress syndrome.","volume":"348","author":"Herridge","year":"2003","journal-title":"N Engl J Med"},{"key":"R4-20240807","doi-asserted-by":"crossref","first-page":"1293","DOI":"10.1056\/NEJMoa1011802","article-title":"Functional disability 5 years after acute respiratory distress syndrome.","volume":"364","author":"Herridge","year":"2011","journal-title":"N Engl J Med"},{"key":"R5-20240807","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1164\/ajrccm.160.1.9708059","article-title":"Neuropsychological sequelae and impaired health status in survivors of severe acute respiratory distress syndrome.","volume":"160","author":"Hopkins","year":"1999","journal-title":"Am J Respir Crit Care Med"},{"key":"R6-20240807","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1097\/CCM.0b013e318232da75","article-title":"Improving long-term outcomes after discharge from intensive care unit: Report from a stakeholders\u2019 conference.","volume":"40","author":"Needham","year":"2012","journal-title":"Crit Care Med"},{"key":"R7-20240807","doi-asserted-by":"crossref","first-page":"2518","DOI":"10.1097\/CCM.0000000000000525","article-title":"Exploring the scope of post-intensive care syndrome therapy and care: Engagement of non-critical care providers and survivors in a second stakeholders meeting.","volume":"42","author":"Elliott","year":"2014","journal-title":"Crit Care Med"},{"key":"R8-20240807","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1007\/s00134-012-2784-9","article-title":"Cognitive impairment after intensive care unit admission: A systematic review.","volume":"39","author":"Wolters","year":"2013","journal-title":"Intensive Care Med"},{"key":"R9-20240807","doi-asserted-by":"crossref","first-page":"1787","DOI":"10.1001\/jama.2010.1553","article-title":"Long-term cognitive impairment and functional disability among survivors of severe sepsis.","volume":"304","author":"Iwashyna","year":"2010","journal-title":"JAMA"},{"key":"R10-20240807","doi-asserted-by":"crossref","first-page":"1306","DOI":"10.1056\/NEJMoa1301372","article-title":"Long-term cognitive impairment after critical illness.","volume":"369","author":"Pandharipande","year":"2013","journal-title":"N Engl J Med"},{"key":"R11-20240807","doi-asserted-by":"crossref","first-page":"763","DOI":"10.1001\/jama.2010.167","article-title":"Association between acute care and critical illness hospitalization and cognitive function in older adults.","volume":"303","author":"Ehlenbach","year":"2010","journal-title":"JAMA"},{"key":"R12-20240807","doi-asserted-by":"crossref","first-page":"1373","DOI":"10.1001\/jamaneurol.2020.2273","article-title":"Association of delirium with long-term cognitive decline: A meta-analysis.","volume":"77","author":"Goldberg","year":"2020","journal-title":"JAMA Neurology"},{"key":"R13-20240807","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1097\/01.CCM.0000059996.30263.94","article-title":"Six-month neuropsychological outcome of medical intensive care unit patients.","volume":"31","author":"Jackson","year":"2003","journal-title":"Crit Care Med"},{"key":"R14-20240807","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1177\/1751143720923597","article-title":"Instruments to measure outcomes of post-intensive care syndrome in outpatient care settings\u2013results of an expert consensus and feasibility field test.","volume":"22","author":"Spies","year":"2021","journal-title":"J Intensive Care Soc"},{"key":"R15-20240807","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1164\/rccm.201702-0372OC","article-title":"Core outcome measures for clinical research in acute respiratory failure survivors. An international modified Delphi consensus study.","volume":"196","author":"Needham","year":"2017","journal-title":"Am J Respir Crit Care Med"},{"key":"R17-20240807","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1097\/WAD.0000000000000388","article-title":"Expanded demographic norms for version 3 of the Alzheimer disease centers\u2019 neuropsychological test battery in the uniform data set.","volume":"34","author":"Sachs","year":"2020","journal-title":"Alzheimer Dis Assoc Disord"},{"key":"R18-20240807","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1080\/13803395.2011.559157","article-title":"Demographically corrected norms for African Americans and Caucasians on the Hopkins verbal learning test-revised, brief visuospatial memory test-revised, stroop color and word test, and Wisconsin card sorting test 64-card version.","volume":"33","author":"Norman","year":"2011","journal-title":"J Clin Exp Neuropsychol"},{"key":"R19-20240807","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1080\/13854040590945265","article-title":"Mayo\u2019s older African Americans normative studies: Normative data for commonly used clinical neuropsychological measures.","volume":"19","author":"Lucas","year":"2005","journal-title":"Clin Neuropsychol"},{"key":"R20-20240807","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1076\/1380-3395(200002)22:1;1-8;FT080","article-title":"Demographically corrected norms for the California verbal learning test.","volume":"22","author":"Norman","year":"2000","journal-title":"J Clin Exp Neuropsychol"},{"key":"R21-20240807","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1177\/107319119900600204","article-title":"Norms for letter and category fluency: Demographic corrections for age, education, and ethnicity.","volume":"6","author":"Gladsjo","year":"1999","journal-title":"Assessment"},{"key":"R22-20240807","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1007\/s11065-009-9090-5","article-title":"Race-norming of neuropsychological tests.","volume":"19","author":"Gasquoine","year":"2009","journal-title":"Neuropsychol Rev"},{"key":"R23-20240807","doi-asserted-by":"crossref","first-page":"956","DOI":"10.1080\/13803390801945046","article-title":"A screening test of English naming ability in bilingual Spanish\/English speakers.","volume":"30","author":"Casas","year":"2008","journal-title":"J Clin Exp Neuropsychol"},{"key":"R24-20240807","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1080\/13854049708407034","article-title":"Stroop color-word performance of African Americans.","volume":"11","author":"Strickland","year":"1997","journal-title":"Clin Neuropsychol"},{"key":"R25-20240807","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1001\/jamaneurol.2020.4763","article-title":"Perils of race-based norms in cognitive testing: The case of former NFL players.","volume":"78","author":"Possin","year":"2021","journal-title":"JAMA Neurol"},{"key":"R26-20240807","doi-asserted-by":"crossref","first-page":"1089","DOI":"10.1037\/neu0000579","article-title":"Group differences in normal neuropsychological test performance for older non-Hispanic White and Black\/African American adults.","volume":"33","author":"Werry","year":"2019","journal-title":"Neuropsychology"},{"key":"R27-20240807","doi-asserted-by":"crossref","first-page":"874","DOI":"10.1056\/NEJMms2004740","article-title":"Hidden in plain sight \u2014 reconsidering the use of race correction in clinical algorithms.","volume":"383","author":"Vyas","year":"2020","journal-title":"N Engl J Med"},{"key":"R29-20240807","first-page":"58782","article-title":"Revisions to the standards for the classification of federal data on race and ethnicity.","volume":"62","year":"1997","journal-title":"Fed Regist"},{"key":"R30-20240807","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13643-016-0384-4","article-title":"Rayyan\u2014a web and mobile app for systematic reviews.","volume":"5","author":"Ouzzani","year":"2016","journal-title":"Syst Rev"},{"key":"R31-20240807","doi-asserted-by":"crossref","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement: An updated guideline for reporting systematic reviews.","volume":"372","author":"Page","year":"2021","journal-title":"BMJ"},{"key":"R32-20240807","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1016\/j.jcrc.2016.09.026","article-title":"Derivation and validation of the automated search algorithms to identify cognitive impairment and dementia in electronic health records.","volume":"37","author":"Amra","year":"2017","journal-title":"J Crit Care"},{"key":"R33-20240807","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1080\/01616412.2020.1831302","article-title":"Functional outcome after critical illness in older patients: A population-based study.","volume":"43","author":"Hajeb","year":"2021","journal-title":"Neurol Res"},{"key":"R34-20240807","doi-asserted-by":"crossref","first-page":"1116","DOI":"10.1097\/CCM.0000000000003829","article-title":"Association between critical care admissions and cognitive trajectories in older adults.","volume":"47","author":"Schulte","year":"2019","journal-title":"Crit Care Med"},{"key":"R35-20240807","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1111\/jgs.16909","article-title":"Association of hospitalization with long-term cognitive trajectories in older adults.","volume":"69","author":"Sprung","year":"2021","journal-title":"J Am Geriatr Soc"},{"key":"R36-20240807","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1186\/s13054-015-0934-5","article-title":"Cognitive screening among acute respiratory failure survivors: A cross-sectional evaluation of the mini-mental state examination.","volume":"19","author":"Pfoh","year":"2015","journal-title":"Crit Care"},{"key":"R37-20240807","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/0022-3956(75)90026-6","article-title":"\u201cMini-mental state\u201d: A practical method for grading the cognitive state of patients for the clinician.","volume":"12","author":"Folstein","year":"1975","journal-title":"J Psychiatr Res"},{"key":"R40-20240807","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1076\/jcen.20.3.310.823","article-title":"The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS): Preliminary clinical validity.","volume":"20","author":"Randolph","year":"1998","journal-title":"J Clin Exp Neuropsychol"},{"key":"R41-20240807","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1111\/j.1532-5415.2005.53221.x","article-title":"The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment.","volume":"53","author":"Nasreddine","year":"2005","journal-title":"J Am Geriatr Soc"},{"key":"R42-20240807","first-page":"641","article-title":"Consortium to establish a registry for Alzheimer\u2019s Disease (CERAD) clinical and neuropsychological.","volume":"24","author":"Morris","year":"1989","journal-title":"Psychopharmacol Bull"},{"key":"R43-20240807","doi-asserted-by":"crossref","first-page":"2386","DOI":"10.1001\/jama.1993.03500180078038","article-title":"Population-based norms for the mini-mental state examination by age and educational level.","volume":"269","author":"Crum","year":"1993","journal-title":"JAMA"},{"key":"R44-20240807","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/S0887-6177(03)00039-8","article-title":"Trail making test A and B: Normative data stratified by age and education.","volume":"19","author":"Tombaugh","year":"2004","journal-title":"Arch Clin Neuropsychol"},{"key":"R46-20240807","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.clineuro.2017.07.010","article-title":"Towards reporting standards for neuropsychological study results: A proposal to minimize communication errors with standardized qualitative descriptors for normalized test scores.","volume":"162","author":"Schoenberg","year":"2017","journal-title":"Clin Neurol Neurosurg"},{"key":"R47-20240807","doi-asserted-by":"crossref","first-page":"155","DOI":"10.4054\/DemRes.2018.38.6","article-title":"The role of education in the association between race\/ethnicity\/nativity, cognitive impairment, and dementia among older adults in the United States.","volume":"38","author":"Garcia","year":"2018","journal-title":"Demogr Res"},{"key":"R48-20240807","doi-asserted-by":"crossref","first-page":"963","DOI":"10.1016\/j.childyouth.2009.04.012","article-title":"Wealth, race\/ethnicity, and children\u2019s educational outcomes.","volume":"31","author":"Kaushal","year":"2009","journal-title":"Child Youth Serv Rev"},{"key":"R49-20240807","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1007\/s00127-017-1362-4","article-title":"Intersections of poverty, race\/ethnicity, and sex: Alcohol consumption and adverse outcomes in the United States.","volume":"52","author":"Glass","year":"2017","journal-title":"Soc Psychiatry Psychiatr Epidemiol"},{"key":"R50-20240807","doi-asserted-by":"crossref","first-page":"312","DOI":"10.2105\/AJPH.2003.032482","article-title":"Painting a truer picture of us socioeconomic and racial\/ethnic health inequalities: The public health disparities geocoding project.","volume":"95","author":"Krieger","year":"2005","journal-title":"Am J Public Health"},{"key":"R51-20240807","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1164\/rccm.201904-0816CI","article-title":"Natural history of cognitive impairment in critical illness survivors. A systematic review.","volume":"202","author":"Honarmand","year":"2020","journal-title":"Am J Respir Crit Care Med"},{"key":"R52-20240807","doi-asserted-by":"crossref","first-page":"1267","DOI":"10.1097\/CCM.0000000000001651","article-title":"Outcome measurement in ICU survivorship research from 1970 to 2013: A scoping review of 425 publications.","volume":"44","author":"Turnbull","year":"2016","journal-title":"Crit Care Med"},{"key":"R53-20240807","doi-asserted-by":"crossref","first-page":"4269","DOI":"10.3390\/jcm10184269","article-title":"Sepsis and cognitive assessment.","volume":"10","author":"Jones","year":"2021","journal-title":"J Clin Med"},{"key":"R54-20240807","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1080\/13854040590945346","article-title":"Advantages and disadvantages of separate norms for African Americans.","volume":"19","author":"Manly","year":"2005","journal-title":"Clin Neuropsychol"}],"container-title":["Critical Care Explorations"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/10.1097\/CCE.0000000000000830","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,7]],"date-time":"2024-08-07T14:12:28Z","timestamp":1723039948000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/10.1097\/CCE.0000000000000830"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12]]},"references-count":48,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022]]}},"URL":"https:\/\/doi.org\/10.1097\/cce.0000000000000830","relation":{},"ISSN":["2639-8028"],"issn-type":[{"value":"2639-8028","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12]]}}}