{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T07:50:07Z","timestamp":1773993007531,"version":"3.50.1"},"reference-count":119,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[1998,6,1]],"date-time":"1998-06-01T00:00:00Z","timestamp":896659200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Hum Factors"],"published-print":{"date-parts":[[1998,6]]},"abstract":"<jats:p> The Critical Decision Method (CDM) is an approach to cognitive task analysis. The method involves multiple-pass event retrospection guided by probe questions. The CDM has been used in the elicitation of expert knowledge in diverse domains and for applications including system development and instructional design. The CDM research illustrates the sorts of knowledge representation products that can arise from cognitive task analysis (e.g., Situation Assessment Records, time lines, decision requirements). The research also shows how one can approach methodological issues surrounding cognitive task analysis, including questions about data quality and method reliability, efficiency, and utility. As cognitive task analysis is used more widely in the elicitation, preservation, and dissemination of expert knowledge and is used more widely as the basis for the design of complex cognitive systems, and as projects move into even more field applications and real-world settings, the issues we discuss become increasingly critical. <\/jats:p>","DOI":"10.1518\/001872098779480442","type":"journal-article","created":{"date-parts":[[2007,1,13]],"date-time":"2007-01-13T15:25:31Z","timestamp":1168701931000},"page":"254-276","source":"Crossref","is-referenced-by-count":282,"title":["Use of the Critical Decision Method to Elicit Expert Knowledge: A Case Study in the Methodology of Cognitive Task Analysis"],"prefix":"10.1177","volume":"40","author":[{"given":"Robert R.","family":"Hoffman","sequence":"first","affiliation":[{"name":"Adelphi University, Garden City, New York"}]},{"given":"Beth","family":"Crandall","sequence":"additional","affiliation":[{"name":"Klein associates, Inc., Fairborn, Ohio"}]},{"given":"Nigel","family":"Shadbolt","sequence":"additional","affiliation":[{"name":"University of Nottingham, Nottingham, England"}]}],"member":"179","published-online":{"date-parts":[[1998,6,1]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1109\/21.31055"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-7373(79)80035-8"},{"key":"atypb3","first-page":"21","volume-title":"Decision making in action: Models and methods","author":"Beach, L. R.","year":"1993"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.3758\/BF03336211"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-0394.1987.tb00138.x"},{"key":"atypb6","volume-title":"Decision makingin armored platoon command","author":"Brezovic, C. P.","year":"1987"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1518\/001872095779049381"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1145\/63266.63283"},{"key":"atypb9","volume-title":"Poster presented at the Annual Convention of the American Psychological Society","author":"Buckner, V. G."},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.21236\/ADA234877"},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog0502_2"},{"key":"atypb12","volume-title":"The nature of expertise","author":"Chi, M. T. H.","year":"1988"},{"key":"atypb13","doi-asserted-by":"publisher","DOI":"10.1177\/001872088803000402"},{"key":"atypb14","first-page":"252","volume-title":"Decision making in action: Models and methods","author":"Christensen-Szalanski, J. J.","year":"1993"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(83)90008-5"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-7373(87)80049-4"},{"key":"atypb17","volume-title":"Human performance in anesthesia","author":"Cook, R. I.","year":"1991"},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1016\/0020-7373(92)90065-S"},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.1994.1083"},{"key":"atypb20","doi-asserted-by":"crossref","unstructured":"Cooke, N. J. & Rowe, A. L. (1994). Evaluating mental model elicitation methods. In Proceedings of the Human Factors and Ergonomics Society 38th Annual Meeting (pp. 261\u2013265). Santa Monica, CA: Human Factors and Ergonomics Society.","DOI":"10.1177\/154193129403800416"},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1145\/63266.63288"},{"key":"atypb22","volume-title":"Clinical assessment skills of experienced neonatal intensive care nurses","author":"Crandall, B.","year":"1989"},{"key":"atypb23","volume-title":"Guide to early sepsis assessment in the NICU","author":"Crandall, B.","year":"1991"},{"key":"atypb24","doi-asserted-by":"publisher","DOI":"10.1097\/00012272-199309000-00006"},{"key":"atypb25","unstructured":"Crandall, B. & Klein, G. A. (1988a). Critical cues for MI and cardiogenic shock symptoms. Unpublished manuscript."},{"key":"atypb26","volume-title":"Key components of MIS performance","author":"Crandall, B.","year":"1988"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-0394.1988.tb00065.x"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/5657.001.0001"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1080\/01449298808901868"},{"key":"atypb30","volume-title":"Bias in human reasoning: Causes and consequences","author":"Evans, J. St. B. T.","year":"1989"},{"key":"atypb31","doi-asserted-by":"publisher","DOI":"10.2307\/1416631"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1109\/21.31052"},{"key":"atypb33","volume-title":"Memory-enhancing techniques for investigative interviewing: The cognitive interview","author":"Fisher, R. P.","year":"1992"},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1037\/h0061470"},{"key":"atypb35","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.30.12.1127"},{"key":"atypb36","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1007\/978-1-4613-9733-5_7","volume-title":"The cognition of experts: Psychological research and empirical AI","author":"Ford, K. M.","year":"1992"},{"key":"atypb37","volume-title":"Knowledge acquisition as modeling","author":"Ford, K. M.","year":"1993"},{"key":"atypb38","doi-asserted-by":"publisher","DOI":"10.1016\/0020-7373(92)90056-Q"},{"key":"atypb39","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-0394.1990.tb00160.x"},{"key":"atypb40","first-page":"131","volume-title":"Naturalistic decision making","author":"Gordon, S. E.","year":"1997"},{"key":"atypb41","first-page":"35","volume":"1","author":"Gordon, S. E.","year":"1987","journal-title":"AI Applications in Environmental Science"},{"key":"atypb42","doi-asserted-by":"publisher","DOI":"10.1177\/001872089303500305"},{"key":"atypb43","first-page":"15","author":"Hayes, P. J.","year":"1994","journal-title":"AI Magazine"},{"key":"atypb44","first-page":"53","volume":"8","author":"Hoffman, R. R.","year":"1987","journal-title":"AI Magazine"},{"key":"atypb45","doi-asserted-by":"publisher","DOI":"10.1080\/09528139408953797"},{"key":"atypb46","unstructured":"Hoffman, R. R. (1997). A proposed paradigm for the experimental comparison of KA software tools. EVALKA [on-line], Computer Science and Engineering Department, University of New South Wales, Australia. http:\/\/www.cse.unsw.edu.au\/~timm\/pub\/eval."},{"key":"atypb47","first-page":"543","volume-title":"Expertise in context","author":"Hoffman, R. R.","year":"1997"},{"key":"atypb48","doi-asserted-by":"publisher","DOI":"10.1006\/obhd.1995.1039"},{"key":"atypb49","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-0394.1994.tb00001.x"},{"key":"atypb50","doi-asserted-by":"publisher","DOI":"10.1002\/job.4030150505"},{"key":"atypb51","first-page":"721","volume-title":"Proceedings of the Ninth International Symposium on Aviation Psychology","author":"Hutton, R. J. B.","year":"1997"},{"key":"atypb52","doi-asserted-by":"publisher","DOI":"10.1080\/01449298608914505"},{"key":"atypb53","volume-title":"The effect of outcome information on the recall and evaluation of individuals' own decisions.","author":"Jones, S. K.","year":"1996"},{"key":"atypb54","volume-title":"Application of an expertise-centered taxonomy to training decisions","author":"Kaempf, G. L.","year":"1991"},{"key":"atypb55","volume-title":"Decision making in the AEGIS combat information center","author":"Kaempf, G. L.","year":"1992"},{"key":"atypb56","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4613-1823-1"},{"key":"atypb57","doi-asserted-by":"publisher","DOI":"10.1016\/0167-9236(88)90016-4"},{"key":"atypb58","first-page":"55","volume":"57","author":"Kinney, W. R.","year":"1982","journal-title":"Accounting Review"},{"key":"atypb59","doi-asserted-by":"publisher","DOI":"10.1207\/s15327868ms0203_3"},{"key":"atypb60","volume-title":"Utility of the critical decision method for eliciting knowledge from expert C debuggers","author":"Klein, G.","year":"1989"},{"key":"atypb61","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4613-9733-5_10"},{"key":"atypb62","doi-asserted-by":"publisher","DOI":"10.21236\/ADA492114"},{"key":"atypb63","first-page":"285","volume-title":"Naturalistic decision making","author":"Klein, G.","year":"1993"},{"key":"atypb64","doi-asserted-by":"crossref","unstructured":"Klein, G. & Brezovic, C. P. (1986). Design engineers and the design process: Decision strategies and human factors literature. In Proceedings of the Human Factors Society 30th Annual Meeting (pp. 771\u2013775). Santa Monica, CA: Human Factors and Ergonomics Society.","DOI":"10.1177\/154193128603000809"},{"key":"atypb65","doi-asserted-by":"crossref","unstructured":"Klein, G. A., Calderwood, R. & Clinton-Cirocco, A. (1986). Rapid decision making on the fire ground. In Proceedings of the Human Factors Society 30th Annual Meeting (pp. 576\u2013580). Santa Monica, CA: Human Factors and Ergonomics Society.","DOI":"10.1177\/154193128603000616"},{"key":"atypb66","doi-asserted-by":"publisher","DOI":"10.1109\/21.31053"},{"key":"atypb67","first-page":"203","volume-title":"Cognitive science foundations of instruction","author":"Klein, G.","year":"1993"},{"key":"atypb68","volume-title":"Decision making in action: Models and methods","author":"Klein, G.","year":"1993"},{"key":"atypb69","unstructured":"Klein, G. A. & Thordsen, M. L. (1991). Representing cockpit crew decision making. In R. S. Jensen (Ed.), Proceedings of the Sixth International Symposium on Aviation Psychology (pp. 1026\u20131031). Columbus: Ohio State University."},{"key":"atypb70","doi-asserted-by":"publisher","DOI":"10.1016\/0003-6870(82)90186-7"},{"key":"atypb71","volume-title":"Designing for performance: A cognitive systems engineering approach to modifying an AWACS human-computer interface","author":"Klinger, D. W.","year":"1993"},{"key":"atypb72","doi-asserted-by":"crossref","unstructured":"Klinger, D. W. & Gomes, M. G. (1993). A cognitive systems engineering application for interface design. In Proceedings of the Human Factors and Ergonomics Society 37th Annual Meeting (pp. 16\u201320). Santa Monica, CA: Human Factors and Ergonomics Society.","DOI":"10.1177\/154193129303700105"},{"key":"atypb73","first-page":"240","volume-title":"Toward a general theory of expertise: Prospects and limits","author":"Kuipers, B.","year":"1987"},{"key":"atypb74","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog1202_2"},{"key":"atypb75","doi-asserted-by":"publisher","DOI":"10.1080\/10926488.1992.9678710"},{"key":"atypb76","first-page":"311","volume-title":"The nature of expertise","author":"Lesgold, A. M.","year":"1988"},{"key":"atypb77","doi-asserted-by":"publisher","DOI":"10.1007\/BF00139624"},{"key":"atypb78","doi-asserted-by":"publisher","DOI":"10.1016\/1042-8143(92)90022-S"},{"key":"atypb79","volume-title":"Blood banking: The need for training and evaluation","author":"Miller, T. E.","year":"1994"},{"key":"atypb80","volume-title":"Using knowledge engineering in the development of an expert system to assist targeteers in assessing battle damage and making weapons decisions for hardened structure targets","author":"Miller, T. E.","year":"1993"},{"key":"atypb81","volume-title":"A decision-centered approach to storyboarding anti-air warfare interfaces","author":"Miller, T. E.","year":"1992"},{"key":"atypb82","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-504582-7.50013-5"},{"key":"atypb83","doi-asserted-by":"publisher","DOI":"10.1109\/21.31067"},{"key":"atypb84","doi-asserted-by":"publisher","DOI":"10.1017\/S0269888900004288"},{"key":"atypb85","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.84.3.231"},{"key":"atypb86","first-page":"53","author":"Noy, N. F.","year":"1997","journal-title":"AI Magazine"},{"key":"atypb87","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-0394.1987.tb00139.x"},{"key":"atypb88","volume-title":"Social aspects of expertis","author":"Orr, J.","year":"1985"},{"key":"atypb89","volume-title":"Training: Research and practice","author":"Patrick, J.","year":"1992"},{"key":"atypb90","volume-title":"Evaluation of proposed control room improvements through analysis of critical operator decisions","author":"Pew, R. W.","year":"1981"},{"key":"atypb91","volume-title":"Developing and managing expert systems: Proven techniques for business and industry","author":"Prerau, D.","year":"1989"},{"key":"atypb92","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4613-9733-5_2"},{"key":"atypb93","first-page":"58","author":"Rolandi, W. G.","year":"1986","journal-title":"AI Expert"},{"key":"atypb94","doi-asserted-by":"publisher","DOI":"10.1002\/hrdq.3920060303"},{"key":"atypb95","doi-asserted-by":"publisher","DOI":"10.1037\/1076-898X.2.1.31"},{"key":"atypb96","doi-asserted-by":"publisher","DOI":"10.1080\/00140138908966911"},{"key":"atypb97","first-page":"21","volume":"108","author":"Shadbolt, N.","year":"1989","journal-title":"SIGART Newsletter"},{"key":"atypb98","unstructured":"Shanteau, J. (1984). Some unasked questions about the psychology of expert decision makers. In M. E. El-Hawary (Ed.), Proceedings of the 1984 IEEE Conference on Systems, Man, & Cybernetics (pp. 23\u201345). New York: Institute of Electrical and Electronics Engineers."},{"key":"atypb99","doi-asserted-by":"publisher","DOI":"10.1016\/0749-5978(92)90064-E"},{"key":"atypb100","doi-asserted-by":"crossref","unstructured":"Shattuck, L. & Woods, D. D. (1994). The critical incident technique 40 years later. In Proceedings of the Human Factors and Ergonomics Society 38th Annual Meeting (pp. 1080\u20131084). Santa Monica, CA: Human Factors and Ergonomics Society.","DOI":"10.1177\/154193129403801702"},{"key":"atypb101","doi-asserted-by":"publisher","DOI":"10.1016\/0361-3682(87)90025-0"},{"key":"atypb102","volume-title":"Report of the ESPRC Workshop on Software Assisted Knowledge Acquisition","author":"Sleeman, D.","year":"1996"},{"key":"atypb103","doi-asserted-by":"publisher","DOI":"10.1002\/job.4030150503"},{"key":"atypb104","volume-title":"The reliability of the critical decision method","author":"Taynor, J.","year":"1987"},{"key":"atypb105","volume-title":"Cognitive task analysis of critical team decision making during multiship engagements","author":"Thordsen, M. L.","year":"1992"},{"key":"atypb106","volume-title":"User defined requirements for the JSTARS self defense suite","author":"Thordsen, M. L.","year":"1990"},{"key":"atypb107","doi-asserted-by":"publisher","DOI":"10.1109\/21.31066"},{"key":"atypb108","volume-title":"On scientific thinking","author":"Tweney, R. D.","year":"1981"},{"key":"atypb109","doi-asserted-by":"publisher","DOI":"10.1109\/21.370186"},{"key":"atypb110","volume-title":"A guide to expert systems","author":"Waterman, D. A.","year":"1986"},{"key":"atypb111","volume-title":"Analogical reasoning as a discovery logic","author":"Weitzenfeld, J. S.","year":"1979"},{"key":"atypb112","doi-asserted-by":"publisher","DOI":"10.1007\/BFb0024300"},{"key":"atypb113","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.60.2.181"},{"key":"atypb114","first-page":"1","volume":"8","author":"Wood, L. E.","year":"1995","journal-title":"International Journal of Expert Systems"},{"key":"atypb115","doi-asserted-by":"publisher","DOI":"10.1002\/int.4550080106"},{"key":"atypb116","first-page":"228","volume-title":"Decision making in action: Models and methods","author":"Woods, D. D.","year":"1993"},{"key":"atypb117","volume-title":"A literature review of analytical and naturalistic decision making","author":"Zsambok, C. E.","year":"1992"},{"key":"atypb118","volume-title":"A cognitive model of a prototype training program for OJT providers","author":"Zsambok, C. E.","year":"1996"},{"key":"atypb119","volume-title":"Naturalistic decision making","author":"Zsambok, C. E.","year":"1997"}],"container-title":["Human Factors: The Journal of the Human Factors and Ergonomics Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1518\/001872098779480442","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1518\/001872098779480442","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,11]],"date-time":"2025-03-11T04:51:51Z","timestamp":1741668711000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1518\/001872098779480442"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1998,6]]},"references-count":119,"journal-issue":{"issue":"2","published-print":{"date-parts":[[1998,6]]}},"alternative-id":["10.1518\/001872098779480442"],"URL":"https:\/\/doi.org\/10.1518\/001872098779480442","relation":{},"ISSN":["0018-7208","1547-8181"],"issn-type":[{"value":"0018-7208","type":"print"},{"value":"1547-8181","type":"electronic"}],"subject":[],"published":{"date-parts":[[1998,6]]}}}