{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,10,26]],"date-time":"2023-10-26T21:40:35Z","timestamp":1698356435716},"reference-count":104,"publisher":"Wiley","issue":"3","license":[{"start":{"date-parts":[[2010,2,11]],"date-time":"2010-02-11T00:00:00Z","timestamp":1265846400000},"content-version":"vor","delay-in-days":5339,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Cognitive Science"],"published-print":{"date-parts":[[1995,7]]},"abstract":"<jats:p>This article presents a computational model of the learning of diagnostic knowledge, based on observations of human operators engaged in real\u2010world troubleshooting tasks. We present a model of problem solving and learning in which the reasoner introspects about its own performance on the problem\u2010solving task, identifies what it needs to learn to improve its performance, formulates learning goals to acquire the required knowledge, and pursues its learning goals using multiple learning strategies. The model is implemented in a computer system which provides a case study based on observations of troubleshooting operators and protocol analysis of the data gathered in the test area of an operational electronics manufacturing plant. The model not only addresses issues in human learning, but, in addition, is computationally justified as a uniform, extensible framework for multistrategy learning.<\/jats:p>","DOI":"10.1207\/s15516709cog1903_2","type":"journal-article","created":{"date-parts":[[2005,8,6]],"date-time":"2005-08-06T01:26:01Z","timestamp":1123291561000},"page":"289-340","update-policy":"http:\/\/dx.doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Learning to Troubleshoot: Multistrategy Learning of Diagnostic Knowledge for a Real\u2010World Problem\u2010Solving Task"],"prefix":"10.1111","volume":"19","author":[{"given":"Ashwin","family":"Ram","sequence":"first","affiliation":[]},{"given":"S.","family":"Narayanan","sequence":"additional","affiliation":[]},{"given":"Michael T.","family":"Cox","sequence":"additional","affiliation":[]}],"member":"311","published-online":{"date-parts":[[2010,2,11]]},"reference":[{"key":"e_1_2_1_2_1","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1037\/0033-295X.94.2.192","article-title":"Skill acquisition: Compilation of weak\u2010method problem solutions","volume":"1","author":"Anderson J.","year":"1987","journal-title":"Psychological Review"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(89)90052-0"},{"key":"e_1_2_1_4_1","volume-title":"Computer integrated electronics manufacturing and testing","author":"Arabian J.","year":"1989"},{"key":"e_1_2_1_5_1","first-page":"31","volume-title":"Meta\u2010knowledge and cognition","author":"Barr A.","year":"1979"},{"key":"e_1_2_1_6_1","volume-title":"The handbook of artificial intelligence","author":"Barr A.","year":"1981"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/21.31027"},{"key":"e_1_2_1_8_1","first-page":"318","volume-title":"Model\u2010based diagnosis of planning failures","author":"Birnbaum L.","year":"1990"},{"key":"e_1_2_1_9_1","volume-title":"Machine learning II: An artificial intelligence approach","author":"Carbonell J.G.","year":"1986"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/B978-0-08-051055-2.50013-4","volume-title":"Machine learning III: An artificial intelligence approach","author":"Carbonell J. G.","year":"1990"},{"key":"e_1_2_1_11_1","first-page":"241","volume-title":"Architectures for intelligence: The twenty\u2010second Carnegie Mellon symposium on cognition","author":"Carbonell J. G.","year":"1991"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0269888900004458"},{"key":"e_1_2_1_13_1","volume-title":"Metacognition, motivation, and understanding","author":"Chi M. T. H.","year":"1987"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls0101_4"},{"key":"e_1_2_1_15_1","volume-title":"Knowledge\u2010based tutoring: The GUIDON program","author":"Clancey W. J.","year":"1986"},{"key":"e_1_2_1_16_1","unstructured":"Cohen S. M.(1990).A model of troubleshooting in electronics assembly manufacturing(Tech. Rep. No. CHMSR 90\u20103). Unpublished master's dissertation Georgia Institute of Technology Center for Human\u2010Machine Systems Research Atlanta."},{"key":"e_1_2_1_17_1","volume-title":"Design for manufacturability: A systems approach to concurrent engineering and ergonomics","author":"Cohen S. M.","year":"1992"},{"key":"e_1_2_1_18_1","first-page":"225","volume-title":"Machines that forget: Learning from retrieval failure of mis\u2010indexed explanations","author":"Cox M. T.","year":"1994"},{"key":"e_1_2_1_19_1","volume-title":"An explicit representation of forgetting","author":"Cox M. T.","year":"1992"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-1-55860-247-2.50021-8"},{"key":"e_1_2_1_21_1","first-page":"230","volume-title":"Failure\u2010driven learning as input bias","author":"Cox M. T.","year":"1994"},{"key":"e_1_2_1_22_1","first-page":"12","volume-title":"Choosing learning strategies to achieve learning goals","author":"Cox M. T.","year":"1994"},{"key":"e_1_2_1_23_1","first-page":"191","volume-title":"Gemini: An integration of analytical and empirical learning","author":"Danyluk A. P.","year":"1991"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(79)90014-6"},{"key":"e_1_2_1_25_1","volume-title":"Artificial Intelligence in Maintenance","author":"Davis R.","year":"1985"},{"key":"e_1_2_1_26_1","volume-title":"Meta\u2010level knowledge: Overview and applications","author":"Davis R.","year":"1977"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00114116"},{"key":"e_1_2_1_28_1","first-page":"1","article-title":"Explicit control of reasoning","author":"deKleer J.","year":"1977","journal-title":"SIGPLAN Notices"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(87)90063-4"},{"key":"e_1_2_1_30_1","first-page":"35","article-title":"Effects of strategy monitoring and proactive instruction on children's problem\u2010solving performance","volume":"1","author":"Delclos V. R.","year":"1990","journal-title":"Journal of Educational Psychology"},{"key":"e_1_2_1_31_1","volume-title":"The Intentiona Stance","author":"Dennett D.","year":"1987"},{"key":"e_1_2_1_32_1","first-page":"16","article-title":"Effective functional test design increases PCB throughput","volume":"1","author":"Douglas P. N.","year":"1988","journal-title":"Electronic Manufacturing"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(79)90008-0"},{"key":"e_1_2_1_34_1","unstructured":"Falkenhainer B.(1989).Learning from Physical analogies: A study in analogy and the explanation process.Doctoral thesis University of Illinois Department of Computer Science Urbana IL ."},{"key":"e_1_2_1_35_1","volume-title":"Computers and thought","author":"Feigenbaum E. A.","year":"1963"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1987.4309051"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00114265"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.2307\/1130419"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511529863.011"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-7373(88)80028-2"},{"key":"e_1_2_1_41_1","unstructured":"Hale C.(1992).Effects of background knowledge on associative learning in causal domains. Unpublished doctoral dissertation. Georgia Institute for Technology School of Psychology Atlanta."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00115010"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022639127361"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-322060-8.50018-8"},{"key":"e_1_2_1_45_1","first-page":"35","volume-title":"Knowledge acquisition planning for inference from large datasets","author":"Hunter L. E.","year":"1990"},{"key":"e_1_2_1_46_1","first-page":"261","volume-title":"Planning to learn","author":"Hunter L. E.","year":"1990"},{"key":"e_1_2_1_47_1","first-page":"614","volume-title":"Testing of surface mount technology boards","author":"Kakani T.","year":"1987"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci0304_2"},{"key":"e_1_2_1_49_1","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1207\/s15516709cog0804_3","article-title":"Causal reasoning in medicine: Analysis of a protocol","volume":"1","author":"Kuipers B.","year":"1984","journal-title":"Cognitive Science"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00116249"},{"key":"e_1_2_1_51_1","volume-title":"Computer assisted instruction and intelligent tutoring systems: Establishing communication and collaboration","author":"Lesgold A.","year":"1988"},{"key":"e_1_2_1_52_1","first-page":"459","volume-title":"The role of forgetting in learning","author":"Markovitch S.","year":"1988"},{"key":"e_1_2_1_53_1","volume-title":"Artificial Intelligence in Maintenance","author":"Maxion R. A.","year":"1985"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.95.4.434"},{"key":"e_1_2_1_55_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-662-12405-5","volume-title":"Machine learning I: An artificial intelligence approach","author":"Michalski R. S.","year":"1983"},{"key":"e_1_2_1_56_1","volume-title":"Machine learning IV: A multistrategy approach","author":"Michalski R. S.","year":"1994"},{"key":"e_1_2_1_57_1","volume-title":"Artificial intelligence applications in the computer\/electronics industry","author":"Miller R. K.","year":"1988"},{"key":"e_1_2_1_58_1","unstructured":"Minton S.(1988).Learning effective search control knowledge: An explanation\u2010based approach(Tech. Rep. No. CMU\u2010CS\u201088\u2010133). Unpublished doctoral dissertation Carnegie\u2010Mellon University Computer Science Department Pittsburgh."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00116250"},{"key":"e_1_2_1_60_1","first-page":"115","volume-title":"A multistrategy approach to theory refinement","author":"Mooney R. J.","year":"1991"},{"key":"e_1_2_1_61_1","first-page":"65","volume-title":"Balanced cooperative modeling","author":"Morik K.","year":"1991"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.56876"},{"key":"e_1_2_1_63_1","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/S0079-7421(08)60053-5","article-title":"Metamemory: A theoretical framework and new findings","volume":"1","author":"Nelson T. O.","year":"1990","journal-title":"The Psychology of Learning and Motivation"},{"key":"e_1_2_1_64_1","first-page":"511","volume-title":"Establishing the coherence of an explanation to improve refinement of an incomplete knowledge base","author":"Park Y.","year":"1990"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls0102_2"},{"key":"e_1_2_1_66_1","first-page":"450","volume-title":"Empirical analyses of self\u2010explanation and transfer in learning to program","author":"Pirolli P.","year":"1989"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1207\/s1532690xci1203_2"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1080\/09528138908953702"},{"key":"e_1_2_1_69_1","volume-title":"Intelligent tutoring systems: Lessons learned","author":"Psotka J.","year":"1988"},{"key":"e_1_2_1_70_1","unstructured":"Quilici A.(in press).Toward automatic acquisition of an advisory system's knowledge base.Applied Intelligence."},{"key":"e_1_2_1_71_1","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/BF00116251","article-title":"Induction of decision trees","author":"Quinlan J. R.","year":"1986","journal-title":"Machine Learning"},{"key":"e_1_2_1_72_1","unstructured":"Rajamoney S.(1989).Explanation\u2010based theory revision: An approach to the problems of incomplete and incorrect theories.Doctoral thesis University of Illinois Department of Computer Science Urbana IL ."},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1080\/10508406.1991.9671973"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022634926452"},{"key":"e_1_2_1_75_1","volume-title":"Machine learning IV: A multi\u2010strategy approach","author":"Ram A.","year":"1994"},{"key":"e_1_2_1_76_1","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/3314.001.0001","volume-title":"Goal\u2010driven learning","author":"Ram A.","year":"1995"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00058575"},{"key":"e_1_2_1_78_1","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/3314.001.0001","volume-title":"Goal\u2010driven learning","author":"Ram A.","year":"1995"},{"key":"e_1_2_1_79_1","first-page":"139","article-title":"Strategies for state identification and diagnosis in supervisory control tasks, and design of computer\u2010based support systems","volume":"1","author":"Rasmussen J.","year":"1984","journal-title":"Advanced in Man-Machine Systems Research"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1109\/21.247883"},{"key":"e_1_2_1_81_1","unstructured":"Redmond M.(1992).Learning by observing and understanding expert problem solving(Tech. Rep. No. GIT\u2010CC\u201092\/43). Unpublished doctoral dissertation Georgia Institute of Technology College of Computing Atlanta."},{"key":"e_1_2_1_82_1","volume-title":"Machine learning IV: A multistrategy approach","author":"Reich Y.","year":"1994"},{"key":"e_1_2_1_83_1","unstructured":"Riddle P.(Ed.). (1992).Proceedings of the Workshop on Integrated Learning in Real\u2010World Domains Ninth International Machine Learning Conference Aberdeen Scotland."},{"key":"e_1_2_1_84_1","first-page":"195","article-title":"Human problem solving in fault diagnosis tasks","volume":"1","author":"Rouse W.","year":"1984","journal-title":"Advances in Man-Machines Systems Research"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls0101_3"},{"issue":"1","key":"e_1_2_1_86_1","first-page":"3","article-title":"The current state of AI: One man's opinion","volume":"1","author":"Schank R. C.","year":"1983","journal-title":"The AI Magazine"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls0304_2"},{"key":"e_1_2_1_88_1","volume-title":"Metacognition, cognition, and human performance: Vol. I. Theoretical perspectives","author":"Schneider W.","year":"1985"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1080\/08839518908949927"},{"key":"e_1_2_1_90_1","volume-title":"Inference and discovery in an exploratory laboratory","author":"Shute V.","year":"1988"},{"key":"e_1_2_1_91_1","first-page":"521","volume-title":"Content = knowledge + media: Content acquisition, maintenance, communication, and construction of intelligent tutoring systems","author":"Spohrer J. C.","year":"1992"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(81)90008-4"},{"key":"e_1_2_1_93_1","doi-asserted-by":"crossref","first-page":"300","DOI":"10.21236\/ADA204680","volume-title":"Varieties of learning in SOAR","author":"Steier D. M.","year":"1987"},{"key":"e_1_2_1_94_1","unstructured":"Stroulia E. &Goel A.(1992).A model\u2010based approach to incremental self\u2010adaptation. InML\u201092 Workshop on Computational Architectures for Supporting Machine Learning and Knowledge Acquisition Aberdeen Scotland."},{"key":"e_1_2_1_95_1","volume-title":"A computer model of skill acquisition","author":"Sussman G. J.","year":"1975"},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-0663.82.2.306"},{"key":"e_1_2_1_97_1","first-page":"549","volume-title":"A method for multistrategy task\u2010adaptive learning based on plausible justifications","author":"Tecuci G.","year":"1991"},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-9287(91)80003-G"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-3172-2_2"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls0201_1"},{"key":"e_1_2_1_101_1","volume-title":"Machine learning IV: A multistrategy approach","author":"Veloso M.","year":"1994"},{"key":"e_1_2_1_102_1","volume-title":"Metacognition, motivation, and understanding","author":"Weinert F. E.","year":"1987"},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1159\/000407965"},{"key":"e_1_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.2307\/1129044"},{"key":"e_1_2_1_105_1","first-page":"197","article-title":"Meta planning: Representing and using knowledge about planning in problem solving and natural language understanding","volume":"1","author":"Wilensky R.","year":"1984","journal-title":"Cognitive Science"}],"container-title":["Cognitive Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1207%2Fs15516709cog1903_2","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1207\/s15516709cog1903_2","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,26]],"date-time":"2023-10-26T21:12:36Z","timestamp":1698354756000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1207\/s15516709cog1903_2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1995,7]]},"references-count":104,"journal-issue":{"issue":"3","published-print":{"date-parts":[[1995,7]]}},"alternative-id":["10.1207\/s15516709cog1903_2"],"URL":"https:\/\/doi.org\/10.1207\/s15516709cog1903_2","archive":["Portico"],"relation":{},"ISSN":["0364-0213","1551-6709"],"issn-type":[{"value":"0364-0213","type":"print"},{"value":"1551-6709","type":"electronic"}],"subject":[],"published":{"date-parts":[[1995,7]]},"assertion":[{"value":"2010-02-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}