{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T21:39:14Z","timestamp":1694641154722},"reference-count":45,"publisher":"Walter de Gruyter GmbH","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2010,12,1]]},"abstract":"<jats:title>Validating Computational Cognitive Process Models across Multiple Timescales<\/jats:title><jats:p>Model comparison is vital to evaluating progress in the fields of artificial general intelligence (AGI) and cognitive architecture. As they mature, AGI and cognitive architectures will become increasingly capable of providing a single model that completes a multitude of tasks, some of which the model was not specifically engineered to perform. These models will be expected to operate for extended periods of time and serve functional roles in real-world contexts. Questions arise regarding how to evaluate such models appropriately, including issues pertaining to model comparison and validation. In this paper, we specifically address model validation across multiple levels of abstraction, using an existing computational process model of unmanned aerial vehicle basic maneuvering to illustrate the relationship between validity and timescales of analysis.<\/jats:p>","DOI":"10.2478\/v10229-011-0012-6","type":"journal-article","created":{"date-parts":[[2011,11,23]],"date-time":"2011-11-23T20:55:31Z","timestamp":1322081731000},"page":"108-127","source":"Crossref","is-referenced-by-count":3,"title":["Validating Computational Cognitive Process Models across Multiple Timescales"],"prefix":"10.2478","volume":"2","author":[{"given":"Christopher","family":"Myers","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kevin","family":"Gluck","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Glenn","family":"Gunzelmann","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Krusmark","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"374","reference":[{"key":"1","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1207\/s15516709cog2601_3","article-title":"Spanning seven orders of magnitude: a challenge for cognitive modeling","volume":"26","author":"J. Anderson","year":"2002","journal-title":"Cognitive Science"},{"key":"2","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780195324259.001.0001","volume-title":"How Can the Human Mind Occur in the Physical Universe?","author":"J. Anderson","year":"2007"},{"issue":"4","key":"3","doi-asserted-by":"crossref","first-page":"1036","DOI":"10.1037\/0033-295X.111.4.1036","article-title":"An Integrated Theory of the Mind","volume":"111","author":"J. Anderson","year":"2004","journal-title":"Psychological Review"},{"key":"4","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1017\/S0140525X0300013X","article-title":"The Newell test for a theory of cognition","volume":"26","author":"J. Anderson","year":"2003","journal-title":"Behavioral and Brain Sciences"},{"key":"5","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1111\/j.1467-9280.1991.tb00174.x","article-title":"Reflections of the environment in memory","volume":"2","author":"J. Anderson","year":"1991","journal-title":"Psychological Science"},{"key":"6","unstructured":"Ball, J. T., Myers, C. W., Heiberg, A., Cooke, N. J., Matessa, M., Freiman, M., et al. (under review). The Synthetic Teammate Project. <i>Computational and Mathematical Organization Theory<\/i>."},{"key":"7","first-page":"97","volume-title":"The human-computer interaction handbook: Fundamentals, evolving technologies and emerging applications","author":"M. Byrne","year":"2003"},{"key":"8","first-page":"165","article-title":"An initial evaluation of a cognitive model of UAV reconnaissance","author":"E. Dimperio","year":"2008"},{"key":"9","doi-asserted-by":"crossref","DOI":"10.1145\/1015330.1015408","article-title":"K-means Clustering via Principal Component Analysis","author":"C. Ding","year":"2004"},{"key":"10","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1016\/B978-0-12-374518-7.00012-2","volume-title":"Human Factors in Aviation","author":"K. Gluck","year":"2010"},{"key":"11","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1093\/acprof:oso\/9780195189193.003.0002","volume-title":"Integrated models of cognitive systems","author":"K. Gluck","year":"2007"},{"key":"12","article-title":"A computational process model of basic aircraft maneuvering","author":"K. Gluck","year":"2003"},{"issue":"4","key":"13","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1207\/s15516709cog2704_2","article-title":"Instance-based learning in real-time dynamic decision making","volume":"27","author":"C. Gonzalez","year":"2003","journal-title":"Cognitive Science"},{"key":"14","volume-title":"Integrated Models of Cognitive Systems","year":"2007"},{"issue":"3","key":"15","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1207\/s15327051hci0803_3","article-title":"Project Ernestine: Validating GOMS for predicting and explaining real-world task performance","volume":"8","author":"W. Gray","year":"1993","journal-title":"Human Computer Interaction"},{"key":"16","article-title":"Computational cognitive models ISO ecologically optimal strategies","author":"W. Gray","year":"2002"},{"key":"17","article-title":"Sleep Deprivation and Sustained Attention Performance: Integrating Mathematical and Cognitive Modeling","author":"G. Gunzelmann","year":"2009","journal-title":"Cognitive Science"},{"key":"18","doi-asserted-by":"crossref","first-page":"2987","DOI":"10.1016\/j.visres.2005.07.017","article-title":"Serial visual search from a parallel model","volume":"45","author":"S. Herd","year":"2005","journal-title":"Vision Research"},{"issue":"1","key":"19","first-page":"27","article-title":"Automated Intelligent Pilots for Combat Flight Simulation","volume":"20","author":"R. Jones","year":"1999","journal-title":"AI Magazine"},{"key":"20","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1207\/s15327051hci1204_4","article-title":"An overview of the EPIC architecture for cognition and performance with application to human-computer interaction","volume":"12","author":"D. Kieras","year":"1997","journal-title":"Human-Computer Interaction"},{"issue":"13","key":"21","doi-asserted-by":"crossref","first-page":"1897","DOI":"10.1016\/0042-6989(94)00279-U","article-title":"The role of attention in the programming of saccades","volume":"35","author":"E. Kowler","year":"1995","journal-title":"Vision Research"},{"key":"22","article-title":"Extending the Soar cognitive architecture","author":"J. Laird","year":"2008"},{"key":"23","doi-asserted-by":"crossref","DOI":"10.2991\/agi.2009.17","article-title":"Claims and challenges in evaluating human-level intelligent systems","author":"J. Laird","year":"2009"},{"key":"24","first-page":"707","article-title":"Binary codes capable of correcting deletions, insertions, and reversals","volume":"10","author":"V. Levenshtein","year":"1966","journal-title":"Soviet Physics Doklady"},{"key":"25","first-page":"255","volume-title":"The atomic components of thought","author":"M. Lovett","year":"1998"},{"key":"26","doi-asserted-by":"crossref","DOI":"10.1177\/154193129804200128","article-title":"Designing synthetic tasks for human factors research: An application to uninhabited air vehicles","author":"E. Martin","year":"1998"},{"key":"27","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1037\/0033-295X.104.4.749","article-title":"A computational theory of executive control processes and human multiple-task performance: Part 2. Accounts of Psychological Refractory-Period Phenomena","volume":"104","author":"D. Meyer","year":"1997","journal-title":"Psychological Review"},{"issue":"8","key":"28","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1167\/10.8","article-title":"Visual scan adaptation during repeated visual search","volume":"10","author":"C. Myers","year":"2010","journal-title":"Journal of Vision"},{"issue":"2","key":"29","doi-asserted-by":"crossref","DOI":"10.3758\/BF03192693","article-title":"ProtoMatch: A tool for analyzing high-density, sequential eye gaze and cursor protocols","volume":"37","author":"C. Myers","year":"2005","journal-title":"Behavior Research Methods"},{"key":"30","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1016\/B978-0-12-170150-5.50012-3","volume-title":"Visual information processing","author":"A. Newell","year":"1973"},{"key":"31","doi-asserted-by":"crossref","DOI":"10.1207\/s15516709cog0402_2","article-title":"Physical symbol system","volume":"4","author":"A. Newell","year":"1980","journal-title":"Cognitive Science"},{"key":"32","volume-title":"Unified Theories of Cognition","author":"A. Newell","year":"1990"},{"key":"33","volume-title":"Human Problem Solving","author":"A. Newell","year":"1972"},{"key":"34","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1518\/001872006777724417","article-title":"Modeling driver behavior in a cognitive architecture","volume":"48","author":"D. Salvucci","year":"2006","journal-title":"Human Factors"},{"key":"35","first-page":"39","volume-title":"Human-Computer Interaction","volume":"16","author":"D. Salvucci","year":"2001"},{"key":"36","article-title":"Steps toward integrated models of cognitive systems: A level-of-analysis approach to comparing human performance to model predictions in a complex task environment","author":"M. Schoelles","year":"2006"},{"key":"37","doi-asserted-by":"crossref","DOI":"10.1037\/e592542010-001","volume-title":"Impact of prior flight experience on learning Predator UAV operator skills","author":"B. Schreiber","year":"2002"},{"key":"38","first-page":"115","volume-title":"Psychologie der Kognition: Reden and Vortrage anlasslich der Emeritierung von Werner Tack","author":"C. Schunn","year":"2005"},{"key":"39","volume-title":"The Sciences of the Artificial","author":"H. Simon","year":"1999"},{"issue":"3","key":"40","article-title":"Desiderata for cognitive architectures","volume":"17","author":"R. Sun","year":"2004","journal-title":"Philosophical Psychology"},{"issue":"61-76","key":"41","article-title":"Production compilation: A simple mechanism to model complex skill acquisition","volume":"45","author":"N. Taatgen","year":"2003","journal-title":"Human Factors"},{"key":"42","unstructured":"USAF. (2000). <i>Air Force Manual on Instrument Flight<\/i>. Retrieved. from."},{"key":"43","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2478\/v10229-011-0001-9","article-title":"Editorial: What makes JAGI special","author":"P. Wang","year":"2009","journal-title":"Journal of Artificial General Intelligence"},{"key":"44","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1093\/acprof:oso\/9780195189193.003.0008","volume-title":"Integrated Models of Cognitive Systems","author":"J. Wolfe","year":"2007"},{"key":"45","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1017\/CBO9780511610721.004","volume-title":"Cognition and Multi-agent Interaction: From Cognitive Modeling to Social Simulation","author":"R. Wray","year":"2005"}],"container-title":["Journal of Artificial General Intelligence"],"original-title":[],"link":[{"URL":"http:\/\/content.sciendo.com\/view\/journals\/jagi\/2\/2\/article-p108.xml","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/view\/j\/jagi.2010.2.issue-2\/v10229-011-0012-6\/v10229-011-0012-6.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,5,30]],"date-time":"2020-05-30T16:04:05Z","timestamp":1590854645000},"score":1,"resource":{"primary":{"URL":"https:\/\/content.sciendo.com\/doi\/10.2478\/v10229-011-0012-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,12,1]]},"references-count":45,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.2478\/v10229-011-0012-6","relation":{},"ISSN":["1946-0163"],"issn-type":[{"value":"1946-0163","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,12,1]]}}}