{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,15]],"date-time":"2026-08-15T04:43:55Z","timestamp":1786769035510,"version":"3.56.0"},"reference-count":42,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[1995,6,1]],"date-time":"1995-06-01T00:00:00Z","timestamp":801964800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Hum Factors"],"published-print":{"date-parts":[[1995,6]]},"abstract":"<jats:p>The out-of-the-loop performance problem, a major potential consequence of automation, leaves operators of automated systems handicapped in their ability to take over manual operations in the event of automation failure. This is attributed to a possible loss of skills and of situation awareness (SA) arising from vigilance and complacency problems, a shift from active to passive information processing, and change in feedback provided to the operator. We studied the automation of a navigation task using an expert system and demonstrated that low SA corresponded with out-of-the-loop performance decrements in decision time following a failure of the expert system. Level of operator control in interacting with automation is a major factor in moderating this loss of SA. Results indicated that the shift from active to passive processing was most likely responsible for decreased SA under automated conditions.<\/jats:p>","DOI":"10.1518\/001872095779064555","type":"journal-article","created":{"date-parts":[[2006,12,6]],"date-time":"2006-12-06T17:53:03Z","timestamp":1165427583000},"page":"381-394","source":"Crossref","is-referenced-by-count":1062,"title":["The Out-of-the-Loop Performance Problem and Level of Control in Automation"],"prefix":"10.1177","volume":"37","author":[{"given":"Mica R.","family":"Endsley","sequence":"first","affiliation":[{"name":"Texas Tech University, Lubbock, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Esin O.","family":"Kiris","sequence":"additional","affiliation":[{"name":"Texas Tech University, Lubbock, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[1995,6,1]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-9230-3_18"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1016\/0005-1098(83)90046-8"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.2514\/3.57549"},{"key":"atypb4","volume-title":"Human-centered aircraft automation: A concept and guidelines","author":"Billings, C. E.","year":"1991"},{"key":"atypb5","first-page":"167","volume-title":"Proceedings of the Seventh International Symposium on Aviation Psychology","author":"Carmody, M. A.","year":"1993"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.104.2.163"},{"key":"atypb7","first-page":"193","volume-title":"Monitoring behavior and supervisory control","author":"Curry, R. E.","year":"1977"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1177\/001872088002200503"},{"key":"atypb9","doi-asserted-by":"crossref","unstructured":"Endsley, M. (1987). The application of human factors to the development of expert systems for advanced cockpits. In Proceedings of the Human Factors Society 31st Annual Meeting (pp. 1388\u20131392). Santa Monica, CA: Human Factors and Ergonomics Society.","DOI":"10.1177\/154193128703101219"},{"key":"atypb10","doi-asserted-by":"crossref","unstructured":"Endsley, M. R. (1988). Design and evaluation for situation awareness enhancement. In Proceedings of the Human Factors Society 32nd Annual Meeting (pp. 97\u2013101). Santa Monica, CA: Human Factors and Ergonomics Society.","DOI":"10.1177\/154193128803200221"},{"key":"atypb11","volume-title":"Paper presented at the NASA\/FAA Workshop on Artificial Intelligence and Human Factors in Air Traffic Control and Aviation Maintenance","author":"Endsley, M. R."},{"key":"atypb12","unstructured":"Endsley, M. R. (1993a). Situation awareness and workload: Flip sides of the same coin. In R. S. Jensen and D. Neumeister (Eds.), Proceedings of the Seventh International Symposium on Aviation Psychology (pp. 906\u2013911). Columbus, OH: Ohio State University, Department of Aviation."},{"key":"atypb13","volume-title":"Paper presented at the First International Conference on Situational Awareness in Complex Systems","author":"Endsley, M. R."},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-9230-3_10"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-4115(08)62386-9"},{"key":"atypb16","volume-title":"An introduction to expert systems","author":"Ignizio, J. P.","year":"1991"},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1177\/001872088202400106"},{"key":"atypb18","first-page":"27","volume-title":"Proceedings of the Seventh International Symposium on Aviation Psychology","author":"Kiris, E. O.","year":"1993"},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1080\/00140139208967392"},{"key":"atypb20","first-page":"40\/1","volume-title":"Handbook of perception and human performance","author":"Moray, N.","year":"1986"},{"key":"atypb21","volume-title":"The problem of automation: Inappropriate feedback and interaction not overautomation","author":"Norman, D. A.","year":"1989"},{"key":"atypb22","first-page":"91","volume-title":"Proceedings of the Fifth International Symposium on Aviation Psychology","author":"Orlady, H. W.","year":"1989"},{"key":"atypb23","doi-asserted-by":"publisher","DOI":"10.1177\/001872088702900609"},{"key":"atypb24","volume-title":"Paper presented at the NASA\/FAA Workshop on Artificial Intelligence and Human Factors in Air Traffic Control and Aviation Maintenance","author":"Parasuraman, R."},{"key":"atypb25","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0301_1"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-9230-3_17"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1983.6313160"},{"key":"atypb28","doi-asserted-by":"crossref","unstructured":"Selcon, S. J. (1990). Decision support in the cockpit: Probably a good thing? In Proceedings of the Human Factors Society 34th Annual Meeting (pp. 46\u201350). Santa Monica, CA: Human Factors and Ergonomics Society.","DOI":"10.1177\/154193129003400111"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1177\/001872088502700105"},{"key":"atypb30","volume-title":"An experimental study of the human-computer interface in process control.","author":"Shiff, B.","year":"1983"},{"key":"atypb31","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0302_2"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1037\/0278-7393.4.6.592"},{"key":"atypb33","first-page":"744","volume":"60","author":"Thackray, R. I.","year":"1989","journal-title":"Aviation, Space and Environmental Medicine"},{"key":"atypb34","volume-title":"A guide to expert systems","author":"Waterman, D. A.","year":"1986"},{"key":"atypb35","first-page":"246","volume":"36","author":"Wempe, T.","year":"1965","journal-title":"Aerospace Medicine"},{"key":"atypb36","volume-title":"Engineering psychology and human performance","author":"Wickens, C. D.","year":"1992","edition":"2"},{"key":"atypb37","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1979.4310070"},{"key":"atypb38","doi-asserted-by":"crossref","unstructured":"Wiener, E. L. (1985). Cockpit automation: In need of a philosophy. In Proceedings of the 1985 Behavioral Engineering Conference (pp. 369\u2013375). Warrendale, PA: Society of Automotive Engineers.","DOI":"10.4271\/851956"},{"key":"atypb39","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-08-057090-7.50019-9"},{"key":"atypb40","volume-title":"Paper presented at the NASA\/FAA Workshop on Artificial Intelligence and Human Factors in Air Traffic Control and Aviation Maintenance","author":"Wiener, E. L."},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1080\/00140138008924809"},{"key":"atypb42","doi-asserted-by":"publisher","DOI":"10.1080\/00140136908931083"}],"container-title":["Human Factors: The Journal of the Human Factors and Ergonomics Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1518\/001872095779064555","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1518\/001872095779064555","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T07:49:53Z","timestamp":1777448993000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1518\/001872095779064555"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1995,6]]},"references-count":42,"journal-issue":{"issue":"2","published-print":{"date-parts":[[1995,6]]}},"alternative-id":["10.1518\/001872095779064555"],"URL":"https:\/\/doi.org\/10.1518\/001872095779064555","relation":{},"ISSN":["0018-7208","1547-8181"],"issn-type":[{"value":"0018-7208","type":"print"},{"value":"1547-8181","type":"electronic"}],"subject":[],"published":{"date-parts":[[1995,6]]}}}