{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T21:01:29Z","timestamp":1777669289339,"version":"3.51.4"},"reference-count":93,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2021,1,28]],"date-time":"2021-01-28T00:00:00Z","timestamp":1611792000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Hum Factors"],"published-print":{"date-parts":[[2022,9]]},"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>The present study replicated and extended prior findings of suboptimal automation use in a signal detection task, benchmarking automation-aided performance to the predictions of several statistical models of collaborative decision making.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Though automated decision aids can assist human operators to perform complex tasks, operators often use the aids suboptimally, achieving performance lower than statistically ideal.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Method<\/jats:title>\n                    <jats:p>Participants performed a simulated security screening task requiring them to judge whether a target (a knife) was present or absent in a series of colored X-ray images of passenger baggage. They completed the task both with and without assistance from a 93%-reliable automated decision aid that provided a binary text diagnosis. A series of three experiments varied task characteristics including the timing of the aid\u2019s judgment relative to the raw stimuli, target certainty, and target prevalence.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results and Conclusion<\/jats:title>\n                    <jats:p>Automation-aided performance fell closest to the predictions of the most suboptimal model under consideration, one which assumes the participant defers to the aid\u2019s diagnosis with a probability of 50%. Performance was similar across experiments.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Application<\/jats:title>\n                    <jats:p>Results suggest that human operators\u2019 performance when undertaking a naturalistic search task falls far short of optimal and far lower than prior findings using an abstract signal detection task.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/0018720820983632","type":"journal-article","created":{"date-parts":[[2021,1,28]],"date-time":"2021-01-28T22:51:46Z","timestamp":1611874306000},"page":"945-961","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":31,"title":["Measuring the Efficiency of Automation-Aided Performance in a Simulated Baggage Screening Task"],"prefix":"10.1177","volume":"64","author":[{"given":"Melanie M.","family":"Boskemper","sequence":"first","affiliation":[{"name":"Flinders University, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5371-7676","authenticated-orcid":false,"given":"Megan L.","family":"Bartlett","sequence":"additional","affiliation":[{"name":"Flinders University, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8824-7491","authenticated-orcid":false,"given":"Jason S.","family":"McCarley","sequence":"additional","affiliation":[{"name":"Oregon State University, USA"}]}],"member":"179","published-online":{"date-parts":[[2021,1,28]]},"reference":[{"key":"bibr1-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1126\/science.1185718"},{"key":"bibr2-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1177\/0018720817700258"},{"key":"bibr3-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1504\/IJHFE.2018.092227"},{"key":"bibr4-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1177\/0018720818802961"},{"key":"bibr5-0018720820983632","first-page":"1","volume":"35","author":"Bartlett M. L.","year":"2020","journal-title":"Ergonomics"},{"key":"bibr6-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1518\/001872007X200076"},{"key":"bibr7-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1109\/TAES.1986.310772"},{"key":"bibr8-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1080\/00140139508925269"},{"key":"bibr9-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1016\/0747-5632(93)90005-D"},{"key":"bibr10-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1016\/j.ergon.2019.102897"},{"key":"bibr11-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1163\/1568568041920212"},{"key":"bibr12-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1080\/00140139.2018.1481231"},{"key":"bibr13-0018720820983632","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2019.00256"},{"key":"bibr14-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1080\/07408179808966456"},{"key":"bibr15-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1177\/0956797613504966"},{"key":"bibr16-0018720820983632","first-page":"2172","volume-title":"Proceedings of the annual meeting of the cognitive science Society","author":"Denkiewicz M.","year":"2013"},{"key":"bibr17-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000033"},{"key":"bibr18-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1177\/154193120204600370"},{"key":"bibr19-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1518\/001872097778667960"},{"key":"bibr21-0018720820983632","doi-asserted-by":"publisher","DOI":"10.3758\/s13414-020-02087-y"},{"key":"bibr20-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1037\/xap0000216"},{"key":"bibr22-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1037\/0096-1523.11.5.583"},{"key":"bibr23-0018720820983632","first-page":"1","volume":"299","author":"European Commission","year":"2015","journal-title":"Official Journal of the European Union, L"},{"key":"bibr24-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1177011136"},{"key":"bibr25-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1080\/13506285.2010.500605"},{"key":"bibr26-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1177\/154193120504900359"},{"key":"bibr27-0018720820983632","volume-title":"Signal detection theory and psychophysics","author":"Green D. M.","year":"1966"},{"key":"bibr28-0018720820983632","doi-asserted-by":"publisher","DOI":"10.3758\/BF03206901"},{"key":"bibr29-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1093\/jnci\/djh067"},{"key":"bibr31-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1016\/j.apergo.2018.05.003"},{"key":"bibr32-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1037\/0278-7393.7.5.344"},{"key":"bibr33-0018720820983632","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1080\/00031305.1998.10480559","volume":"52","author":"Hintze J. L.","year":"1998","journal-title":"American Statistician"},{"key":"bibr30-0018720820983632","unstructured":"Gyles S. P., McCarley J. S. (2019) Metacognition, numeracy, and automation-aided decision-making [Unpublished masters dissertation]. Oregon State University"},{"key":"bibr34-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1016\/j.apergo.2020.103094"},{"key":"bibr35-0018720820983632","volume-title":"Theory of probability","author":"Jeffreys H","year":"1961"},{"key":"bibr36-0018720820983632","unstructured":"Kellner K. (2019). jagsUI: A Wrapper Around \u2018rjags\u2019 to Streamline \u2018JAGS\u2019 Analyses. https:\/\/cran.r-project.org\/web\/packages\/jagsUI\/index.html"},{"key":"bibr37-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1080\/00140130802526935"},{"key":"bibr38-0018720820983632","doi-asserted-by":"publisher","DOI":"10.3758\/BF03205200"},{"key":"bibr39-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1037\/a0029146"},{"key":"bibr40-0018720820983632","volume-title":"Doing Bayesian data analysis: A tutorial with R, JAGS, and Stan","author":"Kruschke J. K","year":"2015","edition":"2"},{"key":"bibr41-0018720820983632","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-016-1221-4"},{"key":"bibr44-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.46.1.50_30392"},{"key":"bibr43-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1002\/9781119170174.epcn502"},{"key":"bibr45-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139087759"},{"key":"bibr42-0018720820983632","first-page":"279","volume-title":"The Oxford Handbook of computational and mathematical psychology","author":"Kruschke J. K.","year":"2015"},{"key":"bibr46-0018720820983632","doi-asserted-by":"publisher","DOI":"10.14786\/flr.v5i3.269"},{"key":"bibr47-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1177\/0956797614541991"},{"key":"bibr48-0018720820983632","volume-title":"Detection theory: A user\u2019s guide","author":"Macmillan N. A.","year":"2005","edition":"2"},{"key":"bibr49-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.45.2.281.27239"},{"key":"bibr50-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1080\/00140130802376059"},{"key":"bibr51-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1111\/j.0956-7976.2004.00673.x"},{"key":"bibr52-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1177\/0018720811411912"},{"key":"bibr53-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1177\/0018720812465081"},{"key":"bibr54-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1177\/0018720814561675"},{"key":"bibr55-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1518\/001872001775870395"},{"key":"bibr56-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1518\/0018720024497754"},{"key":"bibr57-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1109\/THS.2008.4534504"},{"key":"bibr58-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1177\/0018720811413767"},{"key":"bibr59-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1016\/j.compmedimag.2007.02.009"},{"key":"bibr60-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1016\/S0042-6989(99)00244-8"},{"key":"bibr61-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1080\/001401300409125"},{"key":"bibr62-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1518\/001872097778543886"},{"key":"bibr63-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2006.11.017"},{"key":"bibr64-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa052911"},{"key":"bibr65-0018720820983632","unstructured":"Plummer M. (2017). JAGS version 4.3.0 user manual. https:\/\/sourceforge.net\/projects\/mcmc-jags\/files\/Manuals\/4.x\/"},{"key":"bibr66-0018720820983632","volume-title":"R: A language and environment for statistical computing","author":"R Core Team","year":"2018"},{"key":"bibr67-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1037\/a0024243"},{"key":"bibr68-0018720820983632","first-page":"75","volume-title":"Trends in ergonomics\/human factors","author":"Robinson D. E.","year":"1985"},{"key":"bibr69-0018720820983632","doi-asserted-by":"publisher","DOI":"10.3758\/BF03196750"},{"key":"bibr70-0018720820983632","volume-title":"Test and evaluation plan: X-ray image screener selection test (No. DOT\/FAA\/AR-01\/47)","author":"Rubenstein J","year":"2001"},{"key":"bibr71-0018720820983632","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2017.01620"},{"key":"bibr72-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1177\/1745691617708630"},{"key":"bibr73-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2303.1997.42375423.x"},{"key":"bibr74-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1006\/obhd.1994.1072"},{"key":"bibr75-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.108.1.183"},{"key":"bibr76-0018720820983632","doi-asserted-by":"publisher","DOI":"10.3758\/BF03207704"},{"key":"bibr77-0018720820983632","doi-asserted-by":"publisher","DOI":"10.3758\/s13414-018-01654-8"},{"key":"bibr78-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1109\/CCST.2015.7389657"},{"key":"bibr79-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.99.2.181"},{"key":"bibr80-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1177\/0018720809338842"},{"key":"bibr81-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1177\/1745691611406923"},{"key":"bibr82-0018720820983632","doi-asserted-by":"publisher","DOI":"10.4324\/9781315565712-4"},{"key":"bibr83-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1518\/001872000779698015"},{"key":"bibr84-0018720820983632","doi-asserted-by":"crossref","unstructured":"Wickham H. (2016).\n                      Ggplot2: Elegant graphics for data analysis\n                      . Springer-Verlag. https:\/\/ggplot2.tidyverse.org","DOI":"10.1007\/978-3-319-24277-4_9"},{"key":"bibr85-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1080\/1463922X.2016.1207209"},{"key":"bibr87-0018720820983632","first-page":"825","volume":"77","author":"Wiegmann D.","year":"2006","journal-title":"Aviation, Space, and Environmental Medicine"},{"key":"bibr86-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1518\/0018720024494847"},{"key":"bibr88-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1093\/rpd\/ncv501"},{"key":"bibr89-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.136.4.623"},{"key":"bibr90-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2009.11.066"},{"key":"bibr91-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1177\/0018720815621172"},{"key":"bibr92-0018720820983632","doi-asserted-by":"publisher","DOI":"10.1518\/001872001775898269"},{"key":"bibr93-0018720820983632","first-page":"968","volume-title":"IEEE Intelligent Transportation Systems Conference","author":"Zhang Y.","year":"2006"}],"container-title":["Human Factors: The Journal of the Human Factors and Ergonomics Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0018720820983632","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0018720820983632","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0018720820983632","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T07:52:45Z","timestamp":1777449165000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0018720820983632"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,28]]},"references-count":93,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,9]]}},"alternative-id":["10.1177\/0018720820983632"],"URL":"https:\/\/doi.org\/10.1177\/0018720820983632","relation":{},"ISSN":["0018-7208","1547-8181"],"issn-type":[{"value":"0018-7208","type":"print"},{"value":"1547-8181","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,28]]}}}