{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T05:08:30Z","timestamp":1775020110590,"version":"3.50.1"},"reference-count":78,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2014,6,18]],"date-time":"2014-06-18T00:00:00Z","timestamp":1403049600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Hum Factors"],"published-print":{"date-parts":[[2015,2]]},"abstract":"<jats:sec><jats:title>Objective:<\/jats:title><jats:p> A study was run to test the sensitivity of multiple workload indices to the differing cognitive demands of four military monitoring task scenarios and to investigate relationships between indices. <\/jats:p><\/jats:sec><jats:sec><jats:title>Background:<\/jats:title><jats:p> Various psychophysiological indices of mental workload exhibit sensitivity to task factors. However, the psychometric properties of multiple indices, including the extent to which they intercorrelate, have not been adequately investigated. <\/jats:p><\/jats:sec><jats:sec><jats:title>Method:<\/jats:title><jats:p> One hundred fifty participants performed in four task scenarios based on a simulation of unmanned ground vehicle operation. Scenarios required threat detection and\/or change detection. Both single- and dual-task scenarios were used. Workload metrics for each scenario were derived from the electroencephalogram (EEG), electrocardiogram, transcranial Doppler sonography, functional near infrared, and eye tracking. Subjective workload was also assessed. <\/jats:p><\/jats:sec><jats:sec><jats:title>Results:<\/jats:title><jats:p> Several metrics showed sensitivity to the differing demands of the four scenarios. Eye fixation duration and the Task Load Index metric derived from EEG were diagnostic of single-versus dual-task performance. Several other metrics differentiated the two single tasks but were less effective in differentiating single- from dual-task performance. Psychometric analyses confirmed the reliability of individual metrics but failed to identify any general workload factor. An analysis of difference scores between low- and high-workload conditions suggested an effort factor defined by heart rate variability and frontal cortex oxygenation. <\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions:<\/jats:title><jats:p> General workload is not well defined psychometrically, although various individual metrics may satisfy conventional criteria for workload assessment. <\/jats:p><\/jats:sec><jats:sec><jats:title>Application:<\/jats:title><jats:p> Practitioners should exercise caution in using multiple metrics that may not correspond well, especially at the level of the individual operator. <\/jats:p><\/jats:sec>","DOI":"10.1177\/0018720814539505","type":"journal-article","created":{"date-parts":[[2014,6,19]],"date-time":"2014-06-19T05:39:49Z","timestamp":1403156389000},"page":"125-143","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":223,"title":["The Psychometrics of Mental Workload"],"prefix":"10.1177","volume":"57","author":[{"given":"Gerald","family":"Matthews","sequence":"first","affiliation":[{"name":"University of Central Florida, Orlando"}]},{"given":"Lauren E.","family":"Reinerman-Jones","sequence":"additional","affiliation":[{"name":"University of Central Florida, Orlando"}]},{"given":"Daniel J.","family":"Barber","sequence":"additional","affiliation":[{"name":"University of Central Florida, Orlando"}]},{"suffix":"IV","given":"Julian","family":"Abich","sequence":"additional","affiliation":[{"name":"University of Central Florida, Orlando"}]}],"member":"179","published-online":{"date-parts":[[2014,6,18]]},"reference":[{"key":"bibr1-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-39420-1_23"},{"key":"bibr2-0018720814539505","volume-title":"B-Alert Software User Manual","author":"Advanced Brain Monitoring, Inc. (ABM)","year":"2011"},{"key":"bibr3-0018720814539505","volume-title":"Standards for educational and psychological testing","author":"American Educational Research Association, American Psychological Association, &amp; National Council on Measurement in Education","year":"1999","edition":"3"},{"key":"bibr4-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1201\/EBK1439835012-c3"},{"key":"bibr5-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2011.07.047"},{"key":"bibr6-0018720814539505","volume-title":"Paper presented at the Army Science Conference","author":"Barber D.","year":"2008"},{"key":"bibr7-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.91.2.276"},{"key":"bibr8-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1518\/001872007779598073"},{"key":"bibr9-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2012.6347469"},{"key":"bibr10-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/j.aap.2009.06.001"},{"key":"bibr11-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/0301-0511(95)05167-8"},{"key":"bibr12-0018720814539505","volume-title":"A review of the mental workload literature","author":"Cain B.","year":"2007"},{"key":"bibr13-0018720814539505","volume-title":"Personality and mood by questionnaire","author":"Cattell R. B.","year":"1973"},{"key":"bibr14-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1177\/0018720813476883"},{"key":"bibr15-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2011.07.091"},{"key":"bibr16-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/j.bandc.2012.12.003"},{"key":"bibr17-0018720814539505","volume-title":"Department of Defense interface standard: Common warfighter symbology","author":"Department of Defense","year":"2005"},{"key":"bibr18-0018720814539505","first-page":"344","volume":"76","author":"Dussault C.","year":"2005","journal-title":"Aviation, Space, and Environmental Medicine"},{"key":"bibr19-0018720814539505","first-page":"207","volume-title":"Multiple task performance","author":"Eggemeier F. T.","year":"1991"},{"key":"bibr20-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2008.10.011"},{"key":"bibr21-0018720814539505","volume-title":"Motivational perspectives on the cardiovascular response","author":"Fairclough S. H."},{"key":"bibr22-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2004.11.003"},{"key":"bibr23-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-39473-7_82"},{"key":"bibr24-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1177\/154193121005401809"},{"key":"bibr25-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1080\/14639220210159717"},{"key":"bibr26-0018720814539505","first-page":"65","volume-title":"Neuroergonomics: The brain at work","author":"Gratton G.","year":"2007"},{"key":"bibr27-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.2009.02316.x"},{"key":"bibr28-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1109\/21.17382"},{"key":"bibr29-0018720814539505","first-page":"360","volume":"69","author":"Hankins T. C.","year":"1998","journal-title":"Aviation, Space, and Environmental Medicine"},{"key":"bibr30-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1177\/154193120605000909"},{"key":"bibr31-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-4115(08)62386-9"},{"key":"bibr32-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1177\/1094428104263675"},{"key":"bibr33-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2009.5332602"},{"key":"bibr34-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1037\/a0027284"},{"key":"bibr35-0018720814539505","first-page":"45","volume-title":"Handbook of operator fatigue","author":"Hockey G. R. J.","year":"2012"},{"key":"bibr36-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/j.apergo.2009.04.008"},{"key":"bibr37-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1007\/BF02289447"},{"key":"bibr38-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsr.2008.10.011"},{"key":"bibr39-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/B978-044451020-4\/50031-1"},{"key":"bibr40-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1002\/wcs.130"},{"key":"bibr41-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1007\/s00213-004-2000-x"},{"key":"bibr42-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1177\/0018720814526617"},{"key":"bibr43-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-0173(98)00056-3"},{"key":"bibr44-0018720814539505","first-page":"14","volume-title":"Psychological stress","author":"Lacey J. I.","year":"1967"},{"key":"bibr45-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1037\/a0030694"},{"key":"bibr46-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1109\/HFPP.2002.1042860"},{"key":"bibr47-0018720814539505","first-page":"5","volume-title":"Stress, workload and fatigue","author":"Matthews G.","year":"2001"},{"key":"bibr48-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1037\/12343-010"},{"key":"bibr49-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1037\/a0019572"},{"key":"bibr50-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1201\/9780203489925.ch20"},{"key":"bibr51-0018720814539505","volume-title":"Psychometric theory","author":"Nunnally J. C.","year":"1994","edition":"3"},{"key":"bibr52-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1177\/001872089103300102"},{"key":"bibr53-0018720814539505","first-page":"1","volume-title":"Handbook of perception and human performance: Vol. 2. Cognitive processes and performance","author":"O\u2019Donnell R. D.","year":"1986","edition":"2"},{"key":"bibr54-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1177\/1071181311551189"},{"key":"bibr55-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1518\/001872097778543886"},{"key":"bibr56-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1518\/155534308X284417"},{"key":"bibr57-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1080\/14639220500078021"},{"key":"bibr58-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1145\/355017.355028"},{"key":"bibr59-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/j.trf.2012.10.002"},{"key":"bibr60-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1037\/a0034386"},{"key":"bibr61-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2006.03.001"},{"key":"bibr62-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1177\/106480460501300303"},{"key":"bibr63-0018720814539505","first-page":"289","volume-title":"Engineering in Medicine and Biology Society, 1997: Proceedings of the 19th Annual International Conference of the IEEE","volume":"1","author":"So H. H.","year":"1997"},{"key":"bibr64-0018720814539505","volume-title":"Human factors methods: A practical guide for engineering and design","author":"Stanton N. A.","year":"2005"},{"key":"bibr65-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/j.biopsycho.2010.03.014"},{"key":"bibr66-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1023\/A:1026412811036"},{"key":"bibr67-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1016\/S0301-5629(00)00325-2"},{"key":"bibr68-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1080\/14639220902893613"},{"key":"bibr69-0018720814539505","volume-title":"Using multivariate statistics","author":"Tabachnick B. G.","year":"2001"},{"key":"bibr70-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1177\/1555343413495396"},{"key":"bibr71-0018720814539505","unstructured":"Tollner A. M. (2006). Individual and team susceptibility to change blindness (Dissertation). University of Cincinnati, Cincinnati, OH."},{"key":"bibr72-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1002\/9781118131350.ch8"},{"key":"bibr73-0018720814539505","first-page":"197","volume-title":"Handbook of operator fatigue","author":"Warm J. S.","year":"2012"},{"key":"bibr74-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1518\/001872008X288394"},{"key":"bibr75-0018720814539505","first-page":"329","volume-title":"Multiple task performance","author":"Wilson G. F.","year":"1991"},{"key":"bibr76-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.45.4.635.27088"},{"key":"bibr77-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1177\/001872088803000110"},{"key":"bibr78-0018720814539505","doi-asserted-by":"publisher","DOI":"10.1518\/0018720024497709"}],"container-title":["Human Factors: The Journal of the Human Factors and Ergonomics Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0018720814539505","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0018720814539505","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0018720814539505","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,3]],"date-time":"2025-03-03T11:12:28Z","timestamp":1741000348000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0018720814539505"}},"subtitle":["Multiple Measures Are Sensitive but Divergent"],"short-title":[],"issued":{"date-parts":[[2014,6,18]]},"references-count":78,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2015,2]]}},"alternative-id":["10.1177\/0018720814539505"],"URL":"https:\/\/doi.org\/10.1177\/0018720814539505","relation":{},"ISSN":["0018-7208","1547-8181"],"issn-type":[{"value":"0018-7208","type":"print"},{"value":"1547-8181","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,6,18]]}}}