{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,20]],"date-time":"2026-04-20T10:46:21Z","timestamp":1776681981131,"version":"3.51.2"},"publisher-location":"New York, NY, USA","reference-count":63,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,11,7]],"date-time":"2022-11-07T00:00:00Z","timestamp":1667779200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,11,7]]},"DOI":"10.1145\/3536221.3556610","type":"proceedings-article","created":{"date-parts":[[2022,11,4]],"date-time":"2022-11-04T15:54:14Z","timestamp":1667577254000},"page":"337-348","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["Cognitive Workload Assessment via Eye Gaze and EEG in an Interactive Multi-Modal Driving Task"],"prefix":"10.1145","author":[{"given":"Ayca","family":"Aygun","sequence":"first","affiliation":[{"name":"Department of Computer Science, Tufts University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Boyang","family":"Lyu","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Tufts University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thuan","family":"Nguyen","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Tufts University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zachary","family":"Haga","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Tufts University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuchin","family":"Aeron","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Tufts University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthias","family":"Scheutz","sequence":"additional","affiliation":[{"name":"Human-Robot Interaction Laboratory, Tufts University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,11,7]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Abien\u00a0Fred Agarap. 2018. Deep learning using rectified linear units (relu). arXiv preprint arXiv:1803.08375(2018).  Abien\u00a0Fred Agarap. 2018. Deep learning using rectified linear units (relu). arXiv preprint arXiv:1803.08375(2018)."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"crossref","unstructured":"Ulf Ahlstrom and Ferne\u00a0J Friedman-Berg. 2006. Using eye movement activity as a correlate of cognitive workload. International journal of industrial ergonomics 36 7(2006) 623\u2013636.  Ulf Ahlstrom and Ferne\u00a0J Friedman-Berg. 2006. Using eye movement activity as a correlate of cognitive workload. International journal of industrial ergonomics 36 7(2006) 623\u2013636.","DOI":"10.1016\/j.ergon.2006.04.002"},{"key":"e_1_3_2_1_3_1","first-page":"419","article-title":"Classification of human emotions from electroencephalogram (EEG) signal using deep neural network","volume":"8","author":"Al-Nafjan Abeer","year":"2017","unstructured":"Abeer Al-Nafjan , Manar Hosny , Areej Al-Wabil , and Yousef Al-Ohali . 2017 . Classification of human emotions from electroencephalogram (EEG) signal using deep neural network . Int. J. Adv. Comput. Sci. Appl 8 , 9 (2017), 419 \u2013 425 . Abeer Al-Nafjan, Manar Hosny, Areej Al-Wabil, and Yousef Al-Ohali. 2017. Classification of human emotions from electroencephalogram (EEG) signal using deep neural network. Int. J. Adv. Comput. Sci. Appl 8, 9 (2017), 419\u2013425.","journal-title":"Int. J. Adv. Comput. Sci. Appl"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.23919\/ICACT.2019.8702048"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3204493.3204531"},{"key":"e_1_3_2_1_6_1","volume-title":"Task-evoked pupillary responses, processing load, and the structure of processing resources.Psychological bulletin 91, 2","author":"Beatty Jackson","year":"1982","unstructured":"Jackson Beatty . 1982. Task-evoked pupillary responses, processing load, and the structure of processing resources.Psychological bulletin 91, 2 ( 1982 ), 276. Jackson Beatty. 1982. Task-evoked pupillary responses, processing load, and the structure of processing resources.Psychological bulletin 91, 2 (1982), 276."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1995.tb02031.x"},{"key":"e_1_3_2_1_8_1","volume-title":"EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. Aviation, space, and environmental medicine 78, 5","author":"Berka Chris","year":"2007","unstructured":"Chris Berka , Daniel\u00a0 J Levendowski , Michelle\u00a0 N Lumicao , Alan Yau , Gene Davis , Vladimir\u00a0 T Zivkovic , Richard\u00a0 E Olmstead , Patrice\u00a0 D Tremoulet , and Patrick\u00a0 L Craven . 2007. EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. Aviation, space, and environmental medicine 78, 5 ( 2007 ), B231\u2013B244. Chris Berka, Daniel\u00a0J Levendowski, Michelle\u00a0N Lumicao, Alan Yau, Gene Davis, Vladimir\u00a0T Zivkovic, Richard\u00a0E Olmstead, Patrice\u00a0D Tremoulet, and Patrick\u00a0L Craven. 2007. EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. Aviation, space, and environmental medicine 78, 5 (2007), B231\u2013B244."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ergon.2021.103193"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCDS.2016.2628702"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-67642-5_8"},{"key":"e_1_3_2_1_12_1","unstructured":"Marco Cerliani. 2021. Tsmoothie. https:\/\/github.com\/cerlymarco\/tsmoothie.  Marco Cerliani. 2021. Tsmoothie. https:\/\/github.com\/cerlymarco\/tsmoothie."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-91122-9_23"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2011.07.091"},{"key":"e_1_3_2_1_15_1","volume-title":"Assessing Mental Workload Using Eye Tracking Technology and Deep Learning Models. Handbook of Intelligent Computing and Optimization for Sustainable Development","author":"Das Souvik","year":"2022","unstructured":"Souvik Das , Kintada Prudhvi , and J Maiti . 2022. Assessing Mental Workload Using Eye Tracking Technology and Deep Learning Models. Handbook of Intelligent Computing and Optimization for Sustainable Development ( 2022 ), 1\u201311. Souvik Das, Kintada Prudhvi, and J Maiti. 2022. Assessing Mental Workload Using Eye Tracking Technology and Deep Learning Models. Handbook of Intelligent Computing and Optimization for Sustainable Development (2022), 1\u201311."},{"key":"e_1_3_2_1_16_1","volume-title":"Multimodal fusion for objective assessment of cognitive workload: a review","author":"Debie Essam","year":"2019","unstructured":"Essam Debie , Raul\u00a0Fernandez Rojas , Justin Fidock , Michael Barlow , Kathryn Kasmarik , Sreenatha Anavatti , Matt Garratt , and Hussein\u00a0 A Abbass . 2019. Multimodal fusion for objective assessment of cognitive workload: a review . IEEE transactions on cybernetics 51, 3 ( 2019 ), 1542\u20131555. Essam Debie, Raul\u00a0Fernandez Rojas, Justin Fidock, Michael Barlow, Kathryn Kasmarik, Sreenatha Anavatti, Matt Garratt, and Hussein\u00a0A Abbass. 2019. Multimodal fusion for objective assessment of cognitive workload: a review. IEEE transactions on cybernetics 51, 3 (2019), 1542\u20131555."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2003.10.009"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNSRE.2017.2701002"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICEDSS.2017.8073658"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-02812-0_26"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.3923\/jbs.2016.265.271"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2017.2782483"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1037\/e578902012-042"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1088\/1757-899X\/1077\/1\/012031"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-021-01961-6"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.96.3.589"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.3390\/s19050987"},{"key":"e_1_3_2_1_28_1","volume-title":"Interpretable machine learning models for three-way classification of cognitive workload levels for eye-tracking features. Brain sciences 11, 2","author":"Kaczorowska Monika","year":"2021","unstructured":"Monika Kaczorowska , Ma\u0142gorzata Plechawska-W\u00f3jcik , and Mikhail Tokovarov . 2021. Interpretable machine learning models for three-way classification of cognitive workload levels for eye-tracking features. Brain sciences 11, 2 ( 2021 ), 210. Monika Kaczorowska, Ma\u0142gorzata Plechawska-W\u00f3jcik, and Mikhail Tokovarov. 2021. Interpretable machine learning models for three-way classification of cognitive workload levels for eye-tracking features. Brain sciences 11, 2 (2021), 210."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Rudolph\u00a0Emil Kalman. 1960. A new approach to linear filtering and prediction problems. (1960).  Rudolph\u00a0Emil Kalman. 1960. A new approach to linear filtering and prediction problems. (1960).","DOI":"10.1115\/1.3662552"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2019.04.014"},{"key":"e_1_3_2_1_31_1","volume-title":"The Thirty-Second International Flairs Conference.","author":"Khedher Asma\u00a0Ben","year":"2019","unstructured":"Asma\u00a0Ben Khedher , Im\u00e8ne Jraidi , and Claude Frasson . 2019 . Predicting learners\u2019 performance using EEG and eye tracking features . In The Thirty-Second International Flairs Conference. Asma\u00a0Ben Khedher, Im\u00e8ne Jraidi, and Claude Frasson. 2019. Predicting learners\u2019 performance using EEG and eye tracking features. In The Thirty-Second International Flairs Conference."},{"key":"e_1_3_2_1_32_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980(2014).","author":"Kingma P","year":"2014","unstructured":"Diederik\u00a0 P Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980(2014). Diederik\u00a0P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980(2014)."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170427.3188643"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/aace8c"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2950112.2964585"},{"key":"e_1_3_2_1_36_1","volume-title":"Eye movement indices of mental workload. Acta psychologica 75, 1","author":"May G","year":"1990","unstructured":"James\u00a0 G May , Robert\u00a0 S Kennedy , Mary\u00a0 C Williams , William\u00a0 P Dunlap , and Julie\u00a0 R Brannan . 1990. Eye movement indices of mental workload. Acta psychologica 75, 1 ( 1990 ), 75\u201389. James\u00a0G May, Robert\u00a0S Kennedy, Mary\u00a0C Williams, William\u00a0P Dunlap, and Julie\u00a0R Brannan. 1990. Eye movement indices of mental workload. Acta psychologica 75, 1 (1990), 75\u201389."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2731784"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2168556.2168650"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1743666.1743701"},{"key":"e_1_3_2_1_40_1","volume-title":"Mental Workload Estimation Using EEG. In 2020 Fifth International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN). IEEE, 83\u201386","author":"Pandey Vishal","year":"2020","unstructured":"Vishal Pandey , Dhirendra\u00a0Kumar Choudhary , Vinita Verma , Greeshma Sharma , Ram Singh , and Sushil Chandra . 2020 . Mental Workload Estimation Using EEG. In 2020 Fifth International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN). IEEE, 83\u201386 . Vishal Pandey, Dhirendra\u00a0Kumar Choudhary, Vinita Verma, Greeshma Sharma, Ram Singh, and Sushil Chandra. 2020. Mental Workload Estimation Using EEG. In 2020 Fifth International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN). IEEE, 83\u201386."},{"key":"e_1_3_2_1_41_1","volume-title":"BioMedical Engineering and Informatics (CISP-BMEI)","author":"Pang Liping","unstructured":"Liping Pang , Yurong Fan , Ye Deng , Xin Wang , and Tianbo Wang . 2020. Mental Workload Classification By Eye Movements In Visual Search Tasks. In 2020 13th International Congress on Image and Signal Processing , BioMedical Engineering and Informatics (CISP-BMEI) . IEEE , 29\u201333. Liping Pang, Yurong Fan, Ye Deng, Xin Wang, and Tianbo Wang. 2020. Mental Workload Classification By Eye Movements In Visual Search Tasks. In 2020 13th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI). IEEE, 29\u201333."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858117"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/HSI.2016.7529661"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/CAC48633.2019.8996873"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.3390\/app10093036"},{"key":"e_1_3_2_1_46_1","article-title":"Artifact removal from EEG signals","volume":"77","author":"Reddy A\u00a0Guruva","year":"2013","unstructured":"A\u00a0Guruva Reddy and Srilatha Narava . 2013 . Artifact removal from EEG signals . International Journal of Computer Applications 77 , 13(2013). A\u00a0Guruva Reddy and Srilatha Narava. 2013. Artifact removal from EEG signals. International Journal of Computer Applications 77, 13(2013).","journal-title":"International Journal of Computer Applications"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"crossref","unstructured":"Nigel\u00a0C Rogasch Mana Biabani and Tuomas\u00a0P Mutanen. 2022. Designing and comparing cleaning pipelines for TMS-EEG data: a theoretical overview and practical example. Journal of Neuroscience Methods(2022) 109494.  Nigel\u00a0C Rogasch Mana Biabani and Tuomas\u00a0P Mutanen. 2022. Designing and comparing cleaning pipelines for TMS-EEG data: a theoretical overview and practical example. Journal of Neuroscience Methods(2022) 109494.","DOI":"10.1016\/j.jneumeth.2022.109494"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0121262"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2015.314"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-020-05915-7"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0018298"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0174949"},{"key":"e_1_3_2_1_53_1","volume-title":"Analysis of variance (ANOVA). Chemometrics and intelligent laboratory systems 6, 4","author":"St Lars","year":"1989","unstructured":"Lars St , Svante Wold , 1989. Analysis of variance (ANOVA). Chemometrics and intelligent laboratory systems 6, 4 ( 1989 ), 259\u2013272. Lars St, Svante Wold, 1989. Analysis of variance (ANOVA). Chemometrics and intelligent laboratory systems 6, 4 (1989), 259\u2013272."},{"key":"e_1_3_2_1_54_1","unstructured":"Petre Stoica Randolph\u00a0L Moses 2005. Spectral analysis of signals. (2005).  Petre Stoica Randolph\u00a0L Moses 2005. Spectral analysis of signals. (2005)."},{"key":"e_1_3_2_1_55_1","first-page":"127","article-title":"Cross-validation: A review. Statistics","volume":"9","author":"Stone M","year":"1978","unstructured":"M Stone . 1978 . Cross-validation: A review. Statistics : A Journal of Theoretical and Applied Statistics 9 , 1(1978), 127 \u2013 139 . M Stone. 1978. Cross-validation: A review. Statistics: A Journal of Theoretical and Applied Statistics 9, 1(1978), 127\u2013139.","journal-title":"A Journal of Theoretical and Applied Statistics"},{"key":"e_1_3_2_1_56_1","volume-title":"A multimodal dataset for various forms of distracted driving. Scientific data 4, 1","author":"Taamneh Salah","year":"2017","unstructured":"Salah Taamneh , Panagiotis Tsiamyrtzis , Malcolm Dcosta , Pradeep Buddharaju , Ashik Khatri , Michael Manser , Thomas Ferris , Robert Wunderlich , and Ioannis Pavlidis . 2017. A multimodal dataset for various forms of distracted driving. Scientific data 4, 1 ( 2017 ), 1\u201321. Salah Taamneh, Panagiotis Tsiamyrtzis, Malcolm Dcosta, Pradeep Buddharaju, Ashik Khatri, Michael Manser, Thomas Ferris, Robert Wunderlich, and Ioannis Pavlidis. 2017. A multimodal dataset for various forms of distracted driving. Scientific data 4, 1 (2017), 1\u201321."},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.aei.2020.101095"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1111\/aas.13129"},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2016.11.013"},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2560\/12\/4\/046020"},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAMD.2015.2441960"},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3388818.3389166"},{"key":"e_1_3_2_1_63_1","volume-title":"Cognitive Workload Recognition Using EEG Signals and Machine Learning: A Review","author":"Zhou Yueying","year":"2021","unstructured":"Yueying Zhou , Shuo Huang , Ziming Xu , Pengpai Wang , Xia Wu , and Daoqiang Zhang . 2021. Cognitive Workload Recognition Using EEG Signals and Machine Learning: A Review . IEEE Transactions on Cognitive and Developmental Systems ( 2021 ). Yueying Zhou, Shuo Huang, Ziming Xu, Pengpai Wang, Xia Wu, and Daoqiang Zhang. 2021. Cognitive Workload Recognition Using EEG Signals and Machine Learning: A Review. IEEE Transactions on Cognitive and Developmental Systems (2021)."}],"event":{"name":"ICMI '22: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","location":"Bengaluru India","acronym":"ICMI '22","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2022 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3536221.3556610","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3536221.3556610","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:48:53Z","timestamp":1750182533000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3536221.3556610"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,7]]},"references-count":63,"alternative-id":["10.1145\/3536221.3556610","10.1145\/3536221"],"URL":"https:\/\/doi.org\/10.1145\/3536221.3556610","relation":{},"subject":[],"published":{"date-parts":[[2022,11,7]]},"assertion":[{"value":"2022-11-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}