{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,14]],"date-time":"2024-09-14T23:14:44Z","timestamp":1726355684571},"reference-count":52,"publisher":"MIT Press - Journals","issue":"6","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,5,13]]},"abstract":"<jats:p>Driver mental fatigue leads to thousands of traffic accidents. The increasing quality and availability of low-cost electroencephalogram (EEG) systems offer possibilities for practical fatigue monitoring. However, non-data-driven methods, designed for practical, complex situations, usually rely on handcrafted data statistics of EEG signals. To reduce human involvement, we introduce a data-driven methodology for online mental fatigue detection: self-weight ordinal regression (SWORE). Reaction time (RT), referring to the length of time people take to react to an emergency, is widely considered an objective behavioral measure for mental fatigue state. Since regression methods are sensitive to extreme RTs, we propose an indirect RT estimation based on preferences to explore the relationship between EEG and RT, which generalizes to any scenario when an objective fatigue indicator is available. In particular, SWORE evaluates the noisy EEG signals from multiple channels in terms of two states: shaking state and steady state. Modeling the shaking state can discriminate the reliable channels from the uninformative ones, while modeling the steady state can suppress the task-nonrelevant fluctuation within each channel. In addition, an online generalized Bayesian moment matching (online GBMM) algorithm is proposed to online-calibrate SWORE efficiently per participant. Experimental results with 40 participants show that SWORE can maximally achieve consistent with RT, demonstrating the feasibility and adaptability of our proposed framework in practical mental fatigue estimation.<\/jats:p>","DOI":"10.1162\/neco_a_01382","type":"journal-article","created":{"date-parts":[[2021,4,15]],"date-time":"2021-04-15T00:35:15Z","timestamp":1618446915000},"page":"1616-1655","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":4,"title":["Online Mental Fatigue Monitoring via Indirect Brain Dynamics Evaluation"],"prefix":"10.1162","volume":"33","author":[{"given":"Yuangang","family":"Pan","sequence":"first","affiliation":[{"name":"Australian Artificial Intelligence Institute, University of Technology Sydney, Sydney, NSW 2007, Australia yuangang.pan@uts.edu.au"}]},{"given":"Ivor W.","family":"Tsang","sequence":"additional","affiliation":[{"name":"Australian Artificial Intelligence Institute, University of Technology Sydney, Sydney, NSW 2007, Australia ivor.tsang@uts.edu.au"}]},{"given":"Yueming","family":"Lyu","sequence":"additional","affiliation":[{"name":"Australian Artificial Intelligence Institute, University of Technology Sydney, Sydney, NSW 2007, Australia Yueming.Lyu@student.uts.edu.au"}]},{"given":"Avinash K.","family":"Singh","sequence":"additional","affiliation":[{"name":"Australian Artificial Intelligence Institute, University of Technology Sydney, Sydney, NSW 2007, Australia Avinash.Singh@uts.edu.au"}]},{"given":"Chin-Teng","family":"Lin","sequence":"additional","affiliation":[{"name":"Australian Artificial Intelligence Institute, University of Technology Sydney, Sydney, NSW 2007, Australia Chin-teng.Lin@uts.edu.au"}]}],"member":"281","published-online":{"date-parts":[[2021,5,13]]},"reference":[{"issue":"4","key":"2021051720034932400_B1","doi-asserted-by":"crossref","first-page":"920","DOI":"10.1109\/TBME.2011.2172210","article-title":"Multiclass brain-computer interface classification by Riemannian geometry","volume":"59","author":"Barachant","year":"2012","journal-title":"IEEE Transactions on Biomedical Engineering"},{"key":"2021051720034932400_B2","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/j.neubiorev.2012.10.003","article-title":"Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness","volume":"44","author":"Borghini","year":"2014","journal-title":"Neuroscience and Biobehavioral Reviews"},{"key":"2021051720034932400_B3","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1109\/TCDS.2019.2929858","article-title":"Regression based continuous driving fatigue estimation: Towards practical implementation","volume":"12","author":"Bose","year":"2019","journal-title":"IEEE Transactions on Cognitive and Developmental Systems"},{"issue":"3","key":"2021051720034932400_B4","doi-asserted-by":"crossref","first-page":"715","DOI":"10.1109\/JBHI.2016.2532354","article-title":"Driver fatigue classification with independent component by entropy rate bound minimization analysis in an EEG-based system","volume":"21","author":"Chai","year":"2016","journal-title":"IEEE Journal of Biomedical and Health Informatics"},{"key":"2021051720034932400_B5","doi-asserted-by":"crossref","first-page":"5074","DOI":"10.1523\/JNEUROSCI.3209-16.2017","article-title":"Neural mechanisms of cognitive dissonance (revised): An EEG study","volume":"37","author":"Colosio","year":"2017","journal-title":"Journal of Neuroscience"},{"issue":"3","key":"2021051720034932400_B6","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1080\/2326263X.2017.1297192","article-title":"Riemannian geometry for EEG-based brain-computer interfaces: A primer and a review","volume":"4","author":"Congedo","year":"2017","journal-title":"Brain-Computer Interfaces"},{"key":"2021051720034932400_B7","first-page":"822","article-title":"EEG-based driver drowsiness estimation using convolutional neural networks","author":"Cui","year":"2017","journal-title":"Proceedings of the International Conference on Neural Information Processing"},{"issue":"11","key":"2021051720034932400_B8","doi-asserted-by":"crossref","first-page":"2263","DOI":"10.1109\/TNSRE.2019.2945794","article-title":"EEG-based driver drowsiness estimation using feature weighted episodic training","volume":"27","author":"Cui","year":"2019","journal-title":"IEEE Transactions on Neural Systems and Rehabilitation Engineering"},{"key":"2021051720034932400_B9","doi-asserted-by":"crossref","first-page":"409","DOI":"10.7551\/mitpress\/7493.001.0001","volume-title":"Toward brain-computer interfacing","author":"Dornhege","year":"2007"},{"key":"2021051720034932400_B10","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/j.apergo.2015.07.009","article-title":"Effects of mental workload on physiological and subjective responses during traffic density monitoring: A field study","volume":"52","author":"Fallahi","year":"2016","journal-title":"Applied Ergonomics"},{"issue":"12","key":"2021051720034932400_B11","article-title":"Detecting driver mental fatigue based on EEG alpha power changes during simulated driving","volume":"44","author":"Gharagozlou","year":"2015","journal-title":"Iranian Journal of Public Health"},{"key":"2021051720034932400_B12","author":"Goodfellow","year":"2016","journal-title":"Deep learning"},{"key":"2021051720034932400_B13","first-page":"1","volume-title":"Brain-computer interfaces","author":"Graimann","year":"2009"},{"key":"2021051720034932400_B14","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1016\/j.procs.2014.07.045","article-title":"Drowsy driving detection by EEG analysis using wavelet transform and k-means clustering","volume":"34","author":"Gurudath","year":"2014","journal-title":"Procedia Computer Science"},{"issue":"4","key":"2021051720034932400_B15","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1016\/0013-4694(87)90206-9","article-title":"Cerebral location of international 10\u201320 system electrode placement","volume":"66","author":"Homan","year":"1987","journal-title":"Electroencephalography and Clinical Neurophysiology"},{"key":"2021051720034932400_B16","doi-asserted-by":"crossref","DOI":"10.3389\/fnhum.2015.00570","article-title":"Identifying changes in EEG information transfer during drowsy driving by transfer entropy","volume":"9","author":"Huang","year":"2015","journal-title":"Frontiers in Human Neuroscience"},{"key":"2021051720034932400_B17","first-page":"394","article-title":"Tonic changes in EEG power spectra during simulated driving","author":"Huang","year":"2009","journal-title":"Proceedings of the International Conference on Foundations of Augmented Cognition"},{"issue":"4","key":"2021051720034932400_B18","doi-asserted-by":"crossref","first-page":"1140","DOI":"10.1016\/j.apergo.2014.02.001","article-title":"Assessment of early onset of driver fatigue using multimodal fatigue measures in a static simulator","volume":"45","author":"Jagannath","year":"2014","journal-title":"Applied Ergonomics"},{"key":"2021051720034932400_B19","article-title":"Online Bayesian transfer learning for sequential data modeling.","author":"Jaini","year":"2017","journal-title":"Proceedings of the International Conference on Learning Representations"},{"issue":"2","key":"2021051720034932400_B20","doi-asserted-by":"crossref","first-page":"2352","DOI":"10.1016\/j.eswa.2007.12.043","article-title":"Using EEG spectral components to assess algorithms for detecting fatigue","volume":"36","author":"Jap","year":"2009","journal-title":"Expert Systems with Applications"},{"issue":"5","key":"2021051720034932400_B21","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1016\/j.trf.2010.06.006","article-title":"EEG signal analysis for the assessment and quantification of driver's fatigue","volume":"13","author":"Kar","year":"2010","journal-title":"Transportation Research Part F: Traffic Psychology and Behaviour"},{"issue":"3","key":"2021051720034932400_B22","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/S0022-4375(03)00027-6","article-title":"Development of an algorithm for an EEG-based driver fatigue countermeasure","volume":"34","author":"Lal","year":"2003","journal-title":"Journal of Safety Research"},{"issue":"4","key":"2021051720034932400_B23","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1016\/j.bspc.2013.01.007","article-title":"Multimodal information improves the rapid detection of mental fatigue","volume":"8","author":"Laurent","year":"2013","journal-title":"Biomedical Signal Processing and Control"},{"issue":"2","key":"2021051720034932400_B24","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1007\/s40846-017-0224-6","article-title":"A new method for human mental fatigue detection with several EEG channels","volume":"37","author":"Li","year":"2017","journal-title":"Journal of Medical and Biological Engineering"},{"issue":"4","key":"2021051720034932400_B25","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1109\/TBCAS.2010.2046415","article-title":"A real-time wireless brain\u2013computer interface system for drowsiness detection","volume":"4","author":"Lin","year":"2010","journal-title":"IEEE Transactions on Biomedical Circuits and Systems"},{"issue":"10","key":"2021051720034932400_B26","doi-asserted-by":"crossref","first-page":"1689","DOI":"10.1109\/TNNLS.2013.2275003","article-title":"EEG-based learning system for online motion sickness level estimation in a dynamic vehicle environment","volume":"24","author":"Lin","year":"2013","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"issue":"2","key":"2021051720034932400_B27","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1109\/TNNLS.2015.2496330","article-title":"Brain dynamics in predicting driving fatigue using a recurrent self-evolving fuzzy neural network","volume":"27","author":"Liu","year":"2016","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"issue":"1","key":"2021051720034932400_B28","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.jneumeth.2007.09.022","article-title":"Machine learning for real-time single-trial EEG-analysis: From brain-computer interfacing to mental state monitoring","volume":"167","author":"M\u00fcller","year":"2008","journal-title":"Journal of Neuroscience Methods"},{"key":"2021051720034932400_B29","article-title":"Utilization of a combined EEG\/NIRS system to predict driver drowsiness","volume":"7","author":"Nguyen","year":"2017","journal-title":"Scientific Reports"},{"issue":"1","key":"2021051720034932400_B30","first-page":"627","article-title":"Systematic review on wearable driver vigilance system with future research directions","volume":"10","author":"Rajan","year":"2015","journal-title":"International Journal of Applied Engineering Research"},{"issue":"8","key":"2021051720034932400_B31","doi-asserted-by":"crossref","first-page":"1499","DOI":"10.1162\/neco_a_01293","article-title":"Stochastic multichannel ranking with brain dynamics preferences","volume":"32","author":"Pan","year":"2020","journal-title":"Neural Computation"},{"issue":"16","key":"2021051720034932400_B32","doi-asserted-by":"crossref","first-page":"6539","DOI":"10.1073\/pnas.0812589106","article-title":"Quality of evidence for perceptual decision making is indexed by trial-to-trial variability of the EEG","volume":"106","author":"Ratcliff","year":"2009","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"2021051720034932400_B33","first-page":"1297","article-title":"Learning from crowds","volume":"11","author":"Raykar","year":"2010","journal-title":"Journal of Machine Learning Research"},{"issue":"8","key":"2021051720034932400_B34","doi-asserted-by":"crossref","first-page":"1751","DOI":"10.1007\/s11760-015-0760-x","article-title":"A practical method for driver sleepiness detection by processing the EEG signals stimulated with external flickering light","volume":"9","author":"Resalat","year":"2015","journal-title":"Signal, Image and Video Processing"},{"key":"2021051720034932400_B35","first-page":"5495","article-title":"Real-time mental state recognition using a wearable EEG.","author":"Richer","year":"2018","journal-title":"Proceedings of the 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society"},{"issue":"12","key":"2021051720034932400_B36","doi-asserted-by":"crossref","first-page":"16937","DOI":"10.3390\/s121216937","article-title":"Detecting driver drowsiness based on sensors: A review","volume":"12","author":"Sahayadhas","year":"2012","journal-title":"Sensors"},{"issue":"12","key":"2021051720034932400_B37","doi-asserted-by":"crossref","first-page":"2840","DOI":"10.1109\/TBME.2014.2331189","article-title":"In-flight automatic detection of vigilance states using a single EEG channel","volume":"61","author":"Sauvet","year":"2014","journal-title":"IEEE Transactions on Biomedical Engineering"},{"key":"2021051720034932400_B38","author":"lkopf","year":"2018","journal-title":"Learning with kernels: Support vector machines, regularization, optimization, and beyond"},{"issue":"5","key":"2021051720034932400_B39","doi-asserted-by":"crossref","DOI":"10.1038\/nn.2112","article-title":"Unconscious determinants of free decisions in the human brain","volume":"11","author":"Soon","year":"2008","journal-title":"Nature Neuroscience"},{"issue":"2","key":"2021051720034932400_B40","first-page":"1","article-title":"Fundamentals of EEG measurement","volume":"2","author":"Teplan","year":"2002","journal-title":"Measurement Science Review"},{"issue":"8","key":"2021051720034932400_B41","doi-asserted-by":"crossref","first-page":"1569","DOI":"10.1007\/s40279-016-0672-0","article-title":"The effects of mental fatigue on physical performance: A systematic review","volume":"47","author":"Van Cutsem","year":"2017","journal-title":"Sports Medicine"},{"issue":"1","key":"2021051720034932400_B42","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1145\/3147.3165","article-title":"Random sampling with a reservoir","volume":"11","author":"Vitter","year":"1985","journal-title":"ACM Transactions on Mathematical Software"},{"issue":"4","key":"2021051720034932400_B43","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1007\/s11571-018-9481-5","article-title":"A novel real-time driving fatigue detection system based on wireless dry EEG","volume":"12","author":"Wang","year":"2018","journal-title":"Cognitive Neurodynamics"},{"issue":"1","key":"2021051720034932400_B44","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1109\/TITS.2014.2330979","article-title":"Online prediction of driver distraction based on brain activity patterns","volume":"16","author":"Wang","year":"2015","journal-title":"IEEE Transactions on Intelligent Transportation Systems"},{"key":"2021051720034932400_B45","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1016\/j.neuroimage.2018.03.032","article-title":"A subject-transfer framework for obviating inter- and intra-subject variability in EEG-based drowsiness detection","volume":"174","author":"Wei","year":"2018","journal-title":"NeuroImage"},{"issue":"2","key":"2021051720034932400_B46","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1109\/TAU.1967.1161901","article-title":"The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms","volume":"15","author":"Welch","year":"1967","journal-title":"IEEE Transactions on Audio and Electroacoustics"},{"key":"2021051720034932400_B47","first-page":"267","article-title":"A Bayesian approximation method for online ranking","volume":"12","author":"Weng","year":"2011","journal-title":"Journal of Machine Learning Research"},{"issue":"3","key":"2021051720034932400_B48","doi-asserted-by":"crossref","first-page":"1087","DOI":"10.1214\/aos\/1176347257","article-title":"Very weak expansions for sequentially designed experiments, linear models","volume":"17","author":"Woodroofe","year":"1989","journal-title":"Annals of Statistics"},{"issue":"2","key":"2021051720034932400_B49","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1049\/htl.2017.0020","article-title":"Real-time eye tracking for the assessment of driver fatigue","volume":"5","author":"Xu","year":"2018","journal-title":"Healthcare Technology Letters"},{"key":"2021051720034932400_B50","first-page":"848","article-title":"Optimizing classifier performance via an approximation to the Wilcoxon-Mann-Whitney statistic","author":"Yan","year":"2003","journal-title":"Proceedings of the 20th International Conference on Machine Learning"},{"issue":"1","key":"2021051720034932400_B51","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0004257","article-title":"Bold correlates of trial-by-trial reaction time variability in gray and white matter: A multistudy FMRI analysis","volume":"4","author":"Yarkoni","year":"2009","journal-title":"PLOS One"},{"key":"2021051720034932400_B52","first-page":"275","article-title":"Learning to rank with ties","author":"Zhou","year":"2008","journal-title":"Proceedings of the 31stAnnualInternational ACM SIGIR Conference on Research and Development in Information Retrieval"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/neco\/article-pdf\/33\/6\/1616\/1916389\/neco_a_01382.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/neco\/article-pdf\/33\/6\/1616\/1916389\/neco_a_01382.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,17]],"date-time":"2021-05-17T20:05:01Z","timestamp":1621281901000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/33\/6\/1616\/98294\/Online-Mental-Fatigue-Monitoring-via-Indirect"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,13]]},"references-count":52,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,5,13]]},"published-print":{"date-parts":[[2021,5,13]]}},"URL":"https:\/\/doi.org\/10.1162\/neco_a_01382","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,6]]},"published":{"date-parts":[[2021,5,13]]}}}