{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T02:50:55Z","timestamp":1782355855410,"version":"3.54.5"},"reference-count":46,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2023,7,6]],"date-time":"2023-07-06T00:00:00Z","timestamp":1688601600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Bortnik innovation fund","award":["#23\u0413\u0423Ko\u0434\u0418\u0418C12-D7\/79179"],"award-info":[{"award-number":["#23\u0413\u0423Ko\u0434\u0418\u0418C12-D7\/79179"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Detection of fatigue is extremely important in the development of different kinds of preventive systems (such as driver monitoring or operator monitoring for accident prevention). The presence of fatigue for this task should be determined with physiological and objective behavioral indicators. To develop an effective model of fatigue detection, it is important to record a dataset with people in a state of fatigue as well as in a normal state. We carried out data collection using an eye tracker, a video camera, a stage camera, and a heart rate monitor to record a different kind of signal to analyze them. In our proposed dataset, 10 participants took part in the experiment and recorded data 3 times a day for 8 days. They performed different types of activity (choice reaction time, reading, correction test Landolt rings, playing Tetris), imitating everyday tasks. Our dataset is useful for studying fatigue and finding indicators of its manifestation. We have analyzed datasets that have public access to find the best for this task. Each of them contains data of eye movements and other types of data. We evaluated each of them to determine their suitability for fatigue studies, but none of them fully fit the fatigue detection task. We evaluated the recorded dataset by calculating the correspondences between eye-tracking data and CRT (choice reaction time) that show the presence of fatigue.<\/jats:p>","DOI":"10.3390\/s23136197","type":"journal-article","created":{"date-parts":[[2023,7,7]],"date-time":"2023-07-07T01:57:09Z","timestamp":1688695029000},"page":"6197","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["OperatorEYEVP: Operator Dataset for Fatigue Detection Based on Eye Movements, Heart Rate Data, and Video Information"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-1210-1231","authenticated-orcid":false,"given":"Svetlana","family":"Kovalenko","sequence":"first","affiliation":[{"name":"Institute of Cognitive Neuroscience, HSE University, Moscow 101000, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4541-7454","authenticated-orcid":false,"given":"Anton","family":"Mamonov","sequence":"additional","affiliation":[{"name":"Faculty of Physics and Mathematics and Natural Sciences, Peoples\u2019 Friendship University of Russia, Moscow 117198, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5671-4905","authenticated-orcid":false,"given":"Vladislav","family":"Kuznetsov","sequence":"additional","affiliation":[{"name":"Federal Research Center \u201cComputer Science and Control\u201d of Russian Academy of Sciences (FRC CSC RAS), Moscow 119333, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2071-2123","authenticated-orcid":false,"given":"Alexandr","family":"Bulygin","sequence":"additional","affiliation":[{"name":"St. Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), St. Petersburg 199178, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8113-1680","authenticated-orcid":false,"given":"Irina","family":"Shoshina","sequence":"additional","affiliation":[{"name":"Institute for Cognitive Research, Saint Petersburg State University, St. Petersburg 199034, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5146-0096","authenticated-orcid":false,"given":"Ivan","family":"Brak","sequence":"additional","affiliation":[{"name":"Faculty of Information Technologies, Novosibirsk State University, Novosibirsk 630090, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6503-1447","authenticated-orcid":false,"given":"Alexey","family":"Kashevnik","sequence":"additional","affiliation":[{"name":"St. Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), St. Petersburg 199178, Russia"},{"name":"Institute of Mathematics and Information Technologies, Petrozavodsk State University, Petrozavodsk 185910, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,6]]},"reference":[{"key":"ref_1","unstructured":"Statista (2023, April 27). India\u2014Reasons for Accidents Citied by Truck Drivers 2020. Available online: https:\/\/www.statista.com\/statistics\/1110224\/india-reasons-for-accidents-cited-by-truck-drivers\/."},{"key":"ref_2","unstructured":"Statista (2023, April 27). India\u2014Reasons for Over-Speeding by Truck Drivers 2020. Available online: https:\/\/www.statista.com\/statistics\/1110234\/india-reasons-for-over-speeding-by-truck-drivers\/."},{"key":"ref_3","unstructured":"Statista (2023, April 27). India\u2014Problems Faced by Truck Drivers during Trips 2020. Available online: https:\/\/www.statista.com\/statistics\/1110529\/india-problems-faced-by-truck-drivers-during-trips\/."},{"key":"ref_4","unstructured":"Statista (2023, April 27). Tiredness in Germany 2021. Available online: https:\/\/www.statista.com\/statistics\/1370961\/tiredness-germany\/."},{"key":"ref_5","unstructured":"Statista (2023, April 27). Prevalence of Driver Fatigue in the UK 2006\u20132013. Available online: https:\/\/www.statista.com\/statistics\/322656\/prevalence-of-driver-fatigue-in-the-united-kingdom-uk\/."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1177\/1557234X15573949","article-title":"The Case for Addressing Operator Fatigue","volume":"10","author":"Duffy","year":"2015","journal-title":"Rev. Hum. Factors Ergon."},{"key":"ref_7","unstructured":"Matthews, G., Desmond, P.A., Neubauer, C., and Hancock, P.A. (2012). The Handbook of Operator Fatigue, CRC Press."},{"key":"ref_8","unstructured":"(2018, January 16\u201319). IEEE Technology and Engineering Management Society; Thailand Chapter, IEEE Technology and Engineering Management Society; Singapore Chapter, IEEE Technology and Engineering Management Society; Hong Kong Chapter, and Institute of Electrical and Electronics Engineers. Proceedings of the IEEE IEEM2018: 2018 IEEE International Conference on Industrial Engineering & Engineering Management, Bangkok, Thailand."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Reason, J. (1990). Human Error, Cambridge University Press.","DOI":"10.1017\/CBO9781139062367"},{"key":"ref_10","unstructured":"Senders, J.W., Moray, N.P., and North Atlantic Treaty Organization (1991). Human Error: Cause, Prediction, and Reduction, Proceedings of the Conference on the Nature and Source of Human Error, 2nd, Bellagio, Italy, 5 September 1983, L. Erlbaum Associates. Available online: https:\/\/www.worldcat.org\/title\/22907154."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2539","DOI":"10.1038\/s41598-020-59251-5","article-title":"Gaze-in-wild: A dataset for studying eye and head coordination in everyday activities","volume":"10","author":"Kothari","year":"2019","journal-title":"Sci. Rep."},{"key":"ref_12","unstructured":"Palazzi, A., Abati, D., Calderara, S., Solera, F., and Cucchiara, R. (2017). Predicting the Driver\u2019s Focus of Attention: The DR(eye)VE Project. arXiv, Available online: http:\/\/arxiv.org\/abs\/1705.03854."},{"key":"ref_13","unstructured":"Kastrati, A., P\u0142omecka, M.B., Pascual, D., Wolf, L., Gillioz, V., Wattenhofer, R., and Langer, N. (2021). EEGEyeNet: A Simultaneous Electroencephalography and Eye-tracking Dataset and Benchmark for Eye Movement Prediction. arXiv, Available online: http:\/\/arxiv.org\/abs\/2111.05100."},{"key":"ref_14","unstructured":"(2023, April 26). EYE-EEG: Download Test Datasets. Available online: https:\/\/www.eyetracking-eeg.org\/testdata.html#exampledata2."},{"key":"ref_15","unstructured":"Jiang, L., Xu, M., Liu, T., Qiao, M., and Wang, Z. (2018, January 8\u201314). Predicting Video Saliency with Object-to-Motion CNN and Two-layer Convolutional LSTM. Proceedings of the 15th European Conference, Munich, Germany."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Tonsen, M., Zhang, X., Sugano, Y., and Bulling, A. (2016, January 14\u201317). Labelled pupils in the wild: A dataset for studying pupil detection in unconstrained environments. Proceedings of the ETRA\u201916: 2016 Symposium on Eye Tracking Research and Applications, Charleston, SC, USA.","DOI":"10.1145\/2857491.2857520"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hanhart, P., and Ebrahimi, T. (2014, January 18\u201320). EYEC3D: 3D video eye tracking dataset. Proceedings of the 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX), Singapore.","DOI":"10.1109\/QoMEX.2014.6982290"},{"key":"ref_18","unstructured":"Van Der Linde, I., Rajashekar, U., Bovik, A.C., and Cormack, L.K. (2023, June 30). DOVES: A Database of Visual Eye Movements. Available online: www.brill.nl\/sv."},{"key":"ref_19","unstructured":"Prieto, L.P., Sharma, K., Wen, Y., and Dillenbourg, P. (2015). The Burden of Facilitating Collaboration: Towards Estimation of Teacher Orchestration Load Using Eye-Tracking Measures, International Society of the Learning Sciences, Inc."},{"key":"ref_20","unstructured":"Sood, E., K\u00f6gel, F., Strohm, F., Dhar, P., and Bulling, A. (2023, June 30). VQA-MHUG: A Gaze Dataset to Study Multimodal Neural Attention in Visual Question Answering. Available online: https:\/\/visualqa.org\/download.html."},{"key":"ref_21","unstructured":"Bylinskii, Z., Borkin, M.A., Kim, N.W., Pfister, H., and Oliva, A. (2023, June 30). Eye Fixation Metrics for Large Scale Evaluation and Comparison of Information Visualizations. Available online: http:\/\/massvis.mit.edu."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"179002","DOI":"10.1109\/ACCESS.2019.2956840","article-title":"CrowdFix: An Eyetracking Dataset of Real Life Crowd Videos","volume":"7","author":"Tahira","year":"2019","journal-title":"IEEE Access"},{"key":"ref_23","unstructured":"Schell, C., Sieper, F., Schach, L., and Latoschik, M.E. (2023). Cschell\/Who-Is-Alyx: V2.0, Zenodo."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1038\/s41597-023-01932-7","article-title":"A Non-Laboratory Gait Dataset of Full Body Kinematics and Egocentric Vision","volume":"10","author":"Sharma","year":"2023","journal-title":"Sci. Data"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"38","DOI":"10.34014\/2227-1848-2019-3-38-51","article-title":"Visual-Motor Reactions as an Indicator of CNS Functional State","volume":"10","author":"Ignatova","year":"2019","journal-title":"Ulyanovsk. Med.-Biol. J."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"101216","DOI":"10.1016\/j.smrv.2019.101216","article-title":"Effects of fatigue on teams and their role in 24\/7 operations","volume":"48","author":"Banks","year":"2019","journal-title":"Sleep Med. Rev."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/0165-1781(89)90047-4","article-title":"The Pittsburgh Sleep Quality Index: A New Instrument for Psychiatric Practice and Research","volume":"28","author":"Buysse","year":"1989","journal-title":"Psychiatry Res."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1348\/1359107041557048","article-title":"Measuring fatigue in sarcoidosis: The Fatigue Assessment Scale (FAS)","volume":"9","author":"Michielsen","year":"2004","journal-title":"Br. J. Health Psychol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1134\/S0362119721050121","article-title":"Contrast Sensitivity of the Visual System and Cognitive Functions in Schizophrenia and Depression","volume":"47","author":"Shoshina","year":"2021","journal-title":"Hum. Physiol."},{"key":"ref_30","unstructured":"(2023, June 30). Beck\u2019s Depression Inventory. Available online: http:\/\/www.med.navy.mil\/sites\/NMCP2\/PatientServices\/."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1080\/00221309.1974.9920773","article-title":"Articulateness of the field and cognitive styles","volume":"91","author":"Gupta","year":"1974","journal-title":"J. Gen. Psychol."},{"key":"ref_32","unstructured":"Bragina, N.N., and Dobrohotova, T.A. (1988). Funkcional\u2019nye Asimmetrii Cheloveka. Sci. Am., 201 P."},{"key":"ref_33","unstructured":"Shoshina, I., and Shelepin, Y. (2023, May 24). Mekhanizmy Global\u2019nogo i Lokal\u2019nogo Analiza Zritel\u2019noj Informacii pri Shizofrenii. Available online: https:\/\/elibrary.ru\/item.asp?id=28850687."},{"key":"ref_34","unstructured":"(2023, May 24). Metodika \u00abFigury Gottshal\u2019dta\u00bb\u2014Psylab.Info. Available online: https:\/\/psylab.info\/%D0%9C%D0%B5%D1%82%D0%BE%D0%B4%D0%B8%D0%BA%D0%B0_%C2%AB%D0%A4%D0%B8%D0%B3%D1%83%D1%80%D1%8B_%D0%93%D0%BE%D1%82%D1%82%D1%88%D0%B0%D0%BB%D1%8C%D0%B4%D1%82%D0%B0%C2%BB."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"7","DOI":"10.17691\/stm2019.11.4.01","article-title":"Two visual systems and their eye movements: A fixation-based event-related experiment with ultrafast fMRI reconciles competing views","volume":"11","author":"Velichkovsky","year":"2019","journal-title":"Sovrem. Tehnol. Med."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1037\/h0075694","article-title":"Ocular dominance demonstrated by unconscious sighting","volume":"12","author":"Miles","year":"1929","journal-title":"J. Exp. Psychol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1016\/0165-1781(91)90027-M","article-title":"Validity and Reliability of a Scale to Assess Fatigue","volume":"36","author":"Lee","year":"1991","journal-title":"Psychiatry Res."},{"key":"ref_38","first-page":"213","article-title":"Methode Optometrique Simple","volume":"6","author":"Landolt","year":"1888","journal-title":"Bull. Mem. Soc. Fr. Ophtalmol."},{"key":"ref_39","unstructured":"Tetris (2023, June 15). About Tetris\u00ae. Available online: https:\/\/tetris.com\/about-us."},{"key":"ref_40","unstructured":"Pupil Labs (2023, May 22). Pupil Player. Available online: https:\/\/docs.pupil-labs.com\/core\/software\/pupil-player\/#gaze-positions-csv."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1016\/j.cmpb.2013.07.024","article-title":"Kubios HRV\u2013Heart rate variability analysis software","volume":"113","author":"Tarvainen","year":"2014","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Kashevnik, A., Kruglov, M., Lashkov, I., Teslya, N., Mikhailova, P., Ripachev, E., Malutin, V., Saveliev, N., and Ryabchikov, I. (2020). Human Psychophysiological Activity Estimation Based on Smartphone Camera and Wearable Electronics. Future Internet, 12.","DOI":"10.3390\/fi12070111"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Othman, W., and Kashevnik, A. (2022, January 24\u201326). Video-Based Real-Time Heart Rate Detection for Drivers Inside the Cabin Using a Smartphone. Proceedings of the 2022 IEEE International Conference on Internet of Things and Intelligence Systems, IoTaIS 2022, Bali, Indonesia.","DOI":"10.1109\/IoTaIS56727.2022.9975941"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Hamoud, B., Kashevnik, A., Othman, W., and Shilov, N. (2023). Neural Network Model Combination for Video-Based Blood Pressure Estimation: New Approach and Evaluation. Sensors, 23.","DOI":"10.3390\/s23041753"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Hamoud, B., Othman, W., Shilov, N., and Kashevnik, A. (2023, January 24\u201326). Contactless Oxygen Saturation Detection Based on Face Analysis. Proceedings of the 2023 33rd Conference of Open Innovations Association (FRUCT), Zilina, Slovakia.","DOI":"10.23919\/FRUCT58615.2023.10143059"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Hasan, F., and Kashevnik, A. (2021, January 12\u201314). State-of-the-Art Analysis of Modern Drowsiness Detection Algorithms Based on Computer Vision. Proceedings of the 2021 29th Conference of Open Innovations Association (FRUCT), Tampere, Finland.","DOI":"10.23919\/FRUCT52173.2021.9435480"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/13\/6197\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:07:26Z","timestamp":1760126846000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/13\/6197"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,6]]},"references-count":46,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2023,7]]}},"alternative-id":["s23136197"],"URL":"https:\/\/doi.org\/10.3390\/s23136197","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,6]]}}}