{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T17:55:46Z","timestamp":1776102946283,"version":"3.50.1"},"reference-count":57,"publisher":"SAGE Publications","issue":"5","license":[{"start":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T00:00:00Z","timestamp":1727308800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["P30CA016056"],"award-info":[{"award-number":["P30CA016056"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["3R01EB029398-03S1"],"award-info":[{"award-number":["3R01EB029398-03S1"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000070","name":"National Institute of Biomedical Imaging and Bioengineering","doi-asserted-by":"publisher","award":["R01EB029398"],"award-info":[{"award-number":["R01EB029398"]}],"id":[{"id":"10.13039\/100000070","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Hum Factors"],"published-print":{"date-parts":[[2025,5]]},"abstract":"<jats:sec>\n            <jats:title>Objective<\/jats:title>\n            <jats:p>We aimed to develop advanced machine learning models using electroencephalogram (EEG) and eye-tracking data to predict the mental workload associated with engaging in various surgical tasks.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>Traditional methods of evaluating mental workload often involve self-report scales, which are subject to individual biases. Due to the multidimensional nature of mental workload, there is a pressing need to identify factors that contribute to mental workload across different surgical tasks.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Method<\/jats:title>\n            <jats:p>EEG and eye-tracking data from 26 participants performing Matchboard and Ring Walk tasks from the da Vinci simulator and the pattern cut and suturing tasks from the Fundamentals of Laparoscopic Surgery (FLS) program were used to develop an eXtreme Gradient Boosting (XGBoost) model for mental workload evaluation.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>\n              The developed XGBoost models demonstrated strong predictive performance with\n              <jats:italic>R<\/jats:italic>\n              <jats:sup>2<\/jats:sup>\n              values of 0.82, 0.81, 0.82, and 0.83 for the Matchboard, Ring Walk, pattern cut, and suturing tasks, respectively. Key features for predicting mental workload included task average pupil diameter, complexity level, average functional connectivity strength at the temporal lobe, and the total trajectory length of the nondominant eye\u2019s pupil. Integrating features from both EEG and eye-tracking data significantly enhanced the performance of mental workload evaluation models, as evidenced by repeated-measures t-tests yielding\n              <jats:italic>p<\/jats:italic>\n              -values less than 0.05. However, this enhancement was not observed in the Pattern Cut task (repeated-measures t-tests;\n              <jats:italic>p<\/jats:italic>\n              &gt; 0.05).\n            <\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>The findings underscore the potential for machine learning and multidimensional feature integration to predict mental workload and thereby improve task design and surgical training.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Application<\/jats:title>\n            <jats:p>The advanced mental workload prediction models could serve as instrumental tools to enhance our understanding of surgeons\u2019 cognitive demands and significantly improve the effectiveness of surgical training programs.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1177\/00187208241285513","type":"journal-article","created":{"date-parts":[[2024,9,27]],"date-time":"2024-09-27T04:16:49Z","timestamp":1727410609000},"page":"464-484","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":7,"title":["An Integrated Electroencephalography and Eye-Tracking Analysis Using eXtreme Gradient Boosting for Mental Workload Evaluation in Surgery"],"prefix":"10.1177","volume":"67","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9256-6284","authenticated-orcid":false,"given":"Somayeh B.","family":"Shafiei","sequence":"first","affiliation":[{"name":"Roswell Park Comprehensive Cancer Center, USA"}]},{"given":"Saeed","family":"Shadpour","sequence":"additional","affiliation":[{"name":"University of Guelph, Canada"}]},{"given":"James L.","family":"Mohler","sequence":"additional","affiliation":[{"name":"Roswell Park Comprehensive Cancer Center, USA"}]}],"member":"179","published-online":{"date-parts":[[2024,9,26]]},"reference":[{"key":"e_1_3_4_2_1","doi-asserted-by":"publisher","DOI":"10.1038\/nn.4502"},{"key":"e_1_3_4_3_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1018985108"},{"key":"e_1_3_4_4_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1003171"},{"key":"e_1_3_4_5_1","doi-asserted-by":"publisher","DOI":"10.1038\/nn.3993"},{"key":"e_1_3_4_6_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.91.2.276"},{"key":"e_1_3_4_7_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-017-00425-z"},{"key":"e_1_3_4_8_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1422487112"},{"key":"e_1_3_4_9_1","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2560\/9\/4\/045008"},{"key":"e_1_3_4_10_1","doi-asserted-by":"crossref","unstructured":"Chen T. Guestrin C. (2015). Xgboost: Reliable large-scale tree boosting system. Proceedings of the 22nd SIGKDD Conference on Knowledge Discovery and Data Mining San Francisco CA USA 13\u201317 August 2016.","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_3_4_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_3_4_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2014.05.014"},{"key":"e_1_3_4_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00464-016-4851-8"},{"key":"e_1_3_4_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2011.09.023"},{"key":"e_1_3_4_15_1","doi-asserted-by":"publisher","DOI":"10.1161\/01.CIR.101.23.e215"},{"key":"e_1_3_4_16_1","doi-asserted-by":"publisher","DOI":"10.1177\/154193120605000909"},{"key":"e_1_3_4_17_1","doi-asserted-by":"publisher","DOI":"10.1097\/SLA.0000000000002863"},{"key":"e_1_3_4_18_1","unstructured":"Jutla I. S. Jeub L. G. Mucha P. J. (2011). A generalized Louvain method for community detection implemented in MATLAB. https:\/\/netwiki.amath.unc.edu\/GenLouvain"},{"key":"e_1_3_4_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2015.06.001"},{"key":"e_1_3_4_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3582272"},{"issue":"4","key":"e_1_3_4_21_1","first-page":"279","article-title":"Cautionary note about R 2","volume":"39","author":"Kv\u00e5lseth T. O.","year":"1985","unstructured":"Kv\u00e5lseth T. O. (1985). Cautionary note about R 2. The American Statistician, 39(4), 279\u2013285. https:\/\/doi.org\/10.2307\/2683704","journal-title":"The American Statistician"},{"key":"e_1_3_4_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compenvurbsys.2022.101845"},{"key":"e_1_3_4_23_1","volume-title":"An introduction to the event-related potential technique","author":"Luck S. J.","year":"2014","unstructured":"Luck S. J. (2014). An introduction to the event-related potential technique. MIT Press."},{"key":"e_1_3_4_24_1","first-page":"4768","volume-title":"A unified approach to interpreting model predictions","author":"Lundberg S. M.","year":"2017","unstructured":"Lundberg S. M., Su-In Lee S.-I. (2017). A unified approach to interpreting model predictions. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS'17). Curran Associates Inc., Red Hook, NY, USA, 4768\u20134777."},{"key":"e_1_3_4_25_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42254-019-0040-8"},{"key":"e_1_3_4_26_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1004533"},{"key":"e_1_3_4_27_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2013.00889"},{"key":"e_1_3_4_28_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.24.1.167"},{"key":"e_1_3_4_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00464-002-9224-9"},{"key":"e_1_3_4_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2003.12.011"},{"key":"e_1_3_4_31_1","doi-asserted-by":"publisher","DOI":"10.1055\/s-0035-1555115"},{"key":"e_1_3_4_32_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0400054101"},{"key":"e_1_3_4_33_1","doi-asserted-by":"publisher","DOI":"10.1097\/SLA.0b013e3181e464fb"},{"key":"e_1_3_4_34_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2022.806330"},{"key":"e_1_3_4_35_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.72.046117"},{"key":"e_1_3_4_36_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2753.2006.00712.x"},{"key":"e_1_3_4_37_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41514-023-00119-z"},{"key":"e_1_3_4_38_1","article-title":"Integration of Electroencephalogram and Eye-Gaze Datasets for Performance Evaluation in Fundamentals of Laparoscopic Surgery (FLS) tasks","author":"Shafiei S. B.","year":"2023","unstructured":"Shafiei S. B., Shadpour S. (2023). Integration of Electroencephalogram and Eye-Gaze Datasets for Performance Evaluation in Fundamentals of Laparoscopic Surgery (FLS) tasks. PhysioNet. https:\/\/doi.org\/10.13026\/kyjw-p786","journal-title":"PhysioNet"},{"key":"e_1_3_4_39_1","article-title":"Electroencephalogram and eye-gaze datasets for robot-assisted surgery performance evaluation (version 1.0.0)","author":"Shafiei S. B.","year":"2023","unstructured":"Shafiei S. B., Shadpour S., Mohler J., Toussi M. S., Doherty P., Jing Z. (2023). Electroencephalogram and eye-gaze datasets for robot-assisted surgery performance evaluation (version 1.0.0). Physionet. https:\/\/doi.org\/10.13026\/qj5m-n649","journal-title":"Physionet"},{"key":"e_1_3_4_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00464-023-10409-y"},{"key":"e_1_3_4_41_1","doi-asserted-by":"publisher","DOI":"10.1097\/AS9.0000000000000292"},{"key":"e_1_3_4_42_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41539-024-00216-y"},{"key":"e_1_3_4_43_1","doi-asserted-by":"publisher","DOI":"10.1209\/epl\/i2004-10422-0"},{"key":"e_1_3_4_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2012.11.015"},{"key":"e_1_3_4_45_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1896849"},{"key":"e_1_3_4_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2007.06.026"},{"key":"e_1_3_4_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00062-009-9002-3"},{"key":"e_1_3_4_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2014.04.032"},{"key":"e_1_3_4_49_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.94.238701"},{"key":"e_1_3_4_50_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2017.00167"},{"key":"e_1_3_4_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2016.03.001"},{"key":"e_1_3_4_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00464-015-4239-1"},{"key":"e_1_3_4_53_1","doi-asserted-by":"publisher","DOI":"10.1518\/001872008X288394"},{"key":"e_1_3_4_54_1","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.45.4.635.27088"},{"key":"e_1_3_4_55_1","doi-asserted-by":"publisher","DOI":"10.1080\/026783700417249"},{"key":"e_1_3_4_56_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jopan.2008.01.008"},{"key":"e_1_3_4_57_1","doi-asserted-by":"publisher","DOI":"10.1097\/SIH.0b013e3181e3f329"},{"key":"e_1_3_4_58_1","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/ac6294"}],"container-title":["Human Factors: The Journal of the Human Factors and Ergonomics Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/00187208241285513","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/00187208241285513","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/00187208241285513","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,26]],"date-time":"2025-05-26T04:28:01Z","timestamp":1748233681000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/00187208241285513"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,26]]},"references-count":57,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,5]]}},"alternative-id":["10.1177\/00187208241285513"],"URL":"https:\/\/doi.org\/10.1177\/00187208241285513","relation":{},"ISSN":["0018-7208","1547-8181"],"issn-type":[{"value":"0018-7208","type":"print"},{"value":"1547-8181","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,26]]}}}