{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,9]],"date-time":"2026-02-09T14:34:48Z","timestamp":1770647688901,"version":"3.49.0"},"reference-count":70,"publisher":"Public Library of Science (PLoS)","issue":"3","license":[{"start":{"date-parts":[[2024,3,7]],"date-time":"2024-03-07T00:00:00Z","timestamp":1709769600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["project BASE (POCI - 01-0145 - FEDER- 031581)"],"award-info":[{"award-number":["project BASE (POCI - 01-0145 - FEDER- 031581)"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["Ph.D. grant 2020.07906.BD"],"award-info":[{"award-number":["Ph.D. grant 2020.07906.BD"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>Cognitive human error and recent cognitive taxonomy on human error causes of software defects support the intuitive idea that, for instance, mental overload, attention slips, and working memory overload are important human causes for software bugs. In this paper, we approach the EEG as a reliable surrogate to MRI-based reference of the programmer\u2019s cognitive state to be used in situations where heavy imaging techniques are infeasible. The idea is to use EEG biomarkers to validate other less intrusive physiological measures, that can be easily recorded by wearable devices and useful in the assessment of the developer\u2019s cognitive state during software development tasks. Herein, our EEG study, with the support of fMRI, presents an extensive and systematic analysis by inspecting metrics and extracting relevant information about the most robust features, best EEG channels and the best hemodynamic time delay in the context of software development tasks. From the EEG-fMRI similarity analysis performed, we found significant correlations between a subset of EEG features and the Insula region of the brain, which has been reported as a region highly related to high cognitive tasks, such as software development tasks. We concluded that despite a clear inter-subject variability of the best EEG features and hemodynamic time delay used, the most robust and predominant EEG features, across all the subjects, are related to the Hjorth parameter Activity and Total Power features, from the EEG channels F4, FC4 and C4, and considering in most of the cases a hemodynamic time delay of 4 seconds used on the hemodynamic response function. These findings should be taken into account in future EEG-fMRI studies in the context of software debugging.<\/jats:p>","DOI":"10.1371\/journal.pone.0299108","type":"journal-article","created":{"date-parts":[[2024,3,7]],"date-time":"2024-03-07T18:43:42Z","timestamp":1709837022000},"page":"e0299108","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":8,"title":["EEG as a potential ground truth for the assessment of cognitive state in software development activities: A multimodal imaging study"],"prefix":"10.1371","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2852-6285","authenticated-orcid":true,"given":"J\u00falio","family":"Medeiros","sequence":"first","affiliation":[]},{"given":"Marco","family":"Sim\u00f5es","sequence":"additional","affiliation":[]},{"given":"Jo\u00e3o","family":"Castelhano","sequence":"additional","affiliation":[]},{"given":"Rodolfo","family":"Abreu","sequence":"additional","affiliation":[]},{"given":"Ricardo","family":"Couceiro","sequence":"additional","affiliation":[]},{"given":"Jorge","family":"Henriques","sequence":"additional","affiliation":[]},{"given":"Miguel","family":"Castelo-Branco","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8146-4664","authenticated-orcid":true,"given":"Henrique","family":"Madeira","sequence":"additional","affiliation":[]},{"given":"C\u00e9sar","family":"Teixeira","sequence":"additional","affiliation":[]},{"given":"Paulo","family":"de Carvalho","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2024,3,7]]},"reference":[{"key":"pone.0299108.ref001","volume-title":"Code Complete: A Practical Handbook of Software Construction","author":"SC McConnell","year":"2004"},{"key":"pone.0299108.ref002","doi-asserted-by":"crossref","unstructured":"Shah SMA, Morisio M, Torchiano M. The impact of process maturity on defect density. In: Proceedings of the 2012 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement. IEEE; 2012. p. 315\u2013318.","DOI":"10.1145\/2372251.2372308"},{"issue":"5","key":"pone.0299108.ref003","first-page":"9","article-title":"Achieving CMMI Level 5 improvements with MBASE and the CeBASE method","volume":"15","author":"B Boehm","year":"2002","journal-title":"CrossTalk"},{"key":"pone.0299108.ref004","article-title":"Empirical Analysis for High Quality SW Development","author":"N Honda","year":"2012","journal-title":"Ameri Jour Op Research"},{"key":"pone.0299108.ref005","doi-asserted-by":"crossref","unstructured":"Zhang H. An investigation of the relationships between lines of code and defects. In: 2009 IEEE International Conference on Software Maintenance. IEEE; 2009. p. 274\u2013283.","DOI":"10.1109\/ICSM.2009.5306304"},{"key":"pone.0299108.ref006","unstructured":"Azevedo R. What is the cost of a bug?; 2018. https:\/\/azevedorafaela.com\/2018\/04\/27\/what-is-the-cost-of-a-bug\/."},{"key":"pone.0299108.ref007","doi-asserted-by":"crossref","unstructured":"Wohlin C. Is there a future for empirical software engineering? In: Proceedings of the 10th ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement; 2016. p. 1\u20131.","DOI":"10.1145\/2961111.2962641"},{"issue":"12","key":"pone.0299108.ref008","doi-asserted-by":"crossref","first-page":"1537","DOI":"10.1016\/j.infsof.2014.07.006","article-title":"Human factors in software development: On its underlying theories and the value of learning from related disciplines. A guest editorial introduction to the special issue","volume":"56","author":"CA Amrit","year":"2014","journal-title":"Information and software technology"},{"key":"pone.0299108.ref009","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139062367","volume-title":"Human error","author":"J Reason","year":"1990"},{"key":"pone.0299108.ref010","unstructured":"Huang F, Liu B, Huang B. A taxonomy system to identify human error causes for software defects. In: The 18th international conference on reliability and quality in design; 2012. p. 44\u201349."},{"key":"pone.0299108.ref011","first-page":"19","volume-title":"Theory and Application on Cognitive Factors and Risk Management: New Trends and Procedures","author":"F Huang","year":"2017"},{"issue":"5","key":"pone.0299108.ref012","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1080\/001401398186829","article-title":"Physiological workload reactions to increasing levels of task difficulty","volume":"41","author":"J Veltman","year":"1998","journal-title":"Ergonomics"},{"issue":"6","key":"pone.0299108.ref013","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1111\/j.1469-8986.1976.tb00882.x","article-title":"Heart rate and respiratory responses as a function of task difficulty: The use of discriminant analysis in the selection of psychologically sensitive physiological responses","volume":"13","author":"GF Walter","year":"1976","journal-title":"Psychophysiology"},{"key":"pone.0299108.ref014","doi-asserted-by":"crossref","unstructured":"Pfleging B, Fekety DK, Schmidt A, Kun AL. A model relating pupil diameter to mental workload and lighting conditions. In: Proceedings of the 2016 CHI conference on human factors in computing systems; 2016. p. 5776\u20135788.","DOI":"10.1145\/2858036.2858117"},{"key":"pone.0299108.ref015","doi-asserted-by":"crossref","unstructured":"Parnin C. Subvocalization-toward hearing the inner thoughts of developers. In: 2011 IEEE 19th International Conference on Program Comprehension. IEEE; 2011. p. 197\u2013200.","DOI":"10.1109\/ICPC.2011.49"},{"key":"pone.0299108.ref016","doi-asserted-by":"crossref","unstructured":"Fritz T, Begel A, M\u00fcller SC, Yigit-Elliott S, Z\u00fcger M. Using psycho-physiological measures to assess task difficulty in software development. In: Proceedings of the 36th international conference on software engineering. ACM; 2014. p. 402\u2013413.","DOI":"10.1145\/2568225.2568266"},{"key":"pone.0299108.ref017","doi-asserted-by":"crossref","unstructured":"M\u00fcller SC, Fritz T. Using (bio) metrics to predict code quality online. In: 2016 IEEE\/ACM 38th International Conference on Software Engineering (ICSE). IEEE; 2016. p. 452\u2013463.","DOI":"10.1145\/2884781.2884803"},{"key":"pone.0299108.ref018","doi-asserted-by":"crossref","unstructured":"Couceiro R, Duarte G, Dur\u00e3es J, Castelhano J, Duarte C, Teixeira C, et al. Biofeedback augmented software engineering: monitoring of programmers\u2019 mental effort. In: 2019 IEEE\/ACM 41st International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER). IEEE; 2019. p. 37\u201340.","DOI":"10.1109\/ICSE-NIER.2019.00018"},{"key":"pone.0299108.ref019","doi-asserted-by":"crossref","unstructured":"Couceiro R, Duarte G, Dur\u00e3es J, Castelhano J, Duarte C, Teixeira C, et al. Pupillography as indicator of programmers\u2019 mental effort and cognitive overload. In: 2019 49th Annual IEEE\/IFIP International Conference on Dependable Systems and Networks (DSN). IEEE; 2019. p. 638\u2013644.","DOI":"10.1109\/DSN.2019.00069"},{"key":"pone.0299108.ref020","doi-asserted-by":"crossref","unstructured":"Couceiro R, Barbosa R, Dur\u00e3es J, Duarte G, Castelhano J, Duarte C, et al. Spotting Problematic Code Lines using Nonintrusive Programmers\u2019 Biofeedback. In: 2019 IEEE 30th International Symposium on Software Reliability Engineering (ISSRE). IEEE; 2019. p. 93\u2013103.","DOI":"10.1109\/ISSRE.2019.00019"},{"key":"pone.0299108.ref021","doi-asserted-by":"crossref","unstructured":"Gon\u00e7ales L, Farias K, Silva Bd, Fessler J. Measuring the cognitive load of software developers: a systematic mapping study. In: Proceedings of the 27th International Conference on Program Comprehension. IEEE Press; 2019. p. 42\u201352.","DOI":"10.1109\/ICPC.2019.00018"},{"key":"pone.0299108.ref022","doi-asserted-by":"crossref","unstructured":"Crk I, Kluthe T. Toward using alpha and theta brain waves to quantify programmer expertise. In: 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE; 2014. p. 5373\u20135376.","DOI":"10.1109\/EMBC.2014.6944840"},{"key":"pone.0299108.ref023","doi-asserted-by":"crossref","unstructured":"Lee S, Matteson A, Hooshyar D, Kim S, Jung J, Nam G, et al. Comparing programming language comprehension between novice and expert programmers using eeg analysis. In: 2016 IEEE 16th International Conference on Bioinformatics and Bioengineering (BIBE). IEEE; 2016. p. 350\u2013355.","DOI":"10.1109\/BIBE.2016.30"},{"issue":"1","key":"pone.0299108.ref024","doi-asserted-by":"crossref","first-page":"1097","DOI":"10.1007\/s10586-017-0746-2","article-title":"Mining biometric data to predict programmer expertise and task difficulty","volume":"21","author":"S Lee","year":"2018","journal-title":"Cluster Computing"},{"key":"pone.0299108.ref025","doi-asserted-by":"crossref","unstructured":"Yeh MKC, Gopstein D, Yan Y, Zhuang Y. Detecting and comparing brain activity in short program comprehension using EEG. In: 2017 IEEE Frontiers in Education Conference (FIE). IEEE; 2017. p. 1\u20135.","DOI":"10.1109\/FIE.2017.8190486"},{"key":"pone.0299108.ref026","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.ijhcs.2018.03.002","article-title":"Towards an affordable brain computer interface for the assessment of programmers\u2019 mental workload","volume":"115","author":"MV Kosti","year":"2018","journal-title":"International Journal of Human-Computer Studies"},{"key":"pone.0299108.ref027","doi-asserted-by":"crossref","unstructured":"Medeiros J, Couceiro R, Castelhano J, Branco MC, Duarte G, Duarte C, et al. Software code complexity assessment using EEG features. In: 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE; 2019. p. 1413\u20131416.","DOI":"10.1109\/EMBC.2019.8856283"},{"key":"pone.0299108.ref028","article-title":"Quality Evaluation of Modern Code Reviews Through Intelligent Biometric Program Comprehension","author":"H Hijazi","year":"2022","journal-title":"IEEE Transactions on Software Engineering"},{"issue":"7","key":"pone.0299108.ref029","doi-asserted-by":"crossref","first-page":"2338","DOI":"10.3390\/s21072338","article-title":"Can EEG Be Adopted as a Neuroscience Reference for Assessing Software Programmers\u2019 Cognitive Load?","volume":"21","author":"J Medeiros","year":"2021","journal-title":"Sensors"},{"key":"pone.0299108.ref030","doi-asserted-by":"crossref","unstructured":"Peitek N, Bergum A, Rekrut M, Mucke J, Nadig M, Parnin C, et al. Correlates of programmer efficacy and their link to experience: A combined EEG and eye-tracking study. In: Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering; 2022. p. 120\u2013131.","DOI":"10.1145\/3540250.3549084"},{"key":"pone.0299108.ref031","doi-asserted-by":"crossref","first-page":"1065366","DOI":"10.3389\/fnins.2022.1065366","article-title":"On the accuracy of code complexity metrics: A neuroscience-based guideline for improvement","volume":"16","author":"G Hao","year":"2023","journal-title":"Frontiers in Neuroscience"},{"key":"pone.0299108.ref032","article-title":"Role of the EEG theta network during software production: a connectivity study","author":"A Calcagno","year":"2023","journal-title":"IEEE Transactions on Neural Systems and Rehabilitation Engineering"},{"key":"pone.0299108.ref033","doi-asserted-by":"crossref","unstructured":"Siegmund J, K\u00e4stner C, Apel S, Parnin C, Bethmann A, Leich T, et al. Understanding understanding source code with functional magnetic resonance imaging. In: Proceedings of the 36th International Conference on Software Engineering. ACM; 2014. p. 378\u2013389.","DOI":"10.1145\/2568225.2568252"},{"key":"pone.0299108.ref034","doi-asserted-by":"crossref","unstructured":"Floyd B, Santander T, Weimer W. Decoding the representation of code in the brain: An fMRI study of code review and expertise. In: 2017 IEEE\/ACM 39th International Conference on Software Engineering (ICSE). IEEE; 2017. p. 175\u2013186.","DOI":"10.1109\/ICSE.2017.24"},{"key":"pone.0299108.ref035","doi-asserted-by":"crossref","unstructured":"Siegmund J, Peitek N, Parnin C, Apel S, Hofmeister J, K\u00e4stner C, et al. Measuring neural efficiency of program comprehension. In: Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering. ACM; 2017. p. 140\u2013150.","DOI":"10.1145\/3106237.3106268"},{"key":"pone.0299108.ref036","article-title":"A Look into Programmers\u2019 Heads","author":"N Peitek","year":"2018","journal-title":"IEEE Transactions on Software Engineering"},{"key":"pone.0299108.ref037","doi-asserted-by":"crossref","unstructured":"Peitek N, Siegmund J, Parnin C, Apel S, Hofmeister JC, Brechmann A. Simultaneous measurement of program comprehension with fMRI and eye tracking: a case study. In: Proceedings of the 12th ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement; 2018. p. 1\u201310.","DOI":"10.1145\/3239235.3240495"},{"key":"pone.0299108.ref038","doi-asserted-by":"crossref","unstructured":"Peitek N, Siegmund J, Parnin C, Apel S, Brechmann A. Toward conjoint analysis of simultaneous eye-tracking and fMRI data for program-comprehension studies. In: Proceedings of the Workshop on Eye Movements in Programming; 2018. p. 1\u20135.","DOI":"10.1145\/3216723.3216725"},{"issue":"3","key":"pone.0299108.ref039","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1007\/s11682-018-9885-1","article-title":"The role of the insula in intuitive expert bug detection in computer code: an fMRI study","volume":"13","author":"J Castelhano","year":"2019","journal-title":"Brain imaging and behavior"},{"key":"pone.0299108.ref040","doi-asserted-by":"crossref","unstructured":"Krueger R, Huang Y, Liu X, Santander T, Weimer W, Leach K. Neurological Divide: An fMRI Study of Prose and Code Writing. In: 2020 IEEE\/ACM 42nd International Conference on Software Engineering (ICSE). vol. 13; 2020.","DOI":"10.1145\/3377811.3380348"},{"key":"pone.0299108.ref041","doi-asserted-by":"crossref","unstructured":"Nakagawa T, Kamei Y, Uwano H, Monden A, Matsumoto K, German DM. Quantifying programmers\u2019 mental workload during program comprehension based on cerebral blood flow measurement: a controlled experiment. In: Companion Proceedings of the 36th International Conference on Software Engineering. ACM; 2014. p. 448\u2013451.","DOI":"10.1145\/2591062.2591098"},{"key":"pone.0299108.ref042","doi-asserted-by":"crossref","unstructured":"Ikutani Y, Uwano H. Brain activity measurement during program comprehension with NIRS. In: 15th IEEE\/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel\/Distributed Computing (SNPD). IEEE; 2014. p. 1\u20136.","DOI":"10.1109\/SNPD.2014.6888727"},{"key":"pone.0299108.ref043","article-title":"Software Bug Detection Causes a Shift From Bottom-Up to Top-Down Effective Connectivity Involving the Insula Within the Error-Monitoring Network","author":"J Castelhano","year":"2022","journal-title":"Frontiers in Human Neuroscience"},{"key":"pone.0299108.ref044","article-title":"How much of the BOLD-fMRI signal can be approximated from simultaneous EEG data: relevance for the transfer and dissemination of neurofeedback interventions","author":"M Simoes","year":"2020","journal-title":"Journal of Neural Engineering"},{"key":"pone.0299108.ref045","doi-asserted-by":"crossref","first-page":"29","DOI":"10.3389\/fnhum.2018.00029","article-title":"EEG-informed fMRI: a review of data analysis methods","volume":"12","author":"R Abreu","year":"2018","journal-title":"Frontiers in human neuroscience"},{"key":"pone.0299108.ref046","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1016\/j.neuroimage.2018.02.061","article-title":"Characterization of the hemodynamic response function across the majority of human cerebral cortex","volume":"173","author":"AJ Taylor","year":"2018","journal-title":"Neuroimage"},{"issue":"43","key":"pone.0299108.ref047","doi-asserted-by":"crossref","first-page":"E10206","DOI":"10.1073\/pnas.1804340115","article-title":"The brain\u2019s hemodynamic response function rapidly changes under acute psychosocial stress in association with genetic and endocrine stress response markers","volume":"115","author":"IG Elbau","year":"2018","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pone.0299108.ref048","first-page":"139","volume-title":"Advances in psychology","author":"SG Hart","year":"1988"},{"issue":"11","key":"pone.0299108.ref049","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1109\/TSE.2006.113","article-title":"Emulation of software faults: A field data study and a practical approach","volume":"32","author":"JA Duraes","year":"2006","journal-title":"Ieee transactions on software engineering"},{"key":"pone.0299108.ref050","doi-asserted-by":"crossref","unstructured":"Cotroneo D, De Simone L, Liguori P, Natella R, Bidokhti N. How bad can a bug get? an empirical analysis of software failures in the OpenStack cloud computing platform. In: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering; 2019. p. 200\u2013211.","DOI":"10.1145\/3338906.3338916"},{"issue":"11","key":"pone.0299108.ref051","doi-asserted-by":"crossref","first-page":"943","DOI":"10.1109\/32.177364","article-title":"Orthogonal defect classification-a concept for in-process measurements","volume":"18","author":"R Chillarege","year":"1992","journal-title":"IEEE Transactions on software Engineering"},{"issue":"1","key":"pone.0299108.ref052","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.jneumeth.2003.10.009","article-title":"EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis","volume":"134","author":"A Delorme","year":"2004","journal-title":"Journal of neuroscience methods"},{"issue":"3","key":"pone.0299108.ref053","doi-asserted-by":"crossref","first-page":"720","DOI":"10.1016\/j.neuroimage.2005.06.067","article-title":"Removal of FMRI environment artifacts from EEG data using optimal basis sets","volume":"28","author":"RK Niazy","year":"2005","journal-title":"Neuroimage"},{"issue":"3","key":"pone.0299108.ref054","doi-asserted-by":"crossref","first-page":"708","DOI":"10.1016\/j.neuroimage.2005.06.060","article-title":"Simultaneous recording of laser-evoked brain potentials and continuous, high-field functional magnetic resonance imaging in humans","volume":"28","author":"GD Iannetti","year":"2005","journal-title":"Neuroimage"},{"key":"pone.0299108.ref055","volume-title":"Volume 16: how to detect and handle outliers","author":"B Iglewicz","year":"1993"},{"key":"pone.0299108.ref056","article-title":"Understanding robust and exploratory data anlysis","author":"DC Hoaglin","year":"1983","journal-title":"Wiley series in probability and mathematical statistics"},{"issue":"2","key":"pone.0299108.ref057","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/0013-4694(89)90180-6","article-title":"Spherical splines for scalp potential and current density mapping","volume":"72","author":"F Perrin","year":"1989","journal-title":"Electroencephalography and clinical neurophysiology"},{"key":"pone.0299108.ref058","doi-asserted-by":"crossref","first-page":"87","DOI":"10.7551\/mitpress\/9609.001.0001","volume-title":"Analyzing neural time series data: theory and practice","author":"MX Cohen","year":"2014"},{"issue":"2","key":"pone.0299108.ref059","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1162\/089976699300016719","article-title":"Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources","volume":"11","author":"TW Lee","year":"1999","journal-title":"Neural computation"},{"key":"pone.0299108.ref060","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/j.neuroimage.2019.05.026","article-title":"ICLabel: An automated electroencephalographic independent component classifier, dataset, and website","volume":"198","author":"L Pion-Tonachini","year":"2019","journal-title":"NeuroImage"},{"key":"pone.0299108.ref061","volume-title":"Probability theory and statistical inference: econometric modeling with observational data","author":"A Spanos","year":"1999"},{"issue":"3","key":"pone.0299108.ref062","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1016\/0013-4694(70)90143-4","article-title":"EEG analysis based on time domain properties","volume":"29","author":"B Hjorth","year":"1970","journal-title":"Electroencephalography and clinical neurophysiology"},{"issue":"1","key":"pone.0299108.ref063","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1080\/13854040600744839","article-title":"EEG neurofeedback: a brief overview and an example of peak alpha frequency training for cognitive enhancement in the elderly","volume":"21","author":"E Angelakis","year":"2007","journal-title":"The clinical neuropsychologist"},{"issue":"1-2","key":"pone.0299108.ref064","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/0301-0511(95)05116-3","article-title":"Biocybernetic system evaluates indices of operator engagement in automated task","volume":"40","author":"AT Pope","year":"1995","journal-title":"Biological psychology"},{"issue":"3","key":"pone.0299108.ref065","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1016\/j.biopsycho.2004.01.002","article-title":"An evaluation of an adaptive automation system using a cognitive vigilance task","volume":"67","author":"FG Freeman","year":"2004","journal-title":"Biological psychology"},{"issue":"2","key":"pone.0299108.ref066","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/0167-2789(88)90081-4","article-title":"Approach to an irregular time series on the basis of the fractal theory","volume":"31","author":"T Higuchi","year":"1988","journal-title":"Physica D: Nonlinear Phenomena"},{"key":"pone.0299108.ref067","unstructured":"Qian B, Rasheed K. Hurst exponent and financial market predictability. In: IASTED conference on Financial Engineering and Applications; 2004. p. 203\u2013209."},{"key":"pone.0299108.ref068","first-page":"1","article-title":"The role of the insula in intuitive expert bug detection in computer code: an fMRI study","author":"J Castelhano","year":"2018","journal-title":"Brain imaging and behavior"},{"key":"pone.0299108.ref069","doi-asserted-by":"crossref","unstructured":"Campbell GA. Cognitive complexity: An overview and evaluation. In: Proceedings of the 2018 international conference on technical debt; 2018. p. 57\u201358.","DOI":"10.1145\/3194164.3194186"},{"key":"pone.0299108.ref070","doi-asserted-by":"crossref","first-page":"110946","DOI":"10.1016\/j.jss.2021.110946","article-title":"Brain and autonomic nervous system activity measurement in software engineering: A systematic literature review","volume":"178","author":"B Weber","year":"2021","journal-title":"Journal of Systems and Software"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0299108","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,7]],"date-time":"2024-03-07T18:44:16Z","timestamp":1709837056000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0299108"}},"subtitle":[],"editor":[{"given":"Zhishun","family":"Wang","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2024,3,7]]},"references-count":70,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,3,7]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0299108","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,7]]}}}