{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T11:51:50Z","timestamp":1791460310861,"version":"4.3.4"},"reference-count":72,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2026,3,31]]},"abstract":"<jats:p>\n                    <jats:italic toggle=\"yes\">Background<\/jats:italic>\n                    : Neuroimaging methods have been proved insightful in program-comprehension research. A key problem is that different baselines have been used in different experiments. A\n                    <jats:italic toggle=\"yes\">baseline<\/jats:italic>\n                    is a task during which the \u201cnormal\u201d brain activation is captured as a reference compared to the task of interest. Unfortunately, the influence of the choice of the baseline is still unclear.\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:italic toggle=\"yes\">Aims<\/jats:italic>\n                    : We investigate whether and to what extent the selected baseline influences the results of neuroimaging experiments on program comprehension. This helps to understand the tradeoffs in baseline selection with the ultimate goal of making the baseline selection informed and transparent.\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:italic toggle=\"yes\">Method<\/jats:italic>\n                    : We have conducted a pre-registered program-comprehension study with 20 participants using multiple baselines (i.e., reading, calculations, problem solving, and cross-fixation). We monitored brain activation with a 64-channel electroencephalography (EEG) device. We compared how the different baselines affect the results regarding brain activation of program comprehension.\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:italic toggle=\"yes\">Results and Implications<\/jats:italic>\n                    : We found significant differences in mental load across baselines suggesting that selecting a suitable baseline is critical. Our results show that a standard problem-solving task, operationalized by the Raven-Progressive Matrices, is a well-suited default baseline for program-comprehension studies. Our results highlight the need for carefully designing and selecting a baseline in program-comprehension studies.\n                  <\/jats:p>","DOI":"10.1145\/3744739","type":"journal-article","created":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T09:09:34Z","timestamp":1750151374000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["On the Influence of the Baseline in Neuroimaging Experiments on Program Comprehension"],"prefix":"10.1145","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9953-4904","authenticated-orcid":false,"given":"Annabelle","family":"Bergum","sequence":"first","affiliation":[{"name":"Saarland Informatics Campus, Graduate School of Computer Science, Saarland University, Saarbrucken, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7828-4558","authenticated-orcid":false,"given":"Norman","family":"Peitek","sequence":"additional","affiliation":[{"name":"Saarland Informatics Campus, Saarland University, Saarbrucken, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5829-5409","authenticated-orcid":false,"given":"Maurice","family":"Rekrut","sequence":"additional","affiliation":[{"name":"Saarland Informatics Campus, German Research Centre for Artificial Intelligence Saarbrucken Branch, Saarbrucken, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9574-3020","authenticated-orcid":false,"given":"Janet","family":"Siegmund","sequence":"additional","affiliation":[{"name":"Chemnitz University of Technology, Chemnitz, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3687-2233","authenticated-orcid":false,"given":"Sven","family":"Apel","sequence":"additional","affiliation":[{"name":"Saarland Informatics Campus, Saarland University, Saarbrucken, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,2,13]]},"reference":[{"key":"e_1_3_3_2_2","first-page":"F3G\u20131","volume-title":"Proc. 2011 Frontiers in Education Conference (FIE)","author":"Ambr\u00f3sio Ana Paula","year":"2011","unstructured":"Ana Paula Ambr\u00f3sio, F\u00e1bio Moreira Costa, Leandro Almeida, Amanda Franco, and Joaquim Macedo. 2011. Identifying cognitive abilities to improve CS1 outcome. In Proc. 2011 Frontiers in Education Conference (FIE). IEEE, F3G\u20131."},{"key":"e_1_3_3_3_2","first-page":"25","volume-title":"Proc. Annual Conf. Psychology of Programming Interest Group (PPIG)","author":"Ambrosio Ana Paula","year":"2014","unstructured":"Ana Paula Ambrosio, Leandro da Silva Almeida, Joaquim Macedo, and Amanda Franco. 2014. Exploring core cognitive skills of computational thinking. In Proc. Annual Conf. Psychology of Programming Interest Group (PPIG), 25\u201334."},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10648-010-9130-y"},{"issue":"11","key":"e_1_3_3_5_2","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1037\/0003-066X.56.11.851","article-title":"Is working memory still working","volume":"56","author":"Baddeley Alan","year":"2001","unstructured":"Alan Baddeley. 2001. Is working memory still working? The American Psychologist 56, 11 (2001), 851\u2013864.","journal-title":"The American Psychologist"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.5555\/137076"},{"key":"e_1_3_3_7_2","first-page":"11","volume-title":"Proc. Int\u2019l Conf. Program Comprehension (ICPC)","author":"Bauer Jennifer","year":"2019","unstructured":"Jennifer Bauer, Janet Siegmund, Norman Peitek, Johannes Hofmeister, and Sven Apel. 2019. Indentation: Simply a matter of style or support for program comprehension? In Proc. Int\u2019l Conf. Program Comprehension (ICPC). ACM, 11."},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2011.09.003"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1995.tb02031.x"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1162\/089892999563265"},{"key":"e_1_3_3_11_2","volume-title":"Brodmann\u2019s Localisation in the Cerebral Cortex","author":"Brodmann Korbinian","year":"2006","unstructured":"Korbinian Brodmann. 2006. Brodmann\u2019s Localisation in the Cerebral Cortex. Springer."},{"key":"e_1_3_3_12_2","first-page":"255","volume-title":"Proc. Int\u2019l Conf. Program Comprehension (ICPC)","author":"Busjahn Teresa","year":"2015","unstructured":"Teresa Busjahn, Roman Bednarik, Andrew Begel, Martha Crosby, James Paterson, Carsten Schulte, Bonita Sharif, and Sascha Tamm. 2015. Eye movements in code reading: Relaxing the linear order. In Proc. Int\u2019l Conf. Program Comprehension (ICPC). IEEE, 255\u2013265."},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11682-018-9885-1"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.114.3.494"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2003.10.009"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.5555\/7916"},{"key":"e_1_3_3_17_2","first-page":"87","volume-title":"Proc. Int. Symposium Software Reliability Engineering (ISSRE)","author":"Dur\u00e3es Jo\u00e3o","year":"2016","unstructured":"Jo\u00e3o Dur\u00e3es, Henrique Madeira, Jo\u00e3o Castelhano, Isabel Duarte, and Miguel Castelo-Branco. 2016. WAP: Understanding the brain at software debugging. In Proc. Int. Symposium Software Reliability Engineering (ISSRE). IEEE, 87\u201392."},{"key":"e_1_3_3_18_2","first-page":"754","volume-title":"Proc. Joint Meeting on Foundations of Software Engineering (ESEC\/FSE)","author":"Endres Madeline","year":"2021","unstructured":"Madeline Endres, Madison Fansher, Priti Shah, and Westley Weimer. 2021. To read or to rotate? Comparing the effects of technical reading training and spatial skills training on novice programming ability. In Proc. Joint Meeting on Foundations of Software Engineering (ESEC\/FSE). ACM, 754\u2013766."},{"key":"e_1_3_3_19_2","doi-asserted-by":"crossref","first-page":"2140","DOI":"10.1007\/s10664-019-09751-4","article-title":"Measuring the impact of lexical and structural inconsistencies on developers? Cognitive load during bug localization","volume":"25","author":"Fakhoury Sarah","year":"2020","unstructured":"Sarah Fakhoury, Devjeet Roy, Yuzhan Ma, Venera Arnaoudova, and Olusola Adesope. 2020. Measuring the impact of lexical and structural inconsistencies on developers? Cognitive load during bug localization. Empirical Software Engineering 25 (2020), 2140\u20132178.","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_3_20_2","first-page":"175","volume-title":"Proc. Int\u2019l Conf. Software Engineering (ICSE)","author":"Floyd Benjamin","year":"2017","unstructured":"Benjamin Floyd, Tyler Santander, and Westley Weimer. 2017. Decoding the representation of code in the brain: An fMRI study of code review and expertise. In Proc. Int\u2019l Conf. Software Engineering (ICSE). IEEE, 175\u2013186."},{"key":"e_1_3_3_21_2","first-page":"402","volume-title":"Proc. Int\u2019l Conf. Software Engineering (ICSE)","author":"Fritz Thomas","year":"2014","unstructured":"Thomas Fritz, Andrew Begel, Sebastian C. M\u00fcller, Serap Yigit-Elliott, and Manuela Z\u00fcger. 2014. Using psycho-physiological measures to assess task difficulty in software development. In Proc. Int\u2019l Conf. Software Engineering (ICSE). ACM, 402\u2013413."},{"issue":"10","key":"e_1_3_3_22_2","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1038\/35094500","article-title":"Searching for a baseline: Functional imaging and the resting human bra","volume":"2","author":"Gusnard D. A.","year":"2001","unstructured":"D. A. Gusnard, M. E. Raichle, and M. E. Raichle. 2001. Searching for a baseline: Functional imaging and the resting human bra. Nature Reviews Neuroscience 2, 10 (2001), 685\u2013694.","journal-title":"Nature Reviews Neuroscience"},{"key":"e_1_3_3_23_2","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.conb.2014.07.013","article-title":"Nodes and networks in the neural architecture for language: Broca\u2019s region and beyond","volume":"28","author":"Hagoort Peter","year":"2014","unstructured":"Peter Hagoort. 2014. Nodes and networks in the neural architecture for language: Broca\u2019s region and beyond. Current Opinion in Neurobiology 28 (2014), 136\u2013141.","journal-title":"Current Opinion in Neurobiology"},{"key":"e_1_3_3_24_2","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1146\/annurev-neuro-071013-013847","article-title":"The neurobiology of language beyond single words","volume":"37","author":"Hagoort Peter","year":"2014","unstructured":"Peter Hagoort and Peter Indefrey. 2014. The neurobiology of language beyond single words. Annual Review of Neuroscience 37 (2014), 347\u2013362.","journal-title":"Annual Review of Neuroscience"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-016-0822-1"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00429-023-02674-3"},{"key":"e_1_3_3_27_2","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1100\/tsw.2009.83","article-title":"Estimating brain load from the EEG","volume":"9","author":"Holm Anu","year":"2009","unstructured":"Anu Holm, Kristian Lukander, Jussi Korpela, Mikael Sallinen, and Kiti M\u00fcller. 2009. Estimating brain load from the EEG. The Scientific World Journal 9 (2009), 639\u2013651.","journal-title":"The Scientific World Journal"},{"key":"e_1_3_3_28_2","volume-title":"Eye Tracking: A Comprehensive Guide to Methods and Measures","author":"Holmqvist Kenneth","year":"2011","unstructured":"Kenneth Holmqvist, Marcus Nystr\u00f6m, Richard Andersson, Richard Dewhurst, Halszka Jarodzka, and Joost Van de Weijer. 2011. Eye Tracking: A Comprehensive Guide to Methods and Measures. OUP Oxford."},{"key":"e_1_3_3_29_2","first-page":"456","volume-title":"Proc. Europ. Software Engineering Conf.\/Foundations of Software Engineering (ESEC\/FSE)","author":"Huang Yu","year":"2020","unstructured":"Yu Huang, Kevin Leach, Zohreh Sharafi, Nicholas McKay, Tyler Santander, and Westley Weimer. 2020. Biases and differences in code review using medical imaging and eye-tracking: Genders, humans, and machines. In Proc. Europ. Software Engineering Conf.\/Foundations of Software Engineering (ESEC\/FSE). ACM, 456\u2013468."},{"key":"e_1_3_3_30_2","first-page":"396","volume-title":"Proc. Int\u2019l Conf. Software Engineering (ICSE)","author":"Huang Yu","year":"2019","unstructured":"Yu Huang, Xinyu Liu, Ryan Krueger, Tyler Santander, Xiaosu Hu, Kevin Leach, and Westley Weimer. 2019. Distilling neural representations of data structure manipulation using fMRI and fNIRS. In Proc. Int\u2019l Conf. Software Engineering (ICSE). IEEE, 396\u2013407."},{"key":"e_1_3_3_31_2","volume-title":"Functional Magnetic Resonance Imaging","author":"Huettel Scott","year":"2014","unstructured":"Scott Huettel, Allen Song, and Gregory McCarthy. 2014. Functional Magnetic Resonance Imaging, Vol. 3. Sinauer Associates."},{"issue":"1","key":"e_1_3_3_32_2","first-page":"1","article-title":"Expert programmers have fine-tuned cortical representations of source code","volume":"8","author":"Ikutani Yoshiharu","year":"2021","unstructured":"Yoshiharu Ikutani, Takatomi Kubo, Satoshi Nishida, Hideaki Hata, Kenichi Matsumoto, Kazushi Ikeda, and Shinji Nishimoto. 2021. Expert programmers have fine-tuned cortical representations of source code. eNeuro 8, 1 (2021), 1\u201316.","journal-title":"eNeuro"},{"issue":"58906","key":"e_1_3_3_33_2","first-page":"1","article-title":"Comprehension of computer code relies primarily on domain-general executive resources","volume":"9","author":"Ivanova Anna A.","year":"2020","unstructured":"Anna A. Ivanova, Shashank Srikant, Yotaro Sueoka, Hope H. Kean, Riva Dhamala, Una-May O'Reilly, Marina U. Bers, and Evelina Fedorenko. 2020. Comprehension of computer code relies primarily on domain-general executive resources. eLife 9, e58906 (2020), 1\u201324.","journal-title":"eLife"},{"issue":"1958","key":"e_1_3_3_34_2","first-page":"370","article-title":"Report of the committee on methods of clinical examination in electroencephalography","volume":"10","author":"Jasper Herbert","year":"1958","unstructured":"Herbert Jasper. 1958. Report of the committee on methods of clinical examination in electroencephalography. Electroencephalography and Clinical Neurophysiology 10 (1958), 370\u2013375.","journal-title":"Electroencephalography and Clinical Neurophysiology"},{"key":"e_1_3_3_35_2","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/978-1-84800-044-5_8","volume-title":"Guide to Advanced Empirical Software Engineering","author":"Jedlitschka Andreas","year":"2008","unstructured":"Andreas Jedlitschka, Marcus Ciolkowski, and Dietmar Pfahl. 2008. Reporting experiments in software engineering. In Guide to Advanced Empirical Software Engineering. Forrest Shull, JaniceSinger, and Dag I. K. Sj\u00f8berg (Eds.), Springer, 201\u2013228."},{"key":"e_1_3_3_36_2","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1007\/978-3-030-32423-0_2","volume-title":"Human Mental Workload: Models and Applications","author":"Kartali Aneta","year":"2019","unstructured":"Aneta Kartali, Milica Jankovi\u0107, Ivan Gligorijevi\u0107, Pavle Mijovi\u0107, Bogdan Mijovi\u0107, and Maria Leva. 2019. Real-time mental workload estimation using EEG. In Human Mental Workload: Models and Applications. Luca Longo and Maria Chiara Leva (Eds.), Springer International Publishing, 20\u201334."},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-007-9053-5"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2002.1027796"},{"key":"e_1_3_3_39_2","first-page":"52","article-title":"Diomidis Spinellis, and Lefteris Angelis. 2018. Towards an affordable brain computer interface for the assessment of programmers\u2019 mental workload","volume":"115","author":"Kosti Makrina","year":"2018","unstructured":"Makrina Kosti, Kostas Georgiadis, Dimitrios Adamos, Nikos Laskaris, Diomidis Spinellis, and Lefteris Angelis. 2018. Towards an affordable brain computer interface for the assessment of programmers\u2019 mental workload. International Journal of Human-Computer Studies 115 (2018), 52\u201366.","journal-title":"International Journal of Human-Computer Studies"},{"key":"e_1_3_3_40_2","first-page":"678","volume-title":"Proc. Int\u2019l Conf. Software Engineering (ICSE)","author":"Krueger Ryan","year":"2020","unstructured":"Ryan Krueger, Yu Huang, Xinyu Liu, Tyler Santander, Westley Weimer, and Kevin Leach. 2020. Neurological divide: An fMRI study of prose and code writing. In Proc. Int\u2019l Conf. Software Engineering (ICSE). IEEE, 678\u2013690."},{"key":"e_1_3_3_41_2","doi-asserted-by":"crossref","unstructured":"William Kruskal and Allen Wallis. 1952. Use of ranks in one-criterion variance analysis. Journal of the American Statistical Association 47 260 (1952) 583\u2013621.","DOI":"10.1080\/01621459.1952.10483441"},{"key":"e_1_3_3_42_2","first-page":"350","volume-title":"Proc. Int\u2019l Conf. on Bioinformatics and Bioengineering (BIBE)","author":"Lee Seolhwa","year":"2016","unstructured":"Seolhwa Lee, Andrew Matteson, Danial Hooshyar, SongHyun Kim, JaeBum Jung, GiChun Nam, and Heuiseok Lim. 2016. Comparing programming language comprehension between novice and expert programmers using EEG analysis. In Proc. Int\u2019l Conf. on Bioinformatics and Bioengineering (BIBE). IEEE, 350\u2013355."},{"key":"e_1_3_3_43_2","unstructured":"Ren Li Jared Johansen Hamad Ahmed Thomas Ilyevsky Ronnie Wilbur Hari Bharadwaj and Jeffrey Siskind. 2018. Training on the test set? An analysis of Spampinato et al. arXiv:1812.07697. Retrieved from https:\/\/arxiv.org\/abs\/1812.07697"},{"key":"e_1_3_3_44_2","doi-asserted-by":"crossref","first-page":"e59340","DOI":"10.7554\/eLife.59340","article-title":"Computer code comprehension shares neural resources with formal logical inference in the fronto-parietal network","volume":"9","author":"Liu Yun-Fei","year":"2020","unstructured":"Yun-Fei Liu, Judy Kim, Colin Wilson, and Marina Bedny. 2020. Computer code comprehension shares neural resources with formal logical inference in the fronto-parietal network. eLife 9 (2020), e59340.","journal-title":"eLife"},{"key":"e_1_3_3_45_2","first-page":"251","volume-title":"An Introduction to the Event-Related Potential Technique","author":"Luck Steven","year":"2014","unstructured":"Steven Luck. 2014. An Introduction to the Event-Related Potential Technique. MIT Press, 251\u2013253."},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177730491"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/1189136.1189185"},{"key":"e_1_3_3_48_2","first-page":"1413","volume-title":"Proc. Int\u2019l Conf. Engineering in Medicine and Biology Society (EMBC)","author":"Medeiros Julio","year":"2019","unstructured":"Julio Medeiros, Ricardo Couceiro, Jo\u00e3o Castelhano, Castelo Branco, Gon\u00e7alo Duarte, Catarina Duarte, Jo\u00e3o Dur\u00e3es, Henrique Madeira, Paulo Carvalho, and C\u00e9sar Teixeira. 2019. Software code complexity assessment using EEG features. In Proc. Int\u2019l Conf. Engineering in Medicine and Biology Society (EMBC). IEEE, 1413\u20131416."},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.3390\/s21072338"},{"key":"e_1_3_3_50_2","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.brainres.2011.06.053","article-title":"The effect of problem structure on problem-solving: An fMRI study of word versus number problems","volume":"1410","author":"Newman Sharlene D.","year":"2011","unstructured":"Sharlene D. Newman, Gregory Willoughby, and Benjamin Pruce. 2011. The effect of problem structure on problem-solving: An fMRI study of word versus number problems. Brain Research 1410 (2011), 77\u201388.","journal-title":"Brain Research"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-018-01193-y"},{"key":"e_1_3_3_52_2","volume-title":"A Neuro-Cognitive Perspective of Program Comprehension","author":"Peitek Norman","year":"2022","unstructured":"Norman Peitek. 2022. A Neuro-Cognitive Perspective of Program Comprehension. Ph.D. Dissertation. University of Technology Chemnitz."},{"key":"e_1_3_3_53_2","first-page":"524","volume-title":"Proc. Int\u2019l Conf. Software Engineering (ICSE)","author":"Peitek Norman","year":"2021","unstructured":"Norman Peitek, Sven Apel, Chris Parnin, Andr\u00e9 Brechmann, and Janet Siegmund. 2021. Program comprehension and code complexity metrics: An fMRI study. In Proc. Int\u2019l Conf. Software Engineering (ICSE). ACM, 524\u2013536."},{"key":"e_1_3_3_54_2","first-page":"120","volume-title":"Proc. Joint Meeting on Foundations of Software Engineering (ESEC\/FSE)","author":"Peitek Norman","year":"2022","unstructured":"Norman Peitek, Annabelle Bergum, Maurice Rekrut, Jonas Mucke, Matthias Nadig, Chris Parnin, Janet Siegmund, and Sven Apel. 2022. Correlates of programmer efficacy and their link to experience: A combined EEG and eye-tracking study. In Proc. Joint Meeting on Foundations of Software Engineering (ESEC\/FSE). ACM, 120\u2013131."},{"key":"e_1_3_3_55_2","first-page":"342","volume-title":"Proc. Int\u2019l Conf. Program Comprehension (ICPC)","author":"Peitek Norman","year":"2020","unstructured":"Norman Peitek, Janet Siegmund, and Sven Apel. 2020. What drives the reading order of programmers? An eye tracking study. In Proc. Int\u2019l Conf. Program Comprehension (ICPC). ACM, 342\u2013353."},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2018.2863303"},{"key":"e_1_3_3_57_2","first-page":"22","volume-title":"Proc. Int\u2019l Workshop on Eye Movements in Programming (EMIP)","author":"Peitek Norman","year":"2017","unstructured":"Norman Peitek, Janet Siegmund, and Andr\u00e9 Brechmann. 2017. Enhancing fMRI studies of program comprehension with eye-tracking. In Proc. Int\u2019l Workshop on Eye Movements in Programming (EMIP). Freie Universit\u00e4t, Berlin, 22\u201323."},{"key":"e_1_3_3_58_2","first-page":"24:1","volume-title":"Proc. Int\u2019l Symposium Empirical Software Engineering and Measurement (ESEM)","author":"Peitek Norman","year":"2018","unstructured":"Norman Peitek, Janet Siegmund, Chris Parnin, Sven Apel, Johannes Hofmeister, and Andr\u00e9 Brechmann. 2018. Simultaneous measurement of program comprehension with fMRI and eye tracking: A case study. In Proc. Int\u2019l Symposium Empirical Software Engineering and Measurement (ESEM). ACM, 24:1\u201324:10."},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0285(87)90007-7"},{"issue":"1","key":"e_1_3_3_60_2","doi-asserted-by":"crossref","first-page":"3817","DOI":"10.1038\/s41598-020-60661-8","article-title":"Relating natural language aptitude to individual differences in learning programming languages","volume":"10","author":"Prat Chantal","year":"2020","unstructured":"Chantal Prat, Tara Madhyastha, Malayka Mottarella, and Chu-Hsuan Kuo. 2020. Relating natural language aptitude to individual differences in learning programming languages. Scientific Reports 10, 1 (2020), 3817.","journal-title":"Scientific Reports"},{"issue":"2","key":"e_1_3_3_61_2","doi-asserted-by":"crossref","first-page":"816","DOI":"10.1016\/j.neuroimage.2012.04.062","article-title":"A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading","volume":"62","author":"Cathy Price","year":"2012","unstructured":"Price Cathy. 2012. A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading. NeuroImage 62, 2 (2012), 816\u2013847.","journal-title":"NeuroImage"},{"issue":"1","key":"e_1_3_3_62_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1006\/cogp.1999.0735","article-title":"The raven\u2019s progressive matrices: Change and stability over culture and time","volume":"41","author":"John Raven","year":"2000","unstructured":"Raven John. 2000. The raven\u2019s progressive matrices: Change and stability over culture and time. Cognitive Psychology 41, 1 (2000), 1\u201348.","journal-title":"Cognitive Psychology"},{"key":"e_1_3_3_63_2","first-page":"1","volume-title":"Proc. Int\u2019l Winter Conf. Brain-Computer Interface (BCI)","author":"Rekrut Maurice","year":"2020","unstructured":"Maurice Rekrut, Mansi Sharma, Matthias Schmitt, Jan Alexandersson, and Antonio Kr\u00fcger. 2020. Decoding semantic categories from EEG activity in object-based decision tasks. In Proc. Int\u2019l Winter Conf. Brain-Computer Interface (BCI). IEEE, 1\u20137."},{"key":"e_1_3_3_64_2","first-page":"378","volume-title":"Proc. Int\u2019l Conf. Software Engineering (ICSE)","author":"Siegmund Janet","year":"2014","unstructured":"Janet Siegmund, Christian K\u00e4stner, Sven Apel, Chris Parnin, Anja Bethmann, Thomas Leich, Gunter Saake, and Andr\u00e9 Brechmann. 2014. Understanding understanding source code with functional magnetic resonance imaging. In Proc. Int\u2019l Conf. Software Engineering (ICSE). ACM, 378\u2013389."},{"issue":"5","key":"e_1_3_3_65_2","first-page":"1299","article-title":"J\u00f6rg Liebig, Sven Apel, and Stefan Hanenberg. 2014. Measuring and modeling programming experience","volume":"19","author":"Siegmund Janet","year":"2014","unstructured":"Janet Siegmund, Christian K\u00e4stner, J\u00f6rg Liebig, Sven Apel, and Stefan Hanenberg. 2014. Measuring and modeling programming experience. Empirical Software Engineering 19, 5 (2014), 1299\u20131334.","journal-title":"Empirical Software Engineering"},{"issue":"6","key":"e_1_3_3_66_2","first-page":"30","article-title":"Andr\u00e9 Brechmann, Chris Parnin, and Sven Apel. 2020. Studying programming in the neuroage: Just a crazy idea","volume":"63","author":"Siegmund Janet","year":"2020","unstructured":"Janet Siegmund, Norman Peitek, Andr\u00e9 Brechmann, Chris Parnin, and Sven Apel. 2020. Studying programming in the neuroage: Just a crazy idea? Communications of the ACM 63, 6 (2020), 30\u201334.","journal-title":"Communications of the ACM"},{"key":"e_1_3_3_67_2","first-page":"140","volume-title":"Proc. Europ. Software Engineering Conf.\/Foundations of Software Engineering (ESEC\/FSE)","author":"Siegmund Janet","year":"2017","unstructured":"Janet Siegmund, Norman Peitek, Chris Parnin, Sven Apel, Johannes Hofmeister, Christian K\u00e4stner, Andrew Begel, Anja Bethmann, and Andr\u00e9 Brechmann. 2017. Measuring neural efficiency of program comprehension. In Proc. Europ. Software Engineering Conf.\/Foundations of Software Engineering (ESEC\/FSE). ACM, 140\u2013150."},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.5555\/2818754.2818759"},{"issue":"22","key":"e_1_3_3_69_2","doi-asserted-by":"crossref","first-page":"12760","DOI":"10.1073\/pnas.221462998","article-title":"When zero is not zero: The problem of ambiguous baseline conditions in fMRI","volume":"98","author":"Stark Craig","year":"2001","unstructured":"Craig Stark and Larry Squire. 2001. When zero is not zero: The problem of ambiguous baseline conditions in fMRI. Proceedings of the National Academy of Sciences 98, 22 (2001), 12760\u201312766.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"2021","key":"e_1_3_3_70_2","doi-asserted-by":"crossref","first-page":"110946","DOI":"10.1016\/j.jss.2021.110946","article-title":"Brain and autonomic nervous system activity measurement in software engineering: A systematic literature review","volume":"178","author":"Weber Barbara","year":"2021","unstructured":"Barbara Weber, Thomas Fischer, and Ren\u00e9 Riedl. 2021. Brain and autonomic nervous system activity measurement in software engineering: A systematic literature review. Journal of Systems and Software 178 (2021), 110946.","journal-title":"Journal of Systems and Software"},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.5555\/330775"},{"issue":"4","key":"e_1_3_3_72_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3626522","article-title":"40 years of designing code comprehension experiments: Systematic mapping study","volume":"56","author":"Wyrich Marvin","year":"2023","unstructured":"Marvin Wyrich, Justus Bogner, and Stefan Wagner. 2023. 40 years of designing code comprehension experiments: Systematic mapping study. ACM Computing Surveys 56, 4 (2023), 1\u201342.","journal-title":"ACM Computing Surveys"},{"key":"e_1_3_3_73_2","first-page":"1","volume-title":"Proc. Frontiers in Education Conference","author":"Yeh Martin","year":"2017","unstructured":"Martin Yeh, Dan Gopstein, Yu Yan, and Yanyan Zhuang. 2017. Detecting and comparing brain activity in short program comprehension using EEG. In Proc. Frontiers in Education Conference. IEEE, 1\u20135."}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3744739","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T14:38:38Z","timestamp":1770993518000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3744739"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,13]]},"references-count":72,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,3,31]]}},"alternative-id":["10.1145\/3744739"],"URL":"https:\/\/doi.org\/10.1145\/3744739","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,13]]},"assertion":[{"value":"2023-11-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-22","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-02-13","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}