{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T07:19:11Z","timestamp":1780471151360,"version":"3.54.1"},"reference-count":77,"publisher":"Association for Computing Machinery (ACM)","issue":"FSE","license":[{"start":{"date-parts":[[2024,7,12]],"date-time":"2024-07-12T00:00:00Z","timestamp":1720742400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["CCF-2211429,CCF-2211428,CCF-2100035,SaTC-2312057"],"award-info":[{"award-number":["CCF-2211429,CCF-2211428,CCF-2100035,SaTC-2312057"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2024,7,12]]},"abstract":"<jats:p>\n                    Neural code summarization leverages deep learning models to automatically generate brief natural language summaries of code snippets. The development of Transformer models has led to extensive use of attention during model design. While existing work has primarily and almost exclusively focused on static properties of source code and related structural representations like the Abstract Syntax Tree (AST), few studies have considered human attention \u2014 that is, where programmers focus while examining and comprehending code. In this paper, we develop a method for incorporating human attention into machine attention to enhance neural code summarization. To facilitate this incorporation and vindicate this hypothesis, we introduce E\n                    <jats:sc>ye<\/jats:sc>\n                    T\n                    <jats:sc>rans<\/jats:sc>\n                    , which consists of three steps: (1) we conduct an extensive eye-tracking human study to collect and pre-analyze data for model training, (2) we devise a data-centric approach to integrate human attention with machine attention in the Transformer architecture, and (3) we conduct comprehensive experiments on two code summarization tasks to demonstrate the effectiveness of incorporating human attention into Transformers. Integrating human attention leads to an improvement of up to 29.91% in Functional Summarization and up to 6.39% in General Code Summarization performance, demonstrating the substantial benefits of this combination. We further explore performance in terms of robustness and efficiency by creating challenging summarization scenarios in which E\n                    <jats:sc>ye<\/jats:sc>\n                    Trans exhibits interesting properties. We also visualize the attention map to depict the simplifying effect of machine attention in the Transformer by incorporating human attention. This work has the potential to propel AI research in software engineering by introducing more human-centered approaches and data.\n                  <\/jats:p>","DOI":"10.1145\/3643732","type":"journal-article","created":{"date-parts":[[2024,7,12]],"date-time":"2024-07-12T10:22:09Z","timestamp":1720779729000},"page":"115-136","source":"Crossref","is-referenced-by-count":17,"title":["EyeTrans: Merging Human and Machine Attention for Neural Code Summarization"],"prefix":"10.1145","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5719-772X","authenticated-orcid":false,"given":"Yifan","family":"Zhang","sequence":"first","affiliation":[{"name":"Vanderbilt University, Nashville, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-2852-0865","authenticated-orcid":false,"given":"Jiliang","family":"Li","sequence":"additional","affiliation":[{"name":"Vanderbilt University, Nashville, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5721-8794","authenticated-orcid":false,"given":"Zachary","family":"Karas","sequence":"additional","affiliation":[{"name":"Vanderbilt University, Nashville, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7475-7899","authenticated-orcid":false,"given":"Aakash","family":"Bansal","sequence":"additional","affiliation":[{"name":"University of Notre Dame, South Bend, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7902-7625","authenticated-orcid":false,"given":"Toby Jia-Jun","family":"Li","sequence":"additional","affiliation":[{"name":"University of Notre Dame, South Bend, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-0887-1083","authenticated-orcid":false,"given":"Collin","family":"McMillan","sequence":"additional","affiliation":[{"name":"University of Notre Dame, South Bend, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4001-3442","authenticated-orcid":false,"given":"Kevin","family":"Leach","sequence":"additional","affiliation":[{"name":"Vanderbilt University, Nashville, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2730-5077","authenticated-orcid":false,"given":"Yu","family":"Huang","sequence":"additional","affiliation":[{"name":"Vanderbilt University, Nashville, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,7,12]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"2023. https:\/\/go.tobii.com\/tobii-pro-fusion-user-manual"},{"key":"e_1_3_1_3_2","doi-asserted-by":"crossref","unstructured":"Nahla J Abid Jonathan I Maletic and Bonita Sharif. 2019. Using developer eye movements to externalize the mental model used in code summarization tasks. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications. 1\u20139.","DOI":"10.1145\/3314111.3319834"},{"key":"e_1_3_1_4_2","doi-asserted-by":"crossref","unstructured":"Nahla J Abid Bonita Sharif Natalia Dragan Hend Alrasheed and Jonathan I Maletic. 2019. Developer reading behavior while summarizing java methods: Size and context matters. In 2019 IEEE\/ACM 41st International Conference on Software Engineering (ICSE). IEEE 384\u2013395.","DOI":"10.1109\/ICSE.2019.00052"},{"key":"e_1_3_1_5_2","doi-asserted-by":"crossref","unstructured":"Hammad Ahmad Zachary Karas Kimberly Diaz Amir Kamil Jean-Baptiste Jeannin and Westley Weimer. 2023. How Do We Read Formal Claims? Eye-Tracking and the Cognition of Proofs about Algorithms. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). IEEE 208\u2013220.","DOI":"10.1109\/ICSE48619.2023.00029"},{"key":"e_1_3_1_6_2","doi-asserted-by":"crossref","unstructured":"Wasi Uddin Ahmad Saikat Chakraborty Baishakhi Ray and Kai-Wei Chang. 2020. A transformer-based approach for source code summarization. arXiv preprint arXiv:2005.00653 (2020).","DOI":"10.18653\/v1\/2020.acl-main.449"},{"key":"e_1_3_1_7_2","doi-asserted-by":"crossref","unstructured":"Nasir Ali Zohreh Sharafi Yann-Ga\u00ebl Gu\u00e9h\u00e9neuc and Giuliano Antoniol. 2015. An empirical study on the importance of source code entities for requirements traceability. Empirical software engineering 20 (2015) 442\u2013478.","DOI":"10.1007\/s10664-014-9315-y"},{"key":"e_1_3_1_8_2","unstructured":"Uri Alon Shaked Brody Omer Levy and Eran Yahav. 2018. code2seq: Generating sequences from structured representations of code. arXiv preprint arXiv:1808.01400 (2018)."},{"key":"e_1_3_1_9_2","unstructured":"Jimmy Lei Ba Jamie Ryan Kiros and Geoffrey E Hinton. 2016. Layer normalization. arXiv preprint arXiv:1607.06450 (2016)."},{"key":"e_1_3_1_10_2","doi-asserted-by":"crossref","unstructured":"Aakash Bansal Bonita Sharif and Collin McMillan. 2023. Towards Modeling Human Attention from Eye Movements for Neural Source Code Summarization. Proceedings of the ACM on Human-Computer Interaction 7 ETRA (2023) 1\u201319.","DOI":"10.1145\/3591136"},{"key":"e_1_3_1_11_2","doi-asserted-by":"crossref","unstructured":"Aakash Bansal Chia-Yi Su Zachary Karas Yifan Zhang Yu Huang Toby Jia-Jun Li and Collin McMillan. 2023. Modeling Programmer Attention as Scanpath Prediction. In 2023 38th IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE 1732\u20131736.","DOI":"10.1109\/ASE56229.2023.00092"},{"key":"e_1_3_1_12_2","doi-asserted-by":"crossref","unstructured":"Maria Barrett Joachim Bingel Nora Hollenstein Marek Rei and Anders S\u00f8gaard. 2018. Sequence classification with human attention. In Proceedings of the 22nd conference on computational natural language learning. 302\u2013312.","DOI":"10.18653\/v1\/K18-1030"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","unstructured":"Roman Bednarik. 2012. Expertise-dependent Visual Attention Strategies Develop over Time During Debugging with Multiple Code Representations. International Journal of Human-Computer Studies 70 2 (Feb. 2012) 143\u2013155. https:\/\/doi.org\/10.1016\/j.ijhcs.2011.09.003 10.1016\/j.ijhcs.2011.09.003","DOI":"10.1016\/j.ijhcs.2011.09.003"},{"key":"e_1_3_1_14_2","doi-asserted-by":"crossref","unstructured":"Jean-Francois Bergeretti and Bernard A Carr\u00e9. 1985. Information-flow and data-flow analysis of while-programs. ACM Transactions on Programming Languages and Systems (TOPLAS) 7 1 (1985) 37\u201361.","DOI":"10.1145\/2363.2366"},{"key":"e_1_3_1_15_2","doi-asserted-by":"crossref","unstructured":"Birtukan Birawo and Pawel Kasprowski. 2022. Review and evaluation of eye movement event detection algorithms. Sensors 22 22 (2022)","DOI":"10.3390\/s22228810"},{"key":"e_1_3_1_16_2","doi-asserted-by":"crossref","unstructured":"Egon B\u00f6rger and Wolfram Schulte. 1999. A programmer friendly modular definition of the semantics of Java. Formal Syntax and Semantics of Java (1999)\u2013404.","DOI":"10.1007\/3-540-48737-9_10"},{"key":"e_1_3_1_17_2","doi-asserted-by":"crossref","unstructured":"Teresa Busjahn Roman Bednarik Andrew Begel Martha Crosby James H Paterson Carsten Schulte Bonita Sharif and Sascha Tamm Eye movements in code reading: Relaxing the linear order. In 2015 IEEE 23rd International Conference on Program Comprehension. IEEE 255\u2013265.","DOI":"10.1109\/ICPC.2015.36"},{"key":"e_1_3_1_18_2","doi-asserted-by":"crossref","unstructured":"Michael L Collard Michael John Decker and Jonathan I Maletic. 2013. srcml: An infrastructure for the exploration analysis and manipulation of source code: A tool demonstration. In 2013 IEEE International conference on software maintenance. IEEE 516\u2013519.","DOI":"10.1109\/ICSM.2013.85"},{"key":"e_1_3_1_19_2","unstructured":"Martha E Crosby Jean Scholtz and Susan Wiedenbeck. 2002. The Roles Beacons Play in Comprehension for Novice and Expert Programmers. In PPIG. 5."},{"key":"e_1_3_1_20_2","doi-asserted-by":"crossref","unstructured":"Zhengcong Fei. 2022. Attention-aligned transformer for image captioning. In proceedings of the AAAI Conference on Artificial Intelligence Vol. 36. 607\u2013615.","DOI":"10.1609\/aaai.v36i1.19940"},{"key":"e_1_3_1_21_2","doi-asserted-by":"crossref","unstructured":"Shuzheng Gao Cuiyun Gao Yulan He Jichuan Zeng Lunyiu Nie Xin Xia and Michael Lyu. 2023. Code Structure\u2013Guided Transformer for Source Code Summarization. ACM Transactions on Software Engineering and Methodology 32 1 (2023) 1\u201332.","DOI":"10.1145\/3522674"},{"key":"e_1_3_1_22_2","doi-asserted-by":"crossref","unstructured":"Zi Gong Cuiyun Gao Yasheng Wang Wenchao Gu Yun Peng and Zenglin Xu. 2022. Source code summarization with structural relative position guided transformer. In 2022 IEEE International Conference on Software Analysis Evolution and Reengineering (SANER). IEEE 13\u201324.","DOI":"10.1109\/SANER53432.2022.00013"},{"key":"e_1_3_1_23_2","unstructured":"Daya Guo Shuo Ren Shuai Lu Zhangyin Feng Duyu Tang Shujie Liu Long Zhou Nan Duan Alexey Svyatkovskiy Shengyu Fu et al. 2020. Graphcodebert: Pre-training code representations with data flow. arXiv preprint arXiv:2009.08366 (2020)."},{"key":"e_1_3_1_24_2","doi-asserted-by":"crossref","unstructured":"Meng-Hao Guo Tian-Xing Xu Jiang-Jiang Liu Zheng-Ning Liu Peng-Tao Jiang Tai-Jiang Mu Song-Hai Zhang Ralph R Martin Ming-Ming Cheng and Shi-Min Hu. 2022. Attention mechanisms in computer vision: A survey. Computational visual media 8 3 (2022) 331\u2013368.","DOI":"10.1007\/s41095-022-0271-y"},{"key":"e_1_3_1_25_2","doi-asserted-by":"crossref","unstructured":"Sonia Haiduc Jairo Aponte and Andrian Marcus. 2010. Supporting program comprehension with source code summarization. In Proceedings of the 32nd ACM\/IEEE International Conference on Software Engineering-Volume 2. 223\u2013226.","DOI":"10.1145\/1810295.1810335"},{"key":"e_1_3_1_26_2","doi-asserted-by":"crossref","unstructured":"Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770\u2013778.","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_1_27_2","doi-asserted-by":"crossref","unstructured":"Xing Hu Ge Li Xin Xia David Lo and Zhi Jin. 2018. Deep code comment generation. In Proceedings of the 26th conference on program comprehension. 200\u2013210.","DOI":"10.1145\/3196321.3196334"},{"key":"e_1_3_1_28_2","doi-asserted-by":"crossref","unstructured":"Yu Huang Kevin Leach Zohreh Sharafi Nicholas McKay Tyler Santander and Westley Weimer. 2020. Biases and differences in code review using medical imaging and eye-tracking: genders humans and machines. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 456\u2013468.","DOI":"10.1145\/3368089.3409681"},{"key":"e_1_3_1_29_2","unstructured":"Ryu Iida Masaaki Yasuhara and Takenobu Tokunaga. 2011. Multi-modal reference resolution in situated dialogue by integrating linguistic and extra-linguistic clues. In Proceedings of 5th International Joint Conference on Natural Language Processing. 84\u201392."},{"key":"e_1_3_1_30_2","doi-asserted-by":"crossref","unstructured":"Srinivasan Iyer Ioannis Konstas Alvin Cheung and Luke Zettlemoyer. 2016. Summarizing source code using a neural attention model. In 54th Annual Meeting of the Association for Computational Linguistics 2016. Association for Computational Linguistics 2073\u20132083.","DOI":"10.18653\/v1\/P16-1195"},{"key":"e_1_3_1_31_2","doi-asserted-by":"crossref","unstructured":"Marcel A Just and Patricia A Carpenter. 1980. A theory of reading: from eye fixations to comprehension. Psychological review 87 4 (1980) 329.","DOI":"10.1037\/0033-295X.87.4.329"},{"key":"e_1_3_1_32_2","doi-asserted-by":"crossref","unstructured":"Nour Karessli Zeynep Akata Bernt Schiele and Andreas Bulling. 2017. Gaze embeddings for zero-shot image classification. In Proceedings of the IEEE conference on computer vision and pattern recognition. 4525\u20134534.","DOI":"10.1109\/CVPR.2017.679"},{"key":"e_1_3_1_33_2","unstructured":"Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_3_1_34_2","doi-asserted-by":"crossref","unstructured":"Sigrid Klerke Yoav Goldberg and Anders S\u00f8gaard. 2016. Improving sentence compression by learning to predict gaze. arXiv preprint arXiv:1604.03357 (2016).","DOI":"10.18653\/v1\/N16-1179"},{"key":"e_1_3_1_35_2","doi-asserted-by":"crossref","unstructured":"Sigrid Klerke and Barbara Plank. 2019. At a glance: The impact of gaze aggregation views on syntactic tagging. In Proceedings of the Beyond Vision and LANguage: inTEgrating Real-world kNowledge (LANTERN). 51\u201361.","DOI":"10.18653\/v1\/D19-6408"},{"key":"e_1_3_1_36_2","doi-asserted-by":"crossref","unstructured":"Thanh Le-Cong Hong Jin Kang Truong Giang Nguyen Stefanus Agus Haryono David Lo Xuan-Bach D Le and Quyet Thang Huynh. 2022. Autopruner: transformer-based call graph pruning. In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 520\u2013532.","DOI":"10.1145\/3540250.3549175"},{"key":"e_1_3_1_37_2","doi-asserted-by":"crossref","unstructured":"Alexander LeClair Sakib Haque Lingfei Wu and Collin McMillan. 2020. Improved code summarization via a graph neural network. In Proceedings of the 28th international conference on program comprehension. 184\u2013195.","DOI":"10.1145\/3387904.3389268"},{"key":"e_1_3_1_38_2","doi-asserted-by":"crossref","unstructured":"Alexander LeClair and Collin McMillan. 2019. Recommendations for datasets for source code summarization. arXiv preprint arXiv:1904.02660 (2019).","DOI":"10.18653\/v1\/N19-1394"},{"key":"e_1_3_1_39_2","doi-asserted-by":"crossref","unstructured":"Chen Lin Zhichao Ouyang Junqing Zhuang Jianqiang Chen Hui Li and Rongxin Wu. 2021. Improving code summarization with block-wise abstract syntax tree splitting. In 2021 IEEE\/ACM 29th International Conference on Program Comprehension (ICPC). IEEE 184\u2013195.","DOI":"10.1109\/ICPC52881.2021.00026"},{"key":"e_1_3_1_40_2","unstructured":"Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. In Text summarization branches out. 74\u201381."},{"key":"e_1_3_1_41_2","unstructured":"Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019)."},{"key":"e_1_3_1_42_2","unstructured":"Sun Developer Network. 1999. Code conventions for the Java programming language."},{"key":"e_1_3_1_43_2","doi-asserted-by":"crossref","unstructured":"Zhaoyang Niu Guoqiang Zhong and Hui Yu. 2021. A review on the attention mechanism of deep learning. Neurocomputing 452 (2021) 48\u201362.","DOI":"10.1016\/j.neucom.2021.03.091"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","unstructured":"Unaizah Obaidellah Mohammed Al Haek and Peter C.-H. Cheng. 2018. A Survey on the Usage of Eye-Tracking in Computer Programming. ACM Comput. Surv. 51 1 Article 5 (Jan. 2018) 58 pages. https:\/\/doi.org\/10.1145\/3145904 10.1145\/3145904","DOI":"10.1145\/3145904"},{"key":"e_1_3_1_45_2","unstructured":"Anneli Olsen. 2012. The Tobii I-VT fixation filter. Tobii Technology 21 (2012) 4\u201319."},{"key":"e_1_3_1_46_2","doi-asserted-by":"crossref","unstructured":"Norman Peitek Janet Siegmund and Sven Apel. 2020. What drives the reading order of programmers? an eye tracking study. In Proceedings of the 28th International Conference on Program Comprehension. 342\u2013353.","DOI":"10.1145\/3387904.3389279"},{"key":"e_1_3_1_47_2","unstructured":"Baolin Peng Chunyuan Li Pengcheng He Michel Galley and Jianfeng Gao. 2023. Instruction tuning with gpt-4. arXiv preprint arXiv:2304.03277 (2023)."},{"key":"e_1_3_1_48_2","doi-asserted-by":"crossref","unstructured":"Tingting Qiao Jianfeng Dong and Duanqing Xu. 2018. Exploring human-like attention supervision in visual question answering. In Proceedings of the AAAI Conference on Artificial Intelligence Vol. 32.","DOI":"10.1609\/aaai.v32i1.12272"},{"key":"e_1_3_1_49_2","doi-asserted-by":"crossref","unstructured":"Erik D Reichle Keith Rayner and Alexander Pollatsek. 2003. The EZ Reader model of eye-movement control in reading: Comparisons to other models. Behavioral and brain sciences 26 4 (2003) 445\u2013476.","DOI":"10.1017\/S0140525X03000104"},{"key":"e_1_3_1_50_2","doi-asserted-by":"crossref","unstructured":"Paige Rodeghero Cheng Liu Paul W McBurney and Collin McMillan. 2015. An eye-tracking study of java programmers and application to source code summarization. IEEE Transactions on Software Engineering 41 11 (2015) 1038\u20131054.","DOI":"10.1109\/TSE.2015.2442238"},{"key":"e_1_3_1_51_2","doi-asserted-by":"crossref","unstructured":"Paige Rodeghero and Collin McMillan. 2015. An empirical study on the patterns of eye movement during summarization tasks. In 2015 ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). IEEE 1\u201310.","DOI":"10.1109\/ESEM.2015.7321188"},{"key":"e_1_3_1_52_2","doi-asserted-by":"crossref","unstructured":"Paige Rodeghero Collin McMillan Paul W McBurney Nigel Bosch and Sidney D\u2019Mello. 2014. Improving automated source code summarization via an eye-tracking study of programmers. In Proceedings of the 36th international conference on Software engineering. 390\u2013401.","DOI":"10.1145\/2568225.2568247"},{"key":"e_1_3_1_53_2","unstructured":"Omid Rohanian Shiva Taslimipoor Victoria Yaneva and Le An Ha. 2017. Using gaze data to predict multiword expressions. (2017)."},{"key":"e_1_3_1_54_2","unstructured":"Herbert Schildt. 2007. Java: the complete reference.(2007)."},{"key":"e_1_3_1_55_2","doi-asserted-by":"crossref","unstructured":"Timothy R Shaffer Jenna L Wise Braden M Walters Sebastian C M\u00fcller Michael Falcone and Bonita Sharif. 2015. itrace: Enabling eye tracking on software artifacts within the ide to support software engineering tasks. In Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering. 954\u2013957.","DOI":"10.1145\/2786805.2803188"},{"key":"e_1_3_1_56_2","doi-asserted-by":"crossref","unstructured":"Zohreh Sharafi Yu Huang Kevin Leach and Westley Weimer. 2021. Toward an Objective Measure of Developers\u2019 Cognitive Activities. ACM Transactions on Software Engineering and Methodology (TOSEM) 30 3 (2021) 1\u201340.","DOI":"10.1145\/3434643"},{"key":"e_1_3_1_57_2","doi-asserted-by":"crossref","unstructured":"Zohreh Sharafi Timothy Shaffer Bonita Sharif and Yann-Ga\u00ebl Gu\u00e9h\u00e9neuc. 2015. Eye-tracking metrics in software engineering. In 2015 Asia-Pacific Software Engineering Conference (APSEC). IEEE 96\u2013103.","DOI":"10.1109\/APSEC.2015.53"},{"key":"e_1_3_1_58_2","doi-asserted-by":"crossref","unstructured":"Zohreh Sharafi Bonita Sharif Yann-Ga\u00ebl Gu\u00e9h\u00e9neuc Andrew Begel Roman Bednarik and Martha Crosby. 2020. A practical guide on conducting eye tracking studies in software engineering. Empirical Software Engineering 25 (2020) 3128\u20133174.","DOI":"10.1007\/s10664-020-09829-4"},{"key":"e_1_3_1_59_2","doi-asserted-by":"crossref","unstructured":"Ensheng Shi Yanlin Wang Lun Du Junjie Chen Shi Han Hongyu Zhang Dongmei Zhang and Hongbin Sun. 2022. On the evaluation of neural code summarization. In Proceedings of the 44th International Conference on Software Engineering. 1597\u20131608.","DOI":"10.1145\/3510003.3510060"},{"key":"e_1_3_1_60_2","unstructured":"Ensheng Shi Yanlin Wang Lun Du Hongyu Zhang Shi Han Dongmei Zhang and Hongbin Sun. 2021. Cast: Enhancing code summarization with hierarchical splitting and reconstruction of abstract syntax trees. arXiv preprint arXiv:2108.12987 (2021)."},{"key":"e_1_3_1_61_2","unstructured":"Ekta Sood Simon Tannert Philipp M\u00fcller and Andreas Bulling. 2020. Improving natural language processing tasks with human gaze-guided neural attention. Advances in Neural Information Processing Systems 33 (2020) 6327\u20136341."},{"key":"e_1_3_1_62_2","doi-asserted-by":"crossref","unstructured":"Sean Stapleton Yashmeet Gambhir Alexander LeClair Zachary Eberhart Westley Weimer Kevin Leach and Yu Huang. 2020. A human study of comprehension and code summarization. In Proceedings of the 28th International Conference on Program Comprehension. 2\u201313.","DOI":"10.1145\/3387904.3389258"},{"key":"e_1_3_1_63_2","unstructured":"Yusuke Sugano and Andreas Bulling. 2016. Seeing with humans: Gaze-assisted neural image captioning. arXiv preprint arXiv:1608.05203 (2016)."},{"key":"e_1_3_1_64_2","doi-asserted-by":"crossref","unstructured":"Jerry Chih-Yuan Sun and Kelly Yi-Chuan Hsu. 2019. A smart eye-tracking feedback scaffolding approach to improving students\u2019 learning self-efficacy and performance in a C programming course. Computers in Human Behavior 95 (2019) 66\u201372.","DOI":"10.1016\/j.chb.2019.01.036"},{"key":"e_1_3_1_65_2","doi-asserted-by":"crossref","unstructured":"Ze Tang Chuanyi Li Jidong Ge Xiaoyu Shen Zheling Zhu and Bin Luo. 2021. AST-transformer: Encoding abstract syntax trees efficiently for code summarization. In 2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE 1193\u20131195.","DOI":"10.1109\/ASE51524.2021.9678882"},{"key":"e_1_3_1_66_2","doi-asserted-by":"crossref","unstructured":"Ze Tang Xiaoyu Shen Chuanyi Li Jidong Ge Liguo Huang Zhelin Zhu and Bin Luo. 2022. AST-trans: Code summarization with efficient tree-structured attention. In Proceedings of the 44th International Conference on Software Engineering. 150\u2013162.","DOI":"10.1145\/3510003.3510224"},{"key":"e_1_3_1_67_2","unstructured":"Hugo Touvron Thibaut Lavril Gautier Izacard Xavier Martinet Marie-Anne Lachaux Timoth\u00e9e Lacroix Baptiste Rozi\u00e8re Naman Goyal Eric Hambro Faisal Azhar et al. 2023. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023)."},{"key":"e_1_3_1_68_2","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez \u0141ukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017)."},{"key":"e_1_3_1_69_2","doi-asserted-by":"crossref","unstructured":"Hao Wang Wenjie Qu Gilad Katz Wenyu Zhu Zeyu Gao Han Qiu Jianwei Zhuge and Chao Zhang. 2022. Jtrans: Jump-aware transformer for binary code similarity detection. In Proceedings of the 31st ACM SIGSOFT International Symposium on Software Testing and Analysis. 1\u201313.","DOI":"10.1145\/3533767.3534367"},{"key":"e_1_3_1_70_2","unstructured":"Hongqiu Wu Hai Zhao and Min Zhang. 2020. Code summarization with structure-induced transformer. arXiv preprint arXiv:2012.14710 (2020)."},{"key":"e_1_3_1_71_2","doi-asserted-by":"crossref","unstructured":"Jia Xu Lopamudra Mukherjee Yin Li Jamieson Warner James M Rehg and Vikas Singh. 2015. Gaze-enabled egocentric video summarization via constrained submodular maximization. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2235\u20132244.","DOI":"10.1109\/CVPR.2015.7298836"},{"key":"e_1_3_1_72_2","unstructured":"Victoria Yaneva Le An Ha Richard Evans and Ruslan Mitkov. 2020. Classifying referential and non-referential it using gaze. arXiv preprint arXiv:2006.13327 (2020)."},{"key":"e_1_3_1_73_2","unstructured":"Youngjae Yu Jongwook Choi Yeonhwa Kim Kyung Yoo Sang-Hun Lee and Gunhee Kim. 2017. Supervising neural attention models for video captioning by human gaze data. In Proceedings of the IEEE conference on computer vision and pattern recognition. 490\u2013498."},{"key":"e_1_3_1_74_2","doi-asserted-by":"crossref","unstructured":"Zhengran Zeng Hanzhuo Tan Haotian Zhang Jing Li Yuqun Zhang and Lingming Zhang. 2022. An extensive study on pre-trained models for program understanding and generation. In Proceedings of the 31st ACM SIGSOFT international symposium on software testing and analysis. 39\u201351.","DOI":"10.1145\/3533767.3534390"},{"key":"e_1_3_1_75_2","doi-asserted-by":"publisher","unstructured":"Yifan Zhang. [n. d.]. Reproduction Package for the FSE 2024 Paper \u201cEyeTrans: Merging Human and Machine Attention for Neural Code Summarization\u201d. https:\/\/doi.org\/10.5281\/zenodo.10684985 10.5281\/zenodo.10684985","DOI":"10.5281\/zenodo.10684985"},{"key":"e_1_3_1_76_2","doi-asserted-by":"crossref","unstructured":"Yingyi Zhang and Chengzhi Zhang. 2019. Using human attention to extract keyphrase from microblog post. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 5867\u20135872.","DOI":"10.18653\/v1\/P19-1588"},{"key":"e_1_3_1_77_2","doi-asserted-by":"crossref","unstructured":"Yue Zhao Gao Cong Jiachen Shi and Chunyan Miao. 2022. QueryFormer: a tree transformer model for query plan representation. Proceedings of the VLDB Endowment 15 8 (2022) 1658\u20131670.","DOI":"10.14778\/3529337.3529349"},{"key":"e_1_3_1_78_2","unstructured":"Wenyu Zhu Hao Wang Yuchen Zhou Jiaming Wang Zihan Sha Zeyu Gao and Chao Zhang. 2023. kTrans: Knowledge-Aware Transformer for Binary Code Embedding. arXiv preprint arXiv:2308.12659 (2023)."}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3643732","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3643732","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3643732","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T07:52:58Z","timestamp":1770191578000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3643732"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,12]]},"references-count":77,"journal-issue":{"issue":"FSE","published-print":{"date-parts":[[2024,7,12]]}},"alternative-id":["10.1145\/3643732"],"URL":"https:\/\/doi.org\/10.1145\/3643732","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,12]]}}}