{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T23:27:14Z","timestamp":1773098834875,"version":"3.50.1"},"reference-count":43,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,6,28]],"date-time":"2023-06-28T00:00:00Z","timestamp":1687910400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1658758"],"award-info":[{"award-number":["1658758"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1658760"],"award-info":[{"award-number":["1658760"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>When job seekers are unsuccessful in getting a position, they often do not get feedback to inform them on how to develop a better application in the future. Therefore, there is a critical need to understand what qualifications recruiters value in order to help applicants. To address this need, we utilized eye-trackers to measure and record visual data of recruiters screening resumes to gain insight into which Areas of Interest (AOIs) influenced recruiters\u2019 decisions the most. Using just this eye-tracking data, we trained a machine learning classifier to predict whether or not a recruiter would move a resume on to the next level of the hiring process with an AUC of 0.767. We found that features associated with recruiters looking outside the content of a resume were most predictive of their decision as well as total time viewing the resume and time spent on the Experience and Education sections. We hypothesize that this behavior is indicative of the recruiter reflecting on the content of the resume. These initial results show that applicants should focus on designing clear and concise resumes that are easy for recruiters to absorb and think about, with additional attention given to the Experience and Education sections.<\/jats:p>","DOI":"10.3390\/make5030038","type":"journal-article","created":{"date-parts":[[2023,6,29]],"date-time":"2023-06-29T01:53:57Z","timestamp":1688003637000},"page":"713-724","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Using Machine Learning with Eye-Tracking Data to Predict if a Recruiter Will Approve a Resume"],"prefix":"10.3390","volume":"5","author":[{"given":"Angel","family":"Pina","sequence":"first","affiliation":[{"name":"Sketch Recognition Lab., Department of Computer Science & Engineering, Texas A&M University, College Station, TX 77843, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5221-7418","authenticated-orcid":false,"given":"Corbin","family":"Petersheim","sequence":"additional","affiliation":[{"name":"Sketch Recognition Lab., Department of Computer Science & Engineering, Texas A&M University, College Station, TX 77843, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7749-2109","authenticated-orcid":false,"given":"Josh","family":"Cherian","sequence":"additional","affiliation":[{"name":"Sketch Recognition Lab., Department of Computer Science & Engineering, Texas A&M University, College Station, TX 77843, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4674-6647","authenticated-orcid":false,"given":"Joanna Nicole","family":"Lahey","sequence":"additional","affiliation":[{"name":"Bush School of Government and Public Service, Texas A&M University, College Station, TX 77843, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0072-1874","authenticated-orcid":false,"given":"Gerianne","family":"Alexander","sequence":"additional","affiliation":[{"name":"Department of Psychology, Texas A&M University, College Station, TX 77843, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7272-0507","authenticated-orcid":false,"given":"Tracy","family":"Hammond","sequence":"additional","affiliation":[{"name":"Sketch Recognition Lab., Department of Computer Science & Engineering, Texas A&M University, College Station, TX 77843, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,6,28]]},"reference":[{"key":"ref_1","first-page":"4","article-title":"Resume content: What should be included and excluded","volume":"60","author":"Hornsby","year":"1995","journal-title":"SAM Adv. Manag. J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1023\/A:1022974232557","article-title":"Resume Characteristics as Predictors of an Invitation to Interview","volume":"13","author":"Thoms","year":"1999","journal-title":"J. Bus. Psychol."},{"key":"ref_3","first-page":"2","article-title":"Intelligent software tools for recruiting","volume":"28","author":"Kulkarni","year":"2019","journal-title":"J. Int. Technol. Inf. Manag."},{"key":"ref_4","unstructured":"Shellenbarger, S. (2022, November 10). Life & Arts: Make Your Job Application Robot-Proof\u2014It Takes Planning to Make Sure AI Gatekeepers Don\u2019t Bounce Your Resume before a Human Can Make a Call. Available online: https:\/\/www.wsj.com\/articles\/make-your-job-application-robot-proof-11576492201."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1177\/108056999105400306","article-title":"An analysis of effective resume content, format, and appearance based on college recruiter perceptions","volume":"54","author":"Schramm","year":"1991","journal-title":"Bull. Assoc. Bus. Commun."},{"key":"ref_6","unstructured":"Noonan, R. (2022, November 10). STEM Jobs: 2017 Update, Available online: https:\/\/eric.ed.gov\/?id=ED594354."},{"key":"ref_7","unstructured":"Jobvite (2022, November 10). Recruiting Benchmark Report. Available online: https:\/\/www.jobvite.com\/wp-content\/uploads\/2019\/03\/2019-Recruiting-Benchmark-Report.pdf."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kabicher, S., Motschnig-Pitrik, R., and Figl, K. (2009, January 18\u201321). What competences do employers, staff and students expect from a Computer Science graduate?. Proceedings of the 39th IEEE Frontiers in Education Conference, San Antonio, TX, USA.","DOI":"10.1109\/FIE.2009.5350536"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"169","DOI":"10.5539\/jedp.v7n1p169","article-title":"The Resume Research Literature: Where Have We Been and Where Should We Go Next?","volume":"7","author":"Risavy","year":"2017","journal-title":"J. Educ. Dev. Psychol."},{"key":"ref_10","unstructured":"Guo, S., and Hammond, T. (2015). ResuMatcher: A Personalized Resume-Job Matching System, Texas A & M University."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1007\/BF02230985","article-title":"Impressions of the Resume: The Effects of Applicant Education, Experience, and Impression Management","volume":"9","author":"Stephen","year":"1994","journal-title":"J. Bus. Psychol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"897","DOI":"10.1037\/0021-9010.79.6.897","article-title":"Biodata phenomenology: Recruiters\u2019 perceptions and use of biographical information in resume screening","volume":"79","author":"Brown","year":"1994","journal-title":"J. Appl. Psychol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1006\/jvbe.1993.1050","article-title":"Recruiter Perceptions of Applicant Fit: Implications for Individual Career Preparation and Job Search Behavior","volume":"43","author":"Bretz","year":"1993","journal-title":"J. Vocat. Behav."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"546","DOI":"10.1037\/0021-9010.82.4.546","article-title":"Interviewers\u2019 Perceptions of Person-Organization Fit and Organizational Selection Decisions","volume":"82","author":"Cable","year":"1997","journal-title":"J. Appl. Psychol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1037\/0021-9010.85.3.399","article-title":"College grade point average as a personnel selection device: Ethnic group differences and potential adverse impact","volume":"85","author":"Roth","year":"2000","journal-title":"J. Appl. Psychol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1177\/0273475302242010","article-title":"The value of students\u2019 classroom experiences from the eyes of the recruiter: Information, implications, and recommendations for marketing educators","volume":"24","author":"Barr","year":"2002","journal-title":"J. Mark. Educ."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1111\/j.1744-6570.1994.tb01740.x","article-title":"Judgments of fit in the selection process: The role of work value congruence","volume":"47","author":"Adkins","year":"1994","journal-title":"Pers. Psychol."},{"key":"ref_18","first-page":"8","article-title":"Identifying exceptional application software developers: A comparison of students and professionals","volume":"11","author":"Clark","year":"2003","journal-title":"Commun. Assoc. Inf. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"548","DOI":"10.1037\/0021-9010.81.5.548","article-title":"Meta-analyzing the relationship between grades and job performance","volume":"81","author":"Roth","year":"1996","journal-title":"J. Appl. Psychol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1177\/108056999706000206","article-title":"Personnel Administrators\u2019 Preferences for R\u00e9sum\u00e9 Content: Ten Years After","volume":"60","author":"Hutchinson","year":"1997","journal-title":"Bus. Commun. Q."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"887","DOI":"10.1111\/j.1744-6570.1995.tb01785.x","article-title":"The relationship between work experience and job performance: A conceptual and meta-analytic review","volume":"48","author":"Ford","year":"1995","journal-title":"Pers. Psychol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1037\/0021-9010.76.4.550","article-title":"Relative effect of applicant work experience and academic qualification on selection interview decisions: A study of between-sample generalizability","volume":"76","author":"Singer","year":"1991","journal-title":"J. Appl. Psychol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1177\/002194368402100401","article-title":"Personnel Administrators\u2019 Preferences for R\u00e9sum\u00e9 Content: A Survey and Review of Empirically Based Conclusions","volume":"21","author":"Hutchinson","year":"1984","journal-title":"J. Bus. Commun. (1973)"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1111\/j.1464-0597.2007.00288.x","article-title":"Recruiters\u2019 Perceptions and Use of Applicant R\u00e9sum\u00e9 Information: Screening the Recent Graduate","volume":"56","author":"Cole","year":"2007","journal-title":"Appl. Psychol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1080\/02673843.2014.996236","article-title":"Grade point average and biographical data in personal resumes: Predictors of finding employment","volume":"20","author":"Sulastri","year":"2015","journal-title":"Int. J. Adolesc. Youth"},{"key":"ref_26","first-page":"1","article-title":"Student internships and employment opportunities after graduation: A field experiment","volume":"83","author":"Baert","year":"2019","journal-title":"Econ. Educ. Rev."},{"key":"ref_27","first-page":"106","article-title":"Changing qualifications for entry-level application developers","volume":"20","author":"Ferguson","year":"2005","journal-title":"J. Comput. Sci. Coll."},{"key":"ref_28","first-page":"8","article-title":"Knowledge and skill requirements for entry-level IT workers: A longitudinal study","volume":"23","author":"Aasheim","year":"2019","journal-title":"J. Inf. Syst. Educ."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"530","DOI":"10.1037\/0021-9010.71.3.530","article-title":"College experiences and managerial performance","volume":"71","author":"Howard","year":"1986","journal-title":"J. Appl. Psychol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1111\/1468-2389.00210","article-title":"The Differential Effects of Extracurricular Activities on Attributions in R\u00e9sum\u00e9 Evaluation","volume":"10","author":"Nemanick","year":"2002","journal-title":"Int. J. Sel. Assess."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1002\/hrm.10053","article-title":"Using extracurricular activity as an indicator of interpersonal skill: Prudent evaluation or recruiting malpractice?","volume":"41","author":"Rubin","year":"2002","journal-title":"Hum. Resour. Manag."},{"key":"ref_32","unstructured":"Poole, A., and Ball, L.J. (2006). Encyclopedia of Human Computer Interaction, IGI Global."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1007\/s10339-012-0499-z","article-title":"Gaze and eye-tracking solutions for psychological research","volume":"13","author":"Mele","year":"2012","journal-title":"Cogn. Process."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.cortex.2017.05.024","article-title":"Eying the future: Eye movement in past and future thinking","volume":"105","author":"Lenoble","year":"2018","journal-title":"Cortex"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1177\/1080569913501860","article-title":"Updating Best Practices: Applying On-Screen Reading Strategies to R\u00e9sum\u00e9 Writing","volume":"76","author":"Diaz","year":"2013","journal-title":"Bus. Commun. Q."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Lahey, J.N., and Oxley, D.R. (2018). Discrimination at the Intersection of Age, Race, and Gender: Evidence from a Lab-in-the-Field Experiment, National Bureau of Economic Research.","DOI":"10.3386\/w25357"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Shalev-Shwartz, S., and Ben-David, S. (2014). Understanding Machine Learning: From Theory to Algorithms, Cambridge University Press.","DOI":"10.1017\/CBO9781107298019"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Yu, K., Guan, G., and Zhou, M. (2005, January 25\u201330). Resume information extraction with cascaded hybrid model. Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL\u201905), Ann Arbor, MI, USA.","DOI":"10.3115\/1219840.1219902"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/j.eswa.2016.04.013","article-title":"R\u00e9suMatcher: A personalized r\u00e9sum\u00e9-job matching system","volume":"60","author":"Guo","year":"2016","journal-title":"Expert Syst. Appl."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2318","DOI":"10.1016\/j.procs.2020.03.284","article-title":"A Machine Learning approach for automation of Resume Recommendation system","volume":"167","author":"Roy","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"832","DOI":"10.1002\/mp.12100","article-title":"Fractal analysis of visual search activity for mass detection during mammographic screening","volume":"44","author":"Alamudun","year":"2017","journal-title":"Med. Phys."},{"key":"ref_42","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_43","first-page":"329","article-title":"Deep ROC analysis and AUC as balanced average accuracy, for improved classifier selection, audit and explanation","volume":"60","author":"Carrington","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/5\/3\/38\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:02:24Z","timestamp":1760126544000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/5\/3\/38"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,28]]},"references-count":43,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["make5030038"],"URL":"https:\/\/doi.org\/10.3390\/make5030038","relation":{},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,28]]}}}