{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,22]],"date-time":"2025-02-22T00:38:42Z","timestamp":1740184722083,"version":"3.37.3"},"reference-count":12,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,1,10]],"date-time":"2023-01-10T00:00:00Z","timestamp":1673308800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,1,10]],"date-time":"2023-01-10T00:00:00Z","timestamp":1673308800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100006952","name":"Louisiana Board of Regents","doi-asserted-by":"publisher","award":["AWD-AM210614"],"award-info":[{"award-number":["AWD-AM210614"]}],"id":[{"id":"10.13039\/100006952","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Discov Artif Intell"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Machine learning (ML) algorithms are often assumed to be the most accurate way of producing predictive models despite problems with explainability and adverse impact. The 3rd annual Society for Industrial and Organizational Psychology Machine Learning Competition sought to find ML models for personnel selection that could balance the best of ML prediction with the constraint of minimizing selection bias based on race and gender. To test the possible advantages of simple rules over ML algorithms, we entered a simple and explainable rule-based model inspired by recent advances in model comparison. This simple model outperformed most ML models entered and was comparable to the top performers while retaining positive qualities such as explainability and transparency.<\/jats:p>","DOI":"10.1007\/s44163-022-00044-2","type":"journal-article","created":{"date-parts":[[2023,1,10]],"date-time":"2023-01-10T12:02:49Z","timestamp":1673352169000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Simple rules outperform machine learning for personnel selection: insights from the 3rd annual SIOP machine learning competition"],"prefix":"10.1007","volume":"3","author":[{"given":"Jason L.","family":"Harman","sequence":"first","affiliation":[]},{"given":"Jaelle","family":"Scheuerman","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,1,10]]},"reference":[{"key":"44_CR1","first-page":"2","volume":"17","author":"N Shadbolt","year":"2002","unstructured":"Shadbolt N. A matter of trust. IEEE Intell Syst. 2002;17:2\u20133.","journal-title":"IEEE Intell Syst"},{"key":"44_CR2","unstructured":"Angwin J, Larson J, Mattu S, Kirchner L. Machine bias. ProPublica. 2016. https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing."},{"issue":"6464","key":"44_CR3","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1126\/science.aaz3873","volume":"366","author":"R Benjamin","year":"2019","unstructured":"Benjamin R. Assessing risk, automating racism. Science. 2019;366(6464):421\u20132.","journal-title":"Science"},{"key":"44_CR4","unstructured":"Kirchner L, Goldstein M. How automated background checks freeze out renters. The New York Times. 2020. https:\/\/www.nytimes.com\/2020\/05\/28\/business\/renters-background-checks.html. Accessed 15 Aug 2022."},{"key":"44_CR5","doi-asserted-by":"publisher","first-page":"352","DOI":"10.1016\/j.jmp.2008.04.003","volume":"52","author":"L Martignon","year":"2008","unstructured":"Martignon L, Katsikopoulos KV, Woike JK. Categorization with limited resources: a family of simple heuristics. J Math Psychol. 2008;52:352\u201361.","journal-title":"J Math Psychol"},{"key":"44_CR6","unstructured":"Frederik J, Martijn M. The new dot com bubble is here: it\u2019s called online advertising. The Correspondent. 2019. https:\/\/thecorrespondent.com\/100\/the-new-dot-com-bubble-is-here-its-called-online-advertising\/13228924500-22d5fd24. Accessed 15 Aug 2022."},{"key":"44_CR7","doi-asserted-by":"publisher","first-page":"451","DOI":"10.1146\/annurev-psych-120709-145346","volume":"62","author":"G Gigerenzer","year":"2011","unstructured":"Gigerenzer G, Gaissmaier W. Heuristic decision making. Annu Rev Psychol. 2011;62:451\u201382.","journal-title":"Annu Rev Psychol"},{"issue":"2","key":"44_CR8","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1016\/j.jmp.2010.07.002","volume":"55","author":"KV Katsikopoulos","year":"2011","unstructured":"Katsikopoulos KV. How to model it? Review of \u201ccognitive modeling\u201d (J. R. Busemeyer and A. Diederich). J Math Psychol. 2011;55(2):198\u2013201.","journal-title":"J Math Psychol"},{"key":"44_CR9","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1016\/j.omega.2017.09.005","volume":"81","author":"KV Katsikopoulos","year":"2018","unstructured":"Katsikopoulos KV, Durbach IN, Stewart TJ. When should we use simple decision models? a synthesis of various research strands. Omega\u2014Int J Manag Sci. 2018;81:17\u201325.","journal-title":"Omega\u2014Int J Manag Sci"},{"key":"44_CR10","doi-asserted-by":"publisher","first-page":"995","DOI":"10.1037\/rev0000274","volume":"128","author":"JL Harman","year":"2021","unstructured":"Harman JL, Yu M, Konstantinidis E, Gonzalez C. How to use a multi-criteria comparison procedure to improve modeling competitions. Psychol Rev. 2021;128:995\u20131005.","journal-title":"Psychol Rev"},{"key":"44_CR11","unstructured":"Koenig N, Thompson I. The 2020\u20132021 SIOP machine learning competition. Presented at the 36th annual Society for Industrial and Organizational Psychology conference in New Orleans, LA. https:\/\/github.com\/izk8\/2021_SIOP_Machine_Learning_Winners. Accessed 15 Aug 2022."},{"key":"44_CR12","unstructured":"Harman JL, Scheuerman J. Multi-criteria comparison as a method of advancing knowledge-guided machine learning. Proceedings of the Association for the Advancement of Artificial Intelligence 2022 Fall Symposium on Knowledge Guided Machine Learning. 2022."}],"container-title":["Discover Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44163-022-00044-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44163-022-00044-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44163-022-00044-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,10]],"date-time":"2023-01-10T12:29:24Z","timestamp":1673353764000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44163-022-00044-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,10]]},"references-count":12,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["44"],"URL":"https:\/\/doi.org\/10.1007\/s44163-022-00044-2","relation":{},"ISSN":["2731-0809"],"issn-type":[{"type":"electronic","value":"2731-0809"}],"subject":[],"published":{"date-parts":[[2023,1,10]]},"assertion":[{"value":"20 September 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 December 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 January 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"2"}}