{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T18:49:33Z","timestamp":1776106173512,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":66,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,7,26]],"date-time":"2022-07-26T00:00:00Z","timestamp":1658793600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1934464, 1916505, 1922658"],"award-info":[{"award-number":["1934464, 1916505, 1922658"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,7,26]]},"DOI":"10.1145\/3514094.3534189","type":"proceedings-article","created":{"date-parts":[[2022,7,27]],"date-time":"2022-07-27T22:25:13Z","timestamp":1658960713000},"page":"572-587","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Resume Format, LinkedIn URLs and Other Unexpected Influences on AI Personality Prediction in Hiring: Results of an Audit"],"prefix":"10.1145","author":[{"given":"Alene","family":"Rhea","sequence":"first","affiliation":[{"name":"New York University, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kelsey","family":"Markey","sequence":"additional","affiliation":[{"name":"New York University, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lauren","family":"D'Arinzo","sequence":"additional","affiliation":[{"name":"New York University, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hilke","family":"Schellmann","sequence":"additional","affiliation":[{"name":"New York University, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mona","family":"Sloane","sequence":"additional","affiliation":[{"name":"New York University, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul","family":"Squires","sequence":"additional","affiliation":[{"name":"New York University, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julia","family":"Stoyanovich","sequence":"additional","affiliation":[{"name":"New York University, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,7,27]]},"reference":[{"key":"e_1_3_2_2_1_1","first-page":"80","article-title":"An Auditing Imperative for Automated Hiring Systems","volume":"34","author":"Ajunwa Ifeoma","year":"2021","unstructured":"Ifeoma Ajunwa . 2021 . An Auditing Imperative for Automated Hiring Systems . Harvard Journal of Law & Technology 34 , 2 (2021), 80 . https:\/\/doi.org\/10.2139\/ssrn.3437631 10.2139\/ssrn.3437631 Ifeoma Ajunwa. 2021. An Auditing Imperative for Automated Hiring Systems. Harvard Journal of Law & Technology 34, 2 (2021), 80. https:\/\/doi.org\/10.2139\/ssrn.3437631","journal-title":"Harvard Journal of Law & Technology"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1108\/IJCED-12-2016-0023"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449148"},{"key":"e_1_3_2_2_4_1","article-title":"Big Data's Disparate Impact","volume":"671","author":"Barocas Solon","year":"2016","unstructured":"Solon Barocas and Andrew D. Selbst . 2016 . Big Data's Disparate Impact . California Law Review 671 , 104 (2016). https:\/\/doi.org\/10.2139\/ssrn.2477899 10.2139\/ssrn.2477899 Solon Barocas and Andrew D. Selbst. 2016. Big Data's Disparate Impact. California Law Review 671, 104 (2016). https:\/\/doi.org\/10.2139\/ssrn.2477899","journal-title":"California Law Review"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1995.tb02031.x"},{"key":"e_1_3_2_2_6_1","unstructured":"Miranda Bogen and Aaron Rieke. 2018. Help Wanted: An Exploration of Hiring Algorithms Equity and Bias. Technical Report. Upturn. 75 pages. https:\/\/www.upturn.org\/static\/reports\/2018\/hiring-algorithms\/files\/Upturn%20--%20Help%20Wanted%20-%20An%20Exploration%20of%20Hiring%20Algorithms %20Equity%20and%20Bias.pdf  Miranda Bogen and Aaron Rieke. 2018. Help Wanted: An Exploration of Hiring Algorithms Equity and Bias. Technical Report. Upturn. 75 pages. https:\/\/www.upturn.org\/static\/reports\/2018\/hiring-algorithms\/files\/Upturn%20--%20Help%20Wanted%20-%20An%20Exploration%20of%20Hiring%20Algorithms %20Equity%20and%20Bias.pdf"},{"key":"e_1_3_2_2_7_1","volume-title":"The algorithm audit: Scoring the algorithms that score us","author":"Brown Shea","year":"2021","unstructured":"Shea Brown , Jovana Davidovic , and Ali Hasan . 2021. The algorithm audit: Scoring the algorithms that score us . Big Data & Society 8, 1 ( Jan. 2021 ), 2053951720983865. https:\/\/doi.org\/10.1177\/2053951720983865 Publisher : SAGE Publications Ltd . 10.1177\/2053951720983865 Shea Brown, Jovana Davidovic, and Ali Hasan. 2021. The algorithm audit: Scoring the algorithms that score us. Big Data & Society 8, 1 (Jan. 2021), 2053951720983865. https:\/\/doi.org\/10.1177\/2053951720983865 Publisher: SAGE Publications Ltd."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1976.tb00003.x"},{"key":"e_1_3_2_2_9_1","volume-title":"Reliability and Validity Assessment","author":"Carmines Edward","unstructured":"Edward Carmines and Richard Zeller . 1979. Reliability and Validity Assessment . SAGE Publications, Inc., 2455 Teller Road , Thousand Oaks California 91320 United States of America . https:\/\/doi.org\/10.4135\/9781412985642 10.4135\/9781412985642 Edward Carmines and Richard Zeller. 1979. Reliability and Validity Assessment. SAGE Publications, Inc., 2455 Teller Road, Thousand Oaks California 91320 United States of America. https:\/\/doi.org\/10.4135\/9781412985642"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174225"},{"key":"e_1_3_2_2_11_1","unstructured":"\"The European Commission\". 2021. Better regulation toolbox. https:\/\/ec.europa.eu\/info\/law\/law-making-process\/planning-and-proposing-law\/better-regulation-why-and-how\/better-regulation-guidelines-and-toolbox\/better-regulation-toolbox_en.  \"The European Commission\". 2021. Better regulation toolbox. https:\/\/ec.europa.eu\/info\/law\/law-making-process\/planning-and-proposing-law\/better-regulation-why-and-how\/better-regulation-guidelines-and-toolbox\/better-regulation-toolbox_en."},{"key":"e_1_3_2_2_12_1","volume-title":"Amazon scraps secret AI recruiting tool that showed bias against women","author":"Dastin Jeffrey","year":"2018","unstructured":"Jeffrey Dastin . 2018. Amazon scraps secret AI recruiting tool that showed bias against women . Reuters (Oct . 2018 ). https:\/\/www.reuters.com\/article\/us-amazon-com-jobs-automation-insight-idUSKCN1MK08G Jeffrey Dastin. 2018. Amazon scraps secret AI recruiting tool that showed bias against women. Reuters (Oct. 2018). https:\/\/www.reuters.com\/article\/us-amazon-com-jobs-automation-insight-idUSKCN1MK08G"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1515\/popets-2015-0007"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287572"},{"key":"e_1_3_2_2_15_1","volume-title":"The Personality Brokers: The Strange History of Myers-Briggs and the Birth of Personality Testing","author":"Emre Merve","unstructured":"Merve Emre . 2018. The Personality Brokers: The Strange History of Myers-Briggs and the Birth of Personality Testing ( first ed.). Doubleday , New York . Merve Emre. 2018. The Personality Brokers: The Strange History of Myers-Briggs and the Birth of Personality Testing (first ed.). Doubleday, New York."},{"key":"e_1_3_2_2_16_1","volume-title":"Department of Labor, and Department of Justice.","author":"Equal Employment Opportunity Commission (EEOC)","year":"1978","unstructured":"Equal Employment Opportunity Commission (EEOC) , Civil Service Commission , Department of Labor, and Department of Justice. 1978 . Uniform guidelines on employee selection procedures. Federal Register (Aug . 1978). https:\/\/www.ojp.gov\/pdffiles1\/Digitization\/58846NCJRS.pdf Equal Employment Opportunity Commission (EEOC), Civil Service Commission, Department of Labor, and Department of Justice. 1978. Uniform guidelines on employee selection procedures. Federal Register (Aug. 1978). https:\/\/www.ojp.gov\/pdffiles1\/Digitization\/58846NCJRS.pdf"},{"key":"e_1_3_2_2_17_1","volume-title":"Principled Artificial Intelligence: Mapping Consensus in Ethical and Rights-Based Approaches to Principles for AI. SSRN Electronic Journal","author":"Fjeld Jessica","year":"2020","unstructured":"Jessica Fjeld , Nele Achten , Hannah Hilligoss , Adam Nagy , and Madhulika Srikumar . 2020. Principled Artificial Intelligence: Mapping Consensus in Ethical and Rights-Based Approaches to Principles for AI. SSRN Electronic Journal ( 2020 ). https:\/\/doi.org\/10.2139\/ssrn.3518482 10.2139\/ssrn.3518482 Jessica Fjeld, Nele Achten, Hannah Hilligoss, Adam Nagy, and Madhulika Srikumar. 2020. Principled Artificial Intelligence: Mapping Consensus in Ethical and Rights-Based Approaches to Principles for AI. SSRN Electronic Journal (2020). https:\/\/doi.org\/10.2139\/ssrn.3518482"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/230538.230561"},{"key":"e_1_3_2_2_19_1","volume-title":"Questioning the Ecological Footprint. Ecological Indicators 69 (Oct","author":"Galli Alessandro","year":"2016","unstructured":"Alessandro Galli , Mario Giampietro , Steve Goldfinger , Elias Lazarus , David Lin , Andrea Saltelli , Mathis Wackernagel , and Felix M\u00fcller . 2016. Questioning the Ecological Footprint. Ecological Indicators 69 (Oct . 2016 ), 224--232. https:\/\/doi.org\/10.1016\/j.ecolind.2016.04.014 10.1016\/j.ecolind.2016.04.014 Alessandro Galli, Mario Giampietro, Steve Goldfinger, Elias Lazarus, David Lin, Andrea Saltelli, Mathis Wackernagel, and Felix M\u00fcller. 2016. Questioning the Ecological Footprint. Ecological Indicators 69 (Oct. 2016), 224--232. https:\/\/doi.org\/10.1016\/j.ecolind.2016.04.014"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022941331649"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1744-6570.1965.tb00273.x"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1017\/iop.2015.40"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11023-020-09517-8"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998327"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.75.5.581"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.85.6.869"},{"key":"e_1_3_2_2_27_1","volume-title":"Challenging Biased Hiring Algorithms. SSRN Scholarly Paper ID 3744248. Social Science Research Network","author":"Kelly-Lyth Aislinn","unstructured":"Aislinn Kelly-Lyth . 2020. Challenging Biased Hiring Algorithms. SSRN Scholarly Paper ID 3744248. Social Science Research Network , Rochester, NY . https:\/\/papers.ssrn.com\/abstract=3744248 Aislinn Kelly-Lyth. 2020. Challenging Biased Hiring Algorithms. SSRN Scholarly Paper ID 3744248. Social Science Research Network, Rochester, NY. https:\/\/papers.ssrn.com\/abstract=3744248"},{"key":"e_1_3_2_2_28_1","first-page":"81","article-title":"Data-Driven Discrimination at Work","volume":"58","author":"Kim Pauline T","year":"2017","unstructured":"Pauline T Kim . 2017 . Data-Driven Discrimination at Work . William & Mary Law 58 (2017), 81 . Pauline T Kim. 2017. Data-Driven Discrimination at Work. William & Mary Law 58 (2017), 81.","journal-title":"William & Mary Law"},{"key":"e_1_3_2_2_30_1","volume-title":"Hiring Fairly in the Age of Algorithms. arXiv:2004.07132 [cs] (April","author":"Langenkamp Max","year":"2020","unstructured":"Max Langenkamp , Allan Costa , and Chris Cheung . 2020. Hiring Fairly in the Age of Algorithms. arXiv:2004.07132 [cs] (April 2020 ). http:\/\/arxiv.org\/abs\/2004.07132 arXiv: 2004.07132. Max Langenkamp, Allan Costa, and Chris Cheung. 2020. Hiring Fairly in the Age of Algorithms. arXiv:2004.07132 [cs] (April 2020). http:\/\/arxiv.org\/abs\/2004.07132 arXiv: 2004.07132."},{"key":"e_1_3_2_2_31_1","volume-title":"Nutrition and public health economic evaluations under the lenses of post normal science | Elsevier Enhanced Reader. Futures 112","author":"Piano Samuele Lo","year":"2019","unstructured":"Samuele Lo Piano and Marguerite Robinson . 2019. Nutrition and public health economic evaluations under the lenses of post normal science | Elsevier Enhanced Reader. Futures 112 ( 2019 ). https:\/\/doi.org\/10.1016\/j.futures.2019.06.008 10.1016\/j.futures.2019.06.008 Samuele Lo Piano and Marguerite Robinson. 2019. Nutrition and public health economic evaluations under the lenses of post normal science | Elsevier Enhanced Reader. Futures 112 (2019). https:\/\/doi.org\/10.1016\/j.futures.2019.06.008"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1037\/hop0000081"},{"key":"e_1_3_2_2_33_1","unstructured":"Dori Meinert. 2015. What Do Personality Tests Really Reveal? https:\/\/www.shrm.org\/hr-today\/news\/hr-magazine\/pages\/0615-personality-tests.aspx  Dori Meinert. 2015. What Do Personality Tests Really Reveal? https:\/\/www.shrm.org\/hr-today\/news\/hr-magazine\/pages\/0615-personality-tests.aspx"},{"key":"e_1_3_2_2_34_1","volume-title":"Ranjit Singh, and Madeleine Clare Elish.","author":"Metcalf Jacob","year":"2021","unstructured":"Jacob Metcalf , Emanuel Moss , Elizabeth Anne Watkins , Ranjit Singh, and Madeleine Clare Elish. 2021 . Algorithmic Impact Assessments and Accountability: The Co-construction of Impacts . https:\/\/papers.ssrn.com\/abstract=3736261 Jacob Metcalf, Emanuel Moss, Elizabeth Anne Watkins, Ranjit Singh, and Madeleine Clare Elish. 2021. Algorithmic Impact Assessments and Accountability: The Co-construction of Impacts. https:\/\/papers.ssrn.com\/abstract=3736261"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1744-6570.2007.00089.x"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1080\/02701367.1993.10608821"},{"key":"e_1_3_2_2_37_1","volume-title":"Knapp","author":"Mueller Ralph O.","year":"2018","unstructured":"Ralph O. Mueller and Thomas R . Knapp . 2018 . Reliability and Validity. In The Reviewer's Guide to Quantitative Methods in the Social Sciences (2 ed.). Routledge . Num Pages: 5. Ralph O. Mueller and Thomas R. Knapp. 2018. Reliability and Validity. In The Reviewer's Guide to Quantitative Methods in the Social Sciences (2 ed.). Routledge. Num Pages: 5."},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11948-021-00319-4"},{"key":"e_1_3_2_2_39_1","volume-title":"Bernstein","author":"Nunnally Jum C.","year":"1994","unstructured":"Jum C. Nunnally and Ira H . Bernstein . 1994 . Psychometric Theory (3 ed.). McGraw-Hill , Inc. Jum C. Nunnally and Ira H. Bernstein. 1994. Psychometric Theory (3 ed.). McGraw-Hill, Inc."},{"key":"e_1_3_2_2_40_1","volume-title":"Saul Calderon-Ramirez, Danny Xie Li, Gabriel Nobis, Erick Alejandro Mu\u00f1oz Alvarado, Giovanna Jaramillo-Gutierrez, Christian Matek, Arun Shroff, Ferath Kherif, Bruno Sanguinetti, and Thomas Wiegand.","author":"Oala Luis","year":"2020","unstructured":"Luis Oala , Jana Fehr , Luca Gilli , Pradeep Balachandran , Alixandro Werneck Leite , Saul Calderon-Ramirez, Danny Xie Li, Gabriel Nobis, Erick Alejandro Mu\u00f1oz Alvarado, Giovanna Jaramillo-Gutierrez, Christian Matek, Arun Shroff, Ferath Kherif, Bruno Sanguinetti, and Thomas Wiegand. 2020 . ML4H Auditing : From Paper to Practice. In Machine Learning for Health. PMLR, 280--317. https:\/\/proceedings.mlr.press\/v136\/oala20a.html ISSN : 2640--3498. Luis Oala, Jana Fehr, Luca Gilli, Pradeep Balachandran, Alixandro Werneck Leite, Saul Calderon-Ramirez, Danny Xie Li, Gabriel Nobis, Erick Alejandro Mu\u00f1oz Alvarado, Giovanna Jaramillo-Gutierrez, Christian Matek, Arun Shroff, Ferath Kherif, Bruno Sanguinetti, and Thomas Wiegand. 2020. ML4H Auditing: From Paper to Practice. In Machine Learning for Health. PMLR, 280--317. https:\/\/proceedings.mlr.press\/v136\/oala20a.html ISSN: 2640--3498."},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372828"},{"key":"e_1_3_2_2_43_1","volume-title":"Rebecca N White, Margaret Mitchell, Timnit Gebru, Ben Hutchinson, Jamila Smith-Loud, Daniel Theron, and Parker Barnes.","author":"Raji Inioluwa Deborah","year":"2020","unstructured":"Inioluwa Deborah Raji , Andrew Smart , Rebecca N White, Margaret Mitchell, Timnit Gebru, Ben Hutchinson, Jamila Smith-Loud, Daniel Theron, and Parker Barnes. 2020 . Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing. ACM, Barcelona, Spain , 12. https:\/\/doi.org\/10.1145\/3351095.3372873 10.1145\/3351095.3372873 Inioluwa Deborah Raji, Andrew Smart, Rebecca N White, Margaret Mitchell, Timnit Gebru, Ben Hutchinson, Jamila Smith-Loud, Daniel Theron, and Parker Barnes. 2020. Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing. ACM, Barcelona, Spain, 12. https:\/\/doi.org\/10.1145\/3351095.3372873"},{"key":"#cr-split#-e_1_3_2_2_44_1.1","doi-asserted-by":"crossref","unstructured":"Saman Razavi Anthony Jakeman Andrea Saltelli Cl\u00e9mentine Prieur Bertrand Iooss Emanuele Borgonovo Elmar Plischke Samuele Lo Piano Takuya Iwanaga William Becker Stefano Tarantola Joseph H. A. Guillaume John Jakeman Hoshin Gupta Nicola Melillo Giovanni Rabitti Vincent Chabridon Qingyun Duan Xifu Sun Stef\u00e1n Smith Razi Sheikholeslami Nasim Hosseini Masoud Asadzadeh Arnald Puy Sergei Kucherenko and Holger R. Maier. 2021. The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support. Environmental Modelling & Software 137 (March 2021) 104954. https:\/\/doi.org\/10.1016\/j.envsoft.2020.104954 10.1016\/j.envsoft.2020.104954","DOI":"10.1016\/j.envsoft.2020.104954"},{"key":"#cr-split#-e_1_3_2_2_44_1.2","doi-asserted-by":"crossref","unstructured":"Saman Razavi Anthony Jakeman Andrea Saltelli Cl\u00e9mentine Prieur Bertrand Iooss Emanuele Borgonovo Elmar Plischke Samuele Lo Piano Takuya Iwanaga William Becker Stefano Tarantola Joseph H. A. Guillaume John Jakeman Hoshin Gupta Nicola Melillo Giovanni Rabitti Vincent Chabridon Qingyun Duan Xifu Sun Stef\u00e1n Smith Razi Sheikholeslami Nasim Hosseini Masoud Asadzadeh Arnald Puy Sergei Kucherenko and Holger R. Maier. 2021. The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support. Environmental Modelling & Software 137 (March 2021) 104954. https:\/\/doi.org\/10.1016\/j.envsoft.2020.104954","DOI":"10.1016\/j.envsoft.2020.104954"},{"key":"e_1_3_2_2_45_1","volume-title":"Falaah Arif Khan, and Julia Stoyanovich","author":"Rhea Alene K.","year":"2022","unstructured":"Alene K. Rhea , Kelsey Markey , Lauren D'Arinzo , Hilke Schellmann , Mona Sloane , Paul Squires , Falaah Arif Khan, and Julia Stoyanovich . 2022 . An External Stability Audit Framework to Test the Validity of Personality Prediction in AI Hiring. CoRR abs\/2201.09151 (2022). arXiv:2201.09151 https:\/\/arxiv.org\/abs\/2201.09151 Alene K. Rhea, Kelsey Markey, Lauren D'Arinzo, Hilke Schellmann, Mona Sloane, Paul Squires, Falaah Arif Khan, and Julia Stoyanovich. 2022. An External Stability Audit Framework to Test the Validity of Personality Prediction in AI Hiring. CoRR abs\/2201.09151 (2022). arXiv:2201.09151 https:\/\/arxiv.org\/abs\/2201.09151"},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274417"},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-020-01812-9"},{"key":"e_1_3_2_2_48_1","first-page":"2","article-title":"Problematic Quantifications: a Critical Appraisal of Scenario Making for a Global ?Sustainable","volume":"1","author":"Saltelli Andrea","year":"2017","unstructured":"Andrea Saltelli and Samuele Lo Piano . 2017 . Problematic Quantifications: a Critical Appraisal of Scenario Making for a Global ?Sustainable ' Food Production. Food Ethics 1 , 2 (Aug. 2017), 173--179. https:\/\/doi.org\/10.1007\/s41055-017-0020--6 10.1007\/s41055-017-0020--6 Andrea Saltelli and Samuele Lo Piano. 2017. Problematic Quantifications: a Critical Appraisal of Scenario Making for a Global ?Sustainable' Food Production. Food Ethics 1, 2 (Aug. 2017), 173--179. https:\/\/doi.org\/10.1007\/s41055-017-0020--6","journal-title":"Food Production. Food Ethics"},{"key":"e_1_3_2_2_49_1","volume-title":"Auditing Algorithms: Research Methods for Detecting Discrimination on Internet Platforms. In Data and Discrimination: Converting Critical Concerns into Productive Inquiry.","author":"Sandvig Christian","year":"2014","unstructured":"Christian Sandvig , Kevin Hamilton , Karrie Karahalios , and Cedric Langbort . 2014 . Auditing Algorithms: Research Methods for Detecting Discrimination on Internet Platforms. In Data and Discrimination: Converting Critical Concerns into Productive Inquiry. Seattle, WA, USA , 23. Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cedric Langbort. 2014. Auditing Algorithms: Research Methods for Detecting Discrimination on Internet Platforms. In Data and Discrimination: Converting Critical Concerns into Productive Inquiry. Seattle, WA, USA, 23."},{"key":"e_1_3_2_2_50_1","volume-title":"Machines We Trust podcast series, MIT Technology Review","author":"Schellmann Hilke","year":"2021","unstructured":"Hilke Schellmann , Jennifer Strong , Ian, and Siegel. 2021. Hired by an algorithm. https:\/\/podcasts.apple.com\/us\/podcast\/hired-by-an-algorithm\/id1523584878?i=1000526571833 . In Machines We Trust podcast series, MIT Technology Review ( 2021 ). Hilke Schellmann, Jennifer Strong, Ian, and Siegel. 2021. Hired by an algorithm. https:\/\/podcasts.apple.com\/us\/podcast\/hired-by-an-algorithm\/id1523584878?i=1000526571833. In Machines We Trust podcast series, MIT Technology Review (2021)."},{"key":"e_1_3_2_2_51_1","volume-title":"Machines We Trust podcast series, MIT Technology Review","author":"Schellmann Hilke","year":"2021","unstructured":"Hilke Schellmann , Jennifer Strong , Ian, and Siegel. 2021. Want a job? The AI will see you now. https:\/\/podcasts.apple.com\/us\/podcast\/want-a-job-the-ai-will-see-you-now\/id1523584878?i=1000528104144 . In Machines We Trust podcast series, MIT Technology Review ( 2021 ). Hilke Schellmann, Jennifer Strong, Ian, and Siegel. 2021. Want a job? The AI will see you now. https:\/\/podcasts.apple.com\/us\/podcast\/want-a-job-the-ai-will-see-you-now\/id1523584878?i=1000528104144. In Machines We Trust podcast series, MIT Technology Review (2021)."},{"key":"e_1_3_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.8.2.206"},{"key":"e_1_3_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1744-6570.1984.tb00519.x"},{"key":"#cr-split#-e_1_3_2_2_54_1.1","unstructured":"Science Advice for Policy by European Academies (SAPEA). 2019. Making sense of science for policy under conditions of complexity and uncertainty. Science Advice for Policy by European Academies DE. https:\/\/doi.org\/10.26356\/masos 10.26356\/masos"},{"key":"#cr-split#-e_1_3_2_2_54_1.2","unstructured":"Science Advice for Policy by European Academies (SAPEA). 2019. Making sense of science for policy under conditions of complexity and uncertainty. Science Advice for Policy by European Academies DE. https:\/\/doi.org\/10.26356\/masos"},{"key":"e_1_3_2_2_55_1","volume-title":"Morris","author":"Scroggins Wesley A.","year":"2008","unstructured":"Wesley A. Scroggins , Steven L. Thomas , and Jerry A . Morris . 2008 . Psychological Testing in Personnel Selection, Part I: A Century of Psychological Testing. Public Personnel Management 37, 1 (March 2008), 99--109. https:\/\/doi.org\/10.1177\/009102600803700107 Publisher : SAGE Publications Inc . 10.1177\/009102600803700107 Wesley A. Scroggins, Steven L. Thomas, and Jerry A. Morris. 2008. Psychological Testing in Personnel Selection, Part I: A Century of Psychological Testing. Public Personnel Management 37, 1 (March 2008), 99--109. https:\/\/doi.org\/10.1177\/009102600803700107 Publisher: SAGE Publications Inc."},{"key":"e_1_3_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3375627.3375812"},{"key":"e_1_3_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3419764"},{"key":"e_1_3_2_2_58_1","unstructured":"Mona Sloane. 2021. The Algorithmic Auditing Trap. https:\/\/onezero.medium.com\/the-algorithmic-auditing-trap-9a6f2d4d461d  Mona Sloane. 2021. The Algorithmic Auditing Trap. https:\/\/onezero.medium.com\/the-algorithmic-auditing-trap-9a6f2d4d461d"},{"key":"e_1_3_2_2_59_1","volume-title":"Pseudo-Science, and the Quest for Auditability. Patterns 3, 2","author":"Sloane Mona","year":"2022","unstructured":"Mona Sloane , Emanuel Moss , and Rumman Chowdhury . 2022. A Silicon Valley Love Triangle: Hiring Algorithms , Pseudo-Science, and the Quest for Auditability. Patterns 3, 2 ( 2022 ). https:\/\/doi.org\/10.1016\/j.patter.2021.100425 10.1016\/j.patter.2021.100425 Mona Sloane, Emanuel Moss, and Rumman Chowdhury. 2022. A Silicon Valley Love Triangle: Hiring Algorithms, Pseudo-Science, and the Quest for Auditability. Patterns 3, 2 (2022). https:\/\/doi.org\/10.1016\/j.patter.2021.100425"},{"key":"e_1_3_2_2_60_1","volume-title":"Physiognomic Artificial Intelligence. SSRN Electronic Journal","author":"Stark Luke","year":"2021","unstructured":"Luke Stark and Jevan Hutson . 2021. Physiognomic Artificial Intelligence. SSRN Electronic Journal ( 2021 ). https:\/\/doi.org\/10.2139\/ssrn.3927300 10.2139\/ssrn.3927300 Luke Stark and Jevan Hutson. 2021. Physiognomic Artificial Intelligence. SSRN Electronic Journal (2021). https:\/\/doi.org\/10.2139\/ssrn.3927300"},{"key":"e_1_3_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462602"},{"key":"e_1_3_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00993473"},{"key":"e_1_3_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1093\/aje\/kwy250"},{"key":"e_1_3_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2018.00014"},{"key":"e_1_3_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445928"},{"key":"e_1_3_2_2_67_1","volume-title":"Auditing ML Models for Individual Bias and Unfairness. In International Conference on Artificial Intelligence and Statistics. PMLR, 4552--4562","author":"Xue Songkai","year":"2020","unstructured":"Songkai Xue , Mikhail Yurochkin , and Yuekai Sun . 2020 . Auditing ML Models for Individual Bias and Unfairness. In International Conference on Artificial Intelligence and Statistics. PMLR, 4552--4562 . https:\/\/proceedings.mlr.press\/v108\/xue20a.html ISSN: 2640--3498. Songkai Xue, Mikhail Yurochkin, and Yuekai Sun. 2020. Auditing ML Models for Individual Bias and Unfairness. In International Conference on Artificial Intelligence and Statistics. PMLR, 4552--4562. https:\/\/proceedings.mlr.press\/v108\/xue20a.html ISSN: 2640--3498."}],"event":{"name":"AIES '22: AAAI\/ACM Conference on AI, Ethics, and Society","location":"Oxford United Kingdom","acronym":"AIES '22","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","AAAI"]},"container-title":["Proceedings of the 2022 AAAI\/ACM Conference on AI, Ethics, and Society"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514094.3534189","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3514094.3534189","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3514094.3534189","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:36Z","timestamp":1750186956000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514094.3534189"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,26]]},"references-count":66,"alternative-id":["10.1145\/3514094.3534189","10.1145\/3514094"],"URL":"https:\/\/doi.org\/10.1145\/3514094.3534189","relation":{},"subject":[],"published":{"date-parts":[[2022,7,26]]},"assertion":[{"value":"2022-07-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}