{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T19:48:17Z","timestamp":1772653697025,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":53,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T00:00:00Z","timestamp":1698624000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"MacArthur Foundation"},{"name":"NSF","award":["CNS-1704527"],"award-info":[{"award-number":["CNS-1704527"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,10,30]]},"DOI":"10.1145\/3617694.3623237","type":"proceedings-article","created":{"date-parts":[[2023,10,29]],"date-time":"2023-10-29T15:52:11Z","timestamp":1698594731000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Strategic Evaluation"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3676-848X","authenticated-orcid":false,"given":"Benjamin","family":"Laufer","sequence":"first","affiliation":[{"name":"Cornell University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1929-2512","authenticated-orcid":false,"given":"Jon","family":"Kleinberg","sequence":"additional","affiliation":[{"name":"Cornell University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3806-9161","authenticated-orcid":false,"given":"Karen","family":"Levy","sequence":"additional","affiliation":[{"name":"Cornell University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6485-6997","authenticated-orcid":false,"given":"Helen","family":"Nissenbaum","sequence":"additional","affiliation":[{"name":"Cornell University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,10,30]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.4135\/9781412984157"},{"key":"e_1_3_2_2_2_1","unstructured":"Nicole\u00a0Almond Anderson. 2022. ASU Law Program helps women master the golf club as a business tool. https:\/\/attorneyatlawmagazine.com\/law-school\/asu\/asu-law-program-helps-women-master-the-golf-club-as-a-business-tool  Nicole\u00a0Almond Anderson. 2022. ASU Law Program helps women master the golf club as a business tool. https:\/\/attorneyatlawmagazine.com\/law-school\/asu\/asu-law-program-helps-women-master-the-golf-club-as-a-business-tool"},{"key":"e_1_3_2_2_3_1","unstructured":"World Athletics. 2020. Certification System Procedures. Online at www.worldathletics.org.  World Athletics. 2020. Certification System Procedures. Online at www.worldathletics.org."},{"key":"e_1_3_2_2_4_1","first-page":"1","article-title":"The algorithm game","volume":"94","author":"Bambauer Jane","year":"2018","unstructured":"Jane Bambauer and Tal Zarsky . 2018 . The algorithm game . Notre Dame L. Rev. 94 (2018), 1 . Jane Bambauer and Tal Zarsky. 2018. The algorithm game. Notre Dame L. Rev. 94 (2018), 1.","journal-title":"Notre Dame L. Rev."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372859"},{"key":"e_1_3_2_2_6_1","volume-title":"Help wanted: An examination of hiring algorithms, equity, and bias. Upturn.org 0","author":"Bogen Miranda","year":"2018","unstructured":"Miranda Bogen and Aaron Rieke . 2018. Help wanted: An examination of hiring algorithms, equity, and bias. Upturn.org 0 ( 2018 ). Miranda Bogen and Aaron Rieke. 2018. Help wanted: An examination of hiring algorithms, equity, and bias. Upturn.org 0 (2018)."},{"key":"e_1_3_2_2_7_1","volume-title":"Lying: Moral choice in public and private life.","author":"Bok Sissela","year":"1979","unstructured":"Sissela Bok . 1979 . Lying: Moral choice in public and private life. Vintage, New York . Sissela Bok. 1979. Lying: Moral choice in public and private life. Vintage, New York."},{"key":"e_1_3_2_2_8_1","volume-title":"Distinction: A social critique of the judgement of taste","author":"Bourdieu Pierre","year":"1987","unstructured":"Pierre Bourdieu . 1987 . Distinction: A social critique of the judgement of taste . Harvard university press , Cambridge, MA, USA . Pierre Bourdieu. 1987. Distinction: A social critique of the judgement of taste. Harvard university press, Cambridge, MA, USA."},{"key":"e_1_3_2_2_9_1","volume-title":"The Epic Untold Story of Nike\u2019s (Almost) Perfect Marathon. Wired 0 (June","author":"Caesar Ed","year":"2017","unstructured":"Ed Caesar . 2017. The Epic Untold Story of Nike\u2019s (Almost) Perfect Marathon. Wired 0 (June 2017 ). Ed Caesar. 2017. The Epic Untold Story of Nike\u2019s (Almost) Perfect Marathon. Wired 0 (June 2017)."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219166.3219175"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.7202\/1074151ar"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533213"},{"key":"e_1_3_2_2_13_1","volume-title":"What is ethical about grade inflation and coursework deflation?Journal of Academic Ethics 8","author":"Crumbley Donald\u00a0Larry","year":"2010","unstructured":"Donald\u00a0Larry Crumbley , Ronald\u00a0 E Flinn , and Kenneth\u00a0 J Reichelt . 2010. What is ethical about grade inflation and coursework deflation?Journal of Academic Ethics 8 ( 2010 ), 187\u2013197. Donald\u00a0Larry Crumbley, Ronald\u00a0E Flinn, and Kenneth\u00a0J Reichelt. 2010. What is ethical about grade inflation and coursework deflation?Journal of Academic Ethics 8 (2010), 187\u2013197."},{"key":"e_1_3_2_2_14_1","volume-title":"The evaluation society","author":"Dahler-Larsen Peter","unstructured":"Peter Dahler-Larsen . 2011. The evaluation society . Stanford University Press , Stanford, CA, USA . Peter Dahler-Larsen. 2011. The evaluation society. Stanford University Press, Stanford, CA, USA."},{"key":"e_1_3_2_2_15_1","volume-title":"What is wrong with grade inflation (if anything)?Philosophical Inquiry in Education 23, 1","author":"Finefter-Rosenbluh Ilana","year":"2015","unstructured":"Ilana Finefter-Rosenbluh and Meira Levinson . 2015. What is wrong with grade inflation (if anything)?Philosophical Inquiry in Education 23, 1 ( 2015 ), 3\u201321. Ilana Finefter-Rosenbluh and Meira Levinson. 2015. What is wrong with grade inflation (if anything)?Philosophical Inquiry in Education 23, 1 (2015), 3\u201321."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445912"},{"key":"e_1_3_2_2_17_1","volume-title":"An analysis of the principal-agent problem","author":"Grossman J","unstructured":"Sanford\u00a0 J Grossman and Oliver\u00a0 D Hart . 1992. An analysis of the principal-agent problem . Springer , New York . Sanford\u00a0J Grossman and Oliver\u00a0D Hart. 1992. An analysis of the principal-agent problem. Springer, New York."},{"key":"e_1_3_2_2_18_1","volume-title":"Fourth generation evaluation","author":"Guba G","unstructured":"Egon\u00a0 G Guba and Yvonna\u00a0 S Lincoln . 1989. Fourth generation evaluation . Sage , Newbury Park . Egon\u00a0G Guba and Yvonna\u00a0S Lincoln. 1989. Fourth generation evaluation. Sage, Newbury Park."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2840728.2840730"},{"key":"e_1_3_2_2_20_1","first-page":"28728","article-title":"Stateful strategic regression","volume":"34","author":"Harris Keegan","year":"2021","unstructured":"Keegan Harris , Hoda Heidari , and Steven\u00a0 Z Wu . 2021 . Stateful strategic regression . Advances in Neural Information Processing Systems 34 (2021), 28728 \u2013 28741 . Keegan Harris, Hoda Heidari, and Steven\u00a0Z Wu. 2021. Stateful strategic regression. Advances in Neural Information Processing Systems 34 (2021), 28728\u201328741.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0266267119000270"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.3386\/w6875"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186044"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287597"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1152\/jappl.1991.70.2.683"},{"key":"e_1_3_2_2_26_1","volume-title":"How do classifiers induce agents to invest effort strategically?ACM Transactions on Economics and Computation (TEAC) 8, 4","author":"Kleinberg Jon","year":"2020","unstructured":"Jon Kleinberg and Manish Raghavan . 2020. How do classifiers induce agents to invest effort strategically?ACM Transactions on Economics and Computation (TEAC) 8, 4 ( 2020 ), 1\u201323. Jon Kleinberg and Manish Raghavan. 2020. How do classifiers induce agents to invest effort strategically?ACM Transactions on Economics and Computation (TEAC) 8, 4 (2020), 1\u201323."},{"key":"e_1_3_2_2_27_1","unstructured":"Sonali Kohli. 2014. Princeton is giving up ground in its fight against grade inflation. https:\/\/qz.com\/277288\/princeton-is-giving-up-ground-in-its-fight-against-grade-inflation  Sonali Kohli. 2014. Princeton is giving up ground in its fight against grade inflation. https:\/\/qz.com\/277288\/princeton-is-giving-up-ground-in-its-fight-against-grade-inflation"},{"key":"e_1_3_2_2_28_1","unstructured":"Alfie Kohn. 2019. Why Can\u2019t Everyone Get A\u2019s?https:\/\/www.nytimes.com\/2019\/06\/15\/opinion\/sunday\/schools-testing-ranking.html  Alfie Kohn. 2019. Why Can\u2019t Everyone Get A\u2019s?https:\/\/www.nytimes.com\/2019\/06\/15\/opinion\/sunday\/schools-testing-ranking.html"},{"key":"e_1_3_2_2_29_1","first-page":"163","article-title":"Grade inflation: A consideration of additional causes","volume":"22","author":"Lanning Wayne","year":"1995","unstructured":"Wayne Lanning and Peggy Perkins . 1995 . Grade inflation: A consideration of additional causes . Journal of Instructional Psychology 22 , 2 (1995), 163 . Wayne Lanning and Peggy Perkins. 1995. Grade inflation: A consideration of additional causes. Journal of Instructional Psychology 22, 2 (1995), 163.","journal-title":"Journal of Instructional Psychology"},{"key":"e_1_3_2_2_30_1","volume-title":"International Conference on Artificial Intelligence and Statistics. PMLR, Virtual, 2489\u20132518","author":"Liu T","year":"2022","unstructured":"Lydia\u00a0 T Liu , Nikhil Garg , and Christian Borgs . 2022 . Strategic ranking . In International Conference on Artificial Intelligence and Statistics. PMLR, Virtual, 2489\u20132518 . Lydia\u00a0T Liu, Nikhil Garg, and Christian Borgs. 2022. Strategic ranking. In International Conference on Artificial Intelligence and Statistics. PMLR, Virtual, 2489\u20132518."},{"key":"e_1_3_2_2_31_1","volume-title":"Program evaluation theory and practice","author":"Mertens M","unstructured":"Donna\u00a0 M Mertens and Amy\u00a0 T Wilson . 2018. Program evaluation theory and practice . Guilford Publications , New York . Donna\u00a0M Mertens and Amy\u00a0T Wilson. 2018. Program evaluation theory and practice. Guilford Publications, New York."},{"key":"e_1_3_2_2_32_1","volume-title":"International Conference on Machine Learning. PMLR, Virtual, 6917\u20136926","author":"Miller John","year":"2020","unstructured":"John Miller , Smitha Milli , and Moritz Hardt . 2020 . Strategic classification is causal modeling in disguise . In International Conference on Machine Learning. PMLR, Virtual, 6917\u20136926 . John Miller, Smitha Milli, and Moritz Hardt. 2020. Strategic classification is causal modeling in disguise. In International Conference on Machine Learning. PMLR, Virtual, 6917\u20136926."},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287576"},{"key":"e_1_3_2_2_34_1","unstructured":"Arvind Narayanan. 2022. The limits of the quantitative approach to discrimination.  Arvind Narayanan. 2022. The limits of the quantitative approach to discrimination."},{"key":"e_1_3_2_2_35_1","volume-title":"A Track Built for Speed Is Already Producing Records. New York Times 0 (2","author":"Panja Tariq","year":"2021","unstructured":"Tariq Panja . 2021. A Track Built for Speed Is Already Producing Records. New York Times 0 (2 August 2021 ). Tariq Panja. 2021. A Track Built for Speed Is Already Producing Records. New York Times 0 (2 August 2021)."},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"crossref","unstructured":"Caitlin Petre Brooke\u00a0Erin Duffy and Emily Hund. 2019. \u201cGaming the system\u201d: Platform paternalism and the politics of algorithmic visibility. Social Media+ Society 5 4 (2019) 2056305119879995.  Caitlin Petre Brooke\u00a0Erin Duffy and Emily Hund. 2019. \u201cGaming the system\u201d: Platform paternalism and the politics of algorithmic visibility. Social Media+ Society 5 4 (2019) 2056305119879995.","DOI":"10.1177\/2056305119879995"},{"key":"e_1_3_2_2_37_1","volume-title":"The audit society: Rituals of verification. OUP Oxford","author":"Power Michael","unstructured":"Michael Power . 1997. The audit society: Rituals of verification. OUP Oxford , Oxford . Michael Power. 1997. The audit society: Rituals of verification. OUP Oxford, Oxford."},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1093\/sf\/soaa026"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372828"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514094.3534181"},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1177\/0003122418822335"},{"key":"e_1_3_2_2_42_1","volume-title":"Pedigree","author":"Rivera A","unstructured":"Lauren\u00a0 A Rivera . 2016. Pedigree . In Pedigree . Princeton University Press , Princeton, NJ, USA . Lauren\u00a0A Rivera. 2016. Pedigree. In Pedigree. Princeton University Press, Princeton, NJ, USA."},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1177\/016146811211400707"},{"key":"e_1_3_2_2_44_1","volume-title":"Evaluation thesaurus","author":"Scriven Michael","unstructured":"Michael Scriven . 1991. Evaluation thesaurus . Sage , Newbury Park . Michael Scriven. 1991. Evaluation thesaurus. Sage, Newbury Park."},{"key":"e_1_3_2_2_45_1","volume-title":"The fine line between evaluation and explanation. Research on social work practice 9, 4","author":"Scriven Michael","year":"1999","unstructured":"Michael Scriven . 1999. The fine line between evaluation and explanation. Research on social work practice 9, 4 ( 1999 ), 521\u2013524. Michael Scriven. 1999. The fine line between evaluation and explanation. Research on social work practice 9, 4 (1999), 521\u2013524."},{"key":"e_1_3_2_2_46_1","first-page":"1","article-title":"The logic of evaluation","volume":"1","author":"Scriven Michael","year":"2007","unstructured":"Michael Scriven . 2007 . The logic of evaluation . Dissensus and the Search for Common Ground 1 (2007), 1 \u2013 16 . Michael Scriven. 2007. The logic of evaluation. Dissensus and the Search for Common Ground 1 (2007), 1\u201316.","journal-title":"Dissensus and the Search for Common Ground"},{"key":"e_1_3_2_2_47_1","volume-title":"International Conference on Machine Learning. PMLR, Virtual, 8676\u20138686","author":"Shavit Yonadav","year":"2020","unstructured":"Yonadav Shavit , Benjamin Edelman , and Brian Axelrod . 2020 . Causal strategic linear regression . In International Conference on Machine Learning. PMLR, Virtual, 8676\u20138686 . Yonadav Shavit, Benjamin Edelman, and Brian Axelrod. 2020. Causal strategic linear regression. In International Conference on Machine Learning. PMLR, Virtual, 8676\u20138686."},{"key":"e_1_3_2_2_48_1","volume-title":"An analysis of alternative approaches to evaluation. Systematic Evaluation: A Self-Instructional Guide to Theory and Practice 1","author":"Stufflebeam L","year":"1985","unstructured":"Daniel\u00a0 L Stufflebeam , Anthony\u00a0 J Shinkfield , Daniel\u00a0 L Stufflebeam , and Anthony\u00a0 J Shinkfield . 1985. An analysis of alternative approaches to evaluation. Systematic Evaluation: A Self-Instructional Guide to Theory and Practice 1 ( 1985 ), 45\u201368. Daniel\u00a0L Stufflebeam, Anthony\u00a0J Shinkfield, Daniel\u00a0L Stufflebeam, and Anthony\u00a0J Shinkfield. 1985. An analysis of alternative approaches to evaluation. Systematic Evaluation: A Self-Instructional Guide to Theory and Practice 1 (1985), 45\u201368."},{"key":"e_1_3_2_2_49_1","first-page":"1","article-title":"Online manipulation: Hidden influences in a digital world. Geo","volume":"4","author":"Susser Daniel","year":"2019","unstructured":"Daniel Susser , Beate Roessler , and Helen Nissenbaum . 2019 . Online manipulation: Hidden influences in a digital world. Geo . L. Tech. Rev. 4 (2019), 1 \u2013 45 . Daniel Susser, Beate Roessler, and Helen Nissenbaum. 2019. Online manipulation: Hidden influences in a digital world. Geo. L. Tech. Rev. 4 (2019), 1\u201345.","journal-title":"L. Tech. Rev."},{"key":"e_1_3_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.14763\/2019.2.1410"},{"key":"e_1_3_2_2_51_1","doi-asserted-by":"crossref","unstructured":"Briana Vecchione Karen Levy and Solon Barocas. 2021. Algorithmic auditing and social justice: Lessons from the history of audit studies. In Equity and Access in Algorithms Mechanisms and Optimization. ACM Virtual 1\u20139.  Briana Vecchione Karen Levy and Solon Barocas. 2021. Algorithmic auditing and social justice: Lessons from the history of audit studies. In Equity and Access in Algorithms Mechanisms and Optimization. ACM Virtual 1\u20139.","DOI":"10.1145\/3465416.3483294"},{"key":"e_1_3_2_2_52_1","volume-title":"Rethinking gaming: The ethical work of optimization in web search engines. Social studies of science 49, 5","author":"Ziewitz Malte","year":"2019","unstructured":"Malte Ziewitz . 2019. Rethinking gaming: The ethical work of optimization in web search engines. Social studies of science 49, 5 ( 2019 ), 707\u2013731. Malte Ziewitz. 2019. Rethinking gaming: The ethical work of optimization in web search engines. Social studies of science 49, 5 (2019), 707\u2013731."},{"key":"e_1_3_2_2_53_1","volume-title":"Who Leads and Who Follows in Strategic Classification?Advances in Neural Information Processing Systems 34","author":"Zrnic Tijana","year":"2021","unstructured":"Tijana Zrnic , Eric Mazumdar , Shankar Sastry , and Michael Jordan . 2021. Who Leads and Who Follows in Strategic Classification?Advances in Neural Information Processing Systems 34 ( 2021 ), 15257\u201315269. Tijana Zrnic, Eric Mazumdar, Shankar Sastry, and Michael Jordan. 2021. Who Leads and Who Follows in Strategic Classification?Advances in Neural Information Processing Systems 34 (2021), 15257\u201315269."}],"event":{"name":"EAAMO '23: Equity and Access in Algorithms, Mechanisms, and Optimization","location":"Boston MA USA","acronym":"EAAMO '23","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","SIGecom Special Interest Group on Economics and Computation"]},"container-title":["Equity and Access in Algorithms, Mechanisms, and Optimization"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617694.3623237","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3617694.3623237","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:32Z","timestamp":1750178192000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617694.3623237"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,30]]},"references-count":53,"alternative-id":["10.1145\/3617694.3623237","10.1145\/3617694"],"URL":"https:\/\/doi.org\/10.1145\/3617694.3623237","relation":{},"subject":[],"published":{"date-parts":[[2023,10,30]]},"assertion":[{"value":"2023-10-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}