{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T19:42:28Z","timestamp":1776109348996,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":65,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,7,26]],"date-time":"2022-07-26T00:00:00Z","timestamp":1658793600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1845460"],"award-info":[{"award-number":["IIS-1845460"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,7,26]]},"DOI":"10.1145\/3514094.3534145","type":"proceedings-article","created":{"date-parts":[[2022,7,27]],"date-time":"2022-07-27T22:25:13Z","timestamp":1658960713000},"page":"56-67","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Crowdsourcing Impacts"],"prefix":"10.1145","author":[{"given":"Julia","family":"Barnett","sequence":"first","affiliation":[{"name":"Northwestern Univeristy, Evanston, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicholas","family":"Diakopoulos","sequence":"additional","affiliation":[{"name":"Northwestern University, Evanston, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,7,27]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380281"},{"key":"e_1_3_2_2_2_1","volume-title":"The state of artificial intelligence-based FDA-approved medical devices and algorithms: an online database. NPJ digital medicine 3, 1","author":"Benjamens Stan","year":"2020","unstructured":"Stan Benjamens , Pranavsingh Dhunnoo , and Bertalan Mesk\u00f3 . 2020. The state of artificial intelligence-based FDA-approved medical devices and algorithms: an online database. NPJ digital medicine 3, 1 ( 2020 ), 1--8. Stan Benjamens, Pranavsingh Dhunnoo, and Bertalan Mesk\u00f3. 2020. The state of artificial intelligence-based FDA-approved medical devices and algorithms: an online database. NPJ digital medicine 3, 1 (2020), 1--8."},{"key":"e_1_3_2_2_3_1","unstructured":"Ruha Benjamin. [n.d.]. Race After Technology: Abolitionist Tools for the New Jim Code. ([n. d.]) 3.  Ruha Benjamin. [n.d.]. Race After Technology: Abolitionist Tools for the New Jim Code. ([n. d.]) 3."},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2117261118"},{"key":"e_1_3_2_2_5_1","volume-title":"Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers)","author":"Bianchi Federico","year":"1865","unstructured":"Federico Bianchi , Silvia Terragni , and Dirk Hovy . 2021. Pre-training is a Hot Topic: Contextualized Document Embeddings Improve Topic Coherence . In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) . Association for Computational Linguistics , Online , 759--766. https:\/\/doi.org\/10. 1865 3\/v1\/2021.acl-short.96 10.18653\/v1 Federico Bianchi, Silvia Terragni, and Dirk Hovy. 2021. Pre-training is a Hot Topic: Contextualized Document Embeddings Improve Topic Coherence. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers). Association for Computational Linguistics, Online, 759--766. https:\/\/doi.org\/10.18653\/v1\/2021.acl-short.96"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780197565742.001.0001"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"crossref","unstructured":"Fergus Bolger and George Wright. 2017. Use of expert knowledge to anticipate the future: Issues analysis and directions. 230--243 pages.  Fergus Bolger and George Wright. 2017. Use of expert knowledge to anticipate the future: Issues analysis and directions. 230--243 pages.","DOI":"10.1016\/j.ijforecast.2016.11.001"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.techfore.2019.119855"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1080\/02691720903364019"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11077-006-9010-y"},{"key":"e_1_3_2_2_11_1","volume-title":"Ethics of emerging technology. The ethics of technology: Methods and approaches","author":"Brey Philip","year":"2017","unstructured":"Philip Brey . 2017. Ethics of emerging technology. The ethics of technology: Methods and approaches ( 2017 ), 175--191. Philip Brey. 2017. Ethics of emerging technology. The ethics of technology: Methods and approaches (2017), 175--191."},{"key":"e_1_3_2_2_12_1","volume-title":"The new practitioner's guide to fiscal impact analysis","author":"Burchell Robert W","unstructured":"Robert W Burchell , David Listokin , and William R Dolphin . 1985. The new practitioner's guide to fiscal impact analysis . Routledge . Robert W Burchell, David Listokin, and William R Dolphin. 1985. The new practitioner's guide to fiscal impact analysis. Routledge."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.3152\/146155109X454285"},{"key":"e_1_3_2_2_14_1","volume-title":"Actionable Auditing: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products (Proc. Conference on AI, Ethics, and Society (AIES)","volume":"435","author":"Conitzer Vincent","year":"2019","unstructured":"Vincent Conitzer , Gillian Hadfield , Shannon Vallor , Inioluwa Deborah Raji , and Joy Buolamwini . 2019 . Actionable Auditing: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products (Proc. Conference on AI, Ethics, and Society (AIES) , Vol. 31). 429-- 435 . https:\/\/doi.org\/10.1145\/3306618. 3314244 10.1145\/3306618 Vincent Conitzer, Gillian Hadfield, Shannon Vallor, Inioluwa Deborah Raji, and Joy Buolamwini. 2019. Actionable Auditing: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products (Proc. Conference on AI, Ethics, and Society (AIES), Vol. 31). 429--435. https:\/\/doi.org\/10.1145\/3306618. 3314244"},{"key":"e_1_3_2_2_15_1","volume-title":"The Measure and Mismeasure of Fairness: A Critical Review of Fair Machine Learning. arXiv:1808.00023 [cs] (Aug","author":"Corbett-Davies Sam","year":"2018","unstructured":"Sam Corbett-Davies and Sharad Goel . 2018. The Measure and Mismeasure of Fairness: A Critical Review of Fair Machine Learning. arXiv:1808.00023 [cs] (Aug . 2018 ). http:\/\/arxiv.org\/abs\/1808.00023 arXiv: 1808.00023. Sam Corbett-Davies and Sharad Goel. 2018. The Measure and Mismeasure of Fairness: A Critical Review of Fair Machine Learning. arXiv:1808.00023 [cs] (Aug. 2018). http:\/\/arxiv.org\/abs\/1808.00023 arXiv: 1808.00023."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1080\/21670811.2014.976411"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2844110"},{"key":"e_1_3_2_2_18_1","volume-title":"Automating the News: How Algorithms Are Rewriting the Media","author":"Diakopoulos Nicholas","unstructured":"Nicholas Diakopoulos . 2019. Automating the News: How Algorithms Are Rewriting the Media . Harvard University Press . https:\/\/doi.org\/doi:10.4159\/9780674239302 10.4159\/9780674239302 Nicholas Diakopoulos. 2019. Automating the News: How Algorithms Are Rewriting the Media. Harvard University Press. https:\/\/doi.org\/doi:10.4159\/9780674239302"},{"key":"e_1_3_2_2_19_1","unstructured":"Nicholas Diakopoulos and Deborah G Johnson. [n.d.]. Anticipating and Address- ing the Ethical Implications of Deepfakes in the Context of Elections. ([n. d.]) 27.  Nicholas Diakopoulos and Deborah G Johnson. [n.d.]. Anticipating and Address- ing the Ethical Implications of Deepfakes in the Context of Elections. ([n. d.]) 27."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479550"},{"key":"e_1_3_2_2_21_1","volume-title":"Public Law Research Paper 20--54","author":"Engstrom David Freeman","year":"2020","unstructured":"David Freeman Engstrom , Daniel E Ho , Catherine M Sharkey , and Mariano- Florentino Cu\u00e9llar . 2020. Government by algorithm: Artificial intelligence in federal administrative agencies. NYU School of Law , Public Law Research Paper 20--54 ( 2020 ). David Freeman Engstrom, Daniel E Ho, Catherine M Sharkey, and Mariano- Florentino Cu\u00e9llar. 2020. Government by algorithm: Artificial intelligence in federal administrative agencies. NYU School of Law, Public Law Research Paper 20--54 (2020)."},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1080\/14615517.2012.660356"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0304-3894(01)00260-6"},{"key":"e_1_3_2_2_24_1","volume-title":"Science's Social Effects. Issues in science and technology 23, 3 (March","author":"Frodeman Robert","year":"2007","unstructured":"Robert Frodeman and J. Britt Holbrook . 2007. Science's Social Effects. Issues in science and technology 23, 3 (March 2007 ), 28--30. Robert Frodeman and J. Britt Holbrook. 2007. Science's Social Effects. Issues in science and technology 23, 3 (March 2007), 28--30."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2843948"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1378\/chest.15-0706"},{"key":"e_1_3_2_2_27_1","volume-title":"XAI-Explainable artificial intelligence. Science Robotics 4, 37","author":"Gunning David","year":"2019","unstructured":"David Gunning , Mark Stefik , Jaesik Choi , Timothy Miller , Simone Stumpf , and Guang-Zhong Yang . 2019. XAI-Explainable artificial intelligence. Science Robotics 4, 37 ( 2019 ), eaay7120. https:\/\/doi.org\/10.1126\/scirobotics.aay7120 arXiv:https:\/\/www.science.org\/doi\/pdf\/10.1126\/scirobotics.aay7120 10.1126\/scirobotics.aay7120 David Gunning, Mark Stefik, Jaesik Choi, Timothy Miller, Simone Stumpf, and Guang-Zhong Yang. 2019. XAI-Explainable artificial intelligence. Science Robotics 4, 37 (2019), eaay7120. https:\/\/doi.org\/10.1126\/scirobotics.aay7120 arXiv:https:\/\/www.science.org\/doi\/pdf\/10.1126\/scirobotics.aay7120"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1177\/0306312713508669"},{"key":"e_1_3_2_2_29_1","volume-title":"Wisconsin. In Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing. 206--210","author":"Romael Haque MD","year":"2019","unstructured":"MD Romael Haque , Katherine Weathington , and Shion Guha . 2019 . Exploring the Impact of (Not) Changing Default Settings in Algorithmic Crime Mapping-A Case Study of Milwaukee , Wisconsin. In Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing. 206--210 . MD Romael Haque, Katherine Weathington, and Shion Guha. 2019. Exploring the Impact of (Not) Changing Default Settings in Algorithmic Crime Mapping-A Case Study of Milwaukee, Wisconsin. In Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing. 206--210."},{"key":"e_1_3_2_2_30_1","volume-title":"Comparing Internet Experiences and Prosociality in Amazon Mechanical Turk and Population-Based Survey Samples. Socius: Sociological Research for a Dynamic World 6","author":"Hargittai Eszter","year":"2020","unstructured":"Eszter Hargittai and Aaron Shaw . 2020. Comparing Internet Experiences and Prosociality in Amazon Mechanical Turk and Population-Based Survey Samples. Socius: Sociological Research for a Dynamic World 6 ( 2020 ), 237802311988983. https:\/\/doi.org\/10.1177\/2378023119889834 10.1177\/2378023119889834 Eszter Hargittai and Aaron Shaw. 2020. Comparing Internet Experiences and Prosociality in Amazon Mechanical Turk and Population-Based Survey Samples. Socius: Sociological Research for a Dynamic World 6 (2020), 237802311988983. https:\/\/doi.org\/10.1177\/2378023119889834"},{"key":"e_1_3_2_2_31_1","volume-title":"Lana Yarosh, Bushra Anjum, Danish Contractor, and Cathy Wu.","author":"Hecht Brent","year":"2018","unstructured":"Brent Hecht , Lauren Wilcox , Jeffrey P Bigham , Johannes Sch\u00f6ning , Ehsan Hoque , Jason Ernst , Yonatan Bisk , Luigi De Russis , Lana Yarosh, Bushra Anjum, Danish Contractor, and Cathy Wu. 2018 . It's Time to Do Something : Mitigating the Negative Impacts of Computing Through a Change to the Peer Review Process. ACM Future of Computing Blog ( 2018). Brent Hecht, Lauren Wilcox, Jeffrey P Bigham, Johannes Sch\u00f6ning, Ehsan Hoque, Jason Ernst, Yonatan Bisk, Luigi De Russis, Lana Yarosh, Bushra Anjum, Danish Contractor, and Cathy Wu. 2018. It's Time to Do Something: Mitigating the Negative Impacts of Computing Through a Change to the Peer Review Process. ACM Future of Computing Blog (2018)."},{"key":"e_1_3_2_2_32_1","volume-title":"Filipa De Almeida, and Natalia Martin","author":"Hidalgo C\u00e9sar A.","year":"2021","unstructured":"C\u00e9sar A. Hidalgo , Diana Orghian , Jordi Albo-Canals , Filipa De Almeida, and Natalia Martin . 2021 . How Humans Judge Machines. The MIT Press . C\u00e9sar A. Hidalgo, Diana Orghian, Jordi Albo-Canals, Filipa De Almeida, and Natalia Martin. 2021. How Humans Judge Machines. The MIT Press."},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.3152\/095820211X12941371876788"},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2016.08.011"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447255"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1080\/14615517.2013.782978"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445937"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/E14-1056"},{"key":"e_1_3_2_2_39_1","volume-title":"Collecting Annotator Rationales for Relevance Judgments. Fourth AAAI Conference on Human Computation and Crowdsourcing (Sept.","author":"McDonnell Tyler","year":"2016","unstructured":"Tyler McDonnell , Matthew Lease , Mucahid Kutlu , and Tamer Elsayed . 2016 . Why Is That Relevant? Collecting Annotator Rationales for Relevance Judgments. Fourth AAAI Conference on Human Computation and Crowdsourcing (Sept. 2016). Tyler McDonnell, Matthew Lease, Mucahid Kutlu, and Tamer Elsayed. 2016. Why Is That Relevant? Collecting Annotator Rationales for Relevance Judgments. Fourth AAAI Conference on Human Computation and Crowdsourcing (Sept. 2016)."},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"crossref","unstructured":"Craig R M McKenzie Michael J Liersch and Stacey R Finkelstein. [n.d.]. Recom- mendations Implicit in Policy Defaults. 17 5 ([n. d.]) 7.  Craig R M McKenzie Michael J Liersch and Stacey R Finkelstein. [n.d.]. Recom- mendations Implicit in Policy Defaults. 17 5 ([n. d.]) 7.","DOI":"10.1111\/j.1467-9280.2006.01721.x"},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1177\/1046496415602558"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445935"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951716679679"},{"key":"e_1_3_2_2_44_1","first-page":"773","article-title":"Procurement as policy: Administrative process for machine learning","volume":"34","author":"Mulligan Deirdre K","year":"2019","unstructured":"Deirdre K Mulligan and Kenneth A Bamberger . 2019 . Procurement as policy: Administrative process for machine learning . Berkeley Tech. LJ 34 (2019), 773 . Deirdre K Mulligan and Kenneth A Bamberger. 2019. Procurement as policy: Administrative process for machine learning. Berkeley Tech. LJ 34 (2019), 773.","journal-title":"Berkeley Tech. LJ"},{"key":"e_1_3_2_2_45_1","volume-title":"An- ticipatory Ethics and the Role of Uncertainty. arXiv:2011.13170 [cs] (Nov","author":"Nanayakkara Priyanka","year":"2020","unstructured":"Priyanka Nanayakkara , Nicholas Diakopoulos , and Jessica Hullman . 2020. An- ticipatory Ethics and the Role of Uncertainty. arXiv:2011.13170 [cs] (Nov . 2020 ). http:\/\/arxiv.org\/abs\/2011.13170 arXiv: 2011.13170. Priyanka Nanayakkara, Nicholas Diakopoulos, and Jessica Hullman. 2020. An- ticipatory Ethics and the Role of Uncertainty. arXiv:2011.13170 [cs] (Nov. 2020). http:\/\/arxiv.org\/abs\/2011.13170 arXiv: 2011.13170."},{"key":"e_1_3_2_2_46_1","volume-title":"Proc. Conference on AI, Ethics, and Society (AIES) (July","author":"Nanayakkara Priyanka","year":"2021","unstructured":"Priyanka Nanayakkara , Jessica Hullman , and Nicholas Diakopoulos . 2021 . Un- packing the Expressed Consequences of AI Research in Broader Impact State- ments . Proc. Conference on AI, Ethics, and Society (AIES) (July 2021), 795--806. https:\/\/doi.org\/10.1145\/3461702.3462608 arXiv: 2105.04760. 10.1145\/3461702.3462608 Priyanka Nanayakkara, Jessica Hullman, and Nicholas Diakopoulos. 2021. Un- packing the Expressed Consequences of AI Research in Broader Impact State- ments. Proc. Conference on AI, Ethics, and Society (AIES) (July 2021), 795--806. https:\/\/doi.org\/10.1145\/3461702.3462608 arXiv: 2105.04760."},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1177\/0049124117729703"},{"key":"e_1_3_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40309-013-0033-2"},{"key":"e_1_3_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1177\/0149206306298657"},{"key":"e_1_3_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3492857"},{"key":"e_1_3_2_2_51_1","volume-title":"Manning","author":"Pennington Jeffrey","year":"2014","unstructured":"Jeffrey Pennington , Richard Socher , and Christopher D . Manning . 2014 . GloVe: Global Vectors for Word Representation. In Empirical Methods in Natural Language Processing (EMNLP) . 1532--1543. http:\/\/www.aclweb.org\/anthology\/D14- 1162 Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. GloVe: Global Vectors for Word Representation. In Empirical Methods in Natural Language Processing (EMNLP). 1532--1543. http:\/\/www.aclweb.org\/anthology\/D14- 1162"},{"key":"e_1_3_2_2_52_1","volume-title":"Rebecca N White, Margaret Mitchell, Timnit Gebru, Ben Hutchinson, Jamila Smith-Loud, Daniel Theron, and Parker Barnes.","author":"Raji Inioluwa Deborah","year":"2020","unstructured":"Inioluwa Deborah Raji , Andrew Smart , Rebecca N White, Margaret Mitchell, Timnit Gebru, Ben Hutchinson, Jamila Smith-Loud, Daniel Theron, and Parker Barnes. 2020 . Closing the AI Accountability Gap: Defining an End-to-End Frame- work for Internal Algorithmic Auditing . (2020), 12. Inioluwa Deborah Raji, Andrew Smart, Rebecca N White, Margaret Mitchell, Timnit Gebru, Ben Hutchinson, Jamila Smith-Loud, Daniel Theron, and Parker Barnes. 2020. Closing the AI Accountability Gap: Defining an End-to-End Frame- work for Internal Algorithmic Auditing. (2020), 12."},{"key":"e_1_3_2_2_53_1","volume-title":"Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084","author":"Reimers Nils","year":"2019","unstructured":"Nils Reimers and Iryna Gurevych . 2019 . Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084 (2019). Nils Reimers and Iryna Gurevych. 2019. Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084 (2019)."},{"key":"e_1_3_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1080\/02691720903364035"},{"key":"e_1_3_2_2_55_1","volume-title":"Towards Explainable Artificial Intelligence","author":"Samek Wojciech","unstructured":"Wojciech Samek and Klaus-Robert M\u00fcller . 2019. Towards Explainable Artificial Intelligence . Springer International Publishing , Cham , 5--22. https:\/\/doi.org\/10. 1007\/978-3-030-28954--6_1 Wojciech Samek and Klaus-Robert M\u00fcller. 2019. Towards Explainable Artificial Intelligence. Springer International Publishing, Cham, 5--22. https:\/\/doi.org\/10. 1007\/978-3-030-28954--6_1"},{"key":"e_1_3_2_2_56_1","volume-title":"The Growing Gap Between Emerging Technologies and Legal-Ethical Oversight","author":"Sarewitz Daniel","unstructured":"Daniel Sarewitz . 2011. Anticipatory Governance of Emerging Technologies . In The Growing Gap Between Emerging Technologies and Legal-Ethical Oversight . Springer Netherlands . Daniel Sarewitz. 2011. Anticipatory Governance of Emerging Technologies. In The Growing Gap Between Emerging Technologies and Legal-Ethical Oversight. Springer Netherlands."},{"key":"e_1_3_2_2_57_1","doi-asserted-by":"crossref","unstructured":"Nripsuta Saxena Karen Huang Evan DeFilippis Goran Radanovic David Parkes and Yang Liu. 2019. How Do Fairness Definitions Fare? Examining Public Attitudes Towards Algorithmic Definitions of Fairness. arXiv:1811.03654 [cs.AI]  Nripsuta Saxena Karen Huang Evan DeFilippis Goran Radanovic David Parkes and Yang Liu. 2019. How Do Fairness Definitions Fare? Examining Public Attitudes Towards Algorithmic Definitions of Fairness. arXiv:1811.03654 [cs.AI]","DOI":"10.1145\/3306618.3314248"},{"key":"e_1_3_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.5555\/2390948.2391052"},{"key":"e_1_3_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1177\/0261927X09351676"},{"key":"e_1_3_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-80599-9_4"},{"key":"e_1_3_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1080\/713856137"},{"key":"e_1_3_2_2_62_1","volume-title":"The ethics of algorithms: key problems and solutions. AI & SOCIETY","author":"Tsamados Andreas","year":"2021","unstructured":"Andreas Tsamados , Nikita Aggarwal , Josh Cowls , Jessica Morley , Huw Roberts , Mariarosaria Taddeo , and Luciano Floridi . 2021. The ethics of algorithms: key problems and solutions. AI & SOCIETY ( 2021 ), 1--16. Andreas Tsamados, Nikita Aggarwal, Josh Cowls, Jessica Morley, Huw Roberts, Mariarosaria Taddeo, and Luciano Floridi. 2021. The ethics of algorithms: key problems and solutions. AI & SOCIETY (2021), 1--16."},{"key":"e_1_3_2_2_63_1","volume-title":"The ethics of algorithms: key problems and solutions. AI & SOCIETY (Feb","author":"Tsamados Andreas","year":"2021","unstructured":"Andreas Tsamados , Nikita Aggarwal , Josh Cowls , Jessica Morley , Huw Roberts , Mariarosaria Taddeo , and Luciano Floridi . 2021. The ethics of algorithms: key problems and solutions. AI & SOCIETY (Feb . 2021 ). https:\/\/doi.org\/10.1007\/ s00146-021-01154-8 Andreas Tsamados, Nikita Aggarwal, Josh Cowls, Jessica Morley, Huw Roberts, Mariarosaria Taddeo, and Luciano Floridi. 2021. The ethics of algorithms: key problems and solutions. AI & SOCIETY (Feb. 2021). https:\/\/doi.org\/10.1007\/ s00146-021-01154-8"},{"key":"e_1_3_2_2_64_1","volume-title":"Confusing the Crowd: Task Instruction Quality on Amazon Mechanical Turk. Fifth AAAI Conference on Human Computation and Crowdsourcing (Sept.","author":"Wu Meng-Han","year":"2017","unstructured":"Meng-Han Wu and Alexander James Quinn . 2017 . Confusing the Crowd: Task Instruction Quality on Amazon Mechanical Turk. Fifth AAAI Conference on Human Computation and Crowdsourcing (Sept. 2017). Meng-Han Wu and Alexander James Quinn. 2017. Confusing the Crowd: Task Instruction Quality on Amazon Mechanical Turk. Fifth AAAI Conference on Human Computation and Crowdsourcing (Sept. 2017)."},{"key":"e_1_3_2_2_65_1","unstructured":"Tal Z Zarsky. 2013. Transparent predictions. U. Ill. L. Rev. (2013) 15  Tal Z Zarsky. 2013. Transparent predictions. U. Ill. L. Rev. (2013) 15"}],"event":{"name":"AIES '22: AAAI\/ACM Conference on AI, Ethics, and Society","location":"Oxford United Kingdom","acronym":"AIES '22","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","AAAI"]},"container-title":["Proceedings of the 2022 AAAI\/ACM Conference on AI, Ethics, and Society"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514094.3534145","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3514094.3534145","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3514094.3534145","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:36Z","timestamp":1750186956000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514094.3534145"}},"subtitle":["Exploring the Utility of Crowds for Anticipating Societal Impacts of Algorithmic Decision Making"],"short-title":[],"issued":{"date-parts":[[2022,7,26]]},"references-count":65,"alternative-id":["10.1145\/3514094.3534145","10.1145\/3514094"],"URL":"https:\/\/doi.org\/10.1145\/3514094.3534145","relation":{},"subject":[],"published":{"date-parts":[[2022,7,26]]},"assertion":[{"value":"2022-07-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}