{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T23:03:45Z","timestamp":1781737425754,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":39,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,6,20]],"date-time":"2022-06-20T00:00:00Z","timestamp":1655683200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF (National Science Foundation)","doi-asserted-by":"publisher","award":["DGE-1650441"],"award-info":[{"award-number":["DGE-1650441"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,6,21]]},"DOI":"10.1145\/3531146.3533221","type":"proceedings-article","created":{"date-parts":[[2022,6,20]],"date-time":"2022-06-20T14:27:10Z","timestamp":1655735230000},"page":"1639-1656","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":28,"title":["Human-Algorithm Collaboration: Achieving Complementarity and Avoiding Unfairness"],"prefix":"10.1145","author":[{"given":"Kate","family":"Donahue","sequence":"first","affiliation":[{"name":"Cornell University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandra","family":"Chouldechova","sequence":"additional","affiliation":[{"name":"Amazon, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Krishnaram","family":"Kenthapadi","sequence":"additional","affiliation":[{"name":"Fiddler AI, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,6,20]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i13.17359"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445717"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376718"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1257\/pandp.20201037"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i7.16738"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376638"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-38067-9_4"},{"key":"e_1_3_2_1_8_1","volume-title":"People reject algorithms in uncertain decision domains because they have diminishing sensitivity to forecasting error. Psychological science 31, 10","author":"Dietvorst J","year":"2020","unstructured":"Berkeley\u00a0J Dietvorst and Soaham Bharti. 2020. People reject algorithms in uncertain decision domains because they have diminishing sensitivity to forecasting error. Psychological science 31, 10 (2020), 1302\u20131314."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2016.2643"},{"key":"e_1_3_2_1_10_1","volume-title":"Fairness Under Composition. In 10th Innovations in Theoretical Computer Science Conference (ITCS","author":"Dwork Cynthia","year":"2018","unstructured":"Cynthia Dwork and Christina Ilvento. 2018. Fairness Under Composition. In 10th Innovations in Theoretical Computer Science Conference (ITCS 2019). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik."},{"key":"e_1_3_2_1_11_1","volume-title":"Individual Fairness in Pipelines. In 1st Symposium on Foundations of Responsible Computing (FORC","author":"Dwork Cynthia","year":"2020","unstructured":"Cynthia Dwork, Christina Ilvento, and Meena Jagadeesan. 2020. Individual Fairness in Pipelines. In 1st Symposium on Foundations of Responsible Computing (FORC 2020). Schloss Dagstuhl-Leibniz-Zentrum f\u00fcr Informatik."},{"key":"e_1_3_2_1_12_1","unstructured":"Aaron Fraenkel. 2020. Fairness and Algorithmic Decision Making. https:\/\/afraenkel.github.io\/fairness-algo-decision"},{"key":"e_1_3_2_1_13_1","first-page":"13890","article-title":"Beyond accuracy: quantifying trial-by-trial behaviour of CNNs and humans by measuring error consistency","volume":"33","author":"Geirhos Robert","year":"2020","unstructured":"Robert Geirhos, Kristof Meding, and Felix\u00a0A Wichmann. 2020. Beyond accuracy: quantifying trial-by-trial behaviour of CNNs and humans by measuring error consistency. Advances in Neural Information Processing Systems 33 (2020), 13890\u201313902.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_14_1","unstructured":"Talia Gillis Bryce McLaughlin and Jann Spiess. 2021. On the Fairness of Machine-Assisted Human Decisions. arXiv preprint arXiv:2110.15310(2021)."},{"key":"e_1_3_2_1_15_1","unstructured":"Joel Hestness Sharan Narang Newsha Ardalani Gregory\u00a0F. Diamos Heewoo Jun Hassan Kianinejad Md. Mostofa\u00a0Ali Patwary Yang Yang and Yanqi Zhou. 2017. Deep Learning Scaling is Predictable Empirically. CoRR abs\/1712.00409(2017). arXiv:1712.00409http:\/\/arxiv.org\/abs\/1712.00409"},{"key":"e_1_3_2_1_16_1","unstructured":"Jared Kaplan Sam McCandlish Tom Henighan Tom\u00a0B Brown Benjamin Chess Rewon Child Scott Gray Alec Radford Jeffrey Wu and Dario Amodei. 2020. Scaling laws for neural language models. arXiv preprint arXiv:2001.08361(2020)."},{"key":"e_1_3_2_1_17_1","unstructured":"Gavin Kerrigan Padhraic Smyth and Mark Steyvers. 2021. Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibration. (2021)."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462516"},{"key":"e_1_3_2_1_19_1","unstructured":"Vijay Keswani Matthew Lease and Krishnaram Kenthapadi. 2022. Designing Closed Human-in-the-loop Deferral Pipelines. arXiv preprint arXiv:2202.04718(2022)."},{"key":"e_1_3_2_1_20_1","volume-title":"Combining pattern classifiers: methods and algorithms","author":"Kuncheva I","unstructured":"Ludmila\u00a0I Kuncheva. 2014. Combining pattern classifiers: methods and algorithms. John Wiley & Sons."},{"key":"e_1_3_2_1_21_1","volume-title":"\u201ctrue\u201d? The dangers of training and evaluating AI tools based on experts","author":"Lebovitz Sarah","year":"2021","unstructured":"Sarah Lebovitz, Natalia Levina, and Hila Lifshitz-Assaf. 2021. Is AI ground truth really \u201ctrue\u201d? The dangers of training and evaluating AI tools based on experts\u2019 know-what. Management Information Systems Quarterly(2021)."},{"key":"e_1_3_2_1_22_1","volume-title":"To incorporate or not to incorporate AI for critical judgments: The importance of ambiguity in professionals","author":"Lebovitz Sarah","unstructured":"Sarah Lebovitz, Hila Lifshitz-Assaf, and Natalia Levina. 2020. To incorporate or not to incorporate AI for critical judgments: The importance of ambiguity in professionals\u2019 judgment process. Collective Intelligence, The Association for Computing Machinery (2020)."},{"key":"e_1_3_2_1_23_1","unstructured":"David Madras Toni Pitassi and Richard Zemel. 2018. Predict Responsibly: Improving Fairness and Accuracy by Learning to Defer. In Advances in Neural Information Processing Systems S.\u00a0Bengio H.\u00a0Wallach H.\u00a0Larochelle K.\u00a0Grauman N.\u00a0Cesa-Bianchi and R.\u00a0Garnett (Eds.). Vol.\u00a031. Curran Associates Inc.https:\/\/proceedings.neurips.cc\/paper\/2018\/file\/09d37c08f7b129e96277388757530c72-Paper.pdf"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Paul\u00a0E Meehl. 1954. Clinical versus statistical prediction: A theoretical analysis and a review of the evidence.(1954).","DOI":"10.1037\/11281-000"},{"key":"e_1_3_2_1_25_1","volume-title":"ICML Workshop on Human-AI Collaboration in Sequential Decision-Making.","author":"Meresht Vahid\u00a0Balazadeh","year":"2020","unstructured":"Vahid\u00a0Balazadeh Meresht, Abir De, Adish Singla, and Manuel Gomez-Rodriguez. 2020. Learning to switch between machines and humans. ICML Workshop on Human-AI Collaboration in Sequential Decision-Making. (2020)."},{"key":"e_1_3_2_1_26_1","volume-title":"Differentiable learning under triage. Advances in Neural Information Processing Systems 34","author":"Okati Nastaran","year":"2021","unstructured":"Nastaran Okati, Abir De, and Manuel Rodriguez. 2021. Differentiable learning under triage. Advances in Neural Information Processing Systems 34 (2021)."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445420"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445315"},{"key":"e_1_3_2_1_29_1","volume-title":"NeurIPS Workshop on Machine Learning for Health (ML4H)","author":"Raghu Maithra","year":"2018","unstructured":"Maithra Raghu, Katy Blumer, Greg Corrado, Jon Kleinberg, Ziad Obermeyer, and Sendhil Mullainathan. 2018. The algorithmic automation problem: Prediction, triage, and human effort. NeurIPS Workshop on Machine Learning for Health (ML4H) (2018)."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ophtha.2018.11.016"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403379"},{"key":"e_1_3_2_1_32_1","unstructured":"Eleni Straitouri Lequn Wang Nastaran Okati and Manuel\u00a0Gomez Rodriguez. 2022. Provably Improving Expert Predictions with Conformal Prediction. arxiv:2201.12006\u00a0[cs.LG]"},{"key":"e_1_3_2_1_33_1","volume-title":"NeurIPS 2018 Workshop on Ethical, Social and Governance Issues in AI","author":"Tan Sarah","year":"2018","unstructured":"Sarah Tan, Julius Adebayo, Kori Inkpen, and Ece Kamar. 2018. Investigating human+ machine complementarity for recidivism predictions. NeurIPS 2018 Workshop on Ethical, Social and Governance Issues in AI (2018)."},{"key":"e_1_3_2_1_34_1","volume-title":"Advances in Neural Information Processing Systems 31 (NeurIPS","author":"Valera I.","year":"2018","unstructured":"I. Valera, A. Singla, and M. Gomez\u00a0Rodriguez. 2018. Enhancing the Accuracy and Fairness of Human Decision Making. In Advances in Neural Information Processing Systems 31 (NeurIPS 2018). Curran Associates, Inc., 1774\u20131783. http:\/\/papers.nips.cc\/paper\/7448-enhancing-the-accuracy-and-fairness-of-human-decision-making.pdf"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"crossref","unstructured":"Kailas Vodrahalli Tobias Gerstenberg and James Zou. 2021. Do Humans Trust Advice More if it Comes from AI? An Analysis of Human-AI Interactions. arXiv preprint arXiv:2107.07015(2021).","DOI":"10.1145\/3514094.3534150"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3437963.3441732"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196730"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300509"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","unstructured":"Muhammad\u00a0Bilal Zafar Isabel Valera Manuel Gomez\u00a0Rodriguez and Krishna\u00a0P. Gummadi. 2017. Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatment. In Proceedings of the 26th International Conference on World Wide Web (Perth Australia) (WWW \u201917). International World Wide Web Conferences Steering Committee Republic and Canton of Geneva CHE 1171\u20131180. https:\/\/doi.org\/10.1145\/3038912.3052660","DOI":"10.1145\/3038912.3052660"}],"event":{"name":"FAccT '22: 2022 ACM Conference on Fairness, Accountability, and Transparency","location":"Seoul Republic of Korea","acronym":"FAccT '22","sponsor":["ACM Association for Computing Machinery"]},"container-title":["2022 ACM Conference on Fairness Accountability and Transparency"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3531146.3533221","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3531146.3533221","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3531146.3533221","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:30Z","timestamp":1750188690000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3531146.3533221"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,20]]},"references-count":39,"alternative-id":["10.1145\/3531146.3533221","10.1145\/3531146"],"URL":"https:\/\/doi.org\/10.1145\/3531146.3533221","relation":{},"subject":[],"published":{"date-parts":[[2022,6,20]]},"assertion":[{"value":"2022-06-20","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}