{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,20]],"date-time":"2025-11-20T18:49:56Z","timestamp":1763664596970,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,6,28]],"date-time":"2021-06-28T00:00:00Z","timestamp":1624838400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSF Program on Fairness in AI in collaboration with Amazon","award":["1939606"],"award-info":[{"award-number":["1939606"]}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2001851, 2000782 and 1952085"],"award-info":[{"award-number":["2001851, 2000782 and 1952085"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,6,28]]},"DOI":"10.1145\/3461778.3462099","type":"proceedings-article","created":{"date-parts":[[2021,6,28]],"date-time":"2021-06-28T20:27:20Z","timestamp":1624912040000},"page":"1554-1565","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Wikipedia ORES Explorer: Visualizing Trade-offs For Designing Applications With Machine Learning API"],"prefix":"10.1145","author":[{"given":"Zining","family":"Ye","sequence":"first","affiliation":[{"name":"Human-Computer Interaction Institute Carnegie Mellon University, United States"}]},{"given":"Xinran","family":"Yuan","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, United States"}]},{"given":"Shaurya","family":"Gaur","sequence":"additional","affiliation":[{"name":"Oregon State University, United States"}]},{"given":"Aaron","family":"Halfaker","sequence":"additional","affiliation":[{"name":"Microsoft, Redmond, WA, United States"}]},{"given":"Jodi","family":"Forlizzi","sequence":"additional","affiliation":[{"name":"Human-Computer Interaction Institute Carnegie Mellon University, United States"}]},{"given":"Haiyi","family":"Zhu","sequence":"additional","affiliation":[{"name":"Human Computer Interaction Institute Carnegie Mellon University, United States"}]}],"member":"320","published-online":{"date-parts":[[2021,6,28]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174156"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v35i4.2513"},{"key":"e_1_3_2_1_3_1","volume-title":"May 23(2016)","author":"Angwin Julia","year":"2016","unstructured":"Julia Angwin , Jeff Larson , Surya Mattu , and Lauren Kirchner . 2016. Machine bias. ProPublica , May 23(2016) , 2016 . Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine bias. ProPublica, May 23(2016), 2016."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-44781-0_8"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST47406.2019.8986948"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359206"},{"volume-title":"Intelligible and Explainable Machine Learning: Best Practices and Practical Challenges(KDD \u201920)","author":"Caruana Rich","key":"e_1_3_2_1_7_1","unstructured":"Rich Caruana , Scott Lundberg , Marco\u00a0Tulio Ribeiro , Harsha Nori , and Samuel Jenkins . 2020. Intelligible and Explainable Machine Learning: Best Practices and Practical Challenges(KDD \u201920) . Association for Computing Machinery , New York, NY, USA , 3511\u20133512. https:\/\/doi.org\/10.1145\/3394486.3406707 10.1145\/3394486.3406707 Rich Caruana, Scott Lundberg, Marco\u00a0Tulio Ribeiro, Harsha Nori, and Samuel Jenkins. 2020. Intelligible and Explainable Machine Learning: Best Practices and Practical Challenges(KDD \u201920). Association for Computing Machinery, New York, NY, USA, 3511\u20133512. https:\/\/doi.org\/10.1145\/3394486.3406707"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3406707"},{"key":"e_1_3_2_1_9_1","unstructured":"Kathy Charmaz. 2014. Constructing grounded theory. sage.  Kathy Charmaz. 2014. Constructing grounded theory. sage."},{"key":"e_1_3_2_1_10_1","unstructured":"Mark Craven and Jude Shavlik. 1999. Rule extraction: Where do we go from here. University of Wisconsin Machine Learning Research Group working Paper 99 (1999).  Mark Craven and Jude Shavlik. 1999. Rule extraction: Where do we go from here. University of Wisconsin Machine Learning Research Group working Paper 99 (1999)."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025739"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2011.6102453"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491055.2491061"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2856492"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSAA.2018.00018"},{"key":"e_1_3_2_1_16_1","volume-title":"ORES: Lowering Barriers with Participatory Machine Learning in Wikipedia. arXiv preprint arXiv:1909.05189(2019).","author":"Halfaker Aaron","year":"2019","unstructured":"Aaron Halfaker and R\u00a0Stuart Geiger . 2019 . ORES: Lowering Barriers with Participatory Machine Learning in Wikipedia. arXiv preprint arXiv:1909.05189(2019). Aaron Halfaker and R\u00a0Stuart Geiger. 2019. ORES: Lowering Barriers with Participatory Machine Learning in Wikipedia. arXiv preprint arXiv:1909.05189(2019)."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3085571"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300830"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376219"},{"key":"e_1_3_2_1_20_1","volume-title":"How we analyzed the COMPAS recidivism algorithm. ProPublica (5 2016) 9, 1","author":"Larson Jeff","year":"2016","unstructured":"Jeff Larson , Surya Mattu , Lauren Kirchner , and Julia Angwin . 2016. How we analyzed the COMPAS recidivism algorithm. ProPublica (5 2016) 9, 1 ( 2016 ). Jeff Larson, Surya Mattu, Lauren Kirchner, and Julia Angwin. 2016. How we analyzed the COMPAS recidivism algorithm. ProPublica (5 2016) 9, 1 (2016)."},{"key":"e_1_3_2_1_21_1","unstructured":"Jeff Larson Surya Mattu Lauren Kirchner and Julia Angwin. 2016. How We Analyzed the COMPAS Recidivism Algorithm. https:\/\/www.propublica.org\/article\/how-we-analyzed-the-compas-recidivism-algorithm  Jeff Larson Surya Mattu Lauren Kirchner and Julia Angwin. 2016. How We Analyzed the COMPAS Recidivism Algorithm. https:\/\/www.propublica.org\/article\/how-we-analyzed-the-compas-recidivism-algorithm"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376590"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287596"},{"key":"e_1_3_2_1_24_1","volume-title":"Dissecting racial bias in an algorithm used to manage the health of populations. Science 366, 6464","author":"Obermeyer Ziad","year":"2019","unstructured":"Ziad Obermeyer , Brian Powers , Christine Vogeli , and Sendhil Mullainathan . 2019. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366, 6464 ( 2019 ), 447\u2013453. Ziad Obermeyer, Brian Powers, Christine Vogeli, and Sendhil Mullainathan. 2019. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366, 6464 (2019), 447\u2013453."},{"key":"e_1_3_2_1_25_1","unstructured":"Marco\u00a0Tulio Ribeiro Sameer Singh and Carlos Guestrin. 2016. Model-agnostic interpretability of machine learning. arXiv preprint arXiv:1606.05386(2016).  Marco\u00a0Tulio Ribeiro Sameer Singh and Carlos Guestrin. 2016. Model-agnostic interpretability of machine learning. arXiv preprint arXiv:1606.05386(2016)."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376783"},{"key":"e_1_3_2_1_28_1","unstructured":"Nathan TeBlunthuis Benjamin\u00a0Mako Hill and Aaron Halfaker. 2020. The effects of algorithmic flagging on fairness: quasi-experimental evidence from Wikipedia. arXiv preprint arXiv:2006.03121(2020).  Nathan TeBlunthuis Benjamin\u00a0Mako Hill and Aaron Halfaker. 2020. The effects of algorithmic flagging on fairness: quasi-experimental evidence from Wikipedia. arXiv preprint arXiv:2006.03121(2020)."},{"key":"e_1_3_2_1_29_1","unstructured":"Martin Wattenberg Fernanda Vi\u00e9gas and Moritz Hardt. 2016. Attacking discrimination with smarter machine learning. Google Research 17(2016).  Martin Wattenberg Fernanda Vi\u00e9gas and Moritz Hardt. 2016. Attacking discrimination with smarter machine learning. Google Research 17(2016)."},{"key":"e_1_3_2_1_30_1","volume-title":"The what-if tool: Interactive probing of machine learning models","author":"Wexler James","year":"2019","unstructured":"James Wexler , Mahima Pushkarna , Tolga Bolukbasi , Martin Wattenberg , Fernanda Vi\u00e9gas , and Jimbo Wilson . 2019. The what-if tool: Interactive probing of machine learning models . IEEE transactions on visualization and computer graphics 26, 1( 2019 ), 56\u201365. James Wexler, Mahima Pushkarna, Tolga Bolukbasi, Martin Wattenberg, Fernanda Vi\u00e9gas, and Jimbo Wilson. 2019. The what-if tool: Interactive probing of machine learning models. IEEE transactions on visualization and computer graphics 26, 1(2019), 56\u201365."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/3122009.3153004"},{"key":"e_1_3_2_1_32_1","unstructured":"Qian Yang. 2018. Machine learning as a UX design material: How can we imagine beyond automation recommenders and reminders?. In AAAI Spring Symposia.  Qian Yang. 2018. Machine learning as a UX design material: How can we imagine beyond automation recommenders and reminders?. In AAAI Spring Symposia."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196730"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376301"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376301"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196729"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357236.3395528"}],"event":{"name":"DIS '21: Designing Interactive Systems Conference 2021","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Virtual Event USA","acronym":"DIS '21"},"container-title":["Designing Interactive Systems Conference 2021"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461778.3462099","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3461778.3462099","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3461778.3462099","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:33Z","timestamp":1750191453000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461778.3462099"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,28]]},"references-count":37,"alternative-id":["10.1145\/3461778.3462099","10.1145\/3461778"],"URL":"https:\/\/doi.org\/10.1145\/3461778.3462099","relation":{},"subject":[],"published":{"date-parts":[[2021,6,28]]},"assertion":[{"value":"2021-06-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}