{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T19:01:53Z","timestamp":1773342113455,"version":"3.50.1"},"reference-count":118,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2024,4,17]],"date-time":"2024-04-17T00:00:00Z","timestamp":1713312000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006374","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-2229876 and IIS-2340209"],"award-info":[{"award-number":["IIS-2229876 and IIS-2340209"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,4,17]]},"abstract":"<jats:p>AI assistance in decision-making has become popular, yet people's inappropriate reliance on AI often leads to unsatisfactory human-AI collaboration performance. In this paper, through three pre-registered, randomized human subject experiments, we explore whether and how the provision of second opinions may affect decision-makers' behavior and performance in AI-assisted decision-making. We find that if both the AI model's decision recommendation and a second opinion are always presented together, decision-makers reduce their over-reliance on AI while increase their under-reliance on AI, regardless whether the second opinion is generated by a peer or another AI model. However, if decision-makers have the control to decide when to solicit a peer's second opinion, we find that their active solicitations of second opinions have the potential to mitigate over-reliance on AI without inducing increased under-reliance in some cases. We conclude by discussing the implications of our findings for promoting effective human-AI collaborations in decision-making.<\/jats:p>","DOI":"10.1145\/3653708","type":"journal-article","created":{"date-parts":[[2024,4,29]],"date-time":"2024-04-29T10:05:31Z","timestamp":1714385131000},"page":"1-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Does More Advice Help? The Effects of Second Opinions in AI-Assisted Decision Making"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1079-2043","authenticated-orcid":false,"given":"Zhuoran","family":"Lu","sequence":"first","affiliation":[{"name":"Purdue University, West Lafayette, IN, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9371-9441","authenticated-orcid":false,"given":"Dakuo","family":"Wang","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, MA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7364-139X","authenticated-orcid":false,"given":"Ming","family":"Yin","sequence":"additional","affiliation":[{"name":"Purdue University, West Lafayette, IN, USA"}]}],"member":"320","published-online":{"date-parts":[[2024,4,26]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449163"},{"key":"e_1_2_2_2_1","volume-title":"An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivariate behavioral research 46, 3","author":"Austin Peter C","year":"2011","unstructured":"Peter C Austin. 2011. An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivariate behavioral research 46, 3 (2011), 399--424."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v7i1.5285"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33012429"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445717"},{"key":"e_1_2_2_6_1","volume-title":"How online discussion board activity affects stock trading: the case of GameStop. Financial markets and portfolio management","author":"Betzer Andr\u00e9","year":"2022","unstructured":"Andr\u00e9 Betzer and Jan Philipp Harries. 2022. How online discussion board activity affects stock trading: the case of GameStop. Financial markets and portfolio management (2022), 1--30."},{"key":"e_1_2_2_7_1","volume-title":"Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences. Organizational behavior and human decision processes 101, 2","author":"Bonaccio Silvia","year":"2006","unstructured":"Silvia Bonaccio and Reeshad S Dalal. 2006. Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences. Organizational behavior and human decision processes 101, 2 (2006), 127--151."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449287"},{"key":"e_1_2_2_9_1","volume-title":"Confidence in aggregation of expert opinions. Acta psychologica 104, 3","author":"Budescu David V","year":"2000","unstructured":"David V Budescu and Adrian K Rantilla. 2000. Confidence in aggregation of expert opinions. Acta psychologica 104, 3 (2000), 371--398."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICHI.2015.26"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v14i1.7282"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610219"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300789"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447535.3462487"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3490099.3511121"},{"key":"e_1_2_2_16_1","volume-title":"Are visual explanations useful? a case study in model-in-the-loop prediction. arXiv preprint arXiv:2007.12248","author":"Chu Eric","year":"2020","unstructured":"Eric Chu, Deb Roy, and Jacob Andreas. 2020. Are visual explanations useful? a case study in model-in-the-loop prediction. arXiv preprint arXiv:2007.12248 (2020)."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00449"},{"key":"e_1_2_2_18_1","volume-title":"Doubting AI Predictions: Influence-Driven Second Opinion Recommendation. arXiv preprint arXiv:2205.00072","author":"De-Arteaga Maria","year":"2022","unstructured":"Maria De-Arteaga, Alexandra Chouldechova, and Artur Dubrawski. 2022. Doubting AI Predictions: Influence-Driven Second Opinion Recommendation. arXiv preprint arXiv:2205.00072 (2022)."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i11.21714"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450698"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000033"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1093\/jleo\/17.1.62"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3503727"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517734"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v8i1.7462"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICoICT.2016.7571912"},{"key":"e_1_2_2_27_1","unstructured":"Raymond Fok and Daniel S Weld. 2023. In Search of Verifiability: Explanations Rarely Enable Complementary Performance in AI-Advised Decision Making. arXiv preprint arXiv:2305.07722 (2023)."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1257\/089533005775196732"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.93.5.1165"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502004"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359152"},{"key":"e_1_2_2_32_1","volume-title":"Taking advice: Accepting help, improving judgment, and sharing responsibility. Organizational behavior and human decision processes 70, 2","author":"Harvey Nigel","year":"1997","unstructured":"Nigel Harvey and Ilan Fischer. 1997. Taking advice: Accepting help, improving judgment, and sharing responsibility. Organizational behavior and human decision processes 70, 2 (1997), 117--133."},{"key":"e_1_2_2_33_1","volume-title":"Using advice and assessing its quality. Organizational behavior and human decision processes 81, 2","author":"Harvey Nigel","year":"2000","unstructured":"Nigel Harvey, Clare Harries, and Ilan Fischer. 2000. Using advice and assessing its quality. Organizational behavior and human decision processes 81, 2 (2000), 252--273."},{"key":"e_1_2_2_34_1","volume-title":"Evaluating explainable AI: Which algorithmic explanations help users predict model behavior? arXiv preprint arXiv:2005.01831","author":"Hase Peter","year":"2020","unstructured":"Peter Hase and Mohit Bansal. 2020. Evaluating explainable AI: Which algorithmic explanations help users predict model behavior? arXiv preprint arXiv:2005.01831 (2020)."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581025"},{"key":"e_1_2_2_36_1","volume-title":"Human-AI Complementarity in Hybrid Intelligence Systems: A Structured Literature Review. PACIS","author":"Hemmer Patrick","year":"2021","unstructured":"Patrick Hemmer, Max Schemmer, Michael V\u00f6ssing, and Niklas K\u00fchl. 2021. Human-AI Complementarity in Hybrid Intelligence Systems: A Structured Literature Review. PACIS (2021), 78."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.82.3.363"},{"key":"e_1_2_2_38_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction 5, CSCW2","author":"Tsung-Yu Hou Yoyo","year":"2021","unstructured":"Yoyo Tsung-Yu Hou and Malte F Jung. 2021. Who is the expert? Reconciling algorithm aversion and algorithm appreciation in AI-supported decision making. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1--25."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0378-7206(00)00051-3"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1017\/S193029750000382X"},{"key":"e_1_2_2_41_1","volume-title":"Exploring the Use of Personalized AI for Identifying Misinformation on Social Media. CHI'23","author":"Jahanbakhsh Farnaz","year":"2023","unstructured":"Farnaz Jahanbakhsh, Yannis Katsis, Dakuo Wang, Lucian Popa, and Michael Muller. 2023. Exploring the Use of Personalized AI for Identifying Misinformation on Social Media. CHI'23 (2023)."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.369"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517533"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300641"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CCAA.2018.8777449"},{"key":"e_1_2_2_46_1","volume-title":"Machine learning applications in cancer prognosis and prediction. Computational and structural biotechnology journal 13","author":"Kourou Konstantina","year":"2015","unstructured":"Konstantina Kourou, Themis P Exarchos, Konstantinos P Exarchos, Michalis V Karamouzis, and Dimitrios I Fotiadis. 2015. Machine learning applications in cancer prognosis and prediction. Computational and structural biotechnology journal 13 (2015), 8--17."},{"key":"e_1_2_2_47_1","volume-title":"Machine learning techniques and data for stock market forecasting: a literature review. Expert Systems with Applications","author":"Kumbure Mahinda Mailagaha","year":"2022","unstructured":"Mahinda Mailagaha Kumbure, Christoph Lohrmann, Pasi Luukka, and Jari Porras. 2022. Machine learning techniques and data for stock market forecasting: a literature review. Expert Systems with Applications (2022), 116659."},{"key":"e_1_2_2_48_1","volume-title":"Towards a science of human-ai decision making: a survey of empirical studies. arXiv preprint arXiv:2112.11471","author":"Lai Vivian","year":"2021","unstructured":"Vivian Lai, Chacha Chen, Q Vera Liao, Alison Smith-Renner, and Chenhao Tan. 2021. Towards a science of human-ai decision making: a survey of empirical studies. arXiv preprint arXiv:2112.11471 (2021)."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376873"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287590"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v37i5.25748"},{"key":"e_1_2_2_52_1","unstructured":"Zhuoyan Li Zhuoran Lu and Ming Yin. 2024. Decoding AI's Nudge: A Unified Framework to Predict Human Behavior in AI-assisted Decision Making. arXiv:2401.05840 [cs.HC]"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479552"},{"key":"e_1_2_2_54_1","volume-title":"Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019)."},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.obhdp.2018.12.005"},{"key":"e_1_2_2_56_1","volume-title":"The role of Reddit sentiment in the GameStop share rally. Financial Review","author":"Long Suwan","year":"2022","unstructured":"Suwan Long, Brian Lucey, Ying Xie, and Larisa Yarovaya. 2022. ?I just like the stock\": The role of Reddit sentiment in the GameStop share rally. Financial Review (2022)."},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2023\/337"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445562"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581058"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.5555\/2002472.2002491"},{"key":"e_1_2_2_61_1","volume-title":"Supporting trust calibration and the effective use of decision aids by presenting dynamic system confidence information. Human factors 48, 4","author":"McGuirl John M","year":"2006","unstructured":"John M McGuirl and Nadine B Sarter. 2006. Supporting trust calibration and the effective use of decision aids by presenting dynamic system confidence information. Human factors 48, 4 (2006), 656--665."},{"key":"e_1_2_2_62_1","volume-title":"Evaluation of sentiment analysis in finance: from lexicons to transformers","author":"Mishev Kostadin","year":"2020","unstructured":"Kostadin Mishev, Ana Gjorgjevikj, Irena Vodenska, Lubomir T Chitkushev, and Dimitar Trajanov. 2020. Evaluation of sentiment analysis in finance: from lexicons to transformers. IEEE access 8 (2020), 131662--131682."},{"key":"e_1_2_2_63_1","volume-title":"Human-in-the-Loop Machine Learning: Active learning and annotation for human-centered AI","author":"Monarch Robert","unstructured":"Robert Monarch and Robert Munro. 2021. Human-in-the-Loop Machine Learning: Active learning and annotation for human-centered AI. Simon and Schuster."},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-022-10246-w"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1049\/iet-its.2018.0064"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0895-4356(00)00321-8"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3334480.3382967"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v8i1.7469"},{"key":"e_1_2_2_69_1","volume-title":"Anchoring Bias Affects Mental Model Formation and User Reliance in Explainable AI Systems. In 26th International Conference on Intelligent User Interfaces. 340--350","author":"Nourani Mahsan","year":"2021","unstructured":"Mahsan Nourani, Chiradeep Roy, Jeremy E Block, Donald R Honeycutt, Tahrima Rahman, Eric Ragan, and Vibhav Gogate. 2021. Anchoring Bias Affects Mental Model Formation and User Reliance in Explainable AI Systems. In 26th International Conference on Intelligent User Interfaces. 340--350."},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0229132"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359204"},{"key":"e_1_2_2_72_1","unstructured":"Samir Passi and Mihaela Vorvoreanu. 2022. Overreliance on AI: Literature review. (2022)."},{"key":"e_1_2_2_73_1","volume-title":"Predicting stock and stock price index movement using trend deterministic data preparation and machine learning techniques. Expert systems with applications 42, 1","author":"Patel Jigar","year":"2015","unstructured":"Jigar Patel, Sahil Shah, Priyank Thakkar, and Ketan Kotecha. 2015. Predicting stock and stock price index movement using trend deterministic data preparation and machine learning techniques. Expert systems with applications 42, 1 (2015), 259--268."},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445315"},{"key":"e_1_2_2_75_1","volume-title":"When Confidence Meets Accuracy: Exploring the Effects of Multiple Performance Indicators on Trust in Machine Learning Models. In CHI Conference on Human Factors in Computing Systems. 1--14","author":"Rechkemmer Amy","year":"2022","unstructured":"Amy Rechkemmer and Ming Yin. 2022. When Confidence Meets Accuracy: Exploring the Effects of Multiple Performance Indicators on Trust in Machine Learning Models. In CHI Conference on Human Factors in Computing Systems. 1--14."},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(79)90017-5"},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.1016\/0749-5978(87)90012-4"},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/70.1.41"},{"key":"e_1_2_2_79_1","article-title":"Machine-learning techniques for customer retention: A comparative study","volume":"9","author":"Sabbeh Sahar F","year":"2018","unstructured":"Sahar F Sabbeh. 2018. Machine-learning techniques for customer retention: A comparative study. International Journal of Advanced Computer Science and Applications 9, 2 (2018).","journal-title":"International Journal of Advanced Computer Science and Applications"},{"key":"e_1_2_2_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302308"},{"key":"e_1_2_2_81_1","volume-title":"Should I Follow AI-based Advice? Measuring Appropriate Reliance in Human-AI Decision-Making. arXiv preprint arXiv:2204.06916","author":"Schemmer Max","year":"2022","unstructured":"Max Schemmer, Patrick Hemmer, Niklas K\u00fchl, Carina Benz, and Gerhard Satzger. 2022. Should I Follow AI-based Advice? Measuring Appropriate Reliance in Human-AI Decision-Making. arXiv preprint arXiv:2204.06916 (2022)."},{"key":"e_1_2_2_82_1","volume-title":"A Meta-Analysis on the Utility of Explainable Artificial Intelligence in Human-AI Decision-Making. arXiv preprint arXiv:2205.05126","author":"Schemmer Max","year":"2022","unstructured":"Max Schemmer, Patrick Hemmer, Maximilian Nitsche, Niklas K\u00fchl, and Michael V\u00f6ssing. 2022. A Meta-Analysis on the Utility of Explainable Artificial Intelligence in Human-AI Decision-Making. arXiv preprint arXiv:2205.05126 (2022)."},{"key":"e_1_2_2_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584066"},{"key":"e_1_2_2_84_1","volume-title":"Quantifying interpretability and trust in machine learning systems. arXiv preprint arXiv:1901.08558","author":"Schmidt Philipp","year":"2019","unstructured":"Philipp Schmidt and Felix Biessmann. 2019. Quantifying interpretability and trust in machine learning systems. arXiv preprint arXiv:1901.08558 (2019)."},{"key":"e_1_2_2_85_1","volume-title":"On the Interdependence of Reliance Behavior and Accuracy in AI-Assisted Decision-Making. arXiv preprint arXiv:2304.08804","author":"Schoeffer Jakob","year":"2023","unstructured":"Jakob Schoeffer, Johannes Jakubik, Michael Voessing, Niklas Kuehl, and Gerhard Satzger. 2023. On the Interdependence of Reliance Behavior and Accuracy in AI-Assisted Decision-Making. arXiv preprint arXiv:2304.08804 (2023)."},{"key":"e_1_2_2_86_1","doi-asserted-by":"publisher","DOI":"10.1257\/000282803321947047"},{"key":"e_1_2_2_87_1","doi-asserted-by":"publisher","DOI":"10.1027\/1618-3169\/a000361"},{"key":"e_1_2_2_88_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSCWD49262.2021.9437789"},{"key":"e_1_2_2_89_1","doi-asserted-by":"publisher","DOI":"10.1016\/0169-2070(89)90084-8"},{"key":"e_1_2_2_90_1","volume-title":"Cueing and cognitive conflict in judge-advisor decision making. Organizational behavior and human decision processes 62, 2","author":"Sniezek Janet A","year":"1995","unstructured":"Janet A Sniezek and Timothy Buckley. 1995. Cueing and cognitive conflict in judge-advisor decision making. Organizational behavior and human decision processes 62, 2 (1995), 159--174."},{"key":"e_1_2_2_91_1","doi-asserted-by":"publisher","DOI":"10.1006\/cogp.1998.0699"},{"key":"e_1_2_2_92_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450613.3456817"},{"key":"e_1_2_2_93_1","volume-title":"The Cognitive Reflection Test as a predictor of performance on heuristics-and-biases tasks. Memory & cognition 39, 7","author":"Toplak Maggie E","year":"2011","unstructured":"Maggie E Toplak, Richard F West, and Keith E Stanovich. 2011. The Cognitive Reflection Test as a predictor of performance on heuristics-and-biases tasks. Memory & cognition 39, 7 (2011), 1275--1289."},{"key":"e_1_2_2_94_1","volume-title":"A human-centered agenda for intelligible machine learning. Machines We Trust: Getting Along with Artificial Intelligence","author":"Vaughan Jennifer Wortman","year":"2020","unstructured":"Jennifer Wortman Vaughan and Hanna Wallach. 2020. A human-centered agenda for intelligible machine learning. Machines We Trust: Getting Along with Artificial Intelligence (2020)."},{"key":"e_1_2_2_95_1","volume-title":"Vinay Anand Tikkiwal, and Arun Kumar","author":"Vijh Mehar","year":"2020","unstructured":"Mehar Vijh, Deeksha Chandola, Vinay Anand Tikkiwal, and Arun Kumar. 2020. Stock closing price prediction using machine learning techniques. Procedia computer science 167 (2020), 599--606."},{"key":"e_1_2_2_96_1","doi-asserted-by":"publisher","DOI":"10.1145\/3489465"},{"key":"e_1_2_2_97_1","doi-asserted-by":"crossref","unstructured":"Dakuo Wang Elizabeth Churchill Pattie Maes Xiangmin Fan Ben Shneiderman Yuanchun Shi and Qianying Wang. 2020. From human-human collaboration to Human-AI collaboration: Designing AI systems that can work together with people. In Extended abstracts of the 2020 CHI conference on human factors in computing systems. 1--6.","DOI":"10.1145\/3334480.3381069"},{"key":"e_1_2_2_98_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359313"},{"key":"e_1_2_2_99_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300831"},{"key":"e_1_2_2_100_1","first-page":"57","article-title":"Human-Centered Design and Evaluation of AI-Empowered Clinical Decision Support Systems","volume":"5","author":"Wang Liuping","year":"2023","unstructured":"Liuping Wang, Zhan Zhang, Dakuo Wang, Weidan Cao, Xiaomu Zhou, Ping Zhang, Jianxing Liu, Xiangmin Fan, and Feng Tian. 2023. Human-Centered Design and Evaluation of AI-Empowered Clinical Decision Support Systems: A Systematic Review. Frontiers in Computer Science 5 (2023), 57.","journal-title":"A Systematic Review. Frontiers in Computer Science"},{"key":"e_1_2_2_101_1","volume-title":"Proceedings of the ACM Web Conference","author":"Lu Zhuoran","year":"2022","unstructured":"XinruWang, Zhuoran Lu, and Ming Yin. 2022. Will You Accept the AI Recommendation? Predicting Human Behavior in AI-Assisted Decision Making. In Proceedings of the ACM Web Conference 2022. 1697--1708."},{"key":"e_1_2_2_102_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450650"},{"key":"e_1_2_2_103_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581197"},{"key":"e_1_2_2_104_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2022.05.014"},{"key":"e_1_2_2_105_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.naacl-main.43"},{"key":"e_1_2_2_106_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377325.3377480"},{"key":"e_1_2_2_107_1","volume-title":"The benefit of additional opinions. Current directions in psychological science 13, 2","author":"Yaniv Ilan","year":"2004","unstructured":"Ilan Yaniv. 2004. The benefit of additional opinions. Current directions in psychological science 13, 2 (2004), 75--78."},{"key":"e_1_2_2_108_1","volume-title":"Advice taking in decision making: Egocentric discounting and reputation formation. Organizational behavior and human decision processes 83, 2","author":"Yaniv Ilan","year":"2000","unstructured":"Ilan Yaniv and Eli Kleinberger. 2000. Advice taking in decision making: Egocentric discounting and reputation formation. Organizational behavior and human decision processes 83, 2 (2000), 260--281."},{"key":"e_1_2_2_109_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.obhdp.2006.05.006"},{"key":"e_1_2_2_110_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-emnlp.778"},{"key":"e_1_2_2_111_1","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.2118"},{"key":"e_1_2_2_112_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300509"},{"key":"e_1_2_2_113_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302277"},{"key":"e_1_2_2_114_1","volume-title":"Long-Text Sentiment Analysis Based on Semantic Graph. In 2020 IEEE International Conference on Embedded Software and Systems (ICESS). IEEE, 1--6.","author":"Zhang Linkun","year":"2020","unstructured":"Linkun Zhang, Yuxia Lei, and Zhengyan Wang. 2020. Long-Text Sentiment Analysis Based on Semantic Graph. In 2020 IEEE International Conference on Embedded Software and Systems (ICESS). IEEE, 1--6."},{"key":"e_1_2_2_115_1","doi-asserted-by":"crossref","unstructured":"Shao Zhang Jianing Yu Xuhai Xu Changchang Yin Yuxuan Lu Bingsheng Yao Melanie Tory Lace M Padilla Jeffrey Caterino Ping Zhang et al. 2023. Rethinking human-ai collaboration in complex medical decision making: A case study in sepsis diagnosis. arXiv preprint arXiv:2309.12368 (2023).","DOI":"10.1145\/3613904.3642343"},{"key":"e_1_2_2_116_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372852"},{"key":"e_1_2_2_117_1","volume-title":"StoryBuddy: A Human-AI Collaborative Chatbot for Parent-Child Interactive Storytelling with Flexible Parental Involvement. CHI'2022","author":"Zhang Zheng","year":"2022","unstructured":"Zheng Zhang, Ying Xu, Yanhao Wang, Bingsheng Yao, Daniel Ritchie, Tongshuang Wu, Mo Yu, Dakuo Wang, and Toby Jia-Jun Li. 2022. StoryBuddy: A Human-AI Collaborative Chatbot for Parent-Child Interactive Storytelling with Flexible Parental Involvement. CHI'2022 (2022)."},{"key":"e_1_2_2_118_1","volume-title":"Sentiment analysis in health and well-being: systematic review. JMIR medical informatics 8, 1","author":"Zunic Anastazia","year":"2020","unstructured":"Anastazia Zunic, Padraig Corcoran, and Irena Spasic. 2020. Sentiment analysis in health and well-being: systematic review. JMIR medical informatics 8, 1 (2020), e16023."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3653708","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3653708","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T17:32:02Z","timestamp":1755883922000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3653708"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,17]]},"references-count":118,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2024,4,17]]}},"alternative-id":["10.1145\/3653708"],"URL":"https:\/\/doi.org\/10.1145\/3653708","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,17]]},"assertion":[{"value":"2024-04-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}