{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T15:13:39Z","timestamp":1784819619077,"version":"3.55.0"},"reference-count":59,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,2,9]],"date-time":"2024-02-09T00:00:00Z","timestamp":1707436800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,9]],"date-time":"2024-02-09T00:00:00Z","timestamp":1707436800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2020AAA0108101"],"award-info":[{"award-number":["2020AAA0108101"]}]},{"name":"National Natural Science Foundation of China under Grant","award":["U1964201"],"award-info":[{"award-number":["U1964201"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Auton. Intell. Syst."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>With the tremendous success of machine learning (ML), concerns about their black-box nature have grown. The issue of interpretability affects trust in ML systems and raises ethical concerns such as algorithmic bias. In recent years, the feature attribution explanation method based on Shapley value has become the mainstream explainable artificial intelligence approach for explaining ML models. This paper provides a comprehensive overview of Shapley value-based attribution methods. We begin by outlining the foundational theory of Shapley value rooted in cooperative game theory and discussing its desirable properties. To enhance comprehension and aid in identifying relevant algorithms, we propose a comprehensive classification framework for existing Shapley value-based feature attribution methods from three dimensions: Shapley value type, feature replacement method, and approximation method. Furthermore, we emphasize the practical application of the Shapley value at different stages of ML model development, encompassing pre-modeling, modeling, and post-modeling phases. Finally, this work summarizes the limitations associated with the Shapley value and discusses potential directions for future research.<\/jats:p>","DOI":"10.1007\/s43684-023-00060-8","type":"journal-article","created":{"date-parts":[[2024,2,9]],"date-time":"2024-02-09T09:02:46Z","timestamp":1707469366000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":186,"title":["Shapley value: from cooperative game to explainable artificial intelligence"],"prefix":"10.1007","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7313-0277","authenticated-orcid":false,"given":"Meng","family":"Li","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hengyang","family":"Sun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanjun","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hong","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,2,9]]},"reference":[{"issue":"7587","key":"60_CR1","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1038\/nature16961","volume":"529","author":"D. Silver","year":"2016","unstructured":"D. Silver, A. Huang, C.J. Maddison, A. Guez, L. Sifre, G. Van Den Driessche, J. Schrittwieser, I. Antonoglou, V. Panneershelvam, M. Lanctot et al., Mastering the game of go with deep neural networks and tree search. Nature 529(7587), 484\u2013489 (2016)","journal-title":"Nature"},{"issue":"7676","key":"60_CR2","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1038\/nature24270","volume":"550","author":"D. Silver","year":"2017","unstructured":"D. Silver, J. Schrittwieser, K. Simonyan, I. Antonoglou, A. Huang, A. Guez, T. Hubert, L. Baker, M. Lai, A. Bolton et al., Mastering the game of go without human knowledge. Nature 550(7676), 354\u2013359 (2017)","journal-title":"Nature"},{"issue":"7782","key":"60_CR3","doi-asserted-by":"publisher","first-page":"350","DOI":"10.1038\/s41586-019-1724-z","volume":"575","author":"O. Vinyals","year":"2019","unstructured":"O. Vinyals, I. Babuschkin, W.M. Czarnecki, M. Mathieu, A. Dudzik, J. Chung, D.H. Choi, R. Powell, T. Ewalds, P. Georgiev et al., Grandmaster level in starcraft ii using multi-agent reinforcement learning. Nature 575(7782), 350\u2013354 (2019)","journal-title":"Nature"},{"issue":"7896","key":"60_CR4","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1038\/s41586-021-04357-7","volume":"602","author":"P.R. Wurman","year":"2022","unstructured":"P.R. Wurman, S. Barrett, K. Kawamoto, J. MacGlashan, K. Subramanian, T.J. Walsh, R. Capobianco, A. Devlic, F. Eckert, F. Fuchs et al., Outracing champion Gran Turismo drivers with deep reinforcement learning. Nature 602(7896), 223\u2013228 (2022)","journal-title":"Nature"},{"issue":"7953","key":"60_CR5","doi-asserted-by":"publisher","first-page":"620","DOI":"10.1038\/s41586-023-05732-2","volume":"615","author":"S. Feng","year":"2023","unstructured":"S. Feng, H. Sun, X. Yan, H. Zhu, Z. Zou, S. Shen, H.X. Liu, Dense reinforcement learning for safety validation of autonomous vehicles. Nature 615(7953), 620\u2013627 (2023)","journal-title":"Nature"},{"issue":"7792","key":"60_CR6","doi-asserted-by":"publisher","first-page":"706","DOI":"10.1038\/s41586-019-1923-7","volume":"577","author":"A.W. Senior","year":"2020","unstructured":"A.W. Senior, R. Evans, J. Jumper, J. Kirkpatrick, L. Sifre, T. Green, C. Qin, A. \u017d\u00eddek, A.W. Nelson, A. Bridgland et al., Improved protein structure prediction using potentials from deep learning. Nature 577(7792), 706\u2013710 (2020)","journal-title":"Nature"},{"key":"60_CR7","doi-asserted-by":"publisher","unstructured":"A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A.N. Gomez, \u0141. Kaiser, I. Polosukhin, Attention is all you need. Adv. Neural Inf. Process. Syst. 30 (2017). https:\/\/doi.org\/10.48550\/arXiv.1706.03762. arXiv:1706.03762","DOI":"10.48550\/arXiv.1706.03762"},{"key":"60_CR8","unstructured":"I. Zliobaite, A survey on measuring indirect discrimination in machine learning. arXiv preprint (2015). arXiv:1511.00148"},{"key":"60_CR9","first-page":"1","volume":"25","author":"P. Regulation","year":"2018","unstructured":"P. Regulation, General data protection regulation. Intouch 25, 1\u20135 (2018)","journal-title":"Intouch"},{"key":"60_CR10","first-page":"3319","volume-title":"International Conference on Machine Learning","author":"M. Sundararajan","year":"2017","unstructured":"M. Sundararajan, A. Taly, Q. Yan, Axiomatic attribution for deep networks, in International Conference on Machine Learning (PMLR, 2017), pp.\u00a03319\u20133328"},{"issue":"7","key":"60_CR11","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0130140","volume":"10","author":"S. Bach","year":"2015","unstructured":"S. Bach, A. Binder, G. Montavon, F. Klauschen, K.-R. M\u00fcller, W. Samek, On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PLoS ONE 10(7), 0130140 (2015)","journal-title":"PLoS ONE"},{"key":"60_CR12","first-page":"3145","volume-title":"International Conference on Machine Learning","author":"A. Shrikumar","year":"2017","unstructured":"A. Shrikumar, P. Greenside, A. Kundaje, Learning important features through propagating activation differences, in International Conference on Machine Learning (PMLR, 2017), pp.\u00a03145\u20133153"},{"key":"60_CR13","doi-asserted-by":"publisher","first-page":"1135","DOI":"10.1145\/2939672.2939778","volume-title":"Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"M.T. Ribeiro","year":"2016","unstructured":"M.T. Ribeiro, S. Singh, C. Guestrin, \u2018Why should I trust you?\u201d Explaining the predictions of any classifier, in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2016), pp.\u00a01135\u20131144"},{"key":"60_CR14","doi-asserted-by":"publisher","unstructured":"S.M. Lundberg, S.-I. Lee, A unified approach to interpreting model predictions. Adv. Neural Inf. Process. Syst. 30 (2017). https:\/\/doi.org\/10.48550\/arXiv.1705.07874. arXiv:1705.07874","DOI":"10.48550\/arXiv.1705.07874"},{"key":"60_CR15","doi-asserted-by":"crossref","unstructured":"B. Rozemberczki, L. Watson, P. Bayer, H.-T. Yang, O. Kiss, S. Nilsson, R. Sarkar, The Shapley value in machine learning. arXiv preprint (2022). arXiv:2202.05594","DOI":"10.24963\/ijcai.2022\/778"},{"key":"60_CR16","doi-asserted-by":"publisher","first-page":"590","DOI":"10.1038\/s42256-023-00657-x","volume":"5","author":"H. Chen","year":"2023","unstructured":"H. Chen, I.C. Covert, S.M. Lundberg, S.-I. Lee, Algorithms to estimate Shapley value feature attributions. Nat. Mach. Intell. 5, 590\u2013601 (2023)","journal-title":"Nat. Mach. Intell."},{"key":"60_CR17","unstructured":"C. Molnar, Interpretable Machine Learning. Lulu.com (2020)"},{"key":"60_CR18","volume-title":"Models in Cooperative Game Theory","author":"R. Branzei","year":"2008","unstructured":"R. Branzei, D. Dimitrov, S. Tijs, Models in Cooperative Game Theory, vol.\u00a0556 (Springer, Berlin, 2008)"},{"key":"60_CR19","volume-title":"Contributions to the Theory of Games","author":"H.W. Kuhn","year":"1953","unstructured":"H.W. Kuhn, A.W. Tucker, Contributions to the Theory of Games, vol.\u00a028 (Princeton University Press, Princeton, 1953)"},{"key":"60_CR20","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1007\/978-3-642-45494-3_7","volume-title":"Mathematical Economics and Game Theory: Essays in Honor of Oskar Morgenstern","author":"G. Owen","year":"1977","unstructured":"G. Owen, Values of games with a priori unions, in Mathematical Economics and Game Theory: Essays in Honor of Oskar Morgenstern (Springer, Berlin, 1977), pp.\u00a076\u201388"},{"key":"60_CR21","unstructured":"C. Frye, D. Mijolla, T. Begley, L. Cowton, M. Stanley, I. Feige, Shapley explainability on the data manifold. arXiv preprint (2020). arXiv:2006.01272"},{"issue":"10","key":"60_CR22","doi-asserted-by":"publisher","first-page":"749","DOI":"10.1038\/s41551-018-0304-0","volume":"2","author":"S.M. Lundberg","year":"2018","unstructured":"S.M. Lundberg, B. Nair, M.S. Vavilala, M. Horibe, M.J. Eisses, T. Adams, D.E. Liston, D.K.-W. Low, S.-F. Newman, J. Kim et al., Explainable machine-learning predictions for the prevention of hypoxaemia during surgery. Nat. Biomed. Eng. 2(10), 749\u2013760 (2018)","journal-title":"Nat. Biomed. Eng."},{"issue":"9","key":"60_CR23","doi-asserted-by":"publisher","first-page":"1145","DOI":"10.1088\/0034-4885\/43\/9\/002","volume":"43","author":"F. James","year":"1980","unstructured":"F. James, Monte Carlo theory and practice. Rep. Prog. Phys. 43(9), 1145 (1980)","journal-title":"Rep. Prog. Phys."},{"issue":"14","key":"60_CR24","doi-asserted-by":"publisher","first-page":"1673","DOI":"10.1016\/j.artint.2008.05.003","volume":"172","author":"S.S. Fatima","year":"2008","unstructured":"S.S. Fatima, M. Wooldridge, N.R. Jennings, A linear approximation method for the Shapley value. Artif. Intell. 172(14), 1673\u20131699 (2008)","journal-title":"Artif. Intell."},{"issue":"5","key":"60_CR25","doi-asserted-by":"publisher","first-page":"1726","DOI":"10.1016\/j.cor.2008.04.004","volume":"36","author":"J. Castro","year":"2009","unstructured":"J. Castro, D. G\u00f3mez, J. Tejada, Polynomial calculation of the Shapley value based on sampling. Comput. Oper. Res. 36(5), 1726\u20131730 (2009)","journal-title":"Comput. Oper. Res."},{"key":"60_CR26","doi-asserted-by":"publisher","first-page":"647","DOI":"10.1007\/s10115-013-0679-x","volume":"41","author":"E. \u0160trumbelj","year":"2014","unstructured":"E. \u0160trumbelj, I. Kononenko, Explaining prediction models and individual predictions with feature contributions. Knowl. Inf. Syst. 41, 647\u2013665 (2014)","journal-title":"Knowl. Inf. Syst."},{"key":"60_CR27","first-page":"1","volume":"23","author":"R. Mitchell","year":"2022","unstructured":"R. Mitchell, J. Cooper, E. Frank, G. Holmes, Sampling permutations for Shapley value estimation. J. Mach. Learn. Res. 23, 1\u201346 (2022)","journal-title":"J. Mach. Learn. Res."},{"key":"60_CR28","first-page":"3457","volume-title":"International Conference on Artificial Intelligence and Statistics","author":"I. Covert","year":"2021","unstructured":"I. Covert, S.-I. Lee, Improving kernelshap: practical Shapley value estimation using linear regression, in International Conference on Artificial Intelligence and Statistics (PMLR, 2021), pp.\u00a03457\u20133465"},{"key":"60_CR29","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1007\/978-3-030-57321-8_6","volume-title":"Machine Learning and Knowledge Extraction: 4th IFIP TC 5, TC 12, WG 8.4, WG 8.9, WG 12.9 International Cross-Domain Conference, CD-MAKE 2020, Dublin, Ireland, August 25\u201328, 2020, Proceedings 4","author":"G. Simon","year":"2020","unstructured":"G. Simon, T. Vincent, A projected stochastic gradient algorithm for estimating Shapley value applied in attribute importance, in Machine Learning and Knowledge Extraction: 4th IFIP TC 5, TC 12, WG 8.4, WG 8.9, WG 12.9 International Cross-Domain Conference, CD-MAKE 2020, Dublin, Ireland, August 25\u201328, 2020, Proceedings 4 (Springer, Berlin, 2020), pp.\u00a097\u2013115"},{"key":"60_CR30","volume-title":"International Conference on Learning Representations","author":"N. Jethani","year":"2021","unstructured":"N. Jethani, M. Sudarshan, I.C. Covert, S.-I. Lee, R. Ranganath, Fastshap: real-time Shapley value estimation, in International Conference on Learning Representations (2021)"},{"key":"60_CR31","doi-asserted-by":"publisher","first-page":"7992","DOI":"10.1109\/ICPR48806.2021.9412511","volume-title":"2020 25th International Conference on Pattern Recognition (ICPR)","author":"R. Okhrati","year":"2021","unstructured":"R. Okhrati, A. Lipani, A multilinear sampling algorithm to estimate Shapley values, in 2020 25th International Conference on Pattern Recognition (ICPR) (IEEE, New York, 2021), pp.\u00a07992\u20137999"},{"key":"60_CR32","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1007\/978-3-030-53352-6_24","volume-title":"Explainable AI in Healthcare and Medicine: Building a Culture of Transparency and Accountability","author":"H. Chen","year":"2021","unstructured":"H. Chen, S. Lundberg, S.-I. Lee, Explaining models by propagating Shapley values of local components, in Explainable AI in Healthcare and Medicine: Building a Culture of Transparency and Accountability (2021), pp.\u00a0261\u2013270"},{"issue":"1","key":"60_CR33","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-022-31384-3","volume":"13","author":"H. Chen","year":"2022","unstructured":"H. Chen, S.M. Lundberg, S.-I. Lee, Explaining a series of models by propagating Shapley values. Nat. Commun. 13(1), 4512 (2022)","journal-title":"Nat. Commun."},{"key":"60_CR34","unstructured":"M. Mase, A.B. Owen, B. Seiler, Explaining black box decisions by shapley cohort refinement. arXiv preprint (2019). arXiv:1911.00467"},{"issue":"1","key":"60_CR35","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1038\/s42256-019-0138-9","volume":"2","author":"S.M. Lundberg","year":"2020","unstructured":"S.M. Lundberg, G. Erion, H. Chen, A. DeGrave, J.M. Prutkin, B. Nair, R. Katz, J. Himmelfarb, N. Bansal, S.-I. Lee, From local explanations to global understanding with explainable AI for trees. Nat. Mach. Intell. 2(1), 56\u201367 (2020)","journal-title":"Nat. Mach. Intell."},{"key":"60_CR36","unstructured":"S.M. Lundberg, G.G. Erion, S.-I. Lee, Consistent individualized feature attribution for tree ensembles. arXiv preprint (2018). arXiv:1802.03888"},{"key":"60_CR37","first-page":"272","volume-title":"International Conference on Machine Learning","author":"M. Ancona","year":"2019","unstructured":"M. Ancona, C. Oztireli, M. Gross, Explaining deep neural networks with a polynomial time algorithm for Shapley value approximation, in International Conference on Machine Learning (PMLR, 2019), pp.\u00a0272\u2013281"},{"key":"60_CR38","unstructured":"R. Wang, X. Wang, D.I. Inouye, Shapley explanation networks. arXiv preprint (2021). arXiv:2104.02297"},{"key":"60_CR39","first-page":"2907","volume-title":"International Conference on Artificial Intelligence and Statistics","author":"D. Janzing","year":"2020","unstructured":"D. Janzing, L. Minorics, P. Bl\u00f6baum, Feature relevance quantification in explainable AI: a causal problem, in International Conference on Artificial Intelligence and Statistics (PMLR, 2020), pp.\u00a02907\u20132916"},{"key":"60_CR40","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1007\/978-3-319-73848-2_33","volume-title":"The Mathematics of the Uncertain: A Tribute to Pedro Gil","author":"A. Saavedra-Nieves","year":"2018","unstructured":"A. Saavedra-Nieves, I. Garc\u00eda-Jurado, M.G. Fiestras-Janeiro, Estimation of the owen value based on sampling, in The Mathematics of the Uncertain: A Tribute to Pedro Gil (2018), pp.\u00a0347\u2013356"},{"key":"60_CR41","first-page":"1229","volume":"33","author":"C. Frye","year":"2020","unstructured":"C. Frye, C. Rowat, I. Feige, Asymmetric Shapley values: incorporating causal knowledge into model-agnostic explainability. Adv. Neural Inf. Process. Syst. 33, 1229\u20131239 (2020)","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"60_CR42","first-page":"4778","volume":"33","author":"T. Heskes","year":"2020","unstructured":"T. Heskes, E. Sijben, I.G. Bucur, T. Claassen, Causal Shapley values: exploiting causal knowledge to explain individual predictions of complex models. Adv. Neural Inf. Process. Syst. 33, 4778\u20134789 (2020)","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"60_CR43","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511803161","volume-title":"Causality","author":"J. Pearl","year":"2009","unstructured":"J. Pearl, Causality (Cambridge University Press, Cambridge, 2009)"},{"key":"60_CR44","first-page":"721","volume-title":"International Conference on Artificial Intelligence and Statistics","author":"J. Wang","year":"2021","unstructured":"J. Wang, J. Wiens, S. Lundberg, Shapley flow: a graph-based approach to interpreting model predictions, in International Conference on Artificial Intelligence and Statistics (PMLR, 2021), pp.\u00a0721\u2013729"},{"issue":"98Eqr","key":"60_CR45","first-page":"155","volume":"1","author":"S. Cohen","year":"2005","unstructured":"S. Cohen, E. Ruppin, G. Dror, Feature selection based on the Shapley value. Other Words 1(98Eqr), 155 (2005)","journal-title":"Other Words"},{"key":"60_CR46","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1109\/SIBGRAPI51738.2020.00053","volume-title":"2020 33rd SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI)","author":"W.E. Marc\u00edlio","year":"2020","unstructured":"W.E. Marc\u00edlio, D.M. Eler, From explanations to feature selection: assessing shap values as feature selection mechanism, in 2020 33rd SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) (IEEE, New York, 2020), pp.\u00a0340\u2013347"},{"issue":"1","key":"60_CR47","doi-asserted-by":"publisher","first-page":"72","DOI":"10.3390\/fintech1010006","volume":"1","author":"A. Gramegna","year":"2022","unstructured":"A. Gramegna, P. Giudici, Shapley feature selection. FinTech 1(1), 72\u201380 (2022)","journal-title":"FinTech"},{"key":"60_CR48","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1109\/EMBC.2018.8512266","volume-title":"2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)","author":"M. Zaeri-Amirani","year":"2018","unstructured":"M. Zaeri-Amirani, F. Afghah, S. Mousavi, A feature selection method based on Shapley value to false alarm reduction in icus a genetic-algorithm approach, in 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (IEEE, New York, 2018), pp.\u00a0319\u2013323"},{"key":"60_CR49","first-page":"7285","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"J. Wang","year":"2020","unstructured":"J. Wang, Y. Zhang, T.-K. Kim, Y. Gu, Shapley q-value: a local reward approach to solve global reward games, in Proceedings of the AAAI Conference on Artificial Intelligence, vol.\u00a034 (2020), pp.\u00a07285\u20137292"},{"key":"60_CR50","first-page":"5941","volume":"35","author":"J. Wang","year":"2022","unstructured":"J. Wang, Y. Zhang, Y. Gu, T.-K. Kim, Shaq: incorporating Shapley value theory into multi-agent q-learning. Adv. Neural Inf. Process. Syst. 35, 5941\u20135954 (2022)","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"60_CR51","first-page":"2242","volume-title":"International Conference on Machine Learning","author":"A. Ghorbani","year":"2019","unstructured":"A. Ghorbani, J. Zou, Data Shapley: equitable valuation of data for machine learning, in International Conference on Machine Learning (PMLR, 2019), pp.\u00a02242\u20132251"},{"key":"60_CR52","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1145\/3450439.3451861","volume-title":"Proceedings of the Conference on Health, Inference, and Learning","author":"K.D. Pandl","year":"2021","unstructured":"K.D. Pandl, F. Feiland, S. Thiebes, A. Sunyaev, Trustworthy machine learning for health care: scalable data valuation with the Shapley value, in Proceedings of the Conference on Health, Inference, and Learning (2021), pp.\u00a047\u201357"},{"issue":"1","key":"60_CR53","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-020-79139-8","volume":"11","author":"S. Tang","year":"2021","unstructured":"S. Tang, A. Ghorbani, R. Yamashita, S. Rehman, J.A. Dunnmon, J. Zou, D.L. Rubin, Data valuation for medical imaging using Shapley value and application to a large-scale chest X-ray dataset. Sci. Rep. 11(1), 1\u20139 (2021)","journal-title":"Sci. Rep."},{"issue":"1","key":"60_CR54","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1109\/MCI.2021.3129959","volume":"17","author":"A. Heuillet","year":"2022","unstructured":"A. Heuillet, F. Couthouis, N. D\u00edaz-Rodr\u00ed guez, Collective explainable AI: explaining cooperative strategies and agent contribution in multiagent reinforcement learning with Shapley values. IEEE Comput. Intell. Mag. 17(1), 59\u201371 (2022)","journal-title":"IEEE Comput. Intell. Mag."},{"key":"60_CR55","first-page":"5491","volume-title":"International Conference on Machine Learning","author":"I.E. Kumar","year":"2020","unstructured":"I.E. Kumar, S. Venkatasubramanian, C. Scheidegger, S. Friedler, Problems with Shapley-value-based explanations as feature importance measures, in International Conference on Machine Learning (PMLR, 2020), pp.\u00a05491\u20135500"},{"key":"60_CR56","first-page":"5922","volume":"33","author":"A. Ghorbani","year":"2020","unstructured":"A. Ghorbani, J.Y. Zou, Neuron Shapley: discovering the responsible neurons. Adv. Neural Inf. Process. Syst. 33, 5922\u20135932 (2020)","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"60_CR57","volume-title":"IEEE Transactions on Intelligent Vehicles","author":"M. Li","year":"2023","unstructured":"M. Li, Y. Wang, H. Sun, Z. Cui, Y. Huang, H. Chen, Explaining a machine-learning lane change model with maximum entropy Shapley values, in IEEE Transactions on Intelligent Vehicles (2023)"},{"issue":"7","key":"60_CR58","doi-asserted-by":"publisher","first-page":"620","DOI":"10.1038\/s42256-021-00343-w","volume":"3","author":"G. Erion","year":"2021","unstructured":"G. Erion, J.D. Janizek, P. Sturmfels, S.M. Lundberg, S.-I. Lee, Improving performance of deep learning models with axiomatic attribution priors and expected gradients. Nat. Mach. Intell. 3(7), 620\u2013631 (2021)","journal-title":"Nat. Mach. Intell."},{"key":"60_CR59","first-page":"8116","volume-title":"International Conference on Machine Learning","author":"L. Rieger","year":"2020","unstructured":"L. Rieger, C. Singh, W. Murdoch, B. Yu, Interpretations are useful: penalizing explanations to align neural networks with prior knowledge, in International Conference on Machine Learning (PMLR, 2020), pp.\u00a08116\u20138126"}],"container-title":["Autonomous Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43684-023-00060-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s43684-023-00060-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43684-023-00060-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,9]],"date-time":"2024-02-09T09:05:33Z","timestamp":1707469533000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s43684-023-00060-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,9]]},"references-count":59,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["60"],"URL":"https:\/\/doi.org\/10.1007\/s43684-023-00060-8","relation":{},"ISSN":["2730-616X"],"issn-type":[{"value":"2730-616X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,9]]},"assertion":[{"value":"7 November 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 December 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 December 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 February 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Profs. Hong Chen and Yanjun Huang are editorial board members for Autonomous Intelligent Systems and were not involved in the editorial review or the decision to publish this article. All authors declare that there are no other competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"2"}}