{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T07:52:54Z","timestamp":1770537174288,"version":"3.49.0"},"reference-count":24,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,9,11]],"date-time":"2021-09-11T00:00:00Z","timestamp":1631318400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,9,11]],"date-time":"2021-09-11T00:00:00Z","timestamp":1631318400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["628.003.001"],"award-info":[{"award-number":["628.003.001"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Vis"],"published-print":{"date-parts":[[2022,2]]},"abstract":"<jats:sec>\n                <jats:title>Abstract<\/jats:title>\n                <jats:p>The field of explainable artificial intelligence aims to help experts understand complex machine learning models. One key approach is to show the impact of a feature on the model prediction. This helps experts to verify and validate the predictions the model provides. However, many challenges remain open. For example, due to the subjective nature of interpretability, a strict definition of concepts such as the contribution of a feature remains elusive. Different techniques have varying underlying assumptions, which can cause inconsistent and conflicting views. In this work, we introduce local and global contribution-value plots as a novel approach to visualize feature impact on predictions and the relationship with feature value. We discuss design decisions and show an exemplary visual analytics implementation that provides new insights into the model. We conducted a user study and found the visualizations aid model interpretation by increasing correctness and confidence and reducing the time taken to obtain an insight.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Graphic Abstract<\/jats:title>\n                \n              <\/jats:sec>","DOI":"10.1007\/s12650-021-00776-w","type":"journal-article","created":{"date-parts":[[2021,9,11]],"date-time":"2021-09-11T02:02:20Z","timestamp":1631325740000},"page":"47-57","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Comparative evaluation of contribution-value plots for machine learning understanding"],"prefix":"10.1007","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7612-9319","authenticated-orcid":false,"given":"Dennis","family":"Collaris","sequence":"first","affiliation":[]},{"given":"Jarke J.","family":"van Wijk","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,9,11]]},"reference":[{"issue":"Jun","key":"776_CR1","first-page":"1803","volume":"11","author":"D Baehrens","year":"2010","unstructured":"Baehrens D, Schroeter T, Harmeling S, Kawanabe M, Hansen K, M\u00fcller KR (2010) How to explain individual classification decisions. J Mach Lear Res 11(Jun):1803\u20131831","journal-title":"J Mach Lear Res"},{"issue":"4716","key":"776_CR2","doi-asserted-by":"publisher","first-page":"828","DOI":"10.1126\/science.229.4716.828","volume":"229","author":"WS Cleveland","year":"1985","unstructured":"Cleveland WS, McGill R (1985) Graphical perception and graphical methods for analyzing scientific data. Science 229(4716):828\u2013833","journal-title":"Science"},{"key":"776_CR3","doi-asserted-by":"crossref","unstructured":"Collaris D, van Wijk JJ (2020a) ExplainExplore: Visual exploration of machine learning explanations. In: 2020 IEEE Pacific Visualization Symposium (PacificVis), IEEE","DOI":"10.1109\/PacificVis48177.2020.7090"},{"key":"776_CR4","doi-asserted-by":"crossref","unstructured":"Collaris D, van Wijk JJ (2020b) Machine learning interpretability through Contribution-Value Plots. In: Proceedings of the 13th International Symposium on Visual Information Communication and Interaction (VINCI 2020), pp 1\u20135","DOI":"10.1145\/3430036.3430067"},{"issue":"4","key":"776_CR5","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1016\/j.dss.2009.05.016","volume":"47","author":"P Cortez","year":"2009","unstructured":"Cortez P, Cerdeira A, Almeida F, Matos T, Reis J (2009) Modeling wine preferences by data mining from physicochemical properties. Decis Support Syst 47(4):547\u2013553","journal-title":"Decis Support Syst"},{"key":"776_CR6","unstructured":"Doshi-Velez B Finale;\u00a0Kim (2017) Towards a rigorous science of interpretable machine learning. In: arXiv:1702.08608"},{"key":"776_CR7","doi-asserted-by":"publisher","unstructured":"Friedman JH (2001) Greedy function approximation: A gradient boosting machine. Annals of Statistics 29(5):1189\u20131232, https:\/\/doi.org\/10.1214\/aos\/1013203451, arXiv:1011.1669v3","DOI":"10.1214\/aos\/1013203451"},{"key":"776_CR8","unstructured":"Garreau D, von Luxburg U (2020) Explaining the explainer: A first theoretical analysis of lime. arXiv preprint arXiv:200103447"},{"issue":"1","key":"776_CR9","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1080\/10618600.2014.907095","volume":"24","author":"A Goldstein","year":"2015","unstructured":"Goldstein A, Kapelner A, Bleich J, Pitkin E (2015) Peeking inside the black box: visualizing statistical learning with plots of individual conditional expectation. J Comput Graph Stat 24(1):44\u201365","journal-title":"J Comput Graph Stat"},{"key":"776_CR10","doi-asserted-by":"crossref","unstructured":"Graham M, Kennedy J (2003) Using curves to enhance parallel coordinate visualisations. In: Proceedings of the 7th international conference on information visualization, IV 2003., IEEE (2003), pp 10\u201316","DOI":"10.1109\/IV.2003.1217950"},{"key":"776_CR11","doi-asserted-by":"crossref","unstructured":"Guidotti R, Monreale A, Turini F, Pedreschi D, Giannotti F (2018) A survey of methods for explaining black box models. arXiv preprint arXiv:180201933","DOI":"10.1145\/3236009"},{"key":"776_CR12","doi-asserted-by":"crossref","unstructured":"Karras T, Laine S, Aila T (2019) A style-based generator architecture for generative adversarial networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4401\u20134410","DOI":"10.1109\/CVPR.2019.00453"},{"issue":"Jan","key":"776_CR13","first-page":"1","volume":"11","author":"I Kononenko","year":"2010","unstructured":"Kononenko I et al (2010) An efficient explanation of individual classifications using game theory. J Mach Learn Res 11(Jan):1\u201318","journal-title":"J Mach Learn Res"},{"key":"776_CR14","unstructured":"Krause J, Perer A, Bertini E (2016a) Using visual analytics to interpret predictive machine learning models. ICML Workshop on Human Interpretability in Machine Learning pp 106\u2013110, arXiv:1606.05685v1"},{"key":"776_CR15","doi-asserted-by":"publisher","unstructured":"Krause J, Perer A, Ng K (2016b) Interacting with predictions: Visual inspection of black-box machine learning models. ACM Conf on Human Factors in Computing Systems pp 5686\u20135697, https:\/\/doi.org\/10.1145\/2858036.2858529","DOI":"10.1145\/2858036.2858529"},{"key":"776_CR16","unstructured":"Kumar IE, Venkatasubramanian S, Scheidegger C, Friedler S (2020) Problems with shapley-value-based explanations as feature importance measures. arXiv preprint arXiv:200211097"},{"key":"776_CR17","unstructured":"Lundberg SM, Lee SI (2017) A unified approach to interpreting model predictions. In: Advances in neural information processing systems, pp 4768\u20134777"},{"issue":"7788","key":"776_CR18","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1038\/s41586-019-1799-6","volume":"577","author":"SM McKinney","year":"2020","unstructured":"McKinney SM, Sieniek M, Godbole V, Godwin J, Antropova N, Ashrafian H, Back T, Chesus M, Corrado GC, Darzi A et al (2020) International evaluation of an ai system for breast cancer screening. Nature 577(7788):89\u201394","journal-title":"Nature"},{"key":"776_CR19","doi-asserted-by":"crossref","unstructured":"Merrick L, Taly A (2019) The explanation game: Explaining machine learning models with cooperative game theory. arXiv preprint arXiv:190908128","DOI":"10.1007\/978-3-030-57321-8_2"},{"issue":"1","key":"776_CR20","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1109\/TVCG.2015.2467872","volume":"22","author":"RG Raidou","year":"2015","unstructured":"Raidou RG, Eisemann M, Breeuwer M, Eisemann E, Vilanova A (2015) Orientation-enhanced parallel coordinate plots. IEEE Trans Vis Comput Graph 22(1):589\u2013598","journal-title":"IEEE Trans Vis Comput Graph"},{"key":"776_CR21","doi-asserted-by":"crossref","unstructured":"Ribeiro MT, Singh S, Guestrin C (2016) \u201cWhy should I trust you?\u201d explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 1135\u20131144","DOI":"10.1145\/2939672.2939778"},{"issue":"10","key":"776_CR22","doi-asserted-by":"publisher","first-page":"886","DOI":"10.1016\/j.datak.2009.01.004","volume":"68","author":"E \u0160trumbelj","year":"2009","unstructured":"\u0160trumbelj E, Kononenko I, \u0160ikonja MR (2009) Explaining instance classifications with interactions of subsets of feature values. Data Knowl Eng 68(10):886\u2013904","journal-title":"Data Knowl Eng"},{"issue":"1","key":"776_CR23","first-page":"56","volume":"26","author":"J Wexler","year":"2019","unstructured":"Wexler J, Pushkarna M, Bolukbasi T, Wattenberg M, Vi\u00e9gas F, Wilson J (2019) The what-if tool: interactive probing of machine learning models. IEEE Trans Vis Comput Graph 26(1):56\u201365","journal-title":"IEEE Trans Vis Comput Graph"},{"issue":"1","key":"776_CR24","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1109\/TVCG.2018.2864475","volume":"25","author":"X Zhao","year":"2018","unstructured":"Zhao X, Wu Y, Lee DL, Cui W (2018) iForest: interpreting random forests via visual analytics. IEEE Trans Vis Comput Graph 25(1):407\u2013416","journal-title":"IEEE Trans Vis Comput Graph"}],"container-title":["Journal of Visualization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12650-021-00776-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12650-021-00776-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12650-021-00776-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,24]],"date-time":"2022-01-24T03:09:31Z","timestamp":1642993771000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12650-021-00776-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,11]]},"references-count":24,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,2]]}},"alternative-id":["776"],"URL":"https:\/\/doi.org\/10.1007\/s12650-021-00776-w","relation":{},"ISSN":["1343-8875","1875-8975"],"issn-type":[{"value":"1343-8875","type":"print"},{"value":"1875-8975","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,11]]},"assertion":[{"value":"1 May 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 June 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 July 2021","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 September 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}