{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T10:51:09Z","timestamp":1790247069589,"version":"4.1.0"},"publisher-location":"New York, NY, USA","reference-count":46,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,4,19]],"date-time":"2021-04-19T00:00:00Z","timestamp":1618790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,4,19]]},"DOI":"10.1145\/3442381.3450069","type":"proceedings-article","created":{"date-parts":[[2021,6,3]],"date-time":"2021-06-03T19:00:27Z","timestamp":1622746827000},"page":"1937-1948","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["What do You Mean? Interpreting Image Classification with Crowdsourced Concept Extraction and Analysis"],"prefix":"10.1145","author":[{"given":"Agathe","family":"Balayn","sequence":"first","affiliation":[{"name":"Delft University of Technology, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Panagiotis","family":"Soilis","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christoph","family":"Lofi","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Yang","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alessandro","family":"Bozzon","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,6,3]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.2307\/2577276"},{"key":"e_1_3_2_1_2_1","volume-title":"Quantum theory and human perception of the macro-world. How Humans Recognize Objects: Segmentation, Categorization and Individual Identification","author":"Aerts Diederik","year":"2016","unstructured":"Diederik Aerts . 2016. Quantum theory and human perception of the macro-world. How Humans Recognize Objects: Segmentation, Categorization and Individual Identification ( 2016 ), 210. Diederik Aerts. 2016. Quantum theory and human perception of the macro-world. How Humans Recognize Objects: Segmentation, Categorization and Individual Identification (2016), 210."},{"key":"e_1_3_2_1_3_1","volume-title":"A theory of concepts and their combinations I. Kybernetes","author":"Aerts D","year":"2005","unstructured":"D Aerts and L Gabora . 2005. A theory of concepts and their combinations I. Kybernetes ( 2005 ). D Aerts and L Gabora. 2005. A theory of concepts and their combinations I. Kybernetes (2005)."},{"key":"e_1_3_2_1_4_1","unstructured":"R Agarwal and al. 1994. Fast algorithms for mining association rules. In VLDB.  R Agarwal and al. 1994. Fast algorithms for mining association rules. In VLDB."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"crossref","unstructured":"M Ancona E Ceolini C \u00d6ztireli and M Gross. 2018. Towards better understanding of gradient-based attribution methods for Deep Neural Networks. In ICLR.  M Ancona E Ceolini C \u00d6ztireli and M Gross. 2018. Towards better understanding of gradient-based attribution methods for Deep Neural Networks. In ICLR.","DOI":"10.1007\/978-3-030-28954-6_9"},{"key":"e_1_3_2_1_6_1","volume-title":"On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PloS one 10, 7","author":"Bach S","year":"2015","unstructured":"S Bach , A Binder , and al. 2015. On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PloS one 10, 7 ( 2015 ). S Bach, A Binder, and al. 2015. On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PloS one 10, 7 (2015)."},{"key":"e_1_3_2_1_7_1","unstructured":"D Bahdanau K Cho and Y Bengio. 2015. Neural machine translation by jointly learning to align and translate. In ICLR.  D Bahdanau K Cho and Y Bengio. 2015. Neural machine translation by jointly learning to align and translate. In ICLR."},{"key":"e_1_3_2_1_8_1","volume-title":"Objectnet: A large-scale bias-controlled dataset for pushing the limits of object recognition models. In NeurIPS. 9453\u20139463.","author":"Barbu A","year":"2019","unstructured":"A Barbu , D Mayo , and al. 2019 . Objectnet: A large-scale bias-controlled dataset for pushing the limits of object recognition models. In NeurIPS. 9453\u20139463. A Barbu, D Mayo, and al. 2019. Objectnet: A large-scale bias-controlled dataset for pushing the limits of object recognition models. In NeurIPS. 9453\u20139463."},{"key":"e_1_3_2_1_9_1","unstructured":"L Breiman J Friedman and al. 1984. Classification and regression trees.  L Breiman J Friedman and al. 1984. Classification and regression trees."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_2_1_11_1","unstructured":"Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608(2017).  Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608(2017)."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2594473.2594475"},{"key":"e_1_3_2_1_13_1","unstructured":"A Ghorbani and al. 2019. Towards automatic concept-based explanations. In NeurIPS.  A Ghorbani and al. 2019. Towards automatic concept-based explanations. In NeurIPS."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380063"},{"key":"e_1_3_2_1_15_1","unstructured":"B Kim M Wattenberg J Gilmer and al. 2018. Interpretability beyond feature attribution: Quantitative testing with concept activation vectors. In ICML.  B Kim M Wattenberg J Gilmer and al. 2018. Interpretability beyond feature attribution: Quantitative testing with concept activation vectors. In ICML."},{"key":"e_1_3_2_1_16_1","unstructured":"P\u00a0W Koh and P Liang. 2017. Understanding black-box predictions via influence functions. arXiv preprint arXiv:1703.04730(2017).  P\u00a0W Koh and P Liang. 2017. Understanding black-box predictions via influence functions. arXiv preprint arXiv:1703.04730(2017)."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.46"},{"key":"e_1_3_2_1_18_1","unstructured":"Nicolas Maleve. 2019. An Introduction to Image Datasets. (2019). https:\/\/unthinking.photography\/articles\/an-introduction-to-image-datasets  Nicolas Maleve. 2019. An Introduction to Image Datasets. (2019). https:\/\/unthinking.photography\/articles\/an-introduction-to-image-datasets"},{"key":"e_1_3_2_1_19_1","volume-title":"The ontology of concepts-abstract objects or mental representations?No\u00fbs 41, 4","author":"Margolis Eric","year":"2007","unstructured":"Eric Margolis and Stephen Laurence . 2007. The ontology of concepts-abstract objects or mental representations?No\u00fbs 41, 4 ( 2007 ), 561\u2013593. Eric Margolis and Stephen Laurence. 2007. The ontology of concepts-abstract objects or mental representations?No\u00fbs 41, 4 (2007), 561\u2013593."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"crossref","unstructured":"B Nushi E Kamar and al. 2017. On human intellect and machine failures: Troubleshooting integrative machine learning systems. In AAAI.  B Nushi E Kamar and al. 2017. On human intellect and machine failures: Troubleshooting integrative machine learning systems. In AAAI.","DOI":"10.1609\/aaai.v31i1.10633"},{"key":"e_1_3_2_1_21_1","unstructured":"European Parliament and Council of EU. 2018. European Union General Data Protection Regulation. (2018). http:\/\/www.privacy-regulation.eu\/en\/13.htm  European Parliament and Council of EU. 2018. European Union General Data Protection Regulation. (2018). http:\/\/www.privacy-regulation.eu\/en\/13.htm"},{"key":"e_1_3_2_1_22_1","first-page":"65","article-title":"Conceptual combination: Models, theories and controversies","volume":"1","author":"Ran Bing","year":"2010","unstructured":"Bing Ran and P\u00a0R Duimering . 2010 . Conceptual combination: Models, theories and controversies . International Journal of Cognitive Linguistics 1 , 1(2010), 65 \u2013 90 . Bing Ran and P\u00a0R Duimering. 2010. Conceptual combination: Models, theories and controversies. International Journal of Cognitive Linguistics 1, 1(2010), 65\u201390.","journal-title":"International Journal of Cognitive Linguistics"},{"key":"e_1_3_2_1_23_1","volume-title":"JMLR","author":"Raykar V\u00a0C","year":"2010","unstructured":"V\u00a0C Raykar , S Yu , and al. 2010 . Learning from crowds . JMLR 11, Apr (2010). V\u00a0C Raykar, S Yu, and al. 2010. Learning from crowds. JMLR 11, Apr (2010)."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-3020"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","unstructured":"A\u00a0S Ross M\u00a0C Hughes and F Doshi-V. 2017. Right for the right reasons: training differentiable models by constraining their explanations. In IJCAI. 2662\u20132670.  A\u00a0S Ross M\u00a0C Hughes and F Doshi-V. 2017. Right for the right reasons: training differentiable models by constraining their explanations. In IJCAI. 2662\u20132670.","DOI":"10.24963\/ijcai.2017\/371"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-015-0816-y"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.74"},{"key":"e_1_3_2_1_28_1","unstructured":"A Shrikumar P G and A Kundaje. 2017. Learning Important Features Through Propagating Activation Differences. In ICML. 3145\u20133153.  A Shrikumar P G and A Kundaje. 2017. Learning Important Features Through Propagating Activation Differences. In ICML. 3145\u20133153."},{"key":"e_1_3_2_1_29_1","unstructured":"K Simonyan A Vedaldi and A Zisserman. 2014. Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps. In ICLR.  K Simonyan A Vedaldi and A Zisserman. 2014. Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps. In ICLR."},{"key":"e_1_3_2_1_30_1","unstructured":"Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556(2014).  Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556(2014)."},{"key":"e_1_3_2_1_31_1","unstructured":"D Smilkov and al. 2017. SmoothGrad: removing noise by adding noise. (2017).  D Smilkov and al. 2017. SmoothGrad: removing noise by adding noise. (2017)."},{"key":"e_1_3_2_1_32_1","unstructured":"E \u0160trumbelj and I Kononenko. 2014. Explaining prediction models and individual predictions with feature contributions. Knowledge and information systems(2014).  E \u0160trumbelj and I Kononenko. 2014. Explaining prediction models and individual predictions with feature contributions. Knowledge and information systems(2014)."},{"key":"e_1_3_2_1_33_1","unstructured":"M Sundararajan and al. 2017. Axiomatic Attribution for Deep Networks. In ICML.  M Sundararajan and al. 2017. Axiomatic Attribution for Deep Networks. In ICML."},{"key":"e_1_3_2_1_34_1","volume-title":"Proc. of the IEEE CVPR. 2818\u20132826","author":"Szegedy C","unstructured":"C Szegedy , V. Vanhoucke , S. Ioffe , J. Shlens , and Z. Wojna . 2016. Rethinking the inception architecture for computer vision . In Proc. of the IEEE CVPR. 2818\u20132826 . C Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna. 2016. Rethinking the inception architecture for computer vision. In Proc. of the IEEE CVPR. 2818\u20132826."},{"key":"e_1_3_2_1_35_1","volume-title":"Legal Research\u00a0Directorate The Law Library\u00a0of Congress. 2019","author":"Global","year":"2019","unstructured":"Global Legal Research\u00a0Directorate The Law Library\u00a0of Congress. 2019 . Regulation of Artificial Intelligence in Selected Jurisdictions. https:\/\/www.loc.gov\/law\/help\/artificial-intelligence\/index.php ( 2019 ). Global Legal Research\u00a0Directorate The Law Library\u00a0of Congress. 2019. Regulation of Artificial Intelligence in Selected Jurisdictions. https:\/\/www.loc.gov\/law\/help\/artificial-intelligence\/index.php(2019)."},{"key":"e_1_3_2_1_36_1","first-page":"1","article-title":"Making better use of the crowd: How crowdsourcing can advance machine learning research","volume":"18","author":"Vaughan Jennifer\u00a0Wortman","year":"2018","unstructured":"Jennifer\u00a0Wortman Vaughan . 2018 . Making better use of the crowd: How crowdsourcing can advance machine learning research . JMLR 18 , 193 (2018), 1 \u2013 46 . Jennifer\u00a0Wortman Vaughan. 2018. Making better use of the crowd: How crowdsourcing can advance machine learning research. JMLR 18, 193 (2018), 1\u201346.","journal-title":"JMLR"},{"key":"e_1_3_2_1_37_1","unstructured":"K Xu J Ba R Kiros K Cho A Courville and al. 2015. Show attend and tell: Neural image caption generation with visual attention. In ICML. 2048\u20132057.  K Xu J Ba R Kiros K Cho A Courville and al. 2015. Show attend and tell: Neural image caption generation with visual attention. In ICML. 2048\u20132057."},{"key":"e_1_3_2_1_38_1","unstructured":"Y Yan G\u00a0M Fung and al. 2011. Active learning from crowds. In ICML. 1161\u20131168.  Y Yan G\u00a0M Fung and al. 2011. Active learning from crowds. In ICML. 1161\u20131168."},{"key":"e_1_3_2_1_39_1","volume-title":"Global model interpretation via recursive partitioning","author":"Yang C","unstructured":"C Yang , A Rangarajan , and S Ranka . 2018. Global model interpretation via recursive partitioning . In IEEE HPCC\/SmartCity\/DSS. IEEE , 1563\u20131570. C Yang, A Rangarajan, and S Ranka. 2018. Global model interpretation via recursive partitioning. In IEEE HPCC\/SmartCity\/DSS. IEEE, 1563\u20131570."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"crossref","unstructured":"J Yang T Drake A\u00a0Damianou and Y Maarek. 2018. Leveraging crowdsourcing data for deep active learning. An application: learning intents in Alexa. In WWW.  J Yang T Drake A\u00a0Damianou and Y Maarek. 2018. Leveraging crowdsourcing data for deep active learning. An application: learning intents in Alexa. In WWW.","DOI":"10.1145\/3178876.3186033"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"crossref","unstructured":"J Yang A Smirnova and al. 2019. Scalpel-cd: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data. In WWW. 2158\u20132168.  J Yang A Smirnova and al. 2019. Scalpel-cd: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data. In WWW. 2158\u20132168.","DOI":"10.1145\/3308558.3313599"},{"key":"e_1_3_2_1_42_1","unstructured":"M Yang and B Kim. 2019. Benchmarking Attribution Methods with Relative Feature Importance. (2019).  M Yang and B Kim. 2019. Benchmarking Attribution Methods with Relative Feature Importance. (2019)."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"crossref","unstructured":"M\u00a0D. Zeiler and R Fergus. 2014. Visualizing and Understanding Convolutional Networks. In ECCV. 818\u2013833.  M\u00a0D. Zeiler and R Fergus. 2014. Visualizing and Understanding Convolutional Networks. In ECCV. 818\u2013833.","DOI":"10.1007\/978-3-319-10590-1_53"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"crossref","unstructured":"Q Zhang and al. 2018. Interpretable convolutional neural networks. In CVPR.  Q Zhang and al. 2018. Interpretable convolutional neural networks. In CVPR.","DOI":"10.1109\/CVPR.2018.00920"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359158"},{"key":"e_1_3_2_1_46_1","unstructured":"Minhaz\u00a0Fahim Zibran. 2007. Chi-squared test of independence. (2007).  Minhaz\u00a0Fahim Zibran. 2007. Chi-squared test of independence. (2007)."}],"event":{"name":"WWW '21: The Web Conference 2021","location":"Ljubljana Slovenia","acronym":"WWW '21","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"]},"container-title":["Proceedings of the Web Conference 2021"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442381.3450069","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3442381.3450069","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:27Z","timestamp":1750195467000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442381.3450069"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,19]]},"references-count":46,"alternative-id":["10.1145\/3442381.3450069","10.1145\/3442381"],"URL":"https:\/\/doi.org\/10.1145\/3442381.3450069","relation":{},"subject":[],"published":{"date-parts":[[2021,4,19]]},"assertion":[{"value":"2021-06-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}