{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,12]],"date-time":"2026-04-12T03:11:59Z","timestamp":1775963519887,"version":"3.50.1"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2019,12,20]],"date-time":"2019-12-20T00:00:00Z","timestamp":1576800000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Commun. ACM"],"published-print":{"date-parts":[[2019,12,20]]},"abstract":"<jats:p>Uncovering the mysterious ways machine learning models make decisions.<\/jats:p>","DOI":"10.1145\/3359786","type":"journal-article","created":{"date-parts":[[2019,12,20]],"date-time":"2019-12-20T19:45:25Z","timestamp":1576871125000},"page":"68-77","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":974,"title":["Techniques for interpretable machine learning"],"prefix":"10.1145","volume":"63","author":[{"given":"Mengnan","family":"Du","sequence":"first","affiliation":[{"name":"Texas A&amp;M University, College Station, TX"}]},{"given":"Ninghao","family":"Liu","sequence":"additional","affiliation":[{"name":"Texas A&amp;M University, College Station, TX"}]},{"given":"Xia","family":"Hu","sequence":"additional","affiliation":[{"name":"Texas A&amp;M University, College Station, TX"}]}],"member":"320","published-online":{"date-parts":[[2019,12,20]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btq134"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the Intern. Conf. Learning Representations","author":"Ancona M.","year":"2018","unstructured":"Ancona , M. , Ceolini , E. , Oztireli , C. and Gross , M . Towards better understanding of gradient-based attribution methods for deep neural networks . In Proceedings of the Intern. Conf. Learning Representations , 2018 . Ancona, M., Ceolini, E., Oztireli, C. and Gross, M. Towards better understanding of gradient-based attribution methods for deep neural networks. In Proceedings of the Intern. Conf. Learning Representations, 2018."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0130140"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the Intern. Conf. Learning Representations","author":"Bahdanau D.","year":"2015","unstructured":"Bahdanau , D. , Cho , K. and Bengio , Y . Neural machine translation by jointly learning to align and translate . In Proceedings of the Intern. Conf. Learning Representations , 2015 . Bahdanau, D., Cho, K. and Bengio, Y. Neural machine translation by jointly learning to align and translate. In Proceedings of the Intern. Conf. Learning Representations, 2015."},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the Fairness, Accountability, and Transparency in Machine Learning Workshop","author":"Bastani O.","year":"2017","unstructured":"Bastani , O. , Kim , C. , and Bastani , H . Interpretability via model extraction . In Proceedings of the Fairness, Accountability, and Transparency in Machine Learning Workshop , 2017 . Bastani, O., Kim, C., and Bastani, H. Interpretability via model extraction. In Proceedings of the Fairness, Accountability, and Transparency in Machine Learning Workshop, 2017."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788613"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_2_1_8_1","volume-title":"Real time image saliency for black box classifiers. Advances in Neural Information Processing Systems","author":"Dabkowski P.","year":"2017","unstructured":"Dabkowski , P. and Gal , Y . Real time image saliency for black box classifiers. Advances in Neural Information Processing Systems ( 2017 ), 6970--6979. Dabkowski, P. and Gal, Y. Real time image saliency for black box classifiers. Advances in Neural Information Processing Systems (2017), 6970--6979."},{"key":"e_1_2_1_9_1","volume-title":"Human issues in the use of pattern recognition techniques. Neural Networks and Pattern Recognition in Human Computer Interaction","author":"Dix A.","year":"1992","unstructured":"Dix , A. Human issues in the use of pattern recognition techniques. Neural Networks and Pattern Recognition in Human Computer Interaction ( 1992 ), 429--451. Dix, A. Human issues in the use of pattern recognition techniques. Neural Networks and Pattern Recognition in Human Computer Interaction (1992), 429--451."},{"key":"e_1_2_1_10_1","volume-title":"Towards a rigorous science of interpretable machine learning","author":"Doshi-Velez F.","year":"2017","unstructured":"Doshi-Velez , F. and Kim , B . Towards a rigorous science of interpretable machine learning . 2017 . Doshi-Velez, F. and Kim, B. Towards a rigorous science of interpretable machine learning. 2017."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220099"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313545"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.371"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2594473.2594475"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/3086952"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the Intern. Conf. Learning Representations","author":"Goodfellow I.J.","year":"2015","unstructured":"Goodfellow , I.J. , Shlens , J. and Szegedy , C . Explaining and harnessing adversarial examples . In Proceedings of the Intern. Conf. Learning Representations , 2015 . Goodfellow, I.J., Shlens, J. and Szegedy, C. Explaining and harnessing adversarial examples. In Proceedings of the Intern. Conf. Learning Representations, 2015."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00300"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the ICLR Workshop","author":"Karpathy A.","year":"2016","unstructured":"Karpathy , A. , Johnson , J. , and Fei-Fei , L . Visualizing and understanding recurrent networks . In Proceedings of the ICLR Workshop , 2016 . Karpathy, A., Johnson, J., and Fei-Fei, L. Visualizing and understanding recurrent networks. In Proceedings of the ICLR Workshop, 2016."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3289600.3290960"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220027"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-3242-6"},{"key":"e_1_2_1_22_1","volume-title":"Explanation in artificial intelligence: Insights from the social sciences. Artificial Intelligence","author":"Miller T.","year":"2018","unstructured":"Miller , T. Explanation in artificial intelligence: Insights from the social sciences. Artificial Intelligence ( 2018 ). Miller, T. Explanation in artificial intelligence: Insights from the social sciences. Artificial Intelligence (2018)."},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Molnar C. Interpretable Machine Learning (2018); https:\/\/christophm.github.io\/interpretable-ml-book\/.  Molnar C. Interpretable Machine Learning (2018); https:\/\/christophm.github.io\/interpretable-ml-book\/.","DOI":"10.21105\/joss.00786"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1176"},{"key":"e_1_2_1_25_1","volume-title":"Advances in Neural Information Processing Systems","author":"Nguyen A.","year":"2016","unstructured":"Nguyen , A. , Dosovitskiy , A. , Yosinski , J. , Brox , T. and Clune , J . Synthesizing the preferred inputs for neurons in neural networks via deep generator networks . Advances in Neural Information Processing Systems , 2016 . Nguyen, A., Dosovitskiy, A., Yosinski, J., Brox, T. and Clune, J. Synthesizing the preferred inputs for neurons in neural networks via deep generator networks. Advances in Neural Information Processing Systems, 2016."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298640"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the ICLR Workshop","author":"Nguyen A.","year":"2016","unstructured":"Nguyen , A. , Yosinski , J. and Clune , J . Multifaceted feature visualization: Uncovering the different types of features learned by each neuron in deep neural networks . In Proceedings of the ICLR Workshop , 2016 . Nguyen, A., Yosinski, J. and Clune, J. Multifaceted feature visualization: Uncovering the different types of features learned by each neuron in deep neural networks. In Proceedings of the ICLR Workshop, 2016."},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the NAACL-HLT","author":"Peters M.E.","year":"2018","unstructured":"Peters , M.E. et al. Deep contextualized word representations . In Proceedings of the NAACL-HLT , 2018 . Peters, M.E. et al. Deep contextualized word representations. In Proceedings of the NAACL-HLT, 2018."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-7373(87)80053-6"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-3020"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the AAAI Conf. Artificial Intelligence","author":"Ribeiro M.T.","year":"2018","unstructured":"Ribeiro , M.T. , Singh , S. and Guestrin , C . Anchors: High-precision model-agnostic explanations . In Proceedings of the AAAI Conf. Artificial Intelligence , 2018 . Ribeiro, M.T., Singh, S. and Guestrin, C. Anchors: High-precision model-agnostic explanations. In Proceedings of the AAAI Conf. Artificial Intelligence, 2018."},{"key":"e_1_2_1_32_1","volume-title":"Advances in Neural Information Processing Systems","author":"Sabour S.","year":"2017","unstructured":"Sabour , S. , Frosst , N. and Hinton , G.E . Dynamic routing between capsules . Advances in Neural Information Processing Systems , 2017 . Sabour, S., Frosst, N. and Hinton, G.E. Dynamic routing between capsules. Advances in Neural Information Processing Systems, 2017."},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the ICLR Workshop","author":"Simonyan K.","year":"2014","unstructured":"Simonyan , K. , Vedaldi , A. and Zisserman , A . Deep inside convolutional networks: Visualising image classification models and saliency maps . In Proceedings of the ICLR Workshop , 2014 . Simonyan, K., Vedaldi, A. and Zisserman, A. Deep inside convolutional networks: Visualising image classification models and saliency maps. In Proceedings of the ICLR Workshop, 2014."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the ICLR workshop","author":"Springenberg J.T.","year":"2015","unstructured":"Springenberg , J.T. , Dosovitskiy , A. , Brox , T. and Riedmiller , M . Striving for simplicity: The all convolutional net . In Proceedings of the ICLR workshop , 2015 . Springenberg, J.T., Dosovitskiy, A., Brox, T. and Riedmiller, M. Striving for simplicity: The all convolutional net. In Proceedings of the ICLR workshop, 2015."},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the ICML Workshop on Human Interpretability in Machine Learning","author":"Tomsett R.","year":"2018","unstructured":"Tomsett , R. , Braines , D. , Harborne , D. , Preece , A. and Chakraborty , S . Interpretable to whom? A role-based model for analyzing interpretable machine learning systems . In Proceedings of the ICML Workshop on Human Interpretability in Machine Learning , 2018 . Tomsett, R., Braines, D., Harborne, D., Preece, A. and Chakraborty, S. Interpretable to whom? A role-based model for analyzing interpretable machine learning systems. In Proceedings of the ICML Workshop on Human Interpretability in Machine Learning, 2018."},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the NIPS Workshop","author":"Vandewiele G.","year":"2016","unstructured":"Vandewiele , G. , Janssens , G. , Ongenae , O. , and Van Hoecke , F.S. Genesim : Genetic extraction of a single, interpretable model . In Proceedings of the NIPS Workshop , 2016 . Vandewiele, G., Janssens, G., Ongenae, O., and Van Hoecke, F.S. Genesim: Genetic extraction of a single, interpretable model. In Proceedings of the NIPS Workshop, 2016."},{"key":"e_1_2_1_37_1","volume-title":"Counterfactual explanations without opening the black box: Automated decisions and the GDPR","author":"Wachter S.","year":"2017","unstructured":"Wachter , S. , Mittelstadt , B. and Russell , C . Counterfactual explanations without opening the black box: Automated decisions and the GDPR . 2017 . Wachter, S., Mittelstadt, B. and Russell, C. Counterfactual explanations without opening the black box: Automated decisions and the GDPR. 2017."},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the Intern. Conf. Machine Learning","author":"Xu K.","year":"2015","unstructured":"Xu , K. et al. Show, attend and tell: Neural image caption generation with visual attention . In Proceedings of the Intern. Conf. Machine Learning , 2015 . Xu, K. et al. Show, attend and tell: Neural image caption generation with visual attention. In Proceedings of the Intern. Conf. Machine Learning, 2015."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00920"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the Intern. Conf. Learning Representations","author":"Zhou B.","year":"2015","unstructured":"Zhou , B. , Khosla , A. , Lapedriza , A. , Oliva , A. and Torralba , A . Object detectors emerge in deep scene CNNs . In Proceedings of the Intern. Conf. Learning Representations , 2015 . Zhou, B., Khosla, A., Lapedriza, A., Oliva, A. and Torralba, A. Object detectors emerge in deep scene CNNs. In Proceedings of the Intern. Conf. Learning Representations, 2015."}],"container-title":["Communications of the ACM"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359786","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3359786","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:23:06Z","timestamp":1750202586000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359786"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,20]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12,20]]}},"alternative-id":["10.1145\/3359786"],"URL":"https:\/\/doi.org\/10.1145\/3359786","relation":{},"ISSN":["0001-0782","1557-7317"],"issn-type":[{"value":"0001-0782","type":"print"},{"value":"1557-7317","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,20]]},"assertion":[{"value":"2019-12-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}