{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T15:49:54Z","timestamp":1778168994436,"version":"3.51.4"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T00:00:00Z","timestamp":1638316800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,12,20]],"date-time":"2021-12-20T00:00:00Z","timestamp":1639958400000},"content-version":"vor","delay-in-days":19,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"National Science Foundation","award":["DMS-1741191"],"award-info":[{"award-number":["DMS-1741191"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Discov Artif Intell"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>In the field of eXplainable AI (XAI), robust \u201cblackbox\u201d algorithms such as Convolutional Neural Networks (CNNs) are known for making high prediction performance. However, the ability to explain and interpret these algorithms still require innovation in the understanding of influential and, more importantly, explainable features that directly or indirectly impact the performance of predictivity. A number of methods existing in literature focus on visualization techniques but the concepts of explainability and interpretability still require rigorous definition. In view of the above needs, this paper proposes an interaction-based methodology\u2013Influence score (I-score)\u2014to screen out the noisy and non-informative variables in the images hence it nourishes an environment with explainable and interpretable features that are directly associated to feature predictivity. The selected features with high I-score values can be considered as a group of variables with interactive effect, hence the proposed name interaction-based methodology. We apply the proposed method on a real world application in Pneumonia Chest X-ray Image data set and produced state-of-the-art results. We demonstrate how to apply the proposed approach for more general big data problems by improving the explainability and interpretability without sacrificing the prediction performance. The contribution of this paper opens a novel angle that moves the community closer to the future pipelines of XAI problems. In investigation of Pneumonia Chest X-ray Image data, the proposed method achieves 99.7% Area-Under-Curve (AUC) using less than 20,000 parameters while its peers such as VGG16 and its upgraded versions require at least millions of parameters to achieve on-par performance. Using I-score selected explainable features allows reduction of over 98% of parameters while delivering same or even better prediction results.<\/jats:p>","DOI":"10.1007\/s44163-021-00015-z","type":"journal-article","created":{"date-parts":[[2021,12,20]],"date-time":"2021-12-20T09:11:40Z","timestamp":1639991500000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["A novel interaction-based methodology towards explainable AI with better understanding of Pneumonia Chest X-ray Images"],"prefix":"10.1007","volume":"1","author":[{"given":"Shaw-Hwa","family":"Lo","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yiqiao","family":"Yin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,12,20]]},"reference":[{"key":"15_CR1","doi-asserted-by":"publisher","first-page":"52138","DOI":"10.1109\/ACCESS.2018.2870052","volume":"6","author":"A Adadi","year":"2018","unstructured":"Adadi A, Berrada M. Peeking inside the black-box: a survey on explainable artificial intelligence (xai). IEEE Access. 2018;6:52138\u201360.","journal-title":"IEEE Access"},{"key":"15_CR2","doi-asserted-by":"crossref","unstructured":"Ayan E, \u00dcnver HM. Diagnosis of pneumonia from chest x-ray images using deep learning. In 2019 Scientific Meeting on Electrical-Electronics Biomedical Engineering and Computer Science (EBBT), 2019;1\u20135.","DOI":"10.1109\/EBBT.2019.8741582"},{"key":"15_CR3","first-page":"353","volume":"83","author":"T Cherian","year":"2005","unstructured":"Cherian T, Mulholland EK, Carlin JB, Ostensen H, Amin R, Campo M, Greenberg D, Lagos R, Lucero M, Madhi SA, et al. Standardized interpretation of paediatric chest radiographs for the diagnosis of pneumonia in epidemiological studies. Bull World Health Org. 2005;83:353\u20139.","journal-title":"Bull World Health Org."},{"issue":"4","key":"15_CR4","doi-asserted-by":"publisher","first-page":"1335","DOI":"10.1214\/09-AOAS265","volume":"3","author":"H Chernoff","year":"2009","unstructured":"Chernoff H, Lo S-H, Zheng T. Discovering influential variables: a method of partitions. Ann Appl Stat. 2009;3(4):1335\u201369.","journal-title":"Ann Appl Stat"},{"key":"15_CR5","doi-asserted-by":"crossref","unstructured":"Chollet F. Xception: Deep learning with depthwise separable convolutions. 2016 arXiv preprint arXiv:1610.02357.","DOI":"10.1109\/CVPR.2017.195"},{"key":"15_CR6","unstructured":"Cohen J, Bertin P, Frappier V. A web delivered locally computed chest X-ray disease prediction system. In: Proceedings of machine learning research, under review 2020;1\u201312."},{"key":"15_CR7","unstructured":"DARPA. Broad agency announcement, explainable artificial intelligence (xai). DARPA. 2016"},{"key":"15_CR8","unstructured":"Doshi-Velez F, Kim B. Towards a rigorous science of interpretable machine learning. 2017 arXiv preprint arXiv:1702.08608."},{"issue":"5","key":"15_CR9","doi-asserted-by":"publisher","first-page":"282","DOI":"10.1097\/RTI.0000000000000347","volume":"33","author":"T Franquet","year":"2018","unstructured":"Franquet T. Imaging of community-acquired pneumonia. J Thorac Imaging. 2018;33(5):282\u201394.","journal-title":"J Thorac Imaging"},{"key":"15_CR10","doi-asserted-by":"crossref","unstructured":"Girshick R, Donahue J, Darrell T, Malik J. Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2014;580\u2013587.","DOI":"10.1109\/CVPR.2014.81"},{"key":"15_CR11","doi-asserted-by":"crossref","unstructured":"Gong Y, Wang L, Guo R, Lazebnik S. Multi-scale orderless pooling of deep convolutional activation features. In: European conference on computer vision, 2014;392\u2013407. Springer.","DOI":"10.1007\/978-3-319-10584-0_26"},{"key":"15_CR12","doi-asserted-by":"crossref","unstructured":"Gordo A, Almaz\u00e1n J, Revaud J, Larlus D. Deep image retrieval: Learning global representations for image search. In: European conference on computer vision, 2016;241\u2013257. Springer.","DOI":"10.1007\/978-3-319-46466-4_15"},{"key":"15_CR13","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2016a;770\u2013778.","DOI":"10.1109\/CVPR.2016.90"},{"key":"15_CR14","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J, Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2016b;770\u2013778.","DOI":"10.1109\/CVPR.2016.90"},{"key":"15_CR15","doi-asserted-by":"crossref","unstructured":"Huang G, Liu Z, Maaten L, KQ W. Densely connected convolutional networks. Computer Vision and Pattern Recognition. 2017.","DOI":"10.1109\/CVPR.2017.243"},{"key":"15_CR16","first-page":"1097","volume":"25","author":"A Krizhevsky","year":"2012","unstructured":"Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst. 2012;25:1097\u2013105.","journal-title":"Adv Neural Inf Process Syst"},{"key":"15_CR17","unstructured":"LeCun Y, Boser B, Denker JS, Henderson D, Howard RE, Hubbard W, Jackel LD. Handwritten digit recognition with a back-propagation network. Advances in Neural Information Processing Systems (NIPS 1989) 2. 1990"},{"issue":"1","key":"15_CR18","doi-asserted-by":"publisher","first-page":"18","DOI":"10.3390\/e23010018","volume":"23","author":"P Linardatos","year":"2021","unstructured":"Linardatos P, Papastefanopoulos V, Kotsiantis S. Explainable AI: a review of machine learning interpretability methods. Entropy. 2021;23(1):18.","journal-title":"Entropy"},{"issue":"3","key":"15_CR19","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1145\/3236386.3241340","volume":"16","author":"ZC Lipton","year":"2018","unstructured":"Lipton ZC. The mythos of model interpretability: in machine learning, the concept of interpretability is both important and slippery. Queue. 2018;16(3):31\u201357.","journal-title":"Queue"},{"issue":"4","key":"15_CR20","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1159\/000066194","volume":"53","author":"S Lo","year":"2002","unstructured":"Lo S, Zheng T. Backward haplotype transmission association algorithm\u2014a fast multiple-marker screening method. Hum Hered. 2002;53(4):197\u2013215.","journal-title":"Hum Hered."},{"issue":"45","key":"15_CR21","doi-asserted-by":"publisher","first-page":"13892","DOI":"10.1073\/pnas.1518285112","volume":"112","author":"A Lo","year":"2015","unstructured":"Lo A, Chernoff H, Zheng T, Lo S-H. Why significant variables aren\u2019t automatically good predictors. Proc Natl Acad Sci. 2015;112(45):13892\u20137.","journal-title":"Proc Natl Acad Sci"},{"issue":"50","key":"15_CR22","doi-asserted-by":"publisher","first-page":"14277","DOI":"10.1073\/pnas.1616647113","volume":"113","author":"A Lo","year":"2016","unstructured":"Lo A, Chernoff H, Zheng T, Lo S-H. Framework for making better predictions by directly estimating variables\u2019 predictivity. Proc Natl Acad Sci. 2016;113(50):14277\u201382.","journal-title":"Proc Natl Acad Sci"},{"key":"15_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.artint.2018.07.007","volume":"267","author":"T Miller","year":"2019","unstructured":"Miller T. Explanation in artificial intelligence: insights from the social sciences. Artif Intell. 2019;267:1\u201338.","journal-title":"Artif Intell"},{"issue":"4","key":"15_CR24","doi-asserted-by":"publisher","first-page":"294","DOI":"10.1002\/jhm.955","volume":"7","author":"MI Neuman","year":"2012","unstructured":"Neuman MI. Variability in the interpretation of chest radiographs for the diagnosis of pneumonia in children. J Hosp Med. 2012;7(4):294\u20138.","journal-title":"J Hosp Med"},{"issue":"10","key":"15_CR25","doi-asserted-by":"publisher","first-page":"1715","DOI":"10.3390\/app8101715","volume":"8","author":"S Rajaraman","year":"2018","unstructured":"Rajaraman S, Candemir S, Kim I, Thoma G, Antani S. Visualization and interpretation of convolutional neural network predictions in detecting pneumonia in pediatric chest radiographs. Appl Sci. 2018;8(10):1715.","journal-title":"Appl Sci"},{"issue":"5","key":"15_CR26","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","volume":"1","author":"C Rudin","year":"2019","unstructured":"Rudin C. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat Mach Intell. 2019;1(5):206\u201315.","journal-title":"Nat Mach Intell."},{"key":"15_CR27","doi-asserted-by":"crossref","unstructured":"Saraiva A, Carvalho\u00a0da Costa N, Sousa J, Ferreira N, Valente A, Soares S. Models of learning to classify X-ray images for the detection of pneumonia using neural networks. In Bioimaging, 2019;76\u201383.","DOI":"10.5220\/0007346600760083"},{"key":"15_CR28","unstructured":"Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. 2014 arXiv preprint arXiv:1409.1556."},{"key":"15_CR29","doi-asserted-by":"crossref","unstructured":"Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A. Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2015;1\u20139.","DOI":"10.1109\/CVPR.2015.7298594"},{"issue":"4","key":"15_CR30","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1016\/j.irbm.2019.10.006","volume":"41","author":"M To\u011fa\u00e7ar","year":"2020","unstructured":"To\u011fa\u00e7ar M, Ergen B, C\u00f6mert Z, \u00d6zyurt F. A deep feature learning model for pneumonia detection applying a combination of mrmr feature selection and machine learning models. IRBM. 2020;41(4):212\u201322.","journal-title":"IRBM"},{"issue":"21","key":"15_CR31","doi-asserted-by":"publisher","first-page":"2834","DOI":"10.1093\/bioinformatics\/bts531","volume":"28","author":"H Wang","year":"2012","unstructured":"Wang H, Lo S-H, Zheng T, Hu I. Interaction-based feature selection and classification for high-dimensional biological data. Bioinformatics. 2012;28(21):2834\u201342.","journal-title":"Bioinformatics"},{"key":"15_CR32","unstructured":"Yang M, Kim B. Benchmarking attribution methods with relative feature importance. 2019 arXiv preprint arXiv:1907.09701."},{"key":"15_CR33","doi-asserted-by":"crossref","unstructured":"Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A. Learning deep features for discriminative localization. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2016;2921\u20132929.","DOI":"10.1109\/CVPR.2016.319"}],"container-title":["Discover Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44163-021-00015-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44163-021-00015-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44163-021-00015-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,20]],"date-time":"2021-12-20T09:44:16Z","timestamp":1639993456000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44163-021-00015-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12]]},"references-count":33,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["15"],"URL":"https:\/\/doi.org\/10.1007\/s44163-021-00015-z","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-963338\/v1","asserted-by":"object"}]},"ISSN":["2731-0809"],"issn-type":[{"value":"2731-0809","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12]]},"assertion":[{"value":"11 October 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 December 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 December 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"16"}}