{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T07:12:25Z","timestamp":1784099545034,"version":"3.55.0"},"reference-count":162,"publisher":"Emerald","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,8,2]]},"abstract":"<jats:p>Humans reason about the world around them by seeking to understand why and how something occurs. The same principle extends to the technology that so many of human activities increasingly rely on. Issues of trust, transparency, and understandability are critical in promoting adoption and proper use of systems. However, with increasing complexity of the systems and technologies we use, it is hard or even impossible to comprehend their function and behavior, and justify surprising observations through manual investigation alone. Explanation support can ease humans\u2019 interactions with technology: explanations can help users understand a system\u2019s function, justify system results, and increase their trust in automated decisions.<\/jats:p>\n                  <jats:p>Our goal in this article is to provide an overview of existing work in explanation support for data-driven processes, through a lens that identifies commonalities across varied problem settings and solutions. We suggest a classification of explainability requirements across three dimensions: the target of the explanation (\u201cWhat\u201d), the audience of the explanation (\u201cWho\u201d), and the purpose of the explanation (\u201cWhy\u201d). We identify dominant themes across these dimensions and the high-level desiderata each implies, accompanied by several examples to motivate various problem settings. We discuss explainability solutions through the lens of the \u201cHow\u201d dimension: How something is explained (the form of the explanation) and how explanations are derived (methodology). We conclude with a roadmap of possible research directions for the data management community within the field of explainability in data systems.<\/jats:p>","DOI":"10.1561\/1900000074","type":"journal-article","created":{"date-parts":[[2021,8,2]],"date-time":"2021-08-02T09:31:26Z","timestamp":1627896686000},"page":"226-318","source":"Crossref","is-referenced-by-count":11,"title":["Trends in Explanations: Understanding and Debugging Data-driven Systems"],"prefix":"10.1108","volume":"11","author":[{"given":"Boris","family":"Glavic","sequence":"first","affiliation":[{"name":"Illinois Institute of Technology , Chicago"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandra","family":"Alexandra","sequence":"additional","affiliation":[{"name":"University of Massachusetts Amherst"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sudeepa","family":"Sudeepa","sequence":"additional","affiliation":[{"name":"Duke University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"140","published-online":{"date-parts":[[2021,8,2]]},"reference":[{"key":"2025120412013001200_ref001","unstructured":"Aas, K., M.Jullum, and A.L\u00f8land. (2019). \u201cExplaining Individual Predictions When Features Are Dependent: More Accurate Approximations To Shapley Values\u201d. CoRR. abs\/1903.10464. arXiv: 1903.10464. url: http:\/\/arxiv.org\/abs\/1903.10464."},{"key":"2025120412013001200_ref002","doi-asserted-by":"publisher","first-page":"143","DOI":"10.5441\/002\/icdt.2014.17","article-title":"Deduction with Contradictions in Datalog","volume-title":"Proc. 17th International Conference on Database Theory (ICDT), Athens, Greece, March 24-28, 2014","author":"Abiteboul","year":"2014"},{"key":"2025120412013001200_ref003","volume-title":"Foundations of Databases: The Logical Level","author":"Abiteboul","year":"1995","edition":"1st"},{"issue":"4","key":"2025120412013001200_ref004","doi-asserted-by":"publisher","first-page":"15:1","DOI":"10.1145\/3276463","article-title":"Macrobase: Prioritizing Attention in Fast Data","volume":"43","author":"Abuzaid","year":"2018","journal-title":"ACM Trans. Database Syst"},{"issue":"1","key":"2025120412013001200_ref005","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1007\/s00778-020-00633-6","article-title":"DIFF: a Relational Interface for Large-Scale Data Explanation","volume":"30","author":"Abuzaid","year":"2021","journal-title":"VLDB J"},{"key":"2025120412013001200_ref006","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1145\/1281192.1281197","volume-title":"KDD","author":"Agarwal","year":"2007"},{"key":"2025120412013001200_ref007","first-page":"487","volume-title":"Proceedings of the 20th International Conference on Very Large Data Bases. VLDB \u201894","author":"Agrawal","year":"1994"},{"issue":"10","key":"2025120412013001200_ref008","doi-asserted-by":"publisher","first-page":"968","DOI":"10.14778\/2336664. 2336670","article-title":"DBToaster: Higher-order Delta Processing for Dynamic, Frequently Fresh Views","volume":"5","author":"Ahmad","year":"2012","journal-title":"Proc. VLDB Endow"},{"key":"2025120412013001200_ref009","first-page":"1179","volume-title":"Proceedings of the 32nd international conference on Very large data bases","author":"Alexe","year":"2006"},{"key":"2025120412013001200_ref010","first-page":"153","volume-title":"PODS \u201811","author":"Amsterdamer","year":"2011"},{"key":"2025120412013001200_ref011","unstructured":"\u201cApache Ambari\u201d. (2019). http:\/\/ambari.apache.org."},{"key":"2025120412013001200_ref012","doi-asserted-by":"publisher","first-page":"1273","DOI":"10.1109\/ICDE.2007.368991","article-title":"Parsimonious Explanations of Change in Hierarchical Data","volume-title":"ICDE","author":"Barman","year":"2007"},{"key":"2025120412013001200_ref013","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","article-title":"Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI","volume":"58","author":"Barredo Arrieta","year":"2020","journal-title":"Information Fusion"},{"key":"2025120412013001200_ref014","unstructured":"Basu, S., X.You, and S.Feizi. (2019). \u201cSecond-Order Group Influence Functions for Black-Box Predictions\u201d. CoRR. abs\/1911.00418. arXiv: 1911.00418. url: http:\/\/arxiv.org\/abs\/1911.00418."},{"key":"2025120412013001200_ref015","doi-asserted-by":"publisher","first-page":"1411","DOI":"10.1145\/2588555.2593663","volume-title":"Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data. SIGMOD \u201814","author":"Bender","year":"2014"},{"issue":"2","key":"2025120412013001200_ref016","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/223784.223785","article-title":"A critique of ANSI SQL isolation levels","volume":"24","author":"Berenson","year":"1995","journal-title":"SIGMOD Record"},{"key":"2025120412013001200_ref017","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-031-01883-1","article-title":"Database Repairing and Consistent Query Answering","author":"Bertossi","year":"2011"},{"key":"2025120412013001200_ref018","doi-asserted-by":"publisher","first-page":"6:1","DOI":"10.1145\/3399579.3399865","volume-title":"Proceedings of the Fourth Workshop on Data Management for End-To-End Machine Learning, In conjunction with the 2020 ACM SIG-MOD\/PODS Conference, DEEM@SIGMOD 2020, Portland, OR, USA, June 14, 2020","author":"Bertossi","year":"2020"},{"issue":"1","key":"2025120412013001200_ref019","doi-asserted-by":"publisher","first-page":"598","DOI":"10.14778\/1687627.1687695","article-title":"Modeling and querying possible repairs in duplicate detection","volume":"2","author":"Beskales","year":"2009","journal-title":"Proceedings of the VLDB Endowment"},{"key":"2025120412013001200_ref020","doi-asserted-by":"publisher","first-page":"713","DOI":"10.1145\/2806416.2806426","volume-title":"Proceedings of the 24th ACM International Conference on Information and Knowledge Management, CIKM 2015, Melbourne, VIC, Australia, October 19 - 23, 2015","author":"Bidoit","year":"2015"},{"key":"2025120412013001200_ref021","doi-asserted-by":"publisher","DOI":"10.5441\/002\/edbt.2014.14","article-title":"Query-Based Why-Not Provenance with NedExplain","volume-title":"Extending Database Technology (EDBT)","author":"Bidoit","year":"2014"},{"key":"2025120412013001200_ref022","volume-title":"8th USENIX Workshop on the Theory and Practice of Provenance (TaPP 16)","author":"Bidoit","year":"2016"},{"key":"2025120412013001200_ref023","article-title":"Why Did My Query Slow Down?","volume-title":"arXiv preprint arXiv:0907.3183","author":"Borisov","year":"2009"},{"key":"2025120412013001200_ref024","doi-asserted-by":"publisher","first-page":"1877","DOI":"10.1145\/3299869.3320246","volume-title":"Proceedings of the 2019 International Conference on Management of Data. SIGMOD 19","author":"Brachmann","year":"2019"},{"key":"2025120412013001200_ref025","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1007\/3-540-44503-X\\_20","volume-title":"Database Theory - ICDT 2001, 8th International Conference, London, UK, January 4-6, 2001, Proceedings","author":"Buneman","year":"2001"},{"key":"2025120412013001200_ref026","first-page":"324","article-title":"Ontology-based Database Access","volume-title":"Proceedings of the Fifteenth Italian Symposium on Advanced Database Systems, SEBD 2007, 17-20 June 2007, Torre Canne, Fasano, BR, Italy","author":"Calvanese","year":"2007"},{"key":"2025120412013001200_ref027","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1145\/2745754.2745765","volume-title":"Proceedings of the 34th ACM SIGMOD-SIGACT-SIGAI Symposium on Principles of Database Systems","author":"Cate","year":"2015"},{"key":"2025120412013001200_ref028","first-page":"577","volume-title":"Proceedings of the 17th International Conference on Very Large Data Bases. VLDB \u201891","author":"Ceri","year":"1991"},{"key":"2025120412013001200_ref029","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1145\/2588555.2610520","volume-title":"Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data. SIGMOD \u201814","author":"Chalamalla","year":"2014"},{"issue":"6","key":"2025120412013001200_ref030","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1007\/s00778-015-0395-0","article-title":"Data generation for testing and grading SQL queries","volume":"24","author":"Chandra","year":"2015","journal-title":"VLDB J"},{"key":"2025120412013001200_ref031","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1145\/1559845.1559901","article-title":"Why Not?","volume-title":"SIGMOD \u201809: Proceedings of the 35th SIGMOD International Conference on Management of Data","author":"Chapman","year":"2009"},{"issue":"4","key":"2025120412013001200_ref032","first-page":"22","article-title":"Program Slicing and Data Provenance","volume":"30","author":"Cheney","year":"2007","journal-title":"IEEE Data Engineering Bulletin"},{"key":"2025120412013001200_ref033","first-page":"271","article-title":"Database Queries that Explain their Work","volume-title":"Proceedings of the 16th International Symposium on Principles and Practice of Declarative Programming, Kent, Canterbury, United Kingdom, September 8-10, 2014","author":"Cheney","year":"2014"},{"issue":"4","key":"2025120412013001200_ref034","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1561\/1900000006","article-title":"Provenance in Databases: Why, How, and Where","volume":"1","author":"Cheney","year":"2009","journal-title":"Foundations and Trends\u00ae in Databases"},{"issue":"1","key":"2025120412013001200_ref035","first-page":"93","article-title":"Responsibility and Blame: A Structural-Model Approach","volume":"22","author":"Chockler","year":"2004","journal-title":"J. Artif. Int. Res"},{"key":"2025120412013001200_ref036","first-page":"1591","volume-title":"Proceedings of the 2017 ACM International Conference on Management of Data, SIGMOD Conference 2017, Chicago, IL, USA, May 14-19, 2017","author":"Chu","year":"2017"},{"key":"2025120412013001200_ref037","unstructured":"Chu, S., C.Wang, K.Weitz, and A.Cheung. (2017b). \u201cCosette: An Automated Prover for SQL\u201d. In: CIDR 2017, 8th Biennial Conference on Innovative Data Systems Research, Chaminade, CA, USA, January 8-11, 2017, Online Proceedings. www.cidrdb.org."},{"key":"2025120412013001200_ref038","doi-asserted-by":"crossref","first-page":"1550","DOI":"10.1109\/ICDE.2019.00139","volume-title":"2019 IEEE 35th International Conference on Data Engineering (ICDE)","author":"Chung","year":"2019"},{"key":"2025120412013001200_ref039","volume-title":"Residuals and influence in regression","author":"Cook","year":"1982"},{"key":"2025120412013001200_ref040","first-page":"471","article-title":"Lineage Tracing for General Data Warehouse Transformations","volume-title":"Proceedings of 27th International Conference on Very Large Data Bases","author":"Cui","year":"2001"},{"issue":"11","key":"2025120412013001200_ref041","first-page":"1063","article-title":"MRI: Meaningful Interpretations of Collaborative Ratings","volume":"4","author":"Das","year":"2011","journal-title":"PVLDB"},{"key":"2025120412013001200_ref042","doi-asserted-by":"publisher","first-page":"598","DOI":"10.1109\/SP.2016.42","volume-title":"IEEE Symposium on Security and Privacy, SP 2016, San Jose, CA, USA, May 22-26, 2016","author":"Datta","year":"2016"},{"issue":"4","key":"2025120412013001200_ref043","first-page":"44","article-title":"Provenance in Scientific Workflow Systems","volume":"30","author":"Davidson","year":"2007","journal-title":"IEEE Data Eng. Bull"},{"issue":"5","key":"2025120412013001200_ref044","doi-asserted-by":"crossref","DOI":"10.14778\/3055540.3055550","article-title":"Provenance for Natural Language Queries","volume":"10","author":"Deutch","year":"2017","journal-title":"Proceedings of the VLDB Endowment"},{"key":"2025120412013001200_ref045","doi-asserted-by":"publisher","first-page":"2765","DOI":"10.1145\/3318464.3384700","volume-title":"Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data. SIGMOD \u201820","author":"Deutch","year":"2020"},{"key":"2025120412013001200_ref046","first-page":"201","article-title":"Circuits for Datalog Provenance","volume-title":"Proc. 17th International Conference on Database Theory (ICDT)","author":"Deutch","year":"2014"},{"key":"2025120412013001200_ref047","first-page":"84","article-title":"Automatic Performance Diagnosis and Tuning in Oracle","volume-title":"CIDR","author":"Dias","year":"2005"},{"key":"2025120412013001200_ref048","first-page":"405","article-title":"To not miss the forest for the trees - A holistic approach for explaining missing answers over nested data","volume-title":"Proceedings of the 46th International Conference on Management of Data","author":"Diestelk\u00e4mper","year":"2021"},{"key":"2025120412013001200_ref049","doi-asserted-by":"publisher","first-page":"601","DOI":"10.1145\/2623330.2623623","volume-title":"Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD \u201814","author":"Dong","year":"2014"},{"key":"2025120412013001200_ref050","unstructured":"\u201cDr. Elephant\u201d. (2019). http:\/\/www.teradata.com."},{"issue":"1","key":"2025120412013001200_ref051","doi-asserted-by":"crossref","first-page":"13","DOI":"10.14778\/2428536.2428538","article-title":"DisC Diversity: Result Diversification Based on Dissimilarity and Coverage","volume":"6","author":"Drosou","year":"2012","journal-title":"Proc. VLDB Endow"},{"issue":"1","key":"2025120412013001200_ref052","doi-asserted-by":"crossref","first-page":"1","DOI":"10.14778\/2047485.2047486","article-title":"Explanation-based auditing","volume":"5","author":"Fabbri","year":"2011","journal-title":"Proc. VLDB Endow"},{"key":"2025120412013001200_ref053","first-page":"431","volume-title":"Proceedings of the 2020 International Conference on Management of Data, SIGMOD Conference 2020, online conference [Portland, OR, USA], June 14-19, 2020","author":"Fariha","year":"2020"},{"key":"2025120412013001200_ref054","first-page":"74","volume-title":"Proceedings of the 17th ACM SIGPLAN International Symposium on Database Programming Languages, DBPL 2019, Phoenix, AZ, USA, June 23, 2019","author":"Fehrenbach","year":"2019"},{"key":"2025120412013001200_ref055","first-page":"528","article-title":"Efficient Uncertainty Tracking for Complex Queries with Attribute-level Bounds","volume-title":"Proceedings of the 46th International Conference on Management of Data","author":"Feng","year":"2021"},{"issue":"3","key":"2025120412013001200_ref056","doi-asserted-by":"publisher","first-page":"180","DOI":"10.14778\/2850583.2850592","article-title":"A Characterization of the Complexity of Resilience and Responsibility for Self-join-free Conjunctive Queries","volume":"9","author":"Freire","year":"2015","journal-title":"PVLDB"},{"key":"2025120412013001200_ref057","unstructured":"Frye, C., C.Rowat, and I.Feige. (2020). \u201cAsymmetric Shapley values: incorporating causal knowledge into model-agnostic explainability\u201d. In: Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual. Ed. by H.Larochelle, M.Ranzato, R.Hadsell, M.Balcan, and H.Lin. url: https:\/\/proceedings.neurips.cc\/paper\/2020\/hash\/0d770c496aa3da6d2c3f2bd19e7b9d6b-Abstract.html."},{"key":"2025120412013001200_ref058","unstructured":"Galhotra, S., R.Pradhan, and B.Salimi. (2021). \u201cExplaining Black-Box Algorithms Using Probabilistic Contrastive Counterfactuals\u201d. CoRR. abs\/2103.11972. arXiv: 2103.11972. url: https:\/\/arxiv.org\/abs\/2103.11972."},{"key":"2025120412013001200_ref059","unstructured":"\u201cGanglia Monitoring System\u201d. (2019). http:\/\/ganglia.info."},{"issue":"1","key":"2025120412013001200_ref060","doi-asserted-by":"crossref","first-page":"61","DOI":"10.14778\/2735461.2735467","article-title":"Interpretable and Informative Explanations of Outcomes","volume":"8","author":"Gebaly","year":"2014","journal-title":"Proc. VLDB Endow"},{"issue":"3","key":"2025120412013001200_ref061","first-page":"43","article-title":"Explanation Tables","volume":"41","author":"Gebaly","year":"2018","journal-title":"IEEE Data Eng. Bull"},{"key":"2025120412013001200_ref062","first-page":"3535","volume-title":"Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event","author":"Ghorbani","year":"2020"},{"key":"2025120412013001200_ref063","first-page":"2242","volume-title":"Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA","author":"Ghorbani","year":"2019"},{"key":"2025120412013001200_ref064","doi-asserted-by":"crossref","DOI":"10.1561\/9781680838299","article-title":"Data Provenance: Origins, Applications, Algorithms, and Models","volume-title":"Foundations and Trends\u00ae in Databases","author":"Glavic","year":"2021"},{"issue":"1","key":"2025120412013001200_ref065","first-page":"1314","article-title":"TRAMP: Understanding the Behavior of Schema Mappings through Provenance","volume":"3","author":"Glavic","year":"2010","journal-title":"Proceedings of the Very Large Data Bases Endowment"},{"key":"2025120412013001200_ref066","article-title":"Towards Constraint-based Explanations for Answers and Non-Answers","volume-title":"Proceedings of the 7th USENIX Workshop on the Theory and Practice of Provenance","author":"Glavic","year":"2015"},{"key":"2025120412013001200_ref067","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1007\/978-3-642-41660-6_16","article-title":"Using SQL for Efficient Generation and Querying of Provenance Information","volume-title":"In search of elegance in the theory and practice of computation: a Festschrift in honour of Peter Buneman","author":"Glavic","year":"2013"},{"issue":"1","key":"2025120412013001200_ref068","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1023\/A:1009726021843","article-title":"Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals","volume":"1","author":"Gray","year":"1997","journal-title":"Data Min. Knowl. Discov"},{"key":"2025120412013001200_ref069","first-page":"31","article-title":"Provenance semirings","volume-title":"PODS","author":"Green","year":"2007"},{"issue":"5","key":"2025120412013001200_ref070","doi-asserted-by":"publisher","first-page":"93:1","DOI":"10.1145\/3236009","article-title":"A Survey of Methods for Explaining Black Box Models","volume":"51","author":"Guidotti","year":"2019","journal-title":"ACM Comput. Surv"},{"key":"2025120412013001200_ref071","first-page":"194","volume-title":"Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence. UAI\u201901","author":"Halpern","year":"2001"},{"key":"2025120412013001200_ref072","volume-title":"Data Mining: Concepts and Techniques","author":"Han","year":"2001"},{"issue":"2011","key":"2025120412013001200_ref073","first-page":"261","article-title":"Starfish: a self-tuning system for big data analytics","volume":"11","author":"Herodotou","year":"2011","journal-title":"Cidr"},{"issue":"1","key":"2025120412013001200_ref074","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1109\/TKDE.2017.2685998","article-title":"Interactive data exploration with smart drill-down","volume":"31","author":"Joglekar","year":"2017","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"2025120412013001200_ref075","doi-asserted-by":"publisher","first-page":"906","DOI":"10.1109\/ICDE.2016.7498300","volume-title":"32nd IEEE International Conference on Data Engineering, ICDE 2016, Helsinki, Finland, May 16-20, 2016","author":"Joglekar","year":"2016"},{"key":"2025120412013001200_ref076","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1145\/3183713.3183727","volume-title":"Proceedings of the 2018 International Conference on Management of Data","author":"Kalashnikov","year":"2018"},{"key":"2025120412013001200_ref077","first-page":"918","article-title":"iQCAR: inter-Query Contention Analyzer for Data Analytics Frameworks","volume-title":"Proceedings of the 2019 International Conference on Management of Data, SIGMOD Conference 2019, Amsterdam, The Netherlands, June 30 - July 5, 2019","author":"Kalmegh","year":"2019"},{"key":"2025120412013001200_ref078","doi-asserted-by":"publisher","first-page":"841","DOI":"10.1145\/1989323. 1989411","volume-title":"SIGMOD","author":"Kanagal","year":"2011"},{"key":"2025120412013001200_ref079","first-page":"895","volume-title":"The 23rd International Conference on Artificial Intelligence and Statistics, AISTATS 2020, 26-28 August 2020, Online [Palermo, Sicily, Italy]","author":"Karimi","year":"2020"},{"issue":"7","key":"2025120412013001200_ref080","first-page":"598","article-title":"Perfxplain: debugging mapreduce job performance","volume":"5","author":"Khoussainova","year":"2012","journal-title":"PVLDB"},{"key":"2025120412013001200_ref081","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1109\/ICDE48307.2020.00081","volume-title":"2020 IEEE 36th International Conference on Data Engineering (ICDE)","author":"Kim","year":"2020"},{"key":"2025120412013001200_ref082","first-page":"1885","volume-title":"Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6-11 August 2017","author":"Koh","year":"2017"},{"key":"2025120412013001200_ref083","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1007\/978-3-642-32925-8_12","article-title":"Declarative datalog debugging for mere mortals","volume-title":"Datalog in Academia and Industry","author":"K\u00f6hler","year":"2012"},{"key":"2025120412013001200_ref084","first-page":"793","volume-title":"The 24th International Conference on Artificial Intelligence and Statistics, AISTATS 2021, April 13-15, 2021, Virtual Event","author":"Kwon","year":"2021"},{"key":"2025120412013001200_ref085","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1007\/978-3-319-91473-2\\_9","volume-title":"Information Processing and Management of Uncertainty in Knowledge-Based Systems. Theory and Foundations - 17th International Conference, IPMU 2018, C\u00e1diz, Spain, June 11-15, 2018, Proceedings, Part I","author":"Laugel","year":"2018"},{"issue":"1","key":"2025120412013001200_ref086","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1007\/s00778-018-0518-5","article-title":"PUG: a framework and practical implementation for why and why-not provenance","volume":"28","author":"Lee","year":"2018","journal-title":"The VLDB Journal"},{"issue":"6","key":"2025120412013001200_ref087","first-page":"912","article-title":"Approximate Summaries for Why and Why-not Provenance","volume":"13","author":"Lee","year":"2020","journal-title":"PVLDB"},{"key":"2025120412013001200_ref088","unstructured":"Letham, B., C.Rudin, T. H.McCormick, and D.Madigan. (2015). \u201cInterpretable Classifiers Using Rules and Bayesian Analysis: Building a Better Stroke Prediction Model\u201d. CoRR. abs\/1511.01644. arXiv: 1511.01644. url: http:\/\/arxiv.org\/abs\/1511.01644."},{"key":"2025120412013001200_ref089","first-page":"20:1","volume-title":"23rd International Conference on Database Theory, ICDT 2020, March 30-April 2, 2020, Copenhagen, Denmark","author":"Livshits","year":"2020"},{"key":"2025120412013001200_ref090","unstructured":"Lundberg, S. M., G. G.Erion, and S.Lee. (2018). \u201cConsistent Individualized Feature Attribution for Tree Ensembles\u201d. CoRR. abs\/1802.03888. arXiv: 1802.03888. url: http:\/\/arxiv.org\/abs\/1802.03888."},{"key":"2025120412013001200_ref091","first-page":"4765","article-title":"A Unified Approach to Interpreting Model Predictions","volume-title":"Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA","author":"Lundberg","year":"2017"},{"key":"2025120412013001200_ref092","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1109\/ICDE.2018.00019","article-title":"DeepEye: Towards Automatic Data Visualization","volume-title":"2018 IEEE 34th International Conference on Data Engineering (ICDE)","author":"Luo","year":"2018"},{"key":"2025120412013001200_ref093","unstructured":"Mahajan, D., C.Tan, and A.Sharma. (2019). \u201cPreserving Causal Constraints in Counterfactual Explanations for Machine Learning Classifiers\u201d. CoRR. abs\/1912.03277. arXiv: 1912.03277. url: http:\/\/arxiv.org\/abs\/1912.03277."},{"key":"2025120412013001200_ref094","first-page":"3","volume-title":"Proceedings of the 4th International VLDB workshop on Management of Uncertain Data (MUD) in conjunction with VLDB (MUD)","author":"Meliou","year":"2010"},{"issue":"11","key":"2025120412013001200_ref095","first-page":"1490","article-title":"Reverse Data Management","volume":"4","author":"Meliou","year":"2011","journal-title":"PVLDB"},{"key":"2025120412013001200_ref096","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1145\/2213836.2213875","volume-title":"Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD) (SIGMOD)","author":"Meliou","year":"2012"},{"key":"2025120412013001200_ref097","unstructured":"Merrick, L. and A.Taly. (2019). \u201cThe Explanation Game: Explaining Machine Learning Models With Cooperative Game Theory\u201d. CoRR. abs\/1909.08128. arXiv: 1909.08128. url: http:\/\/arxiv.org\/abs\/1909.08128."},{"issue":"12","key":"2025120412013001200_ref098","doi-asserted-by":"crossref","first-page":"2997","DOI":"10.14778\/3415478.3415528","article-title":"I-Rex: An Interactive Relational Query Explainer for SQL","volume":"13","author":"Miao","year":"2020","journal-title":"Proc. VLDB Endow"},{"key":"2025120412013001200_ref099","first-page":"503","article-title":"Explaining Wrong Queries Using Small Examples","volume-title":"Proceedings of the 2019 International Conference on Management of Data, SIGMOD Conference 2019, Amsterdam, The Netherlands, June 30 - July 5, 2019","author":"Miao","year":"2019"},{"key":"2025120412013001200_ref100","first-page":"1961","volume-title":"Proceedings of the 2019 International Conference on Management of Data, SIGMOD Conference 2019, Amsterdam, The Netherlands, June 30 - July 5, 2019","author":"Miao","year":"2019"},{"key":"2025120412013001200_ref101","first-page":"485","volume-title":"Proceedings of the 2019 International Conference on Management of Data, SIGMOD Conference 2019, Amsterdam, The Netherlands, June 30 - July 5, 2019","author":"Miao","year":"2019"},{"key":"2025120412013001200_ref102","first-page":"862","volume-title":"EDBT 2009, 12th International Conference on Extending Database Technology, Saint Petersburg, Russia, March 24-26, 2009, Proceedings","author":"Mishra","year":"2009"},{"key":"2025120412013001200_ref103","unstructured":"Mita, G., P.Papotti, M.Filippone, and P.Michiardi. (2020). \u201cLIBRE: Learning Interpretable Boolean Rule Ensembles\u201d. In: The 23rd International Conference on Artificial Intelligence and Statistics, AISTATS 2020, 26-28 August 2020, Online [Palermo, Sicily, Italy]. 245\u2013255. url: http:\/\/proceedings.mlr.press\/v108\/mita20a.html."},{"key":"2025120412013001200_ref104","first-page":"5","volume-title":"ECAI 2012 - 20th European Conference on Artificial Intelligence. Including Prestigious Applications of Artificial Intelligence (PAIS-2012) System Demonstrations Track, Montpellier, France, August 27-31, 2012","author":"Mitchell","year":"2012"},{"key":"2025120412013001200_ref105","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1145\/3351095.3372850","volume-title":"FAT* \u201820: Conference on Fairness, Accountability, and Transparency, Barcelona, Spain, January 27-30, 2020","author":"Mothilal","year":"2020"},{"issue":"14","key":"2025120412013001200_ref106","doi-asserted-by":"crossref","first-page":"1762","DOI":"10.14778\/2556549.2556560","article-title":"A probabilistic optimization framework for the empty-answer problem","volume":"6","author":"Mottin","year":"2013","journal-title":"Proceedings of the VLDB Endowment"},{"key":"2025120412013001200_ref107","first-page":"43","volume-title":"Proceedings of the 2006 USENIX Annual Technical Conference, Boston, MA, USA, May 30 - June 3, 2006","author":"Muniswamy-Reddy","year":"2006"},{"key":"2025120412013001200_ref108","first-page":"245","volume-title":"Proceedings of the ACM SIGMOD International Conference on Management of Data, SIGMOD 2009, Providence, Rhode Island, USA, June 29 - July 2, 2009","author":"Olston","year":"2009"},{"key":"2025120412013001200_ref109","first-page":"293","article-title":"Making Sense of Performance in Data Analytics Frameworks","volume-title":"12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15)","author":"Ousterhout","year":"2015"},{"issue":"1","key":"2025120412013001200_ref110","doi-asserted-by":"publisher","first-page":"986","DOI":"10.1137\/16M1097717","article-title":"On Shapley Value for Measuring Importance of Dependent Inputs","volume":"5","author":"Owen","year":"2017","journal-title":"SIAM\/ASA J. Uncertain. Quantification"},{"key":"2025120412013001200_ref111","volume-title":"Causality: Models, Reasoning, and Inference","author":"Pearl","year":"2000"},{"issue":"11","key":"2025120412013001200_ref112","doi-asserted-by":"publisher","first-page":"1124","DOI":"10.14778\/2350229. 2350233","article-title":"Diversifying Top-K Results","volume":"5","author":"Qin","year":"2012","journal-title":"Proc. VLDB Endow"},{"issue":"1","key":"2025120412013001200_ref113","doi-asserted-by":"crossref","first-page":"797","DOI":"10.14778\/1453856.1453943","article-title":"Approximate lineage for probabilistic databases","volume":"1","author":"R\u00e9","year":"2008","journal-title":"Proc. VLDB Endow"},{"key":"2025120412013001200_ref114","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1145\/3375395.3387664","volume-title":"Proceedings of the 39th ACM SIGMOD-SIGACT-SIGAI Symposium on Principles of Database Systems, PODS 2020, Portland, OR, USA, June 14-19, 2020","author":"Reshef","year":"2020"},{"key":"2025120412013001200_ref115","doi-asserted-by":"publisher","first-page":"1135","DOI":"10.1145\/2939672.2939778","volume-title":"Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, August 13-17, 2016","author":"Ribeiro","year":"2016"},{"key":"2025120412013001200_ref116","first-page":"1527","volume-title":"Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018","author":"Ribeiro","year":"2018"},{"issue":"1","key":"2025120412013001200_ref117","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1093\/biomet\/70.1.41","article-title":"The central role of the propensity score in observational studies for causal effects","volume":"70","author":"Rosenbaum","year":"1983","journal-title":"Biometrika"},{"issue":"4","key":"2025120412013001200_ref118","doi-asserted-by":"publisher","first-page":"348","DOI":"10.14778\/2856318.2856329","article-title":"Explaining Query Answers with Explanation-Ready Databases","volume":"9","author":"Roy","year":"2015","journal-title":"Proc. VLDB Endow"},{"key":"2025120412013001200_ref119","doi-asserted-by":"publisher","first-page":"1579","DOI":"10.1145\/2588555.2588578","volume-title":"Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data. SIGMOD \u201814","author":"Roy","year":"2014"},{"key":"2025120412013001200_ref120","first-page":"1167","article-title":"PerfAugur: Robust diagnostics for performance anomalies in cloud services","volume-title":"31st IEEE International Conference on Data Engineering, ICDE 2015, Seoul, South Korea, April 13-17, 2015","author":"Roy","year":"2015"},{"issue":"Mar.","key":"2025120412013001200_ref121","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1198\/016214504000001880","article-title":"Causal Inference Using Potential Outcomes: Design, Modeling, Decisions","volume":"100","author":"Rubin","year":"2005","journal-title":"Journal of the American Statistical Association"},{"issue":"5","key":"2025120412013001200_ref122","doi-asserted-by":"crossref","DOI":"10.1038\/s42256-019-0048-x","article-title":"Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead","volume":"1","author":"Rudin","year":"2019","journal-title":"Nature Machine Intelligence"},{"key":"2025120412013001200_ref123","doi-asserted-by":"publisher","first-page":"2290","DOI":"10.1145\/3448016.3457323","volume-title":"SIGMOD \u201821: International Conference on Management of Data, Virtual Event, China, June 20-25, 2021","author":"Sagadeeva","year":"2021"},{"key":"2025120412013001200_ref124","first-page":"241","volume-title":"Proceedings of the 2020 International Conference on Management of Data, SIGMOD Conference 2020, online conference [Portland, OR, USA], June 14-19, 2020","author":"Salimi","year":"2020"},{"key":"2025120412013001200_ref125","first-page":"307","volume-title":"VLDB 2000, Proceedings of 26th International Conference on Very Large Data Bases, September 10-14, 2000, Cairo, Egypt","author":"Sarawagi","year":"2000"},{"key":"2025120412013001200_ref126","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1145\/342009.336564","volume-title":"Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, May 16-18, 2000, Dallas, Texas, USA","author":"Sarawagi","year":"2000"},{"key":"2025120412013001200_ref127","first-page":"531","volume-title":"VLDB 2001, Proceedings of 27th International Conference on Very Large Data Bases, September 11-14, 2001, Roma, Italy","author":"Sathe","year":"2001"},{"key":"2025120412013001200_ref128","first-page":"307","article-title":"A Value for n-Person Games","volume-title":"Contributions to the Theory of Games II","author":"Shapley","year":"1953"},{"issue":"4","key":"2025120412013001200_ref129","doi-asserted-by":"crossref","first-page":"457","DOI":"10.14778\/3025111.3025126","article-title":"Effortless Data Exploration with zenvisage: An Expressive and Interactive Visual Analytics System","volume":"10","author":"Siddiqui","year":"2016","journal-title":"Proc. VLDB Endow"},{"key":"2025120412013001200_ref130","first-page":"504","article-title":"Tamper detection in audit logs","volume-title":"VLDB","author":"Snodgrass","year":"2004"},{"key":"2025120412013001200_ref131","unstructured":"\u201cSpark Monitoring and Instrumentation\u201d. (2019). http:\/\/spark.apache.org\/docs\/latest\/monitoring.html."},{"issue":"1","key":"2025120412013001200_ref132","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1093\/bioinformatics\/btr597","article-title":"Missforest - Non-Parametric Missing Value Imputation for Mixed-Type Data","volume":"28","author":"Stekhoven","year":"2012","journal-title":"Bioinform"},{"key":"2025120412013001200_ref133","first-page":"697","volume-title":"Proceedings of the 16th International Conference on World Wide Web, WWW 2007, Banff, Alberta, Canada, May 8-12, 2007","author":"Suchanek","year":"2007"},{"key":"2025120412013001200_ref134","first-page":"1","volume-title":"EDBT 2010, 13th International Conference on Extending Database Technology, Lausanne, Switzerland, March 22-26, 2010, Proceedings","author":"Tannen","year":"2010"},{"issue":"12","key":"2025120412013001200_ref135","doi-asserted-by":"crossref","first-page":"1986","DOI":"10.14778\/2367502.2367554","article-title":"MapRat: meaningful explanation, interactive exploration and geo-visualization of collaborative ratings","volume":"5","author":"Thirumuruganathan","year":"2012","journal-title":"Proc. VLDB Endow"},{"key":"2025120412013001200_ref136","volume-title":"A Survey of Program Slicing Techniques","author":"Tip","year":"1994"},{"issue":"5","key":"2025120412013001200_ref137","doi-asserted-by":"publisher","first-page":"721","DOI":"10.1007\/s00778-013-0349-3","article-title":"Query Reverse Engineering","volume":"23","author":"Tran","year":"2014","journal-title":"VLDB J"},{"key":"2025120412013001200_ref138","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1145\/1807167.1807172","volume-title":"SIGMOD \u201810: Proceedings of the 2010 international conference on Management of data","author":"Tran","year":"2010"},{"key":"2025120412013001200_ref139","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1145\/3287560.3287566","article-title":"Actionable Recourse in Linear Classification","volume-title":"Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT* 2019, Atlanta, GA, USA, January 29-31, 2019","author":"Ustun","year":"2019"},{"key":"2025120412013001200_ref140","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1145\/3035918.3064029","volume-title":"Proceedings of the 2017 ACM International Conference on Management of Data","author":"Van Aken","year":"2017"},{"key":"2025120412013001200_ref141","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1145\/800070.802186","volume-title":"Proceedings of the Fourteenth Annual ACM Symposium on Theory of Computing. STOC \u201882","author":"Vardi","year":"1982"},{"key":"2025120412013001200_ref142","first-page":"425","volume-title":"Logic for Programming, Artificial Intelligence, and Reasoning - 16th International Conference, LPAR-16, Dakar, Senegal, April 25-May 1, 2010, Revised Selected Papers","author":"Veanes","year":"2010"},{"key":"2025120412013001200_ref143","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1145\/258525.258528","volume-title":"SIGIR \u201897: Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, July 27-31, 1997, Philadelphia, PA, USA","author":"V\u00e9lez","year":"1997"},{"key":"2025120412013001200_ref144","unstructured":"Verma, S., J. P.Dickerson, and K.Hines. (2020). \u201cCounterfactual Explanations for Machine Learning: A Review\u201d. CoRR. abs\/2010.10596. arXiv: 2010.10596. url: https:\/\/arxiv.org\/abs\/2010.10596."},{"key":"2025120412013001200_ref145","doi-asserted-by":"crossref","first-page":"1163","DOI":"10.1109\/ICDE.2011.5767846","article-title":"On query result diversification","volume-title":"2011 IEEE 27th International Conference on Data Engineering","author":"Vieira","year":"2011"},{"key":"2025120412013001200_ref146","doi-asserted-by":"crossref","unstructured":"Wachter, S., B. D.Mittelstadt, and C.Russell. (2017). \u201cCounterfactual Explanations Without Opening the Black Box: Automated Decisions and the GDPR\u201d. CoRR. abs\/1711.00399. arXiv: 1711.00399. url: http:\/\/arxiv.org\/abs\/1711.00399.","DOI":"10.2139\/ssrn.3063289"},{"issue":"31","key":"2025120412013001200_ref147","first-page":"1","article-title":"FLAME: A Fast Large-scale Almost Matching Exactly Approach to Causal Inference","volume":"22","author":"Wang","year":"2021","journal-title":"Journal of Machine Learning Research"},{"key":"2025120412013001200_ref148","doi-asserted-by":"publisher","first-page":"1231","DOI":"10.1145\/2723372.2750549","article-title":"Data X-Ray: A Diagnostic Tool for Data Errors","volume-title":"Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD) (SIGMOD)","author":"Wang","year":"2015"},{"issue":"12","key":"2025120412013001200_ref149","doi-asserted-by":"publisher","first-page":"1984","DOI":"10.14778\/2824032.2824117","article-title":"Error Diagnosis and Data Profiling with Data X-Ray","volume":"8","author":"Wang","year":"2015","journal-title":"PVLDB"},{"issue":"7","key":"2025120412013001200_ref150","first-page":"779","article-title":"Explain3D: Explaining Disagreements in Disjoint Datasets","volume":"12","author":"Wang","year":"2019","journal-title":"PVLDB"},{"key":"2025120412013001200_ref151","doi-asserted-by":"publisher","first-page":"1369","DOI":"10.1145\/3035918.3035925","article-title":"QFix: Diagnosing errors through query histories","volume-title":"Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD) (SIGMOD)","author":"Wang","year":"2017"},{"key":"2025120412013001200_ref152","first-page":"439","article-title":"Program slicing","volume-title":"Proceedings of the 5th international conference on Software engineering","author":"Weiser","year":"1981"},{"issue":"13","key":"2025120412013001200_ref153","doi-asserted-by":"crossref","first-page":"2196","DOI":"10.14778\/3275366.3284965","article-title":"Interactive Summarization and Exploration of Top Aggregate Query Answers","volume":"11","author":"Wen","year":"2018","journal-title":"Proc. VLDB Endow"},{"issue":"8","key":"2025120412013001200_ref154","doi-asserted-by":"crossref","first-page":"553","DOI":"10.14778\/2536354.2536356","article-title":"Scorpion: Explaining Away Outliers in Aggregate Queries","volume":"6","author":"Wu","year":"2013","journal-title":"Proc. VLDB Endow"},{"key":"2025120412013001200_ref155","doi-asserted-by":"publisher","first-page":"1317","DOI":"10.1145\/3318464. 3389696","volume-title":"Proceedings of the 2020 International Conference on Management of Data, SIGMOD Conference 2020, online conference [Portland, OR, USA], June 1419, 2020","author":"Wu","year":"2020"},{"issue":"2","key":"2025120412013001200_ref156","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1050849.1050865","article-title":"A brief survey of program slicing","volume":"30","author":"Xu","year":"2005","journal-title":"ACM SIGSOFT Software Engineering Notes"},{"issue":"12","key":"2025120412013001200_ref157","doi-asserted-by":"crossref","first-page":"1578","DOI":"10.14778\/2824032.2824055","article-title":"Lenses: an on-demand approach to ETL","volume":"8","author":"Yang","year":"2015","journal-title":"Proceedings of the VLDB Endowment"},{"key":"2025120412013001200_ref158","doi-asserted-by":"publisher","first-page":"1769","DOI":"10.1145\/3183713.3193564","volume-title":"Proceedings of the 2018 International Conference on Management of Data, SIGMOD Conference 2018, Houston, TX, USA, June 10-15, 2018","author":"Yilmaz","year":"2018"},{"key":"2025120412013001200_ref159","first-page":"9240","article-title":"GNNExplainer: Generating Explanations for Graph Neural Networks","volume-title":"Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada","author":"Ying","year":"2019"},{"key":"2025120412013001200_ref160","doi-asserted-by":"publisher","first-page":"1599","DOI":"10.1145\/2882903.2915218","volume-title":"Proceedings of the 2016 International Conference on Management of Data. SIGMOD \u201816","author":"Yoon","year":"2016"},{"key":"2025120412013001200_ref161","doi-asserted-by":"publisher","first-page":"156","DOI":"10.5441\/002\/edbt.2017.15","article-title":"EXStream: Explaining Anomalies in Event Stream Monitoring","volume-title":"20th International Conference on Extending Database Technology (EDBT) (EDBT)","author":"Zhang","year":"2017"},{"issue":"1","key":"2025120412013001200_ref162","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/1500000066","article-title":"Explainable Recommendation: A Survey and New Perspectives","volume":"14","author":"Zhang","year":"2020","journal-title":"Found. Trends Inf. Retr"}],"container-title":["Foundations and Trends in Databases"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/ftdbs\/article-pdf\/11\/3\/226\/10901423\/1900000074en.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/www.emerald.com\/ftdbs\/article-pdf\/11\/3\/226\/10901423\/1900000074en.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T14:11:43Z","timestamp":1777471903000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.emerald.com\/ftdbs\/article\/11\/3\/226\/1320828\/Trends-in-Explanations-Understanding-and-Debugging"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,2]]},"references-count":162,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,8,2]]}},"URL":"https:\/\/doi.org\/10.1561\/1900000074","relation":{},"ISSN":["1931-7883","1931-7891"],"issn-type":[{"value":"1931-7883","type":"print"},{"value":"1931-7891","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,2]]}}}