{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,12,11]],"date-time":"2023-12-11T03:40:38Z","timestamp":1702266038369},"reference-count":34,"publisher":"Oxford University Press (OUP)","issue":"8","license":[{"start":{"date-parts":[[2023,6,8]],"date-time":"2023-06-08T00:00:00Z","timestamp":1686182400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,12,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>We propose a novel method to inject symbolic knowledge in form of Datalog formul\u00e6 into neural networks (NN), called Knowledge Injection via Network Structuring (KINS). The idea behind our method is to extend NN internal structure with ad-hoc layers built out of the injected symbolic knowledge. KINS does not constrain NN to any specific architecture, neither requires logic formul\u00e6 to be ground. Moreover, it is robust w.r.t. both lack of data and imperfect\/incomplete knowledge. Experiments are reported, involving multiple datasets and predictor types, to demonstrate how KINS can significantly improve the predictive performance of the neural networks it is applied to.<\/jats:p>","DOI":"10.1093\/logcom\/exad037","type":"journal-article","created":{"date-parts":[[2023,6,8]],"date-time":"2023-06-08T12:10:24Z","timestamp":1686226224000},"page":"1832-1850","source":"Crossref","is-referenced-by-count":0,"title":["Knowledge injection of Datalog rules via Neural Network Structuring with KINS"],"prefix":"10.1093","volume":"33","author":[{"given":"Matteo","family":"Magnini","sequence":"first","affiliation":[{"name":"Dipartimento di Informatica, Scienza e Ingegneria (DISI) , Alma Mater Studiorum \u2014Universit\u00e0 di Bologna, Cesena, Emilia Romagna, 47521, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giovanni","family":"Ciatto","sequence":"additional","affiliation":[{"name":"Dipartimento di Informatica, Scienza e Ingegneria (DISI) , Alma Mater Studiorum \u2014Universit\u00e0 di Bologna, Cesena, Emilia Romagna, 47521, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrea","family":"Omicini","sequence":"additional","affiliation":[{"name":"Dipartimento di Informatica, Scienza e Ingegneria (DISI) , Alma Mater Studiorum \u2014Universit\u00e0 di Bologna, Cesena, Emilia Romagna, 47521, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2023,6,8]]},"reference":[{"key":"2023121103254893700_ref1","doi-asserted-by":"crossref","first-page":"562","DOI":"10.1016\/S0022-0000(05)80071-6","article-title":"Datalog vs first-order logic","volume":"49","author":"Ajtai","year":"1994","journal-title":"Journal of Computer and System Sciences"},{"key":"2023121103254893700_ref2","first-page":"314","article-title":"Computing first-order logic programs by fibring artificial neural networks","volume-title":"Proceedings of the 18th International Florida Artificial Intelligence Research Society Conference (FlAIRS), Clearwater Beach, Florida, USA, May 15\u201317, 2005","author":"Bader","year":"2005"},{"key":"2023121103254893700_ref3","first-page":"19","article-title":"Guiding backprop by inserting rules","volume-title":"Proceedings of the 4th International Workshop on Neural-Symbolic Learning and Reasoning (NeSy), Patras, Greece, July 21, 2008","author":"Bader","year":"2008"},{"key":"2023121103254893700_ref4","first-page":"203","article-title":"Parallel logical inference and energy minimization","volume-title":"Proceedings of the 5th National Conference on Artificial Intelligence. Philadelphia, PA, USA, August 11\u201315, 1986. Volume 1: Science","author":"Ballard","year":"1986"},{"key":"2023121103254893700_ref5","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1080\/10556789208805504","article-title":"Robust linear programming discrimination of two linearly inseparable sets","volume":"1","author":"Bennett","year":"1992","journal-title":"Optimization Methods and Software"},{"key":"2023121103254893700_ref6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3233\/FAIA210348","article-title":"Neural-symbolic learning and reasoning: a survey and interpretation","volume-title":"Neuro-Symbolic Artificial Intelligence: The State of the Art","author":"Besold","year":"2021"},{"key":"2023121103254893700_ref7","volume-title":"Classification and Regression Trees","author":"Breiman","year":"1984"},{"key":"2023121103254893700_ref8","doi-asserted-by":"crossref","first-page":"7","DOI":"10.3233\/IA-190036","article-title":"On the integration of symbolic and sub-symbolic techniques for XAI: a survey","volume":"14","author":"Calegari","year":"2020","journal-title":"Intelligenza Artificiale"},{"key":"2023121103254893700_ref9","first-page":"507","article-title":"Deep computational phenotyping","volume-title":"Proceedings of the 21th International Conference on Knowledge Discovery and Data Mining (KDD), Sydney, NSW, Australia, August 10\u201313, 2015","author":"Che","year":"2015"},{"key":"2023121103254893700_ref10","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/TIT.1967.1053964","article-title":"Nearest neighbor pattern classification","volume":"13","author":"Cover","year":"1967","journal-title":"IEEE Transactions on Information Theory"},{"key":"2023121103254893700_ref11","first-page":"342","article-title":"Fibring neural networks","volume-title":"Proceedings of the Nineteenth National Conference on Artificial Intelligence, Sixteenth Conference on Innovative Applications of Artificial Intelligence, July 25\u201329, 2004, San Jose, California, USA","author":"d\u2019Avila Garcez","year":"2004"},{"key":"2023121103254893700_ref12","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1023\/A:1008328630915","article-title":"The connectionist inductive learning and logic programming system","volume":"11","author":"d\u2019Avila Garcez","year":"1999","journal-title":"Applied Intelligence"},{"key":"2023121103254893700_ref13","doi-asserted-by":"crossref","first-page":"1389","DOI":"10.18653\/v1\/D16-1146","article-title":"Lifted rule injection for relation embeddings","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), Austin, Texas, USA, November 1\u20134, 2016","author":"Demeester","year":"2016"},{"key":"2023121103254893700_ref14","first-page":"920","article-title":"Integrating prior knowledge into deep learning","volume-title":"Proceedings of the 16th IEEE International Conference on Machine Learning and Applications (ICMLA), Cancun, Mexico, December 18\u201321, 2017","author":"Diligenti","year":"2017"},{"key":"2023121103254893700_ref15","volume-title":"UCI Machine Learning Repository","author":"Dua","year":"2017"},{"key":"2023121103254893700_ref16","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/s10994-013-5392-1","article-title":"Fast relational learning using bottom clause propositionalization with artificial neural networks","volume":"94","author":"Fran\u00e7a","year":"2014","journal-title":"Machine Learning"},{"key":"2023121103254893700_ref17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/ACES.2014.6808002","article-title":"A comparative study of breast cancer detection based on SVM and MLP BPN classifier","volume-title":"In 2014 First International Conference on Automation, Control, Energy and Systems (ACES)","author":"Ghosh","year":"2014"},{"key":"2023121103254893700_ref18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3236009","article-title":"A survey of methods for explaining black box models","volume":"51","author":"Guidotti","year":"2019","journal-title":"ACM Computing Surveys"},{"key":"2023121103254893700_ref19","doi-asserted-by":"crossref","first-page":"77","DOI":"10.2307\/2271339","article-title":"Axiomatization of the infinite-valued predicate calculus","volume":"28","author":"Hay","year":"1963","journal-title":"The Journal of Symbolic Logic"},{"key":"2023121103254893700_ref20","first-page":"2410","article-title":"Harnessing deep neural networks with logic rules","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL), Berlin, Germany, August 7\u201312, 2016","author":"Hu","year":"2016"},{"key":"2023121103254893700_ref21","article-title":"A method for stochastic optimization","volume-title":"3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7\u20139, 2015","author":"Kingma","year":"2015"},{"key":"2023121103254893700_ref22","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1145\/3233231","article-title":"The mythos of model interpretability","volume":"61","author":"Lipton","year":"2018","journal-title":"Communications of the ACM"},{"key":"2023121103254893700_ref23","first-page":"254","article-title":"KINS: knowledge injection via network structuring","volume-title":"CILC 2022\u2014Italian Conference on Computational Logic","author":"Magnini","year":"2022"},{"key":"2023121103254893700_ref24","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1007\/978-3-031-15565-9_6","article-title":"On the design of PSyKI: a platform for symbolic knowledge injection into sub-symbolic predictors","volume-title":"Explainable and Transparent AI and Multi-Agent Systems","author":"Magnini","year":"2022"},{"key":"2023121103254893700_ref25","article-title":"Cancer diagnosis via linear programming","volume-title":"Computer Sciences Technical Report 958","author":"Mangasarian","year":"1990"},{"key":"2023121103254893700_ref26","doi-asserted-by":"crossref","first-page":"103504","DOI":"10.1016\/j.artint.2021.103504","article-title":"Neural probabilistic logic programming in DeepProbLog","volume":"298","author":"Manhaeve","year":"2021","journal-title":"Artificial Intelligence"},{"key":"2023121103254893700_ref27","first-page":"2825","article-title":"Scikit-learn: machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"2023121103254893700_ref28","first-page":"36","article-title":"Breast cancer diagnosis on three different datasets using multi-classifiers","volume":"1","author":"Salama","year":"2012","journal-title":"International Journal of Computer and Information Technology (IJCIT)"},{"key":"2023121103254893700_ref29","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/0004-3702(94)90105-8","article-title":"Knowledge-based artificial neural networks","volume":"70","author":"Towell","year":"1994","journal-title":"Artificial Intelligence"},{"key":"2023121103254893700_ref30","first-page":"871","article-title":"Network structuring and training using rule-based knowledge","volume-title":"Advances in Neural Information Processing Systems 5, NIPS 1992, Denver, Colorado, USA, November 30\u2013December 3, 1992","author":"Tresp","year":"1992"},{"key":"2023121103254893700_ref31","article-title":"Pattern recognition via linear programming: Theory and application to medical diagnosis","volume-title":"Computer Sciences Technical Report 878","author":"Wolberg","year":"1989"},{"key":"2023121103254893700_ref32","doi-asserted-by":"crossref","first-page":"9193","DOI":"10.1073\/pnas.87.23.9193","article-title":"Multisurface method of pattern separation for medical diagnosis applied to breast cytology","volume":"87","author":"Wolberg","year":"1990","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"2023121103254893700_ref33","first-page":"4235","article-title":"Embedding symbolic knowledge into deep networks","volume-title":"Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8\u201314, 2019, Vancouver, BC, Canada","author":"Xie","year":"2019"},{"key":"2023121103254893700_ref34","first-page":"5498","article-title":"A semantic loss function for deep learning with symbolic knowledge","volume-title":"Proceedings of the 35th International Conference on Machine Learning (ICML), Stockholmsm\u00e4ssan, Stockholm, Sweden, July 10\u201315, 2018","author":"Xu","year":"2018"}],"container-title":["Journal of Logic and Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/logcom\/article-pdf\/33\/8\/1832\/54151372\/exad037.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/logcom\/article-pdf\/33\/8\/1832\/54151372\/exad037.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,11]],"date-time":"2023-12-11T03:26:16Z","timestamp":1702265176000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/logcom\/article\/33\/8\/1832\/7190990"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,8]]},"references-count":34,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,6,8]]},"published-print":{"date-parts":[[2023,12,11]]}},"URL":"https:\/\/doi.org\/10.1093\/logcom\/exad037","relation":{},"ISSN":["0955-792X","1465-363X"],"issn-type":[{"value":"0955-792X","type":"print"},{"value":"1465-363X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,12]]},"published":{"date-parts":[[2023,6,8]]}}}