{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T16:15:09Z","timestamp":1778084109711,"version":"3.51.4"},"reference-count":77,"publisher":"SAGE Publications","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["AIC"],"published-print":{"date-parts":[[2022,3,4]]},"abstract":"<jats:p>Neuro-Symbolic Artificial Intelligence \u2013 the combination of symbolic methods with methods that are based on artificial neural networks \u2013 has a long-standing history. In this article, we provide a structured overview of current trends, by means of categorizing recent publications from key conferences. The article is meant to serve as a convenient starting point for research on the general topic.<\/jats:p>","DOI":"10.3233\/aic-210084","type":"journal-article","created":{"date-parts":[[2021,9,17]],"date-time":"2021-09-17T11:48:54Z","timestamp":1631879334000},"page":"197-209","source":"Crossref","is-referenced-by-count":129,"title":["Neuro-symbolic artificial intelligence"],"prefix":"10.1177","volume":"34","author":[{"given":"Md Kamruzzaman","family":"Sarker","sequence":"first","affiliation":[{"name":"Department of Computing Sciences, University of Hartford, CT, USA"}]},{"given":"Lu","family":"Zhou","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Kansas State University, KS, USA"}]},{"given":"Aaron","family":"Eberhart","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Kansas State University, KS, USA"}]},{"given":"Pascal","family":"Hitzler","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Kansas State University, KS, USA"}]}],"member":"179","reference":[{"key":"10.3233\/AIC-210084_ref1","unstructured":"A.M.\u00a0Alaa and M.\u00a0van der Schaar, Demystifying black-box models with symbolic metamodels, in: Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems, 2019, NeurIPS 2019, Vancouver, BC, Canada, December 8\u201314, 2019, H.M.\u00a0Wallach, H.\u00a0Larochelle, A.\u00a0Beygelzimer, F.\u00a0d\u2019Alch\u00e9-Buc, E.B.\u00a0Fox and R.\u00a0Garnett, eds, 2019, pp.\u00a011301\u201311311, https:\/\/proceedings.neurips.cc\/paper\/2019\/hash\/567b8f5f423af15818a068235807edc0-Abstract.html."},{"key":"10.3233\/AIC-210084_ref2","unstructured":"M.\u00a0Allamanis, P.\u00a0Chanthirasegaran, P.\u00a0Kohli and C.\u00a0Sutton, Learning continuous semantic representations of symbolic expressions, in: Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6\u201311 August 2017, D.\u00a0Precup and Y.W.\u00a0Teh, eds, Proceedings of Machine Learning Research, Vol.\u00a070, PMLR, 2017, pp.\u00a080\u201388, http:\/\/proceedings.mlr.press\/v70\/allamanis17a.html."},{"key":"10.3233\/AIC-210084_ref3","unstructured":"S.\u00a0Amizadeh, H.\u00a0Palangi, A.\u00a0Polozov, Y.\u00a0Huang and K.\u00a0Koishida, Neuro-symbolic visual reasoning: Disentangling \u201cvisual\u201d from \u201creasoning\u201d, in: Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13\u201318 July 2020, Proceedings of Machine Learning Research, Vol.\u00a0119, PMLR, 2020, pp.\u00a0279\u2013290, Virtual Event, http:\/\/proceedings.mlr.press\/v119\/amizadeh20a.html."},{"key":"10.3233\/AIC-210084_ref4","unstructured":"F.\u00a0Arabshahi, S.\u00a0Singh and A.\u00a0Anandkumar, Combining symbolic expressions and black-box function evaluations in neural programs, in: 6th International Conference on Learning Representations, ICLR 2018, Conference Track Proceedings, Vancouver, BC, Canada, April 30\u2013May 3, 2018, OpenReview.net, 2018, https:\/\/openreview.net\/forum?id=Hksj2WWAW."},{"key":"10.3233\/AIC-210084_ref5","unstructured":"M.\u00a0Asai and A.\u00a0Fukunaga, Classical planning in deep latent space: Bridging the subsymbolic-symbolic boundary, in: Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18), the 30th Innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2\u20137, 2018, S.A.\u00a0McIlraith and K.Q.\u00a0Weinberger, eds, AAAI Press, 2018, pp.\u00a06094\u20136101, https:\/\/www.aaai.org\/ocs\/index.php\/AAAI\/AAAI18\/paper\/view\/16302."},{"key":"10.3233\/AIC-210084_ref6","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2020\/371"},{"key":"10.3233\/AIC-210084_ref7","unstructured":"S.\u00a0Bader and P.\u00a0Hitzler, Dimensions of neural\u2013symbolic integration \u2013 a structured survey, in: We Will Show Them! Essays in Honour of Dov Gabbay, Volume One, S.N.\u00a0Art\u00ebmov, H.\u00a0Barringer, A.S.\u00a0d\u2019Avila Garcez, L.C.\u00a0Lamb and J.\u00a0Woods, eds, College Publications, 2005, pp.\u00a0167\u2013194."},{"key":"10.3233\/AIC-210084_ref9","unstructured":"F.\u00a0Bianchi and P.\u00a0Hitzler, On the capabilities of logic tensor networks for deductive reasoning, in: Proceedings of the AAAI 2019 Spring Symposium on Combining Machine Learning with Knowledge Engineering (AAAI-MAKE 2019), Stanford University, Palo Alto, California, USA, March 25\u201327, 2019, A.\u00a0Martin, K.\u00a0Hinkelmann, A.\u00a0Gerber, D.\u00a0Lenat, F.\u00a0van Harmelen and P.\u00a0Clark, eds, CEUR Workshop Proceedings, Vol.\u00a02350, CEUR-WS.org, 2019, http:\/\/ceur-ws.org\/Vol-2350\/paper22.pdf."},{"key":"10.3233\/AIC-210084_ref10","unstructured":"S.\u00a0Cao, W.\u00a0Lu and Q.\u00a0Xu, Deep neural networks for learning graph representations, in: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, Phoenix, Arizona, USA, February 12\u201317, 2016, D.\u00a0Schuurmans and M.P.\u00a0Wellman, eds, AAAI Press, 2016, pp.\u00a01145\u20131152, http:\/\/www.aaai.org\/ocs\/index.php\/AAAI\/AAAI16\/paper\/view\/12423."},{"key":"10.3233\/AIC-210084_ref11","unstructured":"F.\u00a0Charton, A.\u00a0Hayat and G.\u00a0Lample, Learning advanced mathematical computations from examples, in: 9th International Conference on Learning Representations, ICLR 2021, Austria, May 3\u20137, 2021, OpenReview.net, 2021, Virtual Event, https:\/\/openreview.net\/forum?id=-gfhS00XfKj."},{"key":"10.3233\/AIC-210084_ref12","unstructured":"D.\u00a0Chen, Y.\u00a0Bai, W.\u00a0Zhao, S.\u00a0Ament, J.M.\u00a0Gregoire and C.P.\u00a0Gomes, Deep reasoning networks for unsupervised pattern de-mixing with constraint reasoning, in: Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13\u201318 July 2020, Proceedings of Machine Learning Research, Vol.\u00a0119, PMLR, 2020, pp.\u00a01500\u20131509, Virtual Event, http:\/\/proceedings.mlr.press\/v119\/chen20a.html."},{"key":"10.3233\/AIC-210084_ref13","unstructured":"X.\u00a0Chen, C.\u00a0Liang, A.W.\u00a0Yu, D.\u00a0Song and D.\u00a0Zhou, Compositional generalization via neural\u2013symbolic stack machines, in: Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6\u201312, 2020, H.\u00a0Larochelle, M.\u00a0Ranzato, R.\u00a0Hadsell, M.\u00a0Balcan and H.\u00a0Lin, eds, 2020, virtual, https:\/\/proceedings.neurips.cc\/paper\/2020\/hash\/12b1e42dc0746f22cf361267de07073f-Abstract.html."},{"key":"10.3233\/AIC-210084_ref14","unstructured":"X.\u00a0Chen, C.\u00a0Liang, A.W.\u00a0Yu, D.\u00a0Zhou, D.\u00a0Song and Q.V.\u00a0Le, Neural symbolic reader: Scalable integration of distributed and symbolic representations for reading comprehension, in: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26\u201330, 2020, OpenReview.net, 2020, https:\/\/openreview.net\/forum?id=ryxjnREFwH."},{"key":"10.3233\/AIC-210084_ref15","unstructured":"X.\u00a0Chen and Y.\u00a0Tian, Learning to perform local rewriting for combinatorial optimization, in: Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems, 2019, NeurIPS 2019, Vancouver, BC, Canada, December 8\u201314, 2019, H.M.\u00a0Wallach, H.\u00a0Larochelle, A.\u00a0Beygelzimer, F.\u00a0d\u2019Alch\u00e9-Buc, E.B.\u00a0Fox and R.\u00a0Garnett, eds, 2019, pp.\u00a06278\u20136289, https:\/\/proceedings.neurips.cc\/paper\/2019\/hash\/131f383b434fdf48079bff1e44e2d9a5-Abstract.html."},{"key":"10.3233\/AIC-210084_ref17","unstructured":"W.W.\u00a0Cohen, H.\u00a0Sun, R.A.\u00a0Hofer and M.\u00a0Siegler, Scalable neural methods for reasoning with a symbolic knowledge base, in: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26\u201330, 2020, OpenReview.net, 2020, https:\/\/openreview.net\/forum?id=BJlguT4YPr."},{"key":"10.3233\/AIC-210084_ref18","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2020\/231"},{"key":"10.3233\/AIC-210084_ref19","unstructured":"M.D.\u00a0Cranmer, A.\u00a0Sanchez-Gonzalez, P.W.\u00a0Battaglia, R.\u00a0Xu, K.\u00a0Cranmer, D.N.\u00a0Spergel and S.\u00a0Ho, Discovering symbolic models from deep learning with inductive biases, in: Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems, 2020, NeurIPS 2020, December 6\u201312, 2020, H.\u00a0Larochelle, M.\u00a0Ranzato, R.\u00a0Hadsell, M.\u00a0Balcan and H.\u00a0Lin, eds, 2020, virtual, https:\/\/proceedings.neurips.cc\/paper\/2020\/hash\/c9f2f917078bd2db12f23c3b413d9cba-Abstract.html."},{"key":"10.3233\/AIC-210084_ref20","unstructured":"R.\u00a0Dang-Nhu, PLANS: Neuro-symbolic program learning from videos, in: Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6\u201312, 2020, H.\u00a0Larochelle, M.\u00a0Ranzato, R.\u00a0Hadsell, M.\u00a0Balcan and H.\u00a0Lin, eds, 2020, virtual, https:\/\/proceedings.neurips.cc\/paper\/2020\/hash\/fe131d7f5a6b38b23cc967316c13dae2-Abstract.html."},{"key":"10.3233\/AIC-210084_ref21","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-73246-4"},{"key":"10.3233\/AIC-210084_ref22","doi-asserted-by":"publisher","DOI":"10.5591\/978-1-57735-516-8\/IJCAI11-278"},{"key":"10.3233\/AIC-210084_ref23","doi-asserted-by":"crossref","unstructured":"D.\u00a0Demeter and D.\u00a0Downey, Just add functions: A neural\u2013symbolic language model, in: The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7\u201312, 2020, AAAI Press, 2020, pp.\u00a07634\u20137642, https:\/\/aaai.org\/ojs\/index.php\/AAAI\/article\/view\/6264.","DOI":"10.1609\/aaai.v34i05.6264"},{"key":"10.3233\/AIC-210084_ref24","doi-asserted-by":"publisher","DOI":"10.1145\/3308560.3317701"},{"key":"10.3233\/AIC-210084_ref25","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00526"},{"key":"10.3233\/AIC-210084_ref26","unstructured":"B.\u00a0Dhingra, M.\u00a0Zaheer, V.\u00a0Balachandran, G.\u00a0Neubig, R.\u00a0Salakhutdinov and W.W.\u00a0Cohen, Differentiable reasoning over a virtual knowledge base, in: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26\u201330, 2020, OpenReview.net, 2020, https:\/\/openreview.net\/forum?id=SJxstlHFPH."},{"key":"10.3233\/AIC-210084_ref27","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2017\/221"},{"key":"10.3233\/AIC-210084_ref28","unstructured":"A.\u00a0Eberhart, M.\u00a0Ebrahimi, L.\u00a0Zhou, C.\u00a0Shimizu and P.\u00a0Hitzler, Completion reasoning emulation for the description logic EL+, in: Proceedings of the AAAI 2020 Spring Symposium on Combining Machine Learning and Knowledge Engineering in Practice, AAAI-MAKE 2020, Volume I, Palo Alto, CA, USA, March 23\u201325, 2020, A.\u00a0Martin, K.\u00a0Hinkelmann, H.\u00a0Fill, A.\u00a0Gerber, D.\u00a0Lenat, R.\u00a0Stolle and F.\u00a0van Harmelen, eds, CEUR Workshop Proceedings, Vol.\u00a02600, CEUR-WS.org, 2020, http:\/\/ceur-ws.org\/Vol-2600\/paper5.pdf."},{"issue":"9","key":"10.3233\/AIC-210084_ref29","doi-asserted-by":"publisher","first-page":"6326","DOI":"10.1007\/s10489-020-02165-6","article-title":"Towards bridging the neuro-symbolic gap: Deep deductive reasoners","volume":"51","author":"Ebrahimi","year":"2021","journal-title":"Applied Intelligence"},{"key":"10.3233\/AIC-210084_ref31","unstructured":"M.\u00a0Ebrahimi, M.K.\u00a0Sarker, F.\u00a0Bianchi, N.\u00a0Xie, A.\u00a0Eberhart, D.\u00a0Doran, H.\u00a0Kim and P.\u00a0Hitzler, Neuro-symbolic deductive reasoning for cross-knowledge graph entailment, in: Proceedings of the AAAI 2021 Spring Symposium on Combining Machine Learning and Knowledge Engineering (AAAI-MAKE 2021), Stanford University, Palo Alto, California, USA, March 22\u201324, 2021, A.\u00a0Martin, K.\u00a0Hinkelmann, H.\u00a0Fill, A.\u00a0Gerber, D.\u00a0Lenat, R.\u00a0Stolle and F.\u00a0van Harmelen, eds, CEUR Workshop Proceedings, Vol.\u00a02846, CEUR-WS.org, 2021, http:\/\/ceur-ws.org\/Vol-2846\/paper8.pdf."},{"key":"10.3233\/AIC-210084_ref32","unstructured":"M.\u00a0Fischer, M.\u00a0Balunovic, D.\u00a0Drachsler-Cohen, T.\u00a0Gehr, C.\u00a0Zhang and M.T.\u00a0Vechev, DL2: Training and querying neural networks with logic, in: Proceedings of the 36th International Conference on Machine Learning, ICML 2019, Long Beach, California, USA, 9\u201315 June 2019, K.\u00a0Chaudhuri and R.\u00a0Salakhutdinov, eds, Proceedings of Machine Learning Research, Vol.\u00a097, PMLR, 2019, pp.\u00a01931\u20131941, http:\/\/proceedings.mlr.press\/v97\/fischer19a.html."},{"key":"10.3233\/AIC-210084_ref33","unstructured":"S.\u00a0Garg, A.\u00a0Bajpai and Mausam, Symbolic network: Generalized neural policies for relational MDPs, in: Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13\u201318 July 2020, Proceedings of Machine Learning Research, Vol.\u00a0119, PMLR, 2020, pp.\u00a03397\u20133407, Virtual Event, http:\/\/proceedings.mlr.press\/v119\/garg20a.html."},{"key":"10.3233\/AIC-210084_ref34","unstructured":"B.\u00a0Hammer and P.\u00a0Hitzler\u00a0(eds), Perspectives of Neural-Symbolic Integration, Studies in Computational Intelligence, Vol.\u00a077, Springer, 2007. ISBN 978-3-540-73953-1."},{"issue":"2","key":"10.3233\/AIC-210084_ref35","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1145\/3397512","article-title":"A review of the semantic web field","volume":"64","author":"Hitzler","year":"2021","journal-title":"Commun. ACM"},{"issue":"1","key":"10.3233\/AIC-210084_ref36","doi-asserted-by":"publisher","first-page":"3","DOI":"10.3233\/SW-190368","article-title":"Neural-symbolic integration and the semantic web","volume":"11","author":"Hitzler","year":"2020","journal-title":"Semantic Web"},{"issue":"3","key":"10.3233\/AIC-210084_ref37","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.jal.2004.03.002","article-title":"Logic programs and connectionist networks","volume":"2","author":"Hitzler","year":"2004","journal-title":"J. Appl. Log."},{"key":"10.3233\/AIC-210084_ref38","doi-asserted-by":"crossref","unstructured":"P.\u00a0Hitzler, M.\u00a0Kr\u00f6tzsch and S.\u00a0Rudolph, Foundations of Semantic Web Technologies, Chapman and Hall\/CRC Press, 2010, http:\/\/www.semantic-web-book.org\/. ISBN 9781420090505.","DOI":"10.1201\/9781420090512"},{"key":"10.3233\/AIC-210084_ref39","doi-asserted-by":"publisher","first-page":"503","DOI":"10.1613\/jair.1.11661","article-title":"Ontology reasoning with deep neural networks","volume":"68","author":"Hohenecker","year":"2020","journal-title":"J. Artif. Intell. Res."},{"key":"10.3233\/AIC-210084_ref40","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.93"},{"key":"10.3233\/AIC-210084_ref41","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/p16-1228"},{"key":"10.3233\/AIC-210084_ref42","unstructured":"J.\u00a0Jiang and S.\u00a0Ahn, Generative neurosymbolic machines, in: Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6\u201312, 2020, H.\u00a0Larochelle, M.\u00a0Ranzato, R.\u00a0Hadsell, M.\u00a0Balcan and H.\u00a0Lin, eds, 2020, virtual, https:\/\/proceedings.neurips.cc\/paper\/2020\/hash\/94c28dcfc97557df0df6d1f7222fc384-Abstract.html."},{"key":"10.3233\/AIC-210084_ref43","unstructured":"Z.\u00a0Jiang and S.\u00a0Luo, Neural logic reinforcement learning, in: Proceedings of the 36th International Conference on Machine Learning, ICML 2019, Long Beach, California, USA, 9\u201315 June 2019, K.\u00a0Chaudhuri and R.\u00a0Salakhutdinov, eds, Proceedings of Machine Learning Research, Vol.\u00a097, PMLR, 2019, pp.\u00a03110\u20133119, http:\/\/proceedings.mlr.press\/v97\/jiang19a.html."},{"key":"10.3233\/AIC-210084_ref44","unstructured":"G.\u00a0Lample and F.\u00a0Charton, Deep learning for symbolic mathematics, in: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26\u201330, 2020, OpenReview.net, 2020, https:\/\/openreview.net\/forum?id=S1eZYeHFDS."},{"key":"10.3233\/AIC-210084_ref45","unstructured":"Q.\u00a0Li, S.\u00a0Huang, Y.\u00a0Hong, Y.\u00a0Chen, Y.N.\u00a0Wu and S.\u00a0Zhu, Closed loop neural\u2013symbolic learning via integrating neural perception, grammar parsing, and symbolic reasoning, in: Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13\u201318 July 2020, Proceedings of Machine Learning Research, Vol.\u00a0119, PMLR, 2020, pp.\u00a05884\u20135894, Virtual Event, http:\/\/proceedings.mlr.press\/v119\/li20f.html."},{"key":"10.3233\/AIC-210084_ref46","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1003"},{"key":"10.3233\/AIC-210084_ref47","unstructured":"X.\u00a0Liang, Z.\u00a0Hu, H.\u00a0Zhang, L.\u00a0Lin and E.P.\u00a0Xing, Symbolic graph reasoning meets convolutions, in: Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems, 2018, NeurIPS 2018, Montr\u00e9al, Canada, December 3\u20138, 2018, S.\u00a0Bengio, H.M.\u00a0Wallach, H.\u00a0Larochelle, K.\u00a0Grauman, N.\u00a0Cesa-Bianchi and R.\u00a0Garnett, eds, 2018, pp.\u00a01858\u20131868, https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/cbb6a3b884f4f88b3a8e3d44c636cbd8-Abstract.html."},{"key":"10.3233\/AIC-210084_ref48","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33012970"},{"issue":"5","key":"10.3233\/AIC-210084_ref49","doi-asserted-by":"publisher","first-page":"823","DOI":"10.3233\/SW-190363","article-title":"Deep learning for noise-tolerant RDFS reasoning","volume":"10","author":"Makni","year":"2019","journal-title":"Semantic Web"},{"key":"10.3233\/AIC-210084_ref50","unstructured":"R.\u00a0Manhaeve, S.\u00a0Dumancic, A.\u00a0Kimmig, T.\u00a0Demeester and L.D.\u00a0Raedt, DeepProbLog: Neural probabilistic logic programming, in: Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems, 2018, NeurIPS 2018, Montr\u00e9al, Canada, December 3\u20138, 2018, S.\u00a0Bengio, H.M.\u00a0Wallach, H.\u00a0Larochelle, K.\u00a0Grauman, N.\u00a0Cesa-Bianchi and R.\u00a0Garnett, eds, 2018, pp.\u00a03753\u20133763, https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/dc5d637ed5e62c36ecb73b654b05ba2a-Abstract.html."},{"key":"10.3233\/AIC-210084_ref51","unstructured":"J.\u00a0Mao, C.\u00a0Gan, P.\u00a0Kohli, J.B.\u00a0Tenenbaum and J.\u00a0Wu, The neuro-symbolic concept learner: Interpreting scenes, words, and sentences from natural supervision, in: 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6\u20139, 2019, OpenReview.net, 2019, https:\/\/openreview.net\/forum?id=rJgMlhRctm."},{"key":"10.3233\/AIC-210084_ref52","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1017\/S0140525X0005264X","article-title":"Epistomological challenges for connectionism","volume":"11","author":"McCarthy","year":"1988","journal-title":"Behavioral and Brain Sciences"},{"key":"10.3233\/AIC-210084_ref53","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1007\/BF02478259","article-title":"A logical calculus of the ideas immanent in nervous activity","volume":"5","author":"McCulloch","year":"1943","journal-title":"Bulletin of Mathematical Biophysics"},{"key":"10.3233\/AIC-210084_ref54","unstructured":"P.\u00a0Minervini, S.\u00a0Riedel, P.\u00a0Stenetorp, E.\u00a0Grefenstette and T.\u00a0Rockt\u00e4schel, Learning reasoning strategies in end-to-end differentiable proving, in: Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13\u201318 July 2020, Proceedings of Machine Learning Research, Vol.\u00a0119, PMLR, 2020, pp.\u00a06938\u20136949, Virtual Event, http:\/\/proceedings.mlr.press\/v119\/minervini20a.html."},{"key":"10.3233\/AIC-210084_ref55","unstructured":"L.\u00a0Mou, Z.\u00a0Lu, H.\u00a0Li and Z.\u00a0Jin, Coupling distributed and symbolic execution for natural language queries, in: Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6\u201311 August 2017, D.\u00a0Precup and Y.W.\u00a0Teh, eds, Proceedings of Machine Learning Research, Vol.\u00a070, PMLR, 2017, pp.\u00a02518\u20132526, http:\/\/proceedings.mlr.press\/v70\/mou17a.html."},{"key":"10.3233\/AIC-210084_ref56","unstructured":"M.\u00a0Niepert, M.\u00a0Ahmed and K.\u00a0Kutzkov, Learning convolutional neural networks for graphs, in: Proceedings of the 33nd International Conference on Machine Learning, ICML 2016, New York City, NY, USA, June 19\u201324, 2016, M.\u00a0Balcan and K.Q.\u00a0Weinberger, eds, JMLR Workshop and Conference Proceedings, Vol.\u00a048, JMLR.org, 2016, pp.\u00a02014\u20132023, http:\/\/proceedings.mlr.press\/v48\/niepert16.html."},{"key":"10.3233\/AIC-210084_ref57","unstructured":"E.\u00a0Parisotto, A.\u00a0Mohamed, R.\u00a0Singh, L.\u00a0Li, D.\u00a0Zhou and P.\u00a0Kohli, Neuro-symbolic program synthesis, in: 5th International Conference on Learning Representations, ICLR 2017, Conference Track Proceedings, Toulon, France, April 24\u201326, 2017, OpenReview.net, 2017, https:\/\/openreview.net\/forum?id=rJ0JwFcex."},{"key":"10.3233\/AIC-210084_ref58","unstructured":"A.\u00a0Santoro, F.\u00a0Hill, D.G.T.\u00a0Barrett, A.S.\u00a0Morcos and T.P.\u00a0Lillicrap, Measuring abstract reasoning in neural networks, in: Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan, Stockholm, Sweden, July 10\u201315, 2018, J.G.\u00a0Dy and A.\u00a0Krause, eds, Proceedings of Machine Learning Research, Vol.\u00a080, PMLR, 2018, pp.\u00a04477\u20134486, http:\/\/proceedings.mlr.press\/v80\/santoro18a.html."},{"key":"10.3233\/AIC-210084_ref59","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-65384-2_6"},{"key":"10.3233\/AIC-210084_ref60","unstructured":"M.K.\u00a0Sarker, N.\u00a0Xie, D.\u00a0Doran, M.L.\u00a0Raymer and P.\u00a0Hitzler, Explaining trained neural networks with semantic web technologies: First steps, in: Proceedings of the Twelfth International Workshop on Neural-Symbolic Learning and Reasoning, NeSy 2017, London, UK, July 17\u201318, 2017, T.R.\u00a0Besold, A.S.\u00a0d\u2019Avila Garcez and I.\u00a0Noble, eds, CEUR Workshop Proceedings, Vol.\u00a02003, CEUR-WS.org, 2017, http:\/\/ceur-ws.org\/Vol-2003\/NeSy17_paper4.pdf."},{"key":"10.3233\/AIC-210084_ref61","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01261-8_32"},{"issue":"1","key":"10.3233\/AIC-210084_ref62","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1023\/A:1008380614985","article-title":"Advances in SHRUTI\u00a0\u2013 a neurally motivated model of relational knowledge representation and rapid inference using temporal synchrony","volume":"11","author":"Shastri","year":"1999","journal-title":"Appl. Intell."},{"key":"10.3233\/AIC-210084_ref63","unstructured":"K.K.\u00a0Teru, E.\u00a0Denis and W.\u00a0Hamilton, Inductive relation prediction by subgraph reasoning, in: Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13\u201318 July 2020, Proceedings of Machine Learning Research, Vol.\u00a0119, PMLR, 2020, pp.\u00a09448\u20139457, Virtual Event, http:\/\/proceedings.mlr.press\/v119\/teru20a.html."},{"key":"10.3233\/AIC-210084_ref64","unstructured":"R.\u00a0Trivedi, H.\u00a0Dai, Y.\u00a0Wang and L.\u00a0Song, Know-evolve: Deep temporal reasoning for dynamic knowledge graphs, in: Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6\u201311 August 2017, D.\u00a0Precup and Y.W.\u00a0Teh, eds, Proceedings of Machine Learning Research, Vol.\u00a070, PMLR, 2017, pp.\u00a03462\u20133471, http:\/\/proceedings.mlr.press\/v70\/trivedi17a.html."},{"issue":"1\u20133","key":"10.3233\/AIC-210084_ref65","doi-asserted-by":"publisher","first-page":"97","DOI":"10.13052\/jwe1540-9589.18133","article-title":"A boxology of design patterns for hybrid learning and reasoning systems","volume":"18","author":"van Harmelen","year":"2019","journal-title":"J. Web Eng."},{"key":"10.3233\/AIC-210084_ref66","unstructured":"R.\u00a0Vedantam, K.\u00a0Desai, S.\u00a0Lee, M.\u00a0Rohrbach, D.\u00a0Batra and D.\u00a0Parikh, Probabilistic neural symbolic models for interpretable visual question answering, in: Proceedings of the 36th International Conference on Machine Learning, ICML 2019, Long Beach, California, USA, 9\u201315 June 2019, K.\u00a0Chaudhuri and R.\u00a0Salakhutdinov, eds, Proceedings of Machine Learning Research, Vol.\u00a097, PMLR, 2019, pp.\u00a06428\u20136437, http:\/\/proceedings.mlr.press\/v97\/vedantam19a.html."},{"key":"10.3233\/AIC-210084_ref67","unstructured":"P.\u00a0Velickovic, L.\u00a0Buesing, M.C.\u00a0Overlan, R.\u00a0Pascanu, O.\u00a0Vinyals and C.\u00a0Blundell, Pointer graph networks, in: Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6\u201312, 2020, H.\u00a0Larochelle, M.\u00a0Ranzato, R.\u00a0Hadsell, M.\u00a0Balcan and H.\u00a0Lin, eds, 2020, virtual, https:\/\/proceedings.neurips.cc\/paper\/2020\/hash\/176bf6219855a6eb1f3a30903e34b6fb-Abstract.html."},{"key":"10.3233\/AIC-210084_ref68","unstructured":"O.\u00a0Vinyals, M.\u00a0Fortunato and N.\u00a0Jaitly, Pointer networks, in: Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems, 2015, Montreal, Quebec, Canada, December 7\u201312, 2015, C.\u00a0Cortes, N.D.\u00a0Lawrence, D.D.\u00a0Lee, M.\u00a0Sugiyama and R.\u00a0Garnett, eds, 2015, pp.\u00a02692\u20132700, https:\/\/proceedings.neurips.cc\/paper\/2015\/hash\/29921001f2f04bd3baee84a12e98098f-Abstract.html."},{"key":"10.3233\/AIC-210084_ref69","unstructured":"P.\u00a0Wang, P.L.\u00a0Donti, B.\u00a0Wilder and J.Z.\u00a0Kolter, SATNet: Bridging deep learning and logical reasoning using a differentiable satisfiability solver, in: Proceedings of the 36th International Conference on Machine Learning, ICML 2019, Long Beach, California, USA, 9\u201315 June 2019, K.\u00a0Chaudhuri and R.\u00a0Salakhutdinov, eds, Proceedings of Machine Learning Research, Vol.\u00a097, PMLR, 2019, pp.\u00a06545\u20136554, http:\/\/proceedings.mlr.press\/v97\/wang19e.html."},{"key":"10.3233\/AIC-210084_ref70","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2017\/585"},{"key":"10.3233\/AIC-210084_ref71","unstructured":"Y.\u00a0Xie, Z.\u00a0Xu, K.S.\u00a0Meel, M.S.\u00a0Kankanhalli and H.\u00a0Soh, Embedding symbolic knowledge into deep networks, in: Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems, 2019, NeurIPS 2019, Vancouver, BC, Canada, December 8\u201314, 2019, H.M.\u00a0Wallach, H.\u00a0Larochelle, A.\u00a0Beygelzimer, F.\u00a0d\u2019Alch\u00e9-Buc, E.B.\u00a0Fox and R.\u00a0Garnett, eds, 2019, pp.\u00a04235\u20134245, https:\/\/proceedings.neurips.cc\/paper\/2019\/hash\/7b66b4fd401a271a1c7224027ce111bc-Abstract.html."},{"key":"10.3233\/AIC-210084_ref72","unstructured":"C.\u00a0Xiong, S.\u00a0Merity and R.\u00a0Socher, Dynamic memory networks for visual and textual question answering, in: Proceedings of the 33nd International Conference on Machine Learning, ICML 2016, New York City, NY, USA, June 19\u201324, 2016, M.\u00a0Balcan and K.Q.\u00a0Weinberger, eds, JMLR Workshop and Conference Proceedings, Vol.\u00a048, JMLR.org, 2016, pp.\u00a02397\u20132406, http:\/\/proceedings.mlr.press\/v48\/xiong16.html."},{"key":"10.3233\/AIC-210084_ref73","unstructured":"J.\u00a0Xu, Z.\u00a0Zhang, T.\u00a0Friedman, Y.\u00a0Liang and G.V.\u00a0den Broeck, A semantic loss function for deep learning with symbolic knowledge, in: Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan, Stockholm, Sweden, July 10\u201315, 2018, J.G.\u00a0Dy and A.\u00a0Krause, eds, Proceedings of Machine Learning Research, Vol.\u00a080, PMLR, 2018, pp.\u00a05498\u20135507, http:\/\/proceedings.mlr.press\/v80\/xu18h.html."},{"key":"10.3233\/AIC-210084_ref74","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2018\/675"},{"key":"10.3233\/AIC-210084_ref75","unstructured":"C.\u00a0Yeh, B.\u00a0Kim, S.\u00d6.\u00a0Arik, C.\u00a0Li, T.\u00a0Pfister and P.\u00a0Ravikumar, On completeness-aware concept-based explanations in deep neural networks, in: Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6\u201312, 2020, H.\u00a0Larochelle, M.\u00a0Ranzato, R.\u00a0Hadsell, M.\u00a0Balcan and H.\u00a0Lin, eds, 2020, virtual, https:\/\/proceedings.neurips.cc\/paper\/2020\/hash\/ecb287ff763c169694f682af52c1f309-Abstract.html."},{"key":"10.3233\/AIC-210084_ref76","unstructured":"K.\u00a0Yi, J.\u00a0Wu, C.\u00a0Gan, A.\u00a0Torralba, P.\u00a0Kohli and J.\u00a0Tenenbaum, Neural-symbolic VQA: Disentangling reasoning from vision and language understanding, in: Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems, 2018, NeurIPS 2018, Montr\u00e9al, Canada, December 3\u20138, 2018, S.\u00a0Bengio, H.M.\u00a0Wallach, H.\u00a0Larochelle, K.\u00a0Grauman, N.\u00a0Cesa-Bianchi and R.\u00a0Garnett, eds, 2018, pp.\u00a01039\u20131050, https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/5e388103a391daabe3de1d76a6739ccd-Abstract.html."},{"key":"10.3233\/AIC-210084_ref77","unstructured":"I.\u00a0Yildirim, T.\u00a0Gerstenberg, B.\u00a0Saeed, M.\u00a0Toussaint and J.\u00a0Tenenbaum, Physical problem solving: Joint planning with symbolic, geometric, and dynamic constraints, in: Proceedings of the 39th Annual Meeting of the Cognitive Science Society, CogSci 2017, London, UK, 16\u201329 July 2017, G.\u00a0Gunzelmann, A.\u00a0Howes, T.\u00a0Tenbrink and E.J.\u00a0Davelaar, eds, cognitivesciencesociety.org, 2017, https:\/\/mindmodeling.org\/cogsci2017\/papers\/0676\/index.html."},{"key":"10.3233\/AIC-210084_ref78","unstructured":"H.\u00a0Young, O.\u00a0Bastani and M.\u00a0Naik, Learning neurosymbolic generative models via program synthesis, in: Proceedings of the 36th International Conference on Machine Learning, ICML 2019, Long Beach, California, USA, 9\u201315 June 2019, K.\u00a0Chaudhuri and R.\u00a0Salakhutdinov, eds, Proceedings of Machine Learning Research, Vol.\u00a097, PMLR, 2019, pp.\u00a07144\u20137153, http:\/\/proceedings.mlr.press\/v97\/young19a.html."},{"key":"10.3233\/AIC-210084_ref79","unstructured":"X.\u00a0Zhang, A.\u00a0Solar-Lezama and R.\u00a0Singh, Interpreting neural network judgments via minimal, stable, and symbolic corrections, in: Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems, 2018, NeurIPS 2018, Montr\u00e9al, Canada, December 3\u20138, 2018, S.\u00a0Bengio, H.M.\u00a0Wallach, H.\u00a0Larochelle, K.\u00a0Grauman, N.\u00a0Cesa-Bianchi and R.\u00a0Garnett, eds, 2018, pp.\u00a04879\u20134890, https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/300891a62162b960cf02ce3827bb363c-Abstract.html."},{"issue":"9","key":"10.3233\/AIC-210084_ref80","doi-asserted-by":"publisher","first-page":"2131","DOI":"10.1109\/TPAMI.2018.2858759","article-title":"Interpreting deep visual representations via network dissection","volume":"41","author":"Zhou","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["AI Communications"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/AIC-210084","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T18:27:59Z","timestamp":1777400879000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/AIC-210084"}},"subtitle":["Current trends"],"short-title":[],"issued":{"date-parts":[[2022,3,4]]},"references-count":77,"journal-issue":{"issue":"3"},"URL":"https:\/\/doi.org\/10.3233\/aic-210084","relation":{},"ISSN":["1875-8452","0921-7126"],"issn-type":[{"value":"1875-8452","type":"electronic"},{"value":"0921-7126","type":"print"}],"subject":[],"published":{"date-parts":[[2022,3,4]]}}}