{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T18:30:51Z","timestamp":1785781851430,"version":"3.56.0"},"reference-count":158,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2024,10,4]],"date-time":"2024-10-04T00:00:00Z","timestamp":1728000000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SW"],"published-print":{"date-parts":[[2024,10,4]]},"abstract":"<jats:p>Advocates for Neuro-Symbolic Artificial Intelligence (NeSy) assert that combining deep learning with symbolic reasoning will lead to stronger AI than either paradigm on its own. As successful as deep learning has been, it is generally accepted that even our best deep learning systems are not very good at abstract reasoning. And since reasoning is inextricably linked to language, it makes intuitive sense that Natural Language Processing (NLP), would be a particularly well-suited candidate for NeSy. We conduct a structured review of studies implementing NeSy for NLP, with the aim of answering the question of whether NeSy is indeed meeting its promises: reasoning, out-of-distribution generalization, interpretability, learning and reasoning from small data, and transferability to new domains. We examine the impact of knowledge representation, such as rules and semantic networks, language structure and relational structure, and whether implicit or explicit reasoning contributes to higher promise scores. We find that systems where logic is compiled into the neural network lead to the most NeSy goals being satisfied, while other factors such as knowledge representation, or type of neural architecture do not exhibit a clear correlation with goals being met. We find many discrepancies in how reasoning is defined, specifically in relation to human level reasoning, which impact decisions about model architectures and drive conclusions which are not always consistent across studies. Hence we advocate for a more methodical approach to the application of theories of human reasoning as well as the development of appropriate benchmarks, which we hope can lead to a better understanding of progress in the field. We make our data and code available on github for further analysis.11 https:\/\/github.com\/kyleiwaniec\/neuro-symbolic-ai-systematic-review<\/jats:p>","DOI":"10.3233\/sw-223228","type":"journal-article","created":{"date-parts":[[2022,11,11]],"date-time":"2022-11-11T11:43:46Z","timestamp":1668167026000},"page":"1265-1306","source":"Crossref","is-referenced-by-count":46,"title":["Is neuro-symbolic AI meeting its promises in natural language processing? A\u00a0structured review"],"prefix":"10.1177","volume":"15","author":[{"given":"Kyle","family":"Hamilton","sequence":"first","affiliation":[{"name":"SFI Centre for Research Training in Machine Learning, School of Computer Science, Technological University Dublin, Republic of Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aparna","family":"Nayak","sequence":"additional","affiliation":[{"name":"SFI Centre for Research Training in Machine Learning, School of Computer Science, Technological University Dublin, Republic of Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bojan","family":"Bo\u017ei\u0107","sequence":"additional","affiliation":[{"name":"SFI Centre for Research Training in Machine Learning, School of Computer Science, Technological University Dublin, Republic of Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luca","family":"Longo","sequence":"additional","affiliation":[{"name":"SFI Centre for Research Training in Machine Learning, School of Computer Science, Technological University Dublin, Republic of Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","reference":[{"key":"10.3233\/SW-223228_ref1","unstructured":"E.\u00a0Altszyler, P.\u00a0Brusco, N.\u00a0Basiou, J.\u00a0Byrnes and D.\u00a0Vergyri, Zero-shot multi-domain dialog state tracking using prescriptive rules, in: Proceedings of the 15th International Workshop on Neural-Symbolic Learning and Reasoning as Part of the 1st International Joint Conference on Learning & Reasoning (IJCLR 2021), Virtual Conference, October 25\u201327, 2021, A.S.\u00a0d\u2019Avila Garcez and E.\u00a0Jim\u00e9nez-Ruiz, eds, CEUR Workshop Proceedings, Vol.\u00a02986, CEUR-WS.org, 2021, pp.\u00a057\u201366."},{"key":"10.3233\/SW-223228_ref2","doi-asserted-by":"publisher","DOI":"10.1109\/ICTAI.2019.00027"},{"key":"10.3233\/SW-223228_ref3","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/d14-1059"},{"key":"10.3233\/SW-223228_ref4","doi-asserted-by":"publisher","DOI":"10.1109\/INDICON47234.2019.9028985"},{"key":"10.3233\/SW-223228_ref5","unstructured":"S.\u00a0Bader and P.\u00a0Hitzler, Dimensions of neural-symbolic integration \u2014 a structured survey, in: We Will Show Them: Essays in Honour of Dov Gabbay, S.Artemov, H.\u00a0Barringer, A.S.D.\u00a0Garcez, L.C.\u00a0Lamb and J.\u00a0Woods, eds, King\u2019s College Publications, 2005, pp.\u00a0167\u2013194."},{"key":"10.3233\/SW-223228_ref6","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58449-8_1"},{"key":"10.3233\/SW-223228_ref7","unstructured":"T.J.M.\u00a0Bench-Capon, Knowledge Representation: An Approach to Artificial Intelligence, Academic Press Professional, Inc., USA, 1990. ISBN 0120864401."},{"key":"10.3233\/SW-223228_ref8","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445922"},{"key":"10.3233\/SW-223228_ref10","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553380"},{"key":"10.3233\/SW-223228_ref12","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1711.03902"},{"key":"10.3233\/SW-223228_ref13","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1016\/j.bica.2015.09.003","article-title":"Towards integrated neural-symbolic systems for human-level AI: Two research programs helping to bridge the gaps","volume":"14","author":"Besold","year":"2015","journal-title":"Biologically Inspired Cognitive Architectures"},{"key":"10.3233\/SW-223228_ref14","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-31095-0_11"},{"issue":"1","key":"10.3233\/SW-223228_ref15","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1146\/annurev-linguistics-011619-030303","article-title":"Distributional semantics and linguistic theory","volume":"6","author":"Boleda","year":"2020","journal-title":"Annual Review of Linguistics"},{"key":"10.3233\/SW-223228_ref16","unstructured":"G.\u00a0Bonaccorso, Machine Learning Algorithms, Packt Publishing Ltd, 2017."},{"issue":"3","key":"10.3233\/SW-223228_ref17","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1108\/IJWIS-11-2020-0067","article-title":"A new neutrosophic TF-IDF term weighting for text mining tasks: Text classification use case","volume":"17","author":"Bounabi","year":"2021","journal-title":"International Journal of Web Information Systems"},{"key":"10.3233\/SW-223228_ref18","doi-asserted-by":"crossref","unstructured":"R.J.\u00a0Brachman and H.J.\u00a0Levesque, Knowledge Representation and Reasoning, Elsevier, 2004. ISBN 978-1-55860-932-7.","DOI":"10.1016\/B978-155860932-7\/50086-8"},{"key":"10.3233\/SW-223228_ref19","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-20521-8_54"},{"key":"10.3233\/SW-223228_ref20","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2005.14165"},{"key":"10.3233\/SW-223228_ref21","unstructured":"J.\u00a0Byszuk, M.\u00a0Wo\u017aniak, M.\u00a0Kestemont, A.\u00a0Le\u015bniak, W.\u00a0Lukasik, A.\u00a0\u0160e\u013ca and M.\u00a0Eder, Detecting direct speech in multilingual collection of 19th-century novels, in: Proceedings of LT4HALA 2020\u00a0\u2013 1st Workshop on Language Technologies for Historical and Ancient Languages, R.\u00a0Sprugnoli and M.\u00a0Passarotti, eds, European Language Resources Association (ELRA), Marseille, France, 2020, pp.\u00a0100\u2013104. ISBN 979-10-95546-53-5."},{"key":"10.3233\/SW-223228_ref22","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1016\/j.aiopen.2021.07.002","article-title":"Discrete and continuous representations and processing in deep learning: Looking forward","volume":"2","author":"Cartuyvels","year":"2021","journal-title":"AI Open"},{"key":"10.3233\/SW-223228_ref23","doi-asserted-by":"publisher","first-page":"264","DOI":"10.1016\/j.patrec.2019.04.024","article-title":"Fuzzy commonsense reasoning for multimodal sentiment analysis","volume":"125","author":"Chaturvedi","year":"2019","journal-title":"Pattern Recognition Letters"},{"key":"10.3233\/SW-223228_ref24","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.245"},{"key":"10.3233\/SW-223228_ref25","unstructured":"K.\u00a0Chen, Q.\u00a0Huang, H.\u00a0Palangi, P.\u00a0Smolensky, K.D.\u00a0Forbus and J.\u00a0Gao, Mapping natural-language problems to formal-language solutions using structured neural representations, in: Proceedings of the 37th International Conference on Machine Learning, ICML\u201920, JMLR.org, 2020."},{"key":"10.3233\/SW-223228_ref26","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.549"},{"key":"10.3233\/SW-223228_ref27","doi-asserted-by":"publisher","DOI":"10.1145\/3453483.3454047"},{"key":"10.3233\/SW-223228_ref28","unstructured":"X.\u00a0Chen, C.\u00a0Liang, A.W.\u00a0Yu, D.\u00a0Song and D.\u00a0Zhou, Compositional generalization via neural-symbolic stack machines, in: Advances in Neural Information Processing Systems, H.\u00a0Larochelle, M.\u00a0Ranzato, R.\u00a0Hadsell, M.F.\u00a0Balcan and H.\u00a0Lin, eds, Vol.\u00a033, Curran Associates, Inc., 2020, pp.\u00a01690\u20131701."},{"key":"10.3233\/SW-223228_ref29","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.starsem-1.7"},{"key":"10.3233\/SW-223228_ref30","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1906.04985"},{"issue":"LNAI","key":"10.3233\/SW-223228_ref31","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1007\/978-3-030-82147-0_34","article-title":"Sememes-based framework for knowledge graph embedding with comprehensive-information","volume":"12816","author":"Cui","year":"2021","journal-title":"Lecture Notes in Computer Science"},{"key":"10.3233\/SW-223228_ref32","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.755"},{"issue":"1","key":"10.3233\/SW-223228_ref33","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1609\/aimag.v14i1.1029","article-title":"What is a knowledge representation?","volume":"14","author":"Davis","year":"1993","journal-title":"AI Magazine"},{"key":"10.3233\/SW-223228_ref34","unstructured":"L.\u00a0De Raedt, A.\u00a0Kimmig and H.\u00a0Toivonen, ProbLog: A\u00a0probabilistic prolog and its application in link discovery, in: Proceedings of the 20th International Joint Conference on Artifical Intelligence, IJCAI\u201907, C.\u00a0Bessiere, ed., Vol.\u00a07, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 2007, pp.\u00a02468\u20132473."},{"key":"10.3233\/SW-223228_ref35","unstructured":"C.\u00a0Dehua, Z.\u00a0Keting and H.\u00a0Jianrong, BDCN: Semantic embedding self-explanatory breast diagnostic capsules network, in: Proceedings of the 20th Chinese National Conference on Computational Linguistics, S.\u00a0Li, M.\u00a0Sun, Y.\u00a0Liu, H.\u00a0Wu, K.\u00a0Liu, W.\u00a0Che, S.\u00a0He and G.\u00a0Rao, eds, Chinese Information Processing Society of China, Huhhot, China, 2021, pp.\u00a01178\u20131189."},{"key":"10.3233\/SW-223228_ref36","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6264"},{"key":"10.3233\/SW-223228_ref37","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1423"},{"key":"10.3233\/SW-223228_ref38","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1016\/j.artint.2015.08.011","article-title":"Semantic-based regularization for learning and inference","volume":"244","author":"Diligenti","year":"2017","journal-title":"Artificial Intelligence"},{"key":"10.3233\/SW-223228_ref39","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1904.11694"},{"key":"10.3233\/SW-223228_ref40","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-5312"},{"key":"10.3233\/SW-223228_ref42","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1807.00973"},{"key":"10.3233\/SW-223228_ref43","doi-asserted-by":"publisher","DOI":"10.4324\/9780203486030"},{"key":"10.3233\/SW-223228_ref44","doi-asserted-by":"publisher","first-page":"17943","DOI":"10.1109\/ACCESS.2021.3053917","article-title":"Sentence-level classification using parallel fuzzy deep learning classifier","volume":"9","author":"Es-Sabery","year":"2021","journal-title":"IEEE Access"},{"key":"10.3233\/SW-223228_ref45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1613\/jair.5714","article-title":"Learning explanatory rules from noisy data","volume":"61","author":"Evans","year":"2018","journal-title":"Journal of Artificial Intelligence Research"},{"key":"10.3233\/SW-223228_ref46","unstructured":"W.\u00a0Farnsworth, The Socratic Method: A\u00a0Practitioner\u2019s Handbook, David R. Godine Publisher Inc, 2021. ISBN 978-1-56792-685-9."},{"key":"10.3233\/SW-223228_ref47","doi-asserted-by":"publisher","DOI":"10.23919\/MIPRO.2019.8756929"},{"issue":"3.4","key":"10.3233\/SW-223228_ref48","doi-asserted-by":"publisher","first-page":"1:1","DOI":"10.1147\/JRD.2012.2184356","article-title":"Introduction to \u201cthis is Watson\u201d","volume":"56","author":"Ferrucci","year":"2012","journal-title":"IBM Journal of Research and Development"},{"key":"10.3233\/SW-223228_ref49","unstructured":"E.\u00a0Gabrilovich, R.\u00a0Guha, A.\u00a0McCallum and K.\u00a0Murphy, Knowledge Representation and Reasoning: Integrating Symbolic and Neural Approaches, The AAAI Press, Palo Alto, California, 2015. ISBN 978-1-57735-707-0."},{"key":"10.3233\/SW-223228_ref50","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1905.06088"},{"key":"10.3233\/SW-223228_ref51","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2012.05876"},{"key":"10.3233\/SW-223228_ref52","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-73246-4"},{"key":"10.3233\/SW-223228_ref53","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-0211-3"},{"key":"10.3233\/SW-223228_ref54","doi-asserted-by":"publisher","DOI":"10.5555\/1597148"},{"key":"10.3233\/SW-223228_ref55","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1613\/jair.5477","article-title":"Survey of the state of the art in natural language generation: Core tasks, applications and evaluation","volume":"61","author":"Gatt","year":"2018","journal-title":"Journal of Artificial Intelligence Research"},{"key":"10.3233\/SW-223228_ref56","doi-asserted-by":"publisher","first-page":"30885","DOI":"10.1109\/ACCESS.2020.2972751","article-title":"Hierarchical graph transformer-based deep learning model for large-scale multi-label text classification","volume":"8","author":"Gong","year":"2020","journal-title":"IEEE Access"},{"key":"10.3233\/SW-223228_ref57","doi-asserted-by":"publisher","DOI":"10.1017\/9781316584705"},{"key":"10.3233\/SW-223228_ref58","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-30490-4_16"},{"key":"10.3233\/SW-223228_ref59","unstructured":"Y.\u00a0Gu, J.Z.\u00a0Pan, G.\u00a0Cheng, H.\u00a0Paulheim and G.\u00a0Stoilos, Local ABox consistency prediction with transparent TBoxes using gated graph neural networks, in: Proceedings of the 2019 International Workshop on Neural-Symbolic Learning and Reasoning, D.\u00a0Doran, A.\u00a0d\u2019Avila Garcez and F.\u00a0Lecue, eds, 2019, pp.\u00a048\u201353."},{"key":"10.3233\/SW-223228_ref60","unstructured":"K.\u00a0Gupta, T.\u00a0Ghosal and A.\u00a0Ekbal, A neuro-symbolic approach for question answering on research articles, in: Proceedings of the 35th Pacific Asia Conference on Language, Information and Computation, K.\u00a0Hu, J.\u00a0Kim, C.\u00a0Zong and E.\u00a0Chersoni, eds, Association for Computational Lingustics, Shanghai, China, 2021, pp.\u00a040\u201349."},{"key":"10.3233\/SW-223228_ref61","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-2017"},{"key":"10.3233\/SW-223228_ref62","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1709.05584"},{"key":"10.3233\/SW-223228_ref63","unstructured":"B.\u00a0Hammer and P.\u00a0Hitzler\u00a0(eds), Perspectives of Neural-Symbolic Integration, Vol.\u00a077, Springer, 2007. ISBN 978-3-540-73953-1."},{"key":"10.3233\/SW-223228_ref64","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1016\/j.cogsys.2017.07.004","volume":"47","author":"Harder","year":"2018","journal-title":"Cognitive Systems Research"},{"issue":"1","key":"10.3233\/SW-223228_ref65","doi-asserted-by":"publisher","first-page":"3","DOI":"10.3233\/SW-190368","article-title":"Neural-symbolic integration and the semantic web","volume":"11","author":"Hitzler","year":"2020","journal-title":"Semantic Web"},{"issue":"8","key":"10.3233\/SW-223228_ref66","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Computation"},{"key":"10.3233\/SW-223228_ref67","doi-asserted-by":"publisher","first-page":"152368","DOI":"10.1109\/ACCESS.2019.2948081","article-title":"Question answering systems with deep learning-based symbolic processing","volume":"7","author":"Honda","year":"2019","journal-title":"IEEE Access"},{"key":"10.3233\/SW-223228_ref68","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.acl-long.547"},{"key":"10.3233\/SW-223228_ref69","doi-asserted-by":"publisher","first-page":"1344","DOI":"10.1609\/aaai.v33i01.33011344","article-title":"Attentive tensor product learning","volume":"33","author":"Huang","year":"2019","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"10.3233\/SW-223228_ref70","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-5319"},{"key":"10.3233\/SW-223228_ref71","doi-asserted-by":"publisher","first-page":"1662","DOI":"10.1016\/j.neucom.2017.10.010","article-title":"Semi-supervised learning for big social data analysis","volume":"275","author":"Hussain","year":"2018","journal-title":"Neurocomputing"},{"key":"10.3233\/SW-223228_ref72","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/d17-1215"},{"key":"10.3233\/SW-223228_ref73","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.acl-long.64"},{"key":"10.3233\/SW-223228_ref74","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.197"},{"key":"10.3233\/SW-223228_ref75","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2019.101772"},{"issue":"3","key":"10.3233\/SW-223228_ref76","first-page":"235","article-title":"Connectionist perspectives on language learning, representation and processing","volume":"6","author":"Joanisse","year":"2015","journal-title":"Wiley Interdisciplinary Reviews: Cognitive Science"},{"key":"10.3233\/SW-223228_ref77","unstructured":"D.\u00a0Kahneman, Thinking, Fast and Slow, Farrar, Straus and Giroux, New York, 2011, 0374275637. ISBN 9780374275631."},{"key":"10.3233\/SW-223228_ref78","unstructured":"D.\u00a0Kahneman, O.\u00a0Sibony and C.R.\u00a0Sunstein, Noise: A\u00a0Flaw in Human Judgment, HarperCollins Publishers, Limited, 2021. ISBN 978-0-00-830900-8."},{"key":"10.3233\/SW-223228_ref79","doi-asserted-by":"publisher","DOI":"10.1002\/9781119515326.ch4"},{"key":"10.3233\/SW-223228_ref81","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1609.02907"},{"key":"10.3233\/SW-223228_ref82","first-page":"1","volume-title":"Procedures for Performing Systematic Reviews","author":"Kitchenham","year":"2004"},{"key":"10.3233\/SW-223228_ref83","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.conll-1.3"},{"key":"10.3233\/SW-223228_ref84","unstructured":"D.\u00a0Koller, N.\u00a0Friedman, S.\u00a0D\u017eeroski, C.\u00a0Sutton, A.\u00a0McCallum, A.\u00a0Pfeffer, P.\u00a0Abbeel, M.-F.\u00a0Wong, C.\u00a0Meek, J.\u00a0Neville et al., Introduction to Statistical Relational Learning, MIT Press, 2007."},{"issue":"4","key":"10.3233\/SW-223228_ref85","doi-asserted-by":"publisher","first-page":"813","DOI":"10.1162\/coli_a_00417","article-title":"Abstractive text summarization: Enhancing sequence-to-sequence models using word sense disambiguation and semantic content generalization","volume":"47","author":"Kouris","year":"2021","journal-title":"Computational Linguistics"},{"issue":"1","key":"10.3233\/SW-223228_ref86","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1007\/BF00413602","article-title":"Linguistics and natural logic","volume":"22","author":"Lakoff","year":"1970","journal-title":"Synthese"},{"key":"10.3233\/SW-223228_ref87","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2020\/679"},{"key":"10.3233\/SW-223228_ref88","unstructured":"G.\u00a0Lample and F.\u00a0Charton, Deep learning for symbolic mathematics, in: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26\u201330, 2020, OpenReview.net, 2020."},{"key":"10.3233\/SW-223228_ref89","unstructured":"J.\u00a0Langton and K.\u00a0Srihasam, Applied medical code mapping with character-based deep learning models and word-based logic, in: Proceedings of the 1st and 2nd Workshops on Natural Logic Meets Machine Learning (NALOMA), A.-L.\u00a0Kalouli and L.S.\u00a0Moss, eds, Association for Computational Linguistics, Groningen, the Netherlands, 2021, pp.\u00a07\u201311, online."},{"key":"10.3233\/SW-223228_ref90","doi-asserted-by":"publisher","DOI":"10.4249\/scholarpedia.30977"},{"key":"10.3233\/SW-223228_ref91","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-61609-0_51"},{"issue":"1","key":"10.3233\/SW-223228_ref92","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1146\/annurev.cs.01.060186.001351","article-title":"Knowledge representation and reasoning","volume":"1","author":"Levesque","year":"1986","journal-title":"Annual Review of Computer Science"},{"key":"10.3233\/SW-223228_ref93","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1028"},{"key":"10.3233\/SW-223228_ref94","doi-asserted-by":"publisher","DOI":"10.26615\/978-954-452-056-4_076"},{"key":"10.3233\/SW-223228_ref95","doi-asserted-by":"publisher","first-page":"260","DOI":"10.1016\/j.neucom.2021.02.021","article-title":"Heterogeneous graph reasoning for knowledge-grounded medical dialogue system","volume":"442","author":"Liu","year":"2021","journal-title":"Neurocomputing"},{"key":"10.3233\/SW-223228_ref96","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2203.10557"},{"key":"10.3233\/SW-223228_ref98","doi-asserted-by":"publisher","DOI":"10.3115\/1654536.1654575"},{"key":"10.3233\/SW-223228_ref99","doi-asserted-by":"crossref","unstructured":"B.\u00a0MacCartney and C.D.\u00a0Manning, An extended model of natural logic, in: Proceedings of the Eight International Conference on Computational Semantics, H.\u00a0Bunt, ed., Association for Computational Linguistics, Tilburg, The Netherlands, 2009, pp.\u00a0140\u2013156.","DOI":"10.3115\/1693756.1693772"},{"key":"10.3233\/SW-223228_ref100","doi-asserted-by":"publisher","DOI":"10.1145\/3391274.3393636"},{"key":"10.3233\/SW-223228_ref101","unstructured":"R.\u00a0Manhaeve, S.\u00a0Dumancic, A.\u00a0Kimmig, T.\u00a0Demeester and L.\u00a0De Raedt, DeepProbLog: Neural probabilistic logic programming, in: Advances in Neural Information Processing Systems, S.\u00a0Bengio, H.\u00a0Wallach, H.\u00a0Larochelle, K.\u00a0Grauman, N.\u00a0Cesa-Bianchi and R.\u00a0Garnett, eds, Vol.\u00a031, Curran Associates, Inc., 2018."},{"key":"10.3233\/SW-223228_ref102","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-5010"},{"key":"10.3233\/SW-223228_ref103","unstructured":"J.\u00a0Mao, C.\u00a0Gan, P.\u00a0Kohli, J.B.\u00a0Tenenbaum and J.\u00a0Wu, The neuro-symbolic concept learner: Interpreting scenes, words, and sentences from natural supervision, in: 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6\u20139, 2019, OpenReview.net, 2019."},{"key":"10.3233\/SW-223228_ref104","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1801.00631"},{"issue":"1","key":"10.3233\/SW-223228_ref106","first-page":"165","article-title":"Review of selected works","volume":"26","author":"McCall","year":"1973","journal-title":"Synthese"},{"key":"10.3233\/SW-223228_ref108","doi-asserted-by":"crossref","unstructured":"R.\u00a0Miikkulainen, Neuroevolution, in: Encyclopedia of Machine Learning, Springer, New York, 2010.","DOI":"10.1007\/978-0-387-30164-8_589"},{"issue":"4","key":"10.3233\/SW-223228_ref109","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1007\/BF03037089","article-title":"Inductive logic programming","volume":"8","author":"Muggleton","year":"1991","journal-title":"New Generation Computing"},{"key":"10.3233\/SW-223228_ref110","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1162\/tacl_a_00357","article-title":"Modeling content and context with deep relational learning","volume":"9","author":"Pacheco","year":"2021","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"10.3233\/SW-223228_ref111","doi-asserted-by":"publisher","DOI":"10.1186\/s13643-021-01626-4"},{"issue":"2","key":"10.3233\/SW-223228_ref112","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1016\/j.im.2014.08.008","article-title":"Synthesizing information systems knowledge: A\u00a0typology of literature reviews","volume":"52","author":"Par\u00e9","year":"2015","journal-title":"Information & Management"},{"key":"10.3233\/SW-223228_ref113","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1801.04016"},{"key":"10.3233\/SW-223228_ref114","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.acl-long.545"},{"issue":"1\u20134","key":"10.3233\/SW-223228_ref115","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1016\/S0024-3841(98)00035-7","article-title":"Words and rules","volume":"106","author":"Pinker","year":"1998","journal-title":"Lingua"},{"key":"10.3233\/SW-223228_ref116","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.acl-long.456"},{"issue":"1","key":"10.3233\/SW-223228_ref118","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1007\/s10994-006-5833-1","article-title":"Markov logic networks","volume":"62","author":"Richardson","year":"2006","journal-title":"Machine Learning"},{"key":"10.3233\/SW-223228_ref119","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2006.13155"},{"key":"10.3233\/SW-223228_ref120","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-13"},{"key":"10.3233\/SW-223228_ref121","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1214\/21-SS133","article-title":"Interpretable machine learning: Fundamental principles and 10 grand challenges","volume":"16","author":"Rudin","year":"2022","journal-title":"Statistics Surveys"},{"key":"10.3233\/SW-223228_ref122","doi-asserted-by":"publisher","DOI":"10.1017\/exp.2021.9"},{"key":"10.3233\/SW-223228_ref123","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2105.05330"},{"key":"10.3233\/SW-223228_ref124","doi-asserted-by":"crossref","unstructured":"E.\u00a0Saveleva, V.\u00a0Petukhova, M.\u00a0Mosbach and D.\u00a0Klakow, Graph-based argument quality assessment, in: Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021), R.\u00a0Mitkov, G.\u00a0Angelova and K.\u00a0Bontcheva, eds, INCOMA Ltd. Shoumen, BULGARIA, Held Online, 2021, pp.\u00a01268\u20131280.","DOI":"10.26615\/978-954-452-072-4_143"},{"issue":"1","key":"10.3233\/SW-223228_ref125","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1109\/TNN.2008.2005605","article-title":"The graph neural network model","volume":"20","author":"Scarselli","year":"2008","journal-title":"IEEE transactions on neural networks"},{"key":"10.3233\/SW-223228_ref126","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-93417-4_38"},{"issue":"3","key":"10.3233\/SW-223228_ref127","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1007\/s13218-019-00601-5","article-title":"The CoRg project: Cognitive reasoning","volume":"33","author":"Schon","year":"2019","journal-title":"K\u00fcnstliche Intell."},{"key":"10.3233\/SW-223228_ref128","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.345"},{"key":"10.3233\/SW-223228_ref129","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-49130-1_25"},{"key":"10.3233\/SW-223228_ref130","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1606.04422"},{"key":"10.3233\/SW-223228_ref131","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2004.08900"},{"key":"10.3233\/SW-223228_ref132","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2108.13624"},{"key":"10.3233\/SW-223228_ref133","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.298"},{"issue":"5","key":"10.3233\/SW-223228_ref134","doi-asserted-by":"publisher","first-page":"989","DOI":"10.1007\/s10994-021-05968-x","article-title":"autoBOT: Evolving neuro-symbolic representations for explainable low resource text classification","volume":"110","author":"\u0160krlj","year":"2021","journal-title":"Machine Learning"},{"issue":"1\u20132","key":"10.3233\/SW-223228_ref135","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1016\/0004-3702(90)90007-M","article-title":"Tensor product variable binding and the representation of symbolic structures in connectionist systems","volume":"46","author":"Smolensky","year":"1990","journal-title":"Artificial Intelligence"},{"key":"10.3233\/SW-223228_ref136","unstructured":"R.\u00a0Socher, D.\u00a0Chen, C.D.\u00a0Manning and A.\u00a0Ng, Reasoning with neural tensor networks for knowledge base completion, in: Advances in Neural Information Processing Systems, C.J.\u00a0Burges, L.\u00a0Bottou, M.\u00a0Welling, Z.\u00a0Ghahramani and K.Q.\u00a0Weinberger, eds, Vol.\u00a026, Curran Associates, Inc., 2013."},{"key":"10.3233\/SW-223228_ref137","doi-asserted-by":"publisher","DOI":"10.1016\/C2013-0-08297-7"},{"key":"10.3233\/SW-223228_ref138","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-0631-9_6"},{"key":"10.3233\/SW-223228_ref139","unstructured":"C.\u00a0Strasser and G.A.\u00a0Antonelli, Non-monotonic logic, in: The Stanford Encyclopedia of Philosophy, Summer 2019 edn, 2019, Research Lab, Stanford University."},{"key":"10.3233\/SW-223228_ref140","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2019.8851875"},{"key":"10.3233\/SW-223228_ref141","unstructured":"A.A.N.\u00a0Tato, R.\u00a0Nkambou and A.\u00a0Dufresne, Hybrid deep neural networks to predict socio-moral reasoning skills, in: Proceedings of the 12th International Conference on Educational Data Mining, C.F.\u00a0Lynch, A.\u00a0Merceron, M.\u00a0Desmarais and R.\u00a0Nkambou, eds, International Educational Data Mining Society (IEDMS), 2019, pp.\u00a0623\u2013626."},{"issue":"1\u20132","key":"10.3233\/SW-223228_ref142","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/0004-3702(94)90105-8","article-title":"Knowledge-based artificial neural networks","volume":"70","author":"Towell","year":"1994","journal-title":"Artificial intelligence"},{"key":"10.3233\/SW-223228_ref143","unstructured":"I.L.\u00a0Travis, Knowledge representation in artificial intelligence, in: Clinic on Library Applications of Data Processing, Vol.\u00a027, 1990, p.\u00a01990."},{"key":"10.3233\/SW-223228_ref144","doi-asserted-by":"crossref","unstructured":"E.\u00a0Tsamoura, T.\u00a0Hospedales and L.\u00a0Michael, Neural-symbolic integration: A\u00a0compositional perspective, in: Proceedings of the AAAI Conference on Artificial Intelligence, Vol.\u00a035, 2021, pp.\u00a05051\u20135060.","DOI":"10.1609\/aaai.v35i6.16639"},{"issue":"1","key":"10.3233\/SW-223228_ref145","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1145\/602382.602410","article-title":"Three problems in computer science","volume":"50","author":"Valiant","year":"2003","journal-title":"Journal of the ACM"},{"key":"10.3233\/SW-223228_ref146","doi-asserted-by":"publisher","first-page":"97","DOI":"10.13052\/jwe1540-9589.18133","article-title":"A boxology of design patterns for hybrid learning and reasoning systems","volume":"18","author":"Van Harmelen","year":"2019","journal-title":"Journal of Web Engineering"},{"key":"10.3233\/SW-223228_ref147","unstructured":"A.\u00a0Vaswani, N.\u00a0Shazeer, N.\u00a0Parmar, J.\u00a0Uszkoreit, L.\u00a0Jones, A.N.\u00a0Gomez, L.U.\u00a0Kaiser and I.\u00a0Polosukhin, Attention is all you need, in: Advances in Neural Information Processing Systems, I.\u00a0Guyon, U.V.\u00a0Luxburg, S.\u00a0Bengio, H.\u00a0Wallach, R.\u00a0Fergus, S.\u00a0Vishwanathan and R.\u00a0Garnett, eds, Vol.\u00a030, Curran Associates, Inc., 2017, pp.\u00a05998\u20136008."},{"key":"10.3233\/SW-223228_ref149","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-main.288"},{"key":"10.3233\/SW-223228_ref150","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/j.inffus.2021.05.009","article-title":"Notions of explainability and evaluation approaches for explainable artificial intelligence","volume":"76","author":"Vilone","year":"2021","journal-title":"Information Fusion"},{"key":"10.3233\/SW-223228_ref151","unstructured":"O.\u00a0Vinyals, M.\u00a0Fortunato and N.\u00a0Jaitly, Pointer networks, in: Advances in Neural Information Processing Systems, C.\u00a0Cortes, N.\u00a0Lawrence, D.\u00a0Lee, M.\u00a0Sugiyama and R.\u00a0Garnett, eds, Vol.\u00a028, Curran Associates, Inc., 2015."},{"key":"10.3233\/SW-223228_ref152","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2021.3079836"},{"issue":"4","key":"10.3233\/SW-223228_ref153","doi-asserted-by":"publisher","first-page":"775","DOI":"10.1162\/coli_a_00415","article-title":"Variational deep logic network for joint inference of entities and relations","volume":"47","author":"Wang","year":"2021","journal-title":"Computational Linguistics"},{"issue":"3","key":"10.3233\/SW-223228_ref154","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3386252","article-title":"Generalizing from a few examples: A\u00a0survey on few-shot learning","volume":"53","author":"Wang","year":"2020","journal-title":"ACM computing surveys (csur)"},{"issue":"1","key":"10.3233\/SW-223228_ref155","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1145\/365153.365168","article-title":"ELIZA\u00a0\u2013 a computer program for the study of natural language communication between man and machine","volume":"9","author":"Weizenbaum","year":"1966","journal-title":"Communications of the ACM"},{"issue":"3","key":"10.3233\/SW-223228_ref156","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1080\/09540090412331311932","article-title":"Multiple instantiation and rule mediation in SHRUTI","volume":"16","author":"Wendelken","year":"2004","journal-title":"Connection Science"},{"key":"10.3233\/SW-223228_ref157","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.453"},{"key":"10.3233\/SW-223228_ref158","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1026"},{"key":"10.3233\/SW-223228_ref159","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.semeval-1.83"},{"key":"10.3233\/SW-223228_ref161","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33017370"},{"key":"10.3233\/SW-223228_ref162","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1016\/j.neunet.2018.06.012","article-title":"Learning to activate logic rules for textual reasoning","volume":"106","author":"Yao","year":"2018","journal-title":"Neural Networks"},{"key":"10.3233\/SW-223228_ref163","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2111.08164"},{"key":"10.3233\/SW-223228_ref164","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/j.aiopen.2021.03.001","article-title":"Neural, symbolic and neural-symbolic reasoning on knowledge graphs","volume":"2","author":"Zhang","year":"2021","journal-title":"AI Open"},{"key":"10.3233\/SW-223228_ref165","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.findings-emnlp.350"},{"key":"10.3233\/SW-223228_ref166","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-main.107"},{"key":"10.3233\/SW-223228_ref167","doi-asserted-by":"publisher","first-page":"2015","DOI":"10.1109\/TASLP.2021.3082295","article-title":"Relation extraction in dialogues: A\u00a0deep learning model based on the generality and specialty of dialogue text","volume":"29","author":"Zhou","year":"2021","journal-title":"IEEE\/ACM Transactions on Audio Speech and Language Processing"},{"issue":"1","key":"10.3233\/SW-223228_ref168","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1109\/JPROC.2020.3004555","article-title":"A comprehensive survey on transfer learning","volume":"109","author":"Zhuang","year":"2021","journal-title":"Proceedings of the IEEE"}],"container-title":["Semantic Web"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/SW-223228","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T05:26:48Z","timestamp":1777613208000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/SW-223228"}},"subtitle":[],"editor":[{"given":"Monireh","family":"Ebrahimi","sequence":"additional","affiliation":[{"name":"IBM, USA"}],"role":[{"vocabulary":"crossref","role":"editor"}]},{"given":"Pascal","family":"Hitzler","sequence":"additional","affiliation":[{"name":"Kansas State University, USA"}],"role":[{"vocabulary":"crossref","role":"editor"}]},{"given":"Md","family":"Kamruzzaman Sarker","sequence":"additional","affiliation":[{"name":"University of Hartford, USA"}],"role":[{"vocabulary":"crossref","role":"editor"}]},{"given":"Daria","family":"Stepanova","sequence":"additional","affiliation":[{"name":"Bosch Center for AI, Germany"}],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2024,10,4]]},"references-count":158,"journal-issue":{"issue":"4"},"URL":"https:\/\/doi.org\/10.3233\/sw-223228","relation":{},"ISSN":["2210-4968","1570-0844"],"issn-type":[{"value":"2210-4968","type":"electronic"},{"value":"1570-0844","type":"print"}],"subject":[],"published":{"date-parts":[[2024,10,4]]}}}