{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:19:48Z","timestamp":1750220388029,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":32,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,8,14]],"date-time":"2021-08-14T00:00:00Z","timestamp":1628899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,14]]},"DOI":"10.1145\/3447548.3470803","type":"proceedings-article","created":{"date-parts":[[2021,8,12]],"date-time":"2021-08-12T06:12:03Z","timestamp":1628748723000},"page":"4076-4077","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["From Deep Learning to Deep Reasoning"],"prefix":"10.1145","author":[{"given":"Truyen","family":"Tran","sequence":"first","affiliation":[{"name":"Deakin University, Waurn Ponds, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vuong","family":"Le","sequence":"additional","affiliation":[{"name":"Deakin University, Waurn Ponds, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hung","family":"Le","sequence":"additional","affiliation":[{"name":"Deakin University, Waurn Ponds, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thao M.","family":"Le","sequence":"additional","affiliation":[{"name":"Deakin University, Waurn Ponds, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,8,14]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/873"},{"key":"e_1_3_2_1_2_1","volume-title":"Neuro-Symbolic Visual Reasoning: Disentangling\" Visual\" from\" Reasoning\". ICML","author":"Amizadeh Saeed","year":"2020","unstructured":"Saeed Amizadeh , Hamid Palangi , Oleksandr Polozov , Yichen Huang , and Kazuhito Koishida . 2020. Neuro-Symbolic Visual Reasoning: Disentangling\" Visual\" from\" Reasoning\". ICML ( 2020 ). Saeed Amizadeh, Hamid Palangi, Oleksandr Polozov, Yichen Huang, and Kazuhito Koishida. 2020. Neuro-Symbolic Visual Reasoning: Disentangling\" Visual\" from\" Reasoning\". ICML (2020)."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"crossref","unstructured":"Jacob Andreas Marcus Rohrbach Trevor Darrell and Dan Klein. 2016. Neural module networks. In CVPR. 39--48.  Jacob Andreas Marcus Rohrbach Trevor Darrell and Dan Klein. 2016. Neural module networks. In CVPR. 39--48.","DOI":"10.1109\/CVPR.2016.12"},{"key":"e_1_3_2_1_4_1","volume-title":"Harm de Vries, and Aaron Courville.","author":"Bahdanau Dzmitry","year":"2019","unstructured":"Dzmitry Bahdanau , Shikhar Murty , Michael Noukhovitch , Thien Huu Nguyen , Harm de Vries, and Aaron Courville. 2019 . Systematic generalization: what is required and can it be learned? ICLR ( 2019). Dzmitry Bahdanau, Shikhar Murty, Michael Noukhovitch, Thien Huu Nguyen, Harm de Vries, and Aaron Courville. 2019. Systematic generalization: what is required and can it be learned? ICLR (2019)."},{"key":"e_1_3_2_1_5_1","volume-title":"et almbox","author":"Battaglia Peter W","year":"2018","unstructured":"Peter W Battaglia , Jessica B Hamrick , Victor Bapst , Alvaro Sanchez-Gonzalez , Vinicius Zambaldi , Mateusz Malinowski , Andrea Tacchetti , David Raposo , Adam Santoro , Ryan Faulkner , et almbox . 2018 . Relational inductive biases, deep learning, and graph networks. arXiv preprint arXiv:1806.01261 (2018). Peter W Battaglia, Jessica B Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Vinicius Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro, Ryan Faulkner, et almbox. 2018. Relational inductive biases, deep learning, and graph networks. arXiv preprint arXiv:1806.01261 (2018)."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-013-5335-x"},{"volume-title":"The Stanford Encyclopedia of Philosophy fall 2019 ed.), , Edward N","author":"Buckner Cameron","key":"e_1_3_2_1_7_1","unstructured":"Cameron Buckner and James Garson . 2019. Connectionism . In The Stanford Encyclopedia of Philosophy fall 2019 ed.), , Edward N . Zalta (Ed.). Metaphysics Research Lab, Stanford University . Cameron Buckner and James Garson. 2019. Connectionism. In The Stanford Encyclopedia of Philosophy fall 2019 ed.), , Edward N. Zalta (Ed.). Metaphysics Research Lab, Stanford University."},{"key":"e_1_3_2_1_8_1","first-page":"4171","article-title":"BERT","volume":"2019","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT : Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of NAACL-HLT 2019 . 4171 -- 4186 . Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of NAACL-HLT 2019 . 4171--4186.","journal-title":"Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of NAACL-HLT"},{"volume-title":"Reasoning as memory","author":"Feeney Aidan","key":"e_1_3_2_1_9_1","unstructured":"Aidan Feeney and Valerie A Thompson . 2014. Reasoning as memory . Psychology Press . Aidan Feeney and Valerie A Thompson. 2014. Reasoning as memory .Psychology Press."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cobeha.2018.12.010"},{"key":"e_1_3_2_1_11_1","volume-title":"Edward Grefenstette, Tiago Ramalho, John Agapiou, et almbox.","author":"Graves Alex","year":"2016","unstructured":"Alex Graves , Greg Wayne , Malcolm Reynolds , Tim Harley , Ivo Danihelka , Agnieszka Grabska-Barwi'nska , Sergio G\u00f3mez Colmenarejo , Edward Grefenstette, Tiago Ramalho, John Agapiou, et almbox. 2016 . Hybrid computing using a neural network with dynamic external memory. Nature , Vol. 538 , 7626 (2016), 471--476. Alex Graves, Greg Wayne, Malcolm Reynolds, Tim Harley, Ivo Danihelka, Agnieszka Grabska-Barwi'nska, Sergio G\u00f3mez Colmenarejo, Edward Grefenstette, Tiago Ramalho, John Agapiou, et almbox. 2016. Hybrid computing using a neural network with dynamic external memory. Nature , Vol. 538, 7626 (2016), 471--476."},{"key":"e_1_3_2_1_12_1","volume-title":"On the Binding Problem in Artificial Neural Networks. arXiv preprint arXiv:2012.05208","author":"Greff Klaus","year":"2020","unstructured":"Klaus Greff , Sjoerd van Steenkiste , and J\u00fcrgen Schmidhuber . 2020. On the Binding Problem in Artificial Neural Networks. arXiv preprint arXiv:2012.05208 ( 2020 ). Klaus Greff, Sjoerd van Steenkiste, and J\u00fcrgen Schmidhuber. 2020. On the Binding Problem in Artificial Neural Networks. arXiv preprint arXiv:2012.05208 (2020)."},{"key":"e_1_3_2_1_13_1","unstructured":"Drew Hudson and Christopher D Manning. 2019. Learning by abstraction: The neural state machine. In NeurIPS. 5901--5914.  Drew Hudson and Christopher D Manning. 2019. Learning by abstraction: The neural state machine. In NeurIPS. 5901--5914."},{"key":"e_1_3_2_1_14_1","volume-title":"Compositional Attention Networks for Machine Reasoning. ICLR","author":"Hudson Drew A","year":"2018","unstructured":"Drew A Hudson and Christopher D Manning . 2018. Compositional Attention Networks for Machine Reasoning. ICLR ( 2018 ). Drew A Hudson and Christopher D Manning. 2018. Compositional Attention Networks for Machine Reasoning. ICLR (2018)."},{"key":"e_1_3_2_1_15_1","unstructured":"Daniel Kahneman. 2011. Thinking fast and slow .Farrar Straus and Giroux New York.  Daniel Kahneman. 2011. Thinking fast and slow .Farrar Straus and Giroux New York."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/265910.265918"},{"key":"e_1_3_2_1_17_1","volume-title":"Relational memory and the hippocampus: representations and methods. Frontiers in neuroscience","author":"Konkel Alex","year":"2009","unstructured":"Alex Konkel and Neal J Cohen . 2009. Relational memory and the hippocampus: representations and methods. Frontiers in neuroscience , Vol. 3 ( 2009 ), 23. Alex Konkel and Neal J Cohen. 2009. Relational memory and the hippocampus: representations and methods. Frontiers in neuroscience , Vol. 3 (2009), 23."},{"key":"e_1_3_2_1_18_1","volume-title":"Neural Stored-program Memory. In ICLR 2020: Proceedings of the 8th International Conference on Learning Representations .","author":"Le Hung","year":"2020","unstructured":"Hung Le , Truyen Tran , and Svetha Venkatesh . 2020 c . Neural Stored-program Memory. In ICLR 2020: Proceedings of the 8th International Conference on Learning Representations . Hung Le, Truyen Tran, and Svetha Venkatesh. 2020 c. Neural Stored-program Memory. In ICLR 2020: Proceedings of the 8th International Conference on Learning Representations ."},{"key":"e_1_3_2_1_19_1","first-page":"5682","article-title":"d. Self-Attentive Associative Memory","volume":"119","author":"Le Hung","year":"2020","unstructured":"Hung Le , Truyen Tran , and Svetha Venkatesh . 2020 d. Self-Attentive Associative Memory . In ICML , Vol. 119. 5682 -- 5691 . Hung Le, Truyen Tran, and Svetha Venkatesh. 2020 d. Self-Attentive Associative Memory. In ICML, Vol. 119. 5682--5691.","journal-title":"ICML"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Thao Minh Le Vuong Le Svetha Venkatesh and Truyen Tran. 2020 a. Dynamic language binding in relational visual reasoning. In IJCAI. 818--824.  Thao Minh Le Vuong Le Svetha Venkatesh and Truyen Tran. 2020 a. Dynamic language binding in relational visual reasoning. In IJCAI. 818--824.","DOI":"10.24963\/ijcai.2020\/114"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN48605.2020.9207580"},{"key":"e_1_3_2_1_22_1","volume-title":"Self-supervised learning: Generative or contrastive. arXiv preprint arXiv:2006.08218","author":"Liu Xiao","year":"2020","unstructured":"Xiao Liu , Fanjin Zhang , Zhenyu Hou , Zhaoyu Wang , Li Mian , Jing Zhang , and Jie Tang . 2020. Self-supervised learning: Generative or contrastive. arXiv preprint arXiv:2006.08218 , Vol. 1 , 2 ( 2020 ). Xiao Liu, Fanjin Zhang, Zhenyu Hou, Zhaoyu Wang, Li Mian, Jing Zhang, and Jie Tang. 2020. Self-supervised learning: Generative or contrastive. arXiv preprint arXiv:2006.08218 , Vol. 1, 2 (2020)."},{"key":"e_1_3_2_1_23_1","unstructured":"Rasmus Palm Ulrich Paquet and Ole Winther. 2018. Recurrent relational networks. In NeurIPS. 3368--3378.  Rasmus Palm Ulrich Paquet and Ole Winther. 2018. Recurrent relational networks. In NeurIPS. 3368--3378."},{"key":"e_1_3_2_1_24_1","volume-title":"Vincent Dumoulin, and Aaron Courville.","author":"Perez Ethan","year":"2018","unstructured":"Ethan Perez , Florian Strub , Harm De Vries , Vincent Dumoulin, and Aaron Courville. 2018 . Film : Visual reasoning with a general conditioning layer. In AAAI . Ethan Perez, Florian Strub, Harm De Vries, Vincent Dumoulin, and Aaron Courville. 2018. Film: Visual reasoning with a general conditioning layer. In AAAI ."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i1.10851"},{"key":"e_1_3_2_1_26_1","volume-title":"Relational recurrent neural networks. NIPS","author":"Santoro Adam","year":"2018","unstructured":"Adam Santoro , Ryan Faulkner , David Raposo , Jack Rae , Mike Chrzanowski , Theophane Weber , Daan Wierstra , Oriol Vinyals , Razvan Pascanu , and Timothy Lillicrap . 2018. Relational recurrent neural networks. NIPS ( 2018 ). Adam Santoro, Ryan Faulkner, David Raposo, Jack Rae, Mike Chrzanowski, Theophane Weber, Daan Wierstra, Oriol Vinyals, Razvan Pascanu, and Timothy Lillicrap. 2018. Relational recurrent neural networks. NIPS (2018)."},{"key":"e_1_3_2_1_27_1","unstructured":"Adam Santoro David Raposo David G Barrett Mateusz Malinowski Razvan Pascanu Peter Battaglia and Tim Lillicrap. 2017. A simple neural network module for relational reasoning. In NIPS. 4974--4983.  Adam Santoro David Raposo David G Barrett Mateusz Malinowski Razvan Pascanu Peter Battaglia and Tim Lillicrap. 2017. A simple neural network module for relational reasoning. In NIPS. 4974--4983."},{"key":"e_1_3_2_1_28_1","volume-title":"Bidirectional attention flow for machine comprehension. ICLR","author":"Seo Minjoon","year":"2017","unstructured":"Minjoon Seo , Aniruddha Kembhavi , Ali Farhadi , and Hannaneh Hajishirzi . 2017. Bidirectional attention flow for machine comprehension. ICLR ( 2017 ). Minjoon Seo, Aniruddha Kembhavi, Ali Farhadi, and Hannaneh Hajishirzi. 2017. Bidirectional attention flow for machine comprehension. ICLR (2017)."},{"key":"e_1_3_2_1_29_1","volume-title":"End-To-End Memory Networks. NIPS","author":"Sukhbaatar Sainbayar","year":"2015","unstructured":"Sainbayar Sukhbaatar , Arthur Szlam , Jason Weston , and Rob Fergus . 2015. End-To-End Memory Networks. NIPS ( 2015 ). Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston, and Rob Fergus. 2015. End-To-End Memory Networks. NIPS (2015)."},{"key":"e_1_3_2_1_30_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez \u0141ukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems. 5998--6008.  Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez \u0141ukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems. 5998--6008."},{"key":"e_1_3_2_1_31_1","volume-title":"Graph Attention Networks. ICLR","author":"Petar Velivc","year":"2018","unstructured":"Petar Velivc kovi\u0107 , Guillem Cucurull , Arantxa Casanova , Adriana Romero , Pietro Li\u00f2 , and Yoshua Bengio . 2018. Graph Attention Networks. ICLR ( 2018 ). Petar Velivc kovi\u0107 , Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Li\u00f2, and Yoshua Bengio. 2018. Graph Attention Networks. ICLR (2018)."},{"key":"e_1_3_2_1_32_1","volume-title":"What Can Neural Networks Reason About? arXiv preprint arXiv:1905.13211","author":"Xu Keyulu","year":"2019","unstructured":"Keyulu Xu , Jingling Li , Mozhi Zhang , Simon S Du , Ken-ichi Kawarabayashi, and Stefanie Jegelka . 2019. What Can Neural Networks Reason About? arXiv preprint arXiv:1905.13211 ( 2019 ). Keyulu Xu, Jingling Li, Mozhi Zhang, Simon S Du, Ken-ichi Kawarabayashi, and Stefanie Jegelka. 2019. What Can Neural Networks Reason About? arXiv preprint arXiv:1905.13211 (2019)."}],"event":{"name":"KDD '21: The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"],"location":"Virtual Event Singapore","acronym":"KDD '21"},"container-title":["Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery &amp; Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447548.3470803","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447548.3470803","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:32Z","timestamp":1750191512000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447548.3470803"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,14]]},"references-count":32,"alternative-id":["10.1145\/3447548.3470803","10.1145\/3447548"],"URL":"https:\/\/doi.org\/10.1145\/3447548.3470803","relation":{},"subject":[],"published":{"date-parts":[[2021,8,14]]},"assertion":[{"value":"2021-08-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}