{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T16:39:04Z","timestamp":1779295144555,"version":"3.51.4"},"reference-count":79,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2019,5,21]],"date-time":"2019-05-21T00:00:00Z","timestamp":1558396800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61333018"],"award-info":[{"award-number":["61333018"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2019,12,31]]},"abstract":"<jats:p>Understanding causality in text is crucial for intelligent agents. In this article, inspired by human causality learning, we propose an experience-based causality learning framework. Comparing to traditional approaches, which attempt to handle the causality problem relying on textual clues and linguistic resources, we are the first to use experience information for causality learning. Specifically, we first construct various scenarios for intelligent agents, thus, the agents can gain experience from interaction in these scenarios. Then, human participants build a number of training instances for agents of causality learning based on these scenarios. Each instance contains two sentences and a label. Each sentence describes an event that an agent experienced in a scenario, and the label indicates whether the sentence (event) pair has a causal relation. Accordingly, we propose a model that can infer the causality in text using experience by accessing the corresponding event information based on the input sentence pair. Experiment results show that our method can achieve impressive performance on the grounded causality corpus and significantly outperform the conventional approaches. Our work suggests that experience is very important for intelligent agents to understand causality.<\/jats:p>","DOI":"10.1145\/3314943","type":"journal-article","created":{"date-parts":[[2019,5,23]],"date-time":"2019-05-23T18:01:38Z","timestamp":1558634498000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Experience-based Causality Learning for Intelligent Agents"],"prefix":"10.1145","volume":"18","author":[{"given":"Yang","family":"Liu","sequence":"first","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation Chinese Academy of Sciences, University of Chinese Academy of Sciences, Beijing"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shaonan","family":"Wang","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation Chinese Academy of Sciences, University of Chinese Academy of Sciences, Beijing"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiajun","family":"Zhang","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation Chinese Academy of Sciences, University of Chinese Academy of Sciences, Beijing"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chengqing","family":"Zong","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation Chinese Academy of Sciences, University of Chinese Academy of Sciences, CAS Center for Excellence in Brain Science and Intelligence Technology, Beijing"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,5,21]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v33i1.2322"},{"key":"e_1_2_1_2_1","unstructured":"Yoshua Bengio Hugo Larochelle Pascal Lamblin Dan Popovici Aaron Courville Clarence Simard Jerome Louradour and Dumitru Erhan. 2007. Deep architectures for baby AI. http:\/\/www.cs.toronto.edu\/~amnih\/cifar\/talks\/bengio_tutorial.pdf.  Yoshua Bengio Hugo Larochelle Pascal Lamblin Dan Popovici Aaron Courville Clarence Simard Jerome Louradour and Dumitru Erhan. 2007. Deep architectures for baby AI. http:\/\/www.cs.toronto.edu\/~amnih\/cifar\/talks\/bengio_tutorial.pdf."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1080\/0163853X.2017.1306677"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the 32nd AAAI Conference on Artificial Intelligence.","author":"Chaplot Devendra Singh","year":"2018"},{"key":"e_1_2_1_5_1","unstructured":"Maxime Chevalier-Boisvert Dzmitry Bahdanau Salem Lahlou Lucas Willems Chitwan Saharia Thien Huu Nguyen and Yoshua Bengio. 2018. BabyAI: First steps towards grounded language learning with a human in the loop. arXiv preprint arXiv:1810.08272.  Maxime Chevalier-Boisvert Dzmitry Bahdanau Salem Lahlou Lucas Willems Chitwan Saharia Thien Huu Nguyen and Yoshua Bengio. 2018. BabyAI: First steps towards grounded language learning with a human in the loop. arXiv preprint arXiv:1810.08272."},{"key":"e_1_2_1_6_1","unstructured":"Elizabeth Couper-Kuhlen and Bernd Kortmann. 2009. Cause-Condition-Concession-Contrast: Cognitive and Discourse Perspectives vol. 33. Walter de Gruyter.  Elizabeth Couper-Kuhlen and Bernd Kortmann. 2009. Cause-Condition-Concession-Contrast: Cognitive and Discourse Perspectives vol. 33. Walter de Gruyter."},{"key":"e_1_2_1_7_1","doi-asserted-by":"crossref","unstructured":"Martin Curd and Stathis Psillos. 2013. The Routledge Companion to Philosophy of Science. Routledge.  Martin Curd and Stathis Psillos. 2013. The Routledge Companion to Philosophy of Science. Routledge.","DOI":"10.4324\/9780203744857"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 2054--2063","author":"Das Abhishek","year":"2018"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 294--303","author":"Do Quang Xuan","year":"2011"},{"key":"e_1_2_1_10_1","first-page":"2121","article-title":"Adaptive subgradient methods for online learning and stochastic optimization","author":"Duchi John","year":"2011","journal-title":"J. Mach. Learn. Res. 12"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1171"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0093-934X(02)00517-5"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.3115\/1119312.1119322"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.111.1.3"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1037\/0012-1649.37.5.620"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-2789(90)90087-6"},{"key":"e_1_2_1_17_1","unstructured":"Karl Moritz Hermann Felix Hill Simon Green Fumin Wang Ryan Faulkner Hubert Soyer David Szepesvari Wojtek Czarnecki Max Jaderberg Denis Teplyashin etal 2017. Grounded language learning in a simulated 3D world. arXiv preprint arXiv:1706.06551.  Karl Moritz Hermann Felix Hill Simon Green Fumin Wang Ryan Faulkner Hubert Soyer David Szepesvari Wojtek Czarnecki Max Jaderberg Denis Teplyashin et al. 2017. Grounded language learning in a simulated 3D world. arXiv preprint arXiv:1706.06551."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1135"},{"key":"e_1_2_1_19_1","unstructured":"Felix Hill Karl Moritz Hermann Phil Blunsom and Stephen Clark. 2017. Understanding grounded language learning agents {J}. arXiv preprint arXiv:1710.09867.  Felix Hill Karl Moritz Hermann Phil Blunsom and Stephen Clark. 2017. Understanding grounded language learning agents {J}. arXiv preprint arXiv:1710.09867."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pragma.2017.10.010"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the 5th International Workshop on Natural Language Generation.","author":"Hovy Eduard H.","year":"1990"},{"key":"e_1_2_1_23_1","volume-title":"Seven Masterpieces of Philosophy","author":"Hume David"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00142"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the International Joint Conferences on Artificial Intelligence (IJCAI\u201916)","author":"Johnson Matthew","year":"2016"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K16-2003"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CIG.2016.7860433"},{"key":"e_1_2_1_28_1","unstructured":"Douwe Kiela Luana Bulat Anita L. Vero and Stephen Clark. 2016. Virtual embodiment: A scalable long-term strategy for artificial intelligence research. arXiv preprint arXiv:1610.07432.  Douwe Kiela Luana Bulat Anita L. Vero and Stephen Clark. 2016. Virtual embodiment: A scalable long-term strategy for artificial intelligence research. arXiv preprint arXiv:1610.07432."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.95.2.163"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2014.07.014"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0378-2166(98)00023-X"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1321"},{"key":"e_1_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Brenden M. Lake Tomer D. Ullman Joshua B. Tenenbaum and Samuel J. Gershman. 2017. Building machines that learn and think like people. Behav. Brain Sci. 40 (2017).  Brenden M. Lake Tomer D. Ullman Joshua B. Tenenbaum and Samuel J. Gershman. 2017. Building machines that learn and think like people. Behav. Brain Sci. 40 (2017).","DOI":"10.1017\/S0140525X16001837"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00986208"},{"key":"e_1_2_1_35_1","unstructured":"Angeliki Lazaridou Alexander Peysakhovich and Marco Baroni. 2016. Multi-agent cooperation and the emergence of (natural) language. arXiv preprint arXiv:1612.07182.  Angeliki Lazaridou Alexander Peysakhovich and Marco Baroni. 2016. Multi-agent cooperation and the emergence of (natural) language. arXiv preprint arXiv:1612.07182."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3028772"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.5555\/1699510.1699555"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 15th International Conference on Principles of Knowledge Representation and Reasoning. 421--430","author":"Luo Zhiyi","year":"2016"},{"key":"e_1_2_1_39_1","unstructured":"Minh-Thang Luong Eugene Brevdo and Rui Zhao. 2017. Neural machine translation (seq2seq) tutorial. Retrieved from https:\/\/github.com\/tensorflow\/nmt.  Minh-Thang Luong Eugene Brevdo and Rui Zhao. 2017. Neural machine translation (seq2seq) tutorial. Retrieved from https:\/\/github.com\/tensorflow\/nmt."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1080\/01638538609544632"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1515\/text.1.1988.8.3.243"},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the 12th International Conference on Computational Semantics (IWCS\u201917)","author":"Mart\u00ednez-C\u00e1mara Eugenio","year":"2017"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K16-2014"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the International Conference on Intelligent Text Processing and Computational Linguistics. Springer, 29--61","author":"Mikolov Tomas","year":"2016"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the International Conference on Language Resources and Evaluation (LREC\u201904)","author":"Miltsakaki Eleni"},{"key":"e_1_2_1_46_1","doi-asserted-by":"crossref","unstructured":"Volodymyr Mnih Koray Kavukcuoglu David Silver Andrei A. Rusu Joel Veness Marc G. Bellemare Alex Graves Martin Riedmiller Andreas K. Fidjeland Georg Ostrovski etal 2015. Human-level control through deep reinforcement learning. Nature 518 7540 (2015) 529--533.  Volodymyr Mnih Koray Kavukcuoglu David Silver Andrei A. Rusu Joel Veness Marc G. Bellemare Alex Graves Martin Riedmiller Andreas K. Fidjeland Georg Ostrovski et al. 2015. Human-level control through deep reinforcement learning. Nature 518 7540 (2015) 529--533.","DOI":"10.1038\/nature14236"},{"key":"e_1_2_1_47_1","unstructured":"Gerben Mulder. 2008. Understanding Causal Coherence Relations. Vol. 172. LOT.  Gerben Mulder. 2008. Understanding Causal Coherence Relations. Vol. 172. LOT."},{"key":"e_1_2_1_48_1","first-page":"355","article-title":"Mining learning and crafting scientific experiments: A literature review on the use of Minecraft in education and research","volume":"19","author":"Nebel Steve","year":"2016","journal-title":"J. Edu. Technol. Soc."},{"key":"e_1_2_1_49_1","unstructured":"Junhyuk Oh Valliappa Chockalingam Satinder Singh and Honglak Lee. 2016. Control of memory active perception and action in Minecraft. arXiv preprint arXiv:1605.09128.   Junhyuk Oh Valliappa Chockalingam Satinder Singh and Honglak Lee. 2016. Control of memory active perception and action in Minecraft. arXiv preprint arXiv:1605.09128."},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning. JMLR.org, 2661--2670","author":"Oh Junhyuk","year":"2017"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073135"},{"key":"e_1_2_1_52_1","doi-asserted-by":"crossref","unstructured":"Jean Piaget. 1970. Piaget\u2019s theory. Piaget and His School. Springer Berlin 11--23.  Jean Piaget. 1970. Piaget\u2019s theory. Piaget and His School. Springer Berlin 11--23.","DOI":"10.1007\/978-3-642-46323-5_2"},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of the International Conference on Computational Linguistics (COLING\u201908)","author":"Pitler Emily"},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the International Conference on Language Resources and Evaluation (LREC\u201908)","author":"Prasad Rashmi"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSC.2010.19"},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL\u201913)","author":"Riaz Mehwish","year":"2013"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-4322"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1210"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-1027"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K16-2007"},{"key":"e_1_2_1_61_1","volume-title":"Proceedings of the 1st International Symposium on the Exploration and Modelling of Meaning (ACTS\/SEM\u201905)","author":"Sanders Ted","year":"2005"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15326950dp2901_3"},{"key":"e_1_2_1_63_1","doi-asserted-by":"crossref","unstructured":"Ted J. M. Sanders Wilbert P. M. Spooren and Leo G. M. Noordman. 1993. Coherence Relations in a Cognitive Theory of Discourse Representation. De Gruyter Berlin.  Ted J. M. Sanders Wilbert P. M. Spooren and Leo G. M. Noordman. 1993. Coherence Relations in a Cognitive Theory of Discourse Representation. De Gruyter Berlin.","DOI":"10.1515\/cogl.1993.4.2.93"},{"key":"e_1_2_1_64_1","volume-title":"Int. Assoc. Dev. Info. Soc.","author":"Frederick Schifter Maria Moffat","year":"2013"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1037\/0012-1649.42.6.1103"},{"key":"e_1_2_1_66_1","volume-title":"Mazebase: A sandbox for learning from games. arXiv preprint arXiv:1511.07401.","author":"Sukhbaatar Sainbayar","year":"2015"},{"key":"e_1_2_1_67_1","unstructured":"Ilya Sutskever Oriol Vinyals and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems. 3104--3112.   Ilya Sutskever Oriol Vinyals and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems. 3104--3112."},{"key":"e_1_2_1_68_1","doi-asserted-by":"crossref","unstructured":"Francisco J. Varela Evan Thompson and Eleanor Rosch. 2017. The Embodied Mind: Cognitive Science and Human Experience. MIT Press.  Francisco J. Varela Evan Thompson and Eleanor Rosch. 2017. The Embodied Mind: Cognitive Science and Human Experience. MIT Press.","DOI":"10.7551\/mitpress\/9780262529365.001.0001"},{"key":"e_1_2_1_69_1","unstructured":"Georg Henrik Von Wright. 2004. Explanation and Understanding. Cornell University Press.  Georg Henrik Von Wright. 2004. Explanation and Understanding. Cornell University Press."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K16-2006"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.104.1.36"},{"key":"e_1_2_1_72_1","volume-title":"MASSACHUSETTS INST OF TECH CAMBRIDGE PROJECT MAC","author":"Winograd Terry","year":"1971"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0285(72)90002-3"},{"key":"e_1_2_1_74_1","unstructured":"Yi Wu Yuxin Wu Georgia Gkioxari and Yuandong Tian. 2018. Building generalizable agents with a realistic and rich 3D environment. arXiv preprint arXiv:1801.02209.  Yi Wu Yuxin Wu Georgia Gkioxari and Yuandong Tian. 2018. Building generalizable agents with a realistic and rich 3D environment. arXiv preprint arXiv:1801.02209."},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K15-2001"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K16-2001"},{"key":"e_1_2_1_77_1","unstructured":"Haonan Yu Haichao Zhang and Wei Xu. 2018. Interactive grounded language acquisition and generalization in a 2D world. arXiv preprint arXiv:1802.01433.  Haonan Yu Haichao Zhang and Wei Xu. 2018. Interactive grounded language acquisition and generalization in a 2D world. arXiv preprint arXiv:1802.01433."},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1109\/72.165591"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-014-9290-3"}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3314943","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3314943","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:02:03Z","timestamp":1750208523000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3314943"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,5,21]]},"references-count":79,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2019,12,31]]}},"alternative-id":["10.1145\/3314943"],"URL":"https:\/\/doi.org\/10.1145\/3314943","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"value":"2375-4699","type":"print"},{"value":"2375-4702","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,5,21]]},"assertion":[{"value":"2018-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-02-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-05-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}