{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:49:39Z","timestamp":1760028579303,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,2,7]],"date-time":"2020-02-07T00:00:00Z","timestamp":1581033600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1849231"],"award-info":[{"award-number":["1849231"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,2,7]]},"DOI":"10.1145\/3375627.3375825","type":"proceedings-article","created":{"date-parts":[[2020,2,5]],"date-time":"2020-02-05T01:10:22Z","timestamp":1580865022000},"page":"124-130","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Learning Norms from Stories"],"prefix":"10.1145","author":[{"given":"Md Sultan Al","family":"Nahian","sequence":"first","affiliation":[{"name":"University of Kentucky, Lexington, KY, USA"}]},{"given":"Spencer","family":"Frazier","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}]},{"given":"Mark","family":"Riedl","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}]},{"given":"Brent","family":"Harrison","sequence":"additional","affiliation":[{"name":"University of Kentucky, Lexington, KY, USA"}]}],"member":"320","published-online":{"date-parts":[[2020,2,7]]},"reference":[{"volume-title":"AAAI Workshop: AI, Ethics, and Society.","author":"Abel David","key":"e_1_3_2_1_1_1","unstructured":"David Abel, James MacGlashan, and Michael L. Littman. 2016. Reinforcement Learning as a Framework for Ethical Decision Making. In AAAI Workshop: AI, Ethics, and Society."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33486-3_8"},{"key":"e_1_3_2_1_3_1","volume-title":"Riedl","author":"Ammanabrolu Prithviraj","year":"2019","unstructured":"Prithviraj Ammanabrolu, Ethan Tien, Wesley Cheung, Zhaochen Luo, William L. White Ma, Lara J. Martin, and Mark O. Riedl. 2019. Story Realization: Expanding Plot Events into Sentences. ArXiv abs\/1909.03480 (2019)."},{"key":"e_1_3_2_1_4_1","volume-title":"AAAI Workshop: AI, Ethics, and Society.","author":"Arnold Thomas","year":"2017","unstructured":"Thomas Arnold, Daniel Kasenberg, and Matthias Scheutz. 2017. Value Alignment or Misalignment - What Will Keep Systems Accountable?. In AAAI Workshop: AI, Ethics, and Society."},{"volume-title":"The grammar of society: The nature and dynamics of social norms","author":"Bicchieri Cristina","key":"e_1_3_2_1_5_1","unstructured":"Cristina Bicchieri. 2005. The grammar of society: The nature and dynamics of social norms. Cambridge University Press."},{"key":"e_1_3_2_1_6_1","volume-title":"Superintelligence: Paths, Dangers, Strategies.","author":"Bostrom Nick","year":"2014","unstructured":"Nick Bostrom. 2014. Superintelligence: Paths, Dangers, Strategies. (2014)."},{"key":"e_1_3_2_1_7_1","unstructured":"Paul F Christiano Jan Leike Tom Brown Miljan Martic Shane Legg and Dario Amodei. 2017. Deep reinforcement learning from human preferences. In Advances in Neural Information Processing Systems. 4299--4307."},{"key":"e_1_3_2_1_8_1","volume-title":"Plotto: The Master Book of All Plots","author":"Cook William Wallace","year":"1920","unstructured":"William Wallace Cook. 1920. Plotto: The Master Book of All Plots. Tin House Books."},{"key":"e_1_3_2_1_9_1","volume-title":"Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context. CoRR abs\/1901.02860","author":"Dai Zihang","year":"2019","unstructured":"Zihang Dai, Zhilin Yang, Yiming Yang, Jaime G. Carbonell, Quoc V. Le, and Ruslan Salakhutdinov. 2019. Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context. CoRR abs\/1901.02860 (2019). arXiv:1901.02860 http:\/\/arxiv.org\/abs\/1901.02860"},{"key":"e_1_3_2_1_10_1","unstructured":"Morteza Dehghani Emmett Tomai Kenneth D Forbus and Matthew Klenk. 2008. An Integrated Reasoning Approach to Moral Decision-Making.. In AAAI. 1280--1286."},{"key":"e_1_3_2_1_11_1","volume-title":"Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)."},{"key":"e_1_3_2_1_12_1","volume-title":"Mathewson","author":"Eger Markus","year":"2018","unstructured":"Markus Eger and Kory W. Mathewson. 2018. dAIrector: Automatic Story Beat Generation through Knowledge Synthesis. CoRR abs\/1811.03423 (2018)."},{"key":"e_1_3_2_1_13_1","unstructured":"Dylan Hadfield-Menell Stuart J Russell Pieter Abbeel and Anca Dragan. 2016. Cooperative inverse reinforcement learning. In Advances in neural information processing systems."},{"key":"e_1_3_2_1_14_1","volume-title":"Twelfth Artificial Intelligence and Interactive Digital Entertainment Conference.","author":"Harrison Brent","year":"2016","unstructured":"Brent Harrison and Mark O Riedl. 2016. Learning from stories: using crowdsourced narratives to train virtual agents. In Twelfth Artificial Intelligence and Interactive Digital Entertainment Conference."},{"key":"e_1_3_2_1_15_1","unstructured":"Jonathan Ho and Stefano Ermon. 2016. Generative adversarial imitation learning. In Advances in neural information processing systems. 4565--4573."},{"key":"e_1_3_2_1_16_1","unstructured":"Mark K Ho Michael Littman James MacGlashan Fiery Cushman and Joseph L Austerweil. 2016. Showing versus doing: Teaching by demonstration. In Advances in neural information processing systems. 3027--3035."},{"key":"e_1_3_2_1_17_1","volume-title":"Bidirectional LSTM-CRF models for sequence tagging. arXiv preprint arXiv:1508.01991","author":"Huang Zhiheng","year":"2015","unstructured":"Zhiheng Huang, Wei Xu, and Kai Yu. 2015. Bidirectional LSTM-CRF models for sequence tagging. arXiv preprint arXiv:1508.01991 (2015)."},{"volume-title":"Advances in Neural Information Processing Systems 28","author":"Johnson Rie","key":"e_1_3_2_1_18_1","unstructured":"Rie Johnson and Tong Zhang. 2015. Semi-supervised Convolutional Neural Networks for Text Categorization via Region Embedding. In Advances in Neural Information Processing Systems 28, C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama, and R. Garnett (Eds.). Curran Associates, Inc., 919--927."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1"},{"key":"e_1_3_2_1_20_1","volume-title":"com: A versatile crowdsourcing data acquisition platform for the behavioral sciences. Behavior research methods 49, 2","author":"Litman Leib","year":"2017","unstructured":"Leib Litman, Jonathan Robinson, and Tzvi Abberbock. 2017. TurkPrime. com: A versatile crowdsourcing data acquisition platform for the behavioral sciences. Behavior research methods 49, 2 (2017), 433--442."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2006.80"},{"key":"e_1_3_2_1_22_1","first-page":"2","article-title":"Algorithms for inverse reinforcement learning","volume":"1","author":"Ng Andrew Y","year":"2000","unstructured":"Andrew Y Ng, Stuart J Russell, et al. 2000. Algorithms for inverse reinforcement learning.. In Icml, Vol. 1. 2.","journal-title":"Icml"},{"key":"e_1_3_2_1_23_1","volume-title":"Manning","author":"Pennington Jeffrey","year":"2014","unstructured":"Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. GloVe: Global Vectors for Word Representation. In Empirical Methods in Natural Language Processing (EMNLP). 1532--1543. http:\/\/www.aclweb.org\/anthology\/ D14--1162"},{"key":"e_1_3_2_1_24_1","volume-title":"Computational Narrative Intelligence: A Human-Centered Goal for Artificial Intelligence. CoRR abs\/1602.06484","author":"Riedl Mark O.","year":"2016","unstructured":"Mark O. Riedl. 2016. Computational Narrative Intelligence: A Human-Centered Goal for Artificial Intelligence. CoRR abs\/1602.06484 (2016). arXiv:1602.06484 http:\/\/arxiv.org\/abs\/1602.06484"},{"key":"e_1_3_2_1_25_1","volume-title":"Workshops at the Thirtieth AAAI Conference on Artificial Intelligence.","author":"Riedl Mark O","year":"2016","unstructured":"Mark O Riedl and Brent Harrison. 2016. Using stories to teach human values to artificial agents. In Workshops at the Thirtieth AAAI Conference on Artificial Intelligence."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v36i4.2577"},{"key":"e_1_3_2_1_27_1","volume-title":"Human Compatible: Artificial Intelligence and the Problem of Con","author":"Russell Stuart J","year":"2019","unstructured":"Stuart J Russell. 2019. Human Compatible: Artificial Intelligence and the Problem of Con. Viking (October 8, 2019)."},{"key":"e_1_3_2_1_28_1","unstructured":"Stefan Schaal. 1997. Learning from demonstration. In Advances in neural information processing systems. 1040--1046."},{"key":"e_1_3_2_1_29_1","volume-title":"The value learning problem","author":"Soares Nate","year":"2015","unstructured":"Nate Soares. 2015. The value learning problem. Machine Intelligence Research Institute, Berkley (2015)."},{"key":"e_1_3_2_1_30_1","volume-title":"Aligning superintelligence with human interests: A technical research agenda","author":"Soares Nate","year":"2014","unstructured":"Nate Soares and Benja Fallenstein. 2014. Aligning superintelligence with human interests: A technical research agenda. Machine Intelligence Research Institute technical report 8 (2014)."},{"key":"e_1_3_2_1_31_1","volume-title":"Third-person imitation learning. arXiv preprint arXiv:1703.01703","author":"Stadie Bradly C","year":"2017","unstructured":"Bradly C Stadie, Pieter Abbeel, and Ilya Sutskever. 2017. Third-person imitation learning. arXiv preprint arXiv:1703.01703 (2017)."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12559-012-9181-0"},{"key":"e_1_3_2_1_33_1","volume-title":"Alignment for advanced machine learning systems","author":"Taylor Jessica","year":"2016","unstructured":"Jessica Taylor, Eliezer Yudkowsky, Patrick LaVictoire, and Andrew Critch. 2016. Alignment for advanced machine learning systems. Machine Intelligence Research Institute (2016)."},{"key":"e_1_3_2_1_34_1","volume-title":"Efficient Supervision for Robot Learning Via Imitation, Simulation, and Adaptation. KI - K\u00fcnstliche Intelligenz","author":"Wulfmeier Markus","year":"2019","unstructured":"Markus Wulfmeier. 2019. Efficient Supervision for Robot Learning Via Imitation, Simulation, and Adaptation. KI - K\u00fcnstliche Intelligenz (2019), 1--5."},{"key":"e_1_3_2_1_35_1","volume-title":"Le","author":"Yang Zhilin","year":"2019","unstructured":"Zhilin Yang, Zihang Dai, Yiming Yang, Jaime G. Carbonell, Ruslan Salakhutdinov, and Quoc V. Le. 2019. XLNet: Generalized Autoregressive Pretraining for Language Understanding. CoRR abs\/1906.08237 (2019). arXiv:1906.08237 http:\/\/arxiv.org\/abs\/1906.08237"},{"key":"e_1_3_2_1_36_1","volume-title":"Fine-Tuning Language Models from Human Preferences. arXiv preprint arXiv:1909.08593","author":"Ziegler Daniel M","year":"2019","unstructured":"Daniel M Ziegler, Nisan Stiennon, JeffreyWu, Tom B Brown, Alec Radford, Dario Amodei, Paul Christiano, and Geoffrey Irving. 2019. Fine-Tuning Language Models from Human Preferences. arXiv preprint arXiv:1909.08593 (2019)."},{"key":"e_1_3_2_1_37_1","volume-title":"Transfer learning for low-resource neural machine translation. arXiv preprint arXiv:1604.02201","author":"Zoph Barret","year":"2016","unstructured":"Barret Zoph, Deniz Yuret, Jonathan May, and Kevin Knight. 2016. Transfer learning for low-resource neural machine translation. arXiv preprint arXiv:1604.02201 (2016)."}],"event":{"name":"AIES '20: AAAI\/ACM Conference on AI, Ethics, and Society","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence"],"location":"New York NY USA","acronym":"AIES '20"},"container-title":["Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3375627.3375825","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3375627.3375825","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3375627.3375825","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:14Z","timestamp":1750199894000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3375627.3375825"}},"subtitle":["A Prior for Value Aligned Agents"],"short-title":[],"issued":{"date-parts":[[2020,2,7]]},"references-count":37,"alternative-id":["10.1145\/3375627.3375825","10.1145\/3375627"],"URL":"https:\/\/doi.org\/10.1145\/3375627.3375825","relation":{},"subject":[],"published":{"date-parts":[[2020,2,7]]},"assertion":[{"value":"2020-02-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}