{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T01:07:42Z","timestamp":1776128862963,"version":"3.50.1"},"reference-count":62,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,5,29]],"date-time":"2023-05-29T00:00:00Z","timestamp":1685318400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,5,29]],"date-time":"2023-05-29T00:00:00Z","timestamp":1685318400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004752","name":"State Government of Victoria","doi-asserted-by":"publisher","award":["Through my involvement with the Murdoch Children\u2019s Research Institute"],"award-info":[{"award-number":["Through my involvement with the Murdoch Children\u2019s Research Institute"]}],"id":[{"id":"10.13039\/501100004752","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004752","name":"State Government of Victoria","doi-asserted-by":"publisher","award":["I received funding through from the Victorian State Government through the Operational Infrastructure Support (OIS) Program"],"award-info":[{"award-number":["I received funding through from the Victorian State Government through the Operational Infrastructure Support (OIS) Program"]}],"id":[{"id":"10.13039\/501100004752","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001782","name":"University of Melbourne","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001782","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ethics Inf Technol"],"published-print":{"date-parts":[[2023,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>AI researchers have developed sophisticated language models capable of generating paragraphs of 'synthetic text' on topics specified by the user. While AI text generation has legitimate benefits, it could also be misused, potentially to grave effect. For example, AI text generators could be used to automate the production of convincing fake news, or to inundate social media platforms with machine-generated disinformation. This paper argues that AI text generators should be conceptualised as a dual-use technology, outlines some relevant lessons from earlier debates on dual-use life sciences research, and calls for closer collaboration between ethicists and the machine learning community to address AI language models\u2019 dual-use implications.<\/jats:p>","DOI":"10.1007\/s10676-023-09703-z","type":"journal-article","created":{"date-parts":[[2023,5,29]],"date-time":"2023-05-29T04:02:13Z","timestamp":1685332933000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["Dual-use implications of AI text generation"],"prefix":"10.1007","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2752-7334","authenticated-orcid":false,"given":"Julian J.","family":"Koplin","sequence":"first","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,5,29]]},"reference":[{"key":"9703_CR1","unstructured":"Brundage, M., Avin, S., Clark, J., Toner, H., Eckersley, P., Garfinkel, B., Dafoe, A., Scharre, P., Zeitzoff, T., & Filar, B. (2018). The malicious use of artificial intelligence: Forecasting, prevention, and mitigation. arXiv preprint. http:\/\/arxiv.org\/abs\/1802.07228"},{"issue":"1","key":"9703_CR2","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1017\/S1351324920000601","volume":"27","author":"R Dale","year":"2021","unstructured":"Dale, R. (2021). GPT-3: What\u2019s it good for? Natural Language Engineering, 27(1), 113\u2013118.","journal-title":"Natural Language Engineering"},{"issue":"11","key":"9703_CR3","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1136\/jme.2010.038232","volume":"36","author":"T Douglas","year":"2010","unstructured":"Douglas, T., & Savulescu, J. (2010). Synthetic biology and the ethics of knowledge. Journal of Medical Ethics, 36(11), 687\u2013693.","journal-title":"Journal of Medical Ethics"},{"key":"9703_CR4","doi-asserted-by":"crossref","unstructured":"Evans, N. G. (2013). Contrasting dual-use issues in biology and nuclear science. In B. Rappert & M. Selgelid (Eds.), On the dual uses of science and ethics. ANU Press.","DOI":"10.22459\/DUSE.12.2013.16"},{"issue":"11","key":"9703_CR5","doi-asserted-by":"publisher","first-page":"901","DOI":"10.1136\/medethics-2014-102619","volume":"41","author":"NG Evans","year":"2015","unstructured":"Evans, N. G., Lipsitch, M., & Levinson, M. (2015). The ethics of biosafety considerations in gain-of-function research resulting in the creation of potential pandemic pathogens. Journal of Medical Ethics, 41(11), 901\u2013908.","journal-title":"Journal of Medical Ethics"},{"key":"9703_CR250","unstructured":"Flick, D. 2018. \"Combatting Fake News: Alternatives to Limiting Social Media Misinformation and Rehabilitating Quality Journalism.\" SMU Science and Technology Law Review. 20(2): 375\u2013405."},{"issue":"4","key":"9703_CR6","doi-asserted-by":"publisher","first-page":"681","DOI":"10.1007\/s11023-020-09548-1","volume":"30","author":"L Floridi","year":"2020","unstructured":"Floridi, L., & Chiriatti, M. (2020). GPT-3: Its nature, scope, limits, and consequences. Minds and Machines, 30(4), 681\u2013694.","journal-title":"Minds and Machines"},{"key":"9703_CR300","doi-asserted-by":"crossref","unstructured":"Forge, J. (2013). Responsible Dual Use. In B. Rappert & M. Selgelid (Eds.), On the dual uses of science and ethics. ANU Press.","DOI":"10.22459\/DUSE.12.2013.08"},{"issue":"1","key":"9703_CR7","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1111\/j.1467-9760.2006.00237.x","volume":"14","author":"SM Gardiner","year":"2006","unstructured":"Gardiner, S. M. (2006). A core precautionary principle. Journal of Political Philosophy, 14(1), 33\u201360.","journal-title":"Journal of Political Philosophy"},{"key":"9703_CR8","unstructured":"Gokaslan, A., & Cohen, V. (2019). OpenGPT-2: We replicated GPT-2 because you can too. Medium, August 23."},{"issue":"1","key":"9703_CR9","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1007\/s11023-020-09517-8","volume":"30","author":"T Hagendorff","year":"2020","unstructured":"Hagendorff, T. (2020). The ethics of AI ethics: An evaluation of guidelines. Minds and Machines, 30(1), 99\u2013120.","journal-title":"Minds and Machines"},{"issue":"3","key":"9703_CR10","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1023\/A:1026005915919","volume":"59","author":"SO Hansson","year":"2003","unstructured":"Hansson, S. O. (2003). Ethical criteria of risk acceptance. Erkenntnis, 59(3), 291\u2013309.","journal-title":"Erkenntnis"},{"issue":"5","key":"9703_CR11","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1007\/s10677-010-9232-0","volume":"13","author":"SO Hansson","year":"2010","unstructured":"Hansson, S. O. (2010). The harmful influence of decision theory on ethics. Ethical Theory and Moral Practice, 13(5), 585\u2013593.","journal-title":"Ethical Theory and Moral Practice"},{"issue":"7","key":"9703_CR12","doi-asserted-by":"publisher","first-page":"479","DOI":"10.1111\/bioe.12255","volume":"30","author":"J Herington","year":"2016","unstructured":"Herington, J. (2016). Health security and risk aversion. Bioethics, 30(7), 479\u2013489.","journal-title":"Bioethics"},{"key":"9703_CR13","doi-asserted-by":"crossref","unstructured":"Hovy, D. (2016). The enemy in your own camp: How well can we detect statistically-generated fake reviews\u2014An adversarial study. In Proceedings of the 54th annual meeting of the Association for Computational Linguistics (Volume 2: Short Papers).","DOI":"10.18653\/v1\/P16-2057"},{"key":"9703_CR14","doi-asserted-by":"crossref","unstructured":"Hovy, D., & Spruit, S. L. (2016). The social impact of natural language processing. In Proceedings of the 54th annual meeting of the Association for Computational Linguistics (Volume 2: Short Papers).","DOI":"10.18653\/v1\/P16-2096"},{"issue":"9","key":"9703_CR15","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1038\/s42256-019-0088-2","volume":"1","author":"A Jobin","year":"2019","unstructured":"Jobin, A., Ienca, M., & Vayena, E. (2019). The global landscape of AI ethics guidelines. Nature Machine Intelligence, 1(9), 389\u2013399.","journal-title":"Nature Machine Intelligence"},{"key":"9703_CR16","first-page":"20","volume":"29","author":"T Kimura","year":"2013","unstructured":"Kimura, T. (2013). Applying Taurek\u2019s \u2018Should the numbers count?\u2019 to (un)justify Hiroshima and Nagasaki: A combination of historiography and applied ethics. Flinders Journal of History and Politics, 29, 20\u201340.","journal-title":"Flinders Journal of History and Politics"},{"key":"9703_CR17","unstructured":"Koplin, J. (2019). The very human language of AI. Pursuit, September 8."},{"issue":"1","key":"9703_CR18","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1111\/bioe.12609","volume":"34","author":"J Koplin","year":"2019","unstructured":"Koplin, J., Savulescu, J., & Gyngell, C. (2019). Germline gene editing and the precautionary principle. Bioethics, 34(1), 49\u201359.","journal-title":"Bioethics"},{"key":"9703_CR19","unstructured":"Kreps, S., & McCain, M. (2019). Not your father's bots: AI is making fake news look real. Foreign Affairs, August 2."},{"issue":"1","key":"9703_CR20","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1177\/1747016113478517","volume":"9","author":"F Kuhlau","year":"2013","unstructured":"Kuhlau, F., H\u00f6glund, A. T., Eriksson, S., & Evers, K. (2013). The ethics of disseminating dual-use knowledge. Research Ethics, 9(1), 6\u201319.","journal-title":"Research Ethics"},{"key":"9703_CR21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.47289\/AIEJ20200916","volume":"1","author":"K LaGrandeur","year":"2020","unstructured":"LaGrandeur, K. (2020). How safe is our reliance on AI, and should we regulate it? AI and Ethics, 1, 1\u20137.","journal-title":"AI and Ethics"},{"issue":"6380","key":"9703_CR22","doi-asserted-by":"publisher","first-page":"1094","DOI":"10.1126\/science.aao2998","volume":"359","author":"DMJ Lazer","year":"2018","unstructured":"Lazer, D. M. J., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., Metzger, M. J., Nyhan, B., Pennycook, G., & Rothschild, D. (2018). The science of fake news. Science, 359(6380), 1094\u20131096.","journal-title":"Science"},{"key":"9703_CR23","doi-asserted-by":"crossref","unstructured":"Lee, J.-S., & Hsiang, J. (2019). Patent claim generation by fine-tuning OpenAI GPT-2. arXiv preprint. http:\/\/arxiv.org\/abs\/1907.02052","DOI":"10.1016\/j.wpi.2020.101983"},{"key":"9703_CR24","doi-asserted-by":"crossref","unstructured":"Leidner, J. L., & Plachouras, V. (2017). Ethical by design: Ethics best practices for natural language processing. In Proceedings of the First ACL workshop on ethics in natural language processing.","DOI":"10.18653\/v1\/W17-1604"},{"key":"9703_CR25","unstructured":"Lowe, R. (2019). OpenAI\u2019s GPT-2: The model, the hype, and the controversy. KDnuggets. https:\/\/www.kdnuggets.com\/2019\/03\/openai-gpt-2-model-hype-controversy.html"},{"key":"9703_CR26","unstructured":"Marcus, G., & Davis, E. (2020). GPT-3, Bloviator: OpenAI\u2019s language generator has no idea what it\u2019s talking about. MIT Technology Review."},{"key":"9703_CR27","doi-asserted-by":"crossref","unstructured":"McNamara, A., Smith, J., & Murphy-Hill, E. (2018). Does ACM\u2019s code of ethics change ethical decision making in software development? In Proceedings of the 2018 26th ACM joint meeting on European software engineering conference and symposium on the foundations of software engineering, 2018.","DOI":"10.1145\/3236024.3264833"},{"issue":"2","key":"9703_CR28","doi-asserted-by":"publisher","first-page":"121","DOI":"10.2307\/2538830","volume":"10","author":"RE Miles Jr","year":"1985","unstructured":"Miles, R. E., Jr. (1985). Hiroshima: The strange myth of half a million American lives saved. International Security, 10(2), 121\u2013140.","journal-title":"International Security"},{"key":"9703_CR29","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-92606-3","volume-title":"Dual use science and technology, ethics and weapons of mass destruction","author":"S Miller","year":"2018","unstructured":"Miller, S. (2018). Dual use science and technology, ethics and weapons of mass destruction. Springer."},{"key":"9703_CR30","unstructured":"National Institutes of Health. (2017). Framework for guiding funding decisions about proposed research involving enhanced potential pandemic pathogens. NIH."},{"key":"9703_CR31","unstructured":"Ovadya, A., & Whittlestone, J. (2019). Reducing malicious use of synthetic media research: Considerations and potential release practices for machine learning. arXiv preprint. http:\/\/arxiv.org\/abs\/1907.11274"},{"key":"9703_CR32","doi-asserted-by":"crossref","unstructured":"Palmer, M. J. (2020). Learning to deal with dual use. American Association for the Advancement of Science.","DOI":"10.1126\/science.abb1466"},{"key":"9703_CR33","unstructured":"Parkinson, H. J. (2019). AI can write just like me. Brace for the robot apocalypse. The Guardian, February 16. https:\/\/www.theguardian.com\/commentisfree\/2019\/feb\/15\/ai-write-robot-openai-gpt2-elon-musk"},{"key":"9703_CR34","unstructured":"Parliamentary Office of Science and Technology. (2009). The dual-use dilemma. Parliamentary Office of Science and Technology."},{"key":"9703_CR215","doi-asserted-by":"crossref","unstructured":"Phippen, A., Bond, E., & Buck, E. (2021). Effective strategies for information literacy education: combatting \u2018fake news\u2019 and empowering critical thinking. In Future Directions in Digital Information . (pp. 39\u201353). Chandos Publishing.","DOI":"10.1016\/B978-0-12-822144-0.00003-3"},{"key":"9703_CR35","unstructured":"Radford, A., Wu, J., Amodei, D., Amodei, D., Clark, J., Brundin, M., & Sutskever, I. (2019a, February 14). Better language models and their implications. https:\/\/openai.com\/blog\/better-language-models\/"},{"key":"9703_CR36","unstructured":"Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019b). Language models are unsupervised multitask learners. OpenAI Blog, 1(8)."},{"key":"9703_CR201","doi-asserted-by":"crossref","unstructured":"Resnik, D. B. (2009). What is \u201cdual use\u201d research? A response to Miller and Selgelid. Science and engineering ethics, 15(1), 3\u20135.","DOI":"10.1007\/s11948-008-9104-3"},{"key":"9703_CR37","doi-asserted-by":"publisher","DOI":"10.2202\/1941-6008.1124","author":"DB Resnik","year":"2010","unstructured":"Resnik, D. B. (2010). Can scientists regulate the publication of dual use research? Studies in Ethics, Law, and Technology. https:\/\/doi.org\/10.2202\/1941-6008.1124","journal-title":"Studies in Ethics, Law, and Technology"},{"key":"9703_CR38","unstructured":"Robitzski, D. (2019). A neural network dreams up this text adventure game as you play. Futurism, September 5."},{"key":"9703_CR39","unstructured":"Rousseau, A.-L., Baudelaire, C., & Riera, K. (2020). Doctor GPT-3: Hype or reality? Nabla."},{"key":"9703_CR40","unstructured":"Samuel, S. (2019). How I\u2019m using AI to write my next novel. Vox, August 30."},{"key":"9703_CR41","doi-asserted-by":"crossref","unstructured":"Schlagwein, D., Conboy, K., Feller, J., Leimeister, J. M., & Morgan, L. (2017). \u201cOpenness\u201d with and without Information Technology: A framework and a brief history. SAGE Publications.","DOI":"10.1057\/s41265-017-0049-3"},{"issue":"2","key":"9703_CR42","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1017\/bca.2019.16","volume":"10","author":"J Scouras","year":"2019","unstructured":"Scouras, J. (2019). Nuclear war as a global catastrophic risk. Journal of Benefit\u2013cost Analysis, 10(2), 274\u2013295.","journal-title":"Journal of Benefit\u2013cost Analysis"},{"issue":"3","key":"9703_CR43","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1353\/hcr.2007.0046","volume":"37","author":"MJ Selgelid","year":"2007","unstructured":"Selgelid, M. J. (2007). A tale of two studies: Ethics, bioterrorism, and the censorship of science. Hastings Center Report, 37(3), 35\u201343.","journal-title":"Hastings Center Report"},{"key":"9703_CR44","unstructured":"Selgelid, M. J. (2013). Ethics and censorship of dual-use life science research. In M. L. Gross & D. Carrick (Eds.), Military medical ethics for the 21st century. Ashgate."},{"issue":"4","key":"9703_CR45","doi-asserted-by":"publisher","first-page":"923","DOI":"10.1007\/s11948-016-9810-1","volume":"22","author":"MJ Selgelid","year":"2016","unstructured":"Selgelid, M. J. (2016). Gain-of-function research: Ethical analysis. Science and Engineering Ethics, 22(4), 923\u2013964.","journal-title":"Science and Engineering Ethics"},{"key":"9703_CR46","unstructured":"Shea, D. A. (2006). Oversight of dual-use biological research: The National Science Advisory Board for Biosecurity. Congressional Research Service reports."},{"key":"9703_CR47","doi-asserted-by":"publisher","first-page":"142","DOI":"10.3389\/fpubh.2014.00142","volume":"2","author":"FL Smith III","year":"2014","unstructured":"Smith, F. L., III., & Kamradt-Scott, A. (2014). Antipodal biosecurity? Oversight of dual use research in the United States and Australia. Frontiers in Public Health, 2, 142.","journal-title":"Frontiers in Public Health"},{"key":"9703_CR48","unstructured":"Solaiman, I., Brundage, M., Clark, J., Askell, A., Herbert-Voss, A., Wu, J., Radford, A., & Wang, J. (2019). Release strategies and the social impacts of language models. arXiv preprint. http:\/\/arxiv.org\/abs\/1908.09203"},{"key":"9703_CR210","doi-asserted-by":"crossref","unstructured":"Sparrow, R. (2012). \"Just Say No\" to Drones. IEEE Technology and Society Magazine, 31(1), 56\u201363.","DOI":"10.1109\/MTS.2012.2185275"},{"key":"9703_CR500","doi-asserted-by":"crossref","unstructured":"Stankovic, B., & Stankovic, M. 2014. \"Educating about biomedical research ethics.\" Medicine, Health Care and Philosophy, 17, 541\u2013548.","DOI":"10.1007\/s11019-014-9561-1"},{"key":"9703_CR49","doi-asserted-by":"publisher","DOI":"10.4324\/9780203873991","volume-title":"Practical autonomy and bioethics","author":"JS Taylor","year":"2010","unstructured":"Taylor, J. S. (2010). Practical autonomy and bioethics. Routledge."},{"key":"9703_CR50","unstructured":"Thiergart, J., Huber, S., & \u00dcbellacker, T. (2021). Understanding emails and drafting responses\u2014An approach using GPT-3. arXiv preprint. http:\/\/arxiv.org\/abs\/2102.03062"},{"issue":"8","key":"9703_CR51","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1038\/s41928-019-0294-2","volume":"2","author":"C V\u00e9liz","year":"2019","unstructured":"V\u00e9liz, C. (2019). Three things digital ethics can learn from medical ethics. Nature Electronics, 2(8), 316\u2013318.","journal-title":"Nature Electronics"},{"issue":"6380","key":"9703_CR52","doi-asserted-by":"publisher","first-page":"1146","DOI":"10.1126\/science.aap9559","volume":"359","author":"S Vosoughi","year":"2018","unstructured":"Vosoughi, S., Roy, D., & Aral, S. (2018). The spread of true and false news online. Science, 359(6380), 1146\u20131151.","journal-title":"Science"},{"key":"9703_CR53","doi-asserted-by":"crossref","unstructured":"Whittlestone, J., Nyrup, R., Alexandrova, A., & Cave, S. (2019). The role and limits of principles in AI ethics: Towards a focus on tensions. In Proceedings of the 2019 AAAI\/ACM conference on AI, ethics, and society, 2019.","DOI":"10.1145\/3306618.3314289"},{"key":"9703_CR200","unstructured":"World Health Organization. (2010). Responsible life sciences research for global health security: A Guidance Document, Switzerland: WHO Press."},{"key":"9703_CR54","doi-asserted-by":"crossref","unstructured":"Zellers, R., Holtzman, A., Bisk, Y., Farhadi, A., & Choi, Y. (2019a). HellaSwag: Can a machine really finish your sentence? arXiv preprint. http:\/\/arxiv.org\/abs\/1905.07830","DOI":"10.18653\/v1\/P19-1472"},{"key":"9703_CR55","unstructured":"Zellers, R., Holtzman, A., Rashkin, H., Bisk, Y., Farhadi, A., Roesner, F., & Choi, Y. (2019b). Defending against neural fake news. arXiv preprint. hhttp:\/\/arxiv.org\/abs\/1905.12616"}],"container-title":["Ethics and Information Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-023-09703-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10676-023-09703-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-023-09703-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,19]],"date-time":"2023-06-19T03:12:22Z","timestamp":1687144342000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10676-023-09703-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,29]]},"references-count":62,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["9703"],"URL":"https:\/\/doi.org\/10.1007\/s10676-023-09703-z","relation":{},"ISSN":["1388-1957","1572-8439"],"issn-type":[{"value":"1388-1957","type":"print"},{"value":"1572-8439","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,29]]},"assertion":[{"value":"29 May 2023","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"32"}}