{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T03:11:10Z","timestamp":1789528270655,"version":"build-2803163510"},"reference-count":31,"publisher":"American Association for the Advancement of Science (AAAS)","issue":"6654","content-domain":{"domain":["www.science.org"],"crossmark-restriction":true},"short-container-title":["Science"],"published-print":{"date-parts":[[2023,7,14]]},"abstract":"<jats:p>We examined the productivity effects of a generative artificial intelligence (AI) technology, the assistive chatbot ChatGPT, in the context of midlevel professional writing tasks. In a preregistered online experiment, we assigned occupation-specific, incentivized writing tasks to 453 college-educated professionals and randomly exposed half of them to ChatGPT. Our results show that ChatGPT substantially raised productivity: The average time taken decreased by 40% and output quality rose by 18%. Inequality between workers decreased, and concern and excitement about AI temporarily rose. Workers exposed to ChatGPT during the experiment were 2 times as likely to report using it in their real job 2 weeks after the experiment and 1.6 times as likely 2 months after the experiment.<\/jats:p>","DOI":"10.1126\/science.adh2586","type":"journal-article","created":{"date-parts":[[2023,7,13]],"date-time":"2023-07-13T13:55:32Z","timestamp":1689256532000},"page":"187-192","update-policy":"https:\/\/doi.org\/10.34133\/aaas_crossmark","source":"Crossref","is-referenced-by-count":1680,"title":["Experimental evidence on the productivity effects of generative artificial intelligence"],"prefix":"10.1126","volume":"381","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7814-5184","authenticated-orcid":true,"given":"Shakked","family":"Noy","sequence":"first","affiliation":[{"name":"Department of Economics, Massachusetts Institute of Technology, Cambridge, MA, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7399-0066","authenticated-orcid":true,"given":"Whitney","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Economics, Massachusetts Institute of Technology, Cambridge, MA, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"221","reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1257\/jep.29.3.3"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1257\/aer.103.5.1553"},{"key":"e_1_3_2_4_2","doi-asserted-by":"crossref","unstructured":"T. Eloundou S. Manning P. Mishkin D. Rock GPTs are GPTs: An early look at the labor market impact potential of large language models. arXiv:2303.10130 [econ.GN] (2023).","DOI":"10.1126\/science.adj0998"},{"key":"e_1_3_2_5_2","doi-asserted-by":"crossref","unstructured":"E. W. Felten M. Raj R. Seamans How will language modelers like ChatGPT affect occupations and industries? SSRN [Preprint] (2023); http:\/\/dx.doi.org\/10.2139\/ssrn.4375268.10.2139\/ssrn.4375268","DOI":"10.2139\/ssrn.4375268"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1900949116"},{"key":"e_1_3_2_7_2","doi-asserted-by":"crossref","unstructured":"L. P. Boustan J. Choi D. Clingingsmith \u201cAutomation after the assembly line: computerized machine tools employment and productivity in the United States\u201d (National Bureau of Economic Research 2022); https:\/\/www.nber.org\/papers\/w30400.","DOI":"10.3386\/w30400"},{"key":"e_1_3_2_8_2","doi-asserted-by":"crossref","unstructured":"D. Acemoglu P. Restrepo \u201cRobots and jobs: Evidence from US labor markets\u201d (National Bureau of Economic Research 2020); https:\/\/www.nber.org\/papers\/w23285.","DOI":"10.1086\/705716"},{"key":"e_1_3_2_9_2","doi-asserted-by":"crossref","unstructured":"K. Kanazawa D. Kawaguchi H. Shigeoka Y. Watanabe \u201cAI skill and productivity: The case of taxi drivers\u201d (National Bureau of Economic Research 2022); https:\/\/www.nber.org\/papers\/w30612.","DOI":"10.3386\/w30612"},{"key":"e_1_3_2_10_2","doi-asserted-by":"crossref","unstructured":"R. Arakawa H. Yakura M. Goto CatAlyst:Domain-extensible intervention for preventing task procrastination using large generative models. arXiv:2302.05678 [cs.HC] (2023).","DOI":"10.1145\/3544548.3581133"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1257\/aer.20160696"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1257\/jep.33.2.31"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1093\/qje\/qjx042"},{"key":"e_1_3_2_14_2","first-page":"237","article-title":"Human decisions and machine predictions","volume":"133","author":"Kleinberg J.","year":"2018","unstructured":"J. Kleinberg, H. Lakkaraju, J. Leskovec, J. Ludwig, S. Mullainathan, Human decisions and machine predictions. Q. J. Econ.133, 237\u2013293 (2018). 29755141","journal-title":"Q. J. Econ."},{"key":"e_1_3_2_16_2","doi-asserted-by":"crossref","unstructured":"E. Brynjolfsson D. Li L. R. Raymond \u201cGenerative AI at work\u201d (National Bureau of Economic Research 2023); https:\/\/www.nber.org\/papers\/w31161.","DOI":"10.3386\/w31161"},{"key":"e_1_3_2_17_2","unstructured":"S. Peng E. Kalliamvakou P. Cihon M. Demirer The impact of AI on developer productivity: Evidence from GitHub Copilot. arXiv:2302.06590 [cs.SE] (2023)."},{"key":"e_1_3_2_18_2","unstructured":"A. Calderwood V. Qiu K. Ilonka Gero L. B. Chilton \u201cHow novelists use generative language models: An exploratory user study \u201d in Joint Proceedings of the Workshops on Human-AI Co-Creation with Generative Models and User-Aware Conversational Agents co-located with 25th International Conference on Intelligent User Interfaces (IUI 2020) Cagliari Italy March 17 2020 W. Geyer Y. Khazaeni M. Shmueli-Scheuer Eds. (CEUR 2018) vol. 2848 of CEUR Workshop Proceedings ."},{"key":"e_1_3_2_19_2","unstructured":"A. Campero M. Vaccaro J. Song H. Wen A. Almaatouq T. W. Malone A test for evaluating performance in human-computer systems. arXiv:2206.12390 [cs.HC] (2022)."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0242929"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-021-01694-3"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-937X.2009.00536.x"},{"key":"e_1_3_2_30_2","doi-asserted-by":"crossref","unstructured":"Y. Liu A. Mittal D. Yang A. Bruckman \u201cWill AI console me when I lose my pet? Understanding perceptions of AI-mediated Email writing \u201d in CHI \u201922: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems New Orleans LA 29 April 2022 \u2013 5 May 2022 S. Barbosa C. Lampe C. Appert D. A. Shamma S. Drucker J. Williamson K. Yatani Eds. (Association for Computing Machinery 2022); https:\/\/dl.acm.org\/doi\/10.1145\/3491102.3517731.","DOI":"10.1145\/3491102.3517731"},{"key":"e_1_3_2_31_2","doi-asserted-by":"crossref","unstructured":"J. Qadir Engineering education in the era of ChatGPT: Promise and pitfalls of generative AI for education. TechRxiv [Preprint] (2022); https:\/\/doi.org\/10.36227\/techrxiv.21789434.v1.10.36227\/techrxiv.21789434.v1","DOI":"10.36227\/techrxiv.21789434.v1"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0014-2921(01)00199-4"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/s43681-021-00084-x"},{"key":"e_1_3_2_34_2","unstructured":"J. Hohenstein D. DiFranzo R. F. Kizilcec Z. Aghajari H. Mieczkowski K. Levy M. Naaman J. Hancock M. Jung Artificial intelligence in communication impacts language and social relationships. arXiv:2102.05756 [cs.HC] (2021)."},{"key":"e_1_3_2_35_2","doi-asserted-by":"crossref","unstructured":"M. Suh E. Youngblom M. Terry C. J. Cai \u201cAI as social glue: Uncovering the roles of deep generative AI during social music composition \u201d in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems Yokohama Japan 8\u201313 May 2021 Y. Kitamura A. Quigley K. Isbister T. Igarashi P. Bjorn S. Drucker Eds. (Association for Computing Machinery 2021); https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445219.","DOI":"10.1145\/3411764.3445219"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1136\/jme-2023-108909"},{"key":"e_1_3_2_37_2","doi-asserted-by":"crossref","unstructured":"D. Autor \u201cThe labor market impacts of technological change: From unbridled enthusiasm to qualified optimism to vast uncertainty\u201d (National Bureau of Economic Research 2022); https:\/\/www.nber.org\/papers\/w30074.","DOI":"10.3386\/w30074"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/MITP.2019.2951851"},{"key":"e_1_3_2_39_2","doi-asserted-by":"crossref","unstructured":"A. Agrawal J. Gans A. Goldfarb The Economics of Artificial Intelligence: An Agenda (Univ. of Chicago Press 2019).","DOI":"10.7208\/chicago\/9780226613475.001.0001"},{"key":"e_1_3_2_40_2","unstructured":"Data and code for: S. Noy W. Zhang Experimental evidence on the productivity effects of generative artificial intelligence Open Science Framework (2023); https:\/\/osf.io\/xd7qw\/?view_only=b8dac58dd6f44b979bf81069022fa392DOI10.17605\/OSF.IO\/XD7QW.10.17605\/OSF.IO\/XD7QW"}],"container-title":["Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.science.org\/doi\/pdf\/10.1126\/science.adh2586","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,23]],"date-time":"2024-10-23T23:02:19Z","timestamp":1729724539000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.science.org\/doi\/10.1126\/science.adh2586"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,14]]},"references-count":31,"journal-issue":{"issue":"6654","published-print":{"date-parts":[[2023,7,14]]}},"alternative-id":["10.1126\/science.adh2586"],"URL":"https:\/\/doi.org\/10.1126\/science.adh2586","relation":{},"ISSN":["0036-8075","1095-9203"],"issn-type":[{"value":"0036-8075","type":"print"},{"value":"1095-9203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,14]]},"assertion":[{"value":"2023-02-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-06-02","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-07-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}