{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T23:01:04Z","timestamp":1772492464072,"version":"3.50.1"},"reference-count":19,"publisher":"Emerald","issue":"7","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,12,15]]},"abstract":"\n Purpose<\/jats:title>\n We compare human intelligence to artificial intelligence (AI) in the choice of appropriate Journal of Economic Literature (JEL) codes for research papers in economics.<\/jats:p>\n <\/jats:sec>\n \n Design\/methodology\/approach<\/jats:title>\n We compare the JEL code choices related to articles published in the recent issues of the Journal of Economic Literature and the American Economic Review and compare these to the original JEL code choices of the authors in earlier working paper versions and JEL codes recommended by various generative AI systems (OpenAI\u2019s ChatGPT, Microsoft\u2019s Copilot, Google\u2019s Gemini) based on the abstracts of the articles.<\/jats:p>\n <\/jats:sec>\n \n Findings<\/jats:title>\n There are significant discrepancies and often limited overlap between authors\u2019 choices of JEL codes, editors\u2019 choices as well as the choices by contemporary widely used AI systems. However, the observations suggest that generative AI can augment human intelligence in the micro-task of choosing the JEL codes and, thus, save researchers time.<\/jats:p>\n <\/jats:sec>\n \n Research limitations\/implications<\/jats:title>\n Rapid development of AI systems makes the findings quickly obsolete.<\/jats:p>\n <\/jats:sec>\n \n Practical implications<\/jats:title>\n AI systems may economize on classification costs and (semi-)automate the choice of JEL codes by recommending the most appropriate ones. Future studies may apply the presented approach to analyze whether the JEL code choices between authors, editors and AI systems converge and become more consistent as humans increasingly interact with AI systems.<\/jats:p>\n <\/jats:sec>\n \n Originality\/value<\/jats:title>\n We assume that the choice of JEL codes is a micro-task in which boundedly rational decision-makers rather satisfice than optimize. This exploratory experiment is among the first to compare human intelligence and generative AI in choosing and justifying the choice of optimal JEL codes.<\/jats:p>\n <\/jats:sec>","DOI":"10.1108\/jd-05-2024-0104","type":"journal-article","created":{"date-parts":[[2024,12,13]],"date-time":"2024-12-13T14:31:42Z","timestamp":1734100302000},"page":"18-30","source":"Crossref","is-referenced-by-count":2,"title":["Human intelligence versus artificial intelligence in classifying economics research articles: exploratory evidence"],"prefix":"10.1108","volume":"81","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5122-7956","authenticated-orcid":true,"given":"Jussi T.S.","family":"Heikkil\u00e4","sequence":"first","affiliation":[{"name":"LUT University, Lahti Campus , ,","place":["Lahti, Finland"]},{"name":"Jyv\u00e4skyl\u00e4 University School of Business and Economics , ,","place":["Jyv\u00e4skyl\u00e4, Finland"]}]}],"member":"140","published-online":{"date-parts":[[2024,12,16]]},"reference":[{"issue":"5","key":"2025121000511864600_ref001","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1257\/aer.p20171117","article-title":"Economic research evolves: fields and styles","volume":"107","author":"Angrist","year":"2017","journal-title":"The American Economic Review"},{"issue":"2","key":"2025121000511864600_ref002","doi-asserted-by":"publisher","first-page":"598","DOI":"10.1257\/jel.20201396","article-title":"Satisficing: integrating two traditions","volume":"60","author":"Artinger","year":"2022","journal-title":"Journal of Economic Literature"},{"issue":"3","key":"2025121000511864600_ref003","doi-asserted-by":"publisher","first-page":"2433","DOI":"10.1007\/s11192-020-03570-x","article-title":"Where have all the working papers gone? Evidence from four major economics working paper series","volume":"124","author":"Baumann","year":"2020","journal-title":"Scientometrics"},{"issue":"4","key":"2025121000511864600_ref004","doi-asserted-by":"publisher","first-page":"824","DOI":"10.1108\/JD-10-2023-0201","article-title":"Recent temporal dynamics in economics: empirical analyses of annual publications in economic fields","volume":"80","author":"Bornmann","year":"2024","journal-title":"Journal of Documentation"},{"key":"2025121000511864600_ref005","doi-asserted-by":"crossref","unstructured":"Brynjolfsson, E., Li, D. and Raymond, L. (2023), \u201cGenerative AI at work\u201d, NBER Working Paper No. 31161, available at:\u00a0http:\/\/www.nber.org\/papers\/w31161","DOI":"10.3386\/w31161"},{"issue":"7","key":"2025121000511864600_ref006","doi-asserted-by":"publisher","first-page":"2899","DOI":"10.1257\/aer.101.7.2899","article-title":"Search and satisficing","volume":"101","author":"Caplin","year":"2011","journal-title":"The American Economic Review"},{"issue":"1","key":"2025121000511864600_ref007","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1257\/jel.51.1.144","article-title":"Nine facts about top journals in economics","volume":"51","author":"Card","year":"2013","journal-title":"Journal of Economic Literature"},{"issue":"2","key":"2025121000511864600_ref008","doi-asserted-by":"publisher","first-page":"545","DOI":"10.1257\/jel.20151296","article-title":"Classifying economics: a history of the JEL codes","volume":"55","author":"Cherrier","year":"2017","journal-title":"Journal of Economic Literature"},{"issue":"6702","key":"2025121000511864600_ref009","doi-asserted-by":"publisher","first-page":"1306","DOI":"10.1126\/science.adj0998","article-title":"GPTs are GPTs: labor market impact potential of LLMs","volume":"384","author":"Eloundou","year":"2024","journal-title":"Science"},{"issue":"1","key":"2025121000511864600_ref010","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1257\/jel.20171452","article-title":"Digital economics","volume":"57","author":"Goldfarb","year":"2019","journal-title":"Journal of Economic Literature"},{"issue":"2","key":"2025121000511864600_ref011","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1108\/JD-08-2020-0146","article-title":"Classifying economics for the common good: a note on the links between sustainable development goals and JEL codes","volume":"77","author":"Heikkil\u00e4","year":"2021","journal-title":"Journal of Documentation"},{"issue":"5","key":"2025121000511864600_ref012","doi-asserted-by":"publisher","first-page":"352","DOI":"10.5771\/0943-7444-2022-5-352","article-title":"Journal of economic literature codes classification system (JEL)","volume":"49","author":"Heikkil\u00e4","year":"2022","journal-title":"Knowledge Organization"},{"issue":"4","key":"2025121000511864600_ref013","doi-asserted-by":"publisher","first-page":"1281","DOI":"10.1257\/jel.20231736","article-title":"Generative AI for economic research: use cases and implications for economists","volume":"61","author":"Korinek","year":"2023","journal-title":"Journal of Economic Literature"},{"issue":"1","key":"2025121000511864600_ref014","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1111\/joes.12189","article-title":"A survey of JEL codes: what do they mean and are they used consistently?","volume":"32","author":"Kosnik","year":"2018","journal-title":"Journal of Economic Surveys"},{"issue":"4","key":"2025121000511864600_ref015","doi-asserted-by":"publisher","DOI":"10.1016\/j.joi.2020.101066","article-title":"How do authors select keywords? A preliminary study of author keyword selection behavior","volume":"14","author":"Lu","year":"2020","journal-title":"Journal of Informetrics"},{"issue":"1","key":"2025121000511864600_ref016","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1257\/jel.20211524","article-title":"Rational inattention: a review","volume":"61","author":"Ma\u0107kowiak","year":"2023","journal-title":"Journal of Economic Literature"},{"issue":"8022","key":"2025121000511864600_ref017","doi-asserted-by":"publisher","first-page":"755","DOI":"10.1038\/s41586-024-07566-y","article-title":"AI models collapse when trained on recursively generated data","volume":"631","author":"Shumailov","year":"2024","journal-title":"Nature"},{"issue":"1","key":"2025121000511864600_ref018","doi-asserted-by":"publisher","first-page":"99","DOI":"10.2307\/1884852","article-title":"A behavioral model of rational choice","volume":"69","author":"Simon","year":"1955","journal-title":"Quarterly Journal of Economics"},{"key":"2025121000511864600_ref019","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1145\/3626772.3657848","article-title":"Large language models and future of information retrieval: opportunities and challenges","author":"Zhai","year":"2024"}],"container-title":["Journal of Documentation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JD-05-2024-0104\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/jd\/article-pdf\/81\/7\/18\/10048272\/jd-05-2024-0104en.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/www.emerald.com\/jd\/article-pdf\/81\/7\/18\/10048272\/jd-05-2024-0104en.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,10]],"date-time":"2025-12-10T05:51:25Z","timestamp":1765345885000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.emerald.com\/jd\/article\/81\/7\/18\/1267440\/Human-intelligence-versus-artificial-intelligence"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,16]]},"references-count":19,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,12,15]]}},"URL":"https:\/\/doi.org\/10.1108\/jd-05-2024-0104","relation":{},"ISSN":["0022-0418","1758-7379"],"issn-type":[{"value":"0022-0418","type":"print"},{"value":"1758-7379","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,16]]}}}