{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T05:16:37Z","timestamp":1774415797441,"version":"3.50.1"},"reference-count":104,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2025,7,28]],"date-time":"2025-07-28T00:00:00Z","timestamp":1753660800000},"content-version":"vor","delay-in-days":27,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,7,2]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Genome annotation is essential for understanding the functional elements within genomes. While automated methods are indispensable for processing large-scale genomic data, they often face challenges in accurately predicting gene structures and functions. Consequently, manual curation by domain experts remains crucial for validating and refining these predictions. These combined outcomes from automated tools and manual curation highlight the importance of integrating human expertise with artificial intelligence (AI) capabilities to improve both the accuracy and efficiency of genome annotation. However, the manual curation process is inherently labor-intensive and time-consuming, making it difficult to scale for large datasets. To address these challenges, we propose a conceptual framework, Human-AI Collaborative Genome Annotation (HAICoGA), that leverages the synergistic partnership between humans and AI to enhance human capabilities and accelerate the genome annotation process. Additionally, we explore the potential of integrating large language models into this framework to support and augment specific tasks. Finally, we discuss emerging challenges and outline open research questions to guide further exploration in this area.<\/jats:p>","DOI":"10.1093\/bib\/bbaf377","type":"journal-article","created":{"date-parts":[[2025,7,28]],"date-time":"2025-07-28T03:58:54Z","timestamp":1753675134000},"source":"Crossref","is-referenced-by-count":3,"title":["A conceptual framework for human\u2013AI collaborative genome annotation"],"prefix":"10.1093","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8870-3186","authenticated-orcid":false,"given":"Xiaomei","family":"Li","sequence":"first","affiliation":[{"name":"Agriculture and Food , CSIRO, 26 Pembroke Road, Marsfield, NSW 2122 ,","place":["Australia"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6839-2915","authenticated-orcid":false,"given":"Alex","family":"Whan","sequence":"additional","affiliation":[{"name":"Agriculture and Food , CSIRO, 2-40 Clunies Ross Street, Acton, ACT 2601 ,","place":["Australia"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4671-7210","authenticated-orcid":false,"given":"Meredith","family":"McNeil","sequence":"additional","affiliation":[{"name":"Agriculture and Food , CSIRO, 306 Carmody Road, St Lucia, QLD 4067 ,","place":["Australia"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6583-9067","authenticated-orcid":false,"given":"David","family":"Starns","sequence":"additional","affiliation":[{"name":"School of Molecular and Cellular Biology, University of Leeds , Woodhouse Lane, Leeds LS2 9JT ,","place":["United Kingdom"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0671-5168","authenticated-orcid":false,"given":"Jessica","family":"Irons","sequence":"additional","affiliation":[{"name":"Data 61, CSIRO , 13 Garden Street, Eveleigh, NSW 2015 ,","place":["Australia"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4589-2746","authenticated-orcid":false,"given":"Samuel C","family":"Andrew","sequence":"additional","affiliation":[{"name":"Agriculture and Food, CSIRO , 26 Pembroke Road, Marsfield, NSW 2122 ,","place":["Australia"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4992-9497","authenticated-orcid":false,"given":"Rad","family":"Suchecki","sequence":"additional","affiliation":[{"name":"Agriculture and Food, CSIRO , 40 Waite Road, Urrbrae, SA 5064 ,","place":["Australia"]},{"name":"sAlkahest Inc. , 125 Shoreway Rd D, San Carlos, CA 94070 ,","place":["United States"]}]}],"member":"286","published-online":{"date-parts":[[2025,7,28]]},"reference":[{"key":"2026032500270407100_ref1","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1038\/s41576-019-0122-6","article-title":"Deep learning: new computational modelling techniques for genomics","volume":"20","author":"Eraslan","year":"2019","journal-title":"Nat Rev Genet"},{"key":"2026032500270407100_ref2","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1038\/s41588-018-0295-5","article-title":"A primer on deep learning in genomics","volume":"51","author":"Zou","year":"2019","journal-title":"Nat Genet"},{"key":"2026032500270407100_ref3","doi-asserted-by":"publisher","first-page":"e11376","DOI":"10.1002\/aps3.11376","article-title":"Machine learning: a powerful tool for gene function prediction in plants","volume":"8","author":"Mahood","year":"2020","journal-title":"Appl Plant Sci"},{"key":"2026032500270407100_ref4","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1016\/S0022-2836(05)80360-2","article-title":"Basic local alignment search tool","volume":"215","author":"Altschul","year":"1990","journal-title":"J Mol Biol"},{"key":"2026032500270407100_ref5","doi-asserted-by":"crossref","first-page":"W435","DOI":"10.1093\/nar\/gkl200","article-title":"AUGUSTUS: ab initio prediction of alternative transcripts","volume":"34","author":"Stanke","year":"2006","journal-title":"Nucleic Acids Res"},{"key":"2026032500270407100_ref6","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1038\/nrg3174","article-title":"A beginner\u2019s guide to eukaryotic genome annotation","volume":"13","author":"Yandell","year":"2012","journal-title":"Nat Rev Genet"},{"key":"2026032500270407100_ref7","first-page":"baq001","article-title":"Meeting report: a workshop on best practices in genome annotation","author":"Madupu","year":"2010","journal-title":"Database"},{"key":"2026032500270407100_ref8","doi-asserted-by":"publisher","first-page":"6614","DOI":"10.1093\/nar\/gkw569","article-title":"NCBI prokaryotic genome annotation pipeline","volume":"44","author":"Tatusova","year":"2016","journal-title":"Nucleic Acids Res"},{"key":"2026032500270407100_ref9","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1146\/annurev-genom-121119-083418","article-title":"Progress, challenges, and surprises in annotating the human genome","volume":"21","author":"Zerbino","year":"2020","journal-title":"Annu Rev Genomics Hum Genet"},{"key":"2026032500270407100_ref10","doi-asserted-by":"crossref","first-page":"295","DOI":"10.3390\/biology9090295","article-title":"Review on the computational genome annotation of sequences obtained by next-generation sequencing","volume":"9","author":"Ejigu","year":"2020","journal-title":"Biology"},{"key":"2026032500270407100_ref11","doi-asserted-by":"publisher","first-page":"e0224086","DOI":"10.1371\/journal.pone.0224086","article-title":"Double triage to identify poorly annotated genes in maize: the missing link in community curation","volume":"14","author":"Tello-Ruiz","year":"2019","journal-title":"PloS One"},{"key":"2026032500270407100_ref12","doi-asserted-by":"publisher","first-page":"R93","DOI":"10.1186\/gb-2013-14-8-r93","article-title":"Web Apollo: a web-based genomic annotation editing platform","volume":"14","author":"Lee","year":"2013","journal-title":"Genome Biol"},{"key":"2026032500270407100_ref13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1741-7007-3-7","article-title":"Complete reannotation of the arabidopsis genome: methods, tools, protocols and the final release","volume":"3","author":"Haas","year":"2005","journal-title":"BMC Biol"},{"key":"2026032500270407100_ref14","doi-asserted-by":"crossref","DOI":"10.1109\/ICPR.2014.12","article-title":"Putting the scientist in the loop\u2013accelerating scientific progress with interactive machine learning","volume-title":"2014 22nd International Conference on Pattern Recognition","author":"Aodha"},{"key":"2026032500270407100_ref15","doi-asserted-by":"crossref","DOI":"10.1016\/j.cell.2024.09.022","article-title":"Empowering biomedical discovery with AI agents.","author":"Gao","year":"2024"},{"key":"2026032500270407100_ref16","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1038\/s41746-021-00520-6","article-title":"Biological data annotation via a human-augmenting AI-based labeling system","volume":"4","author":"van der Wal","year":"2021","journal-title":"NPJ Digital Medicine"},{"key":"2026032500270407100_ref17","doi-asserted-by":"publisher","first-page":"1229","DOI":"10.1038\/s41591-020-0942-0","article-title":"Human\u2013computer collaboration for skin cancer recognition","volume":"26","author":"Tschandl","year":"2020","journal-title":"Nat Med"},{"key":"2026032500270407100_ref18","doi-asserted-by":"publisher","first-page":"525","DOI":"10.1038\/s42256-024-00832-8","article-title":"Augmenting large language models with chemistry tools","volume":"6","author":"Bran","year":"2024","journal-title":"Nat Mach Intell"},{"key":"2026032500270407100_ref19","first-page":"114","article-title":"Collaborative intelligence: humans and ai are joining forces","volume":"96","author":"James Wilson","year":"2018","journal-title":"Harv Bus Rev"},{"key":"2026032500270407100_ref20","doi-asserted-by":"publisher","first-page":"2327890","DOI":"10.1080\/08839514.2024.2327890","article-title":"Collaborative intelligence: a scoping review of current applications","volume":"38","author":"Schleiger","year":"2024","journal-title":"Appl Artif Intell"},{"key":"2026032500270407100_ref21","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1038\/s42256-018-0008-x","article-title":"Robots and the return to collaborative intelligence","volume":"1","author":"Goldberg","year":"2019","journal-title":"Nat Mach Intell"},{"key":"2026032500270407100_ref22","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1016\/j.jretai.2021.03.001","article-title":"A framework for collaborative artificial intelligence in marketing","volume":"98","author":"Huang","year":"2022","journal-title":"J Retailing"},{"key":"2026032500270407100_ref23","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1038\/nrg1769","article-title":"Towards multidimensional genome annotation","volume":"7","author":"Reed","year":"2006","journal-title":"Nat Rev Genet"},{"key":"2026032500270407100_ref24","doi-asserted-by":"publisher","first-page":"627","DOI":"10.1038\/nbt.1552","article-title":"Fifteen years of microbial genomics: meeting the challenges and fulfilling the dream","volume":"27","author":"Kyrpides","year":"2009","journal-title":"Nat Biotechnol"},{"key":"2026032500270407100_ref25","article-title":"A systematic study of bias amplification.","author":"Hall","year":"2022"},{"key":"2026032500270407100_ref26","doi-asserted-by":"publisher","first-page":"789","DOI":"10.1111\/tpj.13415","article-title":"Araport11: a complete reannotation of the arabidopsis thaliana reference genome","volume":"89","author":"Cheng","year":"2017","journal-title":"Plant J"},{"key":"2026032500270407100_ref27","doi-asserted-by":"publisher","first-page":"D1202","DOI":"10.1093\/nar\/gkr1090","article-title":"The arabidopsis information resource (TAIR): improved gene annotation and new tools","volume":"40","author":"Lamesch","year":"2012","journal-title":"Nucleic Acids Res"},{"key":"2026032500270407100_ref28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/gb-2002-3-12-research0082","article-title":"Apollo: a sequence annotation editor","volume":"3","author":"Lewis","year":"2002","journal-title":"Genome Biol"},{"key":"2026032500270407100_ref29","doi-asserted-by":"publisher","first-page":"e1006790","DOI":"10.1371\/journal.pcbi.1006790","article-title":"Apollo: democratizing genome annotation","volume":"15","author":"Dunn","year":"2019","journal-title":"PLoS Comput Biol"},{"key":"2026032500270407100_ref30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13059-016-0924-1","article-title":"JBrowse: a dynamic web platform for genome visualization and analysis","volume":"17","author":"Buels","year":"2016","journal-title":"Genome Biol"},{"key":"2026032500270407100_ref31","doi-asserted-by":"publisher","first-page":"W587","DOI":"10.1093\/nar\/gkz389","article-title":"PubTtator central: automated concept annotation for biomedical full text articles","volume":"47","author":"Wei","year":"2019","journal-title":"Nucleic Acids Res"},{"key":"2026032500270407100_ref32","doi-asserted-by":"crossref","first-page":"bau086","DOI":"10.1093\/database\/bau086","article-title":"Overview of the gene ontology task at BioCreative IV","author":"Mao","year":"2014","journal-title":"Database"},{"key":"2026032500270407100_ref33","first-page":"bas045","article-title":"Manual gene ontology annotation workflow at the mouse genome informatics database","author":"Drabkin","year":"2012","journal-title":"Database"},{"key":"2026032500270407100_ref34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3670009","article-title":"Towards human-AI teaming to mitigate alert fatigue in security operations centres","volume":"24","author":"Chhetri","year":"2024","journal-title":"ACM Trans Internet Technol"},{"key":"2026032500270407100_ref35","first-page":"2024","article-title":"Human-AI collaboration in smart manufacturing: key concepts and framework for design","volume":"162\u2013172","author":"Hartikainen","journal-title":"HHAI 2024: Hybrid Human AI Systems for the Social Good"},{"key":"2026032500270407100_ref36","first-page":"V006T06A052","article-title":"A framework to study human-ai collaborative design space exploration","volume-title":"Proceedings of the ASME 2021 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference","author":"Martin","year":", ,"},{"key":"2026032500270407100_ref37","first-page":"1","article-title":"HACO: a framework for developing human-AI teaming","volume-title":"Proceedings of the 13th Innovations in Software Engineering Conference on Formerly known as India Software Engineering Conference","author":"Dubey"},{"key":"2026032500270407100_ref38","article-title":"The future of human-AI collaboration: a taxonomy of design knowledge for hybrid intelligence systems.","author":"Dellermann","year":"2021"},{"key":"2026032500270407100_ref39","first-page":"41","article-title":"Cognitive biases","volume-title":"ABC of clinical reasoning","author":"Cooper","year":"2017"},{"key":"2026032500270407100_ref40","doi-asserted-by":"publisher","first-page":"456","DOI":"10.1518\/001872008X288385","article-title":"Naturalistic decision making","volume":"50","author":"Klein","year":"2008","journal-title":"Hum Factors"},{"key":"2026032500270407100_ref41","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511809477","volume-title":"Judgment under Uncertainty: Heuristics and Biases","author":"Kahneman","year":"1982"},{"key":"2026032500270407100_ref42","doi-asserted-by":"publisher","first-page":"286","DOI":"10.1007\/978-94-010-9521-1_16","article-title":"Scientific discovery and the psychology of problem solving","volume-title":"Models of Discovery: And Other Topics in the Methods of Science","author":"Simon","year":"1977"},{"key":"2026032500270407100_ref43","doi-asserted-by":"crossref","DOI":"10.24963\/ijcai.2025\/37","article-title":"Wisdom from diversity: bias mitigation through hybrid human-llm crowds.","author":"Abels","year":"2025"},{"key":"2026032500270407100_ref44","doi-asserted-by":"crossref","first-page":"bau074","DOI":"10.1093\/database\/bau074","article-title":"BC4GO: a full-text corpus for the BioCreative IV GO task","author":"Van Auken","year":"2014","journal-title":"Database"},{"key":"2026032500270407100_ref45","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-3783-7_6","article-title":"Genome annotation and analysis","author":"Koonin","year":"2003","journal-title":"Sequence\u2014evolution\u2014function: computational approaches in comparative Genomics,"},{"key":"2026032500270407100_ref46","first-page":"177","volume-title":"What\u2019s the Secret to Making Sure AI Does Not Steal your Job? Work with it, Not against it","author":"Paris","year":"2024"},{"key":"2026032500270407100_ref47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/gb-2002-3-12-research0081","article-title":"An integrated computational pipeline and database to support whole-genome sequence annotation","volume":"3","author":"Mungall","year":"2002","journal-title":"Genome Biol"},{"key":"2026032500270407100_ref48","doi-asserted-by":"publisher","first-page":"D523","DOI":"10.1093\/nar\/gkac1052","article-title":"UniProt: the universal protein knowledgebase in 2023","volume":"51","author":"The UniProt Consortium","year":"2023","journal-title":"Nucleic Acids Res"},{"key":"2026032500270407100_ref49","doi-asserted-by":"publisher","first-page":"D325","DOI":"10.1093\/nar\/gkaa1113","article-title":"The gene ontology resource: enriching a gold mine","volume":"49","author":"Gene Ontology Consortium","year":"2021","journal-title":"Nucleic Acids Res"},{"key":"2026032500270407100_ref50","doi-asserted-by":"publisher","first-page":"102665","DOI":"10.1016\/j.pbi.2024.102665","article-title":"The gene function prediction challenge: large language models and knowledge graphs to the rescue","volume":"82","author":"Sunil","year":"2024","journal-title":"Curr Opin Plant Biol"},{"key":"2026032500270407100_ref51","doi-asserted-by":"crossref","DOI":"10.2139\/ssrn.5211067","article-title":"Unraveling human-AI teaming: a review and outlook.","author":"Lou","year":"2025"},{"key":"2026032500270407100_ref52","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1002\/hfm.20512","article-title":"CCPE: methodology for a combined evaluation of cognitive and physical ergonomics in the interaction between human and machine","volume":"24","author":"Blig\u00e5rd","year":"2014","journal-title":"Hum Factors Ergon Manuf Serv Ind"},{"key":"2026032500270407100_ref53","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/2024.findings-emnlp.72","article-title":"Large language model\u2013based human\u2013agent collaboration for complex task solving.","volume-title":"Findings of the Association for Computational Linguistics: EMNLP 2024, Miami, Florida, USA","author":"Feng"},{"key":"2026032500270407100_ref54","doi-asserted-by":"publisher","DOI":"10.3390\/systems6040044","article-title":"Architectural framework for exploring adaptive human-machine teaming options in simulated dynamic environments","volume":"6","author":"Madni","year":"2018","journal-title":"Systems"},{"key":"2026032500270407100_ref55","doi-asserted-by":"publisher","DOI":"10.17226\/26355","article-title":"Engineering, and Medicine","volume-title":"Human-AI Teaming: State-of-the-Art and Research Needs","author":"National Academies of Sciences","year":"2022"},{"key":"2026032500270407100_ref56","doi-asserted-by":"publisher","first-page":"599","DOI":"10.1002\/hrm.21628","article-title":"Understanding and improving teamwork in organizations: a scientifically based practical guide","volume":"54","author":"Salas","year":"2015","journal-title":"Hum Resour Manage"},{"key":"2026032500270407100_ref57","doi-asserted-by":"crossref","first-page":"101837","DOI":"10.1016\/j.copsyc.2024.101837","article-title":"Ai-teaming: redefining collaboration in the digital era","author":"Schmutz","year":"2024","journal-title":"Curr Opin Psychol"},{"key":"2026032500270407100_ref58","doi-asserted-by":"publisher","first-page":"904","DOI":"10.1177\/0018720820960865","article-title":"Human\u2013autonomy teaming: a review and analysis of the empirical literature","volume":"64","author":"O\u2019Neill","year":"2022","journal-title":"Human Factors: The Journal of the Human Factors and Ergonomics Society"},{"key":"2026032500270407100_ref59","doi-asserted-by":"publisher","first-page":"589585","DOI":"10.3389\/fpsyg.2021.589585","article-title":"Human\u2013autonomy teaming: Definitions, debates, and directions","volume":"12","author":"Lyons","year":"2021","journal-title":"Front Psychol"},{"key":"2026032500270407100_ref60","doi-asserted-by":"crossref","article-title":"Scientific large language models: a survey on biological & chemical domains.","author":"Zhang","DOI":"10.1145\/3715318"},{"key":"2026032500270407100_ref61","first-page":"4171","article-title":"BERT: pre-training of deep bidirectional transformers for language understanding","volume-title":"Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, Minneapolis, MN, USA, Association for Computational Linguistics, Stroudsburg, PA, USA, volume 1 (long and short papers)","author":"Devlin","year":"2019"},{"key":"2026032500270407100_ref62","first-page":"9","article-title":"Language models are unsupervised multitask learners","volume":"1","author":"Radford","year":"2019","journal-title":"OpenAI blog"},{"key":"2026032500270407100_ref63","doi-asserted-by":"crossref","DOI":"10.1101\/2024.04.30.591835","article-title":"ChatNT: a multimodal conversational agent for DNA, RNA and protein tasks,","author":"Richard","year":"2024.04.30.591835"},{"key":"2026032500270407100_ref64","doi-asserted-by":"crossref","DOI":"10.1186\/s13326-024-00320-3","article-title":"Dynamic Retrieval Augmented Generation of Ontologies using Artificial Intelligence (DRAGON-AI).","volume-title":"Journal of Biomedical Semantics","author":"Toro"},{"key":"2026032500270407100_ref65","doi-asserted-by":"crossref","first-page":"btae075","DOI":"10.1093\/bioinformatics\/btae075","article-title":"GeneGPT: augmenting large language models with domain tools for improved access to biomedical information","volume":"40","author":"Jin","year":"2024","journal-title":"Bioinformatics"},{"key":"2026032500270407100_ref66","article-title":"Phenomics Assistant: an interface for LLM-based biomedical knowledge graph exploration","author":"Neil","year":"2024.01.31.578275"},{"key":"2026032500270407100_ref67","doi-asserted-by":"crossref","first-page":"btae183","DOI":"10.1093\/bioinformatics\/btae183","article-title":"VarChat: the generative ai assistant for the interpretation of human genomic variations","volume":"40","author":"De Paoli","year":"2024","journal-title":"Bioinformatics"},{"key":"2026032500270407100_ref68","doi-asserted-by":"crossref","DOI":"10.1038\/s41587-024-02534-3","article-title":"A platform for the biomedical application of large language models.","volume-title":"Nature biotechnology","author":"Lobentanzer"},{"key":"2026032500270407100_ref69","article-title":"BioDiscoveryAgent: an AI agent for designing genetic perturbation experiments.","author":"Roohani","year":"2024"},{"key":"2026032500270407100_ref70","article-title":"GeneAgent: self-verification language agent for gene set knowledge discovery using domain databases.","author":"Wang","year":"2024"},{"key":"2026032500270407100_ref71","article-title":"Automatic biomarker discovery and enrichment with BRAD.","volume-title":"Bioinformatics","author":"Pickard","year":"2025"},{"key":"2026032500270407100_ref72","article-title":"BioKGBench: a knowledge graph checking benchmark of AI agent for biomedical science.","author":"Lin","year":"2024"},{"key":"2026032500270407100_ref73","article-title":"GenoTEX: a benchmark for evaluating LLM-based exploration of gene expression data in alignment with bioinformaticians.","author":"Liu","year":"2024"},{"key":"2026032500270407100_ref74","doi-asserted-by":"crossref","first-page":"1389","DOI":"10.1039\/D4DD00013G","article-title":"ProtAgents: protein discovery via large language model multi-agent collaborations combining physics and machine learning","volume":"3","author":"Ghafarollahi","year":"2024","journal-title":"Digital Discovery"},{"key":"2026032500270407100_ref75","doi-asserted-by":"crossref","DOI":"10.1101\/2024.04.08.588614","article-title":"Replicating a high-impact scientific publication using systems of large language models.","author":"Bersenev","year":"2024.04.08.588614"},{"key":"2026032500270407100_ref76","article-title":"Toward a team of AI-made scientists for scientific discovery from gene expression data.","author":"Liu","year":"2024"},{"key":"2026032500270407100_ref77","doi-asserted-by":"crossref","DOI":"10.1101\/2024.11.11.623004","article-title":"The virtual lab: AI agents design new SARS-COV-2 nanobodies with experimental validation.","author":"Swanson","year":"2024.11.11.623004"},{"key":"2026032500270407100_ref78","article-title":"ReAct: synergizing reasoning and acting in language models","volume-title":"International Conference on Learning Representations (ICLR) Workshop on Foundation Models for Decision Making","author":"Yao","year":"2023"},{"key":"2026032500270407100_ref79","article-title":"AgentBench: evaluating LLMs as agents.","author":"Liu","year":"2023"},{"key":"2026032500270407100_ref80","doi-asserted-by":"crossref","DOI":"10.1007\/s11432-024-4222-0","article-title":"The rise and potential of large language model based agents: a survey.","volume-title":"Science China Information Sciences","author":"Xi"},{"key":"2026032500270407100_ref81","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1007\/978-1-4939-7804-5_16","article-title":"Manual gene curation and functional annotation","volume-title":"Fungal Genomics: Methods and Protocols","author":"McDonnell","year":"2018"},{"key":"2026032500270407100_ref82","doi-asserted-by":"crossref","DOI":"10.1101\/2025.03.30.646211","article-title":"GeneWhisperer: enhancing manual genome annotation with large language models","author":"Li","year":"2025.03.30.646211"},{"key":"2026032500270407100_ref83","doi-asserted-by":"publisher","first-page":"532","DOI":"10.1038\/d41586-024-01684-3","article-title":"Virtual lab powered by \u2018AI scientists\u2019 super-charges biomedical research","volume":"636","author":"Kudiabor","year":"2024","journal-title":"Nature"},{"key":"2026032500270407100_ref84","article-title":"Towards an ai co-scientist.","author":"Gottweis","year":"2025"},{"key":"2026032500270407100_ref85","article-title":"Balancing autonomy and alignment: a multi-dimensional taxonomy for autonomous LLM-powered multi-agent architectures.","author":"H\u00e4ndler","year":"2023"},{"key":"2026032500270407100_ref86","article-title":"LLM-based multi-agent systems for software engineering: vision and the road ahead.","volume-title":"ACM Transactions on Software Engineering and Methodology","author":"He"},{"key":"2026032500270407100_ref87","doi-asserted-by":"crossref","DOI":"10.1145\/3703155","article-title":"A survey on hallucination in large language models: principles, taxonomy, challenges, and open questions.","volume-title":"ACM Transactions on Information Systems","author":"Huang"},{"key":"2026032500270407100_ref88","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1609\/aaaiss.v2i1.27688","article-title":"Memory matters: the need to improve long-term memory in LLM-agents","volume-title":"In Proceedings of the AAAI Symposium Series","author":"Hatalis","year":"2023"},{"key":"2026032500270407100_ref89","article-title":"MemGPT: towards LLMs as operating systems.","author":"Packer","year":"2023"},{"key":"2026032500270407100_ref90","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/2023.findings-acl.67","article-title":"Towards reasoning in large language models: a survey","volume-title":"Findings of the Association for Computational Linguistics: ACL 2023. Toronto, Canada","author":"Huang"},{"key":"2026032500270407100_ref91","doi-asserted-by":"publisher","first-page":"comment2001.1","DOI":"10.1186\/gb-2002-3-2-comment2001","article-title":"The past, present and future of genome-wide re-annotation","volume":"3","author":"Ouzounis","year":"2002","journal-title":"Genome Biol"},{"key":"2026032500270407100_ref92","doi-asserted-by":"publisher","DOI":"10.1126\/science.abn3107","article-title":"Integrating gene annotation with orthology inference at scale","volume":"380","author":"Kirilenko","year":"2023","journal-title":"Science"},{"key":"2026032500270407100_ref93","article-title":"Evaluating human-AI collaboration: a review and methodological framework.","author":"Fragiadakis","year":"2024"},{"key":"2026032500270407100_ref94","first-page":"11405","article-title":"Is the most accurate ai the best teammate? Optimizing AI for teamwork","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Bansal","year":"2021"},{"key":"2026032500270407100_ref95","first-page":"2025","article-title":"A novel method for trust-sensitive design: applying conjoint analysis to machine-assisted genome annotation","volume-title":"Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems","author":"McGrath"},{"key":"2026032500270407100_ref96","article-title":"Prioritizing safeguarding over autonomy: risks of LLM agents for science.","author":"Tang","year":"2024"},{"key":"2026032500270407100_ref97","article-title":"CRISPR-GPT: an LLM agent for automated design of gene-editing experiments","author":"Huang","year":"2024","journal-title":"arXiv preprint arXiv:240418021"},{"key":"2026032500270407100_ref98","article-title":"SafeScientist: toward risk-aware scientific discoveries by LLM agents.","author":"Zhu","year":"2025"},{"key":"2026032500270407100_ref99","article-title":"Empowering LLM to use smartphone for intelligent task automation.","author":"Wen","year":"2023"},{"key":"2026032500270407100_ref100","doi-asserted-by":"crossref","first-page":"11523","DOI":"10.1109\/ICRA48891.2023.10161317","article-title":"ProgPrompt: generating situated robot task plans using large language models","volume-title":"2023 IEEE International Conference on Robotics and Automation (ICRA)","author":"Singh","year":"2023"},{"key":"2026032500270407100_ref101","article-title":"Toolformer: language models can teach themselves to use tools.","author":"Schick","year":"2023"},{"key":"2026032500270407100_ref102","first-page":"1877","article-title":"Language models are few-shot learners","volume-title":"Advances in neural information processing systems","author":"Brown","year":"2020"},{"key":"2026032500270407100_ref103","article-title":"Attention is all you need","volume-title":"Advances in neural information processing systems","author":"Vaswani","year":"2017"},{"key":"2026032500270407100_ref104","first-page":"1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel","year":"2020","journal-title":"J Mach Learn Res"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/26\/4\/bbaf377\/63857641\/bbaf377.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/26\/4\/bbaf377\/63857641\/bbaf377.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T04:28:15Z","timestamp":1774412895000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbaf377\/8214234"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7]]},"references-count":104,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,7,2]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbaf377","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2025,7]]},"published":{"date-parts":[[2025,7]]},"article-number":"bbaf377"}}