{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T20:37:42Z","timestamp":1775162262474,"version":"3.50.1"},"reference-count":60,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2025,1,16]],"date-time":"2025-01-16T00:00:00Z","timestamp":1736985600000},"content-version":"vor","delay-in-days":55,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01GM146340"],"award-info":[{"award-number":["R01GM146340"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,11,22]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Cryo-electron microscopy (cryo-EM) has revolutionized structural biology by enabling the determination of high-resolution 3-Dimensional (3D) structures of large biological macromolecules. Protein particle picking, the process of identifying individual protein particles in cryo-EM micrographs for building protein structures, has progressed from manual and template-based methods to sophisticated artificial intelligence (AI)-driven approaches in recent years. This review critically examines the evolution and current state of cryo-EM particle picking methods, with an emphasis on the impact of AI. We conducted a comparative evaluation of popular AI-based particle picking methods, using both general machine learning metrics and specific cryo-EM structure determination metrics. This analysis involved constructing the 3D density map from the picked protein particles and assessing the obtained resolution and particle orientation diversity, underscoring the significant impact of AI on cryo-EM particle picking. Despite the advancements, we also identified key obstacles, such as handling complex micrographs with small proteins. The analysis provides insights into the future development of more sophisticated and fully automated AI methods in cryo-EM particle recognition.<\/jats:p>","DOI":"10.1093\/bib\/bbaf011","type":"journal-article","created":{"date-parts":[[2025,1,16]],"date-time":"2025-01-16T13:42:28Z","timestamp":1737034948000},"source":"Crossref","is-referenced-by-count":22,"title":["Artificial intelligence in cryo-EM protein particle picking: recent advances and remaining challenges"],"prefix":"10.1093","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4047-9947","authenticated-orcid":false,"given":"Ashwin","family":"Dhakal","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, University of Missouri , Columbia, MO 65211 ,","place":["United States"]},{"name":"NextGen Precision Health, University of Missouri, Columbia , Columbia, MO 65211 ,","place":["United States"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7052-4964","authenticated-orcid":false,"given":"Rajan","family":"Gyawali","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, University of Missouri , Columbia, MO 65211 ,","place":["United States"]},{"name":"NextGen Precision Health, University of Missouri, Columbia , Columbia, MO 65211 ,","place":["United States"]}]},{"given":"Liguo","family":"Wang","sequence":"additional","affiliation":[{"name":"Laboratory for BioMolecular Structure (LBMS), Brookhaven National Laboratory , Upton, NY 11973 ,","place":["United States"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0305-2853","authenticated-orcid":false,"given":"Jianlin","family":"Cheng","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, University of Missouri , Columbia, MO 65211 ,","place":["United States"]},{"name":"NextGen Precision Health, University of Missouri, Columbia , Columbia, MO 65211 ,","place":["United States"]}]}],"member":"286","published-online":{"date-parts":[[2025,1,16]]},"reference":[{"key":"2025011613420611000_ref1","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1146\/annurev.biophys.31.082901.134202","article-title":"Single-particle imaging of macromolecules by cryo-electron microscopy","volume":"31","author":"Frank","year":"2002","journal-title":"Annu Rev Biophys Biomol Struct"},{"key":"2025011613420611000_ref2","doi-asserted-by":"publisher","first-page":"392","DOI":"10.1038\/s41597-023-02280-2","article-title":"A large expert-curated cryo-EM image dataset for machine learning protein particle picking","volume":"10","author":"Dhakal","year":"2023","journal-title":"Sci Data"},{"key":"2025011613420611000_ref3","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1016\/j.tibs.2014.10.005","article-title":"How cryo-EM is revolutionizing structural biology","volume":"40","author":"Bai","year":"2015","journal-title":"Trends Biochem Sci"},{"key":"2025011613420611000_ref4","doi-asserted-by":"publisher","first-page":"1042","DOI":"10.1042\/BST0371042","article-title":"The \u2018super-resolution\u2019 revolution","volume":"37","author":"Davis","year":"2009","journal-title":"Biochem Soc Trans"},{"key":"2025011613420611000_ref5","doi-asserted-by":"publisher","first-page":"1714","DOI":"10.1109\/18.857786","article-title":"Ab initio reconstruction and experimental design for cryo electron microscopy","volume":"46","author":"Doerschuk","year":"2000","journal-title":"IEEE Trans Inf Theory"},{"key":"2025011613420611000_ref6","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1016\/bs.mie.2016.04.011","volume-title":"Methods in Enzymology","author":"Passmore","year":"2016"},{"key":"2025011613420611000_ref7","doi-asserted-by":"publisher","first-page":"749","DOI":"10.1016\/j.bpj.2015.07.050","article-title":"Factors that influence the formation and stability of thin, cryo-EM specimens","volume":"110","author":"Glaeser","year":"2016","journal-title":"Biophys J"},{"key":"2025011613420611000_ref8","doi-asserted-by":"publisher","first-page":"463","DOI":"10.1038\/s41592-021-01130-6","article-title":"Understanding the invisible hands of sample preparation for cryo-EM","volume":"18","author":"Weissenberger","year":"2021","journal-title":"Nat Methods"},{"key":"2025011613420611000_ref9","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1016\/j.jsb.2013.01.004","article-title":"A method to achieve homogeneous dispersion of large transmembrane complexes within the holes of carbon films for electron cryomicroscopy","volume":"182","author":"Cheung","year":"2013","journal-title":"J Struct Biol"},{"key":"2025011613420611000_ref10","doi-asserted-by":"publisher","first-page":"190","DOI":"10.1006\/jsbi.1996.0030","article-title":"SPIDER and WEB: processing and visualization of images in 3D electron microscopy and related fields","volume":"116","author":"Frank","year":"1996","journal-title":"J Struct Biol"},{"key":"2025011613420611000_ref11","doi-asserted-by":"publisher","DOI":"10.1101\/2023.02.21.529443","article-title":"CryoPPP: a large expert-labelled cryo-EM image dataset for machine learning protein particle picking","volume":"2023","author":"Dhakal","year":"2023","journal-title":"bioRxiv"},{"key":"2025011613420611000_ref12","doi-asserted-by":"publisher","first-page":"584","DOI":"10.1038\/nmeth.2472","article-title":"Electron counting and beam-induced motion correction enable near-atomic-resolution single-particle cryo-EM","volume":"10","author":"Li","year":"2013","journal-title":"Nat Methods"},{"key":"2025011613420611000_ref13","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbab476","volume-title":"Artificial Intelligence in the Prediction of Protein-Ligand Interactions: Recent Advances and Future Directions","author":"Dhakal","year":"2022"},{"key":"2025011613420611000_ref14","article-title":"Diffdock: diffusion steps, twists, and turns for molecular docking.","author":"Corso","year":"2022"},{"key":"2025011613420611000_ref15","first-page":"20503","volume-title":"International conference on machine learning","author":"St\u00e4rk","year":"2022"},{"key":"2025011613420611000_ref16","doi-asserted-by":"publisher","DOI":"10.1101\/2023.08.06.552202","article-title":"Predicting protein-ligand binding structure using E(n) Equivariant graph neural networks","volume":"2023","author":"Dhakal","year":"2023","journal-title":"bioRxiv"},{"key":"2025011613420611000_ref17","doi-asserted-by":"publisher","first-page":"519","DOI":"10.1016\/j.jsb.2012.09.006","article-title":"RELION: implementation of a Bayesian approach to cryo-EM structure determination","volume":"180","author":"Scheres","year":"2012","journal-title":"J Struct Biol"},{"key":"2025011613420611000_ref18","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.jsb.2006.05.009","article-title":"EMAN2: an extensible image processing suite for electron microscopy","volume":"157","author":"Tang","year":"2007","journal-title":"J Struct Biol"},{"key":"2025011613420611000_ref19","doi-asserted-by":"publisher","DOI":"10.1101\/2023.12.25.573312","article-title":"CryoVirusDB: a Labeled cryo-EM image dataset for AI-driven virus particle picking","author":"Gyawali","year":"2023"},{"key":"2025011613420611000_ref20","doi-asserted-by":"publisher","first-page":"D1503","DOI":"10.1093\/nar\/gkac1062","article-title":"EMPIAR: the electron microscopy public image archive","volume":"51","author":"Iudin","year":"2023","journal-title":"Nucleic Acids Res"},{"key":"2025011613420611000_ref21","first-page":"120","article-title":"The opencv library","volume":"25","author":"Bradski","year":"2000","journal-title":"Dr Dobb\u2019s Journal: Software Tools for the Professional Programmer"},{"key":"2025011613420611000_ref22","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1016\/j.jsb.2003.11.005","article-title":"Detecting particles in cryo-EM micrographs using learned features","volume":"145","author":"Mallick","year":"2004","journal-title":"J Struct Biol"},{"key":"2025011613420611000_ref23","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.jsb.2003.09.033","article-title":"Automatic particle selection: results of a comparative study","volume":"145","author":"Zhu","year":"2004","journal-title":"J Struct Biol"},{"key":"2025011613420611000_ref24","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1186\/1472-6807-13-25","article-title":"gEMpicker: a highly parallel GPU-accelerated particle picking tool for cryo-electron microscopy","volume":"13","author":"Hoang","year":"2013","journal-title":"BMC Struct Biol"},{"key":"2025011613420611000_ref25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.jsb.2014.03.001","article-title":"Automated particle picking for low-contrast macromolecules in cryo-electron microscopy","volume":"186","author":"Langlois","year":"2014","journal-title":"J Struct Biol"},{"key":"2025011613420611000_ref26","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1016\/j.jsb.2018.08.012","article-title":"APPLE picker: automatic particle picking, a low-effort cryo-EM framework","volume":"204","author":"Heimowitz","year":"2018","journal-title":"J Struct Biol"},{"key":"2025011613420611000_ref27","doi-asserted-by":"publisher","DOI":"10.3390\/genes10090666","article-title":"A super-clustering approach for fully automated single particle picking in cryo-EM","volume":"10","author":"Al Azzawi","year":"2019","journal-title":"Genes (Basel)"},{"key":"2025011613420611000_ref28","doi-asserted-by":"publisher","first-page":"326","DOI":"10.1186\/s12859-019-2926-y","article-title":"Autocryopicker: an unsupervised learning approach for fully automated single particle picking in cryo-EM images","volume":"20","author":"Al-Azzawi","year":"2019","journal-title":"BMC Bioinformatics"},{"key":"2025011613420611000_ref29","doi-asserted-by":"publisher","first-page":"1883","DOI":"10.7554\/eLife.35383.001","article-title":"Plasma hormone profiles in populations at different risk for breast cancer","volume":"36","author":"Rona","year":"2018","journal-title":"Elife"},{"key":"2025011613420611000_ref47","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1016\/j.jsb.2016.07.006","article-title":"DeepPicker: a deep learning approach for fully automated particle picking in cryo-EM","volume":"195","author":"Wang","year":"2016","journal-title":"J Struct Biol"},{"key":"2025011613420611000_ref30","doi-asserted-by":"publisher","first-page":"348","DOI":"10.1186\/s12859-017-1757-y","article-title":"A deep convolutional neural network approach to single-particle recognition in cryo-electron microscopy","volume":"18","author":"Zhu","year":"2017","journal-title":"BMC Bioinformatics"},{"key":"2025011613420611000_ref48","doi-asserted-by":"publisher","DOI":"10.1063\/1.4982020","volume-title":"AIP Conference Proceedings","author":"Xiao","year":"2017"},{"key":"2025011613420611000_ref35","doi-asserted-by":"publisher","first-page":"1146","DOI":"10.1038\/s41592-019-0580-y","article-title":"Real-time cryo-electron microscopy data preprocessing with warp","volume":"16","author":"Tegunov","year":"2019","journal-title":"Nat Methods"},{"key":"2025011613420611000_ref49","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1038\/s42003-019-0437-z","article-title":"SPHIRE-crYOLO is a fast and accurate fully automated particle picker for cryo-EM","volume":"2","author":"Wagner","year":"2019","journal-title":"Commun Biol"},{"key":"2025011613420611000_ref31","volume-title":"30th British Machine Vision Conference 2019, BMVC","author":"Masoumzadeh","year":"2019"},{"key":"2025011613420611000_ref33","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-019-2614-y","article-title":"PIXER: an automated particle-selection method based on segmentation using a deep neural network","volume":"20","author":"Zhang","year":"2019","journal-title":"BMC Bioinformatics"},{"key":"2025011613420611000_ref36","doi-asserted-by":"publisher","first-page":"1153","DOI":"10.1038\/s41592-019-0575-8","article-title":"Positive-unlabeled convolutional neural networks for particle picking in cryo-electron micrographs","volume":"16","author":"Bepler","year":"2019","journal-title":"Nat Methods"},{"key":"2025011613420611000_ref37","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1186\/s12859-020-03809-7","article-title":"DeepCryoPicker: fully automated deep neural network for single protein particle picking in cryo-EM","volume":"21","author":"Al-Azzawi","year":"2020","journal-title":"BMC Bioinformatics"},{"key":"2025011613420611000_ref38","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1107\/S2052252520007241","article-title":"A self-supervised workflow for particle picking in cryo-EM","volume":"7","author":"McSweeney","year":"2020","journal-title":"IUCrJ"},{"key":"2025011613420611000_ref39","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1186\/s12859-020-03948-x","article-title":"DRPnet: automated particle picking in cryo-electron micrographs using deep regression","volume":"22","author":"Nguyen","year":"2021","journal-title":"BMC Bioinformatics"},{"key":"2025011613420611000_ref40","doi-asserted-by":"publisher","first-page":"1179","DOI":"10.1109\/BIBM52615.2021.9669524","volume-title":"Proceedings - 2021 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2021","author":"Zhang","year":"2021"},{"key":"2025011613420611000_ref41","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1038\/s42003-021-01721-1","article-title":"CASSPER is a semantic segmentation-based particle picking algorithm for single-particle cryo-electron microscopy","volume":"4","author":"George","year":"2021","journal-title":"Commun Biol"},{"key":"2025011613420611000_ref42","doi-asserted-by":"publisher","first-page":"1593","DOI":"10.32604\/cmc.2022.025072","article-title":"Urdnet: a cryo-EM particle automatic picking method","volume":"72","author":"Ouyang","year":"2022","journal-title":"Computers, Materials and Continua"},{"key":"2025011613420611000_ref43","doi-asserted-by":"publisher","first-page":"1066","DOI":"10.1109\/BIBM55620.2022.9994906","volume-title":"Proceedings - 2022 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2022","author":"Li","year":"2022"},{"key":"2025011613420611000_ref44","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1109\/MedAI62885.2024.00009","volume-title":"2024 IEEE International Conference on Medical Artificial Intelligence (MedAI)","author":"He","year":"2024"},{"key":"2025011613420611000_ref45","doi-asserted-by":"publisher","first-page":"bbae282","DOI":"10.1093\/bib\/bbae282","article-title":"CryoSegNet: accurate cryo-EM protein particle picking by integrating the foundational AI image segmentation model and attention-gated U-net","volume":"25","author":"Gyawali","year":"2024","journal-title":"Brief Bioinform"},{"key":"2025011613420611000_ref46","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btae109","article-title":"CryoTransformer: a transformer model for picking protein particles from cryo-EM micrographs","volume":"40","author":"Dhakal","year":"2024","journal-title":"Bioinformatics"},{"key":"2025011613420611000_ref50","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2404.10178","article-title":"CryoMAE: few-shot cryo-EM particle picking with masked Autoencoders","author":"Xu","year":"2024","journal-title":"ArXiv"},{"key":"2025011613420611000_ref51","volume-title":"ICML 2024 Workshop on Efficient and Accessible Foundation Models for Biological Discovery","author":"Zamanos","year":"2024"},{"key":"2025011613420611000_ref34","doi-asserted-by":"publisher","first-page":"1440","DOI":"10.1109\/ICCV.2015.169","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Girshick","year":"2015"},{"key":"2025011613420611000_ref32","doi-asserted-by":"publisher","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"DeepLab: semantic image segmentation with deep convolutional nets, Atrous convolution, and fully connected CRFs","volume":"40","author":"Chen","year":"2018","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"2025011613420611000_ref52","article-title":"Deformable detr: Deformable transformers for end-to-end object detection","author":"Zhu","year":"2020"},{"key":"2025011613420611000_ref53","doi-asserted-by":"publisher","first-page":"btae290","DOI":"10.1093\/bioinformatics\/btae290","article-title":"LMCrot: an enhanced protein crotonylation site predictor by leveraging an interpretable window-level embedding from a transformer-based protein language model","volume":"40","author":"Pratyush","year":"2024","journal-title":"Bioinformatics"},{"key":"2025011613420611000_ref54","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2311.16140","article-title":"Adapting segment anything model (SAM) through prompt-based learning for enhanced protein identification in cryo-EM micrographs","author":"He","year":"2023"},{"key":"2025011613420611000_ref55","doi-asserted-by":"publisher","first-page":"3992","DOI":"10.1109\/ICCV51070.2023.00371","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Kirillov","year":"2023"},{"key":"2025011613420611000_ref56","doi-asserted-by":"publisher","DOI":"10.1101\/2023.10.02.560572","article-title":"Accurate cryo-EM protein particle picking by integrating the foundational AI image segmentation model and specialized U-net","author":"Gyawali","year":"2024","journal-title":"bioRxiv"},{"key":"2025011613420611000_ref57","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1038\/nmeth.4169","article-title":"CryoSPARC: algorithms for rapid unsupervised cryo-EM structure determination","volume":"14","author":"Punjani","year":"2017","journal-title":"Nat Methods"},{"key":"2025011613420611000_ref58","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1002\/pro.3943","article-title":"UCSF ChimeraX: structure visualization for researchers, educators, and developers","volume":"30","author":"Pettersen","year":"2021","journal-title":"Protein Sci"},{"key":"2025011613420611000_ref59","first-page":"10012","volume-title":"Proceedings of the IEEE\/CVF international conference on computer vision","author":"Liu","year":"2021"},{"key":"2025011613420611000_ref60","first-page":"213","volume-title":"European conference on computer vision","author":"Carion","year":"2020"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/26\/1\/bbaf011\/61458053\/bbaf011.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/26\/1\/bbaf011\/61458053\/bbaf011.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,16]],"date-time":"2025-01-16T13:42:33Z","timestamp":1737034953000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbaf011\/7958312"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,22]]},"references-count":60,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,11,22]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbaf011","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2025,1]]},"published":{"date-parts":[[2024,11,22]]},"article-number":"bbaf011"}}