{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T10:07:18Z","timestamp":1784110038069,"version":"3.55.0"},"reference-count":61,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2023,7,29]],"date-time":"2023-07-29T00:00:00Z","timestamp":1690588800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"name":"the major key project of PCL","award":["PCL2021A13"],"award-info":[{"award-number":["PCL2021A13"]}]},{"name":"Nature Science Foundation of China","award":["No. 12131002"],"award-info":[{"award-number":["No. 12131002"]}]},{"name":"Nature Science Foundation of China","award":["No. 32071459"],"award-info":[{"award-number":["No. 32071459"]}]},{"name":"Nature Science Foundation of China","award":["No. 61972217"],"award-info":[{"award-number":["No. 61972217"]}]},{"name":"Nature Science Foundation of China","award":["No. 62006133"],"award-info":[{"award-number":["No. 62006133"]}]},{"name":"Nature Science Foundation of China","award":["No. 62081360152"],"award-info":[{"award-number":["No. 62081360152"]}]},{"DOI":"10.13039\/501100007162","name":"Guangdong Science and Technology Department","doi-asserted-by":"publisher","award":["No. 2020B1111340056"],"award-info":[{"award-number":["No. 2020B1111340056"]}],"id":[{"id":"10.13039\/501100007162","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100021171","name":"Guangdong Basic and Applied Basic Research Foundation","doi-asserted-by":"crossref","award":["No. 2019B1515120049"],"award-info":[{"award-number":["No. 2019B1515120049"]}],"id":[{"id":"10.13039\/501100021171","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2023,11]]},"abstract":"<jats:p>The never-ending emergence of SARS-CoV-2 variations of concern (VOCs) has challenged the whole world for pandemic control. In order to develop effective drugs and vaccines, one needs to efficiently simulate SARS-CoV-2 spike receptor-binding domain (RBD) mutations and identify high-risk variants. We pretrain a large protein language model with approximately 408 million protein sequences and construct a high-throughput screening for the prediction of binding affinity and antibody escape. As the first work on SARS-CoV-2 RBD mutation simulation, we successfully identify mutations in the RBD regions of 5 VOCs and can screen millions of potential variants in seconds. Our workflow scales to 4096 NPUs with 96.5% scalability and 493.9\u00d7 speedup in mixed-precision computing, while achieving a peak performance of 366.8 PFLOPS (reaching 34.9% theoretical peak) on Pengcheng Cloudbrain-II. Our method paves the way for simulating coronavirus evolution in order to prepare for a future pandemic that will inevitably take place. Our models are released at https:\/\/github.com\/ZhiweiNiepku\/SARS-CoV-2_mutation_simulation to facilitate future related work.<\/jats:p>","DOI":"10.1177\/10943420231188077","type":"journal-article","created":{"date-parts":[[2023,7,29]],"date-time":"2023-07-29T06:38:45Z","timestamp":1690612725000},"page":"650-665","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":12,"title":["Running ahead of evolution\u2014AI-based simulation for predicting future high-risk SARS-CoV-2 variants"],"prefix":"10.1177","volume":"37","author":[{"given":"Jie","family":"Chen","sequence":"first","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"},{"name":"School of Electronic and Computer Engineering, Peking University, Shenzhen, China"},{"name":"AI for Science (AI4S)-Preferred Program, Peking University; Shenzhen Graduate School, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2781-5248","authenticated-orcid":false,"given":"Zhiwei","family":"Nie","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"},{"name":"School of Electronic and Computer Engineering, Peking University, Shenzhen, China"},{"name":"AI for Science (AI4S)-Preferred Program, Peking University; Shenzhen Graduate School, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4976-9366","authenticated-orcid":false,"given":"Yu","family":"Wang","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kai","family":"Wang","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fan","family":"Xu","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhiheng","family":"Hu","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bing","family":"Zheng","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"},{"name":"Shenzhen International Graduate School, Tsinghua University, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5814-3798","authenticated-orcid":false,"given":"Zhennan","family":"Wang","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guoli","family":"Song","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingyi","family":"Zhang","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4494-843X","authenticated-orcid":false,"given":"Jie","family":"Fu","sequence":"additional","affiliation":[{"name":"Beijing Academy of Artificial Intelligence, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiansong","family":"Huang","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhongqi","family":"Wang","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4104-3790","authenticated-orcid":false,"given":"Zhixiang","family":"Ren","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2465-1468","authenticated-orcid":false,"given":"Qiankun","family":"Wang","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"},{"name":"State Key Laboratory of Microbial Metabolism, Joint International Research Laboratory of Metabolic and Developmental Sciences and School of Life Sciences and Biotechnology, Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7112-2801","authenticated-orcid":false,"given":"Daixi","family":"Li","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"},{"name":"School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dongqing","family":"Wei","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"},{"name":"State Key Laboratory of Microbial Metabolism, Joint International Research Laboratory of Metabolic and Developmental Sciences and School of Life Sciences and Biotechnology, Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bin","family":"Zhou","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"},{"name":"School of Information Science and Engineering, Shandong University, Qingdao, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chao","family":"Yang","sequence":"additional","affiliation":[{"name":"ICODE and School of Mathematical Sciences, Peking University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yonghong","family":"Tian","sequence":"additional","affiliation":[{"name":"Peng Cheng Laboratory, Shenzhen, China"},{"name":"School of Electronic and Computer Engineering, Peking University, Shenzhen, China"},{"name":"AI for Science (AI4S)-Preferred Program, Peking University; Shenzhen Graduate School, China"},{"name":"School of Computer Science, Peking University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2023,7,29]]},"reference":[{"key":"bibr1-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1093\/emph\/eoac010"},{"key":"bibr2-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btm024"},{"key":"bibr3-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0809524106"},{"key":"bibr4-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-022-01240-x"},{"key":"bibr5-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmb.2020.07.009"},{"key":"bibr6-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1126\/science.abc6952"},{"key":"bibr7-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1038\/s41564-020-0695-z"},{"key":"bibr8-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1010056"},{"key":"bibr9-10943420231188077","volume-title":"Bert: Pre-training of Deep Bidirectional Transformers for Language Understanding","author":"Devlin J","year":"2018"},{"key":"bibr10-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa030747"},{"key":"bibr11-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.3000003"},{"key":"bibr12-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2021.3095381"},{"key":"bibr13-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btq322"},{"key":"bibr14-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-022-32007-7"},{"key":"bibr15-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1093\/molbev\/msp098"},{"key":"bibr16-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1006\/viro.2000.0757"},{"key":"bibr17-10943420231188077","volume-title":"Accurate, Large Minibatch SGD: Training Imagenet in 1 Hour","author":"Goyal P","year":"2017"},{"key":"bibr19-10943420231188077","volume-title":"Large-scale Deep Learning Optimizations: A Comprehensive Survey","author":"He X","year":"2021"},{"key":"bibr20-10943420231188077","volume-title":"Train longer, generalize better: closing the generalization gap in large batch training of neural networks","author":"Hoffer E","year":"2017"},{"key":"bibr21-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1016\/j.cell.2020.02.052"},{"key":"bibr22-10943420231188077","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1031"},{"key":"bibr23-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/18.2.337"},{"issue":"27","key":"bibr24-10943420231188077","first-page":"2100570","volume":"26","author":"Ito K","year":"2021","journal-title":"Euro Surveillance"},{"key":"bibr25-10943420231188077","volume-title":"On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima","author":"Keskar NS","year":"2016"},{"key":"bibr26-10943420231188077","first-page":"1","author":"Lamers MM","year":"2022","journal-title":"Nature Reviews Microbiology"},{"key":"bibr27-10943420231188077","volume-title":"ALBERT: A Lite BERT for Self-Supervised Learning of Language Representations","author":"Lan Z","year":"2019"},{"key":"bibr28-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/bth264"},{"key":"bibr30-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1038\/nature02145"},{"key":"bibr31-10943420231188077","first-page":"5958","volume-title":"International Conference on Machine Learning","author":"Li Z","year":"2020"},{"key":"bibr32-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbac036"},{"key":"bibr34-10943420231188077","volume-title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","author":"Liu Y","year":"2019"},{"key":"bibr35-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1016\/j.tim.2015.06.003"},{"key":"bibr36-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(20)30251-8"},{"key":"bibr37-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1109\/ICENCO49852.2021.9698948"},{"key":"bibr38-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1126\/science.abm1208"},{"key":"bibr39-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1016\/j.csbj.2021.03.022"},{"key":"bibr40-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2020.3004354"},{"key":"bibr41-10943420231188077","doi-asserted-by":"publisher","DOI":"10.3390\/v13050935"},{"key":"bibr42-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/13.3.235"},{"key":"bibr43-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2016239118"},{"key":"bibr44-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2024815118"},{"key":"bibr45-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1010409"},{"key":"bibr46-10943420231188077","doi-asserted-by":"publisher","DOI":"10.2807\/1560-7917.ES.2017.22.13.30494"},{"key":"bibr47-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1016\/j.antiviral.2013.09.028"},{"key":"bibr48-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-12-104"},{"key":"bibr49-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1016\/j.cell.2020.08.012"},{"key":"bibr52-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1016\/S0006-3495(96)79210-X"},{"key":"bibr53-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1016\/j.tim.2016.03.003"},{"key":"bibr54-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btm098"},{"key":"bibr56-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1016\/j.resmic.2009.05.004"},{"key":"bibr57-10943420231188077","volume-title":"Attention is all you need","author":"Vaswani A","year":"2017"},{"key":"bibr58-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1016\/j.cell.2020.02.058"},{"key":"bibr59-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1128\/JVI.00127-20"},{"key":"bibr60-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1126\/science.abb2507"},{"key":"bibr61-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1016\/j.apsb.2020.02.008"},{"key":"bibr62-10943420231188077","volume-title":"Phylotransformer: a discriminative model for mutation prediction based on a multi-head self-attention mechanism","author":"Wu Y","year":"2021"},{"key":"bibr63-10943420231188077","volume-title":"XLNet: generalized autoregressive pretraining for language understanding","author":"Yang Z","year":"2019"},{"key":"bibr64-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1111\/resp.13196"},{"key":"bibr66-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1814684116"},{"key":"bibr67-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa1211721"},{"key":"bibr68-10943420231188077","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020-2012-7"}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420231188077","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/10943420231188077","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420231188077","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T08:17:31Z","timestamp":1777450651000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/10943420231188077"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,29]]},"references-count":61,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,11]]}},"alternative-id":["10.1177\/10943420231188077"],"URL":"https:\/\/doi.org\/10.1177\/10943420231188077","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2022.11.17.516989","asserted-by":"object"}]},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"value":"1094-3420","type":"print"},{"value":"1741-2846","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,29]]}}}