{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,4]],"date-time":"2026-04-04T00:45:18Z","timestamp":1775263518944,"version":"3.50.1"},"reference-count":57,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2023,11,29]],"date-time":"2023-11-29T00:00:00Z","timestamp":1701216000000},"content-version":"vor","delay-in-days":7,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Youth Project of Zhejiang Province Natural Science Foundation of China","award":["LQ22F020028"],"award-info":[{"award-number":["LQ22F020028"]}]},{"name":"Key Project of Zhejiang Provincial Natural Science Foundation of China","award":["LZ20F030002"],"award-info":[{"award-number":["LZ20F030002"]}]},{"DOI":"10.13039\/501100001809","name":"National Nature Science Foundation of China","doi-asserted-by":"publisher","award":["62201506"],"award-info":[{"award-number":["62201506"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Nature Science Foundation of China","doi-asserted-by":"publisher","award":["62173304"],"award-info":[{"award-number":["62173304"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"publisher","award":["2022ZD0115103"],"award-info":[{"award-number":["2022ZD0115103"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,11,22]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Model quality evaluation is a crucial part of protein structural biology. How to distinguish high-quality models from low-quality models, and to assess which high-quality models have relatively incorrect regions for improvement, are remain a challenge. More importantly, the quality assessment of multimer models is a hot topic for structure prediction. In this study, we propose GraphCPLMQA, a novel approach for evaluating residue-level model quality that combines graph coupled networks and embeddings from protein language models. The GraphCPLMQA consists of a graph encoding module and a transform-based convolutional decoding module. In encoding module, the underlying relational representations of sequence and high-dimensional geometry structure are extracted by protein language models with Evolutionary Scale Modeling. In decoding module, the mapping connection between structure and quality is inferred by the representations and low-dimensional features. Specifically, the triangular location and residue level contact order features are designed to enhance the association between the local structure and the overall topology. Experimental results demonstrate that GraphCPLMQA using single-sequence embedding achieves the best performance compared with the CASP15 residue-level interface evaluation methods among 9108 models in the local residue interface test set of CASP15 multimers. In CAMEO blind test (20 May 2022 to 13 August 2022), GraphCPLMQA ranked first compared with other servers (https:\/\/www.cameo3d.org\/quality-estimation). GraphCPLMQA also outperforms state-of-the-art methods on 19,\u00a0035 models in CASP13 and CASP14 monomer test set.<\/jats:p>","DOI":"10.1093\/bib\/bbad420","type":"journal-article","created":{"date-parts":[[2023,11,2]],"date-time":"2023-11-02T10:24:29Z","timestamp":1698920669000},"source":"Crossref","is-referenced-by-count":17,"title":["Assessing protein model quality based on deep graph coupled networks using protein language model"],"prefix":"10.1093","volume":"25","author":[{"given":"Dong","family":"Liu","sequence":"first","affiliation":[{"name":"College of Information Engineering, Zhejiang University of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Biao","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Zhejiang University of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Zhejiang University of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hui","family":"Li","sequence":"additional","affiliation":[{"name":"researcher of AI in the BioMap"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Le","family":"Song","sequence":"additional","affiliation":[{"name":"Chief Scientist of AI in the BioMap & MBZUAI"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7815-5884","authenticated-orcid":false,"given":"Guijun","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Zhejiang University of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2023,11,28]]},"reference":[{"key":"2023112911311057000_ref1","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1038\/s41586-021-03819-2","article-title":"Highly accurate protein structure prediction with AlphaFold","volume":"596","author":"Jumper","year":"2021","journal-title":"Nature"},{"key":"2023112911311057000_ref2","first-page":"871","article-title":"Accurate prediction of protein structures and interactions using a three-track neural network","volume-title":"Science","author":"Baek"},{"key":"2023112911311057000_ref3","volume-title":"Science","author":"Lin"},{"key":"2023112911311057000_ref4","first-page":"1617","article-title":"Single-sequence protein structure prediction using a language model and deep learning","volume-title":"Nat Biotechnol","author":"Chowdhury","year":"2022"},{"key":"2023112911311057000_ref5","first-page":"243","article-title":"Protein structure and folding pathway prediction based on remote homologs recognition using PAthreader","volume-title":"Commun Biol","author":"Zhao","year":"2023"},{"key":"2023112911311057000_ref6","first-page":"D439","article-title":"AlphaFold protein structure database: massively expanding the structural coverage of protein-sequence space with high-accuracy models","volume-title":"Nucleic Acids Res","author":"Varadi","year":"2022"},{"key":"2023112911311057000_ref7","first-page":"1340","article-title":"Improved protein structure refinement guided by deep learning based accuracy estimation","volume-title":"Nat Commun","author":"Hiranuma","year":"2021"},{"key":"2023112911311057000_ref8","first-page":"W425","article-title":"ModFOLD8: accurate global and local quality estimates for 3D protein models","volume-title":"Nucleic Acids Res","author":"McGuffin","year":"2021"},{"key":"2023112911311057000_ref9","first-page":"1765","article-title":"QMEANDisCo\u2014distance constraints applied on model quality estimation","volume-title":"Bioinformatics","author":"Studer","year":"2020"},{"key":"2023112911311057000_ref10","first-page":"1351","article-title":"Assessment of protein model structure accuracy estimation in CASP13: challenges in the era of deep learning","volume-title":"Proteins","author":"Won","year":"2019"},{"key":"2023112911311057000_ref11","first-page":"1361","article-title":"Estimation of model accuracy in CASP13","volume-title":"Proteins","author":"Cheng","year":"2019"},{"key":"2023112911311057000_ref12","first-page":"349","article-title":"Methods of model accuracy estimation can help selecting the best models from decoy sets: assessment of model accuracy estimations in CASP11","volume-title":"Proteins","author":"Kryshtafovych","year":"2016"},{"key":"2023112911311057000_ref13","first-page":"4046","article-title":"Deep convolutional networks for quality assessment of protein folds","volume-title":"Bioinformatics","author":"Derevyanko","year":"2018"},{"key":"2023112911311057000_ref14","first-page":"3313","article-title":"Protein model quality assessment using 3D oriented convolutional neural networks","volume-title":"Bioinformatics","author":"Pag\u00e8s","year":"2019"},{"key":"2023112911311057000_ref15","article-title":"ROSETTA3: an object-oriented software suite for the simulation and design of macromolecules","volume":"487","author":"Leaver-Fay","journal-title":"Methods Enzymol"},{"key":"2023112911311057000_ref16","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/S0076-6879(04)83004-0","article-title":"Protein structure prediction using Rosetta","volume":"383","author":"Rohl","year":"2004","journal-title":"Methods Enzymol"},{"key":"2023112911311057000_ref17","first-page":"33509","article-title":"ProQ3: improved model quality assessments using Rosetta energy terms","volume-title":"Sci Rep","author":"Uziela","year":"2016"},{"key":"2023112911311057000_ref18","doi-asserted-by":"crossref","first-page":"1131","DOI":"10.1002\/prot.25278","article-title":"VoroMQA: assessment of protein structure quality using interatomic contact areas","volume":"85","author":"Olechnovi\u010d","year":"2017","journal-title":"Proteins"},{"key":"2023112911311057000_ref19","article-title":"Deep transfer learning in the assessment of the quality of protein models","volume-title":"arXiv","author":"Hurtado"},{"key":"2023112911311057000_ref20","first-page":"1895","article-title":"DeepUMQA: ultrafast shape recognition-based protein model quality assessment using deep learning","volume-title":"Bioinformatics","author":"Guo","year":"2022"},{"key":"2023112911311057000_ref21","doi-asserted-by":"crossref","first-page":"1711","DOI":"10.1002\/jcc.20681","article-title":"Ultrafast shape recognition to search compound databases for similar molecular shapes","volume":"28","author":"Ballester","year":"2007","journal-title":"J Comput Chem"},{"key":"2023112911311057000_ref22","doi-asserted-by":"crossref","first-page":"bbac507","DOI":"10.1093\/bib\/bbac507","article-title":"Improved model quality assessment using sequence and structural information by enhanced deep neural networks","volume":"24","author":"Liu","year":"2023","journal-title":"Brief Bioinform"},{"key":"2023112911311057000_ref23","first-page":"1578","article-title":"ProQ3D: improved model quality assessments using deep learning","volume-title":"Bioinformatics","author":"Uziela","year":"2017"},{"key":"2023112911311057000_ref24","first-page":"1","article-title":"AngularQA: protein model quality assessment with LSTM networks","volume-title":"Computational and Mathematical Biophysics","author":"Conover","year":"2019"},{"key":"2023112911311057000_ref25","first-page":"360","article-title":"GraphQA: protein model quality assessment using graph convolutional networks","volume-title":"Bioinformatics","author":"Baldassarre","year":"2021"},{"key":"2023112911311057000_ref26","doi-asserted-by":"crossref","first-page":"155a","DOI":"10.1016\/j.bpj.2021.11.1942","article-title":"Fast, accurate antibody structure prediction from deep learning on massive set of natural antibodies","volume":"121","author":"Ruffolo","year":"2022","journal-title":"Biophysical J"},{"key":"2023112911311057000_ref27","first-page":"8946","volume-title":"International Conference on Machine Learning","author":"Hsu","year":"2022"},{"key":"2023112911311057000_ref28","first-page":"1735","article-title":"High-resolution comparative modeling with RosettaCM","volume-title":"Structure","author":"Song","year":"2013"},{"key":"2023112911311057000_ref29","first-page":"2326","article-title":"I-TASSER-MTD: a deep-learning-based platform for multi-domain protein structure and function prediction","volume-title":"Nat Protoc","author":"Zhou","year":"2022"},{"key":"2023112911311057000_ref30","doi-asserted-by":"crossref","DOI":"10.1101\/2022.01.11.475831","article-title":"De novo protein structure prediction by incremental inter-residue geometries prediction and model quality assessment using deep learning","volume-title":"bioRxiv","author":"Liu","year":"2022"},{"key":"2023112911311057000_ref31","first-page":"173","article-title":"HHblits: lightning-fast iterative protein sequence searching by HMM-HMM alignment","volume-title":"Nat Methods","author":"Remmert"},{"key":"2023112911311057000_ref32","first-page":"D170","article-title":"Uniclust databases of clustered and deeply annotated protein sequences and alignments","volume-title":"Nucleic Acids Res","author":"Mirdita","year":"2017"},{"key":"2023112911311057000_ref33","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1038\/s41592-019-0437-4","article-title":"Protein-level assembly increases protein sequence recovery from metagenomic samples manyfold","volume":"16","author":"Steinegger","year":"2019","journal-title":"Nat Methods"},{"key":"2023112911311057000_ref34","first-page":"8844","volume-title":"International Conference on Machine Learning","author":"Rao","year":"2021"},{"key":"2023112911311057000_ref35","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1006\/jmbi.1998.1645","article-title":"Contact order, transition state placement and the refolding rates of single domain proteins","volume":"277","author":"Plaxco","year":"1998","journal-title":"J Mol Biol"},{"key":"2023112911311057000_ref36","article-title":"Attention is all you need","volume-title":"Advances in neural information processing systems","author":"Vaswani","year":"2017"},{"key":"2023112911311057000_ref37","doi-asserted-by":"crossref","first-page":"10915","DOI":"10.1073\/pnas.89.22.10915","article-title":"Amino acid substitution matrices from protein blocks","volume":"89","author":"Henikoff","year":"1992","journal-title":"Proc Natl Acad Sci U S A"},{"key":"2023112911311057000_ref38","first-page":"360","article-title":"Generation and evaluation of dimension-reduced amino acid parameter representations by artificial neural networks","volume-title":"J Mol Model","author":"Meiler","year":"2001"},{"key":"2023112911311057000_ref39","first-page":"2577","article-title":"Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features","volume-title":"BIOPOLYMERS","author":"Kabsch","year":"1983"},{"key":"2023112911311057000_ref40","article-title":"Graph transformer networks","volume-title":"Advances in Neural Information Processing Systems","author":"Yun","year":"2019"},{"key":"2023112911311057000_ref41","first-page":"9323","volume-title":"International Conference on Machine Learning","author":"Satorras","year":"2021"},{"key":"2023112911311057000_ref42","article-title":"Gaussian error linear units (gelus)","volume-title":"arXiv","author":"Hendrycks"},{"key":"2023112911311057000_ref43","first-page":"11976","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Liu","year":"2022"},{"key":"2023112911311057000_ref44","first-page":"2722","article-title":"lDDT: a local superposition-free score for comparing protein structures and models using distance difference tests","volume-title":"Bioinformatics","author":"Mariani","year":"2013"},{"key":"2023112911311057000_ref45","article-title":"Decoupled weight decay regularization","volume-title":"arXiv","author":"Loshchilov"},{"key":"2023112911311057000_ref46","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1093\/biomet\/30.1-2.81","article-title":"A new measure of rank correlation","volume":"30","author":"Kendall","year":"1938","journal-title":"Biometrika"},{"key":"2023112911311057000_ref47","volume-title":"Advances in Neural Information Processing Systems","author":"Cortes"},{"key":"2023112911311057000_ref48","first-page":"1940","article-title":"Assessment of protein model structure accuracy estimation in CASP14: old and new challenges","volume-title":"Proteins","author":"Kwon","year":"2021"},{"key":"2023112911311057000_ref49","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1080\/01621459.1972.10481251","article-title":"Significance testing of the Spearman rank correlation coefficient","volume":"67","author":"Zar","year":"1972","journal-title":"J Am Stat Assoc"},{"key":"2023112911311057000_ref50","doi-asserted-by":"crossref","first-page":"W274","DOI":"10.1093\/nar\/gkad297","article-title":"Prediction of protein structures, functions and interactions using the IntFOLD7, MultiFOLD and ModFOLDdock servers","volume":"51","author":"McGuffin","year":"2023","journal-title":"Nucleic Acids Res"},{"key":"2023112911311057000_ref51","article-title":"Estimation of model accuracy in CASP15 using the ModFOLDdockserver","volume-title":"Proteins","author":"Edmunds"},{"key":"2023112911311057000_ref52","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1002\/prot.21715","article-title":"QMEAN: a comprehensive scoring function for model quality assessment","volume":"71","author":"Benkert","year":"2008","journal-title":"Proteins"},{"key":"2023112911311057000_ref53","doi-asserted-by":"crossref","first-page":"1411","DOI":"10.1093\/bioinformatics\/btv767","article-title":"ProQ2: estimation of model accuracy implemented in Rosetta","volume":"32","author":"Uziela","year":"2016","journal-title":"Bioinformatics"},{"key":"2023112911311057000_ref54","doi-asserted-by":"crossref","first-page":"W416","DOI":"10.1093\/nar\/gkx332","article-title":"ModFOLD6: an accurate web server for the global and local quality estimation of 3D protein models","volume":"45","author":"Maghrabi","year":"2017","journal-title":"Nucleic Acids Res"},{"key":"2023112911311057000_ref55","article-title":"Deep learning using rectified linear units (ReLU)","volume-title":"arXiv","author":"Agarap"},{"key":"2023112911311057000_ref56","doi-asserted-by":"crossref","DOI":"10.1073\/pnas.2016239118","article-title":"Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences","volume-title":"Proc Natl Acad Sci U S A","author":"Rives","year":"2021"},{"key":"2023112911311057000_ref57","first-page":"29287","article-title":"Language models enable zero-shot prediction of the effects of mutations on protein function","volume-title":"Advances in Neural Information Processing Systems","author":"Meier","year":"2021"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/25\/1\/bbad420\/53896386\/bbad420.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/25\/1\/bbad420\/53896386\/bbad420.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,29]],"date-time":"2023-11-29T06:32:28Z","timestamp":1701239548000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbad420\/7450272"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,22]]},"references-count":57,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,11,22]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbad420","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2023.05.16.540981","asserted-by":"object"}]},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,1,1]]},"published":{"date-parts":[[2023,11,22]]},"article-number":"bbad420"}}