{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,19]],"date-time":"2026-01-19T03:37:40Z","timestamp":1768793860297,"version":"3.49.0"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1009027","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,6,4]],"date-time":"2021-06-04T00:00:00Z","timestamp":1622764800000}}],"reference-count":72,"publisher":"Public Library of Science (PLoS)","issue":"5","license":[{"start":{"date-parts":[[2021,5,24]],"date-time":"2021-05-24T00:00:00Z","timestamp":1621814400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2018YFB0204403"],"award-info":[{"award-number":["2018YFB0204403"]}]},{"name":"Strategic Priority CAS Project","award":["XDB38000000"],"award-info":[{"award-number":["XDB38000000"]}]},{"DOI":"10.13039\/501100001809","name":"National Science Foundation of China","doi-asserted-by":"crossref","award":["Grant no. U1813203"],"award-info":[{"award-number":["Grant no. U1813203"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Shenzhen Basic Research Fund","award":["JCYJ20180507182818013"],"award-info":[{"award-number":["JCYJ20180507182818013"]}]},{"name":"Shenzhen Basic Research Fund","award":["JCYJ20170413093358429"],"award-info":[{"award-number":["JCYJ20170413093358429"]}]},{"name":"CAS Key Lab","award":["2011DP173015"],"award-info":[{"award-number":["2011DP173015"]}]},{"name":"Youth Innovation Promotion Associatio"},{"name":"the Outstanding Youth Innovation Fun"},{"DOI":"10.13039\/501100001809","name":"National Science Foundation of China","doi-asserted-by":"crossref","award":["61802384"],"award-info":[{"award-number":["61802384"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Shenzhen Basic Research Fund","award":["JCYJ20200109114818703"],"award-info":[{"award-number":["JCYJ20200109114818703"]}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Sequence-based residue contact prediction plays a crucial role in protein structure reconstruction. In recent years, the combination of evolutionary coupling analysis (ECA) and deep learning (DL) techniques has made tremendous progress for residue contact prediction, thus a comprehensive assessment of current methods based on a large-scale benchmark data set is very needed. In this study, we evaluate 18 contact predictors on 610 non-redundant proteins and 32 CASP13 targets according to a wide range of perspectives. The results show that different methods have different application scenarios: (1) DL methods based on multi-categories of inputs and large training sets are the best choices for low-contact-density proteins such as the intrinsically disordered ones and proteins with shallow multi-sequence alignments (MSAs). (2) With at least 5L (L is sequence length) effective sequences in the MSA, all the methods show the best performance, and methods that rely only on MSA as input can reach comparable achievements as methods that adopt multi-source inputs. (3) For top L\/5 and L\/2 predictions, DL methods can predict more hydrophobic interactions while ECA methods predict more salt bridges and disulfide bonds. (4) ECA methods can detect more secondary structure interactions, while DL methods can accurately excavate more contact patterns and prune isolated false positives. In general, multi-input DL methods with large training sets dominate current approaches with the best overall performance. Despite the great success of current DL methods must be stated the fact that there is still much room left for further improvement: (1) With shallow MSAs, the performance will be greatly affected. (2) Current methods show lower precisions for inter-domain compared with intra-domain contact predictions, as well as very high imbalances in precisions between intra-domains. (3) Strong prediction similarities between DL methods indicating more feature types and diversified models need to be developed. (4) The runtime of most methods can be further optimized.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1009027","type":"journal-article","created":{"date-parts":[[2021,5,24]],"date-time":"2021-05-24T17:31:01Z","timestamp":1621877461000},"page":"e1009027","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":24,"title":["Evaluation of residue-residue contact prediction methods: From retrospective to prospective"],"prefix":"10.1371","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7856-2703","authenticated-orcid":true,"given":"Huiling","family":"Zhang","sequence":"first","affiliation":[]},{"given":"Zhendong","family":"Bei","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4272-7518","authenticated-orcid":true,"given":"Wenhui","family":"Xi","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5696-7745","authenticated-orcid":true,"given":"Min","family":"Hao","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7720-1570","authenticated-orcid":true,"given":"Zhen","family":"Ju","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5541-234X","authenticated-orcid":true,"given":"Konda Mani","family":"Saravanan","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2133-1768","authenticated-orcid":true,"given":"Haiping","family":"Zhang","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3434-3717","authenticated-orcid":true,"given":"Ning","family":"Guo","sequence":"additional","affiliation":[]},{"given":"Yanjie","family":"Wei","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2021,5,24]]},"reference":[{"key":"pcbi.1009027.ref001","doi-asserted-by":"crossref","first-page":"1072","DOI":"10.1038\/nbt.2419","article-title":"Protein structure prediction from sequence variation","volume":"30","author":"DS Marks","year":"2012","journal-title":"Nature biotechnology"},{"key":"pcbi.1009027.ref002","doi-asserted-by":"crossref","first-page":"E1540","DOI":"10.1073\/pnas.1120036109","article-title":"Accurate de novo structure prediction of large transmembrane protein domains using fragment-assembly and correlated mutation analysis","volume":"109","author":"T Nugent","year":"2012","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1009027.ref003","first-page":"9","article-title":"De novo structure prediction of globular proteins aided by sequence variation-derived contacts","author":"T Kosciolek","year":"2014","journal-title":"PloS one"},{"key":"pcbi.1009027.ref004","doi-asserted-by":"crossref","first-page":"i482","DOI":"10.1093\/bioinformatics\/btu458","article-title":"PconsFold: improved contact predictions improve protein models","volume":"30","author":"M Michel","year":"2014","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref005","doi-asserted-by":"crossref","first-page":"1436","DOI":"10.1002\/prot.24829","article-title":"CONFOLD: residue-residue contact-guided ab initio protein folding","volume":"83","author":"B Adhikari","year":"2015","journal-title":"Proteins: Structure, Function, and Bioinformatics"},{"key":"pcbi.1009027.ref006","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1038\/nmeth.3213","article-title":"The I-TASSER Suite: protein structure and function prediction","volume":"12","author":"J Yang","year":"2015","journal-title":"Nature methods"},{"key":"pcbi.1009027.ref007","doi-asserted-by":"crossref","first-page":"W361","DOI":"10.1093\/nar\/gkw307","article-title":"CoinFold: a web server for protein contact prediction and contact-assisted protein folding","volume":"44","author":"S Wang","year":"2016","journal-title":"Nucleic acids research"},{"key":"pcbi.1009027.ref008","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1186\/s12859-018-2032-6","article-title":"CONFOLD2: improved contact-driven ab initio protein structure modeling","volume":"19","author":"B Adhikari","year":"2018","journal-title":"BMC bioinformatics"},{"key":"pcbi.1009027.ref009","article-title":"SPOT-Fold: Fragment-Free Protein Structure Prediction Guided by Predicted Backbone Structure and Contact Map","author":"Y Cai","year":"2019","journal-title":"Journal of Computational Chemistry"},{"key":"pcbi.1009027.ref010","author":"Bassot Claudio","year":"2019","journal-title":"Using PconsC4 and PconsFold2 to Predict Protein Structure"},{"key":"pcbi.1009027.ref011","first-page":"1","article-title":"DESTINI: A deep-learning approach to contact-driven protein structure prediction","volume":"9","author":"M Gao","year":"2019","journal-title":"Scientific reports"},{"key":"pcbi.1009027.ref012","article-title":"CGLFold: a contact-assisted de novo protein structure prediction using global exploration and loop perturbation sampling algorithm","author":"L Jun","year":"2019","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref013","doi-asserted-by":"crossref","first-page":"16856","DOI":"10.1073\/pnas.1821309116","article-title":"Distance-based protein folding powered by deep learning","volume":"116","author":"J Xu","year":"2019","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1009027.ref014","first-page":"201914677","article-title":"Improved protein structure prediction using predicted interresidue orientations","author":"J Yang","year":"2020","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1009027.ref015","first-page":"1","article-title":"Improved protein structure prediction using potentials from deep learning","author":"AW Senior","year":"2020","journal-title":"Nature"},{"key":"pcbi.1009027.ref016","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1002\/pro.2002","article-title":"Protein topology from predicted residue contacts","volume":"21","author":"WR Taylor","year":"2012","journal-title":"Protein Science"},{"key":"pcbi.1009027.ref017","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1006\/jmbi.1996.0114","article-title":"Residue\u2013residue potentials with a favorable contact pair term and an unfavorable high packing density term, for simulation and threading","volume":"256","author":"S Miyazawa","year":"1996","journal-title":"Journal of molecular biology"},{"key":"pcbi.1009027.ref018","doi-asserted-by":"crossref","first-page":"i263","DOI":"10.1093\/bioinformatics\/bty278","article-title":"Protein threading using residue co-variation and deep learning","volume":"34","author":"J Zhu","year":"2018","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref019","doi-asserted-by":"crossref","first-page":"e07454","DOI":"10.7554\/eLife.07454","article-title":"Contacts-based prediction of binding affinity in protein\u2013protein complexes","volume":"4","author":"A Vangone","year":"2015","journal-title":"elife"},{"key":"pcbi.1009027.ref020","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.ymeth.2016.06.001","article-title":"Prediction of residue-residue contact matrix for protein-protein interaction with Fisher score features and deep learning","volume":"110","author":"T Du","year":"2016","journal-title":"Methods"},{"key":"pcbi.1009027.ref021","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1126\/science.aaw6718","article-title":"Protein interaction networks revealed by proteome coevolution","volume":"365","author":"Q Cong","year":"2019","journal-title":"Science"},{"key":"pcbi.1009027.ref022","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1002\/pro.2770","article-title":"Assessment of the utility of contact-based restraints in accelerating the prediction of protein structure using molecular dynamics simulations","volume":"25","author":"A Raval","year":"2016","journal-title":"Protein Science"},{"key":"pcbi.1009027.ref023","doi-asserted-by":"crossref","first-page":"2164","DOI":"10.1002\/jcc.25847","article-title":"Introduction of a bounded penalty function in contact-assisted simulations of protein structures to omit false restraints","volume":"40","author":"EA Lubecka","year":"2019","journal-title":"Journal of computational chemistry"},{"key":"pcbi.1009027.ref024","doi-asserted-by":"crossref","first-page":"E1733","DOI":"10.1073\/pnas.1201301109","article-title":"Structural basis of histidine kinase autophosphorylation deduced by integrating genomics, molecular dynamics, and mutagenesis","volume":"109","author":"AE Dago","year":"2012","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1009027.ref025","doi-asserted-by":"crossref","first-page":"929","DOI":"10.1002\/prot.22202","article-title":"Towards accurate residue\u2013residue hydrophobic contact prediction for \u03b1 helical proteins via integer linear optimization","volume":"74","author":"R Rajgaria","year":"2009","journal-title":"Proteins: Structure, Function, and Bioinformatics"},{"key":"pcbi.1009027.ref026","doi-asserted-by":"crossref","first-page":"1825","DOI":"10.1002\/prot.22696","article-title":"Contact prediction for beta and alpha-beta proteins using integer linear optimization and its impact on the first principles 3D structure prediction method ASTRO-FOLD","volume":"78","author":"R Rajgaria","year":"2010","journal-title":"Proteins: Structure, Function, and Bioinformatics"},{"key":"pcbi.1009027.ref027","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1186\/1471-2105-8-113","article-title":"Improved residue contact prediction using support vector machines and a large feature set","volume":"8","author":"B Pierre","year":"2007","journal-title":"Bmc Bioinformatics"},{"key":"pcbi.1009027.ref028","doi-asserted-by":"crossref","first-page":"W515","DOI":"10.1093\/nar\/gkp305","article-title":"NNcon: improved protein contact map prediction using 2D-recursive neural networks","volume":"37","author":"AN Tegge","year":"2009","journal-title":"Nucleic Acids Research"},{"key":"pcbi.1009027.ref029","doi-asserted-by":"crossref","first-page":"924","DOI":"10.1093\/bioinformatics\/btn069","article-title":"A comprehensive assessment of sequence-based and template-based methods for protein contact prediction","volume":"24","author":"S Wu","year":"2008","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref030","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1002\/prot.22329","article-title":"Predicting residue\u2013residue contact maps by a two-layer, integrated neural-network method","volume":"76","author":"B Xue","year":"2009","journal-title":"Proteins"},{"key":"pcbi.1009027.ref031","doi-asserted-by":"crossref","first-page":"i266","DOI":"10.1093\/bioinformatics\/btt211","article-title":"Predicting protein contact map using evolutionary and physical constraints by integer programming","volume":"29","author":"Z Wang","year":"2013","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref032","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1002\/prot.24979","article-title":"COMSAT: Residue contact prediction of transmembrane proteins based on support vector machines and mixed integer linear programming","volume":"84","author":"H Zhang","year":"2016","journal-title":"Proteins: Structure, Function, and Bioinformatics"},{"key":"pcbi.1009027.ref033","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1073\/pnas.0805923106","article-title":"Identification of direct residue contacts in protein\u2013protein interaction by message passing","volume":"106","author":"M Weigt","year":"2009","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1009027.ref034","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1093\/bioinformatics\/btr638","article-title":"PSICOV: precise structural contact prediction using sparse inverse covariance estimation on large multiple sequence alignments","volume":"28","author":"DT Jones","year":"2012","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref035","doi-asserted-by":"crossref","first-page":"E1293","DOI":"10.1073\/pnas.1111471108","article-title":"Direct-coupling analysis of residue coevolution captures native contacts across many protein families","volume":"108","author":"F Morcos","year":"2011","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1009027.ref036","doi-asserted-by":"crossref","first-page":"012707","DOI":"10.1103\/PhysRevE.87.012707","article-title":"Improved contact prediction in proteins: using pseudolikelihoods to infer Potts models","volume":"87","author":"M Ekeberg","year":"2013","journal-title":"Physical Review E"},{"key":"pcbi.1009027.ref037","doi-asserted-by":"crossref","first-page":"15674","DOI":"10.1073\/pnas.1314045110","article-title":"Assessing the utility of coevolution-based residue\u2013residue contact predictions in a sequence-and structure-rich era","volume":"110","author":"H Kamisetty","year":"2013","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1009027.ref038","doi-asserted-by":"crossref","first-page":"3128","DOI":"10.1093\/bioinformatics\/btu500","article-title":"CCMpred\u2014fast and precise prediction of protein residue\u2013residue contacts from correlated mutations","volume":"30","author":"S Seemayer","year":"2014","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref039","doi-asserted-by":"crossref","first-page":"e92721","DOI":"10.1371\/journal.pone.0092721","article-title":"Fast and accurate multivariate Gaussian modeling of protein families: predicting residue contacts and protein-interaction partners","volume":"9","author":"C Baldassi","year":"2014","journal-title":"PloS one"},{"key":"pcbi.1009027.ref040","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1186\/1471-2105-15-85","article-title":"FreeContact: fast and free software for protein contact prediction from residue co-evolution","volume":"15","author":"L Kaj\u00e1n","year":"2014","journal-title":"BMC bioinformatics"},{"key":"pcbi.1009027.ref041","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.bbrc.2016.01.188","article-title":"Improving residue\u2013residue contact prediction via low-rank and sparse decomposition of residue correlation matrix","volume":"472","author":"H Zhang","year":"2016","journal-title":"Biochemical and biophysical research communications"},{"key":"pcbi.1009027.ref042","doi-asserted-by":"crossref","first-page":"1815","DOI":"10.1093\/bioinformatics\/btt259","article-title":"PconsC: combination of direct information methods and alignments improves contact prediction","volume":"29","author":"MJ Skwark","year":"2013","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref043","doi-asserted-by":"crossref","first-page":"999","DOI":"10.1093\/bioinformatics\/btu791","article-title":"MetaPSICOV: combining coevolution methods for accurate prediction of contacts and long range hydrogen bonding in proteins","volume":"31","author":"DT Jones","year":"2015","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref044","doi-asserted-by":"crossref","first-page":"2296","DOI":"10.1093\/bioinformatics\/btx164","article-title":"NeBcon: protein contact map prediction using neural network training coupled with na\u00efve Bayes classifiers","volume":"33","author":"B He","year":"2017","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref045","doi-asserted-by":"crossref","first-page":"3308","DOI":"10.1093\/bioinformatics\/bty341","article-title":"High precision in protein contact prediction using fully convolutional neural networks and minimal sequence features","volume":"34","author":"DT Jones","year":"2018","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref046","doi-asserted-by":"crossref","first-page":"2677","DOI":"10.1093\/bioinformatics\/bty1036","article-title":"PconsC4: fast, accurate and hassle-free contact predictions","volume":"35","author":"M Michel","year":"2019","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref047","doi-asserted-by":"crossref","first-page":"e1005324","DOI":"10.1371\/journal.pcbi.1005324","article-title":"Accurate de novo prediction of protein contact map by ultra-deep learning model","volume":"13","author":"S Wang","year":"2017","journal-title":"PLoS computational biology"},{"key":"pcbi.1009027.ref048","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.cels.2017.11.014","article-title":"Enhancing evolutionary couplings with deep convolutional neural networks","volume":"6","author":"Y Liu","year":"2018","journal-title":"Cell systems"},{"key":"pcbi.1009027.ref049","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1016\/j.csbj.2018.10.009","article-title":"DeepConPred2: An Improved Method for the Prediction of Protein Residue Contacts","volume":"16","author":"W Ding","year":"2018","journal-title":"Computational and Structural Biotechnology Journal"},{"key":"pcbi.1009027.ref050","doi-asserted-by":"crossref","first-page":"1466","DOI":"10.1093\/bioinformatics\/btx781","article-title":"DNCON2: improved protein contact prediction using two-level deep convolutional neural networks","volume":"34","author":"B Adhikari","year":"2018","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref051","first-page":"590455","article-title":"DEEPCON: Protein Contact Prediction using Dilated Convolutional Neural Networks with Dropout","author":"B Adhikari","year":"2019","journal-title":"bioRxiv"},{"key":"pcbi.1009027.ref052","doi-asserted-by":"crossref","first-page":"4039","DOI":"10.1093\/bioinformatics\/bty481","article-title":"Accurate prediction of protein contact maps by coupling residual two-dimensional bidirectional long short-term memory with convolutional neural networks","volume":"34","author":"J Hanson","year":"2018","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref053","doi-asserted-by":"crossref","first-page":"e0205214","DOI":"10.1371\/journal.pone.0205214","article-title":"DeepCDpred: Inter-residue distance and contact prediction for improved prediction of protein structure","volume":"14","author":"S Ji","year":"2019","journal-title":"PloS one"},{"key":"pcbi.1009027.ref054","doi-asserted-by":"crossref","first-page":"4647","DOI":"10.1093\/bioinformatics\/btz291","article-title":"ResPRE: high-accuracy protein contact prediction by coupling precision matrix with deep residual neural networks","volume":"35","author":"Y Li","year":"2019","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref055","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1093\/bioinformatics\/btz477","article-title":"Protein contact prediction using metagenome sequence data and residual neural networks","volume":"36","author":"Q Wu","year":"2020","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref056","first-page":"118","article-title":"Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences","author":"A Rives","year":"2021","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1009027.ref057","article-title":"Transformer protein language models are unsupervised structure learners","author":"R Rao","year":"2020","journal-title":"bioRxiv"},{"key":"pcbi.1009027.ref058","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1002\/prot.25415","article-title":"Critical assessment of methods of protein structure prediction (CASP)\u2014Round XII","volume":"86","author":"J Moult","year":"2018","journal-title":"Proteins: Structure, Function, and Bioinformatics"},{"key":"pcbi.1009027.ref059","doi-asserted-by":"crossref","first-page":"1058","DOI":"10.1002\/prot.25819","article-title":"Assessing the accuracy of contact predictions in CASP13","volume":"87","author":"R Shrestha","year":"2019","journal-title":"Proteins: Structure, Function, and Bioinformatics"},{"key":"pcbi.1009027.ref060","first-page":"219","article-title":"A large-scale comparative assessment of methods for residue\u2013residue contact prediction","volume":"19","author":"Q Wuyun","year":"2018","journal-title":"Briefings in bioinformatics"},{"key":"pcbi.1009027.ref061","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1093\/bioinformatics\/btw618","article-title":"Comparing co-evolution methods and their application to template-free protein structure prediction","volume":"33","author":"SHP de Oliveira","year":"2016","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref062","doi-asserted-by":"crossref","first-page":"W432","DOI":"10.1093\/nar\/gky420","article-title":"ComplexContact: a web server for inter-protein contact prediction using deep learning","volume":"46","author":"H Zeng","year":"2018","journal-title":"Nucleic acids research"},{"key":"pcbi.1009027.ref063","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1007\/s00239-008-9094-4","article-title":"Contact Density Affects Protein Evolutionary Rate from Bacteria to Animals","volume":"66","author":"T Zhou","year":"2008","journal-title":"Journal of Molecular Evolution"},{"key":"pcbi.1009027.ref064","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1186\/1471-2105-11-431","article-title":"Hidden Markov model speed heuristic and iterative HMM search procedure","volume":"11","author":"LS Johnson","year":"2010","journal-title":"BMC bioinformatics"},{"key":"pcbi.1009027.ref065","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1007\/s10878-015-9914-6","article-title":"Constrained pairwise and center-star sequences alignment problems","volume":"32","author":"Y Zhang","year":"2016","journal-title":"Journal of Combinatorial Optimization"},{"key":"pcbi.1009027.ref066","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1002\/prot.25407","article-title":"Assessment of contact predictions in CASP12: Co-evolution and deep learning coming of age","volume":"86","author":"J Schaarschmidt","year":"2018","journal-title":"Proteins: Structure, Function, and Bioinformatics"},{"key":"pcbi.1009027.ref067","first-page":"10","article-title":"Improved Contact Predictions Using the Recognition of Protein Like Contact Patterns","author":"MJ Skwark","year":"2014","journal-title":"Plos Computational Biology"},{"key":"pcbi.1009027.ref068","article-title":"Ensembling multiple raw coevolutionary features with deep residual neural networks for contact-map prediction in CASP13","author":"Y Li","year":"2019","journal-title":"Proteins Structure Function and Bioinformatics"},{"key":"pcbi.1009027.ref069","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1002\/prot.25379","article-title":"Improved protein contact predictions with the MetaPSICOV2 server in CASP12","volume":"86","author":"DW Buchan","year":"2018","journal-title":"Proteins: Structure, Function, and Bioinformatics"},{"key":"pcbi.1009027.ref070","doi-asserted-by":"crossref","first-page":"1091","DOI":"10.1093\/bioinformatics\/btz679","article-title":"Analysis of several key factors influencing deep learning-based inter-residue contact prediction","volume":"36","author":"T Wu","year":"2020","journal-title":"Bioinformatics"},{"key":"pcbi.1009027.ref071","doi-asserted-by":"crossref","first-page":"e1007621","DOI":"10.1371\/journal.pcbi.1007621","article-title":"FilterDCA: Interpretable supervised contact prediction using inter-domain coevolution","volume":"16","author":"M Muscat","year":"2020","journal-title":"PLoS computational biology"},{"key":"pcbi.1009027.ref072","doi-asserted-by":"crossref","first-page":"2763","DOI":"10.1093\/bioinformatics\/bts533","article-title":"Assignment of protein sequences to existing domain and family classification systems: Pfam and the PDB","volume":"28","author":"Q Xu","year":"2012","journal-title":"Bioinformatics"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1009027","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,6,4]],"date-time":"2021-06-04T00:00:00Z","timestamp":1622764800000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009027","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,4]],"date-time":"2023-11-04T03:21:19Z","timestamp":1699068079000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009027"}},"subtitle":[],"editor":[{"given":"Avner","family":"Schlessinger","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2021,5,24]]},"references-count":72,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2021,5,24]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1009027","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1009027","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,24]]}}}