{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T08:08:21Z","timestamp":1778054901852,"version":"3.51.4"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2016,12,7]],"date-time":"2016-12-07T00:00:00Z","timestamp":1481068800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2016,12,7]],"date-time":"2016-12-07T00:00:00Z","timestamp":1481068800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000057","name":"National Institute of General Medical Sciences","doi-asserted-by":"publisher","award":["R01GM093123"],"award-info":[{"award-number":["R01GM093123"]}],"id":[{"id":"10.13039\/100000057","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>In recent years, successful contact prediction methods and contact-guided ab initio protein structure prediction methods have highlighted the importance of incorporating contact information into protein structure prediction methods. It is also observed that for almost all globular proteins, the quality of contact prediction dictates the accuracy of structure prediction. Hence, like many existing evaluation measures for evaluating 3D protein models, various measures are currently used to evaluate predicted contacts, with the most popular ones being precision, coverage and distance distribution score (X<jats:sub>d<\/jats:sub>).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We have built a web application and a downloadable tool, ConEVA, for comprehensive assessment and detailed comparison of predicted contacts. Besides implementing existing measures for contact evaluation we have implemented new and useful methods of contact visualization using chord diagrams and comparison using Jaccard similarity computations. For a set (or sets) of predicted contacts, the web application runs even when a native structure is not available, visualizing the contact coverage and similarity between predicted contacts. We applied the tool on various contact prediction data sets and present our findings and insights we obtained from the evaluation of effective contact assessments. ConEVA is publicly available at <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"http:\/\/cactus.rnet.missouri.edu\/coneva\/\">http:\/\/cactus.rnet.missouri.edu\/coneva\/<\/jats:ext-link>.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>ConEVA is useful for a range of contact related analysis and evaluations including predicted contact comparison, investigation of individual protein folding using predicted contacts, and analysis of contacts in a structure of interest.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12859-016-1404-z","type":"journal-article","created":{"date-parts":[[2016,12,7]],"date-time":"2016-12-07T00:34:37Z","timestamp":1481070877000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["ConEVA: a toolbox for comprehensive assessment of protein contacts"],"prefix":"10.1186","volume":"17","author":[{"given":"Badri","family":"Adhikari","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jackson","family":"Nowotny","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Debswapna","family":"Bhattacharya","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jie","family":"Hou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianlin","family":"Cheng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2016,12,7]]},"reference":[{"key":"1404_CR1","doi-asserted-by":"publisher","first-page":"999","DOI":"10.1093\/bioinformatics\/btu791","volume":"31","author":"DT Jones","year":"2015","unstructured":"Jones DT, Singh T, Kosciolek T, Tetchner S. MetaPSICOV: Combining coevolution methods for accurate prediction of contacts and long range hydrogen bonding in proteins. Bioinformatics. 2015;31:999\u20131006.","journal-title":"Bioinformatics"},{"key":"1404_CR2","doi-asserted-by":"publisher","first-page":"3128","DOI":"10.1093\/bioinformatics\/btu500","volume":"30","author":"S Seemayer","year":"2014","unstructured":"Seemayer S, Gruber M, S\u00f6ding J. CCMpred - Fast and precise prediction of protein residue-residue contacts from correlated mutations. Bioinformatics. 2014;30:3128\u201330.","journal-title":"Bioinformatics"},{"key":"1404_CR3","doi-asserted-by":"publisher","first-page":"3066","DOI":"10.1093\/bioinformatics\/bts598","volume":"28","author":"J Eickholt","year":"2012","unstructured":"Eickholt J, Cheng J. Predicting protein residue-residue contacts using deep networks and boosting. Bioinformatics. 2012;28:3066\u201372.","journal-title":"Bioinformatics"},{"key":"1404_CR4","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1093\/bioinformatics\/btr638","volume":"28","author":"DT Jones","year":"2012","unstructured":"Jones DT, Buchan DWA, Cozzetto D, Pontil M. PSICOV: Precise structural contact prediction using sparse inverse covariance estimation on large multiple sequence alignments. Bioinformatics. 2012;28:184\u201390.","journal-title":"Bioinformatics"},{"key":"1404_CR5","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1186\/1471-2105-8-113","volume":"8","author":"J Cheng","year":"2007","unstructured":"Cheng J, Baldi P. Improved residue contact prediction using support vector machines and a large feature set. BMC Bioinformatics. 2007;8:113.","journal-title":"BMC Bioinformatics"},{"key":"1404_CR6","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1186\/1471-2105-15-85","volume":"15","author":"L Kaj\u00e1n","year":"2014","unstructured":"Kaj\u00e1n L, Hopf TA, Kala\u0161 M, Marks DS, Rost B. FreeContact: fast and free software for protein contact prediction from residue co-evolution. BMC Bioinformatics. 2014;15:85.","journal-title":"BMC Bioinformatics"},{"key":"1404_CR7","doi-asserted-by":"publisher","first-page":"1072","DOI":"10.1038\/nbt.2419","volume":"30","author":"DS Marks","year":"2012","unstructured":"Marks DS, Hopf TA, Sander C. Protein structure prediction from sequence variation. Nat Biotechnol. 2012;30:1072\u201380. Nature Publishing Group, a division of Macmillan Publishers Limited. All Rights Reserved.","journal-title":"Nat Biotechnol"},{"key":"1404_CR8","doi-asserted-by":"publisher","first-page":"1436","DOI":"10.1002\/prot.24829","volume":"83","author":"B Adhikari","year":"2015","unstructured":"Adhikari B, Bhattacharya D, Cao R, Cheng J. CONFOLD: Residue-residue contact-guided ab initio protein folding. Proteins. 2015;83:1436\u201349.","journal-title":"Proteins"},{"key":"1404_CR9","doi-asserted-by":"publisher","first-page":"e92197","DOI":"10.1371\/journal.pone.0092197","volume":"9","author":"T Kosciolek","year":"2014","unstructured":"Kosciolek T, Jones DT. De novo structure prediction of globular proteins aided by sequence variation-derived contacts. PLoS One. 2014;9:e92197.","journal-title":"PLoS One"},{"key":"1404_CR10","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1109\/TCBB.2008.27","volume":"5","author":"M Vassura","year":"2008","unstructured":"Vassura M, Margara L, Di Lena P, Medri F, Fariselli P, Casadio R. Reconstruction of 3D structures from protein contact maps. IEEE\/ACM Trans Comput Biol Bioinform. 2008;5:357\u201367.","journal-title":"IEEE\/ACM Trans Comput Biol Bioinform"},{"key":"1404_CR11","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1186\/1471-2105-11-283","volume":"11","author":"JM Duarte","year":"2010","unstructured":"Duarte JM, Sathyapriya R, Stehr H, Filippis I, Lappe M. Optimal contact definition for reconstruction of contact maps. BMC Bioinformatics. 2010;11:283.","journal-title":"BMC Bioinformatics"},{"key":"1404_CR12","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1002\/prot.24340","volume":"82","author":"B Monastyrskyy","year":"2014","unstructured":"Monastyrskyy B, D\u2019Andrea D, Fidelis K, Tramontano A, Kryshtafovych A. Evaluation of residue-residue contact prediction in CASP10. Proteins Struct Funct Bioinforma. 2014;82:138\u201353.","journal-title":"Proteins Struct Funct Bioinforma"},{"key":"1404_CR13","doi-asserted-by":"crossref","unstructured":"Marks DS, Colwell LJ, Sheridan R, Hopf TA, Pagnani A, Zecchina R, et al. (suppl info) Protein 3D structure computed from evolutionary sequence variation. Sali A, editor. PLoS One. Public Library of Science; 2011;6:e28766.","DOI":"10.1371\/journal.pone.0028766"},{"issue":"Suppl 1","key":"1404_CR14","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1002\/prot.23160","volume":"79","author":"B Monastyrskyy","year":"2011","unstructured":"Monastyrskyy B, Fidelis K, Tramontano A, Kryshtafovych A. Evaluation of residue-residue contact predictions in CASP9. Proteins. 2011;79 Suppl 1:119\u201325.","journal-title":"Proteins"},{"key":"1404_CR15","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1002\/prot.22487","volume":"77","author":"J Cheng","year":"2009","unstructured":"Cheng J, Wang Z, Tegge AN, Eickholt J. Prediction of global and local quality of CASP8 models by MULTICOM series. Proteins Struct Funct Bioinforma. 2009;77:181\u20134.","journal-title":"Proteins Struct Funct Bioinforma"},{"key":"1404_CR16","doi-asserted-by":"publisher","first-page":"i482","DOI":"10.1093\/bioinformatics\/btu458","volume":"30","author":"M Michel","year":"2014","unstructured":"Michel M, Hayat S, Skwark MJ, Sander C, Marks DS, Elofsson A. PconsFold: Improved contact predictions improve protein models. Bioinformatics. 2014;30:i482\u20138.","journal-title":"Bioinformatics"},{"key":"1404_CR17","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1002\/prot.24979","volume":"84","author":"H Zhang","year":"2016","unstructured":"Zhang H, Huang Q, Bei Z, Wei Y, Floudas CA. COMSAT: Residue contact prediction of transmembrane proteins based on support vector machines and mixed integer linear programming. Proteins Struct Funct Bioinforma. 2016;84:332\u201348.","journal-title":"Proteins Struct Funct Bioinforma"},{"key":"1404_CR18","doi-asserted-by":"publisher","first-page":"2449","DOI":"10.1093\/bioinformatics\/bts475","volume":"28","author":"P Di lena","year":"2012","unstructured":"Di lena P, Nagata K, Baldi P. Deep architectures for protein contact map prediction. Bioinformatics. 2012;28:2449\u201357.","journal-title":"Bioinformatics"},{"key":"1404_CR19","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1002\/prot.22554","volume":"77","author":"I Ezkurdia","year":"2009","unstructured":"Ezkurdia I, Gra\u00f1a O, Izarzugaza JMG, Tress ML, Ezkurdia L, Grana O, et al. Assessment of domain boundary predictions and the prediction of intramolecular contacts in CASP8. Proteins. 2009;77:196\u2013209.","journal-title":"Proteins"},{"key":"1404_CR20","doi-asserted-by":"publisher","unstructured":"Gra\u00f1a O, Baker D, MacCallum RM, Meiler J, Punta M, Rost B, Tress ML, Valencia A. CASP6 assessment of contact prediction. Proteins. 2005;61:214\u201324. doi:10.1002\/prot.20739.","DOI":"10.1002\/prot.20739"},{"key":"1404_CR21","doi-asserted-by":"publisher","unstructured":"Izarzugaza JMG, Gra\u00f1a O, Tress ML, Valencia A, Clarke ND. Assessment of intramolecular contact predictions for CASP7. Proteins. 2007;69:152\u201358. doi:10.1002\/prot.21637.","DOI":"10.1002\/prot.21637"},{"key":"1404_CR22","doi-asserted-by":"publisher","first-page":"W515","DOI":"10.1093\/nar\/gkp305","volume":"37","author":"AN Tegge","year":"2009","unstructured":"Tegge AN, Wang Z, Eickholt J, Cheng J. NNcon: Improved protein contact map prediction using 2D-recursive neural networks. Nucleic Acids Res. 2009;37:W515\u20138.","journal-title":"Nucleic Acids Res"},{"key":"1404_CR23","doi-asserted-by":"publisher","first-page":"W347","DOI":"10.1093\/nar\/gki411","volume":"33","author":"O Gra\u00f1a","year":"2005","unstructured":"Gra\u00f1a O, Eyrich VAA, Pazos F, Rost B, Valencia A. EVAcon: A protein contact prediction evaluation service. Nucleic Acids Res. 2005;33:W347\u201351.","journal-title":"Nucleic Acids Res"},{"key":"1404_CR24","doi-asserted-by":"publisher","first-page":"1573","DOI":"10.1093\/bioinformatics\/btr163","volume":"27","author":"C Vehlow","year":"2011","unstructured":"Vehlow C, Stehr H, Winkelmann M, Duarte JM, Petzold L, Dinse J, et al. CMView: Interactive contact map visualization and analysis. Bioinformatics. 2011;27:1573\u20134.","journal-title":"Bioinformatics"},{"key":"1404_CR25","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1186\/s12859-016-0975-z","volume":"17","author":"FN Baker","year":"2016","unstructured":"Baker FN, Porollo A. CoeViz: a web-based tool for coevolution analysis of protein residues. BMC Bioinformatics. 2016;17:119.","journal-title":"BMC Bioinformatics"},{"key":"1404_CR26","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1093\/nar\/28.1.235","volume":"28","author":"HM Berman","year":"2000","unstructured":"Berman HM. The protein data bank. Nucleic Acids Res. 2000;28:235\u201342.","journal-title":"Nucleic Acids Res"},{"key":"1404_CR27","unstructured":"Warnes GR, Bolker B, Bonebakker L, Gentleman R, Liaw WHA, Lumley T, et al. gplots: Various R Programming Tools for Plotting Data. R Packag. version 2.17.0. 2015;2015."},{"key":"1404_CR28","unstructured":"Lemon J. Plotrix: a package in the red light district of R. R-News. 2006;6(4):8\u201312."},{"key":"1404_CR29","doi-asserted-by":"publisher","first-page":"142","DOI":"10.1002\/prot.10069","volume":"47","author":"G Pollastri","year":"2002","unstructured":"Pollastri G, Baldi P, Fariselli P, Casadio R. Prediction of coordination number and relative solvent accessibility in proteins. Proteins Struct Funct Genet. 2002;47:142\u201353.","journal-title":"Proteins Struct Funct Genet"},{"key":"1404_CR30","doi-asserted-by":"crossref","unstructured":"Davis J, Goadrich M. The Relationship Between Precision-Recall and ROC Curves. Proc. 23rd Int. Conf. Mach. Learn. -- ICML\u201906. 2006;233\u201340.","DOI":"10.1145\/1143844.1143874"},{"key":"1404_CR31","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1038\/239174c0","volume":"239","author":"G Gilbert","year":"1972","unstructured":"Gilbert G. Distance between Sets. Nature. 1972;239:174.","journal-title":"Nature"},{"key":"1404_CR32","doi-asserted-by":"publisher","unstructured":"Monastyrskyy B, D\u2019Andrea D, Fidelis K, Tramontano A, Kryshtafovych A. New encouraging developments in contact prediction: Assessment of the CASP11 results. Proteins. 2016;84:131\u201344. doi:10.1002\/prot.24943.","DOI":"10.1002\/prot.24943"},{"key":"1404_CR33","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1093\/bioinformatics\/16.4.404","volume":"16","author":"LJ McGuffin","year":"2000","unstructured":"McGuffin LJ, Bryson K, Jones DT. The PSIPRED protein structure prediction server. Bioinformatics. 2000;16:404\u20135.","journal-title":"Bioinformatics"},{"key":"1404_CR34","doi-asserted-by":"publisher","first-page":"702","DOI":"10.1002\/prot.20264","volume":"57","author":"Y Zhang","year":"2004","unstructured":"Zhang Y, Skolnick J. Scoring function for automated assessment of protein structure template quality. Proteins Struct Funct Bioinforma. 2004;57:702\u201310.","journal-title":"Proteins Struct Funct Bioinforma"},{"key":"1404_CR35","doi-asserted-by":"publisher","first-page":"208","DOI":"10.1002\/prot.24374","volume":"82","author":"DEE Kim","year":"2014","unstructured":"Kim DEE, Dimaio F, Yu-Ruei Wang R, Song Y, Baker D. One contact for every twelve residues allows robust and accurate topology-level protein structure modeling. Proteins Struct Funct Bioinforma. 2014;82:208\u201318.","journal-title":"Proteins Struct Funct Bioinforma"},{"key":"1404_CR36","doi-asserted-by":"crossref","unstructured":"Sathyapriya R, Duarte JM, Stehr H, Filippis I, Lappe M. Defining an essence of structure determining residue contacts in proteins. Nussinov R, editor. PLoS Comput. Biol. Public Library of Science; 2009;5:e1000584.","DOI":"10.1371\/journal.pcbi.1000584"},{"key":"1404_CR37","doi-asserted-by":"publisher","first-page":"23990","DOI":"10.1038\/srep23990","volume":"6","author":"R Cao","year":"2016","unstructured":"Cao R, Cheng J. Protein single-model quality assessment by feature-based probability density functions. Sci Rep. 2016;6:23990.","journal-title":"Sci Rep"},{"key":"1404_CR38","doi-asserted-by":"crossref","unstructured":"Cao R, Bhattacharya D, Adhikari B, Li J, Cheng J. Large-scale model quality assessment for improving protein tertiary structure prediction. Bioinformatics. 2015; 31(12):i116-i123. http:\/\/bioinformatics.oxfordjournals.org\/content\/31\/12\/i116.short.","DOI":"10.1093\/bioinformatics\/btv235"},{"key":"1404_CR39","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1186\/1471-2105-15-120","volume":"15","author":"R Cao","year":"2014","unstructured":"Cao R, Wang Z, Wang Y, Cheng J. SMOQ: a tool for predicting the absolute residue-specific quality of a single protein model with support vector machines. BMC Bioinformatics. 2014;15:120.","journal-title":"BMC Bioinformatics"},{"key":"1404_CR40","doi-asserted-by":"publisher","first-page":"16332","DOI":"10.1038\/srep16332","volume":"5","author":"D Bhattacharya","year":"2015","unstructured":"Bhattacharya D, Cheng J. De novo protein conformational sampling using a probabilistic graphical model. Sci Rep. 2015;5:16332.","journal-title":"Sci Rep"},{"key":"1404_CR41","doi-asserted-by":"publisher","first-page":"2791","DOI":"10.1093\/bioinformatics\/btw316","volume":"32","author":"D Bhattacharya","year":"2016","unstructured":"Bhattacharya D, Cao R, Cheng J. UniCon3D: de novo protein structure prediction using united-residue conformational search via stepwise, probabilistic sampling. Bioinformatics. 2016;32:2791\u20139. btw316.","journal-title":"Bioinformatics"},{"key":"1404_CR42","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1002\/prot.1171","volume":"45","author":"DT Jones","year":"2001","unstructured":"Jones DT. Predicting novel protein folds by using FRAGFOLD. Proteins Struct Funct Genet. 2001;45:127\u201332.","journal-title":"Proteins Struct Funct Genet"},{"key":"1404_CR43","doi-asserted-by":"publisher","first-page":"1605","DOI":"10.1002\/jcc.20084","volume":"25","author":"EF Pettersen","year":"2004","unstructured":"Pettersen EF, Goddard TD, Huang CC, Couch GS, Greenblatt DM, Meng EC, et al. UCSF Chimera - A visualization system for exploratory research and analysis. J Comput Chem. 2004;25:1605\u201312.","journal-title":"J Comput Chem"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-016-1404-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-016-1404-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-016-1404-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,1]],"date-time":"2024-02-01T18:10:30Z","timestamp":1706811030000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-016-1404-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,12,7]]},"references-count":43,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2016,12]]}},"alternative-id":["1404"],"URL":"https:\/\/doi.org\/10.1186\/s12859-016-1404-z","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,12,7]]},"assertion":[{"value":"1 July 2016","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 December 2016","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 December 2016","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"517"}}