{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T08:23:16Z","timestamp":1769588596745,"version":"3.49.0"},"reference-count":17,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,1,6]],"date-time":"2021-01-06T00:00:00Z","timestamp":1609891200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,1,6]],"date-time":"2021-01-06T00:00:00Z","timestamp":1609891200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000083","name":"Directorate for Computer and Information Science and Engineering","doi-asserted-by":"publisher","award":["1948117"],"award-info":[{"award-number":["1948117"]}],"id":[{"id":"10.13039\/100000083","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Protein inter-residue contact and distance prediction are two key intermediate steps essential to accurate protein structure prediction. Distance prediction comes in two forms: real-valued distances and \u2018binned\u2019 distograms, which are a more finely grained variant of the binary contact prediction problem. The latter has been introduced as a new challenge in the 14th Critical Assessment of Techniques for Protein Structure Prediction (CASP14) 2020 experiment. Despite the recent proliferation of methods for predicting distances, few methods exist for evaluating these predictions. Currently only numerical metrics, which evaluate the entire prediction at once, are used. These give no insight into the structural details of a prediction. For this reason, new methods and tools are needed.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We have developed a web server for evaluating predicted inter-residue distances. Our server, DISTEVAL, accepts predicted contacts, distances, and a true structure as optional inputs to generate informative heatmaps, chord diagrams, and 3D models. All of these outputs facilitate visual and qualitative assessment. The server also evaluates predictions using other metrics such as mean absolute error, root mean squared error, and contact precision.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The visualizations generated by DISTEVAL complement each other and collectively serve as a powerful tool for both quantitative and qualitative assessments of predicted contacts and distances, even in the absence of a true 3D structure.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12859-020-03938-z","type":"journal-article","created":{"date-parts":[[2021,1,6]],"date-time":"2021-01-06T20:05:26Z","timestamp":1609963526000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["DISTEVAL: a web server for evaluating predicted protein distances"],"prefix":"10.1186","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1547-0238","authenticated-orcid":false,"given":"Badri","family":"Adhikari","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bikash","family":"Shrestha","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthew","family":"Bernardini","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jie","family":"Hou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jamie","family":"Lea","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,1,6]]},"reference":[{"issue":"12","key":"3938_CR1","doi-asserted-by":"publisher","first-page":"1141","DOI":"10.1002\/prot.25834","volume":"87","author":"AW Senior","year":"2019","unstructured":"Senior AW, Evans R, Jumper J, Kirkpatrick J, Sifre L, Green T, Qin C, \u017d\u00eddek A, Nelson AW, Bridgland A, et al. Protein structure prediction using multiple deep neural networks in the 13th critical assessment of protein structure prediction (CASP13). Proteins Struct Funct Bioinf. 2019;87(12):1141\u20138.","journal-title":"Proteins Struct Funct Bioinf"},{"issue":"12","key":"3938_CR2","doi-asserted-by":"publisher","first-page":"1100","DOI":"10.1002\/prot.25787","volume":"87","author":"LA Abriata","year":"2019","unstructured":"Abriata LA, Tam\u00f2 GE, Dal Peraro M. A further leap of improvement in tertiary structure prediction in CASP13 prompts new routes for future assessments. Proteins Struct Funct Bioinf. 2019;87(12):1100\u201312.","journal-title":"Proteins Struct Funct Bioinf"},{"issue":"12","key":"3938_CR3","doi-asserted-by":"publisher","first-page":"1092","DOI":"10.1002\/prot.25779","volume":"87","author":"SM Kandathil","year":"2019","unstructured":"Kandathil SM, Greener JG, Jones DT. Prediction of interresidue contacts with deepmetapsicov in CASP13. Proteins Struct Funct Bioinf. 2019;87(12):1092\u20139.","journal-title":"Proteins Struct Funct Bioinf"},{"issue":"12","key":"3938_CR4","doi-asserted-by":"publisher","first-page":"1082","DOI":"10.1002\/prot.25798","volume":"87","author":"Y Li","year":"2019","unstructured":"Li Y, Zhang C, Bell EW, Yu D-J, Zhang Y. Ensembling multiple raw coevolutionary features with deep residual neural networks for contact-map prediction in CASP13. Proteins Struct Funct Bioinf. 2019;87(12):1082\u201391.","journal-title":"Proteins Struct Funct Bioinf"},{"key":"3938_CR5","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1002\/prot.25407","volume":"86","author":"J Schaarschmidt","year":"2018","unstructured":"Schaarschmidt J, Monastyrskyy B, Kryshtafovych A, Bonvin AM. Assessment of contact predictions in CASP12: co-evolution and deep learning coming of age. Proteins Struct Funct Bioinf. 2018;86:51\u201366.","journal-title":"Proteins Struct Funct Bioinf"},{"issue":"12","key":"3938_CR6","doi-asserted-by":"publisher","first-page":"1058","DOI":"10.1002\/prot.25819","volume":"87","author":"R Shrestha","year":"2019","unstructured":"Shrestha R, Fajardo E, Gil N, Fidelis K, Kryshtafovych A, Monastyrskyy B, Fiser A. Assessing the accuracy of contact predictions in CASP13. Proteins Struct Funct Bioinf. 2019;87(12):1058\u201368.","journal-title":"Proteins Struct Funct Bioinf"},{"issue":"suppl\u20132","key":"3938_CR7","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1093\/nar\/gki411","volume":"33","author":"O Gra\u00f1a","year":"2005","unstructured":"Gra\u00f1a O, Eyrich VA, Pazos F, Rost B, Valencia A. Evacon: a protein contact prediction evaluation service. Nucleic Acids Res. 2005;33(suppl\u20132):347\u201351.","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"3938_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12859-016-1404-z","volume":"17","author":"B Adhikari","year":"2016","unstructured":"Adhikari B, Nowotny J, Bhattacharya D, Hou J, Cheng J. ConEVA: a toolbox for comprehensive assessment of protein contacts. BMC Bioinform. 2016;17(1):1\u201312.","journal-title":"BMC Bioinform"},{"key":"3938_CR9","doi-asserted-by":"crossref","unstructured":"Yang J, Anishchenko I, Park H, Peng Z, Ovchinnikov S, Baker D. Improved protein structure prediction using predicted interresidue orientations. In: Proceedings of the National Academy of Sciences. 2020.","DOI":"10.1101\/846279"},{"issue":"1","key":"3938_CR10","doi-asserted-by":"publisher","first-page":"2045","DOI":"10.1038\/s41598-020-70181-0","volume":"10","author":"B Adhikari","year":"2020","unstructured":"Adhikari B. A fully open-source framework for deep learning protein real-valued distances. Sci Rep. 2020;10(1):2045\u2013322.","journal-title":"Sci Rep"},{"key":"3938_CR11","doi-asserted-by":"crossref","unstructured":"Ding W, Gong H. Predicting the real-valued inter-residue distances for proteins. Adv Sci. 2020;2001314.","DOI":"10.1002\/advs.202001314"},{"issue":"12","key":"3938_CR12","doi-asserted-by":"crossref","first-page":"2577","DOI":"10.1002\/bip.360221211","volume":"22","author":"W Kabsch","year":"1983","unstructured":"Kabsch W, Sander C. Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features. Biopolym Orig Res Biomol. 1983;22(12):2577\u2013637.","journal-title":"Biopolym Orig Res Biomol"},{"issue":"3\u20134","key":"3938_CR13","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1002\/ijch.201300024","volume":"53","author":"RM Hanson","year":"2013","unstructured":"Hanson RM, Prilusky J, Renjian Z, Nakane T, Sussman JL. Jsmol and the next-generation web-based representation of 3d molecular structure as applied to proteopedia. Isr J Chem. 2013;53(3\u20134):207\u201316.","journal-title":"Isr J Chem"},{"issue":"21","key":"3938_CR14","doi-asserted-by":"publisher","first-page":"2722","DOI":"10.1093\/bioinformatics\/btt473","volume":"29","author":"V Mariani","year":"2013","unstructured":"Mariani V, Biasini M, Barbato A, Schwede T. LDDT: a local superposition-free score for comparing protein structures and models using distance difference tests. Bioinformatics. 2013;29(21):2722\u20138.","journal-title":"Bioinformatics"},{"issue":"8","key":"3938_CR15","doi-asserted-by":"publisher","first-page":"1436","DOI":"10.1002\/prot.24829","volume":"83","author":"B Adhikari","year":"2015","unstructured":"Adhikari B, Bhattacharya D, Cao R, Cheng J. CONFOLD: residue-residue contact-guided ab initio protein folding. Proteins. 2015;83(8):1436\u201349. https:\/\/doi.org\/10.1002\/prot.24829.","journal-title":"Proteins"},{"issue":"4","key":"3938_CR16","doi-asserted-by":"publisher","first-page":"702","DOI":"10.1002\/prot.20264","volume":"57","author":"Y Zhang","year":"2004","unstructured":"Zhang Y, Skolnick J. Scoring function for automated assessment of protein structure template quality. Proteins Struct Funct Bioinf. 2004;57(4):702\u201310.","journal-title":"Proteins Struct Funct Bioinf"},{"issue":"12","key":"3938_CR17","doi-asserted-by":"publisher","first-page":"1069","DOI":"10.1002\/prot.25810","volume":"87","author":"J Xu","year":"2019","unstructured":"Xu J, Wang S. Analysis of distance-based protein structure prediction by deep learning in CASP13. Proteins Struct Funct Bioinf. 2019;87(12):1069\u201381.","journal-title":"Proteins Struct Funct Bioinf"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-020-03938-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12859-020-03938-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-020-03938-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,10]],"date-time":"2022-12-10T20:23:05Z","timestamp":1670703785000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-020-03938-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,6]]},"references-count":17,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["3938"],"URL":"https:\/\/doi.org\/10.1186\/s12859-020-03938-z","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,6]]},"assertion":[{"value":"26 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 December 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 January 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"8"}}