{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T23:40:19Z","timestamp":1780789219757,"version":"3.54.1"},"reference-count":49,"publisher":"Oxford University Press (OUP)","issue":"Supplement_1","license":[{"start":{"date-parts":[[2020,7,13]],"date-time":"2020-07-13T00:00:00Z","timestamp":1594598400000},"content-version":"vor","delay-in-days":12,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["IIS-2030722"],"award-info":[{"award-number":["IIS-2030722"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["DBI-1942692"],"award-info":[{"award-number":["DBI-1942692"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Motivation<\/jats:title>\n                    <jats:p>Protein model quality estimation, in many ways, informs protein structure prediction. Despite their tight coupling, existing model quality estimation methods do not leverage inter-residue distance information or the latest technological breakthrough in deep learning that has recently revolutionized protein structure prediction.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We present a new distance-based single-model quality estimation method called QDeep by harnessing the power of stacked deep residual neural networks (ResNets). Our method first employs stacked deep ResNets to perform residue-level ensemble error classifications at multiple predefined error thresholds, and then combines the predictions from the individual error classifiers for estimating the quality of a protein structural model. Experimental results show that our method consistently outperforms existing state-of-the-art methods including ProQ2, ProQ3, ProQ3D, ProQ4, 3DCNN, MESHI, and VoroMQA in multiple independent test datasets across a wide-range of accuracy measures; and that predicted distance information significantly contributes to the improved performance of QDeep.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Availability and implementation<\/jats:title>\n                    <jats:p>https:\/\/github.com\/Bhattacharya-Lab\/QDeep.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Supplementary information<\/jats:title>\n                    <jats:p>Supplementary data are available at Bioinformatics online.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btaa455","type":"journal-article","created":{"date-parts":[[2020,5,7]],"date-time":"2020-05-07T15:10:19Z","timestamp":1588864219000},"page":"i285-i291","source":"Crossref","is-referenced-by-count":41,"title":["QDeep: distance-based protein model quality estimation by residue-level ensemble error classifications using stacked deep residual neural networks"],"prefix":"10.1093","volume":"36","author":[{"given":"Md Hossain","family":"Shuvo","sequence":"first","affiliation":[{"name":"Department of Computer Science and Software Engineering, Auburn University , Auburn, AL 36849, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sutanu","family":"Bhattacharya","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Software Engineering, Auburn University , Auburn, AL 36849, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9630-0141","authenticated-orcid":false,"given":"Debswapna","family":"Bhattacharya","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Software Engineering, Auburn University , Auburn, AL 36849, USA"},{"name":"Auburn University Department of Biological Sciences, , Auburn, AL 36849, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2020,7,13]]},"reference":[{"key":"2024021913344725200_btaa455-B1","first-page":"307","author":"Alapati","year":"2018"},{"key":"2024021913344725200_btaa455-B2","doi-asserted-by":"crossref","first-page":"3389","DOI":"10.1093\/nar\/25.17.3389","article-title":"Gapped BLAST and PSI-BLAST: a new generation of protein database search programs","volume":"25","author":"Altschul","year":"1997","journal-title":"Nucleic Acids Res"},{"key":"2024021913344725200_btaa455-B3","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1002\/prot.22532","article-title":"Global and local model quality estimation at CASP8 using the scoring functions QMEAN and QMEANclust","volume":"77","author":"Benkert","year":"2009","journal-title":"Proteins"},{"key":"2024021913344725200_btaa455-B4","doi-asserted-by":"crossref","first-page":"i116","DOI":"10.1093\/bioinformatics\/btv235","article-title":"Large-scale model quality assessment for improving protein tertiary structure prediction","volume":"31","author":"Cao","year":"2015","journal-title":"Bioinformatics"},{"key":"2024021913344725200_btaa455-B5","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1002\/prot.24924","article-title":"Massive integration of diverse protein quality assessment methods to improve template based modeling in CASP11","volume":"84","author":"Cao","year":"2016","journal-title":"Proteins"},{"key":"2024021913344725200_btaa455-B6","doi-asserted-by":"crossref","first-page":"1361","DOI":"10.1002\/prot.25767","article-title":"Estimation of model accuracy in CASP13","volume":"87","author":"Cheng","year":"2019","journal-title":"Proteins"},{"key":"2024021913344725200_btaa455-B7","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1002\/prot.22487","article-title":"Prediction of global and local quality of CASP8 models by MULTICOM series","volume":"77","author":"Cheng","year":"2009","journal-title":"Proteins"},{"key":"2024021913344725200_btaa455-B8","author":"Chollet","year":"2015"},{"key":"2024021913344725200_btaa455-B9","doi-asserted-by":"crossref","first-page":"4046","DOI":"10.1093\/bioinformatics\/bty494","article-title":"Deep convolutional networks for quality assessment of protein folds","volume":"34","author":"Derevyanko","year":"2018","journal-title":"Bioinformatics"},{"key":"2024021913344725200_btaa455-B10","doi-asserted-by":"crossref","first-page":"2250","DOI":"10.1093\/bioinformatics\/btq402","article-title":"Fast overlapping of protein contact maps by alignment of eigenvectors","volume":"26","author":"Di Lena","year":"2010","journal-title":"Bioinformatics"},{"key":"2024021913344725200_btaa455-B11","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1038\/s41467-019-11994-0","article-title":"Deep learning extends de novo protein modelling coverage of genomes using iteratively predicted structural constraints","volume":"10","author":"Greener","year":"2019","journal-title":"Nat. Commun"},{"key":"2024021913344725200_btaa455-B12","first-page":"770","author":"He","year":"2016"},{"key":"2024021913344725200_btaa455-B13","doi-asserted-by":"crossref","first-page":"2842","DOI":"10.1093\/bioinformatics\/btx218","article-title":"Capturing non-local interactions by long short-term memory bidirectional recurrent neural networks for improving prediction of protein secondary structure, backbone angles, contact numbers and solvent accessibility","volume":"33","author":"Heffernan","year":"2017","journal-title":"Bioinformatics"},{"key":"2024021913344725200_btaa455-B14","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput"},{"key":"2024021913344725200_btaa455-B15","article-title":"Deep transfer learning in the assessment of the quality of protein models","author":"Hurtado","year":"2018"},{"key":"2024021913344725200_btaa455-B16","first-page":"448","author":"Ioffe","year":"2015"},{"key":"2024021913344725200_btaa455-B17","doi-asserted-by":"crossref","first-page":"3931","DOI":"10.1093\/bioinformatics\/bti630","article-title":"MESHI: a new library of Java classes for molecular modeling","volume":"21","author":"Kalisman","year":"2005","journal-title":"Bioinformatics"},{"key":"2024021913344725200_btaa455-B18","doi-asserted-by":"crossref","first-page":"1299","DOI":"10.1093\/bioinformatics\/btq114","article-title":"Quality assessment of protein model-structures using evolutionary conservation","volume":"26","author":"Kalman","year":"2010","journal-title":"Bioinformatics"},{"key":"2024021913344725200_btaa455-B151","article-title":"Adam: A method for stochastic optimization","author":"Kingma","year":"2014"},{"key":"2024021913344725200_btaa455-B19","doi-asserted-by":"crossref","first-page":"2801","DOI":"10.1093\/bioinformatics\/bty1037","article-title":"Smooth orientation-dependent scoring function for coarse-grained protein quality assessment","volume":"35","author":"Karasikov","year":"2019","journal-title":"Bioinformatics"},{"key":"2024021913344725200_btaa455-B20","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1002\/prot.25371","article-title":"Assessment of model accuracy estimations in CASP12","volume":"86","author":"Kryshtafovych","year":"2018","journal-title":"Proteins"},{"key":"2024021913344725200_btaa455-B21","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1002\/prot.24919","article-title":"Methods of model accuracy estimation can help selecting the best models from decoy sets: assessment of model accuracy estimations in CASP11","volume":"84","author":"Kryshtafovych","year":"2016","journal-title":"Proteins"},{"key":"2024021913344725200_btaa455-B22","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1016\/B978-0-12-381270-4.00019-6","article-title":"ROSETTA3: an object-oriented software suite for the simulation and design of macromolecules","volume":"487","author":"Leaver-Fay","year":"2011","journal-title":"Methods Enzymol"},{"key":"2024021913344725200_btaa455-B23","author":"Lee","year":"2009"},{"key":"2024021913344725200_btaa455-B24","doi-asserted-by":"crossref","first-page":"4647","DOI":"10.1093\/bioinformatics\/btz291","article-title":"ResPRE: high-accuracy protein contact prediction by coupling precision matrix with deep residual neural networks","volume":"35","author":"Li","year":"2019","journal-title":"Bioinformatics"},{"key":"2024021913344725200_btaa455-B25","doi-asserted-by":"crossref","first-page":"e106542","DOI":"10.1371\/journal.pone.0106542","article-title":"Random forest-based protein model quality assessment (RFMQA) using structural features and potential energy terms","volume":"9","author":"Manavalan","year":"2014","journal-title":"PLoS One"},{"key":"2024021913344725200_btaa455-B26","doi-asserted-by":"crossref","first-page":"2496","DOI":"10.1093\/bioinformatics\/btx222","article-title":"SVMQA: support-vector-machine-based protein single-model quality assessment","volume":"33","author":"Manavalan","year":"2017","journal-title":"Bioinformatics"},{"key":"2024021913344725200_btaa455-B27","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1093\/bioinformatics\/btp629","article-title":"Rapid model quality assessment for protein structure predictions using the comparison of multiple models without structural alignments","volume":"26","author":"McGuffin","year":"2010","journal-title":"Bioinformatics"},{"key":"2024021913344725200_btaa455-B28","doi-asserted-by":"crossref","first-page":"D170","DOI":"10.1093\/nar\/gkw1081","article-title":"Uniclust databases of clustered and deeply annotated protein sequences and alignments","volume":"45","author":"Mirdita","year":"2017","journal-title":"Nucleic Acids Res"},{"key":"2024021913344725200_btaa455-B29","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1002\/prot.25064","article-title":"Critical assessment of methods of protein structure prediction (CASP) \u2013 progress and new directions in round XI","volume":"84","author":"Moult","year":"2016","journal-title":"Proteins"},{"key":"2024021913344725200_btaa455-B30","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1002\/prot.25415","article-title":"Critical assessment of methods of protein structure prediction (CASP)-round XII","volume":"86","author":"Moult","year":"2018","journal-title":"Proteins"},{"key":"2024021913344725200_btaa455-B31","doi-asserted-by":"crossref","first-page":"1131","DOI":"10.1002\/prot.25278","article-title":"VoroMQA: assessment of protein structure quality using interatomic contact areas","volume":"85","author":"Olechnovi\u010d","year":"2017","journal-title":"Proteins"},{"key":"2024021913344725200_btaa455-B32","doi-asserted-by":"crossref","first-page":"3313","DOI":"10.1093\/bioinformatics\/btz122","article-title":"Protein model quality assessment using 3D oriented convolutional neural networks","volume":"35","author":"Pag\u00e8s","year":"2019","journal-title":"Bioinformatics"},{"key":"2024021913344725200_btaa455-B33","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1186\/1471-2105-13-224","article-title":"Improved model quality assessment using ProQ2","volume":"13","author":"Ray","year":"2012","journal-title":"BMC Bioinformatics"},{"key":"2024021913344725200_btaa455-B34","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1038\/nmeth.1818","article-title":"HHblits: lightning-fast iterative protein sequence searching by HMM-HMM alignment","volume":"9","author":"Remmert","year":"2012","journal-title":"Nat. Methods"},{"key":"2024021913344725200_btaa455-B35","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/S0076-6879(04)83004-0","article-title":"Protein structure prediction using Rosetta","volume":"383","author":"Rohl","year":"2004","journal-title":"Methods Enzymol"},{"key":"2024021913344725200_btaa455-B36","doi-asserted-by":"crossref","first-page":"e0221347","DOI":"10.1371\/journal.pone.0221347","article-title":"Protein model accuracy estimation based on local structure quality assessment using 3D convolutional neural network","volume":"14","author":"Sato","year":"2019","journal-title":"PLoS One"},{"key":"2024021913344725200_btaa455-B37","doi-asserted-by":"crossref","first-page":"706","DOI":"10.1038\/s41586-019-1923-7","article-title":"Improved protein structure prediction using potentials from deep learning","volume":"577","author":"Senior","year":"2020","journal-title":"Nature"},{"key":"2024021913344725200_btaa455-B38","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1038\/s41467-018-04964-5","article-title":"Clustering huge protein sequence sets in linear time","volume":"9","author":"Steinegger","year":"2018","journal-title":"Nat. Commun"},{"key":"2024021913344725200_btaa455-B39","doi-asserted-by":"crossref","first-page":"926","DOI":"10.1093\/bioinformatics\/btu739","article-title":"UniRef clusters: a comprehensive and scalable alternative for improving sequence similarity searches","volume":"31","author":"Suzek","year":"2015","journal-title":"Bioinformatics"},{"key":"2024021913344725200_btaa455-B40","doi-asserted-by":"crossref","first-page":"33509","DOI":"10.1038\/srep33509","article-title":"ProQ3: improved model quality assessments using Rosetta energy terms","volume":"6","author":"Uziela","year":"2016","journal-title":"Sci. Rep"},{"key":"2024021913344725200_btaa455-B41","doi-asserted-by":"crossref","first-page":"1578","DOI":"10.1093\/bioinformatics\/btw819","article-title":"ProQ3D: improved model quality assessments using deep learning","volume":"33","author":"Uziela","year":"2017","journal-title":"Bioinformatics"},{"key":"2024021913344725200_btaa455-B42","doi-asserted-by":"crossref","first-page":"e1005324","DOI":"10.1371\/journal.pcbi.1005324","article-title":"Accurate de novo prediction of protein contact map by ultra-deep learning model","volume":"13","author":"Wang","year":"2017","journal-title":"PLoS Comput. Biol"},{"key":"2024021913344725200_btaa455-B43","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1002\/prot.22275","article-title":"Evaluating the absolute quality of a single protein model using structural features and support vector machines","volume":"75","author":"Wang","year":"2009","journal-title":"Proteins"},{"key":"2024021913344725200_btaa455-B44","doi-asserted-by":"crossref","first-page":"1351","DOI":"10.1002\/prot.25804","article-title":"Assessment of protein model structure accuracy estimation in CASP13: challenges in the era of deep learning","volume":"87","author":"Won","year":"2019","journal-title":"Proteins"},{"key":"2024021913344725200_btaa455-B45","doi-asserted-by":"crossref","first-page":"16856","DOI":"10.1073\/pnas.1821309116","article-title":"Distance-based protein folding powered by deep learning","volume":"116","author":"Xu","year":"2019","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"2024021913344725200_btaa455-B46","doi-asserted-by":"crossref","first-page":"3370","DOI":"10.1093\/nar\/gkg571","article-title":"LGA: a method for finding 3D similarities in protein structures","volume":"31","author":"Zemla","year":"2003","journal-title":"Nucleic Acids Res"},{"key":"2024021913344725200_btaa455-B47","doi-asserted-by":"crossref","first-page":"2105","DOI":"10.1093\/bioinformatics\/btz863","article-title":"DeepMSA: constructing deep multiple sequence alignment to improve contact prediction and fold-recognition for distant-homology proteins","volume":"36","author":"Zhang","year":"2020","journal-title":"Bioinformatics"},{"key":"2024021913344725200_btaa455-B48","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1002\/pmic.201200334","article-title":"Fast algorithm for population-based protein structural model analysis","volume":"13","author":"Zhang","year":"2013","journal-title":"Proteomics"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/36\/Supplement_1\/i285\/56702788\/bioinformatics_36_supplement1_i285.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/36\/Supplement_1\/i285\/56702788\/bioinformatics_36_supplement1_i285.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,19]],"date-time":"2024-02-19T08:44:47Z","timestamp":1708332287000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/36\/Supplement_1\/i285\/5870505"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,1]]},"references-count":49,"journal-issue":{"issue":"Supplement_1","published-print":{"date-parts":[[2020,7,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btaa455","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.01.31.928622","asserted-by":"object"}]},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,7]]},"published":{"date-parts":[[2020,7,1]]}}}