{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T07:26:31Z","timestamp":1777879591903,"version":"3.51.4"},"reference-count":41,"publisher":"Oxford University Press (OUP)","issue":"12","license":[{"start":{"date-parts":[[2016,10,2]],"date-time":"2016-10-02T00:00:00Z","timestamp":1475366400000},"content-version":"vor","delay-in-days":480,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2015,6,15]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Motivation: Sampling structural models and ranking them are the two major challenges of protein structure prediction. Traditional protein structure prediction methods generally use one or a few quality assessment (QA) methods to select the best-predicted models, which cannot consistently select relatively better models and rank a large number of models well.<\/jats:p>\n               <jats:p>Results: Here, we develop a novel large-scale model QA method in conjunction with model clustering to rank and select protein structural models. It unprecedentedly applied 14 model QA methods to generate consensus model rankings, followed by model refinement based on model combination (i.e. averaging). Our experiment demonstrates that the large-scale model QA approach is more consistent and robust in selecting models of better quality than any individual QA method. Our method was blindly tested during the 11th Critical Assessment of Techniques for Protein Structure Prediction (CASP11) as MULTICOM group. It was officially ranked third out of all 143 human and server predictors according to the total scores of the first models predicted for 78 CASP11 protein domains and second according to the total scores of the best of the five models predicted for these domains. MULTICOM\u2019s outstanding performance in the extremely competitive 2014 CASP11 experiment proves that our large-scale QA approach together with model clustering is a promising solution to one of the two major problems in protein structure modeling.<\/jats:p>\n               <jats:p>Availability and implementation: The web server is available at: http:\/\/sysbio.rnet.missouri.edu\/multicom_cluster\/human\/.<\/jats:p>\n               <jats:p>Contact: chengji@missouri.edu<\/jats:p>","DOI":"10.1093\/bioinformatics\/btv235","type":"journal-article","created":{"date-parts":[[2015,6,13]],"date-time":"2015-06-13T17:12:36Z","timestamp":1434215556000},"page":"i116-i123","source":"Crossref","is-referenced-by-count":58,"title":["Large-scale model quality assessment for improving protein tertiary structure prediction"],"prefix":"10.1093","volume":"31","author":[{"given":"Renzhi","family":"Cao","sequence":"first","affiliation":[{"name":"1 Computer Science Department, University of Missouri, Columbia, Missouri, 65211, USA, 2Informatics Institute, University of Missouri, Columbia, Missouri, 65211, USA and 3C. Bond Life Science Center, University of Missouri, Columbia, Missouri, 65211, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Debswapna","family":"Bhattacharya","sequence":"additional","affiliation":[{"name":"1 Computer Science Department, University of Missouri, Columbia, Missouri, 65211, USA, 2Informatics Institute, University of Missouri, Columbia, Missouri, 65211, USA and 3C. Bond Life Science Center, University of Missouri, Columbia, Missouri, 65211, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Badri","family":"Adhikari","sequence":"additional","affiliation":[{"name":"1 Computer Science Department, University of Missouri, Columbia, Missouri, 65211, USA, 2Informatics Institute, University of Missouri, Columbia, Missouri, 65211, USA and 3C. Bond Life Science Center, University of Missouri, Columbia, Missouri, 65211, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jilong","family":"Li","sequence":"additional","affiliation":[{"name":"1 Computer Science Department, University of Missouri, Columbia, Missouri, 65211, USA, 2Informatics Institute, University of Missouri, Columbia, Missouri, 65211, USA and 3C. Bond Life Science Center, University of Missouri, Columbia, Missouri, 65211, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianlin","family":"Cheng","sequence":"additional","affiliation":[{"name":"1 Computer Science Department, University of Missouri, Columbia, Missouri, 65211, USA, 2Informatics Institute, University of Missouri, Columbia, Missouri, 65211, USA and 3C. Bond Life Science Center, University of Missouri, Columbia, Missouri, 65211, USA"},{"name":"1 Computer Science Department, University of Missouri, Columbia, Missouri, 65211, USA, 2Informatics Institute, University of Missouri, Columbia, Missouri, 65211, USA and 3C. Bond Life Science Center, University of Missouri, Columbia, Missouri, 65211, USA"},{"name":"1 Computer Science Department, University of Missouri, Columbia, Missouri, 65211, USA, 2Informatics Institute, University of Missouri, Columbia, Missouri, 65211, USA and 3C. Bond Life Science Center, University of Missouri, Columbia, Missouri, 65211, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2015,6,10]]},"reference":[{"key":"2023020115402234600_btv235-B1","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1093\/nar\/28.1.235","article-title":"The protein data bank","volume":"28","author":"Berman","year":"2000","journal-title":"Nucleic Acids Res."},{"key":"2023020115402234600_btv235-B2","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1002\/prot.24167","article-title":"3Drefine: consistent protein structure refinement by optimizing hydrogen bonding network and atomic-level energy minimization","volume":"81","author":"Bhattacharya","year":"2013","journal-title":"Proteins Struct. Funct. Bioinform."},{"key":"2023020115402234600_btv235-B3","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1126\/science.1853201","article-title":"A method to identify protein sequences that fold into a known three-dimensional structure","volume":"253","author":"Bowie","year":"1991","journal-title":"Science"},{"key":"2023020115402234600_btv235-B4","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1186\/1472-6807-14-13","article-title":"Designing and evaluating the MULTICOM protein local and global model quality prediction methods in the CASP10 experiment","volume":"14","author":"Cao","year":"2014","journal-title":"BMC Struct. Biol."},{"key":"2023020115402234600_btv235-B5","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1186\/1471-2105-15-120","article-title":"SMOQ: a tool for predicting the absolute residue-specific quality of a single protein model with support vector machines","volume":"15","author":"Cao","year":"2014","journal-title":"BMC Bioinformatics"},{"key":"2023020115402234600_btv235-B6","doi-asserted-by":"crossref","first-page":"W72","DOI":"10.1093\/nar\/gki396","article-title":"SCRATCH: a protein structure and structural feature prediction server","volume":"33","author":"Cheng","year":"2005","journal-title":"Nucleic Acids Res."},{"key":"2023020115402234600_btv235-B7","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1186\/1471-2105-13-65","article-title":"The MULTICOM toolbox for protein structure prediction","volume":"13","author":"Cheng","year":"2012","journal-title":"BMC Bioinformatics"},{"key":"2023020115402234600_btv235-B8","doi-asserted-by":"crossref","first-page":"868","DOI":"10.1002\/(SICI)1521-3773(19980420)37:7<868::AID-ANIE868>3.0.CO;2-H","article-title":"Protein folding: a perspective from theory and experiment","volume":"37","author":"Dobson","year":"1998","journal-title":"Angewandte Chemie International Edition"},{"key":"2023020115402234600_btv235-B9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3109\/10409239509085139","article-title":"Protein structure prediction: recognition of primary, secondary, and tertiary structural features from amino acid sequence","volume":"30","author":"Eisenhaber","year":"1995","journal-title":"Crit. Rev. Biochem. Mol. Biol."},{"key":"2023020115402234600_btv235-B10","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1002\/jcc.21968","article-title":"SPINE X: improving protein secondary structure prediction by multistep learning coupled with prediction of solvent accessible surface area and backbone torsion angles","volume":"33","author":"Faraggi","year":"2012","journal-title":"J. Comput. Chem."},{"key":"2023020115402234600_btv235-B11","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1038\/358086a0","article-title":"A new approach to protein fold recognition","volume":"358","author":"Jones","year":"1992","journal-title":"Nature"},{"key":"2023020115402234600_btv235-B12","doi-asserted-by":"crossref","first-page":"922","DOI":"10.1107\/S0567739476001873","article-title":"A solution for the best rotation to relate two sets of vectors","volume":"32","author":"Kabsch","year":"1976","journal-title":"Acta Crystallogr. Sec. A"},{"key":"2023020115402234600_btv235-B13","doi-asserted-by":"crossref","first-page":"2577","DOI":"10.1002\/bip.360221211","article-title":"Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features","volume":"22","author":"Kabsch","year":"1983","journal-title":"Biopolymers"},{"key":"2023020115402234600_btv235-B14","doi-asserted-by":"crossref","first-page":"1511","DOI":"10.1038\/nprot.2012.085","article-title":"Template-based protein structure modeling using the RaptorX web server","volume":"7","author":"K\u00e4llberg","year":"2012","journal-title":"Nat. Protoc."},{"key":"2023020115402234600_btv235-B15","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1186\/1472-6807-13-2","article-title":"Designing and benchmarking the MULTICOM protein structure prediction system","volume":"13","author":"Li","year":"2013","journal-title":"BMC Struct. Biol."},{"key":"2023020115402234600_btv235-B16","doi-asserted-by":"crossref","first-page":"1925","DOI":"10.1110\/ps.036442.108","article-title":"Fragment-HMM: a new approach to protein structure prediction","volume":"17","author":"Li","year":"2008","journal-title":"Protein Sci."},{"key":"2023020115402234600_btv235-B17","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1016\/j.jmb.2007.11.033","article-title":"OPUS-PSP: an orientation-dependent statistical all-atom potential derived from side-chain packing","volume":"376","author":"Lu","year":"2008","journal-title":"J. Mol. Biol."},{"key":"2023020115402234600_btv235-B18","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1093\/bioinformatics\/btp629","article-title":"Rapid model quality assessment for protein structure predictions using the comparison of multiple models without structural alignments","volume":"26","author":"McGuffin","year":"2010","journal-title":"Bioinformatics"},{"key":"2023020115402234600_btv235-B19","doi-asserted-by":"crossref","first-page":"1520","DOI":"10.1016\/j.bbapap.2013.04.023","article-title":"Capturing native\/native like structures with a physico-chemical metric (pcSM) in protein folding","volume":"1834","author":"Mishra","year":"2013","journal-title":"Biochim. Biophys. Acta (BBA) Proteins Proteomics"},{"key":"2023020115402234600_btv235-B20","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1186\/1471-2105-9-403","article-title":"MetaMQAP: a meta-server for the quality assessment of protein models","volume":"9","author":"Pawlowski","year":"2008","journal-title":"BMC Bioinformatics"},{"key":"2023020115402234600_btv235-B21","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1186\/1472-6807-8-52","article-title":"SELECTpro: effective protein model selection using a structure-based energy function resistant to BLUNDERs","volume":"8","author":"Randall","year":"2008","journal-title":"BMC Struct. Biol."},{"key":"2023020115402234600_btv235-B22","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1186\/1471-2105-13-224","article-title":"Improved model quality assessment using ProQ2","volume":"13","author":"Ray","year":"2012","journal-title":"BMC Bioinformatics"},{"key":"2023020115402234600_btv235-B23","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4020-9058-5","volume-title":"From Protein Structure to Function with Bioinformatics","author":"Rigden","year":"2009"},{"key":"2023020115402234600_btv235-B24","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1002\/prot.21279","article-title":"Effects of amino acid composition, finite size of proteins, and sparse statistics on distance-dependent statistical pair potentials","volume":"67","author":"Rykunov","year":"2007","journal-title":"Proteins Struct. Funct. Bioinform."},{"key":"2023020115402234600_btv235-B25","doi-asserted-by":"crossref","first-page":"2507","DOI":"10.1110\/ps.062416606","article-title":"Statistical potential for assessment and prediction of protein structures","volume":"15","author":"Shen","year":"2006","journal-title":"Protein Sci."},{"key":"2023020115402234600_btv235-B26","doi-asserted-by":"crossref","first-page":"11158","DOI":"10.1073\/pnas.95.19.11158","article-title":"Clustering of low-energy conformations near the native structures of small proteins","volume":"95","author":"Shortle","year":"1998","journal-title":"Proc. Natl. Acad. Sci."},{"key":"2023020115402234600_btv235-B27","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1006\/jmbi.1997.0959","article-title":"Assembly of protein tertiary structures from fragments with similar local sequences using simulated annealing and Bayesian scoring functions","volume":"268","author":"Simons","year":"1997","journal-title":"J. Mol. Biol."},{"key":"2023020115402234600_btv235-B28","doi-asserted-by":"crossref","first-page":"900","DOI":"10.1110\/ps.051799606","article-title":"Identification of correct regions in protein models using structural, alignment, and consensus information","volume":"15","author":"Wallner","year":"2006","journal-title":"Protein Sci."},{"key":"2023020115402234600_btv235-B29","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1002\/prot.22275","article-title":"Evaluating the absolute quality of a single protein model using structural features and support vector machines","volume":"75","author":"Wang","year":"2009","journal-title":"Proteins Struct. Funct. Bioinform."},{"key":"2023020115402234600_btv235-B30","doi-asserted-by":"crossref","first-page":"882","DOI":"10.1093\/bioinformatics\/btq058","article-title":"MULTICOM: a multi-level combination approach to protein structure prediction and its assessments in CASP8","volume":"26","author":"Wang","year":"2010","journal-title":"Bioinformatics"},{"key":"2023020115402234600_btv235-B31","doi-asserted-by":"crossref","first-page":"1715","DOI":"10.1093\/bioinformatics\/btr268","article-title":"APOLLO: a quality assessment service for single and multiple protein models","volume":"27","author":"Wang","year":"2011","journal-title":"Bioinformatics"},{"key":"2023020115402234600_btv235-B32","doi-asserted-by":"crossref","first-page":"1715","DOI":"10.1002\/prot.24065","article-title":"Ab initio protein structure assembly using continuous structure fragments and optimized knowledge-based force field","volume":"80","author":"Xu","year":"2012","journal-title":"Proteins Struct. Funct. Bioinform."},{"key":"2023020115402234600_btv235-B33","doi-asserted-by":"crossref","first-page":"1212","DOI":"10.1110\/ps.033480.107","article-title":"Ab initio folding of terminal segments with secondary structures reveals the fine difference between two closely related all-atom statistical energy functions","volume":"17","author":"Yang","year":"2008","journal-title":"Protein Sci."},{"key":"2023020115402234600_btv235-B34","doi-asserted-by":"crossref","first-page":"622","DOI":"10.1016\/j.sbi.2011.07.005","article-title":"X-ray crystallography at the heart of life science","volume":"21","author":"Yonath","year":"2011","journal-title":"Curr. Opin. Struct. Biol."},{"key":"2023020115402234600_btv235-B35","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1002\/prot.22634","article-title":"MUFOLD: a new solution for protein 3D structure prediction","volume":"78","author":"Zhang","year":"2010","journal-title":"Proteins Struct. Funct. Bioinform."},{"key":"2023020115402234600_btv235-B36","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1002\/pmic.201200334","article-title":"Fast algorithm for population-based protein structural model analysis","volume":"13","author":"Zhang","year":"2013","journal-title":"Proteomics"},{"key":"2023020115402234600_btv235-B37","doi-asserted-by":"crossref","first-page":"e15386","DOI":"10.1371\/journal.pone.0015386","article-title":"A novel side-chain orientation dependent potential derived from random-walk reference state for protein fold selection and structure prediction","volume":"5","author":"Zhang","year":"2010","journal-title":"PloS One"},{"key":"2023020115402234600_btv235-B38","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1186\/1471-2105-9-40","article-title":"I-TASSER server for protein 3D structure prediction","volume":"9","author":"Zhang","year":"2008","journal-title":"BMC Bioinformatics"},{"key":"2023020115402234600_btv235-B39","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1016\/j.sbi.2008.02.004","article-title":"Progress and challenges in protein structure prediction","volume":"18","author":"Zhang","year":"2008","journal-title":"Curr. Opin. Struct. Biol."},{"key":"2023020115402234600_btv235-B40","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1002\/prot.24341","article-title":"Interplay of I-TASSER and QUARK for template-based and ab initio protein structure prediction in CASP10","volume":"82","author":"Zhang","year":"2014","journal-title":"Proteins Struct. Funct. Bioinform."},{"key":"2023020115402234600_btv235-B41","doi-asserted-by":"crossref","first-page":"702","DOI":"10.1002\/prot.20264","article-title":"Scoring function for automated assessment of protein structure template quality","volume":"57","author":"Zhang","year":"2004","journal-title":"Proteins Struct. Funct. Bioinform."}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/31\/12\/i116\/49014062\/bioinformatics_31_12_i116.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/31\/12\/i116\/49014062\/bioinformatics_31_12_i116.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,2]],"date-time":"2023-02-02T00:05:36Z","timestamp":1675296336000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/31\/12\/i116\/215567"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,6,10]]},"references-count":41,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2015,6,15]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btv235","relation":{},"ISSN":["1367-4811","1367-4803"],"issn-type":[{"value":"1367-4811","type":"electronic"},{"value":"1367-4803","type":"print"}],"subject":[],"published-other":{"date-parts":[[2015,6,15]]},"published":{"date-parts":[[2015,6,10]]}}}