{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T19:23:27Z","timestamp":1779909807016,"version":"3.53.1"},"reference-count":51,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2021,1,25]],"date-time":"2021-01-25T00:00:00Z","timestamp":1611532800000},"content-version":"vor","delay-in-days":24,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"the Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"crossref","award":["NSERC, RGPIN-"],"award-info":[{"award-number":["NSERC, RGPIN-"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000038","name":"the Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"crossref","award":["-"],"award-info":[{"award-number":["-"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000038","name":"the Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"crossref","award":["6"],"award-info":[{"award-number":["6"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000024","name":"the Canadian Institutes of Health Research","doi-asserted-by":"crossref","award":["PJT-"],"award-info":[{"award-number":["PJT-"]}],"id":[{"id":"10.13039\/501100000024","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000024","name":"the Canadian Institutes of Health Research","doi-asserted-by":"crossref","award":["90"],"award-info":[{"award-number":["90"]}],"id":[{"id":"10.13039\/501100000024","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,1,20]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Many virus-encoded proteins have intrinsically disordered regions that lack a stable, folded three-dimensional structure. These disordered proteins often play important functional roles in virus replication, such as down-regulating host defense mechanisms. With the widespread availability of next-generation sequencing, the number of new virus genomes with predicted open reading frames is rapidly outpacing our capacity for directly characterizing protein structures through crystallography. Hence, computational methods for structural prediction play an important role. A large number of predictors focus on the problem of classifying residues into ordered and disordered regions, and these methods tend to be validated on a diverse training set of proteins from eukaryotes, prokaryotes, and viruses. In this study, we investigate whether some predictors outperform others in the context of virus proteins and compared our findings with data from non-viral proteins. We evaluate the prediction accuracy of 21 methods, many of which are only available as web applications, on a curated set of 126 proteins encoded by viruses. Furthermore, we apply a random forest classifier to these predictor outputs. Based on cross-validation experiments, this ensemble approach confers a substantial improvement in accuracy, e.g., a mean 36 per cent gain in Matthews correlation coefficient. Lastly, we apply the random forest predictor to severe acute respiratory syndrome coronavirus 2 ORF6, an accessory gene that encodes a short (61 AA) and moderately disordered protein that inhibits the host innate immune response. We show that disorder prediction methods perform differently for viral and non-viral proteins, and that an ensemble approach can yield more robust and accurate predictions.<\/jats:p>","DOI":"10.1093\/ve\/veaa106","type":"journal-article","created":{"date-parts":[[2020,12,29]],"date-time":"2020-12-29T15:12:59Z","timestamp":1609254779000},"source":"Crossref","is-referenced-by-count":5,"title":["Tuning intrinsic disorder predictors for virus proteins"],"prefix":"10.1093","volume":"7","author":[{"given":"Gal","family":"Almog","sequence":"first","affiliation":[{"name":"Department of Pathology & Laboratory Medicine, Western University, Dental Sciences Building, Rm. 4044 London, Ontario, Canada, N6A 5C1"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6620-8694","authenticated-orcid":false,"given":"Abayomi S","family":"Olabode","sequence":"additional","affiliation":[{"name":"Department of Pathology & Laboratory Medicine, Western University, Dental Sciences Building, Rm. 4044 London, Ontario, Canada, N6A 5C1"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3779-154X","authenticated-orcid":false,"given":"Art F Y","family":"Poon","sequence":"additional","affiliation":[{"name":"Department of Pathology & Laboratory Medicine, Western University, Dental Sciences Building, Rm. 4044 London, Ontario, Canada, N6A 5C1"},{"name":"Department of Applied Mathematics, Western University, Middlesex College Room 255, 1151 Richmond Street London, Ontario, Canada, N6A 5B7"},{"name":"Department of Microbiology & Immunology, Western University, 1151 Richmond Street London, Ontario, Canada, N6A 3K"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,1,25]]},"reference":[{"key":"2021021410175124100_veaa106-B1","doi-asserted-by":"crossref","first-page":"19040","DOI":"10.3390\/ijms160819040","article-title":"Disorder Prediction Methods, Their Applicability to Different Protein Targets and Their Usefulness for Guiding Experimental Studies","volume":"16","author":"Atkins","year":"2015","journal-title":"International Journal of Molecular Sciences"},{"key":"2021021410175124100_veaa106-B2","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1186\/1471-2105-13-111","article-title":"Ensemble Prediction of Intrinsically Disordered Regions in Proteins","volume":"13","author":"Attia","year":"2012","journal-title":"BMC Bioinformatics"},{"key":"2021021410175124100_veaa106-B3","doi-asserted-by":"crossref","first-page":"1496","DOI":"10.1101\/gr.6305707","article-title":"The Evolution of Genome Compression and Genomic Novelty in RNA Viruses","volume":"17","author":"Belshaw","year":"2007","journal-title":"Genome Research"},{"key":"2021021410175124100_veaa106-B4","doi-asserted-by":"crossref","first-page":"e0177678","DOI":"10.1371\/journal.pone.0177678","article-title":"Optimal Classifier for Imbalanced Data Using Matthews Correlation Coefficient Metric","volume":"12","author":"Boughorbel","year":"2017","journal-title":"PLoS One"},{"key":"2021021410175124100_veaa106-B5","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Machine Learning"},{"key":"2021021410175124100_veaa106-B6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1961189.1961199","article-title":"Libsvm: A Library for Support Vector Machines","volume":"2","author":"Chang","year":"2011","journal-title":"ACM Transactions on Intelligent Systems and Technology (TIST)"},{"key":"2021021410175124100_veaa106-B7","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: Synthetic Minority over-Sampling Technique","volume":"16","author":"Chawla","year":"2002","journal-title":"Journal of Artificial Intelligence Research"},{"key":"2021021410175124100_veaa106-B8","author":"ChromeDriver: WebDriver for Chrome"},{"key":"2021021410175124100_veaa106-B9","first-page":"73","author":"Cotmore","year":"2005"},{"key":"2021021410175124100_veaa106-B10","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1002\/pro.2864","article-title":"Resolving the Ambiguity: Making Sense of Intrinsic Disorder When PDB Structures Disagree","volume":"25","author":"DeForte","year":"2016","journal-title":"Protein Science"},{"key":"2021021410175124100_veaa106-B11","author":"DisProt"},{"key":"2021021410175124100_veaa106-B12","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/S1093-3263(00)00138-8","article-title":"Intrinsically Disordered Protein","volume":"19","author":"Dunker","year":"2001","journal-title":"Journal of Molecular Graphics and Modelling"},{"key":"2021021410175124100_veaa106-B13","first-page":"179","volume-title":"Methods in Enzymology","author":"Ferreon","year":"2010"},{"key":"2021021410175124100_veaa106-B14","author":"Giri","year":"2020"},{"key":"2021021410175124100_veaa106-B15","doi-asserted-by":"crossref","first-page":"e1004529","DOI":"10.1371\/journal.ppat.1004529","article-title":"Rapid Evolution of Virus Sequences in Intrinsically Disordered Protein Regions","volume":"10","author":"Gitlin","year":"2014","journal-title":"PLoS Pathogens"},{"key":"2021021410175124100_veaa106-B16","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1016\/j.gpb.2019.01.004","article-title":"Spot-disorder2: Improved Protein Intrinsic Disorder Prediction by Ensembled Deep Learning","volume":"17","author":"Hanson","year":"2019","journal-title":"Genomics, Proteomics & Bioinformatics"},{"key":"2021021410175124100_veaa106-B17","first-page":"685","article-title":"Improving Protein Disorder Prediction by Deep Bidirectional Long Short-Term Memory Recurrent Neural Networks","volume":"33","author":"Hanson","year":"2017","journal-title":"Bioinformatics (Oxford, England)"},{"key":"2021021410175124100_veaa106-B18","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-21606-5","volume-title":"The Elements of Statistical Learning","author":"Hastie","year":"2001"},{"key":"2021021410175124100_veaa106-B19","first-page":"D269","article-title":"Disprot: Intrinsic Protein Disorder Annotation in 2020","volume":"48","author":"Hatos","year":"2020","journal-title":"Nucleic Acids Research"},{"key":"2021021410175124100_veaa106-B20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13321-020-00420-z","article-title":"Cover: Conformational Oversampling as Data Augmentation for Molecules","volume":"12","author":"Hemmerich","year":"2020","journal-title":"Journal of Cheminformatics"},{"key":"2021021410175124100_veaa106-B21","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1146\/annurev.ecolsys.110308.120248","article-title":"The Evolutionary Genetics of Emerging Viruses","volume":"40","author":"Holmes","year":"2009","journal-title":"Annual Review of Ecology, Evolution, and Systematics"},{"key":"2021021410175124100_veaa106-B22","doi-asserted-by":"crossref","first-page":"1198","DOI":"10.2174\/1389450116666150722141119","article-title":"Untapped Potential of Disordered Proteins in Current Druggable Human Proteome","volume":"17","author":"Hu","year":"2016","journal-title":"Current Drug Targets"},{"key":"2021021410175124100_veaa106-B23","article-title":"The Class Imbalance Problem: Significance and Strategies","volume":"56","author":"Japkowicz","year":"2000","journal-title":"Proc. of the Int'l Conf. on Artificial Intelligence"},{"key":"2021021410175124100_veaa106-B24","first-page":"48","article-title":"Accuracy of Protein-Level Disorder Predictions","volume":"46","author":"Katuwawala","year":"2019","journal-title":"Briefings in Bioinformatics"},{"key":"2021021410175124100_veaa106-B25","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1186\/1471-2105-13-111","article-title":"Metadisorder: A Meta-Server for the Prediction of Intrinsic Disorder in Proteins","volume":"13","author":"Kozlowski","year":"2012","journal-title":"BMC Bioinformatics"},{"key":"2021021410175124100_veaa106-B26","first-page":"559","article-title":"Imbalanced-Learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning","volume":"18","author":"Lema\u00eetre","year":"2017","journal-title":"The Journal of Machine Learning Research"},{"key":"2021021410175124100_veaa106-B27","doi-asserted-by":"crossref","first-page":"23446","DOI":"10.3390\/ijms161023446","article-title":"An Overview of Predictors for Intrinsically Disordered Proteins over 2010\u20132014","volume":"16","author":"Li","year":"2015","journal-title":"International Journal of Molecular Sciences"},{"key":"2021021410175124100_veaa106-B28","doi-asserted-by":"crossref","first-page":"2364","DOI":"10.1002\/anie.199423641","article-title":"100 Years \u201cSchl\u00fcssel-Schloss-Prinzip\u201d: What Made Emil Fischer Use This Analogy?","volume":"33","author":"Lichtenthaler","year":"1995","journal-title":"Angewandte Chemie International Edition in English"},{"key":"2021021410175124100_veaa106-B29","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1093\/bib\/bbx126","article-title":"A Comprehensive Review and Comparison of Existing Computational Methods for Intrinsically Disordered Protein and Region Prediction","volume":"20","author":"Liu","year":"2019","journal-title":"Briefings in Bioinformatics"},{"key":"2021021410175124100_veaa106-B30","doi-asserted-by":"crossref","first-page":"W329","DOI":"10.1093\/nar\/gky384","article-title":"Iupred2a: Context-Dependent Prediction of Protein Disorder as a Function of Redox State and Protein Binding","volume":"46","author":"M\u00e9sz\u00e1ros","year":"2018","journal-title":"Nucleic Acids Research"},{"key":"2021021410175124100_veaa106-B31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/bs.pmbts.2020.03.001","article-title":"Intrinsically Disordered Proteins of Viruses: Involvement in the Mechanism of Cell Regulation and Pathogenesis","volume":"174","author":"Mishra","year":"2020","journal-title":"Progress in Molecular Biology and Translational Science"},{"key":"2021021410175124100_veaa106-B32","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1093\/bioinformatics\/btx590","article-title":"A Comprehensive Assessment of Long Intrinsic Protein Disorder from the Disprot Database","volume":"34","author":"Necci","year":"2018","journal-title":"Bioinformatics"},{"key":"2021021410175124100_veaa106-B33","doi-asserted-by":"crossref","first-page":"5137","DOI":"10.1038\/s41598-019-41644-w","article-title":"Quality and Bias of Protein Disorder Predictors","volume":"9","author":"Nielsen","year":"2019","journal-title":"Scientific Reports"},{"key":"2021021410175124100_veaa106-B34","first-page":"2825","article-title":"Scikit-Learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"The Journal of Machine Learning Research"},{"key":"2021021410175124100_veaa106-B35","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1186\/1471-2105-7-208","article-title":"Length-Dependent Prediction of Protein Intrinsic Disorder","volume":"7","author":"Peng","year":"2006","journal-title":"BMC Bioinformatics"},{"key":"2021021410175124100_veaa106-B36","doi-asserted-by":"crossref","first-page":"D219","DOI":"10.1093\/nar\/gkw1056","article-title":"Disprot 7.0: A Major Update of the Database of Disordered Proteins","volume":"45","author":"Piovesan","year":"2017","journal-title":"Nucleic Acids Research"},{"key":"2021021410175124100_veaa106-B37","doi-asserted-by":"crossref","first-page":"10719","DOI":"10.1128\/JVI.00595-09","article-title":"Overlapping Genes Produce Proteins with Unusual Sequence Properties and Offer Insight into de Novo Protein Creation","volume":"83","author":"Rancurel","year":"2009","journal-title":"Journal of Virology"},{"key":"2021021410175124100_veaa106-B38","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1002\/1097-0134(20010101)42:1<38::AID-PROT50>3.0.CO;2-3","article-title":"Sequence Complexity of Disordered Protein","volume":"42","author":"Romero","year":"2001","journal-title":"Proteins: Structure, Function, and Genetics"},{"key":"2021021410175124100_veaa106-B39","doi-asserted-by":"crossref","first-page":"9733","DOI":"10.1128\/JVI.00694-10","article-title":"Viral Mutation Rates","volume":"84","author":"Sanju\u00e1n","year":"2010","journal-title":"Journal of Virology"},{"key":"2021021410175124100_veaa106-B40","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.tibs.2008.10.009","article-title":"Do Viral Proteins Possess Unique Biophysical Features?","volume":"34","author":"Tokuriki","year":"2009","journal-title":"Trends in Biochemical Sciences"},{"key":"2021021410175124100_veaa106-B41","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1046\/j.0014-2956.2001.02649.x","article-title":"What Does It Mean to Be Natively Unfolded?","volume":"269","author":"Uversky","year":"2002","journal-title":"European Journal of Biochemistry"},{"key":"2021021410175124100_veaa106-B42","doi-asserted-by":"crossref","first-page":"10","DOI":"10.3389\/fphy.2019.00010","article-title":"Intrinsically Disordered Proteins and Their \u2018Mysterious\u2019 (Meta) Physics","volume":"7","author":"Uversky","year":"2019","journal-title":"Frontiers in Physics"},{"key":"2021021410175124100_veaa106-B43","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1146\/annurev.biophys.37.032807.125924","article-title":"Intrinsically Disordered Proteins in Human Diseases: Introducing the d2 Concept","volume":"37","author":"Uversky","year":"2008","journal-title":"Annual Review of Biophysics"},{"key":"2021021410175124100_veaa106-B44","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1002\/prot.10437","article-title":"Flavors of Protein Disorder","volume":"52","author":"Vucetic","year":"2003","journal-title":"Proteins: Structure, Function, and Bioinformatics"},{"key":"2021021410175124100_veaa106-B45","doi-asserted-by":"crossref","first-page":"W190","DOI":"10.1093\/nar\/gkr411","article-title":"Cspritz: Accurate Prediction of Protein Disorder Segments with Annotation for Homology, Secondary Structure and Linear Motifs","volume":"39","author":"Walsh","year":"2011","journal-title":"Nucleic Acids Research"},{"key":"2021021410175124100_veaa106-B46","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1093\/bioinformatics\/btr682","article-title":"Espritz: Accurate and Fast Prediction of Protein Disorder","volume":"28","author":"Walsh","year":"2012","journal-title":"Bioinformatics"},{"key":"2021021410175124100_veaa106-B47","doi-asserted-by":"crossref","first-page":"e0211725","DOI":"10.1371\/journal.pone.0211725","article-title":"Comparative Analysis of Mutational Robustness of the Intrinsically Disordered Viral Protein VPg and of Its Interactor eIF4E","volume":"14","author":"Walter","year":"2019","journal-title":"PloS One"},{"key":"2021021410175124100_veaa106-B48","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1006\/jmbi.1999.3110","article-title":"Intrinsically Unstructured Proteins: Re-Assessing the Protein Structure-Function Paradigm","volume":"293","author":"Wright","year":"1999","journal-title":"Journal of Molecular Biology"},{"key":"2021021410175124100_veaa106-B49","doi-asserted-by":"crossref","first-page":"996","DOI":"10.1016\/j.bbapap.2010.01.011","article-title":"PONDR-FIT: A Meta-Predictor of Intrinsically Disordered Amino Acids","volume":"1804","author":"Xue","year":"2010","journal-title":"Biochimica et Biophysica Acta"},{"key":"2021021410175124100_veaa106-B50","doi-asserted-by":"crossref","first-page":"6880","DOI":"10.1021\/cr4005692","article-title":"Structural Disorder in Viral Proteins","volume":"114","author":"Xue","year":"2014","journal-title":"Chemical Reviews"},{"key":"2021021410175124100_veaa106-B51","doi-asserted-by":"crossref","first-page":"1418","DOI":"10.1080\/22221751.2020.1780953","article-title":"SARS-COV-2 nsp13, nsp14, nsp15 and orf6 Function as Potent Interferon Antagonists","volume":"9","author":"Yuen","year":"2020","journal-title":"Emerging Microbes & Infections"}],"container-title":["Virus Evolution"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/ve\/advance-article-pdf\/doi\/10.1093\/ve\/veaa106\/36107212\/veaa106.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/ve\/article-pdf\/7\/1\/veaa106\/36252969\/veaa106.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/ve\/article-pdf\/7\/1\/veaa106\/36252969\/veaa106.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,2,14]],"date-time":"2021-02-14T07:11:15Z","timestamp":1613286675000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/ve\/article\/doi\/10.1093\/ve\/veaa106\/6119658"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1]]},"references-count":51,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1,20]]}},"URL":"https:\/\/doi.org\/10.1093\/ve\/veaa106","relation":{"has-review":[{"id-type":"doi","id":"10.3410\/f.739599306.793583267","asserted-by":"object"}],"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.10.27.357954","asserted-by":"object"}]},"ISSN":["2057-1577"],"issn-type":[{"value":"2057-1577","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,1]]},"published":{"date-parts":[[2021,1]]},"article-number":"veaa106"}}