{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T16:29:48Z","timestamp":1772555388605,"version":"3.50.1"},"reference-count":49,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2017,9,18]],"date-time":"2017-09-18T00:00:00Z","timestamp":1505692800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/about_us\/legal\/notices"}],"funder":[{"DOI":"10.13039\/501100003130","name":"Research Foundation Flanders","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003130","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003130","name":"FWO","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003130","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,2,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Motivation<\/jats:title><jats:p>Intrinsic disorder (ID), i.e. the lack of a unique folded conformation at physiological conditions, is a common feature for many proteins, which requires specialized biochemical experiments that are not high-throughput. Missing X-ray residues from the PDB have been widely used as a proxy for ID when developing computational methods. This may lead to a systematic bias, where predictors deviate from biologically relevant ID. Large benchmarking sets on experimentally validated ID are scarce. Recently, the DisProt database has been renewed and expanded to include manually curated ID annotations for several hundred new proteins. This provides a large benchmark set which has not yet been used for training ID predictors.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Here, we describe the first systematic benchmarking of ID predictors on the new DisProt dataset. In contrast to previous assessments based on missing X-ray data, this dataset contains mostly long ID regions and a significant amount of fully ID proteins. The benchmarking shows that ID predictors work quite well on the new dataset, especially for long ID segments. However, a large fraction of ID still goes virtually undetected and the ranking of methods is different than for PDB data. In particular, many predictors appear to confound ID and regions outside X-ray structures. This suggests that the ID prediction methods capture different flavors of disorder and can benefit from highly accurate curated examples.<\/jats:p><\/jats:sec><jats:sec><jats:title>Availability and implementation<\/jats:title><jats:p>The raw data used for the evaluation are available from URL: http:\/\/www.disprot.org\/assessment\/.<\/jats:p><\/jats:sec><jats:sec><jats:title>Supplementary information<\/jats:title><jats:p>Supplementary data are available at Bioinformatics online.<\/jats:p><\/jats:sec>","DOI":"10.1093\/bioinformatics\/btx590","type":"journal-article","created":{"date-parts":[[2017,9,15]],"date-time":"2017-09-15T11:08:59Z","timestamp":1505473739000},"page":"445-452","source":"Crossref","is-referenced-by-count":53,"title":["A comprehensive assessment of long intrinsic protein disorder from the DisProt database"],"prefix":"10.1093","volume":"34","author":[{"given":"Marco","family":"Necci","sequence":"first","affiliation":[{"name":"Department of Biomedical Sciences, University of Padua, Padova, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Damiano","family":"Piovesan","sequence":"additional","affiliation":[{"name":"Department of Biomedical Sciences, University of Padua, Padova, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zsuzsanna","family":"Doszt\u00e1nyi","sequence":"additional","affiliation":[{"name":"Agricoltural Sciences, University of Udine, Udine, Italy"},{"name":"MTA-ELTE Lend\u00fclet Bioinformatics Research Group, Department of Biochemistry, E\u00f6tv\u00f6s Lor\u00e1nd University, Budapest, Hungary"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Tompa","sequence":"additional","affiliation":[{"name":"Fondazione Edmund Mach, S. Michele all'Adige, Italy"},{"name":"Institute of Enzymology, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Budapest, Hungary"},{"name":"Structural Biology Brussels, Vrije Universiteit Brussel (VUB), and Center for Structural Biology (CSB), Flanders Institute for Biotechnology (VIB), Brussels, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4525-7793","authenticated-orcid":false,"given":"Silvio C E","family":"Tosatto","sequence":"additional","affiliation":[{"name":"Department of Biomedical Sciences, University of Padua, Padova, Italy"},{"name":"CNR Institute of Neuroscience, Padova, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2017,9,18]]},"reference":[{"key":"2023012712262306100_btx590-B1","doi-asserted-by":"crossref","first-page":"19040","DOI":"10.3390\/ijms160819040","article-title":"Disorder prediction methods, their applicability to different protein targets and their usefulness for guiding experimental studies","volume":"16","author":"Atkins","year":"2015","journal-title":"Int. J. Mol. Sci"},{"key":"2023012712262306100_btx590-B2","doi-asserted-by":"crossref","first-page":"R14","DOI":"10.1186\/gb-2011-12-2-r14","article-title":"Bringing order to protein disorder through comparative genomics and genetic interactions","volume":"12","author":"Bellay","year":"2011","journal-title":"Genome Biol"},{"key":"2023012712262306100_btx590-B3","doi-asserted-by":"crossref","first-page":"2741.","DOI":"10.1038\/ncomms3741","article-title":"From protein sequence to dynamics and disorder with DynaMine","volume":"4","author":"Cilia","year":"2013","journal-title":"Nat Commun"},{"key":"2023012712262306100_btx590-B4","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.tibs.2010.10.002","article-title":"How viruses hijack cell regulation","volume":"36","author":"Davey","year":"2011","journal-title":"Trends Biochem. Sci"},{"key":"2023012712262306100_btx590-B5","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1016\/j.jmb.2005.01.071","article-title":"The pairwise energy content estimated from amino acid composition discriminates between folded and intrinsically unstructured proteins","volume":"347","author":"Doszt\u00e1nyi","year":"2005","journal-title":"J. Mol. Biol"},{"key":"2023012712262306100_btx590-B6","doi-asserted-by":"crossref","first-page":"e177.","DOI":"10.1371\/journal.pcbi.0020177","article-title":"Prediction of amyloidogenic and disordered regions in protein chains","volume":"2","author":"Galzitskaya","year":"2006","journal-title":"PLoS Comput. Biol"},{"key":"2023012712262306100_btx590-B7","doi-asserted-by":"crossref","first-page":"6561","DOI":"10.1021\/cr400514h","article-title":"Introducing protein intrinsic disorder","volume":"114","author":"Habchi","year":"2014","journal-title":"Chem. Rev"},{"key":"2023012712262306100_btx590-B8","doi-asserted-by":"crossref","first-page":"929","DOI":"10.1038\/cr.2009.87","article-title":"Predicting intrinsic disorder in proteins: an overview","volume":"19","author":"He","year":"2009","journal-title":"Cell Res"},{"key":"2023012712262306100_btx590-B9","doi-asserted-by":"crossref","first-page":"1198","DOI":"10.2174\/1389450116666150722141119","article-title":"Untapped Potential of Disordered Proteins in Current Druggable Human Proteome","volume":"17","author":"Hu","year":"2016","journal-title":"Curr. Drug Targets"},{"key":"2023012712262306100_btx590-B10","doi-asserted-by":"crossref","first-page":"W460","DOI":"10.1093\/nar\/gkm363","article-title":"PrDOS: prediction of disordered protein regions from amino acid sequence","volume":"35","author":"Ishida","year":"2007","journal-title":"Nucleic Acids Res"},{"key":"2023012712262306100_btx590-B11","doi-asserted-by":"crossref","first-page":"1344","DOI":"10.1093\/bioinformatics\/btn195","article-title":"Prediction of disordered regions in proteins based on the meta approach","volume":"24","author":"Ishida","year":"2008","journal-title":"Bioinformatics"},{"key":"2023012712262306100_btx590-B12","doi-asserted-by":"crossref","first-page":"857","DOI":"10.1093\/bioinformatics\/btu744","article-title":"DISOPRED3: precise disordered region predictions with annotated protein-binding activity","volume":"31","author":"Jones","year":"2015","journal-title":"Bioinformatics"},{"key":"2023012712262306100_btx590-B13","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1007\/978-3-319-20164-1_13","article-title":"Druggability of intrinsically disordered proteins","volume":"870","author":"Joshi","year":"2015","journal-title":"Adv. Exp. Med. Biol"},{"key":"2023012712262306100_btx590-B14","doi-asserted-by":"crossref","first-page":"111.","DOI":"10.1186\/1471-2105-13-111","article-title":"MetaDisorder: a meta-server for the prediction of intrinsic disorder in proteins","volume":"13","author":"Kozlowski","year":"2012","journal-title":"BMC Bioinformatics"},{"key":"2023012712262306100_btx590-B15","doi-asserted-by":"crossref","first-page":"6589","DOI":"10.1021\/cr400525m","article-title":"Classification of intrinsically disordered regions and proteins","volume":"114","author":"van der Lee","year":"2014","journal-title":"Chem. Rev"},{"key":"2023012712262306100_btx590-B16","doi-asserted-by":"crossref","first-page":"3701","DOI":"10.1093\/nar\/gkg519","article-title":"GlobPlot: Exploring protein sequences for globularity and disorder","volume":"31","author":"Linding","year":"2003","journal-title":"Nucleic Acids Res"},{"key":"2023012712262306100_btx590-B17","doi-asserted-by":"crossref","first-page":"1453","DOI":"10.1016\/j.str.2003.10.002","article-title":"Protein disorder prediction: implications for structural proteomics","volume":"11","author":"Linding","year":"2003","journal-title":"Structure"},{"key":"2023012712262306100_btx590-B18","doi-asserted-by":"crossref","first-page":"2916","DOI":"10.1093\/bioinformatics\/btq537","article-title":"MOBI: a web server to define and visualize structural mobility in NMR protein ensembles","volume":"26","author":"Martin","year":"2010","journal-title":"Bioinformatics"},{"key":"2023012712262306100_btx590-B19","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1016\/j.cbpa.2010.06.169","article-title":"Intrinsically disordered proteins are potential drug targets","volume":"14","author":"Metallo","year":"2010","journal-title":"Curr. Opin. Chem. Biol"},{"key":"2023012712262306100_btx590-B20","doi-asserted-by":"crossref","first-page":"i489","DOI":"10.1093\/bioinformatics\/btq373","article-title":"Improved sequence-based prediction of disordered regions with multilayer fusion of multiple information sources","volume":"26","author":"Mizianty","year":"2010","journal-title":"Bioinformatics"},{"key":"2023012712262306100_btx590-B21","doi-asserted-by":"crossref","first-page":"e24428.","DOI":"10.4161\/idp.24428","article-title":"MFDp2","volume":"1","author":"Mizianty","year":"2013","journal-title":"Intrinsically Disordered Proteins"},{"key":"2023012712262306100_btx590-B22","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1002\/prot.24391","article-title":"Assessment of protein disorder region predictions in CASP10","volume":"82","author":"Monastyrskyy","year":"2014","journal-title":"Proteins"},{"key":"2023012712262306100_btx590-B23","doi-asserted-by":"crossref","first-page":"1402","DOI":"10.1093\/bioinformatics\/btx015","article-title":"MobiDB-lite: Fast and highly specific consensus prediction of intrinsic disorder in proteins","volume":"33","author":"Necci","year":"2017","journal-title":"Bioinformatics"},{"key":"2023012712262306100_btx590-B24","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1146\/annurev-biochem-072711-164947","article-title":"Intrinsically disordered proteins and intrinsically disordered protein regions","volume":"83","author":"Oldfield","year":"2014","journal-title":"Annu. Rev. Biochem"},{"key":"2023012712262306100_btx590-B25","doi-asserted-by":"crossref","first-page":"e34687.","DOI":"10.1371\/journal.pone.0034687","article-title":"Structural disorder in eukaryotes","volume":"7","author":"Pancsa","year":"2012","journal-title":"PLoS One"},{"key":"2023012712262306100_btx590-B26","doi-asserted-by":"crossref","first-page":"208.","DOI":"10.1186\/1471-2105-7-208","article-title":"Length-dependent prediction of protein intrinsic disorder","volume":"7","author":"Peng","year":"2006","journal-title":"BMC Bioinformatics"},{"key":"2023012712262306100_btx590-B27","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/s00018-014-1661-9","article-title":"Exceptionally abundant exceptions: comprehensive characterization of intrinsic disorder in all domains of life","volume":"72","author":"Peng","year":"2015","journal-title":"Cell. Mol. Life Sci"},{"key":"2023012712262306100_btx590-B28","doi-asserted-by":"crossref","first-page":"D1123","DOI":"10.1093\/nar\/gkw1056","article-title":"DisProt 7.0: a major update of the database of disordered proteins","volume":"45","author":"Piovesan","year":"2017","journal-title":"Nucleic Acids Res"},{"key":"2023012712262306100_btx590-B29","doi-asserted-by":"crossref","first-page":"3435","DOI":"10.1093\/bioinformatics\/bti537","article-title":"FoldIndex: a simple tool to predict whether a given protein sequence is intrinsically unfolded","volume":"21","author":"Prilusky","year":"2005","journal-title":"Bioinformatics"},{"key":"2023012712262306100_btx590-B30","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1016\/j.sbi.2011.03.014","article-title":"Protein disorder\u2014a breakthrough invention of evolution?","volume":"21","author":"Schlessinger","year":"2011","journal-title":"Curr. Opin. Struct. Biol"},{"key":"2023012712262306100_btx590-B31","doi-asserted-by":"crossref","first-page":"D786","DOI":"10.1093\/nar\/gkl893","article-title":"DisProt: the Database of Disordered Proteins","volume":"35","author":"Sickmeier","year":"2007","journal-title":"Nucleic Acids Res"},{"key":"2023012712262306100_btx590-B32","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1016\/j.jmb.2014.12.007","article-title":"The s2D method: simultaneous sequence-based prediction of the statistical populations of ordered and disordered regions in proteins","volume":"427","author":"Sormanni","year":"2015","journal-title":"J. Mol. Biol"},{"key":"2023012712262306100_btx590-B33","doi-asserted-by":"crossref","first-page":"D71","DOI":"10.1093\/nar\/gkr981","article-title":"Reorganizing the protein space at the Universal Protein Resource (UniProt)","volume":"40","author":"The UniProt Consortium","year":"2012","journal-title":"Nucleic Acids Res"},{"key":"2023012712262306100_btx590-B34","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.sbi.2015.08.009","article-title":"Intrinsically disordered proteins: emerging interaction specialists","volume":"35","author":"Tompa","year":"2015","journal-title":"Curr. Opin. Struct. Biol"},{"key":"2023012712262306100_btx590-B35","doi-asserted-by":"crossref","first-page":"3346","DOI":"10.1016\/j.febslet.2005.03.072","article-title":"The interplay between structure and function in intrinsically unstructured proteins","volume":"579","author":"Tompa","year":"2005","journal-title":"FEBS Lett"},{"key":"2023012712262306100_btx590-B36","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1146\/annurev.biophys.37.032807.125924","article-title":"Intrinsically disordered proteins in human diseases: introducing the D2 concept","volume":"37","author":"Uversky","year":"2008","journal-title":"Annu. Rev. Biophys"},{"key":"2023012712262306100_btx590-B37","doi-asserted-by":"crossref","first-page":"2096","DOI":"10.1021\/ac203096k","article-title":"Multiparametric analysis of intrinsically disordered proteins: looking at intrinsic disorder through compound eyes","volume":"84","author":"Uversky","year":"2012","journal-title":"Anal. Chem"},{"key":"2023012712262306100_btx590-B38","doi-asserted-by":"crossref","first-page":"D385","DOI":"10.1093\/nar\/gkv1047","article-title":"PDBe: improved accessibility of macromolecular structure data from PDB and EMDB","volume":"44","author":"Velankar","year":"2016","journal-title":"Nucleic Acids Res"},{"key":"2023012712262306100_btx590-B39","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1002\/prot.10437","article-title":"Flavors of protein disorder","volume":"52","author":"Vucetic","year":"2003","journal-title":"Proteins"},{"key":"2023012712262306100_btx590-B40","doi-asserted-by":"crossref","first-page":"W164","DOI":"10.1093\/nar\/gkl166","article-title":"Spritz: a server for the prediction of intrinsically disordered regions in protein sequences using kernel machines","volume":"34","author":"Vullo","year":"2006","journal-title":"Nucleic Acids Res"},{"key":"2023012712262306100_btx590-B41","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1093\/bioinformatics\/btu625","article-title":"Comprehensive large-scale assessment of intrinsic protein disorder","volume":"31","author":"Walsh","year":"2015","journal-title":"Bioinformatics"},{"key":"2023012712262306100_btx590-B42","doi-asserted-by":"crossref","first-page":"W190","DOI":"10.1093\/nar\/gkr411","article-title":"CSpritz: accurate prediction of protein disorder segments with annotation for homology, secondary structure and linear motifs","volume":"39","author":"Walsh","year":"2011","journal-title":"Nucleic Acids Res"},{"key":"2023012712262306100_btx590-B43","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1093\/bioinformatics\/btr682","article-title":"ESpritz: accurate and fast prediction of protein disorder","volume":"28","author":"Walsh","year":"2012","journal-title":"Bioinformatics"},{"key":"2023012712262306100_btx590-B44","doi-asserted-by":"crossref","first-page":"i672","DOI":"10.1093\/bioinformatics\/btw446","article-title":"AUCpreD: proteome-level protein disorder prediction by AUC-maximized deep convolutional neural fields","volume":"32","author":"Wang","year":"2016","journal-title":"Bioinformatics"},{"key":"2023012712262306100_btx590-B45","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1080\/07391102.2012.675145","article-title":"Orderly order in protein intrinsic disorder distribution: disorder in 3500 proteomes from viruses and the three domains of life","volume":"30","author":"Xue","year":"2012","journal-title":"J. Biomol. Struct. Dyn"},{"key":"2023012712262306100_btx590-B46","doi-asserted-by":"crossref","first-page":"996","DOI":"10.1016\/j.bbapap.2010.01.011","article-title":"PONDR-FIT: a meta-predictor of intrinsically disordered amino acids","volume":"1804","author":"Xue","year":"2010","journal-title":"Biochim. Biophys. Acta"},{"key":"2023012712262306100_btx590-B47","doi-asserted-by":"crossref","first-page":"6880","DOI":"10.1021\/cr4005692","article-title":"Structural disorder in viral proteins","volume":"114","author":"Xue","year":"2014","journal-title":"Chem. Rev"},{"key":"2023012712262306100_btx590-B48","doi-asserted-by":"crossref","first-page":"3369","DOI":"10.1093\/bioinformatics\/bti534","article-title":"RONN: the bio-basis function neural network technique applied to the detection of natively disordered regions in proteins","volume":"21","author":"Yang","year":"2005","journal-title":"Bioinformatics"},{"key":"2023012712262306100_btx590-B49","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1007\/978-1-4939-6406-2_12","article-title":"Intrinsic Disorder and Semi-disorder Prediction by SPINE-D","volume":"1484","author":"Zhang","year":"2017","journal-title":"Methods Mol. Biol"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/34\/3\/445\/48912865\/bioinformatics_34_3_445.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/34\/3\/445\/48912865\/bioinformatics_34_3_445.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,25]],"date-time":"2023-08-25T22:51:07Z","timestamp":1693003867000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/34\/3\/445\/4160678"}},"subtitle":[],"editor":[{"given":"Alfonso","family":"Valencia","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2017,9,18]]},"references-count":49,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2018,2,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btx590","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2018,2,1]]},"published":{"date-parts":[[2017,9,18]]}}}