{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T06:09:42Z","timestamp":1777442982395,"version":"3.51.4"},"reference-count":41,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2024,3,4]],"date-time":"2024-03-04T00:00:00Z","timestamp":1709510400000},"content-version":"vor","delay-in-days":42,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001665","name":"French National Research Agency","doi-asserted-by":"publisher","award":["ANR-20-THIA-0013-01"],"award-info":[{"award-number":["ANR-20-THIA-0013-01"]}],"id":[{"id":"10.13039\/501100001665","id-type":"DOI","asserted-by":"publisher"}]},{"name":"DATAIA Convergence Institute","award":["ANR-17-CONV-0003"],"award-info":[{"award-number":["ANR-17-CONV-0003"]}]},{"name":"GENCI\/IDRIS","award":["AD011014250"],"award-info":[{"award-number":["AD011014250"]}]},{"name":"Labex DigiCosme","award":["ANR11LABEX0045DIGICOSME"],"award-info":[{"award-number":["ANR11LABEX0045DIGICOSME"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,1,22]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>RNA is a complex macromolecule that plays central roles in the cell. While it is well known that its structure is directly related to its functions, understanding and predicting RNA structures is challenging. Assessing the real or predictive quality of a structure is also at stake with the complex 3D possible conformations of RNAs. Metrics have been developed to measure model quality while scoring functions aim at assigning quality to guide the discrimination of structures without a known and solved reference. Throughout the years, many metrics and scoring functions have been developed, and no unique assessment is used nowadays. Each developed assessment method has its specificity and might be complementary to understanding structure quality. Therefore, to evaluate RNA 3D structure predictions, it would be important to calculate different metrics and\/or scoring functions. For this purpose, we developed RNAdvisor, a comprehensive automated software that integrates and enhances the accessibility of existing metrics and scoring functions. In this paper, we present our RNAdvisor tool, as well as state-of-the-art existing metrics, scoring functions and a set of benchmarks we conducted for evaluating them. Source code is freely available on the EvryRNA platform: https:\/\/evryrna.ibisc.univ-evry.fr.<\/jats:p>","DOI":"10.1093\/bib\/bbae064","type":"journal-article","created":{"date-parts":[[2024,2,12]],"date-time":"2024-02-12T16:35:08Z","timestamp":1707755708000},"source":"Crossref","is-referenced-by-count":14,"title":["RNAdvisor: a comprehensive benchmarking tool for the measure and prediction of RNA structural model quality"],"prefix":"10.1093","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-0117-9823","authenticated-orcid":false,"given":"Clement","family":"Bernard","sequence":"first","affiliation":[{"name":"Universit\u00e9 Paris Saclay , Univ Evry, , 91020 Evry-Courcouronnes , France"},{"name":"IBISC , Univ Evry, , 91020 Evry-Courcouronnes , France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0380-0092","authenticated-orcid":false,"given":"Guillaume","family":"Postic","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Paris Saclay , Univ Evry, , 91020 Evry-Courcouronnes , France"},{"name":"IBISC , Univ Evry, , 91020 Evry-Courcouronnes , France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7531-2522","authenticated-orcid":false,"given":"Sahar","family":"Ghannay","sequence":"additional","affiliation":[{"name":"LISN - CNRS\/Universit\u00e9 Paris-Saclay , France, 91400 Orsay , France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3975-5668","authenticated-orcid":false,"given":"Fariza","family":"Tahi","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Paris Saclay , Univ Evry, , 91020 Evry-Courcouronnes , France"},{"name":"IBISC , Univ Evry, , 91020 Evry-Courcouronnes , France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2024,3,2]]},"reference":[{"key":"2024030414150898400_ref1","doi-asserted-by":"crossref","first-page":"14664","DOI":"10.1073\/pnas.0703836104","article-title":"Automated de novo prediction of native-like RNA tertiary structures","volume":"104","author":"Das","year":"2007","journal-title":"Proc Natl Acad Sci U S A"},{"key":"2024030414150898400_ref2","doi-asserted-by":"crossref","first-page":"963","DOI":"10.1016\/j.str.2020.05.011","article-title":"FARFAR2: improved De novo Rosetta prediction of complex global RNA folds","volume":"28","author":"Watkins","year":"2020","journal-title":"Structure"},{"key":"2024030414150898400_ref3","doi-asserted-by":"crossref","first-page":"235102","DOI":"10.1063\/1.4881424","article-title":"A nucleotide-level coarse-grained model of RNA","volume":"140","author":"Sulc","year":"2014","journal-title":"J Chem Phys"},{"issue":"7","key":"2024030414150898400_ref4","doi-asserted-by":"crossref","first-page":"3510","DOI":"10.1021\/acs.jctc.5b00200","article-title":"Coarse-grained HiRE-RNA model for ab initio RNA folding beyond simple molecules, including noncanonical and Multiple Base pairings","volume":"11","author":"Cragnolini","year":"2015","journal-title":"J Chem Theory Comput"},{"key":"2024030414150898400_ref5","doi-asserted-by":"crossref","first-page":"2891","DOI":"10.1093\/bioinformatics\/btv221","article-title":"iFoldRNA v2: folding RNA with constraints","volume":"31","author":"Krokhotin","year":"2015","journal-title":"Bioinformatics"},{"key":"2024030414150898400_ref6","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1038\/s41586-021-03819-2","article-title":"Highly accurate protein structure prediction with AlphaFold","volume":"596","author":"Jumper","year":"2021","journal-title":"Nature"},{"key":"2024030414150898400_ref7","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1126\/science.ade2574","article-title":"Evolutionary-scale prediction of atomic-level protein structure with a language model","volume":"379","author":"Lin","year":"2023","journal-title":"Science"},{"issue":"4","key":"2024030414150898400_ref8","doi-asserted-by":"crossref","first-page":"702","DOI":"10.1002\/prot.20264","article-title":"Scoring function for automated assessment of protein structure template quality","volume":"57","author":"Zhang","year":"2004","journal-title":"Proteins"},{"key":"2024030414150898400_ref9","doi-asserted-by":"crossref","first-page":"1875","DOI":"10.1261\/rna.1700409","article-title":"New metrics for comparing and assessing discrepancies between RNA 3D structures and models","volume":"15","author":"Parisien","year":"2009","journal-title":"RNA (New York, NY)"},{"key":"2024030414150898400_ref10","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1007\/s10100-013-0296-5","article-title":"MCQ4Structures to compute similarity of molecule structures","volume":"22","author":"Zok","year":"2013","journal-title":"Cent Eur J Oper Res"},{"key":"2024030414150898400_ref11","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1261\/rna.1270809","article-title":"Coarse-grained modeling of large RNA molecules with knowledge-based potentials and structural filters","volume":"15","author":"Jonikas","year":"2009","journal-title":"RNA"},{"key":"2024030414150898400_ref12","doi-asserted-by":"crossref","first-page":"e63","DOI":"10.1093\/nar\/gkv1479","article-title":"SimRNA: a coarse-grained method for RNA folding simulations and 3D structure prediction","volume":"44","author":"Boniecki","year":"2016","journal-title":"Nucleic Acids Res"},{"key":"2024030414150898400_ref13","doi-asserted-by":"crossref","first-page":"1842","DOI":"10.1021\/acs.jctc.0c01148","article-title":"IsRNA1: De novo prediction and blind screening of RNA 3D structures","volume":"17","author":"Zhang","year":"2021","journal-title":"J Chem Theory Comput"},{"key":"2024030414150898400_ref14","doi-asserted-by":"crossref","first-page":"11907","DOI":"10.1021\/acs.jpcb.1c07288","article-title":"Modeling noncanonical RNA Base pairs by a coarse-grained IsRNA2 model","volume":"125","author":"Zhang","year":"2021","journal-title":"J Phys Chem B"},{"key":"2024030414150898400_ref15","doi-asserted-by":"crossref","first-page":"3341","DOI":"10.1093\/nar\/gkad122","article-title":"Rnajp: enhanced rna 3d structure predictions with non-canonical interactions and global topology sampling","volume":"51","author":"Li","year":"2023","journal-title":"Nucleic Acids Res"},{"key":"2024030414150898400_ref16","doi-asserted-by":"crossref","first-page":"1086","DOI":"10.1093\/bioinformatics\/btr093","article-title":"All-atom knowledge-based potential for RNA structure prediction and assessment","volume":"27","author":"Capriotti","year":"2011","journal-title":"Bioinformatics"},{"key":"2024030414150898400_ref17","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.bpj.2021.11.016","article-title":"rsRNASP: a residue-separation-based statistical potential for RNA 3D structure evaluation","volume":"121","author":"Tan","year":"2022","journal-title":"Biophys J"},{"key":"2024030414150898400_ref18","doi-asserted-by":"crossref","first-page":"13306","DOI":"10.1093\/nar\/gku972","article-title":"The role of nucleobase interactions in RNA structure and dynamics","volume":"42","author":"Bottaro","year":"2014","journal-title":"Nucleic Acids Res"},{"key":"2024030414150898400_ref19","doi-asserted-by":"crossref","first-page":"W375","DOI":"10.1093\/nar\/gkm216","article-title":"Molprobity: all-atom contacts and structure validation for proteins and nucleic acids","volume":"35","author":"Davis","year":"2007","journal-title":"Nucleic Acids Res"},{"issue":"S3","key":"2024030414150898400_ref20","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1002\/(SICI)1097-0134(1999)37:3+<22::AID-PROT5>3.0.CO;2-W","article-title":"Processing and analysis of CASP3 protein structure predictions","volume":"37","author":"Zemla","year":"1999","journal-title":"Proteins"},{"key":"2024030414150898400_ref21","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1002\/prot.24172","article-title":"CAD-score: a new contact area difference-based function for evaluation of protein structural models","volume":"81","author":"Olechnovic","year":"2013","journal-title":"Proteins"},{"issue":"21","key":"2024030414150898400_ref22","first-page":"2722","article-title":"lDDT: a local superposition-free score for comparing protein structures and models using distance difference tests","volume":"29","author":"Mariani","year":"2013","journal-title":"Bioinformatics (Oxford, England)"},{"key":"2024030414150898400_ref23","doi-asserted-by":"crossref","first-page":"1340","DOI":"10.1261\/rna.1837410","article-title":"On the significance of an RNA tertiary structure prediction","volume":"16","author":"Hajdin","year":"2010","journal-title":"RNA (New York, NY)"},{"key":"2024030414150898400_ref24","doi-asserted-by":"crossref","first-page":"2311","DOI":"10.1002\/prot.24121","article-title":"What is the best reference state for designing statistical atomic potentials in protein structure prediction?","volume":"80","author":"Deng","year":"2012","journal-title":"Proteins"},{"key":"2024030414150898400_ref25","doi-asserted-by":"crossref","first-page":"895","DOI":"10.1006\/jmbi.1997.1479","article-title":"An all-atom distance-dependent conditional probability discriminatory function for protein structure prediction","volume":"275","author":"Samudrala","year":"1998","journal-title":"J Mol Biol"},{"key":"2024030414150898400_ref26","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1002\/prot.1087","article-title":"A distance-dependent atomic knowledge-based potential for improved protein structure selection","volume":"44","author":"Hua","year":"2001","journal-title":"Proteins"},{"key":"2024030414150898400_ref27","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1002\/prot.21279","article-title":"Effects of amino acid composition, finite size of proteins, and sparse statistics on distance-dependent statistical pair potentials","volume":"67","author":"Rykunov","year":"2007","journal-title":"Proteins"},{"key":"2024030414150898400_ref28","doi-asserted-by":"crossref","first-page":"2714","DOI":"10.1110\/ps.0217002","article-title":"Distance-scaled, finite ideal-gas reference state improves structure-derived potentials of mean force for structure selection and stability prediction","volume":"11","author":"Zhou","year":"2002","journal-title":"Protein Sci"},{"key":"2024030414150898400_ref29","doi-asserted-by":"crossref","first-page":"2507","DOI":"10.1110\/ps.062416606","article-title":"Statistical potential for assessment and prediction of protein structures","volume":"15","author":"Shen","year":"2006","journal-title":"Protein Sci"},{"key":"2024030414150898400_ref30","doi-asserted-by":"crossref","first-page":"e15386","DOI":"10.1371\/journal.pone.0015386","article-title":"A novel side-chain orientation dependent potential derived from random-walk reference state for protein fold selection and structure prediction","volume":"5","author":"Zhang","year":"2010","journal-title":"PloS One"},{"key":"2024030414150898400_ref31","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1261\/rna.069872.118","article-title":"What is the best reference state for building statistical potentials in RNA 3D structure evaluation?","volume":"25","author":"Tan","year":"2019","journal-title":"RNA"},{"key":"2024030414150898400_ref32","doi-asserted-by":"crossref","first-page":"e63","DOI":"10.1093\/nar\/gkv141","article-title":"3dRNAscore: a distance and torsion angle dependent evaluation function of 3D RNA structures","volume":"43","author":"Wang","year":"2015","journal-title":"Nucleic Acids Res"},{"issue":"11","key":"2024030414150898400_ref33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pcbi.1006514","article-title":"RNA3DCNN: local and global quality assessments of RNA 3D structures using 3D deep convolutional neural networks","volume":"14","author":"Li","year":"2018","journal-title":"PLoS Comput Biol"},{"key":"2024030414150898400_ref34","doi-asserted-by":"crossref","first-page":"1047","DOI":"10.1126\/science.abe5650","article-title":"Geometric deep learning of RNA structure","volume":"373","author":"Townshend","year":"2021","journal-title":"Science"},{"issue":"W1","key":"2024030414150898400_ref35","doi-asserted-by":"crossref","first-page":"W657","DOI":"10.1093\/nar\/gkac372","article-title":"rna-tools.online: a Swiss army knife for RNA 3D structure modeling workflow","volume":"50","author":"Magnus","year":"2022","journal-title":"Nucleic Acids Res"},{"key":"2024030414150898400_ref36","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1261\/rna.031054.111","article-title":"RNA-puzzles: a CASP-like evaluation of RNA three-dimensional structure prediction","volume":"18","author":"Cruz","year":"2012","journal-title":"RNA (New York, NY)"},{"issue":"239","key":"2024030414150898400_ref37","first-page":"2","article-title":"Docker: lightweight Linux containers for consistent development and deployment","volume":"2014","author":"Merkel","year":"2014","journal-title":"Linux J"},{"key":"2024030414150898400_ref38","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1006\/jmbi.1993.1626","article-title":"Comparative protein modelling by satisfaction of spatial restraints","volume":"234","author":"Sali","year":"1993","journal-title":"J Mol Biol"},{"key":"2024030414150898400_ref39","doi-asserted-by":"crossref","first-page":"e112","DOI":"10.1093\/nar\/gks339","article-title":"Automated 3D structure composition for large RNAs","volume":"40","author":"Popenda","year":"2012","journal-title":"Nucleic Acids Res"},{"key":"2024030414150898400_ref40","doi-asserted-by":"crossref","first-page":"4116","DOI":"10.3390\/ijms20174116","article-title":"3dRNA v2.0: an updated web server for RNA 3D structure prediction","volume":"20","author":"Wang","year":"2019","journal-title":"Int J Mol Sci"},{"key":"2024030414150898400_ref41","article-title":"Quantifying the carbon emissions of machine learning","volume-title":"NeurIPS 2019 Workshop on Tackling Climate Change with Machine Learning","author":"Luccioni","year":"2019"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/25\/2\/bbae064\/56822364\/bbae064.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/25\/2\/bbae064\/56822364\/bbae064.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,4]],"date-time":"2024-03-04T09:29:07Z","timestamp":1709544547000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbae064\/7618078"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,22]]},"references-count":41,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,1,22]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbae064","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2023.11.14.567018","asserted-by":"object"}]},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,3,1]]},"published":{"date-parts":[[2024,1,22]]},"article-number":"bbae064"}}