{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T15:36:45Z","timestamp":1773416205270,"version":"3.50.1"},"reference-count":40,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2025,1,8]],"date-time":"2025-01-08T00:00:00Z","timestamp":1736294400000},"content-version":"vor","delay-in-days":13,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,12,26]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Motivation<\/jats:title>\n                    <jats:p>Predicting the 3D structure of RNA is an ongoing challenge that has yet to be completely addressed despite continuous advancements. RNA 3D structures rely on distances between residues and base interactions but also backbone torsional angles. Knowing the torsional angles for each residue could help reconstruct its global folding, which is what we tackle in this work. This paper presents a novel approach for directly predicting RNA torsional angles from raw sequence data. Our method draws inspiration from the successful application of language models in various domains and adapts them to RNA.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We have developed a language-based model, RNA-TorsionBERT, incorporating better sequential interactions for predicting RNA torsional and pseudo-torsional angles from the sequence only. Through extensive benchmarking, we demonstrate that our method improves the prediction of torsional angles compared to state-of-the-art methods. In addition, by using our predictive model, we have inferred a torsion angle-dependent scoring function, called TB-MCQ, that replaces the true reference angles by our model prediction. We show that it accurately evaluates the quality of near-native predicted structures, in terms of RNA backbone torsion angle values. Our work demonstrates promising results, suggesting the potential utility of language models in advancing RNA 3D structure prediction.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Availability and implementation<\/jats:title>\n                    <jats:p>Source code is freely available on the EvryRNA platform: https:\/\/evryrna.ibisc.univ-evry.fr\/evryrna\/RNA-TorsionBERT.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btaf004","type":"journal-article","created":{"date-parts":[[2025,1,7]],"date-time":"2025-01-07T15:19:26Z","timestamp":1736263166000},"source":"Crossref","is-referenced-by-count":8,"title":["RNA-TorsionBERT: leveraging language models for RNA 3D torsion angles prediction"],"prefix":"10.1093","volume":"41","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-0117-9823","authenticated-orcid":false,"given":"Cl\u00e9ment","family":"Bernard","sequence":"first","affiliation":[{"name":"Universit\u00e9 Paris Saclay, Univ Evry, IBISC , Evry-Courcouronnes 91020,","place":["France"]},{"name":"LISN\u2014CNRS\/Universit\u00e9 Paris-Saclay , Orsay 91400,","place":["France"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0380-0092","authenticated-orcid":false,"given":"Guillaume","family":"Postic","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Paris Saclay, Univ Evry, IBISC , Evry-Courcouronnes 91020,","place":["France"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7531-2522","authenticated-orcid":false,"given":"Sahar","family":"Ghannay","sequence":"additional","affiliation":[{"name":"LISN\u2014CNRS\/Universit\u00e9 Paris-Saclay , Orsay 91400,","place":["France"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3975-5668","authenticated-orcid":false,"given":"Fariza","family":"Tahi","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Paris Saclay, Univ Evry, IBISC , Evry-Courcouronnes 91020,","place":["France"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2025,1,8]]},"reference":[{"key":"2025012414505250700_btaf004-B1","doi-asserted-by":"publisher","first-page":"E4","DOI":"10.1038\/s41586-024-07487-w","article-title":"Accurate structure prediction of biomolecular interactions with AlphaFold 3","volume":"636","author":"Abramson","year":"2024","journal-title":"Nature"},{"key":"2025012414505250700_btaf004-B2","doi-asserted-by":"crossref","first-page":"lqac012","DOI":"10.1093\/nargab\/lqac012","article-title":"Informative RNA base embedding for RNA structural alignment and clustering by deep representation learning","volume":"4","author":"Akiyama","year":"2022","journal-title":"NAR Genom Bioinform"},{"key":"2025012414505250700_btaf004-B3","doi-asserted-by":"publisher","first-page":"304","DOI":"10.1186\/s12859-018-2317-9","article-title":"RNAfitme: a webserver for modeling nucleobase and nucleoside residue conformation in fixed-backbone RNA structures","volume":"19","author":"Antczak","year":"2018","journal-title":"BMC Bioinformatics"},{"key":"2025012414505250700_btaf004-B4","doi-asserted-by":"publisher","author":"Bernard","year":"2024","DOI":"10.1101\/2024.06.13.598780"},{"key":"2025012414505250700_btaf004-B5","doi-asserted-by":"crossref","first-page":"bbae064","DOI":"10.1093\/bib\/bbae064","article-title":"RNAdvisor: a comprehensive benchmarking tool for the measure and prediction of RNA structural model quality","volume":"25","author":"Bernard","year":"2024","journal-title":"Brief Bioinform"},{"key":"2025012414505250700_btaf004-B6","doi-asserted-by":"publisher","first-page":"lqae048","DOI":"10.1093\/nargab\/lqae048","article-title":"State-of-the-RNArt: benchmarking current methods for RNA 3D structure prediction","volume":"6","author":"Bernard","year":"2024","journal-title":"NAR Genom Bioinform"},{"key":"2025012414505250700_btaf004-B7","doi-asserted-by":"crossref","first-page":"13306","DOI":"10.1093\/nar\/gku972","article-title":"The role of nucleobase interactions in RNA structure and dynamics","volume":"42","author":"Bottaro","year":"2014","journal-title":"Nucleic Acids Res"},{"key":"2025012414505250700_btaf004-B8","doi-asserted-by":"crossref","first-page":"1086","DOI":"10.1093\/bioinformatics\/btr093","article-title":"All-atom knowledge-based potential for RNA structure prediction and assessment","volume":"27","author":"Capriotti","year":"2011","journal-title":"Bioinformatics"},{"key":"2025012414505250700_btaf004-B9","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1261\/rna.031054.111","article-title":"RNA-Puzzles: a CASP-like evaluation of RNA three-dimensional structure prediction","volume":"18","author":"Cruz","year":"2012","journal-title":"RNA"},{"key":"2025012414505250700_btaf004-B10","doi-asserted-by":"crossref","first-page":"1747","DOI":"10.1002\/prot.26602","article-title":"Assessment of three-dimensional RNA structure prediction in CASP15","volume":"91","author":"Das","year":"2023","journal-title":"Proteins"},{"key":"2025012414505250700_btaf004-B11","author":"Devlin","year":"2018"},{"key":"2025012414505250700_btaf004-B12","doi-asserted-by":"crossref","first-page":"2112","DOI":"10.1093\/bioinformatics\/btab083","article-title":"DNABERT: pre-trained bidirectional encoder representations from transformers model for DNA-language in genome","volume":"37","author":"Ji","year":"2021","journal-title":"Bioinformatics"},{"key":"2025012414505250700_btaf004-B13","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1038\/s41586-021-03819-2","article-title":"Highly accurate protein structure prediction with AlphaFold","volume":"596","author":"Jumper","year":"2021","journal-title":"Nature"},{"key":"2025012414505250700_btaf004-B14","doi-asserted-by":"crossref","first-page":"D335","DOI":"10.1093\/nar\/gkx1038","article-title":"Rfam 13.0: shifting to a genome-centric resource for non-coding RNA families","volume":"46","author":"Kalvari","year":"2018","journal-title":"Nucleic Acids Res"},{"key":"2025012414505250700_btaf004-B15","doi-asserted-by":"crossref","first-page":"3341","DOI":"10.1093\/nar\/gkad122","article-title":"RNAJP: enhanced RNA 3D structure predictions with non-canonical interactions and global topology sampling","volume":"51","author":"Li","year":"2023","journal-title":"Nucleic Acids Res"},{"key":"2025012414505250700_btaf004-B16","doi-asserted-by":"crossref","first-page":"4042","DOI":"10.1093\/bioinformatics\/btac426","article-title":"Vfold-Pipeline: a web server for RNA 3D structure prediction from sequences","volume":"38","author":"Li","year":"2022","journal-title":"Bioinformatics"},{"key":"2025012414505250700_btaf004-B17","first-page":"576","article-title":"RNA-Puzzles toolkit: a computational resource of RNA 3D structure benchmark datasets, structure manipulation, and evaluation tools","volume":"48","author":"Magnus","year":"2020","journal-title":"Nucleic Acids Res"},{"key":"2025012414505250700_btaf004-B18","doi-asserted-by":"crossref","first-page":"2722","DOI":"10.1093\/bioinformatics\/btt473","article-title":"lDDT: a local superposition-free score for comparing protein structures and models using distance difference tests","volume":"29","author":"Mariani","year":"2013","journal-title":"Bioinformatics"},{"key":"2025012414505250700_btaf004-B19","doi-asserted-by":"publisher","first-page":"655","DOI":"10.1261\/rna.060368.116","article-title":"RNA-Puzzles round III: 3D RNA structure prediction of five riboswitches and one ribozyme","volume":"23","author":"Miao","year":"2017","journal-title":"RNA"},{"key":"2025012414505250700_btaf004-B20","doi-asserted-by":"publisher","first-page":"982","DOI":"10.1261\/rna.075341.120","article-title":"RNA-Puzzles round IV: 3D structure predictions of four ribozymes and two aptamers","volume":"26","author":"Miao","year":"2020","journal-title":"RNA"},{"key":"2025012414505250700_btaf004-B21","doi-asserted-by":"publisher","first-page":"1066","DOI":"10.1261\/rna.049502.114","article-title":"RNA-Puzzles round II: assessment of RNA structure prediction programs applied to three large RNA structures","volume":"21","author":"Miao","year":"2015","journal-title":"RNA"},{"key":"2025012414505250700_btaf004-B22","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1038\/nature06684","article-title":"The MC-Fold and MC-Sym pipeline infers RNA structure from sequence data","volume":"452","author":"Parisien","year":"2008","journal-title":"Nature"},{"key":"2025012414505250700_btaf004-B23","doi-asserted-by":"crossref","first-page":"1875","DOI":"10.1261\/rna.1700409","article-title":"New metrics for comparing and assessing discrepancies between RNA 3D structures and models","volume":"15","author":"Parisien","year":"2009","journal-title":"RNA (New York, N.Y.)"},{"key":"2025012414505250700_btaf004-B24","doi-asserted-by":"crossref","first-page":"e112","DOI":"10.1093\/nar\/gks339","article-title":"Automated 3D structure composition for large RNAs","volume":"40","author":"Popenda","year":"2012","journal-title":"Nucleic Acids Res"},{"key":"2025012414505250700_btaf004-B25","doi-asserted-by":"publisher","first-page":"1666","DOI":"10.1093\/nar\/gkh333","article-title":"RNA conformational classes","volume":"32","author":"Schneider","year":"2004","journal-title":"Nucleic Acids Res"},{"key":"2025012414505250700_btaf004-B26","doi-asserted-by":"publisher","first-page":"9522","DOI":"10.1093\/nar\/gkad726","article-title":"When will RNA get its AlphaFold moment?","volume":"51","author":"Schneider","year":"2023","journal-title":"Nucleic Acids Res"},{"key":"2025012414505250700_btaf004-B27","author":"Shen","year":"2022"},{"key":"2025012414505250700_btaf004-B28","doi-asserted-by":"crossref","first-page":"2610","DOI":"10.1021\/acs.jcim.1c00153","article-title":"RNA backbone torsion and pseudotorsion angle prediction using dilated convolutional neural networks","volume":"61","author":"Singh","year":"2021","journal-title":"J Chem Inf Model"},{"key":"2025012414505250700_btaf004-B29","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.bpj.2021.11.016","article-title":"rsRNASP: a residue-separation-based statistical potential for RNA 3D structure evaluation","volume":"121","author":"Tan","year":"2022","journal-title":"Biophys J"},{"key":"2025012414505250700_btaf004-B30","doi-asserted-by":"crossref","first-page":"1047","DOI":"10.1126\/science.abe5650","article-title":"Geometric deep learning of RNA structure","volume":"373","author":"Townshend","year":"2021","journal-title":"Science"},{"key":"2025012414505250700_btaf004-B31","doi-asserted-by":"publisher","first-page":"942","DOI":"10.1016\/j.jmb.2007.06.058","article-title":"Evaluating and learning from RNA pseudotorsional space: quantitative validation of a reduced representation for RNA structure","volume":"372","author":"Wadley","year":"2007","journal-title":"J Mol Biol"},{"key":"2025012414505250700_btaf004-B32","doi-asserted-by":"crossref","first-page":"4116","DOI":"10.3390\/ijms20174116","article-title":"3dRNA v2.0: an updated web server for RNA 3D structure prediction","volume":"20","author":"Wang","year":"2019","journal-title":"Int J Mol Sci"},{"key":"2025012414505250700_btaf004-B33","doi-asserted-by":"crossref","first-page":"7266","DOI":"10.1038\/s41467-023-42528-4","article-title":"trRosettaRNA: automated prediction of RNA 3D structure with transformer network","volume":"14","author":"Wang","year":"2023","journal-title":"Nat Commun"},{"key":"2025012414505250700_btaf004-B34","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1186\/s12859-017-1867-6","article-title":"LCS-TA to identify similar fragments in RNA 3D structures","volume":"18","author":"Wiedemann","year":"2017","journal-title":"BMC Bioinformatics"},{"key":"2025012414505250700_btaf004-B35","doi-asserted-by":"crossref","first-page":"1842","DOI":"10.1021\/acs.jctc.0c01148","article-title":"IsRNA1: de novo prediction and blind screening of RNA 3D structures","volume":"17","author":"Zhang","year":"2021","journal-title":"J Chem Theory Comput"},{"key":"2025012414505250700_btaf004-B36","doi-asserted-by":"crossref","first-page":"702","DOI":"10.1002\/prot.20264","article-title":"Scoring function for automated assessment of protein structure template quality","volume":"57","author":"Zhang","year":"2004","journal-title":"Proteins"},{"key":"2025012414505250700_btaf004-B37","doi-asserted-by":"publisher","first-page":"e3","DOI":"10.1093\/nar\/gkad1031","article-title":"Multiple sequence alignment-based RNA language model and its application to structural inference","volume":"52","author":"Zhang","year":"2024","journal-title":"Nucleic Acids Res"},{"key":"2025012414505250700_btaf004-B38","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1007\/s10100-013-0296-5","article-title":"MCQ4Structures to compute similarity of molecule structures","volume":"22","author":"Zok","year":"2014","journal-title":"Cent Eur J Oper Res"},{"key":"2025012414505250700_btaf004-B39","doi-asserted-by":"publisher","first-page":"689","DOI":"10.1515\/amcs-2015-0050","article-title":"Building the library of rna 3D nucleotide conformations using the clustering approach","volume":"25","author":"Zok","year":"2015","journal-title":"Int J Appl Math Comput Sci"},{"key":"2025012414505250700_btaf004-B40","doi-asserted-by":"publisher","first-page":"W30","DOI":"10.1093\/nar\/gky314","article-title":"RNApdbee 2.0: multifunctional tool for RNA structure annotation","volume":"46","author":"Zok","year":"2018","journal-title":"Nucleic Acids Res"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btaf004\/61381586\/btaf004.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/41\/1\/btaf004\/61381586\/btaf004.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/41\/1\/btaf004\/61381586\/btaf004.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,24]],"date-time":"2025-01-24T09:51:07Z","timestamp":1737712267000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/doi\/10.1093\/bioinformatics\/btaf004\/7945663"}},"subtitle":[],"editor":[{"given":"Jianlin","family":"Cheng","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2024,12,26]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,12,26]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btaf004","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2024.06.06.597803","asserted-by":"object"}]},"ISSN":["1367-4811"],"issn-type":[{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2025,1]]},"published":{"date-parts":[[2024,12,26]]},"article-number":"btaf004"}}