{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,23]],"date-time":"2026-06-23T17:44:25Z","timestamp":1782236665247,"version":"3.54.5"},"reference-count":41,"publisher":"Oxford University Press (OUP)","issue":"11","license":[{"start":{"date-parts":[[2024,10,26]],"date-time":"2024-10-26T00:00:00Z","timestamp":1729900800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005153","name":"China National Funds for Distinguished Young Scientists","doi-asserted-by":"publisher","award":["62225109"],"award-info":[{"award-number":["62225109"]}],"id":[{"id":"10.13039\/501100005153","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62372098"],"award-info":[{"award-number":["62372098"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62302315"],"award-info":[{"award-number":["62302315"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62231013"],"award-info":[{"award-number":["62231013"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>Recent advancements in high-throughput sequencing technology have significantly increased the focus on non-coding RNA (ncRNA) research within the life sciences. Despite this, the functions of many ncRNAs remain poorly understood. Research suggests that ncRNAs within the same family typically share similar functions, underlining the importance of understanding their roles. There are two primary methods for predicting ncRNA families: biological and computational. Traditional biological methods are not suitable for large-scale data prediction due to the significant human and resource requirements. Concurrently, most existing computational methods either rely solely on ncRNA sequence data or are exclusively based on the secondary structure of ncRNA molecules. These methods fail to fully utilize the rich multimodal information available from ncRNAs, thereby preventing them from learning more comprehensive and in-depth feature representations.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>To tackle these problems, we proposed MM-ncRNAFP, a multi-modal contrastive learning framework for ncRNA family prediction. We first used a pre-trained language model to encode the primary sequences of a large mammalian ncRNA dataset. Then, we adopted a contrastive learning framework with an attention mechanism to fuse the secondary structure information obtained by graph neural networks. The MM-ncRNAFP method can effectively fuse multi-modal information. Experimental comparisons with several competitive baselines demonstrated that MM-ncRNAFP can achieve more comprehensive representations of ncRNA features by integrating both sequence and structural information. This integration significantly enhances the performance of ncRNA family prediction. Ablation experiments and qualitative analyses were performed to verify the effectiveness of each component in our model. Moreover, since our model is pre-trained on a large amount of ncRNA data, it has the potential to bring significant improvements to other ncRNA-related tasks.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Availability and implementation<\/jats:title>\n                  <jats:p>MM-ncRNAFP and the datasets are available at https:\/\/github.com\/xuruiting2\/MM-ncRNAFP.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btae640","type":"journal-article","created":{"date-parts":[[2024,10,26]],"date-time":"2024-10-26T16:44:27Z","timestamp":1729961067000},"source":"Crossref","is-referenced-by-count":2,"title":["Improving ncRNA family prediction using multi-modal contrastive learning of sequence and structure"],"prefix":"10.1093","volume":"40","author":[{"given":"Ruiting","family":"Xu","sequence":"first","affiliation":[{"name":"College of Computer and Control Engineering, Northeast Forestry University , Harbin 150040,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dan","family":"Li","sequence":"additional","affiliation":[{"name":"College of Computer and Control Engineering, Northeast Forestry University , Harbin 150040,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wen","family":"Yang","sequence":"additional","affiliation":[{"name":"International Medical Center, Shenzhen University General Hospital, SZU 518055, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7381-2374","authenticated-orcid":false,"given":"Guohua","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Computer and Control Engineering, Northeast Forestry University , Harbin 150040,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0403-7287","authenticated-orcid":false,"given":"Yang","family":"Li","sequence":"additional","affiliation":[{"name":"College of Computer and Control Engineering, Northeast Forestry University , Harbin 150040,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2024,10,26]]},"reference":[{"key":"2024111117062574100_btae640-B1","doi-asserted-by":"crossref","first-page":"1304","DOI":"10.1093\/bioinformatics\/btx783","article-title":"New algorithms to represent complex pseudoknotted RNA structures in dot-bracket notation","volume":"34","author":"Antczak","year":"2018","journal-title":"Bioinformatics"},{"key":"2024111117062574100_btae640-B2","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1186\/s11658-018-0111-3","article-title":"Editorial focus: entering into the non-coding RNA era","volume":"23","author":"Bartoszewski","year":"2018","journal-title":"Cell Mol Biol Lett"},{"key":"2024111117062574100_btae640-B3","doi-asserted-by":"crossref","first-page":"e202009045","DOI":"10.1083\/jcb.202009045","article-title":"Lnccation: lncRNA localization and function","volume":"220","author":"Bridges","year":"2021","journal-title":"J Cell Biol"},{"key":"2024111117062574100_btae640-B4","doi-asserted-by":"crossref","first-page":"107364","DOI":"10.1016\/j.compbiolchem.2020.107364","article-title":"ncrdeep: non-coding RNA classification with convolutional neural network","volume":"88","author":"Chantsalnyam","year":"2020","journal-title":"Comput Biol Chem"},{"key":"2024111117062574100_btae640-B5","doi-asserted-by":"crossref","first-page":"bbad303","DOI":"10.1093\/bib\/bbad303","article-title":"Mfpred: prediction of ncRNA families based on multi-feature fusion","volume":"24","author":"Chen","year":"2023","journal-title":"Brief Bioinform"},{"key":"2024111117062574100_btae640-B6","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1186\/s12859-023-05191-6","article-title":"ncdense: a novel computational method based on a deep learning framework for non-coding RNAs family prediction","volume":"24","author":"Chen","year":"2023","journal-title":"BMC Bioinformatics"},{"key":"2024111117062574100_btae640-B7","doi-asserted-by":"crossref","first-page":"R108","DOI":"10.1186\/gb-2009-10-10-r108","article-title":"Genomic DNA k-mer spectra: models and modalities","volume":"10","author":"Chor","year":"2009","journal-title":"Genome Biol"},{"key":"2024111117062574100_btae640-B8","doi-asserted-by":"crossref","first-page":"599","DOI":"10.1002\/bies.200900112","article-title":"Non-coding RNAs: meet thy masters","volume":"32","author":"Costa","year":"2010","journal-title":"Bioessays"},{"key":"2024111117062574100_btae640-B9","author":"Creux","year":"2023"},{"key":"2024111117062574100_btae640-B10","doi-asserted-by":"crossref","first-page":"118702","DOI":"10.1088\/1674-1056\/ac8ce3","article-title":"Rnagcn: RNA tertiary structure assessment with a graph convolutional network","volume":"31","author":"Deng","year":"2022","journal-title":"Chinese Phys B"},{"key":"2024111117062574100_btae640-B11","doi-asserted-by":"crossref","first-page":"1377","DOI":"10.1101\/gr.247239.118","article-title":"Decrypting noncoding RNA interactions, structures, and functional networks","volume":"29","author":"Fabbri","year":"2019","journal-title":"Genome Res"},{"key":"2024111117062574100_btae640-B12","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1186\/s13040-017-0148-2","article-title":"nrc: non-coding RNA classifier based on structural features","volume":"10","author":"Fiannaca","year":"2017","journal-title":"BioData Min"},{"key":"2024111117062574100_btae640-B13","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1093\/nsr\/nwu008","article-title":"Non-coding RNA: a new frontier in regulatory biology","volume":"1","author":"Fu","year":"2014","journal-title":"Natl Sci Rev"},{"key":"2024111117062574100_btae640-B14","doi-asserted-by":"crossref","first-page":"D136","DOI":"10.1093\/nar\/gkn766","article-title":"Rfam: updates to the RNA families database","volume":"37","author":"Gardner","year":"2009","journal-title":"Nucleic Acids Res"},{"key":"2024111117062574100_btae640-B15","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/j.aiopen.2021.08.002","article-title":"Pre-trained models: past, present and future","volume":"2","author":"Han","year":"2021","journal-title":"AI Open"},{"key":"2024111117062574100_btae640-B16","doi-asserted-by":"crossref","first-page":"2923","DOI":"10.3390\/ijms25052923","article-title":"Subverting the canon: novel cancer-promoting functions and mechanisms for snornas","volume":"25","author":"Huo","year":"2024","journal-title":"Int J Mol Sci"},{"key":"2024111117062574100_btae640-B17","doi-asserted-by":"crossref","first-page":"2112","DOI":"10.1093\/bioinformatics\/btab083","article-title":"DNABert: pre-trained bidirectional encoder representations from transformers model for DNA-language in genome","volume":"37","author":"Ji","year":"2021","journal-title":"Bioinformatics"},{"key":"2024111117062574100_btae640-B18","doi-asserted-by":"crossref","first-page":"D28","DOI":"10.1093\/nar\/gkq967","article-title":"The European nucleotide archive","volume":"39","author":"Leinonen","year":"2011","journal-title":"Nucleic Acids Res"},{"key":"2024111117062574100_btae640-B19","doi-asserted-by":"crossref","first-page":"bbad118","DOI":"10.1093\/bib\/bbad118","article-title":"End-to-end interpretable disease\u2013gene association prediction","volume":"24","author":"Li","year":"2023","journal-title":"Brief Bioinform"},{"key":"2024111117062574100_btae640-B20","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1109\/TCBB.2021.3131136","article-title":"Ncypred: a bidirectional LSTM network with attention for y RNA and short non-coding RNA classification","volume":"20","author":"Lima","year":"2023","journal-title":"IEEE\/ACM Trans Comput Biol Bioinform"},{"key":"2024111117062574100_btae640-B21","author":"Liu","year":"2013"},{"key":"2024111117062574100_btae640-B22","doi-asserted-by":"crossref","first-page":"R17","DOI":"10.1093\/hmg\/ddl046","article-title":"Non-coding RNA","volume":"15","author":"Mattick","year":"2006","journal-title":"Hum Mol Genet"},{"key":"2024111117062574100_btae640-B23","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1186\/s12859-020-03870-2","article-title":"Plncrna-hdeep: plant long noncoding RNA prediction using hybrid deep learning based on two encoding styles","volume":"22","author":"Meng","year":"2021","journal-title":"BMC Bioinformatics"},{"key":"2024111117062574100_btae640-B24","doi-asserted-by":"crossref","first-page":"2642","DOI":"10.1093\/bioinformatics\/btx295","article-title":"An efficient graph kernel method for non-coding RNA functional prediction","volume":"33","author":"Navarin","year":"2017","journal-title":"Bioinformatics"},{"key":"2024111117062574100_btae640-B25","doi-asserted-by":"crossref","first-page":"e1008415","DOI":"10.1371\/journal.pcbi.1008415","article-title":"Deep learning predicts short non-coding RNA functions from only raw sequence data","volume":"16","author":"Noviello","year":"2020","journal-title":"PLoS Comput Biol"},{"key":"2024111117062574100_btae640-B26","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1016\/j.cell.2009.02.006","article-title":"Evolution and functions of long noncoding RNAs","volume":"136","author":"Ponting","year":"2009","journal-title":"Cell"},{"key":"2024111117062574100_btae640-B27","doi-asserted-by":"crossref","first-page":"D877","DOI":"10.1093\/nar\/gkw1012","article-title":"Malacards: an amalgamated human disease compendium with diverse clinical and genetic annotation and structured search","volume":"45","author":"Rappaport","year":"2017","journal-title":"Nucleic Acids Res"},{"key":"2024111117062574100_btae640-B28","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1186\/1471-2105-11-129","article-title":"Rnastructure: software for RNA secondary structure prediction and analysis","volume":"11","author":"Reuter","year":"2010","journal-title":"BMC Bioinformatics"},{"key":"2024111117062574100_btae640-B29","doi-asserted-by":"crossref","first-page":"baq020","DOI":"10.1093\/database\/baq020","article-title":"Genecards version 3: the human gene integrator","volume":"2010","author":"Safran","year":"2010","journal-title":"Database"},{"key":"2024111117062574100_btae640-B30","first-page":"55","article-title":"Roles of non-coding RNAs in transcriptional regulation","volume":"55","author":"Srijyothi","year":"2018","journal-title":"Transcript Post Transcriptional Regul"},{"key":"2024111117062574100_btae640-B31","doi-asserted-by":"crossref","first-page":"901","DOI":"10.1007\/s00018-005-5558-5","article-title":"Hairpin RNA: a secondary structure of primary importance","volume":"63","author":"Svoboda","year":"2006","journal-title":"Cell Mol Life Sci"},{"key":"2024111117062574100_btae640-B32","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Van der Maaten","year":"2008","journal-title":"J Mach Learn Res"},{"key":"2024111117062574100_btae640-B33","doi-asserted-by":"crossref","first-page":"1972","DOI":"10.1093\/bib\/bby062","article-title":"A review of metrics measuring dissimilarity for rooted phylogenetic networks","volume":"20","author":"Wang","year":"2019","journal-title":"Brief Bioinform"},{"key":"2024111117062574100_btae640-B34","doi-asserted-by":"crossref","first-page":"2269","DOI":"10.1093\/bioinformatics\/btt378","article-title":"Lnetwork: an efficient and effective method for constructing phylogenetic networks","volume":"29","author":"Wang","year":"2013","journal-title":"Bioinformatics"},{"key":"2024111117062574100_btae640-B74906183","doi-asserted-by":"crossref","first-page":"784","DOI":"10.1109\/TCBB.2020.2982873","article-title":"ncRFP: A novel end-TO-end method for non-coding rnas family prediction based on deep learning","volume":"18","author":"Wang","year":"2021","journal-title":"IEEE\/ACM Trans Comput Biol and Bioinf"},{"key":"2024111117062574100_btae640-B35","doi-asserted-by":"crossref","first-page":"784","DOI":"10.1109\/TCBB.2020.2982873","article-title":"ncrfp: a novel end-to-end method for non-coding RNAs family prediction based on deep learning","volume":"18","author":"Wang","year":"2021","journal-title":"IEEE\/ACM Trans Comput Biol Bioinform"},{"key":"2024111117062574100_btae640-B36","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1186\/s12859-021-04365-4","article-title":"ncdlres: a novel method for non-coding RNAs family prediction based on dynamic LSTM and RESNET","volume":"22","author":"Wang","year":"2021","journal-title":"BMC Bioinformatics"},{"key":"2024111117062574100_btae640-B37","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1038\/nrg2484","article-title":"RNA-seq: a revolutionary tool for transcriptomics","volume":"10","author":"Wang","year":"2009","journal-title":"Nat Rev Genet"},{"key":"2024111117062574100_btae640-B38","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.ygeno.2015.12.002","article-title":"Non-coding RNA identification based on topology secondary structure and reading frame in organelle genome level","volume":"107","author":"Wu","year":"2016","journal-title":"Genomics"},{"key":"2024111117062574100_btae640-B39","first-page":"5453","author":"Xu","year":"2018"},{"key":"2024111117062574100_btae640-B40","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1111\/cla.12578","article-title":"Psa: an effective method for predicting horizontal gene transfers through parsimonious phylogenetic networks","volume":"40","author":"Zhang","year":"2024","journal-title":"Cladistics"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btae640\/60129234\/btae640.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/40\/11\/btae640\/60592579\/btae640.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/40\/11\/btae640\/60592579\/btae640.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,11]],"date-time":"2024-11-11T17:06:48Z","timestamp":1731344808000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/doi\/10.1093\/bioinformatics\/btae640\/7845258"}},"subtitle":[],"editor":[{"given":"Jonathan","family":"Wren","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2024,10,26]]},"references-count":41,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2024,11,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btae640","relation":{},"ISSN":["1367-4811"],"issn-type":[{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,11]]},"published":{"date-parts":[[2024,10,26]]},"article-number":"btae640"}}