{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T21:06:35Z","timestamp":1774386395910,"version":"3.50.1"},"reference-count":53,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T00:00:00Z","timestamp":1678838400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["11601324"],"award-info":[{"award-number":["11601324"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>As the most abundant RNA methylation modification, N6-methyladenosine (m6A) could regulate asymmetric and symmetric division of hematopoietic stem cells and play an important role in various diseases. Therefore, the precise identification of m6A sites around the genomes of different species is a critical step to further revealing their biological functions and influence on these diseases. However, the traditional wet-lab experimental methods for identifying m6A sites are often laborious and expensive. In this study, we proposed an ensemble deep learning model called m6A-BERT-Stacking, a powerful predictor for the detection of m6A sites in various tissues of three species. First, we utilized two encoding methods, i.e., di ribonucleotide index of RNA (DiNUCindex_RNA) and k-mer word segmentation, to extract RNA sequence features. Second, two encoding matrices together with the original sequences were respectively input into three different deep learning models in parallel to train three sub-models, namely residual networks with convolutional block attention module (Resnet-CBAM), bidirectional long short-term memory with attention (BiLSTM-Attention), and pre-trained bidirectional encoder representations from transformers model for DNA-language (DNABERT). Finally, the outputs of all sub-models were ensembled based on the stacking strategy to obtain the final prediction of m6A sites through the fully connected layer. The experimental results demonstrated that m6A-BERT-Stacking outperformed most of the existing methods based on the same independent datasets.<\/jats:p>","DOI":"10.3390\/sym15030731","type":"journal-article","created":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T06:36:36Z","timestamp":1678862196000},"page":"731","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["M6A-BERT-Stacking: A Tissue-Specific Predictor for Identifying RNA N6-Methyladenosine Sites Based on BERT and Stacking Strategy"],"prefix":"10.3390","volume":"15","author":[{"given":"Qianyue","family":"Li","sequence":"first","affiliation":[{"name":"College of Information Technology, Shanghai Ocean University, Shanghai 201306, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xin","family":"Cheng","sequence":"additional","affiliation":[{"name":"College of Marine Sciences, Shanghai Ocean University, Shanghai 201306, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chen","family":"Song","sequence":"additional","affiliation":[{"name":"College of Information Technology, Shanghai Ocean University, Shanghai 201306, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8449-9667","authenticated-orcid":false,"given":"Taigang","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Information Technology, Shanghai Ocean University, Shanghai 201306, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1038\/s12276-020-0407-z","article-title":"The emerging role of RNA modifications in the regulation of mRNA stability","volume":"52","author":"Boo","year":"2020","journal-title":"Exp. Mol. Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"D231","DOI":"10.1093\/nar\/gkab1083","article-title":"MODOMICS: A database of RNA modification pathways. 2021 update","volume":"50","author":"Boccaletto","year":"2022","journal-title":"Nucleic Acids Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e105977","DOI":"10.15252\/embj.2020105977","article-title":"m6A RNA methylation: From mechanisms to therapeutic potential","volume":"40","author":"He","year":"2021","journal-title":"Embo J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1186\/s12943-019-1109-9","article-title":"Functions of N6-methyladenosine and its role in cancer","volume":"18","author":"He","year":"2019","journal-title":"Mol. Cancer"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1703","DOI":"10.1016\/j.celrep.2019.07.032","article-title":"m6A RNA Methylation Maintains Hematopoietic Stem Cell Identity and Symmetric Commitment","volume":"28","author":"Cheng","year":"2019","journal-title":"Cell Rep."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"e41","DOI":"10.1093\/nar\/gkz074","article-title":"WHISTLE: A high-accuracy map of the human N6-methyladenosine (m6A) epitranscriptome predicted using a machine learning approach","volume":"47","author":"Chen","year":"2019","journal-title":"Nucleic Acids Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1635","DOI":"10.1016\/j.cell.2012.05.003","article-title":"Comprehensive Analysis of mRNA Methylation Reveals Enrichment in 3 \u2018 UTRs and near Stop Codons","volume":"149","author":"Meyer","year":"2012","journal-title":"Cell"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1038\/nature11112","article-title":"Topology of the human and mouse m6A RNA methylomes revealed by m6A-seq","volume":"485","author":"Dominissini","year":"2012","journal-title":"Nature"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1587","DOI":"10.1002\/anie.201410647","article-title":"High-Resolution N6-Methyladenosine (m6A) Map Using Photo-Crosslinking-Assisted m6A Sequencing","volume":"54","author":"Chen","year":"2015","journal-title":"Angew. Chem. Int. Ed."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"767","DOI":"10.1038\/nmeth.3453","article-title":"Single-nucleotide-resolution mapping of m6A and m6Am throughout the transcriptome","volume":"12","author":"Linder","year":"2015","journal-title":"Nat. Methods"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"e91","DOI":"10.1093\/nar\/gkw104","article-title":"SRAMP: Prediction of mammalian N6-methyladenosine (m6A) sites based on sequence-derived features","volume":"44","author":"Zhou","year":"2016","journal-title":"Nucleic Acids Res."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.ab.2015.08.021","article-title":"iRNA-Methyl: Identifying N6-methyladenosine sites using pseudo nucleotide composition","volume":"490","author":"Chen","year":"2015","journal-title":"Anal. Biochem."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"674","DOI":"10.1109\/TNB.2016.2599115","article-title":"TargetM6A: Identifying N6-Methyladenosine Sites From RNA Sequences via Position-Specific Nucleotide Propensities and a Support Vector Machine","volume":"15","author":"Li","year":"2016","journal-title":"IEEE Trans. Nanobioscience"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"40242","DOI":"10.1038\/srep40242","article-title":"Detecting N6-methyladenosine sites from RNA transcriptomes using ensemble Support Vector Machines","volume":"7","author":"Chen","year":"2017","journal-title":"Sci. Rep."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1007\/s11103-018-0698-9","article-title":"RFAthM6A: A new tool for predicting m6A sites in Arabidopsis thaliana","volume":"96","author":"Wang","year":"2018","journal-title":"Plant Mol. Biol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1016\/j.omtn.2018.07.004","article-title":"M6APred-EL: A Sequence-Based Predictor for Identifying N6-methyladenosine Sites Using Ensemble Learning","volume":"12","author":"Wei","year":"2018","journal-title":"Mol. Ther. Nucleic Acids"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.jtbi.2019.01.035","article-title":"Identifying N6-methyladenosine sites using extreme gradient boosting system optimized by particle swarm optimizer","volume":"467","author":"Zhao","year":"2019","journal-title":"J. Theor. Biol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"26","DOI":"10.2174\/1389202921666200219125625","article-title":"Extremely-randomized-tree-based Prediction of N6-Methyladenosine Sites in Saccharomyces cerevisiae","volume":"21","author":"Govindaraj","year":"2020","journal-title":"Curr. Genom."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1080\/07391102.2020.1821778","article-title":"Using Chou\u2019s 5-steps rule to identify N6-methyladenine sites by ensemble learning combined with multiple feature extraction methods","volume":"40","author":"Zhang","year":"2022","journal-title":"J. Biomol. Struct. Dyn."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Luo, Z., Lou, L., Qiu, W., Xu, Z., and Xiao, X. (2022). Predicting N6-Methyladenosine Sites in Multiple Tissues of Mammals through Ensemble Deep Learning. Int. J. Mol. Sci., 23.","DOI":"10.3390\/ijms232415490"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, L., Qin, X., Liu, M., Xu, Z., and Liu, G. (2021). DNN-m6A: A Cross-Species Method for Identifying RNA N6-methyladenosine Sites Based on Deep Neural Network with Multi-Information Fusion. Genes, 12.","DOI":"10.3390\/genes12030354"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1261\/rna.069112.118","article-title":"Gene2vec: Gene subsequence embedding for prediction of mammalian N6-methyladenosine sites from mRNA","volume":"25","author":"Zou","year":"2019","journal-title":"Rna"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"103811","DOI":"10.1016\/j.chemolab.2019.103811","article-title":"iN6-Methyl (5-step): Identifying RNA N6-methyladenosine sites using deep learning mode via Chou\u2019s 5-step rules and Chou\u2019s general PseKNC","volume":"193","author":"Nazari","year":"2019","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1016\/j.neunet.2020.05.027","article-title":"Prediction of N6-methyladenosine sites using convolution neural network model based on distributed feature representations","volume":"129","author":"Tahir","year":"2020","journal-title":"Neural Netw."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"999506","DOI":"10.3389\/fmicb.2022.999506","article-title":"MTDeepM6A-2S: A two-stage multi-task deep learning method for predicting RNA N6-methyladenosine sites of Saccharomyces cerevisiae","volume":"13","author":"Wang","year":"2022","journal-title":"Front. Microbiol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1016\/j.ymeth.2022.03.001","article-title":"A brief review of machine learning methods for RNA methylation sites prediction","volume":"203","author":"Wang","year":"2022","journal-title":"Methods"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1676","DOI":"10.1093\/bib\/bbz112","article-title":"Comprehensive review and assessment of computational methods for predicting RNA post-transcriptional modification sites from RNA sequences","volume":"21","author":"Chen","year":"2020","journal-title":"Brief. Bioinform."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"104495","DOI":"10.1016\/j.chemolab.2022.104495","article-title":"StackRAM: A cross-species method for identifying RNA N6-methyladenosine sites based on stacked ensemble","volume":"222","author":"Zhang","year":"2022","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"17779","DOI":"10.1109\/ACCESS.2021.3054361","article-title":"m6A-NeuralTool: Convolution Neural Tool for RNA N6-Methyladenosine Site Identification in Different Species","volume":"9","author":"Rehman","year":"2021","journal-title":"IEEE Access"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4619","DOI":"10.1016\/j.csbj.2021.08.014","article-title":"TS-m6A-DL: Tissue-specific identification of N6-methyladenosine sites using a universal deep learning model","volume":"19","author":"Abbas","year":"2021","journal-title":"Comput. Struct. Biotechnol. J."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1044","DOI":"10.1016\/j.omtn.2020.07.034","article-title":"im6A-TS-CNN: Identifying the N6-Methyladenine Site in Multiple Tissues by Using the Convolutional Neural Network","volume":"21","author":"Liu","year":"2020","journal-title":"Mol. Ther. Nucleic Acids"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1084","DOI":"10.1016\/j.csbj.2020.04.015","article-title":"Computational identification of N6-methyladenosine sites in multiple tissues of mammals","volume":"18","author":"Dao","year":"2020","journal-title":"Comput. Struct. Biotechnol. J."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"495","DOI":"10.3389\/fgene.2018.00495","article-title":"M6AMRFS: Robust Prediction of N6-Methyladenosine Sites With Sequence-Based Features in Multiple Species","volume":"9","author":"Qiang","year":"2018","journal-title":"Front. Genet."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1669","DOI":"10.7150\/ijbs.27819","article-title":"BERMP: A cross-species classifier for predicting m6A sites by integrating a deep learning algorithm and a random forest approach","volume":"14","author":"Huang","year":"2018","journal-title":"Int. J. Biol. Sci."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1105","DOI":"10.32604\/biocell.2022.016655","article-title":"Tissue specific prediction of N6-methyladenine sites based on an ensemble of multi-input hybrid neural network","volume":"46","author":"Jia","year":"2022","journal-title":"Biocell"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"842","DOI":"10.1162\/tacl_a_00349","article-title":"A Primer in BERTology: What We Know About How BERT Works","volume":"8","author":"Rogers","year":"2020","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_37","unstructured":"Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2112","DOI":"10.1093\/bioinformatics\/btab083","article-title":"DNABERT: Pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome","volume":"37","author":"Ji","year":"2021","journal-title":"Bioinformatics"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Wang, Y., Hou, Z., Yang, Y., Wong, K.-C., and Li, X. (2022). Genome-wide identification and characterization of DNA enhancers with a stacked multivariate fusion framework. PLoS Comput. Biol., 18.","DOI":"10.1371\/journal.pcbi.1010779"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1186\/s13059-022-02780-1","article-title":"iDNA-ABF: Multi-scale deep biological language learning model for the interpretable prediction of DNA methylations","volume":"23","author":"Jin","year":"2022","journal-title":"Genome Biol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"vbac023","DOI":"10.1093\/bioadv\/vbac023","article-title":"Prediction of RNA-protein interactions using a nucleotide language model","volume":"2","author":"Yamada","year":"2022","journal-title":"Bioinform. Adv."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1658","DOI":"10.1093\/bioinformatics\/btl158","article-title":"Cd-hit: A fast program for clustering and comparing large sets of protein or nucleotide sequences","volume":"22","author":"Li","year":"2006","journal-title":"Bioinformatics"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"bbac108","DOI":"10.1093\/bib\/bbac108","article-title":"A tool for feature extraction from biological sequences","volume":"23","author":"Amerifar","year":"2022","journal-title":"Brief. Bioinform."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"e10813","DOI":"10.7717\/peerj.10813","article-title":"6mA-Pred: Identifying DNA N6-methyladenine sites based on deep learning","volume":"9","author":"Huang","year":"2021","journal-title":"PeerJ"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"D37","DOI":"10.1093\/nar\/gkn597","article-title":"DiProDB: A database for dinucleotide properties","volume":"37","author":"Friedel","year":"2009","journal-title":"Nucleic Acids Res."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"bbaa284","DOI":"10.1093\/bib\/bbaa284","article-title":"KNIndex: A comprehensive database of physicochemical properties for k-tuple nucleotides","volume":"22","author":"Zhang","year":"2021","journal-title":"Brief. Bioinform."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"He, K.M., Zhang, X.Y., Ren, S.Q., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Woo, S.H., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8\u201314). CBAM: Convolutional block attention module. Proceedings of the 15th European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"5929","DOI":"10.1007\/s10462-020-09838-1","article-title":"A review on the long short-term memory model","volume":"53","author":"Mosquera","year":"2020","journal-title":"Artif. Intell. Rev."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"2673","DOI":"10.1109\/78.650093","article-title":"Bidirectional recurrent neural networks","volume":"45","author":"Schuster","year":"1997","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Zhou, P., Shi, W., Tian, J., Qi, Z.Y., Li, B.C., Hao, H.W., and Xu, B. (2016, January 7\u201312). Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification. Proceedings of the 54th Annual Meeting of the Association-for-Computational-Linguistics (ACL), Berlin, Germany.","DOI":"10.18653\/v1\/P16-2034"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"5789","DOI":"10.1007\/s10462-021-09958-2","article-title":"Transformer models for text-based emotion detection: A review of BERT-based approaches","volume":"54","author":"Acheampong","year":"2021","journal-title":"Artif. Intell. Rev."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1536","DOI":"10.1093\/bioinformatics\/btl151","article-title":"Two Sample Logo: A graphical representation of the differences between two sets of sequence alignments","volume":"22","author":"Vacic","year":"2006","journal-title":"Bioinformatics"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/15\/3\/731\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:55:27Z","timestamp":1760122527000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/15\/3\/731"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,15]]},"references-count":53,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["sym15030731"],"URL":"https:\/\/doi.org\/10.3390\/sym15030731","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,15]]}}}