{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T04:31:02Z","timestamp":1776400262225,"version":"3.51.2"},"reference-count":50,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2022,8,17]],"date-time":"2022-08-17T00:00:00Z","timestamp":1660694400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2017YFC0909400"],"award-info":[{"award-number":["2017YFC0909400"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Nature Science Foundation of China","award":["81630010"],"award-info":[{"award-number":["81630010"]}]},{"name":"Nature Science Foundation of China","award":["91839302"],"award-info":[{"award-number":["91839302"]}]},{"name":"Nature Science Foundation of China","award":["81700413"],"award-info":[{"award-number":["81700413"]}]},{"name":"Nature Science Foundation of China","award":["81873506"],"award-info":[{"award-number":["81873506"]}]},{"name":"Shanghai Municipal Science and Technology Major Project","award":["2017SHZDZX01"],"award-info":[{"award-number":["2017SHZDZX01"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["2015ZDTD044"],"award-info":[{"award-number":["2015ZDTD044"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,9,20]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>A critical challenge in genetic diagnostics is the assessment of genetic variants associated with diseases, specifically variants that fall out with canonical splice sites, by altering alternative splicing. Several computational methods have been developed to prioritize variants effect on splicing; however, performance evaluation of these methods is hampered by the lack of large-scale benchmark datasets. In this study, we employed a splicing-region-specific strategy to evaluate the performance of prediction methods based on eight independent datasets. Under most conditions, we found that dbscSNV-ADA performed better in the exonic region, S-CAP performed better in the core donor and acceptor regions, S-CAP and SpliceAI performed better in the extended acceptor region and MMSplice performed better in identifying variants that caused exon skipping. However, it should be noted that the performances of prediction methods varied widely under different datasets and splicing regions, and none of these methods showed the best overall performance with all datasets. To address this, we developed a new method, machine learning-based classification of splice sites variants (MLCsplice), to predict variants effect on splicing based on individual methods. We demonstrated that MLCsplice achieved stable and superior prediction performance compared with any individual method. To facilitate the identification of the splicing effect of variants, we provided precomputed MLCsplice scores for all possible splice sites variants across human protein-coding genes (http:\/\/39.105.51.3:8090\/MLCsplice\/). We believe that the performance of different individual methods under eight benchmark datasets will provide tentative guidance for appropriate method selection to prioritize candidate splice-disrupting variants, thereby increasing the genetic diagnostic yield.<\/jats:p>","DOI":"10.1093\/bib\/bbac334","type":"journal-article","created":{"date-parts":[[2022,8,17]],"date-time":"2022-08-17T13:08:23Z","timestamp":1660741703000},"source":"Crossref","is-referenced-by-count":10,"title":["Performance evaluation of computational methods for splice-disrupting variants and improving the performance using the machine learning-based framework"],"prefix":"10.1093","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5294-2970","authenticated-orcid":false,"given":"Hao","family":"Liu","sequence":"first","affiliation":[{"name":"Division of Cardiology, Department of Internal Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology and Hubei Key Laboratory of Genetics and Molecular Mechanisms of Cardiological Disorders , Wuhan 430030 , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiaqi","family":"Dai","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Department of Internal Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology and Hubei Key Laboratory of Genetics and Molecular Mechanisms of Cardiological Disorders , Wuhan 430030 , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ke","family":"Li","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Department of Internal Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology and Hubei Key Laboratory of Genetics and Molecular Mechanisms of Cardiological Disorders , Wuhan 430030 , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yang","family":"Sun","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Department of Internal Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology and Hubei Key Laboratory of Genetics and Molecular Mechanisms of Cardiological Disorders , Wuhan 430030 , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haoran","family":"Wei","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Department of Internal Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology and Hubei Key Laboratory of Genetics and Molecular Mechanisms of Cardiological Disorders , Wuhan 430030 , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hong","family":"Wang","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Department of Internal Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology and Hubei Key Laboratory of Genetics and Molecular Mechanisms of Cardiological Disorders , Wuhan 430030 , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chunxia","family":"Zhao","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Department of Internal Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology and Hubei Key Laboratory of Genetics and Molecular Mechanisms of Cardiological Disorders , Wuhan 430030 , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dao Wen","family":"Wang","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Department of Internal Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology and Hubei Key Laboratory of Genetics and Molecular Mechanisms of Cardiological Disorders , Wuhan 430030 , China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2022,8,17]]},"reference":[{"issue":"8","key":"2022092013230962000_ref1","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1038\/s41576-019-0127-1","article-title":"Benefits and limitations of genome-wide association studies","volume":"20","author":"Tam","year":"2019","journal-title":"Nat Rev Genet"},{"issue":"15","key":"2022092013230962000_ref2","doi-asserted-by":"crossref","first-page":"7793","DOI":"10.1093\/nar\/gky678","article-title":"Performance evaluation of pathogenicity-computation methods for missense variants","volume":"46","author":"Li","year":"2018","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"2022092013230962000_ref3","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/j.molcel.2018.10.037","article-title":"A multiplexed assay for exon recognition reveals that an unappreciated fraction of rare genetic variants cause large-effect splicing disruptions","volume":"73","author":"Cheung","year":"2019","journal-title":"Mol Cell"},{"issue":"6","key":"2022092013230962000_ref4","doi-asserted-by":"crossref","first-page":"848","DOI":"10.1038\/ng.3837","article-title":"Pathogenic variants that alter protein code often disrupt splicing","volume":"49","author":"Soemedi","year":"2017","journal-title":"Nat Genet"},{"issue":"386","key":"2022092013230962000_ref5","doi-asserted-by":"crossref","first-page":"eaal5209","DOI":"10.1126\/scitranslmed.aal5209","article-title":"Improving genetic diagnosis in Mendelian disease with transcriptome sequencing","volume":"9","author":"Cummings","year":"2017","journal-title":"Sci Transl Med"},{"issue":"1","key":"2022092013230962000_ref6","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1016\/j.gim.2021.09.001","article-title":"Standardized practices for RNA diagnostics using clinically accessible specimens reclassifies 75% of putative splicing variants","volume":"24","author":"Bournazos","year":"2022","journal-title":"Genet Med"},{"issue":"10","key":"2022092013230962000_ref7","doi-asserted-by":"crossref","first-page":"1197","DOI":"10.1007\/s00439-020-02199-3","article-title":"The human gene mutation database (HGMD\u00ae): optimizing its use in a clinical diagnostic or research setting","volume":"139","author":"Stenson","year":"2020","journal-title":"Hum Genet"},{"issue":"5","key":"2022092013230962000_ref8","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1038\/gim.2015.30","article-title":"Standards and guidelines for the interpretation of sequence variants: a joint consensus recommendation of the American College of Medical Genetics and Genomics and the Association for Molecular Pathology","volume":"17","author":"Richards","year":"2015","journal-title":"Genet Med"},{"issue":"1","key":"2022092013230962000_ref9","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.ajhg.2017.11.002","article-title":"The expanding landscape of alternative splicing variation in human populations","volume":"102","author":"Park","year":"2018","journal-title":"Am J Hum Genet"},{"issue":"2\u20133","key":"2022092013230962000_ref10","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1089\/1066527041410418","article-title":"Maximum entropy modeling of short sequence motifs with applications to RNA splicing signals","volume":"11","author":"Yeo","year":"2004","journal-title":"J Comput Biol"},{"issue":"20","key":"2022092013230962000_ref11","doi-asserted-by":"crossref","first-page":"3166","DOI":"10.1093\/bioinformatics\/btx401","article-title":"BPP: a sequence-based algorithm for branch point prediction","volume":"33","author":"Zhang","year":"2017","journal-title":"Bioinformatics"},{"issue":"4","key":"2022092013230962000_ref12","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1038\/s41588-019-0348-4","article-title":"S-CAP extends pathogenicity prediction to genetic variants that affect RNA splicing","volume":"51","author":"Jagadeesh","year":"2019","journal-title":"Nat Genet"},{"issue":"1","key":"2022092013230962000_ref13","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1186\/s13073-021-00835-9","article-title":"CADD-splice\u2014improving genome-wide variant effect prediction using deep learning-derived splice scores","volume":"13","author":"Rentzsch","year":"2021","journal-title":"Genome Med"},{"issue":"1","key":"2022092013230962000_ref14","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1186\/s13059-019-1847-4","article-title":"RegSNPs-intron: a computational framework for predicting pathogenic impact of intronic single nucleotide variants","volume":"20","author":"Lin","year":"2019","journal-title":"Genome Biol"},{"issue":"1","key":"2022092013230962000_ref15","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1186\/s13059-019-1653-z","article-title":"MMSplice: modular modeling improves the predictions of genetic variant effects on splicing","volume":"20","author":"Cheng","year":"2019","journal-title":"Genome Biol"},{"issue":"3","key":"2022092013230962000_ref16","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1016\/j.cell.2018.12.015","article-title":"Predicting splicing from primary sequence with deep learning","volume":"176","author":"Jaganathan","year":"2019","journal-title":"Cell"},{"issue":"7","key":"2022092013230962000_ref17","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1002\/humu.24212","article-title":"Benchmarking deep learning splice prediction tools using functional splice assays","volume":"42","author":"Riepe","year":"2021","journal-title":"Hum Mutat"},{"issue":"Database issue","key":"2022092013230962000_ref18","first-page":"D86","article-title":"DBASS3 and DBASS5: databases of aberrant 3\u2032- and 5\u2032-splice sites","volume":"39","author":"Buratti","year":"2010","journal-title":"Nucleic Acids Res"},{"issue":"7809","key":"2022092013230962000_ref19","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1038\/s41586-020-2308-7","article-title":"The mutational constraint spectrum quantified from variation in 141,456 humans","volume":"581","author":"Karczewski","year":"2020","journal-title":"Nature"},{"issue":"7616","key":"2022092013230962000_ref20","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1038\/nature19057","article-title":"Analysis of protein-coding genetic variation in 60,706 humans","volume":"536","author":"Lek","year":"2016","journal-title":"Nature"},{"issue":"1","key":"2022092013230962000_ref21","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1093\/nar\/29.1.308","article-title":"dbSNP: the NCBI database of genetic variation","volume":"29","author":"Sherry","year":"2001","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"2022092013230962000_ref22","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1186\/s13059-018-1437-x","article-title":"Vex-seq: high-throughput identification of the impact of genetic variation on pre-mRNA splicing efficiency","volume":"19","author":"Adamson","year":"2018","journal-title":"Genome Biol"},{"issue":"18","key":"2022092013230962000_ref23","doi-asserted-by":"crossref","first-page":"2811","DOI":"10.1093\/bioinformatics\/btab051","article-title":"Mutalyzer 2: next generation HGVS nomenclature checker","volume":"37","author":"Lefter","year":"2021","journal-title":"Bioinformatics"},{"issue":"D1","key":"2022092013230962000_ref24","doi-asserted-by":"crossref","first-page":"D1062","DOI":"10.1093\/nar\/gkx1153","article-title":"ClinVar: improving access to variant interpretations and supporting evidence","volume":"46","author":"Landrum","year":"2018","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"2022092013230962000_ref25","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1038\/s41467-017-00141-2","article-title":"Annotating pathogenic non-coding variants in genic regions","volume":"8","author":"Gelfman","year":"2017","journal-title":"Nat Commun"},{"issue":"22","key":"2022092013230962000_ref26","doi-asserted-by":"crossref","first-page":"13534","DOI":"10.1093\/nar\/gku1206","article-title":"In silico prediction of splice-altering single nucleotide variants in the human genome","volume":"42","author":"Jian","year":"2014","journal-title":"Nucleic Acids Res"},{"issue":"6218","key":"2022092013230962000_ref27","doi-asserted-by":"crossref","first-page":"1254806","DOI":"10.1126\/science.1254806","article-title":"The human splicing code reveals new insights into the genetic determinants of disease","volume":"347","author":"Xiong","year":"2015","journal-title":"Science"},{"issue":"12","key":"2022092013230962000_ref28","doi-asserted-by":"crossref","first-page":"1647","DOI":"10.1261\/rna.066290.118","article-title":"A sequence-based, deep learning model accurately predicts RNA splicing branchpoints","volume":"24","author":"Paggi","year":"2018","journal-title":"RNA"},{"key":"2022092013230962000_ref29","doi-asserted-by":"crossref","first-page":"1800","DOI":"10.1109\/ACCESS.2018.2886569","article-title":"Branch point selection in RNA splicing using deep learning","volume":"7","author":"Nazari","year":"2019","journal-title":"IEEE Access"},{"issue":"11","key":"2022092013230962000_ref30","doi-asserted-by":"crossref","first-page":"e1001016","DOI":"10.1371\/journal.pcbi.1001016","article-title":"Genome-wide association between branch point properties and alternative splicing","volume":"6","author":"Corvelo","year":"2010","journal-title":"PLoS Comput Biol"},{"issue":"1","key":"2022092013230962000_ref31","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1186\/s13073-020-00803-9","article-title":"dbNSFP v4: a comprehensive database of transcript-specific functional predictions and annotations for human nonsynonymous and splice-site SNVs","volume":"12","author":"Liu","year":"2020","journal-title":"Genome Med"},{"issue":"3","key":"2022092013230962000_ref32","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach Learn"},{"issue":"1","key":"2022092013230962000_ref33","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/BF00116251","article-title":"Induction of decision trees","volume":"1","author":"Quinlan","year":"1986","journal-title":"Mach Learn"},{"issue":"1","key":"2022092013230962000_ref34","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach Learn"},{"issue":"1","key":"2022092013230962000_ref35","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1006\/jcss.1997.1504","article-title":"A decision-theoretic generalization of on-line learning and an application to boosting","volume":"55","author":"Freund","year":"1997","journal-title":"J Comput Syst Sci"},{"issue":"5","key":"2022092013230962000_ref36","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1214\/aos\/1013203451","article-title":"Greedy function approximation: a gradient boosting machine","volume":"29","author":"Friedman","year":"2001","journal-title":"Ann Stat"},{"key":"2022092013230962000_ref37","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1145\/2939672.2939785","volume-title":"Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"Chen","year":"2016"},{"key":"2022092013230962000_ref38","first-page":"3146","article-title":"Lightgbm: a highly efficient gradient boosting decision tree","volume":"9","author":"Ke","year":"2017","journal-title":"Adv Neural Inf Proces Syst"},{"key":"2022092013230962000_ref39","article-title":"CatBoost: gradient boosting with categorical features support","author":"Prokhorenkova","year":"2018"},{"key":"2022092013230962000_ref40","first-page":"3146","article-title":"A unified approach to interpreting model predictions","volume":"9","author":"Lundberg","year":"2017","journal-title":"Adv Neural Inf Proces Syst"},{"key":"2022092013230962000_ref41","first-page":"2825","article-title":"Scikit-learn: machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J Mach Learn Res"},{"issue":"D1","key":"2022092013230962000_ref42","doi-asserted-by":"crossref","first-page":"D886","DOI":"10.1093\/nar\/gky1016","article-title":"CADD: predicting the deleteriousness of variants throughout the human genome","volume":"47","author":"Rentzsch","year":"2019","journal-title":"Nucleic Acids Res"},{"issue":"4","key":"2022092013230962000_ref43","first-page":"lqaa08","article-title":"AI-Driver: an ensemble method for identifying driver mutations in personal cancer genomes","volume":"2","author":"Wang","year":"2020","journal-title":"NAR Genom Bioinform"},{"issue":"16","key":"2022092013230962000_ref44","doi-asserted-by":"crossref","first-page":"e164","DOI":"10.1093\/nar\/gkq603","article-title":"ANNOVAR: functional annotation of genetic variants from high-throughput sequencing data","volume":"38","author":"Wang","year":"2010","journal-title":"Nucleic Acids Res"},{"issue":"6","key":"2022092013230962000_ref45","doi-asserted-by":"crossref","first-page":"e0177678","DOI":"10.1371\/journal.pone.0177678","article-title":"Optimal classifier for imbalanced data using Matthews correlation coefficient metric","volume":"12","author":"Boughorbel","year":"2017","journal-title":"PLoS One"},{"issue":"8","key":"2022092013230962000_ref46","doi-asserted-by":"crossref","first-page":"1526","DOI":"10.1016\/j.ajhg.2021.06.013","article-title":"High-throughput splicing assays identify missense and silent splice-disruptive POU1F1 variants underlying pituitary hormone deficiency","volume":"108","author":"Gergics","year":"2021","journal-title":"Am J Hum Genet"},{"issue":"5","key":"2022092013230962000_ref47","doi-asserted-by":"crossref","first-page":"e003389","DOI":"10.1161\/CIRCGEN.121.003389","article-title":"Contribution of noncanonical splice variants to TTN truncating variant cardiomyopathy","volume":"14","author":"Patel","year":"2021","journal-title":"Circ Genom Precis Med"},{"key":"2022092013230962000_ref48","doi-asserted-by":"crossref","DOI":"10.1136\/jmedgenet-2021-108013","article-title":"RNA splicing analysis contributes to reclassifying variants of uncertain significance and improves the diagnosis of monogenic disorders","author":"He","year":"2022","journal-title":"J Med Genet"},{"issue":"4","key":"2022092013230962000_ref49","doi-asserted-by":"crossref","first-page":"bbaa321","DOI":"10.1093\/bib\/bbaa321","article-title":"Do we need different machine learning algorithms for QSAR modeling? A comprehensive assessment of 16 machine learning algorithms on 14 QSAR data sets","volume":"22","author":"Wu","year":"2021","journal-title":"Brief Bioinform"},{"issue":"4","key":"2022092013230962000_ref50","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1016\/j.ajhg.2016.08.016","article-title":"REVEL: an ensemble method for predicting the pathogenicity of rare missense variants","volume":"99","author":"Ioannidis","year":"2016","journal-title":"Am J Hum Genet"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/23\/5\/bbac334\/45937437\/bbac334.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/23\/5\/bbac334\/45937437\/bbac334.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,20]],"date-time":"2022-09-20T18:06:20Z","timestamp":1663697180000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbac334\/6670557"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,17]]},"references-count":50,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2022,9,20]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbac334","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,9]]},"published":{"date-parts":[[2022,8,17]]},"article-number":"bbac334"}}