{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T02:31:04Z","timestamp":1767839464713,"version":"3.49.0"},"reference-count":51,"publisher":"Oxford University Press (OUP)","issue":"7","license":[{"start":{"date-parts":[[2018,8,31]],"date-time":"2018-08-31T00:00:00Z","timestamp":1535673600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"name":"Research Grants Council"},{"name":"Hong Kong Special Administrative Region","award":["CityU 21200816"],"award-info":[{"award-number":["CityU 21200816"]}]},{"name":"Hong Kong Special Administrative Region","award":["CityU 11203217"],"award-info":[{"award-number":["CityU 11203217"]}]},{"name":"Hong Kong Special Administrative Region","award":["CityU 11200218"],"award-info":[{"award-number":["CityU 11200218"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Motivation<\/jats:title><jats:p>The RNA-guided CRISPR\/Cas9 system has been widely applied to genome editing. CRISPR\/Cas9 system can effectively edit the on-target genes. Nonetheless, it has recently been demonstrated that many homologous off-target genomic sequences could be mutated, leading to unexpected gene-editing outcomes. Therefore, a plethora of tools were proposed for the prediction of off-target activities of CRISPR\/Cas9. Nonetheless, each computational tool has its own advantages and drawbacks under diverse conditions. It is hardly believed that a single tool is optimal for all conditions. Hence, we would like to explore the ensemble learning potential on synergizing multiple tools with genomic annotations together to enhance its predictive abilities.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We proposed an ensemble learning framework which synergizes multiple tools together to predict the off-target activities of CRISPR\/Cas9 in different combinations. Interestingly, the ensemble learning using AdaBoost outperformed other individual off-target predictive tools. We also investigated the effect of evolutionary conservation (PhyloP and PhastCons) and chromatin annotations (ChromHMM and Segway) and found that only PhyloP can enhance the predictive capabilities further. Case studies are conducted to reveal ensemble insights into the off-target predictions, demonstrating how the current study can be applied in different genomic contexts. The best prediction predicted by AdaBoost is up to 0.9383 (AUC) and 0.2998 (PRC) that outperforms other classifiers. This is ascribable to the fact that AdaBoost introduces a new weak classifier (i.e. decision stump) in each iteration to learn the DNA sequences that were misclassified as off-targets until a small error rate is reached iteratively.<\/jats:p><\/jats:sec><jats:sec><jats:title>Availability and implementation<\/jats:title><jats:p>The source codes are freely available on GitHub at https:\/\/github.com\/Alexzsx\/CRISPR.<\/jats:p><\/jats:sec><jats:sec><jats:title>Supplementary information<\/jats:title><jats:p>Supplementary data are available at Bioinformatics online.<\/jats:p><\/jats:sec>","DOI":"10.1093\/bioinformatics\/bty748","type":"journal-article","created":{"date-parts":[[2018,8,30]],"date-time":"2018-08-30T19:51:16Z","timestamp":1535658676000},"page":"1108-1115","source":"Crossref","is-referenced-by-count":32,"title":["Synergizing CRISPR\/Cas9 off-target predictions for ensemble insights and practical applications"],"prefix":"10.1093","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0314-9199","authenticated-orcid":false,"given":"Shixiong","family":"Zhang","sequence":"first","affiliation":[{"name":"Department of Computer Science, City University of Hong Kong, Kowloon Tong, Hong Kong"}]},{"given":"Xiangtao","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Computer Science, City University of Hong Kong, Kowloon Tong, Hong Kong"},{"name":"Department of Computer Science and Information Technology, Northeast Normal University, Changchun, China and"}]},{"given":"Qiuzhen","family":"Lin","sequence":"additional","affiliation":[{"name":"College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6062-733X","authenticated-orcid":false,"given":"Ka-Chun","family":"Wong","sequence":"additional","affiliation":[{"name":"Department of Computer Science, City University of Hong Kong, Kowloon Tong, Hong Kong"}]}],"member":"286","published-online":{"date-parts":[[2018,8,31]]},"reference":[{"key":"2023013107265785900_bty748-B1","doi-asserted-by":"crossref","first-page":"1473","DOI":"10.1093\/bioinformatics\/btu048","article-title":"Cas-OFFinder: a fast and versatile algorithm that searches for potential off-target sites of Cas9 RNA-guided endonucleases","volume":"30","author":"Bae","year":"2014","journal-title":"Bioinformatics"},{"key":"2023013107265785900_bty748-B2","doi-asserted-by":"crossref","first-page":"1068","DOI":"10.1016\/j.molcel.2017.08.008","article-title":"CRISPR-Mediated base editing enables efficient disruption of eukaryotic genes through induction of STOP codons","volume":"67","author":"Billon","year":"2017","journal-title":"Mol. Cell"},{"key":"2023013107265785900_bty748-B3","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198538493.001.0001","volume-title":"Neural Networks for Pattern Recognition.","author":"Bishop","year":"1995"},{"key":"2023013107265785900_bty748-B4","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn"},{"key":"2023013107265785900_bty748-B5","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1023\/A:1009715923555","article-title":"A tutorial on support vector machines for pattern recognition","volume":"2","author":"Burges","year":"1998","journal-title":"Data Min. Knowl. Discov"},{"key":"2023013107265785900_bty748-B6","doi-asserted-by":"crossref","first-page":"6482","DOI":"10.1093\/nar\/gkw524","article-title":"Probing the impact of chromatin conformation on genome editing tools","volume":"44","author":"Chen","year":"2016","journal-title":"Nucleic Acids Research"},{"key":"2023013107265785900_bty748-B7","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1038\/nbt.2507","article-title":"Targeted genome engineering in human cells with the Cas9 RNA-guided endonuclease","volume":"31","author":"Cho","year":"2013","journal-title":"Nat. Biotechnol"},{"key":"2023013107265785900_bty748-B8","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1101\/gr.162339.113","article-title":"Analysis of off-target effects of CRISPR\/Cas-derived RNA-guided endonucleases and nickases","volume":"24","author":"Cho","year":"2014","journal-title":"Genome Res"},{"key":"2023013107265785900_bty748-B9","doi-asserted-by":"crossref","first-page":"9584","DOI":"10.1093\/nar\/gkt714","article-title":"CRISPR\/Cas9 systems targeting \u03b2-globin and CCR5 genes have substantial off-target activity","volume":"41","author":"Cradick","year":"2013","journal-title":"Nucleic Acids Res"},{"key":"2023013107265785900_bty748-B10","doi-asserted-by":"crossref","first-page":"e214.","DOI":"10.1038\/mtna.2014.64","article-title":"COSMID: a web-based tool for identifying and validating CRISPR\/Cas off-target sites","volume":"3","author":"Cradick","year":"2014","journal-title":"Mol. Ther. Nucleic Acids"},{"key":"2023013107265785900_bty748-B11","doi-asserted-by":"crossref","first-page":"1262","DOI":"10.1038\/nbt.3026","article-title":"Rational design of highly active sgRNAs for CRISPR-Cas9\u2013mediated gene inactivation","volume":"32","author":"Doench","year":"2014","journal-title":"Nat. Biotechnol"},{"key":"2023013107265785900_bty748-B12","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1038\/nmeth.1906","article-title":"ChromHMM: automating chromatin-state discovery and characterization","volume":"9","author":"Ernst","year":"2012","journal-title":"Nat. Methods"},{"key":"2023013107265785900_bty748-B13","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1038\/nature09906","article-title":"Mapping and analysis of chromatin state dynamics in nine human cell types","volume":"473","author":"Ernst","year":"2011","journal-title":"Nature"},{"key":"2023013107265785900_bty748-B14","doi-asserted-by":"crossref","first-page":"2478","DOI":"10.1038\/nprot.2017.124","article-title":"Chromatin-state discovery and genome annotation with ChromHMM","volume":"12","author":"Ernst","year":"2017","journal-title":"Nat. Protoc"},{"key":"2023013107265785900_bty748-B15","first-page":"148","article-title":"Experiments with a new boosting algorithm","volume":"96","author":"Freund","year":"1996","journal-title":"Mach. Learn"},{"key":"2023013107265785900_bty748-B16","doi-asserted-by":"crossref","first-page":"822","DOI":"10.1038\/nbt.2623","article-title":"High-frequency off-target mutagenesis induced by CRISPR-Cas nucleases in human cells","volume":"31","author":"Fu","year":"2013","journal-title":"Nat. Biotechnol"},{"key":"2023013107265785900_bty748-B17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13059-016-1012-2","article-title":"Evaluation of off-target and on-target scoring algorithms and integration into the guide RNA selection tool CRISPOR","volume":"17","author":"Haeussler","year":"2016","journal-title":"Genome Biol"},{"key":"2023013107265785900_bty748-B18","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1038\/nmeth.2812","article-title":"E-CRISP: fast CRISPR target site identification","volume":"11","author":"Heigwer","year":"2014","journal-title":"Nat. Methods"},{"key":"2023013107265785900_bty748-B19","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1038\/nmeth.1937","article-title":"Unsupervised pattern discovery in human chromatin structure through genomic segmentation","volume":"9","author":"Hoffman","year":"2012","journal-title":"Nat. Methods"},{"key":"2023013107265785900_bty748-B20","doi-asserted-by":"crossref","first-page":"4982","DOI":"10.1242\/dev.099085","article-title":"Efficient CRISPR\/Cas9 genome editing with low off-target effects in zebrafish","volume":"140","author":"Hruscha","year":"2013","journal-title":"Development"},{"key":"2023013107265785900_bty748-B21","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1038\/nbt.2647","article-title":"DNA targeting specificity of RNA-guided Cas9 nucleases","volume":"31","author":"Hsu","year":"2013","journal-title":"Nat. Biotechnol"},{"key":"2023013107265785900_bty748-B22","doi-asserted-by":"crossref","first-page":"1262","DOI":"10.1016\/j.cell.2014.05.010","article-title":"Development and applications of CRISPR-Cas9 for genome engineering","volume":"157","author":"Hsu","year":"2014","journal-title":"Cell"},{"key":"2023013107265785900_bty748-B23","first-page":"1225829","article-title":"A programmable dual-RNA\u2013guided DNA endonuclease in adaptive bacterial immunity","volume":"2012","author":"Jinek","year":"2012","journal-title":"Science"},{"key":"2023013107265785900_bty748-B24","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1038\/nmeth.3284","article-title":"Digenome-seq: genome-wide profiling of CRISPR-Cas9 off-target effects in human cells","volume":"12","author":"Kim","year":"2015","journal-title":"Nat. Methods"},{"key":"2023013107265785900_bty748-B25","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1038\/nature16526","article-title":"High-fidelity CRISPR\u2013Cas9 nucleases with no detectable genome-wide off-target effects","volume":"529","author":"Kleinstiver","year":"2016","journal-title":"Nature"},{"key":"2023013107265785900_bty748-B26","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1126\/science.aac6572","article-title":"Dynamics of CRISPR-Cas9 genome interrogation in living cells","volume":"350","author":"Knight","year":"2015","journal-title":"Science"},{"key":"2023013107265785900_bty748-B27","doi-asserted-by":"crossref","first-page":"7473","DOI":"10.1093\/nar\/gku402","article-title":"CRISPR\/Cas9 systems have off-target activity with insertions or deletions between target DNA and guide RNA sequences","volume":"42","author":"Lin","year":"2014","journal-title":"Nucleic Acids Res"},{"key":"2023013107265785900_bty748-B28","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1038\/nature23305","article-title":"Correction of a pathogenic gene mutation in human embryos","volume":"548","author":"Ma","year":"2017","journal-title":"Nature"},{"key":"2023013107265785900_bty748-B29","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1126\/science.1232033","article-title":"RNA-guided human genome engineering via Cas9","volume":"339","author":"Mali","year":"2013","journal-title":"Science"},{"key":"2023013107265785900_bty748-B30","doi-asserted-by":"crossref","first-page":"1238","DOI":"10.1016\/j.molp.2017.06.006","article-title":"Construction of a genome-wide mutant library in rice using CRISPR\/Cas9","volume":"10","author":"Meng","year":"2017","journal-title":"Mol. Plant"},{"key":"2023013107265785900_bty748-B31","doi-asserted-by":"crossref","first-page":"W401","DOI":"10.1093\/nar\/gku410","article-title":"CHOPCHOP: a CRISPR\/Cas9 and TALEN web tool for genome editing","volume":"42","author":"Montague","year":"2014","journal-title":"Nucleic Acids Res"},{"key":"2023013107265785900_bty748-B32","doi-asserted-by":"crossref","first-page":"1120","DOI":"10.1093\/bioinformatics\/btu743","article-title":"CRISPRdirect: software for designing CRISPR\/Cas guide RNA with reduced off-target sites","volume":"31","author":"Naito","year":"2015","journal-title":"Bioinformatics"},{"key":"2023013107265785900_bty748-B33","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1006\/ijhc.1987.0321","article-title":"Simplifying decision trees","volume":"51","author":"Quinlan","year":"1999","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2023013107265785900_bty748-B34","doi-asserted-by":"crossref","first-page":"1218","DOI":"10.1111\/febs.13586","article-title":"Potential pitfalls of CRISPR\/Cas9-mediated genome editing","volume":"283","author":"Peng","year":"2016","journal-title":"Febs J"},{"key":"2023013107265785900_bty748-B35","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.ymthe.2017.09.015","article-title":"Genome-wide mapping of off-target events in single-stranded oligodeoxynucleotide-mediated gene repair experiments","volume":"26","author":"Radecke","year":"2018","journal-title":"Mol. Ther"},{"key":"2023013107265785900_bty748-B36","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1038\/nature14299","article-title":"In vivo genome editing using Staphylococcus aureus Cas9","volume":"520","author":"Ran","year":"2015","journal-title":"Nature"},{"key":"2023013107265785900_bty748-B38","doi-asserted-by":"crossref","first-page":"15403.","DOI":"10.1038\/ncomms15403","article-title":"Complementary information derived from CRISPR Cas9 mediated gene deletion and suppression","volume":"8","author":"Rosenbluh","year":"2017","journal-title":"Nat. Commun"},{"key":"2023013107265785900_bty748-B39","doi-asserted-by":"crossref","first-page":"W462","DOI":"10.1093\/nar\/gkq319","article-title":"ZiFiT (Zinc Finger Targeter): an updated zinc finger engineering tool","volume":"38","author":"Sander","year":"2010","journal-title":"Nucleic Acids Res"},{"key":"2023013107265785900_bty748-B40","doi-asserted-by":"crossref","first-page":"1095","DOI":"10.1038\/nm.4377","article-title":"Implications of human genetic variation in CRISPR-based therapeutic genome editing","volume":"23","author":"Scott","year":"2017","journal-title":"Nat. Med"},{"key":"2023013107265785900_bty748-B41","doi-asserted-by":"crossref","first-page":"e118","DOI":"10.1093\/nar\/gkv575","article-title":"Cas9-chromatin binding information enables more accurate CRISPR off-target prediction","volume":"43","author":"Singh","year":"2015","journal-title":"Nucleic Acids Res"},{"key":"2023013107265785900_bty748-B42","doi-asserted-by":"crossref","first-page":"e0124633.","DOI":"10.1371\/journal.pone.0124633","article-title":"CCTop: an intuitive, flexible and reliable CRISPR\/Cas9 target prediction Tool","volume":"10","author":"Stemmer","year":"2015","journal-title":"PLoS One"},{"key":"2023013107265785900_bty748-B43","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1038\/nbt.3117","article-title":"GUIDE-seq enables genome-wide profiling of off-target cleavage by CRISPR-Cas nucleases","volume":"33","author":"Tsai","year":"2015","journal-title":"Nat. Biotechnol"},{"key":"2023013107265785900_bty748-B44","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1038\/nmeth.4278","article-title":"CIRCLE-seq: a highly sensitive in vitro screen for genome-wide CRISPR\u2013Cas9 nuclease off-targets","volume":"14","author":"Tsai","year":"2017","journal-title":"Nat. Methods"},{"key":"2023013107265785900_bty748-B45","doi-asserted-by":"crossref","first-page":"e0196238","DOI":"10.1371\/journal.pone.0196238","article-title":"Chromatin accessibility is associated with CRISPR-Cas9 efficiency in the zebrafish (Danio rerio)","volume":"13","author":"Uusi-M\u00e4kel\u00e4","year":"2018","journal-title":"PLoS One"},{"key":"2023013107265785900_bty748-B46","doi-asserted-by":"crossref","first-page":"1011","DOI":"10.1016\/j.molp.2017.03.001","article-title":"Multiplex gene editing in rice using the CRISPR-Cpf1 system","volume":"10","author":"Wang","year":"2017","journal-title":"Mol. Plant"},{"key":"2023013107265785900_bty748-B47","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1038\/nbt.3127","article-title":"Unbiased detection of off-target cleavage by CRISPR-Cas9 and TALENs using integrase-defective lentiviral vectors","volume":"33","author":"Wang","year":"2015","journal-title":"Nat. Biotechnol"},{"key":"2023013107265785900_bty748-B48","doi-asserted-by":"crossref","first-page":"43.","DOI":"10.1186\/s13059-017-1179-1","article-title":"Knocking out consumer concerns and regulator\u2019s rules: efficient use of CRISPR\/Cas ribonucleoprotein complexes for genome editing in cereals","volume":"18","author":"Wolter","year":"2017","journal-title":"Genome Biol"},{"key":"2023013107265785900_bty748-B49","doi-asserted-by":"crossref","first-page":"1180","DOI":"10.1093\/bioinformatics\/btt764","article-title":"CasOT: a genome-wide Cas9\/gRNA off-target searching tool","volume":"30","author":"Xiao","year":"2014","journal-title":"Bioinformatics"},{"key":"2023013107265785900_bty748-B50","doi-asserted-by":"crossref","first-page":"143.","DOI":"10.1038\/s41598-017-00180-1","article-title":"CRISPR-Cas9 cleavage efficiency correlates strongly with target-sgRNA folding stability: from physical mechanism to off-target assessment","volume":"7","author":"Xu","year":"2017","journal-title":"Sci. Rep"},{"key":"2023013107265785900_bty748-B51","first-page":"449","article-title":"Mathematical and computational analysis of CRISPR Cas9 sgRNA off-target homologies","author":"Zhou","year":"2017","journal-title":"Proc. 2016 IEEE Int. Conf. Bioinforma. Biomed. BIBM 2016"},{"key":"2023013107265785900_bty748-B52","doi-asserted-by":"crossref","first-page":"e108424.","DOI":"10.1371\/journal.pone.0108424","article-title":"CRISPRseek: a bioconductor package to identify target-specific guide RNAs for CRISPR-Cas9 genome-editing systems","volume":"9","author":"Zhu","year":"2014","journal-title":"PLoS One"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/35\/7\/1108\/48968060\/bioinformatics_35_7_1108.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/35\/7\/1108\/48968060\/bioinformatics_35_7_1108.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,9]],"date-time":"2024-07-09T19:59:48Z","timestamp":1720555188000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/35\/7\/1108\/5088326"}},"subtitle":[],"editor":[{"given":"John","family":"Hancock","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2018,8,31]]},"references-count":51,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2019,4,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/bty748","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,4,1]]},"published":{"date-parts":[[2018,8,31]]}}}