{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T18:00:13Z","timestamp":1781200813352,"version":"3.54.1"},"reference-count":43,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T00:00:00Z","timestamp":1781136000000},"content-version":"vor","delay-in-days":41,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Sungkyunkwan University and the BK21 FOUR"},{"DOI":"10.13039\/100009122","name":"Ministry of Education","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100009122","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100014188","name":"Ministry of Science and ICT","doi-asserted-by":"publisher","award":["RS-2024-00416536"],"award-info":[{"award-number":["RS-2024-00416536"]}],"id":[{"id":"10.13039\/501100014188","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100014188","name":"Ministry of Science and ICT","doi-asserted-by":"publisher","award":["RS-2024-00344752"],"award-info":[{"award-number":["RS-2024-00344752"]}],"id":[{"id":"10.13039\/501100014188","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100014188","name":"Ministry of Science and ICT","doi-asserted-by":"publisher","award":["RS-2025-16072961"],"award-info":[{"award-number":["RS-2025-16072961"]}],"id":[{"id":"10.13039\/501100014188","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Department of Integrative Biotechnology, Sungkyunkwan University"},{"name":"BK21 FOUR Project, Republic of Korea"},{"name":"Commercialization Promotion Agency for R&D Outcomes"},{"name":"MSIT, Republic of Korea","award":["2710096838"],"award-info":[{"award-number":["2710096838"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,5,4]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Interleukin-6 (IL-6) is a key immunomodulatory cytokine implicated in diverse physiological processes and pathological conditions, including autoimmune diseases, cancers, and cytokine storms. Immunogenic peptides capable of inducing IL-6 expression are key modulators of host immune responses and represent promising candidates for therapeutic design and epitope-based vaccine development. However, experimental identification of IL-6-inducing peptides remains laborious and unsuitable for large-scale screening. Although existing computational approaches show promise, many often struggle to capture both global contextual semantics and local motif-level features essential for peptide immunogenicity. To address these limitations, we present CONTRA-IL6, a novel deep learning framework that integrates Transformer fusion and convolutional localization modules with stacked pretrained protein language model embeddings to predict IL-6-inducing peptides. Comprehensive benchmarking on an independent dataset demonstrates that CONTRA-IL6 achieves superior predictive performance over six state-of-the-art predictors. Notably, it achieves the highest Matthews correlation coefficient (MCC, 0.504) and F1 (0.549) and improves over the best-performing existing method by 3.2% in MCC and 4.3% in F1, demonstrating balanced and robust performance. Feature space visualizations (uniform manifold approximation and projection, kernel density estimation) showed clear class separation, while 1D gradient-weighted class activation mapping++ highlighted strong attention to specific C-terminal regions. Crucially, we moved beyond these attribution methods by employing in silico mutagenesis, which causally confirmed the functional importance and physicochemical constraints. Ablation studies further confirmed the synergistic contribution of global and local modules to model performance. CONTRA-IL6 offers a robust, scalable, and interpretable solution for immunoinformatics research. The standalone package is freely available at https:\/\/pypi.org\/project\/contra-il6\/ to facilitate broader community use.<\/jats:p>","DOI":"10.1093\/bib\/bbag250","type":"journal-article","created":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T11:17:27Z","timestamp":1777893447000},"source":"Crossref","is-referenced-by-count":0,"title":["CONTRA-IL6: an interpretable hybrid convolutional neural network and Transformer framework for accurate prediction of interleukin-6-inducing peptides using protein language models"],"prefix":"10.1093","volume":"27","author":[{"given":"Duong Thanh","family":"Tran","sequence":"first","affiliation":[{"name":"Department of Integrative Biotechnology, College of Biotechnology and Bioengineering, Sungkyunkwan University , Suwon 16419, Gyeonggi-do ,","place":["Republic of Korea"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nhat Truong","family":"Pham","sequence":"additional","affiliation":[{"name":"Department of Integrative Biotechnology, College of Biotechnology and Bioengineering, Sungkyunkwan University , Suwon 16419, Gyeonggi-do ,","place":["Republic of Korea"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1299-9478","authenticated-orcid":false,"given":"Gwang","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Physiology, Ajou University School of Medicine, Suwon 16499 ,","place":["Republic of Korea"]},{"name":"Department of Molecular Science and Technology, Ajou University, Suwon 16499 ,","place":["Republic of Korea"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2807-1885","authenticated-orcid":false,"given":"Shaherin","family":"Basith","sequence":"additional","affiliation":[{"name":"Department of Physiology, Ajou University School of Medicine, Suwon 16499 ,","place":["Republic of Korea"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0697-9419","authenticated-orcid":false,"given":"Balachandran","family":"Manavalan","sequence":"additional","affiliation":[{"name":"Department of Integrative Biotechnology, College of Biotechnology and Bioengineering, Sungkyunkwan University , Suwon 16419, Gyeonggi-do ,","place":["Republic of Korea"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,6,11]]},"reference":[{"key":"2026061113275702800_ref1","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1093\/intimm\/dxq030","article-title":"IL-6: from its discovery to clinical applications","volume":"22","author":"Kishimoto","year":"2010","journal-title":"Int Immunol"},{"key":"2026061113275702800_ref2","doi-asserted-by":"publisher","first-page":"448","DOI":"10.1038\/ni.3153","article-title":"IL-6 as a keystone cytokine in health and disease","volume":"16","author":"Hunter","year":"2015","journal-title":"Nat Immunol"},{"key":"2026061113275702800_ref3","doi-asserted-by":"publisher","first-page":"a028415","DOI":"10.1101\/cshperspect.a028415","article-title":"Interleukin-6 family cytokines","volume":"10","author":"Rose-John","year":"2018","journal-title":"Cold Spring Harb Perspect Biol"},{"key":"2026061113275702800_ref4","doi-asserted-by":"publisher","first-page":"249","DOI":"10.3109\/08830189809042997","article-title":"Interleukin 6 and its receptor: ten years later","volume":"16","author":"Hirano","year":"1998","journal-title":"Int Rev Immunol"},{"key":"2026061113275702800_ref5","doi-asserted-by":"publisher","DOI":"10.1101\/cshperspect.a016295","volume-title":"Cold Spring Harbor Perspectives in Biology","author":"Tanaka","year":"2014"},{"key":"2026061113275702800_ref6","doi-asserted-by":"publisher","first-page":"878","DOI":"10.1016\/j.bbamcr.2011.01.034","article-title":"The pro- and anti-inflammatory properties of the cytokine interleukin-6","volume":"1813","author":"Scheller","year":"2011","journal-title":"Biochim Biophys Acta Mol Cell Res"},{"key":"2026061113275702800_ref7","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1038\/s41577-018-0066-7","article-title":"Recent insights into targeting the IL-6 cytokine family in inflammatory diseases and cancer","volume":"18","author":"Jones","year":"2018","journal-title":"Nat Rev Immunol"},{"key":"2026061113275702800_ref8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1042\/bj20030407","article-title":"Principles of interleukin (IL)-6-type cytokine signalling and its regulation","volume":"374","author":"Heinrich","year":"2003","journal-title":"Biochem J"},{"key":"2026061113275702800_ref9","doi-asserted-by":"publisher","first-page":"959","DOI":"10.2217\/imt-2016-0020","article-title":"Immunotherapeutic implications of IL-6 blockade for cytokine storm","volume":"8","author":"Tanaka","year":"2016","journal-title":"Immunotherapy"},{"key":"2026061113275702800_ref10","doi-asserted-by":"publisher","first-page":"619","DOI":"10.1038\/ncprheum0338","article-title":"Interleukin 6: from bench to bedside","volume":"2","author":"Nishimoto","year":"2006","journal-title":"Nat Clin Pract Rheumatol"},{"key":"2026061113275702800_ref11","first-page":"483","article-title":"Coagulopathy in COVID-19: pathophysiology","volume":"21","author":"Pierini","year":"2006","journal-title":"G Ital Cardiol"},{"key":"2026061113275702800_ref12","doi-asserted-by":"publisher","first-page":"497","DOI":"10.1016\/S0140-6736(20)30183-5","article-title":"Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China","volume":"395","author":"Huang","year":"2020","journal-title":"Lancet"},{"key":"2026061113275702800_ref13","doi-asserted-by":"publisher","first-page":"2255","DOI":"10.1056\/NEJMra2026131","article-title":"Cytokine storm","volume":"383","author":"Fajgenbaum","year":"2020","journal-title":"N Engl J Med"},{"key":"2026061113275702800_ref14","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1016\/j.cytogfr.2020.06.001","article-title":"SARS-CoV-2 infection: the role of cytokines in COVID-19 disease","volume":"54","author":"Costela-Ruiz","year":"2020","journal-title":"Cytokine Growth Factor Rev"},{"key":"2026061113275702800_ref15","first-page":"167","article-title":"Cytokine release syndrome (CRS) in severe COVID-19 patients: two controversial and interesting case reports and literature review","volume":"22","author":"Lazovic","year":"2023","journal-title":"Tanaffos"},{"key":"2026061113275702800_ref16","doi-asserted-by":"publisher","first-page":"936","DOI":"10.1093\/bib\/bbaa259","article-title":"Computer-aided prediction and design of IL-6 inducing peptides: IL-6 plays a crucial role in COVID-19","volume":"22","author":"Dhall","year":"2020","journal-title":"Brief Bioinform"},{"key":"2026061113275702800_ref17","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbab172","article-title":"StackIL6: a stacking ensemble model for improving the prediction of IL-6 inducing peptides","volume":"22","author":"Charoenkwan","year":"2021","journal-title":"Brief Bioinform"},{"key":"2026061113275702800_ref18","doi-asserted-by":"publisher","first-page":"125412","DOI":"10.1016\/j.ijbiomac.2023.125412","article-title":"MVIL6: accurate identification of IL-6-induced peptides using multi-view feature learning","volume":"246","author":"Wang","year":"2023","journal-title":"Int J Biol Macromol"},{"key":"2026061113275702800_ref19","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbab152","article-title":"MG-BERT: leveraging unsupervised atomic representation learning for molecular property prediction","volume":"22","author":"Zhang","year":"2021","journal-title":"Brief Bioinform"},{"key":"2026061113275702800_ref20","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv Neural Inf Proces Syst"},{"key":"2026061113275702800_ref21","doi-asserted-by":"crossref","first-page":"108176","DOI":"10.1016\/j.cmpb.2024.108176","article-title":"UsIL-6: an unbalanced learning strategy for identifying IL-6 inducing peptides by undersampling technique","volume":"250","author":"Liao","year":"2024","journal-title":"Comput Methods Prog Biomed"},{"key":"2026061113275702800_ref22","doi-asserted-by":"publisher","first-page":"2685","DOI":"10.1021\/acs.jcim.4c02144","article-title":"RAG_MCNNIL6: a retrieval-augmented multi-window convolutional network for accurate prediction of IL-6 inducing epitopes","volume":"65","author":"Chuang","year":"2025","journal-title":"J Chem Inf Model"},{"key":"2026061113275702800_ref23","doi-asserted-by":"publisher","DOI":"10.3390\/biom15010099","article-title":"IL-6-inducing peptide prediction based on 3D structure and graph neural network","volume":"15","author":"Cao","year":"2025","journal-title":"Biomolecules"},{"key":"2026061113275702800_ref24","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Lin"},{"key":"2026061113275702800_ref25","doi-asserted-by":"publisher","first-page":"110242","DOI":"10.1016\/j.measurement.2021.110242","article-title":"Fault diagnosis for small samples based on attention mechanism","volume":"187","author":"Zhang","year":"2022","journal-title":"Measurement"},{"key":"2026061113275702800_ref26","author":"L","year":"2018"},{"key":"2026061113275702800_ref27","doi-asserted-by":"publisher","first-page":"D339","DOI":"10.1093\/nar\/gky1006","article-title":"The Immune Epitope Database (IEDB): 2018 update","volume":"47","author":"Vita","year":"2019","journal-title":"Nucleic Acids Res"},{"key":"2026061113275702800_ref28","doi-asserted-by":"publisher","first-page":"1658","DOI":"10.1093\/bioinformatics\/btl158","article-title":"Cd-hit: a fast program for clustering and comparing large sets of protein or nucleotide sequences","volume":"22","author":"Li","year":"2006","journal-title":"Bioinformatics"},{"key":"2026061113275702800_ref29","author":"Bepler","year":"2019"},{"key":"2026061113275702800_ref30","author":"Mikolov","year":"2013"},{"key":"2026061113275702800_ref31","doi-asserted-by":"publisher","first-page":"723","DOI":"10.1186\/s12859-019-3220-8","article-title":"Modeling aspects of the language of life through transfer-learning protein sequences","volume":"20","author":"Heinzinger","year":"2019","journal-title":"BMC Bioinformatics"},{"key":"2026061113275702800_ref32","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1162\/tacl_a_00051","article-title":"Enriching word vectors with subword information","volume":"5","author":"Bojanowski","year":"2017","journal-title":"Trans Assoc Comput Linguist"},{"key":"2026061113275702800_ref33","volume-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Pennington"},{"key":"2026061113275702800_ref34","doi-asserted-by":"publisher","first-page":"123912","DOI":"10.1109\/ACCESS.2021.3110269","article-title":"Pre-training of deep bidirectional protein sequence representations with structural information","volume":"9","author":"Min","year":"2021","journal-title":"IEEE Access"},{"key":"2026061113275702800_ref35","doi-asserted-by":"publisher","first-page":"e2016239118","DOI":"10.1073\/pnas.2016239118","article-title":"Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences","volume":"118","author":"Rives","year":"2021","journal-title":"Proc Natl Acad Sci"},{"key":"2026061113275702800_ref36","doi-asserted-by":"publisher","first-page":"1123","DOI":"10.1126\/science.ade2574","article-title":"Evolutionary-scale prediction of atomic-level protein structure with a language model","volume":"379","author":"Lin","year":"2023","journal-title":"Science"},{"key":"2026061113275702800_ref37","doi-asserted-by":"publisher","first-page":"7112","DOI":"10.1109\/TPAMI.2021.3095381","article-title":"ProtTrans: toward understanding the language of life through self-supervised learning","volume":"44","author":"Elnaggar","year":"2022","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"2026061113275702800_ref38","first-page":"876","article-title":"Bio_embeddings: Python pipeline for fast visualization of protein features extracted by language models","volume":"9","author":"Dallago","year":"2020","journal-title":"F1000Res"},{"key":"2026061113275702800_ref39","volume-title":"Proceedings of the 2019 conference of the North American chapter of the Association for Computational Linguistics: human language technologies, volume 1 (long and short papers)","author":"Devlin"},{"key":"2026061113275702800_ref40","author":"Dosovitskiy","year":"2020"},{"key":"2026061113275702800_ref41","doi-asserted-by":"publisher","first-page":"101410","DOI":"10.1016\/j.jpha.2025.101410","article-title":"HyPepTox-Fuse: an interpretable hybrid framework for accurate peptide toxicity prediction fusing protein language model-based embeddings with conventional descriptors","volume":"15","author":"Tran","year":"2025","journal-title":"J Pharm Anal"},{"key":"2026061113275702800_ref42","doi-asserted-by":"publisher","first-page":"107398","DOI":"10.1016\/j.ymssp.2020.107398","article-title":"1D convolutional neural networks and applications: a survey","volume":"151","author":"Kiranyaz","year":"2021","journal-title":"Mech Syst Signal Process"},{"key":"2026061113275702800_ref43","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1023\/A:1022617714621","article-title":"Unsupervised learning of multiple motifs in biopolymers using expectation maximization","volume":"21","author":"Bailey","year":"1995","journal-title":"Mach Learn"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/27\/3\/bbag250\/68514506\/bbag250.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/27\/3\/bbag250\/68514506\/bbag250.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T17:28:06Z","timestamp":1781198886000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbag250\/8706539"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5]]},"references-count":43,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,5,4]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbag250","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,5]]},"published":{"date-parts":[[2026,5]]},"article-number":"bbag250"}}