{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T10:38:14Z","timestamp":1776940694944,"version":"3.51.4"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,5,20]],"date-time":"2024-05-20T00:00:00Z","timestamp":1716163200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,20]],"date-time":"2024-05-20T00:00:00Z","timestamp":1716163200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62172121"],"award-info":[{"award-number":["62172121"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["82073800"],"award-info":[{"award-number":["82073800"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005046","name":"Natural Science Foundation of Heilongjiang Province of China","doi-asserted-by":"crossref","award":["LH2022F012"],"award-info":[{"award-number":["LH2022F012"]}],"id":[{"id":"10.13039\/501100005046","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>CAR-T cell therapy represents a novel approach for the treatment of hematologic malignancies and solid tumors. However, its implementation is accompanied by the emergence of potentially life-threatening adverse events known as cytokine release syndrome (CRS). Given the escalating number of patients undergoing CAR-T therapy, there is an urgent need to develop predictive models for severe CRS occurrence to prevent it in advance. Currently, all existing models are based on decision trees whose accuracy is far from meeting our expectations, and there is a lack of deep learning models to predict the occurrence of severe CRS more accurately.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We propose PrCRS, a deep learning prediction model based on U-net and Transformer. Given the limited data available for CAR-T patients, we employ transfer learning using data from COVID-19 patients. The comprehensive evaluation demonstrates the superiority of the PrCRS model over other state-of-the-art methods for predicting CRS occurrence. We propose six models to forecast the probability of severe CRS for patients with one, two, and three days in advance. Additionally, we present a strategy to convert the model's output into actual probabilities of severe CRS and provide corresponding predictions.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Based on our findings, PrCRS effectively predicts both the likelihood and timing of severe CRS in patients, thereby facilitating expedited and precise patient assessment, thus making a significant contribution to medical research. There is little research on applying deep learning algorithms to predict CRS, and our study fills this gap. This makes our research more novel and significant. Our code is publicly available at <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/github.com\/wzy38828201\/PrCRS\">https:\/\/github.com\/wzy38828201\/PrCRS<\/jats:ext-link>. The website of our prediction platform is: <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"http:\/\/prediction.unicar-therapy.com\/index-en.html\">http:\/\/prediction.unicar-therapy.com\/index-en.html<\/jats:ext-link>.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12859-024-05804-8","type":"journal-article","created":{"date-parts":[[2024,5,20]],"date-time":"2024-05-20T15:01:57Z","timestamp":1716217317000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["PrCRS: a prediction model of severe CRS in CAR-T therapy based on transfer learning"],"prefix":"10.1186","volume":"25","author":[{"given":"Zhenyu","family":"Wei","sequence":"first","affiliation":[]},{"given":"Chengkui","family":"Zhao","sequence":"additional","affiliation":[]},{"given":"Min","family":"Zhang","sequence":"additional","affiliation":[]},{"given":"Jiayu","family":"Xu","sequence":"additional","affiliation":[]},{"given":"Nan","family":"Xu","sequence":"additional","affiliation":[]},{"given":"Shiwei","family":"Wu","sequence":"additional","affiliation":[]},{"given":"Xiaohui","family":"Xin","sequence":"additional","affiliation":[]},{"given":"Lei","family":"Yu","sequence":"additional","affiliation":[]},{"given":"Weixing","family":"Feng","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,5,20]]},"reference":[{"key":"5804_CR1","doi-asserted-by":"publisher","first-page":"927153","DOI":"10.3389\/fimmu.2022.927153","volume":"13","author":"X Zhang","year":"2022","unstructured":"Zhang X, Zhu L, Zhang H, Chen S, Xiao Y. CAR-T cell therapy in hematological malignancies: current opportunities and challenges. Front Immunol. 2022;13:927153.","journal-title":"Front Immunol"},{"key":"5804_CR2","doi-asserted-by":"publisher","first-page":"370","DOI":"10.1016\/j.procs.2022.12.148","volume":"216","author":"MRNM Derwin Suhartonoa","year":"2023","unstructured":"Derwin Suhartonoa MRNM. Towards a more general drug target interaction prediction model using transfer learning. Proc Comput Sci. 2023;216:370\u20136.","journal-title":"Proc Comput Sci"},{"issue":"1\u20132","key":"5804_CR3","doi-asserted-by":"publisher","first-page":"e2100232","DOI":"10.1002\/pmic.202100232","volume":"22","author":"NQK Le","year":"2022","unstructured":"Le NQK. Potential of deep representative learning features to interpret the sequence information in proteomics. Proteomics. 2022;22(1\u20132):e2100232.","journal-title":"Proteomics"},{"issue":"1","key":"5804_CR4","doi-asserted-by":"publisher","first-page":"630","DOI":"10.1093\/bib\/bbac630","volume":"24","author":"Q Yuan","year":"2023","unstructured":"Yuan Q, Chen K, Yu Y, Le NQK, Chua MCH. Prediction of anticancer peptides based on an ensemble model of deep learning and machine learning using ordinal positional encoding. Brief Bioinform. 2023;24(1):630.","journal-title":"Brief Bioinform"},{"issue":"4","key":"5804_CR5","doi-asserted-by":"publisher","first-page":"1337","DOI":"10.1093\/bib\/bby002","volume":"20","author":"A Ezzat","year":"2019","unstructured":"Ezzat A, Wu M, Li X-L, Kwoh C-K. Computational prediction of drug\u2013target interactions using chemogenomic approaches: an empirical survey. Brief Bioinform. 2019;20(4):1337\u201357.","journal-title":"Brief Bioinform"},{"issue":"3","key":"5804_CR6","doi-asserted-by":"publisher","first-page":"362","DOI":"10.1080\/00401706.2015.1044117","volume":"57","author":"N Zou","year":"2015","unstructured":"Zou N, Zhu Y, Zhu J, Baydogan M, Wang W, Li J. A transfer learning approach for predictive modeling of degenerate biological systems. Technometrics. 2015;57(3):362\u201373.","journal-title":"Technometrics"},{"issue":"1","key":"5804_CR7","doi-asserted-by":"publisher","first-page":"20353","DOI":"10.1038\/s41598-019-56911-z","volume":"9","author":"B Mieth","year":"2019","unstructured":"Mieth B, Hockley JRF, G\u00f6rnitz N, Vidovic MMC, M\u00fcller K-R, Gutteridge A, Ziemek D. Using transfer learning from prior reference knowledge to improve the clustering of single-cell RNA-Seq data. Sci Rep. 2019;9(1):20353.","journal-title":"Sci Rep"},{"key":"5804_CR8","doi-asserted-by":"publisher","first-page":"7381","DOI":"10.1109\/ACCESS.2017.2696523","volume":"5","author":"T Turki","year":"2017","unstructured":"Turki T, Wei Z, Wang JTL. Transfer learning approaches to improve drug sensitivity prediction in multiple myeloma patients. IEEE Access. 2017;5:7381\u201393.","journal-title":"IEEE Access"},{"issue":"14","key":"5804_CR9","doi-asserted-by":"publisher","first-page":"i510","DOI":"10.1093\/bioinformatics\/btz372","volume":"35","author":"S Mourragui","year":"2019","unstructured":"Mourragui S, Loog M, van de Wiel MA, Reinders MJT, Wessels LFA. PRECISE: a domain adaptation approach to transfer predictors of drug response from pre-clinical models to tumors. Bioinformatics. 2019;35(14):i510\u20139.","journal-title":"Bioinformatics"},{"key":"5804_CR10","doi-asserted-by":"crossref","unstructured":"Pan SJ, Yang Q. A Survey on Transfer Learning[J]. IEEE Trans Knowledge Data Eng. 2010;22(10).","DOI":"10.1109\/TKDE.2009.191"},{"issue":"D1","key":"5804_CR11","doi-asserted-by":"publisher","first-page":"D945","DOI":"10.1093\/nar\/gkw1074","volume":"45","author":"A Gaulton","year":"2017","unstructured":"Gaulton A, Hersey A, Nowotka M, Bento AP, Chambers J, Mendez D, Mutowo P, Atkinson F, Bellis LJ, Cibri\u00e1n-Uhalte E, et al. The ChEMBL database in 2017. Nucleic Acids Res. 2017;45(D1):D945\u201354.","journal-title":"Nucleic Acids Res"},{"issue":"16","key":"5804_CR12","doi-asserted-by":"publisher","first-page":"8683","DOI":"10.1021\/acs.jmedchem.9b02147","volume":"63","author":"C Cai","year":"2020","unstructured":"Cai C, Wang S, Xu Y, Zhang W, Tang K, Ouyang Q, Lai L, Pei J. Transfer learning for drug discovery. J Med Chem. 2020;63(16):8683\u201394.","journal-title":"J Med Chem"},{"key":"5804_CR13","unstructured":"Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need[J]. arXiv. 2017."},{"issue":"9","key":"5804_CR14","doi-asserted-by":"publisher","first-page":"1572","DOI":"10.1021\/acscentsci.9b00576","volume":"5","author":"P Schwaller","year":"2019","unstructured":"Schwaller P, Laino T, Gaudin T, Bolgar P, Hunter CA, Bekas C, Lee AA. Molecular transformer: a model for uncertainty-calibrated chemical reaction prediction. ACS Cent Sci. 2019;5(9):1572\u201383.","journal-title":"ACS Cent Sci"},{"issue":"81","key":"5804_CR15","doi-asserted-by":"publisher","first-page":"12152","DOI":"10.1039\/C9CC05122H","volume":"55","author":"AA Lee","year":"2019","unstructured":"Lee AA, Yang Q, Sresht V, Bolgar P, Hou X, Klug-McLeod JL, Butler CR. Molecular transformer unifies reaction prediction and retrosynthesis across pharma chemical space. Chem Commun. 2019;55(81):12152\u20135.","journal-title":"Chem Commun"},{"key":"5804_CR16","doi-asserted-by":"crossref","unstructured":"Karita S. A comparative study on transformer vs RNN in speech applications. In: Automatic speech recognition and understanding workshop; 2019.","DOI":"10.1109\/ASRU46091.2019.9003750"},{"key":"5804_CR17","volume-title":"Improving RNN transducer based ASR WITH auxiliary tasks","author":"C Liu","year":"2020","unstructured":"Liu C. Improving RNN transducer based ASR WITH auxiliary tasks. Spoken Language Technology; 2020."},{"key":"5804_CR18","doi-asserted-by":"crossref","unstructured":"Zhang F, Wang Y, Zhang X, et al. Faster, simpler and more accurate hybrid ASR systems using wordpieces [J].  2020, 2020\u20131995.","DOI":"10.21437\/Interspeech.2020-1995"},{"key":"5804_CR19","doi-asserted-by":"crossref","unstructured":"Qian Zhang HL. Transformer transducer: a streamable speech recognition model with transformer encoders and RNN-T loss. In: International conference on acoustics, speech and signal processing; 2020. pp. 7829\u20137833.","DOI":"10.1109\/ICASSP40776.2020.9053896"},{"key":"5804_CR20","first-page":"1","volume":"8","author":"AG Sehoon Kim","year":"2022","unstructured":"Sehoon Kim AG. Squeezeformer: an efficient transformer for automatic speech recognition. NeurIPS. 2022;8:1\u201315.","journal-title":"NeurIPS"},{"issue":"10","key":"5804_CR21","doi-asserted-by":"publisher","first-page":"1636","DOI":"10.1038\/s41591-020-1051-9","volume":"26","author":"DM Del Valle","year":"2020","unstructured":"Del Valle DM, Kim-Schulze S, Huang H-H, Beckmann ND, Nirenberg S, Wang B, Lavin Y, Swartz TH, Madduri D, Stock A, et al. An inflammatory cytokine signature predicts COVID-19 severity and survival. Nat Med. 2020;26(10):1636\u201343.","journal-title":"Nat Med"},{"key":"5804_CR22","unstructured":"Devlin J, Chang MW, Lee K, et al. BERT: pre-training of deep bidirectional transformers for language understanding[J].  2018. 1810.04805."},{"key":"5804_CR23","doi-asserted-by":"crossref","unstructured":"Olaf Ronneberger PF, Thomas B. U-Net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention; 2015.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"5804_CR24","unstructured":"Perslev M, Jensen MH, Darkner S, et al. U-time: a fully convolutional network for time series segmentation applied to sleep staging. 2019. 1910.11162."},{"key":"5804_CR25","doi-asserted-by":"crossref","unstructured":"Anmol Gulati JQ, Chung-Cheng C: Conformer: convolution-augmented transformer for speech recognition. In: Audio and speech processing; 2020.","DOI":"10.21437\/Interspeech.2020-3015"},{"key":"5804_CR26","unstructured":"Lu Y, Li Z, He D, et al. Understanding and improving transformer from a multi-particle dynamic system point of view[J].  2019. 1906.02762."},{"key":"5804_CR27","unstructured":"Dosovitskiy A, Beyer L, Kolesnikov A, et al. An image is worth 16x16 words: transformers for image recognition at scale[C]. In: International Conference on Learning Representations. 2021."},{"key":"5804_CR28","unstructured":"Dong L, Yang N, Wang W, et al. Unified language model pre-training for natural language understanding and generation[J].  2019. 1905.03197."},{"key":"5804_CR29","doi-asserted-by":"crossref","unstructured":"Wang H, Ma S, Dong L, et al. Deepnet: scaling transformers to 1,000 layers[J]. 2022. 2203.00555.","DOI":"10.1109\/TPAMI.2024.3386927"},{"key":"5804_CR30","unstructured":"Sehoon Kim AG. I-BERT: integer-only BERT quantization. In: International conference on machine learning; 2021."},{"key":"5804_CR31","unstructured":"Andrew Brock SD. High-performance large-scale image recognition without normalization. In: International conference on machine learning; 2021. pp. 1059\u20131071."},{"issue":"7","key":"5804_CR32","doi-asserted-by":"publisher","first-page":"867","DOI":"10.1016\/j.jcyt.2017.04.001","volume":"19","author":"N Singh","year":"2017","unstructured":"Singh N, Hofmann TJ, Gershenson Z, Levine BL, Grupp SA, Teachey DT, Barrett DM. Monocyte lineage-derived IL-6 does not affect chimeric antigen receptor T-cell function. Cytotherapy. 2017;19(7):867\u201380.","journal-title":"Cytotherapy"},{"issue":"21","key":"5804_CR33","doi-asserted-by":"publisher","first-page":"2295","DOI":"10.1182\/blood-2017-06-793141","volume":"130","author":"KA Hay","year":"2017","unstructured":"Hay KA, Hanafi LA, Li D, Gust J, Liles WC, Wurfel MM, Lopez JA, Chen J, Chung D, Harju-Baker S, et al. Kinetics and biomarkers of severe cytokine release syndrome after CD19 chimeric antigen receptor-modified T-cell therapy. Blood. 2017;130(21):2295\u2013306.","journal-title":"Blood"},{"issue":"6","key":"5804_CR34","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1038\/s41591-018-0036-4","volume":"24","author":"M Norelli","year":"2018","unstructured":"Norelli M, Camisa B, Barbiera G, Falcone L, Purevdorj A, Genua M, Sanvito F, Ponzoni M, Doglioni C, Cristofori P, et al. Monocyte-derived IL-1 and IL-6 are differentially required for cytokine-release syndrome and neurotoxicity due to CAR T cells. Nat Med. 2018;24(6):739\u201348.","journal-title":"Nat Med"},{"issue":"10","key":"5804_CR35","doi-asserted-by":"publisher","first-page":"793","DOI":"10.1007\/s00113-005-1005-1","volume":"108","author":"F Hildebrand","year":"2005","unstructured":"Hildebrand F, Pape HC, Krettek C. Die Bedeutung der Zytokine in der posttraumatischen Entz\u00fcndungsreaktion. Unfallchirurg. 2005;108(10):793\u2013803.","journal-title":"Unfallchirurg"},{"key":"5804_CR36","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1172\/JCI11914","volume":"107","author":"Y Yamamoto","year":"2014","unstructured":"Yamamoto Y, Gaynor RB. Therapeutic potential of inhibition of the NF-\u03baB pathway in the treatment of inflammation and cancer. J Clin Investig. 2014;107:135\u201341.","journal-title":"J Clin Investig"},{"issue":"2","key":"5804_CR37","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1134\/S0006297916020024","volume":"81","author":"OS Dmitrieva","year":"2016","unstructured":"Dmitrieva OS, Shilovskiy IP, Khaitov MR, Grivennikov SI. Interleukins 1 and 6 as main mediators of inflammation and cancer. Biochem Mosc. 2016;81(2):80\u201390.","journal-title":"Biochem Mosc"},{"key":"5804_CR38","doi-asserted-by":"publisher","first-page":"3297","DOI":"10.1158\/1078-0432.CCR-16-1799","volume":"23","author":"YWZ Hu","year":"2017","unstructured":"Hu YWZ, Luo Y, Shi J, Yu J, Pu C, et al. Potent anti-leukemia activities of chimeric antigen receptor-modified T cells against CD19 in Chinese patients with relapsed\/refractory acute lymphocytic leukemia. Clin Cancer Res. 2017;23:3297\u2013306.","journal-title":"Clin Cancer Res"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-024-05804-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-024-05804-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-024-05804-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,20]],"date-time":"2024-05-20T15:03:29Z","timestamp":1716217409000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-024-05804-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,20]]},"references-count":38,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["5804"],"URL":"https:\/\/doi.org\/10.1186\/s12859-024-05804-8","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,20]]},"assertion":[{"value":"6 February 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 May 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 May 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The study was approved by the Ethic Committee of First People\u2019s Hospital Affiliated to Soochow University. We have received informed consents from individual patients who have participated in this study. All methods were carried out in accordance with relevant guidelines and regulations.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to publication"}},{"value":"No conflicts of interest were reported by any of the authors.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"197"}}