{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T06:09:42Z","timestamp":1792822182219,"version":"4.5.0"},"reference-count":68,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2024,2,3]],"date-time":"2024-02-03T00:00:00Z","timestamp":1706918400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,3]],"date-time":"2024-02-03T00:00:00Z","timestamp":1706918400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"European Union\u00b4s Horizon 2020 ,  Marie Sklodowska-Curie Action","award":["H2020-MSCA-IF-2020- 101024693"],"award-info":[{"award-number":["H2020-MSCA-IF-2020- 101024693"]}]},{"DOI":"10.13039\/501100006389","name":"University of Geneva","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006389","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Rev"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Transformers are state-of-the-art technology to support diverse Natural Language Processing (NLP) tasks, such as language translation and word\/sentence predictions. The main advantage of transformers is their ability to obtain high accuracies when processing long sequences since they avoid the vanishing gradient problem and use the attention mechanism to maintain the focus on the information that matters. These features are fostering the use of transformers in other domains beyond NLP. This paper employs a systematic protocol to identify and analyze studies that propose new transformers\u2019 architectures for processing longitudinal health datasets, which are often dense, and specifically focused on physiological, symptoms, functioning, and other daily life data. Our analysis considered 21 of 456 initial papers, collecting evidence to characterize how recent studies modified or extended these architectures to handle longitudinal multifeatured health representations or provide better ways to generate outcomes. Our findings suggest, for example, that the main efforts are focused on methods to integrate multiple vocabularies, encode input data, and represent temporal notions among longitudinal dependencies. We comprehensively discuss these and other findings, addressing major issues that are still open to efficiently deploy transformers architectures for longitudinal multifeatured healthcare data analysis.<\/jats:p>","DOI":"10.1007\/s10462-023-10677-z","type":"journal-article","created":{"date-parts":[[2024,2,3]],"date-time":"2024-02-03T05:02:05Z","timestamp":1706936525000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":37,"title":["Transformers in health: a systematic review on architectures for longitudinal data analysis"],"prefix":"10.1007","volume":"57","author":[{"given":"Clauirton A.","family":"Siebra","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mascha","family":"Kurpicz-Briki","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katarzyna","family":"Wac","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,2,3]]},"reference":[{"issue":"310","key":"10677_CR1","first-page":"1","volume":"20","author":"J Amann","year":"2020","unstructured":"Amann J et al (2020) Explainability for artificial intelligence in healthcare: a multidisciplinary perspective. BMC Med Inform Decis Mak 20(310):1\u20139","journal-title":"BMC Med Inform Decis Mak"},{"key":"10677_CR2","first-page":"1","volume":"4207940","author":"Y An","year":"2022","unstructured":"An Y, Liu Y, Chen X, Sheng Y, Ho\u0161ovsk\u00fd A (2022) TERTIAN: clinical endpoint prediction in ICU via time-aware transformer-based hierarchical attention network. Comput Intell Neurosci 4207940:1\u201313","journal-title":"Comput Intell Neurosci"},{"key":"10677_CR3","unstructured":"Bao H, Dong L, Wei F (2021) Beit: Bert pre-training of image transformers, arXiv preprint arXiv:2106.08254"},{"key":"10677_CR4","doi-asserted-by":"crossref","unstructured":"Boursalie O, Samavi R, Doyle TE (2021) Decoder transformer for temporally-embedded health outcome predictions. In: 20th IEEE International conference on machine learning and applications (ICMLA), pp 1461\u20131467","DOI":"10.1109\/ICMLA52953.2021.00235"},{"issue":"4","key":"10677_CR5","doi-asserted-by":"publisher","first-page":"e17787","DOI":"10.2196\/17787","volume":"8","author":"YP Chen","year":"2020","unstructured":"Chen YP, Chen YY, Lin JJ, Huang CH, Lai F (2020) Modified bidirectional encoder representations from transformers extractive summarization model for hospital information systems based on character-level tokens (AlphaBERT): development and performance evaluation. JMIR Med Inform 8(4):e17787","journal-title":"JMIR Med Inform"},{"key":"10677_CR8","unstructured":"Chen D et al. (2021a) Early detection of post-surgical complications using time-series electronic health records. In: AMIA summits on translational science proceedings, pp 152\u2013160"},{"issue":"1","key":"10677_CR6","doi-asserted-by":"publisher","first-page":"e25113","DOI":"10.2196\/25113","volume":"23","author":"YP Chen","year":"2021","unstructured":"Chen YP, Lo YH, Lai F, Huang CH (2021b) Disease concept-embedding based on the self-supervised method for medical information extraction from electronic health records and disease retrieval: algorithm development and validation study. J Med Internet Res 23(1):e25113","journal-title":"J Med Internet Res"},{"issue":"5","key":"10677_CR7","doi-asserted-by":"publisher","first-page":"e38241","DOI":"10.2196\/38241","volume":"10","author":"PF Chen","year":"2022","unstructured":"Chen PF et al (2022) Predicting postoperative mortality with deep neural networks and natural language processing: model development and validation. JMIR Med Inform 10(5):e38241","journal-title":"JMIR Med Inform"},{"key":"10677_CR9","unstructured":"Culurciello E (2018) The fall of RNN\/LSTM, towards data science. https:\/\/towardsdatascience.com\/the-fall-of-rnn-lstm-2d1594c74ce0. Accessed 26 July 2023"},{"issue":"11","key":"10677_CR10","doi-asserted-by":"publisher","first-page":"3268","DOI":"10.1109\/JBHI.2020.2984931","volume":"24","author":"S Darabi","year":"2020","unstructured":"Darabi S, Kachuee M, Fazeli S, Sarrafzadeh M (2020) Taper: time-aware patient ehr representation. IEEE J Biomed Health Inform 24(11):3268\u20133275","journal-title":"IEEE J Biomed Health Inform"},{"key":"10677_CR11","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K (2018) Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805"},{"key":"10677_CR12","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780198524847.001.0001","volume-title":"Analysis of longitudinal data","author":"P Diggle","year":"2002","unstructured":"Diggle P, Diggle PJ, Heagerty P, Liang KY, Zeger S (2002) Analysis of longitudinal data. Oxford University Press, Oxford"},{"key":"10677_CR13","doi-asserted-by":"crossref","unstructured":"Dong G, Tang M, Cai L, Barnes LE, Boukhechba M (2021) Semi-supervised graph instance transformer for mental health inference. In: 20th IEEE International conference on machine learning and applications (ICMLA), pp 1221\u20131228","DOI":"10.1109\/ICMLA52953.2021.00198"},{"key":"10677_CR14","unstructured":"Dufter P, Schmitt M, Schutze H (2021) Position information in transformers: an overview, arXiv preprint arXiv:2102.11090."},{"issue":"4","key":"10677_CR15","doi-asserted-by":"publisher","first-page":"e26353","DOI":"10.2196\/26353","volume":"10","author":"L Falissard","year":"2022","unstructured":"Falissard L, Morgand C, Ghosn W, Imbaud C, Bounebache K, Rey G (2022) Neural translation and automated recognition of ICD-10 medical entities from natural language: model development and performance assessment. JMIR Med Inform 10(4):e26353","journal-title":"JMIR Med Inform"},{"key":"10677_CR16","doi-asserted-by":"crossref","unstructured":"Florez AY, Scabora L, Eler DM, Rodrigues JF (2021) APEHR: automated prognosis in electronic health records using multi-head self-attention. In: IEEE 34th international symposium on computer-based medical systems (CBMS), pp 277\u2013282","DOI":"10.1109\/CBMS52027.2021.00077"},{"key":"10677_CR17","unstructured":"Fouladvand S et al (2021) Identifying opioid use disorder from longitudinal healthcare data using a multi-stream transformer. In: AMIA annual symposium proceedings. American Medical Informatics Association, pp 476\u2013485"},{"key":"10677_CR18","doi-asserted-by":"crossref","unstructured":"Fu Y et al (2022) A resource-efficient deep learning framework for low-dose brain PET image reconstruction and analysis. In: IEEE 19th International symposium on biomedical imaging (ISBI), pp 1\u20135","DOI":"10.1109\/ISBI52829.2022.9761617"},{"issue":"11","key":"10677_CR19","doi-asserted-by":"publisher","first-page":"e745","DOI":"10.1016\/S2589-7500(21)00208-9","volume":"3","author":"M Ghassemi","year":"2021","unstructured":"Ghassemi M, Oakden-Rayner L, Beam AL (2021) The false hope of current approaches to explainable artificial intelligence in health care. Lancet Digit Health 3(11):e745\u2013e750","journal-title":"Lancet Digit Health"},{"issue":"1","key":"10677_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12911-020-01345-1","volume":"21","author":"A Guo","year":"2021","unstructured":"Guo A, Beheshti R, Khan YM, Langabeer JR, Foraker RE (2021) Predicting cardiovascular health trajectories in time-series electronic health records with LSTM models. BMC Med Inform Decis Mak 21(1):1\u201310","journal-title":"BMC Med Inform Decis Mak"},{"key":"10677_CR21","unstructured":"He K et al (2022) Transformers in medical image analysis: a review, arXiv preprint arXiv:2202.12165"},{"key":"10677_CR22","unstructured":"Huang K, Altosaar J, Ranganath R (2019) ClinicalBERT: modeling clinical notes and predicting hospital readmission. arXiv preprint arXiv:1904.05342"},{"key":"10677_CR23","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1016\/j.patrec.2021.06.030","volume":"150","author":"M Ivanovs","year":"2021","unstructured":"Ivanovs M, Kadikis R, Ozols K (2021) Perturbation-based methods for explaining deep neural networks: a survey. Pattern Recogn Lett 150:228\u2013234","journal-title":"Pattern Recogn Lett"},{"key":"10677_CR24","doi-asserted-by":"crossref","unstructured":"Jagannatha AN, Yu H (2016) Bidirectional RNN for medical event detection in electronic health records. In: Proceedings of the conference. Association for Computational Linguistics, North American Chapter. Meeting, vol 2016, pp 473\u2013482","DOI":"10.18653\/v1\/N16-1056"},{"issue":"10s","key":"10677_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3505244","volume":"54","author":"S Khan","year":"2022","unstructured":"Khan S, Naseer M, Hayat M, Zamir SW, Khan FS, Shah M (2022) Transformers in vision: a survey. ACM Comput Surv (CSUR) 54(10s):1\u201341","journal-title":"ACM Comput Surv (CSUR)"},{"key":"10677_CR26","unstructured":"Kitchenham B (2004) Procedures for performing systematic reviews. Keele University, Keele, vol 33, pp 1\u201326"},{"issue":"1","key":"10677_CR27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-019-56847-4","volume":"10","author":"Y Li","year":"2020","unstructured":"Li Y et al (2020) BEHRT: transformer for electronic health records. Sci Rep 10(1):1\u201312","journal-title":"Sci Rep"},{"key":"10677_CR28","doi-asserted-by":"publisher","first-page":"103894","DOI":"10.1016\/j.jbi.2021.103894","volume":"122","author":"L Li","year":"2021","unstructured":"Li L, Jiang Y, Huang B (2021) Long-term prediction for temporal propagation of seasonal influenza using Transformer-based model. J Biomed Inform 122:103894","journal-title":"J Biomed Inform"},{"issue":"2","key":"10677_CR29","doi-asserted-by":"publisher","first-page":"1106","DOI":"10.1109\/JBHI.2022.3224727","volume":"27","author":"Y Li","year":"2023","unstructured":"Li Y et al (2023a) Hi-BEHRT: hierarchical transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health records. IEEE J Biomed Health Inform 27(2):1106\u20131117","journal-title":"IEEE J Biomed Health Inform"},{"key":"10677_CR30","first-page":"221","volume":"12464","author":"T Li","year":"2023","unstructured":"Li T et al (2023b) Time-distance vision transformers in lung cancer diagnosis from longitudinal computed tomography. Med Imaging 12464:221\u2013230","journal-title":"Med Imaging"},{"key":"10677_CR31","doi-asserted-by":"crossref","unstructured":"Lin T, Wang Y, Liu X, Qiu X (2022) A survey of transformers\u00a0AI Open (In press)","DOI":"10.1016\/j.aiopen.2022.10.001"},{"key":"10677_CR33","doi-asserted-by":"crossref","unstructured":"Liu Y, Yang Y, Jiang W, Wang T, Lei B (2021a) 3d deep attentive u-net with transformer for breast tumor segmentation from automated breast volume scanner. In: 43rd Annual international conference of the IEEE Engineering in Medicine & Biology Society, pp 4011\u20134014","DOI":"10.1109\/EMBC46164.2021.9629523"},{"key":"10677_CR34","unstructured":"Liu Y et al (2021b) A survey of visual transformers, arXiv preprint arXiv:2111.06091"},{"key":"10677_CR32","doi-asserted-by":"publisher","first-page":"120267","DOI":"10.1016\/j.neuroimage.2023.120267","volume":"277","author":"L Liu","year":"2023","unstructured":"Liu L, Liu S, Zhang L, To XV, Nasrallah F, Chandra SS (2023) Cascaded multi-modal mixing transformers for alzheimer\u2019s disease classification with incomplete data. Neuroimage 277:120267","journal-title":"Neuroimage"},{"issue":"11","key":"10677_CR35","doi-asserted-by":"publisher","first-page":"e22508","DOI":"10.2196\/22508","volume":"8","author":"D Mahajan","year":"2020","unstructured":"Mahajan D et al (2020) Identification of semantically similar sentences in clinical notes: Iterative intermediate training using multi-task learning. JMIR Med Inform 8(11):e22508","journal-title":"JMIR Med Inform"},{"key":"10677_CR36","doi-asserted-by":"crossref","unstructured":"Mao S, Sejdi\u0107 E (2022) A review of recurrent neural network-based methods in computational physiology. In: IEEE transactions on neural networks and learning systems","DOI":"10.1109\/TNNLS.2022.3145365"},{"key":"10677_CR37","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1016\/j.jclinepi.2017.04.013","volume":"89","author":"NE Mayo","year":"2017","unstructured":"Mayo NE, Figueiredo S, Ahmed S, Bartlett SJ (2017) Montreal accord on patient-reported outcomes (pros) use series\u2013paper 2: terminology proposed to measure what matters in health. J Clin Epidemiol 89:119\u2013124","journal-title":"J Clin Epidemiol"},{"issue":"8","key":"10677_CR38","doi-asserted-by":"publisher","first-page":"3121","DOI":"10.1109\/JBHI.2021.3063721","volume":"25","author":"Y Meng","year":"2021","unstructured":"Meng Y, Speier W, Ong MK, Arnold CW (2021) Bidirectional representation learning from transformers using multimodal electronic health record data to predict depression. IEEE J Biomed Health Inform 25(8):3121\u20133129","journal-title":"IEEE J Biomed Health Inform"},{"key":"10677_CR39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/JTEHM.2021.3134096","volume":"10","author":"AK Mondal","year":"2021","unstructured":"Mondal AK, Bhattacharjee A, Singla P, Prathosh AP (2021) xViTCOS: explainable vision transformer based COVID-19 screening using radiography. IEEE J Transl Eng Health Med 10:1\u201310","journal-title":"IEEE J Transl Eng Health Med"},{"key":"10677_CR40","doi-asserted-by":"publisher","first-page":"266","DOI":"10.3389\/fsurg.2022.862322","volume":"9","author":"N Naik","year":"2022","unstructured":"Naik N, Hameed BM, Shetty DK, Swain D, Shah M, Paul R et al (2022) Legal and ethical consideration in artificial intelligence in healthcare: who takes responsibility? Front Surg 9:266","journal-title":"Front Surg"},{"key":"10677_CR41","unstructured":"Pang C, Jiang X, Kalluri KS, Spotnitz M, Chen R, Perotte A, Natarajan K (2021) CEHR-BERT: incorporating temporal information from structured EHR data to improve prediction tasks. In: Proceedings of machine learning for health, pp 239\u2013260"},{"key":"10677_CR42","doi-asserted-by":"crossref","unstructured":"Panigutti C, Hamon R, Hupont I, Fernandez Llorca D, Fano Yela D, Junklewitz H et al (2023). The role of explainable AI in the context of the AI Act. In: Proceedings of the 2023 ACM conference on fairness, accountability, and transparency, pp 1139\u20131150","DOI":"10.1145\/3593013.3594069"},{"key":"10677_CR43","doi-asserted-by":"crossref","unstructured":"Peng X, Long G, Shen T, Wang S, Jiang J (2021) Sequential diagnosis prediction with transformer and ontological representation. In: Proceedings of the IEEE International conference on data mining, pp 489\u2013498","DOI":"10.1109\/ICDM51629.2021.00060"},{"key":"10677_CR44","doi-asserted-by":"publisher","first-page":"21875","DOI":"10.1109\/ACCESS.2020.2968608","volume":"8","author":"S Perveen","year":"2020","unstructured":"Perveen S, Shahbaz M, Saba T, Keshavjee K, Rehman A, Guergachi A (2020) Handling irregularly sampled longitudinal data and prognostic modeling of diabetes using machine learning technique. IEEE Access 8:21875\u201321885","journal-title":"IEEE Access"},{"issue":"1","key":"10677_CR45","first-page":"453","volume":"35","author":"PKS Prakash","year":"2021","unstructured":"Prakash PKS, Chilukuri S, Ranade N, Viswanathan S (2021) RareBERT: transformer architecture for rare disease patient identification using administrative claims. Proc AAAI Conf Artif Intell 35(1):453\u2013460","journal-title":"Proc AAAI Conf Artif Intell"},{"issue":"7","key":"10677_CR47","doi-asserted-by":"publisher","first-page":"3362","DOI":"10.1109\/JBHI.2022.3148820","volume":"26","author":"S Rao","year":"2022","unstructured":"Rao S et al (2022a) An explainable transformer-based deep learning model for the prediction of incident heart failure. IEEE J Biomed Health Inform 26(7):3362\u20133372","journal-title":"IEEE J Biomed Health Inform"},{"key":"10677_CR46","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2022.3183864","author":"S Rao","year":"2022","unstructured":"Rao S et al (2022b) Targeted-BEHRT: deep learning for observational causal inference on longitudinal electronic health records. IEEE Trans Neural Netw Learn Syst. https:\/\/doi.org\/10.1109\/TNNLS.2022.3183864","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"1","key":"10677_CR48","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-021-00455-y","volume":"4","author":"L Rasmy","year":"2021","unstructured":"Rasmy L, Xiang Y, Xie Z, Tao C, Zhi D (2021) Med-BERT: pretrained contextualized embeddings on large-scale structured electronic health records for disease prediction. NPJ Digit Med 4(1):1\u201313","journal-title":"NPJ Digit Med"},{"key":"10677_CR49","doi-asserted-by":"crossref","unstructured":"Ren H, Wang J, Zhao WX, Wu N (2021) Rapt: pre-training of time-aware transformer for learning robust healthcare representation. In: Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining,\u00a0pp. 3503\u20133511","DOI":"10.1145\/3447548.3467069"},{"issue":"9","key":"10677_CR50","doi-asserted-by":"publisher","first-page":"e555","DOI":"10.1016\/S2589-7500(21)00101-1","volume":"3","author":"K Severson","year":"2021","unstructured":"Severson K et al (2021) Discovery of Parkinson\u2019s disease states and disease progression modelling: a longitudinal data study using machine learning. Lancet Digital Health 3(9):e555\u2013e564","journal-title":"Lancet Digital Health"},{"key":"10677_CR51","doi-asserted-by":"crossref","unstructured":"Shibly MMA, Tisha TA, Islam MK, Uddin MM (2020) Transfer learning in classifying prescriptions and keyword-based medical notes. In: the 22nd International conference on information integration and web-based applications & services, pp. 82\u201390","DOI":"10.1145\/3428757.3429139"},{"key":"10677_CR52","doi-asserted-by":"crossref","unstructured":"Shome D (2021) RestHAR: residual feature learning transformer for human activity recognition from multi-sensor data. In: 8th International conference on soft computing & machine intelligence (ISCMI), pp. 181\u2013185","DOI":"10.1109\/ISCMI53840.2021.9654816"},{"key":"10677_CR53","doi-asserted-by":"publisher","first-page":"2199","DOI":"10.1001\/jama.2018.17163","volume":"320","author":"EH Shortliffe","year":"2018","unstructured":"Shortliffe EH, Sep\u00falveda MJ (2018) Clinical decision support in the era of artificial intelligence. J Am Med Assoc 320:2199\u20132200","journal-title":"J Am Med Assoc"},{"key":"10677_CR54","doi-asserted-by":"crossref","unstructured":"Siebra C, Matias I, Wac K (2022) Behavioral data categorization for transformers-based models in digital health. In: 2022 IEEE-EMBS International conference on biomedical and health informatics (BHI), Ioannina, Greece, pp 01\u201304","DOI":"10.1109\/BHI56158.2022.9926938"},{"key":"10677_CR55","doi-asserted-by":"crossref","unstructured":"Svyatkovskiy A, Deng SK, Fu S, Sundaresan N (2020) Intellicode compose: code generation using transformer. In: the 28th ACM joint meeting on European software engineering conference and symposium on the foundations of software engineering, pp 1433\u20131443","DOI":"10.1145\/3368089.3417058"},{"key":"10677_CR56","doi-asserted-by":"crossref","unstructured":"Tabarestani S et al (2019) Longitudinal prediction modeling of Alzheimer disease using recurrent neural networks. In: 2019 IEEE EMBS international. Conference on biomedical & health informatics (BHI), pp 1\u20134","DOI":"10.1109\/BHI.2019.8834556"},{"key":"10677_CR57","unstructured":"Vaswani A et al (2017) Attention is all you need. In: Advances in neural information processing systems, vol 30"},{"key":"10677_CR58","doi-asserted-by":"crossref","unstructured":"Vig J (2019) A multiscale visualization of attention in the transformer model. In: Proceedings of the 57th annual meeting of the Association for Computational Linguistics: system demonstrations, pp. 37\u201342","DOI":"10.18653\/v1\/P19-3007"},{"key":"10677_CR59","unstructured":"Wac K (2016) mQoL: experimental methodology for longitudinal, continuous quality of life assessment via unobtrusive, context-rich mobile computing in situ. In: The International Society for Quality-of-Life Studies Conference (ISQOLS 2016)"},{"key":"10677_CR61","doi-asserted-by":"crossref","unstructured":"Wang X et al (2019) Assessing depression risk in Chinese microblogs: a corpus and machine learning methods. In: 2019 IEEE International conference on healthcare informatics (ICHI), pp 1\u20135","DOI":"10.1109\/ICHI.2019.8904506"},{"key":"10677_CR60","doi-asserted-by":"crossref","unstructured":"Wang C, Nulty P, Lillis D (2020) A comparative study on word embeddings in deep learning for text classification. In: Proceedings of the 4th International conference on natural language processing and information retrieval, pp 37\u201346","DOI":"10.1145\/3443279.3443304"},{"key":"10677_CR62","doi-asserted-by":"crossref","unstructured":"Wen Q, Zhou T, Zhang C, Chen W, Ma Z, Yan J, Sun L (2022) Transformers in time series: a survey, arXiv preprint arXiv:2202.07125","DOI":"10.24963\/ijcai.2023\/759"},{"key":"10677_CR63","doi-asserted-by":"crossref","unstructured":"Yan T, Meng H, Liu S, Parada-Cabaleiro E, Ren Z, Schuller BW (2022) Convoluational transformer with adaptive position embedding for Covid-19 detection from cough sounds. In: 2022 IEEE International conference on acoustics, speech and signal processing (ICASSP), pp 9092\u20139096","DOI":"10.1109\/ICASSP43922.2022.9747513"},{"issue":"1","key":"10677_CR64","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1038\/s41746-022-00742-2","volume":"5","author":"X Yang","year":"2022","unstructured":"Yang X, Chen A, PourNejatian N, Shin HC, Smith KE, Parisien C et al (2022) A large language model for electronic health records. NPJ Digit Med 5(1):194","journal-title":"NPJ Digit Med"},{"issue":"5","key":"10677_CR65","doi-asserted-by":"publisher","first-page":"3246","DOI":"10.1002\/mp.15561","volume":"49","author":"Y Yao","year":"2022","unstructured":"Yao Y, Yu W, Gao Y, Dong J, Xiao Q, Huang B, Shi Z (2022) W-Transformer: accurate Cobb angles estimation by using a transformer-based hybrid structure. Med Phys 49(5):3246\u20133262","journal-title":"Med Phys"},{"key":"10677_CR66","doi-asserted-by":"crossref","unstructured":"Ye M, Luo J, Xiao C, Ma F (2020) Lsan: modeling long-term dependencies and short-term correlations with hierarchical attention for risk prediction. In: 29th ACM International conference on information & knowledge management, pp 1753\u20131762","DOI":"10.1145\/3340531.3411864"},{"issue":"1","key":"10677_CR67","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-021-99269-x","volume":"12","author":"X Zeng","year":"2022","unstructured":"Zeng X, Linwood SL, Liu C (2022) Pretrained transformer framework on pediatric claims data for population specific tasks. Sci Rep 12(1):1\u201313","journal-title":"Sci Rep"},{"issue":"1","key":"10677_CR68","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-018-37186-2","volume":"9","author":"J Zhao","year":"2019","unstructured":"Zhao J et al (2019) Learning from longitudinal data in electronic health record and genetic data to improve cardiovascular event prediction. Sci Rep 9(1):1\u201310","journal-title":"Sci Rep"}],"container-title":["Artificial Intelligence Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-023-10677-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10462-023-10677-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-023-10677-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,23]],"date-time":"2024-02-23T07:15:57Z","timestamp":1708672557000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10462-023-10677-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,3]]},"references-count":68,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,2]]}},"alternative-id":["10677"],"URL":"https:\/\/doi.org\/10.1007\/s10462-023-10677-z","relation":{},"ISSN":["1573-7462"],"issn-type":[{"value":"1573-7462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,3]]},"assertion":[{"value":"3 February 2024","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"32"}}