{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,29]],"date-time":"2026-06-29T11:47:12Z","timestamp":1782733632931,"version":"3.54.5"},"reference-count":275,"publisher":"World Scientific Pub Co Pte Ltd","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["World Sci. Ann. Rev. Artif. Intell."],"published-print":{"date-parts":[[2023,1]]},"abstract":"<jats:p>With advanced imaging, sequencing, and profiling technologies, multiple omics data become increasingly available and hold promises for many healthcare applications such as cancer diagnosis and treatment. Multimodal learning for integrative multi-omics analysis can help researchers and practitioners gain deep insights into human diseases and improve clinical decisions. However, several challenges are hindering the development in this area, including the availability of easily accessible open-source tools. This survey aims to provide an up-to-date overview of the data challenges, fusion approaches, datasets, and software tools from several new perspectives. We identify and investigate various omics data challenges that can help us understand the field better. We categorize fusion approaches comprehensively to cover existing methods in this area. We collect existing open-source tools to facilitate their broader utilization and development. We explore a broad range of omics data modalities and a list of accessible datasets. Finally, we summarize future directions that can potentially address existing gaps and answer the pressing need to advance multimodal learning for multi-omics data analysis.<\/jats:p>","DOI":"10.1142\/s2811032322500047","type":"journal-article","created":{"date-parts":[[2022,12,16]],"date-time":"2022-12-16T14:56:46Z","timestamp":1671202606000},"source":"Crossref","is-referenced-by-count":20,"title":["Multimodal Learning for Multi-omics: A Survey"],"prefix":"10.1142","volume":"01","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3075-7907","authenticated-orcid":false,"given":"Sina","family":"Tabakhi","sequence":"first","affiliation":[{"name":"Department of Computer Science, The University of Sheffield, 211 Portobello, Sheffield S1 4DP, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammod Naimul Islam","family":"Suvon","sequence":"additional","affiliation":[{"name":"Department of Computer Science, The University of Sheffield, 211 Portobello, Sheffield S1 4DP, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pegah","family":"Ahadian","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Shahid Beheshti University, Shahid Shahriari Square, Evin, Tehran, Iran"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0349-2181","authenticated-orcid":false,"given":"Haiping","family":"Lu","sequence":"additional","affiliation":[{"name":"Department of Computer Science, The University of Sheffield, 211 Portobello, Sheffield S1 4DP, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"219","published-online":{"date-parts":[[2023,2,16]]},"reference":[{"key":"S2811032322500047BIB001","unstructured":"J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee and A. Ng , Proc 28th Int Conf on Machine Learning (ICML-11), New York, NY, USA, 2011, pp. 689\u2013696."},{"key":"S2811032322500047BIB002","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2798607"},{"key":"S2811032322500047BIB003","author":"Xu P.","year":"2022","journal-title":"Multimodal Learning with Transformers: A Survey"},{"key":"S2811032322500047BIB004","doi-asserted-by":"publisher","DOI":"10.1186\/s40246-020-00287-z"},{"key":"S2811032322500047BIB005","unstructured":"Y. Mroueh, E. Marcheret and V. Goel , Proc 2015 IEEE Int Conf on Acoustics, Speech and Signal Processing (ICASSP), 2015, pp. 2130\u20132134."},{"key":"S2811032322500047BIB006","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2019.2947482"},{"key":"S2811032322500047BIB007","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCC.2010.2050476"},{"key":"S2811032322500047BIB008","author":"Liang P. P.","year":"2018","journal-title":"Multimodal Language Analysis with Recurrent Multistage Fusion"},{"key":"S2811032322500047BIB009","doi-asserted-by":"publisher","DOI":"10.1007\/s11227-019-03101-3"},{"key":"S2811032322500047BIB010","doi-asserted-by":"publisher","DOI":"10.1016\/j.biotechadv.2021.107739"},{"key":"S2811032322500047BIB011","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbab454"},{"key":"S2811032322500047BIB012","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-020-01225-8"},{"key":"S2811032322500047BIB013","doi-asserted-by":"publisher","DOI":"10.1016\/j.csbj.2021.06.030"},{"key":"S2811032322500047BIB014","doi-asserted-by":"publisher","DOI":"10.3389\/fgene.2018.00242"},{"key":"S2811032322500047BIB015","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2015.05.022"},{"key":"S2811032322500047BIB016","doi-asserted-by":"publisher","DOI":"10.3389\/fbioe.2020.00006"},{"key":"S2811032322500047BIB017","doi-asserted-by":"publisher","DOI":"10.1016\/j.bbcan.2021.188588"},{"key":"S2811032322500047BIB018","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-022-01981-2"},{"key":"S2811032322500047BIB019","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2202113119"},{"key":"S2811032322500047BIB020","doi-asserted-by":"publisher","DOI":"10.3389\/fgene.2020.610798"},{"key":"S2811032322500047BIB021","doi-asserted-by":"publisher","DOI":"10.1038\/ng.2764"},{"key":"S2811032322500047BIB022","first-page":"bar026","volume":"2011","author":"Zhang J.","year":"2011","journal-title":"Database"},{"key":"S2811032322500047BIB023","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-20430-7"},{"key":"S2811032322500047BIB024","doi-asserted-by":"publisher","DOI":"10.1177\/1177932219899051"},{"key":"S2811032322500047BIB025","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2020.103466"},{"key":"S2811032322500047BIB026","doi-asserted-by":"publisher","DOI":"10.3390\/genes10020087"},{"key":"S2811032322500047BIB027","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2020.01030"},{"key":"S2811032322500047BIB028","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1007677"},{"key":"S2811032322500047BIB029","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejca.2011.11.036"},{"key":"S2811032322500047BIB030","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroscience.2009.01.027"},{"key":"S2811032322500047BIB031","doi-asserted-by":"publisher","DOI":"10.1038\/nrg.2018.4"},{"key":"S2811032322500047BIB032","doi-asserted-by":"publisher","DOI":"10.1016\/j.margen.2016.04.012"},{"key":"S2811032322500047BIB033","doi-asserted-by":"publisher","DOI":"10.1038\/73723"},{"key":"S2811032322500047BIB034","doi-asserted-by":"publisher","DOI":"10.3389\/fgene.2020.00424"},{"key":"S2811032322500047BIB035","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.0000058"},{"key":"S2811032322500047BIB036","doi-asserted-by":"publisher","DOI":"10.1186\/1479-7364-4-2-69"},{"key":"S2811032322500047BIB037","doi-asserted-by":"publisher","DOI":"10.1182\/blood.V93.12.4059"},{"key":"S2811032322500047BIB038","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0909344107"},{"key":"S2811032322500047BIB039","doi-asserted-by":"publisher","DOI":"10.1038\/35103511"},{"key":"S2811032322500047BIB040","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.biochem.74.082803.133212"},{"key":"S2811032322500047BIB041","doi-asserted-by":"publisher","DOI":"10.1002\/wrna.1364"},{"key":"S2811032322500047BIB042","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(00)03214-1"},{"key":"S2811032322500047BIB043","doi-asserted-by":"publisher","DOI":"10.1101\/gr.2334104"},{"key":"S2811032322500047BIB044","doi-asserted-by":"publisher","DOI":"10.1038\/nrd766"},{"key":"S2811032322500047BIB045","doi-asserted-by":"publisher","DOI":"10.1093\/jxb\/eri010"},{"key":"S2811032322500047BIB046","doi-asserted-by":"publisher","DOI":"10.1038\/nrc3610"},{"key":"S2811032322500047BIB047","doi-asserted-by":"publisher","DOI":"10.1016\/j.isci.2022.103976"},{"key":"S2811032322500047BIB048","doi-asserted-by":"publisher","DOI":"10.1186\/s41199-020-00053-7"},{"key":"S2811032322500047BIB049","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-375003-7.00006-6"},{"key":"S2811032322500047BIB050","doi-asserted-by":"publisher","DOI":"10.1038\/msb4100024"},{"key":"S2811032322500047BIB051","first-page":"5","volume":"12","author":"Aguiar-Pulido V.","year":"2016","journal-title":"Evol. Bioinform."},{"key":"S2811032322500047BIB052","doi-asserted-by":"publisher","DOI":"10.1089\/omi.2019.0149"},{"key":"S2811032322500047BIB053","doi-asserted-by":"publisher","DOI":"10.1148\/rg.2021210037"},{"key":"S2811032322500047BIB054","doi-asserted-by":"publisher","DOI":"10.3390\/cancers13112522"},{"key":"S2811032322500047BIB055","doi-asserted-by":"publisher","DOI":"10.1007\/s10278-013-9622-7"},{"key":"S2811032322500047BIB056","doi-asserted-by":"publisher","DOI":"10.1038\/nrg2897"},{"key":"S2811032322500047BIB057","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-001926"},{"key":"S2811032322500047BIB058","doi-asserted-by":"publisher","DOI":"10.1186\/s12918-018-0556-z"},{"key":"S2811032322500047BIB059","doi-asserted-by":"publisher","DOI":"10.1155\/2015\/198363"},{"key":"S2811032322500047BIB060","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0197910"},{"key":"S2811032322500047BIB061","doi-asserted-by":"publisher","DOI":"10.1016\/j.ymeth.2016.08.014"},{"key":"S2811032322500047BIB062","doi-asserted-by":"publisher","DOI":"10.3390\/ht8010004"},{"key":"S2811032322500047BIB063","unstructured":"Y. Chen, M. E. Barefoot, R. S. Varghese, K. Wang, C. Di\u00a0Poto and H. W. Ressom , Proc 2020 42nd Annu Int Conf of the IEEE Engineering in Medicine & Biology Society (EMBC), 2020, pp. 5300\u20135303."},{"key":"S2811032322500047BIB064","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-23774-w"},{"key":"S2811032322500047BIB065","unstructured":"X. Zhang, J. Zhang, K. Sun, X. Yang, C. Dai and Y. Guo , Proc 2019 IEEE Int Conf on Bioinformatics and Biomedicine (BIBM), 2019, pp. 765\u2013769."},{"key":"S2811032322500047BIB066","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-07802-6_31"},{"key":"S2811032322500047BIB067","doi-asserted-by":"publisher","DOI":"10.1016\/j.jprot.2018.12.004"},{"key":"S2811032322500047BIB068","doi-asserted-by":"publisher","DOI":"10.1142\/S0219720016500293"},{"key":"S2811032322500047BIB069","doi-asserted-by":"publisher","DOI":"10.1016\/j.jchromb.2007.10.042"},{"key":"S2811032322500047BIB070","doi-asserted-by":"publisher","DOI":"10.1186\/s12920-018-0388-0"},{"key":"S2811032322500047BIB071","doi-asserted-by":"crossref","unstructured":"S. Tabakhi and H. Lu , Proc. 44th Annu. Int. Conf. IEEE Engineering in Medicine and Biology Society (EMBC) (Glasgow, Scotland, United Kingdom, 2022), pp. 1638\u20131642.","DOI":"10.1109\/EMBC48229.2022.9871758"},{"key":"S2811032322500047BIB072","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbv108"},{"key":"S2811032322500047BIB073","doi-asserted-by":"publisher","DOI":"10.1038\/nbt0308-303"},{"key":"S2811032322500047BIB074","doi-asserted-by":"publisher","DOI":"10.1162\/089976698300017467"},{"key":"S2811032322500047BIB075","doi-asserted-by":"publisher","DOI":"10.3389\/fgene.2021.647141"},{"key":"S2811032322500047BIB076","doi-asserted-by":"publisher","DOI":"10.1002\/cem.759"},{"key":"S2811032322500047BIB077","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmva.2007.06.007"},{"key":"S2811032322500047BIB078","doi-asserted-by":"publisher","DOI":"10.1109\/34.908974"},{"key":"S2811032322500047BIB079","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-015-0857-9"},{"key":"S2811032322500047BIB080","doi-asserted-by":"publisher","DOI":"10.1093\/biostatistics\/kxp008"},{"key":"S2811032322500047BIB081","doi-asserted-by":"publisher","DOI":"10.3390\/ijms20184414"},{"key":"S2811032322500047BIB082","first-page":"783592","volume":"2015","author":"Kang M.","year":"2015","journal-title":"BioMed Res. Int."},{"key":"S2811032322500047BIB083","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-01588-5"},{"key":"S2811032322500047BIB084","author":"Amor A.","year":"2021","journal-title":"Graph Representation Learning on Tissue-specific Multi-omics"},{"key":"S2811032322500047BIB085","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btz418"},{"key":"S2811032322500047BIB086","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2022.108973"},{"key":"S2811032322500047BIB087","doi-asserted-by":"publisher","DOI":"10.1038\/s41551-022-00942-x"},{"key":"S2811032322500047BIB088","author":"Ektefaie Y.","year":"2022","journal-title":"Multimodal Representation Learning on Graphs"},{"key":"S2811032322500047BIB089","unstructured":"R. Roelofs, V. Shankar, B. Recht, S. Fridovich-Keil, M. Hardt, J. Miller and L. Schmidt , Proc 33rd Int Conf on Neural Information Processing Systems, 2019, pp. 9179\u20139189."},{"key":"S2811032322500047BIB090","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2010.03.005"},{"key":"S2811032322500047BIB091","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btw560"},{"key":"S2811032322500047BIB092","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-022-30792-9"},{"key":"S2811032322500047BIB093","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-019-0192-5"},{"key":"S2811032322500047BIB094","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2006.17"},{"key":"S2811032322500047BIB095","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-85285-4"},{"key":"S2811032322500047BIB096","first-page":"1625","volume":"8","author":"Saar-Tsechansky M.","year":"2007","journal-title":"J. Mach. Learn. Res."},{"key":"S2811032322500047BIB097","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-021-00516-9"},{"key":"S2811032322500047BIB098","doi-asserted-by":"publisher","DOI":"10.3389\/fgene.2020.570255"},{"key":"S2811032322500047BIB099","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2021.0184"},{"key":"S2811032322500047BIB100","doi-asserted-by":"publisher","DOI":"10.1016\/B978-012369531-4\/50006-8"},{"key":"S2811032322500047BIB101","doi-asserted-by":"publisher","DOI":"10.3390\/genes10090652"},{"key":"S2811032322500047BIB102","doi-asserted-by":"publisher","DOI":"10.1186\/s12963-021-00274-z"},{"key":"S2811032322500047BIB103","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-016-1122-6"},{"key":"S2811032322500047BIB104","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-018-03621-1"},{"key":"S2811032322500047BIB105","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-019-11874-7"},{"key":"S2811032322500047BIB106","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-016-1273-5"},{"key":"S2811032322500047BIB107","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/bty775"},{"key":"S2811032322500047BIB108","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btz058"},{"key":"S2811032322500047BIB109","volume-title":"Proc AAAI Conf on Artificial Intelligence","author":"Li S.-Y.","year":"2014"},{"key":"S2811032322500047BIB110","doi-asserted-by":"publisher","DOI":"10.1016\/j.ymeth.2020.08.001"},{"key":"S2811032322500047BIB111","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1008182"},{"key":"S2811032322500047BIB112","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-16937-8"},{"key":"S2811032322500047BIB113","author":"Akdemir D.","year":"2020","journal-title":"Adventures in Multi-omics: Combining Heterogeneous Datasets via Relationships Matrices"},{"key":"S2811032322500047BIB114","doi-asserted-by":"publisher","DOI":"10.1016\/j.patter.2021.100245"},{"key":"S2811032322500047BIB115","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0171324"},{"key":"S2811032322500047BIB116","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btt155"},{"key":"S2811032322500047BIB117","doi-asserted-by":"publisher","DOI":"10.1093\/gigascience\/giz080"},{"key":"S2811032322500047BIB118","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-17453-5"},{"key":"S2811032322500047BIB119","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/bty1049"},{"key":"S2811032322500047BIB120","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbx167"},{"key":"S2811032322500047BIB121","doi-asserted-by":"publisher","DOI":"10.3389\/fgene.2022.854752"},{"key":"S2811032322500047BIB122","doi-asserted-by":"publisher","DOI":"10.1186\/s12864-018-5379-1"},{"key":"S2811032322500047BIB123","doi-asserted-by":"publisher","DOI":"10.1002\/wics.1553"},{"key":"S2811032322500047BIB124","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1009224"},{"key":"S2811032322500047BIB125","doi-asserted-by":"publisher","DOI":"10.1186\/s13059-017-1215-1"},{"key":"S2811032322500047BIB126","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2018.12.003"},{"key":"S2811032322500047BIB127","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-73003-5_157"},{"key":"S2811032322500047BIB128","doi-asserted-by":"publisher","DOI":"10.1016\/j.csbj.2021.04.060"},{"key":"S2811032322500047BIB129","doi-asserted-by":"publisher","DOI":"10.1186\/1756-0381-6-23"},{"key":"S2811032322500047BIB130","first-page":"52","volume":"2016","author":"Ma S.","year":"2016","journal-title":"AMIA Jt. Summits Transl. Sci. Proc."},{"key":"S2811032322500047BIB131","doi-asserted-by":"publisher","DOI":"10.1186\/s40364-017-0082-y"},{"key":"S2811032322500047BIB132","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2020.103761"},{"key":"S2811032322500047BIB133","doi-asserted-by":"publisher","DOI":"10.1038\/nrg3868"},{"key":"S2811032322500047BIB134","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbv090"},{"key":"S2811032322500047BIB135","doi-asserted-by":"publisher","DOI":"10.1093\/toxsci\/kfn001"},{"key":"S2811032322500047BIB136","doi-asserted-by":"publisher","DOI":"10.1016\/j.aca.2020.10.038"},{"key":"S2811032322500047BIB137","doi-asserted-by":"publisher","DOI":"10.1007\/s40484-016-0063-4"},{"key":"S2811032322500047BIB138","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-017-1982-4"},{"key":"S2811032322500047BIB139","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-020-05419-z"},{"key":"S2811032322500047BIB140","doi-asserted-by":"publisher","DOI":"10.1007\/BF00994018"},{"key":"S2811032322500047BIB141","first-page":"92","volume":"71","author":"Noble W. S.","year":"2004","journal-title":"Kernel Methods Comput. Biol."},{"key":"S2811032322500047BIB142","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1000173"},{"key":"S2811032322500047BIB143","first-page":"2211","volume":"12","author":"G\u00f6nen M.","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"S2811032322500047BIB144","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/bth294"},{"key":"S2811032322500047BIB145","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btt610"},{"key":"S2811032322500047BIB146","doi-asserted-by":"publisher","DOI":"10.3390\/genes10030200"},{"key":"S2811032322500047BIB147","first-page":"211","volume":"1","author":"Tipping M. E.","year":"2001","journal-title":"J. Mach. Learn. Res."},{"key":"S2811032322500047BIB148","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btq044"},{"key":"S2811032322500047BIB149","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btx682"},{"key":"S2811032322500047BIB150","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2020.01065"},{"key":"S2811032322500047BIB151","doi-asserted-by":"publisher","DOI":"10.1038\/nmeth.2810"},{"key":"S2811032322500047BIB152","doi-asserted-by":"publisher","DOI":"10.3389\/fphy.2020.00203"},{"key":"S2811032322500047BIB153","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-002481"},{"key":"S2811032322500047BIB154","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-021-04029-3"},{"key":"S2811032322500047BIB155","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2017.2738401"},{"key":"S2811032322500047BIB156","volume-title":"Proc ESANN 2018: European Symp on Artificial Neural Networks, Computational Intelligence and Machine Learning","author":"Bica I.","year":"2018"},{"key":"S2811032322500047BIB157","doi-asserted-by":"publisher","DOI":"10.3389\/fgene.2019.00617"},{"key":"S2811032322500047BIB158","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-71676-9_11"},{"key":"S2811032322500047BIB159","first-page":"197","volume":"2018","author":"Poirion O. B.","year":"2018","journal-title":"AMIA Jt. Summits Transl. Sci. Proc."},{"key":"S2811032322500047BIB160","doi-asserted-by":"publisher","DOI":"10.3389\/fgene.2018.00477"},{"key":"S2811032322500047BIB161","first-page":"1","volume":"13","author":"Yin C.","year":"2022","journal-title":"Front. Genet."},{"key":"S2811032322500047BIB162","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkab1200"},{"key":"S2811032322500047BIB163","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-021-02166-7"},{"key":"S2811032322500047BIB164","unstructured":"Z. Ghahramani and M. Jordan , Proc 6th Int Conf on Neural Information Processing Systems, 1995, pp. 120\u2013127."},{"key":"S2811032322500047BIB165","doi-asserted-by":"publisher","DOI":"10.2174\/138920209789177575"},{"key":"S2811032322500047BIB166","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btac446"},{"key":"S2811032322500047BIB167","doi-asserted-by":"publisher","DOI":"10.1002\/gepi.21628"},{"key":"S2811032322500047BIB168","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-019-0382-7"},{"key":"S2811032322500047BIB169","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2021.12.019"},{"key":"S2811032322500047BIB170","doi-asserted-by":"publisher","DOI":"10.3389\/fgene.2017.00084"},{"key":"S2811032322500047BIB171","volume-title":"Pattern Recognition and Machine Learning","volume":"4","author":"Bishop C. M.","year":"2006"},{"key":"S2811032322500047BIB172","doi-asserted-by":"publisher","DOI":"10.15252\/msb.20178124"},{"key":"S2811032322500047BIB173","doi-asserted-by":"publisher","DOI":"10.1214\/12-AOAS597"},{"key":"S2811032322500047BIB174","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gks725"},{"key":"S2811032322500047BIB175","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btv544"},{"key":"S2811032322500047BIB176","doi-asserted-by":"publisher","DOI":"10.1111\/biom.12974"},{"key":"S2811032322500047BIB177","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btp543"},{"key":"S2811032322500047BIB178","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1208949110"},{"key":"S2811032322500047BIB179","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-011-9206-8"},{"key":"S2811032322500047BIB180","doi-asserted-by":"publisher","DOI":"10.1111\/biom.13108"},{"key":"S2811032322500047BIB181","author":"Liang P. P.","year":"2021","journal-title":"MultiBench: Multiscale Benchmarks for Multimodal Representation Learning"},{"key":"S2811032322500047BIB182","doi-asserted-by":"publisher","DOI":"10.1137\/07070111X"},{"key":"S2811032322500047BIB183","doi-asserted-by":"publisher","DOI":"10.3389\/fgene.2021.682841"},{"key":"S2811032322500047BIB184","unstructured":"V. Kuleshov, A. Chaganty and P. Liang , Proc Eighteenth Int Conf Artificial Intelligence and Statistics, 2015, pp. 507\u2013516."},{"key":"S2811032322500047BIB185","doi-asserted-by":"publisher","DOI":"10.1186\/s13059-018-1455-8"},{"key":"S2811032322500047BIB186","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2018.08.045"},{"key":"S2811032322500047BIB187","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2021.103958"},{"key":"S2811032322500047BIB188","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2015.03.020"},{"key":"S2811032322500047BIB189","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2831228"},{"key":"S2811032322500047BIB190","doi-asserted-by":"publisher","DOI":"10.3390\/jpm12040601"},{"key":"S2811032322500047BIB191","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btz318"},{"key":"S2811032322500047BIB192","doi-asserted-by":"publisher","DOI":"10.3389\/fgene.2019.00166"},{"key":"S2811032322500047BIB193","doi-asserted-by":"publisher","DOI":"10.1038\/s41581-021-00463-x"},{"key":"S2811032322500047BIB196","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/28.1.27"},{"key":"S2811032322500047BIB197","doi-asserted-by":"publisher","DOI":"10.1002\/pro.3715"},{"key":"S2811032322500047BIB198","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkaa970"},{"key":"S2811032322500047BIB199","doi-asserted-by":"publisher","DOI":"10.1126\/science.1260419"},{"key":"S2811032322500047BIB200","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1455"},{"key":"S2811032322500047BIB201","author":"Zadeh A.","year":"2016","journal-title":"MOSI: Multimodal Corpus of Sentiment Intensity and Subjectivity Analysis in Online Opinion Videos"},{"key":"S2811032322500047BIB202","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1211"},{"key":"S2811032322500047BIB204","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.35"},{"key":"S2811032322500047BIB205","unstructured":"M. A. Lee, B. Yi, R. Mart\u00edn-Mart\u00edn, S. Savarese and J. Bohg , Proc 2020 IEEE\/RSJ Int Conf on Intelligent Robots and Systems (IROS), 2020, pp. 10444\u201310451."},{"key":"S2811032322500047BIB206","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2019.2959445"},{"key":"S2811032322500047BIB207","unstructured":"L. A. Leiva, A. Hota and A. Oulasvirta , Proc 22nd Int Conf on Human-Computer Interaction with Mobile Devices and Services, 2020, pp. 1\u20134."},{"key":"S2811032322500047BIB208","author":"Kay W.","year":"2017","journal-title":"The Kinetics Human Action Video Dataset"},{"key":"S2811032322500047BIB210","author":"Arevalo J.","year":"2017","journal-title":"Gated Multimodal Units for Information Fusion"},{"key":"S2811032322500047BIB211","volume-title":"Proc European Conf on Computer Vision (ECCV) Workshops","author":"Vielzeuf V.","year":"2018"},{"key":"S2811032322500047BIB212","doi-asserted-by":"publisher","DOI":"10.1186\/s12864-015-2294-6"},{"key":"S2811032322500047BIB214","first-page":"1","volume":"12","author":"Li B.","year":"2021","journal-title":"Front. Genet."},{"key":"S2811032322500047BIB215","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-020-03921-8"},{"key":"S2811032322500047BIB216","author":"Mariette J.","year":"2017","journal-title":"Integrating TARA Oceans Datasets using Unsupervised Multiple Kernel Learning"},{"key":"S2811032322500047BIB217","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1005752"},{"key":"S2811032322500047BIB218","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2164-10-461"},{"key":"S2811032322500047BIB219","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-018-2371-3"},{"key":"S2811032322500047BIB220","doi-asserted-by":"publisher","DOI":"10.1093\/hmg\/ddp295"},{"key":"S2811032322500047BIB221","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btt703"},{"key":"S2811032322500047BIB222","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pgen.0030087"},{"key":"S2811032322500047BIB223","doi-asserted-by":"publisher","DOI":"10.1189\/jlb.0905530"},{"key":"S2811032322500047BIB224","doi-asserted-by":"publisher","DOI":"10.1038\/nbt.2488"},{"key":"S2811032322500047BIB225","doi-asserted-by":"publisher","DOI":"10.1038\/nbt1210-1248"},{"key":"S2811032322500047BIB226","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkm958"},{"key":"S2811032322500047BIB227","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gky310"},{"key":"S2811032322500047BIB228","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkn810"},{"key":"S2811032322500047BIB229","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btr499"},{"key":"S2811032322500047BIB230","doi-asserted-by":"publisher","DOI":"10.1038\/73439"},{"key":"S2811032322500047BIB231","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/15.1.72"},{"key":"S2811032322500047BIB232","doi-asserted-by":"publisher","DOI":"10.1186\/s12864-017-4399-6"},{"key":"S2811032322500047BIB233","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btx750"},{"key":"S2811032322500047BIB234","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1004321"},{"key":"S2811032322500047BIB235","doi-asserted-by":"publisher","DOI":"10.1038\/nbt.4072"},{"key":"S2811032322500047BIB236","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btx441"},{"key":"S2811032322500047BIB237","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbiotec.2005.12.027"},{"key":"S2811032322500047BIB238","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms4083"},{"key":"S2811032322500047BIB239","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btt493"},{"key":"S2811032322500047BIB240","doi-asserted-by":"publisher","DOI":"10.1074\/jbc.M109.095570"},{"key":"S2811032322500047BIB241","doi-asserted-by":"publisher","DOI":"10.1186\/1752-0509-7-64"},{"key":"S2811032322500047BIB242","doi-asserted-by":"publisher","DOI":"10.1186\/gb-2005-6-8-r66"},{"key":"S2811032322500047BIB243","doi-asserted-by":"publisher","DOI":"10.1038\/nprot.2008.211"},{"key":"S2811032322500047BIB244","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gki031"},{"key":"S2811032322500047BIB245","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkh131"},{"key":"S2811032322500047BIB246","doi-asserted-by":"publisher","DOI":"10.1104\/pp.105.060459"},{"key":"S2811032322500047BIB247","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkg076"},{"key":"S2811032322500047BIB248","doi-asserted-by":"publisher","DOI":"10.3233\/ISB-2010-0415"},{"key":"S2811032322500047BIB249","doi-asserted-by":"publisher","DOI":"10.1016\/j.immuni.2015.08.014"},{"key":"S2811032322500047BIB250","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkj109"},{"key":"S2811032322500047BIB251","doi-asserted-by":"publisher","DOI":"10.1098\/rsif.2015.0571"},{"key":"S2811032322500047BIB252","doi-asserted-by":"publisher","DOI":"10.1038\/nature12113"},{"key":"S2811032322500047BIB255","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkx1089"},{"key":"S2811032322500047BIB256","doi-asserted-by":"publisher","DOI":"10.1107\/S0907444998009378"},{"key":"S2811032322500047BIB257","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkl971"},{"key":"S2811032322500047BIB258","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gku1028"},{"key":"S2811032322500047BIB259","doi-asserted-by":"publisher","DOI":"10.1038\/nature25183"},{"key":"S2811032322500047BIB260","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(10)62101-0"},{"key":"S2811032322500047BIB261","doi-asserted-by":"publisher","DOI":"10.1038\/nrc1951"},{"key":"S2811032322500047BIB263","first-page":"21","volume":"1","author":"Schoch C. L.","year":"2020","journal-title":"Database"},{"key":"S2811032322500047BIB264","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkz828"},{"key":"S2811032322500047BIB265","doi-asserted-by":"publisher","DOI":"10.1038\/s41587-020-0546-8"},{"key":"S2811032322500047BIB266","volume-title":"Proc Workshop on Semantic Web Applications and Tools for Life Sciences","author":"Jupp S.","year":"2015"},{"key":"S2811032322500047BIB267","doi-asserted-by":"publisher","DOI":"10.1038\/nbt.3790"},{"key":"S2811032322500047BIB268","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gky889"},{"key":"S2811032322500047BIB269","doi-asserted-by":"publisher","DOI":"10.1038\/s41587-019-0055-9"},{"key":"S2811032322500047BIB270","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMp1607591"},{"key":"S2811032322500047BIB271","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkt1069"},{"key":"S2811032322500047BIB272","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkab1059"},{"key":"S2811032322500047BIB273","doi-asserted-by":"publisher","DOI":"10.1016\/j.cell.2017.06.010"},{"key":"S2811032322500047BIB274","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-022-32205-3"},{"key":"S2811032322500047BIB275","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkx1090"},{"key":"S2811032322500047BIB276","doi-asserted-by":"publisher","DOI":"10.1186\/s13244-019-0795-6"},{"key":"S2811032322500047BIB277","doi-asserted-by":"publisher","DOI":"10.1007\/s00261-019-02028-w"},{"key":"S2811032322500047BIB278","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btu854"},{"key":"S2811032322500047BIB279","doi-asserted-by":"publisher","DOI":"10.1186\/s13059-020-02100-5"},{"key":"S2811032322500047BIB280","doi-asserted-by":"publisher","DOI":"10.1038\/s41592-019-0667-5"},{"key":"S2811032322500047BIB281","doi-asserted-by":"publisher","DOI":"10.1002\/pmic.202000034"},{"key":"S2811032322500047BIB282","doi-asserted-by":"publisher","DOI":"10.1016\/j.tibtech.2012.02.002"},{"key":"S2811032322500047BIB283","author":"Chue\u00a0Hong N. P.","year":"2022","journal-title":"FAIR Principles for Research Software (FAIR4RS Principles)"}],"container-title":["World Scientific Annual Review of Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S2811032322500047","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,10]],"date-time":"2024-10-10T15:50:49Z","timestamp":1728575449000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S2811032322500047"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1]]},"references-count":275,"alternative-id":["10.1142\/S2811032322500047"],"URL":"https:\/\/doi.org\/10.1142\/s2811032322500047","relation":{},"ISSN":["2811-0323","2811-0331"],"issn-type":[{"value":"2811-0323","type":"print"},{"value":"2811-0331","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1]]},"article-number":"2250004"}}