{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,10]],"date-time":"2026-10-10T05:02:49Z","timestamp":1791608569795,"version":"4.3.4"},"reference-count":74,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,6,15]],"date-time":"2024-06-15T00:00:00Z","timestamp":1718409600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,6,15]],"date-time":"2024-06-15T00:00:00Z","timestamp":1718409600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Data"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In low- and middle-income countries, the substantial costs associated with traditional data collection pose an obstacle to facilitating decision-making in the field of public health. Satellite imagery offers a potential solution, but the image extraction and analysis can be costly and requires specialized expertise. We introduce SatelliteBench, a scalable framework for satellite image extraction and vector embeddings generation. We also propose a novel multimodal fusion pipeline that utilizes a series of satellite imagery and metadata. The framework was evaluated generating a dataset with a collection of 12,636 images and embeddings accompanied by comprehensive metadata, from 81 municipalities in Colombia between 2016 and 2018. The dataset was then evaluated in 3 tasks: including dengue case prediction, poverty assessment, and access to education. The performance showcases the versatility and practicality of SatelliteBench, offering a reproducible, accessible and open tool to enhance decision-making in public health.<\/jats:p>","DOI":"10.1038\/s41597-024-03366-1","type":"journal-article","created":{"date-parts":[[2024,6,15]],"date-time":"2024-06-15T12:01:59Z","timestamp":1718452919000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["A multimodal framework for extraction and fusion of satellite images and public health data"],"prefix":"10.1038","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0818-3898","authenticated-orcid":false,"given":"Dana","family":"Moukheiber","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3789-1957","authenticated-orcid":false,"given":"David","family":"Restrepo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0579-6178","authenticated-orcid":false,"given":"Sebasti\u00e1n Andr\u00e9s","family":"Cajas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mar\u00eda Patricia Arbel\u00e1ez","family":"Montoya","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leo Anthony","family":"Celi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kuan-Ting","family":"Kuo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diego M.","family":"L\u00f3pez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lama","family":"Moukheiber","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mira","family":"Moukheiber","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sulaiman","family":"Moukheiber","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juan Sebastian","family":"Osorio-Valencia","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Saptarshi","family":"Purkayastha","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Atika Rahman","family":"Paddo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenwei","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4020-3147","authenticated-orcid":false,"given":"Po-Chih","family":"Kuo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,6,15]]},"reference":[{"key":"3366_CR1","unstructured":"United Nations. THE 17 GOALS | sustainable development (2023)."},{"key":"3366_CR2","doi-asserted-by":"publisher","unstructured":"Castro, D. A. & \u00c3lvarez, M. A. Predicting socioeconomic indicators using transfer learning on imagery data: an application in brazil, https:\/\/doi.org\/10.1007\/s10708-022-10618-3.","DOI":"10.1007\/s10708-022-10618-3"},{"key":"3366_CR3","doi-asserted-by":"publisher","unstructured":"Hall, O., Ohlsson, M. & R\u00f6gnvaldsson, T. A review of explainable AI in the satellite data, deep machine learning, and human poverty domain, https:\/\/doi.org\/10.1016\/j.patter.2022.100600.","DOI":"10.1016\/j.patter.2022.100600"},{"key":"3366_CR4","doi-asserted-by":"publisher","unstructured":"Hargreaves, P. K. & Watmough, G. R. Satellite earth observation to support sustainable rural development, https:\/\/doi.org\/10.1016\/j.jag.2021.102466.","DOI":"10.1016\/j.jag.2021.102466"},{"key":"3366_CR5","doi-asserted-by":"publisher","unstructured":"Kaselimi, M., Voulodimos, A., Daskalopoulos, I., Doulamis, N. & Doulamis, A. A vision transformer model for convolution-free multilabel classification of satellite imagery in deforestation monitoring, https:\/\/doi.org\/10.1109\/TNNLS.2022.3144791.","DOI":"10.1109\/TNNLS.2022.3144791"},{"key":"3366_CR6","unstructured":"Restrepo, D. S., P\u00e9rez, L. E., L\u00f3pez, D. M., Vargas-Ca\u00f1as, R. & Osorio-Valencia, J. S. Multi-dimensional dataset of open data and satellite images for characterization of food security and nutrition."},{"key":"3366_CR7","doi-asserted-by":"publisher","unstructured":"Jean, N. et al. Combining satellite imagery and machine learning to predict poverty. https:\/\/doi.org\/10.1126\/science.aaf7894.","DOI":"10.1126\/science.aaf7894"},{"key":"3366_CR8","doi-asserted-by":"publisher","unstructured":"Chitturi, V. & Nabulsi, Z. Predicting poverty level from satellite imagery using deep neural networks, https:\/\/doi.org\/10.48550\/arXiv.2112.00011.","DOI":"10.48550\/arXiv.2112.00011"},{"key":"3366_CR9","doi-asserted-by":"publisher","unstructured":"Bhatia, S. et al. A retrospective study of climate change affecting dengue: Evidences, challenges and future directions, https:\/\/doi.org\/10.3389\/fpubh.2022.884645.","DOI":"10.3389\/fpubh.2022.884645"},{"key":"3366_CR10","doi-asserted-by":"publisher","unstructured":"Kuo, K.-T. et al. DengueNet: Dengue prediction using spatiotemporal satellite imagery for resource-limited countries. https:\/\/doi.org\/10.48550\/ARXIV.2401.11114.","DOI":"10.48550\/ARXIV.2401.11114"},{"key":"3366_CR11","doi-asserted-by":"publisher","unstructured":"Kurane, I. The effect of global warming on infectious diseases, https:\/\/doi.org\/10.1016\/j.phrp.2010.12.004.","DOI":"10.1016\/j.phrp.2010.12.004"},{"key":"3366_CR12","unstructured":"Gibbons, R. V. & Vaughn, D. W. Dengue: an escalating problem."},{"key":"3366_CR13","doi-asserted-by":"publisher","unstructured":"Schmidt, W.-P. et al. Population density, water supply, and the risk of dengue fever in vietnam: Cohort study and spatial analysis. Publisher: Public Library of Science, https:\/\/doi.org\/10.1371\/journal.pmed.1001082.","DOI":"10.1371\/journal.pmed.1001082"},{"key":"3366_CR14","doi-asserted-by":"publisher","unstructured":"Shepard, D. S., Coudeville, L., Halasa, Y. A., Zambrano, B. & Dayan, G. H. Economic impact of dengue illness in the americas, https:\/\/doi.org\/10.4269\/ajtmh.2011.10-0503.","DOI":"10.4269\/ajtmh.2011.10-0503"},{"key":"3366_CR15","doi-asserted-by":"publisher","unstructured":"Zhang, X., Zhou, X., Lin, M. & Sun, J. ShuffleNet: An extremely efficient convolutional neural network for mobile devices, https:\/\/doi.org\/10.48550\/arXiv.1707.01083.","DOI":"10.48550\/arXiv.1707.01083"},{"key":"3366_CR16","doi-asserted-by":"publisher","unstructured":"Ma, N., Zhang, X., Zheng, H.-T. & Sun, J. ShuffleNet v2: Practical guidelines for efficient CNN architecture design. Version: 1, https:\/\/doi.org\/10.48550\/arXiv.1807.11164.","DOI":"10.48550\/arXiv.1807.11164"},{"key":"3366_CR17","doi-asserted-by":"publisher","unstructured":"Howard, A. G. et al. MobileNets: Efficient convolutional neural networks for mobile vision applications, https:\/\/doi.org\/10.48550\/arXiv.1704.04861.","DOI":"10.48550\/arXiv.1704.04861"},{"key":"3366_CR18","doi-asserted-by":"publisher","unstructured":"Iandola, F. N. et al. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5\u2009mb model size. Version: 4, https:\/\/doi.org\/10.48550\/arXiv.1602.07360.","DOI":"10.48550\/arXiv.1602.07360"},{"key":"3366_CR19","doi-asserted-by":"publisher","unstructured":"Wold, S., Esbensen, K. & Geladi, P. Principal component analysis, https:\/\/doi.org\/10.1016\/0169-7439(87)80084-9.","DOI":"10.1016\/0169-7439(87)80084-9"},{"key":"3366_CR20","doi-asserted-by":"publisher","unstructured":"McInnes, L., Healy, J. & Melville, J. UMAP: Uniform manifold approximation and projection for dimension reduction, https:\/\/doi.org\/10.48550\/arXiv.1802.03426.","DOI":"10.48550\/arXiv.1802.03426"},{"key":"3366_CR21","doi-asserted-by":"publisher","unstructured":"Cai, T. T. & Ma, R. Theoretical foundations of t-SNE for visualizing high-dimensional clustered data, https:\/\/doi.org\/10.48550\/arXiv.2105.07536.","DOI":"10.48550\/arXiv.2105.07536"},{"key":"3366_CR22","doi-asserted-by":"publisher","unstructured":"Simonyan, K. & Zisserman, A. Very deep convolutional networks for large-scale image recognition, https:\/\/doi.org\/10.48550\/arXiv.1409.1556.","DOI":"10.48550\/arXiv.1409.1556"},{"key":"3366_CR23","doi-asserted-by":"publisher","unstructured":"Tan, M. & Le, Q. V. EfficientNet: Rethinking model scaling for convolutional neural networks, https:\/\/doi.org\/10.48550\/arXiv.1905.11946.","DOI":"10.48550\/arXiv.1905.11946"},{"key":"3366_CR24","doi-asserted-by":"publisher","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition, https:\/\/doi.org\/10.48550\/arXiv.1512.03385.","DOI":"10.48550\/arXiv.1512.03385"},{"key":"3366_CR25","doi-asserted-by":"publisher","unstructured":"Dosovitskiy, A. et al. An image is worth 16\u2009\u00d7\u200916 words: Transformers for image recognition at scale, https:\/\/doi.org\/10.48550\/arXiv.2010.11929.","DOI":"10.48550\/arXiv.2010.11929"},{"key":"3366_CR26","doi-asserted-by":"publisher","unstructured":"Cajas, S. A. et al. A multi-modal satellite imagery dataset for public health analysis in colombia, https:\/\/doi.org\/10.13026\/XR5S-XE24.","DOI":"10.13026\/XR5S-XE24"},{"key":"3366_CR27","doi-asserted-by":"publisher","unstructured":"Elvidge, C. D. et al. A global poverty map derived from satellite data, https:\/\/doi.org\/10.1016\/j.cageo.2009.01.009.","DOI":"10.1016\/j.cageo.2009.01.009"},{"key":"3366_CR28","doi-asserted-by":"publisher","unstructured":"Han, Z. et al. Improving educational equity by maximizing service coverage in rural changyuan, china: An evaluation-optimization-validation framework based on spatial accessibility to schools, https:\/\/doi.org\/10.1016\/j.apgeog.2023.102891.","DOI":"10.1016\/j.apgeog.2023.102891"},{"key":"3366_CR29","doi-asserted-by":"publisher","unstructured":"Shepard, D. S., Undurraga, E. A. & Halasa, Y. A. Economic and disease burden of dengue in southeast asia. Publisher: Public Library of Science, https:\/\/doi.org\/10.1371\/journal.pntd.0002055.","DOI":"10.1371\/journal.pntd.0002055"},{"key":"3366_CR30","doi-asserted-by":"publisher","unstructured":"Guo, P. et al. Developing a dengue forecast model using machine learning: A case study in china. Publisher: Public Library of Science, https:\/\/doi.org\/10.1371\/journal.pntd.0005973.","DOI":"10.1371\/journal.pntd.0005973"},{"key":"3366_CR31","doi-asserted-by":"publisher","unstructured":"Salim, N. A. M. et al. Prediction of dengue outbreak in selangor malaysia using machine learning techniques. Number: 1 Publisher: Nature Publishing Group, https:\/\/doi.org\/10.1038\/s41598-020-79193-2.","DOI":"10.1038\/s41598-020-79193-2"},{"key":"3366_CR32","doi-asserted-by":"publisher","unstructured":"Andersson, V. O., Cechinel, C. & Araujo, R. M. Combining street-level and aerial images for dengue incidence rate estimation. In 2019 International Joint Conference on Neural Networks (IJCNN), 1\u20138, https:\/\/doi.org\/10.1109\/IJCNN.2019.8851749. ISSN: 2161-4407 (2019).","DOI":"10.1109\/IJCNN.2019.8851749"},{"key":"3366_CR33","doi-asserted-by":"publisher","unstructured":"Mudele, O., Frery, A. C., Zanandrez, L. F. R., Eiras, A. E. & Gamba, P. Dengue vector population forecasting using multisource earth observation products and recurrent neural networks. Conference Name: IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, https:\/\/doi.org\/10.1109\/JSTARS.2021.3073351.","DOI":"10.1109\/JSTARS.2021.3073351"},{"key":"3366_CR34","doi-asserted-by":"publisher","unstructured":"Li, Z., Gurgel, H., Xu, L., Yang, L. & Dong, J. Improving dengue forecasts by using geospatial big data analysis in google earth engine and the historical dengue information-aided long short term memory modeling, https:\/\/doi.org\/10.3390\/biology11020169.","DOI":"10.3390\/biology11020169"},{"key":"3366_CR35","doi-asserted-by":"crossref","unstructured":"P\u00e9riss\u00e9, A. R. S. et al. Zika, dengue and chikungunya population prevalence in rio de janeiro city, brazil, and the importance of seroprevalence studies to estimate the real number of infected individuals (2020).","DOI":"10.1371\/journal.pone.0243239"},{"key":"3366_CR36","unstructured":"Xue, Y., Joshi, S., Nguyen, D. & Mirzasoleiman, B. Understanding the robustness of multi-modal contrastive learning to distribution shift."},{"key":"3366_CR37","doi-asserted-by":"publisher","unstructured":"Izmailov, P., Kirichenko, P., Gruver, N. & Wilson, A. G. On feature learning in the presence of spurious correlations. https:\/\/doi.org\/10.48550\/arXiv.2210.11369.","DOI":"10.48550\/arXiv.2210.11369"},{"key":"3366_CR38","doi-asserted-by":"publisher","unstructured":"Santurkar, S., Dubois, Y., Taori, R., Liang, P. & Hashimoto, T. Is a caption worth a thousand images? A controlled study for representation learning. https:\/\/doi.org\/10.48550\/arXiv.2207.07635","DOI":"10.48550\/arXiv.2207.07635"},{"key":"3366_CR39","doi-asserted-by":"crossref","unstructured":"Youssef, A. et al. External validation of ai models in health should be replaced with recurring local validation (2023).","DOI":"10.1038\/s41591-023-02540-z"},{"key":"3366_CR40","doi-asserted-by":"publisher","unstructured":"Futoma, J., Simons, M., Panch, T., Doshi-Velez, F. & Celi, L. A. The myth of generalisability in clinical research and machine learning in health care. https:\/\/doi.org\/10.1016\/S2589-7500(20)30186-2.","DOI":"10.1016\/S2589-7500(20)30186-2"},{"key":"3366_CR41","doi-asserted-by":"crossref","unstructured":"Johnson, A. E. et al. Mimic-iv, a freely accessible electronic health record dataset (2023).","DOI":"10.1038\/s41597-023-01945-2"},{"key":"3366_CR42","doi-asserted-by":"crossref","unstructured":"Celi, L. A., Citi, L., Ghassemi, M. & Pollard, T. J. The plos one collection on machine learning in health and biomedicine: Towards open code and open data (2019).","DOI":"10.1371\/journal.pone.0210232"},{"key":"3366_CR43","doi-asserted-by":"crossref","unstructured":"Restrepo, D. et al. A scoping review of the landscape of health-related open datasets in latin america (2023).","DOI":"10.1371\/journal.pdig.0000368"},{"key":"3366_CR44","doi-asserted-by":"crossref","unstructured":"Gonzales, A., Guruswamy, G. & Smith, S. R. Synthetic data in health care: A narrative review (2023).","DOI":"10.1371\/journal.pdig.0000082"},{"key":"3366_CR45","doi-asserted-by":"crossref","unstructured":"Murtaza, H. et al. Synthetic data generation: State of the art in health care domain (2023).","DOI":"10.1016\/j.cosrev.2023.100546"},{"key":"3366_CR46","doi-asserted-by":"publisher","unstructured":"DePasse, J. & Celi, L. A. Collaboration, capacity building and co-creation as a new mantra in global health, https:\/\/doi.org\/10.1093\/intqhc\/mzt077.","DOI":"10.1093\/intqhc\/mzt077"},{"key":"3366_CR47","doi-asserted-by":"crossref","unstructured":"Elmes, A. et al. Accounting for training data error in machine learning applied to earth observations (2020).","DOI":"10.31223\/OSF.IO\/7ZSYR"},{"key":"3366_CR48","doi-asserted-by":"crossref","unstructured":"Main-Knorn, M. et al. Sen2cor for sentinel-2. In Image and signal processing for remote sensing XXIII, 10427, 37\u201348 (SPIE, 2017).","DOI":"10.1117\/12.2278218"},{"key":"3366_CR49","unstructured":"Golej, P., Orlikova, L., Horak, J., Linhartova, P. & Struhar, J. Detection of people and vehicles using very high-resolution satellite images (2021)."},{"key":"3366_CR50","doi-asserted-by":"crossref","unstructured":"Stuparu, D.-G., Ciobanu, R.-I. & Dobre, C. Vehicle detection in overhead satellite images using a one-stage object detection model (2020).","DOI":"10.3390\/s20226485"},{"key":"3366_CR51","doi-asserted-by":"crossref","unstructured":"Wang, J., Gao, B. & Stein, A. The spatial statistic trinity: A generic framework for spatial sampling and inference (2020).","DOI":"10.1016\/j.envsoft.2020.104835"},{"key":"3366_CR52","doi-asserted-by":"crossref","unstructured":"Getis, A. Spatial autocorrelation. In Handbook of applied spatial analysis: Software tools, methods and applications, 255\u2013278 (Springer, 2009).","DOI":"10.1007\/978-3-642-03647-7_14"},{"key":"3366_CR53","doi-asserted-by":"crossref","unstructured":"Wang, J.-F., Zhang, T.-L. & Fu, B.-J. A measure of spatial stratified heterogeneity (2016).","DOI":"10.1016\/j.ecolind.2016.02.052"},{"key":"3366_CR54","doi-asserted-by":"crossref","unstructured":"Moran, P. A. Notes on continuous stochastic phenomena (1950).","DOI":"10.2307\/2332142"},{"key":"3366_CR55","doi-asserted-by":"crossref","unstructured":"Amgalan, A., Mujica-Parodi, L. R. & Skiena, S. S. Fast spatial autocorrelation (2022).","DOI":"10.1007\/s10115-021-01640-x"},{"key":"3366_CR56","doi-asserted-by":"crossref","unstructured":"Wang, J.-F. et al. Geographical detectors-based health risk assessment and its application in the neural tube defects study of the heshun region, china (2010).","DOI":"10.1080\/13658810802443457"},{"key":"3366_CR57","doi-asserted-by":"crossref","unstructured":"Wang, J. et al. Statistical modeling of spatially stratified heterogeneous data (2024).","DOI":"10.1080\/24694452.2023.2289982"},{"key":"3366_CR58","doi-asserted-by":"crossref","unstructured":"Guo, J., Wang, J., Xu, C. & Song, Y. Modeling of spatial stratified heterogeneity (2022).","DOI":"10.1080\/15481603.2022.2126375"},{"key":"3366_CR59","unstructured":"Ltd, S. Sentinel hub."},{"key":"3366_CR60","doi-asserted-by":"publisher","unstructured":"Seyedzade, S. M., Mirzakuchaki, S. & Atani, R. E. A novel image encryption algorithm based on hash function. In 2010 6th Iranian Conference on Machine Vision and Image Processing, 1\u20136, https:\/\/doi.org\/10.1109\/IranianMVIP.2010.5941167. ISSN: 2166-6784 (2010).","DOI":"10.1109\/IranianMVIP.2010.5941167"},{"key":"3366_CR61","unstructured":"DANE - censo nacional de poblaci\u00f3n y vivienda 2018."},{"key":"3366_CR62","unstructured":"PortalSivigila2019 estad\u00edsticas de vigilancia rutinaria."},{"key":"3366_CR63","doi-asserted-by":"publisher","unstructured":"Fick, S. E. & Hijmans, R. J. WorldClim 2: new 1-km spatial resolution climate surfaces for global land areas, https:\/\/doi.org\/10.1002\/joc.5086.","DOI":"10.1002\/joc.5086"},{"key":"3366_CR64","doi-asserted-by":"crossref","unstructured":"Salomonson, V. V., Barnes, W., Maymon, P. W., Montgomery, H. E. & Ostrow, H. Modis: Advanced facility instrument for studies of the earth as a system (1989).","DOI":"10.1109\/36.20292"},{"key":"3366_CR65","doi-asserted-by":"crossref","unstructured":"Funk, C. et al. The climate hazards infrared precipitation with stations\u2014a new environmental record for monitoring extremes (2015).","DOI":"10.1038\/sdata.2015.66"},{"key":"3366_CR66","unstructured":"Kingma, D. P. & Welling, M. Auto-encoding variational bayes (2013)."},{"key":"3366_CR67","doi-asserted-by":"crossref","unstructured":"Restrepo, D. et al. Df-dm: A foundational process model for multimodal data fusion in the artificial intelligence era (2024).","DOI":"10.21203\/rs.3.rs-4277992\/v1"},{"key":"3366_CR68","doi-asserted-by":"publisher","unstructured":"Hussain, A., Ali, F., Latiwesh, O. B. & Hussain, S. A comprehensive review of the manifestations and pathogenesis of zika virus in neonates and adults, https:\/\/doi.org\/10.7759\/cureus.3290.","DOI":"10.7759\/cureus.3290"},{"key":"3366_CR69","doi-asserted-by":"publisher","unstructured":"Dynamic models of infectious diseases: Volume 1: Vector-borne diseases, https:\/\/doi.org\/10.1007\/978-1-4614-3961-5.","DOI":"10.1007\/978-1-4614-3961-5"},{"key":"3366_CR70","doi-asserted-by":"publisher","unstructured":"Huang, S.-C., Pareek, A., Seyyedi, S., Banerjee, I. & Lungren, M. P. Fusion of medical imaging and electronic health records using deep learning: a systematic review and implementation guidelines. https:\/\/doi.org\/10.1038\/s41746-020-00341-z.","DOI":"10.1038\/s41746-020-00341-z"},{"key":"3366_CR71","doi-asserted-by":"publisher","unstructured":"Chen, R. J. et al. Pathomic fusion: An integrated framework for fusing histopathology and genomic features for cancer diagnosis and prognosis, https:\/\/doi.org\/10.1109\/tmi.2020.3021387.","DOI":"10.1109\/tmi.2020.3021387"},{"key":"3366_CR72","doi-asserted-by":"publisher","unstructured":"Holste, G. et al. Improved multimodal fusion for small datasets with auxiliary supervision, https:\/\/doi.org\/10.48550\/arXiv.2304.00379.","DOI":"10.48550\/arXiv.2304.00379"},{"key":"3366_CR73","unstructured":"Zhang, Y., Xu, Y., Chen, J., Xie, F. & Chen, H. Prototypical information bottlenecking and disentangling for multimodal cancer survival prediction."},{"key":"3366_CR74","doi-asserted-by":"publisher","unstructured":"Cheng, P. et al. CLUB: A contrastive log-ratio upper bound of mutual information. https:\/\/doi.org\/10.48550\/arXiv.2006.12013.","DOI":"10.48550\/arXiv.2006.12013"}],"container-title":["Scientific Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41597-024-03366-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41597-024-03366-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41597-024-03366-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,15]],"date-time":"2024-06-15T12:07:25Z","timestamp":1718453245000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41597-024-03366-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,15]]},"references-count":74,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["3366"],"URL":"https:\/\/doi.org\/10.1038\/s41597-024-03366-1","relation":{},"ISSN":["2052-4463"],"issn-type":[{"value":"2052-4463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,15]]},"assertion":[{"value":"18 September 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 May 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 June 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"634"}}