{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"Research Square"}],"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T21:02:00Z","timestamp":1780520520955,"version":"3.54.1"},"posted":{"date-parts":[[2026,5,11]]},"group-title":"In Review","reference-count":0,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2026,5,11]],"date-time":"2026-05-11T00:00:00Z","timestamp":1778457600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2026,5,8]]},"abstract":"<title>Abstract<\/title>\n                <p>\n                  Electrocardiography (ECG) and photoplethysmography (PPG) arise from the same heartbeat and are routinely co-acquired at every monitored bedside, yet no foundation model jointly encodes both modalities. Existing approaches are either ECG-specific, PPG-specific, or domain-agnostic, and none captures the cross-modal physiological coupling between cardiac electrical activity and peripheral hemodynamics. We present CardioFM, a self-supervised multimodal foundation model that integrates ECG Lead-II and PPG through bidirectional cross-modal attention and adaptive residual vector quantization. CardioFM is pretrained on over 500,000 hours from approximately 63,000 patients across intensive care, surgical, ambulatory, and consumer-wearable settings, learning unified representations that transfer across contexts without retraining. CardioFM achieves an F1-score of 0.86 for cardiovascular disease classification on PTB-XL, estimates the QT interval with a mean error of 20.2 ms approaching expert inter-observer variability, and measures pulse arrival time with a mean error of 22.7 ms sufficient to support non-invasive hemodynamic trending. When used as a feature extractor, CardioFM embeddings provide superior discrimination for intensive care false alarm reduction compared with ECG-FM, PaPaGei, and TimesFM, despite requiring substantially smaller representations. In contrast, generic temporal pretraining fails to encode clinically relevant waveform morphology. Demographic inference from waveform embeddings (age MAE: 10.4 years; gender AUC: 0.97; BMI MAE: 0.66 kg\/m\n                  <sup>2<\/sup>\n                  ) confirms that the learned representations encode fundamental biological characteristics without requiring diagnostic labels. The model maintains zero-shot reconstruction fidelity across five independent datasets spanning heterogeneous sensor hardware, sampling rates, and patient populations, with the cross-modal attention mechanism providing robustness to single-modality signal degradation. The 17.11-million-parameter encoder is compatible with edge-deployment constraints, and the model uses only signal modalities already acquired by standard bedside monitors and consumer wearables, requiring no additional sensing hardware. These findings demonstrate that a single multimodal foundation model can consolidate the fragmented landscape of cardiac biosignal analysis, providing a unified representational framework across clinical monitoring systems and wearable health technologies that may extend to broader critical illness surveillance.\n                <\/p>","DOI":"10.21203\/rs.3.rs-9652631\/v1","type":"posted-content","created":{"date-parts":[[2026,5,11]],"date-time":"2026-05-11T10:47:29Z","timestamp":1778496449000},"source":"Crossref","is-referenced-by-count":0,"title":["CardioFM: A Multimodal Foundation Model for Joint ECG and PPG Representation Learning"],"prefix":"10.21203","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4751-3773","authenticated-orcid":false,"given":"Md","family":"Hassanuzzaman","sequence":"first","affiliation":[{"name":"Duke University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tilendra","family":"Choudhary","sequence":"additional","affiliation":[{"name":"Duke University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alasdair","family":"Gent","sequence":"additional","affiliation":[{"name":"Duke University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mihai","family":"Podgoreanu","sequence":"additional","affiliation":[{"name":"Duke University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Suresh","family":"Agarwal","sequence":"additional","affiliation":[{"name":"Duke University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vijay","family":"Krishnamoorthy","sequence":"additional","affiliation":[{"name":"Duke University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sivasubramanium","family":"Bhavani","sequence":"additional","affiliation":[{"name":"Emory University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Philip","family":"Yang","sequence":"additional","affiliation":[{"name":"Emory University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Annette","family":"Esper","sequence":"additional","affiliation":[{"name":"Emory University\/Georgia Tech"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rishikesan","family":"Kamaleswaran","sequence":"additional","affiliation":[{"name":"Duke University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","container-title":[],"original-title":[],"link":[{"URL":"https:\/\/www.researchsquare.com\/article\/rs-9652631\/v1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.researchsquare.com\/article\/rs-9652631\/v1.html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T20:12:32Z","timestamp":1780517552000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.researchsquare.com\/article\/rs-9652631\/v1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,11]]},"references-count":0,"URL":"https:\/\/doi.org\/10.21203\/rs.3.rs-9652631\/v1","relation":{},"subject":[],"published":{"date-parts":[[2026,5,11]]},"subtype":"preprint"}}