{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T11:52:57Z","timestamp":1781610777407,"version":"3.54.5"},"reference-count":37,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T00:00:00Z","timestamp":1781568000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada Discovery","doi-asserted-by":"publisher","award":["RGPIN-2020-05873"],"award-info":[{"award-number":["RGPIN-2020-05873"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]},{"award":["RGPIN-2020-05873"],"award-info":[{"award-number":["RGPIN-2020-05873"]}],"id":[{"id":"https:\/\/ror.org\/01h531d29","id-type":"ROR","asserted-by":"publisher"}]},{"name":"NSERC DG","award":["RGPIN-2020-04007"],"award-info":[{"award-number":["RGPIN-2020-04007"]}]},{"DOI":"10.13039\/501100009192","name":"Alberta Innovates Accelerating Innovations into Care\u2014Concepts","doi-asserted-by":"publisher","award":["AICE-Concepts 597389"],"award-info":[{"award-number":["AICE-Concepts 597389"]}],"id":[{"id":"10.13039\/501100009192","id-type":"DOI","asserted-by":"publisher"}]},{"award":["AICE-Concepts 597389"],"award-info":[{"award-number":["AICE-Concepts 597389"]}],"id":[{"id":"https:\/\/ror.org\/00ynafe15","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Accurate identification of pathogenic yeasts is essential for clinical diagnosis and effective antifungal therapy. However, current approaches predominantly rely on microscopy-based models, which require large-scale annotated datasets and exhibit limited generalization across morphologically similar species. In contrast, light-scattering (LS) imaging captures the diffraction patterns generated by internal cellular structures, providing volumetric biophysical cues that extend beyond surface morphology, yet its indirect representations pose major challenges for feature discrimination. Our objective is to develop fast and accurate methods to detect various species of yeasts. We propose FPA-YeastNet, which is a frequency-enhanced single-modality deep learning architecture that improves yeast classification in LS images by leveraging discriminative frequency-domain features. Building upon this enhanced modality, we further propose FGCA-YeastNet, a frequency-guided cross-attention network designed to integrate LS and microscopy information for complementary representation learning. The proposed multimodal model facilitates synergistic interactions between volumetric scattering structures and fine-grained cellular textures through adaptive fusion and bidirectional attention, leading to improved robustness and interpretability. Comprehensive classification experiments conducted on a multimodal yeast dataset demonstrate that FGCA-YeastNet effectively bridges the performance gap between LS and microscopy modalities, achieving significant improvements over both unimodal and multimodal baselines. The FPA-YeastNet yields an average accuracy improvement of 6.26% compared with LS-only models, and FGCA-YeastNet further provides mean gains of 19.97% and 7.67% over unimodal and multimodal baseline models, respectively. Experimental results demonstrate the diagnostic potential of light scattering and microscopic imaging and underscore the effectiveness of frequency-guided multimodal collaboration for reliable and interpretable yeast classification in clinical microbiology.<\/jats:p>","DOI":"10.3390\/jimaging12060263","type":"journal-article","created":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T09:06:52Z","timestamp":1781600812000},"page":"263","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Frequency-Guided Cross-Modal Interaction for Multimodal Yeast Classification Based on Light-Scattering and Microscopy Images"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-4479-0596","authenticated-orcid":false,"given":"Zexi","family":"Cheng","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB T6G 2V4, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0101-9494","authenticated-orcid":false,"given":"Xiaoxuan","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB T6G 2V4, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0367-7514","authenticated-orcid":false,"given":"Shamanth","family":"Shankarnarayan","sequence":"additional","affiliation":[{"name":"Department of Physics, University of Alberta, Edmonton, AB T6G 2E1, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manisha","family":"Gupta","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB T6G 2V4, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-2660-3727","authenticated-orcid":false,"given":"Wojciech","family":"Rozmus","sequence":"additional","affiliation":[{"name":"Department of Physics, University of Alberta, Edmonton, AB T6G 2E1, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3353-7790","authenticated-orcid":false,"given":"Ying Yin","family":"Tsui","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB T6G 2V4, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7426-1789","authenticated-orcid":false,"given":"Daniel A.","family":"Charlebois","sequence":"additional","affiliation":[{"name":"Department of Physics, University of Alberta, Edmonton, AB T6G 2E1, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mrinal","family":"Mandal","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB T6G 2V4, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,6,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"165rv13","DOI":"10.1126\/scitranslmed.3004404","article-title":"Hidden killers: Human fungal infections","volume":"4","author":"Brown","year":"2012","journal-title":"Sci. Transl. Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1128\/CMR.00029-06","article-title":"Epidemiology of invasive candidiasis: A persistent public health problem","volume":"20","author":"Pfaller","year":"2007","journal-title":"Clin. Microbiol. Rev."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1287","DOI":"10.2147\/IDR.S249864","article-title":"Candida auris: From multidrug resistance to pan-resistant strains","volume":"13","author":"Ademe","year":"2020","journal-title":"Infect. Drug Resist."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/S1473-3099(10)70218-8","article-title":"Emerging opportunistic yeast infections","volume":"11","author":"Miceli","year":"2011","journal-title":"Lancet Infect. Dis."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"792","DOI":"10.1016\/j.cmi.2019.03.028","article-title":"Resistance of Candida to azoles and echinocandins worldwide","volume":"25","author":"Pristov","year":"2019","journal-title":"Clin. Microbiol. Infect."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Woo, S., Debnath, S., Hu, R., Chen, X., Liu, Z., Kweon, I.S., and Xie, S. (2023, January 18\u201322). ConvNeXt V2: Co-designing and scaling ConvNets with masked autoencoders. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.01548"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11\u201317). Swin Transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hatamizadeh, A., and Kautz, J. (2025, January 10\u201317). MambaVision: A hybrid Mamba-Transformer vision backbone. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR52734.2025.02352"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"myad134","DOI":"10.1093\/mmy\/myad134","article-title":"Machine learning to identify clinically relevant Candida yeast species","volume":"62","author":"Shankarnarayan","year":"2024","journal-title":"Med. Mycol."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Guthrie, J.D., Shankarnarayan, S.A., and Charlebois, D.A. (2025). Peering inside the black box: Explainable AI to interpret advanced computer vision fungal pathogen prediction. bioRxiv.","DOI":"10.1101\/2025.06.27.662051"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"067003","DOI":"10.1117\/1.3583577","article-title":"Label-free and noninvasive optical detection of the distribution of nanometer-size mitochondria in single cells","volume":"16","author":"Su","year":"2011","journal-title":"J. Biomed. Opt."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3512","DOI":"10.1364\/BOE.424357","article-title":"Integration of light scattering with machine learning for label free cell detection","volume":"12","author":"Wan","year":"2021","journal-title":"Biomed. Opt. Express"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2344","DOI":"10.1364\/OPTCON.576333","article-title":"Label-free classification of single-cell lymphoma based on scattering imaging flow cytometry and machine learning","volume":"4","author":"Xie","year":"2025","journal-title":"Opt. Contin."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"108726","DOI":"10.1016\/j.cmpb.2025.108726","article-title":"Light scattering imaging modal expansion cytometry for label-free single-cell analysis with deep learning","volume":"264","author":"Li","year":"2025","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"e2510337122","DOI":"10.1073\/pnas.2510337122","article-title":"Light-field deep learning enables high-throughput, scattering-mitigated calcium imaging","volume":"122","author":"Howe","year":"2025","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"6674","DOI":"10.1364\/BOE.405557","article-title":"Deep learning-based light scattering microfluidic cytometry for label-free acute lymphocytic leukemia classification","volume":"11","author":"Sun","year":"2020","journal-title":"Biomed. Opt. Express"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2018, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8\u201314). CBAM: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"8279342","DOI":"10.1155\/2020\/8279342","article-title":"A review of multimodal medical image fusion techniques","volume":"2020","author":"Huang","year":"2020","journal-title":"Comput. Math. Methods Med."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"5210","DOI":"10.1038\/s41598-024-56001-9","article-title":"Automated detection of Alzheimer\u2019s disease: A multi-modal approach with 3D MRI and amyloid PET","volume":"14","author":"Castellano","year":"2024","journal-title":"Sci. Rep."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"e321","DOI":"10.1055\/s-0040-1701603","article-title":"CT\u2013MRI image fusion-based computer-assisted navigation management of communicative tumors involving the infratemporal\u2013middle cranial fossa","volume":"82","author":"Yang","year":"2021","journal-title":"J. Neurol. Surg. B Skull Base"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Tang, L., Zhou, S., Zhou, N., Gong, L., Wang, W., Yu, Y., Soh, Y.C., and Pedrycz, W. (2026). FNIRNet: A Spatiotemporal Statistical Feature-Based Convolutional Neural Network for Low-Channel fNIRS Brain Function Classification. IEEE Trans. Cogn. Dev. Syst., 1\u201314.","DOI":"10.1109\/TCDS.2026.3684377"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"113830","DOI":"10.1016\/j.engappai.2026.113830","article-title":"Correntropy meets cross-entropy: A robust loss against noisy labels","volume":"167","author":"Zhou","year":"2026","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Rasouli Koohi, S., Shankarnarayan, S.A., Galon, C.M., and Charlebois, D.A. (2023). Identification and elimination of antifungal tolerance in Candida auris. Biomedicines, 11.","DOI":"10.3390\/biomedicines11030898"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1111\/j.1574-6976.2011.00278.x","article-title":"Candida glabrata, Candida parapsilosis and Candida tropicalis: Biology, epidemiology, pathogenicity and antifungal resistance","volume":"36","author":"Silva","year":"2012","journal-title":"FEMS Microbiol. Rev."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1038\/s41426-018-0187-x","article-title":"Filamentation in Candida auris, an emerging fungal pathogen of humans: Passage through the mammalian body induces a heritable phenotypic switch","volume":"7","author":"Yue","year":"2018","journal-title":"Emerg. Microbes Infect."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"e00779-21","DOI":"10.1128\/Spectrum.00779-21","article-title":"Phenotypic switching and filamentation in Candida haemulonii, an emerging opportunistic pathogen of humans","volume":"9","author":"Deng","year":"2021","journal-title":"Microbiol. Spectr."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1099\/00222615-41-5-295","article-title":"Candida krusei: Biology, epidemiology, pathogenicity and clinical manifestations of an emerging pathogen","volume":"41","author":"Samaranayake","year":"1994","journal-title":"J. Med. Microbiol."},{"key":"ref_29","unstructured":"Hendrycks, D., and Gimpel, K. (2016). Gaussian error linear units (gelus). arXiv."},{"key":"ref_30","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Long Beach, CA, USA."},{"key":"ref_31","unstructured":"Loshchilov, I., and Hutter, F. (2017). Decoupled weight decay regularization. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_34","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021). An image is worth 16 \u00d7 16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Hatamizadeh, A., and Kautz, J. (2025). MambaVision: A hybrid Mamba-Transformer vision backbone. arXiv.","DOI":"10.1109\/CVPR52734.2025.02352"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Chen, C.-F., Fan, Q., and Panda, R. (2021, January 11\u201317). CrossViT: Cross-attention multi-scale vision transformer for image classification. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00041"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wang, Z., Chen, Y., Shao, W., Li, H., and Zhang, L. (2022). SwinFuse: A residual Swin Transformer fusion network for infrared and visible images. IEEE Trans. Instrum. Meas., 71.","DOI":"10.1109\/TIM.2022.3191664"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/12\/6\/263\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T11:10:21Z","timestamp":1781608221000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/12\/6\/263"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,16]]},"references-count":37,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2026,6]]}},"alternative-id":["jimaging12060263"],"URL":"https:\/\/doi.org\/10.3390\/jimaging12060263","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,16]]}}}