{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,27]],"date-time":"2025-09-27T00:08:29Z","timestamp":1758931709680,"version":"3.44.0"},"reference-count":28,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2025,9,26]],"date-time":"2025-09-26T00:00:00Z","timestamp":1758844800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.mdpi.com"],"crossmark-restriction":true},"short-container-title":["Algorithms"],"abstract":"<jats:p>Personalised modelling has become dominant in personalised medicine and precision health. It creates a computational model for an individual based on large data repositories of existing personalised data, aiming to achieve the best possible personal diagnosis or prognosis and derive an informative explanation for it. Current methods are still working on a single data modality or treating all modalities with the same method. The proposed method, SAIN (Search-And-INfer), offers better results and an informative explanation for classification and prediction tasks on a new multimodal object (sample) using a database of similar multimodal objects. The method is based on different distance measures suitable for each data modality and introduces a new formula to aggregate all modalities into a single vector distance measure to find the closest objects to a new one, and then use them for a probabilistic inference. This paper describes SAIN and applies it to two types of multimodal data, cardiovascular diagnosis and EEG time series, modelled by integrating modalities, such as numbers, categories, images, and time series, and using a software implementation of SAIN.<\/jats:p>","DOI":"10.3390\/a18100605","type":"journal-article","created":{"date-parts":[[2025,9,26]],"date-time":"2025-09-26T12:33:03Z","timestamp":1758889983000},"page":"605","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["SAIN: Search-And-INfer, a Mathematical and Computational Framework for Personalised Multimodal Data Modelling with Applications in Healthcare"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8711-6799","authenticated-orcid":false,"given":"Cristian S.","family":"Calude","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Auckland, Auckland 1142, New Zealand"}]},{"given":"Patrick","family":"Gladding","sequence":"additional","affiliation":[{"name":"Bioengineering Institute, University of Auckland, Auckland 1142, New Zealand"}]},{"given":"Alec","family":"Henderson","sequence":"additional","affiliation":[{"name":"University of Queensland Center for Clinical Research, Brisbane, QLD 4072, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4433-7521","authenticated-orcid":false,"given":"Nikola","family":"Kasabov","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Auckland University of Technology, Auckland 1142, New Zealand"}]}],"member":"1968","published-online":{"date-parts":[[2025,9,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Budhraja, S., Singh, B., Doborjeh, M., Doborjeh, Z., Tan, S., Lai, E., Goh, W., and Kasabov, N. (2023, January 18\u201322). Mosaic LSM: A Liquid State Machine Approach for Multimodal Longitudinal Data Analysis. Proceedings of the 2023 International Joint Conference on Neural Networks (IJCNN), Gold Coast, QLD, Australia.","DOI":"10.1109\/IJCNN54540.2023.10191256"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"AbouHassan, I., Kasabov, N.K., Jagtap, V., and Kulkarni, P. (2023). Spiking neural networks for predictive and explainable modelling of multimodal streaming data with a case study on financial time series and online news. Sci. Rep., 13.","DOI":"10.1038\/s41598-023-42605-0"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.inffus.2018.07.007","article-title":"Combining time-series and textual data for taxi demand prediction in event areas: A deep learning approach","volume":"49","author":"Rodrigues","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"16248","DOI":"10.1109\/TNNLS.2023.3293274","article-title":"GeSeNet: A General Semantic-Guided Network With Couple Mask Ensemble for Medical Image Fusion","volume":"35","author":"Li","year":"2024","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1038\/s41537-023-00335-2","article-title":"Investigation of social and cognitive predictors in non-transition ultra-high-risk\u2019individuals for psychosis using spiking neural networks","volume":"9","author":"Doborjeh","year":"2023","journal-title":"Schizophrenia"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.neunet.2014.01.006","article-title":"NeuCube: A spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data","volume":"52","author":"Kasabov","year":"2014","journal-title":"Neural Netw."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1016\/j.patrec.2006.08.007","article-title":"Global, local and personalised modeling and pattern discovery in bioinformatics: An integrated approach","volume":"28","author":"Kasabov","year":"2007","journal-title":"Pattern Recognit. Lett."},{"key":"ref_8","unstructured":"Kasabov, N. (2015). Data Analysis and Predictive Systems and Related Methodologies. (9,002,682 B2), U.S. Patent."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"522","DOI":"10.1016\/j.neunet.2021.09.013","article-title":"Personalised predictive modelling with brain-inspired spiking neural networks of longitudinal MRI neuroimaging data and the case study of dementia","volume":"144","author":"Doborjeh","year":"2021","journal-title":"Neural Netw."},{"key":"ref_10","unstructured":"Kasabov, N.K. (2007). Evolving Connectionist Systems, Springer. [2nd ed.]."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kasabov, N.K. (2019). Time-Space, Spiking Neural Networks and Brain-Inspired Artificial Intelligence, Springer.","DOI":"10.1007\/978-3-662-57715-8"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1700","DOI":"10.1016\/S0140-6736(21)02143-7","article-title":"Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic","volume":"398","author":"Santomauro","year":"2021","journal-title":"Lancet"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Swaddiwudhipong, N., Whiteside, D.J., Hezemans, F.H., Street, D., Rowe, J.B., and Rittman, T. (2022). Pre-diagnostic cognitive and functional impairment in multiple sporadic neurodegenerative diseases. bioRxiv.","DOI":"10.1101\/2022.04.05.22273468"},{"key":"ref_14","unstructured":"Kasabov, N.K., Hou, Z., Feigin, V., and Chen, Y. (2015, December 20). Improved Method and System for Predicting Outcomes Based on Spatio\/Spectro-Temporal Data. Available online: https:\/\/patents.google.com\/patent\/WO2015030606A2\/en."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"100588","DOI":"10.1016\/j.softx.2020.100588","article-title":"BANSHEE\u2014A MATLAB toolbox for non-parametric Bayesian networks","volume":"12","author":"Paprotny","year":"2020","journal-title":"SoftwareX"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"101279","DOI":"10.1016\/j.softx.2022.101279","article-title":"PyBanshee version (1.0): A Python implementation of the MATLAB toolbox BANSHEE for Non-Parametric Bayesian Networks with updated features","volume":"21","author":"Koot","year":"2023","journal-title":"SoftwareX"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"101479","DOI":"10.1016\/j.softx.2023.101479","article-title":"Version 1.3-BANSHEE\u2014A MATLAB toolbox for Non-Parametric Bayesian Networks","volume":"23","year":"2023","journal-title":"SoftwareX"},{"key":"ref_18","first-page":"223","article-title":"A metrical method for multicriteria decision making","volume":"34","author":"Calude","year":"1982","journal-title":"St. Cerc. Mat"},{"key":"ref_19","first-page":"40","article-title":"A simple non-uniform operation","volume":"20","author":"Calude","year":"1983","journal-title":"Bull. Eur. Assoc. Theor. Comput. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3233\/FI-2011-524","article-title":"A Multi-Criteria Metric Algorithm for Recommender Systems","volume":"110","author":"Akhtarzada","year":"2011","journal-title":"Fundam. Informaticae"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.eswa.2007.06.004","article-title":"Design of a hybrid system for the diabetes and heart diseases","volume":"35","author":"Kahramanli","year":"2008","journal-title":"Expert Syst. Appl."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Gleeson, S., Liao, Y.W., Dugo, C., Cave, A., Zhou, L., Ayar, Z., Christiansen, J., Scott, T., Dawson, L., and Gavin, A. (2017). ECG-derived spatial QRS-T angle is associated with ICD implantation, mortality and heart failure admissions in patients with LV systolic dysfunction. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0171069"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1591","DOI":"10.1016\/j.neunet.2006.05.028","article-title":"TWNFI\u2013a transductive neuro-fuzzy inference system with weighted data normalization for personalized modeling","volume":"19","author":"Song","year":"2006","journal-title":"Neural Netw."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1109\/TFUZZ.2005.859311","article-title":"NFI: A neuro-fuzzy inference method for transductive reasoning","volume":"13","author":"Song","year":"2005","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5249","DOI":"10.1109\/TNNLS.2018.2796023","article-title":"Integrating space, time, and orientation in spiking neural networks: A case study on multimodal brain data modeling","volume":"29","author":"Sengupta","year":"2018","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kasabov, N. (2012). NeuCube EvoSpike Architecture for Spatio-temporal Modelling and Pattern Recognition of Brain Signals. Artificial Neural Networks in Pattern Recognition, Springer.","DOI":"10.1007\/978-3-642-33212-8_21"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/j.neunet.2019.08.029","article-title":"Deep learning and deep knowledge representation in Spiking Neural Networks for Brain-Computer Interfaces","volume":"121","author":"Kumarasinghe","year":"2020","journal-title":"Neural Netw."},{"key":"ref_28","unstructured":"Futschik, M., and Kasabov, N. (2002, January 12\u201317). Fuzzy clustering of gene expression data. Proceedings of the 2002 IEEE World Congress on Computational Intelligence, 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE\u201902. Proceedings (Cat. No.02CH37291), Honolulu, HI, USA."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/10\/605\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,26]],"date-time":"2025-09-26T12:35:48Z","timestamp":1758890148000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/10\/605"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,26]]},"references-count":28,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2025,10]]}},"alternative-id":["a18100605"],"URL":"https:\/\/doi.org\/10.3390\/a18100605","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,26]]}}}