{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:01:47Z","timestamp":1760148107738,"version":"build-2065373602"},"reference-count":24,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,3,29]],"date-time":"2023-03-29T00:00:00Z","timestamp":1680048000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>In many tasks related to an object\u2019s observation or real-time monitoring, the gathering of temporal multimodal data is required. Such data sets are semantically connected as they reflect different aspects of the same object. However, data sets of different modalities are usually stored and processed independently. This paper presents an approach based on the application of the Algebraic System of Aggregates (ASA) operations that enable the creation of an object\u2019s complex representation, referred to as multi-image (MI). The representation of temporal multimodal data sets as the object\u2019s MI yields simple data-processing procedures as it provides a solid semantic connection between data describing different features of the same object, process, or phenomenon. In terms of software development, the MI is a complex data structure used for data processing with ASA operations. This paper provides a detailed presentation of this concept.<\/jats:p>","DOI":"10.3390\/a16040186","type":"journal-article","created":{"date-parts":[[2023,3,30]],"date-time":"2023-03-30T01:05:26Z","timestamp":1680138326000},"page":"186","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Temporal Multimodal Data-Processing Algorithms Based on Algebraic System of Aggregates"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7278-7349","authenticated-orcid":false,"given":"Andreas","family":"Pester","sequence":"first","affiliation":[{"name":"Faculty of Informatics and Computer Science, The British University in Egypt, Cairo 11837, Egypt"}]},{"given":"Yevgeniya","family":"Sulema","sequence":"additional","affiliation":[{"name":"Department of Computer Systems Software, Igor Sikorsky Kyiv Polytechnic Institute, 03056 Kyiv, Ukraine"}]},{"given":"Ivan","family":"Dychka","sequence":"additional","affiliation":[{"name":"Department of Computer Systems Software, Igor Sikorsky Kyiv Polytechnic Institute, 03056 Kyiv, Ukraine"}]},{"given":"Olga","family":"Sulema","sequence":"additional","affiliation":[{"name":"Department of Computer Systems Software, Igor Sikorsky Kyiv Polytechnic Institute, 03056 Kyiv, Ukraine"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Morency, L.-P., Liang, P.P., and Zadeh, A. (2022, January 10\u201315). Tutorial on Multimodal Machine Learning. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Tutorial Abstracts, Seattle, WA, USA.","DOI":"10.18653\/v1\/2022.naacl-tutorials.5"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1109\/TPAMI.2018.2798607","article-title":"Multimodal Machine Learning: A Survey and Taxonomy","volume":"41","author":"Ahuja","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1109\/COMST.2014.2354398","article-title":"A Survey of Distributed Data Aggregation Algorithms","volume":"17","author":"Jesus","year":"2015","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.knosys.2013.08.032","article-title":"FIF: A fuzzy information fusion algorithm based on multi-criteria decision making","volume":"58","author":"Ribeiro","year":"2014","journal-title":"Knowl.-Based Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4087","DOI":"10.1080\/01431161.2021.1883198","article-title":"Data fusion approach for eucalyptus trees identification","volume":"42","author":"Oliveira","year":"2021","journal-title":"Int. J. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1449","DOI":"10.1109\/JPROC.2015.2460697","article-title":"Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects","volume":"103","author":"Lahat","year":"2015","journal-title":"Proc. IEEE"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Marinoni, A., Chlaily, S., and Jutten, C. (2020, January 26). Addressing Reliability of Multimodal Remote Sensing to Enhance Multisensor Data Fusion and Transfer Learning. Proceedings of the International Geoscience and Remote Sensing Symposium (IGARSS 2020), Waikoloa, HI, USA.","DOI":"10.1109\/IGARSS39084.2020.9323681"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gaonkar, A., Chukkapalli, Y., Raman, P.J., Srikanth, S., and Gurugopinath, S. (2021, January 25\u201327). A Comprehensive Survey on Multimodal Data Representation and Information Fusion Algorithms. Proceedings of the 2021 International Conference on Intelligent Technologies (CONIT), Hubli, India.","DOI":"10.1109\/CONIT51480.2021.9498415"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Camarinha-Matos, L.M., Heijenk, G., Katkoori, S., and Strous, L. (2022). Internet of Things. Technology and Applications. IFIPIoT 2021, Springer. IFIP Advances in Information and Communication Technology.","DOI":"10.1007\/978-3-030-96466-5"},{"key":"ref_10","unstructured":"Liang, P.P., Zadeh, A., and Morency, L.-P. (2023). Foundations and Recent Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"63373","DOI":"10.1109\/ACCESS.2019.2916887","article-title":"Deep Multimodal Representation Learning: A Survey","volume":"7","author":"Guo","year":"2019","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1038\/s41746-022-00712-8","article-title":"Multimodal machine learning in precision health: A scoping review","volume":"5","author":"Kline","year":"2022","journal-title":"Npj Digit. Med."},{"key":"ref_13","unstructured":"Wei, W. (2006). Time Series Analysis, Pearson Addison Wesley."},{"key":"ref_14","unstructured":"Hannan, E.J. (2009). Multiple Time Series, John Wiley and Sons."},{"key":"ref_15","unstructured":"Fraenkel, A.A., Bar-Hillel, Y., and Levy, A. (1973). Foundations of Set Theory, Elsevier."},{"key":"ref_16","unstructured":"Petrovsky, A.B. (1997). Multiple Criteria Decision Making, Springer."},{"key":"ref_17","unstructured":"Petrovsky, A.B. (2001). Multiple Criteria Decision Making in New Millennium, Springer."},{"key":"ref_18","first-page":"44","article-title":"Logical Operations in Algebraic System of Aggregates for Multimodal Data Representation and Processing","volume":"6","author":"Dychka","year":"2018","journal-title":"Sci. J. KPI Sci. News"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"15","DOI":"10.20535\/kpi-sn.2019.1.157245","article-title":"Ordering Operations in Algebraic System of Aggregates for Multi-Image Data Processing","volume":"1","author":"Dychka","year":"2019","journal-title":"Sci. J. KPI Sci. News"},{"key":"ref_20","unstructured":"Knuth, D. (1998). The Art of Computer Programming, Volume 3: Sorting and Searching, Addison-Wesley. [2nd ed.]. Available online: https:\/\/dl.acm.org\/doi\/10.5555\/280635."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Pester, A., and Sulema, Y. (2021). Multimodal Data Representation Based on Multi-Image Concept for Immersive Environments and Online Labs Development, Springer. Advances in Intelligent Systems and Computing.","DOI":"10.1007\/978-3-030-52575-0_17"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Auer, M., and Tsiatsos, T. (2018). Interactive Mobile Communication Technologies and Learning. IMCL 2017, Springer. Advances in Intelligent Systems and Computing.","DOI":"10.1007\/978-3-319-75175-7"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Auer, M.E., El-Seoud, S.A., and Karam, O.H. (2023). Artificial Intelligence and Online Engineering. REV 2022, Springer. Lecture Notes in Networks and Systems.","DOI":"10.1007\/978-3-031-17091-1"},{"key":"ref_24","unstructured":"(2023, March 15). ASAMPL Compiler and Library. Available online: https:\/\/github.com\/orgs\/Asampl-development-team\/repositories."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/4\/186\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:06:35Z","timestamp":1760123195000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/4\/186"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,29]]},"references-count":24,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["a16040186"],"URL":"https:\/\/doi.org\/10.3390\/a16040186","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2023,3,29]]}}}