{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T10:23:21Z","timestamp":1780395801714,"version":"3.54.1"},"reference-count":56,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2024,1,8]],"date-time":"2024-01-08T00:00:00Z","timestamp":1704672000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41961063"],"award-info":[{"award-number":["41961063"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["20220138-2"],"award-info":[{"award-number":["20220138-2"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["20220109"],"award-info":[{"award-number":["20220109"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Guilin City Technology Application and Promotion Project in 2022","award":["41961063"],"award-info":[{"award-number":["41961063"]}]},{"name":"Guilin City Technology Application and Promotion Project in 2022","award":["20220138-2"],"award-info":[{"award-number":["20220138-2"]}]},{"name":"Guilin City Technology Application and Promotion Project in 2022","award":["20220109"],"award-info":[{"award-number":["20220109"]}]},{"name":"Key R&amp;D Projects in Guilin City in 2022","award":["41961063"],"award-info":[{"award-number":["41961063"]}]},{"name":"Key R&amp;D Projects in Guilin City in 2022","award":["20220138-2"],"award-info":[{"award-number":["20220138-2"]}]},{"name":"Key R&amp;D Projects in Guilin City in 2022","award":["20220109"],"award-info":[{"award-number":["20220109"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>The effective association of multimodal data is the basis of massive multi-source heterogeneous data sharing in the era of big data. How to realize data autonomous association between massive multimodal databases and the automatic intelligent screening of valuable information from associated data, so as to provide a reliable data source for artificial intelligence (AI), is an urgent problem to be solved. In this paper, a data autonomous association method based on the organizational structure of data cells is proposed, including transaction abstraction based on information nucleuses, symmetric and asymmetric data association based on strategies and data pipes, and information generation based on big data. To screen meaningful data associations, an information-driven intelligent information discovery method and a task-driven intelligent information discovery method are proposed. The former screens meaningful data associations by training the reward and punishment model to simulate the manual scoring of data associations. The latter is task-oriented and screens meaningful data associations by training the reward and punishment model to simulate the manual ranking of data associations related to the task requests. Through the above work, autonomous data association and intelligent information discovery are effectively realized based on multimodal fusion technology, which provides a novel data source mining approach using multimodal data sharing and intelligent information discovery.<\/jats:p>","DOI":"10.3390\/sym16010081","type":"journal-article","created":{"date-parts":[[2024,1,8]],"date-time":"2024-01-08T07:59:20Z","timestamp":1704700760000},"page":"81","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Autonomous Data Association and Intelligent Information Discovery Based on Multimodal Fusion Technology"],"prefix":"10.3390","volume":"16","author":[{"given":"Wei","family":"Wang","sequence":"first","affiliation":[{"name":"College of Geomatics and Geoinformation, Guilin University of Technology, Guilin 541004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingwen","family":"Li","sequence":"additional","affiliation":[{"name":"College of Geomatics and Geoinformation, Guilin University of Technology, Guilin 541004, China"},{"name":"Ecological Spatiotemporal Big Data Perception Service Laboratory, Guilin 541004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7146-0141","authenticated-orcid":false,"given":"Jianwu","family":"Jiang","sequence":"additional","affiliation":[{"name":"College of Geomatics and Geoinformation, Guilin University of Technology, Guilin 541004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bo","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Geomatics and Geoinformation, Guilin University of Technology, Guilin 541004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6205-1992","authenticated-orcid":false,"given":"Qingyang","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Geomatics and Geoinformation, Guilin University of Technology, Guilin 541004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-1683-3643","authenticated-orcid":false,"given":"Ertao","family":"Gao","sequence":"additional","affiliation":[{"name":"College of Geomatics and Geoinformation, Guilin University of Technology, Guilin 541004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tao","family":"Yue","sequence":"additional","affiliation":[{"name":"College of Geomatics and Geoinformation, Guilin University of Technology, Guilin 541004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,1,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1145\/3555803","article-title":"Trustworthy AI: From principles to practices","volume":"55","author":"Li","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Lotfian, M., Ingensand, J., and Brovelli, M.A. (2021). The partnership of citizen science and machine learning: Benefits, risks, and future challenges for engagement, data collection, and data quality. Sustainability, 13.","DOI":"10.3390\/su13148087"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zha, D., Bhat, Z.P., Lai, K.-H., Yang, F., and Hu, X. (2023, January 27\u201329). Data-centricai: Perspectives and challenges. Proceedings of the 2023 SIAM International Conference on Data Mining (SDM), Minneapolis, MN, USA.","DOI":"10.1137\/1.9781611977653.ch106"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wang, T. (2022). A novel approach of integrating natural language processing techniques with fuzzy TOPSIS for product evaluation. Symmetry, 14.","DOI":"10.3390\/sym14010120"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3126","DOI":"10.1109\/TCC.2023.3262648","article-title":"PM2 VE: Power Metering Model for Virtualization Environments in Cloud Data Centers","volume":"11","author":"Shen","year":"2023","journal-title":"IEEE Trans. Cloud Comput."},{"key":"ref_6","first-page":"20","article-title":"Data Virtualization: The Key to Realizing Big Data Analytics Potential","volume":"6","author":"Ethan","year":"2022","journal-title":"Int. J. Comput. Sci. Inf."},{"key":"ref_7","first-page":"39","article-title":"Data Virtualization Best Practices for Advanced Analytics in Big Data","volume":"6","author":"Shiva","year":"2022","journal-title":"Int. J. Comput. Sci. Inf."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1108\/EMJB-01-2022-0011","article-title":"An empirical study on data warehouse systems effectiveness: The case of Jordanian banks in the business intelligence era","volume":"18","author":"Teoh","year":"2023","journal-title":"EuroMed J. Bus."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Nambiar, A., and Mundra, D. (2022). An Overview of Data Warehouse and Data Lake in Modern Enterprise Data Management. Big Data Cogn. Comput., 6.","DOI":"10.3390\/bdcc6040132"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"100516","DOI":"10.1016\/j.cosrev.2022.100516","article-title":"A systematic review on moving objects\u2019 trajectory data and trajectory data warehouse modeling","volume":"47","author":"Oueslati","year":"2023","journal-title":"Comput. Sci. Rev."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Porshnev, S., Borodin, A., Ponomareva, O., Mirvoda, S., and Chernova, O. (2021). The development of a heterogeneous MP data model based on the ontological approach. Symmetry, 13.","DOI":"10.3390\/sym13050813"},{"key":"ref_12","first-page":"45","article-title":"Data virtualization for decision making in big data","volume":"10","author":"Muniswamaiah","year":"2019","journal-title":"Int. J. Softw. Eng. Appl."},{"key":"ref_13","first-page":"28","article-title":"Data Warehouse Designing: Dimensional Modelling and ER Modelling","volume":"3","author":"Saxena","year":"2014","journal-title":"Int. J. Eng. Invent."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Togatorop, P.R., Sitorus, D., Purba, Y., and Tarigan, A.M. (2022, January 19\u201321). Twitter Data Warehouse and Business Intelligence Using Dimensional Model and Data Mining. Proceedings of the 2022 IEEE International Conference of Computer Science and Information Technology (ICOSNIKOM), Laguboti, Sumatera Utara, Indonesia.","DOI":"10.1109\/ICOSNIKOM56551.2022.10034904"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Rodr\u00edguez-Mazahua, N., Rodr\u00edguez-Mazahua, L., L\u00f3pez-Chau, A., Alor-Hern\u00e1ndez, G., and Machorro-Cano, I. (2022). Decision-Tree-Based Horizontal Fragmentation Method for Data Warehouses. Appl. Sci., 12.","DOI":"10.3390\/app122110942"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Witanto, E.N., Oktian, Y.E., and Lee, S.-G. (2022). Toward data integrity architecture for cloud-based AI systems. Symmetry, 14.","DOI":"10.3390\/sym14020273"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"201","DOI":"10.26599\/BDMA.2022.9020021","article-title":"Medical knowledge graph: Data sources, construction, reasoning, and applications","volume":"6","author":"Wu","year":"2023","journal-title":"Big Data Min. Anal."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1279","DOI":"10.1016\/j.procs.2023.01.412","article-title":"An Apriori Algorithm-Based Association Rule Analysis to detect Human Suicidal Behaviour","volume":"219","author":"Hassan","year":"2023","journal-title":"Procedia Comput. Sci."},{"key":"ref_19","first-page":"1205","article-title":"Knowledge Discovery Method from Text Big Data for Earthquake Emergency","volume":"45","author":"Liu","year":"2020","journal-title":"Geomat. Inf. Sci. Wuhan Univ."},{"key":"ref_20","first-page":"45","article-title":"Research on Interdisciplinary Knowledge Discovery Based on Knowledge Graph to Support Scientific Research Innovation","volume":"45","author":"Cao","year":"2022","journal-title":"Inf. Stud. Theroy Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"104792","DOI":"10.1016\/j.autcon.2023.104792","article-title":"BIM and IoT data fusion: The data process model perspective","volume":"149","author":"Huang","year":"2023","journal-title":"Autom. Constr."},{"key":"ref_22","first-page":"7","article-title":"Data and artificial intelligence strategy: A conceptual enterprise big data cloud architecture to enable market-oriented organisations","volume":"5","author":"Moreno","year":"2019","journal-title":"Int. J. Interact."},{"key":"ref_23","unstructured":"Yang, J.-T., Chen, W.-Y., Li, C.-H., Huang, S.C.-H., and Wu, H.-C. (2022). APPFLChain: A Privacy Protection Distributed Artificial-Intelligence Architecture Based on Federated Learning and Consortium Blockchain. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.inffus.2019.06.016","article-title":"Urban big data fusion based on deep learning: An overview","volume":"53","author":"Liu","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Liu, W., Zhang, C., Yu, B., and Li, Y. (2019, January 22\u201324). A general multi-source data fusion framework. Proceedings of the 2019 11th International Conference on Machine Learning and Computing, Zhuhai, China.","DOI":"10.1145\/3318299.3318394"},{"key":"ref_26","first-page":"126","article-title":"A hybrid recommendation model based on fusion of multi-source heterogeneous data","volume":"42","author":"Ji","year":"2019","journal-title":"J. Beijing Univ. Posts Telecommun."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"14301","DOI":"10.1007\/s00521-019-04476-3","article-title":"Audiovisual cross-modal material surface retrieval","volume":"32","author":"Liu","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1016\/j.procs.2022.01.112","article-title":"An Evidence theory and data fusion based classification method for decision making","volume":"199","author":"Meng","year":"2022","journal-title":"Procedia Comput. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"102817","DOI":"10.1016\/j.ssresearch.2022.102817","article-title":"Knowledge Discovery: Methods from data mining and machine learning","volume":"110","author":"Shu","year":"2023","journal-title":"Soc. Sci. Res"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"100701","DOI":"10.1016\/j.measen.2023.100701","article-title":"Fault prediction using fuzzy convolution neural network on IoT environment with heterogeneous sensing data fusion","volume":"26","author":"Rajput","year":"2023","journal-title":"Meas. Sens."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Abdulahi Hasan, A., and Fang, H. (2021, January 28\u201330). Data Mining in Education: Discussing Knowledge Discovery in Database (KDD) with Cluster Associative Study. Proceedings of the 2021 2nd International Conference on Artificial Intelligence and Information Systems, Chongqing, China.","DOI":"10.1145\/3469213.3471319"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1875","DOI":"10.1080\/10255842.2022.2152678","article-title":"Occupational health knowledge discovery based on association rules applied to workers\u2019 body parts protection: A case study in the automotive industry","volume":"26","author":"Mollaei","year":"2023","journal-title":"Comput. Methods Biomech. Biomed."},{"key":"ref_33","first-page":"4","article-title":"Research on Knowledge Map and Multidimensional Knowledge Discovery of Oral History Archives Re-sources","volume":"66","author":"Jun","year":"2022","journal-title":"Libr. Inf. Serv."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"101493","DOI":"10.1016\/j.giq.2020.101493","article-title":"Data governance: Organizing data for trustworthy Artificial Intelligence","volume":"37","author":"Janssen","year":"2020","journal-title":"Gov. Inf. Q."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"121201","DOI":"10.1016\/j.techfore.2021.121201","article-title":"Data intelligence and analytics: A bibliometric analysis of human\u2013Artificial intelligence in public sector decision-making effectiveness","volume":"174","author":"Hassan","year":"2022","journal-title":"Technol. Forecast. Soc. Chang."},{"key":"ref_36","first-page":"627","article-title":"Knowledge-based and data-driven integrating methodologies for collective intelligence decision making: A survey","volume":"48","author":"Zhen","year":"2022","journal-title":"Acta Autom. Sin."},{"key":"ref_37","first-page":"2580","article-title":"Artificial Intelligence Algorithms Based on Data-driven and Knowledge-guided Models","volume":"45","author":"Zhe","year":"2023","journal-title":"J. Electron. Sci. Technol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"320","DOI":"10.1109\/JIOT.2020.3005939","article-title":"Data and knowledge twin driven integration for large-scale device-free localization","volume":"8","author":"Zhang","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_39","first-page":"62","article-title":"Three-three-three network architecture and learning optimization mechanism for B5G\/6G","volume":"42","author":"Zhu","year":"2021","journal-title":"J. Commun."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1007\/s42979-021-00765-8","article-title":"Data science and analytics: An overview from data-driven smart computing, decision-making and applications perspective","volume":"2","author":"Sarker","year":"2021","journal-title":"SN Comput. Sci."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"109597","DOI":"10.1016\/j.ymssp.2022.109597","article-title":"Knowledge and data dual-driven transfer network for industrial robot fault diagnosis","volume":"182","author":"Yin","year":"2023","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"108183","DOI":"10.1016\/j.ress.2021.108183","article-title":"Quantitative analysis for resilience-based urban rail systems: A hybrid knowledge-based and data-driven approach","volume":"219","author":"Yin","year":"2022","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"11638","DOI":"10.1016\/j.ifacol.2020.12.646","article-title":"Monitoring a segmented fluid bed dryer by hybrid data-driven\/knowledge-driven modeling","volume":"53","author":"Destro","year":"2020","journal-title":"IFAC-PapersOnLine"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"112665","DOI":"10.1016\/j.rse.2021.112665","article-title":"A method for land surface temperature retrieval based on model-data-knowledge-driven and deep learning","volume":"265","author":"Wang","year":"2021","journal-title":"Remote Sens. Environ."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"127044","DOI":"10.1016\/j.energy.2023.127044","article-title":"Prediction of NOx emission concentration from coal-fired power plant based on joint knowledge and data driven","volume":"271","author":"Wu","year":"2023","journal-title":"Energy"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.jprocont.2021.11.013","article-title":"Data-knowledge-driven distributed monitoring for large-scale processes based on digraph","volume":"109","author":"Wu","year":"2022","journal-title":"J. Process Control"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Shi, Z. (2010, January 13\u201316). Image semantic analysis and understanding. Proceedings of the International Conference on Intelligent Information Processing, Manchester, UK.","DOI":"10.1007\/978-3-642-16327-2"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2891","DOI":"10.1109\/TPAMI.2012.162","article-title":"Babytalk: Understanding and generating simple image descriptions","volume":"35","author":"Kulkarni","year":"2013","journal-title":"IEEE Trans. Pattern Anal."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.neuropsychologia.2014.09.018","article-title":"The grammar of visual narrative: Neural evidence for constituent structure in sequential image comprehension","volume":"64","author":"Cohn","year":"2014","journal-title":"Neuropsychologia"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"3377","DOI":"10.1109\/TMM.2018.2832602","article-title":"Predicting visual features from text for image and video caption retrieval","volume":"20","author":"Dong","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Han, M., Wang, Y., Chang, X., and Qiao, Y. (2020, January 23\u201328). Mining inter-video proposal relations for video object detection. Proceedings of the Computer Vision\u2013ECCV 2020: 16th European Conference, Glasgow, UK.","DOI":"10.1007\/978-3-030-58589-1_26"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"13","DOI":"10.54254\/2755-2721\/21\/20231108","article-title":"Review of data normalization methods","volume":"59","author":"Yang","year":"2023","journal-title":"Comput. Appl. Eng. Educ."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"101996","DOI":"10.1016\/j.ijer.2022.101996","article-title":"Undergraduate Research Experience Models: A systematic review of the literature from 2011 to 2021","volume":"114","author":"Ahmad","year":"2022","journal-title":"Int. J. Educ. Res."},{"key":"ref_54","unstructured":"Rafailov, R., Sharma, A., Mitchell, E., Ermon, S., Manning, C.D., and Finn, C. (2023). Direct preference optimization: Your language model is secretly a reward model. arXiv."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1145\/3507900","article-title":"The evolution of topic modeling","volume":"54","author":"Churchill","year":"2022","journal-title":"ACM Comput. Surv."},{"key":"ref_56","first-page":"29","article-title":"Search engines: A study","volume":"4","author":"Tarakeswar","year":"2011","journal-title":"J. Comput. Appl."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/16\/1\/81\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:42:04Z","timestamp":1760103724000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/16\/1\/81"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,8]]},"references-count":56,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,1]]}},"alternative-id":["sym16010081"],"URL":"https:\/\/doi.org\/10.3390\/sym16010081","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,8]]}}}