{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T11:21:10Z","timestamp":1769167270396,"version":"3.49.0"},"reference-count":43,"publisher":"Association for Computing Machinery (ACM)","issue":"8","license":[{"start":{"date-parts":[[2024,6,13]],"date-time":"2024-06-13T00:00:00Z","timestamp":1718236800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62371406, 62171392, 61971365"],"award-info":[{"award-number":["62371406, 62171392, 61971365"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Natural Science Foundation of Fujian Province, China","award":["2020H6001, 2021J01004, 2021H6001"],"award-info":[{"award-number":["2020H6001, 2021J01004, 2021H6001"]}]},{"name":"Xiamen Major Science and Technology Project","award":["3502Z20221026"],"award-info":[{"award-number":["3502Z20221026"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2024,8,31]]},"abstract":"<jats:p>Federated learning (FL) is a prominent paradigm of 6G edge intelligence (EI), which mitigates privacy breaches and high communication pressure caused by conventional centralized model training in the artificial intelligence of things (AIoT). The execution of multimodal federated perception (MFP) services comprises three sub-processes, including sensing-based multimodal data generation, communication-based model transmission, and computing-based model training, ultimately competitive on available underlying multi-domain physical resources such as time, frequency, and computing power. How to reasonably coordinate the multi-domain resources scheduling among sensing, communication, and computing, therefore, is vital to the MFP networks. To address the above issues, this article explores service-oriented resource management with integrated sensing, communication, and computing (ISCC). Specifically, employing the incentive mechanism of the MFP service market, the resources management problem is defined as a social welfare maximization problem, where the concept of \u201cexpanding resources\u201d and \u201creducing costs\u201d is used to enhance learning performance gain and reduce resource costs. Experimental results demonstrate the effectiveness and robustness of the proposed resource scheduling mechanisms.<\/jats:p>","DOI":"10.1145\/3661313","type":"journal-article","created":{"date-parts":[[2024,4,26]],"date-time":"2024-04-26T11:28:40Z","timestamp":1714130920000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Integrated Sensing, Communication, and Computing for Cost-effective Multimodal Federated Perception"],"prefix":"10.1145","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7364-3248","authenticated-orcid":false,"given":"Ning","family":"Chen","sequence":"first","affiliation":[{"name":"Department of Information and Communication Engineering, Xiamen University, Xiamen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9260-6565","authenticated-orcid":false,"given":"Zhipeng","family":"Cheng","sequence":"additional","affiliation":[{"name":"School of Future Science and Engineering, Soochow University, Suzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7488-3369","authenticated-orcid":false,"given":"Xuwei","family":"Fan","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Engineering, Xiamen University, Xiamen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2310-661X","authenticated-orcid":false,"given":"Zhang","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Engineering, Xiamen University, Xiamen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-2656-3779","authenticated-orcid":false,"given":"Bangzhen","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Engineering, Xiamen University, Xiamen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5703-4285","authenticated-orcid":false,"given":"Yifeng","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Engineering, Xiamen University, Xiamen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1620-1504","authenticated-orcid":false,"given":"Lianfen","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Engineering, Xiamen University, Xiamen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4235-9671","authenticated-orcid":false,"given":"Xiaojiang","family":"Du","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Stevens Institute of Technology, Hoboken, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8972-8094","authenticated-orcid":false,"given":"Mohsen","family":"Guizani","sequence":"additional","affiliation":[{"name":"Mohamed bin Zayed University of Artificial Intelligence, Masdar City, United Arab Emirates"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,6,13]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11432-022-3652-2"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11432-020-2955-6"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2020.3039359"},{"key":"e_1_3_2_5_2","volume-title":"Proceedings of the 20th International Conference on Artificial Intelligence and Statistics. PMLR. 1273\u20131282","author":"McMahan Brendan","year":"2017","unstructured":"Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017. Communication-efficient learning of deep networks from decentralized data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics. PMLR. 1273\u20131282."},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3088875"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2021.3075439"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCWorkshops57953.2023.10283497"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNSE.2023.3272013"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2022.3181611"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.23919\/JCC.2022.09.005"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2023.3253251"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3053055"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/IOTM.004.2100182"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/SDF.2019.8916629"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.sna.2021.112566"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2798607"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2019.8803392"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.3390\/s22072542"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2022.01.063"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1002\/int.22953"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/LCOMM.2022.3181612"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMTT.2021.3126887"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2022.3153495"},{"key":"e_1_3_2_25_2","unstructured":"Yue Zhao Meng Li Liangzhen Lai Naveen Suda Damon Civin and Vikas Chandra. 2018. Federated learning with non-iid data. arXiv preprint arXiv:1806.00582"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2022.3162595"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2021.3099723"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2021.3118436"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2021.3085979"},{"key":"e_1_3_2_30_2","first-page":"11073","article-title":"Vehicle selection and resource optimization for federated learning in vehicular edge computing","volume":"22","author":"Xiao Huizi","year":"2021","unstructured":"Huizi Xiao, Jun Zhao, Qingqi Pei, Jie Feng, Lei Liu, and Weisong Shi. 2021. Vehicle selection and resource optimization for federated learning in vehicular edge computing. IEEE Trans. Intell. Transport. Syst. 22, 8 (2021), 11073\u201311087.","journal-title":"IEEE Trans. Intell. Transport. Syst."},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2021.3122436"},{"key":"e_1_3_2_32_2","first-page":"3034","article-title":"Toward an automated auction framework for wireless federated learning services market","volume":"22","author":"Jiao Yutao","year":"2020","unstructured":"Yutao Jiao, Ping Wang, Dusit Niyato, Bin Lin, and Dong In Kim. 2020. Toward an automated auction framework for wireless federated learning services market. IEEE Trans. Mob. Comput. 22, 10 (2020), 3034\u20133048.","journal-title":"IEEE Trans. Mob. Comput."},{"key":"e_1_3_2_33_2","first-page":"2468","article-title":"Task-oriented sensing, computation, and communication integration for multi-device edge AI","volume":"23","author":"Wen Dingzhu","year":"2023","unstructured":"Dingzhu Wen, Peixi Liu, Guangxu Zhu, Yuanming Shi, Jie Xu, Yonina C. Eldar, and Shuguang Cui. 2023. Task-oriented sensing, computation, and communication integration for multi-device edge AI. IEEE Trans. Wirel. Commun. 23, 3 (2023), 2468\u20132502.","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM41043.2020.9155494"},{"key":"e_1_3_2_35_2","volume-title":"Thomas","author":"Cover Thomas M.","year":"1999","unstructured":"Thomas M. Cover and Joy A. Thomas. 1999. Elements of Information Theory.John Wiley & Sons."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.icte.2023.01.007"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2018.2819706"},{"key":"e_1_3_2_38_2","unstructured":"Han Xiao Kashif Rasul and Roland Vollgraf. 2017. Fashion-MNIST: A novel image dataset for benchmarking machine learning algorithms. arXiv preprint arXiv:1708.07747"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01164"},{"key":"e_1_3_2_40_2","unstructured":"Alexey Bochkovskiy Chien-Yao Wang and Hong-Yuan Mark Liao. 2020. YOLOv4: Optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.324"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2020.3042530"},{"key":"e_1_3_2_43_2","volume-title":"Tat-Ming Lok, and Shuguang Cui.","author":"Tang Yao","year":"2023","unstructured":"Yao Tang, Guangxu Zhu, Wei Xu, Man Hon Cheung, Tat-Ming Lok, and Shuguang Cui. 2023. Integrated sensing, computation, and communication for UAV-assisted federated edge learning. arXiv preprint arXiv:2306.02990"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2023.3322755"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3661313","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3661313","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:04:02Z","timestamp":1750291442000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3661313"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,13]]},"references-count":43,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2024,8,31]]}},"alternative-id":["10.1145\/3661313"],"URL":"https:\/\/doi.org\/10.1145\/3661313","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,13]]},"assertion":[{"value":"2023-11-24","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-04-18","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}