{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T17:55:00Z","timestamp":1775066100480,"version":"3.50.1"},"reference-count":42,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2023,8,5]],"date-time":"2023-08-05T00:00:00Z","timestamp":1691193600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62271494"],"award-info":[{"award-number":["62271494"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Automatic modulation classification (AMC) based on deep learning (DL) is gaining increasing attention in dynamic spectrum access for 5G\/6G wireless communications. However, inconsistent feature parameters between the training (source) and testing (target) data lead to performance degradation or even failure of existing DL-based AMC. The primary reason for this is the difficulty in obtaining sufficient labeled training data in the target domain. Therefore, we propose a novel cross-domain AMC algorithm based on multimodal information and transfer learning, utilizing abundant unlabeled target domain data. We achieve complementary gains by fusing multimodal information such as amplitude, phase, and spectrum, which are used to train a network. Additionally, we apply domain adversarial neural network technology from transfer learning to learn from a large number of unlabeled data samples in the target domain to address the issue of decreased accuracy in cross-domain AMC caused by differences in sampling rate, signal-to-noise ratio, and channel variations. Furthermore, we introduce class weight weighting and entropy weighting to solve the partial domain adaptation problem, considering that the target domain has fewer modulation signal classes than the source domain. Experimental results on two designed modulation datasets demonstrate improved performance gains, thus validating the effectiveness of the proposed method.<\/jats:p>","DOI":"10.3390\/rs15153886","type":"journal-article","created":{"date-parts":[[2023,8,5]],"date-time":"2023-08-05T10:25:36Z","timestamp":1691231136000},"page":"3886","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Cross-Domain Automatic Modulation Classification Using Multimodal Information and Transfer Learning"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7173-3688","authenticated-orcid":false,"given":"Wen","family":"Deng","sequence":"first","affiliation":[{"name":"College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China"}]},{"given":"Qiang","family":"Xu","sequence":"additional","affiliation":[{"name":"College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China"}]},{"given":"Si","family":"Li","sequence":"additional","affiliation":[{"name":"College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China"}]},{"given":"Xiang","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China"}]},{"given":"Zhitao","family":"Huang","sequence":"additional","affiliation":[{"name":"College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1049\/iet-com:20050176","article-title":"Survey of automatic modulation classification techniques: Classical approaches and new trends","volume":"1","author":"Dobre","year":"2007","journal-title":"IET Commun."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/MCOM.2012.6178840","article-title":"Cooperative relay techniques for cognitive radio systems: Spectrum sensing and secondary user transmissions","volume":"50","author":"Zou","year":"2012","journal-title":"IEEE Commun. Mag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1109\/MWC.2019.1800353","article-title":"Intelligent cognitive radio in 5G: AI-based hierarchical cognitive cellular networks","volume":"26","author":"Wang","year":"2019","journal-title":"IEEE Wirel. Commun."},{"key":"ref_4","first-page":"4111","article-title":"SYMMeTRy: Exploiting MIMO self-similarity for under-determined modulation recognition","volume":"21","author":"Xiong","year":"2022","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"He, M., Peng, S., Wang, H., and Yao, Y.-D. (2020, January 1\u20132). Identification of ISM band signals using deep learning. Proceedings of the 29th Wireless and Optical Communications Conference (WOCC), Newark, NJ, USA.","DOI":"10.1109\/WOCC48579.2020.9114911"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3098","DOI":"10.1109\/TWC.2008.070015","article-title":"Novel Automatic Modulation Classification Using Cumulant Features for Communications via Multipath Channels","volume":"7","author":"Wu","year":"2008","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_7","first-page":"1493","article-title":"Likelihood methods for MPSK modulation classification","volume":"234","author":"Huang","year":"1995","journal-title":"IEEE Trans. Commun."},{"key":"ref_8","unstructured":"Hong, L., and Ho, K.C. (2001, January 28\u201331). Modulation classification of BPSK and QPSK signals using a two element antenna array receiver. Proceedings of the 2001 MILCOM Proceedings Communications for Network-Centric Operations: Creating the Information Force (Cat. No. 01CH37277), McLean, VA, USA."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"63760","DOI":"10.1109\/ACCESS.2019.2916833","article-title":"Deep learning in digital modulation recognition using high order cumulants","volume":"7","author":"Xie","year":"2019","journal-title":"IEEE Access."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1109\/LCOMM.2019.2927348","article-title":"Classification of spectrally efficient constant envelope modulations based on radial basis function network and deep learning","volume":"23","author":"Shah","year":"2019","journal-title":"IEEE Commun. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2554","DOI":"10.1073\/pnas.79.8.2554","article-title":"Neural networks and physical systems with emergent collective computational abilities","volume":"79","author":"Hopfield","year":"1982","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1109\/JSTSP.2018.2797022","article-title":"Over-the-air deep learning based radio signal classification","volume":"12","author":"Roy","year":"2018","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"7020","DOI":"10.1109\/TNNLS.2021.3085433","article-title":"A survey of modulation classification using deep learning: Signal representation and data preprocessing","volume":"33","author":"Peng","year":"2021","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"718","DOI":"10.1109\/TNNLS.2018.2850703","article-title":"Modulation classification based on signal constellation diagrams and deep learning","volume":"30","author":"Peng","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lee, J.H., Kim, K.-Y., and Shin, Y. (2019, January 11\u201313). Feature image-based automatic modulation classification method using CNN algorithm. Proceedings of the 2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), Okinawa, Japan.","DOI":"10.1109\/ICAIIC.2019.8669002"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1667","DOI":"10.1109\/LPT.2017.2742553","article-title":"Modulation format recognition and OSNR estimation using CNN-based deep learning","volume":"29","author":"Wang","year":"2017","journal-title":"IEEE Photon. Technol. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Mendis, G.J., Wei, J., and Madanayake, A. (2016, January 14\u201316). Deep learning-based automated modulation classification for cognitive radio. Proceedings of the 2016 IEEE International Conference on Communication Systems (ICCS), Shenzhen, China.","DOI":"10.1109\/ICCS.2016.7833571"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"78923","DOI":"10.1109\/ACCESS.2020.2988727","article-title":"Cross model deep learning scheme for automatic modulation classification","volume":"8","author":"Ma","year":"2020","journal-title":"IEEE Access"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1109\/TCCN.2018.2835460","article-title":"Deep learning models for wireless signal classification with distributed lowcost spectrum sensors","volume":"4","author":"Rajendran","year":"2018","journal-title":"IEEE Trans. Cogn. Commun. Netw."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Mossad, O.S., ElNainay, M., and Torki, M. (2019, January 24\u201328). Deep convolutional neural network with multi-task learning scheme for modulations recognition. Proceedings of the 2019 15th International Wireless Communications & Mobile Computing Conference (IWCMC), Tangier, Morocco.","DOI":"10.1109\/IWCMC.2019.8766665"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, M., Zeng, Y., Han, Z., and Gong, Y. (2018, January 25\u201328). Automatic modulation recognition using deep learning architectures. Proceedings of the 2018 IEEE 19th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), Kalamata, Greece.","DOI":"10.1109\/SPAWC.2018.8446021"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"895","DOI":"10.1049\/el.2019.1789","article-title":"Convolutional neural network and multi-feature fusion for automatic modulation classification","volume":"55","author":"Wu","year":"2019","journal-title":"Electron. Lett."},{"key":"ref_23","first-page":"469","article-title":"Automatic modulation classification using convolutional neural network with features fusion of SPWVD and BJD","volume":"5","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Signal Inf. Process. Netw."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1559","DOI":"10.1109\/TPAMI.2013.2296528","article-title":"Large-margin multi-view information bottleneck","volume":"36","author":"Xu","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","first-page":"1","article-title":"Domain-adversarial training of neural networks","volume":"17","author":"Ganin","year":"2016","journal-title":"J. Mach. Learn. Res."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Tzeng, E., Hoffman, J., Saenko, K., and Darrell, T. (2017, January 21\u201326). Adversarial discriminative domain adaptation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.316"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"880","DOI":"10.1109\/LSP.2020.2991875","article-title":"Adversarial transfer learning for deep learning based automatic modulation classification","volume":"27","author":"Bu","year":"2020","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Xu, Q., Li, B., Deng, W., and Wang, X. (2021, January 22\u201324). Modulation recognition algorithm based on partial domain adaptation. Proceedings of the EITCE \u203221: Proceedings of the 2021 5th International Conference on Electronic Information Technology and Computer Engineering, Xiamen, China.","DOI":"10.1145\/3501409.3501633"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2646","DOI":"10.1109\/LCOMM.2022.3193767","article-title":"Self-training based adversarial domain adaptation for radio signal recognition","volume":"26","author":"Liang","year":"2022","journal-title":"IEEE Commun. Lett."},{"key":"ref_30","first-page":"69","article-title":"A modulation recognition method based on domain adaptive neural network","volume":"21","author":"Yunhao","year":"2020","journal-title":"J. Air Force Eng. Univ."},{"key":"ref_31","unstructured":"O\u2019Shea, T.J., and West, N. (2016, January 12\u201316). Radio machine learning dataset generation with gnu radio. Proceedings of the 6th GNU Radio Conference, Boulder, CO, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Cao, Z., You, K., Long, M., Wang, J., and Yang, Q. (2019, January 15\u201320). Learning to transfer examples for partial domain adaptation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00310"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/TCCN.2020.3023145","article-title":"Automatic modulation classification based on deep residual networks with multimodal information","volume":"7","author":"Qi","year":"2020","journal-title":"IEEE Trans. Cogn. Commun. Netw."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2192","DOI":"10.1109\/JIOT.2021.3091523","article-title":"Multitask-Learning-Based Deep Neural Network for Automatic Modulation Classification","volume":"9","author":"Chang","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1051","DOI":"10.1016\/j.dsp.2022.103650","article-title":"Deep learning based automatic modulation recognition: Models, datasets, and challenges","volume":"129","author":"Zhang","year":"2022","journal-title":"Digit. Signal Process."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Cao, Z., Ma, L., Long, M., and Wang, J. (2018, January 8\u201314). Partial adversarial domain adaptation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01237-3_9"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Cao, Z., Long, M., Wang, J., and Jordan, M.I. (2018, January 18\u201322). Partial transfer learning with selective adversarial networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00288"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zhang, J., Ding, Z., Li, W., and Philip, O. (2018). Importance Weighted Adversarial Nets for Partial Domain Adaptation. arXiv, Available online: http:\/\/arxiv.org\/abs\/1803.09210.","DOI":"10.1109\/CVPR.2018.00851"},{"key":"ref_39","unstructured":"Liang, J., Wang, Y., Hu, D., He, R., and Feng, J. (2020). A Balanced and Uncertainty-Aware Approach for Partial Domain Adaptation. arXiv, Available online: http:\/\/arxiv.org\/abs\/2003.02541."},{"key":"ref_40","unstructured":"Long, M., Cao, Z., Wang, J., and Michael, I.J. (2018, January 3\u20138). Conditional adversarial domain adaptation. Proceedings of the 32nd International Conference on Neural Information Processing Systems (NIPS\u201918), Red Hook, NY, USA."},{"key":"ref_41","unstructured":"Loshchilov, I., and Hutter, F. (2016, January 24\u201326). SGDR: Stochastic gradient descent with warm restarts. Proceedings of the 5th International Conference on Learning Representations, Toulon, France."},{"key":"ref_42","first-page":"137","article-title":"Analysis of representations for domain adaptation","volume":"19","author":"Blitzer","year":"2006","journal-title":"Adv. Neural Inf. Process. Syst."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/15\/3886\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:26:23Z","timestamp":1760127983000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/15\/3886"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,5]]},"references-count":42,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["rs15153886"],"URL":"https:\/\/doi.org\/10.3390\/rs15153886","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,5]]}}}