{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T03:06:56Z","timestamp":1785467216694,"version":"3.56.0"},"reference-count":42,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2018,3,20]],"date-time":"2018-03-20T00:00:00Z","timestamp":1521504000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["91538204"],"award-info":[{"award-number":["91538204"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the Natural Science Foundation of China","award":["61672079"],"award-info":[{"award-number":["61672079"]}]},{"name":"the Natural Science Foundation of China","award":["61473086"],"award-info":[{"award-number":["61473086"]}]},{"name":"the Open Projects Program of National Laboratory of Pattern Recognition"},{"DOI":"10.13039\/501100012234","name":"Shenzhen Peacock Plan","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100012234","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Deep learning has recently attracted much attention due to its excellent performance in processing audio, image, and video data. However, few studies are devoted to the field of automatic modulation classification (AMC). It is one of the most well-known research topics in communication signal recognition and remains challenging for traditional methods due to complex disturbance from other sources. This paper proposes a heterogeneous deep model fusion (HDMF) method to solve the problem in a unified framework. The contributions include the following: (1) a convolutional neural network (CNN) and long short-term memory (LSTM) are combined by two different ways without prior knowledge involved; (2) a large database, including eleven types of single-carrier modulation signals with various noises as well as a fading channel, is collected with various signal-to-noise ratios (SNRs) based on a real geographical environment; and (3) experimental results demonstrate that HDMF is very capable of coping with the AMC problem, and achieves much better performance when compared with the independent network.<\/jats:p>","DOI":"10.3390\/s18030924","type":"journal-article","created":{"date-parts":[[2018,3,20]],"date-time":"2018-03-20T15:59:39Z","timestamp":1521561579000},"page":"924","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":97,"title":["Automatic Modulation Classification Based on Deep Learning for Unmanned Aerial Vehicles"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5567-0816","authenticated-orcid":false,"given":"Duona","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Electronics and Information Engineering, Beihang University, Beijing 100083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenrui","family":"Ding","sequence":"additional","affiliation":[{"name":"Unmanned Systems Research Institute, Beihang University, Beijing 100083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Baochang","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Automation Science and Electrical Engineering, Beihang University, Beijing 100083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chunyu","family":"Xie","sequence":"additional","affiliation":[{"name":"School of Automation Science and Electrical Engineering, Beihang University, Beijing 100083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongguang","family":"Li","sequence":"additional","affiliation":[{"name":"Unmanned Systems Research Institute, Beihang University, Beijing 100083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chunhui","family":"Liu","sequence":"additional","affiliation":[{"name":"Unmanned Systems Research Institute, Beihang University, Beijing 100083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jungong","family":"Han","sequence":"additional","affiliation":[{"name":"School of Computing & Communications, Lancaster University, Lancaster LA1 4WA, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2018,3,20]]},"reference":[{"key":"ref_1","unstructured":"Zheleva, M., Chandra, R., Chowdhery, A., Kapoor, A., and Garnett, P. (October, January 29). TX miner: Identifying transmitters in real-world spectrum measurements. Proceedings of the IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN), Stockholm, Sweden."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Hong, S.S., and Katti, S.R. (2011, January 15\u201319). Dof: A local wireless information plane. Proceedings of the ACM SIGCOMM 2011 Conference, Toronto, ON, Canada.","DOI":"10.1145\/2018436.2018463"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1049\/iet-com:20050176","article-title":"Survey of automatic modulation classification techniques: Classical approaches and new trends","volume":"1","author":"Dobre","year":"2007","journal-title":"IET Commun."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"897","DOI":"10.1109\/26.3769","article-title":"Signal interception: A unifying theoretical framework for feature detection","volume":"36","author":"Gardner","year":"1988","journal-title":"IEEE Trans. Commun."},{"key":"ref_5","unstructured":"Yu, Z. (2006). Automatic Modulation Classification of Communication Signals. [Ph.D. Thesis, Department of Electrical and Computer Engineering, New Jersey Institute of Technology]."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2355","DOI":"10.1109\/78.317857","article-title":"Statistical tests for presence of cyclostationarity","volume":"42","author":"Dandawate","year":"1994","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_7","unstructured":"Fehske, A., Gaeddert, J., and Reed, J.H. (2005, January 8\u201311). A new approach to signal classification using spectral correlation and neural networks. Proceedings of the First IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks, Baltimore, MD, USA."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"O\u2019Shea, T.J., Corgan, J., and Clancy, T.C. (2016, January 2\u20135). Convolutional radio modulation recognition networks. Proceedings of the International Conference on Engineering Applications of Neural Networks, Aberdeen, UK.","DOI":"10.1007\/978-3-319-44188-7_16"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_11","unstructured":"Lopatka, J., and Pedzisz, M. (2000, January 21\u201325). Automatic modulation classification using statistical moments and a fuzzy classifier. Proceedings of the 5th International Conference on Signal Processing Proceedings, Beijing, China."},{"key":"ref_12","unstructured":"Yang, Y., and Soliman, S. (1991, January 23\u201326). Optimum classifier for M-ary PSK signals. Proceedings of the ICC 91 International Conference on Communications Conference Record, Denver, CO, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1748","DOI":"10.1016\/j.dsp.2010.03.003","article-title":"Recognition of communication signal types using genetic algorithm and support vector machines based on the higher order statistics","volume":"20","author":"Shermeh","year":"2010","journal-title":"Digit. Signal Process."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1016\/j.asoc.2011.08.025","article-title":"A novel method for automatic modulation recognition","volume":"12","author":"Sherme","year":"2012","journal-title":"Appl. Soft Comput."},{"key":"ref_15","unstructured":"Panagiotou, P., Anastasopoulos, A., and Polydoros, A. (2000, January 22\u201325). Likelihood ratio tests for modulation classification. Proceedings of the 21st Century Military Communications Conference Proceedings, Los Angeles, CA, USA."},{"key":"ref_16","unstructured":"Wong, M., and Nandi, A. (2001, January 13\u201316). Automatic digital modulation recognition using spectral and statistical features with multi-layer perceptions. Proceedings of the Sixth International Symposium on Signal Processing and its Applications, Kuala Lumpur, Malaysia."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/S0167-7012(00)00201-3","article-title":"Artificial neural networks: Fundamentals, computing, design, and application","volume":"43","author":"Basheer","year":"2000","journal-title":"J. Microbiol. Methods"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1066","DOI":"10.1016\/j.envsoft.2006.05.026","article-title":"An artificial neural network model for mountainous water-resources management: The case of Cyprus mountainous watersheds","volume":"22","author":"Iliadis","year":"2007","journal-title":"Environ. Model. Softw."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.phycom.2017.09.004","article-title":"Unsupervised feature learning and automatic modulation classification using deep learning model","volume":"25","author":"Ali","year":"2017","journal-title":"Phys. Commun."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.dsp.2017.09.005","article-title":"Automatic modulation classification of digital modulation signals with stacked autoencoders","volume":"71","author":"Ali","year":"2017","journal-title":"Digit. Signal Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1109\/TPAMI.2012.59","article-title":"3D convolutional neural networks for human action recognition","volume":"35","author":"Ji","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., and Li, F. (2014, January 23\u201328). Large-scale video classification with convolutional neural networks. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.223"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Luan, S., Zhang, B., Chen, C., Han, J., and Liu, J. (arXiv, 2017). Gabor Convolutional Networks, arXiv.","DOI":"10.1109\/WACV.2018.00142"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhang, B., Gu, J., Chen, C., Han, J., Su, X., Cao, X., and Liu, J. (2018). One-Two-One network for Compression Artifacts Reduction in Remote Sensing. ISPRS J. Photogramm. Remote Sens.","DOI":"10.1016\/j.isprsjprs.2018.01.003"},{"key":"ref_25","unstructured":"Duong, T., Bui, H., Phung, D., and Venkatesh, S. (2005, January 20\u201325). Activity recognition and abnormality detection with the switching hidden semi-markov model. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Sminchisescu, C., Kanaujia, A., Li, Z., and Metaxas, D. (2005, January 17\u201321). Conditional models for contextual human motion recognition. Proceedings of the Tenth IEEE International Conference on Computer Vision, Beijing, China.","DOI":"10.1109\/ICCV.2005.59"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ikizler, N., and Forsyth, D. (2007, January 17\u201322). Searching video for complex activities with finite state models. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383168"},{"key":"ref_28","unstructured":"Srivastava, N., Mansimov, E., and Salakhutdinov, R. (2015, January 6\u201311). Unsupervised learning of video representations using LSTMs. Proceedings of the 32nd International Conference on International Conference on Machine Learning, Lille, France."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1109\/TPAMI.2016.2599174","article-title":"Long-term recurrent convolutional networks for visual recognition and description","volume":"39","author":"Donahue","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","unstructured":"Ng, J.Y., Hausknecht, M.J., Vijayanarasimhan, S., Vinyals, O., Monga, R., and Toderici, G. (2015, January 7\u201312). Beyond short snippets: Deep networks for video classification. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wu, Z., Wang, X., Jiang, Y., Ye, H., and Xue, X. (2015, January 26\u201330). Modeling spatial-temporal clues in a hybrid deep learning framework for video classification. Proceedings of the 23rd ACM International Conference on Multimedia, Brisbane, Australia.","DOI":"10.1145\/2733373.2806222"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Venugopalan, S., Rohrbach, M., Donahue, J., Mooney, R.J., Darrell, T., and Saenko, K. (2015, January 7\u201313). Sequence to sequence\u2014Video to text. Proceedings of the 2015 IEEE International Conference on Computer Vision, Los Alamitos, CA, USA.","DOI":"10.1109\/ICCV.2015.515"},{"key":"ref_33","unstructured":"Lazebnik, S., Schmid, C., and Ponce, J. (2006, January 17\u201322). Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, NY, USA."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"4648","DOI":"10.1109\/TIP.2017.2718189","article-title":"Action Recognition Using 3D Histograms of Texture and A Multi-class Boosting Classifier","volume":"26","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1016\/j.patcog.2017.12.023","article-title":"Deep Fisher Discriminant Learning for Mobile Hand Gesture Recognition","volume":"77","author":"Li","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Yao, L., Torabi, A., Cho, K., Ballas, N., Pal, C., Larochelle, H., and Courville, A. (2015, January 7\u201313). Describing videos by exploiting temporal structure. Proceedings of the 2015 IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.512"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1038","DOI":"10.1109\/TIP.2017.2775060","article-title":"Latent Constrained Correlation Filter","volume":"27","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_38","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016, January 2\u20134). Tensorflow: Large-scale machine learning on heterogeneous distributed systems. Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation, Savannah, GA, USA."},{"key":"ref_39","unstructured":"Kingma, D.P., and Ba, J. (2018, March 01). Adam: A Method for Stochastic Optimization. Available online: http:\/\/arxiv.org\/abs\/1412.6980."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"7068349","DOI":"10.1155\/2018\/7068349","article-title":"Deep learning for computer vision: A brief review","volume":"2018","author":"Voulodimos","year":"2018","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_41","unstructured":"Wang, Z., Hu, R., Chen, C., Yu, Y., Jiang, J., Liang, C., and Satoh, S. (2017). Person Re-identification via Discrepancy Matrix and Matrix Metric. IEEE Trans. Cybern., 1\u20135."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"776","DOI":"10.1109\/TIP.2015.2507445","article-title":"Articulated and Generalized Gaussian Kernel Correlation for Human Pose Estimation","volume":"25","author":"Ding","year":"2016","journal-title":"IEEE Trans. Image Process."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/3\/924\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:57:47Z","timestamp":1760194667000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/3\/924"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,3,20]]},"references-count":42,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2018,3]]}},"alternative-id":["s18030924"],"URL":"https:\/\/doi.org\/10.3390\/s18030924","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,3,20]]}}}