{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T17:52:08Z","timestamp":1782582728078,"version":"3.54.5"},"reference-count":40,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2021,5,28]],"date-time":"2021-05-28T00:00:00Z","timestamp":1622160000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["62071056"],"award-info":[{"award-number":["62071056"]}]},{"name":"the action plan project of Beijing University of Posts and Telecommunications","award":["2020XD-A03-1"],"award-info":[{"award-number":["2020XD-A03-1"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Text, voice, images and videos can express some intentions and facts in daily life. By understanding these contents, people can identify and analyze some behaviors. This paper focuses on the commodity trade declaration process and identifies the commodity categories based on text information on customs declarations. Although the technology of text recognition is mature in many application fields, there are few studies on the classification and recognition of customs declaration goods. In this paper, we proposed a classification framework based on machine learning (ML) models for commodity trade declaration that reaches a high rate of accuracy. This paper also proposed a symmetrical decision fusion method for this task based on convolutional neural network (CNN) and transformer. The experimental results show that the fusion model can make up for the shortcomings of the two original models and some improvements have been made. In the two datasets used in this paper, the accuracy can reach 88% and 99%, respectively. To promote the development of study of customs declaration business and Chinese text recognition, we also exposed the proprietary datasets used in this study.<\/jats:p>","DOI":"10.3390\/sym13060964","type":"journal-article","created":{"date-parts":[[2021,5,31]],"date-time":"2021-05-31T03:45:29Z","timestamp":1622432729000},"page":"964","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["A Commodity Classification Framework Based on Machine Learning for Analysis of Trade Declaration"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2896-4595","authenticated-orcid":false,"given":"Mingshu","family":"He","sequence":"first","affiliation":[{"name":"School of Electronic Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaojuan","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Electronic Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chundong","family":"Zou","sequence":"additional","affiliation":[{"name":"School of Electronic Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bingying","family":"Dai","sequence":"additional","affiliation":[{"name":"Department of Statistics, Colorado State University, Fort Collins, CO 80523, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4855-2464","authenticated-orcid":false,"given":"Lei","family":"Jin","sequence":"additional","affiliation":[{"name":"School of Computer Science, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,28]]},"reference":[{"key":"ref_1","unstructured":"International Trade Administration (2021, April 10). Harmonized System (HS) Codes, Available online: https:\/\/www.trade.gov\/harmonized-system-hs-codes."},{"key":"ref_2","first-page":"8","article-title":"Air Transport Policy & Regulation about Live Animal on Pandemic Season","volume":"3","author":"Fredrian","year":"2020","journal-title":"Adv. Transp. Logist. Res."},{"key":"ref_3","first-page":"575","article-title":"A survey of big data and machine learning","volume":"10","author":"Salkuti","year":"2020","journal-title":"Int. J. Electr. Comput. Eng. (2088-8708)"},{"key":"ref_4","unstructured":"Maziarka, \u0141., Danel, T., Mucha, S., Rataj, K., Tabor, J., and Jastrz\u0119bski, S. (2020). Molecule attention transformer. arXiv."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1151","DOI":"10.1007\/s11036-019-01443-z","article-title":"Behavdt: A behavioral decision tree learning to build user-centric context-aware predictive model","volume":"25","author":"Sarker","year":"2020","journal-title":"Mob. Netw. Appl."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Zeng, J., Chen, Y., Zhu, H., Tian, F., Miao, K., Liu, Y., and Zheng, Q. (2020, January 24\u201327). User Sequential Behavior Classification for Click-Through Rate Prediction. Proceedings of the International Conference on Database Systems for Advanced Applications, Jeju, Korea.","DOI":"10.1007\/978-3-030-59413-8_22"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Altaheri, F., and Shaalan, K. (2019, January 25\u201326). Exploring Machine Learning Models to Predict Harmonized System Code. Proceedings of the European, Mediterranean, and Middle Eastern Conference on Information Systems, Dubai, United Arab Emirates.","DOI":"10.1007\/978-3-030-44322-1_22"},{"key":"ref_8","first-page":"145","article-title":"A study using machine learning with Ngram model in harmonized system classification","volume":"12","author":"Harsani","year":"2020","journal-title":"J. Adv. Res. Dyn. Control Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"501","DOI":"10.9728\/dcs.2021.22.3.501","article-title":"Development of a Natural Language Processing based Deep Learning Model for Automated HS Code Classification of the Imported Goods","volume":"22","author":"Lee","year":"2021","journal-title":"J. Digit. Contents Soc."},{"key":"ref_10","first-page":"698","article-title":"Application of Machine Learning for Assessment of HS Code Correctness","volume":"8","author":"Spichakova","year":"2020","journal-title":"Balt. J. Mod. Comput."},{"key":"ref_11","first-page":"1","article-title":"CNN-based Recommendation Model for Classifying HS Code","volume":"39","author":"Lee","year":"2020","journal-title":"Manag. Inf. Syst. Rev."},{"key":"ref_12","unstructured":"Kyung-Ah, Y., Chung, M., and Ku, K.I. (2012). Apparatus and Method of Searching hs Codes Using Ontology. (13\/278,372), U.S. Patent."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1462","DOI":"10.1016\/j.procs.2015.08.224","article-title":"Auto-categorization of HS code using background net approach","volume":"60","author":"Ding","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_14","unstructured":"Reid, C. (2019). System and Method for Dynamic hs Code Classification through Image Analysis and Machine Learning. (16\/275,138), U.S. Patent."},{"key":"ref_15","first-page":"13","article-title":"Research on the Classification Method of HS Code Products Based on Deep Learning","volume":"01","author":"Xu","year":"2019","journal-title":"Mod. Comput."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, H., Jiang, H., Wang, D., and Han, B. (2018, January 19\u201321). An improved KNN algorithm for text classification. Proceedings of the 2018 Eighth International Conference on Instrumentation & Measurement, Computer, Communication and Control (IMCCC), Harbin, China.","DOI":"10.1109\/IMCCC.2018.00225"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1007\/s11633-015-0912-z","article-title":"A novel active learning method using SVM for text classification","volume":"15","author":"Goudjil","year":"2018","journal-title":"Int. J. Autom. Comput."},{"key":"ref_18","first-page":"2913","article-title":"An Improved Random Forest Classifier for Text Categorization","volume":"7","author":"Xu","year":"2012","journal-title":"JCP"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). Xgboost: A scalable tree boosting system. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhang, L., and Zhan, C. (2017, January 17\u201320). Machine learning in rock facies classification: An application of XGBoost. Proceedings of the International Geophysical Conference, Qingdao, China.","DOI":"10.1190\/IGC2017-351"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Kowsari, K., Jafari Meimandi, K., Heidarysafa, M., Mendu, S., Barnes, L., and Brown, D. (2019). Text classification algorithms: A survey. Information, 10.","DOI":"10.3390\/info10040150"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Yang, J., Bai, L., and Guo, Y. (2020, January 3\u20135). A survey of text classification models. Proceedings of the 2020 2nd International Conference on Robotics, Intelligent Control and Artificial Intelligence, Guilin, China.","DOI":"10.1145\/3438872.3439101"},{"key":"ref_23","unstructured":"Li, Q., Peng, H., Li, J., Xia, C., Yang, R., Sun, L., Yu, P.S., and He, L. (2020). A Text Classification Survey: From Shallow to Deep Learning. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"012030","DOI":"10.1088\/1757-899X\/1042\/1\/012030","article-title":"A literature survey on recurrent attention learning for text classification","volume":"1042","author":"Mariyam","year":"2021","journal-title":"IOP Conf. Ser. Mater. Sci. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1016\/j.neucom.2019.07.052","article-title":"Improving text classification with weighted word embeddings via a multi-channel TextCNN model","volume":"363","author":"Guo","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Yao, L., Huang, H., Wang, K.W., Chen, S.H., and Xiong, Q. (2020). Fine-Grained Mechanical Chinese Named Entity Recognition Based on ALBERT-AttBiLSTM-CRF and Transfer Learning. Symmetry, 12.","DOI":"10.3390\/sym12121986"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Jang, B., Kim, I., and Kim, J.W. (2019). Word2vec convolutional neural networks for classification of news articles and tweets. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0220976"},{"key":"ref_28","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lv, X., Liu, K., and Shi, S. (2010, January 6\u20137). Study on SVM compared with the other text classification methods. Proceedings of the 2010 Second International Workshop on Education Technology and Computer Science, Wuhan, China.","DOI":"10.1109\/ETCS.2010.248"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Sun, C., Qiu, X., Xu, Y., and Huang, X. (2019, January 18\u201320). How to fine-tune BERT for text classification?. Proceedings of the China National Conference on Chinese Computational Linguistics, Kunming, China.","DOI":"10.1007\/978-3-030-32381-3_16"},{"key":"ref_31","unstructured":"Wu, Y., Schuster, M., Chen, Z., Le, Q.V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., and Macherey, K. (2016). Google\u2019s neural machine translation system: Bridging the gap between human and machine translation. arXiv."},{"key":"ref_32","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention is all you need. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ma, L., and Zhang, Y. (November, January 29). Using Word2Vec to process big text data. Proceedings of the 2015 IEEE International Conference on Big Data (Big Data), Santa Clara, CA, USA.","DOI":"10.1109\/BigData.2015.7364114"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1445","DOI":"10.1109\/JSEN.2019.2947446","article-title":"Human action recognition using deep multilevel multimodal fusion of depth and inertial sensors","volume":"20","author":"Ahmad","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_35","unstructured":"Mingshu, H., Xiaojuan, W., Chundong, Z., Bingying, D., and Lei, J. (2021, April 09). Available Datasets of HS-Code Classification Task in Chinese. Available online: https:\/\/figshare.com\/articles\/dataset\/BUPT_ICNCAD_Harmonization_System_Code_Datasets_rar\/14355821\/1."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/S0375-9601(00)00725-8","article-title":"Extended tanh-function method and its applications to nonlinear equations","volume":"277","author":"Fan","year":"2000","journal-title":"Phys. Lett. A"},{"key":"ref_37","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_39","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Liu, C., Zoph, B., Neumann, M., Shlens, J., Hua, W., Li, L.J., Li, F.-F., Yuille, A., Huang, J., and Murphy, K. (2018, January 8\u201314). Progressive neural architecture search. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01246-5_2"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/6\/964\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:10:12Z","timestamp":1760163012000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/6\/964"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,28]]},"references-count":40,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["sym13060964"],"URL":"https:\/\/doi.org\/10.3390\/sym13060964","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,28]]}}}