{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T23:27:14Z","timestamp":1769556434497,"version":"3.49.0"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2024,2,22]],"date-time":"2024-02-22T00:00:00Z","timestamp":1708560000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100010446","name":"Institute for Basic Science","doi-asserted-by":"crossref","award":["IBS-R029-C2"],"award-info":[{"award-number":["IBS-R029-C2"]}],"id":[{"id":"10.13039\/501100010446","id-type":"DOI","asserted-by":"crossref"}]},{"name":"NRF","award":["RS-2023-00240062"],"award-info":[{"award-number":["RS-2023-00240062"]}]},{"name":"IITP","award":["RS-2023-00216011, 2019-0-01842"],"award-info":[{"award-number":["RS-2023-00216011, 2019-0-01842"]}]},{"name":"Ministry of Science and ICT in Korea"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2024,4,30]]},"abstract":"<jats:p>The task of assigning internationally accepted commodity codes (aka HS codes) to traded goods is a critical function of customs offices. Like court decisions made by judges, this task follows the doctrine of precedent and can be nontrivial even for experienced officers. Together with the Korea Customs Service (KCS), we propose a first-ever explainable decision supporting model that suggests the most likely subheadings (i.e., the first six digits) of the HS code. The model also provides reasoning for its suggestion in the form of a document that is interpretable by customs officers. We evaluated the model using 5,000 cases that recently received a classification request. The results showed that the top-3 suggestions made by our model had an accuracy of 93.9% when classifying 925 challenging subheadings. A user study with 32 customs experts further confirmed that our algorithmic suggestions accompanied by explainable reasonings, can substantially reduce the time and effort taken by customs officers for classification reviews.<\/jats:p>","DOI":"10.1145\/3635158","type":"journal-article","created":{"date-parts":[[2023,12,1]],"date-time":"2023-12-01T11:46:47Z","timestamp":1701431207000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Explainable Product Classification for Customs"],"prefix":"10.1145","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3961-5793","authenticated-orcid":false,"given":"Eunji","family":"Lee","sequence":"first","affiliation":[{"name":"School of Computing, KAIST, Daejeon, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-9474-1122","authenticated-orcid":false,"given":"Sihyeon","family":"Kim","sequence":"additional","affiliation":[{"name":"School of Computing, KAIST, Daejeon, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9687-2409","authenticated-orcid":false,"given":"Sundong","family":"Kim","sequence":"additional","affiliation":[{"name":"AI Graduate School, GIST, Gwangju, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-8714-6937","authenticated-orcid":false,"given":"Soyeon","family":"Jung","sequence":"additional","affiliation":[{"name":"ICT and Data Policy Bureau, Korea Customs Service, Daejeon, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-5005-7282","authenticated-orcid":false,"given":"Heeja","family":"Kim","sequence":"additional","affiliation":[{"name":"Customs Valuation and Classification Institute, Korea Customs Service, Daejeon, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4085-9648","authenticated-orcid":false,"given":"Meeyoung","family":"Cha","sequence":"additional","affiliation":[{"name":"School of Computing, KAIST, Daejeon, Republic of Korea"}]}],"member":"320","published-online":{"date-parts":[[2024,2,22]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-44322-1_22"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6247"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468891.3468915"},{"key":"e_1_3_2_5_2","unstructured":"Hao Cheng Xiaoqing Yang Zang Li Yanghua Xiao and Yucheng Lin. 2019. Interpretable text classification using CNN and max-pooling. arXiv:1910.11236. Retrieved from https:\/\/arxiv.org\/abs\/cs\/1910.11236"},{"key":"e_1_3_2_6_2","unstructured":"Huyen Chip. 2022. Designing Machine Learning Systems: An Iterative Process for Production-Ready Applications. (1 ed.) O\u2019Reilly."},{"key":"e_1_3_2_7_2","article-title":"Harmonized commodity description and coding system explanatory notes","author":"HS Ciel","year":"2022","unstructured":"Ciel HS. 2022. Harmonized commodity description and coding system explanatory notes. Retrieved from https:\/\/www.clhs.co.kr\/uploads\/lawfile\/404n2563.pdf. (2022). Accessed: 2022-02-27.","journal-title":"https:\/\/www.clhs.co.kr\/uploads\/lawfile\/404n2563.pdf"},{"key":"e_1_3_2_8_2","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR)","author":"Clark Kevin","year":"2020","unstructured":"Kevin Clark, Minh-Thang Luong, Quoc V Le, and Christopher D Manning. 2020. ELECTRA: Pre-training text encoders as discriminators rather than generators. In Proceedings of the International Conference on Learning Representations (ICLR)."},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5035"},{"key":"e_1_3_2_10_2","doi-asserted-by":"crossref","unstructured":"Hans de Bruijn Martijn Warnier and Marijn Janssen. 2021. The perils and pitfalls of explainable AI: Strategies for explaining algorithmic decision-making. Government Information Quarterly 39 2 (2021) 101666.","DOI":"10.1016\/j.giq.2021.101666"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.08.224"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.710"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.711"},{"key":"e_1_3_2_14_2","first-page":"1321","volume-title":"Proceedings of the International Conference on Machine Learning (ICML)","author":"Guo Chuan","year":"2017","unstructured":"Chuan Guo, Geoff Pleiss, Yu Sun, and Kilian Q. Weinberger. 2017. On calibration of modern neural networks. In Proceedings of the International Conference on Machine Learning (ICML). 1321\u20131330."},{"key":"e_1_3_2_15_2","first-page":"4171","volume-title":"Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)","author":"Kenton Jacob Devlin Ming-Wei Chang","year":"2019","unstructured":"Jacob Devlin Ming-Wei Chang Kenton and Lee Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT). 4171\u20134186."},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6319"},{"key":"e_1_3_2_17_2","doi-asserted-by":"crossref","unstructured":"Sundong Kim Tung-Duong Mai Sungwon Han Sungwon Park D. K. Thi Nguyen Jaechan So Karandeep Singh and Meeyoung Cha. 2023. Active learning for human-in-the-loop customs inspection. IEEE Transactions on Knowledge and Data Engineering 35 12 (2023) 12039\u201312052.","DOI":"10.1109\/TKDE.2022.3144299"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2017.09.014"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2021.103473"},{"issue":"3","key":"e_1_3_2_20_2","first-page":"1","article-title":"CNN-based recommendation model for classifying HS code","volume":"39","author":"Lee Dongju","year":"2020","unstructured":"Dongju Lee, Gunwoo Kim, and Keunho Choi. 2020. CNN-based recommendation model for classifying HS code. Management & Information Systems Review 39, 3 (2020), 1\u201316.","journal-title":"Management & Information Systems Review"},{"key":"e_1_3_2_21_2","volume-title":"Proceedings of the Korea Artificial Intelligence Conference (KAIA)","author":"Lee Eunji","year":"2021","unstructured":"Eunji Lee, Sundong Kim, Sihyun Kim, Sungwon Park, Meeyoung Cha, Soyeon Jung, Suyoung Yang, Yeonsoo Choi, Sungdae Ji, Minsoo Song, and Heeja Kim. 2021. Classification of goods using text descriptions with sentences retrieval. In Proceedings of the Korea Artificial Intelligence Conference (KAIA)."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10660-019-09334-x"},{"key":"e_1_3_2_23_2","article-title":"Classifying short text for the harmonized system with convolutional neural networks","author":"Luppes Jeffrey","year":"2019","unstructured":"Jeffrey Luppes, Arjen P de Vries, and Faegheh Hasibi. 2019. Classifying short text for the harmonized system with convolutional neural networks. Radboud University (2019).","journal-title":"Radboud University"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW53433.2021.00052"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1080\/10345329.2019.1658694"},{"issue":"2","key":"e_1_3_2_26_2","first-page":"189","article-title":"A study on the customs classification fallacy of certain ITA goods","volume":"44","author":"Park Minkyu","year":"2019","unstructured":"Minkyu Park. 2019. A study on the customs classification fallacy of certain ITA goods. Korea Trade Review 44, 2 (2019), 189\u2013202.","journal-title":"Korea Trade Review"},{"key":"e_1_3_2_27_2","first-page":"1","volume-title":"Proceedings of the Neural Information Processing Systems (NeurIPS), Track on Datasets and Benchmarks","author":"Park Sungjoon","year":"2021","unstructured":"Sungjoon Park, Jihyung Moon, Sungdong Kim, Won Ik Cho, Jiyoon Han, Jangwon Park, Chisung Song, Junseong Kim, Yongsook Song, Taehwan Oh, Joohong Lee, Juhyun Oh, Sungwon Lyu, Younghoon Jeong, Inkwon Lee, Sangwoo Seo, Dongjun Lee, Hyunwoo Kim, Myeonghwa Lee, Seongbo Jang, Seungwon Do, Sunkyoung Kim, Kyungtae Lim, Jongwon Lee, Kyumin Park, Jamin Shin, Seonghyun Kim, Lucy Park, Alice Oh, Jungwoo Ha, and Kyunghyun Cho. 2021. KLUE: Korean language understanding evaluation. In Proceedings of the Neural Information Processing Systems (NeurIPS), Track on Datasets and Benchmarks. 1\u201325."},{"key":"e_1_3_2_28_2","first-page":"29","volume-title":"Proceedings of the International Conference on Machine Learning (ICML)","volume":"242","author":"Ramos Juan","year":"2003","unstructured":"Juan Ramos. 2003. Using TF-IDF to determine word relevance in document queries. In Proceedings of the International Conference on Machine Learning (ICML), Vol. 242. 29\u201348."},{"key":"e_1_3_2_29_2","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR)","author":"Seo Minjoon","year":"2017","unstructured":"Minjoon Seo, Aniruddha Kembhavi, Ali Farhadi, and Hannaneh Hajishirzi. 2017. Bidirectional attention flow for machine comprehension. In Proceedings of the International Conference on Learning Representations (ICLR)."},{"key":"e_1_3_2_30_2","article-title":"E-commerce goods import trend","author":"Service Korea Customs","year":"2018","unstructured":"Korea Customs Service. 2018. E-commerce goods import trend. Retrieved from https:\/\/url.kr\/4bp9ew. (2018). Accessed: 2023-07-16.","journal-title":"https:\/\/url.kr\/4bp9ew"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-main.335"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.53637\/ZGUX2213"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-5306"},{"key":"e_1_3_2_34_2","article-title":"Smartwatch is a communication device","author":"Times The Korea","year":"2015","unstructured":"The Korea Times. 2015. Smartwatch is a communication device. Retrieved from https:\/\/tinyurl.com\/4vrfx7ef. (2015). Accessed: 2022-02-27.","journal-title":"https:\/\/tinyurl.com\/4vrfx7ef"},{"key":"e_1_3_2_35_2","first-page":"1120","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"T.Y.S.S Santosh","year":"2022","unstructured":"Santosh T.Y.S.S, Shanshan Xu, Oana Ichim, and Matthias Grabmair. 2022. Deconfounding legal judgment prediction for european court of human rights cases towards better alignment with experts. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP). 1120\u20131138."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.eacl-main.15"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K19-1065"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1018"},{"key":"e_1_3_2_39_2","unstructured":"Zhengyang Wang Xia Hu and Shuiwang Ji. 2020. iCapsNets: Towards interpretable capsule networks for text classification. arXiv:2006.00075. Retrieved from https:\/\/arxiv.org\/abs\/cs\/2006.00075"},{"key":"e_1_3_2_40_2","volume-title":"Proceedings of the Neural Information Processing Systems (NeurIPS), Track on Datasets and Benchmarks","author":"Wiegreffe Sarah","year":"2021","unstructured":"Sarah Wiegreffe and Ana Marasovi\u0107. 2021. Teach me to explain: A review of datasets for explainable NLP. In Proceedings of the Neural Information Processing Systems (NeurIPS), Track on Datasets and Benchmarks."},{"key":"e_1_3_2_41_2","article-title":"General rules for the interpretation of the harmonized system","year":"2022","unstructured":"Wikipedia. 2022. General rules for the interpretation of the harmonized system. Retrieved from https:\/\/en.wikipedia.org\/wiki\/General_Rules_for_the_Interpretation_of_the_Harmonized_System. (2022). Accessed: 2022-02-27.","journal-title":"https:\/\/en.wikipedia.org\/wiki\/General_Rules_for_the_Interpretation_of_the_Harmonized_System"},{"key":"e_1_3_2_42_2","volume-title":"Proceedings of the Judicial Decision-Making: Integrating Empirical and Theoretical Perspectives","author":"Winter Christoph","unstructured":"Christoph Winter. forthcoming. The challenges of artificial judicial decision making for liberal democracy. In Proceedings of the Judicial Decision-Making: Integrating Empirical and Theoretical Perspectives."},{"key":"e_1_3_2_43_2","article-title":"HS compendium\u2014The harmonized system, a universal language for international trade","author":"Organization World Customs","year":"2018","unstructured":"World Customs Organization. 2018. HS compendium\u2014The harmonized system, a universal language for international trade. Retrieved from https:\/\/tinyurl.com\/ycr259ty. (2018). Accessed: 2022-02-27.","journal-title":"https:\/\/tinyurl.com\/ycr259ty"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.414"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1259"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3449979"},{"key":"e_1_3_2_47_2","unstructured":"Wei Zhao Rahul Singh Tarun Joshi Agus Sudjianto and Vijayan N. Nair. 2021. Self-interpretable convolutional neural networks for text classification. arXiv:2105.08589. Retrieved from https:\/\/arxiv.org\/abs\/cs\/2105.08589"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3635158","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3635158","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:49:06Z","timestamp":1750286946000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3635158"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,22]]},"references-count":46,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,4,30]]}},"alternative-id":["10.1145\/3635158"],"URL":"https:\/\/doi.org\/10.1145\/3635158","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,22]]},"assertion":[{"value":"2022-04-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-11-17","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-02-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}