{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T15:31:43Z","timestamp":1775143903158,"version":"3.50.1"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,10,5]],"date-time":"2021-10-05T00:00:00Z","timestamp":1633392000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["1956193"],"award-info":[{"award-number":["1956193"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Manage. Inf. Syst."],"published-print":{"date-parts":[[2022,3,31]]},"abstract":"<jats:p>\n            In the past decades, information from all kinds of data has been on a rapid increase. With state-of-the-art performance, machine learning algorithms have been beneficial for information management. However, insufficient supervised training data is still an adversity in many real-world applications. Therefore, transfer learning (TF) was proposed to address this issue. This article studies a not well investigated but important TL problem termed\n            <jats:italic>cross-modality transfer learning<\/jats:italic>\n            (CMTL). This topic is closely related to distant domain transfer learning (DDTL) and negative transfer. In general, conventional TL disciplines assume that the source domain and the target domain are in the same modality. DDTL aims to make efficient transfers even when the domains or the tasks are entirely different. As an extension of DDTL, CMTL aims to make efficient transfers between two different data modalities, such as from image to text. As the main focus of this study, we aim to improve the performance of image classification by transferring knowledge from text data. Previously, a few CMTL algorithms were proposed to deal with image classification problems. However, most existing algorithms are very task specific, and they are unstable on convergence. There are four main contributions in this study. First, we propose a novel heterogeneous CMTL algorithm, which requires only a tiny set of unlabeled target data and labeled source data with associate text tags. Second, we introduce a latent semantic information extraction method to connect the information learned from the image data and the text data. Third, the proposed method can effectively handle the information transfer across different modalities (text-image). Fourth, we examined our algorithm on a public dataset, Office-31. It has achieved up to 5% higher classification accuracy than \u201cnon-transfer\u201d algorithms and up to 9% higher than existing CMTL algorithms.\n          <\/jats:p>","DOI":"10.1145\/3464324","type":"journal-article","created":{"date-parts":[[2021,10,5]],"date-time":"2021-10-05T18:37:36Z","timestamp":1633459056000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Cross-Modality Transfer Learning for Image-Text Information Management"],"prefix":"10.1145","volume":"13","author":[{"given":"Shuteng","family":"Niu","sequence":"first","affiliation":[{"name":"Embry-Riddle Aeronautical University, Daytona Beach, FL"}]},{"given":"Yushan","family":"Jiang","sequence":"additional","affiliation":[{"name":"Embry-Riddle Aeronautical University, Daytona Beach, FL"}]},{"given":"Bowen","family":"Chen","sequence":"additional","affiliation":[{"name":"Embry-Riddle Aeronautical University, Daytona Beach, FL"}]},{"given":"Jian","family":"Wang","sequence":"additional","affiliation":[{"name":"Embry-Riddle Aeronautical University, Daytona Beach, FL"}]},{"given":"Yongxin","family":"Liu","sequence":"additional","affiliation":[{"name":"Embry-Riddle Aeronautical University, Daytona Beach, FL"}]},{"given":"Houbing","family":"Song","sequence":"additional","affiliation":[{"name":"Embry-Riddle Aeronautical University, Daytona Beach, FL"}]}],"member":"320","published-online":{"date-parts":[[2021,10,5]]},"reference":[{"key":"e_1_3_1_2_2","first-page":"1","volume-title":"Proceedings of the 2020 IEEE 25th International Workshop on Computer Aided Modeling and Design of Communication Links and Networks","author":"Andreas Andreou","year":"2020","unstructured":"Andreou Andreas, Constandinos X. Mavromoustakis, George Mastorakis, Shahid Mumtaz, Jordi Mongay Batalla, and Evangelos Pallis. 2020. Modified machine learning technique for curve fitting on regression models for COVID-19 projections. In Proceedings of the 2020 IEEE 25th International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD'20). IEEE, Los Alamitos, CA, 1\u20136."},{"key":"e_1_3_1_3_2","first-page":"35","volume-title":"Proceedings of the KDD Cup and Workshop","year":"2007","unstructured":"James Bennett and Stan Lanning. 2007. The Netflix Prize. In Proceedings of the KDD Cup and Workshop. 35."},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW50498.2020.00388"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btl242"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2019.03.009"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.5555\/2981780.2981825"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.5555\/3384123"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3439771"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1002\/sam.11217"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2019.2957320"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_1_13_2","doi-asserted-by":"crossref","unstructured":"Jeremy Howard and Sebastian Ruder. 2018. Universal language model fine-tuning for text classification. arXiv:1801.06146.","DOI":"10.18653\/v1\/P18-1031"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.5555\/3028809"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.5555\/2999134.2999257"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.106548"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.04.102"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2019.06.005"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2017.1700090"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2017.1600240"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.5555\/3305890.3305909"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2017.2650204"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData50022.2020.9378493"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2021.3051470"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAI.2021.3054609"},{"key":"e_1_3_1_26_2","first-page":"620","volume-title":"Proceedings of the 2020 IEEE International Conference on Dependable, Autonomic and Secure Computing, the International Conference on Pervasive Intelligence and Computing, the International Conference on Cloud and Big Data Computing, and the International Conference on Cyber Science and Technology Congress","author":"Niu S.","year":"2020","unstructured":"S. Niu, J. Wang, Y. Liu, and H. Song. 2020. Transfer learning based data-efficient machine learning enabled classification. In Proceedings of the 2020 IEEE International Conference on Dependable, Autonomic and Secure Computing, the International Conference on Pervasive Intelligence and Computing, the International Conference on Cloud and Big Data Computing, and the International Conference on Cyber Science and Technology Congress (DASC\/PiCom\/CBDCom\/ CyberSciTech'20). 620\u2013626. https:\/\/doi.org\/10.1109\/DASC-PICom-CBDCom-CyberSciTech49142.2020.00108"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.191"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.5555\/2283696.2283784"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.5555\/2898607.2898644"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TEMU.2014.6917738"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.5555\/3504035.3504517"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2016.2528162"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.5555\/3202460"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.5555\/3050798"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.5555\/3165248"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-49409-8_35"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2016.2529723"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783295"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.5555\/3298483.3298614"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cels.2019.04.003"},{"key":"e_1_3_1_41_2","doi-asserted-by":"crossref","unstructured":"Volodymyr Turchenko Eric Chalmers and Artur Luczak. 2017. A deep convolutional auto-encoder with pooling-unpooling layers in Caffe. arXiv:1701.04949.","DOI":"10.1109\/IDAACS.2017.8095172"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3360309"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.5555\/3016387.3016457"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.5555\/2969033.2969197"},{"key":"e_1_3_1_45_2","article-title":"Deep model based transfer and multi-task learning for biological image analysis","author":"Zhang Wenlu","year":"2016","unstructured":"Wenlu Zhang, Rongjian Li, Tao Zeng, Qian Sun, Sudhir Kumar, Jieping Ye, and Shuiwang Ji. 2016. Deep model based transfer and multi-task learning for biological image analysis. IEEE Transactions on Big Data 6, 2 (2016), 322\u2013333.","journal-title":"IEEE Transactions on Big Data"},{"key":"e_1_3_1_46_2","unstructured":"Yunhan Zhao Haider Ali and Ren\u00e9 Vidal. 2017. Stretching domain adaptation: How far is too far? arXiv:1712.02286."},{"key":"e_1_3_1_47_2","first-page":"1304","volume-title":"Proceedings of the 25th AAAI Conference on Artificial Intelligence","author":"Zhu Yin","year":"2011","unstructured":"Yin Zhu, Yuqiang Chen, Zhongqi Lu, Sinno Jialin Pan, Gui-Rong Xue, Yong Yu, and Qiang Yang. 2011. Heterogeneous transfer learning for image classification. In Proceedings of the 25th AAAI Conference on Artificial Intelligence. 1304\u20131309."}],"container-title":["ACM Transactions on Management Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3464324","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3464324","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3464324","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:12:16Z","timestamp":1750191136000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3464324"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,5]]},"references-count":46,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,3,31]]}},"alternative-id":["10.1145\/3464324"],"URL":"https:\/\/doi.org\/10.1145\/3464324","relation":{},"ISSN":["2158-656X","2158-6578"],"issn-type":[{"value":"2158-656X","type":"print"},{"value":"2158-6578","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,5]]},"assertion":[{"value":"2021-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-10-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}