{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,28]],"date-time":"2026-10-28T16:55:49Z","timestamp":1793206549853,"version":"4.5.0"},"publisher-location":"New York, NY, USA","reference-count":46,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T00:00:00Z","timestamp":1665360000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,10,10]]},"DOI":"10.1145\/3503161.3548187","type":"proceedings-article","created":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T11:43:12Z","timestamp":1665402192000},"page":"453-461","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":96,"title":["Differentiable Cross-modal Hashing via Multimodal Transformers"],"prefix":"10.1145","author":[{"given":"Junfeng","family":"Tu","sequence":"first","affiliation":[{"name":"Hefei University of Technology, Hefei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xueliang","family":"Liu","sequence":"additional","affiliation":[{"name":"Hefei University of Technology, Hefei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zongxiang","family":"Lin","sequence":"additional","affiliation":[{"name":"Dalian Naval Academy, Dalian, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richang","family":"Hong","sequence":"additional","affiliation":[{"name":"Hefei University of Technology, Hefei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Meng","family":"Wang","sequence":"additional","affiliation":[{"name":"Hefei University of Technology, Hefei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,10,10]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00636"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372278.3390711"},{"key":"e_1_3_2_2_3_1","volume-title":"ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware. CoRR abs\/1812.00332","author":"Cai Han","year":"2018","unstructured":"Han Cai , Ligeng Zhu , and Song Han . 2018. ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware. CoRR abs\/1812.00332 ( 2018 ). arXiv:1812.00332 http:\/\/arxiv.org\/abs\/1812.00332 Han Cai, Ligeng Zhu, and Song Han. 2018. ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware. CoRR abs\/1812.00332 (2018). arXiv:1812.00332 http:\/\/arxiv.org\/abs\/1812.00332"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01246-5_13"},{"key":"e_1_3_2_2_5_1","volume-title":"Correlation Hashing Network for Efficient Cross-Modal Retrieval. CoRR abs\/1602.06697","author":"Cao Yue","year":"2016","unstructured":"Yue Cao , Mingsheng Long , and Jianmin Wang . 2016. Correlation Hashing Network for Efficient Cross-Modal Retrieval. CoRR abs\/1602.06697 ( 2016 ). arXiv:1602.06697 http:\/\/arxiv.org\/abs\/1602.06697 Yue Cao, Mingsheng Long, and Jianmin Wang. 2016. Correlation Hashing Network for Efficient Cross-Modal Retrieval. CoRR abs\/1602.06697 (2016). arXiv:1602.06697 http:\/\/arxiv.org\/abs\/1602.06697"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3475346"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1646396.1646452"},{"key":"e_1_3_2_2_8_1","volume-title":"ExchNet: A Unified Hashing Network for Large-Scale Fine-Grained Image Retrieval. CoRR abs\/2008.01369","author":"Cui Quan","year":"2020","unstructured":"Quan Cui , Qing-Yuan Jiang , Xiu-Shen Wei , Wu-Jun Li , and Osamu Yoshie . 2020. ExchNet: A Unified Hashing Network for Large-Scale Fine-Grained Image Retrieval. CoRR abs\/2008.01369 ( 2020 ). arXiv:2008.01369 https:\/\/arxiv.org\/abs\/2008.01369 Quan Cui, Qing-Yuan Jiang, Xiu-Shen Wei, Wu-Jun Li, and Osamu Yoshie. 2020. ExchNet: A Unified Hashing Network for Large-Scale Fine-Grained Image Retrieval. CoRR abs\/2008.01369 (2020). arXiv:2008.01369 https:\/\/arxiv.org\/abs\/2008.01369"},{"key":"e_1_3_2_2_9_1","volume-title":"An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. CoRR abs\/2010.11929","author":"Dosovitskiy Alexey","year":"2020","unstructured":"Alexey Dosovitskiy , Lucas Beyer , Alexander Kolesnikov , Dirk Weissenborn , Xiaohua Zhai , Thomas Unterthiner , Mostafa Dehghani , Matthias Minderer , Georg Heigold , Sylvain Gelly , Jakob Uszkoreit , and Neil Houlsby . 2020. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. CoRR abs\/2010.11929 ( 2020 ). arXiv:2010.11929 https:\/\/arxiv.org\/abs\/2010.11929 Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby. 2020. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. CoRR abs\/2010.11929 (2020). arXiv:2010.11929 https:\/\/arxiv.org\/abs\/2010.11929"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/3322706.3361996"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298862"},{"key":"e_1_3_2_2_12_1","volume-title":"Jamie Ryan Kiros, and Sanja Fidler","author":"Faghri Fartash","year":"2017","unstructured":"Fartash Faghri , David J. Fleet , Jamie Ryan Kiros, and Sanja Fidler . 2017 . VSE : Improved Visual-Semantic Embeddings. CoRR abs\/1707.05612 (2017). arXiv:1707.05612 http:\/\/arxiv.org\/abs\/1707.05612 Fartash Faghri, David J. Fleet, Jamie Ryan Kiros, and Sanja Fidler. 2017. VSE: Improved Visual-Semantic Embeddings. CoRR abs\/1707.05612 (2017). arXiv:1707.05612 http:\/\/arxiv.org\/abs\/1707.05612"},{"key":"e_1_3_2_2_13_1","volume-title":"CLIP2Video: Mastering Video-Text Retrieval via Image CLIP. CoRR abs\/2106.11097","author":"Fang Han","year":"2021","unstructured":"Han Fang , Pengfei Xiong , Luhui Xu , and Yu Chen . 2021. CLIP2Video: Mastering Video-Text Retrieval via Image CLIP. CoRR abs\/2106.11097 ( 2021 ). arXiv:2106.11097 https:\/\/arxiv.org\/abs\/2106.11097 Han Fang, Pengfei Xiong, Luhui Xu, and Yu Chen. 2021. CLIP2Video: Mastering Video-Text Retrieval via Image CLIP. CoRR abs\/2106.11097 (2021). arXiv:2106.11097 https:\/\/arxiv.org\/abs\/2106.11097"},{"key":"e_1_3_2_2_14_1","volume-title":"Marc' Aurelio Ranzato, and Tomas Mikolov","author":"Frome Andrea","year":"2013","unstructured":"Andrea Frome , Greg S Corrado , Jon Shlens , Samy Bengio , Jeff Dean , Marc' Aurelio Ranzato, and Tomas Mikolov . 2013 . DeViSE: A Deep Visual-Semantic Embedding Model. In Advances in Neural Information Processing Systems, Vol. 26 . Curran Associates, Inc . Andrea Frome, Greg S Corrado, Jon Shlens, Samy Bengio, Jeff Dean, Marc' Aurelio Ranzato, and Tomas Mikolov. 2013. DeViSE: A Deep Visual-Semantic Embedding Model. In Advances in Neural Information Processing Systems, Vol. 26. Curran Associates, Inc."},{"key":"e_1_3_2_2_15_1","unstructured":"Dehong Gao Linbo Jin Ben Chen Minghui Qiu Peng Li Yi Wei Yi Hu and Hao Wang. 2020. FashionBERT: Text and Image Matching with Adaptive Loss for Cross-Modal Retrieval. 2251--2260.  Dehong Gao Linbo Jin Ben Chen Minghui Qiu Peng Li Yi Wei Yi Hu and Hao Wang. 2020. FashionBERT: Text and Image Matching with Adaptive Loss for Cross-Modal Retrieval. 2251--2260."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3323873.3325045"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.348"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cosrev.2020.100336"},{"key":"e_1_3_2_2_19_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_3_2_2_20_1","volume-title":"Zemel","author":"Kiros Ryan","year":"2014","unstructured":"Ryan Kiros , Ruslan Salakhutdinov , and Richard S . Zemel . 2014 . Unifying Visual-Semantic Embeddings with Multimodal Neural Language Models. CoRR abs\/1411.2539 (2014). arXiv:1411.2539 http:\/\/arxiv.org\/abs\/1411.2539 Ryan Kiros, Ruslan Salakhutdinov, and Richard S. Zemel. 2014. Unifying Visual-Semantic Embeddings with Multimodal Neural Language Models. CoRR abs\/1411.2539 (2014). arXiv:1411.2539 http:\/\/arxiv.org\/abs\/1411.2539"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298947"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01225-0_13"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00446"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00475"},{"key":"e_1_3_2_2_25_1","volume-title":"DARTS: Differentiable Architecture Search. CoRR abs\/1806.09055","author":"Liu Hanxiao","year":"2018","unstructured":"Hanxiao Liu , Karen Simonyan , and Yiming Yang . 2018 . DARTS: Differentiable Architecture Search. CoRR abs\/1806.09055 (2018). arXiv:1806.09055 http:\/\/arxiv.org\/abs\/1806.09055 Hanxiao Liu, Karen Simonyan, and Yiming Yang. 2018. DARTS: Differentiable Architecture Search. CoRR abs\/1806.09055 (2018). arXiv:1806.09055 http:\/\/arxiv.org\/abs\/1806.09055"},{"key":"e_1_3_2_2_26_1","unstructured":"Wei Liu Jun Wang Sanjiv Kumar and Shih-Fu Chang. 2011. Hashing with Graphs. In ICML. 1--8.  Wei Liu Jun Wang Sanjiv Kumar and Shih-Fu Chang. 2011. Hashing with Graphs. In ICML. 1--8."},{"key":"e_1_3_2_2_27_1","volume-title":"SGDR: Stochastic Gradient Descent with Restarts. CoRR abs\/1608.03983","author":"Loshchilov Ilya","year":"2016","unstructured":"Ilya Loshchilov and Frank Hutter . 2016 . SGDR: Stochastic Gradient Descent with Restarts. CoRR abs\/1608.03983 (2016). arXiv:1608.03983 http:\/\/arxiv.org\/abs\/1608.03983 Ilya Loshchilov and Frank Hutter. 2016. SGDR: Stochastic Gradient Descent with Restarts. CoRR abs\/1608.03983 (2016). arXiv:1608.03983 http:\/\/arxiv.org\/abs\/1608.03983"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"key":"e_1_3_2_2_29_1","volume-title":"Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks. Advances in neural information processing systems 32","author":"Lu Jiasen","year":"2019","unstructured":"Jiasen Lu , Dhruv Batra , Devi Parikh , and Stefan Lee . 2019 . Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks. Advances in neural information processing systems 32 (2019). Jiasen Lu, Dhruv Batra, Devi Parikh, and Stefan Lee. 2019. Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks. Advances in neural information processing systems 32 (2019)."},{"key":"e_1_3_2_2_30_1","volume-title":"CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval. CoRR abs\/2104.08860","author":"Luo Huaishao","year":"2021","unstructured":"Huaishao Luo , Lei Ji , Ming Zhong , Yang Chen , Wen Lei , Nan Duan , and Tianrui Li. 2021. CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval. CoRR abs\/2104.08860 ( 2021 ). arXiv:2104.08860 https:\/\/arxiv.org\/abs\/2104.08860 Huaishao Luo, Lei Ji, Ming Zhong, Yang Chen,Wen Lei, Nan Duan, and Tianrui Li. 2021. CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval. CoRR abs\/2104.08860 (2021). arXiv:2104.08860 https:\/\/arxiv.org\/abs\/2104.08860"},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3451390"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-77004-4_1"},{"key":"e_1_3_2_2_33_1","volume-title":"Proceedings of the 38th International Conference on Machine Learning (Proceedings of Machine Learning Research","volume":"8763","author":"Radford Alec","year":"2021","unstructured":"Alec Radford , Jong Wook Kim , Chris Hallacy , Aditya Ramesh , Gabriel Goh , Sandhini Agarwal , Girish Sastry , Amanda Askell , Pamela Mishkin , Jack Clark , Gretchen Krueger , and Ilya Sutskever . 2021 . Learning Transferable Visual Models From Natural Language Supervision . In Proceedings of the 38th International Conference on Machine Learning (Proceedings of Machine Learning Research , Vol. 139). PMLR, 8748-- 8763 . Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021. Learning Transferable Visual Models From Natural Language Supervision. In Proceedings of the 38th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 139). PMLR, 8748--8763."},{"key":"e_1_3_2_2_34_1","unstructured":"Alec Radford JeffreyWu Rewon Child David Luan Dario Amodei Ilya Sutskever etal 2019. Language models are unsupervised multitask learners. OpenAI blog 1 8 (2019) 9.  Alec Radford JeffreyWu Rewon Child David Luan Dario Amodei Ilya Sutskever et al. 2019. Language models are unsupervised multitask learners. OpenAI blog 1 8 (2019) 9."},{"key":"e_1_3_2_2_35_1","volume-title":"Neural Machine Translation of Rare Words with Subword Units. CoRR abs\/1508.07909","author":"Sennrich Rico","year":"2015","unstructured":"Rico Sennrich , Barry Haddow , and Alexandra Birch . 2015. Neural Machine Translation of Rare Words with Subword Units. CoRR abs\/1508.07909 ( 2015 ). arXiv:1508.07909 http:\/\/arxiv.org\/abs\/1508.07909 Rico Sennrich, Barry Haddow, and Alexandra Birch. 2015. Neural Machine Translation of Rare Words with Subword Units. CoRR abs\/1508.07909 (2015). arXiv:1508.07909 http:\/\/arxiv.org\/abs\/1508.07909"},{"key":"e_1_3_2_2_36_1","volume-title":"Advances in Neural Information Processing Systems","volume":"30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N Gomez , Lukasz Kaiser , and Illia Polosukhin . 2017 . Attention is All you Need . In Advances in Neural Information Processing Systems , Vol. 30 . Curran Associates, Inc. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems, Vol. 30. Curran Associates, Inc."},{"key":"e_1_3_2_2_37_1","volume-title":"A comprehensive survey on cross-modal retrieval. arXiv preprint arXiv:1607.06215","author":"Wang Kaiye","year":"2016","unstructured":"Kaiye Wang , Qiyue Yin , Wei Wang , Shu Wu , and Liang Wang . 2016. A comprehensive survey on cross-modal retrieval. arXiv preprint arXiv:1607.06215 ( 2016 ). Kaiye Wang, Qiyue Yin, Wei Wang, Shu Wu, and Liang Wang. 2016. A comprehensive survey on cross-modal retrieval. arXiv preprint arXiv:1607.06215 (2016)."},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.03.019"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343031.3350940"},{"key":"e_1_3_2_2_40_1","volume-title":"Mannat Singh, Eric Mintun, Trevor Darrell, and Ross Girshick.","author":"Xiao Tete","year":"2021","unstructured":"Tete Xiao , Piotr Dollar , Mannat Singh, Eric Mintun, Trevor Darrell, and Ross Girshick. 2021 . Early convolutions help transformers see better. Advances in Neural Information Processing Systems 34 (2021). Tete Xiao, Piotr Dollar, Mannat Singh, Eric Mintun, Trevor Darrell, and Ross Girshick. 2021. Early convolutions help transformers see better. Advances in Neural Information Processing Systems 34 (2021)."},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/138"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00800"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i1.10719"},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3460426.3463625"},{"key":"e_1_3_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394171.3413917"},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10235"}],"event":{"name":"MM '22: The 30th ACM International Conference on Multimedia","location":"Lisboa Portugal","acronym":"MM '22","sponsor":["SIGMM ACM Special Interest Group on Multimedia"]},"container-title":["Proceedings of the 30th ACM International Conference on Multimedia"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503161.3548187","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3503161.3548187","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T15:00:20Z","timestamp":1750172420000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503161.3548187"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,10]]},"references-count":46,"alternative-id":["10.1145\/3503161.3548187","10.1145\/3503161"],"URL":"https:\/\/doi.org\/10.1145\/3503161.3548187","relation":{},"subject":[],"published":{"date-parts":[[2022,10,10]]},"assertion":[{"value":"2022-10-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}