{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,20]],"date-time":"2026-10-20T11:38:46Z","timestamp":1792496326991,"version":"4.5.0"},"publisher-location":"New York, NY, USA","reference-count":57,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T00:00:00Z","timestamp":1665360000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000002","name":"NIH (National Institutes of Health)","doi-asserted-by":"publisher","award":["1R01AA02687901A1"],"award-info":[{"award-number":["1R01AA02687901A1"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"NSF (National Science Foundation)","doi-asserted-by":"publisher","award":["IIS2133595"],"award-info":[{"award-number":["IIS2133595"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,10,10]]},"DOI":"10.1145\/3503161.3548361","type":"proceedings-article","created":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T15:43:01Z","timestamp":1665416581000},"page":"356-365","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Learning to Retrieve Videos by Asking Questions"],"prefix":"10.1145","author":[{"given":"Avinash","family":"Madasu","sequence":"first","affiliation":[{"name":"UNC Chapel Hill, Chapel Hill, NC, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junier","family":"Oliva","sequence":"additional","affiliation":[{"name":"UNC Chapel HIll, Chapel HIll, NC, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gedas","family":"Bertasius","sequence":"additional","affiliation":[{"name":"UNC Chapel Hill, Chapel Hill, NC, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,10,10]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Analyzing the behavior of visual question answering models. arXiv preprint arXiv:1606.07356","author":"Agrawal Aishwarya","year":"2016","unstructured":"Aishwarya Agrawal , Dhruv Batra , and Devi Parikh . 2016. Analyzing the behavior of visual question answering models. arXiv preprint arXiv:1606.07356 ( 2016 ). Aishwarya Agrawal, Dhruv Batra, and Devi Parikh. 2016. Analyzing the behavior of visual question answering models. arXiv preprint arXiv:1606.07356 (2016)."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00522"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00774"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.279"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00175"},{"key":"e_1_3_2_2_6_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML).","author":"Bertasius Gedas","year":"2021","unstructured":"Gedas Bertasius , Heng Wang , and Lorenzo Torresani . 2021 . Is Space-Time Attention All You Need for Video Understanding? . In Proceedings of the International Conference on Machine Learning (ICML). Gedas Bertasius, Heng Wang, and Lorenzo Torresani. 2021. Is Space-Time Attention All You Need for Video Understanding?. In Proceedings of the International Conference on Machine Learning (ICML)."},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00185"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654964"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01138"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.121"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.321"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW53098.2021.00374"},{"key":"e_1_3_2_2_13_1","volume-title":"Clip2video: Mastering video-text retrieval via image clip. arXiv preprint arXiv:2106.11097","author":"Fang Han","year":"2021","unstructured":"Han Fang , Pengfei Xiong , Luhui Xu , and Yu Chen . 2021. Clip2video: Mastering video-text retrieval via image clip. arXiv preprint arXiv:2106.11097 ( 2021 ). Han Fang, Pengfei Xiong, Luhui Xu, and Yu Chen. 2021. Clip2video: Mastering video-text retrieval via image clip. arXiv preprint arXiv:2106.11097 (2021)."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Myron Flickner Harpreet Sawhney Wayne Niblack Jonathan Ashley Qian Huang Byron Dom Monika Gorkani Jim Hafner Denis Lee Dragutin Petkovic etal 1995. Query by image and video content: The QBIC system. computer 28 9 (1995) 23--32.  Myron Flickner Harpreet Sawhney Wayne Niblack Jonathan Ashley Qian Huang Byron Dom Monika Gorkani Jim Hafner Denis Lee Dragutin Petkovic et al. 1995. Query by image and video content: The QBIC system. computer 28 9 (1995) 23--32.","DOI":"10.1109\/2.410146"},{"key":"e_1_3_2_2_15_1","volume-title":"European Conference on Computer Vision. Springer, 214--229","author":"Gabeur Valentin","year":"2020","unstructured":"Valentin Gabeur , Chen Sun , Karteek Alahari , and Cordelia Schmid . 2020 . Multimodal transformer for video retrieval . In European Conference on Computer Vision. Springer, 214--229 . Valentin Gabeur, Chen Sun, Karteek Alahari, and Cordelia Schmid. 2020. Multimodal transformer for video retrieval. In European Conference on Computer Vision. Springer, 214--229."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-98355-0_44"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-98355-0_54"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8682583"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.44"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2012.6248026"},{"key":"e_1_3_2_2_21_1","volume-title":"Multimodal transformer networks for end-to-end video-grounded dialogue systems. arXiv preprint arXiv:1907.01166","author":"Le Hung","year":"2019","unstructured":"Hung Le , Doyen Sahoo , Nancy F Chen , and Steven CH Hoi . 2019. Multimodal transformer networks for end-to-end video-grounded dialogue systems. arXiv preprint arXiv:1907.01166 ( 2019 ). Hung Le, Doyen Sahoo, Nancy F Chen, and Steven CH Hoi. 2019. Multimodal transformer networks for end-to-end video-grounded dialogue systems. arXiv preprint arXiv:1907.01166 (2019)."},{"key":"e_1_3_2_2_22_1","volume-title":"BiST: Bidirectional spatio-temporal reasoning for video-grounded dialogues. arXiv preprint arXiv:2010.10095","author":"Le Hung","year":"2020","unstructured":"Hung Le , Doyen Sahoo , Nancy F Chen , and Steven CH Hoi . 2020. BiST: Bidirectional spatio-temporal reasoning for video-grounded dialogues. arXiv preprint arXiv:2010.10095 ( 2020 ). Hung Le, Doyen Sahoo, Nancy F Chen, and Steven CH Hoi. 2020. BiST: Bidirectional spatio-temporal reasoning for video-grounded dialogues. arXiv preprint arXiv:2010.10095 (2020)."},{"key":"e_1_3_2_2_23_1","volume-title":"Tvqa: Localized, compositional video question answering. arXiv preprint arXiv:1809.01696","author":"Lei Jie","year":"2018","unstructured":"Jie Lei , Licheng Yu , Mohit Bansal , and Tamara L Berg . 2018 . Tvqa: Localized, compositional video question answering. arXiv preprint arXiv:1809.01696 (2018). Jie Lei, Licheng Yu, Mohit Bansal, and Tamara L Berg. 2018. Tvqa: Localized, compositional video question answering. arXiv preprint arXiv:1809.01696 (2018)."},{"key":"e_1_3_2_2_24_1","volume-title":"Tvqa: Spatiotemporal grounding for video question answering. arXiv preprint arXiv:1904.11574","author":"Lei Jie","year":"2019","unstructured":"Jie Lei , Licheng Yu , Tamara L Berg , and Mohit Bansal . 2019 . Tvqa: Spatiotemporal grounding for video question answering. arXiv preprint arXiv:1904.11574 (2019). Jie Lei, Licheng Yu, Tamara L Berg, and Mohit Bansal. 2019. Tvqa: Spatiotemporal grounding for video question answering. arXiv preprint arXiv:1904.11574 (2019)."},{"key":"e_1_3_2_2_25_1","volume-title":"Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461","author":"Lewis Mike","year":"2019","unstructured":"Mike Lewis , Yinhan Liu , Naman Goyal , Marjan Ghazvininejad , Abdelrahman Mohamed , Omer Levy , Ves Stoyanov , and Luke Zettlemoyer . 2019 . Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461 (2019). Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, and Luke Zettlemoyer. 2019. Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461 (2019)."},{"key":"e_1_3_2_2_26_1","volume-title":"Hero: Hierarchical encoder for video language omni-representation pre-training. arXiv preprint arXiv:2005.00200","author":"Li Linjie","year":"2020","unstructured":"Linjie Li , Yen-Chun Chen , Yu Cheng , Zhe Gan , Licheng Yu , and Jingjing Liu . 2020 . Hero: Hierarchical encoder for video language omni-representation pre-training. arXiv preprint arXiv:2005.00200 (2020). Linjie Li, Yen-Chun Chen, Yu Cheng, Zhe Gan, Licheng Yu, and Jingjing Liu. 2020. Hero: Hierarchical encoder for video language omni-representation pre-training. arXiv preprint arXiv:2005.00200 (2020)."},{"key":"e_1_3_2_2_27_1","volume-title":"International Conference on Machine Learning. PMLR, 6450--6459","author":"Li Yang","year":"2021","unstructured":"Yang Li and Junier Oliva . 2021 . Active feature acquisition with generative surrogate models . In International Conference on Machine Learning. PMLR, 6450--6459 . Yang Li and Junier Oliva. 2021. Active feature acquisition with generative surrogate models. In International Conference on Machine Learning. PMLR, 6450--6459."},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2021.3065823"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00693"},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393347.2396432"},{"key":"e_1_3_2_2_31_1","volume-title":"Video Search with Context-Aware Ranker and Relevance Feedback. In International Conference on Multimedia Modeling. Springer, 505--510","author":"Loko\u010d Jakub","year":"2022","unstructured":"Jakub Loko\u010d , Frantiek Mejzl\u00edk , Tom\u00e1\" Sou\u010dek, Patrik Dokoupil , and Ladislav Pe\"ka. 2022 . Video Search with Context-Aware Ranker and Relevance Feedback. In International Conference on Multimedia Modeling. Springer, 505--510 . Jakub Loko\u010d, Frantiek Mejzl\u00edk, Tom\u00e1\" Sou\u010dek, Patrik Dokoupil, and Ladislav Pe\"ka. 2022. Video Search with Context-Aware Ranker and Relevance Feedback. In International Conference on Multimedia Modeling. Springer, 505--510."},{"key":"e_1_3_2_2_32_1","volume-title":"Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101","author":"Loshchilov Ilya","year":"2017","unstructured":"Ilya Loshchilov and Frank Hutter . 2017. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101 ( 2017 ). Ilya Loshchilov and Frank Hutter. 2017. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101 (2017)."},{"key":"e_1_3_2_2_33_1","volume-title":"Clip4clip: An empirical study of clip for end to end video clip retrieval. arXiv preprint arXiv:2104.08860","author":"Luo Huaishao","year":"2021","unstructured":"Huaishao Luo , Lei Ji , Ming Zhong , Yang Chen , Wen Lei , Nan Duan , and Tianrui Li. 2021. Clip4clip: An empirical study of clip for end to end video clip retrieval. arXiv preprint arXiv:2104.08860 ( 2021 ). Huaishao Luo, Lei Ji, Ming Zhong, Yang Chen, Wen Lei, Nan Duan, and Tianrui Li. 2021. Clip4clip: An empirical study of clip for end to end video clip retrieval. arXiv preprint arXiv:2104.08860 (2021)."},{"key":"e_1_3_2_2_34_1","volume-title":"Reinforcement Learning-Based Interactive Video Search. In International Conference on Multimedia Modeling. Springer, 549--555","author":"Ma Zhixin","year":"2022","unstructured":"Zhixin Ma , Jiaxin Wu , Zhijian Hou , and Chong-Wah Ngo . 2022 . Reinforcement Learning-Based Interactive Video Search. In International Conference on Multimedia Modeling. Springer, 549--555 . Zhixin Ma, Jiaxin Wu, Zhijian Hou, and Chong-Wah Ngo. 2022. Reinforcement Learning-Based Interactive Video Search. In International Conference on Multimedia Modeling. Springer, 549--555."},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW50498.2020.00484"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2019.00156"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00009"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3206025.3206064"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2021.103204"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00684"},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01087"},{"key":"e_1_3_2_2_42_1","volume-title":"Proceedings of the 38th International Conference on Machine Learning (Proceedings of Machine Learning Research","volume":"8763","author":"Radford Alec","year":"2021","unstructured":"Alec Radford , Jong Wook Kim , Chris Hallacy , Aditya Ramesh , Gabriel Goh , Sandhini Agarwal , Girish Sastry , Amanda Askell , Pamela Mishkin , Jack Clark , Gretchen Krueger , and Ilya Sutskever . 2021 . Learning Transferable Visual Models From Natural Language Supervision . In Proceedings of the 38th International Conference on Machine Learning (Proceedings of Machine Learning Research , Vol. 139), Marina Meila and Tong Zhang (Eds.). PMLR, 8748-- 8763 . https:\/\/proceedings.mlr.press\/v139\/radford21a.html Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021. Learning Transferable Visual Models From Natural Language Supervision. In Proceedings of the 38th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 139), Marina Meila and Tong Zhang (Eds.). PMLR, 8748--8763. https:\/\/proceedings.mlr.press\/v139\/radford21a.html"},{"key":"e_1_3_2_2_43_1","unstructured":"Alec Radford JeffreyWu Rewon Child David Luan Dario Amodei Ilya Sutskever etal 2019. Language models are unsupervised multitask learners. OpenAI blog 1 8 (2019) 9.  Alec Radford JeffreyWu Rewon Child David Luan Dario Amodei Ilya Sutskever et al. 2019. Language models are unsupervised multitask learners. OpenAI blog 1 8 (2019) 9."},{"key":"e_1_3_2_2_44_1","volume-title":"Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv preprint arXiv:1910.10683","author":"Raffel Colin","year":"2019","unstructured":"Colin Raffel , Noam Shazeer , Adam Roberts , Katherine Lee , Sharan Narang , Michael Matena , Yanqi Zhou , Wei Li , and Peter J Liu . 2019. Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv preprint arXiv:1910.10683 ( 2019 ). Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2019. Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv preprint arXiv:1910.10683 (2019)."},{"key":"e_1_3_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/76.718510"},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"crossref","unstructured":"Olga Russakovsky Jia Deng Hao Su Jonathan Krause Sanjeev Satheesh Sean Ma Zhiheng Huang Andrej Karpathy Aditya Khosla Michael Bernstein etal 2015. Imagenet large scale visual recognition challenge. International journal of computer vision 115 3 (2015) 211--252.  Olga Russakovsky Jia Deng Hao Su Jonathan Krause Sanjeev Satheesh Sean Ma Zhiheng Huang Andrej Karpathy Aditya Khosla Michael Bernstein et al. 2015. Imagenet large scale visual recognition challenge. International journal of computer vision 115 3 (2015) 211--252.","DOI":"10.1007\/s11263-015-0816-y"},{"key":"e_1_3_2_2_47_1","volume-title":"a distilled version of BERT: smaller, faster, cheaper and lighter. ArXiv abs\/1910.01108","author":"Sanh Victor","year":"2019","unstructured":"Victor Sanh , Lysandre Debut , Julien Chaumond , and Thomas Wolf . 2019. DistilBERT , a distilled version of BERT: smaller, faster, cheaper and lighter. ArXiv abs\/1910.01108 ( 2019 ). Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019. DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. ArXiv abs\/1910.01108 (2019)."},{"key":"e_1_3_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2014.56"},{"key":"e_1_3_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01283"},{"key":"e_1_3_2_2_50_1","volume-title":"Sung Ju Hwang, and Eunho Yang","author":"Shim Hajin","year":"2018","unstructured":"Hajin Shim , Sung Ju Hwang, and Eunho Yang . 2018 . Joint active feature acquisition and classification with variable-size set encoding. In Advances in neural information processing systems. 1368--1378. Hajin Shim, Sung Ju Hwang, and Eunho Yang. 2018. Joint active feature acquisition and classification with variable-size set encoding. In Advances in neural information processing systems. 1368--1378."},{"key":"e_1_3_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01109"},{"key":"e_1_3_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00444"},{"key":"e_1_3_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-98355-0_55"},{"key":"e_1_3_2_2_54_1","volume-title":"Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004.","volume":"2","author":"Wu Hong","year":"2004","unstructured":"Hong Wu , Hanqing Lu , and Songde Ma . 2004 . Willhunter: interactive image retrieval with multilevel relevance . In Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004. , Vol. 2 . IEEE, 1009--1012. Hong Wu, Hanqing Lu, and Songde Ma. 2004. Willhunter: interactive image retrieval with multilevel relevance. In Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004., Vol. 2. IEEE, 1009--1012."},{"key":"e_1_3_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV45572.2020.9093596"},{"key":"e_1_3_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV51458.2022.00256"},{"key":"e_1_3_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.5555\/3298023.3298196"}],"event":{"name":"MM '22: The 30th ACM International Conference on Multimedia","location":"Lisboa Portugal","acronym":"MM '22","sponsor":["SIGMM ACM Special Interest Group on Multimedia"]},"container-title":["Proceedings of the 30th ACM International Conference on Multimedia"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503161.3548361","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3503161.3548361","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3503161.3548361","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:00:44Z","timestamp":1750186844000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503161.3548361"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,10]]},"references-count":57,"alternative-id":["10.1145\/3503161.3548361","10.1145\/3503161"],"URL":"https:\/\/doi.org\/10.1145\/3503161.3548361","relation":{},"subject":[],"published":{"date-parts":[[2022,10,10]]},"assertion":[{"value":"2022-10-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}