{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T17:06:52Z","timestamp":1777655212016,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":50,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,10,17]],"date-time":"2021-10-17T00:00:00Z","timestamp":1634428800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2018AAA0100400"],"award-info":[{"award-number":["2018AAA0100400"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,10,17]]},"DOI":"10.1145\/3474085.3475472","type":"proceedings-article","created":{"date-parts":[[2021,10,18]],"date-time":"2021-10-18T21:45:34Z","timestamp":1634593534000},"page":"3220-3228","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":23,"title":["Counterfactual Debiasing Inference for Compositional Action Recognition"],"prefix":"10.1145","author":[{"given":"Pengzhan","family":"Sun","sequence":"first","affiliation":[{"name":"University of Electronic Science and Technology of China, Chengdu, Sichuan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bo","family":"Wu","sequence":"additional","affiliation":[{"name":"MIT-IBM Watson AI Lab, Cambridge, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xunsong","family":"Li","sequence":"additional","affiliation":[{"name":"University of Electronic Science and Technology of China, Chengdu, Sichuan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wen","family":"Li","sequence":"additional","affiliation":[{"name":"University of Electronic Science and Technology of China, Chengdu, Sichuan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lixin","family":"Duan","sequence":"additional","affiliation":[{"name":"University of Electronic Science and Technology of China, Chengdu, Sichuan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chuang","family":"Gan","sequence":"additional","affiliation":[{"name":"MIT-IBM Watson AI Lab, Cambridge, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,10,17]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Computer Vision - ECCV 2018 - 15th European Conference. 106--122.","author":"Baradel Fabien","unstructured":"Fabien Baradel , Natalia Neverova , Christian Wolf , Julien Mille , and Greg Mori . 2018. Object Level Visual Reasoning in Videos . In Computer Vision - ECCV 2018 - 15th European Conference. 106--122. Fabien Baradel, Natalia Neverova, Christian Wolf, Julien Mille, and Greg Mori. 2018. Object Level Visual Reasoning in Videos. In Computer Vision - ECCV 2018 - 15th European Conference. 106--122."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.502"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01081"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00471"},{"key":"e_1_3_2_1_6_1","volume-title":"Joshua B Tenenbaum, and Chuang Gan.","author":"Chen Zhenfang","year":"2021","unstructured":"Zhenfang Chen , Jiayuan Mao , Jiajun Wu , Kwan-Yee Kenneth Wong , Joshua B Tenenbaum, and Chuang Gan. 2021 . Grounding physical concepts of objects and events through dynamic visual reasoning. arXiv preprint arXiv:2103.16564 (2021). Zhenfang Chen, Jiayuan Mao, Jiajun Wu, Kwan-Yee Kenneth Wong, Joshua B Tenenbaum, and Chuang Gan. 2021. Grounding physical concepts of objects and events through dynamic visual reasoning. arXiv preprint arXiv:2103.16564 (2021)."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3454364"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298878"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00654"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00630"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394171.3413502"},{"key":"e_1_3_2_1_12_1","volume-title":"Webly-supervised video recognition by mutually voting for relevant web images and web video frames","author":"Gan Chuang","unstructured":"Chuang Gan , Chen Sun , Lixin Duan , and Boqing Gong . 2016. Webly-supervised video recognition by mutually voting for relevant web images and web video frames . In ECCV. Springer , 849--866. Chuang Gan, Chen Sun, Lixin Duan, and Boqing Gong. 2016. Webly-supervised video recognition by mutually voting for relevant web images and web video frames. In ECCV. Springer, 849--866."},{"key":"e_1_3_2_1_13_1","volume-title":"Devnet: A deep event network for multimedia event detection and evidence recounting. In CVPR. 2568--2577.","author":"Gan Chuang","year":"2015","unstructured":"Chuang Gan , Naiyan Wang , Yi Yang , Dit-Yan Yeung , and Alex G Hauptmann . 2015 . Devnet: A deep event network for multimedia event detection and evidence recounting. In CVPR. 2568--2577. Chuang Gan, Naiyan Wang, Yi Yang, Dit-Yan Yeung, and Alex G Hauptmann. 2015. Devnet: A deep event network for multimedia event detection and evidence recounting. In CVPR. 2568--2577."},{"key":"e_1_3_2_1_14_1","unstructured":"Chuang Gan Ting Yao Kuiyuan Yang Yi Yang and Tao Mei. 2016. You lead we exceed: Labor-free video concept learning by jointly exploiting web videos and images. In CVPR. 923--932.  Chuang Gan Ting Yao Kuiyuan Yang Yi Yang and Tao Mei. 2016. You lead we exceed: Labor-free video concept learning by jointly exploiting web videos and images. In CVPR. 923--932."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.622"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.322"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2019.00288"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01025"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Rudolph Emil Kalman. 1960. A new approach to linear filtering and prediction problems. (1960).  Rudolph Emil Kalman. 1960. A new approach to linear filtering and prediction problems. (1960).","DOI":"10.1115\/1.3662552"},{"key":"e_1_3_2_1_20_1","unstructured":"Will Kay Joao Carreira Karen Simonyan Brian Zhang Chloe Hillier Sudheendra Vijayanarasimhan Fabio Viola Tim Green Trevor Back Paul Natsev etal 2017. The kinetics human action video dataset. arXiv preprint arXiv:1705.06950 (2017).  Will Kay Joao Carreira Karen Simonyan Brian Zhang Chloe Hillier Sudheendra Vijayanarasimhan Fabio Viola Tim Green Trevor Back Paul Natsev et al. 2017. The kinetics human action video dataset. arXiv preprint arXiv:1705.06950 (2017)."},{"key":"e_1_3_2_1_21_1","volume-title":"Hager","author":"Kim Tae Soo","year":"2020","unstructured":"Tae Soo Kim and Gregory D . Hager . 2020 . SAFCAR : Structured Attention Fusion for Compositional Action Recognition . abs\/2012.02109 (2020). arXiv:2012.02109 Tae Soo Kim and Gregory D. Hager. 2020. SAFCAR: Structured Attention Fusion for Compositional Action Recognition. abs\/2012.02109 (2020). arXiv:2012.02109"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01231-1_32"},{"key":"e_1_3_2_1_23_1","volume-title":"TSM: Temporal Shift Module for Efficient Video Understanding. In 2019 IEEE\/CVF International Conference on Computer Vision. 7082--7092","author":"Lin Ji","year":"2019","unstructured":"Ji Lin , Chuang Gan , and Song Han . 2019 . TSM: Temporal Shift Module for Efficient Video Understanding. In 2019 IEEE\/CVF International Conference on Computer Vision. 7082--7092 . Ji Lin, Chuang Gan, and Song Han. 2019. TSM: Temporal Shift Module for Efficient Video Understanding. In 2019 IEEE\/CVF International Conference on Computer Vision. 7082--7092."},{"key":"e_1_3_2_1_24_1","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV) Workshops. 0--0.","author":"Liu Jinlai","year":"2018","unstructured":"Jinlai Liu , Zehuan Yuan , and Changhu Wang . 2018 . Towards good practices for multi-modal fusion in large-scale video classification . In Proceedings of the European Conference on Computer Vision (ECCV) Workshops. 0--0. Jinlai Liu, Zehuan Yuan, and Changhu Wang. 2018. Towards good practices for multi-modal fusion in large-scale video classification. In Proceedings of the European Conference on Computer Vision (ECCV) Workshops. 0--0."},{"key":"e_1_3_2_1_25_1","volume-title":"Jiajun Wu, Xiao Liu, and Shilei Wen.","author":"Long Xiang","year":"2018","unstructured":"Xiang Long , Chuang Gan , Gerard De Melo , Jiajun Wu, Xiao Liu, and Shilei Wen. 2018 . Attention clusters: Purely attention based local feature integration for video classification. In CVPR. 7834--7843. Xiang Long, Chuang Gan, Gerard De Melo, Jiajun Wu, Xiao Liu, and Shilei Wen. 2018. Attention clusters: Purely attention based local feature integration for video classification. In CVPR. 7834--7843."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00710"},{"key":"e_1_3_2_1_27_1","volume-title":"Something-Else: Compositional Action Recognition With Spatial-Temporal Interaction Networks. In 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 1046--1056","author":"Materzynska Joanna","year":"2020","unstructured":"Joanna Materzynska , Tete Xiao , Roei Herzig , Huijuan Xu , Xiaolong Wang , and Trevor Darrell . 2020 . Something-Else: Compositional Action Recognition With Spatial-Temporal Interaction Networks. In 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 1046--1056 . Joanna Materzynska, Tete Xiao, Roei Herzig, Huijuan Xu, Xiaolong Wang, and Trevor Darrell. 2020. Something-Else: Compositional Action Recognition With Spatial-Temporal Interaction Networks. In 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 1046--1056."},{"key":"e_1_3_2_1_28_1","volume-title":"Causality: Models, Reasoning, and Inference.","author":"Neuberg Leland Gerson","year":"2003","unstructured":"Leland Gerson Neuberg . 2003 . Causality: Models, Reasoning, and Inference. Leland Gerson Neuberg. 2003. Causality: Models, Reasoning, and Inference."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01251"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/2074022.2074073"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/3238230"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01087"},{"key":"e_1_3_2_1_33_1","volume-title":"Faster r-cnn: Towards real-time object detection with region proposal networks. arXiv preprint arXiv:1506.01497","author":"Ren Shaoqing","year":"2015","unstructured":"Shaoqing Ren , Kaiming He , Ross Girshick , and Jian Sun . 2015. Faster r-cnn: Towards real-time object detection with region proposal networks. arXiv preprint arXiv:1506.01497 ( 2015 ). Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster r-cnn: Towards real-time object detection with region proposal networks. arXiv preprint arXiv:1506.01497 (2015)."},{"key":"e_1_3_2_1_34_1","volume-title":"Two-stream convolutional networks for action recognition in videos. arXiv preprint arXiv:1406.2199","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan and Andrew Zisserman . 2014. Two-stream convolutional networks for action recognition in videos. arXiv preprint arXiv:1406.2199 ( 2014 ). Karen Simonyan and Andrew Zisserman. 2014. Two-stream convolutional networks for action recognition in videos. arXiv preprint arXiv:1406.2199 (2014)."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00377"},{"key":"e_1_3_2_1_36_1","volume-title":"Learning what makes a difference from counterfactual examples and gradient supervision. arXiv preprint arXiv:2004.09034","author":"Teney Damien","year":"2020","unstructured":"Damien Teney , Ehsan Abbasnedjad , and Anton van den Hengel . 2020. Learning what makes a difference from counterfactual examples and gradient supervision. arXiv preprint arXiv:2004.09034 ( 2020 ). Damien Teney, Ehsan Abbasnedjad, and Anton van den Hengel. 2020. Learning what makes a difference from counterfactual examples and gradient supervision. arXiv preprint arXiv:2004.09034 (2020)."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.510"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46484-8_2"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00813"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01228-1_25"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.226"},{"key":"e_1_3_2_1_42_1","volume-title":"Analogical reasoning for visually grounded language acquisition. arXiv preprint arXiv:2007.11668","author":"Wu Bo","year":"2020","unstructured":"Bo Wu , Haoyu Qin , Alireza Zareian , Carl Vondrick , and Shih-Fu Chang . 2020. Analogical reasoning for visually grounded language acquisition. arXiv preprint arXiv:2007.11668 ( 2020 ). Bo Wu, Haoyu Qin, Alireza Zareian, Carl Vondrick, and Shih-Fu Chang. 2020. Analogical reasoning for visually grounded language acquisition. arXiv preprint arXiv:2007.11668 (2020)."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00037"},{"key":"e_1_3_2_1_44_1","unstructured":"Rui Yan Lingxi Xie Xiangbo Shu and Jinhui Tang. 2020. Interactive Fusion of Multi-level Features for Compositional Activity Recognition. arXiv:2012.05689  Rui Yan Lingxi Xie Xiangbo Shu and Jinhui Tang. 2020. Interactive Fusion of Multi-level Features for Compositional Activity Recognition. arXiv:2012.05689"},{"key":"e_1_3_2_1_45_1","volume-title":"Clevrer: Collision events for video representation and reasoning. arXiv preprint arXiv:1910.01442","author":"Yi Kexin","year":"2019","unstructured":"Kexin Yi , Chuang Gan , Yunzhu Li , Pushmeet Kohli , Jiajun Wu , Antonio Torralba , and Joshua B Tenenbaum . 2019 . Clevrer: Collision events for video representation and reasoning. arXiv preprint arXiv:1910.01442 (2019). Kexin Yi, Chuang Gan, Yunzhu Li, Pushmeet Kohli, Jiajun Wu, Antonio Torralba, and Joshua B Tenenbaum. 2019. Clevrer: Collision events for video representation and reasoning. arXiv preprint arXiv:1910.01442 (2019)."},{"key":"e_1_3_2_1_46_1","volume-title":"Counterfactual Zero-Shot and Open-Set Visual Recognition. arXiv preprint arXiv:2103.00887","author":"Yue Zhongqi","year":"2021","unstructured":"Zhongqi Yue , Tan Wang , Hanwang Zhang , Qianru Sun , and Xian-Sheng Hua . 2021. Counterfactual Zero-Shot and Open-Set Visual Recognition. arXiv preprint arXiv:2103.00887 ( 2021 ). Zhongqi Yue, Tan Wang, Hanwang Zhang, Qianru Sun, and Xian-Sheng Hua. 2021. Counterfactual Zero-Shot and Open-Set Visual Recognition. arXiv preprint arXiv:2103.00887 (2021)."},{"key":"e_1_3_2_1_47_1","volume-title":"Interventional few-shot learning. arXiv preprint arXiv:2009.13000","author":"Yue Zhongqi","year":"2020","unstructured":"Zhongqi Yue , Hanwang Zhang , Qianru Sun , and Xian-Sheng Hua . 2020. Interventional few-shot learning. arXiv preprint arXiv:2009.13000 ( 2020 ). Zhongqi Yue, Hanwang Zhang, Qianru Sun, and Xian-Sheng Hua. 2020. Interventional few-shot learning. arXiv preprint arXiv:2009.13000 (2020)."},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00612"},{"key":"e_1_3_2_1_49_1","volume-title":"Causal intervention for weakly-supervised semantic segmentation. arXiv preprint arXiv:2009.12547","author":"Zhang Dong","year":"2020","unstructured":"Dong Zhang , Hanwang Zhang , Jinhui Tang , Xiansheng Hua , and Qianru Sun . 2020. Causal intervention for weakly-supervised semantic segmentation. arXiv preprint arXiv:2009.12547 ( 2020 ). Dong Zhang, Hanwang Zhang, Jinhui Tang, Xiansheng Hua, and Qianru Sun. 2020. Causal intervention for weakly-supervised semantic segmentation. arXiv preprint arXiv:2009.12547 (2020)."},{"key":"e_1_3_2_1_50_1","volume-title":"mixup: Beyond empirical risk minimization. arXiv preprint arXiv:1710.09412","author":"Zhang Hongyi","year":"2017","unstructured":"Hongyi Zhang , Moustapha Cisse , Yann N Dauphin , and David Lopez-Paz . 2017. mixup: Beyond empirical risk minimization. arXiv preprint arXiv:1710.09412 ( 2017 ). Hongyi Zhang, Moustapha Cisse, Yann N Dauphin, and David Lopez-Paz. 2017. mixup: Beyond empirical risk minimization. arXiv preprint arXiv:1710.09412 (2017)."}],"event":{"name":"MM '21: ACM Multimedia Conference","location":"Virtual Event China","acronym":"MM '21","sponsor":["SIGMM ACM Special Interest Group on Multimedia"]},"container-title":["Proceedings of the 29th ACM International Conference on Multimedia"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3474085.3475472","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3474085.3475472","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:48:34Z","timestamp":1750193314000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3474085.3475472"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,17]]},"references-count":50,"alternative-id":["10.1145\/3474085.3475472","10.1145\/3474085"],"URL":"https:\/\/doi.org\/10.1145\/3474085.3475472","relation":{},"subject":[],"published":{"date-parts":[[2021,10,17]]},"assertion":[{"value":"2021-10-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}