{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,13]],"date-time":"2026-08-13T16:24:46Z","timestamp":1786638286161,"version":"3.56.0"},"reference-count":85,"publisher":"Association for Computing Machinery (ACM)","issue":"11","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2023,7]]},"abstract":"<jats:p>We introduce EQUI-VOCAL: a new system that automatically synthesizes queries over videos from limited user interactions. The user only provides a handful of positive and negative examples of what they are looking for. EQUI-VOCAL utilizes these initial examples and additional ones collected through active learning to efficiently synthesize complex user queries. Our approach enables users to find events without database expertise, with limited labeling effort, and without declarative specifications or sketches. Core to EQUI-VOCAL's design is the use of spatio-temporal scene graphs in its data model and query language and a novel query synthesis approach that works on large and noisy video data. Our system outperforms two baseline systems---in terms of F1 score, synthesis time, and robustness to noise---and can flexibly synthesize complex queries that the baselines do not support.<\/jats:p>","DOI":"10.14778\/3611479.3611482","type":"journal-article","created":{"date-parts":[[2023,8,25]],"date-time":"2023-08-25T02:08:08Z","timestamp":1692929288000},"page":"2714-2727","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["EQUI-VOCAL: Synthesizing Queries for Compositional Video Events from Limited User Interactions"],"prefix":"10.14778","volume":"16","author":[{"given":"Enhao","family":"Zhang","sequence":"first","affiliation":[{"name":"University of Washington"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maureen","family":"Daum","sequence":"additional","affiliation":[{"name":"University of Washington"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dong","family":"He","sequence":"additional","affiliation":[{"name":"University of Washington"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brandon","family":"Haynes","sequence":"additional","affiliation":[{"name":"Microsoft Gray Systems Lab"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ranjay","family":"Krishna","sequence":"additional","affiliation":[{"name":"University of Washington"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Magdalena","family":"Balazinska","sequence":"additional","affiliation":[{"name":"University of Washington"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,8,24]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2003.11.002"},{"key":"e_1_2_1_2_1","first-page":"58","article-title":"Real-Time Video Analytics","volume":"50","author":"Ananthanarayanan Ganesh","year":"2017","unstructured":"Ganesh Ananthanarayanan , Paramvir Bahl , Peter Bod\u00edk , Krishna Chintalapudi , Matthai Philipose , Lenin Ravindranath , and Sudipta Sinha . 2017 . Real-Time Video Analytics : The Killer App for Edge Computing. Computer 50 , 10 (2017), 58 -- 67 . Ganesh Ananthanarayanan, Paramvir Bahl, Peter Bod\u00edk, Krishna Chintalapudi, Matthai Philipose, Lenin Ravindranath, and Sudipta Sinha. 2017. Real-Time Video Analytics: The Killer App for Edge Computing. Computer 50, 10 (2017), 58--67.","journal-title":"The Killer App for Edge Computing. Computer"},{"key":"e_1_2_1_3_1","volume-title":"Wenisch","author":"Anderson Michael R.","year":"2019","unstructured":"Michael R. Anderson , Michael J. Cafarella , Germ\u00e1n Ros , and Thomas F . Wenisch . 2019 . Physical Representation-Based Predicate Optimization for a Visual Analytics Database. In ICDE. 1466--1477. Michael R. Anderson, Michael J. Cafarella, Germ\u00e1n Ros, and Thomas F. Wenisch. 2019. Physical Representation-Based Predicate Optimization for a Visual Analytics Database. In ICDE. 1466--1477."},{"key":"e_1_2_1_4_1","first-page":"111","article-title":"Unmanned Aerial Aircraft Systems for transportation engineering: Current practice and future challenges","volume":"5","author":"Barmpounakis Emmanouil N","year":"2016","unstructured":"Emmanouil N Barmpounakis , Eleni I Vlahogianni , and John C Golias . 2016 . Unmanned Aerial Aircraft Systems for transportation engineering: Current practice and future challenges . IJTST 5 , 3 (2016), 111 -- 122 . Emmanouil N Barmpounakis, Eleni I Vlahogianni, and John C Golias. 2016. Unmanned Aerial Aircraft Systems for transportation engineering: Current practice and future challenges. IJTST 5, 3 (2016), 111--122.","journal-title":"IJTST"},{"key":"e_1_2_1_5_1","volume-title":"MIRIS: Fast Object Track Queries in Video. In SIGMOD. 1907--1921.","author":"Bastani Favyen","year":"2020","unstructured":"Favyen Bastani , Songtao He , Arjun Balasingam , Karthik Gopalakrishnan , Mohammad Alizadeh , Hari Balakrishnan , Michael J. Cafarella , Tim Kraska , and Sam Madden . 2020 . MIRIS: Fast Object Track Queries in Video. In SIGMOD. 1907--1921. Favyen Bastani, Songtao He, Arjun Balasingam, Karthik Gopalakrishnan, Mohammad Alizadeh, Hari Balakrishnan, Michael J. Cafarella, Tim Kraska, and Sam Madden. 2020. MIRIS: Fast Object Track Queries in Video. In SIGMOD. 1907--1921."},{"key":"e_1_2_1_6_1","volume-title":"OTIF: Efficient Tracker Pre-processing over Large Video Datasets. In SIGMOD. 2091--2104.","author":"Bastani Favyen","year":"2022","unstructured":"Favyen Bastani and Samuel Madden . 2022 . OTIF: Efficient Tracker Pre-processing over Large Video Datasets. In SIGMOD. 2091--2104. Favyen Bastani and Samuel Madden. 2022. OTIF: Efficient Tracker Pre-processing over Large Video Datasets. In SIGMOD. 2091--2104."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.14778\/3415478.3415498"},{"key":"e_1_2_1_8_1","volume-title":"Recognition-by-components: a theory of human image understanding. Psychological review 94, 2","author":"Biederman Irving","year":"1987","unstructured":"Irving Biederman . 1987. Recognition-by-components: a theory of human image understanding. Psychological review 94, 2 ( 1987 ), 115. Irving Biederman. 1987. Recognition-by-components: a theory of human image understanding. Psychological review 94, 2 (1987), 115."},{"key":"e_1_2_1_9_1","volume-title":"Privid: Practical, Privacy-Preserving Video Analytics Queries. In NSDI. 209--228.","author":"Cangialosi Frank","year":"2022","unstructured":"Frank Cangialosi , Neil Agarwal , Venkat Arun , Srinivas Narayana , Anand D. Sarwate , and Ravi Netravali . 2022 . Privid: Practical, Privacy-Preserving Video Analytics Queries. In NSDI. 209--228. Frank Cangialosi, Neil Agarwal, Venkat Arun, Srinivas Narayana, Anand D. Sarwate, and Ravi Netravali. 2022. Privid: Practical, Privacy-Preserving Video Analytics Queries. In NSDI. 209--228."},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Shih-Fu Chang William Chen Horace J. Meng Hari Sundaram and Di Zhong. 1997. VideoQ: An Automated Content Based Video Search System Using Visual Cues. In MM. 313--324.  Shih-Fu Chang William Chen Horace J. Meng Hari Sundaram and Di Zhong. 1997. VideoQ: An Automated Content Based Video Search System Using Visual Cues. In MM. 313--324.","DOI":"10.1145\/266180.266382"},{"key":"e_1_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Daren Chao Nick Koudas and Ioannis Xarchakos. 2020. SVQ++: Querying for Object Interactions in Video Streams. In SIGMOD. 2769--2772.  Daren Chao Nick Koudas and Ioannis Xarchakos. 2020. SVQ++: Querying for Object Interactions in Video Streams. In SIGMOD. 2769--2772.","DOI":"10.1145\/3318464.3384701"},{"key":"e_1_2_1_12_1","volume-title":"Scene Graph Prediction With Limited Labels. ICCV","author":"Chen Vincent S.","year":"2019","unstructured":"Vincent S. Chen , Paroma Varma , Ranjay Krishna , Michael S. Bernstein , Christopher R\u00e9 , and Li Fei-Fei . 2019. Scene Graph Prediction With Limited Labels. ICCV ( 2019 ). Vincent S. Chen, Paroma Varma, Ranjay Krishna, Michael S. Bernstein, Christopher R\u00e9, and Li Fei-Fei. 2019. Scene Graph Prediction With Limited Labels. ICCV (2019)."},{"key":"e_1_2_1_13_1","unstructured":"Xinyun Chen Chang Liu and Dawn Song. 2019. Execution-Guided Neural Program Synthesis. In ICLR.  Xinyun Chen Chang Liu and Dawn Song. 2019. Execution-Guided Neural Program Synthesis. In ICLR."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.14778\/3551793.3551865"},{"key":"e_1_2_1_15_1","volume-title":"TQVS: Temporal Queries over Video Streams in Action. In SIGMOD. 2737--2740.","author":"Chen Yueting","year":"2020","unstructured":"Yueting Chen , Xiaohui Yu , and Nick Koudas . 2020 . TQVS: Temporal Queries over Video Streams in Action. In SIGMOD. 2737--2740. Yueting Chen, Xiaohui Yu, and Nick Koudas. 2020. TQVS: Temporal Queries over Video Streams in Action. In SIGMOD. 2737--2740."},{"key":"e_1_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Yueting Chen Xiaohui Yu Nick Koudas and Ziqiang Yu. 2021. Evaluating Temporal Queries Over Video Feeds. In SIGMOD. 287--299.  Yueting Chen Xiaohui Yu Nick Koudas and Ziqiang Yu. 2021. Evaluating Temporal Queries Over Video Feeds. In SIGMOD. 287--299.","DOI":"10.1145\/3448016.3452803"},{"key":"e_1_2_1_17_1","volume-title":"Zeus: Efficiently Localizing Actions in Videos using Reinforcement Learning. In SIGMOD. 545--558.","author":"Chunduri Pramod","year":"2022","unstructured":"Pramod Chunduri , Jaeho Bang , Yao Lu , and Joy Arulraj . 2022 . Zeus: Efficiently Localizing Actions in Videos using Reinforcement Learning. In SIGMOD. 545--558. Pramod Chunduri, Jaeho Bang, Yao Lu, and Joy Arulraj. 2022. Zeus: Efficiently Localizing Actions in Videos using Reinforcement Learning. In SIGMOD. 545--558."},{"key":"e_1_2_1_18_1","volume-title":"TASM: A Tile-Based Storage Manager for Video Analytics. In ICDE. 1775--1786.","author":"Daum Maureen","year":"2021","unstructured":"Maureen Daum , Brandon Haynes , Dong He , Amrita Mazumdar , and Magdalena Balazinska . 2021 . TASM: A Tile-Based Storage Manager for Video Analytics. In ICDE. 1775--1786. Maureen Daum, Brandon Haynes, Dong He, Amrita Mazumdar, and Magdalena Balazinska. 2021. TASM: A Tile-Based Storage Manager for Video Analytics. In ICDE. 1775--1786."},{"key":"e_1_2_1_19_1","volume-title":"VOCAL: Video Organization and Interactive Compositional AnaLytics. In CIDR.","author":"Daum Maureen","year":"2022","unstructured":"Maureen Daum , Enhao Zhang , Dong He , Magdalena Balazinska , Brandon Haynes , Ranjay Krishna , Apryle Craig , and Aaron Wirsing . 2022 . VOCAL: Video Organization and Interactive Compositional AnaLytics. In CIDR. Maureen Daum, Enhao Zhang, Dong He, Magdalena Balazinska, Brandon Haynes, Ranjay Krishna, Apryle Craig, and Aaron Wirsing. 2022. VOCAL: Video Organization and Interactive Compositional AnaLytics. In CIDR."},{"key":"e_1_2_1_20_1","volume-title":"VOCALExplore: Pay-as-You-Go Video Data Exploration and Model Building. arXiv preprint arXiv:2303.04068","author":"Daum Maureen","year":"2023","unstructured":"Maureen Daum , Enhao Zhang , Dong He , Stephen Mussmann , Brandon Haynes , Ranjay Krishna , and Magdalena Balazinska . 2023. VOCALExplore: Pay-as-You-Go Video Data Exploration and Model Building. arXiv preprint arXiv:2303.04068 ( 2023 ). Maureen Daum, Enhao Zhang, Dong He, Stephen Mussmann, Brandon Haynes, Ranjay Krishna, and Magdalena Balazinska. 2023. VOCALExplore: Pay-as-You-Go Video Data Exploration and Model Building. arXiv preprint arXiv:2303.04068 (2023)."},{"key":"e_1_2_1_21_1","volume-title":"Multiscale Vision Transformers","author":"Fan Haoqi","unstructured":"Haoqi Fan , Bo Xiong , Karttikeya Mangalam , Yanghao Li , Zhicheng Yan , Jitendra Malik , and Christoph Feichtenhofer . 2021. Multiscale Vision Transformers . In ICCV. IEEE , 6804--6815. Haoqi Fan, Bo Xiong, Karttikeya Mangalam, Yanghao Li, Zhicheng Yan, Jitendra Malik, and Christoph Feichtenhofer. 2021. Multiscale Vision Transformers. In ICCV. IEEE, 6804--6815."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.14778\/3342263.3342266"},{"key":"e_1_2_1_23_1","volume-title":"Rekall: Specifying Video Events using Compositions of Spatiotemporal Labels. arXiv preprint arXiv:1910.02993","author":"Fu Daniel Y.","year":"2019","unstructured":"Daniel Y. Fu , Will Crichton , James Hong , Xinwei Yao , Haotian Zhang , Anh Truong , Avanika Narayan , Maneesh Agrawala , Christopher R\u00e9 , and Kayvon Fatahalian . 2019 . Rekall: Specifying Video Events using Compositions of Spatiotemporal Labels. arXiv preprint arXiv:1910.02993 (2019). Daniel Y. Fu, Will Crichton, James Hong, Xinwei Yao, Haotian Zhang, Anh Truong, Avanika Narayan, Maneesh Agrawala, Christopher R\u00e9, and Kayvon Fatahalian. 2019. Rekall: Specifying Video Events using Compositions of Spatiotemporal Labels. arXiv preprint arXiv:1910.02993 (2019)."},{"key":"e_1_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Andreas Geiger Philip Lenz and Raquel Urtasun. 2012. Are we ready for autonomous driving? the kitti vision benchmark suite. In CVPR. 3354--3361.  Andreas Geiger Philip Lenz and Raquel Urtasun. 2012. Are we ready for autonomous driving? the kitti vision benchmark suite. In CVPR. 3354--3361.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Shilpa George Junjue Wang Mihir Bala Thomas Eiszler Padmanabhan Pillai and Mahadev Satyanarayanan. 2019. Towards Drone-sourced Live Video Analytics for the Construction Industry. In HotMobile. 3--8.  Shilpa George Junjue Wang Mihir Bala Thomas Eiszler Padmanabhan Pillai and Mahadev Satyanarayanan. 2019. Towards Drone-sourced Live Video Analytics for the Construction Industry. In HotMobile. 3--8.","DOI":"10.1145\/3301293.3302365"},{"key":"e_1_2_1_26_1","first-page":"144","article-title":"A Reasoning Based Model for Anomaly Detection in the Smart City Domain","volume":"1251","author":"Hammer Patrick","year":"2020","unstructured":"Patrick Hammer , Tony Lofthouse , Enzo Fenoglio , Hugo Latapie , and Pei Wang . 2020 . A Reasoning Based Model for Anomaly Detection in the Smart City Domain . In IntelliSys (AISC) , Vol. 1251. 144 -- 159 . Patrick Hammer, Tony Lofthouse, Enzo Fenoglio, Hugo Latapie, and Pei Wang. 2020. A Reasoning Based Model for Anomaly Detection in the Smart City Domain. In IntelliSys (AISC), Vol. 1251. 144--159.","journal-title":"IntelliSys (AISC)"},{"key":"e_1_2_1_27_1","volume-title":"VSS: A Storage System for Video Analytics. In SIGMOD. 685--696.","author":"Haynes Brandon","year":"2021","unstructured":"Brandon Haynes , Maureen Daum , Dong He , Amrita Mazumdar , Magdalena Balazinska , Alvin Cheung , and Luis Ceze . 2021 . VSS: A Storage System for Video Analytics. In SIGMOD. 685--696. Brandon Haynes, Maureen Daum, Dong He, Amrita Mazumdar, Magdalena Balazinska, Alvin Cheung, and Luis Ceze. 2021. VSS: A Storage System for Video Analytics. In SIGMOD. 685--696."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3324955"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.14778\/3485450.3485460"},{"key":"e_1_2_1_30_1","volume-title":"MaskSearch: Querying Image Masks at Scale. arXiv preprint arXiv:2305.02375","author":"He Dong","year":"2023","unstructured":"Dong He , Jieyu Zhang , Maureen Daum , Alexander Ratner , and Magdalena Balazinska . 2023. MaskSearch: Querying Image Masks at Scale. arXiv preprint arXiv:2305.02375 ( 2023 ). Dong He, Jieyu Zhang, Maureen Daum, Alexander Ratner, and Magdalena Balazinska. 2023. MaskSearch: Querying Image Masks at Scale. arXiv preprint arXiv:2305.02375 (2023)."},{"key":"e_1_2_1_31_1","volume-title":"Girshick","author":"He Kaiming","year":"2017","unstructured":"Kaiming He , Georgia Gkioxari , Piotr Doll\u00e1r , and Ross B . Girshick . 2017 . Mask R-CNN. In ICCV. 2980--2988. Kaiming He, Georgia Gkioxari, Piotr Doll\u00e1r, and Ross B. Girshick. 2017. Mask R-CNN. In ICCV. 2980--2988."},{"key":"e_1_2_1_32_1","volume-title":"Cafarella","author":"He Wenjia","year":"2020","unstructured":"Wenjia He , Michael R. Anderson , Maxwell Strome , and Michael J . Cafarella . 2020 . A Method for Optimizing Opaque Filter Queries. In SIGMOD. 1257--1272. Wenjia He, Michael R. Anderson, Maxwell Strome, and Michael J. Cafarella. 2020. A Method for Optimizing Opaque Filter Queries. In SIGMOD. 1257--1272."},{"key":"e_1_2_1_33_1","volume-title":"Cafarella","author":"He Wenjia","year":"2022","unstructured":"Wenjia He and Michael J . Cafarella . 2022 . Controlled Intentional Degradation in Analytical Video Systems. In SIGMOD. 2105--2119. Wenjia He and Michael J. Cafarella. 2022. Controlled Intentional Degradation in Analytical Video Systems. In SIGMOD. 2105--2119."},{"key":"e_1_2_1_34_1","volume-title":"ICML","volume":"119","author":"Huang Jiani","year":"2020","unstructured":"Jiani Huang , Calvin Smith , Osbert Bastani , Rishabh Singh , Aws Albarghouthi , and Mayur Naik . 2020 . Generating Programmatic Referring Expressions via Program Synthesis . In ICML , Vol. 119 . 4495--4506. Jiani Huang, Calvin Smith, Osbert Bastani, Rishabh Singh, Aws Albarghouthi, and Mayur Naik. 2020. Generating Programmatic Referring Expressions via Program Synthesis. In ICML, Vol. 119. 4495--4506."},{"key":"e_1_2_1_35_1","doi-asserted-by":"crossref","unstructured":"Jingwei Ji Ranjay Krishna Li Fei-Fei and Juan Carlos Niebles. 2020. Action genome: Actions as compositions of spatio-temporal scene graphs. In CVPR. 10236--10247.  Jingwei Ji Ranjay Krishna Li Fei-Fei and Juan Carlos Niebles. 2020. Action genome: Actions as compositions of spatio-temporal scene graphs. In CVPR. 10236--10247.","DOI":"10.1109\/CVPR42600.2020.01025"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3385412.3386025"},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Junchen Jiang Ganesh Ananthanarayanan Peter Bod\u00edk Siddhartha Sen and Ion Stoica. 2018. Chameleon: scalable adaptation of video analytics. In SIGCOMM. 253--266.  Junchen Jiang Ganesh Ananthanarayanan Peter Bod\u00edk Siddhartha Sen and Ion Stoica. 2018. Chameleon: scalable adaptation of video analytics. In SIGCOMM. 253--266.","DOI":"10.1145\/3230543.3230574"},{"key":"e_1_2_1_38_1","doi-asserted-by":"crossref","unstructured":"Sean Kandel Andreas Paepcke Joseph M. Hellerstein and Jeffrey Heer. 2011. Wrangler: interactive visual specification of data transformation scripts. In CHI. 3363--3372.  Sean Kandel Andreas Paepcke Joseph M. Hellerstein and Jeffrey Heer. 2011. Wrangler: interactive visual specification of data transformation scripts. In CHI. 3363--3372.","DOI":"10.1145\/1978942.1979444"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.14778\/3372716.3372725"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.14778\/3137628.3137664"},{"key":"e_1_2_1_41_1","volume-title":"TASTI: Semantic Indexes for Machine Learning-based Queries over Unstructured Data. In SIGMOD. 1934--1947.","author":"Kang Daniel","year":"2022","unstructured":"Daniel Kang , John Guibas , Peter D. Bailis , Tatsunori Hashimoto , and Matei Zaharia . 2022 . TASTI: Semantic Indexes for Machine Learning-based Queries over Unstructured Data. In SIGMOD. 1934--1947. Daniel Kang, John Guibas, Peter D. Bailis, Tatsunori Hashimoto, and Matei Zaharia. 2022. TASTI: Semantic Indexes for Machine Learning-based Queries over Unstructured Data. In SIGMOD. 1934--1947."},{"key":"e_1_2_1_42_1","first-page":"307","article-title":"Online Active Model Selection for Pre-trained Classifiers","volume":"130","author":"Karimi Mohammad Reza","year":"2021","unstructured":"Mohammad Reza Karimi , Nezihe Merve G\u00fcrel , Bojan Karlas , Johannes Rausch , Ce Zhang , and Andreas Krause . 2021 . Online Active Model Selection for Pre-trained Classifiers . In AISTATS , Vol. 130. 307 -- 315 . Mohammad Reza Karimi, Nezihe Merve G\u00fcrel, Bojan Karlas, Johannes Rausch, Ce Zhang, and Andreas Krause. 2021. Online Active Model Selection for Pre-trained Classifiers. In AISTATS, Vol. 130. 307--315.","journal-title":"AISTATS"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-016-0981-7"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-013-5371-6"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/6046.825790"},{"key":"e_1_2_1_46_1","first-page":"72","article-title":"Segmentation in the perception and memory of events","volume":"12","author":"Kurby Christopher A","year":"2008","unstructured":"Christopher A Kurby and Jeffrey M Zacks . 2008 . Segmentation in the perception and memory of events . TiCS 12 , 2 (2008), 72 -- 79 . Christopher A Kurby and Jeffrey M Zacks. 2008. Segmentation in the perception and memory of events. TiCS 12, 2 (2008), 72--79.","journal-title":"TiCS"},{"key":"e_1_2_1_47_1","volume-title":"Lewis and Jason Catlett","author":"David","year":"1994","unstructured":"David D. Lewis and Jason Catlett . 1994 . Heterogeneous Uncertainty Sampling for Supervised Learning. In ICML. David D. Lewis and Jason Catlett. 1994. Heterogeneous Uncertainty Sampling for Supervised Learning. In ICML."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.14778\/2831360.2831369"},{"key":"e_1_2_1_49_1","unstructured":"Xiaochen Liu Pradipta Ghosh Oytun Ulutan B. S. Manjunath Kevin S. Chan and Ramesh Govindan. 2019. Caesar: cross-camera complex activity recognition. In SenSys. 232--244.  Xiaochen Liu Pradipta Ghosh Oytun Ulutan B. S. Manjunath Kevin S. Chan and Ramesh Govindan. 2019. Caesar: cross-camera complex activity recognition. In SenSys. 232--244."},{"key":"e_1_2_1_50_1","volume-title":"Lianhui Qin, Youngjae Yu, Rowan Zellers, Noah A. Smith, and Yejin Choi.","author":"Lu Ximing","year":"2022","unstructured":"Ximing Lu , Sean Welleck , Peter West , Liwei Jiang , Jungo Kasai , Daniel Khashabi , Ronan Le Bras , Lianhui Qin, Youngjae Yu, Rowan Zellers, Noah A. Smith, and Yejin Choi. 2022 . NeuroLogic A*esque Decoding : Constrained Text Generation with Lookahead Heuristics. In NAACL. 780--799. Ximing Lu, Sean Welleck, Peter West, Liwei Jiang, Jungo Kasai, Daniel Khashabi, Ronan Le Bras, Lianhui Qin, Youngjae Yu, Rowan Zellers, Noah A. Smith, and Yejin Choi. 2022. NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics. In NAACL. 780--799."},{"key":"e_1_2_1_51_1","doi-asserted-by":"crossref","unstructured":"Yao Lu Aakanksha Chowdhery Srikanth Kandula and Surajit Chaudhuri. 2018. Accelerating Machine Learning Inference with Probabilistic Predicates. In SIGMOD. 1493--1508.  Yao Lu Aakanksha Chowdhery Srikanth Kandula and Surajit Chaudhuri. 2018. Accelerating Machine Learning Inference with Probabilistic Predicates. In SIGMOD. 1493--1508.","DOI":"10.1145\/3183713.3183751"},{"key":"e_1_2_1_52_1","unstructured":"Rachael Mady Peter Mason Matt Strimas-Mackey Miyoko Chu Tina Phillips David Bonter Charles Eldermire and Benjamin Walters. 2021. Bird Cams Lab Biological Data. https:\/\/ecommons.cornell.edu\/handle\/1813\/110264.  Rachael Mady Peter Mason Matt Strimas-Mackey Miyoko Chu Tina Phillips David Bonter Charles Eldermire and Benjamin Walters. 2021. Bird Cams Lab Biological Data. https:\/\/ecommons.cornell.edu\/handle\/1813\/110264."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00346"},{"key":"e_1_2_1_54_1","volume-title":"Synthesizing Video Trajectory Queries. In AIPLANS Workshop.","author":"Mell Stephen","year":"2021","unstructured":"Stephen Mell , Favyen Bastani , Stephan Zdancewic , and Osbert Bastani . 2021 . Synthesizing Video Trajectory Queries. In AIPLANS Workshop. Stephen Mell, Favyen Bastani, Stephan Zdancewic, and Osbert Bastani. 2021. Synthesizing Video Trajectory Queries. In AIPLANS Workshop."},{"key":"e_1_2_1_55_1","volume-title":"ExSample: Efficient Searches on Video Repositories through Adaptive Sampling. ICDE","author":"Moll Oscar","year":"2020","unstructured":"Oscar Moll , Favyen Bastani , Sam Madden , Michael Stonebraker , Vijay N. Gadepally , and Tim Kraska . 2020. ExSample: Efficient Searches on Video Repositories through Adaptive Sampling. ICDE ( 2020 ), 3065--3077. Oscar Moll, Favyen Bastani, Sam Madden, Michael Stonebraker, Vijay N. Gadepally, and Tim Kraska. 2020. ExSample: Efficient Searches on Video Repositories through Adaptive Sampling. ICDE (2020), 3065--3077."},{"key":"e_1_2_1_56_1","volume-title":"BUSTLE: Bottom-Up Program Synthesis Through Learning-Guided Exploration. In ICLR.","author":"Odena Augustus","year":"2021","unstructured":"Augustus Odena , Kensen Shi , David Bieber , Rishabh Singh , Charles Sutton , and Hanjun Dai . 2021 . BUSTLE: Bottom-Up Program Synthesis Through Learning-Guided Exploration. In ICLR. Augustus Odena, Kensen Shi, David Bieber, Rishabh Singh, Charles Sutton, and Hanjun Dai. 2021. BUSTLE: Bottom-Up Program Synthesis Through Learning-Guided Exploration. In ICLR."},{"key":"e_1_2_1_57_1","first-page":"1","article-title":"Ap\u00e9ritif: Scaffolding Preregistrations to Automatically Generate Analysis Code and Methods Descriptions","volume":"207","author":"Pang Yuren","year":"2022","unstructured":"Yuren Pang , Katharina Reinecke , and Ren\u00e9 Just . 2022 . Ap\u00e9ritif: Scaffolding Preregistrations to Automatically Generate Analysis Code and Methods Descriptions . In CHI. 207 : 1 -- 207 :15. Yuren Pang, Katharina Reinecke, and Ren\u00e9 Just. 2022. Ap\u00e9ritif: Scaffolding Preregistrations to Automatically Generate Analysis Code and Methods Descriptions. In CHI. 207:1--207:15.","journal-title":"CHI."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201394"},{"key":"e_1_2_1_59_1","doi-asserted-by":"crossref","unstructured":"Fotis Psallidas Bolin Ding Kaushik Chakrabarti and Surajit Chaudhuri. 2015. S4: Top-k Spreadsheet-Style Search for Query Discovery. In SIGMOD. 2001--2016.  Fotis Psallidas Bolin Ding Kaushik Chakrabarti and Surajit Chaudhuri. 2015. S4: Top-k Spreadsheet-Style Search for Query Discovery. In SIGMOD. 2001--2016.","DOI":"10.1145\/2723372.2749452"},{"key":"e_1_2_1_60_1","volume-title":"ICML","volume":"139","author":"Radford Alec","year":"2021","unstructured":"Alec Radford , Jong Wook Kim , Chris Hallacy , Aditya Ramesh , Gabriel Goh , Sandhini Agarwal , Girish Sastry , Amanda Askell , Pamela Mishkin , Jack Clark , Gretchen Krueger , and Ilya Sutskever . 2021 . Learning Transferable Visual Models From Natural Language Supervision . In ICML , Vol. 139 . PMLR, 8748--8763. Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021. Learning Transferable Visual Models From Natural Language Supervision. In ICML, Vol. 139. PMLR, 8748--8763."},{"key":"e_1_2_1_61_1","doi-asserted-by":"crossref","unstructured":"Veselin Raychev Pavol Bielik Martin T. Vechev and Andreas Krause. 2016. Learning programs from noisy data. In POPL. 761--774.  Veselin Raychev Pavol Bielik Martin T. Vechev and Andreas Krause. 2016. Learning programs from noisy data. In POPL. 761--774.","DOI":"10.1145\/2914770.2837671"},{"key":"e_1_2_1_62_1","unstructured":"Shaoqing Ren Kaiming He Ross B. Girshick and Jian Sun. 2015. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. In NeurIPS. 91--99.  Shaoqing Ren Kaiming He Ross B. Girshick and Jian Sun. 2015. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. In NeurIPS. 91--99."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472883.3486972"},{"key":"e_1_2_1_64_1","unstructured":"Nicholas Roy and Andrew McCallum. 2001. Toward Optimal Active Learning through Sampling Estimation of Error Reduction. In ICML.  Nicholas Roy and Andrew McCallum. 2001. Toward Optimal Active Learning through Sampling Estimation of Error Reduction. In ICML."},{"key":"e_1_2_1_65_1","doi-asserted-by":"crossref","unstructured":"Olga Russakovsky Li-Jia Li and Li Fei-Fei. 2015. Best of both worlds: Human-machine collaboration for object annotation. In CVPR. 2121--2131.  Olga Russakovsky Li-Jia Li and Li Fei-Fei. 2015. Best of both worlds: Human-machine collaboration for object annotation. In CVPR. 2121--2131.","DOI":"10.1109\/CVPR.2015.7298824"},{"key":"e_1_2_1_66_1","unstructured":"Ozan Sener and Silvio Savarese. 2018. Active Learning for Convolutional Neural Networks: A Core-Set Approach. In ICLR.  Ozan Sener and Silvio Savarese. 2018. Active Learning for Convolutional Neural Networks: A Core-Set Approach. In ICLR."},{"key":"e_1_2_1_67_1","volume-title":"Y-L Tian, Sergio Borger, and C Carlson.","author":"Senior Andrew W","year":"2007","unstructured":"Andrew W Senior , L Brown , Arun Hampapur , C-F Shu , Yun Zhai , Rog\u00e9rio Schmidt Feris , Y-L Tian, Sergio Borger, and C Carlson. 2007 . Video analytics for retail. In AVSS. 423--428. Andrew W Senior, L Brown, Arun Hampapur, C-F Shu, Yun Zhai, Rog\u00e9rio Schmidt Feris, Y-L Tian, Sergio Borger, and C Carlson. 2007. Video analytics for retail. In AVSS. 423--428."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/130385.130417"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2745181"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.14778\/3476249.3476253"},{"key":"e_1_2_1_71_1","doi-asserted-by":"crossref","unstructured":"Abhishek Udupa Arun Raghavan Jyotirmoy V. Deshmukh Sela Mador-Haim Milo M. K. Martin and Rajeev Alur. 2013. TRANSIT: specifying protocols with concolic snippets. In PLDI. 287--296.  Abhishek Udupa Arun Raghavan Jyotirmoy V. Deshmukh Sela Mador-Haim Milo M. K. Martin and Rajeev Alur. 2013. TRANSIT: specifying protocols with concolic snippets. In PLDI. 287--296.","DOI":"10.1145\/2499370.2462174"},{"key":"e_1_2_1_72_1","volume-title":"Diverse beam search: Decoding diverse solutions from neural sequence models. arXiv preprint arXiv:1610.02424","author":"Vijayakumar Ashwin K","year":"2016","unstructured":"Ashwin K Vijayakumar , Michael Cogswell , Ramprasath R Selvaraju , Qing Sun , Stefan Lee , David Crandall , and Dhruv Batra . 2016. Diverse beam search: Decoding diverse solutions from neural sequence models. arXiv preprint arXiv:1610.02424 ( 2016 ). Ashwin K Vijayakumar, Michael Cogswell, Ramprasath R Selvaraju, Qing Sun, Stefan Lee, David Crandall, and Dhruv Batra. 2016. Diverse beam search: Decoding diverse solutions from neural sequence models. arXiv preprint arXiv:1610.02424 (2016)."},{"key":"e_1_2_1_73_1","volume-title":"Synthesizing highly expressive SQL queries from input-output examples. PLDI","author":"Wang Chenglong","year":"2017","unstructured":"Chenglong Wang , Alvin Cheung , and Rastislav Bod\u00edk . 2017. Synthesizing highly expressive SQL queries from input-output examples. PLDI ( 2017 ). Chenglong Wang, Alvin Cheung, and Rastislav Bod\u00edk. 2017. Synthesizing highly expressive SQL queries from input-output examples. PLDI (2017)."},{"key":"e_1_2_1_74_1","first-page":"1","article-title":"Falx","volume":"106","author":"Wang Chenglong","year":"2021","unstructured":"Chenglong Wang , Yu Feng , Rastislav Bod\u00edk , Isil Dillig , Alvin Cheung , and Amy J. Ko . 2021 . Falx : Synthesis-Powered Visualization Authoring. In CHI. 106 : 1 -- 106 :15. Chenglong Wang, Yu Feng, Rastislav Bod\u00edk, Isil Dillig, Alvin Cheung, and Amy J. Ko. 2021. Falx: Synthesis-Powered Visualization Authoring. In CHI. 106:1--106:15.","journal-title":"Synthesis-Powered Visualization Authoring. In CHI."},{"key":"e_1_2_1_75_1","doi-asserted-by":"crossref","unstructured":"Junjue Wang Ziqiang Feng Zhuo Chen Shilpa George Mihir Bala Padmanabhan Pillai Shao-Wen Yang and Mahadev Satyanarayanan. 2018. Bandwidth-Efficient Live Video Analytics for Drones Via Edge Computing. In SEC. 159--173.  Junjue Wang Ziqiang Feng Zhuo Chen Shilpa George Mihir Bala Padmanabhan Pillai Shao-Wen Yang and Mahadev Satyanarayanan. 2018. Bandwidth-Efficient Live Video Analytics for Drones Via Edge Computing. In SEC. 159--173.","DOI":"10.1109\/SEC.2018.00019"},{"key":"e_1_2_1_76_1","volume-title":"Manning","author":"Wang Sida I.","year":"2017","unstructured":"Sida I. Wang , Samuel Ginn , Percy Liang , and Christopher D . Manning . 2017 . Naturalizing a Programming Language via Interactive Learning. In ACL. 929--938. Sida I. Wang, Samuel Ginn, Percy Liang, and Christopher D. Manning. 2017. Naturalizing a Programming Language via Interactive Learning. In ACL. 929--938."},{"key":"e_1_2_1_77_1","doi-asserted-by":"crossref","unstructured":"Xiaoli Wang Aakanksha Chowdhery and Mung Chiang. 2016. SkyEyes: adaptive video streaming from UAVs. In HotWireless. 2--6.  Xiaoli Wang Aakanksha Chowdhery and Mung Chiang. 2016. SkyEyes: adaptive video streaming from UAVs. In HotWireless. 2--6.","DOI":"10.1145\/2980115.2980119"},{"key":"e_1_2_1_78_1","doi-asserted-by":"crossref","unstructured":"Nicolai Wojke and Alex Bewley. 2018. Deep Cosine Metric Learning for Person Re-identification. In WACV. 748--756.  Nicolai Wojke and Alex Bewley. 2018. Deep Cosine Metric Learning for Person Re-identification. In WACV. 748--756.","DOI":"10.1109\/WACV.2018.00087"},{"key":"e_1_2_1_79_1","first-page":"1","article-title":"VStore","volume":"16","author":"Xu Tiantu","year":"2019","unstructured":"Tiantu Xu , Luis Materon Botelho , and Felix Xiaozhu Lin . 2019 . VStore : A Data Store for Analytics on Large Videos. In EuroSys. 16 : 1 -- 16 :17. Tiantu Xu, Luis Materon Botelho, and Felix Xiaozhu Lin. 2019. VStore: A Data Store for Analytics on Large Videos. In EuroSys. 16:1--16:17.","journal-title":"A Data Store for Analytics on Large Videos. In EuroSys."},{"key":"e_1_2_1_80_1","doi-asserted-by":"crossref","unstructured":"Piyush Yadav and Edward Curry. 2019. VidCEP: Complex Event Processing Framework to Detect Spatiotemporal Patterns in Video Streams. In Big Data. 2513--2522.  Piyush Yadav and Edward Curry. 2019. VidCEP: Complex Event Processing Framework to Detect Spatiotemporal Patterns in Video Streams. In Big Data. 2513--2522.","DOI":"10.1109\/BigData47090.2019.9006018"},{"key":"e_1_2_1_81_1","volume-title":"Tenenbaum","author":"Yi Kexin","year":"2020","unstructured":"Kexin Yi , Chuang Gan , Yunzhu Li , Pushmeet Kohli , Jiajun Wu , Antonio Torralba , and Joshua B . Tenenbaum . 2020 . CLEVRER : Collision Events for Video Representation and Reasoning. In ICLR. Kexin Yi, Chuang Gan, Yunzhu Li, Pushmeet Kohli, Jiajun Wu, Antonio Torralba, and Joshua B. Tenenbaum. 2020. CLEVRER: Collision Events for Video Representation and Reasoning. In ICLR."},{"key":"e_1_2_1_82_1","unstructured":"Quanzeng You Hailin Jin Zhaowen Wang Chen Fang and Jiebo Luo. 2016. Image Captioning with Semantic Attention. In CVPR. 4651--4659.  Quanzeng You Hailin Jin Zhaowen Wang Chen Fang and Jiebo Luo. 2016. Image Captioning with Semantic Attention. In CVPR. 4651--4659."},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.130.1.29"},{"key":"e_1_2_1_84_1","doi-asserted-by":"crossref","unstructured":"Enhao Zhang Maureen Daum Dong He Brandon Haynes Ranjay Krishna and Magdalena Balazinska. 2023. EQUI-VOCAL: Synthesizing Queries for Compositional Video Events from Limited User Interactions [Technical Report]. arXiv:2301.00929 [cs.DB]  Enhao Zhang Maureen Daum Dong He Brandon Haynes Ranjay Krishna and Magdalena Balazinska. 2023. EQUI-VOCAL: Synthesizing Queries for Compositional Video Events from Limited User Interactions [Technical Report]. arXiv:2301.00929 [cs.DB]","DOI":"10.14778\/3611479.3611482"},{"key":"e_1_2_1_85_1","unstructured":"Jingwei Zhuo Ziru Xu Wei Dai Han Zhu Han Li Jian Xu and Kun Gai. 2020. Learning Optimal Tree Models under Beam Search. In ICML. 11650--11659.  Jingwei Zhuo Ziru Xu Wei Dai Han Zhu Han Li Jian Xu and Kun Gai. 2020. Learning Optimal Tree Models under Beam Search. In ICML. 11650--11659."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3611479.3611482","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,23]],"date-time":"2023-09-23T22:20:14Z","timestamp":1695507614000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3611479.3611482"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7]]},"references-count":85,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["10.14778\/3611479.3611482"],"URL":"https:\/\/doi.org\/10.14778\/3611479.3611482","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2023,7]]},"assertion":[{"value":"2023-08-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}