{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T02:04:49Z","timestamp":1768269889204,"version":"3.49.0"},"reference-count":27,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,6,15]],"date-time":"2021-06-15T00:00:00Z","timestamp":1623715200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGMOD Rec."],"published-print":{"date-parts":[[2021,6,15]]},"abstract":"<jats:p>Data visualization is the primary means by which data analysts explore patterns, trends, and insights in their data. Unfortunately, existing visual analytics tools offer limited expressiveness and scalability when it comes to searching for visualizations over large datasets, making visual data exploration labor-intensive and timeconsuming. We first discuss our prior work on Zenvisage that helps accelerate exploratory data analysis via an interactive interface and an expressive visualization query language, but offers limited flexibility when the pattern of interest is under-specified and approximate. Motivated from our findings from Zenvisage, we develop ShapeSearch, an efficient and flexible pattern-searching tool that enables the search for desired patterns via multiple mechanisms: sketch, natural-language, and visual regular expressions. ShapeSearch leverages a novel shape querying algebra that can express a large class of shape queries and supports query-aware and perceptually-aware optimizations to execute shape queries within interactive response times. To further improve the usability and performance of both Zenvisage and ShapeSearch, we discuss a number of open research problems.<\/jats:p>","DOI":"10.1145\/3471485.3471498","type":"journal-article","created":{"date-parts":[[2021,6,18]],"date-time":"2021-06-18T05:22:06Z","timestamp":1623993726000},"page":"51-58","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["From Sketching to Natural Language"],"prefix":"10.1145","volume":"50","author":[{"given":"Tarique","family":"Siddiqui","sequence":"first","affiliation":[{"name":"Microsoft Research"}]},{"given":"Paul","family":"Luh","sequence":"additional","affiliation":[{"name":"University of Illinois (UIUC)"}]},{"given":"Zesheng","family":"Wang","sequence":"additional","affiliation":[{"name":"University of Illinois (UIUC)"}]},{"given":"Karrie","family":"Karahalios","sequence":"additional","affiliation":[{"name":"University of Illinois (UIUC)"}]},{"given":"Aditya G.","family":"Parameswaran","sequence":"additional","affiliation":[{"name":"UC Berkeley"}]}],"member":"320","published-online":{"date-parts":[[2021,6,17]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"https:\/\/github.com\/lux-org\/lux. https:\/\/github.com\/lux-org\/lux.  https:\/\/github.com\/lux-org\/lux. https:\/\/github.com\/lux-org\/lux."},{"key":"e_1_2_1_2_1","unstructured":"Investopedia. https:\/\/www.investopedia.com\/terms\/t\/tripletop.asp.  Investopedia. https:\/\/www.investopedia.com\/terms\/t\/tripletop.asp."},{"key":"e_1_2_1_3_1","unstructured":"Match recognize. [https:\/\/bit.ly\/3bWwUhs. Online; accessed 17-Aug-2015].  Match recognize. [https:\/\/bit.ly\/3bWwUhs. Online; accessed 17-Aug-2015]."},{"key":"e_1_2_1_4_1","unstructured":"Technical report. https:\/\/arxiv.org\/abs\/1811.07977.  Technical report. https:\/\/arxiv.org\/abs\/1811.07977."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.14778\/2367502.2367542"},{"key":"e_1_2_1_6_1","volume-title":"The mouse genome database (mgd): mouse biology and model systems. Nucleic acids research, 36(suppl_1):D724--D728","author":"Bult C. J.","year":"2008","unstructured":"C. J. Bult , J. T. Eppig , J. A. Kadin , J. E. Richardson , J. A. Blake , and M. G. D. Group . The mouse genome database (mgd): mouse biology and model systems. Nucleic acids research, 36(suppl_1):D724--D728 , 2008 . C. J. Bult, J. T. Eppig, J. A. Kadin, J. E. Richardson, J. A. Blake, and M. G. D. Group. The mouse genome database (mgd): mouse biology and model systems. Nucleic acids research, 36(suppl_1):D724--D728, 2008."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.587537"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/191843.191925"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/645925.671514"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/645530.655813"},{"key":"e_1_2_1_11_1","volume-title":"You can't always sketch what you want: Understanding sensemaking in visual query systems","author":"Lee D. J.-L.","year":"2019","unstructured":"D. J.-L. Lee , J. Lee , T. Siddiqui , J. Kim , K. Karahalios , and A. Parameswaran . You can't always sketch what you want: Understanding sensemaking in visual query systems . IEEE transactions on visualization and computer graphics, 2019 . D. J.-L. Lee, J. Lee, T. Siddiqui, J. Kim, K. Karahalios, and A. Parameswaran. You can't always sketch what you want: Understanding sensemaking in visual query systems. IEEE transactions on visualization and computer graphics, 2019."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/645921.673155"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173962"},{"key":"e_1_2_1_14_1","volume-title":"Google correlate whitepaper","author":"Mohebbi M.","year":"2011","unstructured":"M. Mohebbi , D. Vanderkam , J. Kodysh , R. Schonberger , H. Choi , and S. Kumar . Google correlate whitepaper . 2011 . M. Mohebbi, D. Vanderkam, J. Kodysh, R. Schonberger, H. Choi, and S. Kumar. Google correlate whitepaper. 2011."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2016.7883518"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732240.2732247"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/645921.673157"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASSP.1978.1163164"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.envsoft.2004.01.001"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1056808.1057017"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1005566.1005568"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.5555\/645481.653263"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.14778\/3025111.3025126"},{"key":"e_1_2_1_24_1","volume-title":"CIDR","author":"Siddiqui T.","year":"2017","unstructured":"T. Siddiqui , J. Lee , A. Kim , E. Xue , X. Yu , S. Zou , L. Guo , C. Liu , C. Wang , K. Karahalios , Fast-forwarding to desired visualizations with zenvisage . In CIDR , 2017 . T. Siddiqui, J. Lee, A. Kim, E. Xue, X. Yu, S. Zou, L. Guo, C. Liu, C. Wang, K. Karahalios, et al. Fast-forwarding to desired visualizations with zenvisage. In CIDR, 2017."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.14778\/3229863.3236235"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3389722"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/634067.634292"}],"container-title":["ACM SIGMOD Record"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3471485.3471498","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3471485.3471498","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:26Z","timestamp":1750191446000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3471485.3471498"}},"subtitle":["Expressive Visual Querying for Accelerating Insight"],"short-title":[],"issued":{"date-parts":[[2021,6,15]]},"references-count":27,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,6,15]]}},"alternative-id":["10.1145\/3471485.3471498"],"URL":"https:\/\/doi.org\/10.1145\/3471485.3471498","relation":{},"ISSN":["0163-5808"],"issn-type":[{"value":"0163-5808","type":"print"}],"subject":[],"published":{"date-parts":[[2021,6,15]]},"assertion":[{"value":"2021-06-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}