{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T11:46:02Z","timestamp":1777376762141,"version":"3.51.4"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2022,7,26]],"date-time":"2022-07-26T00:00:00Z","timestamp":1658793600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2022,9,30]]},"abstract":"<jats:p>\n            Sketching is an intuitive and simple way to depict sciences with various object form and appearance characteristics. In the past few years, widely available touchscreen devices have increasingly made sketch-based human-AI co-creation applications popular. One key issue of sketch-oriented interaction is to prepare input sketches efficiently by non-professionals because it is usually difficult and time-consuming to draw an ideal sketch with appropriate outlines and rich details, especially for novice users with no sketching skills. Thus, sketching brings great obstacles for sketch applications in daily life. On the other hand, hand-drawn sketches are scarce and hard to collect. Given the fact that there are several large-scale sketch datasets providing sketch data resources, but they usually have a limited number of objects and categories in sketch, and do not support users to collect new sketch materials according to their personal preferences. In addition, few sketch-related applications support the reuse of existing sketch elements. Thus, knowing how to extract sketches from existing drawings and effectively re-use them in interactive scene sketch composition will provide an elegant way for\n            <jats:bold>sketch-based image retrieval (SBIR)<\/jats:bold>\n            applications, which are widely used in various touch screen devices. In this study, we first conduct a study on current SBIR to better understand the main requirements and challenges in sketch-oriented applications. Then we develop the SketchMaker as an interactive sketch extraction and composition system to help users generate scene sketches via reusing object sketches in existing scene sketches with minimal manual intervention. Moreover, we demonstrate how SBIR improves from composited scene sketches to verify the performance of our interactive sketch processing system. We also include a sketch-based video localization task as an alternative application of our sketch composition scheme. Our pilot study shows that our system is effective and efficient, and provides a way to promote practical applications of sketches.\n          <\/jats:p>","DOI":"10.1145\/3543956","type":"journal-article","created":{"date-parts":[[2022,6,25]],"date-time":"2022-06-25T09:35:11Z","timestamp":1656149711000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["SketchMaker: Sketch Extraction and Reuse for Interactive Scene Sketch Composition"],"prefix":"10.1145","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7733-6790","authenticated-orcid":false,"given":"Fang","family":"Liu","sequence":"first","affiliation":[{"name":"BNRist, MOE-Key Laboratory of Pervasive Computing, Department of Computer Science and Technology, Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8576-1201","authenticated-orcid":false,"given":"Xiaoming","family":"Deng","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Computer Science and Beijing Key Lab of Human-Computer Interaction, Institute of Software, Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9700-2429","authenticated-orcid":false,"given":"Jiancheng","family":"Song","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Computer Science and Beijing Key Lab of Human-Computer Interaction, Institute of Software, Chinese Academy of Sciences; University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2094-5680","authenticated-orcid":false,"given":"Yu-Kun","family":"Lai","sequence":"additional","affiliation":[{"name":"School of Computer Science and Informatics, Cardiff University, Cardiff, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5774-1916","authenticated-orcid":false,"given":"Yong-Jin","family":"Liu","sequence":"additional","affiliation":[{"name":"BNRist, MOE-Key Laboratory of Pervasive Computing, Department of Computer Science and Technology, Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1662-2480","authenticated-orcid":false,"given":"Hao","family":"Wang","sequence":"additional","affiliation":[{"name":"Alibaba Group, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3999-7429","authenticated-orcid":false,"given":"Cuixia","family":"Ma","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Computer Science and Beijing Key Lab of Human-ComputerInteraction, Institute of Software, Chinese Academy of Sciences, University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8538-8136","authenticated-orcid":false,"given":"Shengfeng","family":"Qin","sequence":"additional","affiliation":[{"name":"School of Design, Northumbria University, Newcastle upon Tyne, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9320-4920","authenticated-orcid":false,"given":"Hongan","family":"Wang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Computer Science and Beijing Key Lab of Human-Computer Interaction, Institute of Software, Chinese Academy of Sciences, University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,7,26]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/1449715.1449740"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/1622176.1622189"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/2743029"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858159"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.321"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618470"},{"key":"e_1_3_1_8_2","article-title":"Sketch-Pix2seq: A model to generate sketches of multiple categories","author":"Chen Yajing","year":"2017","unstructured":"Yajing Chen, Shikui Tu, Yuqi Yi, and Lei Xu. 2017. Sketch-Pix2seq: A model to generate sketches of multiple categories. arXiv preprint arXiv:1709.04121 (2017).","journal-title":"arXiv preprint arXiv:1709.04121"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.35.8.982"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3009981"},{"key":"e_1_3_1_11_2","volume-title":"ACM Symposium on User Interface Software and Technology (UIST) Posters","author":"Dixon Daniel","year":"2009","unstructured":"Daniel Dixon, Manoj Prasad, and Tracy Hammond. 2009. iCanDraw? A methodology for using assistive sketch recognition to improve a user\u2019s drawing ability. In ACM Symposium on User Interface Software and Technology (UIST) Posters, Vol. 10. ACM, Vancouver, Canada."},{"issue":"4","key":"e_1_3_1_12_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2185520.2185540","article-title":"How do humans sketch objects?","volume":"31","author":"Eitz Mathias","year":"2012","unstructured":"Mathias Eitz, James Hays, and Marc Alexa. 2012. How do humans sketch objects?ACM Transactions on Graphics 31, 4 (2012), 1\u201310.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047245"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2010.04.004"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00522"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.563"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00126"},{"key":"e_1_3_1_18_2","article-title":"A neural representation of sketch drawings","author":"Ha David","year":"2017","unstructured":"David Ha and Douglas Eck. 2017. A neural representation of sketch drawings. arXiv preprint arXiv:1704.03477 (2017).","journal-title":"arXiv preprint arXiv:1704.03477"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3181673"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/2030365.2030369"},{"key":"e_1_3_1_21_2","first-page":"ABIS\u20136","volume-title":"LWA","author":"Hartmann Melanie","year":"2009","unstructured":"Melanie Hartmann. 2009. Challenges in developing user-adaptive intelligent user interfaces (IUI). In LWA. Citeseer, ABIS\u20136."},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3332165.3347878"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300334"},{"key":"e_1_3_1_24_2","volume-title":"ACM Symposium on User Interface Software and Technology (UIST)","author":"Iarussi Emmanuel","year":"2013","unstructured":"Emmanuel Iarussi, Adrien Bousseau, and Theophanis Tsandilas. 2013. The drawing assistant: Automated drawing guidance and feedback from photographs. In ACM Symposium on User Interface Software and Technology (UIST). ACM, St. Andrews, UK."},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.632"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/2212776.2212390"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/1029632.1029636"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647375"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984567"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964922"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3126594.3126611"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376258"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00598"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58529-7_42"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2554113"},{"key":"e_1_3_1_36_2","article-title":"Gertie the Dinosaur","author":"McCay Winsor","year":"1914","unstructured":"Winsor McCay. 1914. Gertie the Dinosaur. https:\/\/www.youtube.com\/watch?v=TGXC8gXOPoUl.","journal-title":"https:\/\/www.youtube.com\/watch?v=TGXC8gXOPoUl."},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174223"},{"key":"e_1_3_1_38_2","volume-title":"IUI Workshops","author":"Probst Lukas","year":"2018","unstructured":"Lukas Probst, Ihab Al Kabary, Rufus Lobo, Fabian Rauschenbach, Heiko Schuldt, Philipp Seidenschwarz, and Martin Rumo. 2018. SportSense: User interface for sketch-based spatio-temporal team sports video scene retrieval. In IUI Workshops. ACM, Tokyo, Japan."},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00099"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925954"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376520"},{"key":"e_1_3_1_42_2","volume-title":"BMVC","author":"Su Guoyao","year":"2020","unstructured":"Guoyao Su, Yonggang Qi, Kaiyue Pang, Jie Yang, Yi-Zhe Song, and CVSSP SketchX. 2020. SketchHealer: A graph-to-sequence network for recreating partial human sketches. In BMVC. Springer, UK."},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174236"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3312994"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/2876456.2879473"},{"key":"e_1_3_1_46_2","article-title":"Cali-Sketch: Stroke calibration and completion for high-quality face image generation from poorly-drawn sketches","author":"Xia Weihao","year":"2019","unstructured":"Weihao Xia, Yujiu Yang, and Jing-Hao Xue. 2019. Cali-Sketch: Stroke calibration and completion for high-quality face image generation from poorly-drawn sketches. arXiv preprint arXiv:1911.00426 (2019).","journal-title":"arXiv preprint arXiv:1911.00426"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647399"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/2911996.2912067"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01100"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.93"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356561"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01267-0_26"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3543956","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3543956","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:18Z","timestamp":1750178778000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3543956"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,26]]},"references-count":51,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,9,30]]}},"alternative-id":["10.1145\/3543956"],"URL":"https:\/\/doi.org\/10.1145\/3543956","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,26]]},"assertion":[{"value":"2021-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-07-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}