{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T16:16:22Z","timestamp":1775578582773,"version":"3.50.1"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2020,11,30]],"date-time":"2020-11-30T00:00:00Z","timestamp":1606694400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Open Research Fund of Beijing Key Laboratory of Big Data Technology for Food Safety","award":["BTBD-2018KF"],"award-info":[{"award-number":["BTBD-2018KF"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["91748104, 61972067, 61632006, U1811463, U1908214, and 61751203"],"award-info":[{"award-number":["91748104, 61972067, 61632006, U1811463, U1908214, and 61751203"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National Key Research and Development Program of China","award":["2018AAA0102003 and 2018YFC0910506"],"award-info":[{"award-number":["2018AAA0102003 and 2018YFC0910506"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2020,11,30]]},"abstract":"<jats:p>Image matting is an ill-posed problem that usually requires additional user input, such as trimaps or scribbles. Drawing a fine trimap requires a large amount of user effort, while using scribbles can hardly obtain satisfactory alpha mattes for non-professional users. Some recent deep learning\u2013based matting networks rely on large-scale composite datasets for training to improve performance, resulting in the occasional appearance of obvious artifacts when processing natural images. In this article, we explore the intrinsic relationship between user input and alpha mattes and strike a balance between user effort and the quality of alpha mattes. In particular, we propose an interactive framework, referred to as smart scribbles, to guide users to draw few scribbles on the input images to produce high-quality alpha mattes. It first infers the most informative regions of an image for drawing scribbles to indicate different categories (foreground, background, or unknown) and then spreads these scribbles (i.e., the category labels) to the rest of the image via our well-designed two-phase propagation. Both neighboring low-level affinities and high-level semantic features are considered during the propagation process. Our method can be optimized without large-scale matting datasets and exhibits more universality in real situations. Extensive experiments demonstrate that smart scribbles can produce more accurate alpha mattes with reduced additional input, compared to the state-of-the-art matting methods.<\/jats:p>","DOI":"10.1145\/3408323","type":"journal-article","created":{"date-parts":[[2020,12,17]],"date-time":"2020-12-17T17:49:26Z","timestamp":1608227366000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["Smart Scribbles for Image Matting"],"prefix":"10.1145","volume":"16","author":[{"given":"Xin","family":"Yang","sequence":"first","affiliation":[{"name":"Dalian University of Technology and Beijing Technology and Business University, Dalian, Liaoning, China"}]},{"given":"Yu","family":"Qiao","sequence":"additional","affiliation":[{"name":"Dalian University of Technology, Dalian, Liaoning, China"}]},{"given":"Shaozhe","family":"Chen","sequence":"additional","affiliation":[{"name":"Dalian University of Technology, Dalian, Liaoning, China"}]},{"given":"Shengfeng","family":"He","sequence":"additional","affiliation":[{"name":"South China University of Technology, Guangzhou, Guangdong, China"}]},{"given":"Baocai","family":"Yin","sequence":"additional","affiliation":[{"name":"Dalian University of Technology and Peng Cheng Laboratory, Shenzhen, Guangdong, China"}]},{"given":"Qiang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Dalian University of Technology, Dalian, Liaoning, China"}]},{"given":"Xiaopeng","family":"Wei","sequence":"additional","affiliation":[{"name":"Dalian University of Technology, Dalian, Liaoning, China"}]},{"given":"Rynson W. H.","family":"Lau","sequence":"additional","affiliation":[{"name":"City University of Hong Kong, Hong Kong, China"}]}],"member":"320","published-online":{"date-parts":[[2020,12,17]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.120"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917)","author":"Aksoy Y.","unstructured":"Y. Aksoy , T. O. Aydin , and M. Pollefeys . 2017. Designing effective inter-pixel information flow for natural image matting . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917) . 228--236. Y. Aksoy, T. O. Aydin, and M. Pollefeys. 2017. Designing effective inter-pixel information flow for natural image matting. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917). 228--236."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2644615"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the International Conference on Computer Vision (ICCV\u201919)","author":"Cai S.","unstructured":"S. Cai , X. Zhang , H. Fan , H. Huang , J. Liu , J. Liu , J. Liu , J. Wang , and J. Sun . 2019. Disentangled image matting . In Proceedings of the International Conference on Computer Vision (ICCV\u201919) . 8818--8827. S. Cai, X. Zhang, H. Fan, H. Huang, J. Liu, J. Liu, J. Liu, J. Wang, and J. Sun. 2019. Disentangled image matting. In Proceedings of the International Conference on Computer Vision (ICCV\u201919). 8818--8827."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2699184"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3240508.3240610"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.18"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46475-6_39"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12822"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46475-6_13"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1080\/00401706.1997.10485132"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01627.x"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the Visualization, Imaging, and Image Processing (VIIP\u201905)","author":"Grady Leo","year":"2005","unstructured":"Leo Grady , Thomas Schiwietz , Shmuel Aharon , and R\u00fcdiger Westermann . 2005 . Random walks for interactive alpha-matting . In Proceedings of the Visualization, Imaging, and Image Processing (VIIP\u201905) . 423--429. Leo Grady, Thomas Schiwietz, Shmuel Aharon, and R\u00fcdiger Westermann. 2005. Random walks for interactive alpha-matting. In Proceedings of the Visualization, Imaging, and Image Processing (VIIP\u201905). 423--429."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2006.00976.x"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the International Conference on Computer Vision (ICCV\u201919)","author":"Hou Q.","unstructured":"Q. Hou and F. Liu . 2019. Context-aware image matting for simultaneous foreground and alpha estimation . In Proceedings of the International Conference on Computer Vision (ICCV\u201919) . 4129--4138. Q. Hou and F. Liu. 2019. Context-aware image matting for simultaneous foreground and alpha estimation. In Proceedings of the International Conference on Computer Vision (ICCV\u201919). 4129--4138."},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the International Conference on Computer Vision (ICCV\u201915)","author":"Karacan L.","unstructured":"L. Karacan , A. Erdem , and E. Erdem . 2015. Image matting with KL-divergence based sparse sampling . In Proceedings of the International Conference on Computer Vision (ICCV\u201915) . 424--432. L. Karacan, A. Erdem, and E. Erdem. 2015. Image matting with KL-divergence based sparse sampling. In Proceedings of the International Conference on Computer Vision (ICCV\u201915). 424--432."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995665"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1177"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.168"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2017.06.011"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the International Conference on Computer Vision (ICCV\u201919)","author":"Lu H.","unstructured":"H. Lu , Y. Dai , C. Shen , and S. Xu . 2019. Indices matter: Learning to index for deep image matting . In Proceedings of the International Conference on Computer Vision (ICCV\u201919) . 3265--3274. H. Lu, Y. Dai, C. Shen, and S. Xu. 2019. Indices matter: Learning to index for deep image matting. In Proceedings of the International Conference on Computer Vision (ICCV\u201919). 3265--3274."},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the British Machine Vision Conference (BMVC\u201918)","author":"Lutz Sebastian","year":"2018","unstructured":"Sebastian Lutz , Konstantinos Amplianitis , and Aljoscha Smolic . 2018 . AlphaGAN: Generative adversarial networks for natural image matting . In Proceedings of the British Machine Vision Conference (BMVC\u201918) . 259. Sebastian Lutz, Konstantinos Amplianitis, and Aljoscha Smolic. 2018. AlphaGAN: Generative adversarial networks for natural image matting. In Proceedings of the British Machine Vision Conference (BMVC\u201918). 259."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01369"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201911). 2049","author":"Rhemann C.","year":"2056","unstructured":"C. Rhemann and C. Rother . 2011. A global sampling method for alpha matting . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201911). 2049 -- 2056 . C. Rhemann and C. Rother. 2011. A global sampling method for alpha matting. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201911). 2049--2056."},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201909). 1826","author":"Rhemann C.","year":"1833","unstructured":"C. Rhemann , C. Rother , Jue Wang , M. Gelautz , P. Kohli , and P. Rott . 2009. A perceptually motivated online benchmark for image matting . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201909). 1826 -- 1833 . C. Rhemann, C. Rother, Jue Wang, M. Gelautz, P. Kohli, and P. Rott. 2009. A perceptually motivated online benchmark for image matting. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201909). 1826--1833."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015720"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.88"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2572683"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46448-0_6"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015721"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2015.2403241"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201919)","author":"Tang J.","unstructured":"J. Tang , Y. Aksoy , C. Oztireli , M. Gross , and T. O. Aydin . 2019. Learning-based sampling for natural image matting . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201919) . 3050--3058. J. Tang, Y. Aksoy, C. Oztireli, M. Gross, and T. O. Aydin. 2019. Learning-based sampling for natural image matting. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201919). 3050--3058."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the International Conference on Computer Vision (ICCV\u201905)","author":"Wang Jue","unstructured":"Jue Wang and Michael F. Cohen . 2005. An iterative optimization approach for unified image segmentation and matting . In Proceedings of the International Conference on Computer Vision (ICCV\u201905) . 936--943. Jue Wang and Michael F. Cohen. 2005. An iterative optimization approach for unified image segmentation and matting. In Proceedings of the International Conference on Computer Vision (ICCV\u201905). 936--943."},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201907)","author":"Wang Jue","unstructured":"Jue Wang and Michael F. Cohen . 2007. Optimized color sampling for robust matting . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201907) . 1--8. Jue Wang and Michael F. Cohen. 2007. Optimized color sampling for robust matting. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201907). 1--8."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2964284.2967232"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-018-1554-2"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.41"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/tmm.2018.2863602"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the International Conference on Neural Information Processing Systems (NeurIPS\u201918)","author":"Yang Xin","year":"2018","unstructured":"Xin Yang , Ke Xu , Shaozhe Chen , Shengfeng He , Baocai Yin Yin , and Rynson Lau . 2018 . Active matting . In Proceedings of the International Conference on Neural Information Processing Systems (NeurIPS\u201918) . 4590--4600. Xin Yang, Ke Xu, Shaozhe Chen, Shengfeng He, Baocai Yin Yin, and Rynson Lau. 2018. Active matting. In Proceedings of the International Conference on Neural Information Processing Systems (NeurIPS\u201918). 4590--4600."},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201901)","author":"Chuang Yung-Yu","unstructured":"Yung-Yu Chuang , B. Curless , D. H. Salesin , and R. Szeliski . 2001. A Bayesian approach to digital matting . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201901) . II--II. Yung-Yu Chuang, B. Curless, D. H. Salesin, and R. Szeliski. 2001. A Bayesian approach to digital matting. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201901). II--II."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICME46284.2020.9102868"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201919)","author":"Zhang Y.","unstructured":"Y. Zhang , L. Gong , L. Fan , P. Ren , Q. Huang , H. Bao , and W. Xu . 2019. A late fusion CNN for digital matting . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201919) . 7461--7470. Y. Zhang, L. Gong, L. Fan, P. Ren, Q. Huang, H. Bao, and W. Xu. 2019. A late fusion CNN for digital matting. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201919). 7461--7470."},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the International Conference on Computer Vision (ICCV\u201909)","author":"Zheng Yuanjie","year":"2009","unstructured":"Yuanjie Zheng and Chandra Kambhamettu . 2009 . Learning based digital matting . In Proceedings of the International Conference on Computer Vision (ICCV\u201909) . 889--896. Yuanjie Zheng and Chandra Kambhamettu. 2009. Learning based digital matting. In Proceedings of the International Conference on Computer Vision (ICCV\u201909). 889--896."},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV\u201914)","author":"Lawrence Zitnick C.","year":"2014","unstructured":"C. Lawrence Zitnick and Piotr Dollar . 2014 . Edge boxes: Locating object proposals from edges . In Proceedings of the European Conference on Computer Vision (ECCV\u201914) . 391--405. C. Lawrence Zitnick and Piotr Dollar. 2014. Edge boxes: Locating object proposals from edges. In Proceedings of the European Conference on Computer Vision (ECCV\u201914). 391--405."}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3408323","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3408323","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:39:02Z","timestamp":1750199942000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3408323"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,30]]},"references-count":45,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,11,30]]}},"alternative-id":["10.1145\/3408323"],"URL":"https:\/\/doi.org\/10.1145\/3408323","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,30]]},"assertion":[{"value":"2020-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-12-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}