{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T00:29:21Z","timestamp":1779928161912,"version":"3.53.1"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2016,7,11]],"date-time":"2016-07-11T00:00:00Z","timestamp":1468195200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["CAMERA (EP\/M023281\/1), OAK (EP\/K023578\/1, EP\/K02339X\/1)"],"award-info":[{"award-number":["CAMERA (EP\/M023281\/1), OAK (EP\/K023578\/1, EP\/K02339X\/1)"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["CR-PLAY (611089), DREAMSPACE (610005)"],"award-info":[{"award-number":["CR-PLAY (611089), DREAMSPACE (610005)"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2016,7,11]]},"abstract":"<jats:p>Rotoscoping (cutting out different characters\/objects\/layers in raw video footage) is a ubiquitous task in modern post-production and represents a significant investment in person-hours. In this work, we study the particular task of professional rotoscoping for high-end, live action movies and propose a new framework that works with roto-artists to accelerate the workflow and improve their productivity. Working with the existing keyframing paradigm, our first contribution is the development of a shape model that is updated as artists add successive keyframes. This model is used to improve the output of traditional interpolation and tracking techniques, reducing the number of keyframes that need to be specified by the artist. Our second contribution is to use the same shape model to provide a new interactive tool that allows an artist to reduce the time spent editing each keyframe. The more keyframes that are edited, the better the interactive tool becomes, accelerating the process and making the artist more efficient without compromising their control. Finally, we also provide a new, professionally rotoscoped dataset that enables truly representative, real-world evaluation of rotoscoping methods. We used this dataset to perform a number of experiments, including an expert study with professional roto-artists, to show, quantitatively, the advantages of our approach.<\/jats:p>","DOI":"10.1145\/2897824.2925973","type":"journal-article","created":{"date-parts":[[2016,7,11]],"date-time":"2016-07-11T16:04:33Z","timestamp":1468253073000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":26,"title":["Roto++"],"prefix":"10.1145","volume":"35","author":[{"given":"Wenbin","family":"Li","sequence":"first","affiliation":[{"name":"University College London"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fabio","family":"Viola","sequence":"additional","affiliation":[{"name":"The Foundry"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan","family":"Starck","sequence":"additional","affiliation":[{"name":"The Foundry"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gabriel J.","family":"Brostow","sequence":"additional","affiliation":[{"name":"University College London"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Neill D. F.","family":"Campbell","sequence":"additional","affiliation":[{"name":"University of Bath"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,7,11]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Agarwal S. Mierle K. and Others 2015. Ceres solver. http:\/\/ceres-solver.org.  Agarwal S. Mierle K. and Others 2015. Ceres solver. http:\/\/ceres-solver.org."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015764"},{"key":"e_1_2_2_3_1","volume-title":"IEEE Int. Conf. on Computer Vision (ICCV).","author":"Bai X.","unstructured":"Bai , X. , and Sapiro , G . 2007. A geodesic framework for fast interactive image and video segmentation and matting . In IEEE Int. Conf. on Computer Vision (ICCV). Bai, X., and Sapiro, G. 2007. A geodesic framework for fast interactive image and video segmentation and matting. In IEEE Int. Conf. on Computer Vision (ICCV)."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531376"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000011205.11775.fd"},{"key":"e_1_2_2_6_1","volume-title":"IEEE Workshop on Motion of Nonrigid and Articulated Objects, 194--199","author":"Baumberg A. M.","unstructured":"Baumberg , A. M. , and Hogg , D. C . 1994. An efficient method for contour tracking using active shape models . In IEEE Workshop on Motion of Nonrigid and Articulated Objects, 194--199 . Baumberg, A. M., and Hogg, D. C. 1994. An efficient method for contour tracking using active shape models. In IEEE Workshop on Motion of Nonrigid and Articulated Objects, 194--199."},{"key":"e_1_2_2_7_1","first-page":"943","article-title":"Real-time image-based tracking of planes using efficient second-order minimization","volume":"1","author":"Benhimane S.","year":"2004","unstructured":"Benhimane , S. , and Malis , E. 2004 . Real-time image-based tracking of planes using efficient second-order minimization . In IEEE\/RSJ Int. Conf. on Intelligent Robots and Systems (IROS) , vol. 1 , 943 -- 948 . Benhimane, S., and Malis, E. 2004. Real-time image-based tracking of planes using efficient second-order minimization. In IEEE\/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), vol. 1, 943--948.","journal-title":"IEEE\/RSJ Int. Conf. on Intelligent Robots and Systems (IROS)"},{"key":"e_1_2_2_8_1","volume-title":"Blender - a 3D modelling and rendering package","author":"Blender Online Community","unstructured":"Blender Online Community . 2015. Blender - a 3D modelling and rendering package . Blender Foundation . Blender Online Community. 2015. Blender - a 3D modelling and rendering package. Blender Foundation."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2001.937505"},{"key":"e_1_2_2_10_1","volume-title":"Rotoscoping: Techniques and Tools for the Aspiring Artist","author":"Bratt B.","year":"2011","unstructured":"Bratt , B. 2011 . Rotoscoping: Techniques and Tools for the Aspiring Artist . Taylor & Francis . Bratt, B. 2011. Rotoscoping: Techniques and Tools for the Aspiring Artist. Taylor & Francis."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601212"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566572"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1006\/cviu.1995.1004"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1857907.1857910"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.170"},{"key":"e_1_2_2_16_1","volume-title":"British Machine Vision Conference (BMVC).","author":"Erofeev M.","unstructured":"Erofeev , M. , Gitman , Y. , Vatolin , D. , Fedorov , A. , and Wang , J . 2015. Perceptually motivated benchmark for video matting . In British Machine Vision Conference (BMVC). Erofeev, M., Gitman, Y., Vatolin, D., Fedorov, A., and Wang, J. 2015. Perceptually motivated benchmark for video matting. In British Machine Vision Conference (BMVC)."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818105"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015755"},{"key":"e_1_2_2_19_1","volume-title":"IEEE Int. Conf. on Computer Vision and Pattern Recognition (CVPR).","author":"Grundmann M.","unstructured":"Grundmann , M. , Kwatra , V. , Han , M. , and Essa , I . 2010. Efficient hierarchical graph based video segmentation . IEEE Int. Conf. on Computer Vision and Pattern Recognition (CVPR). Grundmann, M., Kwatra, V., Han, M., and Essa, I. 2010. Efficient hierarchical graph based video segmentation. IEEE Int. Conf. on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882264"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/1046920.1194904"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2015.2497141"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1177"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073234"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661273"},{"key":"e_1_2_2_26_1","first-page":"674","article-title":"An iterative image registration technique with an application to stereo vision","volume":"2","author":"Lucas B. D.","year":"1981","unstructured":"Lucas , B. D. , and Kanade , T. 1981 . An iterative image registration technique with an application to stereo vision . In Int. Joint Conf. on AI , vol. 2 , 674 -- 679 . Lucas, B. D., and Kanade, T. 1981. An iterative image registration technique with an application to stereo vision. In Int. Joint Conf. on AI, vol. 2, 674--679.","journal-title":"Int. Joint Conf. on AI"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218442"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995687"},{"key":"e_1_2_2_29_1","doi-asserted-by":"crossref","unstructured":"Rasmussen C. E. and Williams C. 2006. Gaussian Processes for Machine Learning. MIT Press.   Rasmussen C. E. and Williams C. 2006. Gaussian Processes for Machine Learning . MIT Press.","DOI":"10.7551\/mitpress\/3206.001.0001"},{"key":"e_1_2_2_30_1","volume-title":"IEEE Int. Conf. on Computer Vision and Pattern Recognition (CVPR).","author":"Rhemann C.","unstructured":"Rhemann , C. , Rother , C. , Wang , J. , Gelautz , M. , Kohli , P. , and Rott , P . 2009. A perceptually motivated online benchmark for image matting . In IEEE Int. Conf. on Computer Vision and Pattern Recognition (CVPR). Rhemann, C., Rother, C., Wang, J., Gelautz, M., Kohli, P., and Rott, P. 2009. A perceptually motivated online benchmark for image matting. In IEEE Int. Conf. on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015720"},{"key":"e_1_2_2_32_1","volume-title":"IEEE Int. Conf. on Multimedia and Expo (ICME), 1334--1337","author":"Rzeszutek R.","unstructured":"Rzeszutek , R. , El-Maraghi , T. , and Androutsos , D . 2009. Interactive rotoscoping through scale-space random walks . In IEEE Int. Conf. on Multimedia and Expo (ICME), 1334--1337 . Rzeszutek, R., El-Maraghi, T., and Androutsos, D. 2009. Interactive rotoscoping through scale-space random walks. In IEEE Int. Conf. on Multimedia and Expo (ICME), 1334--1337."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2466148"},{"key":"e_1_2_2_34_1","unstructured":"SilhouetteFX. Silhouette 5.2 User Guide 2014.  SilhouetteFX. Silhouette 5.2 User Guide 2014 ."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237263"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601202"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12024"},{"key":"e_1_2_2_38_1","volume-title":"Proc. of 13th Int. Workshop on AI and Stats.","author":"Titsias M.","unstructured":"Titsias , M. , and Lawrence , N . 2010. Bayesian gaussian process latent variable model . In Proc. of 13th Int. Workshop on AI and Stats. Titsias, M., and Lawrence, N. 2010. Bayesian gaussian process latent variable model. In Proc. of 13th Int. Workshop on AI and Stats."},{"key":"e_1_2_2_39_1","volume-title":"IEEE Int. Conf. on Computer Vision and Pattern Recognition (CVPR).","author":"Torresani L.","unstructured":"Torresani , L. , Yang , D. B. , Alexander , E. J. , and Bregler , C . 2001. Tracking and modeling non-rigid objects with rank constraints . In IEEE Int. Conf. on Computer Vision and Pattern Recognition (CVPR). Torresani, L., Yang, D. B., Alexander, E. J., and Bregler, C. 2001. Tracking and modeling non-rigid objects with rank constraints. In IEEE Int. Conf. on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.70752"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-011-0512-5"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12665"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1561\/0600000019"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2011.2177078"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073233"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276389"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897824.2925973","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2897824.2925973","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:55:05Z","timestamp":1750222505000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897824.2925973"}},"subtitle":["accelerating professional rotoscoping using shape manifolds"],"short-title":[],"issued":{"date-parts":[[2016,7,11]]},"references-count":46,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,7,11]]}},"alternative-id":["10.1145\/2897824.2925973"],"URL":"https:\/\/doi.org\/10.1145\/2897824.2925973","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,7,11]]},"assertion":[{"value":"2016-07-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}