{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,27]],"date-time":"2026-09-27T17:38:23Z","timestamp":1790530703782,"version":"4.1.0"},"reference-count":43,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2016,7,11]],"date-time":"2016-07-11T00:00:00Z","timestamp":1468195200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2016,7,11]]},"abstract":"<jats:p>Skies are common backgrounds in photos but are often less interesting due to the time of photographing. Professional photographers correct this by using sophisticated tools with painstaking efforts that are beyond the command of ordinary users. In this work, we propose an automatic background replacement algorithm that can generate realistic, artifact-free images with a diverse styles of skies. The key idea of our algorithm is to utilize visual semantics to guide the entire process including sky segmentation, search and replacement. First we train a deep convolutional neural network for semantic scene parsing, which is used as visual prior to segment sky regions in a coarse-to-fine manner. Second, in order to find proper skies for replacement, we propose a data-driven sky search scheme based on semantic layout of the input image. Finally, to re-compose the stylized sky with the original foreground naturally, an appearance transfer method is developed to match statistics locally and semantically. We show that the proposed algorithm can automatically generate a set of visually pleasing results. In addition, we demonstrate the effectiveness of the proposed algorithm with extensive user studies.<\/jats:p>","DOI":"10.1145\/2897824.2925942","type":"journal-article","created":{"date-parts":[[2016,7,11]],"date-time":"2016-07-11T16:04:33Z","timestamp":1468253073000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":56,"title":["Sky is not the limit"],"prefix":"10.1145","volume":"35","author":[{"given":"Yi-Hsuan","family":"Tsai","sequence":"first","affiliation":[{"name":"University of California, Merced"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaohui","family":"Shen","sequence":"additional","affiliation":[{"name":"Adobe Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhe","family":"Lin","sequence":"additional","affiliation":[{"name":"Adobe Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kalyan","family":"Sunkavalli","sequence":"additional","affiliation":[{"name":"Adobe Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ming-Hsuan","family":"Yang","sequence":"additional","affiliation":[{"name":"University of California, Merced"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,7,11]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360638"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2004.60"},{"key":"e_1_2_2_3_1","unstructured":"Chen L.-C. Papandreou G. Kokkinos I. Murphy K. and Yuille A. L. 2015. Semantic image segmentation with deep convolutional nets and fully connected crfs. In ICLR.  Chen L.-C. Papandreou G. Kokkinos I. Murphy K. and Yuille A. L. 2015. Semantic image segmentation with deep convolutional nets and fully connected crfs. In ICLR ."},{"key":"e_1_2_2_4_1","doi-asserted-by":"crossref","unstructured":"Dale K. Johnson M. K. Sunkavalli K. Matusik W. and Pfister H. 2009. Image restoration using online photo collections. In ICCV.  Dale K. Johnson M. K. Sunkavalli K. Matusik W. and Pfister H. 2009. Image restoration using online photo collections. In ICCV .","DOI":"10.1109\/ICCV.2009.5459473"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185578"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.438"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964965"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276382"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.213"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-006-0031-y"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.233"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03225.x"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.249"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601101"},{"key":"e_1_2_2_15_1","doi-asserted-by":"crossref","unstructured":"Lalonde J.-F. and Efros A. A. 2007. Using color compatibility for assessing image realism. In ICCV.  Lalonde J.-F. and Efros A. A. 2007. Using color compatibility for assessing image realism. In ICCV .","DOI":"10.1109\/ICCV.2007.4409107"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276381"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-009-0291-4"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-011-0501-8"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.68"},{"key":"e_1_2_2_20_1","doi-asserted-by":"crossref","unstructured":"Lee J.-Y. Sunkavalli K. Lin Z. Shen X. and Kweon I. S. 2016. Automatic content-aware color and tone stylization. In CVPR.  Lee J.-Y. Sunkavalli K. Lin Z. Shen X. and Kweon I. S. 2016. Automatic content-aware color and tone stylization. In CVPR .","DOI":"10.1109\/CVPR.2016.271"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.77"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2011.131"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12409"},{"key":"e_1_2_2_24_1","doi-asserted-by":"crossref","unstructured":"Long J. Shelhamer E. and Darrell T. 2015. Fully convolutional networks for semantic segmentation. In CVPR.  Long J. Shelhamer E. and Darrell T. 2015. Fully convolutional networks for semantic segmentation. In CVPR .","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882269"},{"key":"e_1_2_2_26_1","doi-asserted-by":"crossref","unstructured":"Piti\u00e9 F. and Kokaram A. 2007. The linear mongekantorovitch linear colour mapping for example-based colour transfer. In CVMP.  Piti\u00e9 F. and Kokaram A. 2007. The linear mongekantorovitch linear colour mapping for example-based colour transfer. In CVMP .","DOI":"10.1049\/cp:20070055"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.946629"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015720"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.88"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508419"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778862"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.215"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531374"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-012-0579-7"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-012-0574-z"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.113.4.766"},{"key":"e_1_2_2_37_1","volume-title":"-H","author":"Tsai Y.-H.","year":"2015","unstructured":"Tsai , Y.-H. , Hamsici , O. , and Yang , M . -H . 2015 . Adaptive region pooling for object detection. In CVPR. Tsai, Y.-H., Hamsici, O., and Yang, M.-H. 2015. Adaptive region pooling for object detection. In CVPR."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.10"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12008"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185580"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2790296"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.179"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.449"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897824.2925942","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2897824.2925942","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:55:04Z","timestamp":1750222504000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897824.2925942"}},"subtitle":["semantic-aware sky replacement"],"short-title":[],"issued":{"date-parts":[[2016,7,11]]},"references-count":43,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,7,11]]}},"alternative-id":["10.1145\/2897824.2925942"],"URL":"https:\/\/doi.org\/10.1145\/2897824.2925942","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,7,11]]},"assertion":[{"value":"2016-07-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}