{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T16:51:25Z","timestamp":1777654285969,"version":"3.51.4"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2018,7,30]],"date-time":"2018-07-30T00:00:00Z","timestamp":1532908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2018,8,31]]},"abstract":"<jats:p>\n            Correspondence between images is a fundamental problem in computer vision, with a variety of graphics applications. This paper presents a novel method for\n            <jats:italic>sparse cross-domain correspondence.<\/jats:italic>\n            Our method is designed for pairs of images where the main objects of interest may belong to different semantic categories and differ drastically in shape and appearance, yet still contain semantically related or geometrically similar parts. Our approach operates on hierarchies of deep features, extracted from the input images by a pre-trained CNN. Specifically, starting from the coarsest layer in both hierarchies, we search for Neural Best Buddies (NBB): pairs of neurons that are mutual nearest neighbors. The key idea is then to percolate NBBs through the hierarchy, while narrowing down the search regions at each level and retaining only NBBs with significant activations. Furthermore, in order to overcome differences in appearance, each pair of search regions is transformed into a common appearance.\n          <\/jats:p>\n          <jats:p>We evaluate our method via a user study, in addition to comparisons with alternative correspondence approaches. The usefulness of our method is demonstrated using a variety of graphics applications, including cross-domain image alignment, creation of hybrid images, automatic image morphing, and more.<\/jats:p>","DOI":"10.1145\/3197517.3201332","type":"journal-article","created":{"date-parts":[[2018,7,31]],"date-time":"2018-07-31T15:56:23Z","timestamp":1533052583000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":72,"title":["Neural best-buddies"],"prefix":"10.1145","volume":"37","author":[{"given":"Kfir","family":"Aberman","sequence":"first","affiliation":[{"name":"Tel-Aviv University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jing","family":"Liao","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mingyi","family":"Shi","sequence":"additional","affiliation":[{"name":"Shandong University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dani","family":"Lischinski","sequence":"additional","affiliation":[{"name":"Hebrew University of Jerusalem"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Baoquan","family":"Chen","sequence":"additional","affiliation":[{"name":"Shandong University and Peking University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"Cohen-Or","sequence":"additional","affiliation":[{"name":"Tel-Aviv University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,7,30]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531330"},{"key":"e_1_2_2_2_1","volume-title":"Proc","author":"Barnes Connelly","unstructured":"Connelly Barnes , Eli Shechtman , Dan B Goldman , and Adam Finkelstein . 2010. The generalized patchmatch correspondence algorithm . In Proc . ECCV. Springer , 29--43. Connelly Barnes, Eli Shechtman, Dan B Goldman, and Adam Finkelstein. 2010. The generalized patchmatch correspondence algorithm. In Proc. ECCV. Springer, 29--43."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/11744023_32"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.23"},{"key":"e_1_2_2_5_1","volume-title":"Nonlinear Spectral Image Fusion. In International Conference on Scale Space and Variational Methods in Computer Vision. Springer, 41--53","author":"Benning Martin","year":"2017","unstructured":"Martin Benning , Michael M\u00f6ller , Raz Z Nossek , Martin Burger , Daniel Cremers , Guy Gilboa , and Carola-Bibiane Sch\u00f6nlieb . 2017 . Nonlinear Spectral Image Fusion. In International Conference on Scale Space and Variational Methods in Computer Vision. Springer, 41--53 . Martin Benning, Michael M\u00f6ller, Raz Z Nossek, Martin Burger, Daniel Cremers, Guy Gilboa, and Carola-Bibiane Sch\u00f6nlieb. 2017. Nonlinear Spectral Image Fusion. In International Conference on Scale Space and Variational Methods in Computer Vision. Springer, 41--53."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/524467.796029"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360638"},{"key":"e_1_2_2_8_1","unstructured":"Christopher B Choy JunYoung Gwak Silvio Savarese and Manmohan Chandraker. 2016. Universal correspondence network. In Advances in Neural Information Processing Systems. 2414--2422.   Christopher B Choy JunYoung Gwak Silvio Savarese and Manmohan Chandraker. 2016. Universal correspondence network. In Advances in Neural Information Processing Systems. 2414--2422."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298813"},{"key":"e_1_2_2_10_1","volume-title":"Descriptor matching with convolutional neural networks: a comparison to sift. arXiv preprint arXiv:1405.5769","author":"Fischer Philipp","year":"2014","unstructured":"Philipp Fischer , Alexey Dosovitskiy , and Thomas Brox . 2014. Descriptor matching with convolutional neural networks: a comparison to sift. arXiv preprint arXiv:1405.5769 ( 2014 ). Philipp Fischer, Alexey Dosovitskiy, and Thomas Brox. 2014. Descriptor matching with convolutional neural networks: a comparison to sift. arXiv preprint arXiv:1405.5769 (2014)."},{"key":"e_1_2_2_11_1","volume-title":"A neural algorithm of artistic style. arXiv preprint arXiv:1508.06576","author":"Gatys Leon A","year":"2015","unstructured":"Leon A Gatys , Alexander S Ecker , and Matthias Bethge . 2015. A neural algorithm of artistic style. arXiv preprint arXiv:1508.06576 ( 2015 ). Leon A Gatys, Alexander S Ecker, and Matthias Bethge. 2015. A neural algorithm of artistic style. arXiv preprint arXiv:1508.06576 (2015)."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.458"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964965"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.378"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.5244\/C.2.23"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508373"},{"key":"e_1_2_2_17_1","volume-title":"Arbitrary style transfer in real-time with adaptive instance normalization. arXiv preprint arXiv:1703.06868","author":"Huang Xun","year":"2017","unstructured":"Xun Huang and Serge Belongie . 2017. Arbitrary style transfer in real-time with adaptive instance normalization. arXiv preprint arXiv:1703.06868 ( 2017 ). Xun Huang and Serge Belongie. 2017. Arbitrary style transfer in real-time with adaptive instance normalization. arXiv preprint arXiv:1703.06868 (2017)."},{"key":"e_1_2_2_18_1","volume-title":"Proc","author":"Johnson Justin","unstructured":"Justin Johnson , Alexandre Alahi , and Li Fei-Fei . 2016. Perceptual losses for real-time style transfer and super-resolution . In Proc . ECCV. Springer , 694--711. Justin Johnson, Alexandre Alahi, and Li Fei-Fei. 2016. Perceptual losses for real-time style transfer and super-resolution. In Proc. ECCV. Springer, 694--711."},{"key":"e_1_2_2_19_1","volume-title":"FCSS: Fully convolutional self-similarity for dense semantic correspondence. arXiv preprint arXiv:1702.00926","author":"Kim Seungryong","year":"2017","unstructured":"Seungryong Kim , Dongbo Min , Bumsub Ham , Sangryul Jeon , Stephen Lin , and Kwanghoon Sohn . 2017 . FCSS: Fully convolutional self-similarity for dense semantic correspondence. arXiv preprint arXiv:1702.00926 (2017). Seungryong Kim, Dongbo Min, Bumsub Ham, Sangryul Jeon, Stephen Lin, and Kwanghoon Sohn. 2017. FCSS: Fully convolutional self-similarity for dense semantic correspondence. arXiv preprint arXiv:1702.00926 (2017)."},{"key":"e_1_2_2_20_1","volume-title":"Fast face-swap using convolutional neural networks. arXiv preprint arXiv:1611.09577","author":"Korshunova Iryna","year":"2016","unstructured":"Iryna Korshunova , Wenzhe Shi , Joni Dambre , and Lucas Theis . 2016. Fast face-swap using convolutional neural networks. arXiv preprint arXiv:1611.09577 ( 2016 ). Iryna Korshunova, Wenzhe Shi, Joni Dambre, and Lucas Theis. 2016. Fast face-swap using convolutional neural networks. arXiv preprint arXiv:1611.09577 (2016)."},{"key":"e_1_2_2_21_1","volume-title":"Deep Alignment Network: A convolutional neural network for robust face alignment. arXiv preprint arXiv:1706.01789","author":"Kowalski Marek","year":"2017","unstructured":"Marek Kowalski , Jacek Naruniec , and Tomasz Trzcinski . 2017. Deep Alignment Network: A convolutional neural network for robust face alignment. arXiv preprint arXiv:1706.01789 ( 2017 ). Marek Kowalski, Jacek Naruniec, and Tomasz Trzcinski. 2017. Deep Alignment Network: A convolutional neural network for robust face alignment. arXiv preprint arXiv:1706.01789 (2017)."},{"key":"e_1_2_2_22_1","unstructured":"Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105.   Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105."},{"key":"e_1_2_2_23_1","volume-title":"International Conference of Young Computer Scientists, Engineers and Educators. Springer, 276--283","author":"Jiang Bo","year":"2015","unstructured":"Ting-ting Li, Bo Jiang , Zheng-zheng Tu, Bin Luo , and Jin Tang . 2015 . Image matching using mutual k-nearest neighbor graph . In International Conference of Young Computer Scientists, Engineers and Educators. Springer, 276--283 . Ting-ting Li, Bo Jiang, Zheng-zheng Tu, Bin Luo, and Jin Tang. 2015. Image matching using mutual k-nearest neighbor graph. In International Conference of Young Computer Scientists, Engineers and Educators. Springer, 276--283."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2629494"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073683"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10851-014-0541-0"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.147"},{"key":"e_1_2_2_28_1","unstructured":"Jonathan L Long Ning Zhang and Trevor Darrell. 2014. Do convnets learn correspondence?. In Advances in Neural Information Processing Systems. 1601--1609.   Jonathan L Long Ning Zhang and Trevor Darrell. 2014. Do convnets learn correspondence?. In Advances in Neural Information Processing Systems. 1601--1609."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299155"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141919"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882269"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-015-0816-y"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141920"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5540159"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.22"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2301163"},{"key":"e_1_2_2_38_1","volume-title":"Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan and Andrew Zisserman . 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 ( 2014 ). Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.144"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.77"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.628"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2003.819861"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.175"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/s003710050148"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2014.6836101"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.435"},{"key":"e_1_2_2_47_1","volume-title":"Thomas J. Fuchs, and Hod Lipson.","author":"Yosinski Jason","year":"2015","unstructured":"Jason Yosinski , Jeff Clune , Anh Mai Nguyen , Thomas J. Fuchs, and Hod Lipson. 2015 . Understanding Neural Networks Through Deep Visualization. CoRR abs\/1506.06579 (2015). arXiv: 1506.06579 http:\/\/arxiv.org\/abs\/1506.06579 Jason Yosinski, Jeff Clune, Anh Mai Nguyen, Thomas J. Fuchs, and Hod Lipson. 2015. Understanding Neural Networks Through Deep Visualization. CoRR abs\/1506.06579 (2015). arXiv: 1506.06579 http:\/\/arxiv.org\/abs\/1506.06579"},{"key":"e_1_2_2_48_1","volume-title":"Zeiler and Rob Fergus","author":"Matthew","year":"2013","unstructured":"Matthew D. Zeiler and Rob Fergus . 2013 . Visualizing and Understanding Convolutional Networks. CoRR abs\/1311.2901 (2013). arXiv:1311.2901 http:\/\/arxiv.org\/abs\/1311.2901 Matthew D. Zeiler and Rob Fergus. 2013. Visualizing and Understanding Convolutional Networks. CoRR abs\/1311.2901 (2013). arXiv:1311.2901 http:\/\/arxiv.org\/abs\/1311.2901"},{"key":"e_1_2_2_49_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1191--1200","author":"Zhou Tinghui","year":"2015","unstructured":"Tinghui Zhou , Yong Jae Lee , Stella X Yu , and Alyosha A Efros . 2015 . Flowweb: Joint image set alignment by weaving consistent, pixel-wise correspondences . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1191--1200 . Tinghui Zhou, Yong Jae Lee, Stella X Yu, and Alyosha A Efros. 2015. Flowweb: Joint image set alignment by weaving consistent, pixel-wise correspondences. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1191--1200."},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.20"},{"key":"e_1_2_2_51_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4998--5006","author":"Zhu Shizhan","year":"2015","unstructured":"Shizhan Zhu , Cheng Li , Chen Change Loy , and Xiaoou Tang . 2015 . Face alignment by coarse-to-fine shape searching . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4998--5006 . Shizhan Zhu, Cheng Li, Chen Change Loy, and Xiaoou Tang. 2015. Face alignment by coarse-to-fine shape searching. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4998--5006."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3197517.3201332","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3197517.3201332","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:39:44Z","timestamp":1750210784000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3197517.3201332"}},"subtitle":["sparse cross-domain correspondence"],"short-title":[],"issued":{"date-parts":[[2018,7,30]]},"references-count":51,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2018,8,31]]}},"alternative-id":["10.1145\/3197517.3201332"],"URL":"https:\/\/doi.org\/10.1145\/3197517.3201332","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,30]]},"assertion":[{"value":"2018-07-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}