{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:27:50Z","timestamp":1740122870882,"version":"3.37.3"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"29","license":[{"start":{"date-parts":[[2024,4,10]],"date-time":"2024-04-10T00:00:00Z","timestamp":1712707200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,10]],"date-time":"2024-04-10T00:00:00Z","timestamp":1712707200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2025234"],"award-info":[{"award-number":["2025234"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Removing photobombing elements from images is a challenging task that requires sophisticated image inpainting techniques. Despite the availability of various methods, their effectiveness depends on the complexity of the image and the nature of the distracting element. To address this issue, we conducted a benchmark study to evaluate 10 state-of-the-art photobombing removal methods on a dataset of over 300 images. Our study focused on identifying the most effective image inpainting techniques for removing unwanted regions from images. We annotated the photobombed regions that require removal and evaluated the performance of each method using peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), and Fr\u00e9chet inception distance (FID). The results show that image inpainting techniques can effectively remove photobombing elements, but more robust and accurate methods are needed to handle various image complexities. Our benchmarking study provides a valuable resource for researchers and practitioners to select the most suitable method for their specific photobombing removal task.<\/jats:p>","DOI":"10.1007\/s11042-024-19102-1","type":"journal-article","created":{"date-parts":[[2024,4,10]],"date-time":"2024-04-10T03:29:12Z","timestamp":1712719752000},"page":"73553-73568","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Image de-photobombing benchmark"],"prefix":"10.1007","volume":"83","author":[{"given":"Vatsa S.","family":"Patel","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kunal","family":"Agrawal","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Samah S.","family":"Baraheem","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amira","family":"Yousif","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0236-7992","authenticated-orcid":false,"given":"Tam V.","family":"Nguyen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,4,10]]},"reference":[{"key":"19102_CR1","unstructured":"Edwards P (2015) This 1853 image might show the first photobomb, Vox. [Online]. Available: https:\/\/www.vox.com\/2015\/9\/25\/93977-33\/first-photobomb. Accessed 12 Mar 2023]"},{"key":"19102_CR2","unstructured":"Keeling M (2022) Frechet Inception Distance,\" MATLAB Central File Exchange. [Online]. Available: https:\/\/www.mathworks.com\/matlabcentral\/file-exchange\/79071-frechet-inception-distance. Accessed 12 Mar 2023"},{"issue":"4","key":"19102_CR3","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1109\/TIP.2003.819861","volume":"13","author":"W Zhou","year":"2004","unstructured":"Zhou W, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600\u2013612","journal-title":"IEEE Trans Image Process"},{"key":"19102_CR4","doi-asserted-by":"crossref","unstructured":"Hore A, Ziou D (2010) Image quality metrics: PSNR vs. SSIM. In: 2010 20th international conference on pattern recognition. IEEE, pp 2366\u20132369","DOI":"10.1109\/ICPR.2010.579"},{"issue":"5","key":"19102_CR5","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1109\/TIP.2009.2012908","volume":"18","author":"FA Fardo","year":"2009","unstructured":"Fardo FA, Conforto VH, de Oliveira FC, Rodrigues PS (2009) A formal evaluation of psnr as quality measurement parameter for image segmentation algorithms. IEEE Trans Image Process 18(5):969\u2013976","journal-title":"IEEE Trans Image Process"},{"issue":"9","key":"19102_CR6","doi-asserted-by":"publisher","first-page":"1200","DOI":"10.1109\/TIP.2004.833105","volume":"13","author":"A Criminisi","year":"2004","unstructured":"Criminisi A, Perez P, Toyama K (2004) Region filling and object removal by exemplar-based image inpainting. IEEE Trans Image Process 13(9):1200\u20131212","journal-title":"IEEE Trans Image Process"},{"issue":"10","key":"19102_CR7","doi-asserted-by":"publisher","first-page":"3779","DOI":"10.1109\/TIP.2013.2261308","volume":"22","author":"O Le Meur","year":"2013","unstructured":"Le Meur O, Ebdelli M, Guillemot C (2013) Hierarchical super-resolution-based-inpainting. IEEE Trans Image Process 22(10):3779\u20133790","journal-title":"IEEE Trans Image Process"},{"key":"19102_CR8","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1007\/s10851-007-0017-6","volume":"28","author":"F Bornemann","year":"2007","unstructured":"Bornemann F, M\u00e4rz T (2007) Fast image inpainting based on coherence transport. J Math Imaging Vis 28:259\u2013278","journal-title":"J Math Imaging Vis"},{"issue":"1","key":"19102_CR9","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1080\/10867651.2004.10487596","volume":"9","author":"A Telea","year":"2004","unstructured":"Telea A (2004) An image inpainting technique based on the fast marching method. J Graph Tools 9(1):23\u201334","journal-title":"J Graph Tools"},{"key":"19102_CR10","doi-asserted-by":"crossref","unstructured":"Bertalmio M, Bertozzi AL, Sapiro G (2001) Navier-stokes, fluid dynamics, and image and video inpainting. In: Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition.\u00a0IEEE. CVPR 2001, vol 1, pp I\u2013I","DOI":"10.1109\/CVPR.2001.990497"},{"key":"19102_CR11","unstructured":"TFill: https:\/\/github.com\/lyndonzheng\/TFill. Accessed 19 Jan 2023"},{"key":"19102_CR12","unstructured":"CR-Fill: https:\/\/github.com\/zengxianyu\/crfill. Accessed 19 Jan 2023"},{"key":"19102_CR13","unstructured":"DeepFillv2: https:\/\/github.com\/csqiangwen\/DeepFillv2_Pytorch. Accessed 19 Jan 2023"},{"key":"19102_CR14","unstructured":"Fridman J. Facebook Page, https:\/\/www.facebook.com\/jamesfridmanpage\/photos. Last retrieved on March 1 2023"},{"key":"19102_CR15","unstructured":"Getty Images, Photobombing Images, https:\/\/www.gettyimages.com\/photos\/photobombing. Last retrieved on March 1 2023"},{"key":"19102_CR16","unstructured":"Borepanda, Photobomb Images, https:\/\/www.boredpanda.com\/?s=photobomb&utm_source=google&utm_medium=organic&utm_campaign=organic. Last retrieved on March 1, 2023"},{"key":"19102_CR17","unstructured":"Adobe stock, photobomb, https:\/\/stock.adobe.com\/search?k=photobomb. Last retrieved on March 1, 2023"},{"key":"19102_CR18","unstructured":"Shutterstock, photobombing, https:\/\/www.shutterstock.com\/search\/photob-ombing. Last retrieved on March 1, 2023"},{"key":"19102_CR19","unstructured":"Pinterest, photobomb https:\/\/www.pinterest.com\/agasca11\/photobomb\/. Last retrieved on March 1, 2023"},{"key":"19102_CR20","unstructured":"Region of Interest (ROI) Creation Overview. MATLAB documentation. [Online]. Available: https:\/\/www.mathworks.com\/help\/images\/roi-creation-overview.html. Accessed 1 Mar 2023"},{"key":"19102_CR21","unstructured":"MathWorks. inpaintExemplar function. MATLAB Documentation, https:\/\/www.mathworks.com\/help\/images\/ref\/inpaintexemplar.html. Last retrieved on Mar 1, 2023"},{"key":"19102_CR22","unstructured":"Elad M (2019) Inpaint coherent, Version 1.1.1\", MathWorks, Natick, MA. [Online]. Available: https:\/\/www.mathworks.com\/help\/images\/ref\/inpain-tcoherent.html. Accessed 1 Mar 2023"},{"key":"19102_CR23","unstructured":"OpenCV. Image inpainting, OpenCV documentation, [Online]. Available: https:\/\/docs.opencv.org\/3.4\/df\/d3d\/tutorial_py_inpainting.html. Accessed 1 March 2023"},{"key":"19102_CR24","unstructured":"RN: https:\/\/github.com\/geekyutao\/RN. Accessed 19 Jan 2023"},{"issue":"6","key":"19102_CR25","doi-asserted-by":"publisher","first-page":"1452","DOI":"10.1109\/TPAMI.2017.2723009","volume":"40","author":"B Zhou","year":"2018","unstructured":"Zhou B, Lapedriza A, Khosla A, Oliva A, Torralba A (2018) Places: A 10 million image database for scene recognition. IEEE Trans Pattern Anal Mach Intell 40(6):1452\u20131464","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"19102_CR26","unstructured":"HiFill: https:\/\/github.com\/Atlas200dk\/sample-imageinpainting-HiFill. Accessed 19 Jan 2023"},{"key":"19102_CR27","unstructured":"Peak signal-to-noise ratio (PSNR). MathWorks, [Online]. Available: https:\/\/www.mathworks.com\/help\/images\/ref\/psnr.html. Accessed 1 Mar 2023"},{"key":"19102_CR28","unstructured":"Structural similarity (SSIM) index function, MathWorks, [Online]. Available: https:\/\/www.mathworks.com\/help\/images\/ref\/ssim.html.Accessed. Accessed 1 Mar 2023"},{"key":"19102_CR29","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1007\/s11760-013-0457-y","volume":"9","author":"M Seyedsaeid","year":"2015","unstructured":"Seyedsaeid M, Nagabhushan P (2015) Object removal by depth-wise image inpainting. SIViP 9:427\u2013436","journal-title":"SIViP"},{"issue":"5","key":"19102_CR30","doi-asserted-by":"publisher","first-page":"717","DOI":"10.1109\/TETCI.2018.2865215","volume":"4","author":"N Shan","year":"2020","unstructured":"Shan N, Tan DS, Denekew MS, Chen Y-Y, Cheng W-H, Hua K-L (2020) Photobomb defusal expert: automatically remove distracting people from photos. IEEE Trans Emerg Top Comput Intell 4(5):717\u2013727","journal-title":"IEEE Trans Emerg Top Comput Intell"},{"key":"19102_CR31","doi-asserted-by":"publisher","first-page":"32406","DOI":"10.1109\/ACCESS.2022.3160174","volume":"10","author":"A Hassanpour","year":"2022","unstructured":"Hassanpour A et al (2022) E2F-GAN: Eyes-to-face inpainting via edge-aware coarse-to-fine GANs. IEEE Access 10:32406\u201332417","journal-title":"IEEE Access"},{"key":"19102_CR32","doi-asserted-by":"crossref","unstructured":"Zheng C, Cham T-J, Cai J, Phung D (2021) Bridging global context interactions for high-fidelity image completion. arXiv [cs.CV], pp 11512\u201311522","DOI":"10.1109\/CVPR52688.2022.01122"},{"key":"19102_CR33","doi-asserted-by":"crossref","unstructured":"Zeng YY, Lin Z, Lu H, Patel VM (2021) CR-fill: Generative image inpainting with auxiliary contexutal reconstruction.\u00a0In: Proceedings of the IEEE\/CVF international conference on computer vision, pp 14164\u201314173","DOI":"10.1109\/ICCV48922.2021.01390"},{"key":"19102_CR34","doi-asserted-by":"crossref","unstructured":"Yu J, Lin Z, Yang J, Shen X, Lu X, Huang T (2019) Free-form image inpainting with gated convolution.\u00a0In: Proceedings of the IEEE\/CVF international conference on computer vision, pp 4471\u20134480","DOI":"10.1109\/ICCV.2019.00457"},{"key":"19102_CR35","doi-asserted-by":"crossref","unstructured":"Yu T, Guo Z, Jin X, Wu S, Chen Z, Li W, Zhang Z, Liu S (2020) Region normalization forimage inpainting. In: Proceedings of the AAAI conference on artificial intelligence, vol 34, no 7, pp 12733\u201312740","DOI":"10.1609\/aaai.v34i07.6967"},{"key":"19102_CR36","doi-asserted-by":"crossref","unstructured":"Yi Z, Tang Q, Azizi S, Jang D, Xu Z (2020) Contextual residual aggregation for ultra high-resolution image inpainting. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 7508\u20137517","DOI":"10.1109\/CVPR42600.2020.00753"},{"key":"19102_CR37","doi-asserted-by":"crossref","unstructured":"Prakya SPK, Sainath MMV, Patel VS, Baraheem SS, Nguyen TV (2022) Photobombing removal benchmarking.\u00a0In: International Symposium on Visual Computing. Springer Nature, Cham, pp 55\u201366","DOI":"10.1007\/978-3-031-20716-7_5"},{"key":"19102_CR38","unstructured":"Flickr, \u201cPhotobomb,\u201d https:\/\/www.flickr.com\/search\/?text=photobomb. Accessed on 12 Mar 2023"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-024-19102-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-024-19102-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-024-19102-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,2]],"date-time":"2024-09-02T13:30:27Z","timestamp":1725283827000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-024-19102-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,10]]},"references-count":38,"journal-issue":{"issue":"29","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["19102"],"URL":"https:\/\/doi.org\/10.1007\/s11042-024-19102-1","relation":{},"ISSN":["1573-7721"],"issn-type":[{"type":"electronic","value":"1573-7721"}],"subject":[],"published":{"date-parts":[[2024,4,10]]},"assertion":[{"value":"11 May 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 February 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 March 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 April 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}