{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T02:16:09Z","timestamp":1769912169050,"version":"3.49.0"},"reference-count":72,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2023,4,8]],"date-time":"2023-04-08T00:00:00Z","timestamp":1680912000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,4,8]],"date-time":"2023-04-08T00:00:00Z","timestamp":1680912000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010663","name":"H2020 European Research Council","doi-asserted-by":"publisher","award":["741215"],"award-info":[{"award-number":["741215"]}],"id":[{"id":"10.13039\/100010663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005690","name":"Universit\u00e4t des Saarlandes","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005690","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Pattern Anal Applic"],"published-print":{"date-parts":[[2023,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Diffusion-based inpainting can reconstruct missing image areas with high quality from sparse data, provided that their location and their values are well optimised. This is particularly useful for applications such as image compression, where the original image is known. Selecting the known data constitutes a challenging optimisation problem, that has so far been only investigated with model-based approaches. So far, these methods require a choice between either high quality or high speed since qualitatively convincing algorithms rely on many time-consuming inpaintings. We propose the first neural network architecture that allows fast optimisation of pixel positions and pixel values for homogeneous diffusion inpainting. During training, we combine two optimisation networks with a neural network-based surrogate solver for diffusion inpainting. This novel concept allows us to perform backpropagation based on inpainting results that approximate the solution of the inpainting equation. Without the need for a single inpainting during test time, our deep optimisation accelerates data selection by more than four orders of magnitude compared to common model-based approaches. This provides real-time performance with high quality results.<\/jats:p>","DOI":"10.1007\/s10044-023-01162-y","type":"journal-article","created":{"date-parts":[[2023,4,8]],"date-time":"2023-04-08T08:02:43Z","timestamp":1680940963000},"page":"1585-1600","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Deep spatial and tonal data optimisation for homogeneous diffusion inpainting"],"prefix":"10.1007","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9279-6944","authenticated-orcid":false,"given":"Pascal","family":"Peter","sequence":"first","affiliation":[]},{"given":"Karl","family":"Schrader","sequence":"additional","affiliation":[]},{"given":"Tobias","family":"Alt","sequence":"additional","affiliation":[]},{"given":"Joachim","family":"Weickert","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,4,8]]},"reference":[{"key":"1162_CR1","unstructured":"Masnou S, Morel J-M (1998) Level lines based disocclusion. In: Proceedings of the 1998 IEEE international conference on image processing. Chicago, IL, vol 3, pp 259\u2013263"},{"key":"1162_CR2","doi-asserted-by":"crossref","unstructured":"Efros AA, Leung T (1999) Texture synthesis by non-parametric sampling. In: Proceedings of the seventh international conference on computer vision. Kerkyra, Greece, vol 2, pp 1033\u20131038","DOI":"10.1109\/ICCV.1999.790383"},{"key":"1162_CR3","doi-asserted-by":"crossref","unstructured":"Bertalm\u00edo M, Sapiro G, Caselles V, Ballester C (2000) Image inpainting. In: Proceedings of the SIGGRAPH 2000, New Orleans, LI, pp 417\u2013424","DOI":"10.1145\/344779.344972"},{"issue":"1","key":"1162_CR4","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1109\/MSP.2013.2273004","volume":"31","author":"C Guillemot","year":"2014","unstructured":"Guillemot C, Le Meur O (2014) Image inpainting: overview and recent advances. IEEE Signal Process Mag 31(1):127\u2013144","journal-title":"IEEE Signal Process Mag"},{"key":"1162_CR5","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/0165-1684(88)90028-X","volume":"15","author":"S Carlsson","year":"1988","unstructured":"Carlsson S (1988) Sketch based coding of grey level images. Signal Process 15:57\u201383","journal-title":"Signal Process"},{"key":"1162_CR6","unstructured":"Acar T, G\u00f6kmen M (1994) Image coding using weak membrane model of images. In: Katsaggelos AK (ed) Visual communications and image processing\u201994, vol 2308. Proceedings of SPIE. SPIE Press, Bellingham, pp 1221\u20131230"},{"key":"1162_CR7","unstructured":"Desai UY, Mizuki MM, Masaki I, Horn BKP (1996) Edge and mean based image compression. Technical Report 1584 (A.I. Memo), Artificial Intelligence Lab., Massachusetts Institute of Technology, Cambridge, MA, Nov 1996"},{"issue":"2\u20133","key":"1162_CR8","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1007\/s10851-008-0087-0","volume":"31","author":"I Gali\u0107","year":"2008","unstructured":"Gali\u0107 I, Weickert J, Welk M, Bruhn A, Belyaev A, Seidel H-P (2008) Image compression with anisotropic diffusion. J Math Imaging Vis 31(2\u20133):255\u2013269","journal-title":"J Math Imaging Vis"},{"key":"1162_CR9","doi-asserted-by":"crossref","unstructured":"Wu Y, Zhang H, Sun Y, Guo H (2009) Two image compression schemes based on image inpainting. In: Proceedings of the 2009 international joint conference on computational sciences and optimization, Sanya, China, pp 816\u2013820","DOI":"10.1109\/CSO.2009.470"},{"issue":"2","key":"1162_CR10","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1631\/jzus.C0910182","volume":"11","author":"V Bastani","year":"2010","unstructured":"Bastani V, Helfroush M, Kasiri K (2010) Image compression based on spatial redundancy removal and image inpainting. J Zhejiang Univ Sci C (Comput Electron) 11(2):92\u2013100","journal-title":"J Zhejiang Univ Sci C (Comput Electron)"},{"key":"1162_CR11","doi-asserted-by":"crossref","unstructured":"Zhao C, Du M (2011) Image compression based on PDEs. In: Proceedings of the\u00a02011 international conference of computer science and network technology, Harbin, China, pp 1768\u20131771","DOI":"10.1109\/ICCSNT.2011.6182311"},{"key":"1162_CR12","doi-asserted-by":"crossref","unstructured":"Gautier J, Le Meur O, Guillemot C (2012) Efficient depth map compression based on lossless edge coding and diffusion. In: Proceedings of the \u00a02012 picture coding symposium, Krak\u00f3w, Poland, pp 81\u201384","DOI":"10.1109\/PCS.2012.6213291"},{"key":"1162_CR13","unstructured":"Li Y, Sj\u00f6str\u00f6m M, Jennehag U, Olsson R (2012) A scalable coding approach for high quality depth image compression. In: Proceedings of the 3DTV-conference: the true vision\u2014capture, transmission and display of 3D Video, Zurich, Switzerland"},{"key":"1162_CR14","first-page":"40","volume":"46","author":"P Peter","year":"2016","unstructured":"Peter P, Hoffmann S, Nedwed F, Hoeltgen L, Weickert J (2016) Evaluating the true potential of diffusion-based inpainting in a compression context. Signal Process: Image Commun 46:40\u201353","journal-title":"Signal Process: Image Commun"},{"issue":"2","key":"1162_CR15","doi-asserted-by":"crossref","first-page":"860","DOI":"10.1109\/TIP.2016.2627800","volume":"26","author":"P Peter","year":"2017","unstructured":"Peter P, Kaufhold L, Weickert J (2017) Turning diffusion-based image colorization into efficient color compression. IEEE Trans Image Process 26(2):860\u2013869","journal-title":"IEEE Trans Image Process"},{"issue":"3","key":"1162_CR16","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1007\/s11263-014-0702-z","volume":"108","author":"C Schmaltz","year":"2014","unstructured":"Schmaltz C, Peter P, Mainberger M, Ebel F, Weickert J, Bruhn A (2014) Understanding, optimising, and extending data compression with anisotropic diffusion. Int J Comput Vis 108(3):222\u2013240","journal-title":"Int J Comput Vis"},{"issue":"2","key":"1162_CR17","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1007\/s10851-020-00973-6","volume":"63","author":"M Breu\u00df","year":"2021","unstructured":"Breu\u00df M, Hoeltgen L, Radow G (2021) Towards PDE-based video compression with optimal masks prolongated by optic flow. J Math Imaging Vis 63(2):144\u2013156","journal-title":"J Math Imaging Vis"},{"key":"1162_CR18","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1007\/978-3-030-75549-2_36","volume-title":"Scale space and variational methods in computer vision. Lecture notes in computer science","author":"I Jumakulyyev","year":"2021","unstructured":"Jumakulyyev I, Schultz T (2021) Lossless PDE-based compression of 3D medical images. In: Elmoataz A, Fadili J, Qu\u00e9au Y, Rabin J, Simon L (eds) Scale space and variational methods in computer vision. Lecture notes in computer science, vol 12679. Springer, Cham, pp 450\u2013462"},{"key":"1162_CR19","first-page":"37","volume-title":"Variational, geometric and level-set methods in computer vision. Lecture notes in computer science","author":"I Gali\u0107","year":"2005","unstructured":"Gali\u0107 I, Weickert J, Welk M, Bruhn A, Belyaev A, Seidel H-P (2005) Towards PDE-based image compression. In: Paragios N, Faugeras O, Chan T, Schn\u00f6rr C (eds) Variational, geometric and level-set methods in computer vision. Lecture notes in computer science, vol 3752. Springer, Berlin, pp 37\u201348"},{"key":"1162_CR20","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1007\/978-3-642-38267-3_27","volume-title":"Scale space and variational methods in computer vision. Lecture notes in computer science","author":"S Hoffmann","year":"2013","unstructured":"Hoffmann S, Mainberger M, Weickert J, Puhl M (2013) Compression of depth maps with segment-based homogeneous diffusion. In: Kuijper A, Bredies K, Pock T, Bischof H (eds) Scale space and variational methods in computer vision. Lecture notes in computer science, vol 7893. Springer, Berlin, pp 319\u2013330"},{"key":"1162_CR21","first-page":"368","volume":"26","author":"T Iijima","year":"1962","unstructured":"Iijima T (1962) Basic theory on normalization of pattern (in case of typical one-dimensional pattern). Bull Electrotech Labor 26:368\u2013388 (In Japanese)","journal-title":"Bull Electrotech Labor"},{"issue":"12","key":"1162_CR22","doi-asserted-by":"crossref","first-page":"1649","DOI":"10.1109\/TCSVT.2012.2221191","volume":"22","author":"GJ Sullivan","year":"2012","unstructured":"Sullivan GJ, Ohm JR, Han WJ, Wiegand T (2012) Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circuits Syst Video Technol 22(12):1649\u20131668","journal-title":"IEEE Trans Circuits Syst Video Technol"},{"key":"1162_CR23","doi-asserted-by":"crossref","unstructured":"Jost F, Peter P, Weickert J (2020) Compressing flow fields with edge-aware homogeneous diffusion inpainting. In: Proceedings of the\u00a02020 international conference on acoustics, speech, and signal processing, Barcelona, Spain, pp 2198\u20132202","DOI":"10.1109\/ICASSP40776.2020.9054255"},{"key":"1162_CR24","doi-asserted-by":"crossref","unstructured":"Jost F, Peter P, Weickert J (2021) Compressing piecewise smooth images with the Mumford\u2013Shah cartoon model. In: Proceedings of the\u00a028th European signal processing conference, Amsterdam, Netherlands, pp 511\u2013515","DOI":"10.23919\/Eusipco47968.2020.9287790"},{"key":"1162_CR25","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1007\/978-3-319-58771-4_10","volume-title":"Scale space and variational methods in computer vision. Lecture notes in computer science","author":"RD Adam","year":"2017","unstructured":"Adam RD, Peter P, Weickert J (2017) Denoising by inpainting. In: Lauze F, Dong Y, Dahl AB (eds) Scale space and variational methods in computer vision. Lecture notes in computer science, vol 10302. Springer, Cham, pp 121\u2013132"},{"issue":"10","key":"1162_CR26","doi-asserted-by":"crossref","first-page":"2564","DOI":"10.1109\/TMM.2019.2958760","volume":"22","author":"Q Dai","year":"2019","unstructured":"Dai Q, Chopp H, Pouyet E, Cossairt O, Walton M, Katsaggelos AK (2019) Adaptive image sampling using deep learning and its application on X-ray fluorescence image reconstruction. IEEE Trans Multimedia 22(10):2564\u20132578","journal-title":"IEEE Trans Multimedia"},{"issue":"1","key":"1162_CR27","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1137\/080716396","volume":"70","author":"Z Belhachmi","year":"2009","unstructured":"Belhachmi Z, Bucur D, Burgeth B, Weickert J (2009) How to choose interpolation data in images. SIAM J Appl Math 70(1):333\u2013352","journal-title":"SIAM J Appl Math"},{"issue":"5","key":"1162_CR28","doi-asserted-by":"crossref","DOI":"10.1088\/1361-6420\/aa5bfd","volume":"33","author":"S Bonettini","year":"2017","unstructured":"Bonettini S, Loris I, Porta F, Prato M, Rebegoldi S (2017) On the convergence of a linesearch based proximal-gradient method for nonconvex optimization. Inverse Prob 33(5):055005","journal-title":"Inverse Prob"},{"key":"1162_CR29","unstructured":"Chen Y, Ranftl R, Pock T (2014) A bi-level view of inpainting-based image compression. In: K\u00fakelov\u00e1 Z, Heller J (eds) Proceedings of the\u00a019th computer vision winter workshop, K\u0159tiny, Czech Republic"},{"key":"1162_CR30","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1007\/978-3-030-89131-2_40","volume-title":"Computer analysis of images and patterns. Part 2. Lecture notes in computer science","author":"V Chizhov","year":"2021","unstructured":"Chizhov V, Weickert J (2021) Efficient data optimisation for harmonic inpainting with finite elements. In: Tsapatsoulis N, Panayides A, Theocharides T, Lanitis A, Pattichis CS, Vento M (eds) Computer analysis of images and patterns. Part 2. Lecture notes in computer science, vol 13053. Springer, Cham, pp 432\u2013441"},{"issue":"4","key":"1162_CR31","first-page":"1669","volume":"14","author":"V Daropoulos","year":"2021","unstructured":"Daropoulos V, Augustin M, Weickert J (2021) Sparse inpainting with smoothed particle hydrodynamics. SIAM J Appl Math 14(4):1669\u20131704","journal-title":"SIAM J Appl Math"},{"issue":"7","key":"1162_CR32","doi-asserted-by":"crossref","first-page":"1604","DOI":"10.1016\/j.sigpro.2005.09.003","volume":"86","author":"L Demaret","year":"2006","unstructured":"Demaret L, Dyn N, Iske A (2006) Image compression by linear splines over adaptive triangulations. Signal Process 86(7):1604\u20131616","journal-title":"Signal Process"},{"key":"1162_CR33","first-page":"151","volume-title":"Energy minimisation methods in computer vision and pattern recognition. Lecture notes in computer science","author":"L Hoeltgen","year":"2013","unstructured":"Hoeltgen L, Setzer S, Weickert J (2013) An optimal control approach to find sparse data for Laplace interpolation. In: Heyden A, Kahl F, Olsson C, Oskarsson M, Tai X-C (eds) Energy minimisation methods in computer vision and pattern recognition. Lecture notes in computer science, vol 8081. Springer, Berlin, pp 151\u2013164"},{"key":"1162_CR34","first-page":"35","volume-title":"Variational methods in imaging and geometric control. Radon series on computational and applied mathematics","author":"L Hoeltgen","year":"2017","unstructured":"Hoeltgen L, Mainberger M, Hoffmann S, Weickert J, Tang CH, Setzer S, Johannsen D, Neumann F, Doerr B (2017) Optimising spatial and tonal data for PDE-based inpainting. In: Bergounioux M, Peyr\u00e9 G, Schn\u00f6rr C, Caillau J-P, Haberkorn T (eds) Variational methods in imaging and geometric control. Radon series on computational and applied mathematics, vol 18. De Gruyter, Berlin, pp 35\u201383"},{"key":"1162_CR35","first-page":"85","volume-title":"Energy minimisation methods in computer vision and pattern recognition. Lecture notes in computer science","author":"L Hoeltgen","year":"2015","unstructured":"Hoeltgen L, Weickert J (2015) Why does non-binary mask optimisation work for diffusion-based image compression? In: Tai X-C, Bae E, Chan TF, Leung SY, Lysaker M (eds) Energy minimisation methods in computer vision and pattern recognition. Lecture notes in computer science, vol 8932. Springer, Berlin, pp 85\u201398"},{"key":"1162_CR36","first-page":"547","volume-title":"Advanced concepts for intelligent vision systems. Lecture notes in computer science","author":"L Karos","year":"2018","unstructured":"Karos L, Bheed P, Peter P, Weickert J (2018) Optimising data for exemplar-based inpainting. In: Blanc-Talon J, Helbert D, Philips W, Popescu D, Scheunders P (eds) Advanced concepts for intelligent vision systems. Lecture notes in computer science, vol 11182. Springer, Cham, pp 547\u2013558"},{"key":"1162_CR37","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1007\/978-3-642-24785-9_3","volume-title":"Scale space and variational methods in computer vision. Lecture notes in computer science","author":"M Mainberger","year":"2012","unstructured":"Mainberger M, Hoffmann S, Weickert J, Tang CH, Johannsen D, Neumann F, Doerr B (2012) Optimising spatial and tonal data for homogeneous diffusion inpainting. In: Bruckstein AM, ter Haar Romeny B, Bronstein AM, Bronstein MM (eds) Scale space and variational methods in computer vision. Lecture notes in computer science, vol 6667. Springer, Berlin, pp 26\u201337"},{"key":"1162_CR38","doi-asserted-by":"crossref","unstructured":"Marwood D, Massimino P, Covell M, Baluja S (2018) Representing images in 200 bytes: compression via triangulation. In: Proceedings of the 2018 IEEE international conference on image processing, Athens, Greece, pp 405\u2013409","DOI":"10.1109\/ICIP.2018.8451393"},{"key":"1162_CR39","unstructured":"Nahme R (2015) Inertial proximal algorithms in diffusion-based image compression. Master\u2019s thesis, Department of Mathematics, University of G\u00f6ttingen, Germany"},{"issue":"2","key":"1162_CR40","doi-asserted-by":"crossref","first-page":"1388","DOI":"10.1137\/130942954","volume":"7","author":"P Ochs","year":"2014","unstructured":"Ochs P, Chen Y, Brox T, Pock T (2014) iPiano: inertial proximal algorithm for nonconvex optimization. SIAM J Imag Sci 7(2):1388\u20131419","journal-title":"SIAM J Imag Sci"},{"key":"1162_CR41","doi-asserted-by":"crossref","unstructured":"Peter P (2019) Fast inpainting-based compression: combining Shepard interpolation with joint inpainting and prediction. In: Proceedings of the 26th IEEE international conference on image processing, Taipei, Taiwan, pp 3557\u20133561","DOI":"10.1109\/ICIP.2019.8803760"},{"key":"1162_CR42","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1007\/978-3-031-04881-4_42","volume-title":"Pattern recognition and image analysis. Lecture notes in computer science","author":"T Alt","year":"2022","unstructured":"Alt T, Peter P, Weickert J (2022) Learning sparse masks for diffusion-based image inpainting. In: Pinho AJ, Georgieva P, Teixeira LF, S\u00e1nchez JA (eds) Pattern recognition and image analysis. Lecture notes in computer science, vol 13256. Springer, Cham, pp 528\u2013539"},{"key":"1162_CR43","doi-asserted-by":"crossref","unstructured":"Peter P (2022) A Wasserstein GAN for joint learning of inpainting and its spatial optimisation. arXiv:2202.05623 [eess.IV]","DOI":"10.1007\/978-3-031-26431-3_11"},{"issue":"1","key":"1162_CR44","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1023\/A:1023609324173","volume":"43","author":"T Sch\u00fctze","year":"2003","unstructured":"Sch\u00fctze T, Schwetlick H (2003) Bivariate free knot splines. BIT Numer Math 43(1):153\u2013178","journal-title":"BIT Numer Math"},{"issue":"9","key":"1162_CR45","doi-asserted-by":"crossref","first-page":"1095","DOI":"10.1109\/26.623074","volume":"45","author":"R Distasi","year":"1997","unstructured":"Distasi R, Nappi M, Vitulano S (1997) Image compression by B-tree triangular coding. IEEE Trans Commun 45(9):1095\u20131100","journal-title":"IEEE Trans Commun"},{"key":"1162_CR46","doi-asserted-by":"crossref","DOI":"10.1137\/1.9781611971484","volume-title":"Numerical methods for least squares problems","author":"\u00c5 Bj\u00f6rck","year":"1996","unstructured":"Bj\u00f6rck \u00c5 (1996) Numerical methods for least squares problems. SIAM, Philadelphia"},{"key":"1162_CR47","first-page":"169","volume-title":"Energy minimization methods in computer vision and pattern recognition. Lecture notes in computer science","author":"S Hoffmann","year":"2015","unstructured":"Hoffmann S, Plonka G, Weickert J (2015) Discrete Green\u2019s functions for harmonic and biharmonic inpainting with sparse atoms. In: Tai X-C, Bae E, Chan TF, Lysaker M (eds) Energy minimization methods in computer vision and pattern recognition. Lecture notes in computer science, vol 8932. Springer, Berlin, pp 169\u2013182"},{"key":"1162_CR48","unstructured":"Hoffmann S (2017) Competitive image compression with linear PDEs. PhD thesis, Department of Computer Science, Saarland University, Saarbr\u00fccken, Germany"},{"key":"1162_CR49","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1007\/978-3-030-22368-7_8","volume-title":"Scale space and variational methods in computer vision. Lecture notes in computer science","author":"P Peter","year":"2019","unstructured":"Peter P, Contelly J, Weickert J (2019) Compressing audio signals with inpainting-based sparsification. In: Lellmann J, Burger M, Modersitzki J (eds) Scale space and variational methods in computer vision. Lecture notes in computer science, vol 11603. Springer, Cham, pp 92\u2013103"},{"key":"1162_CR50","doi-asserted-by":"crossref","unstructured":"Liu H, Jiang B, Xiao Y, Yang C (2017) Coherent semantic attention for image inpainting. In: Proceedings of the 2019 IEEE\/CVF international conference on computer vision, Seoul, Korea, pp 4170\u20134179","DOI":"10.1109\/ICCV.2019.00427"},{"key":"1162_CR51","doi-asserted-by":"crossref","unstructured":"Pathak D, Kr\u00e4henb\u00fchl P, Donahue J, Darrell T, Efros AA (2016) Context encoders: feature learning by inpainting. In: Proceedings of the 2016 IEEE conference on computer vision and pattern recognition, Las Vegas, NV, pp 2536\u20132544","DOI":"10.1109\/CVPR.2016.278"},{"key":"1162_CR52","first-page":"350","volume-title":"Proceedings of the 26th international conference on neural information processing systems. Advances in neural information processing systems","author":"J Xie","year":"2012","unstructured":"Xie J, Xu L, Chen E (2012) Image denoising and inpainting with deep neural networks. In: Bartlett PL, Pereira FCN, Burges CJC, Bottou L, Weinberger KQ (eds) Proceedings of the 26th international conference on neural information processing systems. Advances in neural information processing systems, vol 25. Lake Tahoe, NV, pp 350\u2013358"},{"key":"1162_CR53","doi-asserted-by":"crossref","unstructured":"Yang C, Lu X, Lin Z, Shechtman E, Wang O, Li H (2017) High-resolution image inpainting using multi-scale neural patch synthesis. In: Proceedings of the 2017 IEEE conference on computer vision and pattern recognition, Honolulu, HI, pp 6721\u20136729","DOI":"10.1109\/CVPR.2017.434"},{"key":"1162_CR54","doi-asserted-by":"crossref","unstructured":"Yu J, Lin Z, Yang J, Shen X, Lu X, Huang TS (2018) Generative image inpainting with contextual attention. In: Proceedings of the 2018 IEEE conference on computer vision and pattern recognition, Salt Lake City, UT, pp 5505\u20135514","DOI":"10.1109\/CVPR.2018.00577"},{"key":"1162_CR55","doi-asserted-by":"crossref","unstructured":"Wang W, Zhang J, Niu L, Ling H, Yang X, Zhang L (2021) Parallel multi-resolution fusion network for image inpainting. In: Proceedings of the 2021 IEEE\/CVF international conference on computer vision, pp 14559\u201314568","DOI":"10.1109\/ICCV48922.2021.01429"},{"key":"1162_CR56","doi-asserted-by":"crossref","first-page":"1784","DOI":"10.1109\/TIP.2020.3048629","volume":"30","author":"N Wang","year":"2021","unstructured":"Wang N, Zhang Y, Zhang L (2021) Dynamic selection network for image inpainting. IEEE Trans Image Process 30:1784\u20131798","journal-title":"IEEE Trans Image Process"},{"issue":"5","key":"1162_CR57","doi-asserted-by":"crossref","first-page":"898","DOI":"10.1109\/TPAMI.2010.161","volume":"33","author":"P Arbelaez","year":"2011","unstructured":"Arbelaez P, Maire M, Fowlkes C, Malik J (2011) Contour detection and hierarchical image segmentation. IEEE Trans Pattern Anal Mach Intell 33(5):898\u2013916","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"1162_CR58","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1007\/3-540-31272-2_19","volume-title":"Visualization and processing of tensor fields","author":"J Weickert","year":"2006","unstructured":"Weickert J, Welk M (2006) Tensor field interpolation with PDEs. In: Weickert J, Hagen H (eds) Visualization and processing of tensor fields. Springer, Berlin, pp 315\u2013325"},{"key":"1162_CR59","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1007\/978-3-030-56215-1_5","volume-title":"Anisotropy across fields and scales. Mathematics and visualization","author":"I Jumakulyyev","year":"2021","unstructured":"Jumakulyyev I, Schultz T (2021) Fourth-order anisotropic diffusion for inpainting and image compression. In: \u00d6zarslan E, Schultz T, Zhang E, Fuster A (eds) Anisotropy across fields and scales. Mathematics and visualization. Springer, Cham, pp 99\u2013124"},{"key":"1162_CR60","first-page":"75","volume":"17","author":"RW Floyd","year":"1976","unstructured":"Floyd RW, Steinberg L (1976) An adaptive algorithm for spatial grey scale. Proc Soc Inf Disp 17:75\u201377","journal-title":"Proc Soc Inf Disp"},{"key":"1162_CR61","first-page":"234","volume-title":"Medical image computing and computer-assisted intervention\u2014MICCAI 2015. Lecture Notes in Computer Science","author":"O Ronneberger","year":"2015","unstructured":"Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, Wells W, Frangi A (eds) Medical image computing and computer-assisted intervention\u2014MICCAI 2015. Lecture Notes in Computer Science, vol 9351. Springer, Cham, pp 234\u2013241"},{"key":"1162_CR62","first-page":"85","volume":"65","author":"T Alt","year":"2022","unstructured":"Alt T, Schrader K, Augustin M, Peter P, Weickert J (2022) Connections between numerical algorithms for PDEs and neural networks. J Math Imaging Vis 65:185\u2013208","journal-title":"J Math Imaging Vis"},{"key":"1162_CR63","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the 2016 IEEE conference on computer vision and pattern recognition, Las Vegas, NV, pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"issue":"2","key":"1162_CR64","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1109\/JSTSP.2021.3049634","volume":"15","author":"A Golts","year":"2021","unstructured":"Golts A, Freedman D, Elad M (2021) Deep energy: task driven training of deep neural networks. IEEE J Sel Top Signal Process 15(2):324\u2013338","journal-title":"IEEE J Sel Top Signal Process"},{"key":"1162_CR65","unstructured":"Theis L, Shi W, Cunningham A, Husz\u00e1r F (2017) Lossy image compression with compressive autoencoders. In: Proceedings of the 5th international conference on learning representations, Toulon, France"},{"key":"1162_CR66","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1007\/978-3-030-86340-1_46","volume-title":"Artificial neural networks and machine learning\u2014ICANN 2021. Lecture notes in computer science","author":"D Va\u0161ata","year":"2021","unstructured":"Va\u0161ata D, Halama T, Friedjungov\u00e1 M (2021) Image inpainting using Wasserstein generative adversarial imputation network. In: Farka\u0161 I, Masulli P, Otte S, Wermter S (eds) Artificial neural networks and machine learning\u2014ICANN 2021. Lecture notes in computer science, vol 12892. Springer, Cham, pp 575\u2013586"},{"key":"1162_CR67","unstructured":"Yu F, Koltun V (2016) Multi-scale context aggregation by dilated convolutions. In: Proceedings of the 4th international conference on learning representations, San Juan, Puerto Rico"},{"key":"1162_CR68","doi-asserted-by":"crossref","unstructured":"Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: Proceedings of the 2009 IEEE computer society conference on computer vision and pattern recognition, Miami, FL, pp 248\u2013255","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"1162_CR69","unstructured":"Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. In: Proceedings of the\u00a03rd international conference on learning representations, San Diego, CA"},{"key":"1162_CR70","unstructured":"K\u00f6stler H, St\u00fcrmer M, Freundl C, R\u00fcde U (2007) PDE based video compression in real time. Technical Report 07-11, Lehrstuhl f\u00fcr Informatik 10, Univ. Erlangen\u2013N\u00fcrnberg, Germany"},{"key":"1162_CR71","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1016\/j.jvcir.2015.06.017","volume":"31","author":"P Peter","year":"2015","unstructured":"Peter P, Schmaltz C, Mach N, Mainberger M, Weickert J (2015) Beyond pure quality: progressive mode, region of interest coding and real time video decoding in PDE-based image compression. J Vis Commun Image Represent 31:256\u2013265","journal-title":"J Vis Commun Image Represent"},{"key":"1162_CR72","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1007\/978-3-030-75549-2_34","volume-title":"Scale space and variational methods in computer vision. Lecture notes in computer science","author":"S Andris","year":"2021","unstructured":"Andris S, Peter P, Mohideen RMK, Weickert J, Hoffmann S (2021) Inpainting-based video compression in FullHD. In: Elmoataz A, Fadili J, Qu\u00e9au Y, Rabin J, Simon L (eds) Scale space and variational methods in computer vision. Lecture notes in computer science, vol 12679. Springer, Cham, pp 425\u2013436"}],"container-title":["Pattern Analysis and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10044-023-01162-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10044-023-01162-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10044-023-01162-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,21]],"date-time":"2023-11-21T20:11:13Z","timestamp":1700597473000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10044-023-01162-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,8]]},"references-count":72,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,11]]}},"alternative-id":["1162"],"URL":"https:\/\/doi.org\/10.1007\/s10044-023-01162-y","relation":{},"ISSN":["1433-7541","1433-755X"],"issn-type":[{"value":"1433-7541","type":"print"},{"value":"1433-755X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,8]]},"assertion":[{"value":"9 September 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 March 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 April 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interests"}}]}}