{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T17:05:30Z","timestamp":1776186330647,"version":"3.50.1"},"reference-count":50,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,2,6]],"date-time":"2022-02-06T00:00:00Z","timestamp":1644105600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004410","name":"Scientific and Technological Research Council of Turkey","doi-asserted-by":"publisher","award":["120E234"],"award-info":[{"award-number":["120E234"]}],"id":[{"id":"10.13039\/501100004410","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Missing data problem frequently occurs during data acquisition in ground-penetrating radar (GPR) and recovery of the missing entries prior to any processing is vital in GPR imaging. Existing missing data recovery methods are based on low-rank matrix completion or the recently proposed deep generative networks. However, the former approaches suffer from producing satisfying results under severe missing data cases and the latter require a large amount of data for training. This study proposes two methods based on deep networks for the missing data recovery. The first method uses pyramid-context encoder network (PEN-Net) architecture which consists of three parts: attention transfer network, guided Pyramid-context encoder, and a multi-scale decoder. Although the method needs training, it requires considerably less data compared to the existing U-Net based method. The second method, deep image prior (DIP), is a regularization based data recovery method which uses an untrained network as a prior. This method does not need any training, network weights are initialized randomly and updated during the iterations to minimize the cost function. Different experiments are reported for both pixel and column-wise missing cases in simulated and real data. The simulated data results show that the proposed methods have a noticeably better performance than conventional methods for the challenging pixel-wise case around 17\u201327% and moderate level column-wise missing case around 15%. Besides, they can also deal with extreme column-wise missing data cases where the conventional methods fail completely. Real data results further verify the superiority of the proposed methods.<\/jats:p>","DOI":"10.3390\/rs14030754","type":"journal-article","created":{"date-parts":[[2022,2,6]],"date-time":"2022-02-06T20:38:40Z","timestamp":1644179920000},"page":"754","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Missing Data Recovery via Deep Networks for Limited Ground Penetrating Radar Measurements"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7192-7466","authenticated-orcid":false,"given":"Deniz","family":"Kumlu","sequence":"first","affiliation":[{"name":"Electronics and Communication Department, Istanbul Technical University, Istanbul 34469, Turkey"}]},{"given":"Kubra","family":"Tas","sequence":"additional","affiliation":[{"name":"Electronics and Communication Department, Istanbul Technical University, Istanbul 34469, Turkey"}]},{"given":"Isin","family":"Erer","sequence":"additional","affiliation":[{"name":"Electronics and Communication Department, Istanbul Technical University, Istanbul 34469, Turkey"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Daniels, D.J. (2004). Ground Penetrating Radar, IET.","DOI":"10.1049\/PBRA015E"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1600","DOI":"10.1109\/TAP.2005.846723","article-title":"Time reversal imaging of obscured targets from multistatic data","volume":"53","author":"Devaney","year":"2005","journal-title":"IEEE Trans. Antennas Propag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2650","DOI":"10.1109\/TSP.2015.2417507","article-title":"Performance analysis of time-reversal MUSIC","volume":"63","author":"Ciuonzo","year":"2015","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1002\/cjg2.1279","article-title":"Seismic data reconstruction with fractal interpolation","volume":"51","author":"Li","year":"2008","journal-title":"Chin. J. Geophys."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"94215","DOI":"10.1109\/ACCESS.2019.2928130","article-title":"Low-Rank Matrix Completion: A Contemporary Survey","volume":"7","author":"Nguyen","year":"2019","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"V11","DOI":"10.1190\/geo2017-0495.1","article-title":"Deep-learning-based seismic data interpolation: A preliminary result","volume":"84","author":"Wang","year":"2019","journal-title":"Geophysics"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1007\/s10208-009-9045-5","article-title":"Exact Matrix Completion via Convex Optimization","volume":"9","author":"Candes","year":"2008","journal-title":"Found Comput. Math."},{"key":"ref_8","first-page":"2057","article-title":"Matrix Completion from Noisy Entries","volume":"11","author":"Keshavan","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Jain, P., Netrapalli, P., and Sanghavi, S. (2013, January 1\u20134). Low-rank matrix completion using alternating minimization. Proceedings of the Symposium on Theory of Computing, STOC\u201913, Palo Alto, CA, USA.","DOI":"10.1145\/2488608.2488693"},{"key":"ref_10","first-page":"15","article-title":"An Accelerated Proximal Gradient Algorithm for Nuclear Norm Regularized Least Squares Problems","volume":"6","author":"Toh","year":"2010","journal-title":"Pac. J. Optim."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1007\/s12532-012-0044-1","article-title":"Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm","volume":"4","author":"Wen","year":"2012","journal-title":"Math. Program. Comput."},{"key":"ref_12","first-page":"678","article-title":"Interest Zone Matrix Approximation","volume":"23","author":"Shabat","year":"2012","journal-title":"ELA. Electron. J. Linear Algebra"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1080\/17415977.2014.890616","article-title":"Seismic data reconstruction via weighted nuclear-norm minimization","volume":"23","author":"Wang","year":"2015","journal-title":"Inverse Probl. Sci. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1379","DOI":"10.3934\/ipi.2013.7.1379","article-title":"Seismic data reconstruction via matrix completion","volume":"7","author":"Yang","year":"2013","journal-title":"Inverse Probl. Imaging"},{"key":"ref_15","unstructured":"Chen, X. (2016). The Application of \u201cOPTSPACE\u201d Algorithm and Comparison with \u201cLmaFit\u201d Algorithm in Three-Dimensional Seismic Data Reconstruction via Low-Rank Matrix Completion. [Master\u2019s Thesis, Stanford University]."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"7680","DOI":"10.1080\/01431161.2020.1763508","article-title":"Ground penetrating radar clutter removal via randomized low rank and sparse decomposition for missing data case","volume":"41","author":"Kumlu","year":"2020","journal-title":"Int. J. Remote Sens."},{"key":"ref_17","unstructured":"Zhou, T., and Tao, D. (July, January 28). GoDec: Randomized Lowrank & Sparse Matrix Decomposition in Noisy Case. Proceedings of the 28th International Conference on Machine Learning, ICML 2011, Bellevue, WA, USA."},{"key":"ref_18","first-page":"365","article-title":"An Alternating Direction Algorithm for Matrix Completion with Nonnegative Factors","volume":"7","author":"Xu","year":"2011","journal-title":"Comput. Res. Repos. CORR"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Efros, A., and Leung, T. (1999, January 20\u201325). Texture synthesis by non-parametric sampling. Proceedings of the Seventh IEEE International Conference on Computer Vision, Corfu, Greece.","DOI":"10.1109\/ICCV.1999.790383"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.1109\/TIP.2004.833105","article-title":"Region filling and object removal by exemplar-based image inpainting","volume":"13","author":"Criminisi","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1531326.1531330","article-title":"PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing","volume":"28","author":"Barnes","year":"2009","journal-title":"ACM Trans. Graph."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1109\/TIP.2014.2372479","article-title":"Context-aware patch-based image inpainting using Markov random field modeling","volume":"24","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., and Efros, A.A. (2016, January 27\u201330). Context Encoders: Feature Learning by Inpainting. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.278"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1080\/10867651.2004.10487596","article-title":"An Image Inpainting Technique Based on the Fast Marching Method","volume":"9","author":"Telea","year":"2004","journal-title":"J. Graph. Tools"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Bertalm\u00edo, M., Sapiro, G., Caselles, V., and Ballester, C. (2000, January 23\u201328). Image inpainting. Proceedings of the ACM SIGGRAPH Conference on Computer Graphics, New Orleans, LA, USA.","DOI":"10.1145\/344779.344972"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1145\/1073204.1073274","article-title":"Image Completion with Structure Propagation","volume":"24","author":"Sun","year":"2005","journal-title":"ACM Trans. Graph."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1109\/TPAMI.2007.60","article-title":"Space-Time Completion of Video","volume":"29","author":"Wexler","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yang, C., Lu, X., Lin, Z., Shechtman, E., Wang, O., and Li, H. (2017, January 21\u201326). High-Resolution Image Inpainting Using Multi-scale Neural Patch Synthesis. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.434"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3072959.3073659","article-title":"Globally and Locally Consistent Image Completion","volume":"36","author":"Iizuka","year":"2017","journal-title":"ACM Trans. Graph."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1867","DOI":"10.1007\/s11263-020-01303-4","article-title":"Deep Image Prior","volume":"128","author":"Ulyanov","year":"2020","journal-title":"Int. J. Comput. Vis."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Liu, G., Reda, F.A., Shih, K.J., Wang, T.C., Tao, A., and Catanzaro, B. (2018, January 8\u201314). Image Inpainting for Irregular Holes Using Partial Convolutions. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01252-6_6"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Xiong, W., Yu, J., Lin, Z., Yang, J., Lu, X., Barnes, C., and Luo, J. (2019, January 15\u201320). Foreground-Aware Image Inpainting. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00599"},{"key":"ref_33","first-page":"8300","article-title":"Localization of deep inpainting using high-pass fully convolutional network","volume":"2019","author":"Li","year":"2019","journal-title":"Proc. IEEE Int. Conf. Comput. Vis."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"36921","DOI":"10.1109\/ACCESS.2019.2905268","article-title":"Artist-Net: Decorating the Inferred Content with Unified Style for Image Inpainting","volume":"7","author":"Liao","year":"2019","journal-title":"IEEE Access"},{"key":"ref_35","unstructured":"Dosovitskiy, A., and Brox, T. (2016, January 5\u201310). Generating Images with Perceptual Similarity Metrics Based on Deep Networks. Proceedings of the 30th International Conference on Neural Information Processing Systems, NIPS\u201916, Barcelona Spain."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1109\/TIFS.2017.2763119","article-title":"DeMeshNet: Blind Face Inpainting for Deep MeshFace Verification","volume":"13","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Li, Y., Liu, S., Yang, J., and Yang, M.H. (2017, January 21\u201326). Generative Face Completion. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.624"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Song, Y., Yang, C., Lin, Z., Liu, X., Huang, Q., Li, H., and Kuo, C.C.J. (2018, January 8\u201314). Contextual-Based Image Inpainting: Infer, Match, and Translaten. Proceedings of the 15th European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01216-8_1"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., and Huang, T.S. (2018, January 18\u201323). Generative Image Inpainting With Contextual Attention. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00577"},{"key":"ref_40","unstructured":"Ferrari, V., Hebert, M., Sminchisescu, C., and Weiss, Y. (2018). Shift-Net: Image Inpainting via Deep Feature Rearrangement. Computer Vision, Springer."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Rohman, B.P.A., Member, S., and Nishimoto, M. (2021). Reconstruction of Missing Ground-Penetrating Radar Traces Using Simplified U-Net. IEEE Geosci. Remote Sens. Lett., 3.","DOI":"10.1109\/LGRS.2021.3072028"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Tas, K., Kumlu, D., and Erer, I. (2021, January 26\u201328). Pyramid-Context Encoder Network (PEN-Net) for Missing Data Recovery in Ground Penetrating Radar. Proceedings of the 2021 44th International Conference on Telecommunications and Signal Processing (TSP), Brno, Czech Republic.","DOI":"10.1109\/TSP52935.2021.9522613"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.neunet.2017.10.007","article-title":"Matrix completion by deep matrix factorization","volume":"98","author":"Fan","year":"2018","journal-title":"Neural Netw."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation, Springer International Publishing.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Zeng, Y., Fu, J., Chao, H., and Guo, B. (2019). Learning pyramid-context encoder network for high-quality image inpainting. arXiv.","DOI":"10.1109\/CVPR.2019.00158"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Wang, X., Yu, F., Dou, Z.Y., Darrell, T., and Gonzalez, J.E. (2018, January 8\u201314). SkipNet: Learning Dynamic Routing in Convolutional Networks. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01261-8_25"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.cpc.2016.08.020","article-title":"gprMax: Open source software to simulate electromagnetic wave propagation for Ground Penetrating Radar","volume":"209","author":"Warren","year":"2016","journal-title":"Comput. Phys. Commun."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"52138","DOI":"10.1109\/ACCESS.2018.2870052","article-title":"Peeking inside the black-box: A survey on explainable artificial intelligence (XAI)","volume":"6","author":"Adadi","year":"2018","journal-title":"IEEE Access"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"4225","DOI":"10.1109\/TNSM.2021.3098157","article-title":"XAI meets mobile traffic classification: Understanding and improving multimodal deep learning architectures","volume":"18","author":"Nascita","year":"2021","journal-title":"IEEE Trans. Netw. Serv. Manag."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/3\/754\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:15:00Z","timestamp":1760134500000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/3\/754"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,6]]},"references-count":50,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["rs14030754"],"URL":"https:\/\/doi.org\/10.3390\/rs14030754","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,6]]}}}