{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,12]],"date-time":"2025-12-12T13:33:53Z","timestamp":1765546433383,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2019,4,19]],"date-time":"2019-04-19T00:00:00Z","timestamp":1555632000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["11572084,11472061"],"award-info":[{"award-number":["11572084,11472061"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["16D110412,17D110408"],"award-info":[{"award-number":["16D110412,17D110408"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"name":"DHU Distinguished Young Professor Program","award":["18D210402"],"award-info":[{"award-number":["18D210402"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>In this paper, we propose a novel spatial image error concealment (EC) method based on deep neural network. Considering that the natural images have local correlation and non-local self-similarity, we use the local information to predict the missing pixels and the non-local information to correct the predictions. The deep neural network we utilize can be divided into two parts: the prediction part and the auto-encoder (AE) part. The first part utilizes the local correlation among pixels to predict the missing ones. The second part extracts image features, which are used to collect similar samples from the whole image. In addition, a novel adaptive scan order based on the joint credibility of the support area and reconstruction is also proposed to alleviate the error propagation problem. The experimental results show that the proposed method can reconstruct corrupted images effectively and outperform the compared state-of-the-art methods in terms of objective and perceptual metrics.<\/jats:p>","DOI":"10.3390\/a12040082","type":"journal-article","created":{"date-parts":[[2019,4,22]],"date-time":"2019-04-22T03:15:53Z","timestamp":1555902953000},"page":"82","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Image Error Concealment Based on Deep Neural Network"],"prefix":"10.3390","volume":"12","author":[{"given":"Zhiqiang","family":"Zhang","sequence":"first","affiliation":[{"name":"College of Information Science and Technology, Donghua University, Shanghai 201620, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rong","family":"Huang","sequence":"additional","affiliation":[{"name":"College of Information Science and Technology, Donghua University, Shanghai 201620, China"},{"name":"Engineering Research Center of Digitized Textile &amp; Apparel Technology, Ministry of Education, Shanghai 201620, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fang","family":"Han","sequence":"additional","affiliation":[{"name":"College of Information Science and Technology, Donghua University, Shanghai 201620, China"},{"name":"Engineering Research Center of Digitized Textile &amp; Apparel Technology, Ministry of Education, Shanghai 201620, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhijie","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Information Science and Technology, Donghua University, Shanghai 201620, China"},{"name":"Engineering Research Center of Digitized Textile &amp; Apparel Technology, Ministry of Education, Shanghai 201620, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,4,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/TCSVT.2011.2130450","article-title":"Packet video error concealment with auto regressive model","volume":"1","author":"Zhang","year":"2012","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1224","DOI":"10.1109\/TCSVT.2010.2057019","article-title":"Bayesian error concealment with DCT pyramid for images","volume":"9","author":"Zhai","year":"2010","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1109\/LSP.2004.827916","article-title":"An edge-oriented spatial interpolation for consecutive block error concealment","volume":"1","author":"Hsia","year":"2004","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"470","DOI":"10.1109\/83.370675","article-title":"Concealment of damaged block transform coded images using projections onto convex sets","volume":"4","author":"Sun","year":"1995","journal-title":"IEEE Trans. Image Process."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"648","DOI":"10.1109\/76.767129","article-title":"Geometric-structure-based error concealment with novel applications in block-based low-bit-rate coding","volume":"1","author":"Zeng","year":"1999","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_6","first-page":"857","article-title":"Novel sequential error-concealment techniques using orientation adaptive interpolation","volume":"10","author":"Li","year":"2002","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1007\/s00034-012-9504-0","article-title":"Spatial Error Concealment Based on Edge Visual Clearness for Image\/Video Communication","volume":"4","author":"Koloda","year":"2013","journal-title":"Circuits Syst. Signal Process."},{"key":"ref_8","first-page":"353","article-title":"Spatial error concealment with an adaptive linear predictor","volume":"3","author":"Liu","year":"2015","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"957","DOI":"10.1109\/TMM.2013.2238524","article-title":"Sequential error concealment for video\/images by sparse linear prediction","volume":"6","author":"Koloda","year":"2013","journal-title":"IEEE Trans. Multimed."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1729","DOI":"10.1109\/TMM.2014.2330314","article-title":"Kernel-based MMSE multimedia signal reconstruction and its application to spatial error concealment","volume":"10","author":"Koloda","year":"2014","journal-title":"IEEE Trans. Multimed."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1109\/TIP.2004.842354","article-title":"Recovery of image blocks using the method of alternating projections","volume":"4","author":"Park","year":"2005","journal-title":"IEEE Trans. Image Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1109\/TBC.2016.2619581","article-title":"Scalable kernel-based minimum mean square error estimator for accelerated image error concealment","volume":"11","author":"Koloda","year":"2017","journal-title":"IEEE Trans. Broadcast."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Akbari, A., Trocan, M., and Granard, B. (2017, January 23\u201325). Joint-domin dictionary learning-based error concealment using common space mapping. Proceedings of the 2017 22nd International Conference on Digital Signal Processing-DSP, London, UK.","DOI":"10.1109\/ICDSP.2017.8096049"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1705","DOI":"10.1109\/TIP.2018.2880681","article-title":"Image inpainting using nonlocal texture matching and nonlinear filtering","volume":"4","author":"Ding","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.patrec.2015.04.020","article-title":"Application of GRNN neural network in non-texture image inpainting and restoration","volume":"9","author":"Alilou","year":"2015","journal-title":"Pattern Recognit. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lam, W.M., Reibman, A.R., and Liu, B. (1993, January 27\u201330). Recovery of lost or erroneously received motion vectors. Proceedings of the 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing-ICASSP, Minneapolis, MN, USA.","DOI":"10.1109\/ICASSP.1993.319836"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1109\/76.845011","article-title":"A cell-loss concealment technique for MPEG-2 coded video","volume":"6","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1880","DOI":"10.1109\/TCE.2008.4711249","article-title":"A temporal error concealment method for H.264\/AVC using motion vector recovery","volume":"11","author":"Wu","year":"2008","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1109\/TMM.2009.2017609","article-title":"Recovering connected error region based on adaptive error concealment order determination","volume":"6","author":"Qian","year":"2009","journal-title":"IEEE Trans. Multimed."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Shao, S.C., and Chen, J.H. (2011, January 16\u201318). A novel error concealment approach based on general regression neural network. Proceedings of the 2011 International Conference on Consumer Electrics, Communication and Networks-CECNet, XianNing, China.","DOI":"10.1109\/CECNET.2011.5768232"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sankisa, A., Punjabi, A., and Katsaggelos, A.K. (2018, January 7\u201310). Video error concealment using deep neural networks. Proceedings of the IEEE International Conference on Image Processing-ICIP, Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451090"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Ghuge, A.D., Rajani, P.K., and Khaparde, A. (2017, January 17\u201318). Video error concealment using moment Invariance. Proceedings of the 2017 International Conference on Computing, Communication, Control and Automation-ICCUBEA, Pune, India.","DOI":"10.1109\/ICCUBEA.2017.8463802"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Xiang, X., Ma, S., Zhao, D., and Gao, W. (2010, January 24\u201326). Auto regressive model and weighted least squares based packet video error concealment. Proceedings of the 2010 Data Compression Conference-DCC, Snowbird, UT, USA.","DOI":"10.1109\/DCC.2010.100"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"960","DOI":"10.1109\/TCSVT.2006.879988","article-title":"Enhanced error concealment with mode selection","volume":"8","author":"Agrafiotis","year":"2006","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"789","DOI":"10.1109\/TCSVT.2006.877391","article-title":"Spatial and temporal error concealment techniques for video transmission over noisy channels","volume":"7","author":"Kung","year":"2006","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_26","first-page":"382","article-title":"Edge-directed error concealment","volume":"3","author":"Ma","year":"2010","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Shirani, S., Kossentini, F., and Ward, R. (1999, January 15\u201319). An Adaptive Markov Random Field Based Error Concealment Method for Video Communication in an Error Prone Environment. Proceedings of the 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing-ICASSP, Phoenix, AZ, USA.","DOI":"10.1109\/ICASSP.1999.757501"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Koloda, J., Peinado, A.M., and S\u00e1nchez, V. (2013, January 26\u201331). On the application of multivariate kernel density estimation to image error concealment. Proceedings of the 2013 IEEE International Conference on Acoustics, Speech, and Signal Processing-ICASSP, Vancouver, BC, Canada.","DOI":"10.1109\/ICASSP.2013.6637867"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"782","DOI":"10.1109\/TIP.2016.2623481","article-title":"Sparsity-Based image error concealment via adaptive dual dictionary learning and regularization","volume":"2","author":"Liu","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1126\/science.1127647","article-title":"Reducing the Dimensionality of Data with Neural Networks","volume":"7","author":"Hinton","year":"2006","journal-title":"Science"},{"key":"ref_31","unstructured":"Varsa, V., Hannuksela, M.M., and Wang, Y.-K. (2001, January 21\u201324). Non-Normative Error Concealment Algorithms. Proceedings of the 14th ITU-T VCEG Meeting Document: VCEG-N62, Santa Barbara, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1109\/TCE.2004.1277882","article-title":"Content-adaptive spatial error concealment for video communication","volume":"2","author":"Rongfu","year":"2004","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"4","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_34","unstructured":"(2019, March 01). Janko. Available online: http:\/\/dtstc.ugr.es\/~jkoloda\/download.html."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/12\/4\/82\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:46:48Z","timestamp":1760186808000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/12\/4\/82"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,19]]},"references-count":34,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2019,4]]}},"alternative-id":["a12040082"],"URL":"https:\/\/doi.org\/10.3390\/a12040082","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2019,4,19]]}}}