{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,21]],"date-time":"2025-11-21T18:06:26Z","timestamp":1763748386761,"version":"build-2065373602"},"reference-count":50,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,6,4]],"date-time":"2021-06-04T00:00:00Z","timestamp":1622764800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the Pre-Study Foundation of the Army Armament Department of China","award":["6140414050327"],"award-info":[{"award-number":["6140414050327"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62031018"],"award-info":[{"award-number":["62031018"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Image intensifiers are used internationally as advanced military night-vision devices. They have better imaging performance in low-light-level conditions than CMOS\/CCD. The intensified CMOS (ICMOS) was developed to satisfy the digital demand of image intensifiers. In order to make the ICMOS capable of color imaging in low-light-level conditions, a liquid-crystal tunable filter based color imaging ICMOS was developed. Due to the time-division color imaging scheme, motion artifacts may be introduced when a moving target is in the scene. To solve this problem, a deformable kernel prediction neural network (DKPNN) is proposed for joint denoising and motion artifact removal, and a data generation method which generates images with color-channel motion artifacts is also proposed to train the DKPNN. The results show that, compared with other denoising methods, the proposed DKPNN performed better both on generated noisy data and on real noisy data. Therefore, the proposed DKPNN is more suitable for color ICMOS denoising and motion artifact removal. A new exploration was made for low-light-level color imaging schemes.<\/jats:p>","DOI":"10.3390\/s21113891","type":"journal-article","created":{"date-parts":[[2021,6,7]],"date-time":"2021-06-07T01:56:40Z","timestamp":1623031000000},"page":"3891","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Denoising and Motion Artifact Removal Using Deformable Kernel Prediction Neural Network for Color-Intensified CMOS"],"prefix":"10.3390","volume":"21","author":[{"given":"Zhenghao","family":"Han","sequence":"first","affiliation":[{"name":"Key Laboratory of Photo-Electronic Imaging Technology and Systems, School of Optics and Photonics, Ministry of Education of China, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Li","family":"Li","sequence":"additional","affiliation":[{"name":"Key Laboratory of Photo-Electronic Imaging Technology and Systems, School of Optics and Photonics, Ministry of Education of China, Beijing Institute of Technology, Beijing 100081, China"},{"name":"Science and Technology on Low-Light-Level Night Vision Laboratory, Xi\u2019an 710065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weiqi","family":"Jin","sequence":"additional","affiliation":[{"name":"Key Laboratory of Photo-Electronic Imaging Technology and Systems, School of Optics and Photonics, Ministry of Education of China, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xia","family":"Wang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Photo-Electronic Imaging Technology and Systems, School of Optics and Photonics, Ministry of Education of China, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gangcheng","family":"Jiao","sequence":"additional","affiliation":[{"name":"Science and Technology on Low-Light-Level Night Vision Laboratory, Xi\u2019an 710065, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuan","family":"Liu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Photo-Electronic Imaging Technology and Systems, School of Optics and Photonics, Ministry of Education of China, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hailin","family":"Wang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Photo-Electronic Imaging Technology and Systems, School of Optics and Photonics, Ministry of Education of China, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"010901","DOI":"10.1117\/1.OE.51.1.010901","article-title":"Progress in color night vision","volume":"51","author":"Toet","year":"2012","journal-title":"Opt. Eng."},{"key":"ref_2","unstructured":"(2021, April 25). ColorPath CCNVD Color Capable Night Vision. Available online: https:\/\/armament.com\/tenebraex\/."},{"key":"ref_3","first-page":"313","article-title":"Spectrum matching optimization study on tri-band color night vision technology","volume":"38","author":"Chen","year":"2016","journal-title":"Opt. Instrum."},{"key":"ref_4","first-page":"175","article-title":"Study on color night vision image fusion method based on quadruple-based images","volume":"46","author":"Wu","year":"2017","journal-title":"Acta Photonica Sin."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Kriesel, J., and Gat, N. (2007). True-Color. Night Vision Cameras, Optics and Photonics in Global Homeland Security III, International Society for Optics and Photonics.","DOI":"10.1117\/12.719902"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4947","DOI":"10.1364\/AO.58.004947","article-title":"Tunable-liquid-crystal-filter-based low-light-level color night vision system and its image processing method","volume":"58","author":"Yuan","year":"2019","journal-title":"Appl. Opt."},{"key":"ref_7","unstructured":"Buades, A., Coll, B., and Morel, J.-M. (2005, January 20\u201325). A non-local algorithm for image denoising. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2080","DOI":"10.1109\/TIP.2007.901238","article-title":"Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering","volume":"16","author":"Dabov","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Dabov, K., Foi, A., Katkovnik, V., and Egiazarian, K.O. (2008). Image restoration by sparse 3D transform-domain collaborative filtering. Image Processing: Algorithms and Systems VI, International Society for Optics and Photonics.","DOI":"10.1117\/12.766355"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3114","DOI":"10.1109\/TIP.2014.2326771","article-title":"Progressive Image Denoising","volume":"23","author":"Knaus","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_11","unstructured":"Mao, X.J., Shen, C., and Yang, Y.B. (2016). Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3142","DOI":"10.1109\/TIP.2017.2662206","article-title":"Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising","volume":"26","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_14","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Tai, Y., Yang, J., Liu, X., and Xu, C. (2017, January 22\u201329). MemNet: A persistent memory network for image restoration. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.486"},{"key":"ref_16","unstructured":"Liu, P., and Fang, R. (2017). Learning pixel-distribution prior with wider convolution for image denoising. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lefkimmiatis, S. (2017, January 21\u201326). Non-local color image denoising with convolutional neural networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.623"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lefkimmiatis, S. (2018, January 19\u201321). Universal denoising networks: A novel CNN architecture for image denoising. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00338"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kligvasser, I., Shaham, T.R., and Michaeli, T. (2018, January 18\u201322). xUnit: Learning a spatial activation function for efficient image restoration. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00258"},{"key":"ref_20","unstructured":"Ulyanov, D., Vedaldi, A., and Lempitsky, V. (2018, January 18\u201322). Deep image prior. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Cha, S., and Moon, T. (November, January 17). Fully convolutional pixel adaptive image denoiser. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00426"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Liu, P., Zhang, H., Zhang, K., Lin, L., and Zuo, W. (2018, January 18\u201322). Multi-level wavelet-CNN for image restoration. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00121"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Mildenhall, B., Barron, J.T., Chen, J., Sharlet, D., Ng, R., and Carroll, R. (2018, January 18\u201322). Burst denoising with kernel prediction networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00265"},{"key":"ref_24","first-page":"1087","article-title":"Neural nearest neighbors networks","volume":"31","author":"Roth","year":"2018","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_25","unstructured":"Liu, D., Wen, B., Fan, Y., Loy, C.C., and Huang, T.S. (2018). Non-local recurrent network for image restoration. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"4608","DOI":"10.1109\/TIP.2018.2839891","article-title":"FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising","volume":"27","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","unstructured":"Lehtinen, J., Munkberg, J., Hasselgren, J., Laine, S., Karras, T., Aittala, M., and Aila, T. (2018). Noise2noise: Learning image restoration without clean data. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Liu, J., Wu, C.-H., Wang, Y., Xu, Q., Zhou, Y., Huang, H., Wang, C., Cai, S., Ding, Y., and Fan, H. (2019, January 16\u201317). Learning raw image denoising with bayer pattern unification and bayer preserving augmentation. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00259"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, X., Chan, K.C., Yu, K., Dong, C., and Loy, C.C. (2019, January 16\u201317). EDVR: Video restoration with enhanced deformable convolutional networks. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00247"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Guo, S., Yan, Z., Zhang, K., Zuo, W., and Zhang, L. (2019, January 16\u201317). Toward convolutional blind denoising of real photographs. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00181"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Marinc, T., Srinivasan, V., Gul, S., Hellge, C., and Samek, W. (2019, January 22\u201325). Multi-kernel prediction networks for denoising of burst images. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8803335"},{"key":"ref_32","unstructured":"Xu, X., Li, M., and Sun, W. (2019). Learning deformable kernels for image and video denoising. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"7153","DOI":"10.1109\/TIP.2020.2999209","article-title":"Learning Spatial and Spatio-Temporal Pixel Aggregations for Image and Video Denoising","volume":"29","author":"Xu","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Tassano, M., Delon, J., and Veit, T. (2019, January 22\u201325). DVDNET: A fast network for deep video denoising. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8803136"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Tassano, M., Delon, J., and Veit, T. (2020, January 14\u201319). FastDVDnet: Towards real-time deep video denoising without flow estimation. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00143"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Brooks, T., Mildenhall, B., Xue, T., Chen, J., Sharlet, D., and Barron, J.T. (2019, January 22\u201325). Unprocessing images for learned raw denoising. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Taipei, Taiwan.","DOI":"10.1109\/CVPR.2019.01129"},{"key":"ref_37","unstructured":"Jaroensri, R., Biscarrat, C., Aittala, M., and Durand, F. (2019). Generating training data for denoising real rgb images via camera pipeline simulation. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1737","DOI":"10.1109\/TIP.2008.2001399","article-title":"Practical Poissonian-Gaussian noise modeling and fitting for single-image raw-data","volume":"17","author":"Foi","year":"2008","journal-title":"IEEE Trans. Image Process."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Hasinoff, S.W., Durand, F., and Freeman, W.T. (2010, January 13\u201318). Noise-optimal capture for high dynamic range photography. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5540167"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Hasinoff, S.W. (2021, April 25). Photon, Poisson Noise. Available online: http:\/\/people.csail.mit.edu\/hasinoff\/pubs\/hasinoff-photon-2011-preprint.pdf.","DOI":"10.1007\/978-3-030-63416-2_482"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Su, S., Delbracio, M., Wang, J., Sapiro, G., Heidrich, W., and Wang, O. (2017, January 21\u201326). Deep video deblurring for hand-held cameras. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.33"},{"key":"ref_42","first-page":"1929","article-title":"Dropout: A Simple Way to Prevent Neural Networks from Overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_43","unstructured":"Loshchilov, I., and Hutter, F. (2017). Decoupled weight decay regularization. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Hore, A., and Ziou, D. (2010, January 23\u201326). Image quality metrics: PSNR vs. SSIM. Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.579"},{"key":"ref_45","unstructured":"Wang, Z., Simoncelli, E., and Bovik, A. (2003, January 9\u201312). Multiscale structural similarity for image quality assessment. Proceedings of the Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, Pacific Grove, CA, USA."},{"key":"ref_46","unstructured":"Farneb\u00e4ck, G. (July, January 29). Two-frame motion estimation based on polynomial expansion. Proceedings of the Scandinavian Conference on Image Analysis, Halmstad, Sweden."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"772","DOI":"10.1364\/AO.38.000772","article-title":"Statistical algorithm for nonuniformity correction in focal-plane arrays","volume":"38","author":"Hayat","year":"1999","journal-title":"Appl. Opt."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2032","DOI":"10.1364\/JOSAA.7.002032","article-title":"Contrast in complex images","volume":"7","author":"Peli","year":"1990","journal-title":"J. Opt. Soc. Am. A"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Adjabi, I., Ouahabi, A., Benzaoui, A., and Jacques, S. (2021). Multi-Block Color-Binarized Statistical Images for Single-Sample Face Recognition. Sensors, 21.","DOI":"10.3390\/s21030728"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Khaldi, Y., and Benzaoui, A. (2020). A new framework for grayscale ear images recognition using generative adversarial networks under unconstrained conditions. Evol. Syst., 1\u201312.","DOI":"10.1007\/s12530-020-09346-1"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/11\/3891\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:11:04Z","timestamp":1760163064000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/11\/3891"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,4]]},"references-count":50,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["s21113891"],"URL":"https:\/\/doi.org\/10.3390\/s21113891","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,6,4]]}}}