{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:46:51Z","timestamp":1760237211663,"version":"build-2065373602"},"reference-count":29,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,3,12]],"date-time":"2020-03-12T00:00:00Z","timestamp":1583971200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Financially supported by the Marine S&amp;T Fund of Shandong Province for Pilot National Laboratory for Marine Science and Technology (Qingdao)","award":["2018SDKJ0102-6"],"award-info":[{"award-number":["2018SDKJ0102-6"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>High-dynamic range imaging technology is an effective method to improve the limitations of a camera\u2019s dynamic range. However, most current high-dynamic imaging technologies are based on image fusion of multiple frames with different exposure levels. Such methods are prone to various phenomena, for example motion artifacts, detail loss and edge effects. In this paper, we combine a dual-channel camera that can output two different gain images simultaneously, a semi-supervised network structure based on an attention mechanism to fuse multiple gain images is proposed. The proposed network structure comprises encoding, fusion and decoding modules. First, the U-Net structure is employed in the encoding module to extract important detailed information in the source image to the maximum extent. Simultaneously, the SENet attention mechanism is employed in the encoding module to assign different weights to different feature channels and emphasis important features. Then, a feature map extracted from the encoding module is input to the decoding module for reconstruction after fusing by the fusion module to obtain a fused image. Experimental results indicate that the fused images obtained by the proposed method demonstrate clear details and high contrast. Compared with other methods, the proposed method improves fused image quality relative to several indicators.<\/jats:p>","DOI":"10.3390\/sym12030451","type":"journal-article","created":{"date-parts":[[2020,3,13]],"date-time":"2020-03-13T08:58:59Z","timestamp":1584089939000},"page":"451","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Attention Mechanism Based Semi-Supervised Multi-Gain Image Fusion"],"prefix":"10.3390","volume":"12","author":[{"given":"Ming","family":"Fang","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Changchun University of Science and Technology, Changchun 130022, China"},{"name":"School of Artificial Intelligence, Changchun University of Science and Technology, Changchun 130022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xu","family":"Liang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Changchun University of Science and Technology, Changchun 130022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Feiran","family":"Fu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Changchun University of Science and Technology, Changchun 130022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yansong","family":"Song","sequence":"additional","affiliation":[{"name":"Institute of Space Photoelectric Technology, Changchun University of Science and Technology, Changchun 130022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhen","family":"Shao","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Changchun University of Science and Technology, Changchun 130022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1016\/j.jvcir.2018.03.020","article-title":"Edge-preserving smoothing pyramid based multi-scale exposure fusion","volume":"53","author":"Kou","year":"2018","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1109\/TIP.2016.2639450","article-title":"LIME: Low-light image enhancement via illumination map estimation","volume":"26","author":"Guo","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1111\/j.1467-8659.2008.01171.x","article-title":"Exposure fusion: A simple and practical alternative to high dynamic range photography","volume":"28","author":"Mertens","year":"2009","journal-title":"Comput. Graph. Forum"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1016\/j.infrared.2015.07.026","article-title":"A fast fusion scheme for infrared and visible light images in NSCT domain","volume":"72","author":"Zhao","year":"2015","journal-title":"Infrared Phys. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Que, Y., Yang, Y., and Lee, H. (2019). Exposure Measurement and Fusion via Adaptive Multiscale Edge-Preserving Smoothing. IEEE Trans. Instrum. Meas.","DOI":"10.1109\/TIM.2019.2896551"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Chen, C., Li, Y., Liu, W., and Huang, J. (2014, January 23\u201328). Image fusion with local spectral consistency and dynamic gradient sparsity. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.347"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.inffus.2017.05.006","article-title":"Sparse representation based multi-sensor image fusion for multi-focus and multi-modality images: A review","volume":"40","author":"Zhang","year":"2018","journal-title":"Inf. Fusion"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"5182","DOI":"10.1364\/OE.21.005182","article-title":"Regional multifocus image fusion using sparse representation","volume":"21","author":"Chen","year":"2013","journal-title":"Opt. Express"},{"key":"ref_9","unstructured":"Burt, P., and Kolczynski, R. (1993, January 11\u201314). Enhanced image capture through fusion. Proceedings of the 1993 (4th) International Conference on Computer Vision, Berlin, Germany."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2864","DOI":"10.1109\/TIP.2013.2244222","article-title":"Image fusion with guided filtering","volume":"22","author":"Li","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1016\/j.jvcir.2015.06.021","article-title":"Dense SIFT for ghost-free multi-exposure fusion","volume":"31","author":"Liu","year":"2015","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2519","DOI":"10.1109\/TIP.2017.2671921","article-title":"Robust multi-exposure image fusion: A structural patch decomposition approach","volume":"26","author":"Ma","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1109\/TCI.2017.2786138","article-title":"Multi-exposure image fusion by optimizing a structural similarity index","volume":"4","author":"Ma","year":"2017","journal-title":"IEEE Trans. Comput. Imaging"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1006\/gmip.1995.1022","article-title":"Multi sensor image fusion using the wavelet transform","volume":"57","author":"Li","year":"1995","journal-title":"Graph. Models Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Borwonwatanadelok, P., Rattanapitak, W., and Udomhunsakul, S. (2009, January 20\u201322). Multi-focus image fusion based on stationary wavelet transform and extended spatial frequency measurement. Proceedings of the 2009 International Conference on Electronic Computer Technology, Macau, China.","DOI":"10.1109\/ICECT.2009.94"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Hill, P., Canagarajah, C., and Bull, D. (2002, January 22\u221224). Image Fusion Using Complex Wavelets. Proceedings of the BMVC, Tvbingen, Germany.","DOI":"10.5244\/C.16.47"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ma, X., Hu, S., Liu, S., Fang, J., and Xu, S. (2019). Multi-focus image fusion based on joint sparse representation and optimum theory. Signal Process. Image Commun.","DOI":"10.1016\/j.image.2019.06.002"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Prabhakar, K., Srikar, V., and Babu, R. (2017, January 22\u201329). DeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairs. Proceedings of the ICCV, Venice, Italy.","DOI":"10.1109\/ICCV.2017.505"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Li, H., and Zhang, L. (2018, January 7\u201310). Multi-exposure fusion with CNN features. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451689"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Yan, Q., Gong, D., Zhang, P., Shi, Q., Sun, J., Reid, I., and Zhang, Y. (2019, January 7\u201311). Multi-Scale Dense Networks for Deep High Dynamic Range Imaging. Proceedings of the 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa Village, HI, USA.","DOI":"10.1109\/WACV.2019.00012"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2614","DOI":"10.1109\/TIP.2018.2887342","article-title":"Densefuse: A fusion approach to infrared and visible images","volume":"28","author":"Li","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Lin, T., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollar, P., and Lawrence Zitnick, C. (2014, January 6\u201312). Microsoft coco: Common Objects in Context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.ins.2019.08.066","article-title":"Infrared and visible image fusion based on target-enhanced multiscale transform decomposition","volume":"508","author":"Chen","year":"2020","journal-title":"Inf. Sci."},{"key":"ref_26","unstructured":"Xu, L. (2019, September 01). Multi-Gain Dataset [EB\/OL]. Available online: https:\/\/pan.baidu.com\/s\/1ku7nAz0ZHxjyvNJ_z2IvfA."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1016\/j.imavis.2011.09.003","article-title":"Edge preserved image fusion based on multiscale toggle contrast operator","volume":"29","author":"Bai","year":"2011","journal-title":"Image Vis. Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1049\/el:20020212","article-title":"Information measure for performance of image fusion","volume":"38","author":"Qu","year":"2002","journal-title":"Electron. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/3\/451\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:06:19Z","timestamp":1760173579000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/3\/451"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,12]]},"references-count":29,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["sym12030451"],"URL":"https:\/\/doi.org\/10.3390\/sym12030451","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2020,3,12]]}}}