{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,18]],"date-time":"2026-01-18T12:02:08Z","timestamp":1768737728152,"version":"3.49.0"},"reference-count":33,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2021,2,19]],"date-time":"2021-02-19T00:00:00Z","timestamp":1613692800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62075169"],"award-info":[{"award-number":["62075169"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Obtaining key and rich visual information under sophisticated road conditions is one of the key requirements for advanced driving assistance. In this paper, a newfangled end-to-end model is proposed for advanced driving assistance based on the fusion of infrared and visible images, termed as FusionADA. In our model, we are committed to extracting and fusing the optimal texture details and salient thermal targets from the source images. To achieve this goal, our model constitutes an adversarial framework between the generator and the discriminator. Specifically, the generator aims to generate a fused image with basic intensity information together with the optimal texture details from source images, while the discriminator aims to force the fused image to restore the salient thermal targets from the source infrared image. In addition, our FusionADA is a fully end-to-end model, solving the issues of manually designing complicated activity level measurements and fusion rules existing in traditional methods. Qualitative and quantitative experiments on publicly available datasets RoadScene and TNO demonstrate the superiority of our FusionADA over the state-of-the-art approaches.<\/jats:p>","DOI":"10.3390\/e23020239","type":"journal-article","created":{"date-parts":[[2021,2,19]],"date-time":"2021-02-19T09:06:10Z","timestamp":1613725570000},"page":"239","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Advanced Driving Assistance Based on the Fusion of Infrared and Visible Images"],"prefix":"10.3390","volume":"23","author":[{"given":"Yansong","family":"Gu","sequence":"first","affiliation":[{"name":"School of Information Management, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinya","family":"Wang","sequence":"additional","affiliation":[{"name":"Electronic Information School, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Can","family":"Zhang","sequence":"additional","affiliation":[{"name":"Electronic Information School, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Baiyang","family":"Li","sequence":"additional","affiliation":[{"name":"School of Information Management, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ziebinski, A., Cupek, R., Erdogan, H., and Waechter, S. (2016, January 28\u201330). A survey of ADAS technologies for the future perspective of sensor fusion. Proceedings of the International Conference on Computational Collective Intelligence, Halkidiki, Greece.","DOI":"10.1007\/978-3-319-45246-3_13"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.inffus.2018.02.004","article-title":"Infrared and visible image fusion methods and applications: A survey","volume":"45","author":"Ma","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Huang, X., Qi, G., Wei, H., Chai, Y., and Sim, J. (2019). A novel infrared and visible image information fusion method based on phase congruency and image entropy. Entropy, 21.","DOI":"10.3390\/e21121135"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4980","DOI":"10.1109\/TIP.2020.2977573","article-title":"DDcGAN: A dual-discriminator conditional generative adversarial network for multi-resolution image fusion","volume":"29","author":"Ma","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yin, S., Wang, Y., and Yang, Y.H. (2019). A Novel Residual Dense Pyramid Network for Image Dehazing. Entropy, 21.","DOI":"10.3390\/e21111123"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2265","DOI":"10.1007\/s11517-019-02023-9","article-title":"A sum-modified-Laplacian and sparse representation based multimodal medical image fusion in Laplacian pyramid domain","volume":"57","author":"Li","year":"2019","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Teng, J., Wang, S., Zhang, J., and Wang, X. (2010, January 16\u201318). Neuro-fuzzy logic based fusion algorithm of medical images. Proceedings of the International Congress on Image and Signal Processing, Yantai, China.","DOI":"10.1109\/CISP.2010.5646958"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"44002","DOI":"10.1109\/ACCESS.2019.2908378","article-title":"CT and MR Image Fusion Based on Adaptive Structure Decomposition","volume":"7","author":"Zhao","year":"2019","journal-title":"IEEE Access"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Liu, Y., Yang, X., Zhang, R., Albertini, M.K., Celik, T., and Jeon, G. (2020). Entropy-Based Image Fusion with Joint Sparse Representation and Rolling Guidance Filter. Entropy, 22.","DOI":"10.3390\/e22010118"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1016\/j.compeleceng.2018.03.037","article-title":"Medical images fusion by using weighted least squares filter and sparse representation","volume":"67","author":"Jiang","year":"2018","journal-title":"Comput. Electr. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.inffus.2013.01.001","article-title":"Medical image fusion using multi-level local extrema","volume":"19","author":"Xu","year":"2014","journal-title":"Inf. Fusion"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Jiang, F., Kong, B., Li, J., Dashtipour, K., and Gogate, M. (2020). Robust visual saliency optimization based on bidirectional Markov chains. Cogn. Comput., 1\u201312.","DOI":"10.1007\/s12559-020-09724-6"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Tian, X., Chen, Y., Yang, C., and Ma, J. (2021). Variational Pansharpening by Exploiting Cartoon-Texture Similarities. IEEE Trans. Geosci. Remote Sens.","DOI":"10.1109\/TGRS.2020.3048257"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"8649","DOI":"10.1109\/TIE.2019.2950866","article-title":"SCSCN: A Separated Channel-Spatial Convolution Net with Attention for Single-view Reconstruction","volume":"67","author":"Ma","year":"2020","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"5687","DOI":"10.1109\/TIE.2019.2934071","article-title":"Image Super-Resolution via Dense Discriminative Network","volume":"67","author":"Ma","year":"2020","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Shopovska, I., Jovanov, L., and Philips, W. (2019). Deep visible and thermal image fusion for enhanced pedestrian visibility. Sensors, 19.","DOI":"10.3390\/s19173727"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"15119","DOI":"10.1007\/s00521-020-04863-1","article-title":"A generative adversarial network with adaptive constraints for multi-focus image fusion","volume":"32","author":"Huang","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1850018","DOI":"10.1142\/S0219691318500182","article-title":"Infrared and visible image fusion with convolutional neural networks","volume":"16","author":"Liu","year":"2018","journal-title":"Int. J. Wavelets Multiresolution Inf. Process."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2614","DOI":"10.1109\/TIP.2018.2887342","article-title":"DenseFuse: A fusion approach to infrared and visible images","volume":"28","author":"Li","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1882","DOI":"10.1109\/LSP.2016.2618776","article-title":"Image fusion with convolutional sparse representation","volume":"23","author":"Liu","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.inffus.2018.09.004","article-title":"FusionGAN: A generative adversarial network for infrared and visible image fusion","volume":"48","author":"Ma","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.inffus.2019.07.005","article-title":"Infrared and visible image fusion via detail preserving adversarial learning","volume":"54","author":"Ma","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Xu, H., Liang, P., Yu, W., Jiang, J., and Ma, J. (2019, January 10\u201316). Learning a generative model for fusing infrared and visible images via conditional generative adversarial network with dual discriminators. Proceedings of the International Joint Conference on Artificial Intelligence, Macao, China.","DOI":"10.24963\/ijcai.2019\/549"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.inffus.2016.02.001","article-title":"Infrared and visible image fusion via gradient transfer and total variation minimization","volume":"31","author":"Ma","year":"2016","journal-title":"Inf. Fusion"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Bavirisetti, D.P., Xiao, G., and Liu, G. (2017, January 10\u201313). Multi-sensor image fusion based on fourth order partial differential equations. Proceedings of the International Conference on Information Fusion, Xi\u2019an, China.","DOI":"10.23919\/ICIF.2017.8009719"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.inffus.2015.11.003","article-title":"Perceptual fusion of infrared and visible images through a hybrid multi-scale decomposition with Gaussian and bilateral filters","volume":"30","author":"Zhou","year":"2016","journal-title":"Inf. Fusion"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zhang, H., Xu, H., Xiao, Y., Guo, X., and Ma, J. (2020, January 7\u201312). Rethinking the Image Fusion: A Fast Unified Image Fusion Network based on Proportional Maintenance of Gradient and Intensity. Proceedings of the AAAI Conference on Artificial Intelligence, Hilton New York Midtown, NY, USA.","DOI":"10.1609\/aaai.v34i07.6975"},{"key":"ref_28","unstructured":"Xu, H., Ma, J., Jiang, J., Guo, X., and Ling, H. (2020). U2fusion: A unified unsupervised image fusion network. IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","first-page":"1","article-title":"GANMcC: A Generative Adversarial Network With Multiclassification Constraints for Infrared and Visible Image Fusion","volume":"70","author":"Ma","year":"2020","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2959","DOI":"10.1109\/26.477498","article-title":"Image quality measures and their performance","volume":"43","author":"Eskicioglu","year":"1995","journal-title":"IEEE Trans. Commun."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"023522","DOI":"10.1117\/1.2945910","article-title":"Assessment of image fusion procedures using entropy, image quality, and multispectral classification","volume":"2","author":"Roberts","year":"2008","journal-title":"J. Appl. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"175947","DOI":"10.1109\/ACCESS.2019.2955382","article-title":"Multi-source medical image fusion based on Wasserstein generative adversarial networks","volume":"7","author":"Yang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1890","DOI":"10.1016\/j.aeue.2015.09.004","article-title":"A new image quality metric for image fusion: The sum of the correlations of differences","volume":"69","author":"Aslantas","year":"2015","journal-title":"AEU-Int. J. Electron. Commun."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/2\/239\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:26:06Z","timestamp":1760160366000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/2\/239"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,19]]},"references-count":33,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["e23020239"],"URL":"https:\/\/doi.org\/10.3390\/e23020239","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,19]]}}}