{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,3]],"date-time":"2025-11-03T09:12:41Z","timestamp":1762161161682,"version":"build-2065373602"},"reference-count":42,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2015,5,8]],"date-time":"2015-05-08T00:00:00Z","timestamp":1431043200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"EPSRC","doi-asserted-by":"publisher","award":["EP\/K004638\/1"],"award-info":[{"award-number":["EP\/K004638\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>A novel scheme to perform the fusion of multiple images using the multivariate empirical mode decomposition (MEMD) algorithm is proposed. Standard multi-scale fusion techniques make a priori assumptions regarding input data, whereas standard univariate empirical mode decomposition (EMD)-based fusion techniques suffer from inherent mode mixing and mode misalignment issues, characterized respectively by either a single intrinsic mode function (IMF) containing multiple scales or the same indexed IMFs corresponding to multiple input images carrying different frequency information. We show that MEMD overcomes these problems by being fully data adaptive and by aligning common frequency scales from multiple channels, thus enabling their comparison at a pixel level and subsequent fusion at multiple data scales. We then demonstrate the potential of the proposed scheme on a large dataset of real-world multi-exposure and multi-focus images and compare the results against those obtained from standard fusion algorithms, including the principal component analysis (PCA), discrete wavelet transform (DWT) and non-subsampled contourlet transform (NCT). A variety of image fusion quality measures are employed for the objective evaluation of the proposed method. We also report the results of a hypothesis testing approach on our large image dataset to identify statistically-significant performance differences.<\/jats:p>","DOI":"10.3390\/s150510923","type":"journal-article","created":{"date-parts":[[2015,5,8]],"date-time":"2015-05-08T10:56:41Z","timestamp":1431082601000},"page":"10923-10947","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["Multi-Scale Pixel-Based Image Fusion Using Multivariate Empirical Mode Decomposition"],"prefix":"10.3390","volume":"15","author":[{"given":"Naveed","family":"Rehman","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, COMSATS Institute of Information Technology, Park Road, Chak Shahzad, Islamabad 44000, Pakistan"}]},{"given":"Shoaib","family":"Ehsan","sequence":"additional","affiliation":[{"name":"School of Computer Science and Electronic Engineering, University of Essex, Wivenhoe Park, Colchester CO4 3SQ, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7334-0722","authenticated-orcid":false,"given":"Syed","family":"Abdullah","sequence":"additional","affiliation":[{"name":"Halliburton Worldwide Limited, Islamabad 44000, Pakistan"}]},{"given":"Muhammad","family":"Akhtar","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, COMSATS Institute of Information Technology, Park Road, Chak Shahzad, Islamabad 44000, Pakistan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8432-3963","authenticated-orcid":false,"given":"Danilo","family":"Mandic","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Imperial College London, Exhibition Road, London SW7 2AZ, UK"}]},{"given":"Klaus","family":"McDonald-Maier","sequence":"additional","affiliation":[{"name":"School of Computer Science and Electronic Engineering, University of Essex, Wivenhoe Park, Colchester CO4 3SQ, UK"}]}],"member":"1968","published-online":{"date-parts":[[2015,5,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"7771","DOI":"10.3390\/s91007771","article-title":"Advances in Multi-Sensor Data Fusion: Algorithms and Applications","volume":"9","author":"Dong","year":"2009","journal-title":"Sensors"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2500","DOI":"10.3390\/s8042500","article-title":"Improving Empirical Mode Decomposition Using Support Vector Machines for Multifocus Image Fusion","volume":"8","author":"Chen","year":"2008","journal-title":"Sensors"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2469","DOI":"10.1109\/TIP.2012.2236346","article-title":"QoE-based multi-exposure fusion in hierarchical multivariate Gaussian CRF","volume":"22","author":"Shen","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Jones, M.J., and Nikolov, S.G. (2003, January 8\u201311). Dual-modality two-stage direct volume rendering. Cairns, Australia.","DOI":"10.1109\/ICIF.2003.177327"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Goshtasby, A. (2006, January 18\u201320). Fusion of multifocus images to maximize image information. Orlando, FL, USA.","DOI":"10.1117\/12.663706"},{"key":"ref_6","unstructured":"Tian, Y.F., Qin, Y.X., Yang, J.Y., and Gao, A.P. (2009, January 17\u201319). An Approach of Image Fusion Based on General Image Quality Evaluation. Tianjin, China."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"338","DOI":"10.14429\/dsj.58.1653","article-title":"Pixel-level Image Fusion using Wavelets and Principal Component Analysis","volume":"58","author":"Naidu","year":"2008","journal-title":"Def. Sci. J."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Patil, U., and Mudengudi, U. (2011, January 3\u20135). Image fusion using hierarchical PCA. Himachal Pradesh, India.","DOI":"10.1109\/ICIIP.2011.6108966"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2898","DOI":"10.1109\/TIP.2012.2183140","article-title":"Image fusion using higher order singular value decomposition","volume":"21","author":"Liang","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1109\/LGRS.2011.2182032","article-title":"Ensemble methodology using multistage learning for improved detection of harmful algal blooms","volume":"9","author":"Gokaraju","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1109\/TIP.2004.823821","article-title":"Gradient-Based Multiresolution Image Fusion","volume":"13","author":"Petrovic","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1117\/12.131644","article-title":"Pyramidal Techniques for Multi-sensor Fusion","volume":"1828","author":"Akerman","year":"1992","journal-title":"SPIE Sens. Fusion V"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Naidu, V. (2011, January 3\u20135). Multi-resolution image fusion by FFT. Himachal Pardesh.","DOI":"10.1109\/ICIIP.2011.6108862"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.dsp.2003.06.001","article-title":"A contrast based image fusion technique in the DCT domain","volume":"14","author":"Tang","year":"2004","journal-title":"Digit. Signal Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1855","DOI":"10.1016\/j.patcog.2004.03.010","article-title":"A wavelet-based image fusion tutorial","volume":"37","author":"Pajares","year":"2004","journal-title":"Pattern Recogn."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Hill, P., Canagarajah, N., and Bull, D. (2002, January 2\u20135). Image Fusion using Complex Wavelets. Cardiff, UK.","DOI":"10.5244\/C.16.47"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2091","DOI":"10.1109\/TIP.2005.859376","article-title":"The contourlet transform: An efficient directional multiresolution image representation","volume":"14","author":"Do","year":"2005","journal-title":"IEEE Trans. Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1334","DOI":"10.1016\/j.sigpro.2009.01.012","article-title":"Multifocus image fusion using the nonsubsampled contourlet transform","volume":"89","author":"Zhang","year":"2009","journal-title":"Signal Process."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.inffus.2010.03.002","article-title":"Performance comparison of different multi-resolution transforms for image fusion","volume":"12","author":"Li","year":"2011","journal-title":"Inf. Fusion"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"041001","DOI":"10.3788\/COL201109.041001","article-title":"Multifocus image fusion algorithm based on shearlets","volume":"9","author":"Miao","year":"2011","journal-title":"Chin. Opt. Lett."},{"key":"ref_21","unstructured":"Koren, I., Laine, A., and Taylor, F. (1995, January 23\u201326). Image fusion using steerable dyadic wavelet transform. Washington, DC, USA."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"924","DOI":"10.1016\/j.sigpro.2005.06.015","article-title":"A simple and efficient algorithm for multifocus image fusion using morphological wavelets","volume":"86","author":"De","year":"2006","journal-title":"Signal Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3271","DOI":"10.1109\/TIP.2013.2262284","article-title":"Single image dehazing by multi-scale fusion","volume":"22","author":"Ancuti","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_24","first-page":"88","article-title":"Area level fusion of Multi-focused Images using Multi-Stationary Wavelet Packet Transform","volume":"2","author":"Kannan","year":"2010","journal-title":"Int. J. Comput. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1005","DOI":"10.1109\/TIP.2012.2226045","article-title":"Multiscale Image Fusion Using the Undecimated Wavelet Transform With Spectral Factorization and Nonorthogonal Filter Banks","volume":"22","author":"Ellmauthaler","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"903","DOI":"10.1098\/rspa.1998.0193","article-title":"The empirical mode decomposition and the Hilbert spectrum for non-linear and non-stationary time series analysis","volume":"454","author":"Huang","year":"1998","journal-title":"Proc. R. Soc. A"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1626","DOI":"10.1109\/TSP.2008.2011836","article-title":"Multiscale Image Fusion Using Complex Extensions of EMD","volume":"57","author":"Looney","year":"2009","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/MSP.2013.2267931","article-title":"Empirical Mode Decomposition-Based Time-Frequency Analysis of Multivariate Signals: The Power of Adaptive Data Analysis","volume":"30","author":"Mandic","year":"2013","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_29","first-page":"16","article-title":"Image Fusion and Enhancement via Empirical Mode Decomposition","volume":"1","author":"Hariharan","year":"2006","journal-title":"J. Pattern Recogn. Res."},{"key":"ref_30","unstructured":"Rehman, N., Looney, D., Rutkowski, T.M., and Mandic, D.P. (3, January 31). Bivariate EMD-based Image Fusion. Cardiff, UK."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1291","DOI":"10.1098\/rspa.2009.0502","article-title":"Multivariate Empirical Mode Decomposition","volume":"466","author":"Rehman","year":"2009","journal-title":"Proc. R. Soc. Eng. A"},{"key":"ref_32","unstructured":"Empirical Mode Decomposition, Multivariate EMD, Multivariate Synchrosqueezing, Matlab code and data. Available online: http:\/\/www.commsp.ee.ic.ac.uk\/\u223cmandic\/research\/emd.htm."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Rilling, G., Flandrin, P., and Goncalves, P. (2003, January 8\u201311). On empirical mode decomposition and its algorithms. Grado, Italy.","DOI":"10.1109\/LSP.2003.821662"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3012","DOI":"10.1109\/TGRS.2007.904923","article-title":"Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest","volume":"45","author":"Alparone","year":"2007","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/S1566-2535(01)00038-0","article-title":"Combination of images with diverse focuses using the spatial frequency","volume":"2","author":"Li","year":"2001","journal-title":"Inf. Fusion"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1007\/s11263-011-0473-8","article-title":"Interesting Interest Points\u2014A Comparative Study of Interest Point Performance on a Unique data set","volume":"97","author":"Aanes","year":"2012","journal-title":"Int. J. Comput. Vis."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/j.inffus.2005.04.003","article-title":"A new metric based on extended spatial frequency and its application to DWT based fusion algorithms","volume":"8","author":"Zheng","year":"2005","journal-title":"Inf. Fusion"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/97.995823","article-title":"A universal image quality index","volume":"9","author":"Wang","year":"2002","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_39","unstructured":"Piella, G., and Heijmans, H. (2009, January 14\u201317). A new quality metric for image fusion. Barcelona, Spain."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1049\/el:20000267","article-title":"Objective image fusion performance measure","volume":"36","author":"Xydeas","year":"2000","journal-title":"IEEE Electron. Lett."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1007\/BF02295996","article-title":"Note on the sampling error of the difference between correlated proportions or percentages","volume":"12","author":"McNemar","year":"1947","journal-title":"Psychometrika"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"857","DOI":"10.1109\/LSP.2014.2317773","article-title":"Dynamically-Sampled Bivariate Empirical Mode Decomposition","volume":"21","author":"Rehman","year":"2014","journal-title":"IEEE Signal Process. Lett."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/5\/10923\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:46:01Z","timestamp":1760215561000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/5\/10923"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,5,8]]},"references-count":42,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2015,5]]}},"alternative-id":["s150510923"],"URL":"https:\/\/doi.org\/10.3390\/s150510923","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2015,5,8]]}}}