{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:44:45Z","timestamp":1760240685673,"version":"build-2065373602"},"reference-count":30,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2019,9,2]],"date-time":"2019-09-02T00:00:00Z","timestamp":1567382400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>In this paper, a multi-focus image stack captured by varying positions of the imaging plane is processed to synthesize an all-in-focus (AIF) image and estimate its corresponding depth map. Compared with traditional methods (e.g., pixel- and block-based techniques), our focus-based measures are calculated based on irregularly shaped regions that have been refined or split in an iterative manner, to adapt to different image contents. An initial all-focus image is first computed, which is then segmented to get a region map. Spatial-focal property for each region is then analyzed to determine whether a region should be iteratively split into sub-regions. After iterative splitting, the final region map is used to perform regionally best focusing, based on the Winner-take-all (WTA) strategy, i.e., choosing the best focused pixels from image stack. The depth image can be easily converted from the resulting label image, where the label for each pixel represents the image index from which the pixel with the best focus is chosen. Regions whose focus profiles are not confident in getting a winner of the best focus will resort to spatial propagation from neighboring confident regions. Our experiments show that the adaptive region-splitting algorithm outperforms other state-of-the-art methods or commercial software in synthesis quality (in terms of a well-known Q metric), depth maps (in terms of subjective quality), and processing speed (with a gain of 17.81~40.43%).<\/jats:p>","DOI":"10.3390\/jimaging5090073","type":"journal-article","created":{"date-parts":[[2019,9,3]],"date-time":"2019-09-03T03:06:14Z","timestamp":1567479974000},"page":"73","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Multi-Focus Image Fusion and Depth Map Estimation Based on Iterative Region Splitting Techniques"],"prefix":"10.3390","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8166-2844","authenticated-orcid":false,"given":"Wen-Nung","family":"Lie","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, Center for Innovative Research on Aging Society (CIRAS), and Advanced Institute of Manufacturing with High-tech Innovations (AIM-HI), National Chung Cheng University, Chia-Yi 621, Taiwan"}]},{"given":"Chia-Che","family":"Ho","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Center for Innovative Research on Aging Society (CIRAS), and Advanced Institute of Manufacturing with High-tech Innovations (AIM-HI), National Chung Cheng University, Chia-Yi 621, Taiwan"}]}],"member":"1968","published-online":{"date-parts":[[2019,9,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lie, W.N., and Ho, C.C. (2015, January 25\u201327). All-focus Image Fusion and Depth Image Estimation Based on Iterative Splitting Technique for Multi-focus Images. Proceedings of the 2015 Pacific-Rim Symposium on Image and Video Technology, PSIVT\u201915, Auckland, New Zealand.","DOI":"10.1007\/978-3-319-29451-3_47"},{"key":"ref_2","unstructured":"Wong, E. (2006, January 14\u201319). A New Method for Creating a Depth Map for Camera Auto Focus Using an All in Focus Picture and 2D Scale Space Matching. Proceedings of the 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings, Toulouse, France."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Chen, Y.C., Wu, Y.C., Liu, C.H., Sun, W.C., and Chen, Y.C. (2010, January 11\u201314). Depth Map Generation Based on Depth from Focus. Proceedings of the 2010 International Conference on Electronic Devices, Systems and Applications, Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICEDSA.2010.5503103"},{"key":"ref_4","unstructured":"Zhou, C., Miau, D., and Nayar, S.K. (2012). Focal Sweep Camera for Space-Time Refocusing, Department of Computer Science, Columbia University. Technical Report."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.inffus.2016.05.004","article-title":"Pixel-level image fusion: A survey of the state of the art","volume":"33","author":"Li","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_6","unstructured":"Yokota, A., Yoshida, T., Kashiyama, H., and Hamamoto, T. (2005, January 23\u201326). High speed Sensing System for Depth Estimation Based on Depth from Focus by Using Smart Imager. Proceedings of the 2005 IEEE International Symposium on Circuits and Systems, Kobe, Japan."},{"key":"ref_7","unstructured":"Pedraza, J.C., Ohba, K., Rodriguez, J.W., and Tanie, K. (November, January 29). All in Focus Camera Vision System for Robot Navigation and Manipulation based on the DFF criteria. Proceedings of the 2001 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Maui, HI, USA."},{"key":"ref_8","first-page":"67","article-title":"Research on Fast Image Based Auto Focus Technique","volume":"3","author":"Cheng","year":"2008","journal-title":"J. Inf. Technol. Appl."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1016\/j.inffus.2016.12.009","article-title":"Surface area-based focus criterion for multi-focus image fusion","volume":"36","author":"Nejati","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.sigpro.2017.03.008","article-title":"Multi-focus image fusion via fixed window technique of multiscale images and non-local means filtering","volume":"138","author":"Li","year":"2017","journal-title":"Signal Process."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Li, Q.P., Du, J.P., Song, F., Wang, C., Liu, H.G., and Lu, C. (2013, January 25\u201327). Region-based multi-focus image fusion using the local spatial frequency. Proceedings of the 25th Chinese Control and Decision Conference (CCDC), Guiyang, China.","DOI":"10.1109\/CCDC.2013.6561609"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zeng, Y.C. (November, January 29). Generation of all-focus images and depth-adjustable images based on pixel blurriness. Proceedings of the 2013 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, Kaohsiung, Taiwan.","DOI":"10.1109\/APSIPA.2013.6694253"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1242","DOI":"10.1109\/TIP.2012.2231087","article-title":"Generation of All-in-Focus Images by Noise-Robust Selective Fusion of Limited Depth-of-Field Images","volume":"22","author":"Pertuz","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3634","DOI":"10.1109\/TIP.2011.2150235","article-title":"Generalized Random Walks for Fusion of Multi-Exposure Images","volume":"20","author":"Shen","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chen, Y., and Cham, W.K. (2015, January 27\u201330). Edge model based fusion of multi-focus images using matting method. Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, Canada.","DOI":"10.1109\/ICIP.2015.7351119"},{"key":"ref_16","unstructured":"Shah, P., Kumar, A., Merchant, S.N., and Desai, U.B. (2012, January 9\u201312). Multifocus image fusion algorithm using iterative segmentation based on edge information and adaptive threshold. Proceedings of the 15th International Conference on Information Fusion, Singapore."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lee, J.Y., Park, S.O., and Park, R.H. (2016, January 9\u201311). Reconstruction of an all-in-focus image by region-adaptive fusion of limited depth-of-field images. Proceedings of the 2016 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA.","DOI":"10.1109\/ICCE.2016.7430621"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.inffus.2016.09.006","article-title":"Boundary finding based multi-focus image fusion through multi-scale morphological focus-measure","volume":"35","author":"Zhang","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.inffus.2014.05.003","article-title":"Quadtree-based multi-focus image fusion using a weighted focus-measure","volume":"22","author":"Bai","year":"2015","journal-title":"Inf. Fusion"},{"key":"ref_20","first-page":"1","article-title":"Multi-focus Image Fusion Based on Image Decomposition and Quad Tree Decomposition","volume":"25","author":"Zhang","year":"2014","journal-title":"J. Comput."},{"key":"ref_21","unstructured":"Lee, K., and Ji, S. (2015, January 1\u20134). Multi-focus image fusion using energy of image gradient and gradual boundary smoothing. Proceedings of the TENCON 2015\u20142015 IEEE Region 10 Conference, Dunhuang, China."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.inffus.2016.12.001","article-title":"Multi-focus image fusion with a deep convolutional neural network","volume":"36","author":"Liu","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.sigpro.2016.01.014","article-title":"Multi-focus image fusion based on depth extraction with inhomogeneous diffusion equation","volume":"125","author":"Xiao","year":"2016","journal-title":"Signal Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.inffus.2016.09.007","article-title":"A novel multi-focus image fusion approach based on image decomposition","volume":"35","author":"Liu","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.sigpro.2016.01.006","article-title":"A new multi-focus image fusion based on spectrum comparison","volume":"123","author":"Zhang","year":"2016","journal-title":"Signal Process."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1016\/j.ins.2017.09.010","article-title":"A novel multi-modality image fusion method based on image decomposition and sparse representation","volume":"432","author":"Zhu","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1109\/34.1000236","article-title":"Mean shift: A robust approach toward feature space analysis","volume":"24","author":"Comaniciu","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A Threshold Selection Method from Gray-Level Histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_29","unstructured":"Yan, X., Yang, Y., Er, G.H., and Dai, Q.H. (2011, January 16\u201318). Depth map generation for 2D-to-3D conversion by limited user inputs and depth propagation. Proceedings of the 2011 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), Antalya, Turkey."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1049\/el:20000267","article-title":"Objective image fusion performance measure","volume":"36","author":"Xydeas","year":"2000","journal-title":"Electron. Lett."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/5\/9\/73\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:16:05Z","timestamp":1760188565000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/5\/9\/73"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,2]]},"references-count":30,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2019,9]]}},"alternative-id":["jimaging5090073"],"URL":"https:\/\/doi.org\/10.3390\/jimaging5090073","relation":{},"ISSN":["2313-433X"],"issn-type":[{"type":"electronic","value":"2313-433X"}],"subject":[],"published":{"date-parts":[[2019,9,2]]}}}