{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,18]],"date-time":"2026-01-18T10:12:19Z","timestamp":1768731139764,"version":"3.49.0"},"reference-count":52,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2019,1,25]],"date-time":"2019-01-25T00:00:00Z","timestamp":1548374400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union\u2019s Framework Programme for Research and Innovation Horizon 2020 (2014-2020) under the Marie Sk\u0142odowska-Curie Actions Grant Agreement","award":["676401"],"award-info":[{"award-number":["676401"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Light field technologies have seen a rise in recent years and microscopy is a field where such technology has had a deep impact. The possibility to provide spatial and angular information at the same time and in a single shot brings several advantages and allows for new applications. A common goal in these applications is the calculation of a depth map to reconstruct the three-dimensional geometry of the scene. Many approaches are applicable, but most of them cannot achieve high accuracy because of the nature of such images: biological samples are usually poor in features and do not exhibit sharp colors like natural scene. Due to such conditions, standard approaches result in noisy depth maps. In this work, a robust approach is proposed where accurate depth maps can be produced exploiting the information recorded in the light field, in particular, images produced with Fourier integral Microscope. The proposed approach can be divided into three main parts. Initially, it creates two cost volumes using different focal cues, namely correspondences and defocus. Secondly, it applies filtering methods that exploit multi-scale and super-pixels cost aggregation to reduce noise and enhance the accuracy. Finally, it merges the two cost volumes and extracts a depth map through multi-label optimization.<\/jats:p>","DOI":"10.3390\/s19030500","type":"journal-article","created":{"date-parts":[[2019,1,25]],"date-time":"2019-01-25T11:30:00Z","timestamp":1548415800000},"page":"500","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["Robust Depth Estimation for Light Field Microscopy"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9701-1915","authenticated-orcid":false,"given":"Luca","family":"Palmieri","sequence":"first","affiliation":[{"name":"Department of Computer Science, Christian-Albrecht-University, 24118 Kiel, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gabriele","family":"Scrofani","sequence":"additional","affiliation":[{"name":"Department of Optics, University of Valencia, E-46100 Burjassot, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicol\u00f2","family":"Incardona","sequence":"additional","affiliation":[{"name":"Department of Optics, University of Valencia, E-46100 Burjassot, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Genaro","family":"Saavedra","sequence":"additional","affiliation":[{"name":"Department of Optics, University of Valencia, E-46100 Burjassot, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1449-8976","authenticated-orcid":false,"given":"Manuel","family":"Mart\u00ednez-Corral","sequence":"additional","affiliation":[{"name":"Department of Optics, University of Valencia, E-46100 Burjassot, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Reinhard","family":"Koch","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Christian-Albrecht-University, 24118 Kiel, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"924","DOI":"10.1145\/1141911.1141976","article-title":"Light field microscopy","volume":"25","author":"Levoy","year":"2006","journal-title":"ACM Trans. Graph."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1111\/j.1365-2818.2009.03195.x","article-title":"Recording and controlling the 4D light field in a microscope using microlens arrays","volume":"235","author":"Levoy","year":"2009","journal-title":"J. Microsc."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"25418","DOI":"10.1364\/OE.21.025418","article-title":"Wave optics theory and 3-D deconvolution for the light field microscope","volume":"21","author":"Broxton","year":"2013","journal-title":"Opt. Express"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"24817","DOI":"10.1364\/OE.22.024817","article-title":"Enhancing the performance of the light field microscope using wavefront coding","volume":"22","author":"Cohen","year":"2014","journal-title":"Opt. Express"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1080\/15980316.2015.1027749","article-title":"Analysis of the pickup and display property of integral floating microscopy","volume":"16","author":"Hong","year":"2015","journal-title":"J. Inf. Disp."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"20792","DOI":"10.1364\/OE.24.020792","article-title":"Resolution improvements in integral microscopy with Fourier plane recording","volume":"24","author":"Llavador","year":"2016","journal-title":"Opt. Express"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1364\/BOE.9.000335","article-title":"FIMic: Design for ultimate 3D-integral microscopy of in-vivo biological samples","volume":"9","author":"Scrofani","year":"2018","journal-title":"Biomed. Opt. Express"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1038\/nmeth.2964","article-title":"Simultaneous whole-animal 3D imaging of neuronal activity using light-field microscopy","volume":"11","author":"Prevedel","year":"2014","journal-title":"Nat. Methods"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"e28158","DOI":"10.7554\/eLife.28158","article-title":"Rapid whole brain imaging of neural activity in freely behaving larval zebrafish (Danio rerio)","volume":"6","author":"Cong","year":"2017","journal-title":"eLife"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1364\/OPTICA.3.000517","article-title":"Compressive light-field microscopy for 3D neural activity recording","volume":"3","author":"Liu","year":"2016","journal-title":"Optica"},{"key":"ref_11","unstructured":"Olympus Stream (2018, December 19). Industrial Microscope. Available online: https:\/\/www.olympus-ims.com\/en\/microscope\/stream2\/#!."},{"key":"ref_12","unstructured":"Sensofar (2018, December 19). 3D Surface Metrology Applications. Available online: https:\/\/www.sensofar.com\/metrology\/technology\/."},{"key":"ref_13","unstructured":"Lucideon (2018, December 17). Three Dimensional Scanning Electron Microscopy (3D SEM). Available online: https:\/\/www.lucideon.com\/testing-characterization\/techniques\/three-dimensional-scanning-electron-microscopy-3dsem."},{"key":"ref_14","unstructured":"Zygo (2018, December 17). 3D Optical Surface Profilers. Available online: https:\/\/www.zygo.com\/?\/met\/profilers\/."},{"key":"ref_15","unstructured":"Filmetrics (2018, December 19). The World\u2019s First $19k 3D Profilometer: The Profilm3D. Available online: https:\/\/www.filmetrics.com\/profilometers\/profilm3d."},{"key":"ref_16","unstructured":"FLIR\u2014Machine Vision (2018, December 18). Rolling Down the Cost of 3D Confocal Microscopy. Available online: https:\/\/www.ptgrey.com\/case-study\/id\/10878."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"26373","DOI":"10.1364\/OE.18.026373","article-title":"Reconstruction of three-dimensional occluded object using optical flow and triangular mesh reconstruction in integral imaging","volume":"18","author":"Jung","year":"2010","journal-title":"Opt. Express"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Mignard-Debise, L., and Ihrke, I. (2015, January 19\u201322). Light-field microscopy with a consumer light-field camera. Proceedings of the 2015 International Conference on 3D Vision (3DV), Lyon, France.","DOI":"10.1109\/3DV.2015.45"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liu, C., Narasimhan, S.G., and Dubrawski, A.W. (2017, January 21\u201326). Matting and Depth Recovery of Thin Structures using a Focal Stack. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.508"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1109\/TPAMI.2013.147","article-title":"Variational light field analysis for disparity estimation and super-resolution","volume":"36","author":"Wanner","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"739","DOI":"10.1109\/TCSVT.2016.2555778","article-title":"Light-field depth estimation via epipolar plane image analysis and locally linear embedding","volume":"27","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Chen, C., Lin, H., Yu, Z., Bing Kang, S., and Yu, J. (2014, January 23\u201328). Light field stereo matching using bilateral statistics of surface cameras. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.197"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Jeon, H.G., Park, J., Choe, G., Park, J., Bok, Y., Tai, Y.W., and So Kweon, I. (2015, January 7\u201312). Accurate depth map estimation from a lenslet light field camera. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298762"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Lin, H., Chen, C., Kang, S.B., and Yu, J. (2015, January 7\u201313). Depth recovery from light field using focal stack symmetry. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.394"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Tao, M.W., Hadap, S., Malik, J., and Ramamoorthi, R. (2013, January 1\u20138). Depth from combining defocus and correspondence using light-field cameras. Proceedings of the 2013 IEEE International Conference on Computer Vision (ICCV), Sydney, Australia.","DOI":"10.1109\/ICCV.2013.89"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wang, T.C., Efros, A.A., and Ramamoorthi, R. (2015, January 7\u201313). Occlusion-aware depth estimation using light-field cameras. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chil.","DOI":"10.1109\/ICCV.2015.398"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Huang, C.T. (2017, January 22\u201329). Robust Pseudo Random Fields for Light-Field Stereo Matching. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.11"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1109\/TPAMI.2018.2794979","article-title":"Depth from a Light Field Image with Learning-based Matching Costs","volume":"41","author":"Jeon","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Palmieri, L., and Koch, R. (2017, January 21\u201326). Optimizing the Lens Selection Process for Multi-focus Plenoptic Cameras and Numerical Evaluation. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.223"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Palmieri, L., Koch, R., and Veld, R.O.H. (2018, January 7\u201310). The Plenoptic 2.0 Toolbox: Benchmarking of Depth Estimation Methods for MLA-Based Focused Plenoptic Cameras. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451073"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1109\/TCSVT.2015.2513663","article-title":"Cross-scale cost aggregation for stereo matching","volume":"27","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Circ. Syst. Video Technol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"12469","DOI":"10.1007\/s11042-017-4897-1","article-title":"Efficiency-enhanced cost-volume filtering featuring coarse-to-fine strategy","volume":"77","author":"Furuta","year":"2017","journal-title":"Multimedia Tools Appl."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"792","DOI":"10.1109\/TMM.2015.2425141","article-title":"Multi-resolution disparity processing and fusion for large high-resolution stereo image","volume":"17","author":"Lee","year":"2015","journal-title":"IEEE Trans. Multimedia"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Choi, E., Lee, S., and Hong, H. (2017). Hierarchical Stereo Matching in Two-Scale Space for Cyber-Physical System. Sensors, 17.","DOI":"10.3390\/s17071680"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Meier, L., Honegger, D., Vilhjalmsson, V., and Pollefeys, M. (June, January 29). Real-time stereo matching failure prediction and resolution using orthogonal stereo setups. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989662"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.cviu.2017.06.011","article-title":"Three-layer graph framework with the sumD feature for alpha matting","volume":"162","author":"Li","year":"2017","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"650","DOI":"10.1109\/TPAMI.2006.70","article-title":"Adaptive support-weight approach for correspondence search","volume":"28","author":"Yoon","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1109\/TPAMI.2012.156","article-title":"Fast cost-volume filtering for visual correspondence and beyond","volume":"35","author":"Hosni","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Ren, X., and Malik, J. (2003, January 13\u201316). Learning a classification model for segmentation. Proceedings of the Ninth IEEE International Conference on Computer Vision, Nice, France.","DOI":"10.1109\/ICCV.2003.1238308"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Facciolo, G., De Franchis, C., and Meinhardt, E. (2015, January 7\u201310). MGM: A Significantly More Global Matching for Stereovision. Proceedings of the British Machine Vision Conference (BMVC), Swansea, UK.","DOI":"10.5244\/C.29.90"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1068","DOI":"10.1109\/TPAMI.2007.70844","article-title":"A comparative study of energy minimization methods for markov random fields with smoothness-based priors","volume":"30","author":"Szeliski","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Meltzer, T., Yanover, C., and Weiss, Y. (2005, January 17\u201321). Globally optimal solutions for energy minimization in stereo vision using reweighted belief propagation. Proceedings of the Tenth IEEE International Conference on Computer Vision, Beijing, China.","DOI":"10.1109\/ICCV.2005.110"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Tappen, M.F., and Freeman, W.T. (2003, January 13\u201316). Comparison of graph cuts with belief propagation for stereo, using identical MRF parameters. Proceedings of the Eigth IEEE International Conference on Computer Vision, Nice, France.","DOI":"10.1109\/ICCV.2003.1238444"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1222","DOI":"10.1109\/34.969114","article-title":"Fast approximate energy minimization via graph cuts","volume":"23","author":"Boykov","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1109\/TPAMI.2004.1262177","article-title":"What energy functions can be minimized via graph cuts?","volume":"26","author":"Kolmogorov","year":"2004","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1124","DOI":"10.1109\/TPAMI.2004.60","article-title":"An experimental comparison of min-cut\/max-flow algorithms for energy minimization in vision","volume":"26","author":"Boykov","year":"2004","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"824","DOI":"10.1109\/34.308479","article-title":"Shape from Focus","volume":"16","author":"Nayar","year":"1994","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.1016\/j.patcog.2012.11.011","article-title":"Analysis of focus measure operators for shape-from-focus","volume":"46","author":"Pertuz","year":"2013","journal-title":"Pattern Recognit."},{"key":"ref_49","first-page":"2287","article-title":"Stereo matching by training a convolutional neural network to compare image patches","volume":"17","author":"Zbontar","year":"2016","journal-title":"J. Mach. Learn. Res."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Michels, T., Petersen, A., Palmieri, L., and Koch, R. (2018, January 3\u20135). Simulation of plenoptic cameras. Proceedings of the 2018\u20143DTV-Conference: The True Vision\u2014Capture, Transmission and Display of 3D Video (3DTV-CON), Helsinki, Finland.","DOI":"10.1109\/3DTV.2018.8478432"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Incardona, N., Hong, S., Mart\u00ednez-Corral, M., and Saavedra, G. (2018). New Method of Microimages Generation for 3D Display. Sensors, 18.","DOI":"10.3390\/s18092805"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1109\/JDT.2005.853354","article-title":"Three-dimensional imaging methods based on multiview images","volume":"1","author":"Son","year":"2005","journal-title":"J. Disp. Technol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/3\/500\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:28:39Z","timestamp":1760185719000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/3\/500"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,25]]},"references-count":52,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["s19030500"],"URL":"https:\/\/doi.org\/10.3390\/s19030500","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,25]]}}}