{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,6]],"date-time":"2026-08-06T21:29:29Z","timestamp":1786051769035,"version":"3.56.0"},"reference-count":49,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2019,1,31]],"date-time":"2019-01-31T00:00:00Z","timestamp":1548892800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61501286,61877038,61672333,61671385,61402274,61703096"],"award-info":[{"award-number":["61501286,61877038,61672333,61671385,61402274,61703096"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the Key Research and Development Program in Shaanxi Province","award":["2018GY-008"],"award-info":[{"award-number":["2018GY-008"]}]},{"name":"the Natural Science Basic Research Plan in Shaanxi Province of China","award":["2018JM6030, 2018JM6068"],"award-info":[{"award-number":["2018JM6030, 2018JM6068"]}]},{"name":"the Fundamental Research Funds for the Central Universities","award":["GK201702015"],"award-info":[{"award-number":["GK201702015"]}]},{"name":"the Natural Science Foundation of Jiangsu Province","award":["BK20170691"],"award-info":[{"award-number":["BK20170691"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>With the three-dimensional (3D) coordinates of objects captured by a sequence of images taken in different views, object reconstruction is a technique which aims to recover the shape and appearance information of objects. Although great progress in object reconstruction has been made over the past few years, object reconstruction in occlusion situations remains a challenging problem. In this paper, we propose a novel method to reconstruct occluded objects based on synthetic aperture imaging. Unlike most existing methods, which either assume that there is no occlusion in the scene or remove the occlusion from the reconstructed result, our method uses the characteristics of synthetic aperture imaging that can effectively reduce the influence of occlusion to reconstruct the scene with occlusion. The proposed method labels occlusion pixels according to variance and reconstructs the 3D point cloud based on synthetic aperture imaging. Accuracies of the point cloud are tested by calculating the spatial difference between occlusion and non-occlusion conditions. The experiment results show that the proposed method can handle the occluded situation well and demonstrates a promising performance.<\/jats:p>","DOI":"10.3390\/s19030607","type":"journal-article","created":{"date-parts":[[2019,2,1]],"date-time":"2019-02-01T03:08:05Z","timestamp":1548990485000},"page":"607","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Occluded-Object 3D Reconstruction Using Camera Array Synthetic Aperture Imaging"],"prefix":"10.3390","volume":"19","author":[{"given":"Zhao","family":"Pei","sequence":"first","affiliation":[{"name":"Key Laboratory of Modern Teaching Technology, Ministry of Education, Xi\u2019an 710119, China"},{"name":"School of Computer Science, Shaanxi Normal University, Xi\u2019an 710119, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yawen","family":"Li","sequence":"additional","affiliation":[{"name":"School of Computer Science, Shaanxi Normal University, Xi\u2019an 710119, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Miao","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Computer Science, Shaanxi Normal University, Xi\u2019an 710119, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jun","family":"Li","sequence":"additional","affiliation":[{"name":"School of Computer Science, Nanjing Normal University, Nanjing 210046, China"},{"name":"School of Automation, Southeast University, Nanjing 210096, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chengcai","family":"Leng","sequence":"additional","affiliation":[{"name":"School of Mathematics, Northwest University, Xi\u2019an 710127, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoqiang","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Southwest University of Science and Technology, Mianyang 621010, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanning","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science, Northwestern Polytechnical University, Xi\u2019an 710129, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Agarwal, S., Snavely, N., Simon, I., Seitz, S.M., and Szeliski, R. (October, January 29). Building Rome in a day. Proceedings of the International Conference on Computer Vision (ICCV 2009), Kyoto, Japan.","DOI":"10.1109\/ICCV.2009.5459148"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Frahm, J.M., Fite-Georgel, P., Gallup, D., Johnson, T., Raguram, R., Wu, C., Jen, Y.-H., Dunn, E., Clipp, B., and Pollefeys, M. (2010, January 5\u201311). Building Rome on a Cloudless Day. Proceedings of the European conference on computer vision (ECCV 2010), Crete, Greece.","DOI":"10.1007\/978-3-642-15561-1_27"},{"key":"ref_3","unstructured":"Wu, C. (July, January 29). Towards Linear-Time Incremental Structure from Motion. Proceedings of the International Conference on 3D Vision, Lyon, France."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Schonberger, J.L., Radenovic, F., Chum, O., and Frahm, J.M. (2015, January 7\u201312). From single image query to detailed 3D reconstruction. Proceedings of the Computer Vision and Pattern Recognition (CVPR 2015), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299148"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Radenovic, F., Schonberger, J.L., Ji, D., Frahm, J.M., Chum, O., and Matas, J. (2016, January 27\u201330). From Dusk Till Dawn: Modeling in the Dark. Proceedings of the Computer Vision and Pattern Recognition (CVPR 2016), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.592"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Heinly, J., Schonberger, J.L., Dunn, E., and Frahm, J.M. (2015, January 7\u201312). Reconstructing the world in six days. Proceedings of the Computer Vision and Pattern Recognition (CVPR 2015), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298949"},{"key":"ref_7","unstructured":"Vaish, V., Wilburn, B., Joshi, N., and Levoy, M. (July, January 27). Using plane + parallax for calibrating dense camera arrays. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2004), Washington, DC, USA."},{"key":"ref_8","unstructured":"Vaish, V., Garg, G., Talvala, E.V., Antunez, E., Wilburn, B., Horowitz, M., and Levoy, M. (2005, January 21\u201323). Synthetic Aperture Focusing using a Shear-Warp Factorization of the Viewing Transform. Proceedings of the Computer Vision and Pattern Recognition (CVPR Workshops 2005), San Diego, CA, USA."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Pei, Z., Zhang, Y., Yang, T., and Chen, X. (2012, January 29\u201331). A novel method for detecting occluded object by multiple camera arrays. Proceedings of the International Conference on Fuzzy Systems and Knowledge Discovery, Chongqing, China.","DOI":"10.1109\/FSKD.2012.6234235"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1637","DOI":"10.1016\/j.patcog.2011.10.003","article-title":"A novel multi-object detection method in complex scene using synthetic aperture imaging","volume":"45","author":"Pei","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Whiting, E., Ouf, N., Makatura, L., Mousas, C., Shu, Z., and Kavan, L. (2017, January 6\u201311). Environment-Scale Fabrication. Proceedings of the CHI Conference on Human Factors in Computing Systems, Denver, CO, USA.","DOI":"10.1145\/3025453.3025465"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Qian, Y., Zheng, Y., Gong, M., and Yang, Y.H. (2018, January 8\u201314). Simultaneous 3D Reconstruction for Water Surface and Underwater Scene. Proceedings of the European conference on computer vision (ECCV 2018), Munich, Germany.","DOI":"10.1007\/978-3-030-01219-9_46"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Xu, X., Che, R., Nian, R., He, B., Chen, M., and Lendasse, A. (2016, January 10\u201313). Underwater 3D object reconstruction with multiple views in video stream via structure from motion. Proceedings of the OCEANS, Shanghai, China.","DOI":"10.1109\/OCEANSAP.2016.7485694"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ebner, T., Schreer, O., and Feldmann, I. (2017, January 17\u201320). Fully automated highly accurate 3D reconstruction from multiple views. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8296738"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1901","DOI":"10.1109\/TIP.2013.2237921","article-title":"Accurate Multiple View 3D Reconstruction Using Patch-Based Stereo for Large-Scale Scenes","volume":"22","author":"Shen","year":"2013","journal-title":"Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Beardsley, P., Torr, P., and Zisserman, A. (1996, January 14\u201318). 3D model acquisition from extended image sequences. Proceedings of the European Conference on Computer Vision, Cambridge, UK.","DOI":"10.1007\/3-540-61123-1_181"},{"key":"ref_17","unstructured":"Mohr, R., Veillon, F., and Quan, L. (1995, January 14). Relative 3-D reconstruction using multiple uncalibrated images. Proceedings of the Computer Vision and Pattern Recognition (CVPR 1995), New York, NY, USA."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Fitzgibbon, A.W., and Zisserman, A. (1998, January 2\u20136). Automatic camera recovery for closed or open image sequences. Proceedings of the European conference on computer vision (ECCV 1998), Freiburg, Germany.","DOI":"10.1007\/BFb0055675"},{"key":"ref_19","unstructured":"Dellaert, F., Seitz, S., Thorpe, C., and Thrun, S. (2000, January 15). Structure from motion without correspondence. Proceedings of the Computer Vision and Pattern Recognition (CVPR 2000), Hilton Head Island, SC, USA."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1023\/B:VISI.0000025798.50602.3a","article-title":"Visual Modeling with a Hand-Held Camera","volume":"59","author":"Pollefeys","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Schaffalitzky, F., and Zisserman, A. (2002, January 28\u201331). Multi-view Matching for Unordered Image Sets, or \u201cHow Do I Organize My Holiday Snaps?\u201d. Proceedings of the European Conference on Computer Vision (ECCV 2002), Copenhagen, Denmark.","DOI":"10.1007\/3-540-47969-4_28"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Snavely, N., Seitz, S.M., and Szeliski, R. (2006, January 29\u201330). Photo tourism. Proceedings of the ACM SIGGRAPH, Boston, MA, USA.","DOI":"10.1145\/1179352.1141964"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1007\/s11263-007-0086-4","article-title":"Detailed Real-Time Urban 3D Reconstruction from Video","volume":"78","author":"Pollefeys","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Schonberger, J.L., and Frahm, J.M. (July, January 26). Structure-from-Motion Revisited. Proceedings of the Computer Vision and Pattern Recognition (CVPR 2016), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.445"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wilburn, B., Smulski, M., Lee, K., and Horowitz, M.A. (2002, January 19\u201325). The Light Field Video Camera. Proceedings of the Media Processors, San Jose, CA, USA.","DOI":"10.1117\/12.451074"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhang, C., and Chen, T. (2004, January 8\u201312). A self-reconfigurable camera array. Proceedings of the ACM SIGGRAPH, Los Angeles, CA, USA.","DOI":"10.1145\/1186223.1186412"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Joshi, N., Avidan, S., Matusik, W., and Kriegman, D.J. (2007, January 14\u201321). Synthetic Aperture Tracking: Tracking through Occlusions. Proceedings of the International Conference on Computer Vision (ICCV 2007), Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4409032"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Fujii, T., Mori, K., Takeda, K., Mase, K., Tanimoto, M., and Suenaga, Y. (2006, January 9\u201312). Multipoint Measuring System for Video and Sound-100-Camera and Microphone System. Proceedings of the International Conference on Multimedia and Expo (ICME 2006), Toronto, ON, Canada.","DOI":"10.1109\/ICME.2006.262566"},{"key":"ref_29","unstructured":"Lei, C., Chen, X.D., and Yang, Y.H. (October, January 29). A new multiview spacetime-consistent depth recovery framework for free viewpoint video rendering. Proceedings of the International Conference on Computer Vision (ICCV 2009), Kyoto, Japan."},{"key":"ref_30","unstructured":"Wilburn, B., Joshi, N., Vaish, V., Levoy, M., and Horowitz, M. (July, January 27). High-speed videography using a dense camera array. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2004), Washington, DC, USA."},{"key":"ref_31","unstructured":"Wilburn, B., Joshi, N., Vaish, V., Talvala, E.V., Antunez, E., Barth, A., Adams, A., Horowitz, M., and Levoy, M. (August, January 31). High performance imaging using large camera arrays. Proceedings of the ACM Transactions on Graphics (TOG), Los Angeles, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Ga\u0161parovi\u0107, M., and Gajski, D. (2016, January 12\u201319). Two-step camera calibration method developed for micro UAV\u2019s. Proceedings of the XXIII ISPRS Congress, Prague, Czech Republic.","DOI":"10.5194\/isprsarchives-XLI-B1-829-2016"},{"key":"ref_33","first-page":"C22","article-title":"Digital camera calibration using images taken from an unmanned aerial vehicle","volume":"38","author":"Carvajal","year":"2011","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_34","first-page":"311","article-title":"Low cost surveying using an unmanned aerial vehicle","volume":"40","author":"Carvajal","year":"2013","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1109\/JDT.2010.2049191","article-title":"3D Integral Imaging Reconstruction of Occluded Objects Using Independent Component Analysis-Based K-Means Clustering","volume":"6","author":"Do","year":"2010","journal-title":"J. Disp. Technol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1109\/TCSVT.2016.2615328","article-title":"All-In-Focus Synthetic Aperture Imaging Using Image Matting","volume":"28","author":"Pei","year":"2018","journal-title":"Trans. Circuits Syst. Video Technol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/j.patcog.2012.06.014","article-title":"Synthetic aperture imaging using pixel labeling via energy minimization","volume":"46","author":"Pei","year":"2013","journal-title":"Pattern Recognit."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Pei, Z., Zhang, Y., Yang, T., and Chen, X. (2012, January 29\u201331). Synthetic aperture image quality assessment based on camera array: Measures and their performance. Proceedings of the International Conference on Fuzzy Systems and Knowledge Discovery, Chongqing, China.","DOI":"10.1109\/FSKD.2012.6234234"},{"key":"ref_39","unstructured":"Seitz, S., and Dyer, C. (1997, January 17\u201319). Photorealistic scene reconstruction by voxel coloring. Proceedings of the Computer Vision and Pattern Recognition (CVPR 1997), San Juan, Puerto Rico."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Kutulakos, K., and Seitz, S. (1999, January 20\u201327). A theory of shape by space carving. Proceedings of the Seventh International Conference on Computer Vision (ICCV 1999), Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.791235"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1111\/j.1467-8659.2009.01627.x","article-title":"Shared Sampling for Real-Time Alpha Matting","volume":"29","author":"Gastal","year":"2010","journal-title":"Comput. Graph. Forum"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"377","DOI":"10.5194\/isprs-archives-XLII-1-W1-377-2017","article-title":"3D Data Acquisition Based on OpenCV for Close-Range Photogrammetry Applications","volume":"XLII-1\/W1","year":"2017","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.jas.2016.01.002","article-title":"Accurate measurement with photogrammetry at large sites","volume":"66","author":"Sapirstein","year":"2016","journal-title":"J. Archaeol. Sci."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.catena.2015.04.004","article-title":"Measuring gullies by synergetic application of UAV and close range photogrammetry\u2014A case study from Andalusia, Spain","volume":"132","author":"Eltner","year":"2015","journal-title":"Catena"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Moulon, P., Monasse, P., and Marlet, R. (2012, January 5\u20139). Adaptive Structure from Motion with a Contrario Model Estimation. Proceedings of the Asian Computer Vision Conference (ACCV 2012), Daejeon, Korea.","DOI":"10.1007\/978-3-642-37447-0_20"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Jancosek, M., and Pajdla, T. (2011, January 20\u201325). Multi-view reconstruction preserving weakly-supported surfaces. Proceedings of the Computer Vision and Pattern Recognition (CVPR 2011), Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995693"},{"key":"ref_47","first-page":"1","article-title":"Comparison of Image Quality Assessment: PSNR, HVS, SSIM, UIQI","volume":"3","year":"2012","journal-title":"Int. J. Sci. Eng. Res."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"93","DOI":"10.5194\/isprsarchives-XXXIX-B5-93-2012","article-title":"Increase of readability and accuracy of 3D models using fusion of close range phorogrammetry and laser scanning","volume":"XXXIX-B5","year":"2012","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_49","first-page":"253","article-title":"Testing of Image Quality Parameters of Digital Cameras for Photogrammetric Surveying with Unmanned Aircrafts","volume":"70","author":"Gasparovic","year":"2016","journal-title":"Geodetski List"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/3\/607\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:30:02Z","timestamp":1760185802000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/3\/607"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,31]]},"references-count":49,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["s19030607"],"URL":"https:\/\/doi.org\/10.3390\/s19030607","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,31]]}}}