{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T16:42:09Z","timestamp":1764002529284,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2022,5,26]],"date-time":"2022-05-26T00:00:00Z","timestamp":1653523200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["51879211"],"award-info":[{"award-number":["51879211"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>With the popularization of the concept of \u201cmetaverse\u201d, Augmented Reality (AR) technology is slowly being applied to people\u2019s daily life as its underlying technology support. In recent years, rapid 3D reconstruction of interior furniture to meet AR shopping needs has become a new method. In this paper, a virtual home environment system is designed and the related core technologies in the system are studied. Background removal and instance segmentation are performed for furniture images containing complex backgrounds, and a Bayesian Classifier and GrabCut (BCGC) algorithm is proposed to improve on the traditional foreground background separation technique. The reconstruction part takes the classical occupancy network reconstruction algorithm as the network basis and proposes a precise occupancy network (PONet) algorithm, which can reconstruct the structural details of furniture images, and the model accuracy is improved. Because the traditional 3D registration model is prone to the problems of model position shift and inaccurate matching with the scene, the AKAZE-based tracking registration algorithm is improved, and a Multiple Filtering-AKAZE (MF-AKAZE) based on AKAZE is proposed to remove the matching points. The matching accuracy is increased by improving the RANSAC filtering mis-matching algorithm based on further screening of the matching results. Finally, the system is verified to realize the function of the AR visualization furniture model, which can better complete the reconstruction as well as registration effect.<\/jats:p>","DOI":"10.3390\/s22114020","type":"journal-article","created":{"date-parts":[[2022,5,31]],"date-time":"2022-05-31T02:30:06Z","timestamp":1653964206000},"page":"4020","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Home Environment Augmented Reality System Based on 3D Reconstruction of a Single Furniture Picture"],"prefix":"10.3390","volume":"22","author":[{"given":"Hongtao","family":"Wei","sequence":"first","affiliation":[{"name":"College of Information Engineering, Wuhan University of Technology, Wuhan 430070, China"}]},{"given":"Lei","family":"Tang","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Wuhan University of Technology, Wuhan 430070, China"}]},{"given":"Wenshuo","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Wuhan University of Technology, Wuhan 430070, China"}]},{"given":"Jiaming","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Wuhan University of Technology, Wuhan 430070, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Dutta, R., Mantri, A., Singh, G., Kumar, A., and Kaur, D.P. (2021, January 26\u201328). Evaluating Usability of Mobile Augmented Reality System for Enhancing the Learning Experience. Proceedings of the 2021 Sixth International Conference on Image Information Processing (ICIIP), Noida, India.","DOI":"10.1109\/ICIIP53038.2021.9702603"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Sridhar, S., and Sanagavarapu, S. (2020, January 26\u201327). Instant Tracking-Based Approach for Interior D\u00e9cor Planning with Markerless AR. Proceedings of the 2020 Zooming Innovation in Consumer Technologies Conference (ZINC), Novi Sad, Serbia.","DOI":"10.1109\/ZINC50678.2020.9161789"},{"key":"ref_3","unstructured":"Silver, D., Hasselt, H., Hessel, M., Schaul, T., Guez, A., Harley, T., Arnold, G.D., Reichert, D., Rabinowitz, N., and Barreto, A. (2017, January 6\u201311). The predictron: End-to-end learning and planning. Proceedings of the International conference on machine learning (PMLR), Sydney, Australia."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Choy, C.B., Xu, D., Gwak, J., Chen, K., and Savarese, S. (2016, January 11\u201314). 3d-r2n2: A unified approach for single and multi-view 3d object reconstruction. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46484-8_38"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Fan, H., Su, H., and Guibas, L.J. (2017, January 21\u201326). A point set generation network for 3d object reconstruction from a single image. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.264"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Newell, A., Yang, K., and Deng, J. (2016, January 11\u201314). Stacked hourglass networks for human pose estimation. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46484-8_29"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Kato, H., Ushiku, Y., and Harada, T. (2018, January 18\u201323). Neural 3d mesh renderer. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake, UT, USA.","DOI":"10.1109\/CVPR.2018.00411"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Pontes, J.K., Kong, C., Sridharan, S., Lucey, S., Eriksson, A., and Fookes, C. (2018, January 2\u20136). Image2mesh: A learning framework for single image 3d reconstruction. Proceedings of the Asian Conference on Computer Vision, Perth, WA, Australia.","DOI":"10.1007\/978-3-030-20887-5_23"},{"key":"ref_9","first-page":"240","article-title":"Fpnn: Field probing neural networks for 3d data","volume":"29","author":"Li","year":"2016","journal-title":"Adv. Neural Inf. Processing Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Park, J.J., Florence, P., Straub, J., Newcombe, R., and Lovegrove, S. (2019, January 15\u201320). Deepsdf: Learning continuous signed distance functions for shape representation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00025"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Mescheder, L., Oechsle, M., Niemeyer, M., Nowozin, S., and Geiger, A. (2019, January 15\u201320). Occupancy networks: Learning 3d reconstruction in function space. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00459"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Peng, S., Niemeyer, M., Mescheder, L., Pollefeys, M., and Geiger, A. (2020, January 23\u201328). Convolutional occupancy networks. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58580-8_31"},{"key":"ref_13","first-page":"104","article-title":"Artoolkit 3d registration based on dynamic feature template matching","volume":"34","author":"Xiaomei","year":"2017","journal-title":"Comput. Appl. Softw."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"8810991","DOI":"10.1155\/2021\/8810991","article-title":"An improved 3D registration method of mobile augmented reality for urban built environment","volume":"2021","author":"Wu","year":"2021","journal-title":"Int. J. Comput. Games Technol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"9625","DOI":"10.1364\/AO.57.009625","article-title":"Research of the three-dimensional tracking and registration method based on multiobjective constraints in an AR system","volume":"57","author":"An","year":"2018","journal-title":"Appl. Opt."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/s11263-006-0002-3","article-title":"Automatic panoramic image stitching using invariant features","volume":"74","author":"Brown","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-up robust features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 IEEE International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Calonder, M., Lepetit, V., Strecha, C., and Fua, P. (2010, January 5\u201311). BRIEF: Binary robust independent elementary features. Proceedings of the 11th European Conference on Computer Vision, Heraklion, Greece.","DOI":"10.1007\/978-3-642-15561-1_56"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhou, L., Zhu, S., Shen, T., Wang, J., Fang, T., and Quan, L. (2017, January 22\u201329). Progressive large scale-invariant image matching in scale space. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.259"},{"key":"ref_21","first-page":"20","article-title":"A novel and fast blurred image matching method","volume":"4","author":"Huang","year":"2021","journal-title":"Acad. J. Comput. Inf. Sci."},{"key":"ref_22","first-page":"1145569","article-title":"SIFT in GMS-selected areas: A method for feature point matching between photographs and rendered images. Sixth Symposium on Novel Optoelectronic Detection Technology and Applications","volume":"11455","author":"Zhou","year":"2020","journal-title":"Int. Soc. Opt. Photonics"},{"key":"ref_23","first-page":"283","article-title":"Research on matching algorithm of BOLD mask descriptor based on AKAZE","volume":"37","author":"Changzheng","year":"2020","journal-title":"Comput. Appl. Softw."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Alcantarilla, P.F., Bartoli, A., and Davison, A.J. (2012, January 7\u201313). KAZE features. Proceedings of the European Conference on Computer Vision, Florence, Italy.","DOI":"10.1007\/978-3-642-33783-3_16"},{"key":"ref_25","first-page":"1281","article-title":"Fast explicit diffusion for accelerated features in nonlinear scale spaces","volume":"34","author":"Alcantarilla","year":"2013","journal-title":"Br. Mach. Vis. Conf."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wang, N., Zhang, Y., Li, Z., Fu, Y., Liu, W., and Jiang, Y.G. (2018, January 8\u201314). Pixel2mesh: Generating 3d mesh models from single rgb images. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01252-6_4"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1007\/s41066-020-00251-1","article-title":"A method for solving linear difference equation in Gaussian fuzzy environments","volume":"7","author":"Rahaman","year":"2022","journal-title":"Granul. Comput."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Fu, H., Jia, R., Gao, L., Gong, M., Zhao, B., Maybank, S., and Tao, D. (2020). 3D-FUTURE: 3D Furniture shape with TextURE. arXiv.","DOI":"10.1007\/s11263-021-01534-z"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"5138","DOI":"10.1109\/TIP.2021.3078106","article-title":"Geodesic Paths for Image Segmentation with Implicit Region-Based Homogeneity Enhancement","volume":"30","author":"Chen","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_31","unstructured":"Xu, Q., Wang, W., Ceylan, D., Mech, R., and Neumann, U. (2019). Disn: Deep implicit surface network for high-quality single-view 3d reconstruction. Adv. Neural Inf. Processing Syst., 32."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Xie, Y., Wang, Q., Chang, Y., and Zhang, X. (2022). Fast Target Recognition Based on Improved ORB Feature. Appl. Sci., 12.","DOI":"10.3390\/app12020786"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Nuernberger, B., Ofek, E., Benko, H., and Wilson, A.D. (2016, January 7\u201312). Snaptoreality: Aligning augmented reality to the real world. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA.","DOI":"10.1145\/2858036.2858250"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/11\/4020\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:18:52Z","timestamp":1760138332000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/11\/4020"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,26]]},"references-count":33,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2022,6]]}},"alternative-id":["s22114020"],"URL":"https:\/\/doi.org\/10.3390\/s22114020","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,5,26]]}}}