{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T18:15:25Z","timestamp":1772302525670,"version":"3.50.1"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2022,9,27]],"date-time":"2022-09-27T00:00:00Z","timestamp":1664236800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,9,27]],"date-time":"2022-09-27T00:00:00Z","timestamp":1664236800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Key Research and Development Plan of Zhejiang Provinc","award":["2019C03131"],"award-info":[{"award-number":["2019C03131"]}]},{"DOI":"10.13039\/501100010248","name":"Zhejiang Province Public Welfare Technology Application Research Project","doi-asserted-by":"publisher","award":["LGF21F020004"],"award-info":[{"award-number":["LGF21F020004"]}],"id":[{"id":"10.13039\/501100010248","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Key Lab of Film and TV Media Technology of Zhejiang Province","award":["2020E10015"],"award-info":[{"award-number":["2020E10015"]}]},{"name":"Key Research and Development Plan of Zhejiang Provinc","award":["2021C03137"],"award-info":[{"award-number":["2021C03137"]}]},{"DOI":"10.13039\/501100010248","name":"Zhejiang Province Public Welfare Technology Application Research Project","doi-asserted-by":"publisher","award":["LGF22F020008"],"award-info":[{"award-number":["LGF22F020008"]}],"id":[{"id":"10.13039\/501100010248","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Virtual Reality"],"published-print":{"date-parts":[[2023,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Mixed reality applications often require virtual objects that are partly occluded by real objects. However, previous research and commercial products have limitations in terms of performance and efficiency. To address these challenges, we propose a novel depth contour occlusion (DCO) algorithm. The proposed method is based on the sensitivity of contour occlusion and a binocular stereoscopic vision device. In this method, a depth contour map is combined with a sparse depth map obtained from a two-stage adaptive filter area stereo matching algorithm and the depth contour map of the objects extracted by a digital image stabilisation optical flow method. We also propose a quadratic optimisation model with three constraints to generate an accurate dense map of the depth contour for high-quality real-virtual occlusion. The whole process is accelerated by GPU. To evaluate the effectiveness of the algorithm, we demonstrate a time consumption statistical analysis for each stage of the DCO algorithm execution. To verify the reliability of the real-virtual occlusion effect, we conduct an experimental analysis on single-sided, enclosed, and complex occlusions. Subsequently, we compare it with the occlusion method without quadratic optimisation. With our GPU implementation for real-time DCO, the evaluation indicates that applying the presented DCO algorithm enhances the real-time performance and the visual quality of real-virtual occlusion.<\/jats:p>","DOI":"10.1007\/s10055-022-00695-7","type":"journal-article","created":{"date-parts":[[2022,9,27]],"date-time":"2022-09-27T09:03:20Z","timestamp":1664269400000},"page":"887-901","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Mixed reality depth contour occlusion using binocular similarity matching and three-dimensional contour optimisation"],"prefix":"10.1007","volume":"27","author":[{"given":"Naye","family":"Ji","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9534-1777","authenticated-orcid":false,"given":"Fan","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haoxiang","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Youbing","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dingguo","family":"Yu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,9,27]]},"reference":[{"key":"695_CR1","doi-asserted-by":"publisher","unstructured":"Berger MO (1997) Resolving occlusion in augmented reality: a contour based approach without 3d reconstruction. In: Computer Society Conference on Computer Vision and Pattern Recognition(CVPR), IEEE, pp 91\u201396. https:\/\/doi.org\/10.1109\/CVPR.1997.609304","DOI":"10.1109\/CVPR.1997.609304"},{"issue":"2","key":"695_CR2","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1109\/TPAMI.2019.2935715","volume":"43","author":"A Borji","year":"2019","unstructured":"Borji A (2019) Saliency prediction in the deep learning era: successes and limitations. IEEE Trans Pattern Anal Machine Intell 43(2):679\u2013700. https:\/\/doi.org\/10.1109\/TPAMI.2019.2935715","journal-title":"IEEE Trans Pattern Anal Machine Intell"},{"issue":"3","key":"695_CR3","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1111\/1467-8659.1530011","volume":"15","author":"DE Breen","year":"1996","unstructured":"Breen DE, Whitaker RT, Rose E et\u00a0al. (1996) Interactive occlusion and automatic object placement for augmented reality. Comput Graphics Forum 15(3):11\u201322. https:\/\/doi.org\/10.1111\/1467-8659.1530011","journal-title":"Comput Graphics Forum"},{"key":"695_CR4","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","volume":"6","author":"J Canny","year":"1986","unstructured":"Canny J (1986) A computational approach to edge detection. IEEE IEEE Trans Pattern Anal Machine Intell 6:679\u2013698. https:\/\/doi.org\/10.1109\/TPAMI.1986.4767851","journal-title":"IEEE IEEE Trans Pattern Anal Machine Intell"},{"key":"695_CR5","doi-asserted-by":"publisher","unstructured":"Du C, Chen YL, Ye M, et\u00a0al. (2016) Edge snapping-based depth enhancement for dynamic occlusion handling in augmented reality. In: International Symposium on Mixed and Augmented Reality (ISMAR), IEEE, pp 54\u201362. https:\/\/doi.org\/10.1145\/1077534.1077570","DOI":"10.1145\/1077534.1077570"},{"key":"695_CR6","unstructured":"Feng Y (2007) Research on seamless fusion of real and virtual scenes in augmented reality system. PhD thesis, Shanghai University"},{"key":"695_CR7","doi-asserted-by":"crossref","unstructured":"Fischer J, Bartz D, Stra\u00dfer W (2004) Occlusion handling for medical augmented reality using a volumetric phantom model. In: ACM symposium on Virtual reality software and technology, pp 174\u2013177.","DOI":"10.1145\/1077534.1077570"},{"key":"695_CR8","unstructured":"Fuchs H, Bishop G, Arthur K et\u00a0al. (1994) Virtual space teleconferencing using a sea of cameras. Tech. rep, USA"},{"issue":"23","key":"695_CR9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.14022\/j.cnki.dzsjgc.2018.23.001","volume":"26","author":"Z Guo","year":"2018","unstructured":"Guo Z, Zhang X, Gao Y (2018) Implementation of an augmented reality system based on stereo vision. Electron Design Eng 26(23):1\u20136. https:\/\/doi.org\/10.14022\/j.cnki.dzsjgc.2018.23.001","journal-title":"Electron Design Eng"},{"key":"695_CR10","doi-asserted-by":"crossref","unstructured":"Hebborn AK, H\u00f6hner N, M\u00fcller S (2017) Occlusion matting: realistic occlusion handling for augmented reality applications. In: International Symposium on Mixed and Augmented Reality (ISMAR), IEEE, pp 62\u201371","DOI":"10.1109\/ISMAR.2017.23"},{"issue":"6","key":"695_CR11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3272127.3275083","volume":"37","author":"A Holynski","year":"2018","unstructured":"Holynski A, Kopf J (2018) Fast depth densification for occlusion-aware augmented reality. ACM Trans Graphics (ToG) 37(6):1\u201311. https:\/\/doi.org\/10.1145\/3272127.3275083","journal-title":"ACM Trans Graphics (ToG)"},{"key":"695_CR12","doi-asserted-by":"crossref","unstructured":"Jorge J, Anjos RKD, Silva R (2019) Dynamic occlusion handling for real-time ar applications. In: International Conference on Virtual-Reality Continuum and its Applications in Industry, pp 1\u20139","DOI":"10.1145\/3359997.3365700"},{"key":"695_CR13","doi-asserted-by":"crossref","unstructured":"Klein G, Drummond T (2004) Sensor fusion and occlusion refinement for tablet-based ar. In: Third IEEE and ACM International Symposium on Mixed and Augmented Reality, IEEE, pp 38\u201347","DOI":"10.1109\/ISMAR.2004.54"},{"key":"695_CR14","doi-asserted-by":"publisher","unstructured":"Kroeger T, Timofte R, Dai D, et\u00a0al. (2016) Fast optical flow using dense inverse search. In: European Conference on Computer Vision, Springer, pp 471\u2013488. https:\/\/doi.org\/10.1007\/978-3-319-46493-0_29","DOI":"10.1007\/978-3-319-46493-0_29"},{"issue":"1","key":"695_CR15","doi-asserted-by":"publisher","first-page":"125","DOI":"10.16186\/j.cnki.1673-9787.2020.1.16","volume":"39","author":"B Li","year":"2020","unstructured":"Li B, Wang H (2020) Binocular stereo matching algorithm based on two-stage adaptive optimization. J Henan Polytech Univ 39(1):125\u2013132. https:\/\/doi.org\/10.16186\/j.cnki.1673-9787.2020.1.16","journal-title":"J Henan Polytech Univ"},{"key":"695_CR16","doi-asserted-by":"publisher","unstructured":"Luo T, Liu Z, Pan Z, et\u00a0al. (2019) A virtual-real occlusion method based on gpu acceleration for mr. In: Conference on Virtual Reality and 3D User Interfaces (VR), IEEE, pp 1068\u20131069. https:\/\/doi.org\/10.1109\/VR.2019.8797811","DOI":"10.1109\/VR.2019.8797811"},{"issue":"4","key":"695_CR17","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1145\/3386569.3392377","volume":"39","author":"X Luo","year":"2020","unstructured":"Luo X, Huang JB, Szeliski R et\u00a0al. (2020) Consistent video depth estimation. ACM Trans Graphics (ToG) 39(4):71\u20131. https:\/\/doi.org\/10.1145\/3386569.3392377","journal-title":"ACM Trans Graphics (ToG)"},{"key":"695_CR18","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3117866","author":"MCdF Macedo","year":"2021","unstructured":"Macedo MCdF, Apolinario AL (2021) Occlusion handling in augmented reality: Past, present and future. IEEE Trans Visual Comput Graphics. https:\/\/doi.org\/10.1109\/TVCG.2021.3117866","journal-title":"IEEE Trans Visual Comput Graphics"},{"key":"695_CR19","doi-asserted-by":"publisher","first-page":"282","DOI":"10.1117\/12.197321","volume-title":"Telemanipulator and telepresence technologies, international society for optics and photonics","author":"P Milgram","year":"1995","unstructured":"Milgram P, Takemura H, Utsumi A et\u00a0al. (1995) Augmented reality: a class of displays on the reality-virtuality continuum. In: Das H (ed) Telemanipulator and telepresence technologies, international society for optics and photonics, vol 2351. SPIE, United States, pp 282\u2013292. https:\/\/doi.org\/10.1117\/12.197321"},{"key":"695_CR20","doi-asserted-by":"crossref","unstructured":"Neubeck A, Van\u00a0Gool L (2006) Efficient non-maximum suppression. In: International Conference on Pattern Recognition (ICPR), IEEE, pp 850\u2013855","DOI":"10.1109\/ICPR.2006.479"},{"key":"695_CR21","first-page":"132","volume":"1","author":"J Ni","year":"2006","unstructured":"Ni J, Yan D, Zhou Y et\u00a0al. (2006) Depth detecting using stereo scope for ar systems. J Comput Appl 1:132\u2013134","journal-title":"J Comput Appl"},{"key":"695_CR22","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1007\/978-3-319-11752-2_3","volume-title":"German Conference on Pattern Recognition (GCPR)","author":"D Scharstein","year":"2014","unstructured":"Scharstein D, Hirschm\u00fcller H, Kitajima Y et\u00a0al. (2014) High-resolution stereo datasets with subpixel-accurate ground truth. In: Jiang X, Hornegger J, Koch R (eds) German Conference on Pattern Recognition (GCPR). Springer International Publishing, Cham, pp 31\u201342"},{"key":"695_CR23","doi-asserted-by":"crossref","unstructured":"Schmidt J, Niemann H, Vogt S (2002) Dense disparity maps in real-time with an application to augmented reality. In: IEEE Workshop on Applications of Computer Vision (WACV), IEEE, pp 225\u2013230","DOI":"10.1109\/ACV.2002.1182186"},{"key":"695_CR24","doi-asserted-by":"publisher","unstructured":"Szeliski R (2006) Locally adapted hierarchical basis preconditioning. In: SIGGRAPH, ACM, pp 1135\u20131143. https:\/\/doi.org\/10.1145\/1141911.1142005","DOI":"10.1145\/1141911.1142005"},{"key":"695_CR25","doi-asserted-by":"crossref","unstructured":"Tang X, Hu X, Fu CW, et\u00a0al. (2020) Grabar: occlusion-aware grabbing virtual objects in ar. In: Annual ACM Symposium on User Interface Software and Technology, pp 697\u2013708","DOI":"10.1145\/3379337.3415835"},{"key":"695_CR26","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1016\/j.neucom.2014.12.081","volume":"156","author":"Y Tian","year":"2015","unstructured":"Tian Y, Long Y, Xia D et\u00a0al. (2015) Handling occlusions in augmented reality based on 3d reconstruction method. Neurocomputing 156:96\u2013104. https:\/\/doi.org\/10.1016\/j.neucom.2014.12.081","journal-title":"Neurocomputing"},{"key":"695_CR27","doi-asserted-by":"crossref","unstructured":"Walton DR, Steed A (2017) Accurate real-time occlusion for mixed reality. In: ACM Symposium on Virtual Reality Software and Technology, pp 1\u201310","DOI":"10.1145\/3139131.3139153"},{"key":"695_CR28","doi-asserted-by":"crossref","unstructured":"Wloka MM, Anderson BG (1995) Resolving occlusion in augmented reality. In: Proceedings of the 1995 symposium on Interactive 3D graphics, pp 5\u201312","DOI":"10.1145\/199404.199405"},{"issue":"11","key":"695_CR29","doi-asserted-by":"publisher","first-page":"1635","DOI":"10.3969\/j.issn.1003-9775.2013.11.005","volume":"25","author":"W Xu","year":"2013","unstructured":"Xu W, Wang Y, Liu Y et\u00a0al. (2013) Survey on occlusion handling in augmented reality. J Comput Aid Des Comput Graphics 25(11):1635\u20131642. https:\/\/doi.org\/10.3969\/j.issn.1003-9775.2013.11.005","journal-title":"J Comput Aid Des Comput Graphics"},{"key":"695_CR30","doi-asserted-by":"publisher","unstructured":"Zabih R, Woodfill J (1994) Non-parametric local transforms for computing visual correspondence. In: European conference on computer vision, Springer, pp 151\u2013158. https:\/\/doi.org\/10.1007\/BFb0028345","DOI":"10.1007\/BFb0028345"},{"issue":"4","key":"695_CR31","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1007\/s10055-016-0297-5","volume":"20","author":"M Zheng","year":"2016","unstructured":"Zheng M, Zhu J, Xiong X et\u00a0al. (2016) 3d model reconstruction with common hand-held cameras. Virtual Real 20(4):221\u2013235. https:\/\/doi.org\/10.1007\/s10055-016-0297-5","journal-title":"Virtual Real"}],"container-title":["Virtual Reality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10055-022-00695-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10055-022-00695-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10055-022-00695-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,3]],"date-time":"2023-06-03T03:38:58Z","timestamp":1685763538000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10055-022-00695-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,27]]},"references-count":31,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["695"],"URL":"https:\/\/doi.org\/10.1007\/s10055-022-00695-7","relation":{},"ISSN":["1359-4338","1434-9957"],"issn-type":[{"value":"1359-4338","type":"print"},{"value":"1434-9957","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,27]]},"assertion":[{"value":"28 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 September 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 September 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}