{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,27]],"date-time":"2024-09-27T04:15:28Z","timestamp":1727410528125},"reference-count":40,"publisher":"Institute of Electronics, Information and Communications Engineers (IEICE)","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IEICE Trans. Inf. & Syst."],"published-print":{"date-parts":[[2022,6,1]]},"DOI":"10.1587\/transinf.2021edp7226","type":"journal-article","created":{"date-parts":[[2022,5,31]],"date-time":"2022-05-31T22:14:00Z","timestamp":1654035240000},"page":"1211-1224","source":"Crossref","is-referenced-by-count":2,"title":["Depth Image Noise Reduction and Super-Resolution by Pixel-Wise Multi-Frame Fusion"],"prefix":"10.1587","volume":"E105.D","author":[{"given":"Masahiro","family":"MURAYAMA","sequence":"first","affiliation":[{"name":"Graduate School of Energy Science, Kyoto University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Toyohiro","family":"HIGASHIYAMA","sequence":"additional","affiliation":[{"name":"Nomura Research Institute, Ltd."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuki","family":"HARAZONO","sequence":"additional","affiliation":[{"name":"Graduate School of Energy Science, Kyoto University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hirotake","family":"ISHII","sequence":"additional","affiliation":[{"name":"Graduate School of Energy Science, Kyoto University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hiroshi","family":"SHIMODA","sequence":"additional","affiliation":[{"name":"Graduate School of Energy Science, Kyoto University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shinobu","family":"OKIDO","sequence":"additional","affiliation":[{"name":"Hitachi-GE Nuclear Energy, Ltd."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yasuyoshi","family":"TARUTA","sequence":"additional","affiliation":[{"name":"Fugen Decommissioning Engineering Center, Japan Atomic Energy Agency"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"532","reference":[{"key":"1","doi-asserted-by":"crossref","unstructured":"[1] O. K\u00e4hler, V.A. Prisacariu, C.Y. Ren, X. Sun, P. Torr, and D. Murray, \u201cVery high frame rate volumetric integration of depth images on mobile devices,\u201d IEEE Transactions on Visualization and Computer Graphics, vol.21, no.11, pp.1241-1250, 2015. 10.1109\/tvcg.2015.2459891","DOI":"10.1109\/TVCG.2015.2459891"},{"key":"2","doi-asserted-by":"crossref","unstructured":"[2] R.A. Newcombe, S. Izadi, O. Hilliges, D. Molyneaux, D. Kim, A.J. Davison, P. Kohi, J. Shotton, S. Hodges, and A. Fitzgibbon, \u201cKinectfusion: real-time dense surface mapping and tracking,\u201d 2011 Tenth IEEE International Symposium on Mixed and Augmented Reality, pp.127-136, 2011. 10.1109\/ismar.2011.6092378","DOI":"10.1109\/ISMAR.2011.6092378"},{"key":"3","doi-asserted-by":"publisher","unstructured":"[3] E. Marchand, H. Uchiyama, and F. Spindler, \u201cPose estimation for augmented reality: a hands-on survey,\u201d IEEE Transactions on Visualization and Computer Graphics, vol.22, no.12, pp.2633-2651, 2015. 10.1109\/tvcg.2015.2513408","DOI":"10.1109\/TVCG.2015.2513408"},{"key":"4","doi-asserted-by":"crossref","unstructured":"[4] B. Jiang and U. Neumann, \u201cExtendible tracking by line auto-calibration,\u201d Proceedings IEEE and ACM International Symposium on Augmented Reality, pp.97-103, 2001. 10.1109\/isar.2001.970519","DOI":"10.1109\/ISAR.2001.970519"},{"key":"5","unstructured":"[5] C. Tomasi and R. Manduchi, \u201cBilateral filtering for gray and color images,\u201d Sixth International Conference on Computer Vision, pp.839-846, 1998. 10.1109\/iccv.1998.710815"},{"key":"6","unstructured":"[6] P. Choudhury and J. Tumblin, \u201cThe trilateral filter for high contrast images and meshes,\u201d Proceedings of the 14th Eurographics Workshop on Rendering, pp.186-196, 2003. 10.1145\/1198555.1198565"},{"key":"7","doi-asserted-by":"publisher","unstructured":"[7] J. Kopf, M.F. Cohen, D. Lischinski, and M. Uyttendaele, \u201cJoint bilateral upsampling,\u201d ACM Transactions on Graphics (ToG), vol.26, no.3, p.96, 2007. 10.1145\/1276377.1276497","DOI":"10.1145\/1276377.1276497"},{"key":"8","doi-asserted-by":"publisher","unstructured":"[8] C. Richardt, C. Stoll, N.A. Dodgson, H.P. Seidel, and C. Theobalt, \u201cCoherent spatiotemporal filtering, upsampling and rendering of rgbz videos,\u201d Computer Graphics Forum, vol.31, no.2pt1, pp.247-256, Wiley Online Library, 2012. 10.1111\/j.1467-8659.2012.03003.x","DOI":"10.1111\/j.1467-8659.2012.03003.x"},{"key":"9","doi-asserted-by":"publisher","unstructured":"[9] W. Dong, G. Shi, X. Li, K. Peng, J. Wu, and Z. Guo, \u201cColor-guided depth recovery via joint local structural and nonlocal low-rank regularization,\u201d IEEE Transactions on Multimedia, vol.19, no.2, pp.293-301, 2016. 10.1109\/tmm.2016.2613824","DOI":"10.1109\/TMM.2016.2613824"},{"key":"10","doi-asserted-by":"crossref","unstructured":"[10] S. Matyunin, D. Vatolin, Y. Berdnikov, and M. Smirnov, \u201cTemporal filtering for depth maps generated by kinect depth camera,\u201d 2011 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Vide, pp.1-4, IEEE, 2011. 10.1109\/3dtv.2011.5877202","DOI":"10.1109\/3DTV.2011.5877202"},{"key":"11","doi-asserted-by":"crossref","unstructured":"[11] L. Wang, H. Jin, R. Yang, and M. Gong, \u201cStereoscopic inpainting: Joint color and depth completion from stereo images,\u201d 2008 IEEE Conference on Computer Vision and Pattern Recognition, pp.1-8, IEEE, 2008. 10.1109\/cvpr.2008.4587704","DOI":"10.1109\/CVPR.2008.4587704"},{"key":"12","doi-asserted-by":"crossref","unstructured":"[12] S. Lu, X. Ren, and F. Liu, \u201cDepth enhancement via low-rank matrix completion,\u201d Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.3390-3397, 2014. 10.1109\/cvpr.2014.433","DOI":"10.1109\/CVPR.2014.433"},{"key":"13","doi-asserted-by":"publisher","unstructured":"[13] S. Kim, J. Cha, J. Ryu, and K.H. Lee, \u201cDepth video enhancement for haptic interaction using a smooth surface reconstruction,\u201d IEICE Transactions on Information and Systems, vol.E89-D, no.1, pp.37-44, 2006. 10.1093\/ietisy\/e89-d.1.37","DOI":"10.1093\/ietisy\/e89-d.1.37"},{"key":"14","doi-asserted-by":"publisher","unstructured":"[14] J. Xie, R.S. Feris, and M.-T. Sun, \u201cEdge-guided single depth image super resolution,\u201d IEEE Transactions on Image Processing, vol.25, no.1, pp.428-438, 2015. 10.1109\/tip.2015.2501749","DOI":"10.1109\/TIP.2015.2501749"},{"key":"15","doi-asserted-by":"crossref","unstructured":"[15] A.K. Riemens, O.P. Gangwal, B. Barenbrug, and R.-P.M. Berretty, \u201cMultistep joint bilateral depth upsampling,\u201d Visual Communications and Image Processing, p.72570M, International Society for Optics and Photonics, 2009. 10.1117\/12.805640","DOI":"10.1117\/12.805640"},{"key":"16","doi-asserted-by":"publisher","unstructured":"[16] D. Zhou, R. Wang, X. Yang, Q. Zhang, and X. Wei, \u201cDepth image super-resolution reconstruction based on a modified joint trilateral filter,\u201d Royal Society Open Science, vol.6, no.1, p.181074, 2019. 10.1098\/rsos.181074","DOI":"10.1098\/rsos.181074"},{"key":"17","doi-asserted-by":"publisher","unstructured":"[17] C. Jung, S. Yu, and J. Kim, \u201cIntensity-guided edge-preserving depth upsampling through weighted l0 gradient minimization,\u201d Journal of Visual Communication and Image Representation, vol.42, pp.132-144, 2017. 10.1016\/j.jvcir.2016.11.009","DOI":"10.1016\/j.jvcir.2016.11.009"},{"key":"18","unstructured":"[18] J. Diebel and S. Thrun, \u201cAn application of markov random fields to range sensing,\u201d NIPS, pp.291-298, 2005."},{"key":"19","doi-asserted-by":"crossref","unstructured":"[19] J. Lu, D. Min, R.S. Pahwa, and M.N. Do, \u201cA revisit to mrf-based depth map super-resolution and enhancement,\u201d 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.985-988, IEEE, 2011. 10.1109\/icassp.2011.5946571","DOI":"10.1109\/ICASSP.2011.5946571"},{"key":"20","doi-asserted-by":"publisher","unstructured":"[20] Y. Zuo, Q. Wu, J. Zhang, and P. An, \u201cMinimum spanning forest with embedded edge inconsistency measurement model for guided depth map enhancement,\u201d IEEE Transactions on Image Processing, vol.27, no.8, pp.4145-4159, 2018. 10.1109\/tip.2018.2828335","DOI":"10.1109\/TIP.2018.2828335"},{"key":"21","doi-asserted-by":"crossref","unstructured":"[21] X. Zhang and R. Wu, \u201cFast depth image denoising and enhancement using a deep convolutional network,\u201d 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.2499-2503, 2016. 10.1109\/icassp.2016.7472127","DOI":"10.1109\/ICASSP.2016.7472127"},{"key":"22","doi-asserted-by":"crossref","unstructured":"[22] X. Liao and X. Zhang, \u201cMulti-scale mutual feature convolutional neural network for depth image denoise and enhancement,\u201d 2017 IEEE Visual Communications and Image Processing (VCIP), pp.1-4, 2017. 10.1109\/vcip.2017.8305145","DOI":"10.1109\/VCIP.2017.8305145"},{"key":"23","doi-asserted-by":"crossref","unstructured":"[23] J. Zhu, J. Zhang, Y. Cao, and Z. Wang, \u201cImage guided depth enhancement via deep fusion and local linear regularizaron,\u201d 2017 IEEE International Conference on Image Processing (ICIP), pp.4068-4072, 2017. 10.1109\/icip.2017.8297047","DOI":"10.1109\/ICIP.2017.8297047"},{"key":"24","doi-asserted-by":"publisher","unstructured":"[24] Y. Zuo, Q. Wu, Y. Fang, P. An, L. Huang, and Z. Chen, \u201cMulti-scale frequency reconstruction for guided depth map super-resolution via deep residual network,\u201d IEEE Transactions on Circuits and Systems for Video Technology, vol.30, no.2, pp.297-306, 2019. 10.1109\/tcsvt.2018.2890271","DOI":"10.1109\/TCSVT.2018.2890271"},{"key":"25","doi-asserted-by":"publisher","unstructured":"[25] Y. Zuo, Y. Fang, Y. Yang, X. Shang, and B. Wang, \u201cResidual dense network for intensity-guided depth map enhancement,\u201d Information Sciences, vol.495, pp.52-64, 2019. 10.1016\/j.ins.2019.05.003","DOI":"10.1016\/j.ins.2019.05.003"},{"key":"26","doi-asserted-by":"publisher","unstructured":"[26] L. Zhao, H. Bai, J. Liang, B. Zeng, A. Wang, and Y. Zhao, \u201cSimultaneous color-depth super-resolution with conditional generative adversarial networks,\u201d Pattern Recognition, vol.88, pp.356-369, 2019. 10.1016\/j.patcog.2018.11.028","DOI":"10.1016\/j.patcog.2018.11.028"},{"key":"27","doi-asserted-by":"crossref","unstructured":"[27] B. Curless and M. Levoy, \u201cA volumetric method for building complex models from range images,\u201d Proceedings of The 23rd Annual Conference on Computer Graphics and Interactive Techniques, pp.303-312, 1996. 10.1145\/237170.237269","DOI":"10.1145\/237170.237269"},{"key":"28","doi-asserted-by":"crossref","unstructured":"[28] J.L. Sch\u00f6nberger and J.-M. Frahm, \u201cStructure-from-motion revisited,\u201d Conference on Computer Vision and Pattern Recognition (CVPR), 2016. 10.1109\/cvpr.2016.445","DOI":"10.1109\/CVPR.2016.445"},{"key":"29","doi-asserted-by":"crossref","unstructured":"[29] J.L. Sch\u00f6nberger, E. Zheng, J.-M. Frahm, and M. Pollefeys, \u201cPixelwise view selection for unstructured multi-view stereo,\u201d European Conference on Computer Vision (ECCV), vol.9907, pp.501-518, 2016. 10.1007\/978-3-319-46487-9_31","DOI":"10.1007\/978-3-319-46487-9_31"},{"key":"30","unstructured":"[30] ASUS, \u201cXtion pro live.\u201d https:\/\/www.asus.com\/jp\/3D-Sensor\/Xtion_PRO_LIVE\/ (Accessed on 12\/26\/2020)."},{"key":"31","unstructured":"[31] \u201cBoost.\u201d https:\/\/www.boost.org\/ (Accessed on 9\/7\/2021)."},{"key":"32","unstructured":"[32] \u201cEigen.\u201d http:\/\/eigen.tuxfamily.org\/index.php?title=Main_Page (Accessed on 9\/7\/2021)."},{"key":"33","unstructured":"[33] \u201cOpencv.\u201d https:\/\/opencv.org\/ (Accessed on 9\/7\/2021)."},{"key":"34","doi-asserted-by":"publisher","unstructured":"[34] A. Criminisi, P. Perez, and K. Toyama, \u201cRegion filling and object removal by exemplar-based image inpainting,\u201d IEEE Transactions on Image Processing, vol.13, no.9, pp.1200-1212, 2004. 10.1109\/tip.2004.833105","DOI":"10.1109\/TIP.2004.833105"},{"key":"35","doi-asserted-by":"crossref","unstructured":"[35] P.J. Besl and N.D. McKay, \u201cA method for registration of 3-d shapes,\u201d IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.14, no.2, pp.239-256, 1992. 10.1109\/34.121791","DOI":"10.1109\/34.121791"},{"key":"36","doi-asserted-by":"crossref","unstructured":"[36] E. Rublee, V. Rabaud, K. Konolige, and G. Bradski, \u201cOrb: An efficient alternative to sift or surf,\u201d International Conference on Computer Vision (ICCV), pp.2564-2571, 2011. 10.1109\/iccv.2011.6126544","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"37","doi-asserted-by":"crossref","unstructured":"[37] E. Rosten and T. Drummond, \u201cFusing points and lines for high performance tracking,\u201d Tenth IEEE International Conference on Computer Vision, pp.1508-1515, 2005. 10.1109\/iccv.2005.104","DOI":"10.1109\/ICCV.2005.104"},{"key":"38","doi-asserted-by":"crossref","unstructured":"[38] B. Glocker, J. Shotton, A. Criminisi, and S. Izadi, \u201cReal-time rgb-d camera relocalization via randomized ferns for keyframe encoding,\u201d IEEE Transactions on Visualization and Computer Graphics, vol.21, no.5, pp.571-583, 2015. 10.1109\/tvcg.2014.2360403","DOI":"10.1109\/TVCG.2014.2360403"},{"key":"39","doi-asserted-by":"publisher","unstructured":"[39] V. Lepetit, F. Moreno-Noguer, and P. Fua, \u201cEpnp: An accurate o (n) solution to the pnp problem,\u201d International Journal of Computer Vision, vol.81, no.2, pp.155-166, 2009. 10.1007\/s11263-008-0152-6","DOI":"10.1007\/s11263-008-0152-6"},{"key":"40","unstructured":"[40] S. Agarwal, K. Mierle, and Others, \u201cCeres solver.\u201d http:\/\/ceres-solver.org"}],"container-title":["IEICE Transactions on Information and Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transinf\/E105.D\/6\/E105.D_2021EDP7226\/_pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T05:48:46Z","timestamp":1727329726000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transinf\/E105.D\/6\/E105.D_2021EDP7226\/_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,1]]},"references-count":40,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022]]}},"URL":"https:\/\/doi.org\/10.1587\/transinf.2021edp7226","relation":{},"ISSN":["0916-8532","1745-1361"],"issn-type":[{"type":"print","value":"0916-8532"},{"type":"electronic","value":"1745-1361"}],"subject":[],"published":{"date-parts":[[2022,6,1]]},"article-number":"2021EDP7226"}}