{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T09:07:50Z","timestamp":1760346470290,"version":"build-2065373602"},"reference-count":48,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2015,7,30]],"date-time":"2015-07-30T00:00:00Z","timestamp":1438214400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61165007"],"award-info":[{"award-number":["61165007"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Nature Science Foundation of Jiangxi Province, China","award":["20132BAB211036"],"award-info":[{"award-number":["20132BAB211036"]}]},{"name":"Research Foundation of Education Bureau of Jiangxi Province, China","award":["GJJ14367"],"award-info":[{"award-number":["GJJ14367"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this paper, we present a novel RGB-D SLAM system based on visual odometry and an extended information filter, which does not require any other sensors or odometry. In contrast to the graph optimization approaches, this is more suitable for online applications. A visual dead reckoning algorithm based on visual residuals is devised, which is used to estimate motion control input. In addition, we use a novel descriptor called binary robust appearance and normals descriptor (BRAND) to extract features from the RGB-D frame and use them as landmarks. Furthermore, considering both the 3D positions and the BRAND descriptors of the landmarks, our observation model avoids explicit data association between the observations and the map by marginalizing the observation likelihood over all possible associations. Experimental validation is provided, which compares the proposed RGB-D SLAM algorithm with just RGB-D visual odometry and a graph-based RGB-D SLAM algorithm using the publicly-available RGB-D dataset. The results of the experiments demonstrate that our system is quicker than the graph-based RGB-D SLAM algorithm.<\/jats:p>","DOI":"10.3390\/s150818742","type":"journal-article","created":{"date-parts":[[2015,7,30]],"date-time":"2015-07-30T11:21:59Z","timestamp":1438255319000},"page":"18742-18766","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["RGB-D SLAM Combining Visual Odometry and Extended Information Filter"],"prefix":"10.3390","volume":"15","author":[{"given":"Heng","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Information Engineering, East China Jiaotong University, Nanchang 330013, China"},{"name":"Department of Mechanical, Aerospace and Biomedical Engineering, University of Tennessee, Knoxville, TN 37996, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanli","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Information Engineering, East China Jiaotong University, Nanchang 330013, China"},{"name":"Department of Mechanical, Aerospace and Biomedical Engineering, University of Tennessee, Knoxville, TN 37996, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jindong","family":"Tan","sequence":"additional","affiliation":[{"name":"Department of Mechanical, Aerospace and Biomedical Engineering, University of Tennessee, Knoxville, TN 37996, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0394-4635","authenticated-orcid":false,"given":"Naixue","family":"Xiong","sequence":"additional","affiliation":[{"name":"School of Computer Science, Colorado Technical University, Colorado Springs, CO 80907, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2015,7,30]]},"reference":[{"key":"ref_1","unstructured":"Thrun, S., Burgard, W., and Fox, D. (2005). Probabilistic Robotics, The MIT Press."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1109\/48.972094","article-title":"Decoupled stochastic mapping","volume":"26","author":"Leonard","year":"2001","journal-title":"IEEE J. Ocean. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1177\/0278364904045479","article-title":"Simultaneous localization and mapping with sparse extended information filters","volume":"23","author":"Thrun","year":"2004","journal-title":"Int. J. Robot. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"955","DOI":"10.1016\/j.robot.2009.03.002","article-title":"Stereo vision-specific models for particle filter-based SLAM","volume":"57","author":"Moreno","year":"2008","journal-title":"Robot. Auton. Syst."},{"key":"ref_5","unstructured":"Kummerle, R., Grisetti, G., Strasdat, H., Konolige, K., and Burgard, W. (2011, January 9\u201313). G2o: A general framework for graph optimization. Proceedings of 2011 IEEE International Conference on Robotics and Automation, Shanghai, China."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Johannsson, H., Kaess, M., Fallon, M., and Leonard, J.J. (2013, January 6\u201310). Temporally scalable visual SLAM using a reduced pose graph. Proceedings of 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6630556"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Sun, F., Hu, D., and Liu, H. (2014). Foundations and Practical Applications of Cognitive Systems and Information Processing, Springer Heidelberg.","DOI":"10.1007\/978-3-642-37835-5"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Jun, L., Pan, T., Tseng, K., and Pan, J. (2013, January 15\u201319). Design of a monocular simultaneous localisation and mapping system with ORB feature. Proceedings of 2013 IEEE International Conference Multimedia and Expo, San Jose, CA, USA.","DOI":"10.1109\/ICME.2013.6607458"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Valenti, R.G., Dryanovski, I., Jaramillo, C., Strom, D.P., and Xiao, J. (Jun, January 31). Autonomous quadrotor flight using onboard RGB-D visual odometry. Proceedings of 2014 IEEE International Conference Robotics and Automation, Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907628"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Hildebrandt, M., Gaudig, C., Christensen, L., Natarajan, S., Carrio, J.H., Paranhos, P.M., and Kirchner, F. (2014). A validation process for underwater localization algorithms. Int. J. Adv. Robot. Syst., 11.","DOI":"10.5772\/58581"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1318","DOI":"10.1109\/TCYB.2013.2265378","article-title":"Enhanced computer vision with microsoft Kinect sensor: A review","volume":"43","author":"Han","year":"2013","journal-title":"IEEE Trans. Cyber."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Nascimento, E.R., Oliveira, G.L., Campos, M.F.M., Vieira, A.W., and Schwartz, W.R. (2012, January 7\u201312). BRAND: A robust appearance and depth descriptor for RGB-D images. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Portugal.","DOI":"10.1109\/IROS.2012.6385693"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Leutenegger, S., Chli, M., and Siegwart, R.Y. (2011, January 6\u201313). BRISK: Binary robust invariant scalable keypoints. Proceedings of the 2011 IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126542"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"778","DOI":"10.1007\/978-3-642-15561-1_56","article-title":"BRIEF: Binary robust independent elementary features","volume":"Volume 6314","author":"Daniilidis","year":"2010","journal-title":"Computer Vision\u2014ECCV 2010"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1177\/0278364911434148","article-title":"RGB-D mapping: Using kinect-style depth cameras for dense 3D modeling of indoor environments","volume":"31","author":"Henry","year":"2012","journal-title":"Int. J. Robot. Res."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Khatib, O., Kumar, V., and Sukhatme, G. (2014). Experimental Robotics, Springer Heidelberg.","DOI":"10.1007\/978-3-642-28572-1"},{"key":"ref_17","unstructured":"Fioraio, N., and Konolige, K. (2011, January 27). Realtime visual and point cloud slam. Proceedings of the RGB-D Workshop on Advanced Reasoning with Depth Cameras at Robotics: Science and Systems Conference, Los Angeles, CA, USA."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"A method for registration of 3-D shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","unstructured":"Po-Chang, S., Ju, S., and Cheung, S.C.S. (2013, January 15\u201318). A robust RGB-D SLAM system for 3D environment with planar surfaces. Proceedings of the 2013 20th IEEE International Conference on Image Processing (ICIP), Melbourne, Australia."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"12467","DOI":"10.3390\/s140712467","article-title":"Solution to the SLAM problem in low dynamic environments using a pose graph and an RGB-D sensor","volume":"14","author":"Lee","year":"2014","journal-title":"Sensors"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Calonder, M., Lepetit, V., and Fua, P. (2008, January 12\u201318). Keypoint signatures for fast learning and recognition. Proceedings of the 10th European Conference on Computer Vision: Part I, Marseille, France.","DOI":"10.1007\/978-3-540-88682-2_6"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1486525.1486527","article-title":"SBA: A software package for generic sparse bundle adjustment","volume":"36","author":"Lourakis","year":"2009","journal-title":"ACM Trans. Math. Soft."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Henry, P., Fox, D., Bhowmik, A., and Mongia, R. (July, January 29). Patch volumes: Segmentation-based consistent mapping with RGB-D cameras. Proceedings of 2013 International Conference on 3D Vision, Seattle, WA, USA.","DOI":"10.1109\/3DV.2013.59"},{"key":"ref_24","unstructured":"Audras, C., Comport, A., Meilland, M., and Rives, P. (2011, January 7\u20139). Real-time dense appearance-based SLAM for RGB-D sensors. Proceedings of the 2011 Australasian Conference on Robotics and Automation, Melbourne, Australia."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Steinbrucker, F., Sturm, J., and Cremers, D. (2011, January 6\u201313). Real-time visual odometry from dense RGB-D images. Proceedings of 2011 IEEE International Conference on Computer Vision Workshops, Barcelona, Spain.","DOI":"10.1109\/ICCVW.2011.6130321"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Guti\u00e9rrez-G\u00f3mez, D., Mayol-Cuevas, W., and Guerrero, J.J. (2015, January 26\u201330). Inverse depth for accurate photometric and geometric error minimisation in RGB-D dense visual odometry. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7138984"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Whelan, T., Johannsson, H., Kaess, M., Leonard, J.J., and McDonald, J. (2013, January 6\u201310). Robust real-time visual odometry for dense RGB-D mapping. Proceedings of the 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6631400"},{"key":"ref_28","unstructured":"Whelan, T., Kaess, M., Fallon, M., Johannsson, H., Leonard, J., and McDonald, J. (2012, January 9\u201310). Kintinuous: Spatially extended kinectfusion. Proceedings of the RSS Workshop on RGB-D: Advanced Reasoning with Depth Cameras, Sydney, Australia."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hu, G., Huang, S., Zhao, L., Alempijevic, A., and Dissanayake, G. (2012, January 7\u201312). A robust RGB-D SLAM algorithm. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Portugal.","DOI":"10.1109\/IROS.2012.6386103"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Endres, F., Hess, J., Engelhard, N., Sturm, J., Cremers, D., and Burgard, W. (2012, January 14\u201318). An evaluation of the RGB-D SLAM system. Proceedings of the 2012 IEEE International Conference on Robotics and Automation, Saint Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6225199"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Sturm, J., Engelhard, N., Endres, F., Burgard, W., and Cremers, D. (2012, January 7\u201312). A benchmark for the evaluation of RGB-D SLAM systems. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Portugal.","DOI":"10.1109\/IROS.2012.6385773"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kerl, C., Sturm, J., and Cremers, D. (2013, January 3\u20137). Dense visual SLAM for RGB-D cameras. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696650"},{"key":"ref_33","first-page":"207","article-title":"Live RGB-D camera tracking for television production studios","volume":"14","author":"Comportb","year":"2014","journal-title":"J. Vis. Commu. Image Repr."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Whelan, T., Kaess, M., Leonard, J.J., and McDonald, J.B. (2013, January 3\u20137). Deformation-based loop closure for large scale dense RGB-D SLAM. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696405"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1109\/TRO.2013.2279412","article-title":"3-D mapping with an RGB-D camera","volume":"30","author":"Endres","year":"2014","journal-title":"IEEE Trans. Robot."},{"key":"ref_36","unstructured":"Huang, A.S., Bachrach, A., Henry, P., Krainin, M., Maturana, D., Fox, D., and Roy, N. (September, January 28). Visual odometry and mapping for autonomous flight using an RGB-D camera. Proceedings of the International symposium on Robotics Research, Flagstaff, AZ, USA."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kerl, C., Sturm, J., and Cremers, D. (2013, January 6\u201310). Robust odometry estimation for RGB-D cameras. Proceedings of the 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6631104"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Tykkala, T., Audras, C., and Comport, A.I. (2011, January 6\u201313). Direct iterative closest point for real-time visual odometry. Proceedings of the 2011 IEEE International Conference on Computer Vision Workshops, Barcelona, Spain.","DOI":"10.1109\/ICCVW.2011.6130500"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Ataer-Cansizoglu, E., Taguchi, Y., Ramalingam, S., and Garaas, T. (2013, January 2\u20138). Tracking an RGB-D camera using points and planes. Proceedings of the 2013 IEEE International Conference on Computer Vision Workshops, Sydney, Australia.","DOI":"10.1109\/ICCVW.2013.14"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Teichman, A., Miller, S., and Thrun, S. (2013, January 24\u201328). Unsupervised intrinsic calibration of depth sensors via SLAM. Proceedings of the Robotics: Science and Systems, Berlin, Germany.","DOI":"10.15607\/RSS.2013.IX.027"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-up robust features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Engel, J., Sturm, J., and Cremers, D. (2012, January 7\u201312). Camera-based navigation of a low-cost quadrocopter. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Portugal.","DOI":"10.1109\/IROS.2012.6385458"},{"key":"ref_45","first-page":"881","article-title":"Robust statistical modeling using the t distribution","volume":"84","author":"Lange","year":"1989","journal-title":"J. Am Stat. Assoc."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"734","DOI":"10.1109\/TRO.2013.2242375","article-title":"Appearance-based loop closure detection for online large-scale and long-term operation","volume":"29","author":"Labbe","year":"2013","journal-title":"IEEE Trans. Robot."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"428","DOI":"10.1109\/TITS.2009.2026444","article-title":"Nonlinear constraint network optimization for efficient map learning","volume":"10","author":"Grisetti","year":"2009","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"14639","DOI":"10.3390\/s150614639","article-title":"Loop closing detection in RGB-D SLAM combining appearance and geometric constraints","volume":"15","author":"Zhang","year":"2015","journal-title":"Sensors"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/8\/18742\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:49:56Z","timestamp":1760215796000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/8\/18742"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,7,30]]},"references-count":48,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2015,8]]}},"alternative-id":["s150818742"],"URL":"https:\/\/doi.org\/10.3390\/s150818742","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2015,7,30]]}}}