{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T22:34:33Z","timestamp":1782858873712,"version":"3.54.5"},"reference-count":41,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2018,1,10]],"date-time":"2018-01-10T00:00:00Z","timestamp":1515542400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this paper, a new localization system utilizing afocal optical flow sensor (AOFS) based sensor fusion for indoor service robots in low luminance and slippery environment is proposed, where conventional localization systems do not perform well. To accurately estimate the moving distance of a robot in a slippery environment, the robot was equipped with an AOFS along with two conventional wheel encoders. To estimate the orientation of the robot, we adopted a forward-viewing mono-camera and a gyroscope. In a very low luminance environment, it is hard to conduct conventional feature extraction and matching for localization. Instead, the interior space structure from an image and robot orientation was assessed. To enhance the appearance of image boundary, rolling guidance filter was applied after the histogram equalization. The proposed system was developed to be operable on a low-cost processor and implemented on a consumer robot. Experiments were conducted in low illumination condition of 0.1 lx and carpeted environment. The robot moved for 20 times in a 1.5 \u00d7 2.0 m square trajectory. When only wheel encoders and a gyroscope were used for robot localization, the maximum position error was 10.3 m and the maximum orientation error was 15.4\u00b0. Using the proposed system, the maximum position error and orientation error were found as 0.8 m and within 1.0\u00b0, respectively.<\/jats:p>","DOI":"10.3390\/s18010171","type":"journal-article","created":{"date-parts":[[2018,1,10]],"date-time":"2018-01-10T12:41:10Z","timestamp":1515588070000},"page":"171","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["A New Localization System for Indoor Service Robots in Low Luminance and Slippery Indoor Environment Using Afocal Optical Flow Sensor Based Sensor Fusion"],"prefix":"10.3390","volume":"18","author":[{"given":"Dong-Hoon","family":"Yi","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, Automation and Systems Research Institute (ASRI), Seoul National University, Seoul 151-742, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tae-Jae","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Automation and Systems Research Institute (ASRI), Seoul National University, Seoul 151-742, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8040-5803","authenticated-orcid":false,"given":"Dong-Il","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Automation and Systems Research Institute (ASRI), Seoul National University, Seoul 151-742, Korea"},{"name":"Inter-University Semiconductor Research Center (ISRC), Seoul National University, Seoul 151-742, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2018,1,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Passafiume, M., Maddio, S., and Cidronali, A. (2017). An improved approach for RSSI-based only calibration-free real-time indoor localization on IEEE 802.11 and 802.15.4 wireless networks. Sensors, 17.","DOI":"10.3390\/s17040717"},{"key":"ref_2","unstructured":"Showcase, R., Biswas, J., Veloso, M.M., and Veloso, M. (2010, January 3\u20138). WiFi Localization and Navigation for Autonomous Indoor Mobile Robots. Proceedings of the IEEE International Conference on Robotics and Automations, Anchorage, AK, USA."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Alarifi, A., Al-Salman, A., Alsaleh, M., Alnafessah, A., Al-Hadhrami, S., Al-Ammar, M., and Al-Khalifa, H. (2016). Ultra Wideband Indoor Positioning Technologies: Analysis and Recent Advances. Sensors, 16.","DOI":"10.3390\/s16050707"},{"key":"ref_4","first-page":"30","article-title":"A BIM and UWB integrated Mobile Robot Navigation System for Indoor Position Tracking Applications","volume":"6","author":"Park","year":"2016","journal-title":"J. Constr. Eng. Proj. Manag."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Shim, J.H., and Cho, Y.I. (2016). A mobile robot localization via indoor fixed remote surveillance cameras. Sensors, 16.","DOI":"10.3390\/s16020195"},{"key":"ref_6","unstructured":"Haehnel, D., Burgard, W., Fox, D., Fishkin, K., and Philipose, M. (May, January 26). Mapping and Localization with RFID Technology. Proceedings of the IEEE International Conference on Robotics and Automations, New Orleans, LA, USA."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Mi, J., and Takahashi, Y. (2016). An design of HF-band RFID system with multiple readers and passive tags for indoor mobile robot self-localization. Sensors, 16.","DOI":"10.3390\/s16081200"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1007\/s11263-006-0023-y","article-title":"Monocular Vision for Mobile Robot Localization and Autonomous Navigation","volume":"74","author":"Royer","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Di, K., Zhao, Q., Wan, W., Wang, Y., and Gao, Y. (2016). RGB-D SLAM based on extended bundle adjustment with 2D and 3D information. Sensors, 16.","DOI":"10.3390\/s16081285"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1016\/j.robot.2005.02.004","article-title":"High-speed laser localization for mobile robots","volume":"51","author":"Lingemann","year":"2005","journal-title":"Rob. Auton. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"26430","DOI":"10.3390\/s151026430","article-title":"Development of kinematic 3D laser scanning system for indoor mapping and as-built BIM using constrained SLAM","volume":"15","author":"Jung","year":"2015","journal-title":"Sensors"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A Versatile and Accurate Monocular SLAM System","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Rob."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Engel, J., Sch\u00f6ps, T., Cremers, D., Sch\u00f6ps, T., and Cremers, D. (2014, January 6\u201312). LSD-SLAM: Large-Scale Direct monocular SLAM. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10605-2_54"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1109\/TMECH.2006.871095","article-title":"Wheel slippage and sinkage detection for planetary rovers","volume":"11","author":"Reina","year":"2006","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1016\/j.mechatronics.2003.09.002","article-title":"Visual dead-reckoning for motion control of a Mecanum-wheeled mobile robot","volume":"14","author":"Cooney","year":"2004","journal-title":"Mechatronics"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Seyr, M., and Jakubek, S. (2006, January 1\u20133). Proprioceptive navigation, slip estimation and slip control for autonomous wheeled mobile robots. Proceedings of the IEEE Conference on Robotics, Automation and Mechatronics, Bangkok, Thailand.","DOI":"10.1109\/RAMECH.2006.252627"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1128","DOI":"10.1109\/TCST.2010.2076321","article-title":"Accelerometer calibration and dynamic bias and gravity estimation: Analysis, design, and experimental evaluation","volume":"19","author":"Batista","year":"2011","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Jackson, J.D., Callahan, D.W., and Marstrander, J. (2007, January 22\u201325). A rationale for the use of optical mice chips for economic and accurate vehicle tracking. Proceedings of the IEEE International Conference on Automation Science and Engineering, Scottsdale, AZ, USA.","DOI":"10.1109\/COASE.2007.4341837"},{"key":"ref_19","unstructured":"McCarthy, C., and Barnes, N. (May, January 26). Performance of optical flow techniques for indoor navigation with a mobile robot. Proceedings of the IEEE International Conference on Robotics and Automation, New Orleans, LA, USA."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/j.sna.2005.09.015","article-title":"The optical mouse for indoor mobile robot odometry measurement","volume":"126","author":"Palacin","year":"2006","journal-title":"Sens. Actuators A"},{"key":"ref_21","unstructured":"Lee, S.Y., and Song, J.B. (May, January 26). Robust mobile robot localization using optical flow sensors and encoders. Proceedings of the IEEE International Conference on Robotics and Automation, New Orleans, LA, USA."},{"key":"ref_22","unstructured":"Avago (2017, November 28). ADNS-3080 and ADNS-3088 High Performance Optical Sensor. Available online: http:\/\/www.alldatasheet.com."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1016\/j.sna.2006.01.034","article-title":"Low-cost optical motion sensors: An experimental characterization","volume":"128","author":"Minoni","year":"2006","journal-title":"Sens. Actuators A"},{"key":"ref_24","unstructured":"Kim, S., and Lee, S. (2008, January 20\u201323). Robust velocity estimation of an omnidirectional mobile robot using a polygonal array of optical mice. Proceedings of the IEEE International Conference on Information and Automation, Changsha, China."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"21045","DOI":"10.3390\/s141121045","article-title":"Odometry for ground moving agents by optic flow recorded with optical mouse chips","volume":"14","author":"Dahmen","year":"2014","journal-title":"Sensors"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1925","DOI":"10.1109\/JSEN.2011.2180525","article-title":"Toward refocused optical mouse sensors for outdoor optical flow odometry","volume":"12","author":"Ross","year":"2012","journal-title":"IEEE Sens. J."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Dille, M., Grocholsky, B., and Singh, S. (2009). Outdoor Downward-facing Optical Flow Odometry with Commodity Sensors. Field Serv. Robot., 1\u201310.","DOI":"10.1007\/978-3-642-13408-1_17"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1016\/j.sna.2009.10.007","article-title":"Differential optical navigation sensor for mobile robots","volume":"156","author":"Hyun","year":"2009","journal-title":"Sens. Actuators A"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"11208","DOI":"10.3390\/s150511208","article-title":"Afocal optical flow sensor for reducing vertical height sensitivity in indoor robot localization and navigation","volume":"15","author":"Yi","year":"2015","journal-title":"Sensors"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/S0734-189X(87)80186-X","article-title":"Adaptive Histogram Equalization and Its Variations","volume":"39","author":"Pizer","year":"1987","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_31","unstructured":"Maddern, W., Stewart, A.D., McManus, C., Upcroft, B., Churchill, W., and Newman, P. (June, January 31). Illumination Invariant Imaging: Applications in Robust Vision-based Localisation, Mapping and Classification for Autonomous Vehicles. Proceedings of the IEEE International Conference on Robotics and Automation, Hong Kong, China."},{"key":"ref_32","unstructured":"Park, C., and Song, J.B. (2015, January 28\u201330). Illumination Change Compensation and Extraction of Corner Feature Orientation for Upward-Looking Camera-Based SLAM. Proceedings of the 12th International Conference on Ubiquitous Robots and Ambient Intelligence, Goyang, Korea."},{"key":"ref_33","unstructured":"Heckbert, P.S. (1994). Graphics Gems IV. Contrast Limited Adaptive Histogram Equalization, Academic Press. Chapter VIII.5."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1364\/JOSA.61.000001","article-title":"Lightness and Retinex Theory","volume":"61","author":"Land","year":"1971","journal-title":"J. Opt. Soc. Am."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Rahman, Z., Jobson, D.J., and Woodell, G.A. (2004). Retinex processing for automatic image enhancement. J. Electron. Imag., 13.","DOI":"10.1117\/1.1636183"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Chang, H.C., Huang, S.H., and Lai, S.H. (2015, January 27\u201330). Using line consistency to estimate 3D indoor Manhattan scene layout from a single image. Proceedings of the IEEE International Conference on Image Processing, Quebec City, QC, Canada.","DOI":"10.1109\/ICIP.2015.7351703"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1007\/s11263-015-0854-5","article-title":"Vanishing Point Estimation and Line Classification in a Manhattan World","volume":"117","author":"Zhang","year":"2016","journal-title":"Int. J. Comput. Vis."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Flint, A., Murray, D., and Reid, I. (2011, January 6\u201313). Manhattan scene understanding using monocular, stereo, and 3D features. Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126501"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Jia, H., and Li, S. (2013, January 5\u20138). Estimating the structure of rooms from a single fisheye image. Proceedings of the 2nd IAPR Asian Conference on Pattern Recognition, Naha, Japan.","DOI":"10.1109\/ACPR.2013.148"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Schwing, A.G., Fidler, S., Pollefeys, M., and Urtasun, R. (2013, January 1\u20138). Box in the box: Joint 3D layout and object reasoning from single images. Proceedings of the IEEE International Conference on Computer Vision, Sydney, NSW, Australia.","DOI":"10.1109\/ICCV.2013.51"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Zhang, Q., Shen, X., Xu, L., and Jia, J. (2014, January 6\u201312). Rolling guidance filter. Proceedings of the 13th European Conference, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10578-9_53"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/1\/171\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:50:43Z","timestamp":1760194243000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/1\/171"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,1,10]]},"references-count":41,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2018,1]]}},"alternative-id":["s18010171"],"URL":"https:\/\/doi.org\/10.3390\/s18010171","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,1,10]]}}}