{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:31:32Z","timestamp":1760239892274,"version":"build-2065373602"},"reference-count":40,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2019,1,11]],"date-time":"2019-01-11T00:00:00Z","timestamp":1547164800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["17K00384"],"award-info":[{"award-number":["17K00384"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>Numerous autonomous robots are used not only for factory automation as labor saving devices, but also for interaction and communication with humans in our daily life. Although superior compatibility for semantic recognition of generic objects provides wide applications in a practical use, it is still a challenging task to create an extraction method that includes robustness and stability against environmental changes. This paper proposes a novel method of scene and position recognition based on visual landmarks (VLs) used for an autonomous mobile robot in an environment living with humans. The proposed method provides a mask image of human regions using histograms of oriented gradients (HOG). The VL features are described with accelerated KAZE (AKAZE) after extracting conspicuous regions obtained using saliency maps (SMs). The experimentally obtained results using leave-one-out cross validation (LOOCV) revealed that recognition accuracy of high-saliency feature points was higher than that of low-saliency feature points. We created our original benchmark datasets using a mobile robot. The recognition accuracy evaluated using LOOCV reveals 49.9% for our method, which is 3.2 percentage points higher than the accuracy of the comparison method without HOG detectors. The analysis of false recognition using a confusion matrix examines false recognition occurring in neighboring zones. This trend is reduced according to zone separations.<\/jats:p>","DOI":"10.3390\/robotics8010003","type":"journal-article","created":{"date-parts":[[2019,1,11]],"date-time":"2019-01-11T11:36:42Z","timestamp":1547206602000},"page":"3","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Indoor Scene and Position Recognition Based on Visual Landmarks Obtained from Visual Saliency without Human Effect"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5485-2928","authenticated-orcid":false,"given":"Hirokazu","family":"Madokoro","sequence":"first","affiliation":[{"name":"Faculty of Systems Science and Technology, Akita Prefectural University, Yurihonjo City 015\u20130055, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kazuhito","family":"Sato","sequence":"additional","affiliation":[{"name":"Faculty of Systems Science and Technology, Akita Prefectural University, Yurihonjo City 015\u20130055, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nobuhiro","family":"Shimoi","sequence":"additional","affiliation":[{"name":"Faculty of Systems Science and Technology, Akita Prefectural University, Yurihonjo City 015\u20130055, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Dissanayake, G., Newman, P., Clark, S., Durrant-Whyte, H.F., and Csorba, M. (2000). An Experimental and Theoretical Investigation into Simultaneous Localisation and Map Building (SLAM). Exp. Robot., 265\u2013274.","DOI":"10.1007\/BFb0119405"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ishikoori, Y., Madokoro, H., and Sato, K. (2017, January 11\u201314). Semantic Position Recognition and Visual Landmark Detection with Invariant for Human Effect. Proceedings of the 2017 IEEE\/SICE International Symposium on System Integration (SII), Taipei, Taiwan.","DOI":"10.1109\/SII.2017.8279296"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Tokuhara, K., Madokoro, H., and Sato, K. (2017, January 11\u201314). Semantic Indoor Scenes Recognition Based on Visual Saliency and Part-Based Features. Proceedings of the 2017 IEEE\/SICE International Symposium on System Integration (SII), Taipei, Taiwan.","DOI":"10.1109\/SII.2017.8279297"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1109\/34.982903","article-title":"Vision for mobile robot navigation: A survey","volume":"24","author":"Desouza","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_5","first-page":"524","article-title":"A Bayesian Hierarchical Model for Learning Natural Scene Categories","volume":"2","author":"Li","year":"2005","journal-title":"Proc. Comput. Vis. Pattern Recognit."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1016\/S0262-8856(98)00124-3","article-title":"View-Based Object Recognition Using Saliency Maps","volume":"17","author":"Shokoufandeha","year":"1999","journal-title":"Image Vis. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1395","DOI":"10.1016\/j.neunet.2006.10.001","article-title":"Modeling Attention to Salient Proto-Objects","volume":"19","author":"Walthera","year":"2006","journal-title":"Neural Netw."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1254","DOI":"10.1109\/34.730558","article-title":"A Model of Saliency-Based Visual Attention for Rapid Scene Analysis","volume":"20","author":"Itti","year":"1998","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Lowe, D.G. (1999, January 20\u201327). Object Recognition from Local Scale-Invariant Features. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"ref_10","first-page":"545","article-title":"Graph-based visual saliency","volume":"19","author":"Harel","year":"2006","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kostavelis, I., Nalpantidis, L., and Gasteratos, A. (2012, January 16\u201317). Object Recognition Using Saliency Maps and HTM Learning. Proceedings of the 2012 IEEE International Conference on Imaging Systems and Techniques, Manchester, UK.","DOI":"10.1109\/IST.2012.6295575"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1460","DOI":"10.1016\/j.robot.2013.07.008","article-title":"Learning spatially semantic representations for cognitive robot navigation","volume":"61","author":"Kostavelis","year":"2013","journal-title":"Robot. Autom. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.robot.2014.12.006","article-title":"Semantic mapping for mobile robotics tasks: A survey","volume":"66","author":"Kostavelis","year":"2015","journal-title":"Robot. Autom. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Fernandes, C.S., Campos, M.F.M., and Chaimowicz, L. (2012, January 16\u201319). A Low-Cost Localization System Based on Artificial Landmarks. Proceedings of the 2012 Brazilian Robotics Symposium and Latin American Robotics Symposium, Fortaleza, Brazil.","DOI":"10.1109\/SBR-LARS.2012.25"},{"key":"ref_15","unstructured":"Chang, C.K., Siagian, C., and Itti, L. (2010, January 18\u201322). Mobile Robot Vision Navigation and Localization Using Gist and Saliency. Proceedings of the 2010 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1341","DOI":"10.1016\/j.imavis.2006.08.006","article-title":"A Visual Landmark Framework for Mobile Robot Navigation","volume":"25","author":"Hayet","year":"2007","journal-title":"Image Vis. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1109\/TRO.2005.861480","article-title":"Landmark Selection for Vision-Based Navigation","volume":"22","author":"Sala","year":"2006","journal-title":"IEEE Trans. Robot."},{"key":"ref_18","unstructured":"Hayet, J.B., Esteves, C., and Devy, M. (Octorber, January 30). Qualitative Modeling of Indoor Environments from Visual Landmarks and Range Data. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Lausanne, Switzerland."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"735","DOI":"10.1177\/027836402761412467","article-title":"Mobile Robot Localization and Mapping with Uncertainty Using Scale-Invariant Visual Landmarks","volume":"21","author":"Se","year":"2002","journal-title":"Int. J. Robot. Res."},{"key":"ref_20","unstructured":"Livatino, S., and Madsen, C.B. (, January August). Automatic Selection of Visual Landmark for Mobile Robot Navigation. Proceedings of the Seventh Danish Conference on Pattern Recognition and Image Analysis, Copenhagen, Denmark."},{"key":"ref_21","first-page":"179","article-title":"Analyzing the Effects of VGI-based Landmarks on Spatial Memory and Navigation Performance","volume":"31","author":"Bestgen","year":"2017","journal-title":"Ger. J. Artif. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2587","DOI":"10.1587\/transinf.E93.D.2587","article-title":"Position-invariant Robust Features for Long-term Recognition of Dynamic Outdoor Scenes","volume":"93","author":"Kawewong","year":"2010","journal-title":"IEICE Trans. Inf. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"684","DOI":"10.7210\/jrsj.30.684","article-title":"Human Avoidance Path Planning based on Massive People Trajectories","volume":"30","author":"Noguchi","year":"2012","journal-title":"J. Robot. Soc. J."},{"key":"ref_24","first-page":"1281","article-title":"Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces","volume":"34","author":"Alcantarilla","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Madokoro, H., Shimoi, N., and Sato, K. (2014, January 25\u201329). Adaptive Category Mapping Networks for All-Mode Topological Feature Learning Used for Mobile Robot Vision. Proceedings of the 23rd IEEE International Symposium on Robot and Human Interactive Communication, Edinburgh, UK.","DOI":"10.1109\/ROMAN.2014.6926331"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kohonen, T. (1995). Self-Organizing Maps, Springer.","DOI":"10.1007\/978-3-642-97610-0"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"4979","DOI":"10.1364\/AO.26.004979","article-title":"Counterpropagation networks","volume":"26","year":"1987","journal-title":"Appl. Opt."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"4919","DOI":"10.1364\/AO.26.004919","article-title":"ART 2: Stable Self-Organization of Pattern Recognition Codes for Analog Input Patterns","volume":"26","author":"Carpenter","year":"1987","journal-title":"Appl. Opt."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1023\/A:1011139631724","article-title":"Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope","volume":"42","author":"Oliva","year":"2001","journal-title":"Int. J. Comput. Vis."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Alcantarilla, P.F., Bartoli, A., and Davison, A.J. (2012, January 7\u201313). KAZE Features. Proceedings of the ECCV 2012\u201412th European Conference on Computer Vision, Florence, Italy.","DOI":"10.1007\/978-3-642-33783-3_16"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/978-94-009-3833-5_5","article-title":"Shifts in Selective Visual Attention: Towards the Underlying Neural Circuitry","volume":"188","author":"Koch","year":"1987","journal-title":"Matters Intell."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Luo, J., Pronobis, A., Caputo, B., and Jensfelt, P. (November, January 29). Incremental learning for place recognition in dynamic environments. Proceedings of the 2007 IEEE\/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA, USA.","DOI":"10.1109\/IROS.2007.4398986"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1452","DOI":"10.1109\/TPAMI.2017.2723009","article-title":"Places: A 10 million Image Database for Scene Recognition","volume":"40","author":"Zhou","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","first-page":"1137","article-title":"A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection","volume":"2","author":"Kohavi","year":"1995","journal-title":"Proc. Int. J. Conf. Artif. Intell."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"559","DOI":"10.4304\/jcp.8.3.559-566","article-title":"FPGA Implementation of Back-Propagation Neural Networks for Real-Time Image Processing","volume":"8","author":"Madokoro","year":"2013","journal-title":"J. Comput."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kalms, L., Elhossini, A., and Juurlink, B. (2016, January 7\u20139). FPGA based hardware accelerator for KAZE feature extraction algorithm. Proceedings of the 2016 International Conference on Field-Programmable Technology (FPT), Xi\u2019an, China.","DOI":"10.1109\/FPT.2016.7929553"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1109\/TPAMI.2007.1174","article-title":"Multi-Camera People Tracking with a Probabilistic Occupancy Map","volume":"30","author":"Fleuret","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","first-page":"37","article-title":"Evaluation: From Precision, Recall and F-Factor to ROC, Informedness, Markedness & Correlation","volume":"2","author":"Powers","year":"2011","journal-title":"J. Mach. Learn. Tech."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1002\/scj.1185","article-title":"Acquisition of World Image and Self-Localization Using Sequential View Images","volume":"34","author":"Madokoro","year":"2003","journal-title":"Syst. Comput. Jpn."}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/8\/1\/3\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:25:24Z","timestamp":1760185524000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/8\/1\/3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,11]]},"references-count":40,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,3]]}},"alternative-id":["robotics8010003"],"URL":"https:\/\/doi.org\/10.3390\/robotics8010003","relation":{},"ISSN":["2218-6581"],"issn-type":[{"type":"electronic","value":"2218-6581"}],"subject":[],"published":{"date-parts":[[2019,1,11]]}}}