{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T18:11:30Z","timestamp":1772302290219,"version":"3.50.1"},"reference-count":37,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2017,12,8]],"date-time":"2017-12-08T00:00:00Z","timestamp":1512691200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>After decades of research, there is still no solution for indoor localization like the GNSS (Global Navigation Satellite System) solution for outdoor environments. The major reasons for this phenomenon are the complex spatial topology and RF transmission environment. To deal with these problems, an indoor scene constrained method for localization is proposed in this paper, which is inspired by the visual cognition ability of the human brain and the progress in the computer vision field regarding high-level image understanding. Furthermore, a multi-sensor fusion method is implemented on a commercial smartphone including cameras, WiFi and inertial sensors. Compared to former research, the camera on a smartphone is used to \u201csee\u201d which scene the user is in. With this information, a particle filter algorithm constrained by scene information is adopted to determine the final location. For indoor scene recognition, we take advantage of deep learning that has been proven to be highly effective in the computer vision community. For particle filter, both WiFi and magnetic field signals are used to update the weights of particles. Similar to other fingerprinting localization methods, there are two stages in the proposed system, offline training and online localization. In the offline stage, an indoor scene model is trained by Caffe (one of the most popular open source frameworks for deep learning) and a fingerprint database is constructed by user trajectories in different scenes. To reduce the volume requirement of training data for deep learning, a fine-tuned method is adopted for model training. In the online stage, a camera in a smartphone is used to recognize the initial scene. Then a particle filter algorithm is used to fuse the sensor data and determine the final location. To prove the effectiveness of the proposed method, an Android client and a web server are implemented. The Android client is used to collect data and locate a user. The web server is developed for indoor scene model training and communication with an Android client. To evaluate the performance, comparison experiments are conducted and the results demonstrate that a positioning accuracy of 1.32 m at 95% is achievable with the proposed solution. Both positioning accuracy and robustness are enhanced compared to approaches without scene constraint including commercial products such as IndoorAtlas.<\/jats:p>","DOI":"10.3390\/s17122847","type":"journal-article","created":{"date-parts":[[2017,12,8]],"date-time":"2017-12-08T11:37:40Z","timestamp":1512733060000},"page":"2847","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":62,"title":["Scene Recognition for Indoor Localization Using a Multi-Sensor Fusion Approach"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0296-5933","authenticated-orcid":false,"given":"Mengyun","family":"Liu","sequence":"first","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6683-2342","authenticated-orcid":false,"given":"Ruizhi","family":"Chen","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan 430079, China"},{"name":"Collaborative Innovation Center of Geospatial Technology, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Deren","family":"Li","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan 430079, China"},{"name":"Collaborative Innovation Center of Geospatial Technology, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3709-6125","authenticated-orcid":false,"given":"Yujin","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Geodesy and Geomatics, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guangyi","family":"Guo","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhipeng","family":"Cao","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9496-346X","authenticated-orcid":false,"given":"Yuanjin","family":"Pan","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,12,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1080\/10095020.2013.772803","article-title":"Geomatics for smart cities-concept, key techniques, and applications","volume":"16","author":"Li","year":"2013","journal-title":"Geo-Spat. Inf. Sci."},{"key":"ref_2","unstructured":"Bahl, P., and Padmanabhan, V.N. (2000, January 26\u201330). RADAR: An in-building RF-based User Location and Tracking System. Proceedings of the Nineteenth Joint Conference of the IEEE Computer and Communications Societies, Tel Aviv, Israel."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Youssef, M., and Agrawala, A. (2005, January 6\u20138). The Horus WLAN location determination system. Proceedings of the International Conference on Mobile Systems, Applications, and Services, Seattle, WA, USA.","DOI":"10.1145\/1067170.1067193"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Rai, A., Chintalapudi, K.K., Padmanabhan, V.N., and Sen, R. (2012, January 22\u201326). Zee: Zero-effort crowdsourcing for indoor localization. Proceedings of the 18th Annual International Conference on Mobile Computing and Networking, Istanbul, Turkey.","DOI":"10.1145\/2348543.2348580"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yang, Z., Wu, C., and Liu, Y. (2012, January 22\u201326). Locating in fingerprint space: Wireless indoor localization with little human intervention. Proceedings of the 18th Annual International Conference on Mobile Computing and Networking, Istanbul, Turkey.","DOI":"10.1145\/2348543.2348578"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Yang, S., Dessai, P., Verma, M., and Gerla, M. (2013, January 14\u201319). Freeloc: Calibration-free crowdsourced indoor localization. Proceedings of the 32nd IEEE International Conference on Computer Communications, Turin, Italy.","DOI":"10.1109\/INFCOM.2013.6567054"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Li, F., Zhao, C., Ding, G., Gong, J., Liu, C., and Zhao, F. (2012, January 5\u20138). A reliable and accurate indoor localization method using phone inertial sensors. Proceedings of the 14th ACM International Conference on Ubiquitous Computing, Pittsburgh, PA, USA.","DOI":"10.1145\/2370216.2370280"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"466","DOI":"10.1109\/COMST.2015.2464084","article-title":"Wi-Fi Fingerprint-Based Indoor Positioning: Recent Advances and Comparisons","volume":"18","author":"He","year":"2016","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2676430","article-title":"Mobility increases localizability: A survey on wireless indoor localization using inertial sensors","volume":"47","author":"Yang","year":"2015","journal-title":"ACM Comput. Surv."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zheng, Y., Shen, G., Li, L., Zhao, C., Li, M., and Zhao, F. (2014, January 7\u201311). Travi-navi: Self-deployable Indoor Navigation System. Proceedings of the 20th Annual International Conference on Mobile Computing and Networking, Maui, HI, USA.","DOI":"10.1145\/2639108.2639124"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"715","DOI":"10.3390\/s150100715","article-title":"Fusion of WiFi, Smartphone Sensors and Landmarks Using the Kalman Filter for Indoor Localization","volume":"15","author":"Chen","year":"2015","journal-title":"Sensors"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"17208","DOI":"10.3390\/s121217208","article-title":"A hybrid smartphone indoor positioning solution for mobile LBS","volume":"12","author":"Liu","year":"2012","journal-title":"Sensors"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"4034","DOI":"10.1109\/JSEN.2014.2330573","article-title":"Intelligent fusion of Wi-Fi and inertial sensor-based positioning systems for indoor pedestrian navigation","volume":"14","author":"Chen","year":"2014","journal-title":"IEEE Sens. J."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1443","DOI":"10.1109\/JSAC.2015.2430274","article-title":"Magicol: Indoor localization using pervasive magnetic field and opportunistic WiFi sensing","volume":"33","author":"Shu","year":"2015","journal-title":"IEEE J. Sel. Area. Comm."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Oquab, M., Bottou, L., Laptev, I., and Sivic, J. (2014, January 24\u201327). Learning and Transferring Mid-Level Image Representations using Convolutional Neural Networks. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.222"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3372","DOI":"10.1109\/TIP.2016.2567076","article-title":"A Discriminative Representation of Convolutional Features for Indoor Scene Recognition","volume":"25","author":"Khan","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.sigpro.2014.07.027","article-title":"Semantic embedding for indoor scene recognition by weighted hypergraph learning","volume":"112","author":"Yu","year":"2015","journal-title":"Signal Process."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Gupta, S., Arbelaez, P., and Malik, J. (2013, January 25\u201327). Perceptual organization and recognition of indoor scenes from RGB-D images. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.79"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kawewong, A., Pimup, R., and Hasegawa, O. (2013, January 14\u201318). Incremental Learning Framework for Indoor Scene Recognition. Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence, Bellevue, WA, USA.","DOI":"10.1609\/aaai.v27i1.8584"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"932","DOI":"10.1016\/j.robot.2013.05.002","article-title":"Indoor scene recognition by a mobile robot through adaptive object detection","volume":"61","author":"Espinace","year":"2013","journal-title":"Robot. Auton. Syst."},{"key":"ref_21","unstructured":"Espinace, P., Kollar, T., Soto, A., and Roy, N. (2012, January 14\u201318). Indoor scene recognition through object detection. Proceedings of the IEEE International Conference on Robotics and Automation, St Paul, MN, USA."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Quattoni, A., and Torralba, A. (2009, January 20\u201325). Recognizing indoor scenes. Proceedings of the 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2009), Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206537"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 24\u201327). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1904","DOI":"10.1109\/TPAMI.2015.2389824","article-title":"Spatial pyramid pooling in deep convolutional networks for visual recognition","volume":"37","author":"He","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","unstructured":"Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (arXiv, 2014). Object detectors emerge in deep scene cnns, arXiv."},{"key":"ref_26","unstructured":"Yosinski, J., Clune, J., Bengio, Y., and Lipson, H. (2014, January 3\u20136). How transferable are features in deep neural networks?. Proceedings of the Neural Information Processing\u201421st International Conference, ICONIP 2014, Kuching, Malaysia."},{"key":"ref_27","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 12\u201315). ImageNet classification with deep convolutional neural networks. Proceedings of the Neural Information Processing\u201419th International Conference, ICONIP 2012, Doha, Qatar."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Chen, W., Wang, W., Li, Q., Chang, Q., and Hou, H. (2016). A Crowd-Sourcing Indoor Localization Algorithm via Optical Camera on a Smartphone Assisted by Wi-Fi Fingerprint RSSI. Sensors, 16.","DOI":"10.3390\/s16030410"},{"key":"ref_29","unstructured":"(2017, October 15). IndoorAtlas. Available online: http:\/\/www.indooratlas.com\/."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Li, F.-F. (2009, January 20\u201325). ImageNet: A Large-Scale Hierarchical Image Database. Proceedings of the 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_31","unstructured":"Chen, R., Pei, L., and Chen, Y. (2010, January 20\u201323). A smart phone based PDR solution for indoor navigation. Proceedings of the 24th International Technical Meeting of the Satellite Division of the Institute of Navigation, Portland, OR, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lane, N.D., and Georgiev, P. (2015, January 12\u201313). Can deep learning revolutionize mobile sensing?. Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications, Santa Fe, NM, USA.","DOI":"10.1145\/2699343.2699349"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Latifi Oskouei, S.S., Golestani, H., Hashemi, M., and Ghiasi, S. (2016, January 15\u201319). CNNdroid: GPU-Accelerated Execution of Trained Deep Convolutional Neural Networks on Android. Proceedings of the 2016 ACM on Multimedia Conference, Amsterdam, The Netherlands.","DOI":"10.1145\/2964284.2973801"},{"key":"ref_34","unstructured":"(2017, October 15). Caffe|Deep Learning Framework. Available online: http:\/\/caffe.berkeleyvision.org\/."},{"key":"ref_35","unstructured":"(2017, October 15). Model Zoo BVLC\/Caffe Wiki. Available online: https:\/\/github.com\/BVLC\/caffe\/wiki\/Model-Zoo."},{"key":"ref_36","unstructured":"(2017, October 15). Caffe\/Models\/Bvlc_Reference_Caffenet at Master BVLC\/Caffe. Available online: https:\/\/github.com\/BVLC\/caffe\/tree\/master\/models\/bvlc_reference_caffenet."},{"key":"ref_37","unstructured":"Goodfellow, I., Bengio, Y., and Aaron, C. (2016). Deep Learning, MIT Press."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/12\/2847\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:53:12Z","timestamp":1760208792000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/12\/2847"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,12,8]]},"references-count":37,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2017,12]]}},"alternative-id":["s17122847"],"URL":"https:\/\/doi.org\/10.3390\/s17122847","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,12,8]]}}}