{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T14:19:09Z","timestamp":1761401949926,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2018,8,6]],"date-time":"2018-08-06T00:00:00Z","timestamp":1533513600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Technology R&amp;D Program","award":["2013BAH33F02"],"award-info":[{"award-number":["2013BAH33F02"]}]},{"name":"NSF china projects","award":["61300192"],"award-info":[{"award-number":["61300192"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["ZYGX2014J052"],"award-info":[{"award-number":["ZYGX2014J052"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Location information plays a key role in pervasive computing and application, especially indoor location-based service, even though a mass of systems have been proposed, an accurate and practical indoor localization system remains unsettled. To tackle this issue, in this paper, we present a new localization scheme, SITE, combining acoustic Signals and Images to achieve accurate and robust indoor locaTion sErvice. Relying on a pre-deployed platform of acoustic sources with different frequencies, using proactively generated Doppler effect signals, SITE could track relative directions between the phone and the sources. Given m (m\u22655) relative directions, SITE can use the angle differences to compute a set of locations corresponding to different subsets of sources. Then, based on a key observation\u2014while the simultaneously estimated locations using different sets of acoustic anchors are within a small circle, the results converge to a point near the true location\u2014SITE proposes a decision scheme that confirms whether these locations satisfy the demand of localization accuracy and can be used to search the user\u2019s location. If not, SITE utilizes VSFM(Visual Structure from Motion) technique to achieve a set of relative locations using some images captured by the phone\u2019s camera. By exploiting the synergy between the set of relative locations and the set of initial locations computed by relative directions, an optimal transformation relationship is obtained and applied to refine the initial calculated results. The refined result will be regarded as the user\u2019s location. In the evaluation, we implemented a prototype and deployed a real platform of acoustic sources in different scenarios. Experimental results show that SITE has excellent performance of localization accuracy, robustness and feasibility in practical application.<\/jats:p>","DOI":"10.3390\/s18082566","type":"journal-article","created":{"date-parts":[[2018,8,7]],"date-time":"2018-08-07T03:44:18Z","timestamp":1533613458000},"page":"2566","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Using Acoustic Signal and Image to Achieve Accurate Indoor Localization"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6400-9106","authenticated-orcid":false,"given":"Rui","family":"Xi","sequence":"first","affiliation":[{"name":"School of Computer Science &amp; Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8268-2951","authenticated-orcid":false,"given":"Daibo","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer Science &amp; Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mengshu","family":"Hou","sequence":"additional","affiliation":[{"name":"School of Computer Science &amp; Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yujun","family":"Li","sequence":"additional","affiliation":[{"name":"School of Computer Science &amp; Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7383-5864","authenticated-orcid":false,"given":"Jun","family":"Li","sequence":"additional","affiliation":[{"name":"School of Computer Engineering, Chengdu Technological University, Chengdu 611731, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,8,6]]},"reference":[{"key":"ref_1","unstructured":"Joshi, K., Hong, S., and Katti, S. (2013, January 2\u20135). Pinpoint: Localizing interfering radios. Proceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation, Lombard, IL, USA."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Liu, K., Liu, X., and Li, X. (2013, January 25\u201328). Guoguo: Enabling fine-grained indoor localization via smartphone. Proceedings of the 11th Annual International Conference on Mobile Systems, Applications, and Services, Taipei, Taiwan.","DOI":"10.1145\/2462456.2464450"},{"key":"ref_3","unstructured":"Xiong, J., and Jamieson, K. (2013, January 2\u20135). Arraytrack: A fine-grained indoor location system. Proceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation, Lombard, IL, USA."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Rai, A., Chintalapudi, K.K., Padmanabhan, V.N., and Sen, R. (2012, January 22\u201326). Zee: Zero effort crowdsourcing for indoor localization. Proceedings of the IEEE 18th International Conference on Mobile Computing and Networking, Istanbul, Turkey.","DOI":"10.1145\/2348543.2348580"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Jiang, Y., Pan, X., Li, K., Lv, Q., Dick, R.P., Hannigan, M., and Shang, L. (2012, January 5\u20138). Ariel: Automatic wi-fi based room fingerprinting for indoor localization. Proceedings of the 2012 ACM Conference on Ubiquitous Computing, Pittsburgh, PA, USA.","DOI":"10.1145\/2370216.2370282"},{"key":"ref_6","first-page":"111","article-title":"Achieving centimeter-accuracy indoor localization on WiFi platforms: A frequency hopping approach","volume":"4","author":"Chen","year":"2017","journal-title":"IEEE Internet Things J."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Chen, Y., Lymberopoulos, D., Liu, J., and Priyantha, B. (2012, January 25\u201329). FM-based indoor localization. Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services, Low Wood Bay, UK.","DOI":"10.1145\/2307636.2307653"},{"key":"ref_8","unstructured":"Xu, Q., Gerber, A., Mao, Z.M., and Pang, J. (July, January 28). AccuLoc: Practical localization of performance measurements in 3 g networks. Proceedings of the 9th International Conference on Mobile Systems, Applications, and Services, Bethesda, MD, USA."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xie, H., Gu, T., Tao, X., Ye, H., and Lv, J. (2014, January 13\u201317). Maloc: A practical magnetic fingerprinting approach to indoor localization using smartphones. Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Seattle, WA, USA.","DOI":"10.1145\/2632048.2632057"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Azizyan, M., Constandache, I., and Choudhury, R.R. (2009, January 20\u201325). Surroundsense: Mobile phone localization via ambience fingerprinting. Proceedings of the 15th Annual International Conference on Mobile Computing and Networking, Beijing, China.","DOI":"10.1145\/1614320.1614350"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lu, H., Pan, W., Lane, N.D., Choudhury, T., and Campbell, A.T. (2009, January 22\u201325). Soundsense: Scalable sound sensing for people-centric applications on mobile phones. Proceedings of the 7th International Conference on Mobile Systems, Applications, and Services, Krak\u00f3w, Poland.","DOI":"10.1145\/1555816.1555834"},{"key":"ref_12","unstructured":"Zimmermann, A., and Rossmann, A. (2015). Feasibility of Bluetooth iBeacons for Indoor Localization, Gesellschaft fu\u00a8r Informatik e.V.. Digital Enterprise Computing (DEC 2015)."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Dickinson, P., Cielniak, G., Szymanezyk, O., and Mannion, M. (2016, January 4\u20137). Indoor positioning of shoppers using a network of Bluetooth Low Energy beacons. Proceedings of the 2016 IEEE International Conference on Indoor Positioning and Indoor Navigation, Alcala de Henares, Spain.","DOI":"10.1109\/IPIN.2016.7743684"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Pirkl, G., and Lukowicz, P. (2012, January 5\u20138). Robust, low cost indoor positioning using magnetic resonant coupling. Proceedings of the 2012 ACM Conference on Ubiquitous Computing, Pittsburgh, PA, USA.","DOI":"10.1145\/2370216.2370281"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Priyantha, N.B., Chakraborty, A., and Balakrishnan, H. (2000, January 6\u201311). The cricket location-support system. Proceedings of the 6th Annual International Conference on Mobile Computing and Networking, Boston, MA, USA.","DOI":"10.1145\/345910.345917"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1016\/j.pmcj.2010.08.005","article-title":"FM radio for indoor localization with spontaneous recalibration","volume":"6","author":"Matic","year":"2010","journal-title":"Pervasive Mobile Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1145\/2829988.2787487","article-title":"Spotfi: Decimeter level localization using WiFi","volume":"45","author":"Kotaru","year":"2015","journal-title":"ACM SIGCOMM Comput. Commun. Rev."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wu, C. (July, January 29). Towards linear-time incremental structure from motion. In Proceeding of the 2013 IEEE International Conference on 3D Vision, Seattle, WA, USA.","DOI":"10.1109\/3DV.2013.25"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Huang, W., Xiong, Y., Li, X.Y., Lin, H., Mao, X., Yang, P., and Liu, Y. (May, January 27). Shake and walk: Acoustic direction finding and fine-grained indoor localization using smartphones. Proceedings of the 2014 IEEE Conference on Computer Communications, Toronto, ON, Canada.","DOI":"10.1109\/INFOCOM.2014.6847959"},{"key":"ref_20","unstructured":"Subramanian, A.P., Deshpande, P., Gao, J., and Das, S.R. (May, January 26). Drive-by localization of roadside WiFi networks. In Proceeding of the 27th IEEE Conference on Computer Communications (INFOCOM), Hong Kong, China."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Zhou, X., Zhang, W., Zhang, Y., Wang, G., Zhao, B.Y., and Zheng, H. (2011, January 19\u201323). I am the antenna: Accurate outdoor AP location using smartphones. Proceedings of the 17th Annual International Conference on Mobile Computing and Networking, Las Vegas, NV, USA.","DOI":"10.1145\/2030613.2030626"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Huang, W., Xiong, Y., Li, X.Y., Hu, Y., Mao, X., and Yang, P. (arXiv, 2015). Walkielokie: Relative positioning for augmented reality using a dummy acoustic speaker, arXiv.","DOI":"10.1145\/2971648.2971655"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Xi, R., Li, Y., Liu, D., Luo, S., and Hou, M. (2016, January 13\u201316). Bat with good eyesight: Using acoustic signal and image to achieve accurate indoor localization. Proceedings of the 22nd IEEE International Conference on Parallel and Distributed Systems, Wuhan, China.","DOI":"10.1109\/ICPADS.2016.0012"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhang, L., Huang, D., Wang, X., Schindelhauer, C., and Wang, Z. (2017). Acoustic NLOS Identification Using Acoustic Channel Characteristics for Smartphone Indoor Localization. Sensors, 17.","DOI":"10.3390\/s17040727"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Robertson, D.P., and Cipolla, R. (2004, January 7\u20139). An image-based system for urban navigation. Proceedings of the 15th British Machine Vision Conference, London, UK.","DOI":"10.5244\/C.18.84"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Sattler, T., Leibe, B., and Kobbelt, L. (2011, January 6\u201313). Fast image-based localization using direct 2D-to-3D matching. Proceedings of the 2011 IEEE International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126302"},{"key":"ref_27","unstructured":"Kosecka, J., Zhou, L., Barber, P., and Duric, Z. (2003, January 18\u201320). Qualitative image based localization in indoors environments. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1109\/TMC.2015.2418205","article-title":"Sextant: Towards Ubiquitous Indoor Localization Service by Photo-Taking of the Environment","volume":"15","author":"Gao","year":"2016","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Balzano, W., Murano, A., and Vitale, F. (2016, January 23\u201325). Wifact-wireless fingerprinting automated continuous training. Proceedings of the 30th International Conference on Advanced Information Networking and Applications Workshops (WAINA), Crans-Montana, Switzerland.","DOI":"10.1109\/WAINA.2016.137"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"79","DOI":"10.3233\/JHS-170582","article-title":"SnotWiFi: Sensor network optimized training for wireless fingerprinting","volume":"24","author":"Balzano","year":"2018","journal-title":"J. High Speed Network."},{"key":"ref_31","unstructured":"Chintalapudi, K., and Padmanabha, V. (2012, January 22\u201326). Centaur: Locating devices in an office environment. Proceedings of the 18th IEEE International Conference on Mobile Computing and Networking, Istanbul, Turkey."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1712","DOI":"10.1109\/TSP.2015.2399860","article-title":"An efficient compartmental model for realtime node tracking over cognitive wireless sensor networks","volume":"63","author":"Kumar","year":"2015","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Kanaris, L., Akis, K., Antonio, L., and Stavros, S. (2017). Fusing Bluetooth beacon data with Wi-Fi radio-maps for improved indoor localization. Sensors, 17.","DOI":"10.3390\/s17040812"},{"key":"ref_34","unstructured":"Sergio, S., and Antoni, P. (2016, January 4\u20137). Fusion system based on WiFi and ultrasounds for in-home positioning systems: The UTOPIA experiment. Proceedings of the 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Alcala de Henares, Spain."},{"key":"ref_35","unstructured":"Kessel, M., and Werner, M. (2011, January 23\u201329). Smartpos: Accurate and precise indoor positioning on mobile phones. Proceedings of the First International Conference on Mobile Services, Resources, and Users (Mobility), Barcelona, Spain."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Chen, S., Li, M., Ren, K., Fu, X., and Qiao, C. (2015, January 1\u20134). Rise of the indoor crowd: Reconstruction of building interior view via mobile crowdsourcing. Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems, Seoul, South Korea.","DOI":"10.1145\/2809695.2809702"},{"key":"ref_37","unstructured":"Gao, R., Zhao, M., Ye, T., Ye, F., Wang, Y., Bian, K., Wang, T., and Li, X. (October, January 30). Jigsaw: Indoor floor plan reconstruction via mobile crowdsensing. Proceedings of the 20th Annual International Conference on Mobile Computing and Networking, Miami, Florida, USA."},{"key":"ref_38","unstructured":"Shen, G., Chen, Z., Zhang, P., Moscibroda, T., and Zhang, Y. (2013, January 2\u20135). Walkie-markie: Indoor pathway mapping made easy. Proceedings of the 10th USENIX Conference on Networked Systems Design and Implementation, Lombard, IL, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/8\/2566\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:16:46Z","timestamp":1760195806000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/8\/2566"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,6]]},"references-count":38,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2018,8]]}},"alternative-id":["s18082566"],"URL":"https:\/\/doi.org\/10.3390\/s18082566","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2018,8,6]]}}}