{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T08:31:40Z","timestamp":1780043500907,"version":"3.53.1"},"reference-count":81,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2018,2,6]],"date-time":"2018-02-06T00:00:00Z","timestamp":1517875200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministerio de Economia","award":["TEC2015-71426-REDT"],"award-info":[{"award-number":["TEC2015-71426-REDT"]}]},{"name":"Ministerio de Economia","award":["TIN2012-38080-C04-04"],"award-info":[{"award-number":["TIN2012-38080-C04-04"]}]},{"name":"Ministerio de Economia","award":["TIN2015-71564-C4-2-R"],"award-info":[{"award-number":["TIN2015-71564-C4-2-R"]}]},{"name":"Ministerio de Economia","award":["TIN2015-70202-P"],"award-info":[{"award-number":["TIN2015-70202-P"]}]},{"DOI":"10.13039\/501100006049","name":"CSIC","doi-asserted-by":"publisher","award":["CSIC-PIE Ref.201450E011"],"award-info":[{"award-number":["CSIC-PIE Ref.201450E011"]}],"id":[{"id":"10.13039\/501100006049","id-type":"DOI","asserted-by":"publisher"}]},{"name":"German Federal Ministry of Education and Research programme","award":["03FH035PB3"],"award-info":[{"award-number":["03FH035PB3"]}]},{"DOI":"10.13039\/501100001871","name":"FCT","doi-asserted-by":"publisher","award":["UID\/CEC\/00319\/2013"],"award-info":[{"award-number":["UID\/CEC\/00319\/2013"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011929","name":"COMPETE","doi-asserted-by":"publisher","award":["POCI-01-0145-FEDER-007043"],"award-info":[{"award-number":["POCI-01-0145-FEDER-007043"]}],"id":[{"id":"10.13039\/501100011929","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004834","name":"UNIVERSITAT JAUME I","doi-asserted-by":"publisher","award":["PREDOC\/2016\/55"],"award-info":[{"award-number":["PREDOC\/2016\/55"]}],"id":[{"id":"10.13039\/501100004834","id-type":"DOI","asserted-by":"publisher"}]},{"name":"H2020-MSCA-ITN-2014","award":["Project ID: 642332"],"award-info":[{"award-number":["Project ID: 642332"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The development of indoor positioning solutions using smartphones is a growing activity with an enormous potential for everyday life and professional applications. The research activities on this topic concentrate on the development of new positioning solutions that are tested in specific environments under their own evaluation metrics. To explore the real positioning quality of smartphone-based solutions and their capabilities for seamlessly adapting to different scenarios, it is needed to find fair evaluation frameworks. The design of competitions using extensive pre-recorded datasets is a valid way to generate open data for comparing the different solutions created by research teams. In this paper, we discuss the details of the 2017 IPIN indoor localization competition, the different datasets created, the teams participating in the event, and the results they obtained. We compare these results with other competition-based approaches (Microsoft and Perf-loc) and on-line evaluation web sites. The lessons learned by organising these competitions and the benefits for the community are addressed along the paper. Our analysis paves the way for future developments on the standardization of evaluations and for creating a widely-adopted benchmark strategy for researchers and companies in the field.<\/jats:p>","DOI":"10.3390\/s18020487","type":"journal-article","created":{"date-parts":[[2018,2,6]],"date-time":"2018-02-06T15:18:05Z","timestamp":1517930285000},"page":"487","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":66,"title":["Off-Line Evaluation of Mobile-Centric Indoor Positioning Systems: The Experiences from the 2017 IPIN Competition"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4338-4334","authenticated-orcid":false,"given":"Joaqu\u00edn","family":"Torres-Sospedra","sequence":"first","affiliation":[{"name":"Institute of New Imaging Technologies, Universitat Jaume I, 12071 Castell\u00f3, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9771-1930","authenticated-orcid":false,"given":"Antonio","family":"Jim\u00e9nez","sequence":"additional","affiliation":[{"name":"Centre for Automation and Robotics (CAR), CSIC-UPM, 28500 Arganda del Rey, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adriano","family":"Moreira","sequence":"additional","affiliation":[{"name":"Algoritmi Research Centre, University of Minho, 4800-058 Guimar\u00e3es, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tom\u00e1s","family":"Lungenstrass","sequence":"additional","affiliation":[{"name":"AraraDS, Monse\u00f1or S\u00f3tero Sanz 161, 8340457 Santiago, Chile"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei-Chung","family":"Lu","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Yuan Ze University, Zhongli 32003, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6873-472X","authenticated-orcid":false,"given":"Stefan","family":"Knauth","sequence":"additional","affiliation":[{"name":"Faculty for Geomatics, Computer Science and Mathematics, HFT Stuttgart\u2014University of Applied Sciences, 70174 Stuttgart, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2744-0236","authenticated-orcid":false,"given":"Germ\u00e1n","family":"Mendoza-Silva","sequence":"additional","affiliation":[{"name":"Institute of New Imaging Technologies, Universitat Jaume I, 12071 Castell\u00f3, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fernando","family":"Seco","sequence":"additional","affiliation":[{"name":"Centre for Automation and Robotics (CAR), CSIC-UPM, 28500 Arganda del Rey, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7037-0635","authenticated-orcid":false,"given":"Antoni","family":"P\u00e9rez-Navarro","sequence":"additional","affiliation":[{"name":"Estudis d\u2019Inform\u00e0tica, Multim\u00e8dia i Telecomunicaci\u00f3, Universitat Oberta de Catalunya, Rambla del Poblenou 156, 08018 Barcelona, Spain"},{"name":"Internet Interdisciplinary Institute IN3, Av. Carl Friedrich Gauss 5, 08860 Castelldefels, Barcelona, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria","family":"Nicolau","sequence":"additional","affiliation":[{"name":"Algoritmi Research Centre, University of Minho, 4800-058 Guimar\u00e3es, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0691-1377","authenticated-orcid":false,"given":"Ant\u00f3nio","family":"Costa","sequence":"additional","affiliation":[{"name":"Algoritmi Research Centre, University of Minho, 4800-058 Guimar\u00e3es, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0575-981X","authenticated-orcid":false,"given":"Filipe","family":"Meneses","sequence":"additional","affiliation":[{"name":"Centro de Computa\u00e7\u00e3o Gr\u00e1fica (CCG), 4800-058 Guimar\u00e3es, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joaqu\u00edn","family":"Farina","sequence":"additional","affiliation":[{"name":"AraraDS, Monse\u00f1or S\u00f3tero Sanz 161, 8340457 Santiago, Chile"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juan","family":"Morales","sequence":"additional","affiliation":[{"name":"AraraDS, Monse\u00f1or S\u00f3tero Sanz 161, 8340457 Santiago, Chile"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wen-Chen","family":"Lu","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Yuan Ze University, Zhongli 32003, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ho-Ti","family":"Cheng","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Yuan Ze University, Zhongli 32003, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shi-Shen","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Ilan University, Yilan 26047, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1580-0257","authenticated-orcid":false,"given":"Shih-Hau","family":"Fang","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Yuan Ze University, Zhongli 32003, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3013-0290","authenticated-orcid":false,"given":"Ying-Ren","family":"Chien","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Ilan University, Yilan 26047, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6956-0418","authenticated-orcid":false,"given":"Yu","family":"Tsao","sequence":"additional","affiliation":[{"name":"Research Center for Information Technology Innovation, Academia Sinica, Taipei 11529, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2018,2,6]]},"reference":[{"key":"ref_1","unstructured":"(2017, November 01). Markets and Markets: Indoor Location Market Worth 40.99 Billion USD by 2022. Available online: http:\/\/www.marketsandmarkets.com\/PressReleases\/indoor-location.asp."},{"key":"ref_2","unstructured":"(2017, November 23). Global Indoor Location Market Analysis (2017\u20132023). Available online: https:\/\/www.reportlinker.com\/p05207399\/Global-Indoor-Location-Market-Analysis.html."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Pipelidis, G., Rad, O.R.M., prehofer, C., Iwaszczuk, D., and Hugentobler, U. (2017, January 18\u201321). A Novel Approach for Dynamic Vertical Indoor Mapping through Crowd-sourced Smartphone Sensor Data. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115902"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Takayuki Akiyama, M.S., and Hashizume, H. (2017, January 18\u201321). Time-of-arrival-based Smartphone Localization Using Visible Light Communication. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115904"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Moreira, A., Silva, I., Meneses, F., Nicolau, M.J., Pend\u00e3o, C., and Torres-Sospedra, J. (2017, January 18\u201321). Multiple simultaneous Wi-Fi measurements in fingerprinting indoor positioning. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115914"},{"key":"ref_6","unstructured":"Bousdar, D., Blanco, L.E.D., and Diaz, E.M. (2017, January 18\u201321). Performance comparison of wearable-based pedestrian navigation systems in large areas. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Berkvens, R., Bellekens, B., and Weyn, M. (2017, January 18\u201321). Signal Strength Indoor Localization using a Single DASH7 Message. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115875"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Tiemann, J., and Wietfeld, C. (2017, January 18\u201321). Scalable and Precise Multi-UAV Indoor Navigation using DOA-based UWB Localization. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115937"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Anagnostopoulos, G.G., Deriaz, M., Gaspoz, J.M., Konstantas, D., and Guessous, I. (2017, January 18\u201321). Navigational Needs and Requirements of Hospital Staff: Geneva University Hospitals Case Study. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115958"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wei, D., Ji, X., Li, W., Yuan, H., and Xu1, Y. (2017, January 18\u201321). Vehicle Localization Based on Odometry Assisted Magnetic Matching. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115941"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Antigny, N., Servi\u00e8res, M., and Renaudin, V. (2017, January 18\u201321). Pedestrian Track Estimation with Handheld Monocular Camera and Inertial-Magnetic Sensor for Urban Augmented Reality. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115934"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Walsh, E., Daems, W., and Steckel, J. (2017, January 18\u201321). Stable Six-DoF Head-Pose Tracking in Assistive Technology Application. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115957"},{"key":"ref_13","unstructured":"Gualda, D., D\u00edaz, E., Garcia, J.J., del Carmen Perez, M., Ure\u00f1a, J.U., and Cervig\u00f3n, R. (2017, January 18\u201321). Patient Activity Monitoring for Smartphones based on a PDR Algorithm. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan."},{"key":"ref_14","unstructured":"Schumann, J., and Boltes, M. (2017, January 18\u201321). Tracking of wheelchair users in dense crowds. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Gualda, D., Ure\u00f1a, J.U., Garcia, J.C., del Carmen Perez, M., and D\u00edaz, E. (2017, January 18\u201321). Study of Cooperative Position Estimations of Mobile Robots. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115967"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Nguyen, K.A., Watkins, C., and Luo, Z. (2017, January 18\u201321). Co-location Epidemic Tracking on London Public Transports Using Low Power Mobile Magnetometer. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115963"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Perera, A., Arukgoda, J., Ranasinghe, R., and Dissanayake, G. (2017, January 18\u201321). Localization System for Carers to Track Elderly People in Visits to a Crowded Shopping Mall. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115936"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Jim\u00e9nez, A.R., and Seco, F. (2017, January 18\u201321). Finding objects using UWB or BLE localization technology: A museum-like use case. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115865"},{"key":"ref_19","unstructured":"Bahl, P., and Padmanabhan, V.N. (2000, January 26\u201330). RADAR: An In-Building RF-Based User Location and Tracking System. Proceedings of the IEEE Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM 2000), Tel Aviv, Israel."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Youssef, M., and Agrawala, A.K. (2005, January 6\u20138). The Horus WLAN location determination system. Proceedings of the 3rd International Conference on Mobile Systems, Applications, and Services (MobiSys 2005), Seattle, WA, USA.","DOI":"10.1145\/1067170.1067193"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Jovan Powar, C.G., and Harle, R. (2017, January 18\u201321). Assessing the Impact of Multi-Channel BLE Beacons on Fingerprint-based Positioning. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115871"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Gharat, V., Colin, E., Baudoin, G., and Richard, D. (2017, January 18\u201321). Indoor Performance Analysis of LF-RFID based Positioning System: Comparison with UHF-RFID and UWB. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115901"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Jim\u00e9nez, A.R., and Seco, F. (2015, January 13\u201316). Combining RSS-based trilateration methods with radio-tomographic imaging: Exploring the capabilities of long-range RFID systems. Proceedings of the 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Banff, AB, Canada.","DOI":"10.1109\/IPIN.2015.7346937"},{"key":"ref_24","unstructured":"Popleteev, A. (2017, January 18\u201321). AmbiLoc: A year-long dataset of FM, TV and GSM fingerprints for ambient indoor localization. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Knobloch, D. (2017, January 18\u201321). Practical Challenges of Particle Filter Based UWB Localization in Vehicular Environments. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115895"},{"key":"ref_26","first-page":"2106","article-title":"Comparing Ubisense, Bespoon and Decawave UWB location systems: indoor performance analysis","volume":"6","author":"Seco","year":"2017","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Rapp, P., Esslinger, D., Sawodny, O., and Tarin, C. (2017, January 18\u201321). Experimental Validation for Opto-Acoustic Distance Measurement based on Code Division Multiple Access Amplitude Modulation and Differential Carrier Phase Estimation. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115891"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Seco, F., Jim\u00e9nez, A.R., and Zampella, F. (2015, January 17\u201319). Fine-Grained Acoustic Positioning with Compensation of CDMA Interference. Proceedings of the 2015 IEEE International Conference on Industrial Technology (ICIT), Seville, Spain.","DOI":"10.1109\/ICIT.2015.7125606"},{"key":"ref_29","unstructured":"Dina Bousdar, E.M.D., and Minguez, J.A.C. (2017, January 18\u201321). Exploiting wearable devices for the calibration of inertial navigation systems. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Jim\u00e9nez, A.R., Seco, F., Prieto, J., and Guevara, J. (2010, January 15\u201317). Pedestrian Indoor Navigation by aiding a Foot-mounted IMU with RFID Signal Strength Measurements. Proceedings of the 2010 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Zurich, Switzerland.","DOI":"10.1109\/IPIN.2010.5646885"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"9393","DOI":"10.3390\/s111009393","article-title":"PDR with a Foot-Mounted IMU and Ramp Detection","volume":"11","author":"Seco","year":"2011","journal-title":"Sensors"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Jim\u00e9nez, A.R., Zampella, F., and Seco, F. (2013, January 28\u201331). Light-Matching : A new Signal of Opportunity for Pedestrian Indoor Navigation. Proceedings of the International Conference on Indoor Positioning and Indoor Navigation (IPIN), Montbeliard-Belfort, France.","DOI":"10.1109\/IPIN.2013.6817843"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Hanley, D., Faustino, A., Zelman, S., Degenhardt, D., and Bretl, T. (2017, January 18\u201321). MagPIE: A Dataset for Indoor Positioning with Magnetic Anomalies. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115961"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Le Scornec, J., Ortiz, M., and Renaudin, V. (2017, January 18\u201321). Foot-mounted pedestrian navigation reference with tightly coupled GNSS carrier phases, inertial and magnetic data. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115882"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1304","DOI":"10.1109\/TVT.2015.2391296","article-title":"Indoor Positioning Using Efficient Map Matching , RSS Measurements , and an Improved Motion Model","volume":"64","author":"Zampella","year":"2015","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/j.sna.2013.08.028","article-title":"Indoor positioning using Pedestrian Dead Reckoning and RSS\/TOF measurements","volume":"203","author":"Zampella","year":"2013","journal-title":"Sens. Actuators A Phys."},{"key":"ref_37","unstructured":"(2017, November 01). Eighth International Conference on Indoor Positioning and Indoor Navigation, Sapporo, Japan, 18\u201321 September 2017. Available online: http:\/\/www.ipin2017.org\/."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sakr, M., and El-Sheimy, N. (2017, January 18\u201321). Efficient Wi-Fi Signal Strength Maps Using Sparse Gaussian Process Models. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115955"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Fet, N., Handte, M., and Marron, P.J. (2017, January 18\u201321). Autonomous Signal Source Displacement Detection and Recalibration of Fingerprinting-based Indoor Localization Systems. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115906"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Potort\u00ec, F., Park, S., Ruiz, A.R.J., Barsocchi, P., Girolami, M., Crivello, A., Lee, S.Y., Lim, J.H., Torres-Sospedra, J., and Seco, F. (2017). Comparing the performance of indoor localization systems through the EvAAL framework. Sensors, 17.","DOI":"10.3390\/s17102327"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Kasebzadeh, P., Hendeby, G., Fritsche, C., Gunnarsson, F., and Gustafsson, F. (2017, January 18\u201321). IMU Dataset For Motion and Device Mode Classification. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115956"},{"key":"ref_42","unstructured":"(2017, November 01). IPIN International Standards Committee (ISC). Available online: http:\/\/ipin-standards.org\/."},{"key":"ref_43","unstructured":"(2017, December 15). ISO\/IEC 18305:2016. Information Technology\u2014Real Time Locating Systems\u2014Test and Evaluation of Localization and Tracking Systems. Available online: https:\/\/www.iso.org\/standard\/62090.html."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1145\/2721914.2721923","article-title":"Microsoft Indoor Localization Competition: Experiences and Lessons Learned","volume":"18","author":"Lymberopoulos","year":"2015","journal-title":"GetMob. Mob. Comput. Commun."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Lymberopoulos, D., Liu, J., Yang, X., Choudhury, R.R., Handziski, V., and Sen, S. (2015, January 13\u201316). A Realistic Evaluation and Comparison of Indoor Location Technologies: Experiences and Lessons Learned. Proceedings of the 14th International Conference on Information Processing in Sensor Networks (IPSN \u201915), Seattle, WA, USA.","DOI":"10.1145\/2737095.2737726"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1109\/MSP.2017.2713817","article-title":"The Microsoft Indoor Localization Competition: Experiences and Lessons Learned","volume":"34","author":"Lymberopoulos","year":"2017","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1109\/MPRV.2013.23","article-title":"Evaluating AAL solutions through competitive benchmarking: The localization competition","volume":"12","author":"Barsocchi","year":"2013","journal-title":"IEEE Pervasive Comput. Mag."},{"key":"ref_48","unstructured":"Chessa, S., Furfari, F., Potort\u00ec, F., L\u00e1zaro, J.P., and Salvi, D. (2011). EvAAL: Evaluating AAL Systems through Competitive Benchmarking, Springer. ERCIM News."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Salvi, D., Barsocchi, P., Arredondo, M.T., and Ramos, J.P.L. (2011). EvAAL, Evaluating AAL Systems through Competitive Benchmarking, the Experience of the 1st Competition, Springer. International Competitions and Final Workshop.","DOI":"10.1007\/978-3-642-33533-4_2"},{"key":"ref_50","unstructured":"(2017, December 15). EvAAL-ETRI On-Site and Off-Site Indoor Localization Competition. Available online: http:\/\/www.ucalgary.ca\/ipin2015\/call-papers\/call-competition."},{"key":"ref_51","unstructured":"(2017, December 15). IPIN 2016 Indoor Localization Competition. Available online: http:\/\/www3.uah.es\/ipin2016\/cfc.php."},{"key":"ref_52","unstructured":"(2017, December 15). PerfLoc: Performance Evaluation of Smartphone Indoor Localization Apps, Available online: https:\/\/perfloc.nist.gov\/perfloc.php."},{"key":"ref_53","unstructured":"(2017, December 15). Geo IoT World Indoor Location Testbed. Available online: https:\/\/www.geoiotworld.com\/testbed."},{"key":"ref_54","unstructured":"(2017, December 15). Evaluation of RF-Based Indoor Localization Solutions for the Future Internet. Available online: http:\/\/www.evarilos.eu\/index.php."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1109\/MCOM.2015.7263356","article-title":"Platform for benchmarking of RF-based indoor localization solutions","volume":"53","author":"Haute","year":"2015","journal-title":"IEEE Commun. Mag."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Lemic, F., Handziski, V., Wolisz, A., Constambeys, T., Laoudias, C., Adler, S., Schmitt, S., and Yang, Y. (2015, January 22\u201324). Experimental evaluation of RF-based indoor localization algorithms under RF interference. Proceedings of the 2015 International Conference on Location and GNSS (ICL-GNSS), Gothenburg, Sweden.","DOI":"10.1109\/ICL-GNSS.2015.7217149"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1186\/s12942-016-0034-z","article-title":"Performance analysis of multiple Indoor Positioning Systems in a healthcare environment","volume":"15","author":"Crombez","year":"2016","journal-title":"Int. J. Health Geogr."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Montoliu, R., Sansano, E., Torres-Sospedra, J., and Belmonte, O. (2017, January 18\u201321). IndoorLoc Platform: A Public Repository for Comparing and Evaluating Indoor Positioning Systems. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115940"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Shrestha, S., Talvitie, J., and Lohan, E.S. (2013, January 25\u201327). Deconvolution-based indoor localization with WLAN signals and unknown access point locations. Proceedings of the 2013 International Conference on Localization and GNSS (ICL-GNSS), Turin, Italy.","DOI":"10.1109\/ICL-GNSS.2013.6577256"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Talvitie, J., Lohan, E.S., and Renfors, M. (2014, January 24\u201326). The effect of coverage gaps and measurement inaccuracies in fingerprinting based indoor localization. Proceedings of the International Conference on Localization and GNSS 2014 (ICL-GNSS 2014), Helsinki, Finland.","DOI":"10.1109\/ICL-GNSS.2014.6934181"},{"key":"ref_61","unstructured":"King, T., Kopf, S., Haenselmann, T., Lubberger, C., and Effelsberg, W. (2017, December 15). CRAWDAD Dataset Mannheim\/Compass (v. 2008-04-11). Available online: http:\/\/crawdad.org\/mannheim\/compass\/20080411\/fingerprint."},{"key":"ref_62","unstructured":"Rhee, I., Shin, M., Hong, S., Lee, K., Kim, S., and Chong, S. (2017, December 15). CRAWDAD Dataset Ncsu\/Mobilitymodels (v. 2009-07-23). Available online: http:\/\/crawdad.org\/ncsu\/mobilitymodels\/20090723."},{"key":"ref_63","unstructured":"Nahrstedt, K., and Vu, L. (2017, December 15). CRAWDAD Dataset Uiuc\/Uim (v. 2012-01-24). Available online: http:\/\/crawdad.org\/uiuc\/uim\/20120124."},{"key":"ref_64","unstructured":"Purohit, A., Pan, S., Chen, K., Sun, Z., and Zhang, P. (2017, December 15). CRAWDAD Dataset Cmu\/Supermarket (v. 2014-05-27). Available online: http:\/\/crawdad.org\/cmu\/supermarket\/20140527."},{"key":"ref_65","unstructured":"Parasuraman, R., Caccamo, S., Baberg, F., and Ogren, P. (2017, December 15). CRAWDAD Dataset Kth\/Rss (v. 2016-01-05). Available online: http:\/\/crawdad.org\/kth\/rss\/20160105."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Torres-Sospedra, J., Montoliu, R., Us\u00f3, A.M., Avariento, J.P., Arnau, T.J., Benedito-Bordonau, M., and Huerta, J. (2014, January 27\u201330). UJIIndoorLoc: A new multi-building and multi-floor database for WLAN fingerprint-based indoor localization problems. Proceedings of the 2014 International Conference on Indoor Positioning and Indoor Navigation (IPIN 2014), Busan, Korea.","DOI":"10.1109\/IPIN.2014.7275492"},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Torres-Sospedra, J., Rambla, D., Montoliu, R., Belmonte, O., and Huerta, J. (2015, January 13\u201316). UJIIndoorLoc-Mag: A new database for magnetic field-based localization problems. Proceedings of the 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Banff, AB, Canada.","DOI":"10.1109\/IPIN.2015.7346763"},{"key":"ref_68","first-page":"6092618","article-title":"Providing Databases for Different Indoor Positioning Technologies: Pros and Cons of Magnetic Field and Wi-Fi Based Positioning","volume":"2016","author":"Montoliu","year":"2016","journal-title":"Mob. Inf. Syst."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"1451","DOI":"10.1007\/s00521-013-1364-4","article-title":"An experimental characterization of reservoir computing in ambient assisted living applications","volume":"24","author":"Bacciu","year":"2014","journal-title":"Neural Comput. Appl."},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Barsocchi, P., Crivello, A., Rosa, D.L., and Palumbo, F. (2016, January 4\u20137). A multisource and multivariate dataset for indoor localization methods based on WLAN and geo-magnetic field fingerprinting. Proceedings of the 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Alcala de Henares, Spain.","DOI":"10.1109\/IPIN.2016.7743678"},{"key":"ref_71","unstructured":"Tiemann, J. (2017, December 15). Tudoetknjt\/ed810593: Raw Experimental Results. Available online: http:\/\/doi.org\/10.5281\/zenodo.322616."},{"key":"ref_72","unstructured":"Lohan, E.S., Torres-Sospedra, J., Richter, P., Lepp\u00e4koski, H., Huerta, J., and Cramariuc, A. (2017, December 15). Crowdsourced WiFi Database and Benchmark Software for Indoor Positioning. Available online: https:\/\/doi.org\/10.5281\/zenodo.889797."},{"key":"ref_73","doi-asserted-by":"crossref","unstructured":"Lohan, E.S., Torres-Sospedra, J., Lep\u00e4koski, H., Richter, P., Peng, Z., and Huerta, J. (2017). Wi-Fi Crowdsourced Fingerprinting Dataset for Indoor Positioning. Data, 2.","DOI":"10.3390\/data2040032"},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Torres-Sospedra, J., Jim\u00e9nez, A.R., Knauth, S., Moreira, A., Beer, Y., Fetzer, T., Ta, V.C., Montoliu, R., Seco, F., and Mendoza-Silva, G.M. (2017). The smartphone-based offline indoor location competition at IPIN 2016: Analysis and future work. Sensors, 17.","DOI":"10.3390\/s17030557"},{"key":"ref_75","unstructured":"(2017, December 15). The GetSensorData Android App for Registering All Sensor Stream in a Smartphone. Available online: https:\/\/lopsi.weebly.com\/downloads.html."},{"key":"ref_76","doi-asserted-by":"crossref","unstructured":"Mendoza-Silva, G.M., Torres-Sospedra, J., and Huerta, J. (2017, January 18\u201321). More Realistic Error Distance Calculation for WiFi Indoor Positioning Systems Accuracy Evaluation. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115950"},{"key":"ref_77","doi-asserted-by":"crossref","unstructured":"Knauth, S. (2017, January 18\u201321). Smartphone PDR positioning in large environments employing WiFi, particle filter, and backward optimization. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115918"},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Moreira, A., Nicolau, M.J., Costa, A., and Meneses, F. (2016, January 4\u20137). Indoor tracking from multidimensional sensor data. Proceedings of the 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Alcal\u00e1 de Henares, Spain.","DOI":"10.1109\/IPIN.2016.7743705"},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"2906","DOI":"10.1109\/JSEN.2014.2382568","article-title":"SmartPDR: Smartphone-Based Pedestrian Dead Reckoning for Indoor Localization","volume":"15","author":"Kang","year":"2015","journal-title":"IEEE Sens. J."},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Willemsen, T., Keller, F., and Sternberg, H. (2015, January 13\u201316). A topological approach with MEMS in smartphones based on routing-graph. Proceedings of the 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Banff, AB, Canada.","DOI":"10.1109\/IPIN.2015.7346952"},{"key":"ref_81","doi-asserted-by":"crossref","unstructured":"Knauth, S., Storz, M., Dastageeri, H., Koukofikis, A., and M\u00e4hser-Hipp, N.A. (2015, January 13\u201316). Fingerprint calibrated centroid and scalar product correlation RSSI positioning in large environments. Proceedings of the 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Banff, AB, Canada.","DOI":"10.1109\/IPIN.2015.7346968"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/2\/487\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:54:02Z","timestamp":1760194442000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/2\/487"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,2,6]]},"references-count":81,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2018,2]]}},"alternative-id":["s18020487"],"URL":"https:\/\/doi.org\/10.3390\/s18020487","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,2,6]]}}}