{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:22:43Z","timestamp":1760239363704,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2020,11,12]],"date-time":"2020-11-12T00:00:00Z","timestamp":1605139200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001729","name":"Swedish Foundation for Strategic Research","doi-asserted-by":"publisher","award":["(N.A.)"],"award-info":[{"award-number":["(N.A.)"]}],"id":[{"id":"10.13039\/501100001729","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004359","name":"Swedish Research Council","doi-asserted-by":"publisher","award":["(N.A.)"],"award-info":[{"award-number":["(N.A.)"]}],"id":[{"id":"10.13039\/501100004359","id-type":"DOI","asserted-by":"publisher"}]},{"name":"STINT joint China-Sweden mobility program","award":["(N.A.)"],"award-info":[{"award-number":["(N.A.)"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61605047","61671212","61550110240"],"award-info":[{"award-number":["61605047","61671212","61550110240"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Golden Seed Project of South China Normal University","award":["20HDKC04"],"award-info":[{"award-number":["20HDKC04"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>To provide high-quality location-based services in the era of the Internet of Things, visible light positioning (VLP) is considered a promising technology for indoor positioning. In this paper, we study a multi-photodiodes (multi-PDs) three-dimensional (3D) indoor VLP system enhanced by reinforcement learning (RL), which can realize accurate positioning in the 3D space without any off-line training. The basic 3D positioning model is introduced, where without height information of the receiver, the initial height value is first estimated by exploring its relationship with the received signal strength (RSS), and then, the coordinates of the other two dimensions (i.e., X and Y in the horizontal plane) are calculated via trilateration based on the RSS. Two different RL processes, namely RL1 and RL2, are devised to form two methods that further improve horizontal and vertical positioning accuracy, respectively. A combination of RL1 and RL2 as the third proposed method enhances the overall 3D positioning accuracy. The positioning performance of the four presented 3D positioning methods, including the basic model without RL (i.e., Benchmark) and three RL based methods that run on top of the basic model, is evaluated experimentally. Experimental results verify that obviously higher 3D positioning accuracy is achieved by implementing any proposed RL based methods compared with the benchmark. The best performance is obtained when using the third RL based method that runs RL2 and RL1 sequentially. For the testbed that emulates a typical office environment with a height difference between the receiver and the transmitter ranging from 140 cm to 200 cm, an average 3D positioning error of 2.6 cm is reached by the best RL method, demonstrating at least 20% improvement compared to the basic model without performing RL.<\/jats:p>","DOI":"10.3390\/s20226470","type":"journal-article","created":{"date-parts":[[2020,11,12]],"date-time":"2020-11-12T20:17:52Z","timestamp":1605212272000},"page":"6470","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Demonstration of Three-Dimensional Indoor Visible Light Positioning with Multiple Photodiodes and Reinforcement Learning"],"prefix":"10.3390","volume":"20","author":[{"given":"Zhuo","family":"Zhang","sequence":"first","affiliation":[{"name":"Centre for Optical and Electromagnetic Research, South China Academy of Advanced Optoelectronics, South China Normal University, Guangzhou 510006, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huayang","family":"Chen","sequence":"additional","affiliation":[{"name":"Centre for Optical and Electromagnetic Research, South China Academy of Advanced Optoelectronics, South China Normal University, Guangzhou 510006, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weikang","family":"Zeng","sequence":"additional","affiliation":[{"name":"Centre for Optical and Electromagnetic Research, South China Academy of Advanced Optoelectronics, South China Normal University, Guangzhou 510006, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinlong","family":"Cao","sequence":"additional","affiliation":[{"name":"Centre for Optical and Electromagnetic Research, South China Academy of Advanced Optoelectronics, South China Normal University, Guangzhou 510006, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuezhi","family":"Hong","sequence":"additional","affiliation":[{"name":"Centre for Optical and Electromagnetic Research, South China Academy of Advanced Optoelectronics, South China Normal University, Guangzhou 510006, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiajia","family":"Chen","sequence":"additional","affiliation":[{"name":"Centre for Optical and Electromagnetic Research, South China Academy of Advanced Optoelectronics, South China Normal University, Guangzhou 510006, China"},{"name":"Department of Electrical Engineering, Chalmers University of Technology, H\u00f6rsalsv\u00e4gen 9, 41296 Gothenburg, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ling, R.W.C., Gupta, A., Vashistha, A., Sharma, M., and Law, C.L. (2018, January 5\u20138). High precision UWB-IR indoor positioning system for IoT applications. Proceedings of the 2018 IEEE 4th World Forum on Internet of Things (WF-IoT), Singapore.","DOI":"10.1109\/WF-IoT.2018.8355162"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Sthapit, P., Gang, H.S., and Pyun, J.Y. (2018, January 24\u201326). Bluetooth based indoor positioning using machine learning algorithms. Proceedings of the 2018 IEEE International Conference on Consumer Electronics\u2014Asia (ICCE-Asia), Jeju, Korea.","DOI":"10.1109\/ICCE-ASIA.2018.8552138"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Andrushchak, V., Maksymyuk, T., Klymash, M., and Ageyev, D. (2018, January 9\u201312). Development of the iBeacon\u2019s positioning algorithm for indoor scenarios. Proceedings of the 2018 International Scientific-Practical Conference Problems of Infocommunications, Science and Technology (PIC S&T), Kharkiv, Ukraine.","DOI":"10.1109\/INFOCOMMST.2018.8632075"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Tang, S., Tok, B., and Hanneghan, M. (2015, January 12\u201315). Passive indoor positioning system (PIPS) using near field communication (NFC) technology. Proceedings of the 2015 International Conference on Developments of E-Systems Engineering (DeSE), Dubai, UAE.","DOI":"10.1109\/DeSE.2015.48"},{"key":"ref_5","unstructured":"(2020, October 30). Ultra-Wideband Technology for Indoor Positioning-by Infsoft. Available online: https:\/\/www.infsoft.com\/technology\/positioning-technologies\/ultra-wideband."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Soner, B., and Ergen, S.C. (2019, January 8\u201311). Vehicular Visible Light Positioning with a Single Receiver. Proceedings of the 2019 PIMRC, Istanbul, Turkey.","DOI":"10.1109\/PIMRC.2019.8904408"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Rahman, A.B.M.M., Li, T., and Wang, Y. (2020). Recent advances in indoor localization via visible light: A survey. Sensors, 20.","DOI":"10.3390\/s20051382"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gu, W., Aminikashani, M., and Kavehrad, M. (2016, January 9\u201311). Indoor visible light positioning system with multipath reflection analysis. Proceedings of the 2016 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA.","DOI":"10.1109\/ICCE.2016.7430533"},{"key":"ref_9","first-page":"1550147718758263","article-title":"Light positioning: A high-accuracy visible light indoor positioning system based on attitude identification and propagation model","volume":"14","author":"Wang","year":"2018","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1109\/TCE.2004.1277847","article-title":"Fundamental analysis for visible-light communication system using LED lights","volume":"50","author":"Komine","year":"2004","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1109\/LCOMM.2011.010411.101945","article-title":"Indoor channel characteristics for visible light communications","volume":"15","author":"Lee","year":"2011","journal-title":"IEEE Commun. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3306","DOI":"10.1109\/JLT.2014.2344772","article-title":"Indoor positioning system using visible light and accelerometer","volume":"32","author":"Yasir","year":"2014","journal-title":"J. Lightwave Technol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"106103","DOI":"10.1117\/1.OE.55.10.106103","article-title":"Three-dimensional indoor visible light positioning system with a single transmitter and a single tilted receiver","volume":"55","author":"Li","year":"2016","journal-title":"Opt. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lam, E.W., and Little, T.D.C. (2019, January 12\u201313). Indoor 3D Location with Low-Cost LiFi Components. Proceedings of the 2019 Global LIFI Congress (GLC), Paris, France.","DOI":"10.1109\/GLC.2019.8864119"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lam, E.W., and Little, T.D.C. (2018, January 20\u201324). Resolving height uncertainty in indoor visible light positioning using a steerable laser. Proceedings of the 2018 IEEE International Conference on Communications Workshops, KansasCity, MO, USA.","DOI":"10.1109\/ICCW.2018.8403739"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"05LT01","DOI":"10.1088\/2040-8986\/ab1389","article-title":"Efficient 3D trilateration algorithm for visible light positioning","volume":"21","author":"Plets","year":"2019","journal-title":"J. Opt."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Plets, D., Bastiaens, S., Ijza, M., Almadani, Y., Martens, L., Reas, W., Stevens, N., and Joseph, W. (October, January 30). Three-dimensional visible light positioning: An Experimental Assessment of the Importance of the LEDs\u2019 Locations. Proceedings of the 2019 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Pisa, Italy.","DOI":"10.1109\/IPIN.2019.8911763"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2480","DOI":"10.1109\/JLT.2014.2327623","article-title":"Three-dimensional visible light indoor localization using AOA and RSS with multiple optical receivers","volume":"32","author":"Yang","year":"2014","journal-title":"J. Lightwave Technol."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Xu, Y., Zhao, J., Shi, J., and Chi, N. (2016). Reversed three-dimensional visible light indoor positioning utilizing annular receivers with multi-photodiodes. Sensors, 16.","DOI":"10.3390\/s16081254"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1166","DOI":"10.1109\/JLT.2015.2507182","article-title":"Indoor position tracking using multiple optical receivers","volume":"34","author":"Yasir","year":"2016","journal-title":"J. Light. Technol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1049\/el.2012.3167","article-title":"Indoor three-dimensional location estimation based on LED visible light communication","volume":"49","author":"Han","year":"2013","journal-title":"Electron. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Gu, W., Kavehard, M., and Aminikashani, M. (2016, January 13\u201318). Three-dimensional indoor light positioning algorithm based on nonlinear estimation. Proceedings of the SPIE OPTO, San Francisco, CA, USA.","DOI":"10.1117\/12.2209240"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liu, P., Mao, T., Ma, K., Chen, J., and Wang, Z. (2019, January 24\u201328). Three-dimensional visible light positioning using regression neural network. Proceedings of the 2019 15th International Wireless Communications and Mobile Computing Conference (IWCMC), Tangier, Morocco.","DOI":"10.1109\/IWCMC.2019.8766658"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Alonso-Gonz\u00e1lez, I., S\u00e1nchez-Rodr\u00edguez, D., Ley-Bosch, C., and Quintana-Su\u00e1rez, M. (2018). Discrete indoor three-dimensional localization system based on neural networks using visible light communication. Sensors, 18.","DOI":"10.3390\/s18041040"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, S., Du, P., Chen, C., and Zhong, W.D. (2018, January 2\u20136). 3D indoor visible light positioning system using RSS ratio with neural network. Proceedings of the 2018 23rd Opto-Electronics and Communications Conference (OECC), Jeju, Korea.","DOI":"10.1109\/OECC.2018.8729887"},{"key":"ref_26","first-page":"1","article-title":"Indoor high-precision three-dimensional positioning algorithm based on visible light communication and fingerprinting using K-means and random forest","volume":"58","author":"Jiang","year":"2019","journal-title":"Opt. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Xu, S., Chen, C.C., Wu, Y., Wang, X., and Wei, F. (2020). Adaptive residual weighted K-nearest neighbor fingerprint positioning algorithm based on visible light communication. Sensors, 20.","DOI":"10.3390\/s20164432"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Chen, H., Hong, X., and Chen, J. (2019, January 3\u20137). Accuracy enhancement of indoor visible light positioning using point-wise reinforcement learning. Proceedings of the 2019 Optical Fiber Communications Conference and Exposition (OFC), San Diego, CA, USA.","DOI":"10.1364\/OFC.2019.Th3I.3"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"22161","DOI":"10.1364\/OE.27.022161","article-title":"Iterative point-wise reinforcement learning for highly accurate indoor visible light positioning","volume":"27","author":"Zhang","year":"2019","journal-title":"Opt. Express"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"045105","DOI":"10.1117\/1.OE.53.4.045105","article-title":"Asynchronous indoor positioning system based on visible light communications","volume":"53","author":"Zhang","year":"2014","journal-title":"Opt. Eng."},{"key":"ref_31","first-page":"1","article-title":"Indoor localization using visible light via fusion of multiple classifiers","volume":"9","author":"Guo","year":"2017","journal-title":"IEEE Photonics J."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Milioris, D. (2019, January 12\u201317). Efficient indoor localization via reinforcement learning. Proceedings of the 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, UK.","DOI":"10.1109\/ICASSP.2019.8683598"},{"key":"ref_33","unstructured":"(2020, October 30). Anthropometry | Sustainable Ergonomics Systems\u2014Ergoweb. Available online: https:\/\/ergoweb.com\/anthropometry\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/22\/6470\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:32:43Z","timestamp":1760178763000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/22\/6470"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,12]]},"references-count":33,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["s20226470"],"URL":"https:\/\/doi.org\/10.3390\/s20226470","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,11,12]]}}}