{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T18:13:32Z","timestamp":1771956812319,"version":"3.50.1"},"reference-count":25,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2022,10,31]],"date-time":"2022-10-31T00:00:00Z","timestamp":1667174400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science and Technology Planning Project of Guangdong Province of China","award":["2021A0505030030"],"award-info":[{"award-number":["2021A0505030030"]}]},{"name":"Science and Technology Planning Project of Guangdong Province of China","award":["ZDSYS20210623091807023"],"award-info":[{"award-number":["ZDSYS20210623091807023"]}]},{"name":"Science and Technology Planning Project of Shenzhen","award":["2021A0505030030"],"award-info":[{"award-number":["2021A0505030030"]}]},{"name":"Science and Technology Planning Project of Shenzhen","award":["ZDSYS20210623091807023"],"award-info":[{"award-number":["ZDSYS20210623091807023"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The global navigation satellite system (GNSS) has played an important role in a broad range of consumer and industrial applications. In particular, cities have become GNSS major application scenarios; however, GNSS signals suffer from blocking, reflection and attenuation in harsh urban environments, resulting in diverse received signals, e.g., non-line-of-sight (NLOS) and multipath signals. NLOS signals often cause severe deterioration in positioning, navigation, and timing (PNT) solutions, which should be identified and excluded. In this paper, we propose a vision-aided NLOS identification method to augment GNSS urban positioning. A skyward omnidirectional camera is installed on a GNSS antenna to collect omnidirectional images of the sky region. After being rectified, these images are processed for sky region segmentation, which is improved by leveraging gradient information and energy function optimization. Image morphology processing is further employed to smooth slender boundaries. After sky region segmentation, the satellites are projected onto the omnidirectional image, from which NLOS satellites are identified. Finally, the identified NLOS satellites are excluded from GNSS PNT estimation, promoting accuracy and stability. Practical test results show that the proposed sky region segmentation module achieves over 96% accuracy, and that completely accurate NLOS identification is achieved for the experimental images. We validate the performance of our method on public datasets. Compared with the raw measurements without screening, the vision-aided NLOS identification method enables improvements of 60.3%, 12.4% and 63.3% in the E, N, and U directions, respectively, as well as an improvement of 58.5% in 3D accuracy.<\/jats:p>","DOI":"10.3390\/rs14215493","type":"journal-article","created":{"date-parts":[[2022,11,2]],"date-time":"2022-11-02T06:49:02Z","timestamp":1667371742000},"page":"5493","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["GNSS Urban Positioning with Vision-Aided NLOS Identification"],"prefix":"10.3390","volume":"14","author":[{"given":"Hexiong","family":"Yao","sequence":"first","affiliation":[{"name":"School of Electronic and Communication Engineering, Sun Yat-Sen University, Shenzhen 518107, China"},{"name":"Shenzhen Key Laboratory of Navigation and Communication Integration, Shenzhen 518107, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6846-2776","authenticated-orcid":false,"given":"Zhiqiang","family":"Dai","sequence":"additional","affiliation":[{"name":"School of Electronic and Communication Engineering, Sun Yat-Sen University, Shenzhen 518107, China"},{"name":"Shenzhen Key Laboratory of Navigation and Communication Integration, Shenzhen 518107, China"}]},{"given":"Weixiang","family":"Chen","sequence":"additional","affiliation":[{"name":"The Department of Electronic Engineering, Tsinghua University, Beijing 100084, China"}]},{"given":"Ting","family":"Xie","sequence":"additional","affiliation":[{"name":"School of Electronic and Communication Engineering, Sun Yat-Sen University, Shenzhen 518107, China"},{"name":"Shenzhen Key Laboratory of Navigation and Communication Integration, Shenzhen 518107, China"}]},{"given":"Xiangwei","family":"Zhu","sequence":"additional","affiliation":[{"name":"School of Electronic and Communication Engineering, Sun Yat-Sen University, Shenzhen 518107, China"},{"name":"Shenzhen Key Laboratory of Navigation and Communication Integration, Shenzhen 518107, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Jin, S., Wang, Q., and Dardanelli, G. (2022). A Review on Multi-GNSS for Earth Observation and Emerging Applications. Remote. Sens., 14.","DOI":"10.3390\/rs14163930"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Cheng, Q., Chen, P., Sun, R., Wang, J., Mao, Y., and Ochieng, W.Y. (2021). A new faulty GNSS measurement detection and exclusion algorithm for urban vehicle positioning. Remote. Sens., 13.","DOI":"10.3390\/rs13112117"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10291-017-0667-9","article-title":"Analysis and modeling GPS NLOS effect in highly urbanized area","volume":"22","author":"Hsu","year":"2018","journal-title":"GPS Solut."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1515\/jag-2020-0045","article-title":"Evaluation of multipath mitigation performance using signal-to-noise ratio (SNR) based signal selection methods","volume":"15","author":"Uaratanawong","year":"2021","journal-title":"J. Appl. Geod."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1002\/navi.257","article-title":"Improved multipath and NLOS signals identification in urban environments","volume":"65","author":"Ziedan","year":"2018","journal-title":"Navigation"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s43020-020-00016-w","article-title":"Machine learning based LOS\/NLOS classifier and robust estimator for GNSS shadow matching","volume":"1","author":"Xu","year":"2020","journal-title":"Satell. Navig."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Wen, W., Zhang, G., and Hsu, L.T. (2018, January 23\u201326). Exclusion of GNSS NLOS receptions caused by dynamic objects in heavy traffic urban scenarios using real-time 3D point cloud: An approach without 3D maps. Proceedings of the 2018 IEEE\/ION Position, Location and Navigation Symposium (PLANS), Monterey, CA, USA.","DOI":"10.1109\/PLANS.2018.8373377"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1002\/navi.335","article-title":"Correcting NLOS by 3D LiDAR and building height to improve GNSS single point positioning","volume":"66","author":"Wen","year":"2019","journal-title":"Navigation"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"853","DOI":"10.1109\/TITS.2019.2961128","article-title":"GNSS NLOS exclusion based on dynamic object detection using LiDAR point cloud","volume":"22","author":"Wen","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Xia, Y., Pan, S., Meng, X., Gao, W., Ye, F., Zhao, Q., and Zhao, X. (2020). Anomaly detection for urban vehicle GNSS observation with a hybrid machine learning system. Remote. Sens., 12.","DOI":"10.3390\/rs12060971"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Attia, D., Meurie, C., Ruichek, Y., and Marais, J. (2011, January 5\u20137). Counting of satellites with direct GNSS signals using Fisheye camera: A comparison of clustering algorithms. Proceedings of the 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC), Washington, DC, USA.","DOI":"10.1109\/ITSC.2011.6082955"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"31","DOI":"10.20965\/jrm.2016.p0031","article-title":"Nlos satellite detection using a fish-eye camera for improving gnss positioning accuracy in urban area","volume":"28","author":"Kato","year":"2016","journal-title":"J. Robot. Mechatronics"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1007\/s40328-015-0114-8","article-title":"Image-based approach for satellite visibility analysis in critical environments","volume":"51","author":"Han","year":"2016","journal-title":"Acta Geod. Geophys."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Suzuki, T., and Amano, Y. (2021). NLOS Multipath Classification of GNSS Signal Correlation Output Using Machine Learning. Sensors, 21.","DOI":"10.3390\/s21072503"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Julien, M., S\u00e9bastien, A., and Yassine, R. (2017). Fisheye-Based Method for GPS Localization Improvement in Unknown Semi-Obstructed Areas. Sensors, 17.","DOI":"10.3390\/s17010119"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"362","DOI":"10.5772\/56884","article-title":"Sky Region Detection in a Single Image for Autonomous Ground Robot Navigation","volume":"10","author":"Shen","year":"2013","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Geyer, C., and Daniilidis, K. (2000). A unifying theory for central panoramic systems and practical implications. European Conference on Computer Vision, Springer.","DOI":"10.1007\/3-540-45053-X_29"},{"key":"ref_18","unstructured":"Barreto, J.P., and Ara\u00fajo, H. (2001, January 8\u201314). Issues on the geometry of central catadioptric image formation. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2001), with CD-ROM, Kauai, HI, USA."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Mei, C., and Rives, P. (2007, January 10\u201314). Single view point omnidirectional camera calibration from planar grids. Proceedings of the 2007 IEEE International Conference on Robotics and Automation, IEEE, Rome, Italy.","DOI":"10.1109\/ROBOT.2007.364084"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1163\/156855303769156983","article-title":"Vision-guided flight stability and control for micro air vehicles","volume":"17","author":"Ettinger","year":"2003","journal-title":"Adv. Robot."},{"key":"ref_21","unstructured":"(2022, June 06). Observables\u2014GNSS-SDR. Available online: https:\/\/gnss-sdr.org\/docs\/sp-blocks\/observables\/."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Simon, D. (2006). Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches, John Wiley & Sons.","DOI":"10.1002\/0470045345"},{"key":"ref_23","unstructured":"Sarunic, P.W. (2016). Development of GPS Receiver Kalman Filter Algorithms for Stationary, Low-Dynamics, and High-Dynamics Applications, Technical Report."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wen, W., Zhou, Y., Zhang, G., Fahandezh-Saadi, S., Bai, X., Zhan, W., Tomizuka, M., and Hsu, L.T. (August, January 31). Urbanloco: A full sensor suite dataset for mapping and localization in urban scenes. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.","DOI":"10.1109\/ICRA40945.2020.9196526"},{"key":"ref_25","unstructured":"Zhang, G., Xu, B., and Hsu, L.T. (December, January 28). GNSS shadow matching based on intelligent LOS\/NLOS Classifier. Proceedings of the 16th IAIN World Congress, Chiba, Japan."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/21\/5493\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:07:06Z","timestamp":1760144826000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/21\/5493"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,31]]},"references-count":25,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["rs14215493"],"URL":"https:\/\/doi.org\/10.3390\/rs14215493","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,31]]}}}