{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,14]],"date-time":"2025-12-14T16:12:47Z","timestamp":1765728767224,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2020,2,21]],"date-time":"2020-02-21T00:00:00Z","timestamp":1582243200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"New Energy and Industrial Technology Development Organization","award":["18089495"],"award-info":[{"award-number":["18089495"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Traffic light recognition is an indispensable elemental technology for automated driving in urban areas. In this study, we propose an algorithm that recognizes traffic lights and arrow lights by image processing using the digital map and precise vehicle pose which is estimated by a localization module. The use of a digital map allows the determination of a region-of-interest in an image to reduce the computational cost and false detection. In addition, this study develops an algorithm to recognize arrow lights using relative positions of traffic lights, and the arrow light is used as prior spatial information. This allows for the recognition of distant arrow lights that are difficult for humans to see clearly. Experiments were conducted to evaluate the recognition performance of the proposed method and to verify if it matches the performance required for automated driving. Quantitative evaluations indicate that the proposed method achieved 91.8% and 56.7% of the average f-value for traffic lights and arrow lights, respectively. It was confirmed that the arrow-light detection could recognize small arrow objects even if their size was smaller than 10 pixels. The verification experiments indicate that the performance of the proposed method meets the necessary requirements for smooth acceleration or deceleration at intersections in automated driving.<\/jats:p>","DOI":"10.3390\/s20041181","type":"journal-article","created":{"date-parts":[[2020,2,21]],"date-time":"2020-02-21T10:49:16Z","timestamp":1582282156000},"page":"1181","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["Robust Traffic Light and Arrow Detection Using Digital Map with Spatial Prior Information for Automated Driving"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3247-7001","authenticated-orcid":false,"given":"Keisuke","family":"Yoneda","sequence":"first","affiliation":[{"name":"Institute for Frontier Science Initiative, Kanazawa University, Kanazawa, Ishikawa 920-1192, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Akisuke","family":"Kuramoto","sequence":"additional","affiliation":[{"name":"Department of Mechanical Systems Engineering, Tokyo Metropolitan University, Hino, Tokyo 191-0065, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Naoki","family":"Suganuma","sequence":"additional","affiliation":[{"name":"Institute for Frontier Science Initiative, Kanazawa University, Kanazawa, Ishikawa 920-1192, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Toru","family":"Asaka","sequence":"additional","affiliation":[{"name":"Institute for Frontier Science Initiative, Kanazawa University, Kanazawa, Ishikawa 920-1192, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohammad","family":"Aldibaja","sequence":"additional","affiliation":[{"name":"Institute for Frontier Science Initiative, Kanazawa University, Kanazawa, Ishikawa 920-1192, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ryo","family":"Yanase","sequence":"additional","affiliation":[{"name":"Institute for Frontier Science Initiative, Kanazawa University, Kanazawa, Ishikawa 920-1192, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,2,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Franke, U., Pfeiffer, D., Rabe, C., Knoeppel, C., Enzweiler, M., Stein, F., and Herrtwich, R.G. (2013, January 8\u201312). Making Bertha See. Proceedings of the ICCV Workshop on Computer Vision for Autonomous Driving, Sydney, Australia.","DOI":"10.1109\/ICCVW.2013.36"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Broggi, A., Cerri, P., Debattisti, S., Laghi, M.C., Porta, P.P., Panciroli, M., and Prioletti, A. (2014, January 8\u201311). PROUD-Public ROad Urban Driverless test: Architecture and results. Proceedings of the 2014 IEEE Intelligent Vehicles Symposium, Dearborn, MI, USA.","DOI":"10.1109\/IVS.2014.6856478"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1109\/MM.2015.133","article-title":"An Open Approach to Autonomous Vehicles","volume":"35","author":"Kato","year":"2015","journal-title":"IEEE Micro"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1115\/1.3427093","article-title":"A survey of longitudinal acceleration comfort studies in ground transportation vehicles","volume":"99","author":"Hoberock","year":"1977","journal-title":"J. Dyn. Syst. Meas. Control"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/s40864-015-0012-y","article-title":"Passenger Stability Within Moving Railway Vehicles: Limits on Maximum Longitudinal Acceleration","volume":"1","author":"Powell","year":"2015","journal-title":"Urban Rail Transit"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Levinson, J., and Thrun, S. (2010, January 3\u20137). Robust Vehicle Localization in Urban Environments Using Probabilistic Maps. Proceedings of the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA.","DOI":"10.1109\/ROBOT.2010.5509700"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Yoneda, K., Hashimoto, N., Yanase, R., Aldibaja, M., and Suganuma, N. (2018, January 26\u201330). Vehicle Localization using 76 GHz Omnidirectional Millimeter-Wave Radar for Winter Automated Driving. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium, Changshu, China.","DOI":"10.1109\/IVS.2018.8500378"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wolcott, R.W., and Eustice, R.M. (2014, January 14\u201318). Visual Localization within LIDAR Maps for Automated Urban Driving. Proceedings of the 2014 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA.","DOI":"10.1109\/IROS.2014.6942558"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Fairfield, N., and Urmson, C. (2011, January 9\u201313). Traffic Light Mapping and Detection. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980164"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Levinson, J., Askeland, J., Dolson, J., and Thrun, S. (2011, January 9\u201313). Traffic light mapping, localization and state detection for autonomous vehicles. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5979714"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"John, V., Yoneda, K., Qi, B., Liu, Z., and Mita, S. (2014, January 8\u201311). Traffic Light Recognition in Varying Illumination Using Deep Learning and Saliency Map. Proceedings of the 17th International IEEE Conference on Intelligent Transportation Systems, Qingdao, China.","DOI":"10.1109\/ITSC.2014.6958056"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1109\/TCI.2015.2480006","article-title":"Saliency Map Generation by the Convolutional Neural Network for Real-Time Traffic Light Detection using Template Matching","volume":"1","author":"John","year":"2015","journal-title":"IEEE Trans. Comput. Imaging"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"De Charette, R., and Nashashibi, F. (2009, January 3\u20135). Real Time Visual Traffic Lights Recognition Based on Spot Light Detection and Adaptive Traffic Lights Templates. Proceedings of the 2009 IEEE Intelligent Vehicles Symposium, Xi\u2019an, China.","DOI":"10.1109\/IVS.2009.5164304"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1109\/MITS.2016.2605381","article-title":"Accurate and Reliable Detection of Traffic Lights Using Multiclass Learning and Multiobject Tracking","volume":"8","author":"Chen","year":"2016","journal-title":"IEEE Intell. Transp. Syst. Mag."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chan, T.H., Jia, K., Gao, S., Lu, J., Zeng, Z., and Ma, Y. (2014). Pcanet: A simple deep learning baseline for image classification?. arXiv.","DOI":"10.1109\/TIP.2015.2475625"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.robot.2018.10.004","article-title":"Traffic light recognition using high-definition map features","volume":"111","author":"Hirabayashi","year":"2019","journal-title":"Robot. Auton. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 8\u201310). SSD: Single Shot MultiBox Detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Behrendt, K., Novak, L., and Botros, R. (June, January 29). A Deep Learning Approach to Traffic Lights: Detection, Tracking, and Classification. Proceedings of the 2017 IEEE International Conference on Robotics and Automation, Singapore.","DOI":"10.1109\/ICRA.2017.7989163"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S.K., Girshick, R.B., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_20","unstructured":"Siogkas, G., Skodras, E., and Dermates, E. (2012, January 24\u201326). Traffic Lights Detection in Adverse Conditions using Color, Symmetry and Spatiotemporal Information. Proceedings of the VISAPP 2012, Rome, Italy."},{"key":"ref_21","unstructured":"Omachi, M., and Omachi, S. (2009, January 8\u201311). Traffic light detection with color and edge information. Proceedings of the ICCSIT 2009, Beijing, China."},{"key":"ref_22","unstructured":"Trehard, G., Pollard, E., Bradai, B., and Nashashibi, F. (2014, January 7\u201310). Tracking both pose and status of a traffic light via an Interacting Multiple Model filter. Proceedings of the 17th International Conference on Information Fusion, Salamanca, Spain."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Pon, A.D., Andrienko, O., Harakeh, A., and Waslander, S.L. (2018, January 8\u201310). A Hierarchical Deep Architecture and Mini-Batch Selection Method For Joint Traffic Sign and Light Detection. Proceedings of the IEEE 15th Conference on Computer and Robot Vision, Toronto, ON, Canada.","DOI":"10.1109\/CRV.2018.00024"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yoneda, K., Suganuma, N., and Aldibaja, M. (2016, January 15\u201317). Simultaneous Sate Recognition for Multiple Traffic Signals on Urban Road. Proceedings of the MECATRONICS-REM, Compiegne, France.","DOI":"10.1109\/MECATRONICS.2016.7547129"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Gool, L.V. (2006, January 7\u201313). SURF: Speeded Up Robust Features. Proceedings of the European Conference on Computer Vision 2006, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kuramoto, A., Kameyama, J., Yanase, R., Aldibaja, M., Kim, T.H., Yoneda, K., and Suganuma, N. (2018, January 21\u201323). Digital Map Based Signal State Recognition of Far Traffic Lights with Low Brightness. Proceedings of the 44th Annual Conference of the IEEE Industrial Electronics Society, Washington, DC, USA.","DOI":"10.1109\/IECON.2018.8591043"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1023\/A:1007614523901","article-title":"Improved Boosting Algorithms Using Confidence-rated Predictions","volume":"37","author":"Schapire","year":"1999","journal-title":"Mach. Learn."},{"key":"ref_28","unstructured":"Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Yamamoto, D., and Suganuma, N. (2015, January 28\u201330). Localization for Autonomous Driving on Urban Road. Proceedings of the International Conference on Intelligent Informatics and BioMedical Sciences, Okinawa, Japan.","DOI":"10.1109\/ICIIBMS.2015.7439488"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1007\/s10015-018-0502-6","article-title":"Mono-Camera based vehicle localization using Lidar Intensity Map for automated driving","volume":"24","author":"Yoneda","year":"2018","journal-title":"Artif. Life Robot."},{"key":"ref_31","first-page":"77","article-title":"DynamicMap 2.0: A Traffic Data Management Platform Leveraging Clouds, Edges and Embedded Systems","volume":"18","author":"Watanabe","year":"2018","journal-title":"Int. J. Intell. Transp. Syst. Res."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Yoneda, K., Suganuma, N., Yanase, R., and Aldibaja, M. (2019). Automated driving recognition technologies for adverse weather conditions. IATSS Res., in press.","DOI":"10.1016\/j.iatssr.2019.11.005"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/4\/1181\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T08:59:37Z","timestamp":1760173177000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/4\/1181"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,21]]},"references-count":32,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["s20041181"],"URL":"https:\/\/doi.org\/10.3390\/s20041181","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,2,21]]}}}