{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T17:13:01Z","timestamp":1780333981124,"version":"3.54.1"},"reference-count":48,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2020,8,31]],"date-time":"2020-08-31T00:00:00Z","timestamp":1598832000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM\/IMS Trans. Data Sci."],"published-print":{"date-parts":[[2020,8,31]]},"abstract":"<jats:p>Each year, an average of around 6 million car accidents occur in the United States. Road safety features (e.g., concrete barriers, metal crash barriers, rumble strips) play an important role in preventing or mitigating vehicle crashes. Accurate maps of road safety features is an important component of safety management systems for federal or state transportation agencies, helping traffic engineers identify locations to invest in safety infrastructure. In current practice, mapping road safety features is largely done manually (e.g., observations on the road or visual interpretation of streetview imagery), which is both expensive and time consuming. In this article, we propose a deep learning approach to automatically map road safety features from streetview imagery. Unlike existing convolutional neural networks that classify each image individually, we propose to further add a recurrent neural network (long short-term memory) to capture geographic context of images (spatial autocorrelation effect along linear road network paths). Evaluations on real-world streetview imagery show that our proposed model outperforms several baseline methods.<\/jats:p>","DOI":"10.1145\/3362069","type":"journal-article","created":{"date-parts":[[2020,9,14]],"date-time":"2020-09-14T06:52:46Z","timestamp":1600066366000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Mapping Road Safety Features from Streetview Imagery"],"prefix":"10.1145","volume":"1","author":[{"given":"Arpan Man","family":"Sainju","sequence":"first","affiliation":[{"name":"University of Alabama, Tuscaloosa, AL"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhe","family":"Jiang","sequence":"additional","affiliation":[{"name":"University of Alabama, Tuscaloosa, AL"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,9,14]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the Transportation Research Board 94th Annual Meeting.","author":"Balali Vahid","year":"2015","unstructured":"Vahid Balali, Elizabeth Depwe, and Mani Golparvar-Fard. 2015. Multi-class traffic sign detection and classification using Google Street View images. In Proceedings of the Transportation Research Board 94th Annual Meeting."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40327-015-0027-1"},{"key":"e_1_2_1_3_1","doi-asserted-by":"crossref","first-page":"756","DOI":"10.1080\/15389588.2012.752077","article-title":"The protective effect of roadside barriers for motorcyclists","volume":"14","author":"Bambach Michael R.","year":"2013","unstructured":"Michael R. Bambach, R. J. Mitchell, and Raphael H. Grzebieta. 2013. The protective effect of roadside barriers for motorcyclists. Traffic Injury Prevention 14, 7 (2013), 756--765.","journal-title":"Traffic Injury Prevention"},{"key":"e_1_2_1_4_1","first-page":"69","article-title":"Traffic barrier performance related to vehicle size and type","volume":"1065","author":"Bryden James E.","year":"1986","unstructured":"James E. Bryden and Jan S. Fortuniewicz. 1986. Traffic barrier performance related to vehicle size and type. Transportation Research Record 1065 (1986), 69--78.","journal-title":"Transportation Research Record"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1700035114"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2005.06.042"},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","first-page":"84","DOI":"10.3141\/2377-09","article-title":"Motorcyclist impacts into roadside barriers: Is the European crash test standard comprehensive enough","volume":"2377","author":"Grzebieta Raphael","year":"2013","unstructured":"Raphael Grzebieta, Mike Bambach, and Andrew McIntosh. 2013. Motorcyclist impacts into roadside barriers: Is the European crash test standard comprehensive enough? Transportation Research Record 2377, 1 (2013), 84--91.","journal-title":"Transportation Research Record"},{"key":"e_1_2_1_9_1","doi-asserted-by":"crossref","first-page":"2522","DOI":"10.1016\/j.atmosenv.2011.02.030","article-title":"Model evaluation of roadside barrier impact on near-road air pollution","volume":"45","author":"Hagler Gayle S. W.","year":"2011","unstructured":"Gayle S. W. Hagler, Wei Tang, Matthew J. Freeman, David K. Heist, Steven G. Perry, and Alan F. Vette. 2011. Model evaluation of roadside barrier impact on near-road air pollution. Atmospheric Environment 45, 15 (2011), 2522--2530.","journal-title":"Atmospheric Environment"},{"key":"e_1_2_1_10_1","volume-title":"McIntosh","author":"Jama Hussein H.","year":"2011","unstructured":"Hussein H. Jama, Raphael H. Grzebieta, Rena Friswell, and Andrew S. McIntosh. 2011. Characteristics of fatal motorcycle crashes into roadside safety barriers in Australia and New Zealand. Accident Analysis 8 Prevention 43, 3 (2011), 652--660."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2018.2866809"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2015.10.009"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3139958.3140044"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330878"},{"key":"e_1_2_1_15_1","first-page":"43","article-title":"Spatial ensemble learning for heterogeneous geographic data with class ambiguity","volume":"10","author":"Jiang Zhe","year":"2019","unstructured":"Zhe Jiang, Arpan Man Sainju, Yan Li, Shashi Shekhar, and Joseph Knight. 2019. Spatial ensemble learning for heterogeneous geographic data with class ambiguity. ACM Transactions on Intelligent Systems and Technology 10, 4 (2019), 43.","journal-title":"ACM Transactions on Intelligent Systems and Technology"},{"key":"e_1_2_1_16_1","volume-title":"Spatial Big Data Science","author":"Jiang Zhe","unstructured":"Zhe Jiang and Shashi Shekhar. 2017. Spatial Big Data Science. Springer."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2424321.2424372"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the 2013 IEEE 13th International Conference on Data Mining. IEEE","author":"Jiang Zhe","year":"2013","unstructured":"Zhe Jiang, Shashi Shekhar, Xun Zhou, Joseph Knight, and Jennifer Corcoran. 2013. Focal-test-based spatial decision tree learning: A summary of results. In Proceedings of the 2013 IEEE 13th International Conference on Data Mining. IEEE, Los Alamitos, CA, 320--329."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2014.2373383"},{"key":"e_1_2_1_20_1","first-page":"2019","article-title":"Geographical hidden Markov tree. IEEE Transactions on Knowledge and Data Engineering","volume":"23","author":"Jiang Zhe","year":"2019","unstructured":"Zhe Jiang, Miao Xie, and Arpan Man Sainju. 2019. Geographical hidden Markov tree. IEEE Transactions on Knowledge and Data Engineering. Early Access. July 23, 2019.","journal-title":"Early Access"},{"key":"e_1_2_1_21_1","volume-title":"Assessment of injury rates associated with road barrier collision. Procedia\u2014Social and Behavioral Sciences 48","author":"Karim Hawzheen","year":"2012","unstructured":"Hawzheen Karim, Rolf Magnusson, and Mats Wiklund. 2012. Assessment of injury rates associated with road barrier collision. Procedia\u2014Social and Behavioral Sciences 48 (2012), 52--63."},{"key":"e_1_2_1_22_1","volume-title":"Retrieved","author":"Knowledge Driver","year":"2013","unstructured":"Driver Knowledge. 2013. Car Accident Statistics in the U.S. Retrieved July 16, 2020 from https:\/\/www.driverknowledge.com\/car-accident-statistics\/."},{"key":"e_1_2_1_23_1","volume-title":"Assessing street-level urban greenery using Google Street View and a modified green view index. Urban Forestry 8 Urban Greening 14, 3","author":"Li Xiaojiang","year":"2015","unstructured":"Xiaojiang Li, Chuanrong Zhang, Weidong Li, Robert Ricard, Qingyan Meng, and Weixing Zhang. 2015. Assessing street-level urban greenery using Google Street View and a modified green view index. Urban Forestry 8 Urban Greening 14, 3 (2015), 675--685."},{"key":"e_1_2_1_24_1","unstructured":"Yang Liu Chengjie Sun Lei Lin and Xiaolong Wang. 2016. Learning natural language inference using bidirectional LSTM model and inner-attention. arXiv:1605.09090."},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 19th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM","author":"Mohan Pradeep","year":"2011","unstructured":"Pradeep Mohan, Shashi Shekhar, James A. Shine, James P. Rogers, Zhe Jiang, and Nicole Wayant. 2011. A neighborhood graph based approach to regional co-location pattern discovery: A summary of results. In Proceedings of the 19th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, New York, NY, 122--132."},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the International Conference on Web Services. 134--148","author":"Musaev Aibek","year":"2018","unstructured":"Aibek Musaev, Zhe Jiang, Steven Jones, Pezhman Sheinidashtegol, and Mirbek Dzhumaliev. 2018. Detection of damage and failure events of road infrastructure using social media. In Proceedings of the International Conference on Web Services. 134--148."},{"key":"e_1_2_1_27_1","volume-title":"Retrieved","author":"Office Congressional Budget","year":"2018","unstructured":"Congressional Budget Office. 2018. Public Spending on Transportation and Water Infrastructure, 1956 to 2017. Retrieved July 16, 2020 from https:\/\/www.cbo.gov\/system\/files\/2018-10\/54539-Infrastructure.pdf."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3139958.3139981"},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.iatssr.2013.04.002","article-title":"Observations on the relationship between European standards for safety barrier impact severity and the degree of injury sustained","volume":"37","author":"Roque Carlos","year":"2013","unstructured":"Carlos Roque and Jo\u00e3o Louren\u00e7o Cardoso. 2013. Observations on the relationship between European standards for safety barrier impact severity and the degree of injury sustained. IATSS Research 37, 1 (2013), 21--29.","journal-title":"IATSS Research"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBDATA.2018.2871062"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the International Symposium on Spatial and Temporal Databases. 263--280","author":"Sainju Arpan Man","year":"2017","unstructured":"Arpan Man Sainju and Zhe Jiang. 2017. Grid-based colocation mining algorithms on GPU for big spatial event data: A summary of results. In Proceedings of the International Symposium on Spatial and Temporal Databases. 263--280."},{"key":"e_1_2_1_32_1","volume-title":"et\u00a0al","author":"Schmidt Jennifer D.","year":"2013","unstructured":"Jennifer D. Schmidt, Ronald K. Faller, Dean L. Sicking, John D. Reid, Karla A. Lechtenberg, Robert W. Bielenberg, Scott K. Rosenbaugh, et\u00a0al. 2013. Development of a New Energy-Absorbing Roadside\/Median Barrier System with Restorable Elastomer Cartridges. Technical Report. Nebraska Department of Roads."},{"key":"e_1_2_1_33_1","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1016\/j.atmosenv.2014.08.026","article-title":"Effects of solid barriers on dispersion of roadway emissions","volume":"97","author":"Schulte Nico","year":"2014","unstructured":"Nico Schulte, Michelle Snyder, Vlad Isakov, David Heist, and Akula Venkatram. 2014. Effects of solid barriers on dispersion of roadway emissions. Atmospheric Environment 97 (2014), 286--295.","journal-title":"Atmospheric Environment"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.3390\/ijgi4042306"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the 31st AAAI Conference on Artificial Intelligence.","author":"Szegedy Christian","unstructured":"Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke, and Alexander A. Alemi. 2017. Inception-v4, Inception-ResNet and the impact of residual connections on learning. In Proceedings of the 31st AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.scitotenv.2015.09.067"},{"key":"e_1_2_1_37_1","first-page":"243","article-title":"Traffic sign inventory from Google Street View images. International Archives of the Photogrammetry","volume":"41","author":"Tsai Victor J. D.","year":"2016","unstructured":"Victor J. D. Tsai, Jyun-Han Chen, and Hsun-Sheng Huang. 2016. Traffic sign inventory from Google Street View images. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences 41 (2016), 243--246.","journal-title":"Remote Sensing and Spatial Information Sciences"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 7th LS-DYNA Forum.","author":"Vieira Carlos M.","unstructured":"Carlos M. Vieira, Henrique A. Almeida, Irene S. Ferreira, Joel O. Vasco, Paulo J. B\u00e1rtolo, Rui B. Ruben, and S\u00e9rgio P. Santos. 2008. Development of an impact absorber for roadside barriers. In Proceedings of the 7th LS-DYNA Forum."},{"key":"e_1_2_1_39_1","unstructured":"Yuankai Wu and Huachun Tan. 2016. Short-term traffic flow forecasting with spatial-temporal correlation in a hybrid deep learning framework. arXiv:1612.01022."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220053"},{"key":"e_1_2_1_41_1","unstructured":"Huaxiu Yao Xianfeng Tang Hua Wei Guanjie Zheng Yanwei Yu and Zhenhui Li. 2018. Modeling spatial-temporal dynamics for traffic prediction. arXiv:1803.01254."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11836"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219922"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 6th International Workshop on Urban Computing (UrbComp\u201917)","volume":"14","author":"Yuan Zhuoning","year":"2017","unstructured":"Zhuoning Yuan, Xun Zhou, Tianbao Yang, James Tamerius, and Ricardo Mantilla. 2017. Predicting traffic accidents through heterogeneous urban data: A case study. In Proceedings of the 6th International Workshop on Urban Computing (UrbComp\u201917), Vol. 14."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2018.03.002"},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201917)","author":"Zhang Shanghang","unstructured":"Shanghang Zhang, Guanhang Wu, Joao P. Costeira, and Jose M. F. Moura. 2017. FCN-rLSTM: Deep spatio-temporal neural networks for vehicle counting in city cameras. In Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201917)."},{"key":"e_1_2_1_47_1","volume-title":"Romero","author":"Zou Yaotian","year":"2014","unstructured":"Yaotian Zou, Andrew P. Tarko, Erdong Chen, and Mario A. Romero. 2014. Effectiveness of cable barriers, guardrails, and concrete barrier walls in reducing the risk of injury. Accident Analysis 8 Prevention 72 (2014), 55--65."},{"key":"e_1_2_1_48_1","unstructured":"A. Mehrara Molan M. Rezapour and K. Ksaibati. 2019. Investigating the relationship between the type of traffic barrier and crash severity in trucks and light vehicles. J. Traffic. Transp. Eng. (in press)."}],"container-title":["ACM\/IMS Transactions on Data Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3362069","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3362069","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T13:57:33Z","timestamp":1776347853000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3362069"}},"subtitle":["A Deep Learning Approach"],"short-title":[],"issued":{"date-parts":[[2020,8,31]]},"references-count":48,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,8,31]]}},"alternative-id":["10.1145\/3362069"],"URL":"https:\/\/doi.org\/10.1145\/3362069","relation":{},"ISSN":["2691-1922"],"issn-type":[{"value":"2691-1922","type":"print"}],"subject":[],"published":{"date-parts":[[2020,8,31]]},"assertion":[{"value":"2019-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-09-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-09-14","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}