{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T20:23:13Z","timestamp":1754598193717,"version":"3.40.3"},"publisher-location":"Cham","reference-count":28,"publisher":"Springer Nature Switzerland","isbn-type":[{"type":"print","value":"9783031784460"},{"type":"electronic","value":"9783031784477"}],"license":[{"start":{"date-parts":[[2024,12,3]],"date-time":"2024-12-03T00:00:00Z","timestamp":1733184000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,12,3]],"date-time":"2024-12-03T00:00:00Z","timestamp":1733184000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Slippery road weather conditions are prevalent in many regions and cause a regular risk for traffic. Still, there has been less research on how autonomous vehicles could detect slippery driving conditions on the road to drive safely. In this work, we propose a method to predict a dense grip map from the area in front of the car, based on postprocessed multimodal sensor data. We trained a convolutional neural network to predict pixelwise grip values from fused RGB camera, thermal camera, and LiDAR reflectance images, based on weakly supervised ground truth from an optical road weather sensor.<\/jats:p><jats:p>The experiments show that it is possible to predict dense grip values with good accuracy from the used data modalities as the produced grip map follows both ground truth measurements and local weather conditions, such as snowy areas on the road. The model using only the RGB camera or LiDAR reflectance modality provided good baseline results for grip prediction accuracy while using models fusing the RGB camera, thermal camera, and LiDAR modalities improved the grip predictions significantly.<\/jats:p>","DOI":"10.1007\/978-3-031-78447-7_26","type":"book-chapter","created":{"date-parts":[[2024,12,3]],"date-time":"2024-12-03T00:23:52Z","timestamp":1733185432000},"page":"387-404","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Dense Road Surface Grip Map Prediction from\u00a0Multimodal Image Data"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6772-9611","authenticated-orcid":false,"given":"Jyri","family":"Maanp\u00e4\u00e4","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0009-0000-9175-7129","authenticated-orcid":false,"given":"Julius","family":"Pesonen","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4664-6221","authenticated-orcid":false,"given":"Heikki","family":"Hyyti","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3819-5280","authenticated-orcid":false,"given":"Iaroslav","family":"Melekhov","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5088-4041","authenticated-orcid":false,"given":"Juho","family":"Kannala","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1289-2811","authenticated-orcid":false,"given":"Petri","family":"Manninen","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3841-6533","authenticated-orcid":false,"given":"Antero","family":"Kukko","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5360-4017","authenticated-orcid":false,"given":"Juha","family":"Hyypp\u00e4","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,12,3]]},"reference":[{"issue":"12","key":"26_CR1","doi-asserted-by":"publisher","first-page":"1230","DOI":"10.3390\/app7121230","volume":"7","author":"M Acosta","year":"2017","unstructured":"Acosta, M., Kanarachos, S., Blundell, M.: Road friction virtual sensing: a review of estimation techniques with emphasis on low excitation approaches. Appl. Sci. 7(12), 1230 (2017)","journal-title":"Appl. Sci."},{"key":"26_CR2","doi-asserted-by":"crossref","unstructured":"Cech, J., Hanis, T., Kononisky, A., Rurtle, T., Svancar, J., Twardzik, T.: Self-supervised learning of camera-based drivable surface roughness. In: 2021 IEEE Intelligent Vehicles Symposium (IV), pp. 1319\u20131325. IEEE (2021)","DOI":"10.1109\/IV48863.2021.9575288"},{"key":"26_CR3","doi-asserted-by":"crossref","unstructured":"Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 833\u2013851. Springer (2018)","DOI":"10.1007\/978-3-030-01234-2_49"},{"issue":"6","key":"26_CR4","doi-asserted-by":"publisher","first-page":"2461","DOI":"10.1109\/TITS.2019.2918567","volume":"21","author":"Y Du","year":"2019","unstructured":"Du, Y., Liu, C., Song, Y., Li, Y., Shen, Y.: Rapid estimation of road friction for anti-skid autonomous driving. IEEE Trans. Intell. Transp. Syst. 21(6), 2461\u20132470 (2019)","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"26_CR5","doi-asserted-by":"crossref","unstructured":"Du, Z., Skar, A., Pettinari, M., Zhu, X.: Pavement friction evaluation based on vehicle dynamics and vision data using a multi-feature fusion network. Transp. Res. Rec. J. Transp. Res. Board 2677(11), 219\u2013236 (2023)","DOI":"10.1177\/03611981231165029"},{"key":"26_CR6","unstructured":"Guizilini, V., Li, J., Ambrus, R., Pillai, S., Gaidon, A.: Robust semi-supervised monocular depth estimation with reprojected distances. In: Conference on Robot Learning, vol.\u00a0100, pp. 503\u2013512. PMLR (2020)"},{"key":"26_CR7","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770\u2013778. IEEE (2016)","DOI":"10.1109\/CVPR.2016.90"},{"key":"26_CR8","unstructured":"Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: 3rd International Conference on Learning Representations, (ICLR) (2015)"},{"key":"26_CR9","unstructured":"Kivi, J.: Algorithmic road state modelling. Master\u2019s thesis, Aalto University School of Science (2019)"},{"key":"26_CR10","doi-asserted-by":"crossref","unstructured":"Langstrand, J.P., Randem, H.O., Thunem, H., Hoffmann, M.: Using deep learning to classify road surface conditions and to estimate the coefficient of friction. In: 2023 IEEE Intelligent Vehicles Symposium (IV), pp.\u00a01\u20138. IEEE (2023)","DOI":"10.1109\/IV55152.2023.10186717"},{"key":"26_CR11","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., Belongie, S.: Feature pyramid networks for object detection. In: Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2117\u20132125. IEEE (2017)","DOI":"10.1109\/CVPR.2017.106"},{"issue":"24","key":"26_CR12","doi-asserted-by":"publisher","first-page":"9583","DOI":"10.3390\/s22249583","volume":"22","author":"Y Ma","year":"2022","unstructured":"Ma, Y., Wang, M., Feng, Q., He, Z., Tian, M.: Current non-contact road surface condition detection schemes and technical challenges. Sensors 22(24), 9583 (2022)","journal-title":"Sensors"},{"key":"26_CR13","doi-asserted-by":"crossref","unstructured":"Maanp\u00e4\u00e4, J., Taher, J., Manninen, P., Pakola, L., Melekhov, I., Hyypp\u00e4, J.: Multimodal end-to-end learning for autonomous steering in adverse road and weather conditions. In: 2020 25th International Conference on Pattern Recognition (ICPR), pp. 699\u2013706. IEEE (2021)","DOI":"10.1109\/ICPR48806.2021.9413109"},{"key":"26_CR14","unstructured":"Malmivuo, M.: Comparison study of mobile optical friction and temperature meters 2013. Publications by Finnish Transport Agency (2013)"},{"key":"26_CR15","unstructured":"Malmivuo, M.: Test of optical MD30 sensors within M\u00e4nts\u00e4l\u00e4 contract\u00a0\u2013\u00a0winter season 2021\u201322 (in Finnish). Publications by Finnish Transport Infrastructure Agency (2023)"},{"key":"26_CR16","unstructured":"Ojala, R., Sepp\u00e4nen, A.: Enhanced winter road surface condition monitoring with computer vision. arXiv preprint arXiv:2310.00923 (2023)"},{"issue":"8","key":"26_CR17","doi-asserted-by":"publisher","first-page":"1107","DOI":"10.1364\/JOSA.64.001107","volume":"64","author":"KF Palmer","year":"1974","unstructured":"Palmer, K.F., Williams, D.: Optical properties of water in the near infrared. J. Opt. Soc. Am. 64(8), 1107\u20131110 (1974)","journal-title":"J. Opt. Soc. Am."},{"key":"26_CR18","doi-asserted-by":"crossref","unstructured":"Panhuber, C., Liu, B., Scheickl, O., Wies, R., Isert, C.: Recognition of road surface condition through an on-vehicle camera using multiple classifiers. In: Proceedings of SAE-China Congress 2015: Selected Papers, pp. 267\u2013279. Springer (2016)","DOI":"10.1007\/978-981-287-978-3_24"},{"key":"26_CR19","unstructured":"Pesonen, J.: Pixelwise Road Surface Slipperiness Estimation for Autonomous Driving with Weakly Supervised Learning. Master\u2019s thesis, Aalto University School of Science (2023)"},{"key":"26_CR20","unstructured":"Road Weather Management Program of U.S. Department of Transportation: Snow and ice (2023). https:\/\/ops.fhwa.dot.gov\/weather\/weather_events\/snow_ice.htm. Accessed 8 Feb 2024"},{"key":"26_CR21","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., Brox, T.: U-net: convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention, pp. 234\u2013241. Springer (2015)","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"26_CR22","doi-asserted-by":"crossref","unstructured":"Roychowdhury, S., Zhao, M., Wallin, A., Ohlsson, N., Jonasson, M.: Machine learning models for road surface and friction estimation using front-camera images. In: 2018 International Joint Conference on Neural Networks (IJCNN), pp.\u00a01\u20138. IEEE (2018)","DOI":"10.1109\/IJCNN.2018.8489188"},{"key":"26_CR23","doi-asserted-by":"crossref","unstructured":"Ruiz-Llata, M., Rodr\u00edguez-Cortina, M., Mart\u00edn-Mateos, P., Bonilla-Manrique, O.E., L\u00f3pez-Fern\u00e1ndez, J.R.: Lidar design for road condition measurement ahead of a moving vehicle. In: 2017 IEEE Sensors, pp.\u00a01\u20133 (2017)","DOI":"10.1109\/ICSENS.2017.8234230"},{"issue":"3","key":"26_CR24","doi-asserted-by":"publisher","first-page":"612","DOI":"10.3390\/s20030612","volume":"20","author":"E \u0160abanovi\u010d","year":"2020","unstructured":"\u0160abanovi\u010d, E., \u017duraulis, V., Prentkovskis, O., Skrickij, V.: Identification of road-surface type using deep neural networks for friction coefficient estimation. Sensors 20(3), 612 (2020)","journal-title":"Sensors"},{"key":"26_CR25","doi-asserted-by":"crossref","unstructured":"Sebastian, G., Vattem, T., Lukic, L., B\u00fcrgy, C., Schumann, T.: Rangeweathernet for lidar-only weather and road condition classification. In: 2021 IEEE Intelligent Vehicles Symposium (IV), pp. 777\u2013784. IEEE (2021)","DOI":"10.1109\/IV48863.2021.9575320"},{"key":"26_CR26","doi-asserted-by":"crossref","unstructured":"Shin, J., Park, H., Kim, T., et\u00a0al.: Characteristics of laser backscattering intensity to detect frozen and wet surfaces on roads. J. Sens. 8973248 (2019)","DOI":"10.1155\/2019\/8973248"},{"key":"26_CR27","doi-asserted-by":"crossref","unstructured":"Warren, S.G., Brandt, R.E.: Optical constants of ice from the ultraviolet to the microwave: a revised compilation. J. Geophys. Res. Atmos. 113(D14) (2008)","DOI":"10.1029\/2007JD009744"},{"key":"26_CR28","doi-asserted-by":"publisher","DOI":"10.1016\/j.ymssp.2023.111019","volume":"208","author":"T Zhao","year":"2024","unstructured":"Zhao, T., Guo, P., Wei, Y.: Road friction estimation based on vision for safe autonomous driving. Mech. Syst. Signal Process. 208, 111019 (2024)","journal-title":"Mech. Syst. Signal Process."}],"container-title":["Lecture Notes in Computer Science","Pattern Recognition"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-78447-7_26","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,3]],"date-time":"2024-12-03T01:09:32Z","timestamp":1733188172000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-78447-7_26"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,3]]},"ISBN":["9783031784460","9783031784477"],"references-count":28,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-78447-7_26","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"type":"print","value":"0302-9743"},{"type":"electronic","value":"1611-3349"}],"subject":[],"published":{"date-parts":[[2024,12,3]]},"assertion":[{"value":"3 December 2024","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"ICPR","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Pattern Recognition","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Kolkata","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"India","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2024","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"1 December 2024","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"5 December 2024","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"27","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"icpr2024","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/icpr2024.org\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}