{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:25:28Z","timestamp":1760235928301,"version":"build-2065373602"},"reference-count":29,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2021,10,14]],"date-time":"2021-10-14T00:00:00Z","timestamp":1634169600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Continental AG","award":["PRORETA 5"],"award-info":[{"award-number":["PRORETA 5"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Bottom-up saliency models identify the salient regions of an image based on features such as color, intensity and orientation. These models are typically used as predictors of human visual behavior and for computer vision tasks. In this paper, we conduct a systematic evaluation of the saliency maps computed with four selected bottom-up models on images of urban and highway traffic scenes. Saliency both over whole images and on object level is investigated and elaborated in terms of the energy and the entropy of the saliency maps. We identify significant differences with respect to the amount, size and shape-complexity of the salient areas computed by different models. Based on these findings, we analyze the likelihood that object instances fall within the salient areas of an image and investigate the agreement between the segments of traffic participants and the saliency maps of the different models. The overall and object-level analysis provides insights on the distinctive features of salient areas identified by different models, which can be used as selection criteria for prospective applications in autonomous driving such as object detection and tracking.<\/jats:p>","DOI":"10.3390\/s21206825","type":"journal-article","created":{"date-parts":[[2021,10,14]],"date-time":"2021-10-14T23:02:16Z","timestamp":1634252536000},"page":"6825","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A Comparison of Bottom-Up Models for Spatial Saliency Predictions in Autonomous Driving"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2334-1073","authenticated-orcid":false,"given":"Jaime","family":"Maldonado","sequence":"first","affiliation":[{"name":"Cognitive Neuroinformatics, University of Bremen, Enrique-Schmidt-Stra\u00dfe 5, 28359 Bremen, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1992-3214","authenticated-orcid":false,"given":"Lino Antoni","family":"Giefer","sequence":"additional","affiliation":[{"name":"Cognitive Neuroinformatics, University of Bremen, Enrique-Schmidt-Stra\u00dfe 5, 28359 Bremen, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2021,10,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1109\/TPAMI.2012.89","article-title":"State-of-the-Art in Visual Attention Modeling","volume":"35","author":"Borji","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zhang, L., and Lin, W. (2013). Selective Visual Attention: Computational Models and Applications, John Wiley & Sons.","DOI":"10.1002\/9780470828144"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Silva, G., Schnitman, L., and Oliveira, L. (2012, January 22\u201325). Multi-Scale Spectral Residual Analysis to Speed up Image Object Detection. Proceedings of the 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images, Ouro Preto, Brazil.","DOI":"10.1109\/SIBGRAPI.2012.20"},{"key":"ref_4","unstructured":"Duthon, P., Quinton, J.C., and Colomb, M. (July, January 27). Visual saliency on the road: Model and database dependent detection. Proceedings of the RFIA 2016, Clermont-Ferrand, France."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2051","DOI":"10.1109\/TITS.2016.2535402","article-title":"Where Does the Driver Look? Top-Down-Based Saliency Detection in a Traffic Driving Environment","volume":"17","author":"Deng","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"5706","DOI":"10.1109\/TIP.2015.2487833","article-title":"Salient Object Detection: A Benchmark","volume":"24","author":"Borji","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Bylinskii, Z., Recasens, A., Borji, A., Oliva, A., Torralba, A., and Durand, F. (2016). Where Should Saliency Models Look Next?. Computer Vision \u2013ECCV 2016, Springer International Publishing.","DOI":"10.1007\/978-3-319-46454-1_49"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"961","DOI":"10.1007\/s11263-018-1070-x","article-title":"Augmented Reality Meets Computer Vision: Efficient Data Generation for Urban Driving Scenes","volume":"126","author":"Alhaija","year":"2018","journal-title":"Int. J. Comput. Vis. (IJCV)"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1109\/TPAMI.2015.2473844","article-title":"Exploiting Surroundedness for Saliency Detection: A Boolean Map Approach","volume":"38","author":"Zhang","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1254","DOI":"10.1109\/34.730558","article-title":"A model of saliency-based visual attention for rapid scene analysis","volume":"20","author":"Itti","year":"1998","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Harel, J., Koch, C., and Perona, P. (2006, January 4\u20137). Graph-Based Visual Saliency. Proceedings of the 19th International Conference on Neural Information Processing Systems, NIPS\u201906, Cambridge, MA, USA.","DOI":"10.7551\/mitpress\/7503.003.0073"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Hou, X., and Zhang, L. (2007, January 17\u201322). Saliency Detection: A Spectral Residual Approach. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383267"},{"key":"ref_13","unstructured":"R Core Team (2021). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Pohlert, T. (2021, October 13). The Pairwise Multiple Comparison of Mean Ranks Package (PMCMR). Available online: https:\/\/mran.microsoft.com\/snapshot\/2015-03-21\/web\/packages\/PMCMR\/vignettes\/PMCMR.pdf.","DOI":"10.32614\/CRAN.package.PMCMR"},{"key":"ref_15","unstructured":"Kummerer, M. (2021, October 13). Pysaliency. Available online: https:\/\/github.com\/matthias-k\/pysaliency."},{"key":"ref_16","first-page":"120","article-title":"The OpenCV Library","volume":"25","author":"Bradski","year":"2000","journal-title":"Dr. Dobb\u2019S J. Softw. Tools"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Perrin, A.F., Zhang, L., and Le Meur, O. (2020). Inferring Visual Biases in UAV Videos from Eye Movements. Drones, 4.","DOI":"10.3390\/drones4030031"},{"key":"ref_18","unstructured":"Duda, R.O., Hart, P.E., and Stork, D.G. (1973). Pattern Classification and Scene Analysis, Wiley."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"8873","DOI":"10.1038\/srep08873","article-title":"Visual Attention Model Based on Statistical Properties of Neuron Responses","volume":"5","author":"Duan","year":"2015","journal-title":"Sci. Rep."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3549","DOI":"10.1007\/s13369-018-3592-5","article-title":"Image Inpainting Algorithm Based on Saliency Map and Gray Entropy","volume":"44","author":"Zeng","year":"2018","journal-title":"Arab. J. Sci. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1007\/s41095-019-0149-9","article-title":"Salient object detection: A survey","volume":"5","author":"Borji","year":"2019","journal-title":"Comput. Vis. Media"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"740","DOI":"10.1109\/TPAMI.2018.2815601","article-title":"What Do Different Evaluation Metrics Tell Us about Saliency Models?","volume":"41","author":"Bylinskii","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Fisher, R.A. (1992). Statistical methods for research workers. Breakthroughs in Statistics, Springer.","DOI":"10.1007\/978-1-4612-4380-9_6"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"99","DOI":"10.2307\/3001913","article-title":"Comparing individual means in the analysis of variance","volume":"5","author":"Tukey","year":"1949","journal-title":"Biometrics"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1080\/01621459.1937.10503522","article-title":"The use of ranks to avoid the assumption of normality implicit in the analysis of variance","volume":"32","author":"Friedman","year":"1937","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_27","unstructured":"Nemenyi, P.B. (1963). Distribution-Free Multiple Comparisons. [Ph.D. Thesis, Princeton University]."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Le Meur, O. (2011, January 11\u201315). Predicting saliency using two contextual priors: The dominant depth and the horizon line. Proceedings of the 2011 IEEE International Conference on Multimedia and Expo, Barcelona, Spain.","DOI":"10.1109\/ICME.2011.6011848"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Giefer, L.A., Khamsehashari, R., and Schill, K. (December, January 18). Evaluation of Measurement Space Representations of Deep Multi-Modal Object Detection for Extended Object Tracking in Autonomous Driving. Proceedings of the 2020 IEEE 3rd Connected and Automated Vehicles Symposium (CAVS), Victoria, Canada.","DOI":"10.1109\/CAVS51000.2020.9334646"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/20\/6825\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:14:31Z","timestamp":1760166871000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/20\/6825"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,14]]},"references-count":29,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2021,10]]}},"alternative-id":["s21206825"],"URL":"https:\/\/doi.org\/10.3390\/s21206825","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,10,14]]}}}