{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T13:49:50Z","timestamp":1740145790234,"version":"3.37.3"},"reference-count":51,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,11,2]],"date-time":"2020-11-02T00:00:00Z","timestamp":1604275200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,11,2]],"date-time":"2020-11-02T00:00:00Z","timestamp":1604275200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100010909","name":"Young Scientists Fund","doi-asserted-by":"publisher","award":["61906206"],"award-info":[{"award-number":["61906206"]}],"id":[{"id":"10.13039\/501100010909","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Image Video Proc."],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n              <jats:p>Considering the significant progress made on RGB-based deep salient object detection (SOD) methods, this paper seeks to bridge the gap between those 2D methods and 4D light field data, instead of implementing specific 4D methods. We observe that the performance of 2D methods changes dramatically with the input refocusing on different depths. This paper attempts to make the 2D methods available for light field SOD by learning to select the best single image from the 4D tensor. Given a 2D method, a deep model is proposed to explicitly compare pairs of SOD results on one light field sample. Moreover, a comparator module is designed to integrate the features from a pair, which provides more discriminative representations to classify. Experiments over 13 latest 2D methods and 2 datasets demonstrate the proposed method can bring about 24.0<jats:italic>%<\/jats:italic> and 5.3<jats:italic>%<\/jats:italic> average improvement of mean absolute error and <jats:italic>F<\/jats:italic>-measure, and outperform state-of-the-art 4D methods by a large margin.<\/jats:p>","DOI":"10.1186\/s13640-020-00536-0","type":"journal-article","created":{"date-parts":[[2020,11,2]],"date-time":"2020-11-02T17:03:14Z","timestamp":1604336594000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Are RGB-based salient object detection methods unsuitable for light field data?"],"prefix":"10.1186","volume":"2020","author":[{"given":"Yu","family":"Liu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huaxin","family":"Xiao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hanlin","family":"Tan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ping","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,11,2]]},"reference":[{"issue":"7","key":"536_CR1","first-page":"1442","volume":"36","author":"A. W. Smeulders","year":"2013","unstructured":"A. W. Smeulders, D. M. Chu, R. Cucchiara, S. Calderara, A. Dehghan, M. Shah, Visual tracking: an experimental survey. IEEE Trans. Pattern Anal. Mach. Intell.36(7), 1442\u20131468 (2013).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"issue":"1","key":"536_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13640-017-0240-z","volume":"2018","author":"G. Liu","year":"2018","unstructured":"G. Liu, Z. Liu, S. Liu, J. Ma, F. Wang, Registration of infrared and visible light image based on visual saliency and scale invariant feature transform. EURASIP J. Image Video Process. 2018(1), 1\u201312 (2018).","journal-title":"EURASIP J. Image Video Process"},{"issue":"1","key":"536_CR3","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1186\/s13640-017-0236-8","volume":"2017","author":"M. Sharif","year":"2017","unstructured":"M. Sharif, M. A. Khan, T. Akram, M. Y. Javed, T. Saba, A. Rehman, A framework of human detection and action recognition based on uniform segmentation and combination of euclidean distance and joint entropy-based features selection. EURASIP J. Image Video Process. 2017(1), 89 (2017).","journal-title":"EURASIP J. Image Video Process"},{"key":"536_CR4","first-page":"7268","volume-title":"CVPR","author":"Y. Wei","year":"2018","unstructured":"Y. Wei, H. Xiao, H. Shi, Z. Jie, J. Feng, T. S. Huang, in CVPR. Revisiting dilated convolution: a simple approach for weakly-and semi-supervised semantic segmentation (IEEESalt Lake City, 2018), pp. 7268\u20137277."},{"key":"536_CR5","volume-title":"AAAI","author":"H. Xiao","year":"2018","unstructured":"H. Xiao, Y. Wei, Y. Liu, M. Zhang, J. Feng, in AAAI. Transferable semi-supervised semantic segmentation (AAAI PressNew Orleans, 2018)."},{"key":"536_CR6","first-page":"2806","volume-title":"CVPR","author":"N. Li","year":"2014","unstructured":"N. Li, J. Ye, Y. Ji, H. Ling, J. Yu, in CVPR. Saliency detection on light field (IEEEColumbus, 2014), pp. 2806\u20132813."},{"key":"536_CR7","first-page":"8838","volume-title":"ICCV","author":"T. Wang","year":"2019","unstructured":"T. Wang, Y. Piao, X. Li, L. Zhang, H. Lu, in ICCV. Deep learning for light field saliency detection (IEEESeoul, 2019), pp. 8838\u20138848."},{"issue":"3","key":"536_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3107956","volume":"13","author":"J. Zhang","year":"2017","unstructured":"J. Zhang, M. Wang, L. Lin, X. Yang, J. Gao, Y. Rui, Saliency detection on light field: a multi-cue approach. ACM TOMM. 13(3), 1\u201322 (2017).","journal-title":"ACM TOMM"},{"key":"536_CR9","first-page":"896","volume-title":"NeurIPS","author":"M. Zhang","year":"2019","unstructured":"M. Zhang, J. Li, W. Ji, Y. Piao, H. Lu, in NeurIPS. Memory-oriented decoder for light field salient object detection (Curran Associates, Inc.Vancouver, 2019), pp. 896\u2013906."},{"issue":"11","key":"536_CR10","first-page":"1","volume":"2","author":"M. Sharif","year":"2005","unstructured":"M. Sharif, M. A. Khan, T. Akram, M. Y. Javed, T. Saba, A. Rehman, Light field photography with a hand-held plenoptic camera. Comput. Sci. Tech. Rep.2(11), 1\u201311 (2005).","journal-title":"Comput. Sci. Tech. Rep."},{"key":"536_CR11","first-page":"7264","volume-title":"ICCV","author":"Z. Wu","year":"2019","unstructured":"Z. Wu, L. Su, Q. Huang, in ICCV. Stacked cross refinement network for edge-aware salient object detection (IEEESeoul, 2019), pp. 7264\u20137273."},{"key":"536_CR12","first-page":"1597","volume-title":"CVPR","author":"R. Achanta","year":"2009","unstructured":"R. Achanta, S. Hemami, F. Estrada, S. Susstrunk, in CVPR. Frequency-tuned salient region detection (IEEEMiami, 2009), pp. 1597\u20131604."},{"key":"536_CR13","first-page":"698","volume-title":"IJCAI","author":"D. -P. Fan","year":"2018","unstructured":"D. -P. Fan, C. Gong, Y. Cao, B. Ren, M. -M. Cheng, A. Borji, in IJCAI. Enhanced-alignment measure for binary foreground map evaluation (AAAI PressStockholm, 2018), pp. 698\u2013704."},{"issue":"3","key":"536_CR14","doi-asserted-by":"publisher","first-page":"569","DOI":"10.1109\/TPAMI.2014.2345401","volume":"37","author":"M. -M. Cheng","year":"2014","unstructured":"M. -M. Cheng, N. J. Mitra, X. Huang, P. H. Torr, S. -M. Hu, Global contrast based salient region detection. IEEE Trans. Pattern Anal. Mach. Intell.37(3), 569\u2013582 (2014).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"536_CR15","first-page":"454","volume-title":"CVPR","author":"Y. Niu","year":"2012","unstructured":"Y. Niu, Y. Geng, X. Li, F. Liu, in CVPR. Leveraging stereopsis for saliency analysis (IEEEProvidence, 2012), pp. 454\u2013461."},{"key":"536_CR16","first-page":"853","volume-title":"CVPR","author":"X. Shen","year":"2012","unstructured":"X. Shen, Y. Wu, in CVPR. A unified approach to salient object detection via low rank matrix recovery (IEEEProvidence, 2012), pp. 853\u2013860."},{"issue":"12","key":"536_CR17","first-page":"3239","volume":"20","author":"H. Xiao","year":"2018","unstructured":"H. Xiao, J. Feng, Y. Wei, M. Zhang, S. Yan, Deep salient object detection with dense connections and distraction diagnosis. IEEE TMM. 20(12), 3239\u20133251 (2018).","journal-title":"IEEE TMM"},{"key":"536_CR18","first-page":"5455","volume-title":"CVPR","author":"G. Li","year":"2015","unstructured":"G. Li, Y. Yu, in CVPR. Visual saliency based on multiscale deep features (IEEEBoston, 2015), pp. 5455\u20135463."},{"key":"536_CR19","first-page":"1265","volume-title":"CVPR","author":"R. Zhao","year":"2015","unstructured":"R. Zhao, W. Ouyang, H. Li, X. Wang, in CVPR. Saliency detection by multi-context deep learning (IEEEBoston, 2015), pp. 1265\u20131274."},{"key":"536_CR20","first-page":"478","volume-title":"CVPR","author":"G. Li","year":"2016","unstructured":"G. Li, Y. Yu, in CVPR. Deep contrast learning for salient object detection (IEEELas Vegas, 2016), pp. 478\u2013487."},{"key":"536_CR21","first-page":"3203","volume-title":"CVPR","author":"Q. Hou","year":"2017","unstructured":"Q. Hou, M. -M. Cheng, X. Hu, A. Borji, Z. Tu, P. H. Torr, in CVPR. Deeply supervised salient object detection with short connections (IEEEHawaii, 2017), pp. 3203\u20133212."},{"key":"536_CR22","first-page":"684","volume-title":"IJCAI","author":"Z. Deng","year":"2018","unstructured":"Z. Deng, X. Hu, L. Zhu, X. Xu, J. Qin, G. Han, P. -A. Heng, in IJCAI. R3net: recurrent residual refinement network for saliency detection (AAAI PressNew Orleans, 2018), pp. 684\u2013690."},{"key":"536_CR23","first-page":"355","volume-title":"ECCV","author":"X. Li","year":"2018","unstructured":"X. Li, F. Yang, H. Cheng, W. Liu, D. Shen, in ECCV. Contour knowledge transfer for salient object detection (SpringerMunich, 2018), pp. 355\u2013370."},{"key":"536_CR24","first-page":"7479","volume-title":"CVPR","author":"X. Qin","year":"2019","unstructured":"X. Qin, Z. Zhang, C. Huang, C. Gao, M. Dehghan, M. Jagersand, in CVPR. Basnet: boundary-aware salient object detection (IEEELong Beach, 2019), pp. 7479\u20137489."},{"key":"536_CR25","first-page":"3127","volume-title":"CVPR","author":"T. Wang","year":"2018","unstructured":"T. Wang, L. Zhang, S. Wang, H. Lu, G. Yang, X. Ruan, A. Borji, in CVPR. Detect globally, refine locally: a novel approach to saliency detection (IEEESalt Lake City, 2018), pp. 3127\u20133135."},{"key":"536_CR26","first-page":"3907","volume-title":"CVPR","author":"Z. Wu","year":"2019","unstructured":"Z. Wu, L. Su, Q. Huang, in CVPR. Cascaded partial decoder for fast and accurate salient object detection (IEEELong Beach, 2019), pp. 3907\u20133916."},{"key":"536_CR27","first-page":"8779","volume-title":"ICCV","author":"J. -X. Zhao","year":"2019","unstructured":"J. -X. Zhao, J. -J. Liu, D. -P. Fan, Y. Cao, J. Yang, M. -M. Cheng, in ICCV. Egnet: edge guidance network for salient object detection (IEEESeoul, 2019), pp. 8779\u20138788."},{"key":"536_CR28","first-page":"3089","volume-title":"CVPR","author":"N. Liu","year":"2018","unstructured":"N. Liu, J. Han, M. -H. Yang, in CVPR. Picanet: learning pixel-wise contextual attention for saliency detection (SpringerMunich, 2018), pp. 3089\u20133098."},{"key":"536_CR29","first-page":"234","volume-title":"ECCV","author":"S. Chen","year":"2018","unstructured":"S. Chen, X. Tan, B. Wang, X. Hu, in ECCV. Reverse attention for salient object detection (SpringerMunich, 2018), pp. 234\u2013250."},{"key":"536_CR30","first-page":"1623","volume-title":"CVPR","author":"M. Feng","year":"2019","unstructured":"M. Feng, H. Lu, E. Ding, in CVPR. Attentive feedback network for boundary-aware salient object detection (IEEELong Beach, 2019), pp. 1623\u20131632."},{"key":"536_CR31","first-page":"7254","volume-title":"ICCV","author":"Y. Piao","year":"2019","unstructured":"Y. Piao, W. Ji, J. Li, M. Zhang, H. Lu, in ICCV. Depth-induced multi-scale recurrent attention network for saliency detection (IEEESeoul, 2019), pp. 7254\u20137263."},{"key":"536_CR32","first-page":"3927","volume-title":"CVPR","author":"J. -X. Zhao","year":"2019","unstructured":"J. -X. Zhao, Y. Cao, D. -P. Fan, M. -M. Cheng, X. -Y. Li, L. Zhang, in CVPR. Contrast prior and fluid pyramid integration for RGBD salient object detection (IEEELong Beach, 2019), pp. 3927\u20133936."},{"issue":"5","key":"536_CR33","doi-asserted-by":"publisher","first-page":"2274","DOI":"10.1109\/TIP.2017.2682981","volume":"26","author":"L. Qu","year":"2017","unstructured":"L. Qu, S. He, J. Zhang, J. Tian, Y. Tang, Q. Yang, RGBD salient object detection via deep fusion. IEEE Trans. Image Process.26(5), 2274\u20132285 (2017).","journal-title":"IEEE Trans. Image Process."},{"key":"536_CR34","first-page":"3051","volume-title":"CVPR","author":"H. Chen","year":"2018","unstructured":"H. Chen, Y. Li, in CVPR. Progressively complementarity-aware fusion network for RGB-D salient object detection (IEEESalt Lake City, 2018), pp. 3051\u20133060."},{"key":"536_CR35","first-page":"199","volume-title":"ICME","author":"C. Zhu","year":"2019","unstructured":"C. Zhu, X. Cai, K. Huang, T. H. Li, G. Li, in ICME. Pdnet: prior-model guided depth-enhanced network for salient object detection (IEEEShanghai, 2019), pp. 199\u2013204."},{"key":"536_CR36","first-page":"2212","volume-title":"IJCAI","author":"J. Zhang","year":"2015","unstructured":"J. Zhang, M. Wang, J. Gao, Y. Wang, X. Zhang, X. Wu, in IJCAI. Saliency detection with a deeper investigation of light field (AAAI PressBuenos Aires, 2015), pp. 2212\u20132218."},{"key":"536_CR37","first-page":"5216","volume-title":"CVPR","author":"N. Li","year":"2015","unstructured":"N. Li, B. Sun, J. Yu, in CVPR. A weighted sparse coding framework for saliency detection (IEEEBoston, 2015), pp. 5216\u20135223."},{"key":"536_CR38","volume-title":"AAAI","author":"Y. Piao","year":"2020","unstructured":"Y. Piao, Z. Rong, M. Zhang, H. Lu, in AAAI. Exploit and replace: an asymmetrical two-stream architecture for versatile light field saliency detection (AAAI PressNew York, 2020)."},{"key":"536_CR39","first-page":"4548","volume-title":"ICCV","author":"D. -P. Fan","year":"2017","unstructured":"D. -P. Fan, M. -M. Cheng, Y. Liu, T. Li, A. Borji, in ICCV. Structure-measure: a new way to evaluate foreground maps (IEEEVenice, 2017), pp. 4548\u20134557."},{"key":"536_CR40","first-page":"3623","volume-title":"CVPR","author":"X. Lu","year":"2019","unstructured":"X. Lu, W. Wang, C. Ma, J. Shen, L. Shao, F. Porikli, in CVPR. See more, know more: unsupervised video object segmentation with co-attention siamese networks (IEEELong Beach, 2019), pp. 3623\u20133632."},{"key":"536_CR41","volume-title":"ICLR","author":"C. Xiong","year":"2016","unstructured":"C. Xiong, V. Zhong, R. Socher, in ICLR. Dynamic coattention networks for question answering (ICLRPuerto Rico, 2016)."},{"key":"536_CR42","first-page":"4077","volume-title":"NIPS","author":"J. Snell","year":"2017","unstructured":"J. Snell, K. Swersky, R. Zemel, in NIPS. Prototypical networks for few-shot learning (Curran Associates, Inc.Long Beach, 2017), pp. 4077\u20134087."},{"key":"536_CR43","first-page":"1199","volume-title":"CVPR","author":"F. Sung","year":"2018","unstructured":"F. Sung, Y. Yang, L. Zhang, T. Xiang, P. H. Torr, T. M. Hospedales, in CVPR. Learning to compare: relation network for few-shot learning (IEEESalt Lake City, 2018), pp. 1199\u20131208."},{"key":"536_CR44","volume-title":"AAAI","author":"Z. Cao","year":"2020","unstructured":"Z. Cao, Q. Xu, R. Cong, Q. Huang, in AAAI. Global context-aware progressive aggregation network for salient object detection (AAAI PressNew York, 2020)."},{"key":"536_CR45","volume-title":"AAAI","author":"J. Wei","year":"2020","unstructured":"J. Wei, S. Wang, Q. Huang, in AAAI. F3net: fusion, feedback and focus for salient object detection (AAAI PressNew York, 2020)."},{"key":"536_CR46","first-page":"3789","volume-title":"ICCV","author":"Y. Xu","year":"2019","unstructured":"Y. Xu, D. Xu, X. Hong, W. Ouyang, R. Ji, M. Xu, G. Zhao, in ICCV. Structured modeling of joint deep feature and prediction refinement for salient object detection (IEEESeoul, 2019), pp. 3789\u20133798."},{"key":"536_CR47","first-page":"3917","volume-title":"CVPR","author":"J. -J. Liu","year":"2019","unstructured":"J. -J. Liu, Q. Hou, M. -M. Cheng, J. Feng, J. Jiang, in CVPR. A simple pooling-based design for real-time salient object detection (IEEELong Beach, 2019), pp. 3917\u20133926."},{"key":"536_CR48","first-page":"1741","volume-title":"CVPR","author":"L. Zhang","year":"2018","unstructured":"L. Zhang, J. Dai, H. Lu, Y. He, G. Wang, in CVPR. A bi-directional message passing model for salient object detection (IEEESalt Lake City, 2018), pp. 1741\u20131750."},{"issue":"8","key":"536_CR49","doi-asserted-by":"publisher","first-page":"1605","DOI":"10.1109\/TPAMI.2016.2610425","volume":"39","author":"N. Li","year":"2017","unstructured":"N. Li, J. Ye, Y. Ji, H. Ling, J. Yu, Saliency detection on light field. IEEE Trans. Pattern Anal. Mach. Intell.39(8), 1605\u20131616 (2017).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"536_CR50","first-page":"770","volume-title":"CVPR","author":"K. He","year":"2016","unstructured":"K. He, X. Zhang, S. Ren, J. Sun, in CVPR. Deep residual learning for image recognition (IEEELas Vegas, 2016), pp. 770\u2013778."},{"key":"536_CR51","doi-asserted-by":"publisher","unstructured":"J. Hu, L. Shen, G. Sun, in 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition. Squeeze-and-Excitation Networks (Salt Lake City, 2018), pp. 7132\u20137141. \n                  https:\/\/doi.org\/10.1109\/CVPR.2018.00745\n                  \n                .","DOI":"10.1109\/CVPR.2018.00745"}],"container-title":["EURASIP Journal on Image and Video Processing"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13640-020-00536-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s13640-020-00536-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13640-020-00536-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,2]],"date-time":"2020-11-02T17:09:05Z","timestamp":1604336945000},"score":1,"resource":{"primary":{"URL":"https:\/\/jivp-eurasipjournals.springeropen.com\/articles\/10.1186\/s13640-020-00536-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,2]]},"references-count":51,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["536"],"URL":"https:\/\/doi.org\/10.1186\/s13640-020-00536-0","relation":{},"ISSN":["1687-5281"],"issn-type":[{"type":"electronic","value":"1687-5281"}],"subject":[],"published":{"date-parts":[[2020,11,2]]},"assertion":[{"value":"23 June 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 October 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 November 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"49"}}