{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T20:06:06Z","timestamp":1770753966427,"version":"3.50.0"},"reference-count":43,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2020,5,22]],"date-time":"2020-05-22T00:00:00Z","timestamp":1590105600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key R8D Program of China","award":["2018YFB1003205"],"award-info":[{"award-number":["2018YFB1003205"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61572183 and 61972143"],"award-info":[{"award-number":["61572183 and 61972143"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2020,5,31]]},"abstract":"<jats:p>A spatio-temporal saliency-based frame rate up-conversion (FRUC) approach is proposed, which achieves better quality of interpolated frames and invalidates existing texture variation-based FRUC detectors. A spatio-temporal saliency model is designed to select salient frames. After obtaining initial motion vector field by texture- and color-based bilateral motion estimation, two motion vector refining (MVR) schemes are adopted for high and low saliency frames to hierarchically refine the motion vectors, respectively. To produce high-quality interpolated frames, image enhancement are performed for salient frames after frame interpolation. Due to distinct MVR schemes, there are different degrees of texture information in interpolated frames. Some edge and texture information is supplemented into salient frames as post-processing, which can invalidate existing texture variation-based FRUC detectors. Experimental results show that the proposed approach outperforms state-of-the-art works in both objective and subjective qualities of interpolated frames, and achieves the purpose of FRUC anti-forensics.<\/jats:p>","DOI":"10.1145\/3382506","type":"journal-article","created":{"date-parts":[[2020,5,25]],"date-time":"2020-05-25T22:07:21Z","timestamp":1590444441000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["Spatio-temporal Saliency-based Motion Vector Refinement for Frame Rate Up-conversion"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2186-1793","authenticated-orcid":false,"given":"Jiale","family":"He","sequence":"first","affiliation":[{"name":"Hunan University, Lushangnan Rd, Changsha, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2734-659X","authenticated-orcid":false,"given":"Gaobo","family":"Yang","sequence":"additional","affiliation":[{"name":"Hunan University, Lushangnan Rd, Changsha, China"}]},{"given":"Xin","family":"Liu","sequence":"additional","affiliation":[{"name":"Hunan Applied Technology University, Yuxia Rd, Changde, China"}]},{"given":"Xiangling","family":"Ding","sequence":"additional","affiliation":[{"name":"Hunan University of Science and Technology, Xiangtan, China"}]}],"member":"320","published-online":{"date-parts":[[2020,5,22]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2014.2314487"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2825100"},{"key":"e_1_2_1_3_1","unstructured":"Bryce E. Bayer. 1976. Color imaging array. https:\/\/patents.glgoo.top\/patent\/US3971065\/en US Patent 3 971 065.  Bryce E. Bayer. 1976. Color imaging array. https:\/\/patents.glgoo.top\/patent\/US3971065\/en US Patent 3 971 065."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1006\/jvci.2001.0490"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2007.893835"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2015.2473275"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-018-6504-5"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2017.2676162"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2018.2852799"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1167\/8.7.13"},{"key":"e_1_2_1_11_1","first-page":"89","article-title":"Frame rate up-conversion using linear quadratic motion estimation and trilateral filtering motion smoothing","volume":"12","author":"Guo Yong","year":"2016","unstructured":"Yong Guo , Li Chen , Zhiyong Gao , and Xiaoyun Zhang . 2016 . Frame rate up-conversion using linear quadratic motion estimation and trilateral filtering motion smoothing . Journal of Display Technology 12 , 1 (2016), 89 -- 98 . https:\/\/www.osapublishing.org\/abstract.cfm?uri&equals;jdt-12-1-89 Yong Guo, Li Chen, Zhiyong Gao, and Xiaoyun Zhang. 2016. Frame rate up-conversion using linear quadratic motion estimation and trilateral filtering motion smoothing. Journal of Display Technology 12, 1 (2016), 89--98. https:\/\/www.osapublishing.org\/abstract.cfm?uri&equals;jdt-12-1-89","journal-title":"Journal of Display Technology"},{"key":"e_1_2_1_12_1","volume-title":"Hierarchical prediction-based motion vector refinement for video frame-rate up-conversion. Journal of Real-Time Image Processing","author":"He Jiale","year":"2018","unstructured":"Jiale He , Gaobo Yang , Jingyu Song , Xiangling Ding , and Ran Li. 2018. Hierarchical prediction-based motion vector refinement for video frame-rate up-conversion. Journal of Real-Time Image Processing ( 2018 ), 1--15. https:\/\/link.springer.xilesou.top\/article\/10.1007\/s11554-018-0767-y Jiale He, Gaobo Yang, Jingyu Song, Xiangling Ding, and Ran Li. 2018. Hierarchical prediction-based motion vector refinement for video frame-rate up-conversion. Journal of Real-Time Image Processing (2018), 1--15. https:\/\/link.springer.xilesou.top\/article\/10.1007\/s11554-018-0767-y"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2012.6466992"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2013.2274731"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2007.4429281"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2010.2087832"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-015-2762-7"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2013.2278142"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2013.2288139"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1587\/transinf.2015EDP7027"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.image.2017.02.010"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2780822"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.3390\/fi11020026"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBC.2017.2704423"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2017.2669863"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2012.2197081"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the 11th IEEE International Conference on Multimedia and Expo. IEEE, 778--783","author":"Natan Jacobson","year":"2010","unstructured":"Jacobson Natan , Yenlin Lee , and Mahadevan Vijay . 2010 . Motion vector refinement for FRUC using saliency and segmentation . In Proceedings of the 11th IEEE International Conference on Multimedia and Expo. IEEE, 778--783 . https:\/\/ieeexplore.ieee.xilesou.top\/abstract\/document\/5582574\/ Jacobson Natan, Yenlin Lee, and Mahadevan Vijay. 2010. Motion vector refinement for FRUC using saliency and segmentation. In Proceedings of the 11th IEEE International Conference on Multimedia and Expo. IEEE, 778--783. https:\/\/ieeexplore.ieee.xilesou.top\/abstract\/document\/5582574\/"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2011.2179055"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/83.334974"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2016.7471964"},{"key":"e_1_2_1_31_1","unstructured":"Milan Sonka Vaclav Hlavac and Roger Boyle. 2014. Image Processing Analysis and Machine Vision. Cengage Learning.  Milan Sonka Vaclav Hlavac and Roger Boyle. 2014. Image Processing Analysis and Machine Vision. Cengage Learning."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2012.2205568"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/JDT.2012.2186555"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBC.2016.2550764"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2010.2046057"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-016-3468-1"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jisa.2015.12.001"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/JDT.2013.2263374"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2861567"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180639.1180824"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1049\/iet-cvi.2016.0492"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvcir.2018.01.001"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2009.2039055"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3382506","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3382506","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:26Z","timestamp":1750199906000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3382506"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,22]]},"references-count":43,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,5,31]]}},"alternative-id":["10.1145\/3382506"],"URL":"https:\/\/doi.org\/10.1145\/3382506","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,5,22]]},"assertion":[{"value":"2019-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-02-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-05-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}