{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,22]],"date-time":"2025-11-22T11:35:02Z","timestamp":1763811302143,"version":"3.41.2"},"reference-count":44,"publisher":"World Scientific Pub Co Pte Ltd","issue":"01","funder":[{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["62176027"],"award-info":[{"award-number":["62176027"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Patt. Recogn. Artif. Intell."],"published-print":{"date-parts":[[2024,1]]},"abstract":"<jats:p> Deep learning-based video coding methods have demonstrated superior performance compared to classical video coding standards in recent years. The vast majority of the existing deep video coding (DVC) networks are based on convolutional neural networks (CNNs), and their main drawback is that since CNNs are affected by the size of the receptive field, they cannot effectively handle long-range dependencies and local detail recovery. Therefore, how to better capture and process the overall structure as well as local texture information in the video coding task is the core issue. Notably, the transformer employs a self-attention mechanism that captures dependencies between any two positions in the input sequence without being constrained by distance limitations. This is an effective solution to the problem described above. In this paper, we propose end-to-end transformer-based adaptive video coding (TAVC). First, we compress the motion vector and residuals through a compression network built on the vision transformer (ViT) and design the motion compensation network based on ViT. Second, based on the requirement of video coding to adapt to different resolution inputs, we introduce a position encoding generator (PEG) as adaptive position encoding (APE) to maintain its translation invariance across different resolution video coding tasks. The experiment shows that for multiscale structural similarity index measurement (MS-SSIM) metrics, this method exhibits significant performance gaps compared to conventional engineering codecs, such as [Formula: see text], [Formula: see text], and VTM-15.2. We also achieved a good performance improvement compared to the CNN-based DVC methods. In the case of peak signal-to-noise ratio (PSNR) evaluation metrics, TAVC also achieves good performance. <\/jats:p>","DOI":"10.1142\/s021800142354023x","type":"journal-article","created":{"date-parts":[[2023,12,4]],"date-time":"2023-12-04T02:48:56Z","timestamp":1701658136000},"source":"Crossref","is-referenced-by-count":2,"title":["An End-to-End Video Coding Method via Adaptive Vision Transformer"],"prefix":"10.1142","volume":"38","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-6291-3115","authenticated-orcid":false,"given":"Haoyan","family":"Yang","sequence":"first","affiliation":[{"name":"College of Computer Science, Chongqing University, Chongqing 400044, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1874-3641","authenticated-orcid":false,"given":"Mingliang","family":"Zhou","sequence":"additional","affiliation":[{"name":"College of Computer Science, Chongqing University, Chongqing 400044, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1588-1387","authenticated-orcid":false,"given":"Zhaowei","family":"Shang","sequence":"additional","affiliation":[{"name":"College of Computer Science, Chongqing University, Chongqing 400044, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9830-3955","authenticated-orcid":false,"given":"Huayan","family":"Pu","sequence":"additional","affiliation":[{"name":"School of Mechanical and Vehicle Engineering, Chongqing University, Chongqing 400044, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1314-5631","authenticated-orcid":false,"given":"Jun","family":"Luo","sequence":"additional","affiliation":[{"name":"School of Mechanical and Vehicle Engineering, Chongqing University, Chongqing 400044, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4635-6112","authenticated-orcid":false,"given":"Xiaoxu","family":"Huang","sequence":"additional","affiliation":[{"name":"College of Materials Science and Engineering, Chongqing University, Chongqing 400044, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3321-027X","authenticated-orcid":false,"given":"Shilong","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Mechanical and Vehicle Engineering, Chongqing University, Chongqing 400044, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6617-0473","authenticated-orcid":false,"given":"Huajun","family":"Cao","sequence":"additional","affiliation":[{"name":"School of Mechanical and Vehicle Engineering, Chongqing University, Chongqing 400044, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3761-1759","authenticated-orcid":false,"given":"Xuekai","family":"Wei","sequence":"additional","affiliation":[{"name":"College of Computer Science, Chongqing University, Chongqing 400044, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5137-3542","authenticated-orcid":false,"given":"Weizhi","family":"Xian","sequence":"additional","affiliation":[{"name":"Chongqing Research Institute of Harbin Institute of Technology, Harbin Institute of Technology, Chongqing 401151, P. R. China"}]}],"member":"219","published-online":{"date-parts":[[2024,1,29]]},"reference":[{"key":"S021800142354023XBIB001","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00853"},{"key":"S021800142354023XBIB002","first-page":"1311","volume-title":"2020 IEEE Int. Conf. Image Processing (ICIP)","author":"Akin Yilmaz M.","year":"2020"},{"key":"S021800142354023XBIB003","first-page":"2475","volume-title":"2023 IEEE Int. Conf. Image Processing (ICIP)","author":"Ak\u0131n Y\u0131lmaz M.","year":"2023"},{"key":"S021800142354023XBIB005","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00338"},{"key":"S021800142354023XBIB006","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-019-08572-3"},{"key":"S021800142354023XBIB007","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2021.3101953"},{"key":"S021800142354023XBIB008","doi-asserted-by":"publisher","DOI":"10.1142\/S0218001423550121"},{"key":"S021800142354023XBIB009","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-25066-8_9"},{"key":"S021800142354023XBIB010","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58452-8_13"},{"key":"S021800142354023XBIB011","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00598"},{"key":"S021800142354023XBIB012","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00796"},{"key":"S021800142354023XBIB015","doi-asserted-by":"publisher","DOI":"10.1145\/3503161.3548156"},{"key":"S021800142354023XBIB016","doi-asserted-by":"publisher","DOI":"10.1142\/S0218001423510102"},{"key":"S021800142354023XBIB017","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58536-5_12"},{"key":"S021800142354023XBIB018","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00583"},{"key":"S021800142354023XBIB019","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00155"},{"key":"S021800142354023XBIB020","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2006.93"},{"key":"S021800142354023XBIB021","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.02166"},{"volume-title":"IEEE Trans. Circuits Syst. Video Technol.","year":"2022","author":"Lin K.","key":"S021800142354023XBIB022"},{"key":"S021800142354023XBIB023","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00360"},{"key":"S021800142354023XBIB024","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP42928.2021.9506269"},{"key":"S021800142354023XBIB025","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01773"},{"key":"S021800142354023XBIB026","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"S021800142354023XBIB027","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2020.3035680"},{"key":"S021800142354023XBIB028","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01126"},{"key":"S021800142354023XBIB029","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2020.2988453"},{"key":"S021800142354023XBIB030","doi-asserted-by":"publisher","DOI":"10.1142\/S0218001415550083"},{"key":"S021800142354023XBIB032","doi-asserted-by":"publisher","DOI":"10.1145\/3339825.3394937"},{"key":"S021800142354023XBIB033","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3046040"},{"key":"S021800142354023XBIB034","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00661"},{"key":"S021800142354023XBIB035","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01421"},{"key":"S021800142354023XBIB036","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1948.tb01338.x"},{"key":"S021800142354023XBIB038","first-page":"802","volume-title":"Advances in Neural Information Processing Systems","volume":"28","author":"Shi X.","year":"2015"},{"key":"S021800142354023XBIB039","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2012.2221191"},{"key":"S021800142354023XBIB041","first-page":"10347","volume-title":"Int. Conf. Machine Learning","author":"Touvron H.","year":"2021"},{"key":"S021800142354023XBIB042","doi-asserted-by":"publisher","DOI":"10.1142\/S0218001417550084"},{"key":"S021800142354023XBIB043","first-page":"6000","volume-title":"Advances in Neural Information Processing Systems","volume":"30","author":"Vaswani A.","year":"2015"},{"key":"S021800142354023XBIB045","doi-asserted-by":"publisher","DOI":"10.1109\/ACSSC.2003.1292216"},{"key":"S021800142354023XBIB046","doi-asserted-by":"publisher","DOI":"10.1142\/S0218001423570094"},{"key":"S021800142354023XBIB047","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-018-01144-2"},{"key":"S021800142354023XBIB048","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2020.3043590"},{"key":"S021800142354023XBIB049","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00666"},{"key":"S021800142354023XBIB052","doi-asserted-by":"publisher","DOI":"10.1142\/S0218001416550041"},{"key":"S021800142354023XBIB053","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01697"}],"container-title":["International Journal of Pattern Recognition and Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S021800142354023X","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,29]],"date-time":"2024-02-29T07:51:52Z","timestamp":1709193112000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S021800142354023X"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1]]},"references-count":44,"journal-issue":{"issue":"01","published-print":{"date-parts":[[2024,1]]}},"alternative-id":["10.1142\/S021800142354023X"],"URL":"https:\/\/doi.org\/10.1142\/s021800142354023x","relation":{},"ISSN":["0218-0014","1793-6381"],"issn-type":[{"type":"print","value":"0218-0014"},{"type":"electronic","value":"1793-6381"}],"subject":[],"published":{"date-parts":[[2024,1]]},"article-number":"2354023"}}