{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T13:54:30Z","timestamp":1772978070199,"version":"3.50.1"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"3s","license":[{"start":{"date-parts":[[2022,10,31]],"date-time":"2022-10-31T00:00:00Z","timestamp":1667174400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2022,10,31]]},"abstract":"<jats:p>Reconstructing a high-resolution hyperspectral (HR-HS) image via merging a low-resolution hyperspectral (LR-HS) image and a high-resolution RGB (HR-RGB) image has become a hot research topic, and can greatly benefit for different subsequent high-level vision tasks. Recently, deep learning\u2013based approaches have evolved for HS image reconstruction and validated impressive performance. However, to learn a good reconstruction model in the deep learning\u2013based methods, it is mandatory to previously collect large-scale training triplets consisting of the LR-HS, HR-RGB, and HR-HS images, which is difficult to be collected in real applications. This study proposes a deep self-supervised HS image reconstruction framework (DSSH), which does not have to depend on any handcrafted prior and previously collected training triplets at all. The proposed DSSH method leverages the designed network architecture itself for capturing the prior of the underlying structure in the latent HR-HS image and employs the observed LR-HS and HR-RGB images only for network parameter learning. Experiments on two benchmark HS image datasets validated that the proposed DSSH method manifests very impressive reconstruction performance, and is even better than some state-of-the-art supervised learning approaches.<\/jats:p>","DOI":"10.1145\/3510373","type":"journal-article","created":{"date-parts":[[2022,8,23]],"date-time":"2022-08-23T11:14:31Z","timestamp":1661253271000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Deep Self-Supervised Hyperspectral Image Reconstruction"],"prefix":"10.1145","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3756-2678","authenticated-orcid":false,"given":"Zhe","family":"Liu","sequence":"first","affiliation":[{"name":"Graduate School of Science and Technology for Innovation, Yamaguchi University, Yamaguchi, Japan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5003-3180","authenticated-orcid":false,"given":"Xian-Hua","family":"Han","sequence":"additional","affiliation":[{"name":"Graduate School of Science and Technology for Innovation, Yamaguchi University, Yamaguchi, Japan"}]}],"member":"320","published-online":{"date-parts":[[2022,11]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10584-0_5"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298986"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46487-9_7"},{"key":"e_1_3_1_5_2","unstructured":"Michael Barnes Zhihong Pan and Sizhong Zhang. 2018. Systems and methods for hyperspectral medical imaging using real-time projection of spectral information. (Feb. 2018). US Patent No. 9 883 833. Filed May 13 2009. Issued Feb. 6 2018."},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/MGRS.2013.2244672"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1080\/01431161003698336"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995660"},{"key":"e_1_3_1_9_2","volume-title":"Robotics: Science and Systems","author":"Dahlkamp Hendrik","year":"2006","unstructured":"Hendrik Dahlkamp, Adrian Kaehler, David Stavens, Sebastian Thrun, and Gary R. Bradski. 2006. Self-supervised monocular road detection in desert terrain. In Robotics: Science and Systems, Vol. 38."},{"issue":"99","key":"e_1_3_1_10_2","first-page":"1","article-title":"Deep hyperspectral image sharpening","author":"Dian Renwei","year":"2018","unstructured":"Renwei Dian, Shutao Li, Anjing Guo, and Leyuan Fang. 2018. Deep hyperspectral image sharpening. IEEE Transactions on Neural Networks and Learning Systems99 (2018), 1\u201311.","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/tip.2016.2542360"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01193"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigMM.2019.00-13"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2855418"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2018.8451142"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigMM.2019.00028"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2019.00533"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2015.2452812"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.3390\/rs9101042"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1907.00651"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2019.00178"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995457"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.5555\/1346111.1346125"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2017.7953344"},{"key":"e_1_3_1_25_2","unstructured":"Craig A. Laben and Bernard V. Brower. 2000. Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening. (Jan. 2000). US Patent 6 011 875. Filed Apr. 29 1998. Issued Jan. 4 2000."},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.409"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2017.05.024"},{"key":"e_1_3_1_28_2","volume-title":"Proceedings of the Asian Conference on Computer Vision","author":"Liu Zhe","year":"2020","unstructured":"Zhe Liu, Yinqiang Zheng, and Xian-Hua Han. 2020. Unsupervised multispectral and hyperspectral image fusion with deep spatial and spectral priors. In Proceedings of the Asian Conference on Computer Vision."},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2004.831865"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00266"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1902.00301"},{"key":"e_1_3_1_32_2","article-title":"Deep hyperspectral prior: Denoising, inpainting, super-resolution","volume":"1902","author":"Sidorov Oleksii","year":"2019","unstructured":"Oleksii Sidorov and Jon Yngve Hardeberg. 2019. Deep hyperspectral prior: Denoising, inpainting, super-resolution. CoRR abs\/1902.00301 (2019). arXiv:1902.00301. http:\/\/arxiv.org\/abs\/1902.00301.","journal-title":"CoRR"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICAT.2015.7340509"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58539-6_6"},{"key":"e_1_3_1_35_2","first-page":"9446","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Ulyanov Dmitry","year":"2018","unstructured":"Dmitry Ulyanov, Andrea Vedaldi, and Victor Lempitsky. 2018. Deep image prior. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 9446\u20139454."},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/MEMB.2004.1360407"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00822"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2013.6637883"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00168"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfoodeng.2016.10.021"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2010.2046811"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/IGARSS.2011.6049465"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2017.2655115"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.sigpro.2012.01.020"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00314"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1186\/1687-6180-2011-87"},{"key":"e_1_3_1_47_2","first-page":"1423","article-title":"Residual component estimating CNN for image super-resolution","volume":"30","author":"Zhu Zhiyu","year":"2020","unstructured":"Zhiyu Zhu, Junhui Hou, Jie Chen, Huanqiang Zeng, and Jiantao Zhou. 2020. Residual component estimating CNN for image super-resolution. IEEE Transactions on Image Processing 30 (2020), 1423\u20131428.","journal-title":"IEEE Transactions on Image Processing"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.image.2020.115833"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3510373","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3510373","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:45Z","timestamp":1750183785000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3510373"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,31]]},"references-count":47,"journal-issue":{"issue":"3s","published-print":{"date-parts":[[2022,10,31]]}},"alternative-id":["10.1145\/3510373"],"URL":"https:\/\/doi.org\/10.1145\/3510373","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,31]]},"assertion":[{"value":"2021-07-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-11-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}