{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:23:24Z","timestamp":1750220604338,"version":"3.41.0"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2020,5,22]],"date-time":"2020-05-22T00:00:00Z","timestamp":1590105600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["U1736122"],"award-info":[{"award-number":["U1736122"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Natural Science Foundation for Distinguished Young Scholars of Shandong Province","award":["JQ201718"],"award-info":[{"award-number":["JQ201718"]}]},{"name":"ROIS NII Open Collaborative Research 2020","award":["20FC02"],"award-info":[{"award-number":["20FC02"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2020,5,31]]},"abstract":"<jats:p>High-resolution hyperspectral (HS) reconstruction has recently achieved significantly progress, among which the method based on the fusion of the RGB and HS images of the same scene can greatly improve the reconstruction performance compared with those based on the individually spectral or spatial enhancement. It is well known that the HS image is obtained only via the costly hypersoectral sensor, whereas the RGB images can be provided by low-price RGB cameras and the spectral sensitivity (SS) functions of RGB cameras are usually different. Thus, this study proposes a HS reconstruction, which fuses merely two RGB images with redundant spectral responses. In this work, we design a new RGB camera via shifting the SS of an existed RGB camera, which can provide similar strength of spectral response with different spectral centers of SS, and fuse the new achieved color image with an existed RGB image by a deep ResNet. Experiments validate that fusion of two existed RGB images can provide impressive HS reconstruction performance and further improvement can be achieved by integrating the color image of the simulated SS with the RGB image.<\/jats:p>","DOI":"10.1145\/3386313","type":"journal-article","created":{"date-parts":[[2020,5,25]],"date-time":"2020-05-25T22:07:21Z","timestamp":1590444441000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Hyperspectral Reconstruction with Redundant Camera Spectral Sensitivity Functions"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5003-3180","authenticated-orcid":false,"given":"Xian-Hua","family":"Han","sequence":"first","affiliation":[{"name":"Yamaguchi University, Yoshida, Yamaguchi, Japan"}]},{"given":"Yinqiang","family":"Zheng","sequence":"additional","affiliation":[{"name":"National Institute of Informatics, Hitotsubashi, Chiyoda-ku, Tokyo, Japan"}]},{"given":"Jiande","family":"Sun","sequence":"additional","affiliation":[{"name":"ShanDong Normal University, JiNan, China"}]},{"given":"Yen-Wei","family":"Chen","sequence":"additional","affiliation":[{"name":"Ritsumeikan University, NojiHigashi, Kusatsu, Shiga, Japan"}]}],"member":"320","published-online":{"date-parts":[[2020,5,22]]},"reference":[{"volume-title":"Proceedings of the IEEE International Conference on Computer Vision Workshop (ICCVW\u201917)","author":"Aeschbacher J.","key":"e_1_2_1_1_1","unstructured":"J. Aeschbacher , J. Wu , and R. Timofte . 2017. In defense of shallow learned spectral reconstruction from RGB images . In Proceedings of the IEEE International Conference on Computer Vision Workshop (ICCVW\u201917) . J. Aeschbacher, J. Wu, and R. Timofte. 2017. In defense of shallow learned spectral reconstruction from RGB images. In Proceedings of the IEEE International Conference on Computer Vision Workshop (ICCVW\u201917)."},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201915)","author":"Akhtar N.","key":"e_1_2_1_2_1","unstructured":"N. Akhtar , F. Shafait , and A. Mian . 2015. Bayesian sparse representation for hyperspectral image super resolution . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201915) . 3631--3640. N. Akhtar, F. Shafait, and A. Mian. 2015. Bayesian sparse representation for hyperspectral image super resolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201915). 3631--3640."},{"volume-title":"Proceedings of the IEEE International Conference on Computer Vision Workshop (ICCVW\u201917)","author":"Alvarez-Gila Aitor","key":"e_1_2_1_3_1","unstructured":"Aitor Alvarez-Gila , Joost van de Weijer, and Estibaliz Garrote. 2017. Adversarial networks for spatial context-aware spectral image reconstruction from RGB . In Proceedings of the IEEE International Conference on Computer Vision Workshop (ICCVW\u201917) . Aitor Alvarez-Gila, Joost van de Weijer, and Estibaliz Garrote. 2017. Adversarial networks for spatial context-aware spectral image reconstruction from RGB. In Proceedings of the IEEE International Conference on Computer Vision Workshop (ICCVW\u201917)."},{"volume-title":"Proceedings of the European Conference on Computer Vision.19--34","author":"Arad B.","key":"e_1_2_1_4_1","unstructured":"B. Arad and O. Ben-Shahar . 2016. Sparse recovery of hyperspectral signal from natural RGB images . In Proceedings of the European Conference on Computer Vision.19--34 . B. Arad and O. Ben-Shahar. 2016. Sparse recovery of hyperspectral signal from natural RGB images. In Proceedings of the European Conference on Computer Vision.19--34."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/MGRS.2013.2244672"},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201911)","author":"Chakrabarti A.","key":"e_1_2_1_6_1","unstructured":"A. Chakrabarti and T. Zickler . 2011. Statistics of real-world hyperspectral images . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201911) . 193--200. A. Chakrabarti and T. Zickler. 2011. Statistics of real-world hyperspectral images. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201911). 193--200."},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201904)","author":"Chang H.","key":"e_1_2_1_7_1","unstructured":"H. Chang , D. Yeung , and Y. Xiong . 2004. Super-resolution through neighbor embedding . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201904) . H. Chang, D. Yeung, and Y. Xiong. 2004. Super-resolution through neighbor embedding. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201904)."},{"key":"e_1_2_1_8_1","unstructured":"L.-C. Chen G. Papandreou I. Kokkinos K. Murphy and A. L Yuille. 2016. DeepLab: Semantic image segmentation with deep convolutional nets atrous convolution and fully connected CRFs. arXiv:1606.00915.  L.-C. Chen G. Papandreou I. Kokkinos K. Murphy and A. L Yuille. 2016. DeepLab: Semantic image segmentation with deep convolutional nets atrous convolution and fully connected CRFs. arXiv:1606.00915."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2018.2798162"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TPAMI.2015.2439281","article-title":"Image super-resolution using deep convolutional networks","volume":"38","author":"Dong C.","year":"2015","unstructured":"C. Dong , C. C. Loy , K. M. He , and X. O. Tang . 2015 . Image super-resolution using deep convolutional networks . IEEE Transactions on Pattern Analysis and Machine Intelligence 38 , 2 (2015), 295 -- 307 . C. Dong, C. C. Loy, K. M. He, and X. O. Tang. 2015. Image super-resolution using deep convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 38, 2 (2015), 295--307.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"volume-title":"Proceedings of the European Conference on Computer Vision (ECCV\u201916)","author":"Dong C.","key":"e_1_2_1_11_1","unstructured":"C. Dong , C. C. Loy , and X. O. Tang . 2016. Accelerating the super-resolution convolutional neural network . In Proceedings of the European Conference on Computer Vision (ECCV\u201916) . C. Dong, C. C. Loy, and X. O. Tang. 2016. Accelerating the super-resolution convolutional neural network. In Proceedings of the European Conference on Computer Vision (ECCV\u201916)."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2016.2542360"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2012.2197589"},{"key":"e_1_2_1_14_1","unstructured":"S. Galliani C. Lanaras D. Marmanis E. Baltsavias and K. Schindler. 2017. Learned spectral super-resolution. arXiv:1703.09470.  S. Galliani C. Lanaras D. Marmanis E. Baltsavias and K. Schindler. 2017. Learned spectral super-resolution. arXiv:1703.09470."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.3390\/rs11101173"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigMM.2019.00-13"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2855418"},{"volume-title":"Proceedings of the 25th IEEE International Conference on Image Processing (ICIP\u201918)","author":"Han X.-H.","key":"e_1_2_1_18_1","unstructured":"X.-H. Han , B. X. Shi , and Y. Q. Zheng . 2018. SSF-CNN: Spatial and spectral fusion with CNN for hyperspectral image super-resolution . In Proceedings of the 25th IEEE International Conference on Image Processing (ICIP\u201918) . 2506--2510. X.-H. Han, B. X. Shi, and Y. Q. Zheng. 2018. SSF-CNN: Spatial and spectral fusion with CNN for hyperspectral image super-resolution. In Proceedings of the 25th IEEE International Conference on Image Processing (ICIP\u201918). 2506--2510."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2004.829779"},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201916)","author":"He K. M.","key":"e_1_2_1_20_1","unstructured":"K. M. He , X. Y. Zhang , S. Q. Ren , and J. Sun . 2016. Deep residual learning for image recognition . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201916) . K. M. He, X. Y. Zhang, S. Q. Ren, and J. Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201916)."},{"volume-title":"SSIM. In Proceedings of the 20th International Conference on Pattern Recognition (ICPR\u201910)","author":"Hore A.","key":"e_1_2_1_21_1","unstructured":"A. Hore and D. Ziou . 2010. Image quality metrics: PSNR vs . SSIM. In Proceedings of the 20th International Conference on Pattern Recognition (ICPR\u201910) . 2366--2369. A. Hore and D. Ziou. 2010. Image quality metrics: PSNR vs. SSIM. In Proceedings of the 20th International Conference on Pattern Recognition (ICPR\u201910). 2366--2369."},{"volume-title":"Proceedings of the IEEE Workshop on Applications of Computer Vision (WACV\u201913)","author":"Jiang J.","key":"e_1_2_1_22_1","unstructured":"J. Jiang , D. Y. Liu , J. W. Gu , and S. Susstrunk . 2013. What is the space of spectral sensitivity functions for digital color cameras? In Proceedings of the IEEE Workshop on Applications of Computer Vision (WACV\u201913) . 4321--4328. J. Jiang, D. Y. Liu, J. W. Gu, and S. Susstrunk. 2013. What is the space of spectral sensitivity functions for digital color cameras? In Proceedings of the IEEE Workshop on Applications of Computer Vision (WACV\u201913). 4321--4328."},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201916)","author":"Kim J.","key":"e_1_2_1_23_1","unstructured":"J. Kim , J. K. Lee , and K. M. Lee . 2016. Accurate image super-resolution using very deep convolutional networks . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201916) . J. Kim, J. K. Lee, and K. M. Lee. 2016. Accurate image super-resolution using very deep convolutional networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201916)."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.3390\/rs10091416"},{"volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201915)","author":"Lanaras C.","key":"e_1_2_1_25_1","unstructured":"C. Lanaras , E. Baltsavias , and K. Schindler . 2015. Hyperspectral super-resolution by coupled spectral unmixing . In Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201915) . 3586--3595. C. Lanaras, E. Baltsavias, and K. Schindler. 2015. Hyperspectral super-resolution by coupled spectral unmixing. In Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201915). 3586--3595."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2017.05.024"},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917)","author":"Lim B.","key":"e_1_2_1_27_1","unstructured":"B. Lim , A. Son , H. Kim , S. Nah , and K. M. Lee . 2017. Enhanced deep residual networks for single image super-resolution . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917) . B. Lim, A. Son, H. Kim, S. Nah, and K. M. Lee. 2017. Enhanced deep residual networks for single image super-resolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917)."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/MGRS.2015.2440094"},{"key":"e_1_2_1_29_1","first-page":"1139","article-title":"Hyperspectral image spatial super-resolution via 3D full convolutional neural network","volume":"9","author":"Mei S. H.","year":"2017","unstructured":"S. H. Mei , X. Yuan , J. Y. Ji , and Y. F. Zhang . 2017 . Hyperspectral image spatial super-resolution via 3D full convolutional neural network . Neurocomputing 9 , 11 (2017), 1139 . S. H. Mei, X. Yuan, J. Y. Ji, and Y. F. Zhang. 2017. Hyperspectral image spatial super-resolution via 3D full convolutional neural network. Neurocomputing 9, 11 (2017), 1139.","journal-title":"Neurocomputing"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2009.2037132"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2014.2381272"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201908)","volume":"2","author":"Yang J.","unstructured":"J. Yang , J. Wright , T. Huang , and Y. Ma . 2008. Image super-resolution as sparse representation of raw image patches . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201908) , Vol. 2 . 1--8. J. Yang, J. Wright, T. Huang, and Y. Ma. 2008. Image super-resolution as sparse representation of raw image patches. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201908), Vol. 2. 1--8."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2010.2046811"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2019.2924096"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2011.2161320"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1117\/1.JRS.10.035024"},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201914)","author":"Zhou Y.","key":"e_1_2_1_37_1","unstructured":"Y. Zhou , H. Chang , K. Barner , P. Spellman , and B. Parvin . 2014. Classification of histology sections via multispectral convolutional sparse coding . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201914) . 3081--3088. Y. Zhou, H. Chang, K. Barner, P. Spellman, and B. Parvin. 2014. Classification of histology sections via multispectral convolutional sparse coding. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201914). 3081--3088."}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3386313","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3386313","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:32:03Z","timestamp":1750195923000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3386313"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,22]]},"references-count":37,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,5,31]]}},"alternative-id":["10.1145\/3386313"],"URL":"https:\/\/doi.org\/10.1145\/3386313","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2020,5,22]]},"assertion":[{"value":"2019-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-05-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}