{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T04:19:31Z","timestamp":1787026771155,"version":"build-2736575974"},"reference-count":35,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,4,24]],"date-time":"2023-04-24T00:00:00Z","timestamp":1682294400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:p>The near-infrared (NIR) image obtained by an NIR camera is a grayscale image that is inconsistent with the human visual spectrum. It can be difficult to perceive the details of a scene from an NIR scene; thus, a method is required to convert them to visible images, providing color and texture information. In addition, a camera produces so much video data that it increases the pressure on the cloud server. Image processing can be done on an edge device, but the computing resources of edge devices are limited, and their power consumption constraints need to be considered. Graphics Processing Unit (GPU)-based NVIDIA Jetson embedded systems offer a considerable advantage over Central Processing Unit (CPU)-based embedded devices in inference speed. For this study, we designed an evaluation system that uses image quality, resource occupancy, and energy consumption metrics to verify the performance of different NIR image colorization methods on low-power NVIDIA Jetson embedded systems for practical applications. The performance of 11 image colorization methods on NIR image datasets was tested on three different configurations of NVIDIA Jetson boards. The experimental results indicate that the Pix2Pix method performs best, with a rate of 27 frames per second on the Jetson Xavier NX. This performance is sufficient to meet the requirements of real-time NIR image colorization.<\/jats:p>","DOI":"10.3389\/fnbot.2023.1143032","type":"journal-article","created":{"date-parts":[[2023,4,24]],"date-time":"2023-04-24T00:23:37Z","timestamp":1682295817000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["A comparative analysis of near-infrared image colorization methods for low-power NVIDIA Jetson embedded systems"],"prefix":"10.3389","volume":"17","author":[{"given":"Shengdong","family":"Shi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qian","family":"Jiang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Jin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weiqiang","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kaihua","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haiyang","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peng","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shaowen","family":"Yao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,4,24]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01228-1_8","article-title":"Recycle-gan: unsupervised video retargeting","author":"Bansal","year":"2018","journal-title":"Proceedings of the European conference on computer vision (ECCV)"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995637","author":"Brown","year":"2011","journal-title":"Multi-Spectral SIFT for Scene Category Recognition."},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01438","article-title":"TCTrack: temporal contexts for aerial tracking","author":"Cao","year":"2022","journal-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2021.104298","article-title":"Pushing Artificial intelligence to the edge: emerging trends, issues and challenges.","volume":"103","author":"Fortino","year":"2021","journal-title":"Eng. Appl. Artif. Intell."},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1155\/2020\/8858298","article-title":"Research on multinode collaborative computing offloading algorithm based on minimization of energy consumption.","volume":"2020","author":"Han","year":"2020","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"B6","doi-asserted-by":"publisher","first-page":"770","DOI":"10.1109\/CVPR.2016.90","article-title":"Deep residual learning for image recognition","author":"He","year":"2016","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2022.105006","article-title":"Deep learning for image colorization: current and future prospects.","volume":"114","author":"Huang","year":"2022","journal-title":"Eng. Appl. Artif. Intell."},{"key":"B8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2897824.2925974","article-title":"Let there be color! joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification.","volume":"35","author":"Iizuka","year":"2016","journal-title":"ACM Trans. Graphics"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.632","article-title":"Image-to-image translation with conditional adversarial networks","author":"Isola","year":"2017","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition"},{"key":"B10","doi-asserted-by":"publisher","first-page":"5332","DOI":"10.1109\/LRA.2021.3075141","article-title":"Run your visual-inertial odometry on NVIDIA jetson: benchmark tests on a micro aerial vehicle.","volume":"6","author":"Jeon","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"B11","doi-asserted-by":"publisher","first-page":"478","DOI":"10.1016\/j.infrared.2017.07.010","article-title":"A survey of infrared and visual image fusion methods.","volume":"85","author":"Jin","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1016\/j.infrared.2020.103338","article-title":"Thermal infrared colorization via conditional generative adversarial network.","volume":"107","author":"Kuang","year":"2020","journal-title":"Infrared Phys. Technol."},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3475445","article-title":"I2v-gan: unpaired infrared-to-visible video translation","author":"Li","year":"2021","journal-title":"Proceedings of the 29th ACM International Conference on Multimedia"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1016\/j.infrared.2021.103764","article-title":"An improved DualGAN for near-infrared image colorization.","volume":"116","author":"Liang","year":"2021","journal-title":"Infrared Phys. Technol."},{"key":"B15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TIV.2022.3218833","article-title":"MUGAN: thermal infrared image colorization using mixed-skipping UNet and generative adversarial network.","author":"Liao","year":"2022","journal-title":"IEEE Trans. Intell. Vehicles"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2022.105084","article-title":"CASR-net: a color-aware super-resolution network for panchromatic image.","volume":"114","author":"Liu","year":"2022","journal-title":"Eng. Appl. Artif. Intell."},{"key":"B17","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1016\/j.inffus.2020.06.013","article-title":"Multi-focus image fusion: a survey of the state of the art.","volume":"64","author":"Liu","year":"2020","journal-title":"Information Fusion"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2022.3145476","author":"Luo","year":"2022","journal-title":"Thermal Infrared Image Colorization for Nighttime Driving Scenes with Top-Down Guided Attention. IEEE Transactions on Intelligent Transportation Systems."},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/3610482","article-title":"A novel real-time image restoration algorithm in edge computing.","volume":"2018","author":"Ma","year":"2018","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"B20","doi-asserted-by":"publisher","first-page":"9102","DOI":"10.1109\/ACCESS.2020.2964608","article-title":"Real-time apple detection system using embedded systems with hardware accelerators: an edge AI application.","volume":"8","author":"Mazzia","year":"2020","journal-title":"IEEE Access"},{"key":"B21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TIM.2022.3146923","article-title":"An improved deep network-based scene classification method for self-driving cars.","volume":"71","author":"Ni","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"B22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2020\/8867157","article-title":"User-edge collaborative resource allocation and offloading strategy in edge computing.","volume":"2020","author":"Qin","year":"2020","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"B23","article-title":"Unsupervised representation learning with deep convolutional generative adversarial networks.","author":"Radford","year":"2015","journal-title":"arXiv"},{"key":"B24","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1109\/JIOT.2016.2579198","article-title":"Edge computing: vision and challenges.","volume":"3","author":"Shi","year":"2016","journal-title":"IEEE Internet Things J."},{"key":"B25","doi-asserted-by":"publisher","first-page":"112459","DOI":"10.1109\/ACCESS.2019.2933671","article-title":"Nir to rgb domain translation using asymmetric cycle generative adversarial networks.","volume":"7","author":"Sun","year":"2019","journal-title":"IEEE Access"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/7476201","article-title":"A taxonomy for management and optimization of multiple resources in edge computing.","volume":"2018","author":"Tocz\u00e9","year":"2018","journal-title":"Wirel. Commun. Mobile Comput."},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1109\/WACV45572.2020.9093389","article-title":"Chromagan: adversarial picture colorization with semantic class distribution","author":"Vitoria","year":"2020","journal-title":"Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01154","article-title":"Coloring with limited data: Few-shot colorization via memory augmented networks","author":"Yoo","year":"2019","journal-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition"},{"key":"B29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TIM.2022.3164062","article-title":"Three-channel infrared imaging for object detection in haze.","volume":"71","author":"Yu","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2020.103774","article-title":"Optimized task distribution based on task requirements and time delay in edge computing environments.","volume":"94","author":"Zhang","year":"2020","journal-title":"Eng. Appl. Artif. Intell."},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46487-9_40","article-title":"Colorful image Colorization","author":"Zhang","year":"2016","journal-title":"Proceedings of the European Conference on Computer Vision."},{"key":"B32","article-title":"TBC-net: a real-time detector for infrared small target detection using semantic constraint.","author":"Zhao","year":"2019","journal-title":"arXiv"},{"key":"B33","doi-asserted-by":"publisher","first-page":"3062","DOI":"10.1109\/TCSVT.2020.3037688","article-title":"SCGAN: saliency map-guided colorization with generative adversarial network.","volume":"31","author":"Zhao","year":"2020","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.244","article-title":"Unpaired image-to-image translation using cycle-consistent adversarial networks","author":"Zhu","year":"2017","journal-title":"Proceedings of the IEEE international conference on computer vision"},{"key":"B35","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1016\/j.inffus.2022.10.022","article-title":"Brain tumor segmentation based on the fusion of deep semantics and edge information in multimodal MRI.","volume":"91","author":"Zhu","year":"2023","journal-title":"Information Fusion"}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2023.1143032\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,24]],"date-time":"2023-04-24T00:23:40Z","timestamp":1682295820000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2023.1143032\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,24]]},"references-count":35,"alternative-id":["10.3389\/fnbot.2023.1143032"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2023.1143032","relation":{},"ISSN":["1662-5218"],"issn-type":[{"value":"1662-5218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,24]]},"article-number":"1143032"}}