{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:33:03Z","timestamp":1760236383822,"version":"build-2065373602"},"reference-count":61,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2021,11,18]],"date-time":"2021-11-18T00:00:00Z","timestamp":1637193600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005385","name":"Council for Higher Education","doi-asserted-by":"publisher","award":["postdoctoral scholarship"],"award-info":[{"award-number":["postdoctoral scholarship"]}],"id":[{"id":"10.13039\/501100005385","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012190","name":"Ministry of Science and Higher Education of the Russian Federation","doi-asserted-by":"publisher","award":["075-15-2021-634"],"award-info":[{"award-number":["075-15-2021-634"]}],"id":[{"id":"10.13039\/501100012190","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Data on artificial night-time light (NTL), emitted from the areas, and captured by satellites, are available at a global scale in panchromatic format. In the meantime, data on spectral properties of NTL give more information for further analysis. Such data, however, are available locally or on a commercial basis only. In our recent work, we examined several machine learning techniques, such as linear regression, kernel regression, random forest, and elastic map models, to convert the panchromatic NTL images into colored ones. We compared red, green, and blue light levels for eight geographical areas all over the world with panchromatic light intensities and characteristics of built-up extent from spatially corresponding pixels and their nearest neighbors. In the meantime, information from more distant neighboring pixels might improve the predictive power of models. In the present study, we explore this neighborhood effect using convolutional neural networks (CNN). The main outcome of our analysis is that the neighborhood effect goes in line with the geographical extent of metropolitan areas under analysis: For smaller areas, optimal input image size is smaller than for bigger ones. At that, for relatively large cities, the optimal input image size tends to differ for different colors, being on average higher for red and lower for blue lights. Compared to other machine learning techniques, CNN models emerged comparable in terms of Pearson\u2019s correlation but showed performed better in terms of WMSE, especially for testing datasets.<\/jats:p>","DOI":"10.3390\/s21227662","type":"journal-article","created":{"date-parts":[[2021,11,19]],"date-time":"2021-11-19T02:43:09Z","timestamp":1637289789000},"page":"7662","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["CNN-Based Spectral Super-Resolution of Panchromatic Night-Time Light Imagery: City-Size-Associated Neighborhood Effects"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3135-6865","authenticated-orcid":false,"given":"Nataliya","family":"Rybnikova","sequence":"first","affiliation":[{"name":"Department of Mathematics, University of Leicester, Leicester LE1 7RH, UK"},{"name":"Department of Natural Resources and Environmental Management, University of Haifa, Haifa 3498838, Israel"},{"name":"Department of Geography and Environmental Studies, University of Haifa, Haifa 3498838, Israel"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1474-1734","authenticated-orcid":false,"given":"Evgeny M.","family":"Mirkes","sequence":"additional","affiliation":[{"name":"Department of Mathematics, University of Leicester, Leicester LE1 7RH, UK"},{"name":"Institute of Information Technologies, Mathematics, and Mechanics, Lobachevsky University, 603105 Nizhny Novgorod, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6224-1430","authenticated-orcid":false,"given":"Alexander N.","family":"Gorban","sequence":"additional","affiliation":[{"name":"Department of Mathematics, University of Leicester, Leicester LE1 7RH, UK"},{"name":"Institute of Information Technologies, Mathematics, and Mechanics, Lobachevsky University, 603105 Nizhny Novgorod, Russia"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1373","DOI":"10.1080\/014311697218485","article-title":"Relation between satellite observed visible-near infrared emissions, population, economic activity and electric power consumption","volume":"18","author":"Elvidge","year":"1997","journal-title":"Int. J. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3061","DOI":"10.1080\/01431160010007015","article-title":"Census from Heaven: An estimate of the global human population using night-time satellite imagery","volume":"22","author":"Sutton","year":"2001","journal-title":"Int. J. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.ecolecon.2005.03.007","article-title":"Mapping regional economic activity from night-time light satellite imagery","volume":"57","author":"Doll","year":"2006","journal-title":"Ecol. Econ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1186\/1476-072X-4-5","article-title":"From wealth to health: Modelling the distribution of income per capita at the sub-national level using night-time light imagery","volume":"4","author":"Ebener","year":"2005","journal-title":"Int. J. Health Geogr."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"147","DOI":"10.2174\/1874923201003010147","article-title":"Shedding light on the global distribution of economic activity","volume":"3","author":"Ghosh","year":"2010","journal-title":"Open Geogr. J."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Mellander, C., Lobo, J., Stolarick, K., and Matheson, Z. (2015). Night-time light data: A good proxy measure for economic activity?. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0139779"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1002\/fee.1828","article-title":"Artificial light at night as a driver of evolution across urban-rural landscapes","volume":"16","author":"Hopkins","year":"2018","journal-title":"Front. Ecol. Environ."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1177\/2399808318788567","article-title":"Exploring regional and urban clusters and patterns in Europe using satellite observed lighting","volume":"47","author":"Tselios","year":"2018","journal-title":"Environ. Plan. B Urban Anal. City Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1080\/07420520802694020","article-title":"Global co-distribution of light at night (LAN) and cancers of prostate, colon, and lung in men","volume":"26","author":"Kloog","year":"2009","journal-title":"Chronobiol. Int."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2059","DOI":"10.1007\/s10552-010-9624-4","article-title":"Nighttime light level co-distributes with breast cancer incidence worldwide","volume":"21","author":"Kloog","year":"2010","journal-title":"Cancer Causes Control"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1038\/ijo.2015.255","article-title":"Does artificial light-at-night exposure contribute to the worldwide obesity pandemic?","volume":"40","author":"Rybnikova","year":"2016","journal-title":"Int. J. Obes."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2715","DOI":"10.3390\/rs70302715","article-title":"Global Trends in Exposure to Light Pollution in Natural Terrestrial Ecosystems","volume":"7","author":"Bennie","year":"2015","journal-title":"Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.envpol.2018.04.021","article-title":"Association between nighttime artificial light pollution and sea turtle nest density along Florida coast: A geospatial study using VIIRS remote sensing data","volume":"239","author":"Hu","year":"2018","journal-title":"Environ. Pollut."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1046\/j.1365-8711.2000.03562.x","article-title":"The artificial night sky brightness mapped from DMSP satellite Operational Linescan System measurements","volume":"318","author":"Cinzano","year":"2000","journal-title":"Mon. Not. R. Astron. Soc."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"e1600377","DOI":"10.1126\/sciadv.1600377","article-title":"The new world atlas of artificial night sky brightness","volume":"2","author":"Falchi","year":"2016","journal-title":"Sci. Adv."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"109227","DOI":"10.1016\/j.jenvman.2019.06.128","article-title":"Light pollution in USA and Europe: The good, the bad and the ugly","volume":"248","author":"Falchi","year":"2019","journal-title":"J. Environ. Manag."},{"key":"ref_17","unstructured":"(2021, August 08). Earth Observation Goup. Available online: https:\/\/eogdata.mines.edu\/products\/vnl\/."},{"key":"ref_18","first-page":"62","article-title":"Why VIIRS data are superior to DMSP for mapping nighttime lights","volume":"35","author":"Elvidge","year":"2013","journal-title":"Proc. Asia-Pac. Adv. Netw."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/j.isprsjprs.2017.03.021","article-title":"Remote identification of research and educational activities using spectral properties of nighttime light","volume":"128","author":"Rybnikova","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1177\/1477153507086279","article-title":"Lighting appraisal, well-being and performance in open-plan offices: A linked mechanisms approach","volume":"40","author":"Veitch","year":"2008","journal-title":"Light. Res. Technol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.isprsjprs.2020.02.016","article-title":"Analyzing spatial variability in night-time lights using a high spatial resolution color Jilin-1 image\u2014Jerusalem as a case study","volume":"163","author":"Guk","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1311","DOI":"10.1210\/jc.2004-0957","article-title":"High Sensitivity of Human Melatonin, Alertness, Thermoregulation, and Heart Rate to Short Wavelength Light","volume":"90","author":"Cajochen","year":"2005","journal-title":"J. Clin. Endocrinol. Metab."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Haim, A., and Portnov, B.A. (2013). Light Pollution As a New Risk Factor for Human Breast and Prostate Cancers, Springer.","DOI":"10.1007\/978-94-007-6220-6"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1093\/aje\/kwu117","article-title":"The relationship between obesity and exposure to light at night: Cross-sectional analyses of over 100,000 women in the Breakthrough Generations Study","volume":"180","author":"McFadden","year":"2014","journal-title":"Am. J. Epidemiol."},{"key":"ref_25","unstructured":"(2020, April 07). Search Photos, Available online: https:\/\/eol.jsc.nasa.gov\/SearchPhotos\/."},{"key":"ref_26","unstructured":"(2020, April 07). Jilin-1 Optical-A (Jilin-1 Guangxe-A)\u2014Gunter\u2019s Space Page. Available online: https:\/\/space.skyrocket.de\/doc_sdat\/jilin-1-optical-a.htm."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Rybnikova, N., Portnov, B.A., Mirkes, E.M., Zinovyev, A., Brook, A., and Gorban, A.N. (2021). Coloring Panchromatic Nighttime Satellite Images: Comparing the Performance of Several Machine Learning Methods. IEEE Trans. Geosci. Remote Sens.","DOI":"10.1109\/TGRS.2021.3076011"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3365","DOI":"10.1109\/TPAMI.2020.2982166","article-title":"Deep Learning for Image Super-Resolution: A Survey","volume":"43","author":"Wang","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Milanfar, P. (2017). Super-Resolution Imaging, CRC Press.","DOI":"10.1201\/9781439819319"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1007\/s11760-010-0204-6","article-title":"A survey on super-resolution imaging","volume":"5","author":"Tian","year":"2011","journal-title":"Signal Image Video Process."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1423","DOI":"10.1007\/s00138-014-0623-4","article-title":"Super-resolution: A comprehensive survey","volume":"25","author":"Nasrollahi","year":"2014","journal-title":"Mach. Vis. Appl."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/MSP.2003.1203207","article-title":"Super-resolution image reconstruction: A technical overview","volume":"20","author":"Park","year":"2003","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TPAMI.2015.2439281","article-title":"Image Super-Resolution Using Deep Convolutional Networks","volume":"38","author":"Dong","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1252","DOI":"10.1109\/LSP.2017.2721104","article-title":"Deep CNN-Based Super-Resolution Using External and Internal Examples","volume":"24","author":"Cheong","year":"2017","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Xiao, A., Wang, Z., Wang, L., and Ren, Y. (2018). Super-Resolution for \u201cJilin-1\u201d Satellite Video Imagery via a Convolutional Network. Sensors, 18.","DOI":"10.3390\/s18041194"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zhang, X., Li, C., Meng, Q., Liu, S., Zhang, Y., and Wang, J. (2018). Infrared Image Super Resolution by Combining Compressive Sensing and Deep Learning. Sensors, 18.","DOI":"10.3390\/s18082587"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wang, X., Wu, Y., Ming, Y., and Lv, H. (2020). Remote Sensing Imagery Super Resolution Based on Adaptive Multi-Scale Feature Fusion Network. Sensors, 20.","DOI":"10.3390\/s20041142"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1489","DOI":"10.1109\/TMM.2020.2999182","article-title":"Coarse-to-Fine CNN for Image Super-Resolution","volume":"23","author":"Tian","year":"2021","journal-title":"IEEE Trans. Multimed."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"107394","DOI":"10.1016\/j.sigpro.2019.107394","article-title":"CNN based spectral super-resolution of remote sensing images","volume":"169","author":"Arun","year":"2020","journal-title":"Signal Process."},{"key":"ref_40","unstructured":"Can, Y.B., and Timofte, R. (2018). An efficient CNN for spectral reconstruction from RGB images. arXiv."},{"key":"ref_41","unstructured":"Galliani, S., Lanaras, C., Marmanis, D., Baltsavias, E., Schindler, K., Sensing, R., and Zurich, E. (2017). Learned Spectral Super-Resolution. arXiv."},{"key":"ref_42","unstructured":"Aeschbacher, J., Wu, J., Timofte CVL, R., and Zurich, E. (2017, January 22\u201329). In Defense of Shallow Learned Spectral Reconstruction from RGB Images. Proceedings of the IEEE International Conference on Computer Vision Workshops, Venice, Italy."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Arad, B., and Ben-Shahar, O. (2016, January 11\u201314). Sparse Recovery of Hyperspectral Signal from Natural RGB Images. Proceedings of the 14th European Conference, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46478-7_2"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Timofte, R., De Smet, V., and Van Gool, L. (2013, January 1\u20138). Anchored Neighborhood Regression for Fast Example-Based Super-Resolution. Proceedings of the 2013 IEEE International Conference on Computer Vision, Sydney, Australia.","DOI":"10.1109\/ICCV.2013.241"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Kawakami, R., Matsushita, Y., Wright, J., Ben-Ezra, M., Tai, Y.W., and Ikeuchi, K. (2011, January 20\u201325). High-resolution hyperspectral imaging via matrix factorization. Proceedings of the CVPR 2011, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995457"},{"key":"ref_46","first-page":"577","article-title":"Learning representations for automatic colorization","volume":"Volume 9908","author":"Larsson","year":"2016","journal-title":"Proceedings of the Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Deshpande, A., Rock, J., and Forsyth, D. (2015, January 7\u201313). Learning large-scale automatic image colorization. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.72"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Morimoto, Y., Taguchi, Y., and Naemura, T. (2009, January 3\u20137). Automatic colorization of grayscale images using multiple images on the web. Proceedings of the SIGGRAPH 2009: Talks, New Orleans, LA, USA.","DOI":"10.1145\/1597990.1598049"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2070781.2024190","article-title":"Semantic Colorization with Internet Images","volume":"30","author":"Chia","year":"2011","journal-title":"ACM Trans. Graph."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Gupta, R.K., Chia, A.Y.S., Rajan, D., Ng, E.S., and Zhiyong, H. (2012). Image Colorization using Similar Images, ACM Press.","DOI":"10.1145\/2393347.2393402"},{"key":"ref_51","first-page":"201","article-title":"Colorization by Example","volume":"29","author":"Ironi","year":"2005","journal-title":"Render. Tech."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1109\/TIP.2013.2288929","article-title":"Variational exemplar-based image colorization","volume":"23","author":"Bugeau","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_53","unstructured":"Rom\u00e1n, M.O., Wang, Z., Shrestha, R., Yao, T., and Kalb, V. (2019). Black Marble User Guide Version 1.0."},{"key":"ref_54","unstructured":"Wang, P., Huang, C., Brown de Colstoun, E.C., Tilton, J.C., and Tan, B. (2017). Global Human Built-Up And Settlement Extent (HBASE) Dataset From Landsat."},{"key":"ref_55","unstructured":"(2021, November 02). ArcGIS Desktop|Desktop GIS Software Suite\u2014Esri. Available online: https:\/\/www.esri.com\/en-us\/arcgis\/products\/arcgis-desktop\/overview."},{"key":"ref_56","unstructured":"GitHub (2020, April 11). Elastic Map. Available online: https:\/\/github.com\/Mirkes\/ElMap."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Truong, T.-D., Nguyen, V.-T., and Tran, M.-T. (2018, January 16\u201318). Lightweight Deep Convolutional Network for Tiny Object Recognition. Proceedings of the 7th International Conference on Pattern Recognition Applications and Methods 2018, Funchal, Portugal.","DOI":"10.5220\/0006752006750682"},{"key":"ref_58","unstructured":"(2021, September 11). MATLAB\u2014MathWorks\u2014MATLAB & Simulink. Available online: https:\/\/www.mathworks.com\/products\/matlab.html."},{"key":"ref_59","unstructured":"(2021, September 11). Train Deep Learning Neural Network\u2014MATLAB Train Network. Available online: https:\/\/www.mathworks.com\/help\/deeplearning\/ref\/trainnetwork.html."},{"key":"ref_60","unstructured":"(2021, September 20). JASP. Available online: https:\/\/jasp-stats.org\/."},{"key":"ref_61","unstructured":"(2021, September 19). A New Approach to Identify On-Ground Lamp Types from Night-Time ISS Images. Available online: https:\/\/eartharxiv.org\/repository\/view\/2684\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/22\/7662\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:32:10Z","timestamp":1760167930000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/22\/7662"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,18]]},"references-count":61,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["s21227662"],"URL":"https:\/\/doi.org\/10.3390\/s21227662","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,11,18]]}}}