{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T09:10:01Z","timestamp":1775639401314,"version":"3.50.1"},"reference-count":48,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2024,8,22]],"date-time":"2024-08-22T00:00:00Z","timestamp":1724284800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"University of East Anglia","doi-asserted-by":"publisher","award":["EP\/S028730\/1"],"award-info":[{"award-number":["EP\/S028730\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>In the convolutional retinex approach to image lightness processing, an image is filtered by a centre\/surround operator that is designed to mitigate the effects of shading (illumination gradients), which in turn compresses the dynamic range. Typically, the parameters that define the shape and extent of the filter are tuned to provide visually pleasing results, and a mapping function such as a logarithm is included for further image enhancement. In contrast, a statistical approach to convolutional retinex has recently been introduced, which is based upon known or estimated autocorrelation statistics of the image albedo and shading components. By introducing models for the autocorrelation matrices and solving a linear regression, the optimal filter is obtained in closed form. Unlike existing methods, the aim is simply to objectively mitigate shading, and so image enhancement components such as a logarithmic mapping function are not included. Here, the full mathematical details of the method are provided, along with implementation details. Significantly, it is shown that the shapes of the autocorrelation matrices directly impact the shape of the optimal filter. To investigate the performance of the method, we address the problem of shading removal from text documents. Further experiments on a challenging image dataset validate the method.<\/jats:p>","DOI":"10.3390\/jimaging10080204","type":"journal-article","created":{"date-parts":[[2024,8,22]],"date-time":"2024-08-22T11:14:41Z","timestamp":1724325281000},"page":"204","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Optimisation of Convolution-Based Image Lightness Processing"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-0942-9470","authenticated-orcid":false,"given":"D. Andrew","family":"Rowlands","sequence":"first","affiliation":[{"name":"Colour & Imaging Lab, School of Computing Sciences, University of East Anglia, Norwich NR4 7TJ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4040-0554","authenticated-orcid":false,"given":"Graham D.","family":"Finlayson","sequence":"additional","affiliation":[{"name":"Colour & Imaging Lab, School of Computing Sciences, University of East Anglia, Norwich NR4 7TJ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1364\/JOSA.61.000001","article-title":"Lightness and retinex theory","volume":"61","author":"Land","year":"1971","journal-title":"J. Opt. Soc. Am."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1038\/scientificamerican1277-108","article-title":"The Retinex Theory of Color Vision","volume":"237","author":"Land","year":"1977","journal-title":"Sci. Am."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1684","DOI":"10.1364\/JOSAA.3.001684","article-title":"Formal connections between lightness algorithms","volume":"3","author":"Hurlbert","year":"1986","journal-title":"J. Opt. Soc. Am. A"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1117\/1.1636761","article-title":"Retinex in MatlabTM","volume":"13","author":"Funt","year":"2004","journal-title":"J. Electron. Imag."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3078","DOI":"10.1073\/pnas.83.10.3078","article-title":"An alternative technique for the computation of the designator in the retinex theory of color vision","volume":"83","author":"Land","year":"1986","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1109\/83.557356","article-title":"Properties and Performance of a Center\/Surround Retinex","volume":"6","author":"Jobson","year":"1997","journal-title":"IEEE Trans. Imag. Proc."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1109\/83.597272","article-title":"A Multiscale Retinex for Bridging the Gap between Color Images and the Human Observation of Scenes","volume":"6","author":"Jobson","year":"1997","journal-title":"IEEE Trans. Imag. Proc."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1117\/1.1636183","article-title":"Retinex processing for automatic image enhancement","volume":"13","author":"Rahman","year":"2004","journal-title":"J. Electron. Imaging"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1016\/j.ins.2019.10.009","article-title":"Analyzing center\/surround retinex","volume":"512","author":"Lisani","year":"2020","journal-title":"Inf. Sci."},{"key":"ref_10","first-page":"232","article-title":"The rehabilitation of gamma","volume":"Volume 3299","author":"Rogowitz","year":"1998","journal-title":"SPIE\/IS&T Conference, Proceedings of the Human Vision and Electronic Imaging III, San Jose, CA, USA, 24 January 1998"},{"key":"ref_11","unstructured":"Barnard, K., and Funt, B. (, January March). Investigations into multi-scale retinex. Proceedings of the Colour Imaging in Multimedia\u201998, Derby, UK."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kotera, H., and Fujita, M. (2002, January 12). Appearance improvement of color image by adaptive scale-gain retinex model. Proceedings of the IS&T\/SID Tenth Color Imaging Conference, Scottsdale, AZ, USA.","DOI":"10.2352\/CIC.2002.10.1.art00032"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yoda, M., and Kotera, H. (2004, January 31). Appearance Improvement of Color Image by Adaptive Linear Retinex Model. Proceedings of the IS&T International Conference on Digital Printing Technologies (NIP20), Salt Lake City, UT, USA.","DOI":"10.2352\/ISSN.2169-4451.2004.20.1.art00032_2"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"McCann, J., and Rizzi, A. (2012). The Art and Science of HDR Imaging, John Wiley & Sons.","DOI":"10.1002\/9781119951483"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2352\/ISSN.2470-1173.2016.6.RETINEX-017","article-title":"Retinex Algorithms: Many spatial processes used to solve many different problems","volume":"2016","author":"McCann","year":"2016","journal-title":"Electron. Imaging"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Morel, J.M., Petro, A.B., and Sbert, C. (2014, January 27\u201330). What is the right center\/surround for Retinex?. Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France.","DOI":"10.1109\/ICIP.2014.7025923"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"434","DOI":"10.5201\/ipol.2021.391","article-title":"Center\/Surround Retinex: Analysis and Implementation","volume":"11","author":"Lisani","year":"2021","journal-title":"Image Process. Line"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1117\/12.477590","article-title":"Multi-sensor fusion and enhancement using the Retinex image enhancement algorithm","volume":"4736","author":"Rahman","year":"2002","journal-title":"Proc. SPIE Int. Soc. Opt."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2820","DOI":"10.1109\/TIP.2006.877312","article-title":"High dynamic range image rendering with a Retinex-based adaptive filter","volume":"15","author":"Meylan","year":"2006","journal-title":"IEEE Trans. Image Process. Publ. IEEE Signal Process. Soc."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Setty, S., Nk, S., and Hanumantharaju, D.M. (2013, January 7\u20138). Development of multiscale Retinex algorithm for medical image enhancement based on multi-rate sampling. Proceedings of the Signal Process Image Process Pattern Recognit (ICSIPR), Bangalore, India.","DOI":"10.1109\/ICSIPR.2013.6497976"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"7143","DOI":"10.1016\/j.ijleo.2014.07.118","article-title":"Multi-scale retinex improvement for nighttime image enhancement","volume":"125","author":"Lin","year":"2014","journal-title":"Optik"},{"key":"ref_22","unstructured":"Yin, J., Li, H., Du, J., and He, P. (2014, January 27\u201329). Low illumination image Retinex enhancement algorithm based on guided filtering. Proceedings of the 2014 IEEE 3rd International Conference on Cloud Computing and Intelligence Systems, Shenzhen & Hong Kong, China."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neucom.2017.03.029","article-title":"Underwater Image Enhancement via Extended Multi-Scale Retinex","volume":"245","author":"Shu","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Galdran, A., Bria, A., Alvarez-Gila, A., Vazquez-Corral, J., and Bertalm\u00edo, M. (2018, January 18\u201323). On the Duality Between Retinex and Image Dehazing. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00857"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"e5832","DOI":"10.1002\/cpe.5832","article-title":"Parallelization implementation of the multi-scale retinex image-enhancement algorithm based on a many integrated core platform","volume":"32","author":"Huang","year":"2020","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"063055","DOI":"10.1117\/1.JEI.31.6.063055","article-title":"Survey of methods and evaluation of Retinex-inspired image enhancers","volume":"31","author":"Simone","year":"2022","journal-title":"J. Electron. Imaging"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"87884","DOI":"10.1109\/ACCESS.2020.2992749","article-title":"An Experiment-Based Review of Low-Light Image Enhancement Methods","volume":"8","author":"Wang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Rasheed, M.T., Guo, G., Shi, D., Khan, H., and Cheng, X. (2022). An Empirical Study on Retinex Methods for Low-Light Image Enhancement. Remote Sens., 14.","DOI":"10.3390\/rs14184608"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Rowlands, D.A., and Finlayson, G.D. (2023, January 13\u201317). First-principles approach to image lightness processing. Proceedings of the 31st Color Imaging Conference, Paris, France.","DOI":"10.2352\/CIC.2023.31.1.22"},{"key":"ref_30","first-page":"482","article-title":"Synthesizing a Color Algorithm from Examples","volume":"239","author":"Hurlbert","year":"1988","journal-title":"Sci. New Ser."},{"key":"ref_31","unstructured":"Hurlbert, A.C. (1989). The Computation of Color. [Ph.D. Thesis, MIT Artificial Intelligence Laboratory]."},{"key":"ref_32","unstructured":"Vonikakis, V. (2024, July 15). TM-DIED: The Most Difficult Image Enhancement Dataset. Available online: https:\/\/sites.google.com\/site\/vonikakis\/datasets\/tm-died."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"71","DOI":"10.5201\/ipol.2014.107","article-title":"Multiscale Retinex","volume":"4","author":"Petro","year":"2014","journal-title":"Image Process. Line"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Tian, Z., Qu, P., Li, J., Sun, Y., Li, G., Liang, Z., and Zhang, W. (2023). A Survey of Deep Learning-Based Low-Light Image Enhancement. Sensors, 23.","DOI":"10.3390\/s23187763"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Tao, L., Zhu, C., Xiang, G., Li, Y., Jia, H., and Xie, X. (2017, January 10\u201313). LLCNN: A convolutional neural network for low-light image enhancement. Proceedings of the 2017 IEEE Visual Communications and Image Processing (VCIP), St. Petersburg, FL, USA.","DOI":"10.1109\/VCIP.2017.8305143"},{"key":"ref_36","unstructured":"Lv, F., Lu, F., Wu, J., and Lim, C.S. (2018, January 3\u20136). MBLLEN: Low-Light Image\/Video Enhancement Using CNNs. Proceedings of the British Machine Vision Conference, Newcastle, UK."},{"key":"ref_37","unstructured":"Paul, J. (2006). Digital Image Colour Correction. [Ph.D. Thesis, University of East Anglia]."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Gubner, J.A. (2006). Probability and Random Processes for Electrical and Computer Engineers, Cambridge University Press.","DOI":"10.1017\/CBO9780511813610"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Rowlands, D.A., and Finlayson, G.D. (2023, January 28\u201330). Mondrian representation of real world image statistics. Proceedings of the London Imaging Meeting, London, UK.","DOI":"10.2352\/lim.2023.4.1.11"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). ImageNet: A large-scale hierarchical image database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1016\/0042-6989(76)90020-1","article-title":"Quantitative Studies in Retinex theory, a comparison between theoretical predictions and observer responses to Color Mondrian experiments","volume":"16","author":"McCann","year":"1976","journal-title":"Vis. Res."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1016\/0042-6989(90)90079-Z","article-title":"\u201cColour constancy\u201d in Mondrian patterns: A partial cancellation of physical chromaticity shifts by simultaneous contrast","volume":"30","author":"Valberg","year":"1990","journal-title":"Vis. Res."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"McCann, J.J. (1999, January 16\u201319). Lessons Learned from Mondrians Applied to Real Images and Color Gamuts. Proceedings of the IS&T\/SID Seventh Color Imaging Conference, Scottsdale, AZ, USA.","DOI":"10.2352\/CIC.1999.7.1.art00001"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"R558","DOI":"10.1016\/S0960-9822(99)80354-6","article-title":"Colour vision: Is colour constancy real?","volume":"9","author":"Hurlbert","year":"1999","journal-title":"Curr. Biol."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"E185","DOI":"10.21914\/anziamj.v44i0.493","article-title":"Explicit inverses of Toeplitz and associated matrices","volume":"44","author":"Dow","year":"2003","journal-title":"ANZIAM J."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1145\/3355089.3356563","article-title":"Document rectification and illumination correction using a patch-based CNN","volume":"38","author":"Li","year":"2019","journal-title":"ACM Trans. Graph."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2032","DOI":"10.1364\/JOSAA.7.002032","article-title":"Contrast in complex images","volume":"7","author":"Peli","year":"1990","journal-title":"J. Opt. Soc. Am. A"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1145\/566654.566574","article-title":"Fast bilateral filtering for the display of high-dynamic-range images","volume":"21","author":"Durand","year":"2002","journal-title":"ACM Trans. Graph."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/8\/204\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:41:43Z","timestamp":1760110903000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/8\/204"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,22]]},"references-count":48,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["jimaging10080204"],"URL":"https:\/\/doi.org\/10.3390\/jimaging10080204","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,22]]}}}