{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T01:12:33Z","timestamp":1760058753961,"version":"build-2065373602"},"reference-count":75,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2025,4,23]],"date-time":"2025-04-23T00:00:00Z","timestamp":1745366400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>In this article, for the first time on this topic, we analyze the historical color palettes of Renaissance oil paintings by using machine-learning methods and digital images. Our work has two main parts: we collect data on their historical color palettes and then use machine learning to predict the original colors of paintings. This model studies color ratios, enhancement levels, symbolic meanings, and historical records. It looks at key colors, measures their relationships, and learns how they have changed. The main contributions of this work are as follows: (i) we develop a model that predicts a painting\u2019s original color palette based on multiple factors, such as the color ratios and symbolic meanings, and (ii) we propose a framework for using cognitive computing tools to recover the original colors of historical artworks. This helps us to rediscover lost emotional and cultural details.<\/jats:p>","DOI":"10.3390\/bdcc9050113","type":"journal-article","created":{"date-parts":[[2025,4,23]],"date-time":"2025-04-23T08:26:43Z","timestamp":1745396803000},"page":"113","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Cognitive Computing for Understanding and Restoring Color in Renaissance Art"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6683-0064","authenticated-orcid":false,"given":"Artyom M.","family":"Grigoryan","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, The University of Texas at San Antonio, San Antonio, TX 78249, USA"}]},{"given":"Sos S.","family":"Agaian","sequence":"additional","affiliation":[{"name":"Computer Science Department, College of Staten Island, Staten Island, NY 10314, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7825-0881","authenticated-orcid":false,"given":"Shao","family":"Liu","sequence":"additional","affiliation":[{"name":"Computer Science Department, College of Staten Island, Staten Island, NY 10314, USA"}]}],"member":"1968","published-online":{"date-parts":[[2025,4,23]]},"reference":[{"key":"ref_1","unstructured":"Martin, K. (2006). Chapter 6, Painting and the Representation of Action. Leonardo da Vinci: The Marvellous Works of Nature and Man, Oxford University Press."},{"key":"ref_2","unstructured":"Gage, J. (1999). Chapter 4, Colour, Culture, and Imagery. Color and Meaning: Art, Science, and Symbolism, University of California Press."},{"key":"ref_3","unstructured":"Rewald, J. (1956). Chapter VII, Van Gogh in Saint-Remy. Post-Impressionism: From Van Gogh to Gauguin, Museum of Modern Art."},{"key":"ref_4","unstructured":"Rewald, J. (1956). Chapter IX, Gauguin and Symbolists. Post-Impressionism: From Van Gogh to Gauguin, Museum of Modern Art."},{"key":"ref_5","unstructured":"Turner, M. (2006). The Artful Mind: Cognitive Science and the Riddle of Human Creativity, Oxford University Press. [1st ed.]."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1186\/s41235-023-00499-6","article-title":"Humans versus AI: Whether and why we prefer human-created compared to AI-created artwork","volume":"8","author":"Bellaiche","year":"2023","journal-title":"Cogn. Res."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Aviv, V. (2014). What does the brain tell us about abstract art?. Front. Hum. Neurosci., 8.","DOI":"10.3389\/fnhum.2014.00085"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Condra, J. (2008). The Greenwood Encyclopedia of Clothing Through World History, Greenwood Publishing Group.","DOI":"10.5040\/9781440880100"},{"key":"ref_9","unstructured":"Greenfield, A. (2005). A Perfect Red: Empire, Espionage, and the Quest for the Color of Desire, HarperCollins Publishers."},{"key":"ref_10","unstructured":"Jardine, L., and Goods, W. (1996). A New History of the Renaissance, Doubleday."},{"key":"ref_11","unstructured":"Harvey, J. (1995). Men in Black, The University of Chicago Press."},{"key":"ref_12","unstructured":"Gage, J. (1993). Color and Culture: Practice and Meaning from Antiquity to Abstraction, Bulfinch Press Book."},{"key":"ref_13","unstructured":"Duby, G., and Aries, P. (1988). A History of Private Life: Revelations of the Medieval World, Harvard UP."},{"key":"ref_14","first-page":"29","article-title":"Encyclopedia of the Renaissance","volume":"Volume 2","author":"Covington","year":"1999","journal-title":"Clothing"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"104121","DOI":"10.1016\/j.imavis.2021.104121","article-title":"Novel features for art movement classification of portrait paintings","volume":"108","author":"Liu","year":"2021","journal-title":"Image Vis. Comput."},{"key":"ref_16","unstructured":"(2025, March 03). Colour & Technique in Renaissance Painting. World History Encyclopedia. Available online: https:\/\/www.worldhistory.org\/article\/1628\/colour--technique-in-renaissance-painting\/."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1163\/15733823-02046p02","article-title":"Mining for color: New blues, yellows, and translucent paint","volume":"20","author":"Berrie","year":"2015","journal-title":"Early Sci. Med."},{"key":"ref_18","unstructured":"Milford, H. (1933). Il Libro Dell\u2019arte, Oxford University Press."},{"key":"ref_19","unstructured":"Mills, J.S., and White, R. (1994). The Organic Chemistry of Museum Objects, Butterworth-Heinemann. [2nd ed.]."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1016\/j.jksus.2017.09.001","article-title":"Microorganisms and the integrated conservation-intervention process of the renaissance mural paintings from Casas Pintadas in \u00c9vora\u2014Know to act, act to preserve","volume":"29","author":"Rosado","year":"2017","journal-title":"J. King Saud Univ.-Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1186\/s40494-020-00382-3","article-title":"Salvator Mundi: An investigation of the painting\u2019s materials and techniques","volume":"8","author":"Rieppi","year":"2020","journal-title":"Herit. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Gonzalez, V., Hageraats, V., Wallez, G., Eveno, M., Ravaud, E., R\u00e9fr\u00e9giers, M., Thoury, M., Menu, M., and Gourier, D. (2020). Microchemical analysis of Leonardo da Vinci\u2019s lead white paints reveals knowledge and control over pigment scattering properties. Sci. Rep., 10.","DOI":"10.1038\/s41598-020-78623-5"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1145\/3084547","article-title":"Wall painting reconstruction using a genetic algorithm","volume":"11","author":"Sizikova","year":"2018","journal-title":"J. Comput. Cult. Herit."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1145\/3317949","article-title":"Gloss, color, and topography scanning for reproducing a painting\u2019s appearance using 3D printing","volume":"12","author":"Elkhuizen","year":"2020","journal-title":"J. Comput. Cult. Herit."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.1109\/TIP.2004.833105","article-title":"Region filling and object removal by exemplar-based image inpainting","volume":"13","author":"Criminisi","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1109\/TIT.1982.1056489","article-title":"Least squares quantization in PCM","volume":"28","author":"Stuart","year":"1982","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1145\/3003435","article-title":"Multi-View feature combination for ancient paintings chronological classification","volume":"10","author":"Chen","year":"2017","journal-title":"J. Comput. Cult. Herit."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, R., Isola, P., and Efros, A.A. (2016, January 11\u201314). Colorful image colorization. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46487-9_40"},{"key":"ref_29","unstructured":"Elgammal, A., Liu, B., Kim, D., and Elhoseiny, M. (2017, January 19\u201323). CAN: Creative adversarial networks generating \u201cart\u201d by learning about styles and deviating from style norms. Proceedings of the Eighth International Conference on Computational Creativity (ICCC), Atlanta, GA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1186\/s40494-024-01279-1","article-title":"ConvSRGAN: Super-resolution inpainting of traditional Chinese paintings","volume":"12","author":"Hu","year":"2024","journal-title":"Herit. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1793","DOI":"10.36922\/ac.1793","article-title":"Limitations and possibilities of digital restoration techniques using generative AI tools: Reconstituting Antoine Fran\u00e7ois Callet\u2019s Achilles Dragging Hector\u2019s Body Past the Walls of Troy","volume":"1","author":"Hutson","year":"2023","journal-title":"Arts Commun."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Grigoryan, A., and Agaian, S. (2018). Quaternion and Octonion Color Image Processing with MATLAB, SPIE.","DOI":"10.1117\/3.2278810"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"108533","DOI":"10.1016\/j.sigpro.2022.108533","article-title":"Commutative quaternion algebra and DSP fundamental properties: Quaternion convolution and Fourier transform","volume":"196","author":"Grigoryan","year":"2022","journal-title":"Signal Process."},{"key":"ref_34","first-page":"23","article-title":"Retooling of color imaging in the quaternion algebra","volume":"1","author":"Grigoryan","year":"2014","journal-title":"Appl. Math. Sci. Int. J."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Grigoryan, A., and Agaian, S. (2014, January 2\u20136). Alpha-rooting method of color image enhancement by discrete quaternion Fourier transform, [9019-3]. Proceedings of the SPIE Proceedings, 2014 Electronic Imaging: Image Processing: Algorithms and Systems XII, San Francisco, CA, USA.","DOI":"10.1117\/12.2040596"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.sigpro.2014.11.019","article-title":"Quaternion Fourier transform based alpha-rooting method for color image measurement and enhancement, SIGPRO-D-14-01083R1","volume":"109","author":"Grigoryan","year":"2015","journal-title":"Signal Process."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Grigoryan, A., and Agaian, S. (2017). Image Processing Contrast Enhancement. Wiley Encyclopedia of Electrical and Electronics Engineering, Wiley-Interscience.","DOI":"10.1002\/047134608X.W5525.pub2"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1109\/83.908502","article-title":"Transform-based image enhancement algorithms","volume":"10","author":"Agaian","year":"2001","journal-title":"IEEE Trans. Image Process."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Grigoryan, A., and Agaian, S. (2016, January 14\u201318). 2-D Left-side quaternion discrete Fourier transform fast algorithms. Proceedings of the IS&T International Symposium, 2016 Electronic Imaging: Algorithms and Systems XIV, San Francisco, CA, USA.","DOI":"10.2352\/ISSN.2470-1173.2016.15.IPAS-192"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1016\/S1076-5670(04)30002-9","article-title":"Transform-based image enhancement algorithms with performance measure","volume":"Volume 130","author":"Grigoryan","year":"2004","journal-title":"Advances in Imaging and Electron Physics"},{"key":"ref_41","unstructured":"Grigoryan, A., and Agaian, S. (February, January 28). Color visibility images and measures of image enhancement. Proceedings of the IS&T International Symposium, Electronic Imaging: Algorithms and Systems, Burlingame, CA, USA."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1109\/TCE.2013.6626251","article-title":"No reference color image contrast and quality measures","volume":"59","author":"Panetta","year":"2013","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1109\/TSMCB.2007.909440","article-title":"Human visual system-based image enhancement and measure of image enhancement","volume":"Volume 38","author":"Panetta","year":"2008","journal-title":"IEEE Transactions on Systems, Man and Cybernetics\u2014Part A: Systems and Humans"},{"key":"ref_44","unstructured":"(2025, January 01). Available online: https:\/\/artgreet.com\/symbols-in-renaissance-art\/."},{"key":"ref_45","unstructured":"Gage, J. (1999). Color and Meaning: Art, Science, and Symbolism, University of California Press."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Condra, J. (2008). The Greenwood Encyclopedia of Clothing Through World History, Prehistory to 1500 CE, Greenwood Publishing Group.","DOI":"10.5040\/9781440880094"},{"key":"ref_47","unstructured":"Pearson Education, Inc. (2007). What colors mean. Fact Monster, Pearson Education, Inc.. Available online: http:\/\/www.factmonster.com\/ipka\/A0769383.html."},{"key":"ref_48","unstructured":"Finlay, V. (2002). Color: A Natural History of the Palette, Ballantine Books."},{"key":"ref_49","unstructured":"Ketchum, D. (2025, January 01). The Meaning of Colors During the Renaissance Era|The Classroom|Synonym. Available online: https:\/\/classroom.synonym.com\/meaning-colors-during-renaissance-era-8734.html."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1086\/690580","article-title":"Technical Art History and the First Conference on the Scientific Analysis of Works of Art (Rome, 1930)","volume":"2","author":"Marco","year":"2017","journal-title":"Hist. Humanit."},{"key":"ref_51","unstructured":"Erma, H. (2012). Technical Art History: The synergy of Art, conservation and science. Art History and Visual Studies, Brill Academic Publisher."},{"key":"ref_52","unstructured":"Roy, A., and Spring, M. (2007). Raphael\u2019s materials: Some new discoveries and their context within early sixteenth-century painting. Raphael\u2019s Painting Technique: Working Practices Before Rome, Proceedings of the Eu-ARTECH Workshop, London, UK, 11 November 2004, National Gallery. Available online: https:\/\/cima.ng-london.org.uk\/documentation\/files\/N-6480\/02_Provenance\/Proceedings_2007_SPRING.pdf."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1186\/s40494-017-0152-3","article-title":"New insights into the materials of fifteenth- and sixteenth-century Netherlandish paintings in the National Gallery, London","volume":"5","author":"Spring","year":"2017","journal-title":"Herit. Sci."},{"key":"ref_54","first-page":"83","article-title":"Lead-Tin Yellow","volume":"Volume 2","year":"1993","journal-title":"Artists\u2019 Pigments: A Handbook of the History and Characteristics"},{"key":"ref_55","first-page":"219","article-title":"Lead Antimonate Yellow","volume":"Volume 1","author":"Wainwright","year":"1993","journal-title":"Artists\u2019 Pigments: A Handbook of the History and Characteristics"},{"key":"ref_56","first-page":"131","article-title":"Verdigris and Copper Resinate","volume":"Volume 2","author":"Kuhn","year":"1993","journal-title":"Artists\u2019 Pigments: A Handbook of the History and Characteristics"},{"key":"ref_57","first-page":"183","article-title":"Malachite and Green Verditer","volume":"Volume 2","author":"Gettens","year":"1993","journal-title":"Artists\u2019 Pigments: A Handbook of the History and Characteristics"},{"key":"ref_58","first-page":"159","article-title":"Vermilion and Cinnabar","volume":"Volume 2","author":"Gettens","year":"1993","journal-title":"Artists\u2019 Pigments: A Handbook of the History and Characteristics"},{"key":"ref_59","first-page":"109","article-title":"Red Lead and minimum","volume":"Volume 2","author":"Fitzhugh","year":"1993","journal-title":"Artists\u2019 Pigments: A Handbook of the History and Characteristics"},{"key":"ref_60","first-page":"67","article-title":"Lead White","volume":"Volume 2","author":"Gettens","year":"1993","journal-title":"Artists\u2019 Pigments: A Handbook of the History and Characteristics"},{"key":"ref_61","first-page":"157","article-title":"Vandyke Brown Cassel Earth, Cologne Earth","volume":"Volume 3","author":"Feller","year":"1993","journal-title":"Artists\u2019 Pigments: A Handbook of the History and Characteristics"},{"key":"ref_62","first-page":"38","article-title":"Iron Oxide Pigments","volume":"Volume 4","author":"Berrie","year":"2007","journal-title":"Artists\u2019 Pigments, A Handbook of Their History and Characteristics"},{"key":"ref_63","unstructured":"(2025, January 01). Available online: https:\/\/colourlex.com\/project\/ivory-black\/."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Liu, S., Agaian, S., and Grigoryan, A. (2024). PortraitEmotion3D: A novel dataset and 3D emotion estimation method for artistic portraiture analysis. Appl. Sci., 14.","DOI":"10.3390\/app142311235"},{"key":"ref_65","unstructured":"(2025, January 01). Available online: https:\/\/www.definitions.net\/definition\/palette."},{"key":"ref_66","unstructured":"(2025, January 01). Palette Definition. Available online: https:\/\/www.vocabulary.com\/dictionary\/palette."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/0098-3004(84)90020-7","article-title":"FCM: The fuzzy c-means clustering algorithm","volume":"10","author":"Bezdek","year":"1984","journal-title":"Comput. Geosci."},{"key":"ref_68","unstructured":"Leonard, K., and Rousseeuw, P. (2008). Partitioning Around Medoids (Program PAM), John Wiley & Sons, Inc."},{"key":"ref_69","unstructured":"(2025, January 01). Available online: https:\/\/artsexperiments.withgoogle.com\/artpalette\/."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1002\/col.20070","article-title":"The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations","volume":"30","author":"Gaurav","year":"2005","journal-title":"Color Res. Appl."},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Luo, R. (2015). CIELAB. Encyclopedia of Color Science and Technology, Springer.","DOI":"10.1007\/978-3-642-27851-8"},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Stakhov, A. (1998). The golden section and modern harmony mathematics. Applications of Fibonacci, Springer.","DOI":"10.1007\/978-94-011-5020-0_43"},{"key":"ref_73","unstructured":"Grigoryan, A., and Agaian, S. (May, January 27). Re-Coloring of grayscale images: Models with Aesthetic and Golden proportions. Proceedings of the SPIE, Defence + Commercial Sensing, Mobile Multimedia\/Image Processing, Security, and Applications, Orlando, FL, USA."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MMUL.2019.2908624","article-title":"Evidence of Golden and Aesthetic Proportions in Colors of Paintings of the Prominent Artists","volume":"27","author":"Grigoryan","year":"2020","journal-title":"IEEE MultiMedia"},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"Amirshahi, S.A., Hayn-Leichsenring, G.U., Denzler, J., and Redies, C. (2015). Jenaesthetics Subjective Dataset: Analyzing Paintings by Subjective Scores. Computer Vision-ECCV 2014 Workshops, Springer International Publishing.","DOI":"10.1007\/978-3-319-16178-5_1"}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/5\/113\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:20:06Z","timestamp":1760030406000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/5\/113"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,23]]},"references-count":75,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2025,5]]}},"alternative-id":["bdcc9050113"],"URL":"https:\/\/doi.org\/10.3390\/bdcc9050113","relation":{},"ISSN":["2504-2289"],"issn-type":[{"type":"electronic","value":"2504-2289"}],"subject":[],"published":{"date-parts":[[2025,4,23]]}}}