{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:29:38Z","timestamp":1750220978618,"version":"3.41.0"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"2s","license":[{"start":{"date-parts":[[2019,4,30]],"date-time":"2019-04-30T00:00:00Z","timestamp":1556582400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2019,4,30]]},"abstract":"<jats:p>Fine Art Photography is one of the most popular art forms, which creates lasting impressions that elicit various human emotional reactions. Photo aesthetic enhancement aims at improving the aesthetic level of the photo to please humans by updating color appearance or modifying the geometry structure of objects within that photo. Even though several aesthetic enhancement methods have been proposed, to our knowledge, there is no research to explore, highlight, and accentuate photos\u2019 intrinsic aesthetic value to elicit a stronger response from the human observer about the photos\u2019 theme. To meet this challenge, a new multimedia technology called automatic color theme--based aesthetic enhancement (CT-AEA) is proposed by leveraging big online data to perform timely collection and learning of humans\u2019 current aesthetic perception-behavior over photos and color themes in art, fashion, and design. Unlike existing aesthetic enhancement that examines the composition, such as the geometric structure of the image contents and color\/luminance-related (color tone and luminance distribution) characteristics, this CT-AEA takes into consideration the importance of a suitable color theme, namely a set of dominant colors for the design when assessing the aesthetic appearance of a photo. This algorithm is composed of (1) utilizing the knowledge gained from the human evaluator's perception of beauty from existing online datasets, rather than simply applying prior existing knowledge of color harmony theory; (2) developing a new color theme difference equation that exhibits order-invariance and percentage-sensitive properties; (3) designing an optimal color theme recommendation to maximize the aesthetic performance, while minimizing the color modification cost to solve the problems of color inconsistencies and distortion. Experimental results, quantitative measure, and comparison tests demonstrate the algorithm's effectiveness, advantages, and potential for use in many color-related art and design applications.<\/jats:p>","DOI":"10.1145\/3328991","type":"journal-article","created":{"date-parts":[[2019,7,3]],"date-time":"2019-07-03T13:47:53Z","timestamp":1562161673000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Color Theme--based Aesthetic Enhancement Algorithm to Emulate the Human Perception of Beauty in Photos"],"prefix":"10.1145","volume":"15","member":"320","published-online":{"date-parts":[[2019,7,3]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2659520"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2584105"},{"volume-title":"Proceedings of the International AAAI Conference on Web and Social Media.","author":"Schifanella R.","key":"e_1_2_1_3_1","unstructured":"R. Schifanella, M. Redi, and L. Aiello. 2015. An image is worth more than a thousand favorites: Surfacing the hidden beauty of Flickr pictures. In Proceedings of the International AAAI Conference on Web and Social Media."},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201916)","author":"Chen J.","key":"e_1_2_1_4_1","unstructured":"J. Chen, G. Bai, S. Liang, and Z. Li. 2016. Automatic image cropping: A computational complexity study. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201916). 507--515."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","unstructured":"R. Datta D. Joshi J. Li and J. Z. Wang. 2006. Studying Aesthetics in Photographic Images Using a Computational Approach. Springer Berlin 288--301. 10.1007\/11744078_23","DOI":"10.1007\/11744078_23"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2016.2514499"},{"key":"e_1_2_1_7_1","doi-asserted-by":"crossref","unstructured":"Y. Deng C. C. Loy and X. Tang. 2017. Aesthetic-Driven image enhancement by adversarial learning. Retrieved from: arXiv preprint arXiv:1707.05251.","DOI":"10.1145\/3240508.3240531"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","unstructured":"S. Bhattacharya R. Sukthankar and M. Shah. 2011. A holistic approach to aesthetic enhancement of photographs. ACM Trans. Multimedia Comput. Commun. Appl. 7S (2011) 1--21. 10.1145\/2037676.2037678","DOI":"10.1145\/2037676.2037678"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995539"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126498"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.130"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2015.2460013"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2016.2601784"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3007669.3007708"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-016-3561-5"},{"volume-title":"Proceedings of the 3rd IAPR Asian Conference on Pattern Recognition (ACPR\u201915)","author":"Islam M. B.","key":"e_1_2_1_16_1","unstructured":"M. B. Islam, W. Lai-Kuan, W. Chee-Onn, and K. L. Low. 2015. Stereoscopic image warping for enhancing composition aesthetics. In Proceedings of the 3rd IAPR Asian Conference on Pattern Recognition (ACPR\u201915). 645--649."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10586-016-0547-z"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01616.x"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03212.x"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/2381312.2381314"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2013.2268051"},{"key":"e_1_2_1_22_1","unstructured":"S. H. Lim and D. A. Silverstein. 2016. Image tone adjustment using local tone curve computation S. H. Lim and D. A. Silverstein (Eds.). U.S. Patent 9369684. Retrieved from https:\/\/patents.google.com\/patent\/US9369684B2\/en?q&equals;Image8q&equals;tone8q&equals;adjustment8q&equals;local8q&equals;tone8q&equals;curve8q&equals;computation8oq&equals;Image+tone+adjustment+using+local+tone+curve+computation."},{"key":"e_1_2_1_23_1","first-page":"1","article-title":"Data-driven approach to aesthetic enhancement","volume":"14","author":"Choi J.","year":"2016","unstructured":"J. Choi, S. Koh, J. Kwack, Y. Kwon, and H. Shim. 2016. Data-driven approach to aesthetic enhancement. Electron. Imag. 14 (2016), 1--5.","journal-title":"Electron. Imag."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964959"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of SPIE 9869","author":"Bao L.","year":"2016","unstructured":"L. Bao, K. Panetta, and S. Agaian. 2016. A new color transfer quality measure. In Proceedings of SPIE 9869, Mobile Multimedia\/Image Processing, Security, and Applications 2016, 986904."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2016.7613196"},{"volume-title":"Proceedings of the IEEE International Symposium on Technologies for Homeland Security (HST\u201917)","author":"Bao L.","key":"e_1_2_1_27_1","unstructured":"L. Bao, K. Panetta, and S. Agaian. 2017. Fast color transfer for camouflage applications. In Proceedings of the IEEE International Symposium on Technologies for Homeland Security (HST\u201917). 1--5."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1882261.1866172"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2697948"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2598918"},{"key":"e_1_2_1_31_1","first-page":"396","article-title":"Relationship between color and emotion: A study of college students","volume":"38","author":"Naz K.","year":"2004","unstructured":"K. Naz and H. Epps. 2004. Relationship between color and emotion: A study of college students. Coll. Stud. J. 38 (2004), 396.","journal-title":"Coll. Stud. J."},{"key":"e_1_2_1_32_1","unstructured":"P. T.-F. Chong C. Minchew and K. Ewing. 2015. Color selection system based on desired color emotion and color harmony P. T.-F. Chong C. Minchew and K. Ewing. U.S. Patent No. 9134179. Retrieved from https:\/\/patents.google.com\/patent\/US9134179B2\/en."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1002\/col.21988"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2630099.2630100"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964958"},{"key":"e_1_2_1_36_1","volume-title":"Computational Intelligence in Data Mining","volume":"2","author":"Nayak J.","unstructured":"J. Nayak, B. Naik, and H. Behera. 2015. Fuzzy C-means (FCM) clustering algorithm: A decade review from 2000 to 2014. In Computational Intelligence in Data Mining, Vol. 2. Springer, 133--149."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TFUZZ.2018.2859184"},{"volume-title":"Proceedings of the 6th Signal Processing with Adaptive Sparse Structured Representations Workshop (SPARS\u201917)","author":"Mota J. F.","key":"e_1_2_1_38_1","unstructured":"J. F. Mota, L. Weizman, N. Deligiannis, Y. C. Eldar, and M. R. Rodrigues. 2017. Reweighted l1-norm minimization with guarantees: An incremental measurement approach to sparse reconstruction. In Proceedings of the 6th Signal Processing with Adaptive Sparse Structured Representations Workshop (SPARS\u201917)."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1068\/p5321"},{"volume-title":"Proceedings of the European Conference on Computer Vision. 446--461","author":"Bossard L.","key":"e_1_2_1_40_1","unstructured":"L. Bossard, M. Guillaumin, and L. Van Gool. 2014. Food-101\u2014Mining discriminative components with random forests. In Proceedings of the European Conference on Computer Vision. 446--461."},{"key":"e_1_2_1_41_1","unstructured":"K. Lant. 2017. Colors in marketing and advertising. 99designs. Retrieved from https:\/\/99designs.com\/blog\/tips\/colors-marketing-advertising\/."},{"volume-title":"Proceedings of the Conference on Human Vision and Electronic Imaging VIII.","author":"Hasler D.","key":"e_1_2_1_42_1","unstructured":"D. Hasler and S. S\u00fcsstrunk. 2003. Measuring colourfulness in natural images. In Proceedings of the Conference on Human Vision and Electronic Imaging VIII."},{"volume-title":"Proceedings of the IEEE International Conference on Technologies for Practical Robot Applications (TePRA\u201915)","author":"Bao L.","key":"e_1_2_1_43_1","unstructured":"L. Bao, K. Panetta, and S. Agaian. 2015. A no reference image quality measure using a distance doubling variance. In Proceedings of the IEEE International Conference on Technologies for Practical Robot Applications (TePRA\u201915). 1--6."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIM.2016.7477952"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3328991","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3328991","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:54:41Z","timestamp":1750204481000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3328991"}},"subtitle":[],"editor":[{"given":"Karen","family":"Panetta","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3496-8568","authenticated-orcid":false,"given":"Long","family":"Bao","sequence":"additional","affiliation":[]},{"given":"Sos","family":"Agaian","sequence":"additional","affiliation":[]},{"given":"Victor","family":"Oludare","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2019,4,30]]},"references-count":44,"journal-issue":{"issue":"2s","published-print":{"date-parts":[[2019,4,30]]}},"alternative-id":["10.1145\/3328991"],"URL":"https:\/\/doi.org\/10.1145\/3328991","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2019,4,30]]},"assertion":[{"value":"2018-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-07-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}