{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T18:05:38Z","timestamp":1758823538239,"version":"3.41.0"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2015,8,24]],"date-time":"2015-08-24T00:00:00Z","timestamp":1440374400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2015,8,24]]},"abstract":"<jats:p>In this article, we consider how to automatically create pleasing photo collages created by placing a set of images on a limited canvas area. The task is formulated as an optimization problem. Differently from existing state-of-the-art approaches, we here exploit subjective experiments to model and learn pleasantness from user preferences. To this end, we design an experimental framework for the identification of the criteria that need to be taken into account to generate a pleasing photo collage. Five different thematic photo datasets are used to create collages using state-of-the-art criteria. A first subjective experiment where several subjects evaluated the collages, emphasizes that different criteria are involved in the subjective definition of pleasantness. We then identify new global and local criteria and design algorithms to quantify them. The relative importance of these criteria are automatically learned by exploiting the user preferences, and new collages are generated. To validate our framework, we performed several psycho-visual experiments involving different users. The results shows that the proposed framework allows to learn a novel computational model which effectively encodes an inter-user definition of pleasantness. The learned definition of pleasantness generalizes well to new photo datasets of different themes and sizes not used in the learning. Moreover, compared with two state-of-the-art approaches, the collages created using our framework are preferred by the majority of the users.<\/jats:p>","DOI":"10.1145\/2801126","type":"journal-article","created":{"date-parts":[[2015,8,26]],"date-time":"2015-08-26T14:00:30Z","timestamp":1440597630000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["User Preferences Modeling and Learning for Pleasing Photo Collage Generation"],"prefix":"10.1145","volume":"12","author":[{"given":"Simone","family":"Bianco","sequence":"first","affiliation":[{"name":"University of Milano-Bicocca, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gianluigi","family":"Ciocca","sequence":"additional","affiliation":[{"name":"University of Milano-Bicocca, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2015,8,24]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Borji Ali Cheng Ming-Ming Jiang Huaizu and Li Jia. 2014. Salient Object Detection: A Survey. (2014) arXiv:1411.5878 {cs.CV}.  Borji Ali Cheng Ming-Ming Jiang Huaizu and Li Jia. 2014. Salient Object Detection: A Survey. (2014) arXiv:1411.5878 {cs.CV}."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-79860-6_17"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2012.2211029"},{"volume-title":"Image Processing: Machine Vision Applications V","author":"Bianco Simone","key":"e_1_2_1_4_1","unstructured":"Simone Bianco and Francesco Tisato . 2012. Sensor placement optimization in buildings . In Image Processing: Machine Vision Applications V , vol. 8300 , SPIE , 830003. Simone Bianco and Francesco Tisato. 2012. Sensor placement optimization in buildings. In Image Processing: Machine Vision Applications V, vol. 8300, SPIE, 830003."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2007.897466"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1860559.1860582"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180639.1180653"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2345401"},{"volume-title":"Digital Photography VI","author":"Ciocca Gianluigi","key":"e_1_2_1_9_1","unstructured":"Gianluigi Ciocca and Raimondo Schettini . 2010. Multiple image thumbnailing . In Digital Photography VI , vol. 7537 , SPIE , 75370S. Gianluigi Ciocca and Raimondo Schettini. 2010. Multiple image thumbnailing. In Digital Photography VI, vol. 7537, SPIE, 75370S."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1095034.1095065"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1049\/iet-cvi.2012.0032"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the 6th International Symposium on Micro Machine and Human Science.","volume":"1","author":"Russ","unstructured":"Russ C. Eberhart and James Kennedy. 1995. A new optimizer using particle swarm theory . In Proceedings of the 6th International Symposium on Micro Machine and Human Science. vol. 1 , New York, 39--43. Russ C. Eberhart and James Kennedy. 1995. A new optimizer using particle swarm theory. In Proceedings of the 6th International Symposium on Micro Machine and Human Science. vol. 1, New York, 39--43."},{"key":"e_1_2_1_13_1","first-page":"165","article-title":"Picture collage with genetic algorithm and stereo vision","volume":"8","author":"Ekhtiyar Hesam","year":"2011","unstructured":"Hesam Ekhtiyar , Mahdi Sheida , and Mahmood Amintoosi . 2011 . Picture collage with genetic algorithm and stereo vision . Int. J. Comput. Sci. Iss. 8 , 4, 165 -- 169 . Hesam Ekhtiyar, Mahdi Sheida, and Mahmood Amintoosi. 2011. Picture collage with genetic algorithm and stereo vision. Int. J. Comput. Sci. Iss. 8, 4, 165--169.","journal-title":"Int. J. Comput. Sci. Iss."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICMEW.2012.59"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the IEEE International Conference on Image Processing.","volume":"2","author":"Girgensohn Andreas","year":"2003","unstructured":"Andreas Girgensohn and Patrick Chiu . 2003 . Stained glass photo collages . In Proceedings of the IEEE International Conference on Image Processing. vol. 2 . 871--874. Andreas Girgensohn and Patrick Chiu. 2003. Stained glass photo collages. In Proceedings of the IEEE International Conference on Image Processing. vol. 2. 871--874."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01615.x"},{"key":"e_1_2_1_17_1","volume-title":"Genetic Algorithms in Search, Optimization and Machine Learning","author":"Goldberg David E.","unstructured":"David E. Goldberg . 1989. Genetic Algorithms in Search, Optimization and Machine Learning ( 1 st Ed.). Addison-Wesley Longman Publishing Co., Inc. , Boston, MA . David E. Goldberg. 1989. Genetic Algorithms in Search, Optimization and Machine Learning (1st Ed.). Addison-Wesley Longman Publishing Co., Inc., Boston, MA.","edition":"1"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/321062.321069"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024189"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995721"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Maurice G. Kendall. 1938. A new measure of rank correlation. Biometrika 30 1\/2 81--93.  Maurice G. Kendall. 1938. A new measure of rank correlation. Biometrika 30 1\/2 81--93.","DOI":"10.1093\/biomet\/30.1-2.81"},{"key":"e_1_2_1_22_1","first-page":"4","article-title":"Memorability of image regions","volume":"2","author":"Khosla Aditya","year":"2012","unstructured":"Aditya Khosla , Jianxiong Xiao , Antonio Torralba , and Aude Oliva . 2012 . Memorability of image regions . In NIPS , Vol. 2. 4 . Aditya Khosla, Jianxiong Xiao, Antonio Torralba, and Aude Oliva. 2012. Memorability of image regions. In NIPS, Vol. 2. 4.","journal-title":"NIPS"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1587\/transinf.E96.D.562"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1137\/S003614450242889"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2010.5543752"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2009.2030741"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2013.2270392"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/957013.957094"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-008-0282-4"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2012.2214050"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/7.4.308"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1002\/col.20208"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141965"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.130"},{"key":"e_1_2_1_35_1","series-title":"Lecture Notes in Computer Science","volume-title":"Advances in Multimedia Modeling","author":"Sandhaus Philipp","unstructured":"Philipp Sandhaus , Mohammad Rabbath , and Susanne Boll . 2011. Employing aesthetic principles for automatic photo book layout . In Advances in Multimedia Modeling , Lecture Notes in Computer Science , vol. 6523 , Springer , Berlin Heidelberg , 84--95. Philipp Sandhaus, Mohammad Rabbath, and Susanne Boll. 2011. Employing aesthetic principles for automatic photo book layout. In Advances in Multimedia Modeling, Lecture Notes in Computer Science, vol. 6523, Springer, Berlin Heidelberg, 84--95."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2009.5457512"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 2006 IEEE Conference on Computer Vision and Pattern Recognition.","volume":"1","author":"Wang Jingdong","year":"2006","unstructured":"Jingdong Wang , Long Quan , Jian Sun , Xiaoou Tang , and Heung-Yeung Shum . 2006 . Picture collage . In Proceedings of the 2006 IEEE Conference on Computer Vision and Pattern Recognition. vol. 1 . IEEE, 347--354. Jingdong Wang, Long Quan, Jian Sun, Xiaoou Tang, and Heung-Yeung Shum. 2006. Picture collage. In Proceedings of the 2006 IEEE Conference on Computer Vision and Pattern Recognition. vol. 1. IEEE, 347--354."},{"volume-title":"Proceedings of the 2013 Asia -- Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA). IEEE, 1--10","author":"Wu Zhipeng","key":"e_1_2_1_39_1","unstructured":"Zhipeng Wu and K. Aizawa . 2013. PicWall: Photo collage on-the-fly . In Proceedings of the 2013 Asia -- Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA). IEEE, 1--10 . Zhipeng Wu and K. Aizawa. 2013. PicWall: Photo collage on-the-fly. In Proceedings of the 2013 Asia -- Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA). IEEE, 1--10."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.4304\/jmm.9.1.4-13"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-009-0346-0"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.106"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2801126","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2801126","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T05:07:13Z","timestamp":1750223233000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2801126"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,8,24]]},"references-count":41,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2015,8,24]]}},"alternative-id":["10.1145\/2801126"],"URL":"https:\/\/doi.org\/10.1145\/2801126","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2015,8,24]]},"assertion":[{"value":"2014-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-08-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}