{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T03:21:24Z","timestamp":1740108084614,"version":"3.37.3"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"19","license":[{"start":{"date-parts":[[2023,3,24]],"date-time":"2023-03-24T00:00:00Z","timestamp":1679616000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,24]],"date-time":"2023-03-24T00:00:00Z","timestamp":1679616000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Royal Melbourne Institute of Technology"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Comput &amp; Applic"],"published-print":{"date-parts":[[2023,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Nowadays, in a communicating society, fashion is an integral part of a human life, and it is more comfortable and confident when people dress well. Outfit compatibility is not only a combination of different items but also regarding various aspects, such as style, user preferences, and specific occasions. Most of the existing works lead to address the outfit compatibility concerning only style or user preferences, and have no regard for occasions. In this paper, we propose an efficient method for both outfit compatibility and the fill-in-the-blank tasks according to specific occasions. To this end, we utilized an auxiliary classification branch to learn the significantly important features regarding specific occasions. Besides, a sequence to sequence approach is also applied to learn the relationship of different items along with a visual semantic space, which is able to learn the connection between visual features and their semantic presentation. To demonstrate the effectiveness of the proposed method, we conduct experiments on our newly collected Shoplook-Occasion dataset. The experimental results indicate that our proposed method improved the AUC metric from 0.02 to 0.15% and from 0.5 to 4% on accuracy, compared with other approaches for outfit compatibility problem conditioning on specific occasions.<\/jats:p>","DOI":"10.1007\/s00521-023-08431-1","type":"journal-article","created":{"date-parts":[[2023,3,24]],"date-time":"2023-03-24T20:03:01Z","timestamp":1679688181000},"page":"14213-14226","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["An efficient framework for outfit compatibility prediction towards occasion"],"prefix":"10.1007","volume":"35","author":[{"given":"Anh H.","family":"Vo","sequence":"first","affiliation":[]},{"given":"Tung B. T.","family":"Le","sequence":"additional","affiliation":[]},{"given":"Huy V.","family":"Pham","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8341-7319","authenticated-orcid":false,"given":"Bao T.","family":"Nguyen","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,3,24]]},"reference":[{"key":"8431_CR1","doi-asserted-by":"crossref","unstructured":"Al-Halah Z, Stiefelhagen R, Grauman K (2017) Fashion forward: Forecasting visual style in fashion. CoRR","DOI":"10.1109\/ICCV.2017.50"},{"key":"8431_CR2","unstructured":"Bao NT, Prakash O, Vo AH (2020) Attention Mechanism for Fashion Image Captioning. In: Advances in Intelligent Systems and Computing"},{"key":"8431_CR3","doi-asserted-by":"publisher","unstructured":"Bourdev L, Maji S, Malik J (2011) Describing people: a poselet-based approach to attribute classification. pp 1543\u20131550, https:\/\/doi.org\/10.1109\/ICCV.2011.6126413","DOI":"10.1109\/ICCV.2011.6126413"},{"key":"8431_CR4","doi-asserted-by":"crossref","unstructured":"Choi S, Park S, Lee M, et\u00a0al (2021) Viton-hd: High-resolution virtual try-on via misalignment-aware normalization. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 14,131\u201314, 140","DOI":"10.1109\/CVPR46437.2021.01391"},{"key":"8431_CR5","doi-asserted-by":"crossref","unstructured":"Cucurull G, Taslakian P, Vazquez D (2019) Context-aware visual compatibility prediction. In: The IEEE conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR.2019.01290"},{"key":"8431_CR6","doi-asserted-by":"publisher","unstructured":"Cui Z, Li Z, Wu S, et\u00a0al (2019) Dressing as a whole: Outfit compatibility learning based on node-wise graph neural networks. In: The world wide web conference. ACM, New York, NY, USA, WWW \u201919, pp 307\u2013317, https:\/\/doi.org\/10.1145\/3308558.3313444","DOI":"10.1145\/3308558.3313444"},{"issue":"3","key":"8431_CR7","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1080\/19312458.2021.2020229","volume":"16","author":"N Duran","year":"2022","unstructured":"Duran N, Battle S, Smith J (2022) Inter-annotator agreement using the conversation analysis modelling schema, for dialogue. Commun Methods Meas 16(3):182\u2013214. https:\/\/doi.org\/10.1080\/19312458.2021.2020229","journal-title":"Commun Methods Meas"},{"key":"8431_CR8","doi-asserted-by":"crossref","unstructured":"Ge Y, Song Y, Zhang R, et\u00a0al (2021) Parser-free virtual try-on via distilling appearance flows. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 8485\u20138493","DOI":"10.1109\/CVPR46437.2021.00838"},{"key":"8431_CR9","doi-asserted-by":"crossref","unstructured":"Han X, Wu Z, Jiang Y, et\u00a0al (2017) Learning fashion compatibility with bidirectional lstms. MM\u201917","DOI":"10.1145\/3123266.3123394"},{"key":"8431_CR10","doi-asserted-by":"crossref","unstructured":"Han X, Wu Z, Wu Z, et\u00a0al (2018) Viton: an image-based virtual try-on network. In: CVPR","DOI":"10.1109\/CVPR.2018.00787"},{"key":"8431_CR11","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, et\u00a0al (2016) Deep residual learning for image recognition. In: 2016 IEEE Conference on computer vision and pattern recognition (CVPR), pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"8431_CR12","doi-asserted-by":"crossref","unstructured":"Hou Y, Vig E, Donoser M, et\u00a0al (2021) Learning attribute-driven disentangled representations for interactive fashion retrieval. In: Proceedings of the IEEE\/CVF international conference on computer vision (ICCV), pp 12,147\u201312,157","DOI":"10.1109\/ICCV48922.2021.01193"},{"key":"8431_CR13","doi-asserted-by":"crossref","unstructured":"Hsiao W, Grauman K (2017) Learning the latent \u2019look\u2019: unsupervised discovery of a style-coherent embedding from fashion images. In: IEEE International conference on computer vision (ICCV)","DOI":"10.1109\/ICCV.2017.451"},{"key":"8431_CR14","doi-asserted-by":"crossref","unstructured":"Hsiao W, Grauman K (2018) Creating capsule wardrobes from fashion images. In: 2018 IEEE Conference on computer vision and pattern recognition. IEEE Computer Society, pp 7161\u20137170","DOI":"10.1109\/CVPR.2018.00748"},{"key":"8431_CR15","doi-asserted-by":"crossref","unstructured":"Hu Y, Yi X, Davis LS (2015) Collaborative fashion recommendation: a functional tensor factorization approach. In: ACM Multimedia. ACM, pp 129\u2013138","DOI":"10.1145\/2733373.2806239"},{"key":"8431_CR16","unstructured":"Klein B, Lev G, Sadeh G, et\u00a0al (2014) Fisher vectors derived from hybrid gaussian-laplacian mixture models for image annotation. CoRR arXiv:abs\/1411.7399"},{"key":"8431_CR17","unstructured":"Lai JH, Wu B, Wang X, et\u00a0al (2019) Theme-matters: fashion compatibility learning via theme attention"},{"key":"8431_CR18","doi-asserted-by":"crossref","unstructured":"Li K, Chong MJ, Zhang J, et\u00a0al (2021) Toward accurate and realistic outfits visualization with attention to details. In: Proceedings of the IEEE\/CVF Conference on computer vision and pattern recognition (CVPR), pp 15,546\u201315,555","DOI":"10.1109\/CVPR46437.2021.01529"},{"key":"8431_CR19","doi-asserted-by":"publisher","first-page":"141,814","DOI":"10.1109\/ACCESS.2020.3013639","volume":"8","author":"W Li","year":"2020","unstructured":"Li W, Xu B (2020) Aspect-based fashion recommendation with attention mechanism. IEEE Access 8:141,814-141,823","journal-title":"IEEE Access"},{"key":"8431_CR20","doi-asserted-by":"crossref","unstructured":"Li Y, Cao L, Zhu J, et\u00a0al (2017) Mining fashion outfit composition using an end-to-end deep learning approach on set data. In: IEEE Transactions on multimedia, pp 1946\u20131955","DOI":"10.1109\/TMM.2017.2690144"},{"key":"8431_CR21","doi-asserted-by":"crossref","unstructured":"Lin Y, Ren P, Chen Z, et\u00a0al (2019) Explainable outfit recommendation with joint outfit matching and comment generation. IEEE Transactions on knowledge and data engineering","DOI":"10.1109\/TKDE.2019.2906190"},{"key":"8431_CR22","doi-asserted-by":"crossref","unstructured":"Lin Y, Tran SD, Davis LS (2020) Fashion outfit complementary item retrieval. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 3311\u20133319","DOI":"10.1109\/CVPR42600.2020.00337"},{"key":"8431_CR23","doi-asserted-by":"crossref","unstructured":"Liu J, Lu H (2018) Deep fashion analysis with feature map upsampling and landmark-driven attention. In: European conference on computer vision, Springer, pp 30\u201336","DOI":"10.1007\/978-3-030-11015-4_4"},{"key":"8431_CR24","doi-asserted-by":"crossref","unstructured":"Liu S, Feng J, Song Z, et\u00a0al (2012a) Hi, magic closet, tell me what to wear! In: Proceedings of the ACM international conference on multimedia pp 619-628","DOI":"10.1145\/2393347.2393433"},{"key":"8431_CR25","doi-asserted-by":"publisher","unstructured":"Liu S, Nguyen T, Feng J, et\u00a0al (2012b) Hi, magic closet, tell me what to wear! pp 1333\u20131334, https:\/\/doi.org\/10.1145\/2393347.2396470","DOI":"10.1145\/2393347.2396470"},{"key":"8431_CR26","doi-asserted-by":"publisher","unstructured":"Liu Z, Luo P, Qiu S, et\u00a0al (2016) Deepfashion: Powering robust clothes recognition and retrieval with rich annotations. pp 1096\u20131104, https:\/\/doi.org\/10.1109\/CVPR.2016.124","DOI":"10.1109\/CVPR.2016.124"},{"issue":"3","key":"8431_CR27","doi-asserted-by":"publisher","first-page":"1087","DOI":"10.1007\/s10618-021-00744-w","volume":"35","author":"C Lonjarret","year":"2021","unstructured":"Lonjarret C, Auburtin R, Robardet C et al (2021) Aspect-based fashion recommendation with attention mechanism. Data Min Knowl Disc 35(3):1087\u20131133","journal-title":"Data Min Knowl Disc"},{"key":"8431_CR28","doi-asserted-by":"crossref","unstructured":"Lu Z, Hu Y, Jiang Y, et\u00a0al (2019) Learning binary code for personalized fashion recommendation. In: CVPR","DOI":"10.1109\/CVPR.2019.01081"},{"key":"8431_CR29","doi-asserted-by":"crossref","unstructured":"Lu Z, Hu Y, Chen Y, et\u00a0al (2021) Personalized outfit recommendation with learnable anchors. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 12,722\u201312,731","DOI":"10.1109\/CVPR46437.2021.01253"},{"key":"8431_CR30","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.115386","volume":"183","author":"C Panagiotakis","year":"2021","unstructured":"Panagiotakis C, Papadakis H, Papagrigoriou A et al (2021) Improving recommender systems via a dual training error based correction approach. Expert Syst Appl 183:115386","journal-title":"Expert Syst Appl"},{"key":"8431_CR31","doi-asserted-by":"crossref","unstructured":"Pennington J, Socher R, Manning CD (2014) Glove: global vectors for word representation. In: In EMNLP","DOI":"10.3115\/v1\/D14-1162"},{"key":"8431_CR32","doi-asserted-by":"crossref","unstructured":"Sbai O, Elhoseiny M, Bordes A, et\u00a0al (2018) Design: design inspiration from generative networks. In: Proceedings of the European conference on computer vision (ECCV)","DOI":"10.1007\/978-3-030-11015-4_5"},{"key":"8431_CR33","doi-asserted-by":"crossref","unstructured":"Simo-Serra E, Ishikawa H (2016) Fashion Style in 128 Floats: joint ranking and classification using weak data for feature extraction. In: Proceedings of the conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR.2016.39"},{"key":"8431_CR34","doi-asserted-by":"crossref","unstructured":"Song X, Feng F, Liu J, et\u00a0al (2017) Neurostylist: neuro compatibility modeling for clothing matching. In: Proceedings of the 2017 ACM on multimedia conference, pp 753\u2013761","DOI":"10.1145\/3123266.3123314"},{"key":"8431_CR35","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1016\/j.patrec.2021.04.009","volume":"147","author":"LX Sufang","year":"2021","unstructured":"Sufang LX, Zhu Y et al (2021) Outfit compatibility prediction with multi-layered feature fusion network. Pattern Recogn Lett 147:150\u2013156","journal-title":"Pattern Recogn Lett"},{"key":"8431_CR36","doi-asserted-by":"crossref","unstructured":"Szegedy C, Vanhoucke V, Ioffe S, et\u00a0al (2016) Rethinking the inception architecture for computer vision. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 2818\u20132826","DOI":"10.1109\/CVPR.2016.308"},{"key":"8431_CR37","doi-asserted-by":"crossref","unstructured":"Takagi M, Simo-Serra E, Iizuka S, et\u00a0al (2017) What makes a style: experimental analysis of fashion prediction. In: The IEEE international conference on computer vision (ICCV) Workshops","DOI":"10.1109\/ICCVW.2017.263"},{"key":"8431_CR38","doi-asserted-by":"crossref","unstructured":"Tan R, Vasileva MI, Saenko K, et\u00a0al (2019) Learning similarity conditions without explicit supervision. In: ICCV","DOI":"10.1109\/ICCV.2019.01047"},{"key":"8431_CR39","doi-asserted-by":"crossref","unstructured":"Tangseng P, Okatani T (2020) Toward explainable fashion recommendation. In: Proceedings of the IEEE winter conference on applications of computer vision (WACV), pp 3311\u20133319","DOI":"10.1109\/WACV45572.2020.9093367"},{"key":"8431_CR40","doi-asserted-by":"crossref","unstructured":"Tangseng P, Yamaguchi K, Okatani T (2017) Recommending outfits from personal closet. In ICCV","DOI":"10.1109\/ICCVW.2017.267"},{"key":"8431_CR41","doi-asserted-by":"crossref","unstructured":"Vasileva MI, Plummer BA, Dusad K, et\u00a0al (2018) Learning type-aware embeddings for fashion compatibility. CoRR arXiv:abs\/1803.09196","DOI":"10.1007\/978-3-030-01270-0_24"},{"key":"8431_CR42","doi-asserted-by":"crossref","unstructured":"Veit A, Kovacs B, Bell S, et\u00a0al (2015) Learning visual clothing style with heterogeneous dyadic co-occurrences. In: International conference on computer vision (ICCV), Santiago, Chile","DOI":"10.1109\/ICCV.2015.527"},{"key":"8431_CR43","doi-asserted-by":"crossref","unstructured":"Veit A, Belongie S, Karaletsos T (2017) Conditional similarity networks. In: 2017 IEEE Conference on computer vision and pattern recognition (CVPR), pp 1781\u20131789","DOI":"10.1109\/CVPR.2017.193"},{"key":"8431_CR44","doi-asserted-by":"crossref","unstructured":"Wang W, Xu Y, Shen J, et\u00a0al (2018) Attentive fashion grammar network for fashion landmark detection and clothing category classification. In: IEEE Conference on computer vision and pattern recognition, CVPR 2018. IEEE Computer Society, pp 4271\u20134280","DOI":"10.1109\/CVPR.2018.00449"},{"key":"8431_CR45","unstructured":"Weinberger KQ, Blitzer J, Saul LK (2006) Distance metric learning for large margin nearest neighbor classification. In: Weiss Y, Sch\u00f6lkopf B, Platt JC (eds) advances in neural information processing systems 18. MIT Press, pp 1473\u20131480"},{"key":"8431_CR46","doi-asserted-by":"crossref","unstructured":"Yu C, Hu Y, Chen Y, et\u00a0al (2019) Personalized fashion design. In: The IEEE International conference on computer vision (ICCV)","DOI":"10.1109\/ICCV.2019.00914"},{"key":"8431_CR47","doi-asserted-by":"crossref","unstructured":"Zhang S, Song Z, Cao X et al.(2020) Task-aware attention model for clothing attribute prediction. IEEE Trans Circuits Syst Video Technol 30(4):1051-64","DOI":"10.1109\/TCSVT.2019.2902268"}],"container-title":["Neural Computing and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-023-08431-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00521-023-08431-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-023-08431-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,24]],"date-time":"2023-05-24T18:11:01Z","timestamp":1684951861000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00521-023-08431-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,24]]},"references-count":47,"journal-issue":{"issue":"19","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["8431"],"URL":"https:\/\/doi.org\/10.1007\/s00521-023-08431-1","relation":{},"ISSN":["0941-0643","1433-3058"],"issn-type":[{"type":"print","value":"0941-0643"},{"type":"electronic","value":"1433-3058"}],"subject":[],"published":{"date-parts":[[2023,3,24]]},"assertion":[{"value":"4 November 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 February 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 March 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}