{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T15:14:57Z","timestamp":1770045297453,"version":"3.49.0"},"reference-count":35,"publisher":"SAGE Publications","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IFS"],"published-print":{"date-parts":[[2021,12,16]]},"abstract":"<jats:p>With the trend of people expressing opinions and emotions via images online, increasing attention has been paid to affective analysis of visual content. Traditional image affective analysis mainly focuses on single-label classification, but an image usually evokes multiple emotions. To this end, emotion distribution learning is proposed to describe emotions more explicitly. However, most current studies ignore the ambiguity included in emotions and the elusive correlations with complex visual features. Considering that emotions evoked by images are delivered through various visual features, and each feature in the image may have multiple emotion attributes, this paper develops a novel model that extracts multiple features and proposes an enhanced fuzzy k-nearest neighbor (EFKNN) to calculate the fuzzy emotional memberships. Specifically, the multiple visual features are converted into fuzzy emotional memberships of each feature belonging to emotion classes, which can be regarded as an intermediate representation to bridge the affective gap. Then, the fuzzy emotional memberships are fed into a fully connected neural network to learn the relationships between the fuzzy memberships and image emotion distributions. To obtain the fuzzy memberships of test images, a novel sparse learning method is introduced by learning the combination coefficients of test images and training images. Extensive experimental results on several datasets verify the superiority of our proposed approach for emotion distribution learning of images.<\/jats:p>","DOI":"10.3233\/jifs-210251","type":"journal-article","created":{"date-parts":[[2021,10,29]],"date-time":"2021-10-29T11:38:52Z","timestamp":1635507532000},"page":"6443-6460","source":"Crossref","is-referenced-by-count":2,"title":["Image emotion distribution learning based on enhanced fuzzy KNN algorithm with sparse learning"],"prefix":"10.1177","volume":"41","author":[{"given":"Yunwen","family":"Zhu","sequence":"first","affiliation":[{"name":"Shanghai Film Academy, Shanghai University, Shanghai, China"}]},{"given":"Wenjun","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Information Technology, Shanghai Jian Qiao University, Shanghai, China"}]},{"given":"Meixian","family":"Zhang","sequence":"additional","affiliation":[{"name":"Shanghai Film Academy, Shanghai University, Shanghai, China"}]},{"given":"Ke","family":"Zhang","sequence":"additional","affiliation":[{"name":"Shanghai Film Academy, Shanghai University, Shanghai, China"}]},{"given":"Yonghua","family":"Zhu","sequence":"additional","affiliation":[{"name":"Shanghai Film Academy, Shanghai University, Shanghai, China"}]}],"member":"179","reference":[{"key":"10.3233\/JIFS-210251_ref1","doi-asserted-by":"crossref","first-page":"3218","DOI":"10.1109\/TCYB.2017.2762344","article-title":"Real-Time Multimedia Social Event Detection in Microblog","volume":"48","author":"Zhao","year":"2018","journal-title":"IEEE Transations on Cybernetics"},{"key":"10.3233\/JIFS-210251_ref2","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.neunet.2017.01.013","article-title":"Prediction of advertisement preference by fusing EEG response and sentiment analysis","volume":"92","author":"Gauba","year":"2017","journal-title":"Neural Networks"},{"key":"10.3233\/JIFS-210251_ref7","doi-asserted-by":"crossref","first-page":"632","DOI":"10.1109\/TMM.2016.2617741","article-title":"Continuous Probability Distribution Prediction of Image Emotions via Multitask Shared Sparse Regression","volume":"19","author":"Zhao","year":"2017","journal-title":"Ieee Transactions on Multimedia"},{"key":"10.3233\/JIFS-210251_ref8","doi-asserted-by":"crossref","unstructured":"Zhao S. , Ding G. , Gao Y. and Han J.J.T. , Approximating discrete probability distribution of image emotions by multi-modal features fusion, 1000 (2017), 4669\u20134675.","DOI":"10.24963\/ijcai.2017\/651"},{"key":"10.3233\/JIFS-210251_ref9","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1109\/MSP.2006.1621452","article-title":"Extracting moods from pictures and sounds","volume":"23","author":"Hanjalic","year":"2006","journal-title":"IEEE Signal Processing Magazine"},{"key":"10.3233\/JIFS-210251_ref14","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1109\/TMM.2019.2928998","article-title":"Exploring Discriminative Representations for Image Emotion Recognition With CNNs","volume":"22","author":"Zhang","year":"2020","journal-title":"IEEE Transactions on Multimedia"},{"key":"10.3233\/JIFS-210251_ref15","doi-asserted-by":"crossref","first-page":"2043","DOI":"10.1007\/s11063-019-10033-9","article-title":"Learning Multi-level Deep Representations for Image Emotion Classification","volume":"51","author":"Rao","year":"2020","journal-title":"Neural Processing Letters"},{"key":"10.3233\/JIFS-210251_ref19","doi-asserted-by":"crossref","first-page":"526","DOI":"10.1109\/TAFFC.2016.2628787","article-title":"Predicting Personalized Image Emotion Perceptions in Social Networks","volume":"9","author":"Zhao","year":"2018","journal-title":"IEEE Transactions on Affective Computing"},{"key":"10.3233\/JIFS-210251_ref20","doi-asserted-by":"crossref","first-page":"2140","DOI":"10.1016\/j.sigpro.2012.06.026","article-title":"Hierarchical affective content analysis in arousal and valence dimensions","volume":"93","author":"Xu","year":"2013","journal-title":"Signal Processing"},{"key":"10.3233\/JIFS-210251_ref21","doi-asserted-by":"crossref","unstructured":"Zhou F. , Cao C. , Zhong T. and Geng J. , Learning meta-knowledge for few-shot image emotion recognition, Expert Systems with Applications 168 (2021).","DOI":"10.1016\/j.eswa.2020.114274"},{"key":"10.3233\/JIFS-210251_ref22","doi-asserted-by":"crossref","first-page":"1734","DOI":"10.1109\/TKDE.2016.2545658","article-title":"Label distribution learning","volume":"28","author":"Xin","year":"2016","journal-title":"IEEE Transactions on Knowledge Data Engineering"},{"key":"10.3233\/JIFS-210251_ref23","doi-asserted-by":"crossref","first-page":"2401","DOI":"10.1109\/TPAMI.2013.51","article-title":"Facial age estimation by learning from label distributions","volume":"35","author":"Geng","year":"2013","journal-title":"IEEE Transations Pattern Analysis and Machine Intelligence"},{"key":"10.3233\/JIFS-210251_ref27","doi-asserted-by":"crossref","first-page":"129997","DOI":"10.1109\/ACCESS.2019.2939681","article-title":"Predicting Image Emotion Distribution by Learning Labels\u2019 Correlation","volume":"7","author":"Fan","year":"2019","journal-title":"IEEE Access"},{"key":"10.3233\/JIFS-210251_ref29","doi-asserted-by":"crossref","first-page":"576","DOI":"10.1016\/j.jvcir.2018.12.032","article-title":"Affective image classification by jointly using interpretable art features and semantic annotations","volume":"58","author":"Liu","year":"2019","journal-title":"Journal of Visual Communication and Image Representation"},{"key":"10.3233\/JIFS-210251_ref30","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/j.fss.2015.05.009","article-title":"Fuzzy logic-a personal perspective","volume":"281","author":"Zadeh","year":"2015","journal-title":"Fuzzy Sets and Systems"},{"key":"10.3233\/JIFS-210251_ref31","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1109\/TCSS.2019.2892037","article-title":"A Fuzzy Approach to Text Classification With Two-Stage Training for Ambiguous Instances","volume":"6","author":"Liu","year":"2019","journal-title":"IEEE Transactions on Computational Social Systems"},{"key":"10.3233\/JIFS-210251_ref32","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.asoc.2013.11.009","article-title":"Medical diagnosis of cardiovascular diseases using an interval-valued fuzzy rule-based classification system","volume":"20","author":"Antonio Sanz","year":"2014","journal-title":"Applied Soft Computing"},{"key":"10.3233\/JIFS-210251_ref33","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-020-05498-y"},{"key":"10.3233\/JIFS-210251_ref34","doi-asserted-by":"crossref","first-page":"560","DOI":"10.1016\/j.neucom.2014.04.008","article-title":"Emotion recognition based on 3D fuzzy visual and EEG features in movie clips","volume":"144","author":"Lee","year":"2014","journal-title":"Neurocomputing"},{"key":"10.3233\/JIFS-210251_ref35","doi-asserted-by":"crossref","unstructured":"Cao J. and Chen L. , Fuzzy Emotional Semantic Analysis and Automated Annotation of Scene Images, Computational Intelligence and Neuroscience 2015 (2015).","DOI":"10.1155\/2015\/971039"},{"key":"10.3233\/JIFS-210251_ref36","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1016\/j.neunet.2019.06.010","article-title":"A multimodal convolutional neuro-fuzzy network for emotion understanding of movie clips","volume":"118","author":"Nguyen","year":"2019","journal-title":"Neural Networks"},{"key":"10.3233\/JIFS-210251_ref37","doi-asserted-by":"crossref","first-page":"1008","DOI":"10.1109\/TFUZZ.2008.917287","article-title":"Fuzzy Clustering With Partial Supervision in Organization and Classification of Digital Images","volume":"16","author":"Pedrycz","year":"2008","journal-title":"IEEE Transactions on Fuzzy Systems"},{"key":"10.3233\/JIFS-210251_ref38","doi-asserted-by":"crossref","first-page":"35","DOI":"10.5121\/ijci.2014.3204","article-title":"Possibility Fuzzy C-Means Clustering For Expression Invariant Face Recognization","volume":"3","author":"Bhat","year":"2014","journal-title":"International Journal on Cybernetics & Infomational (IJCI)"},{"key":"10.3233\/JIFS-210251_ref39","doi-asserted-by":"crossref","first-page":"580","DOI":"10.1109\/TSMC.1985.6313426","article-title":"man, A fuzzyk-nearest neighbor algorithm","volume":"SMC-15","author":"Keller","year":"1985","journal-title":"IEEE Transactions on Systems Man & Cybernetics"},{"key":"10.3233\/JIFS-210251_ref40","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/TIT.1967.1053964","article-title":"Nearest neighbor pattern classification","volume":"13","author":"Cover","year":"1967","journal-title":"IEEE Transactions on Information Theory"},{"key":"10.3233\/JIFS-210251_ref41","doi-asserted-by":"crossref","first-page":"21853","DOI":"10.1007\/s11042-019-7498-3","article-title":"An adaptive fuzzy K-nearest neighbor approach for MR brain tumor image classification using parameter free bat optimization algorithm","volume":"78","author":"Kaur","year":"2019","journal-title":"Multimedia Tools and Applications"},{"key":"10.3233\/JIFS-210251_ref44","doi-asserted-by":"crossref","first-page":"1576","DOI":"10.1109\/TPAMI.2011.253","article-title":"Learning sparse representations for human action recognition","volume":"34","author":"Guha","year":"2012","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"10.3233\/JIFS-210251_ref46","first-page":"942","article-title":"Robust Face Recognition via Sparse Representation","volume":"31","author":"Wright","year":"2008","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"10.3233\/JIFS-210251_ref47","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1109\/TAFFC.2018.2818685","article-title":"Discrete Probability Distribution Prediction of Image Emotions with Shared Sparse Learning","volume":"11","author":"Zhao","year":"2020","journal-title":"IEEE Transactions on Affective Computing"},{"key":"10.3233\/JIFS-210251_ref48","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/0169-7439(87)80084-9","article-title":"Principal component analysis","volume":"2","author":"Wold","year":"1987","journal-title":"Chemometrics Intelligent Laboratory Systems"},{"key":"10.3233\/JIFS-210251_ref49","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1023\/A:1026543900054","article-title":"The Earth Mover\u2019s Distance as a metric for image retrieval","volume":"40","author":"Rubner","year":"2000","journal-title":"International Journal of Computer Vision"},{"key":"10.3233\/JIFS-210251_ref50","doi-asserted-by":"crossref","first-page":"4349","DOI":"10.1109\/TIP.2012.2205006","article-title":"Visual classification with multitask joint sparse representation","volume":"21","author":"Yuan","year":"2012","journal-title":"IEEE Transations Image Processing"},{"key":"10.3233\/JIFS-210251_ref52","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1109\/78.738251","article-title":"An affine scaling methodology for best basis selection","volume":"47","author":"Rao","year":"1999","journal-title":"IEEE Transactions on Signal Processing"},{"key":"10.3233\/JIFS-210251_ref53","doi-asserted-by":"crossref","first-page":"2825","DOI":"10.1109\/TIP.2017.2689998","article-title":"Deep Label Distribution Learning With Label Ambiguity","volume":"26","author":"Gao","year":"2017","journal-title":"IEEE Transations Image Processing"},{"key":"10.3233\/JIFS-210251_ref54","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Communications of the ACM"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/JIFS-210251","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T03:24:17Z","timestamp":1770002657000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/JIFS-210251"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,16]]},"references-count":35,"journal-issue":{"issue":"6"},"URL":"https:\/\/doi.org\/10.3233\/jifs-210251","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,16]]}}}