{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T14:23:39Z","timestamp":1775744619852,"version":"3.50.1"},"reference-count":90,"publisher":"World Scientific Pub Co Pte Ltd","issue":"06","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["NSFC 62071314"],"award-info":[{"award-number":["NSFC 62071314"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Sichuan Science and Technology Program","award":["2023YFG0263, 2023NSFSC0497"],"award-info":[{"award-number":["2023YFG0263, 2023NSFSC0497"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Neur. Syst."],"published-print":{"date-parts":[[2023,6]]},"abstract":"<jats:p> Facial expression recognition (FER) plays a vital role in the field of human-computer interaction. To achieve automatic FER, various approaches based on deep learning (DL) have been presented. However, most of them lack for the extraction of discriminative expression semantic information and suffer from the problem of annotation ambiguity. In this paper, we propose an elaborately designed end-to-end recognition network with contrastive learning and uncertainty-guided relabeling, to recognize facial expressions efficiently and accurately, as well as to alleviate the impact of annotation ambiguity. Specifically, a supervised contrastive loss (SCL) is introduced to promote inter-class separability and intra-class compactness, thus helping the network extract fine-grained discriminative expression features. As for the annotation ambiguity problem, we present an uncertainty estimation-based relabeling module (UERM) to estimate the uncertainty of each sample and relabel the unreliable ones. In addition, to deal with the padding erosion problem, we embed an amending representation module (ARM) into the recognition network. Experimental results on three public benchmarks demonstrate that our proposed method facilitates the recognition performance remarkably with 90.91% on RAF-DB, 88.59% on FERPlus and 61.00% on AffectNet, outperforming current state-of-the-art (SOTA) FER methods. Code will be available at http\/\/github.com\/xiaohu-run\/fer_supCon . <\/jats:p>","DOI":"10.1142\/s0129065723500326","type":"journal-article","created":{"date-parts":[[2023,4,10]],"date-time":"2023-04-10T06:32:25Z","timestamp":1681108345000},"source":"Crossref","is-referenced-by-count":15,"title":["Facial Expression Recognition with Contrastive Learning and Uncertainty-Guided Relabeling"],"prefix":"10.1142","volume":"33","author":[{"given":"Yujie","family":"Yang","sequence":"first","affiliation":[{"name":"School of Computer Science, Sichuan University, Chengdu, P. R. China"}]},{"given":"Lin","family":"Hu","sequence":"additional","affiliation":[{"name":"School of Computer Science, Sichuan University, Chengdu, P. R. China"}]},{"given":"Chen","family":"Zu","sequence":"additional","affiliation":[{"name":"Risk Controlling Research Department, JD.com, Chengdu, P. R. China"}]},{"given":"Qizheng","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Applied Mathematics, New York State Stony Brook University, New York, USA"}]},{"given":"Xi","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Computer Science, Chengdu University of Information Technology, Chengdu, P. R. China"}]},{"given":"Jiliu","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Computer Science, Sichuan University, Chengdu, P. R. China"}]},{"given":"Yan","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science, Sichuan University, Chengdu, P. R. China"}]}],"member":"219","published-online":{"date-parts":[[2023,5,16]]},"reference":[{"issue":"2","key":"S0129065723500326BIB001","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1109\/34.908962","volume":"23","author":"Tian Y.-I.","year":"2001","journal-title":"IEEE Trans. Pattern Analysis and Machine Intelligence"},{"issue":"3","key":"S0129065723500326BIB002","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.1109\/TAFFC.2020.2981446","volume":"13","author":"Li S.","year":"2020","journal-title":"IEEE Trans. Affective Computing."},{"key":"S0129065723500326BIB003","doi-asserted-by":"crossref","first-page":"2250029","DOI":"10.1142\/S0129065722500290","author":"Vicente-Querol M. A.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"2","key":"S0129065723500326BIB004","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1037\/h0030377","volume":"17","author":"Ekman P.","year":"1971","journal-title":"J. Pers. Soc. Psychol."},{"issue":"4","key":"S0129065723500326BIB005","doi-asserted-by":"crossref","first-page":"4011","DOI":"10.1109\/LRA.2019.2930434","volume":"4","author":"Filntisis P. P.","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"S0129065723500326BIB006","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065720500689"},{"key":"S0129065723500326BIB007","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065721300011"},{"issue":"8","key":"S0129065723500326BIB008","doi-asserted-by":"crossref","first-page":"2150032","DOI":"10.1142\/S0129065721500325","volume":"31","author":"Lara-Ben\u00edtez P.","year":"2021","journal-title":"Int. J. Neural Syst."},{"key":"S0129065723500326BIB009","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065721500088"},{"key":"S0129065723500326BIB010","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065721500222"},{"key":"S0129065723500326BIB011","doi-asserted-by":"publisher","DOI":"10.1142\/S012906572150026X"},{"issue":"9","key":"S0129065723500326BIB012","doi-asserted-by":"crossref","first-page":"2150033","DOI":"10.1142\/S0129065721500337","volume":"31","author":"Amodeo M.","year":"2021","journal-title":"Int. J. Neural Syst."},{"key":"S0129065723500326BIB013","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065721500386"},{"key":"S0129065723500326BIB014","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065721500465"},{"key":"S0129065723500326BIB015","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065720500562"},{"issue":"1","key":"S0129065723500326BIB016","doi-asserted-by":"crossref","first-page":"2150055","DOI":"10.1142\/S0129065721500556","volume":"32","author":"Hu T.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"2","key":"S0129065723500326BIB017","doi-asserted-by":"crossref","first-page":"2150058","DOI":"10.1142\/S0129065721500581","volume":"32","author":"Bhattacharya A.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"5","key":"S0129065723500326BIB018","doi-asserted-by":"crossref","first-page":"2250021","DOI":"10.1142\/S0129065722500216","volume":"32","author":"Olamat A.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"6","key":"S0129065723500326BIB019","doi-asserted-by":"crossref","first-page":"2250024","DOI":"10.1142\/S0129065722500241","volume":"32","author":"De Lope J.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"7","key":"S0129065723500326BIB020","doi-asserted-by":"crossref","first-page":"2250032","DOI":"10.1142\/S0129065722500320","volume":"32","author":"Yu Z.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"9","key":"S0129065723500326BIB021","doi-asserted-by":"crossref","first-page":"2250039","DOI":"10.1142\/S0129065722500393","volume":"32","author":"Xu F.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"9","key":"S0129065723500326BIB022","doi-asserted-by":"crossref","first-page":"2250044","DOI":"10.1142\/S0129065722500447","volume":"32","author":"Li S.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"11","key":"S0129065723500326BIB023","doi-asserted-by":"crossref","first-page":"2250052","DOI":"10.1142\/S0129065722500526","volume":"32","author":"K\u00fc\u00e7\u00fcko\u011flu B.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"11","key":"S0129065723500326BIB024","doi-asserted-by":"crossref","first-page":"2250046","DOI":"10.1142\/S0129065722500460","volume":"32","author":"Ardakani H. A.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"4","key":"S0129065723500326BIB025","first-page":"1","volume":"29","author":"Demertzis K.","year":"2022","journal-title":"Integr. Comput.-Aided Eng. Preprint"},{"issue":"2","key":"S0129065723500326BIB026","doi-asserted-by":"crossref","first-page":"141","DOI":"10.3233\/ICA-210672","volume":"29","author":"Wu H.","year":"2022","journal-title":"Integr. Comput.-Aided Eng."},{"key":"S0129065723500326BIB027","doi-asserted-by":"crossref","first-page":"103196","DOI":"10.1016\/j.cad.2022.103196","volume":"146","author":"Song Y.","year":"2022","journal-title":"Comput.-Aided Des."},{"issue":"4","key":"S0129065723500326BIB028","doi-asserted-by":"crossref","first-page":"399","DOI":"10.3233\/ICA-210662","volume":"28","author":"Zotov E.","year":"2021","journal-title":"Integr. Comput.-Aided Eng."},{"key":"S0129065723500326BIB029","doi-asserted-by":"crossref","first-page":"102447","DOI":"10.1016\/j.media.2022.102447","volume":"79","author":"Wang K.","year":"2022","journal-title":"Med. Image Anal."},{"key":"S0129065723500326BIB030","doi-asserted-by":"crossref","first-page":"102339","DOI":"10.1016\/j.media.2021.102339","volume":"77","author":"Zhan B.","year":"2022","journal-title":"Med. Image Anal."},{"issue":"6","key":"S0129065723500326BIB031","doi-asserted-by":"crossref","first-page":"1328","DOI":"10.1109\/TMI.2018.2884053","volume":"38","author":"Wang Y.","year":"2018","journal-title":"IEEE Trans. Med. Imag."},{"key":"S0129065723500326BIB032","doi-asserted-by":"crossref","first-page":"108566","DOI":"10.1016\/j.patcog.2022.108566","volume":"126","author":"Shi Y.","year":"2022","journal-title":"Pattern Recognit."},{"key":"S0129065723500326BIB033","doi-asserted-by":"crossref","first-page":"108215","DOI":"10.1016\/j.knosys.2022.108215","volume":"241","author":"Tang P.","year":"2022","journal-title":"Knowl.-Based Syst."},{"issue":"1","key":"S0129065723500326BIB034","doi-asserted-by":"crossref","first-page":"2150042","DOI":"10.1142\/S0129065721500428","volume":"32","author":"Jodas D. S.","year":"2022","journal-title":"Int. J. Neural Syst."},{"key":"S0129065723500326BIB035","first-page":"2250059","author":"Wang J.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"9","key":"S0129065723500326BIB036","doi-asserted-by":"crossref","first-page":"2250043","DOI":"10.1142\/S0129065722500435","volume":"32","author":"Wang K.","year":"2022","journal-title":"Int. J. Neural Syst."},{"key":"S0129065723500326BIB037","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065722500162"},{"key":"S0129065723500326BIB038","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065720500537"},{"key":"S0129065723500326BIB039","first-page":"2350002","author":"Koutrintzes D.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"1","key":"S0129065723500326BIB041","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/TAFFC.2017.2740923","volume":"10","author":"Mollahosseini A.","year":"2017","journal-title":"IEEE Trans. Affect. Comput."},{"key":"S0129065723500326BIB042","first-page":"7660","volume-title":"Proc. IEEE\/CVF Conf. Computer Vision and Pattern Recognition","author":"Ruan D.","year":"2021"},{"key":"S0129065723500326BIB043","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.patrec.2020.01.016","volume":"131","author":"Yu M.","year":"2020","journal-title":"Pattern Recognit. Lett."},{"key":"S0129065723500326BIB044","first-page":"897","volume-title":"Asian Conf. Machine Learning, PMLR","author":"Li Y.","year":"2019"},{"key":"S0129065723500326BIB045","first-page":"6897","volume-title":"Proc. IEEE\/CVF Conf. Computer Vision and Pattern Recognition","author":"Wang K.","year":"2020"},{"key":"S0129065723500326BIB046","first-page":"6248","volume-title":"Proc. IEEE\/CVF Conf. Computer Vision and Pattern Recognition","author":"She J.","year":"2021"},{"key":"S0129065723500326BIB047","first-page":"222","volume-title":"Proc. European Conf. Computer Vision (ECCV)","author":"Zeng J.","year":"2018"},{"key":"S0129065723500326BIB048","first-page":"505","volume-title":"6th IEEE Int. Conf. Automatic Face and Gesture Recognition","author":"Bazzo J. J.","year":"2004"},{"key":"S0129065723500326BIB049","first-page":"926","volume-title":"Proc. 17th Int. Conf. Pattern Recognition","volume":"3","author":"Wang Y.","year":"2004"},{"key":"S0129065723500326BIB050","doi-asserted-by":"crossref","first-page":"1817","DOI":"10.1016\/j.egypro.2012.02.317","volume":"17","author":"Zhang L.","year":"2012","journal-title":"Energy Procedia"},{"key":"S0129065723500326BIB051","first-page":"3601","volume-title":"Proc. IEEE\/CVF Int. Conf. Computer Vision","author":"Xue F.","year":"2021"},{"key":"S0129065723500326BIB052","doi-asserted-by":"crossref","first-page":"4057","DOI":"10.1109\/TIP.2019.2956143","volume":"29","author":"Wang K.","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"S0129065723500326BIB053","first-page":"1","author":"Ruan D.","year":"2022","journal-title":"Int. J. Computer Vision"},{"key":"S0129065723500326BIB054","doi-asserted-by":"crossref","first-page":"109157","DOI":"10.1016\/j.patcog.2022.109157","volume":"135","author":"Sun Z.","year":"2023","journal-title":"Pattern Recognit."},{"key":"S0129065723500326BIB055","doi-asserted-by":"crossref","first-page":"109997","DOI":"10.1016\/j.asoc.2023.109997","author":"Hossain S.","year":"2023","journal-title":"Appl. Soft Comput."},{"issue":"1","key":"S0129065723500326BIB056","volume":"35","author":"Kavitha M. N.","year":"2023","journal-title":"Intell. Autom. Soft Comput."},{"key":"S0129065723500326BIB057","author":"Jiang C. S.","year":"2023","journal-title":"IEEE Trans. Ind. Inf."},{"key":"S0129065723500326BIB058","author":"Li C.","year":"2023","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"S0129065723500326BIB059","doi-asserted-by":"crossref","first-page":"106621","DOI":"10.1016\/j.cmpb.2022.106621","volume":"215","author":"Ge H.","year":"2022","journal-title":"Comput. Methods Prog. Biomed."},{"key":"S0129065723500326BIB060","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065721500131"},{"issue":"3","key":"S0129065723500326BIB061","doi-asserted-by":"crossref","first-page":"2250005","DOI":"10.1142\/S0129065722500058","volume":"32","author":"Cai Z.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"5","key":"S0129065723500326BIB062","doi-asserted-by":"crossref","first-page":"2250021","DOI":"10.1142\/S0129065722500216","volume":"32","author":"Olamat A.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"10","key":"S0129065723500326BIB063","doi-asserted-by":"crossref","first-page":"2250026","DOI":"10.1142\/S0129065722500265","volume":"32","author":"Garc\u00eda-Mart\u00ednez B.","year":"2022","journal-title":"Int. J. Neural Syst."},{"issue":"10","key":"S0129065723500326BIB064","doi-asserted-by":"crossref","first-page":"2250041","DOI":"10.1142\/S0129065722500411","volume":"32","author":"Sanchez-Reolid R.","year":"2022","journal-title":"Int. J. Neural Syst."},{"key":"S0129065723500326BIB065","doi-asserted-by":"crossref","first-page":"102447","DOI":"10.1016\/j.media.2022.102447","volume":"79","author":"Wang K.","year":"2022","journal-title":"Med. Image Anal."},{"key":"S0129065723500326BIB066","first-page":"9912","volume":"33","author":"Caron M.","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"S0129065723500326BIB067","first-page":"9729","volume-title":"Proc. IEEE\/CVF Conf. Computer Vision and Pattern Recognition","author":"He K.","year":"2020"},{"key":"S0129065723500326BIB068","first-page":"1597","volume-title":"Int. Conf. Machine Learning, PMLR","author":"Chen T.","year":"2020"},{"key":"S0129065723500326BIB069","first-page":"21271","volume":"33","author":"Grill J. B.","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"S0129065723500326BIB071","first-page":"22243","volume":"33","author":"Chen T.","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"S0129065723500326BIB072","first-page":"18661","volume":"33","author":"Khosla P.","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"S0129065723500326BIB073","doi-asserted-by":"crossref","first-page":"106771","DOI":"10.1016\/j.knosys.2021.106771","volume":"215","author":"Algan G.","year":"2021","journal-title":"Knowl. Based Syst."},{"key":"S0129065723500326BIB074","first-page":"39","volume-title":"2018 IEEE 15th Int. Symp. Biomedical Imaging (ISBI 2018)","author":"Dgani Y.","year":"2018"},{"key":"S0129065723500326BIB075","first-page":"7017","volume-title":"Proc. IEEE\/CVF Conf. Computer Vision and Pattern Recognition","author":"Yi K.","year":"2019"},{"key":"S0129065723500326BIB076","doi-asserted-by":"crossref","first-page":"9103","DOI":"10.1609\/aaai.v33i01.33019103","volume":"33","author":"Yao J.","year":"2019","journal-title":"Proc. AAAI Conf. Artificial Intelligence"},{"key":"S0129065723500326BIB077","first-page":"460","volume-title":"Proc. IEEE\/CVF Int. Conf. Computer Vision Workshops","author":"Jaehwan L.","year":"2019"},{"key":"S0129065723500326BIB078","first-page":"2304","volume-title":"Int. Conf. Machine Learning, PMLR","author":"Jiang L.","year":"2018"},{"key":"S0129065723500326BIB079","doi-asserted-by":"crossref","first-page":"1373","DOI":"10.1613\/jair.1.12125","volume":"70","author":"Northcutt C.","year":"2021","journal-title":"J. Artif. Intell. Res."},{"key":"S0129065723500326BIB080","volume":"32","author":"Shu J.","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"S0129065723500326BIB081","first-page":"322","volume-title":"Proc. IEEE\/CVF Int. Conf. Computer Vision","author":"Wang Y.","year":"2019"},{"key":"S0129065723500326BIB082","volume":"30","author":"Tarvainen A.","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"S0129065723500326BIB083","first-page":"2852","volume-title":"Proc. IEEE Conf. Computer Vision and Pattern Recognition","author":"Li S.","year":"2017"},{"key":"S0129065723500326BIB084","first-page":"279","volume-title":"Proc. 18th ACM Int. Conf. Multimodal Interaction","author":"Barsoum E.","year":"2016"},{"key":"S0129065723500326BIB085","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1007\/978-3-642-42051-1_16","volume-title":"Int. Conf. Neural Information Processing","author":"Goodfellow I. J.","year":"2013"},{"issue":"10","key":"S0129065723500326BIB086","doi-asserted-by":"crossref","first-page":"1499","DOI":"10.1109\/LSP.2016.2603342","volume":"23","author":"Zhang K.","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"S0129065723500326BIB087","first-page":"1","volume-title":"2017 IEEE MIT Undergraduate Research Technology Conf. (URTC)","author":"Huang C.","year":"2017"},{"issue":"2605","key":"S0129065723500326BIB088","first-page":"2579","volume":"9","author":"van der Maaten L.","year":"2008","journal-title":"J. Mach. Learn. Res."},{"issue":"12","key":"S0129065723500326BIB090","doi-asserted-by":"crossref","first-page":"3074","DOI":"10.1109\/TNNLS.2017.2682102","volume":"28","author":"Rafiei M. H.","year":"2017","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"S0129065723500326BIB091","doi-asserted-by":"crossref","first-page":"6393","DOI":"10.1007\/s00521-019-04146-4","volume":"32","author":"Pereira D. R.","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"S0129065723500326BIB092","doi-asserted-by":"crossref","first-page":"8675","DOI":"10.1007\/s00521-019-04359-7","volume":"32","author":"Alam K. M. R.","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"S0129065723500326BIB093","author":"Rafiei M. H.","year":"2022","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."}],"container-title":["International Journal of Neural Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0129065723500326","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,16]],"date-time":"2023-06-16T06:16:10Z","timestamp":1686896170000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0129065723500326"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,16]]},"references-count":90,"journal-issue":{"issue":"06","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["10.1142\/S0129065723500326"],"URL":"https:\/\/doi.org\/10.1142\/s0129065723500326","relation":{},"ISSN":["0129-0657","1793-6462"],"issn-type":[{"value":"0129-0657","type":"print"},{"value":"1793-6462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,16]]},"article-number":"2350032"}}