{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:24:27Z","timestamp":1760243067197,"version":"build-2065373602"},"reference-count":60,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2015,8,25]],"date-time":"2015-08-25T00:00:00Z","timestamp":1440460800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>With the rapid growth of smart TV, the necessity for recognizing a viewer has increased for various applications that deploy face recognition to provide intelligent services and high convenience to viewers. However, the viewers can have various postures, illumination, and expression variations on their faces while watching TV, and thereby, the performance of face recognition inevitably degrades. In order to handle these problems, video-based face recognition has been proposed, instead of a single image-based one. However, video-based processing of multiple images is prohibitive in smart TVs as the processing power is limited. Therefore, a quality measure-based (QM-based) image selection is required that considers both the processing speed and accuracy of face recognition. Therefore, we propose a performance enhancement method for face recognition through symmetrical fuzzy-based quality assessment. Our research is novel in the following three ways as compared to previous works. First, QMs are adaptively selected by comparing variance values obtained from candidate QMs within a video sequence, where the higher the variance value by a QM, the more meaningful is the QM in terms of a distinction between images. Therefore, we can adaptively select meaningful QMs that reflect the primary factors influencing the performance of face recognition. Second, a quality score of an image is calculated using a fuzzy method based on the inputs of the selected QMs, symmetrical membership functions, and rule table considering the characteristics of symmetry. A  fuzzy-based combination method of image quality has the advantage of being less affected by the types of face databases because it does not perform an additional training procedure. Third, the accuracy of face recognition is enhanced by fusing the matching scores of the high-quality face images, which are selected based on the quality scores among successive face mages. Experimental results showed that the performance of face recognition using the proposed method was better than that of conventional methods in terms of accuracy.<\/jats:p>","DOI":"10.3390\/sym7031475","type":"journal-article","created":{"date-parts":[[2015,8,25]],"date-time":"2015-08-25T10:28:17Z","timestamp":1440498497000},"page":"1475-1518","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Performance Enhancement of Face Recognition in Smart TV Using Symmetrical Fuzzy-Based Quality Assessment"],"prefix":"10.3390","volume":"7","author":[{"given":"Yeong","family":"Kim\u00a0","sequence":"first","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Won","family":"Lee","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Ki","family":"Kim","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Hyung","family":"Hong","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Kang","family":"Park","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2015,8,25]]},"reference":[{"key":"ref_1","unstructured":"Lin, K.-H., Shiue, D.-H., Chiu, Y.-S., Tsai, W.-H., Jang, F.-J., and Chen, J.-S. (2012, January 2\u20135). Design and Implementation of Face Recognition-aided IPTV Adaptive Group Recommendation System Based on NLMS Algorithm. Proceedings of International Symposium on Communications and Information Technologies, Gold Coast, Australia."},{"key":"ref_2","unstructured":"Lee, S.-H., Sohn, M.-K., Kim, D.-J., Kim, B., and Kim, H. (2013, January 11\u201314). Smart TV Interaction System Using Face and Hand Gesture Recognition. Proceedings of International Conference on Consumer Electronics, Las Vegas, NV, USA."},{"key":"ref_3","unstructured":"Chae, Y.N., Lee, S., Han, B.O., and Yang, H.S. (2013, January 11\u201314). Vision-based Sleep Mode Detection for a Smart TV. Proceedings of International Conference on Consumer Electronics, Las Vegas, NV, USA."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1109\/TPAMI.2002.1008383","article-title":"Face Recognition Using Line Edge Map","volume":"24","author":"Gao","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/S0031-3203(00)00031-5","article-title":"Eigenhill vs. Eigenface and Eigenedge","volume":"34","author":"Yilmaz","year":"2001","journal-title":"Pattern Recognit."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1109\/TPAMI.2003.1177153","article-title":"Lambertian Reflectance and Linear Subspaces","volume":"25","author":"Basri","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1109\/34.927464","article-title":"From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose","volume":"23","author":"Georghiades","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"596","DOI":"10.1016\/j.jfranklin.2006.08.006","article-title":"Face Recognition under Pose Variations","volume":"343","author":"Du","year":"2006","journal-title":"J. Frankl. Inst. Eng. Appl. Math."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1109\/34.598235","article-title":"Face Recognition by Elastic Bunch Graph Matching","volume":"19","author":"Wiskott","year":"1997","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1109\/34.927467","article-title":"Active Appearance Models","volume":"23","author":"Cootes","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"711","DOI":"10.1109\/34.598228","article-title":"Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection","volume":"19","author":"Belhumeur","year":"1997","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","unstructured":"Blanz, V., Grother, P., Phillips, P.J., and Vetter, T. (2005, January 20\u201325). Face Recognition Based on Frontal Views Generated from Non-Frontal Images. Proceedings of International Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1063","DOI":"10.1109\/TPAMI.2003.1227983","article-title":"Face Recognition Based on Fitting a 3D Morphable Model","volume":"25","author":"Blanz","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","unstructured":"Vetter, T. (1996, January 14\u201316). Learning Novel Views to a Single Face Image. Proceedings of International Conference on Automatic Face and Gesture Recognition, Killington, VT, USA."},{"key":"ref_15","first-page":"293","article-title":"Video-based Face Recognition: A Survey","volume":"60","author":"Wang","year":"2009","journal-title":"World Acad. Sci. Eng. Technol."},{"key":"ref_16","first-page":"1266002:1","article-title":"Face Recognition from Video: A Review","volume":"26","author":"Barr","year":"2012","journal-title":"J. Pattern Recognit. Artif. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/S1364-6613(02)01908-3","article-title":"Recognizing Moving Faces: A Psychological and Neural Synthesis","volume":"6","author":"Roark","year":"2002","journal-title":"Trends Cognit. Sci."},{"key":"ref_18","unstructured":"Chowdhury, A.R., Chellappa, R., Krishnamurthy, S., and Vo, T. (2002, January 26\u201329). 3D Face Reconstruction from Video Using A Generic Model. Proceedings of International Conference on Multimedia and Expo, Lausanne, Switzerland."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1167","DOI":"10.1109\/TPAMI.2002.1033210","article-title":"Limits on Super-Resolution and How to Break Them","volume":"24","author":"Baker","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1945","DOI":"10.1016\/S0031-3203(03)00057-8","article-title":"Eigenspace Updating for Non-stationary Process and Its Application to Face Recognition","volume":"36","author":"Liu","year":"2003","journal-title":"Pattern Recognit."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1049\/iet-spr.2008.0172","article-title":"Complete Face Logs for Video Sequences Using Face Quality Measures","volume":"3","author":"Nasrollahi","year":"2009","journal-title":"IET Signal Process."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Hsu, R.-L.V., Shah, J., and Martin, B. (2006, January 19\u201321). Quality Assessment of Facial Images. Proceedings of Biometrics Consortium Conference, Baltimore, MD, USA.","DOI":"10.1109\/BCC.2006.4341617"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Fourney, A., and Lagani\u00e8re, R. (2007, January 28\u201330). Constructing Face Image Logs that are Both Complete and Concise. Proceedings of Canadian Conference on Computer and Robot Vision, Montreal, QC, Canada.","DOI":"10.1109\/CRV.2007.20"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Nasrollahi, K., and Moeslund, T.B. (2010, January 7\u201310). Hybrid Super Resolution Using Refined Face Logs. Proceedings of International Conference on Image Processing Theory, Tools and Applications, Paris, France.","DOI":"10.1109\/IPTA.2010.5586769"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1109\/MMUL.2012.15","article-title":"Posterity Logging of Face Imagery for Video Surveillance","volume":"19","author":"Bagdanov","year":"2012","journal-title":"IEEE Multimedia"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Bharadwaj, S., Bhatt, H., Vatsa, M., Singh, R., and Noore, A. (2011, January 20\u201325). Quality Assessment based Denoising to Improve Face Recognition Performance. Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPRW.2011.5981843"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wei, Z., Li, X., and Zhuo, L. (2013, January 16\u201318). An Automatic Face Log Collection Method for Video Sequence. Proceedings of International Conference on Internet Multimedia Computing and Service, Huangshan, China.","DOI":"10.1145\/2499788.2499869"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Anantharajah, K., Denman, S., Sridharan, S., Fookes, C., and Tjondronegoro, D. (2012, January 12\u201314). Quality Based Frame Selection for Video Face Recognition. Proceedings of International Conference on Signal Processing and Communication Systems, Gold Coast, Australia.","DOI":"10.1109\/ICSPCS.2012.6507950"},{"key":"ref_29","unstructured":"Webcam C600. Available online: https:\/\/support.logitech.com\/en_us\/product\/5869."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"053104:1","DOI":"10.1117\/1.OE.53.5.053104","article-title":"New Method for Face Gaze Detection in Smart Television","volume":"53","author":"Lee","year":"2014","journal-title":"Opt. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust Real-Time Face Detection","volume":"57","author":"Viola","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_32","unstructured":"Boyle, M. (2001). The Effects of Capture Conditions on the CAMSHIFT Face Tracker, Department of Computer Science, University of Calgary. Technical Report 2001-691-14."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Tripathi, A.K., Mukhopadhyay, S., and Dhara, A.K. (2011, January 3\u20135). Performance Metrics for Image Contrast. Proceedings of International Conference on Image Information Processing, Himachal Pradesh, India.","DOI":"10.1109\/ICIIP.2011.6108900"},{"key":"ref_34","unstructured":"Barghout, L. (2006). System and Method for Edge Detection in Image Processing and Recognition. (PCT\/US2006\/039812), U.S. Patent."},{"key":"ref_35","first-page":"605","article-title":"From Single Image to List of Objects Based on Edge and Blob Detection","volume":"8468","author":"Grycuk","year":"2014","journal-title":"Artificial Intelligence and Soft Computing"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1007\/978-3-319-16829-6_12","article-title":"Spatial-Taxon Information Granules as Used in Iterative Fuzzy-Decision-Making for Image Segmentation","volume":"Volume 10","author":"Barghout","year":"2015","journal-title":"Granular Computing and Decision-Making: Interactive and Iterative Approaches"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/S0020-7373(75)80002-2","article-title":"An experiment in linguistic synthesis with a fuzzy logic controller","volume":"7","author":"Mamdani","year":"1975","journal-title":"Int. J. Man Mach."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.trf.2011.11.003","article-title":"Fuzzy sets to describe driver behavior in the dilemma zone of high-speed signalized intersections","volume":"15","author":"Hurwitz","year":"2012","journal-title":"Transport. Res. Part F Traffic Psychol. Behav."},{"key":"ref_39","first-page":"62","article-title":"Detecting Moving Objects Based on Fuzzy Non-Symmetric Membership Function in Color Space","volume":"2","author":"Wu","year":"2011","journal-title":"Int. J. Eng. Ind."},{"key":"ref_40","unstructured":"Klir, G.J., and Yuan, B. (1995). Fuzzy Sets and Fuzzy Logic-Theory and Applications, Prentice-Hall."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/S0165-0114(97)00337-0","article-title":"Defuzzification: Criteria and Classification","volume":"108","author":"Leekwijck","year":"1999","journal-title":"Fuzzy Sets Syst."},{"key":"ref_42","unstructured":"Hines, G., Rahman, Z.-U., Jobson, D., and Woodell, G. (2004, January 27\u201330). Single-Scale Retinex Using Digital Signal Processors. Proceedings of Global Signal Processing Conference, Santa Clara, CA, USA."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1162\/jocn.1991.3.1.71","article-title":"Eigenfaces for Recognition","volume":"3","author":"Turk","year":"1991","journal-title":"J. Cogn. Neurosci."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2037","DOI":"10.1109\/TPAMI.2006.244","article-title":"Face Description with Local Binary Patterns: Application to Face Recognition","volume":"28","author":"Ahonen","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_45","first-page":"1","article-title":"Comparative Study of Human Age Estimation with or Without Pre-classification of Gender and Facial Expression","volume":"2014","author":"Nguyen","year":"2014","journal-title":"Sci. World J."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"21726","DOI":"10.3390\/s141121726","article-title":"Face Recognition System for Set-Top Box-Based Intelligent TV","volume":"14","author":"Lee","year":"2014","journal-title":"Sensors"},{"key":"ref_47","unstructured":"FEI Face Database. Available online: http:\/\/fei.edu.br\/~cet\/facedatabase.html."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"630","DOI":"10.3758\/BF03206543","article-title":"A lifespan database of adult facial stimuli","volume":"36","author":"Minear","year":"2004","journal-title":"Behav. Res. Methods"},{"key":"ref_49","unstructured":"AR Face Database. Available online: http:\/\/www2.ece.ohio-state.edu\/~aleix\/ARdatabase.html."},{"key":"ref_50","unstructured":"The Japanese Female Facial Expression (JAFFE) Database. Available online: http:\/\/www.kasrl.org\/jaffe.html."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Wolf, L., Hassner, T., and Maoz, I. (2011, January 20\u201325). Face Recognition in Unconstrained Videos with Matched Background Similarity. Proceedings of IEEE Conference on \u00a0Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2011.5995566"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/j.cviu.2005.02.002","article-title":"Visual tracking and recognition using probabilistic appearance manifolds","volume":"99","author":"Lee","year":"2005","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_53","unstructured":"Gorodnichy, D.O. (2005, January 9\u201311). Video-based Framework for Face Recognition in Video. Proceedings of the 2nd Canadian Conference on Computer and Robot Vision, British Columbia, BC, Canada."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1109\/TSMCA.2007.909557","article-title":"The CAS-PEAL large-scale Chinese face database and baseline evaluations","volume":"38","author":"Gao","year":"2008","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_55","unstructured":"CAS-PEAL-R1 Face Database. Available online: http:\/\/www.jdl.ac.cn\/peal\/."},{"key":"ref_56","unstructured":"TV Size to Distance Calculator and Science. Available online: http:\/\/www.rtings.com\/info\/television-size-to-distance-relationship."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The Pascal Visual Object Classes (VOC) Challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_58","unstructured":"Sensitivity and Specificity. Available online: http:\/\/en.wikipedia.org\/wiki\/Sensitivity_and_specificity."},{"key":"ref_59","unstructured":"Correlation and Dependence. Available online: http:\/\/en.wikipedia.org\/wiki\/Correlation_and_dependence."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1007\/978-3-642-17277-9_10","article-title":"Multiple-Object Tracking in Cluttered and Crowded Public Spaces","volume":"6455","author":"Martin","year":"2010","journal-title":"Lect. Notes Comput. Sci."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/7\/3\/1475\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:47:23Z","timestamp":1760215643000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/7\/3\/1475"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,8,25]]},"references-count":60,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2015,9]]}},"alternative-id":["sym7031475"],"URL":"https:\/\/doi.org\/10.3390\/sym7031475","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2015,8,25]]}}}