{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T23:16:23Z","timestamp":1780614983124,"version":"3.54.1"},"reference-count":36,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2015,8,26]],"date-time":"2015-08-26T00:00:00Z","timestamp":1440547200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Head pose estimation is a crucial initial task for human face analysis, which is employed in several computer vision systems, such as: facial expression recognition, head gesture recognition, yawn detection, etc. In this work, we propose a frame-based approach to estimate the head pose on top of the Viola and Jones (VJ) Haar-like face detector. Several appearance and depth-based feature types are employed for the pose estimation, where comparisons between them in terms of accuracy and speed are presented. It is clearly shown through this work that using the depth data, we improve the accuracy of the head pose estimation. Additionally, we can spot positive detections, faces in profile views detected by the frontal model, that are wrongly cropped due to background disturbances. We introduce a new depth-based feature descriptor that provides competitive estimation results with a lower computation time. Evaluation on a benchmark Kinect database shows that the histogram of oriented gradients and the developed depth-based features are more distinctive for the head pose estimation, where they compare favorably to the current state-of-the-art approaches. Using a concatenation of the aforementioned feature types, we achieved a head pose estimation with average errors not exceeding 5:1; 4:6; 4:2 for pitch, yaw and roll angles, respectively.<\/jats:p>","DOI":"10.3390\/s150920945","type":"journal-article","created":{"date-parts":[[2015,8,26]],"date-time":"2015-08-26T10:23:31Z","timestamp":1440584611000},"page":"20945-20966","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Head Pose Estimation on Top of Haar-Like Face Detection: A Study Using the Kinect Sensor"],"prefix":"10.3390","volume":"15","author":[{"given":"Anwar","family":"Saeed","sequence":"first","affiliation":[{"name":"Institute for Information Technology and Communications (IIKT), Otto-von-Guericke-University Magdeburg, Magdeburg D-39016, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3632-2402","authenticated-orcid":false,"given":"Ayoub","family":"Al-Hamadi","sequence":"additional","affiliation":[{"name":"Institute for Information Technology and Communications (IIKT), Otto-von-Guericke-University Magdeburg, Magdeburg D-39016, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ahmed","family":"Ghoneim","sequence":"additional","affiliation":[{"name":"Department of Software Engineering, College of Computer Science and Information Sciences, King Saud University, Riyadh 11451, Saudi Arabia"},{"name":"Department of Computer Science, College of Science, Menoufia University, Menoufia 32721, Egypt"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2015,8,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1049\/iet-cvi.2011.0064","article-title":"Facial expression recognition based on geometric and optical flow features in colour image sequences","volume":"6","author":"Niese","year":"2012","journal-title":"IET Comput. Vis."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1016\/j.cviu.2010.12.001","article-title":"Local binary patterns for multi-view facial expression recognition","volume":"115","author":"Moore","year":"2011","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1357","DOI":"10.1109\/TPAMI.2012.233","article-title":"Coupled Gaussian processes for pose-invariant facial expression recognition","volume":"35","author":"Rudovic","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2876","DOI":"10.1016\/j.patcog.2009.04.017","article-title":"Face recognition across pose: A review","volume":"42","author":"Zhang","year":"2009","journal-title":"Pattern Recognit."},{"key":"ref_5","unstructured":"Morency, L.P., and Darrell, T. (1, January 29). Head Gesture Recognition in Intelligent Interfaces: The role of Context in Improving Recognition. Proceedings of the 11th International Conference on Intelligent User Interfaces, Sydney, Australia."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Sidner, C.L., Lee, C., Morency, L.P., and Forlines, C. (2006, January 2\u20133). The Effect of Head-nod Recognition in Human-robot Conversation. Proceedings of the 1st ACM SIGCHI\/SIGART Conference on Human-robot Interaction, Salt Lake City, UT, USA.","DOI":"10.1145\/1121241.1121291"},{"key":"ref_7","unstructured":"Kaliouby, R.E., and Robinson, P. (2005). Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures, Springer US."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Baltrusaitis, T., McDuff, D., Banda, N., Mahmoud, M., El Kaliouby, R., Robinson, P., and Picard, R. (2011, January 21\u201325). Real-Time Inference of Mental States from Facial Expressions and Upper Body Gestures. Proceedings of the IEEE International Conference on Automatic Face Gesture Recognition and Workshops, Santa Barbara, CA, USA.","DOI":"10.1109\/FG.2011.5771372"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"8363","DOI":"10.3390\/s140508363","article-title":"An investigation on the feasibility of uncalibrated and unconstrained gaze tracking for human assistive applications by using head pose estimation","volume":"14","author":"Cazzato","year":"2014","journal-title":"Sensors"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1007\/s12193-013-0121-4","article-title":"A dataset for point of gaze detection using head poses and eye images","volume":"7","author":"McMurrough","year":"2013","journal-title":"J. Multimodal User Interfaces"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1109\/TSMCB.2008.927274","article-title":"Recognizing visual focus of attention from head pose in natural meetings","volume":"39","author":"Ba","year":"2009","journal-title":"IEEE Trans. Syst. Man Cybern. B Cybern."},{"key":"ref_12","unstructured":"Murphy-Chutorian, E., Doshi, A., and Trivedi, M. (October, January 30). Head pose estimation for driver assistance systems: A robust algorithm and experimental evaluation. Proceedings of the IEEE Intelligent Transportation Systems Conference, Seattle, Washington, DC, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"4225","DOI":"10.3390\/s130404225","article-title":"Optical flow and driver\u2019s kinematics analysis for state of alert sensing","volume":"13","year":"2013","journal-title":"Sensors"},{"key":"ref_14","first-page":"512","article-title":"Robust head pose estimation using LGBP","volume":"2","author":"Ma","year":"2006","journal-title":"Int. Conf. Pattern Recognit."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1138","DOI":"10.1016\/j.patcog.2007.07.017","article-title":"A Two-stage head pose estimation framework and evaluation","volume":"41","author":"Wu","year":"2008","journal-title":"Pattern Recognit."},{"key":"ref_16","unstructured":"Zhu, X., and Ramanan, D. (2012, January 16\u201321). Face Detection, Pose Estimation, and Landmark Localization in the Wild. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.patcog.2011.06.007","article-title":"Model free head pose estimation using stereovision","volume":"45","author":"Gurbuz","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Jimenez, P., Nuevo, J., and Bergasa, L. (2008, January 23\u201328). Face Pose Estimation and Tracking Using Automatic 3D Model Construction. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Anchorage, AK, USA.","DOI":"10.1109\/CVPRW.2008.4563051"},{"key":"ref_19","unstructured":"Tu, J., Huang, T., and Tao, H. (2006, January 23\u201328). Accurate Head Pose Tracking in Low Resolution Video. Proceedings of the International Conference on Automatic Face and Gesture Recognition, Southampton, AK, USA."},{"key":"ref_20","unstructured":"Ruddarraju, R., Haro, A., and Essa, I.A. (2003, January 11\u201313). Fast Multiple Camera Head Pose Tracking. Proceedings of the 11th International Conference on Intelligent User Interfaces, Vision Interface, Halifax, NS, Canada."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Niese, R., Werner, P., and Al-Hamadi, A. (2013, January 13\u201316). Accurate, Fast and Robust Realtime Face Pose Estimation Using Kinect Camera. Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Manchester, UK.","DOI":"10.1109\/SMC.2013.89"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Fanelli, G., Weise, T., Gall, J., and Gool, L.V. (2011). Real Time Head Pose Estimation from Consumer Depth Cameras, Springer Berlin, Heidelberg.","DOI":"10.1007\/978-3-642-23123-0_11"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Yang, J., Liang, W., and Jia, Y. (2012, January 11\u201315). Face Pose Estimation with Combined 2D and 3D HOG Features. Proceedings of the International Conference on Pattern Recognition, Tsukuba, Japan.","DOI":"10.1109\/ICIG.2013.133"},{"key":"ref_24","unstructured":"Buddharaju, P., Pavlidis, I., and Tsiamyrtzis, P. (2006, January 17\u201322). Pose-Invariant Physiological Face Recognition in the Thermal Infrared Spectrum. Proceedings of the Conference on Computer Vision and Pattern Recognition Workshop, New York, NY, USA."},{"key":"ref_25","unstructured":"Dahmane, A., Larabi, S., Djeraba, C., and Bilasco, I. (2012, January 11\u201315). Learning Symmetrical Model for Head Pose Estimation. Proceedings of the International Conference on Pattern Recognition, Tsukuba, Japan."},{"key":"ref_26","first-page":"511","article-title":"Rapid object detection using a boosted cascade of simple features","volume":"1","author":"Viola","year":"2001","journal-title":"Comput. Vis. Pattern Recognit."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Fossati, A., Gall, J., Grabner, H., Ren, X., and Konolige, K. (2013). Consumer Depth Cameras for Computer Vision, Springer-Verlag London.","DOI":"10.1007\/978-1-4471-4640-7"},{"key":"ref_28","unstructured":"Bradski, G. The OpenCV Library. Available online: http:\/\/sourceforge.net\/projects\/opencvlibrary\/."},{"key":"ref_29","unstructured":"Cruz, A., Bhanu, B., and Thakoor, N. (2012, January 11\u201315). Facial Emotion Recognition in Continuous Video. Proceedings of the International Conference on Pattern Recognition, Tsukuba, Japan."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2014\/408953","article-title":"Frame-based facial expression recognition using geometrical features","volume":"4","author":"Saeed","year":"2014","journal-title":"Adv. Human Comput. Interact."},{"key":"ref_31","unstructured":"Guo, G., and Wang, X. (2012, January 16\u201321). A Study on Human Age Estimation under Facial Expression Changes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Sharma, B., Thota, R., Vydyanathan, N., and Kale, A. (2009, January 16\u201319). Towards a Robust, Real-Time Face Processing System Using CUDA-Enabled GPUs. Proceedings of International Conference on the High Performance Computing, Kochi, India.","DOI":"10.1109\/HIPC.2009.5433189"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/0031-3203(95)00067-4","article-title":"A comparative study of texture measures with classification based on featured distributions","volume":"29","author":"Ojala","year":"1996","journal-title":"Pattern Recognit."},{"key":"ref_34","unstructured":"Dalal, N., and Triggs, B. (2005, January 25). Histograms of oriented gradients for human detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Abe, S. (2010). Support Vector Machines for Pattern Classification, Springer.","DOI":"10.1007\/978-1-84996-098-4"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Chang, C.C., and Lin, C.J. (2011). LIBSVM: A library for support vector machines. ACM Trans. Intell. Syst. Technol., 2.","DOI":"10.1145\/1961189.1961199"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/9\/20945\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:47:25Z","timestamp":1760215645000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/9\/20945"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,8,26]]},"references-count":36,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2015,9]]}},"alternative-id":["s150920945"],"URL":"https:\/\/doi.org\/10.3390\/s150920945","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,8,26]]}}}