{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T11:10:08Z","timestamp":1789038608969,"version":"build-2803163510"},"reference-count":42,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2026,9,9]],"date-time":"2026-09-09T00:00:00Z","timestamp":1788912000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"T\u00dcB\u02d9ITAK","award":["3240924"],"award-info":[{"award-number":["3240924"]}]},{"name":"Core Bina Otomasyon Teknolojileri San. ve Tic. Ltd. \u015eti"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Vision-based hand gesture recognition (HGR) systems are predominantly developed for frontal camera viewpoints, whereas smart-home cameras are often ceiling-mounted, creating a viewpoint-induced domain gap. To investigate this issue, we collected and manually annotated CeilGest, an 18-class ceiling-view hand gesture dataset comprising 156,282 annotated frames from 68 participants recorded in distinct domestic environments. We then systematically evaluated frontal-to-ceiling transfer using YOLO-based detectors trained on HaGRID and compared their performance with an in-domain CeilGest-trained model. On identical ceiling-view footage, the frontal-trained YOLOv8n produced approximately 24\u00d7 more class-to-class misclassified frames than the in-domain model (486 vs. 20 across 27,000 frames); this large paired difference remained evident when temporal dependence within gesture holds was taken into account. The effect was strongly class-dependent, with AP decreasing by up to 5.5 percentage points for the worst-affected gesture, while the aggregate same-architecture mAP50 difference was 0.6 percentage points. Across five YOLOv8 variants evaluated on frontal HaGRID, mAP50 remained at 0.995, supporting selection of the lightweight YOLOv8n for edge deployment. The complete ceiling-view HGR pipeline was implemented on Raspberry Pi 5 using NCNN and Jetson Orin Nano using TensorRT. Mean inference latency was 74.69 \u00b1 4.72 ms and 12.72 \u00b1 0.12 ms, respectively. During a 10 min continuous Raspberry Pi 5 test, mean inference latency increased by 17.6% and junction temperature reached 90.8 \u00b0C with thermal throttling. Power consumption and INT8 inference were not evaluated. Overall, the results show that training\u2013deployment viewpoint consistency is a major consideration for ceiling-mounted HGR and establish an in-domain supervised baseline relative to frontal-only training without domain adaptation.<\/jats:p>","DOI":"10.3390\/s26185735","type":"journal-article","created":{"date-parts":[[2026,9,9]],"date-time":"2026-09-09T14:02:48Z","timestamp":1788962568000},"page":"5735","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Quantifying the Frontal-to-Ceiling Domain Gap for YOLO-Based Hand Gesture Recognition in Smart Homes"],"prefix":"10.3390","volume":"26","author":[{"given":"Ufuk","family":"Be\u015fenk","sequence":"first","affiliation":[{"name":"Department of Electrical and Electronics Engineering, Dokuz Eyl\u00fcl University, \u0130zmir 35330, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"software","vocabulary":"credit"},{"role":"writing-original-draft","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"formal-analysis","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"}]},{"given":"Sarp Ege","family":"Nayim","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronics Engineering, Dokuz Eyl\u00fcl University, \u0130zmir 35330, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"data-curation","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"}]},{"given":"\u00d6m\u00fcr","family":"\u00d6cal","sequence":"additional","affiliation":[{"name":"Core Bina Otomasyon Teknolojileri San. ve Tic. Ltd. \u015eti., Fatih Mahallesi, Ege Caddesi, A2 Blok, No: 42\/5, Gaziemir, \u0130zmir 35410, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"software","vocabulary":"credit"},{"role":"formal-analysis","vocabulary":"credit"},{"role":"resources","vocabulary":"credit"}]},{"given":"Mehmet","family":"\u00d6ztemel","sequence":"additional","affiliation":[{"name":"Core Bina Otomasyon Teknolojileri San. ve Tic. Ltd. \u015eti., Fatih Mahallesi, Ege Caddesi, A2 Blok, No: 42\/5, Gaziemir, \u0130zmir 35410, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"software","vocabulary":"credit"},{"role":"formal-analysis","vocabulary":"credit"},{"role":"resources","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6404-7244","authenticated-orcid":false,"given":"Ahmet","family":"\u00d6zkurt","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronics Engineering, Dokuz Eyl\u00fcl University, \u0130zmir 35330, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"formal-analysis","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8445-0388","authenticated-orcid":false,"given":"Mustafa Alper","family":"Selver","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronics Engineering, Dokuz Eyl\u00fcl University, \u0130zmir 35330, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"project-administration","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1007\/s13042-017-0705-5","article-title":"A Review of Hand Gesture and Sign Language Recognition Techniques","volume":"10","author":"Cheok","year":"2019","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Oudah, M., Al-Naji, A., and Chahl, J. (2020). Hand gesture recognition based on computer vision: A review of techniques. J. Imaging, 6.","DOI":"10.3390\/jimaging6080073"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e2921","DOI":"10.7717\/peerj-cs.2921","article-title":"Deep vision-based real-time hand gesture recognition: A review","volume":"11","author":"Cui","year":"2025","journal-title":"PeerJ Comput. Sci."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Alabdullah, B.I., Ansar, H., Mudawi, N.A., Alazeb, A., Alshahrani, A., Alotaibi, S.S., and Jalal, A. (2023). Smart Home Automation-Based Hand Gesture Recognition Using Feature Fusion and Recurrent Neural Network. Sensors, 23.","DOI":"10.3390\/s23177523"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Besenk, U., Toprak, T., Selver, M.A., Ozkurt, A., and Ocal, O. (2024, January 10\u201312). Increasing the Accessibility of Disabled Individuals with AI Integrated Smart Home Systems. Proceedings of the 2024 Medical Technologies Congress (TIPTEKNO), Mugla, Turkiye.","DOI":"10.1109\/TIPTEKNO63488.2024.10755450"},{"key":"ref_6","unstructured":"Kapitanov, A., Kvanchiani, K., Nagaev, A., Kraynov, R., and Makhliarchuk, A. (2024, January 3\u20138). HaGRID\u2013HAnd Gesture Recognition Image Dataset. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA."},{"key":"ref_7","unstructured":"Jocher, G., Chaurasia, A., and Qiu, J. (2026, August 31). Ultralytics YOLOv8. Version 8.0. Available online: https:\/\/github.com\/ultralytics\/ultralytics."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, A., Chen, H., Liu, L., Chen, K., Lin, Z., Han, J., and Ding, G. (2024). YOLOv10: Real-Time End-to-End Object Detection. arXiv.","DOI":"10.52202\/079017-3429"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"40043","DOI":"10.1038\/s41598-025-23925-9","article-title":"Benchmarking YOLOv8 to YOLOv13 for robust hand gesture recognition in human\u2013robot interaction","volume":"15","author":"Gao","year":"2025","journal-title":"Sci. Rep."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Linardakis, M., Varlamis, I., and Papadopoulos, G.T. (2025). Survey on hand gesture recognition from visual input. arXiv.","DOI":"10.1109\/ACCESS.2025.3593428"},{"key":"ref_11","unstructured":"Zhang, Y., Luo, D., Sundareshan, B., Camps, O., and Sznaier, M. (2023). Cross-view Action Recognition via Contrastive View-invariant Representation. arXiv."},{"key":"ref_12","unstructured":"Han, S., Mao, H., and Dally, W.J. (2015). Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Jacob, B., Kligys, S., Chen, B., Zhu, M., Tang, M., Howard, A., Adam, H., and Kalenichenko, D. (2018, January 18\u201322). Quantization and training of neural networks for efficient integer-arithmetic-only inference. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00286"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Alqahtani, D.K., Cheema, M.A., and Toosi, A.N. (2024). Benchmarking deep learning models for object detection on edge computing devices. Proceedings of the International Conference on Service-Oriented Computing, Springer.","DOI":"10.1007\/978-981-96-0805-8_11"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Fertl, E., Castillo, E., Stettinger, G., Cu\u00e9llar, M.P., and Morales, D.P. (2025). Hand Gesture Recognition on Edge Devices: Sensor Technologies, Algorithms, and Processing Hardware. Sensors, 25.","DOI":"10.3390\/s25061687"},{"key":"#cr-split#-ref_16.1","unstructured":"European Parliament and Council of the European Union (2016). Regulation"},{"key":"#cr-split#-ref_16.2","unstructured":"(EU) 2016\/679 of the European Parliament and of the Council (General Data Protection Regulation), Publications Office of the European Union. Official Journal of the European Union, L 119."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Baptista, J., Santos, V., Silva, F., and Pinho, D. (2023). Domain Adaptation with Contrastive Simultaneous Multi-Loss Training for Hand Gesture Recognition. Sensors, 23.","DOI":"10.3390\/s23063332"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Hobbs, T., and Ali, A. (2025). Smart Home Control Using Real-Time Hand Gesture Recognition and Artificial Intelligence on Raspberry Pi 5. Electronics, 14.","DOI":"10.3390\/electronics14203976"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Lopes, M.C., Silva, P.A., Marenco, L., Vilas Boas, E.C., Carvalho, J.G.d., Ferreira, C.A., Carvalho, A.L., Guimar\u00e3es, C.V., Aquino, G.P., and P. de Figueiredo, F.A. (2026). GECO: A Real-Time Computer Vision-Assisted Gesture Controller for Advanced IoT Home System. Sensors, 26.","DOI":"10.3390\/s26010061"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.patcog.2017.10.033","article-title":"Convolutional neural networks and long short-term memory for skeleton-based human activity and hand gesture recognition","volume":"76","author":"Nunez","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hakim, N.L., Shih, T.K., Kasthuri Arachchi, S.P., Aditya, W., Chen, Y.C., and Lin, C.Y. (2019). Dynamic hand gesture recognition using 3DCNN and LSTM with FSM context-aware model. Sensors, 19.","DOI":"10.3390\/s19245429"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sahoo, J.P., Prakash, A.J., P\u0142awiak, P., and Samantray, S. (2022). Real-time hand gesture recognition using fine-tuned convolutional neural network. Sensors, 22.","DOI":"10.3390\/s22030706"},{"key":"ref_23","first-page":"31","article-title":"Dynamic Gesture Recognition Based on Deep Learning in Human-to-Computer Interfaces","volume":"23","author":"Yu","year":"2020","journal-title":"J. Appl. Sci. Eng."},{"key":"ref_24","first-page":"377","article-title":"Mask RCNN-based Single Shot Multibox Detector for Gesture Recognition in Physical Education","volume":"26","author":"Feng","year":"2023","journal-title":"J. Appl. Sci. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ahuja, H., Varadarajan, K., and Jammal, M. (2023, January 10\u201311). Towards Smart Interaction: Hand Gesture Recognition Using Machine Learning in IoT Scenarios. Proceedings of the 2023 IEEE Global Conference on Artificial Intelligence and Internet of Things (GCAIoT), Dubai, United Arab Emirates.","DOI":"10.1109\/GCAIoT61060.2023.10385100"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ahmad, M., Ahmed, I., and Adnan, A. (2019, January 10\u201312). Overhead View Person Detection Using YOLO. Proceedings of the 2019 IEEE 10th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON), New York, NY, USA.","DOI":"10.1109\/UEMCON47517.2019.8992980"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Moon, G., Yu, S.I., Wen, H., Shiratori, T., and Lee, K.M. (2020). InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Image. Proceedings of the European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-030-58565-5_33"},{"key":"ref_28","unstructured":"Zimmermann, C., Ceylan, D., Yang, J., Russell, B., Argus, M., and Brox, T. (November, January 27). FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hampali, S., Rad, M., Oberweger, M., and Lepetit, V. (2020, January 14\u201319). HOnnotate: A Method for 3D Annotation of Hand and Object Poses. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Virtual.","DOI":"10.1109\/CVPR42600.2020.00326"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"13","DOI":"10.5194\/isprs-archives-XLVIII-2-W9-2025-13-2025","article-title":"Improving Gesture Recognition Efficiency with MediaPipe and YOLO-Pose","volume":"XLVIII-2\/W9-2025","author":"Andriyanov","year":"2025","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Cubuk, E.D., Zoph, B., Mane, D., Vasudevan, V., and Le, Q.V. (2019, January 16\u201320). AutoAugment: Learning Augmentation Strategies From Data. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00020"},{"key":"ref_32","first-page":"1","article-title":"Domain-adversarial training of neural networks","volume":"17","author":"Ganin","year":"2016","journal-title":"J. Mach. Learn. Res."},{"key":"ref_33","unstructured":"Hinton, G., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1109\/JIOT.2016.2579198","article-title":"Edge computing: Vision and challenges","volume":"3","author":"Shi","year":"2016","journal-title":"IEEE Internet Things J."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1655","DOI":"10.1109\/JPROC.2019.2921977","article-title":"Deep Learning With Edge Computing: A Review","volume":"107","author":"Chen","year":"2019","journal-title":"Proc. IEEE"},{"key":"ref_36","first-page":"1","article-title":"LKAFormer: A Lightweight Kolmogorov\u2013Arnold Transformer Model for Image Semantic Segmentation","volume":"17","author":"Yin","year":"2026","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_37","unstructured":"Tencent (2026, August 31). NCNN: A High-Performance Neural Network Inference Framework for Mobile and Embedded. Available online: https:\/\/github.com\/Tencent\/ncnn."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Materzynska, J., Berger, G., Bax, I., and Memisevic, R. (2019, January 27\u201328). The Jester Dataset: A Large-Scale Video Dataset of Human Gestures. Proceedings of the IEEE\/CVF International Conference on Computer Vision Workshops, Seoul, Republic of Korea.","DOI":"10.1109\/ICCVW.2019.00349"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Molchanov, P., Yang, X., Gupta, S., Kim, K., Tyree, S., and Kautz, J. (2016, January 27\u201330). Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.456"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1038","DOI":"10.1109\/TMM.2018.2808769","article-title":"EgoGesture: A New Dataset and Benchmark for Egocentric Hand Gesture Recognition","volume":"20","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_41","unstructured":"(2026, August 31). ONNX Simplifier: Simplify Your ONNX Model. Available online: https:\/\/github.com\/daquexian\/onnx-simplifier."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/18\/5735\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T10:31:41Z","timestamp":1789036301000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/18\/5735"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,9]]},"references-count":42,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2026,9]]}},"alternative-id":["s26185735"],"URL":"https:\/\/doi.org\/10.3390\/s26185735","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,9]]}}}