{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T05:52:41Z","timestamp":1774590761257,"version":"3.50.1"},"reference-count":31,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T00:00:00Z","timestamp":1774483200000},"content-version":"vor","delay-in-days":84,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"funder":[{"DOI":"10.13039\/501100001321","name":"National Research Foundation","doi-asserted-by":"publisher","award":["CSRP23040990793"],"award-info":[{"award-number":["CSRP23040990793"]}],"id":[{"id":"10.13039\/501100001321","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Journal of Robotics"],"published-print":{"date-parts":[[2026,1]]},"abstract":"<jats:p>The integration of multimodal sensor data is critical for developing intelligent systems capable of extracting complex, insightful information. We introduce a robust platform for high\u2010fidelity and real\u2010time hand posture replication, as well as object classification, centered on a novel tactile\u2010sensing glove. The glove design incorporates 10 flex sensors spanning the PIP and MCP joints, complemented by two MPU6050 IMUs strategically mounted on the thumb\u2019s TM and the hand\u2019s dorsal CMC bones for comprehensive motion capture. We leverage this rich sensory data to drive a digital twin\u2014constructed in Blender and visualized in the Unity3D engine\u2014achieving precise real\u2010time hand posture reproduction, necessary for visual feedback and sensor anomaly detection during sensor calibration and data collection by the operator. Furthermore, we evaluate the glove\u2019s classification capability on a custom dataset of 15 objects. Through a grid search optimization, we trained One\u2010dimensional Convolutional Neural Network (CNN\u20101D), Long\u2010Short Term Memory (LSTM), and Temporal Convolutional Network (TCN) architectures. The models achieved classification testing accuracies confidence intervals of [95.40%, 96.50%], [92.55%, 93.84%], and [93.47%, 94.76%], respectively, validating the high\u2010performance and utility of our multimodal sensing approach.<\/jats:p>","DOI":"10.1155\/joro\/6642796","type":"journal-article","created":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T04:11:25Z","timestamp":1774584685000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Object Recognition Using Deep Learning\u2010Powered Glove With Flex and MPU Sensors Fusion"],"prefix":"10.1155","volume":"2026","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-3214-0000","authenticated-orcid":false,"given":"Joao Andre Ndombasi","family":"Diakusala","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0717-5850","authenticated-orcid":false,"given":"Zhigeng","family":"Pan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-4829-0024","authenticated-orcid":false,"given":"Ginias Lulendo","family":"Kiveni","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nenglun","family":"Chen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Habachi","family":"Bilal","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9020-3885","authenticated-orcid":false,"given":"Marcellin","family":"Atemkeng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thierry","family":"Bouwmans","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"M. D. Sabbir","family":"Rahman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ange","family":"Ntokusi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"S\u00e9bastien","family":"Lall\u00e9ch\u00e8re","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Blaise","family":"Ravelo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2026,3,26]]},"reference":[{"key":"e_1_2_9_1_2","doi-asserted-by":"publisher","DOI":"10.3390\/s21082667"},{"key":"e_1_2_9_2_2","doi-asserted-by":"crossref","unstructured":"IacobR.andPopescuD. Haptics Democratization: Challenges and Opportunities 290 MATEC Web of Conferences 2019 EDP Sciences 04006.","DOI":"10.1051\/matecconf\/201929004006"},{"key":"e_1_2_9_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2024.3394674"},{"key":"e_1_2_9_4_2","doi-asserted-by":"publisher","DOI":"10.3390\/ma18174010"},{"key":"e_1_2_9_5_2","doi-asserted-by":"publisher","DOI":"10.1002\/aisy.202100091"},{"key":"e_1_2_9_6_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-019-1234-z"},{"key":"e_1_2_9_7_2","doi-asserted-by":"publisher","DOI":"10.1002\/cav.2258"},{"key":"e_1_2_9_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2024.3456487"},{"key":"e_1_2_9_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2025.3532601"},{"key":"e_1_2_9_10_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0280841"},{"key":"e_1_2_9_11_2","doi-asserted-by":"publisher","DOI":"10.31127\/tuje.1658662"},{"key":"e_1_2_9_12_2","doi-asserted-by":"crossref","first-page":"917","DOI":"10.1007\/s10618-019-00619-1","article-title":"Deep Learning for Time Series Classification: A Review","volume":"33","author":"Fawaz H. I.","year":"2019","journal-title":"Data Mining and Knowledge Discovery"},{"key":"e_1_2_9_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-020-00710-y"},{"key":"e_1_2_9_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2018.02.010"},{"key":"e_1_2_9_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2015.2468589"},{"key":"e_1_2_9_16_2","doi-asserted-by":"crossref","unstructured":"ZhengY. LiuQ. ChenE. GeY. andZhaoJ. Time Series Classification Using Multi-Channels Deep Convolutional Neural Networks Web-Age Information Management 2014 Springer 298\u2013310.","DOI":"10.1007\/978-3-319-08010-9_33"},{"key":"e_1_2_9_17_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_9_18_2","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-24797-2","volume-title":"Supervised Sequence Labelling with Recurrent Neural Networks","author":"Graves A.","year":"2012"},{"key":"e_1_2_9_19_2","article-title":"An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling","volume":"1803","author":"Bai S.","year":"2018","journal-title":"ArXiv"},{"key":"e_1_2_9_20_2","doi-asserted-by":"crossref","unstructured":"LeaC. VidalR. ReiterA. andHagerG. D. Temporal Convolutional Networks: A Unified Approach to Action Segmentation 2016 Springer Verlag 47\u201354 The European Conference on Computer Vision (ECCV).","DOI":"10.1007\/978-3-319-49409-8_7"},{"key":"e_1_2_9_21_2","volume-title":"Neural Networks","author":"Bengio Y.","year":"2012"},{"key":"e_1_2_9_22_2","volume-title":"Deep Learning","author":"Goodfellow I.","year":"2016"},{"key":"e_1_2_9_23_2","article-title":"Random Search for Hyper-Parameter Optimization","volume":"13","author":"Bergstra J.","year":"2012","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_9_24_2","doi-asserted-by":"publisher","DOI":"10.53555\/AJBR.v27i4S.4345"},{"key":"e_1_2_9_25_2","doi-asserted-by":"crossref","unstructured":"CholletF. Xception: Deep Learning With Depthwise Separable Convolutions Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2017 1800\u20131807.","DOI":"10.1109\/CVPR.2017.195"},{"key":"e_1_2_9_26_2","article-title":"Towards Biologically Plausible Deep Learning","volume":"1502","author":"Bengio Y.","year":"2015","journal-title":"arXiv"},{"key":"e_1_2_9_27_2","doi-asserted-by":"publisher","DOI":"10.3390\/s24134378"},{"key":"e_1_2_9_28_2","doi-asserted-by":"crossref","unstructured":"MurphyD. LiY. andOwensC. E. et al.Fits Like a Flex-Glove: Automatic Design of Personalized FPCB\u2013Based Tactile Sensing Gloves Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems 2025 Association for Computing Machinery 1\u20138.","DOI":"10.1145\/3706599.3720147"},{"key":"e_1_2_9_29_2","doi-asserted-by":"crossref","unstructured":"ZhouH. ZhangS. andPengJ. et al.Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting 35 Proceedings of the AAAI Conference on Artificial Intelligence 2021 AAAI Conference on Artificial Intelligence 11106\u201311115.","DOI":"10.1609\/aaai.v35i12.17325"},{"key":"e_1_2_9_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2019.04.014"},{"key":"e_1_2_9_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.measurement.2023.113105"}],"container-title":["Journal of Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/joro\/6642796","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1155\/joro\/6642796","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/joro\/6642796","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T04:11:49Z","timestamp":1774584709000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/joro\/6642796"}},"subtitle":[],"editor":[{"given":"Yangmin","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2026,1]]},"references-count":31,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1]]}},"alternative-id":["10.1155\/joro\/6642796"],"URL":"https:\/\/doi.org\/10.1155\/joro\/6642796","archive":["Portico"],"relation":{},"ISSN":["1687-9600","1687-9619"],"issn-type":[{"value":"1687-9600","type":"print"},{"value":"1687-9619","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1]]},"assertion":[{"value":"2025-12-19","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-01-30","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-03-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"6642796"}}