{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T07:21:53Z","timestamp":1770880913560,"version":"3.50.1"},"reference-count":51,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2016,11,15]],"date-time":"2016-11-15T00:00:00Z","timestamp":1479168000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Exergames have been proposed as a potential tool to improve the current practice of musculoskeletal rehabilitation. Inertial or optical motion capture sensors are commonly used to track the subject\u2019s movements. However, the use of these motion capture tools suffers from the lack of accuracy in estimating joint angles, which could lead to wrong data interpretation. In this study, we proposed a real time quaternion-based fusion scheme, based on the extended Kalman filter, between inertial and visual motion capture sensors, to improve the estimation accuracy of joint angles. The fusion outcome was compared to angles measured using a goniometer. The fusion output shows a better estimation, when compared to inertial measurement units and Kinect outputs. We noted a smaller error (3.96\u00b0) compared to the one obtained using inertial sensors (5.04\u00b0). The proposed multi-sensor fusion system is therefore accurate enough to be applied, in future works, to our serious game for musculoskeletal rehabilitation.<\/jats:p>","DOI":"10.3390\/s16111914","type":"journal-article","created":{"date-parts":[[2016,11,15]],"date-time":"2016-11-15T10:25:31Z","timestamp":1479205531000},"page":"1914","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":47,"title":["A New Multi-Sensor Fusion Scheme to Improve the Accuracy of Knee Flexion Kinematics for Functional Rehabilitation Movements"],"prefix":"10.3390","volume":"16","author":[{"given":"Halim","family":"Tannous","sequence":"first","affiliation":[{"name":"Sorbonne University, Universit\u00e9 de Technologie de Compi\u00e8gne, CNRS, UMR 7338 Biomechanics and Bioengineering, 60200 Compi\u00e8gne, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5906-4947","authenticated-orcid":false,"given":"Dan","family":"Istrate","sequence":"additional","affiliation":[{"name":"Sorbonne University, Universit\u00e9 de Technologie de Compi\u00e8gne, CNRS, UMR 7338 Biomechanics and Bioengineering, 60200 Compi\u00e8gne, France"}]},{"given":"Aziz","family":"Benlarbi-Delai","sequence":"additional","affiliation":[{"name":"Sorbonne University, Universit\u00e9 Pierre et Marie Curie, L2E, Place Jussieu, 75252 Paris, France"}]},{"given":"Julien","family":"Sarrazin","sequence":"additional","affiliation":[{"name":"Sorbonne University, Universit\u00e9 Pierre et Marie Curie, L2E, Place Jussieu, 75252 Paris, France"}]},{"given":"Didier","family":"Gamet","sequence":"additional","affiliation":[{"name":"Sorbonne University, Universit\u00e9 de Technologie de Compi\u00e8gne, CNRS, UMR 7338 Biomechanics and Bioengineering, 60200 Compi\u00e8gne, France"}]},{"given":"Marie","family":"Ho Ba Tho","sequence":"additional","affiliation":[{"name":"Sorbonne University, Universit\u00e9 de Technologie de Compi\u00e8gne, CNRS, UMR 7338 Biomechanics and Bioengineering, 60200 Compi\u00e8gne, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5088-3433","authenticated-orcid":false,"given":"Tien","family":"Dao","sequence":"additional","affiliation":[{"name":"Sorbonne University, Universit\u00e9 de Technologie de Compi\u00e8gne, CNRS, UMR 7338 Biomechanics and Bioengineering, 60200 Compi\u00e8gne, France"}]}],"member":"1968","published-online":{"date-parts":[[2016,11,15]]},"reference":[{"key":"ref_1","unstructured":"Hartley, S., Ilagan, V., Madden, A., Posarac, A., Seelman, K., Shakespeare, T., Sipos, S., Swanson, M., Thomas, M., and Qiu, Z. (2011). World Report on Disability, WHO."},{"key":"ref_2","unstructured":"Perry, J.C., Andureu, J., Cavallaro, F.I., Veneman, J., Carmien, S., and Keller, T. (2010). Handbook of Research on Improving Learning and Motivation through Educational Games, IGI Global."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2566","DOI":"10.1016\/j.ridd.2011.07.002","article-title":"A Kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilities","volume":"32","author":"Chang","year":"2011","journal-title":"Res. Dev. Disabil."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.eurtel.2016.05.001","article-title":"Serious game and functional rehabilitation for the lower limbs","volume":"5","author":"Tannous","year":"2016","journal-title":"Eur. Res. Telemed."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1016\/j.cmpb.2013.04.021","article-title":"Development of a system based on 3D vision, interactive virtual environments, ergonometric signals and a humanoid for stroke rehabilitation","volume":"112","author":"Tamayo","year":"2013","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1016\/j.procs.2015.08.352","article-title":"HeartHealth: A Cardiovascular Disease Home-based Rehabilitation System","volume":"63","author":"Chatzitofis","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"e12","DOI":"10.2196\/games.2933","article-title":"Virtual Rehabilitation for Multiple Sclerosis Using a Kinect-Based System: Randomized Controlled Trial","volume":"2","author":"Fardoun","year":"2014","journal-title":"JMIR Serious Games"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Sun, T.-L., and Lee, C.-H. (2013). An Impact Study of the Design of Exergaming Parameters on Body Intensity from Objective and Gameplay-Based Player Experience Perspectives, Based on Balance Training Exergame. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0069471"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1016\/j.entcom.2014.10.006","article-title":"Design guidelines for developing customised serious games for Parkinson\u2019s Disease rehabilitation using bespoke game sensors","volume":"5","author":"Paraskevopoulos","year":"2014","journal-title":"Entertain. Comput."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1016\/j.cmpb.2013.09.006","article-title":"Development of virtual reality proprioceptive rehabilitation system for stroke patients","volume":"113","author":"Cho","year":"2014","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1016\/j.archger.2012.05.012","article-title":"Lower limb power rehabilitation (LLPR) using interactive video game for improvement of balance function in older people","volume":"55","author":"Chen","year":"2012","journal-title":"Arch. Gerontol. Geriatr."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.displa.2012.08.004","article-title":"Motion games improve balance control in stroke survivors: A preliminary study based on the principle of constraint-induced movement therapy","volume":"34","author":"Ding","year":"2013","journal-title":"Displays"},{"key":"ref_13","unstructured":"Jintrinix. Available online: www.jintronix.com\/."},{"key":"ref_14","unstructured":"Virtual-Reality. Available online: www.virtual-reality-rehabilitation.com\/products\/seeme."},{"key":"ref_15","unstructured":"RespondWell. Available online: www.respondwell.com\/."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1007\/BF02345283","article-title":"Detecting absolute human knee angle and angular velocity using accelerometers and rate gyroscopes","volume":"39","author":"Williamson","year":"2001","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1016\/S0021-9290(01)00231-7","article-title":"Accelerometer and rate gyroscope measurement of kinematics: An inexpensive alternative to optical motion analysis systems","volume":"35","author":"Mayagoitia","year":"2002","journal-title":"J. Biomech."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1029","DOI":"10.1016\/j.jbiomech.2007.12.003","article-title":"Ambulatory measurement of 3D knee joint angle","volume":"41","author":"Favre","year":"2008","journal-title":"J. Biomech."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1016\/j.measurement.2009.02.002","article-title":"Development of a wearable sensor system for quantitative gait analysis","volume":"42","author":"Liu","year":"2009","journal-title":"Measurement"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"10733","DOI":"10.3390\/s101210733","article-title":"Upper Limb Portable Motion Analysis System Based on Inertial Technology for Neurorehabilitation Purposes","volume":"10","author":"Costa","year":"2010","journal-title":"Sensors"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A new approach to linear filtering and prediction problems","volume":"82","author":"Kalman","year":"1960","journal-title":"J. Basic Eng."},{"key":"ref_22","unstructured":"Marins, J.L., Yun, X., Bachmann, E.R., McGhee, R.B., and Zyda, M.J. (November, January 29). An Extended Kalman Filter for Quaternion-Based Orientation Estimation Using MARG Sensors. Proceedings of the International Conference on Intelligent Robots and Systems, 2001 IEEE\/RSJ, Maui, HI, USA."},{"key":"ref_23","unstructured":"Abyarjoo, F., Barreto, A., Cofino, J., and Ortega, F.R. (2015). Innovations and Advances in Computing, Informatics, Systems Sciences, Networking and Engineering, Springer."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Madgwick, S.O., Harrison, A.J., and Vaidyanathan, R. (July, January 29). Estimation of IMU and MARG Orientation Using a Gradient Descent Algorithm. Proceedings of the 2011 IEEE International Conference on Rehabilitation Robotics (ICORR), Zurich, Switzerland.","DOI":"10.1109\/ICORR.2011.5975346"},{"key":"ref_25","unstructured":"ShimmerSensing. Available online: www.shimmersensing.com\/."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Miezal, M., Taetz, B., and Bleser, G. (2016). On Inertial Body Tracking in the Presence of Model Calibration Errors. Sensors, 7.","DOI":"10.3390\/s16071132"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1478","DOI":"10.1109\/TBME.2005.851475","article-title":"A New Approach to Accurate Measurement of Uniaxial Joint Angles Based on a Combination of Accelerometers and Gyroscopes","volume":"52","author":"Dejnabadi","year":"2005","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1385","DOI":"10.1109\/TBME.2006.873678","article-title":"Estimation and Visualization of Sagittal Kinematics of Lower Limbs Orientation Using Body-Fixed Sensors","volume":"53","author":"Dejnabadi","year":"2006","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2330","DOI":"10.1016\/j.jbiomech.2009.06.025","article-title":"Functional calibration procedure for 3D knee joint angle description using inertial sensors","volume":"42","author":"Favre","year":"2009","journal-title":"J. Biomech."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"18813","DOI":"10.3390\/s150818813","article-title":"Upper Limb Kinematics Using Inertial and Magnetic Sensors: Comparison of Sensor-to-Segment Calibrations","volume":"8","author":"Bouvier","year":"2015","journal-title":"Sensors"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhang, L., Sturm, J., Cremers, D., and Lee, D. (2012, January 7\u201312). Real-Time Human Motion Tracking Using Multiple Depth Cameras. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Vilamoura-Algarve, Portugal.","DOI":"10.1109\/IROS.2012.6385968"},{"key":"ref_32","unstructured":"Feng, S., and Murray-Smith, R. (2014, January 30). Fusing Kinect Sensor and Inertial Sensors with Multi-Rate Kalman Filter. Proceedings of the IET Conference on Data Fusion & Target Tracking 2014: Algorithms and Applications (DF&TT 2014), Liverpool, UK."},{"key":"ref_33","unstructured":"Destelle, F., Ahmadi, A., O\u2019Connor, N.E., Moran, K., Chatzitofis, A., Zarpalas, D., and Daras, P. (2014, January 1\u20135). Low-Cost Accurate Skeleton Tracking Based on Fusion of Kinect and Wearable Inertial Sensors. Proceedings of the 22nd European Signal Processing Conference (EUSIPCO), Lisbon, Portugal."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"091005","DOI":"10.1115\/1.4034170","article-title":"Human Arm Motion Tracking by Orientation-Based Fusion of Inertial Sensors and Kinect Using Unscented Kalman Filter","volume":"138","author":"Atrsaei","year":"2016","journal-title":"J. Biomech. Eng."},{"key":"ref_35","unstructured":"Kalkbrenner, C., Hacker, S., Algorri, M., and Blechschmidt-trapp, R. (2014, January 3\u20136). Motion Capturing with Inertial Measurement Units and Kinect\u2014Tracking of Limb Movement using Optical and Orientation Information. Proceedings of the International Conference on Biomedical Electronics and Devices, Angers, France."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.neucom.2015.01.071","article-title":"Upper limb motion tracking with the integration of IMU and Kinect","volume":"159","author":"Tian","year":"2015","journal-title":"Neurocomputing"},{"key":"ref_37","unstructured":"Glonek, G., and Wojciechowski, A. (2016). Information Technologies in Medicine, Springer International Publishing."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.eurtel.2016.05.004","article-title":"Feasibility study of a serious game based on Kinect system for functional rehabilitation of the lower limbs","volume":"5","author":"Tannous","year":"2016","journal-title":"Eur. Res. Telemed."},{"key":"ref_39","unstructured":"NASA Mission Planning and Analysis Division Euler Angles, Quaternions, and Transformation Matrices, Available online: www.ntrs.nasa.gov\/archive\/nasa\/casi.ntrs.nasa.gov\/19770024290.pdf."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1504\/IJAACS.2013.054828","article-title":"Characterising and minimising sources of error in inertial body sensor networks","volume":"6","author":"Chen","year":"2013","journal-title":"Int. J. Auton. Adap. Commun. Syst."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"W\u00e5hsl\u00e9n, J., Orhan, I., and Lindh, T. (2011). Local Time Synchronization in Bluetooth Piconets for Data Fusion Using Mobile Phones, IEEE.","DOI":"10.1109\/BSN.2011.11"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1016\/0167-9457(91)90046-Z","article-title":"A gait analysis data collection and reduction technique","volume":"10","author":"Davis","year":"1991","journal-title":"Hum. Mov. Sci."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"9183","DOI":"10.3390\/s130709183","article-title":"Optimal Placement of Accelerometers for the Detection of Everyday Activities","volume":"13","author":"Cleland","year":"2013","journal-title":"Sensors"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"131","DOI":"10.5772\/61313","article-title":"Quaternion-based Kalman filter for AHRS using an adaptive-step gradient descent algorithm","volume":"12","author":"Wang","year":"2015","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1867","DOI":"10.1093\/ptj\/67.12.1867","article-title":"Clinical measurement of range of motion review of goniometry emphasizing reliability and validity","volume":"67","author":"Gajdosik","year":"1987","journal-title":"Phys. Ther."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1002\/pri.97","article-title":"Intratester and intertester reliability and criterion validity of the parallelogram and universal goniometers for active knee flexion in health","volume":"2","author":"Brosseau","year":"1997","journal-title":"Physiother. Res. Int."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Dao, T.T., Tannous, H., Pouletaut, P., Gamet, D., Istrate, D., and Ho Ba Tho, M.C. (2016). Interactive and Connected Rehabilitation Systems for E-Health. IRBM.","DOI":"10.1016\/j.irbm.2016.02.003"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Olson, E. (2010, January 18\u201322). A Passive Solution to the Sensor Synchronization Problem. Proceedings of the 2010 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan.","DOI":"10.1109\/IROS.2010.5650579"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1016\/j.gaitpost.2013.09.018","article-title":"Validity and reliability of the Kinect within functional assessment activities: Comparison with standard stereophotogrammetry","volume":"39","author":"Jansen","year":"2014","journal-title":"Gait Posture"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"274","DOI":"10.3109\/03091902.2014.909540","article-title":"Comparative abilities of Microsoft Kinect and Vicon 3D motion capture for gait analysis","volume":"38","author":"Pfister","year":"2014","journal-title":"J. Med. Eng. Technol."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1785","DOI":"10.3390\/s150101785","article-title":"Pose Estimation with a Kinect for Ergonomic Studies: Evaluation of the Accuracy Using a Virtual Mannequin","volume":"15","author":"Plantard","year":"2015","journal-title":"Sensors"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/11\/1914\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:35:35Z","timestamp":1760211335000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/11\/1914"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,11,15]]},"references-count":51,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2016,11]]}},"alternative-id":["s16111914"],"URL":"https:\/\/doi.org\/10.3390\/s16111914","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,11,15]]}}}