{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T18:36:01Z","timestamp":1772130961191,"version":"3.50.1"},"reference-count":42,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2021,9,12]],"date-time":"2021-09-12T00:00:00Z","timestamp":1631404800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Optical motion capture is a mature contemporary technique for the acquisition of motion data; alas, it is non-error-free. Due to technical limitations and occlusions of markers, gaps might occur in such recordings. The article reviews various neural network architectures applied to the gap-filling problem in motion capture sequences within the FBM framework providing a representation of body kinematic structure. The results are compared with interpolation and matrix completion methods. We found out that, for longer sequences, simple linear feedforward neural networks can outperform the other, sophisticated architectures, but these outcomes might be affected by the small amount of data availabe for training. We were also able to identify that the acceleration and monotonicity of input sequence are the parameters that have a notable impact on the obtained results.<\/jats:p>","DOI":"10.3390\/s21186115","type":"journal-article","created":{"date-parts":[[2021,9,12]],"date-time":"2021-09-12T21:48:01Z","timestamp":1631483281000},"page":"6115","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Gap Reconstruction in Optical Motion Capture Sequences Using Neural Networks"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5306-9528","authenticated-orcid":false,"given":"Przemys\u0142aw","family":"Skurowski","sequence":"first","affiliation":[{"name":"Department of Graphics, Computer Vision and Digital Systems, Faculty of Automatic Control, Electronics and Computer Science, Silesian University of Technology, Akademicka 16, 44-100 Gliwice, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4708-4956","authenticated-orcid":false,"given":"Magdalena","family":"Pawlyta","sequence":"additional","affiliation":[{"name":"Department of Graphics, Computer Vision and Digital Systems, Faculty of Automatic Control, Electronics and Computer Science, Silesian University of Technology, Akademicka 16, 44-100 Gliwice, Poland"},{"name":"Polish-Japanese Academy of Information Technology, Koszykowa 86, 02-008 Warsaw, Poland"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Kitagawa, M., and Windsor, B. (2008). MoCap for Artists: Workflow and Techniques for Motion Capture, Focal Press.","DOI":"10.1016\/B978-0-240-81000-3.50013-9"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Menache, A. (2011). Understanding Motion Capture for Computer Animation, Morgan Kaufmann. [2nd ed.].","DOI":"10.1016\/B978-0-12-381496-8.00001-9"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1186\/1743-0003-3-6","article-title":"The evolution of methods for the capture of human movement leading to markerless motion capture for biomechanical applications","volume":"3","author":"Corazza","year":"2006","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1038\/s41597-021-00801-5","article-title":"Optical motion capture dataset of selected techniques in beginner and advanced Kyokushin karate athletes","volume":"8","author":"Pawlyta","year":"2021","journal-title":"Sci. Data"},{"key":"ref_5","first-page":"173","article-title":"Diagnosis of the motion pathologies based on a reduced kinematical data of a gait","volume":"87","author":"Mucha","year":"2011","journal-title":"Przegl\u0105D Elektrotechniczny"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"\u015al\u0119zak, D., Tan, A.H., Peters, J.F., and Schwabe, L. (2014). The Analysis of Correlation between MOCAP-Based and UPDRS-Based Evaluation of Gait in Parkinson\u2019s Disease Patients. Brain Informatics and Health, Springer International Publishing. Number 8609 in Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-319-09891-3"},{"key":"ref_7","first-page":"279","article-title":"Evaluation of rehabilitation progress of patients with osteoarthritis of the hip, osteoarthritis of the spine or after stroke using gait indices","volume":"89","author":"Josinski","year":"2013","journal-title":"Przegl\u0105d Elektrotechniczny"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2776","DOI":"10.1016\/j.jbiomech.2008.06.024","article-title":"Systematic accuracy and precision analysis of video motion capturing systems\u2014Exemplified on the Vicon-460 system","volume":"41","author":"Windolf","year":"2008","journal-title":"J. Biomech."},{"key":"ref_9","unstructured":"Jensenius, A., Nymoen, K., Skogstad, S., and Voldsund, A. (2012, January 11\u201314). A Study of the Noise-Level in Two Infrared Marker-Based Motion Capture Systems. Proceedings of the 9th Sound and Music Computing Conference, SMC 2012, Copenhagen, Denmark."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Skurowski, P., and Pawlyta, M. (2019). On the Noise Complexity in an Optical Motion Capture Facility. Sensors, 19.","DOI":"10.20944\/preprints201909.0178.v1"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"71","DOI":"10.18576\/amis\/100107","article-title":"Functional Body Mesh Representation, A Simplified Kinematic Model, Its Inference and Applications","volume":"10","author":"Skurowski","year":"2016","journal-title":"Appl. Math. Inf. Sci."},{"key":"ref_12","unstructured":"Herda, L., Fua, P., Plankers, R., Boulic, R., and Thalmann, D. (2000, January 3\u20135). Skeleton-based motion capture for robust reconstruction of human motion. Proceedings of the Proceedings Computer Animation 2000, Philadelphia, PA, USA. ISSN: 1087-4844."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1007\/s00371-011-0671-y","article-title":"Real-time marker prediction and CoR estimation in optical motion capture","volume":"29","author":"Aristidou","year":"2013","journal-title":"Vis. Comput."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Perepichka, M., Holden, D., Mudur, S.P., and Popa, T. (2019). Robust Marker Trajectory Repair for MOCAP using Kinematic Reference. Motion, Interaction and Games, Association for Computing Machinery. MIG\u201919.","DOI":"10.1145\/3359566.3360060"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lee, J., and Shin, S.Y. (1999, January 8\u201313). A hierarchical approach to interactive motion editing for human-like figures. Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, Los Angeles, CA, USA.","DOI":"10.1145\/311535.311539"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1080\/10255841003664701","article-title":"Quantitative assessment of the accuracy for three interpolation techniques in kinematic analysis of human movement","volume":"13","author":"Howarth","year":"2010","journal-title":"Comput. Methods Biomech. Biomed. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Reda, H.E.A., Benaoumeur, I., Kamel, B., and Zoubir, A.F. (2018, January 10\u201313). MoCap systems and hand movement reconstruction using cubic spline. Proceedings of the 2018 5th International Conference on Control, Decision and Information Technologies (CoDIT), Thessaloniki, Greece.","DOI":"10.1109\/CoDIT.2018.8394887"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1007\/s00371-006-0080-9","article-title":"Estimation of missing markers in human motion capture","volume":"22","author":"Liu","year":"2006","journal-title":"Vis. Comput."},{"key":"ref_19","unstructured":"Avis, N., and Lefebvre, S. (2011). Motion Capture Data Completion and Denoising by Singular Value Thresholding. Eurographics 2011\u2014Short Papers, The Eurographics Association."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Gl\u00f8ersen, \u00d8., and Federolf, P. (2016). Predicting Missing Marker Trajectories in Human Motion Data Using Marker Intercorrelations. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0152616"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Tits, M., Tilmanne, J., and Dutoit, T. (2018). Robust and automatic motion-capture data recovery using soft skeleton constraints and model averaging. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0199744"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Magnenat-Thalmann, N. (2009). Predicting Missing Markers in Real-Time Optical Motion Capture. Modelling the Physiological Human, Springer. Number 5903 in Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-642-10470-1"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wu, Q., and Boulanger, P. (2011, January 23\u201326). Real-Time Estimation of Missing Markers for Reconstruction of Human Motion. Proceedings of the 2011 XIII Symposium on Virtual Reality, Uberlandia, Brazil.","DOI":"10.1109\/SVR.2011.35"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Li, L., McCann, J., Pollard, N.S., and Faloutsos, C. (2009). DynaMMo: Mining and summarization of coevolving sequences with missing values. Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Association for Computing Machinery.","DOI":"10.1145\/1557019.1557078"},{"key":"ref_25","unstructured":"Li, L., McCann, J., Pollard, N., and Faloutsos, C. (2010). BoLeRO: A Principled Technique for Including Bone Length Constraints in Motion Capture Occlusion Filling. Proceedings of the 2010 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation, Eurographics Association."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1854","DOI":"10.1016\/j.jbiomech.2016.04.016","article-title":"Estimating missing marker positions using low dimensional Kalman smoothing","volume":"49","author":"Burke","year":"2016","journal-title":"J. Biomech."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wang, Z., Liu, S., Qian, R., Jiang, T., Yang, X., and Zhang, J.J. (2017, January 6\u201310). Human motion data refinement unitizing structural sparsity and spatial-temporal information. Proceedings of the IEEE 13th International Conference on Signal Processing (ICSP), Chengdu, China.","DOI":"10.1109\/ICSP.2016.7877975"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1111\/cgf.13362","article-title":"Self-similarity Analysis for Motion Capture Cleaning","volume":"37","author":"Aristidou","year":"2018","journal-title":"Comput. Graph. Forum"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, X., and van de Panne, M. (2018, January 8\u201310). Data-driven autocompletion for keyframe animation. Proceedings of the 11th Annual International Conference on Motion, Interaction, and Games, New York, NY, USA.","DOI":"10.1145\/3274247.3274502"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/0893-6080(91)90009-T","article-title":"Approximation capabilities of multilayer feedforward networks","volume":"4","author":"Hornik","year":"1991","journal-title":"Neural Netw."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Fragkiadaki, K., Levine, S., Felsen, P., and Malik, J. (2015, January 7\u201313). Recurrent Network Models for Human Dynamics. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile. ISSN: 2380-7504.","DOI":"10.1109\/ICCV.2015.494"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"60:60:1","DOI":"10.1145\/3386569.3392480","article-title":"Robust motion in-betweening","volume":"39","author":"Harvey","year":"2020","journal-title":"ACM Trans. Graph."},{"key":"ref_33","unstructured":"Mall, U., Lal, G.R., Chaudhuri, S., and Chaudhuri, P. (2017). A Deep Recurrent Framework for Cleaning Motion Capture Data. arXiv."},{"key":"ref_34","unstructured":"Kucherenko, T., Beskow, J., and Kjellstr\u00f6m, H. (2018). A Neural Network Approach to Missing Marker Reconstruction in Human Motion Capture. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"165:1","DOI":"10.1145\/3197517.3201302","article-title":"Robust solving of optical motion capture data by denoising","volume":"37","author":"Holden","year":"2018","journal-title":"ACM Trans. Graph."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Ji, L., Liu, R., Zhou, D., Zhang, Q., and Wei, X. (2020, January 23\u201325). Missing Data Recovery for Human Mocap Data Based on A-LSTM and LS Constraint. Proceedings of the 2020 IEEE 5th International Conference on Signal and Image Processing (ICSIP), Nanjing, China.","DOI":"10.1109\/ICSIP49896.2020.9339359"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kaufmann, M., Aksan, E., Song, J., Pece, F., Ziegler, R., and Hilliges, O. (2020). Convolutional Autoencoders for Human Motion Infilling. arXiv.","DOI":"10.1109\/3DV50981.2020.00102"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1089\/big.2020.0159","article-title":"Deep Learning for Time Series Forecasting: A Survey","volume":"9","author":"Torres","year":"2021","journal-title":"Big Data"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"110212","DOI":"10.1016\/j.chaos.2020.110212","article-title":"Predictions for COVID-19 with deep learning models of LSTM, GRU and Bi-LSTM","volume":"140","author":"Shahid","year":"2020","journal-title":"Chaos Solitons Fractals"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Siami-Namini, S., Tavakoli, N., and Namin, A.S. (2019, January 9\u201312). The Performance of LSTM and BiLSTM in Forecasting Time Series. Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA.","DOI":"10.1109\/BigData47090.2019.9005997"},{"key":"ref_41","first-page":"17","article-title":"Neural network structure optimization in pattern recognition","volume":"35","author":"Czekalski","year":"2014","journal-title":"Stud. Inform."},{"key":"ref_42","unstructured":"Srebro, N., and Jaakkola, T. (2003, January 21\u201324). Weighted low-rank approximations. Proceedings of the Twentieth International Conference on International Conference on Machine Learning, Washington, DC, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/18\/6115\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:01:17Z","timestamp":1760166077000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/18\/6115"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,12]]},"references-count":42,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["s21186115"],"URL":"https:\/\/doi.org\/10.3390\/s21186115","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,12]]}}}