{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T11:01:41Z","timestamp":1782903701638,"version":"3.54.5"},"reference-count":36,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2020,8,12]],"date-time":"2020-08-12T00:00:00Z","timestamp":1597190400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In the military, police, security companies, and shooting sports, precision shooting training is of the outmost importance. In order to achieve high shooting accuracy, a lot of training is needed. As a result, trainees use a large number of cartridges and a considerable amount of time of professional trainers, which can cost a lot. Our motivation is to reduce costs and shorten training time by introducing an augmented biofeedback system based on machine learning techniques. We are designing a system that can detect and provide feedback on three types of errors that regularly occur during a precision shooting practice: excessive hand movement error, aiming error and triggering error. The system is designed to provide concurrent feedback on the hand movement error and terminal feedback on the other two errors. Machine learning techniques are used innovatively to identify hand movement errors; the other two errors are identified by the threshold approach. To correct the excessive hand movement error, a precision shot accuracy prediction model based on Random Forest has proven to be the most suitable. The experimental results show that: (1) the proposed Random Forest (RF) model achieves the prediction accuracy of 91.27%, higher than any of the other reference models, and (2) hand movement is strongly related to the accuracy of precision shooting. Appropriate use of the proposed augmented biofeedback system will result in a lower number of rounds used and shorten the precision shooting training process.<\/jats:p>","DOI":"10.3390\/s20164512","type":"journal-article","created":{"date-parts":[[2020,8,12]],"date-time":"2020-08-12T09:14:49Z","timestamp":1597223689000},"page":"4512","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A Random Forest-Based Accuracy Prediction Model for Augmented Biofeedback in a Precision Shooting Training System"],"prefix":"10.3390","volume":"20","author":[{"given":"Junqi","family":"Guo","sequence":"first","affiliation":[{"name":"School of Artificial Intelligence, Beijing Normal University, Beijing 100875, China"},{"name":"Engineering Research Center of Intelligent Technology and Educational Application, Ministry of Education, Beijing 100875, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lan","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Beijing Normal University, Beijing 100875, China"},{"name":"Academy of Broadcasting Planning, National Radio and Television Administration(NRTA), Beijing 100866, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4408-327X","authenticated-orcid":false,"given":"Anton","family":"Umek","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering, University of Ljubljana, Tr\u017ea\u0161ka Cesta 25, 1000 Ljubljana, Slovenia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rongfang","family":"Bie","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Beijing Normal University, Beijing 100875, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sa\u0161o","family":"Toma\u017ei\u010d","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering, University of Ljubljana, Tr\u017ea\u0161ka Cesta 25, 1000 Ljubljana, Slovenia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6234-8561","authenticated-orcid":false,"given":"Anton","family":"Kos","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering, University of Ljubljana, Tr\u017ea\u0161ka Cesta 25, 1000 Ljubljana, Slovenia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.1109\/JBHI.2017.2722870","article-title":"Assessment of homomorphic analysis for human activity recognition from acceleration signals","volume":"22","author":"Vanrell","year":"2017","journal-title":"IEEE J. Biomed. Health"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"242","DOI":"10.3389\/fphys.2019.00242","article-title":"Estimating physical activity in children aged 8-11 years using accelerometry: Contributions from fundamental movement skills and different accelerometer placements","volume":"10","author":"Duncan","year":"2019","journal-title":"Front. Physiol."},{"key":"ref_3","first-page":"29","article-title":"Golf Swing Data Classification with Deep Convolutional Neural Network","volume":"14","author":"Jiao","year":"2018","journal-title":"IPSI BGD Trans. Internet Res."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kidman, E.M., D\u2019Souza, M.J.A., and Singh, S.P.N. (2016, January 19\u201321). A wearable device with inertial motion tracking and vibro-tactile feedback for aesthetic sport athletes Diving Coach Monitor. Proceedings of the 2016 10th International Conference on Signal Processing and Communication Systems (ICSPCS), Gold Coast, QLD, Australia.","DOI":"10.1109\/ICSPCS.2016.7843371"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.patrec.2018.02.010","article-title":"Deep learning for sensor-based activity recognition: A survey","volume":"119","author":"Wang","year":"2019","journal-title":"Pattern Recognit. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Aroganam, G., Manivannan, N., and Harrison, D. (2019). Review on wearable technology sensors used in consumer sport applications. Sensors, 19.","DOI":"10.3390\/s19091983"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Loke, Y.L., Gopalai, A.A., Khoo, B.H., and Senanayake, S.M.N.A. (2009, January 14\u201317). Smart system for archery using ultrasound sensors. Proceedings of the 2009 IEEE\/ASME International Conference on Advanced Intelligent Mechatronics, Singapore.","DOI":"10.1109\/AIM.2009.5229743"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1109\/TITB.2007.899496","article-title":"Detection of daily activities and sports with wearable sensors in controlled and uncontrolled conditions","volume":"12","author":"Ermes","year":"2008","journal-title":"IEEE Trans. Inf. Technol. Biomed."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Rawashdeh, S., Rafeldt, D., and Uhl, T. (2016). Wearable IMU for shoulder injury prevention in overhead sports. Sensors, 16.","DOI":"10.3390\/s16111847"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1016\/j.procs.2019.01.228","article-title":"Sensor System for Precision Precision shooting Evaluation and Real-time Biofeedback","volume":"147","author":"Kos","year":"2019","journal-title":"Procedia Comput. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"7772","DOI":"10.3390\/s100807772","article-title":"A review of accelerometry-based wearable motion detectors for physical activity monitoring","volume":"10","author":"Yang","year":"2010","journal-title":"Sensors"},{"key":"ref_12","unstructured":"Johnson, R.F. (2001). Statistical Measures of Marksmanship."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1016\/j.proeng.2016.06.266","article-title":"Accuracy of postural human-motion tracking using miniature inertial sensors","volume":"147","author":"Dinu","year":"2016","journal-title":"Procedia Eng."},{"key":"ref_14","unstructured":"Osborn, J. (2004). Method and apparatus to provide precision aiming assistance to a shooter. (Application 10\/365,022), U.S. Patent."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1260\/1747-9541.9.1.171","article-title":"Postural balance and rifle stability during standing precision shooting on an indoor gun range without physical stress in different groups of biathletes","volume":"9","author":"Sattlecker","year":"2014","journal-title":"Int. J. Sports Sci. Coaching"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1508","DOI":"10.3923\/itj.2011.1508.1517","article-title":"Applying machine learning methods to the precision shooting accuracy prediction: A case study of T-75 pistol precision shooting","volume":"10","author":"Deng","year":"2011","journal-title":"Inf. Technol. J."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2333","DOI":"10.1080\/02640414.2018.1455261","article-title":"Predicting biathlon precision shooting performance using machine learning","volume":"36","author":"Maier","year":"2018","journal-title":"J. Sports Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1007\/s11517-018-1892-2","article-title":"ECG-based pulse detection during cardiac arrest using random forest classifier","volume":"57","author":"Elola","year":"2019","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/j.eswa.2017.02.017","article-title":"A boosted decision tree approach using Bayesian hyper-parameter optimization for credit scoring","volume":"78","author":"Xia","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kos, A., and Anton, U. (2018). Biomechanical Biofeedback Systems and Applications, Springer.","DOI":"10.1007\/978-3-319-91349-0"},{"key":"ref_21","first-page":"20","article-title":"Survey of recent development in real-time biofeedback systems in sport","volume":"11","author":"Anton","year":"2020","journal-title":"Serbian J. Sports Sci."},{"key":"ref_22","unstructured":"Zhang, Y., Umek, A., Obinikpo, A.A., and KOS, A. (2018, January 16). A Time-Dependent Multi-Class SVM Algorithm for Crowdsourced Mobility Prediction. Available online: http:\/\/ipsitransactions.org\/journals\/papers\/tir\/2018jan\/p7.pdf."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3","DOI":"10.5937\/nabepo24-23287","article-title":"Mathematical model of short distance pistol shooting performance in experienced shooters of both gender","volume":"24","author":"Dopsaj","year":"2019","journal-title":"NBP Nauka Bezbednost Policija"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"255","DOI":"10.2307\/2532051","article-title":"A concordance correlation coefficient to evaluate reproducibility","volume":"45","author":"Lawrence","year":"1989","journal-title":"Biometrics"},{"key":"ref_25","first-page":"1","article-title":"A literature review on reaction time","volume":"10","author":"Kosinski","year":"2008","journal-title":"Clemson Univ."},{"key":"ref_26","first-page":"e1301","article-title":"Hyperparameters and tuning strategies for random forest","volume":"9","author":"Probst","year":"2019","journal-title":"Wiley Interdiscip. Rev."},{"key":"ref_27","unstructured":"Bergstra, J.S., Bardenet, R., Bengio, Y., and K\u00e9gl, B. (2011, January 12). Algorithms for hyper-parameter optimization. Proceedings of the Advances in Neural Information Processing Systems, Cambridge, MA, USA."},{"key":"ref_28","unstructured":"Bardenet, R., Brendel, M., K\u00e9gl, B., and Sebag, M. (2013, January 21). Collaborative hyperparameter tuning. Proceedings of the International conference on machine learning, Oxford, UK."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"014008","DOI":"10.1088\/1749-4699\/8\/1\/014008","article-title":"Hyperopt: A python library for model selection and hyperparameter optimization","volume":"8","author":"Bergstra","year":"2015","journal-title":"Comput. Sci. Discov."},{"key":"ref_30","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hosmer, D.W., Lemeshow, S., and Sturdivant, R.X. (2013). Applied Logistic Regression, John Wiley & Sons.","DOI":"10.1002\/9781118548387"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2087","DOI":"10.1016\/j.scitotenv.2018.10.064","article-title":"An ensemble prediction of flood susceptibility using multivariate discriminant analysis, classification and regression trees, and support vector machines","volume":"651","author":"Choubin","year":"2019","journal-title":"Sci. Total Environ."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1109\/21.97458","article-title":"A survey of decision tree classifier methodology","volume":"21","author":"Safavian","year":"1991","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/TIT.1967.1053964","article-title":"Nearest neighbor pattern classification","volume":"13","author":"Cover","year":"1967","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Schapire, R.E. (2013). Explaining Ada Boost, Springer.","DOI":"10.1007\/978-3-642-41136-6_5"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1214\/aos\/1013203451","article-title":"Greedy function approximation: A gradient boosting machine","volume":"29","author":"Friedman","year":"2001","journal-title":"Ann. Stat."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/16\/4512\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:59:41Z","timestamp":1760176781000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/16\/4512"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,12]]},"references-count":36,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2020,8]]}},"alternative-id":["s20164512"],"URL":"https:\/\/doi.org\/10.3390\/s20164512","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,12]]}}}