{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:58:27Z","timestamp":1760241507985,"version":"build-2065373602"},"reference-count":30,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2018,4,25]],"date-time":"2018-04-25T00:00:00Z","timestamp":1524614400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Estimation of the motion of ball-shaped objects is essential for the operation of ball sport simulators. In this paper, we propose an estimation system for 3D ball motion, including speed and angle of projection, by using acoustic vector and infrared (IR) scanning sensors. Our system is comprised of three steps to estimate a ball motion: sound-based ball firing detection, sound source localization, and IR scanning for motion analysis. First, an impulsive sound classification based on the mel-frequency cepstrum and feed-forward neural network is introduced to detect the ball launch sound. An impulsive sound source localization using a 2D microelectromechanical system (MEMS) microphones and delay-and-sum beamforming is presented to estimate the firing position. The time and position of a ball in 3D space is determined from a high-speed infrared scanning method. Our experimental results demonstrate that the estimation of ball motion based on sound allows a wider activity area than similar camera-based methods. Thus, it can be practically applied to various simulations in sports such as soccer and baseball.<\/jats:p>","DOI":"10.3390\/s18051323","type":"journal-article","created":{"date-parts":[[2018,4,25]],"date-time":"2018-04-25T03:22:45Z","timestamp":1524626565000},"page":"1323","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Optical and Acoustic Sensor-Based 3D Ball Motion Estimation for Ball Sport Simulators \u2020"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7400-3966","authenticated-orcid":false,"given":"Sang-Woo","family":"Seo","sequence":"first","affiliation":[{"name":"Creative Content Research Division, Electronics and Telecommunications Research Institute, 218 Gajeong-ro, Yuseong-gu, Daejeon 34129, Korea"}]},{"given":"Myunggyu","family":"Kim","sequence":"additional","affiliation":[{"name":"Creative Content Research Division, Electronics and Telecommunications Research Institute, 218 Gajeong-ro, Yuseong-gu, Daejeon 34129, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4209-4266","authenticated-orcid":false,"given":"Yejin","family":"Kim","sequence":"additional","affiliation":[{"name":"School of Games, Hongik University, 2639 Sejong-ro, Jochiwon-eup, Sejong 30016, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2018,4,25]]},"reference":[{"key":"ref_1","unstructured":"(2018, April 21). Golfzone. Available online: https:\/\/www.golfzongolf.com\/."},{"key":"ref_2","unstructured":"Lee, S.-J., Kwon, H.-J., and Kim, H.-G. (2015). Screen Baseball Game Apparatus without Temporal and Spatial limitations. (9604114B2), U.S. Patent."},{"key":"ref_3","unstructured":"(2018, April 11). Sports Entertainment Specialists Soccer Simulator. Available online: http:\/\/www.sportsentertainmentspecialists.com\/MultiSportSimulators\/soccer.html."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kim, J., and Kim, M. (2015, January 28\u201330). Smart vision system for soccer training. Proceedings of the 2015 International Conference on Information and Communication Technology Convergence (ICTC), Jeju, Korea.","DOI":"10.1109\/ICTC.2015.7354543"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1109\/TCE.2010.5505964","article-title":"Measurement of initial motion of a flying golf ball with multi-exposure images for screen-golf","volume":"56","author":"Jung","year":"2010","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"832","DOI":"10.4218\/etrij.17.0117.0157","article-title":"Acoustic Event Detection in Multichannel Audio Using Gated Recurrent Neural Networks with High-Resolution Spectral Features","volume":"39","author":"Kim","year":"2017","journal-title":"ETRI J."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhao, X., and Wang, D. (2013, January 26\u201331). Analyzing noise robustness of MFCC and GFCC features in speaker identification. Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, Vancouver, BC, Canada.","DOI":"10.1109\/ICASSP.2013.6639061"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zeng, Z., and Wang, J. (2010). Impulsive Environment Sound Detection by Neural Classification of Spectrogram and Mel-Frequency Coefficient Images. Advances in Neural Network Research and Applications, Springer.","DOI":"10.1007\/978-3-642-12990-2"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1851","DOI":"10.1121\/1.400208","article-title":"Environmentally tolerant beamforming for high-resolution matched field processing: Deterministic mismatch","volume":"88","author":"Schmidt","year":"1990","journal-title":"J. Acoust. Soc. Am."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Riley, H.B., and Tague, J.A. (1993, January 27\u201330). Matched field source detection and localization in high noise environments: A novel reduced-rank signal processing approach. Proceedings of the 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing, Minneapolis, MN, USA.","DOI":"10.1109\/ICASSP.1993.319113"},{"key":"ref_11","first-page":"586","article-title":"Can we hear the shape of a noise source\/ulcorner","volume":"7","author":"Kim","year":"2004","journal-title":"Trans. Korean Soc. Noise Vib. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Rossing, T.D. (2014). Acoustic Holography. Springer Handbook of Acoustics, Springer.","DOI":"10.1007\/978-1-4939-0755-7"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Tamai, Y., Sasaki, Y., Kagami, S., and Mizoguchi, H. (2005, January 2\u20136). Three ring microphone array for 3D sound localization and separation for mobile robot audition. Proceedings of the 2005 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AB, Canada.","DOI":"10.1109\/IROS.2005.1545095"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Loesch, B., Uhlich, S., and Yang, B. (September, January 31). Multidimensional localization of multiple sound sources using frequency domain ICA and an extended state coherence transform. Proceedings of the 2009 IEEE\/SP 15th Workshop on Statistical Signal Processing, Cardiff, UK.","DOI":"10.1109\/SSP.2009.5278486"},{"key":"ref_15","unstructured":"Valin, J.-M., Michaud, F., Hadjou, B., and Rouat, J. (May, January 26). Localization of Simultaneous Moving Sound Sources for Mobile Robot Using a Frequency-Domain Steered Beamformer Approach. Proceedings of the IEEE International Conference on Robotics and Automation, New Orleans, LA, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/j.ymssp.2014.03.013","article-title":"Impulsive sound source localization using peak and RMS estimation of the time-domain beamformer output","volume":"49","author":"Seo","year":"2014","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_17","unstructured":"Christensen, J.J., and Hald, J. (2004). Beamforming-Br\u00fcel and Kj\u00e6r Technical Review, B & K Publication. [1st ed.]."},{"key":"ref_18","unstructured":"Heilmann, G., Meyer, A., and D\u00f6bler, D. (2018, April 21). Time-domain Beamforming Using 3D-Microphone Arrays. Available online: https:\/\/pdfs.semanticscholar.org\/dc81\/f928af402713b430d5cb021a09799ecbd1c1.pdf."},{"key":"ref_19","unstructured":"(2018, April 11). Real Yagu Zone. Available online: http:\/\/www.realyagu.com\/en\/html\/index.php."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Seo, S.W., and Kim, M. (2016, January 19\u201321). A low cost high-speed infrared scanning system for flying ball detection. Proceedings of the 2016 International Conference on Information and Communication Technology Convergence (ICTC), Jeju, Korea.","DOI":"10.1109\/ICTC.2016.7763465"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Paulraj, M.P., Yaacob, S.B., Nazri, A., and Kumar, S. (2009, January 6\u20138). Classification of vowel sounds using MFCC and feed forward Neural Network. Proceedings of the 2009 5th International Colloquium on Signal Processing Its Applications, Kuala Lumpur, Malaysia.","DOI":"10.1109\/CSPA.2009.5069189"},{"key":"ref_22","unstructured":"International Organization for Standardization (1979). Acoustics, International Organization for Standardization. Draft Addendum ISO 2204."},{"key":"ref_23","unstructured":"IEC-Pub (2018, April 21). 179A, Precision Sound Level Meters Additional Characteristics for the Measurement of Impulsive Sounds. Available online: http:\/\/www.iec.ch."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zimmermann, B., and Studer, C. (June, January 30). FPGA-based real-time acoustic camera prototype. Proceedings of the 2010 IEEE International Symposium on Circuits and Systems, Paris, France.","DOI":"10.1109\/ISCAS.2010.5537301"},{"key":"ref_25","unstructured":"Johnson, D.H., and Dudgeon, D.E. (1993). Array Signal Processing Concepts and Techniques, Prentice Hall."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1121\/1.381733","article-title":"A novel approach to digital beamforming","volume":"63","author":"Pridham","year":"1978","journal-title":"J. Acoust. Soc. Am."},{"key":"ref_27","unstructured":"(2018, April 11). Cirrus CS5381 Evaluation Board. Available online: https:\/\/www.cirrus.com\/products\/cs5381\/."},{"key":"ref_28","unstructured":"Ranchordas, A., Ara\u00fajo, H.J., Pereira, J.M., and Braz, J. (2009). Estimation of 3D Instantaneous Motion of a Ball from a Single Motion-Blurred Image. Computer Vision and Computer Graphics. Theory and Applications, Springer."},{"key":"ref_29","unstructured":"Havr\u00e1nek, Z., Bene\u0161, P., and Klus\u00e1\u010dek, S. (2014, January 13\u201317). Free-field calibration of mems microphone array used for acoustic holography. Proceedings of the 21st International Congress on Sound and Vibration, Beijing, China."},{"key":"ref_30","unstructured":"(2018, April 21). Sports Rader, The Stalker Pro II. Available online: https:\/\/www.stalkerradar.com\/sportsradar\/ProII.html."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/5\/1323\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:02:03Z","timestamp":1760194923000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/5\/1323"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,4,25]]},"references-count":30,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2018,5]]}},"alternative-id":["s18051323"],"URL":"https:\/\/doi.org\/10.3390\/s18051323","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2018,4,25]]}}}