{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:58:36Z","timestamp":1760151516951,"version":"build-2065373602"},"reference-count":61,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,4,6]],"date-time":"2022-04-06T00:00:00Z","timestamp":1649203200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["51778103","52078284"],"award-info":[{"award-number":["51778103","52078284"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Guangdong Basic and Applied Basic Research Foundation","award":["2021A1515011770"],"award-info":[{"award-number":["2021A1515011770"]}]},{"name":"STU Scientific Research Foundation for Talents","award":["NTF18012"],"award-info":[{"award-number":["NTF18012"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The ability to discern subtle image changes over time is useful in applications such as product quality control, civil engineering structure evaluation, medical video analysis, music entertainment, and so on. However, tiny yet useful variations are often combined with large motions, which severely distorts current video amplification methods bounded by external constraints. This paper presents a novel use of spectra to make motion magnification robust to large movements. By exploiting spectra, artificial limitations and the magnification of small motions are avoided at similar frequency levels while ignoring large ones at distinct spectral pixels. To achieve this, this paper constructs spline-kerneled chirplet transform (SCT) into an empirical Bayesian paradigm that applies to the entire time series, giving powerful spectral resolution and robust performance to noise in nonstationary nonlinear signal analysis. The important advance reported is Bayesian-rule embedded SCT (BE-SCT); two numerical experiments show its superiority over current approaches. For applying to spectrum-aware motion magnification, an elaborate analytical framework is established that captures global motion, and use of the proposed BE-SCT for dynamic filtering enables a frequency-based motion isolation. Our approach is demonstrated on real-world and synthetic videos. This approach shows superior qualitative and quantitative results with less visual artifacts and more local details over the state-of-the-art methods.<\/jats:p>","DOI":"10.3390\/s22072794","type":"journal-article","created":{"date-parts":[[2022,4,6]],"date-time":"2022-04-06T05:11:34Z","timestamp":1649221894000},"page":"2794","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Bayesian-Inference Embedded Spline-Kerneled Chirplet Transform for Spectrum-Aware Motion Magnification"],"prefix":"10.3390","volume":"22","author":[{"given":"Enjian","family":"Cai","sequence":"first","affiliation":[{"name":"Department of Civil Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dongsheng","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Civil and Environmental Engineering, Guangdong Engineering Center for Structure Safety and Health Monitoring, Shantou University, Shantou 515063, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianyuan","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of Civil and Environmental Engineering, Guangdong Engineering Center for Structure Safety and Health Monitoring, Shantou University, Shantou 515063, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongnan","family":"Li","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Coastal & Offshore Engineering, Dalian University of Technology, Dalian 116023, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,4,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Balakrishnan, G., Durand, F., and Guttag, J. (2013, January 23\u201328). Detecting Pulse from Head Motions in Video. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.440"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2185520.2185561","article-title":"Eulerian Video Magnification for Revealing Subtle Changes in the World","volume":"31","author":"Wu","year":"2012","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"920","DOI":"10.1212\/WNL.0000000000001914","article-title":"A Microscope for Subtle Movements in Clinical Neurology","volume":"85","author":"Aziz","year":"2015","journal-title":"Neurology"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"21665","DOI":"10.1007\/s11042-016-4079-6","article-title":"Effective recognition of facial micro-expressions with video motion magnification","volume":"76","author":"Wang","year":"2017","journal-title":"Multimed. Tools Appl."},{"key":"ref_5","first-page":"79","article-title":"The Visual Microphone: Passive Recovery of Sound from Video","volume":"33","author":"Davis","year":"2014","journal-title":"Assoc. Comput. Mach. (ACM)"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1007\/978-3-319-30249-2_32","article-title":"Automated Extraction of Mode Shapes Using Motion Magnified Video and Blind Source Separation","volume":"Volume 10","author":"Dorn","year":"2016","journal-title":"Topics in Modal Analysis & Testing"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.engstruct.2016.11.038","article-title":"Output-Only Computer Vision Based Damage Detection Using Phase-Based Optical Flow and Unscented Kalman Filters","volume":"132","author":"Cha","year":"2017","journal-title":"Eng. Struct."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.jsv.2018.01.050","article-title":"Vibration-Based Damage Detection in Wind Turbine Blades using Phase-Based Motion Estimation and Motion Magnification","volume":"421","author":"Sarrafi","year":"2018","journal-title":"J. Sound Vib."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3609","DOI":"10.1007\/s00603-019-01791-y","article-title":"Analysis of the Displacement Field of Soft Rock Samples During UCS Tests by Means of a Computer Vision Technique","volume":"52","author":"Fazio","year":"2019","journal-title":"Rock Mech. Rock Eng."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhang, X., Sheng, C., and Liu, L. (2021, January 23\u201331). Lip Motion Magnification Network for Lip Reading. Proceedings of the 2021 7th International Conference on Big Data and Information Analytics (BigDIA), Chongqing, China.","DOI":"10.1109\/BigDIA53151.2021.9619626"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1145\/1073204.1073223","article-title":"Motion Magnification","volume":"24","author":"Liu","year":"2005","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1109\/34.93808","article-title":"The Design and Use of Steerable Filters","volume":"13","author":"Freeman","year":"1991","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1023\/A:1026553619983","article-title":"A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients","volume":"40","author":"Portilla","year":"2000","journal-title":"Int. J. Comput. Vis."},{"key":"ref_14","unstructured":"Simoncelli, E.P., and Freeman, W.T. (1995, January 23\u201326). The Steerable Pyramid: A Flexible Architecture for Multi-Scale Derivative Computation. Proceedings of the International Conference on Image Processing, Washington, DC, USA."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2461912.2461966","article-title":"Phase-Based Video Motion Processing","volume":"32","author":"Wadhwa","year":"2013","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Davis, A., Bouman, K.L., Chen, J.G., Rubinstein, M., Durand, F., and Freeman, W.T. (2015, January 7\u201312). Visual Vibrometry: Estimating Material Properties from Small Motion in Video. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299171"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/j.jsv.2015.01.024","article-title":"Modal Identification of Simple Structures with High-Speed Video Using Motion Magnification","volume":"345","author":"Chen","year":"2015","journal-title":"J. Sound Vib."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wadhwa, N., Rubinstein, M., Durand, F., and Freeman, W.T. (2014, January 2\u20134). Riesz Pyramids for Fast Phase-Based Video Magnification. Proceedings of the 2014 IEEE International Conference on Computational Photography (ICCP), Santa Clara, CA, USA.","DOI":"10.1109\/ICCPHOT.2014.6831820"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Elgharib, M., Hefeeda, M., Durand, F., and Freeman, W.T. (2015, January 7\u201312). Video Magnification in Presence of Large Motions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299039"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kooij, J.F., and van Gemert, J.C. (2016). Depth-Aware Motion Magnification. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46484-8_28"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Pintea, S.L., and Van Gemert, J.C. (2017, January 21\u201326). Video Acceleration Magnification. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.61"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wu, X., Yang, X., Jin, J., and Yang, Z. (2018). Amplitude-Based Filtering for Video Magnification in Presence of Large Motion. Sensors, 18.","DOI":"10.3390\/s18072312"},{"key":"ref_23","unstructured":"Nawab, S.H. (1988). Short-Time Fourier Transform. Advanced Topics in Signal Processing, Prentice-Hall, Inc."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2964","DOI":"10.1109\/78.869059","article-title":"Improved Instantaneous Frequency Estimation Using an Adaptive Short-Time Fourier Transform","volume":"48","author":"Kwok","year":"2000","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Kaiser, G. (2010). A Friendly Guide to Wavelets, Birkh\u00e4user.","DOI":"10.1007\/978-0-8176-8111-1"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"522","DOI":"10.1109\/TIE.2007.911941","article-title":"On-Line Monitoring of Mechanical Faults in Variable-Speed Induction Motor Drives Using the Wigner Distribution","volume":"55","author":"Blodt","year":"2008","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"4534","DOI":"10.1109\/TIE.2008.2011580","article-title":"Short-Circuit Detection by Means of Empirical Mode Decomposition and Wigner\u2013Ville Distribution for PMSM Running Under Dynamic Condition","volume":"56","author":"Rosero","year":"2009","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"880","DOI":"10.1109\/TIE.2007.911203","article-title":"Wavelet Transform as an Alternative to the Short-Time Fourier Transform for the Study of Conducted Noise in Power Electronics","volume":"55","author":"Coppola","year":"2008","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"4385","DOI":"10.1109\/TIE.2010.2095391","article-title":"Fault Diagnosis in Industrial Induction Machines through Discrete Wavelet Transform","volume":"58","author":"Bouzida","year":"2010","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"903","DOI":"10.1098\/rspa.1998.0193","article-title":"The Empirical Mode Decomposition and the Hilbert Spectrum for Non-linear and Non-Stationary Time Series Analysis","volume":"454","author":"Huang","year":"1998","journal-title":"Proc. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Huang, N.E., and Wu, Z. (2008). A Review on Hilbert-Huang Transform: Method and its Applications to Geophysical Studies. Rev. Geophys., 46.","DOI":"10.1029\/2007RG000228"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1612","DOI":"10.1109\/TIE.2011.2163376","article-title":"Spline-Kernelled Chirplet Transform for the Analysis of Signals with Time-Varying Frequency and its application","volume":"59","author":"Yang","year":"2011","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1809","DOI":"10.1088\/0264-9381\/21\/20\/024","article-title":"Multi-resolution Techniques for the Detection of Gravitational-Wave Bursts","volume":"21","author":"Chatterji","year":"2004","journal-title":"Class. Quantum Gravity"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1038\/nature09426","article-title":"An Influence of Solar Spectral Variations on Radiative Forcing of Climate","volume":"467","author":"Haigh","year":"2010","journal-title":"Nature"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zheng, X., and Chen, B.M. (2013). Stock Market Modeling and Forecasting, Springer.","DOI":"10.1007\/978-1-4471-5155-5"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1074","DOI":"10.1152\/jn.00697.2004","article-title":"A Point Process Framework for Relating Neural Spiking Activity to Spiking History, Neural Ensemble, and Extrinsic Covariate Effects","volume":"93","author":"Truccolo","year":"2005","journal-title":"J. Neurophysiol."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Mitra, P. (2007). Observed Brain Dynamics, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780195178081.001.0001"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"10837","DOI":"10.3390\/s101210837","article-title":"Detecting Vital Signs with Wearable Wireless Sensors","volume":"10","author":"Yilmaz","year":"2010","journal-title":"Sensors"},{"key":"ref_39","unstructured":"Quatieri, T.F. (2006). Discrete-Time Speech Signal Processing: Principles and Practice, Pearson Education India."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/78.193221","article-title":"B-Spline Signal Processing. II. Efficiency Design and Applications","volume":"41","author":"Unser","year":"1993","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Fahrmeir, L., Tutz, G., Hennevogl, W., and Salem, E. (1994). Multivariate Statistical Modelling Based on Generalized Linear Models, Springer.","DOI":"10.1007\/978-1-4899-0010-4"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Durbin, J., and Koopman, S.J. (2012). Time Series Analysis by State Space Methods, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780199641178.001.0001"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Qi, Y., Minka, T.P., and Picara, R.W. (2002, January 13\u201317). Bayesian Spectrum Estimation of Unevenly Sampled Nonstationary Data. Proceedings of the 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing, Orlando, FL, USA.","DOI":"10.1109\/ICASSP.2002.5744891"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Kitagawa, G., and Gersch, W. (1996). Smoothness Priors Analysis of Time Series, Springer Science & Business Media.","DOI":"10.1007\/978-1-4612-0761-0"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1109\/TBME.2003.821029","article-title":"Estimation of Nonstationary EEG with Kalman Smoother Approach: An Application to Event-Related Synchronization (ERS)","volume":"51","author":"Tarvainen","year":"2004","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"5336","DOI":"10.1073\/pnas.1320637111","article-title":"Robust Spectrotemporal Decomposition by Iteratively Reweighted Least Squares","volume":"111","author":"Ba","year":"2014","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_47","first-page":"5","article-title":"State-Space Multitaper Time-Frequency Analysis","volume":"115","author":"Kim","year":"2018","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Shumway, R.H., Stoffer, D.S., and Stoffer, D.S. (2000). Time Series Analysis and Its Applications, Springer.","DOI":"10.1007\/978-1-4757-3261-0"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Doucet, A., De Freitas, N., and Gordon, N. (2001). An Introduction to Sequential Monte Carlo Methods. Sequential Monte Carlo Methods in Practice, Springer.","DOI":"10.1007\/978-1-4757-3437-9"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Carlin, B.P., and Louis, T.A. (2008). Bayesian Methods for Data Analysis, CRC Press.","DOI":"10.1201\/b14884"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.ymssp.2016.04.014","article-title":"High-Speed 3D Digital Image Correlation Vibration Measurement: Recent Advancements and Noted Limitations","volume":"86","author":"Beberniss","year":"2017","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1016\/j.jsv.2017.06.003","article-title":"Feasibility of Extracting Operating Shapes Using Phase-Based Motion Magnification Technique and Stereo-Photogrammetry","volume":"407","author":"Poozesh","year":"2017","journal-title":"J. Sound Vib."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Tian, L., Zhao, J., Pan, B., and Wang, Z. (2021). Full-Field Bridge Deflection Monitoring with Off-Axis Digital Image Correlation. Sensors, 21.","DOI":"10.3390\/s21155058"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Al-Baradoni, N., and Groche, P. (2021). Sensor Integrated Load-Bearing Structures: Measuring Axis Extension with DIC-Based Transducers. Sensors, 21.","DOI":"10.3390\/s21124104"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Liu, G., Li, M., Zhang, W., and Gu, J. (2021). Subpixel Matching Using Double-Precision Gradient-Based Method for Digital Image Correlation. Sensors, 21.","DOI":"10.3390\/s21093140"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Dandois, F., Taylan, O., Bellemans, J., D\u2019hooge, J., Vandenneucker, H., Slane, L., and Scheys, L. (2021). Validated Ultrasound Speckle Tracking Method for Measuring Strains of Knee Collateral Ligaments In-Situ during Varus\/Valgus Loading. Sensors, 21.","DOI":"10.3390\/s21051895"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1154","DOI":"10.3390\/s21041154","article-title":"Experimental Characterization of the FRCM-Concrete Interface Bond Behavior Assisted by Digital Image Correlation","volume":"21","author":"Quattrocchi","year":"2021","journal-title":"Sensors"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"945","DOI":"10.1016\/j.jsv.2007.05.004","article-title":"The Connection between Effective Independence and Modal Kinetic Energy Methods for Sensor Placement","volume":"305","author":"Li","year":"2007","journal-title":"J. Sound Vib."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.ymssp.2012.04.014","article-title":"Load Dependent Sensor Placement Method: Theory and Experimental Validation","volume":"31","author":"Li","year":"2012","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1007\/s10694-011-0227-8","article-title":"Novel Methods for Flame Pulsation Frequency Measurement with Image Analysis","volume":"48","author":"Wu","year":"2012","journal-title":"Fire Technol."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1023\/A:1026543900054","article-title":"The Earth Mover\u2019s Distance as a Metric for Image Retrieval","volume":"40","author":"Rubner","year":"2000","journal-title":"Int. J. Comput. Vis."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/7\/2794\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:48:50Z","timestamp":1760136530000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/7\/2794"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,6]]},"references-count":61,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,4]]}},"alternative-id":["s22072794"],"URL":"https:\/\/doi.org\/10.3390\/s22072794","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,4,6]]}}}