{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:20:46Z","timestamp":1760239246766,"version":"build-2065373602"},"reference-count":28,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2020,10,20]],"date-time":"2020-10-20T00:00:00Z","timestamp":1603152000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"China State Key Laboratory of Subtropical Building Science","award":["2017KB13"],"award-info":[{"award-number":["2017KB13"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Current research on dynamic displacement measurement based on computer vision mostly requires professional high-speed cameras and an ideal shooting environment to ensure the performance and accuracy of the analysis. However, the high cost of the camera and strict requirements of sharp image contrast and stable environment during the shooting process limit the broad application of the technology. This paper proposes an improved vision method to implement multi-point dynamic displacement measurements with smartphones in an interference environment. A motion-enhanced spatio-temporal context (MSTC) algorithm is developed and applied together with the optical flow (OF) algorithm to realize a simultaneous tracking and dynamic displacement extraction of multiple points on a vibrating structure in the interference environment. Finally, a sine-sweep vibration experiment on a cantilever sphere model is presented to validate the feasibility of the proposed method in a wide-band frequency range. In the test, a smartphone was used to shoot the vibration process of the sine-sweep-excited sphere, and illumination change, fog interference, and camera jitter were artificially simulated to represent the interference environment. The results of the proposed method are compared to conventional displacement sensor data and current vision method results. It is demonstrated that, in an interference environment, (1) the OF method is prone to mismatch the feature points and leads to data deviated or lost; (2) the conventional STC method is sensitive to target selection and can effectively track those targets having a large proportion of pixels in the context with motion tendency similar to the target center; (3) the proposed MSTC method, however, can ease the sensitivity to target selection through in-depth processing of the information in the context and finally enhance the robustness of the target tracking. In addition, the MSTC method takes less than one second to track each target between adjacent frame images, implying a potential for online measurement.<\/jats:p>","DOI":"10.3390\/s20205929","type":"journal-article","created":{"date-parts":[[2020,10,20]],"date-time":"2020-10-20T20:50:07Z","timestamp":1603227007000},"page":"5929","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["An Improved Vision Method for Robust Monitoring of Multi-Point Dynamic Displacements with Smartphones in an Interference Environment"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3273-1062","authenticated-orcid":false,"given":"Taicong","family":"Chen","sequence":"first","affiliation":[{"name":"School of Civil Engineering and Transportation, South China University of Technology, Guangzhou 510641, China"},{"name":"State Key Laboratory of Subtropical Building Science, South China University of Technology, Guangzhou 510641, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhou","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Civil Engineering and Transportation, South China University of Technology, Guangzhou 510641, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,10,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"859","DOI":"10.1111\/mice.12147","article-title":"Sensor Attitude Correction of Wireless Sensor Network for Acceleration-Based Monitoring of Civil Structures","volume":"30","author":"Cho","year":"2015","journal-title":"Comput. Civ. Infrastruct. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.eng.2018.11.030","article-title":"Advances in computer vision-based civil infrastructure inspection and monitoring","volume":"5","author":"Spencer","year":"2019","journal-title":"Engineering"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.engstruct.2017.11.018","article-title":"Computer vision for SHM of civil infrastructure: From dynamic response measurement to damage detection\u2212A review","volume":"156","author":"Feng","year":"2018","journal-title":"Eng. Struct."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1002\/stc.1755","article-title":"Vision-based algorithms for damage detection and localization in structural health monitoring","volume":"23","author":"Dworakowski","year":"2016","journal-title":"Struct. Control. Health Monit."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"04015023","DOI":"10.1061\/(ASCE)BE.1943-5592.0000747","article-title":"Non-target vision sensor for remote measurement of bridge dynamic response","volume":"20","author":"Feng","year":"2015","journal-title":"J. Bridge Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/j.engstruct.2018.02.014","article-title":"Robust vision sensor for multi-point displacement monitoring of bridges in the field","volume":"163","author":"Luo","year":"2018","journal-title":"Eng. Struct."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.jweia.2019.05.015","article-title":"Reliability verification of a vision-based dynamic displacement measurement for system identification","volume":"191","author":"Kim","year":"2019","journal-title":"J. Wind Eng. Ind. Aerodyn."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Lee, J., Lee, K.C., Cho, S., and Sim, S.H. (2017). Computer vision-based structural displacement measurement robust to light-induced image degradation for in-service bridges. Sensors, 17.","DOI":"10.3390\/s17102317"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/stc.1977","article-title":"Eulerian-based virtual visual sensors to measure dynamic displacements of structures","volume":"24","author":"Shariati","year":"2017","journal-title":"Struct. Control. Health Monit."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1016\/j.measurement.2016.01.024","article-title":"Vision-based structural displacement measurement: System performance evaluation and influence factor analysis","volume":"88","author":"Ye","year":"2016","journal-title":"Measurement"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"He, L., Tan, J., Hu, Q., He, S., Cai, Q., Fu, Y., and Tang, S. (2018). Non-contact measurement of the surface displacement of a slope based on a smart binocular vision system. Sensors, 18.","DOI":"10.3390\/s18092890"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"e1852","DOI":"10.1002\/stc.1852","article-title":"Completely contactless structural health monitoring of real-life structures using cameras and computer vision","volume":"24","author":"Khuc","year":"2017","journal-title":"Struct. Control. Health Monit."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3461","DOI":"10.1177\/1369433219856171","article-title":"A non-target structural displacement measurement method using advanced feature matching strategy","volume":"22","author":"Dong","year":"2019","journal-title":"Adv. Struct. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1405","DOI":"10.1002\/stc.1850","article-title":"Target-free approach for vision-based structural system identification using consumer-grade cameras","volume":"23","author":"Yoon","year":"2016","journal-title":"Struct. Control. Health Monit."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"16557","DOI":"10.3390\/s150716557","article-title":"A vision-based sensor for noncontact structural displacement measurement","volume":"15","author":"Feng","year":"2015","journal-title":"Sensors"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Dong, C.Z., Celik, O., Catbas, F.N., Obrien, E., and Taylor, S. (2019). A robust vision-based method for displacement measurement under adverse environmental factors using spatio-temporal context learning and taylor approximation. Sensors, 19.","DOI":"10.20944\/preprints201906.0023.v1"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"B4016013","DOI":"10.1061\/(ASCE)IS.1943-555X.0000348","article-title":"Video camera\u2013based vibration measurement for civil infrastructure applications","volume":"23","author":"Chen","year":"2016","journal-title":"J. Infrastruct. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1080\/15732479.2019.1650078","article-title":"Structural displacement monitoring using deep learning-based full field optical flow methods","volume":"16","author":"Dong","year":"2020","journal-title":"Struct. Infrastruct. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"189","DOI":"10.18287\/2412-6179-CO-604","article-title":"Testing edible oil authenticity by using smartphone based spectrometer","volume":"44","author":"Mai","year":"2020","journal-title":"Comput. Opt."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Chan, S.H., V\u00f5, D.T., and Nguyen, T.Q. (2010). Subpixel motion estimation without interpolation. IEEE Int. Conf. Acoust. Speech Sig. Process., 722\u2013725.","DOI":"10.1109\/ICASSP.2010.5495054"},{"key":"ref_22","unstructured":"Gao, X., Zhang, T., Yan, Q., and Liu, Y. (2017). 14 Lectures on Visual SLAM: From Theory to Practice, Publishing House of Electronics Industry."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhang, K., Zhang, L., Liu, Q., Zhang, D., and Yang, M.H. (2014). Fast visual tracking via dense spatio-temporal context learning. Proc. Eur. Conf. Comput. Vis., 127\u2013141.","DOI":"10.1007\/978-3-319-10602-1_9"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Xu, J., Lu, Y., and Liu, J. (2014). Robust tracking via weighted spatio-temporal context learning. IEEE Int. Conf. Image Process., 413\u2013416.","DOI":"10.1109\/ICIP.2014.7025082"},{"key":"ref_25","unstructured":"Fleet, D.J., and Weiss, Y. (2005). Optical flow estimation. Mathematical Models for Computer Vision: The Handbook, Springer."},{"key":"ref_26","unstructured":"Khuc, T. (2016). Computer Vision Based Structural Identification Framework for Bridge Health Monitoring. [Ph.D. Thesis, University of Central Florida]."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1491","DOI":"10.1177\/1475921718806895","article-title":"Marker-free monitoring of the grandstand structures and modal identification using computer vision methods","volume":"18","author":"Dong","year":"2019","journal-title":"Struct. Health Monit."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"106651","DOI":"10.1016\/j.ymssp.2020.106651","article-title":"Long-term displacement measurement of full-scale bridges using camera ego-motion compensation","volume":"140","author":"Lee","year":"2020","journal-title":"Mech. Syst. Signal Proc."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/20\/5929\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:24:51Z","timestamp":1760178291000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/20\/5929"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,20]]},"references-count":28,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2020,10]]}},"alternative-id":["s20205929"],"URL":"https:\/\/doi.org\/10.3390\/s20205929","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,10,20]]}}}