{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,25]],"date-time":"2025-12-25T08:56:06Z","timestamp":1766652966051,"version":"build-2065373602"},"reference-count":48,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2020,4,15]],"date-time":"2020-04-15T00:00:00Z","timestamp":1586908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Oscillation monitoring commonly requires complex setups integrating various types of sensors associated with intensive computations to achieve an adequate rate of observations and accuracy. This research presents a simple, cost-effective approach that allows two-dimensional oscillation monitoring by terrestrial photogrammetry using non-metric cameras. Tedious camera calibration procedures are eliminated by using a grid target that allows geometric correction to be performed to the frame\u2019s region of interest at which oscillations are monitored. Region-based convolutional neural networks (Faster R-CNN) techniques are adopted to minimize the light exposure limitations, commonly constraining applications of terrestrial photogrammetry. The proposed monitoring procedure is tested at outdoor conditions to check its reliability and accuracy and examining the effect of using Faster R-CNN on monitoring results. The proposed artificial intelligence (AI) aided oscillation monitoring allowed sub-millimeter accuracy monitoring with observation rates up to 60 frames per second and gained the benefit of high optical zoom offered by market available bridge cameras to monitor oscillation of targets 100 m apart with high accuracy.<\/jats:p>","DOI":"10.3390\/s20082223","type":"journal-article","created":{"date-parts":[[2020,4,15]],"date-time":"2020-04-15T09:19:50Z","timestamp":1586942390000},"page":"2223","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Robust In-Plane Structures Oscillation Monitoring by Terrestrial Photogrammetry"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1963-9464","authenticated-orcid":false,"given":"Omar","family":"El-Kadi","sequence":"first","affiliation":[{"name":"Civil Engineering, Faculty of Engineering, Cairo University, Giza Governorate 12613, Egypt"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adel","family":"El-Shazly","sequence":"additional","affiliation":[{"name":"Civil Engineering, Faculty of Engineering, Cairo University, Giza Governorate 12613, Egypt"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Khaled","family":"Nassar","sequence":"additional","affiliation":[{"name":"Construction Engineering Department, The American University in Cairo, Cairo 11865, Egypt"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,4,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.14358\/PERS.76.10.1123","article-title":"Point Clouds: Lidar versus 3D Vision","volume":"76","author":"Leberl","year":"2010","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"453","DOI":"10.3390\/s120100453","article-title":"Point Cloud Generation from Aerial Image Data Acquired by a Quadrocopter Type Micro Unmanned Aerial Vehicle and a Digital Still Camera","volume":"12","author":"Rosnell","year":"2012","journal-title":"Sensors"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"559","DOI":"10.5194\/isprs-archives-XLII-2-W13-559-2019","article-title":"Landslide Deformation Monitoring by Three-Camera Imaging System","volume":"XLII-2\/W13","author":"Rau","year":"2019","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"824","DOI":"10.1016\/j.measurement.2007.12.005","article-title":"Close-range photogrammetry applications in bridge measurement: Literature review","volume":"41","author":"Jiang","year":"2008","journal-title":"Measurement"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"23","DOI":"10.3389\/fbuil.2017.00023","article-title":"Vision-Based Bridge Deformation Monitoring","volume":"3","author":"Brownjohn","year":"2017","journal-title":"Front. Built Environ."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"195","DOI":"10.5194\/isprsarchives-XL-5-195-2014","article-title":"Deformation monitoring with off-the-shelf digital cameras FOR civil engineering fatigue testing","volume":"XL-5","author":"Detchev","year":"2014","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_7","unstructured":"Detchev, I., Habib, A., and El-Badry, M. (2011, January 1\u20135). Case Study of Beam Deformation Monitoring Using Conventional Close Range Photogrammetry. Proceedings of the ASPRS 2011 Annual Conference, Milwaukee, Wisconsin."},{"key":"ref_8","first-page":"103","article-title":"Metric or Non-Metric Cameras","volume":"42","author":"Kolbl","year":"1976","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_9","unstructured":"US Army Corps of Engineers (2018). Structural Deformation Surveying EM 1110-2-1009 (Engineer Manual), US Army Corps of Engineers."},{"key":"ref_10","unstructured":"US Army Corps of Engineers (2002). Engineering and Design Photogrammetric Mapping em 1110-1-1000 (Engineering and Design Manual No. EM 1110-1-1000), Department of The Army US ARMY Corps of Engineers, Engineering and Design Manual."},{"key":"ref_11","unstructured":"Wu, Z.Y., and Kalfarisi, R. (2019, January 27\u201329). Deep Learning-based Defect Detection and Assessment for Engineering Structures. Proceedings of the 5th International Conference on Smart Monitoring, Assessment and Rehabilitation of Civil Structures (SMAR 2019), ndl.net, Potsdam, Germany."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Rony, K., Yi, W.Z., and Ken, S. (2020). Crack Detection and Segmentation Using Deep Learning with 3D Reality Mesh Model for Quantitative Assessment and Integrated Visualization. J. Comput. Civ. Eng., 34.","DOI":"10.1061\/(ASCE)CP.1943-5487.0000890"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2018). Mask R-CNN. arXiv.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_14","first-page":"2694","article-title":"A precision analysis of camera distortion models","volume":"26","author":"Tang","year":"2017","journal-title":"IEEE Trans. Image Process. Inst. Electr. Electron. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhou, L., Guo, J., and Yang, F. (2018). Deformation Monitoring and Analysis of LSP landslide based on gbinsar. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci., XLII-3.","DOI":"10.5194\/isprs-archives-XLII-3-2541-2018"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ogundare, J.O. (2016). Precision Surveying: The Principles and Geomatics Practice, Wiley.","DOI":"10.1002\/9781119147770"},{"key":"ref_17","unstructured":"(2020, February 22). Nikon COOLPIX P1000 Super-Telephoto Digital camera [WWW Document], n.d. Available online: https:\/\/www.nikonusa.com\/en\/nikon-products\/product\/compact-digital-cameras\/coolpix-p1000.html."},{"key":"ref_18","unstructured":"(2020, February 22). Sony RX100 VI\u2014Broad Zoom Range and Super-Fast AF [WWW Document], n.d. Sony. Available online: https:\/\/www.sony.com\/electronics\/cyber-shot-compact-cameras\/dsc-rx100m6."},{"key":"ref_19","unstructured":"(2020, February 22). Specifications & Features [WWW Document]. Available online: https:\/\/www.canon.co.uk\/cameras\/powershot-sx70-hs\/specifications\/."},{"key":"ref_20","unstructured":"GOM (2020, January 18). Limitations of 2D Measurements [WWW Document]. Training Webinar\u20142D and 3D Image Correlation in Materials and Components Testing. Available online: https:\/\/www.gom.com\/services\/gom-training\/webinars\/training-webinar-2d-and-3d-image-correlation-in-materials-and-components-testing.html."},{"key":"ref_21","unstructured":"Burger, W. (2016). Zhang\u2019s Camera Calibration Algorithm: In-Depth Tutorial and Implementation (Technical Report), University of Applied Sciences Upper Austria, School of Informatics, Communications and Media, Softwarepark."},{"key":"ref_22","unstructured":"Zhang, Z. (2018, May 12). A Flexible New Technique for Camera Calibration (Technical Report No. MSR-TR-98-71). Microsoft Research Center. Available online: https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/02\/tr98-71.pdf."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1007\/s10851-012-0339-x","article-title":"Zoom Dependent Lens Distortion Mathematical Models","volume":"44","author":"Alvarez","year":"2012","journal-title":"J. Math. Imaging Vis."},{"key":"ref_24","unstructured":"Harris, C., and Stephens, M. (September, January 31). A Combined Corner and Edge Detector. Proceedings of the AVC, Manchester, UK."},{"key":"ref_25","unstructured":"(2016, January 10). OpenCV-Python Tutorials\u2014Feature Detection and Description\u2014Harris Corner Detection [WWW Document]. OpenCV-Python Tutorials-Feature Detection and Description. Available online: https:\/\/opencv-python-tutroals.readthedocs.io\/en\/latest\/py_tutorials\/py_feature2d\/py_features_harris\/py_features_harris.html#harris-corners."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2016). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks (Extended Technical Report), Microsoft Research; IEEE.","DOI":"10.1109\/TPAMI.2016.2577031"},{"key":"ref_27","unstructured":"Ioffe, S., and Szegedy, C. (2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. arXiv, Available online: http:\/\/arxiv.org\/abs\/1502.03167."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Rubin Bose, S., and Sathiesh Kumar, V. (2019). An Efficient Inception V2 based Deep Convolutional Neural Network for Real-Time Hand Action Recognition. IET Image Process.","DOI":"10.1049\/iet-ipr.2019.0985"},{"key":"ref_29","unstructured":"Gandhi, R. (2018, November 23). R-CNN, Fast R-CNN, Faster R-CNN, YOLO\u2014Object Detection Algorithms [WWW Document]. Towards Data Science. Available online: https:\/\/towardsdatascience.com\/r-cnn-fast-r-cnn-faster-r-cnn-yolo-object-detection-algorithms-36d53571365e."},{"key":"ref_30","unstructured":"El-Kadi, O. (2020). Development and Validation of a System for Oscillation Monitoring Using Single Non-Metric Camera. [Ph.D. Thesis, Cairo University]."},{"key":"ref_31","unstructured":"(2018, July 02). Tensorflow\/Models [WWW Document], n.d. GitHub. Available online: https:\/\/github.com\/tensorflow\/models."},{"key":"ref_32","unstructured":"(2019, August 04). Pkulzc, vivek rathod, Mark Sandler, Neal Wu, n.d. Tensorflow\/Models [WWW Document]. GitHub. Available online: https:\/\/github.com\/tensorflow\/models\/blob\/master\/research\/object_detection\/g3doc\/detection_model_zoo.md."},{"key":"ref_33","unstructured":"(2019, August 28). COCO\u2014Common Objects in Context [WWW Document], n.d. Available online: http:\/\/cocodataset.org\/#home."},{"key":"ref_34","unstructured":"(2020, March 19). Cartucho. Cartucho\/mAP. GitHub. Available online: https:\/\/github.com\/Cartucho\/mAP."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The Pascal Visual Object Classes (VOC) Challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Shao, F., Wang, X., Meng, F., Zhu, J., Wang, D., and Dai, J. (2019). Improved Faster R-CNN Traffic Sign Detection Based on a Second Region of Interest and Highly Possible Regions Proposal Network. Sensors, 19.","DOI":"10.3390\/s19102288"},{"key":"ref_37","unstructured":"Oliphant, T.E. (2006). A guide to NumPy, Trelgol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1109\/MCSE.2011.36","article-title":"Python for Scientists and Engineers","volume":"13","author":"Millma","year":"2011","journal-title":"Comput. Sci. Eng."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/MCSE.2007.53","article-title":"IPython: A System for Interactive Scientific Computing","volume":"9","author":"Granger","year":"2007","journal-title":"Comput. Sci. Eng."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Van der Walt, S., Sch\u00f6nberger, J.L., Nunez-Iglesias, J., Boulogne, F., Warner, J.D., Yager, N., Gouillart, E., and Yu, T. (2014). Scikit-Image: Image processing in Python. Peerj\u2014J. Life Environ. Sci.","DOI":"10.7287\/peerj.preprints.336"},{"key":"ref_41","unstructured":"OpenCV (2018, August 05). Camera Calibration and 3D Reconstruction [WWW Document]. OpenCV 2.4.13.7 Documentations. Available online: https:\/\/docs.opencv.org\/2.4\/modules\/calib3d\/doc\/camera_calibration_and_3d_reconstruction.html."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation, UC Berkeley.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast R-CNN. Proceedings of the International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_44","unstructured":"Andrew Howard, G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv, Available online: https:\/\/arxiv.org\/abs\/1704.04861."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016). You Only Look Once: Unified, Real-Time Object Detection. arXiv, Available online: https:\/\/arxiv.org\/abs\/1506.02640.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Kaloop, M.R., Elbeltagi, E., Hu, J.W., and Elrefai, A. (2017). Recent Advances of Structures Monitoring and Evaluation Using GPS-Time Series Monitoring Systems: A Review. ISPRS Int. J. Geo-Inf., 6.","DOI":"10.3390\/ijgi6120382"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"71","DOI":"10.5194\/isprsarchives-XL-5-71-2014","article-title":"Photogrammetric Deformation Monitoring of the Second Bosphorus Bridge in Istanbul","volume":"XL-5","author":"Avsar","year":"2014","journal-title":"ISPRS\u2014Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"10803","DOI":"10.3390\/s101210803","article-title":"Evaluation of High-Precision Sensors in Structural Monitoring","volume":"10","author":"Erol","year":"2010","journal-title":"Sensors"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/8\/2223\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:30:48Z","timestamp":1760362248000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/8\/2223"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,15]]},"references-count":48,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2020,4]]}},"alternative-id":["s20082223"],"URL":"https:\/\/doi.org\/10.3390\/s20082223","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,4,15]]}}}