{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,12]],"date-time":"2025-11-12T14:06:42Z","timestamp":1762956402789,"version":"build-2065373602"},"reference-count":59,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2020,8,30]],"date-time":"2020-08-30T00:00:00Z","timestamp":1598745600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100012938","name":"De La Salle University","doi-asserted-by":"publisher","award":["Eagle Eye 2.0; Proj # 20 F U 1TAY18-1TAY19"],"award-info":[{"award-number":["Eagle Eye 2.0; Proj # 20 F U 1TAY18-1TAY19"]}],"id":[{"id":"10.13039\/100012938","id-type":"DOI","asserted-by":"publisher"}]},{"name":"DOST-ASTI","award":["TITAN: Vision-based Traffic Information and Analysis. Proj No. 07595"],"award-info":[{"award-number":["TITAN: Vision-based Traffic Information and Analysis. Proj No. 07595"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this work, we present a network architecture with parallel convolutional neural networks (CNN) for removing perspective distortion in images. While other works generate corrected images through the use of generative adversarial networks or encoder-decoder networks, we propose a method wherein three CNNs are trained in parallel, to predict a certain element pair in the 3\u00d73 transformation matrix, M^. The corrected image is produced by transforming the distorted input image using M^\u22121. The networks are trained from our generated distorted image dataset using KITTI images. Experimental results show promise in this approach, as our method is capable of correcting perspective distortions on images and outperforms other state-of-the-art methods. Our method also recovers the intended scale and proportion of the image, which is not observed in other works.<\/jats:p>","DOI":"10.3390\/s20174898","type":"journal-article","created":{"date-parts":[[2020,8,30]],"date-time":"2020-08-30T06:06:22Z","timestamp":1598767582000},"page":"4898","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Blind First-Order Perspective Distortion Correction Using Parallel Convolutional Neural Networks"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2312-5474","authenticated-orcid":false,"given":"Neil Patrick","family":"Del Gallego","sequence":"first","affiliation":[{"name":"Software Technology, De La Salle University, 2401 Taft Ave, Malate, Manila, Metro Manila 1004, Philippines"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7601-6605","authenticated-orcid":false,"given":"Joel","family":"Ilao","sequence":"additional","affiliation":[{"name":"Computer Technology, De La Salle University, 2401 Taft Ave, Malate, Manila, Metro Manila 1004, Philippines"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7270-9236","authenticated-orcid":false,"suffix":"II","given":"Macario","family":"Cordel","sequence":"additional","affiliation":[{"name":"Computer Technology, De La Salle University, 2401 Taft Ave, Malate, Manila, Metro Manila 1004, Philippines"},{"name":"Data Science Institute, De La Salle University, 2401 Taft Ave, Malate, Manila, Metro Manila 1004, Philippines"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,30]]},"reference":[{"key":"ref_1","unstructured":"Sun, H.M. (2005). Method of Correcting an Image With Perspective Distortion and Producing an Artificial Image with Perspective Distortion. (6,947,610), U.S. Patent."},{"key":"ref_2","unstructured":"Dobbert, T. (2012). Matchmoving: The Invisible Art of Camera Tracking, Wiley. Serious Skills."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Carroll, R., Agarwala, A., and Agrawala, M. (2010, January 15\u201318). Image warps for artistic perspective manipulation. Proceedings of the ACM SIGGRAPH 2010, Los Angeles, CA, USA.","DOI":"10.1145\/1833349.1778864"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1109\/TMM.2011.2116775","article-title":"Content-aware display adaptation and interactive editing for stereoscopic images","volume":"13","author":"Chang","year":"2011","journal-title":"IEEE Trans. Multimed."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yang, B., Jin, J.S., Li, F., Han, X., Tong, W., and Wang, M. (2016, January 16\u201318). A perspective correction method based on the bounding rectangle and least square fitting. Proceedings of the 2016 13th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), Chengdu, China.","DOI":"10.1109\/ICCWAMTIP.2016.8079851"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1109\/TPAMI.2006.40","article-title":"Restoring warped document images through 3D shape modeling","volume":"28","author":"Tan","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","first-page":"9901","article-title":"2-D and 3-D image registration for medical, remote sensing, and industrial applications","volume":"14","author":"Ray","year":"2005","journal-title":"J. Electron. Imaging"},{"key":"ref_8","unstructured":"Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., and Chen, X. (2016, January 5\u201310). Improved techniques for training GANs. Proceedings of the 30th International Conference on Neural Information Processing Systems, Barcelona, Spain."},{"key":"ref_9","unstructured":"Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (2017, January 4\u20139). VEEGAN: Reducing mode collapse in gans using implicit variational learning. Proceedings of the Advances in Neural Information Processing Systems 30, Long Beach, CA, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhao, Y., Huang, Z., Li, T., Chen, W., Legendre, C., Ren, X., Shapiro, A., and Li, H. (2019, January 27\u201328). Learning perspective undistortion of portraits. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00794"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Li, X., Zhang, B., Sander, P.V., and Liao, J. (2019, January 15\u201320). Blind geometric distortion correction on images through deep learning. Proceedings of the 2019 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00499"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Li, X., Zhang, B., Liao, J., and Sander, P.V. (2019). Document rectification and illumination correction using a patch-based CNN. ACM Trans. Graph., 38.","DOI":"10.1145\/3355089.3356563"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press. [2nd ed.].","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1552","DOI":"10.1109\/TPAMI.2008.202","article-title":"Calibration of cameras with radially symmetric distortion","volume":"31","author":"Tardif","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1109\/JRA.1987.1087109","article-title":"A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses","volume":"3","author":"Tsai","year":"1987","journal-title":"IEEE J. Robot. Autom."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1901","DOI":"10.1109\/TIP.2017.2788204","article-title":"Camera shutter-independent registration and rectification","volume":"27","author":"Vasu","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/s10851-009-0162-1","article-title":"A simple method of radial distortion correction with centre of distortion estimation","volume":"35","author":"Wang","year":"2009","journal-title":"J. Math. Imaging Vis."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/s10851-012-0342-2","article-title":"Automatic radial distortion estimation from a single image","volume":"45","author":"Bukhari","year":"2013","journal-title":"J. Math. Imaging Vis."},{"key":"ref_20","unstructured":"Fitzgibbon, A.W. (2001, January 8\u201314). Simultaneous linear estimation of multiple view geometry and lens distortion. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Chaudhury, K., DiVerdi, S., and Ioffe, S. (2014, January 27\u201330). Auto-rectification of user photos. Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France.","DOI":"10.1109\/ICIP.2014.7025706"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cviu.2017.05.016","article-title":"Automatic correction of perspective and optical distortions","volume":"161","author":"Gomez","year":"2017","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3306346.3322948","article-title":"Distortion-free wide-angle portraits on camera phones","volume":"38","author":"Shih","year":"2019","journal-title":"ACM Trans. Graph."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1016\/j.cviu.2009.07.007","article-title":"Generic self-calibration of central cameras","volume":"114","author":"Ramalingam","year":"2010","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1309","DOI":"10.1109\/TPAMI.2007.1147","article-title":"Parameter-free radial distortion correction with center of distortion estimation","volume":"29","author":"Hartley","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1109\/MSP.2003.1203211","article-title":"Computer vision applied to super resolution","volume":"20","author":"Capel","year":"2003","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, H., and Carin, L. (2014, January 23\u201328). Multi-shot imaging: Joint alignment, deblurring and resolution-enhancement. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.374"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1186\/s13640-016-0156-z","article-title":"Multiple-image super-resolution on mobile devices: An image warping approach","volume":"2017","author":"Ilao","year":"2017","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1959","DOI":"10.1109\/TPAMI.2016.2630687","article-title":"Image registration and change detection under rolling shutter motion blur","volume":"39","author":"Rengarajan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/0600000009","article-title":"Image alignment and stitching: A tutorial","volume":"2","author":"Szeliski","year":"2007","journal-title":"Found. Trends Comput. Graph. Vis."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/s11263-006-0002-3","article-title":"Automatic panoramic image stitching using invariant features","volume":"74","author":"Brown","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhang, F., and Liu, F. (2014, January 24\u201317). Parallax-tolerant image stitching. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.423"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1109\/TIP.2005.863958","article-title":"Seamless image stitching by minimizing false edges","volume":"15","author":"Zomet","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"He, K., Chang, H., and Sun, J. (2013). Rectangling panoramic images via warping. ACM Trans. Graph., 32.","DOI":"10.1145\/2461912.2462004"},{"key":"ref_36","first-page":"450","article-title":"Fast projective image rectification for planar objects with Manhattan structure","volume":"Volume 11433","author":"Osten","year":"2020","journal-title":"Proceedings of the Twelfth International Conference on Machine Vision (ICMV 2019)"},{"key":"ref_37","unstructured":"Sean, P., Sangyup, L., and Park, M. (2019). Automatic Perspective Control Using Vanishing Points. (10,354,364), U.S. Patent."},{"key":"ref_38","unstructured":"Gallagher, A.C. (2005, January 9\u201311). Using vanishing points to correct camera rotation in images. Proceedings of the 2nd Canadian Conference on Computer and Robot Vision (CRV\u201905), Victoria, BC, Canada."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1007\/s00138-016-0807-1","article-title":"Rectification of planar targets using line segments","volume":"28","author":"An","year":"2017","journal-title":"Mach. Vis. Appl."},{"key":"ref_40","unstructured":"Coughlan, J.M., and Yuille, A.L. (2000, January 1). The manhattan world assumption: Regularities in scene statistics which enable bayesian inference. Proceedings of the NIPS 2000, Denver, CO, USA."},{"key":"ref_41","unstructured":"Lee, H., Shechtman, E., Wang, J., and Lee, S. (2012, January 18\u201320). Automatic upright adjustment of photographs. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1109\/TII.2019.2940136","article-title":"Assembling convolution neural networks for automatic viewing transformation","volume":"16","author":"Cai","year":"2019","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Zhai, M., Workman, S., and Jacobs, N. (July, January 26). Detecting vanishing points using global image context in a non-Manhattan world. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.610"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Das, S., Mishra, G., Sudharshana, A., and Shilkrot, R. (2017, January 4\u20137). The common fold: Utilizing the four-fold to dewarp printed documents from a single image. Proceedings of the 2017 ACM Symposium on Document Engineering, Valletta, Malta.","DOI":"10.1145\/3103010.3121030"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Das, S., Ma, K., Shu, Z., Samaras, D., and Shilkrot, R. (November, January 27). DewarpNet: Single-image document unwarping with stacked 3D and 2D regression networks. Proceedings of the 2019 IEEE International Conference on Computer Vision (ICCV), Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00022"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ma, K., Shu, Z., Bai, X., Wang, J., and Samaras, D. (2018, January 18\u201323). Docunet: Document image unwarping via a stacked U-Net. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00494"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_48","unstructured":"Zhou, B., Lapedriza, A., Xiao, J., Torralba, A., and Oliva, A. (2014, January 8\u201313). Learning deep features for scene recognition using places database. Proceedings of the Advances in Neural Information Processing Systems 2014, Montreal, QC, Canada."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision meets Robotics: The KITTI Dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robot. Res."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Szeliski, R. (2010). Computer Vision: Algorithms and Applications, Springer Science & Business Media.","DOI":"10.1007\/978-1-84882-935-0"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Nixon, M.S., and Aguado, A.S. (2012). Chapter 4\u2014Low-level feature extraction. Feature Extraction and Image Processing for Computer Vision, Academic Press. [3rd ed.].","DOI":"10.1016\/B978-0-12-396549-3.00004-5"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_53","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_54","unstructured":"Wang, Z., Simoncelli, E.P., and Bovik, A.C. (2003, January 9\u201312). Multiscale structural similarity for image quality assessment. Proceedings of the Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, Pacific Grove, CA, USA."},{"key":"ref_55","unstructured":"Dubrofsky, E. (2009). Homography Estimation. Diplomov\u00e1 Pr\u00e1ce, Univerzita Britsk\u00e9 Kolumbie."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1007\/s11263-019-01228-7","article-title":"Grad-CAM: Visual explanations from deep networks via gradient-based localization","volume":"128","author":"Selvaraju","year":"2019","journal-title":"Int. J. Comput. Vis."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/17\/4898\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:04:45Z","timestamp":1760177085000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/17\/4898"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,30]]},"references-count":59,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["s20174898"],"URL":"https:\/\/doi.org\/10.3390\/s20174898","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,8,30]]}}}