{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:20:12Z","timestamp":1760242812138,"version":"build-2065373602"},"reference-count":66,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2016,8,5]],"date-time":"2016-08-05T00:00:00Z","timestamp":1470355200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Thanks to the recent diffusion of low-cost high-resolution digital cameras and to the development of mostly automated procedures for image-based 3D reconstruction, the popularity of photogrammetry for environment surveys is constantly increasing in the last years. Automatic feature matching is an important step in order to successfully complete the photogrammetric 3D reconstruction: this step is the fundamental basis for the subsequent estimation of the geometry of the scene. This paper reconsiders the feature matching problem when dealing with smart mobile devices (e.g., when using the standard camera embedded in a smartphone as imaging sensor). More specifically, this paper aims at exploiting the information on camera movements provided by the inertial navigation system (INS) in order to make the feature matching step more robust and, possibly, computationally more efficient. First, a revised version of the affine scale-invariant feature transform (ASIFT) is considered: this version reduces the computational complexity of the original ASIFT, while still ensuring an increase of correct feature matches with respect to the SIFT. Furthermore, a new two-step procedure for the estimation of the essential matrix E (and the camera pose) is proposed in order to increase its estimation robustness and computational efficiency.<\/jats:p>","DOI":"10.3390\/s16081243","type":"journal-article","created":{"date-parts":[[2016,8,5]],"date-time":"2016-08-05T10:10:24Z","timestamp":1470391824000},"page":"1243","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Improved Feature Matching for Mobile Devices with IMU"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8028-2815","authenticated-orcid":false,"given":"Andrea","family":"Masiero","sequence":"first","affiliation":[{"name":"CIRGEO (Interdepartmental Research Center of Geomatics), University of Padova, via dell\u2019Universit\u00e0 16, 35020 Legnaro (PD), Italy"}]},{"given":"Antonio","family":"Vettore","sequence":"additional","affiliation":[{"name":"CIRGEO (Interdepartmental Research Center of Geomatics), University of Padova, via dell\u2019Universit\u00e0 16, 35020 Legnaro (PD), Italy"}]}],"member":"1968","published-online":{"date-parts":[[2016,8,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.autcon.2015.12.022","article-title":"3D terrain reconstruction of construction sites using a stereo camera","volume":"64","author":"Sung","year":"2016","journal-title":"Autom. Constr."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.autcon.2012.09.017","article-title":"Image-based 3D scene reconstruction and exploration in augmented reality","volume":"33","author":"Yang","year":"2013","journal-title":"Autom. Constr."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"290","DOI":"10.3390\/rs8040290","article-title":"Exploring Long Term Spatial Vegetation Trends in Taiwan from AVHRR NDVI3g Dataset Using RDA and HCA Analyses","volume":"8","author":"Tsai","year":"2016","journal-title":"Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1891","DOI":"10.1002\/esp.3767","article-title":"Bank erosion in agricultural drainage networks: New challenges from structure-from-motion photogrammetry for post-event analysis","volume":"40","author":"Prosdocimi","year":"2015","journal-title":"Earth Surf. Process. Landf."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1104","DOI":"10.3390\/rs3061104","article-title":"Heritage recording and 3D modeling with photogrammetry and 3D scanning","volume":"3","author":"Remondino","year":"2011","journal-title":"Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Tanskanen, P., Kolev, K., Meier, L., Camposeco, F., Saurer, O., and Pollefeys, M. (2013, January 1\u20138). Live metric 3d reconstruction on mobile phones. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.","DOI":"10.1109\/ICCV.2013.15"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1177\/0278364913509675","article-title":"Camera-IMU-based localization: Observability analysis and consistency improvement","volume":"33","author":"Hesch","year":"2013","journal-title":"Int. J. Robot. Res."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kolev, K., Tanskanen, P., Speciale, P., and Pollefeys, M. (2014, January 23\u201328). Turning mobile phones into 3d scanners. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.504"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Klingensmith, M., Dryanovski, I., Srinivasa, S., and Xiao, J. (2015, January 3). Chisel: Real time large scale 3D reconstruction onboard a mobile device. Proceedings of the Robotics Science and Systems, Rome, Italy.","DOI":"10.15607\/RSS.2015.XI.040"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Sch\u00f6ps, T., Engel, J., and Cremers, D. (2014, January 10\u201312). Semi-dense visual odometry for AR on a smartphone. Proceedings of the 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Munich, Germany.","DOI":"10.1109\/ISMAR.2014.6948420"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1109\/TVCG.2014.2355207","article-title":"Real-time 3d tracking and reconstruction on mobile phones","volume":"21","author":"Prisacariu","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"17471","DOI":"10.3390\/s140917471","article-title":"Calibration of Action Cameras for Photogrammetric Purposes","volume":"14","author":"Balletti","year":"2014","journal-title":"Sensors"},{"key":"ref_13","first-page":"C22","article-title":"UAV photogTrammetry for mapping and 3d modeling-current status and future perspectives","volume":"38","author":"Remondino","year":"2011","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Surov\u1ef3, P., Yoshimoto, A., and Panagiotidis, D. (2016). Accuracy of Reconstruction of the Tree Stem Surface Using Terrestrial Close-Range Photogrammetry. Remote Sens., 8.","DOI":"10.3390\/rs8020123"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"16883","DOI":"10.3390\/rs71215859","article-title":"Accuracy and Precision of Habitat Structural Complexity Metrics Derived from Underwater Photogrammetry","volume":"7","author":"Figueira","year":"2015","journal-title":"Remote Sens."},{"key":"ref_16","first-page":"1345","article-title":"Analysis of glacial and periglacial processes using structure from motion","volume":"3","author":"Piermattei","year":"2015","journal-title":"Earth Surf. Dyn. Discuss."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lowe, D. (1999, January 20\u201327). Object recognition from local scale-invariant features. Proceedings of the 1999 IEEE International Conference on Computer Vision (ICCV), Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-up robust features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Leutenegger, S., Chli, M., and Siegwart, R.Y. (2011, January 6\u201313). BRISK: Binary robust invariant scalable keypoints. Proceedings of the 2011 IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126542"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Alahi, A., Ortiz, R., and Vandergheynst, P. (2012, January 16\u201321). Freak: Fast retina keypoint. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247715"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Ma, Y., Soatto, S., Ko\u0161eck\u00e1, J., and Sastry, S. (2003). An Invitation to 3D Vision, Springer.","DOI":"10.1007\/978-0-387-21779-6"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1007\/978-3-642-15552-9_9","article-title":"Conjugate Gradient Bundle Adjustment","volume":"Volume 6312","year":"2010","journal-title":"Computer Vision\u2014ECCV 2010"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1007\/978-3-642-15552-9_3","article-title":"Bundle Adjustment in the Large","volume":"Volume 6312","author":"Agarwal","year":"2010","journal-title":"Computer Vision\u2014ECCV 2010"},{"key":"ref_25","first-page":"401","article-title":"An ISVD-based Euclidian structure from motion for smartphones","volume":"XL-5","author":"Masiero","year":"2014","journal-title":"ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"707","DOI":"10.1007\/3-540-47969-4_47","article-title":"Incremental Singular Value Decomposition of Uncertain Data With Missing Values","volume":"Volume 2350","author":"Brand","year":"2002","journal-title":"Computer Vision\u2014ECCV 2002"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1362","DOI":"10.1109\/TPAMI.2009.161","article-title":"Accurate, dense, and robust multiview stereopsis","volume":"32","author":"Furukawa","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Furukawa, Y., Curless, B., Seitz, S., and Szeliski, R. (2010, January 13\u201318). Towards Internet-scale Multi-view Stereo. Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539802"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Goesele, M., Snavely, N., Curless, B., Hoppe, H., and Seitz, S. (2007, January 14\u201321). Multi-View Stereo for Community Photo Collections. Proceedings of the 2007 IEEE International Conference on Computer Vision (ICCV), Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4408933"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1006\/cviu.1997.0547","article-title":"Triangulation","volume":"68","author":"Hartley","year":"1997","journal-title":"Comput. Visi. Image Underst."},{"key":"ref_31","unstructured":"Triggs, B., McLauchlan, P., Hartley, R., and Fitzgibbon, A. (1999). Vision Algorithms: Theory and Practice, Springer Verlag. Springer Lecture Notes on Computer Science."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Masiero, A., and Cenedese, A. (2012, January 27\u201329). On triangulation algorithms in large scale camera network systems. Proceedings of the 2012 American Control Conference, ACC 2012, Montreal, QC, Canada.","DOI":"10.1109\/ACC.2012.6315278"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"De Agostino, M., Manzino, A.M., and Piras, M. (2010, January 4\u20136). Performances comparison of different MEMS-based IMUs. Proceedings of the 2010 IEEE\/ION Position Location and Navigation Symposium (PLANS), Indian Wells, CA, USA.","DOI":"10.1109\/PLANS.2010.5507128"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kurz, D., and Benhimane, S. (2011, January 26\u201329). Gravity-aware handheld augmented reality. Proceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Basel, Switzerland.","DOI":"10.1109\/ISMAR.2011.6092376"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Troiani, C., Martinelli, A., Laugier, C., and Scaramuzza, D. (June, January 31). 2-point-based outlier rejection for camera-imu systems with applications to micro aerial vehicles. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907672"},{"key":"ref_36","unstructured":"Baatz, G., K\u00f6ser, K., Chen, D., Grzeszczuk, R., and Pollefeys, M. (2010). Computer Vision\u2014ECCV 2010, Springer. European Conference on Computer Vision."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1137\/080732730","article-title":"ASIFT: A New Framework for Fully Affine Invariant Image Comparison","volume":"2","author":"Morel","year":"2009","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"115","DOI":"10.3934\/ipi.2011.5.115","article-title":"Is SIFT Scale Invariant?","volume":"5","author":"Morel","year":"2011","journal-title":"Inverse Probl. Imaging"},{"key":"ref_39","unstructured":"Pritchett, P., and Zisserman, A. (1998, January 4\u20137). Wide baseline stereo matching. Proceedings of the Sixth International Conference on Computer Vision, Bombay, India."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Tuytelaars, T., and Van Gool, L.J. (2000, January 11\u201314). Wide Baseline Stereo Matching based on Local, Affinely Invariant Regions. Proceedings of the BMVC, Bristol, UK.","DOI":"10.5244\/C.14.38"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1016\/j.imavis.2004.02.006","article-title":"Robust wide-baseline stereo from maximally stable extremal regions","volume":"22","author":"Matas","year":"2004","journal-title":"Image Vis. Comput."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1109\/TPAMI.2009.77","article-title":"Daisy: An efficient dense descriptor applied to wide-baseline stereo","volume":"32","author":"Tola","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_44","unstructured":"Chum, O., Matas, J., and Kittler, J. (2003). Pattern Recognition, Springer."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"5742","DOI":"10.3390\/s140405742","article-title":"Context-Aware Personal Navigation Using Embedded Sensor Fusion in Smartphones","volume":"14","author":"Saeedi","year":"2014","journal-title":"Sensors"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1606","DOI":"10.1109\/TIM.2006.881033","article-title":"The Utilization of Artificial Neural Networks for Multisensor System Integration in Navigation and Positioning Instruments","volume":"55","author":"Noureldin","year":"2006","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_47","unstructured":"Barbarella, M., Gandolfi, S., Meffe, A., and Burchi, A. (2011, January 20\u201323). Improvement of an MMS trajectory, in presence of GPS outage, using virtual positions. Proceedings of the ION GNSS 24th International Technical Meeting of the Satellite Division, Portland, OR, USA."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1012","DOI":"10.3390\/mi5041012","article-title":"A Particle Filter for Smartphone-Based Indoor Pedestrian Navigation","volume":"5","author":"Masiero","year":"2014","journal-title":"Micromachines"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1007\/s00138-010-0270-3","article-title":"Quasi-Euclidean epipolar rectification of uncalibrated images","volume":"22","author":"Fusiello","year":"2011","journal-title":"Mach. Vis. Appl."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Medioni, G., and Kang, S.B. (2005). Emerging Topics in Computer Vision, Prentice Hall.","DOI":"10.1016\/B978-012375731-9\/50099-9"},{"key":"ref_51","first-page":"855","article-title":"Close-range camera calibration","volume":"37","author":"Brown","year":"1971","journal-title":"Photogramm. Eng."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1066","DOI":"10.1109\/34.879788","article-title":"Geometric Camera Calibration Using Circular Control Points","volume":"22","author":"Heikkila","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_53","unstructured":"Zhang, Z. (1999, January 20\u201327). Flexible camera calibration by viewing a plane from unknown orientations. Proceedings of the 1999 IEEE International Conference on Computer Vision (ICCV), Kerkyra, Greece."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/S0924-2716(97)00005-1","article-title":"Digital camera self-calibration","volume":"52","author":"Fraser","year":"1997","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_55","first-page":"266","article-title":"Digital camera calibration methods: Considerations and comparisons","volume":"XXXVI-5","author":"Remondino","year":"2006","journal-title":"ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"948","DOI":"10.1117\/1.1555732","article-title":"Automatic calibration of low-cost digital cameras","volume":"42","author":"Habib","year":"2003","journal-title":"Opt. Eng."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Karel, W., and Pfeifer, N. (2009, January 19). Range camera calibration based on image sequences and dense comprehensive error statistics. Proceedings of the IS&T\/SPIE Electronic Imaging. International Society for Optics and Photonics, San Jose, CA, USA.","DOI":"10.1117\/12.807785"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.isprsjprs.2015.10.006","article-title":"Sensor modelling and camera calibration for close-range photogrammetry","volume":"115","author":"Luhmann","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_59","unstructured":"Beis, J.S., and Lowe, D.G. (1997, January 17\u201319). Shape indexing using approximate nearest-neighbour search in high-dimensional spaces. Proceedings of the 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"756","DOI":"10.1109\/TPAMI.2004.17","article-title":"An efficient solution to the five-point relative pose problem","volume":"26","year":"2004","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1038\/293133a0","article-title":"A computer algorithm for reconstructing a scene from two projections","volume":"293","year":"1981","journal-title":"Nature"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"580","DOI":"10.1109\/34.601246","article-title":"In Defense of the Eight-Point Algorithm","volume":"19","author":"Hartley","year":"1997","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1109\/TPAMI.2005.44","article-title":"A quasi-dense approach to surface reconstruction from uncalibrated images","volume":"27","author":"Lhuillier","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_64","unstructured":"Vedaldi, A., and Fulkerson, B. VLFeat: An Open and Portable Library of Computer Vision Algorithms. Available online: http:\/\/www.vlfeat.org\/."},{"key":"ref_65","unstructured":"Hol, J. (2011). Sensor Fusion and Calibration of Inertial Sensors, Vision, Ultra-Wideband and GPS. [Ph.D. Thesis, The Institute of Technology, Link\u00f6ping University]."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"1897","DOI":"10.1088\/0957-0233\/18\/7\/016","article-title":"A new multi-position calibration method for MEMS inertial navigation systems","volume":"18","author":"Syed","year":"2007","journal-title":"Meas. Sci. Technol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/8\/1243\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:27:53Z","timestamp":1760210873000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/8\/1243"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,8,5]]},"references-count":66,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2016,8]]}},"alternative-id":["s16081243"],"URL":"https:\/\/doi.org\/10.3390\/s16081243","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2016,8,5]]}}}