{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T13:59:14Z","timestamp":1780581554729,"version":"3.54.1"},"reference-count":52,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T00:00:00Z","timestamp":1658448000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Nature Science Foundation of China","doi-asserted-by":"publisher","award":["42071340"],"award-info":[{"award-number":["42071340"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Nowadays, the integration between photogrammetry and structure from motion (SFM) has become much closer, and many attempts have been made to combine the two approaches to realize the positioning, calibration, and 3D reconstruction of a large number of images. For the positioning and calibration of high oblique frame sweep (HOFS) aerial cameras, a quadrifocal tensor SFM photogrammetry technique is proposed to resolve the positioning and calibration task of such cameras. It adopts the quadrifocal tensor idea into the OpenMVG SFM pipeline to solve the complexity problem caused by the small single-viewing imaging area and the high image overlapping ratio. It also integrates the photogrammetry iteration idea into the OpenMVG SFM pipeline to enhance the positioning and calibration accuracy, which includes a coarse to fine three-stage Bundle Adjustment (BA) processing approach. In this paper, the overall workflow of the proposed technique was first introduced in detail, from feature extraction and image matching, relative rotation and translation estimation, global rotation and translation estimation, and the quadrifocal tensor model construction to the three-stage BA process and calibration. Then, experiments were carried out in the Zhengzhou area, implementing four types of adjustment methods. The results suggest that the proposed quadrifocal tensor SFM photogrammetry is suitable for large tilt frame sweep camera positioning and calibration without prior information on detailed camera intrinsic parameters and structure. The modifications made to the OpenMVG SFM pipeline enhanced the precision of image positioning and calibration and provided the precision level of professional photogrammetry software.<\/jats:p>","DOI":"10.3390\/rs14153521","type":"journal-article","created":{"date-parts":[[2022,7,25]],"date-time":"2022-07-25T01:42:13Z","timestamp":1658713333000},"page":"3521","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A Quadrifocal Tensor SFM Photogrammetry Positioning and Calibration Technique for HOFS Aerial Sensors"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4300-2607","authenticated-orcid":false,"given":"Tao","family":"Wang","sequence":"first","affiliation":[{"name":"Geospatial Information Institute, Information Engineering University, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yan","family":"Zhang","sequence":"additional","affiliation":[{"name":"Geospatial Information Institute, Information Engineering University, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yongsheng","family":"Zhang","sequence":"additional","affiliation":[{"name":"Geospatial Information Institute, Information Engineering University, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ying","family":"Yu","sequence":"additional","affiliation":[{"name":"Geospatial Information Institute, Information Engineering University, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lei","family":"Li","sequence":"additional","affiliation":[{"name":"Geospatial Information Institute, Information Engineering University, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shaocong","family":"Liu","sequence":"additional","affiliation":[{"name":"Geospatial Information Institute, Information Engineering University, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiang","family":"Zhao","sequence":"additional","affiliation":[{"name":"Geospatial Information Institute, Information Engineering University, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2405-2038","authenticated-orcid":false,"given":"Zhenchao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Geospatial Information Institute, Information Engineering University, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1062-2017","authenticated-orcid":false,"given":"Longhui","family":"Wang","sequence":"additional","affiliation":[{"name":"Geospatial Information Institute, Information Engineering University, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Konecny, G. (2014). Geoinformation: Remore Sensing, Photogrammetry and Geographic Information Systems, CRC Press. [2nd ed.].","DOI":"10.1201\/b15765"},{"key":"ref_2","unstructured":"Lindner, W. (2016). Digital Photogrammetry: A Practical Course, Springer."},{"key":"ref_3","unstructured":"McGlone, J.C. (2013). Manual of Photogrammetry, American Society of Photogrammetry and Remote Sensing. [6th ed.]."},{"key":"ref_4","unstructured":"Wolf, P.R., and Dewitt, B.A. (2014). Elements of Photogrammetry with Applications in GIS, McGraw-Hill Education. [4th ed.]."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Aber, J.S., Marzolff, I., and Ries, J. (2010). Small-Format Aerial Photography: Principles, Techniques and Geoscience Applications, Elsevier.","DOI":"10.1016\/B978-0-444-53260-2.10002-X"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ikkala, L., Ronkanen, A.K., Ilmonen, J., Simil\u00e4, M., Rehell, S., Kumpula, T., P\u00e4kkil\u00e4, L., Kl\u00f6ve, B., and Marttila, H. (2022). Unmanned Aircraft System (UAS) Structure-From-Motion (SfM) for Monitoring the Changed Flow Paths and Wetness in Minerotrophic Peatland Restoration. Remote Sens., 14.","DOI":"10.3390\/rs14133169"},{"key":"ref_7","unstructured":"Fritsch, D., and Spiller, R. (2001). DMC-The digital sensor technology of Z\/I-Imaging. Photogrammetric Week\u201901, Wichmann Verlag."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"825","DOI":"10.1111\/j.1365-2966.2007.11881.x","article-title":"ULTRACAM: An ultrafast, triple-beam CCD camera for high-speed astrophysics","volume":"378","author":"Dhillon","year":"2007","journal-title":"Mon. Not. R. Astron. Soc."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"437","DOI":"10.5194\/isprs-archives-XLII-1-437-2018","article-title":"Combining Airborne Oblique Camera and Lidar Sensors: Investigation and new Perspectives","volume":"42","author":"Toschi","year":"2018","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_10","first-page":"450","article-title":"Generation of SWDC-4 aerial digital camera virtual images","volume":"33","author":"Li","year":"2008","journal-title":"Geomat. Inf. Sci. Wuhan Univ."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1117\/12.328037","article-title":"Multispectral EO LOROP camera","volume":"Volume 3436","author":"Hoefft","year":"1998","journal-title":"Infrared Technology and Applications XXIV"},{"key":"ref_12","first-page":"75","article-title":"The Goodrich 3rd generation DB-110 system: Operational on tactical and unmanned aircraft","volume":"Volume 6209","author":"Iyengar","year":"2006","journal-title":"Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications III"},{"key":"ref_13","unstructured":"Pechatnikov, M., Shor, E., and Raizman, Y. (2008, January 3\u201311). VisionMap A3-super wide angle mapping system basic principles and workflow. Proceedings of the 21th ISPRS Congress, Beijing, Oral Technical Session SS-8 (2), Beijing, China."},{"key":"ref_14","unstructured":"Fritsch, D., and Spiller, R. (2013). High Throughput Aerial Photography, Ortho & 3D Processing. Photogrammetric Week, Wichmann Verlag."},{"key":"ref_15","unstructured":"Raizman, Y., and Gozes, A. (2015, January 7\u201311). Tel-Aviv. VisionMap A3 Edge\u2014A Single Camera for Multiple Solutions. Proceedings of the Conference 55th Photogrammetric Week, Stuttgart, Germany."},{"key":"ref_16","unstructured":"Pechatnikov, M., Raizman, Y., and Tel-Aviv, V. (2011, January 19\u201322). Visionmap A3 LightSpeed\u2014A new generation of the ground processing system. Proceedings of the International Scientific Racurs Conference, Tossa der Mar, Spain."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Triggs, B., McLauchlan, P.F., Hartley, R.I., and Fitzgibbon, A.W. (1999). Bundle adjustment\u2014A modern synthesis. International Workshop on Vision Algorithms, Springer.","DOI":"10.1007\/3-540-44480-7_21"},{"key":"ref_18","unstructured":"Richard, H., and Andrew, Z. (2000). Multiple View Geometry in Computer Vision, Cambridge University Press."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"226297","DOI":"10.1109\/ACCESS.2020.3045443","article-title":"Clifford Geometric Algebra-Based Approach for 3D Modeling of Agricultural Images Acquired by UAVs","volume":"8","author":"Khan","year":"2020","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"103664","DOI":"10.1016\/j.compind.2022.103664","article-title":"Structure-from-motion based image unwrapping and stitching for small bore pipe inspections","volume":"139","author":"Zhang","year":"2022","journal-title":"Comput. Ind."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Jiang, N., Cui, Z., and Tan, P. (2013, January 1\u20138). A global linear method for camera pose registration. Proceedings of the IEEE International Conference on Computer Vision, Sydney, NSW, Australia.","DOI":"10.1109\/ICCV.2013.66"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Cui, Z., and Tan, P. (2015, January 7\u201313). Global structure-from-motion by similarity averaging. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.105"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Cui, Z., Jiang, N., Tang, C., and Tan, P. (2015). Linear global translation estimation with feature tracks. arXiv.","DOI":"10.5244\/C.29.46"},{"key":"ref_24","unstructured":"Goldstein, T., Hand, P., Lee, C., Voroninski, V., and Soatto, S. Shapefit and shapekick for robust, scalable structure from motion. Proceedings of the European Conference on Computer Vision."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Sweeney, C., Sattler, T., Hollerer, T., Turk, M., and Pollefeys, M. (2015, January 7\u201313). Optimizing the viewing graph for structure-from-motion. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.98"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ozyesil, O., and Singer, A. (2015, January 7\u201312). Robust camera location estimation by convex programming. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298883"},{"key":"ref_27","unstructured":"Wilson, K., and Snavely, N. Robust global translations with 1dsfm. Proceedings of the European Conference on Computer Vision."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhu, S., Zhang, R., Zhou, L., Shen, T., Fang, T., Tan, P., and Quan, L. (2018, January 18\u201323). Very large-scale global sfm by distributed motion averaging. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00480"},{"key":"ref_29","unstructured":"Moulon, P., Monasse, P., and Marlet, R. Adaptive structure from motion with a contrario model estimation. Proceedings of the Asian Conference on Computer Vision."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Cui, H., Shen, S., Gao, X., and Hu, Z. (2017, January 10\u201312). Batched incremental structure-from-motion. Proceedings of the International Conference on 3D Vision (3DV), Qingdao, China.","DOI":"10.1109\/3DV.2017.00032"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/s11263-007-0107-3","article-title":"Modeling the world from internet photo collections","volume":"80","author":"Snavely","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Snavely, N., Seitz, S.M., and Szeliski, R. (2006). Photo tourism: Exploring photo collections in 3D. ACM Siggraph 2006 Papers, ACM.","DOI":"10.1145\/1179352.1141964"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Cui, H., Shen, S., Gao, W., and Wang, Z. (2018, January 5\u20138). Progressive large-scale structure-from-motion with orthogonal MSTs. Proceedings of the 2018 International Conference on 3D Vision (3DV), Verona, Italy.","DOI":"10.1109\/3DV.2018.00020"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Schonberger, J.L., and Frahm, J.M. (2016, January 27\u201330). Structure-from-motion revisited. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.445"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wu, C. (July, January 29). Towards linear-time incremental structure from motion. Proceedings of the 2013 International Conference on 3D Vision-3DV 2013, Seattle, WA, USA.","DOI":"10.1109\/3DV.2013.25"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Moulon, P., Monasse, P., and Marlet, R. (2013, January 1\u20138). Global fusion of relative motions for robust, accurate and scalable structure from motion. Proceedings of the IEEE International Conference on Computer Vision, Sydney, NSW, Australia.","DOI":"10.1109\/ICCV.2013.403"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Lindenberger, P., Sarlin, P.E., Larsson, V., and Pollefeys, M. (2021, January 11\u201317). Pixel-Perfect Structure-from-Motion with Feature metric Refinement. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00593"},{"key":"ref_38","unstructured":"Bhowmick, B., Patra, S., Chatterjee, A., Govindu, V.M., and Banerjee, S. (2014). Divide and conquer: Efficient large-scale structure from motion using graph partitioning. Asian Conference on Computer Vision, Springer."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Gherardi, R., Farenzena, M., and Fusiello, A. (2010, January 13\u201318). Improving the efficiency of hierarchical structure-and-motion. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539782"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Farenzena, M., Fusiello, A., and Gherardi, R. (October, January 27). Structure-and-motion pipeline on a hierarchical cluster tree. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops, Kyoto, Japan.","DOI":"10.1109\/ICCVW.2009.5457435"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.cviu.2015.05.011","article-title":"Hierarchical structure-and-motion recovery from uncalibrated images","volume":"140","author":"Toldo","year":"2015","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Cui, H., Gao, X., Shen, S., and Hu, Z. (2017, January 21\u201326). HSfM: Hybrid structure-from-motion. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.257"},{"key":"ref_43","unstructured":"Zhu, S., Shen, T., Zhou, L., Zhang, R., Wang, J., Fang, T., and Quan, L. (2017). Parallel structure from motion from local increment to global averaging. arXiv."},{"key":"ref_44","unstructured":"Shah, R., Deshpande, A., and Narayanan, P.J. (2015). Multistage SfM: A coarse-to-fine approach for 3d reconstruction. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Bao, S.Y., and Savarese, S. (2011). Semantic structure from motion. CVPR 2011, IEEE.","DOI":"10.1109\/CVPR.2011.5995462"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Bao, S.Y., Bagra, M., Chao, Y.W., and Savarese, S. (2012, January 16\u201321). Semantic structure from motion with points, regions, and objects. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247992"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Chen, Y., Wang, Y., Lu, P., Chen, Y., and Wang, G. (2018). Large-scale structure from motion with semantic constraints of aerial images. Chinese Conference on Pattern Recognition and Computer Vision (PRCV), Springer.","DOI":"10.1007\/978-3-030-03398-9_30"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.geomorph.2012.08.021","article-title":"\u2018Structure-from-Motion\u2019photogrammetry: A low-cost, effective tool for geoscience applications","volume":"179","author":"Westoby","year":"2012","journal-title":"Geomorphology"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"IJCV"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Martinec, D., and Pajdla, T. (2007, January 17\u201322). Robust rotation and translation estimation in multi-view reconstruction. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383115"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Wang, T., Zhang, Y., Zhang, Y., Zhang, Z., Xiao, X., Yu, Y., and Wang, L. (2021). A Spliced Satellite Optical Camera Geometric Calibration Method Based on Inter-Chip Geometry Constraints. Remote Sens., 13.","DOI":"10.3390\/rs13142832"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"643","DOI":"10.14358\/PERS.85.9.643","article-title":"Geometric Calibration for the Aerial Line Scanning Camera GFXJ","volume":"85","author":"Wang","year":"2019","journal-title":"Photogramm. Eng. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/15\/3521\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:55:00Z","timestamp":1760140500000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/15\/3521"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,22]]},"references-count":52,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["rs14153521"],"URL":"https:\/\/doi.org\/10.3390\/rs14153521","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,22]]}}}