{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T21:07:02Z","timestamp":1767992822566,"version":"3.49.0"},"reference-count":33,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2011,9,8]],"date-time":"2011-09-08T00:00:00Z","timestamp":1315440000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Time-of-flight cameras, based on Photonic Mixer Device (PMD) technology, are capable of measuring distances to objects at high frame rates, however, the measured ranges and the intensity data contain systematic errors that need to be corrected. In this paper, a new integrated range camera self-calibration method via joint setup with a digital (RGB) camera is presented. This method can simultaneously estimate the systematic range error parameters as well as the interior and external orientation parameters of the camera. The calibration approach is based on photogrammetric bundle adjustment of observation equations originating from collinearity condition and a range errors model. Addition of a digital camera to the calibration process overcomes the limitations of small field of view and low pixel resolution of the range camera. The tests are performed on a dataset captured by a PMD[vision]-O3 camera from a multi-resolution test field of high contrast targets. An average improvement of 83% in RMS of range error and 72% in RMS of coordinate residual, over that achieved with basic calibration, was realized in an independent accuracy assessment. Our proposed calibration method also achieved 25% and 36% improvement on RMS of range error and coordinate residual, respectively, over that obtained by integrated calibration of the single PMD camera.<\/jats:p>","DOI":"10.3390\/s110908721","type":"journal-article","created":{"date-parts":[[2011,9,8]],"date-time":"2011-09-08T12:32:55Z","timestamp":1315485175000},"page":"8721-8740","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Range Camera Self-Calibration Based on Integrated Bundle Adjustment via Joint Setup with a 2D Digital Camera"],"prefix":"10.3390","volume":"11","author":[{"given":"Mozhdeh","family":"Shahbazi","sequence":"first","affiliation":[{"name":"Department of Geomatics Engineering, University of Tehran, North Amriabad Street, Tehran 11155-4563, Iran"}]},{"given":"Saeid","family":"Homayouni","sequence":"additional","affiliation":[{"name":"Department of Geomatics Engineering, University of Tehran, North Amriabad Street, Tehran 11155-4563, Iran"}]},{"given":"Mohammad","family":"Saadatseresht","sequence":"additional","affiliation":[{"name":"Department of Geomatics Engineering, University of Tehran, North Amriabad Street, Tehran 11155-4563, Iran"}]},{"given":"Mehran","family":"Sattari","sequence":"additional","affiliation":[{"name":"Department of Geomatics Engineering, University of Isfahan, HezarJerib Street, Isfahan 81746-73441, Iran"}]}],"member":"1968","published-online":{"date-parts":[[2011,9,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Natroshvili, K, Schmid, M, Stephan, M, Stiegler, A, and Schamm, T (2008, January 4\u20136). Real Time Pedestrian Detection by Fusing PMD and CMOS Cameras. Eindhoven, The Netherlands.","DOI":"10.1109\/IVS.2008.4621147"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Van den Bergh, M, and Van Gool, L (2011, January 5\u20137). Combining RGB and ToF Cameras for Real-time 3D Hand Gesture Interaction. Kona, HI, USA.","DOI":"10.1109\/WACV.2011.5711485"},{"key":"ref_3","first-page":"355","article-title":"Pose estimation and map building with a Time-of-Flight camera for robot navigation","volume":"5","author":"Prusak","year":"2008","journal-title":"Int. J. Intell. Syst. Technol. Appl"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Hochdorfer, S, and Schlegel, C (2010, January 18\u201322). 6 DoF SLAM Using a ToF Camera: The Challenge of a Continuously Growing Number of Landmarks. Taipei, Taiwan.","DOI":"10.1109\/IROS.2010.5651229"},{"key":"ref_5","first-page":"402","article-title":"Theoretical and experimental investigation of the systematic errors and statistical uncertainties of Time-of-Flight cameras","volume":"5","author":"Rapp","year":"2008","journal-title":"Int. J. Intell. Syst. Technol. Appl"},{"key":"ref_6","unstructured":"Reulke, R (2006, January 25\u201327). Combination of distance data with high resolution images. Part 3\/W52."},{"key":"ref_7","unstructured":"Santrac, N, Friedland, G, and Rojas, R Technical Report B-06-09; 2006. Available online: http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.149.7888&rep=rep1&type=pdf (accessed on 16 Auguest 2011)."},{"key":"ref_8","first-page":"285","article-title":"Calibration of focal length and 3D pose based on the reflectance and depth","volume":"5","author":"Beder","year":"2008","journal-title":"Int. J. Intell. Syst. Technol. Appl"},{"key":"ref_9","unstructured":"Kahlmann, T, Remondino, F, and Ingensand, H (2006, January 1\u20133). Calibration for increased accuracy of the range imaging camera SwissRanger. Paris, France."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"524","DOI":"10.1007\/11919629_53","article-title":"Lateral and depth calibration of PMD-distance sensors","volume":"4292","author":"Lindner","year":"2006","journal-title":"Lect Note Comput Sci"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lindner, M, and Kolb, A (2007, January 16). Calibration of the Intensity-Related Distance Error of the PMD TOF-Camera. Boston, MA, USA.","DOI":"10.1117\/12.752808"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Fuchs, S, and Hirzinger, G (2008, January 24\u201326). Extrinsic and Depth Calibration of ToF Cameras. Anchorage, AK, USA.","DOI":"10.1109\/CVPR.2008.4587828"},{"key":"ref_13","unstructured":"Schiller, I, Beder, C, and Koch, R (2008, January 3\u201311). Calibration of a PMD-camera using a planar calibration pattern together with a multi-camera setup. Beijing, China."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1318","DOI":"10.1016\/j.cviu.2009.11.002","article-title":"Time-of-flight sensor calibration for accurate range sensing","volume":"114","author":"Lindner","year":"2010","journal-title":"Comput. Vis. Image Underst"},{"key":"ref_15","first-page":"945","article-title":"Integrated range camera calibration using image sequences from hand-held operation","volume":"37","author":"Karel","year":"2008","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci"},{"key":"ref_16","unstructured":"Kager, H, Rottensteiner, F, Kerschner, M, and Stadler, P (2002). Orpheus 3.2.1 User Manual, Institute of Photogrammetry and Remote Sensing, Vienna University of Technology."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1117\/1.3122002","article-title":"Photogrammetric calibration and colorization of the swissranger SR-3100 3-D range imaging sensor","volume":"48","author":"Robbins","year":"2009","journal-title":"Opt. Eng"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"10080","DOI":"10.3390\/s91210080","article-title":"Sensors for 3D imaging: Metric evaluation and calibration of a CCD\/CMOS time-of-flight camera","volume":"9","author":"Chiabrando","year":"2009","journal-title":"Sensors"},{"key":"ref_19","unstructured":"Pattinson, T (2010). Quantification and Description of Distance Measurement Errors of a Time-of-Flight Camera, M.Sc. Thesis,."},{"key":"ref_20","first-page":"927","article-title":"Self-calibration of a 3D range camera","volume":"37","author":"Lichti","year":"2008","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1016\/j.isprsjprs.2010.04.002","article-title":"An integrated bundle adjustment approach to range camera geometric self-calibration","volume":"65","author":"Lichti","year":"2010","journal-title":"ISPRS J. Photogramm"},{"key":"ref_22","unstructured":"Westfeld, P, Mulsow, C, and Schulze, M (2009, January 1\u20133). Photogrammetric Calibration of Range Imaging Sensors Using Intensity and Range Information Simultaneously. Vienna, Austria."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1014","DOI":"10.3390\/rs3051014","article-title":"A comparison of three geometric self-calibration methods for range cameras","volume":"3","author":"Lichti","year":"2011","journal-title":"Remote Sens"},{"key":"ref_24","unstructured":"Moller, T, Kraft, H, Frey, J, Albrecht, M, and Lange, R (2005, January 8\u20139). Robust 3D Measurement with PMD Sensors. ETH Zurich, Switzerland."},{"key":"ref_25","unstructured":"Luhmann, T, Robson, S, Kyle, S, and Harley, I (2007). Close Range Photogrammetry: Principles, Techniques and Applications, John Wiley & Sons."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/S0924-2716(97)00005-1","article-title":"Digital camera self-calibration","volume":"52","author":"Fraser","year":"1997","journal-title":"ISPRS J. Photogramm"},{"key":"ref_27","first-page":"274","article-title":"Calibration and registration for precise surface reconstruction with time-of-flight cameras","volume":"5","author":"Fuchs","year":"2008","journal-title":"Int. J. Intell. Syst. Technol. Appl"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Du, H, Oggier, T, Lustenburger, F, and Charbon, E (2005, January 5\u20138). A Virtual Keyboard Based on True-3D Optical Ranging. Oxford, UK.","DOI":"10.5244\/C.19.27"},{"key":"ref_29","unstructured":"Mikhail, EM (1976). Observations and Least Squares, IEP-A Dun-Donelley."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1007\/BF03655325","article-title":"Robust estimation for dependent observation","volume":"19","author":"Yang","year":"1994","journal-title":"Manuscr. Geod"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Rufli, M, Scaramuzza, D, and Siegwart, R (2008, January 22\u201326). Automatic Detection of Checkerboards on Blurred and Distorted Images. Nice, France.","DOI":"10.1109\/IROS.2008.4650703"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"552","DOI":"10.1007\/s001900050123","article-title":"Robust estimation and optimal selection of polynomial parameters for the interpolation of GPS geoid heights","volume":"71","author":"Zhong","year":"1997","journal-title":"J. Geod"},{"key":"ref_33","unstructured":"Wolf, PR, and Dewitt, BA (2000). Elements of Photogrammetry: With Applications in GIS, The McGraw-Hill Companies. [3rd ed]."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/11\/9\/8721\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:57:19Z","timestamp":1760219839000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/11\/9\/8721"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,9,8]]},"references-count":33,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2011,9]]}},"alternative-id":["s110908721"],"URL":"https:\/\/doi.org\/10.3390\/s110908721","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,9,8]]}}}