{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,17]],"date-time":"2026-05-17T17:46:18Z","timestamp":1779039978060,"version":"3.51.4"},"reference-count":44,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,3,29]],"date-time":"2022-03-29T00:00:00Z","timestamp":1648512000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The automatic positioning of machines in a large number of application areas is an important aspect of automation. Today, this is often done using classic geodetic sensors such as Global Navigation Satellite Systems (GNSS) and robotic total stations. In this work, a stereo camera system was developed that localizes a machine at high frequency and serves as an alternative to the previously mentioned sensors. For this purpose, algorithms were developed that detect active markers on the machine in a stereo image pair, find stereo point correspondences, and estimate the pose of the machine from these. Theoretical influences and accuracies for different systems were estimated with a Monte Carlo simulation, on the basis of which the stereo camera system was designed. Field measurements were used to evaluate the actual achievable accuracies and the robustness of the prototype system. The comparison is present with reference measurements with a laser tracker. The estimated object pose achieved accuracies higher than 16\u00a0mm with the translation components and accuracies higher than 3\u00a0mrad with the rotation components. As a result, 3D point accuracies higher than 16\u00a0mm were achieved by the machine. For the first time, a prototype could be developed that represents an alternative, powerful image-based localization method for machines to the classical geodetic sensors.<\/jats:p>","DOI":"10.3390\/s22072627","type":"journal-article","created":{"date-parts":[[2022,3,29]],"date-time":"2022-03-29T21:45:51Z","timestamp":1648590351000},"page":"2627","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Automatic Real-Time Pose Estimation of Machinery from Images"],"prefix":"10.3390","volume":"22","author":[{"given":"Marcel","family":"Bertels","sequence":"first","affiliation":[{"name":"Institute of Photogrammetry and Remote Sensing (IPF), Karlsruhe Institute of Technology, 76128 Karlsruhe, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4322-3074","authenticated-orcid":false,"given":"Boris","family":"Jutzi","sequence":"additional","affiliation":[{"name":"Institute of Photogrammetry and Remote Sensing (IPF), Karlsruhe Institute of Technology, 76128 Karlsruhe, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8457-5554","authenticated-orcid":false,"given":"Markus","family":"Ulrich","sequence":"additional","affiliation":[{"name":"Institute of Photogrammetry and Remote Sensing (IPF), Karlsruhe Institute of Technology, 76128 Karlsruhe, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,29]]},"reference":[{"key":"ref_1","first-page":"36","article-title":"Baumaschinenf\u00fchrung und\u2014Steuerung\u2014Von der Statischen zur Kinematischen Absteckung","volume":"133","author":"Stempfhuber","year":"2008","journal-title":"Z. Geod\u00e4Sie Geoinf. Landmanagement (zfv)"},{"key":"ref_2","unstructured":"Liebherr (2022, January 31). Crawler Dozers\u2014Product Information. Operator Assistance Systems and Machine Control. Available online: https:\/\/www.liebherr.com\/shared\/media\/construction-machinery\/earthmoving\/operator-assistance-systems\/crawler-tractors-oas-microsite\/liebherr-assistancesystems-brochure_en.pdf."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1515\/jag-2016-0028","article-title":"High frequent total station measurements for the monitoring of bridge vibrations","volume":"11","author":"Lienhart","year":"2017","journal-title":"J. Appl. Geod."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Luhmann, T., Robson, S., Kyle, S., and Boehm, J. (2019). Close-Range Photogrammetry and 3D Imaging, De Gruyter. [3rd ed.].","DOI":"10.1515\/9783110607253"},{"key":"ref_5","unstructured":"Weltzien, C., Kr\u00fcger, J., and Meyer, H. Kinematic positioning in a real time robotic total station network system. Proceedings of the 6th International Conference on Machine Control & Guidance, Berlin, Germany, 1\u20132 October 2018."},{"key":"ref_6","unstructured":"Leica Geosystems AG (2022, January 31). Leica Nova TS60. Available online: www.leica-geosystems.com\/-\/media\/files\/leicageosystems\/products\/datasheets\/leica_nova_ts60_ds.ashx?la=en&hash=5C7BEB60644F956CFD103D64CE197073."},{"key":"ref_7","unstructured":"Trimble Inc (2022, January 31). Trimble S9\/S9 HP. Available online: https:\/\/geospatial.trimble.com\/sites\/geospatial.trimble.com\/files\/2019-04\/022516-155F_TrimbleS9_DS_A4_0419_LR_0.pdf."},{"key":"ref_8","unstructured":"Weinmann, M., Wursthorn, S., and Jutzi, B. (2011, January 5\u20137). Semi-automatic image-based co-registration of range imaging data with different characteristics. Proceedings of the 38th ISPRS Conference PIA, Munich, Germany."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Keselman, L., Iselin Woodfill, J., Grunnet-Jepsen, A., and Bhowmik, A. (2017, January 21\u201326). Intel realsense stereoscopic depth cameras. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.167"},{"key":"ref_10","unstructured":"Intel Corporation (2022, March 02). Intel RealSense Depth Camera D455. Available online: https:\/\/www.intelrealsense.com\/depth-camera-d455\/."},{"key":"ref_11","unstructured":"Basler (2022, March 02). Basler Blaze\u2014Time-of-Flight-Kamera. Available online: https:\/\/www.baslerweb.com\/de\/produkte\/kameras\/3d-kameras\/basler-blaze\/."},{"key":"ref_12","unstructured":"LUCID Vision Labs (2022, March 02). Lucid Helios2\u2014Time-of-Flight-Kamera. Available online: https:\/\/thinklucid.com\/de\/helios-time-of-flight-tof-kamera\/."},{"key":"ref_13","unstructured":"Nerian Vision (2022, March 17). Product Specifications SceneScan & SceneScan Pro. Available online: https:\/\/nerian.de\/nerian-content\/downloads\/documents\/nerian-data-sheet-scenescan-scenescan-pro.pdf."},{"key":"ref_14","unstructured":"Stereolabs (2022, March 17). ZED 2. Available online: https:\/\/cdn.stereolabs.com\/assets\/datasheets\/zed2-camera-datasheet.pdf."},{"key":"ref_15","unstructured":"ARCURE (2022, March 17). Omega. Available online: https:\/\/arcure.net\/omega-stereo-camera-for-indoor-outdoor-applications."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1016\/j.patcog.2015.09.023","article-title":"Generation of fiducial marker dictionaries using mixed integer linear programming","volume":"51","year":"2016","journal-title":"Pattern Recognit."},{"key":"ref_17","unstructured":"Steger, C., Ulrich, M., and Wiedemann, C. (2018). Machine Vision Algorithms and Applications, Wiley-VCH. [2nd ed.]."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A Computational Approach to Edge Detection","volume":"8","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1007\/BF00123164","article-title":"Using Canny\u2019s criteria to derive a recursively implemented optimal edge detector","volume":"1","author":"Deriche","year":"1987","journal-title":"Int. J. Comput. Vis."},{"key":"ref_20","unstructured":"Hough, P.V.C. (1962). Method and Means for Recognizing Complex Patterns. (3069654), U.S. Patent."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"795","DOI":"10.1016\/S0262-8856(98)00160-7","article-title":"Size invariant circle detection","volume":"17","author":"Atherton","year":"1999","journal-title":"Image Vis. Comput."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2557","DOI":"10.1016\/S0031-3203(03)00169-9","article-title":"Real-time object recognition using a modified generalized Hough transform","volume":"36","author":"Ulrich","year":"2003","journal-title":"Pattern Recognit."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ci, W., and Huang, Y. (2016). A Robust Method for Ego-Motion Estimation in Urban Environment Using Stereo Camera. Sensors, 16.","DOI":"10.3390\/s16101704"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Liu, Y., Gu, Y., Li, J., and Zhang, X. (2017). Robust Stereo Visual Odometry Using Improved RANSAC-Based Methods for Mobile Robot Localization. Sensors, 17.","DOI":"10.3390\/s17102339"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1023\/B:VISI.0000025800.10423.1f","article-title":"SoftPOSIT: Simultaneous pose and correspondence determination","volume":"59","author":"David","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"137720","DOI":"10.1109\/ACCESS.2019.2939020","article-title":"Simultaneous Pose and Correspondence Determination Combining Softassign and Orthogonal Iteration","volume":"7","author":"Dong","year":"2019","journal-title":"IEEE Access"},{"key":"ref_28","first-page":"444","article-title":"Decentering distortion of lenses","volume":"32","author":"Brown","year":"1966","journal-title":"Photogramm. Eng."},{"key":"ref_29","unstructured":"(2021). HALCON 21.11 Progress. HALCON Operator Reference Manual, MVTec Software GmbH."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.isprsjprs.2021.04.010","article-title":"Robust detection of non-overlapping ellipses from points with applications to circular target extraction in images and cylinder detection in point clouds","volume":"176","author":"Maalek","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_31","unstructured":"Mosteller, F., and Tukey, J.W. (1977). Data Analysis and Regression: A Second Course in Statistics, Addison-Wesley Publishing Company."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1109\/MRA.2012.2182810","article-title":"Visual Odometry\u2014Part II: Matching, Robustness, Optimization, and Applications","volume":"19","author":"Fraundorfer","year":"2012","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1137\/0106028","article-title":"The Monte Carlo method","volume":"6","author":"Bauer","year":"1958","journal-title":"J. Soc. Ind. Appl. Math."},{"key":"ref_34","unstructured":"Joint Committee for Guides in Metrology (2008). Evaluation of measurement data\u2014Guide to the expression of uncertainty in measurement. JCGM, 100, 1\u2013116."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Sun, P., Lu, N.G., Dong, M.L., Yan, B.X., and Wang, J. (2018). Simultaneous all-parameters calibration and assessment of a stereo camera pair using a scale bar. Sensors, 18.","DOI":"10.3390\/s18113964"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2368","DOI":"10.1364\/AO.56.002368","article-title":"High-precision method of binocular camera calibration with a distortion model","volume":"56","author":"Weimin","year":"2017","journal-title":"Appl. Opt."},{"key":"ref_37","unstructured":"Association for Advancing Automation (2018). GigE Vision\u2014Video Streaming and Device Control Over Ethernet Standard, Association for Advancing Automation. Rel. 2.1."},{"key":"ref_38","unstructured":"(2020). IEEE Standard for a Precision Clock Synchronization Protocol for Networked Measurement and Control Systems (Standard No. IEEE Std 1588-2019 (Revision of IEEE Std 1588-2008))."},{"key":"ref_39","first-page":"855","article-title":"Close-range camera calibration","volume":"37","author":"Brown","year":"1971","journal-title":"Photogramm. Eng."},{"key":"ref_40","unstructured":"European Machine Vision Association (2016). EMVA Standard 1288\u2014Standard for Characterization of Image Sensors and Cameras, European Machine Vision Association. Rel. 3.1."},{"key":"ref_41","unstructured":"Power Motion (2021, September 29). Banner Engineering K80FL. Available online: https:\/\/www.powermotionstore.com\/products\/K80FLGXXP."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1111\/phor.12084","article-title":"Eccentricity in images of circular and spherical targets and its impact on spatial intersection","volume":"29","author":"Luhmann","year":"2014","journal-title":"Photogramm. Rec."},{"key":"ref_43","unstructured":"Hexagon Metrology (2022, January 31). Leica Absolute Tracker AT402. Available online: https:\/\/www.hexagonmi.com\/-\/media\/Hexagon%20MI%20Legacy\/m1\/metrology\/Absolute_Tracker_AT4\/brochures-datasheet\/Leica%20Absolute%20Tracker%20AT402%20-%20ASME%20specifications_en.ashx."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1080\/14498596.2015.1068232","article-title":"Kinematic positioning using a robotic total station as applied to small-scale UAVs","volume":"61","author":"Roberts","year":"2016","journal-title":"J. Spat. Sci."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/7\/2627\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:45:51Z","timestamp":1760136351000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/7\/2627"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,29]]},"references-count":44,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,4]]}},"alternative-id":["s22072627"],"URL":"https:\/\/doi.org\/10.3390\/s22072627","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,29]]}}}