{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:12:21Z","timestamp":1760209941662,"version":"build-2065373602"},"reference-count":52,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2017,10,31]],"date-time":"2017-10-31T00:00:00Z","timestamp":1509408000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>Visual methods have many applications in mobile robotics problems, such as localization, navigation, and mapping. Some methods require that the robot moves in a plane without tilting. This planar-motion assumption simplifies the problem, and can lead to improved results. However, tilting the robot violates this assumption, and may cause planar-motion methods to fail. Such a tilt should therefore be corrected. In this work, we estimate a robot\u2019s tilt relative to a ground plane from individual panoramic images. This estimate is based on the vanishing point of vertical elements, which commonly occur in indoor environments. We test the quality of two methods on images from several environments: An image-space method exploits several approximations to detect the vanishing point in a panoramic fisheye image. The vector-consensus method uses a calibrated camera model to solve the tilt-estimation problem in 3D space. In addition, we measure the time required on desktop and embedded systems. We previously studied visual pose-estimation for a domestic robot, including the effect of tilts. We use these earlier results to establish meaningful standards for the estimation error and time. Overall, we find the methods to be accurate and fast enough for real-time use on embedded systems. However, the tilt-estimation error increases markedly in environments containing relatively few vertical edges.<\/jats:p>","DOI":"10.3390\/robotics6040032","type":"journal-article","created":{"date-parts":[[2017,10,31]],"date-time":"2017-10-31T12:48:31Z","timestamp":1509454111000},"page":"32","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Visual Tilt Estimation for Planar-Motion Methods in Indoor Mobile Robots"],"prefix":"10.3390","volume":"6","author":[{"given":"David","family":"Fleer","sequence":"first","affiliation":[{"name":"Computer Engineering Group, Faculty of Technology, Bielefeld University, D-33594 Bielefeld, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,10,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.robot.2016.12.001","article-title":"Comparing Holistic and Feature-Based Visual Methods for Estimating the Relative Pose of Mobile Robots","volume":"89","author":"Fleer","year":"2017","journal-title":"Robot. Auton. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1109\/MRA.2011.943233","article-title":"Visual Odometry [Tutorial]","volume":"18","author":"Scaramuzza","year":"2011","journal-title":"Robot. Autom. Mag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1109\/MRA.2012.2182810","article-title":"Visual Odometry: Part II: Matching, Robustness, Optimization, and Applications","volume":"19","author":"Fraundorfer","year":"2012","journal-title":"Robot. Autom. Mag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TRO.2015.2496823","article-title":"Visual Place Recognition: A Survey","volume":"32","author":"Lowry","year":"2016","journal-title":"IEEE Trans. Robot."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1007\/s10462-012-9365-8","article-title":"Visual simultaneous localization and mapping: A survey","volume":"43","year":"2015","journal-title":"Artif. Intell. Rev."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1007\/s004220050470","article-title":"Where did I take that snapshot? Scene-based homing by image matching","volume":"79","author":"Franz","year":"1998","journal-title":"Biol. Cybern."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.robot.2005.12.001","article-title":"Efficient visual homing based on Fourier transformed panoramic images","volume":"54","author":"Mallot","year":"2006","journal-title":"Robot. Auton. Syst."},{"key":"ref_8","unstructured":"Franz, M.O., St\u00fcrzl, W., H\u00fcbner, W., and Mallot, H.A. (2007). A Robot System for Biomimetic Navigation\u2014From Snapshots to Metric Embeddings of View Graphs. Robotics and Cognitive Approaches to Spatial Mapping, Springer."},{"key":"ref_9","unstructured":"Booij, O., and Zivkovic, Z. (2009). The Planar Two Point Algorithm, University of Amsterdam, Faculty of Science, Informatics Institute. IAS Technical Report IAS-UVA-09-05."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1007\/s10514-010-9195-y","article-title":"Three 2D-Warping Schemes for Visual Robot Navigation","volume":"29","author":"Krzykawski","year":"2010","journal-title":"Auton. Robot."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Booij, O., Kr\u00f6se, B., and Zivkovic, Z. (2010). Efficient Probabilistic Planar Robot Motion Estimation Given Pairs of Images. Robotics: Science and Systems VI, MIT Press.","DOI":"10.15607\/RSS.2010.VI.026"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Gerstmayr-Hillen, L., Schl\u00fcter, O., Krzykawski, M., and M\u00f6ller, R. (2011, January 20\u201323). Parsimonious Loop-Closure Detection Based on Global Image-Descriptors of Panoramic Images. Proceedings of the International Conference on Advanced Robotics (ICAR 2011), Tallinn, Estonia.","DOI":"10.1109\/ICAR.2011.6088548"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1002\/rob.20103","article-title":"Visual odometry for ground vehicle applications","volume":"23","author":"Naroditsky","year":"2006","journal-title":"J. Field Robot."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1016\/j.isprsjprs.2006.03.005","article-title":"Recent developments on direct relative orientation","volume":"60","author":"Stewenius","year":"2006","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1177\/0278364907079276","article-title":"Relative pose calibration between visual and inertial sensors","volume":"26","author":"Lobo","year":"2007","journal-title":"Int. J. Robot. Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1177\/0278364911421954","article-title":"Rotation estimation and vanishing point extraction by omnidirectional vision in urban environment","volume":"31","author":"Bazin","year":"2012","journal-title":"Int. J. Robot. Res."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1063","DOI":"10.1162\/089976603765202668","article-title":"Manhattan World: Orientation and Outlier Detection by Bayesian Inference","volume":"15","author":"Coughlan","year":"2003","journal-title":"Neural Comput."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ko\u0161eck\u00e1, J., and Zhang, W. (2002). Video compass. European Conference on Computer Vision (ECCV), Springer.","DOI":"10.1007\/3-540-47979-1_32"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Dempster, A.P., Laird, N.M., and Rubin, D.B. (1977). Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. Ser. B, 1\u201338.","DOI":"10.1111\/j.2517-6161.1977.tb01600.x"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Denis, P., Elder, J.H., and Estrada, F.J. (2008). Efficient edge-based methods for estimating manhattan frames in urban imagery. European Conference on Computer Vision (ECCV), Springer.","DOI":"10.1007\/978-3-540-88688-4_15"},{"key":"ref_21","unstructured":"Tardif, J.P. (October, January 29). Non-iterative approach for fast and accurate vanishing point detection. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Kyoto, Japan."},{"key":"ref_22","first-page":"537","article-title":"Robust Multiple Structures Estimation with J-Linkage","volume":"Volume 1","author":"Toldo","year":"2008","journal-title":"European Conference on Computer Vision (ECCV)"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Bazin, J.C., Kweon, I., Demonceaux, C., and Vasseur, P. (2007, January 14\u201321). Rectangle extraction in catadioptric images. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4409208"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1007\/s11263-008-0186-9","article-title":"Global optimization through rotation space search","volume":"82","author":"Hartley","year":"2009","journal-title":"Int. J. Comput. Vis."},{"key":"ref_25","unstructured":"Schindler, G., and Dellaert, F. (July, January 27). Atlanta world: An expectation maximization framework for simultaneous low-level edge grouping and camera calibration in complex man-made environments. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Washington, DC, USA."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1007\/s11263-011-0488-1","article-title":"Geometric image parsing in man-made environments","volume":"97","author":"Tretyak","year":"2012","journal-title":"Int. J. Comput. Vis."},{"key":"ref_27","unstructured":"Antone, M.E., and Teller, S. (2000, January 13\u201315). Automatic recovery of relative camera rotations for urban scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Hilton Head Island, SC, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/S0734-189X(88)80033-1","article-title":"A Survey of the Hough Transform","volume":"44","author":"Illingworth","year":"1988","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_29","unstructured":"Lee, J.K., and Yoon, K.J. (2015, January 7\u201312). Real-time joint estimation of camera orientation and vanishing points. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Gerstmayr, L., R\u00f6ben, F., Krzykawski, M., Kreft, S., Venjakob, D., and M\u00f6ller, R. (2009). A Vision-Based Trajectory Controller for Autonomous Cleaning Robots. Autonome Mobile Systeme, Springer.","DOI":"10.1007\/978-3-642-10284-4_9"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1016\/j.robot.2012.12.006","article-title":"Dense topological maps and partial pose estimation for visual control of an autonomous cleaning robot","volume":"61","author":"Krzykawski","year":"2013","journal-title":"Robot. Auton. Syst."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.1016\/j.robot.2013.07.011","article-title":"Cleaning robot navigation using panoramic views and particle clouds as landmarks","volume":"61","author":"Krzykawski","year":"2013","journal-title":"Robot. Auton. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Scaramuzza, D., Martinelli, A., and Siegwart, R. (2006, January 9\u201315). A Toolbox for Easily Calibrating Omnidirectional Cameras. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Beijing, China.","DOI":"10.1109\/IROS.2006.282372"},{"key":"ref_35","first-page":"125","article-title":"Principles of Filter Design","volume":"2","author":"Scharr","year":"1999","journal-title":"Handb. Comput. Vis. Appl."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1006\/jvci.2001.0495","article-title":"A Scheme for Coherence-Enhancing Diffusion Filtering with Optimized Rotation Invariance","volume":"13","author":"Weickert","year":"2002","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_37","first-page":"120","article-title":"The OpenCV library","volume":"25","author":"Bradski","year":"2000","journal-title":"Dr. Dobbs J."},{"key":"ref_38","unstructured":"Murray, R.M., Li, Z., and Sastry, S.S. (1994). A Mathematical Introduction to Robotic Manipulation, CRC Press."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/0167-8655(86)90018-8","article-title":"Image Space Transforms for Detecting Straight Edges in Industrial Images","volume":"4","author":"Davies","year":"1986","journal-title":"Pattern Recognit. Lett."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random Sample Consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_41","unstructured":"Aguilera, D., Lahoz, J.G., and Codes, J.F. (2017, October 31). A New Method for Vanishing Points Detection in {3D} Reconstruction From a Single View. Available online: http:\/\/www.isprs.org\/proceedings\/XXXVI\/5-W17\/pdf\/6.pdf."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Wildenauer, H., and Vincze, M. (2007, January 10\u201313). Vanishing point detection in complex man-made worlds. Proceedings of the IEEE International Conference on Image Analysis and Processing (ICIAP), Modena, Italy.","DOI":"10.1109\/ICIAP.2007.4362845"},{"key":"ref_43","unstructured":"Guennebaud, G., and Jacob, B. (2017, September 22). Eigen v3. Available online: http:\/\/eigen.tuxfamily.org."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1523","DOI":"10.1109\/TPAMI.2005.199","article-title":"Guided-MLESAC: Faster image transform estimation by using matching priors","volume":"27","author":"Tordoff","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"H\u00e4rdle, W.K., Klinke, S., and R\u00f6nz, B. (2015). Introduction to Statistics, Springer.","DOI":"10.1007\/978-3-319-17704-5"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1016\/0734-189X(84)90188-9","article-title":"Determining vanishing points from perspective images","volume":"26","author":"Magee","year":"1984","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Bazin, J.C., Seo, Y., Demonceaux, C., Vasseur, P., Ikeuchi, K., Kweon, I., and Pollefeys, M. (2012, January 16\u201321). Globally optimal line clustering and vanishing point estimation in manhattan world. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247731"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1006\/cviu.1999.0832","article-title":"MLESAC: A new robust estimator with application to estimating image geometry","volume":"78","author":"Torr","year":"2000","journal-title":"Comput. Vis. Image Understand."},{"key":"ref_50","unstructured":"Chum, O., and Matas, J. (2005, January 20\u201325). Matching with PROSAC-progressive sample consensus. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1007\/s00138-005-0006-y","article-title":"Preemptive RANSAC for live structure and motion estimation","volume":"16","year":"2005","journal-title":"Mach. Vis. Appl."},{"key":"ref_52","unstructured":"Raguram, R., Frahm, J.M., and Pollefeys, M. (October, January 29). Exploiting uncertainty in random sample consensus. Proceedings of the IEEE International Conference on Computer Vision, Kyoto, Japan."}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/6\/4\/32\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:49:01Z","timestamp":1760208541000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/6\/4\/32"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,10,31]]},"references-count":52,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2017,12]]}},"alternative-id":["robotics6040032"],"URL":"https:\/\/doi.org\/10.3390\/robotics6040032","relation":{},"ISSN":["2218-6581"],"issn-type":[{"type":"electronic","value":"2218-6581"}],"subject":[],"published":{"date-parts":[[2017,10,31]]}}}