{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:25:10Z","timestamp":1760239510769,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2020,11,26]],"date-time":"2020-11-26T00:00:00Z","timestamp":1606348800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Key R&amp;D Program Projects in Jiangxi Province","award":["20181ACE50027 and 20193ABC03A006"],"award-info":[{"award-number":["20181ACE50027 and 20193ABC03A006"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Using a standalone camera for pose estimation has been quite a standard task. However, the point correspondence-based algorithms require at least four feature points in the field of view. This paper considers the situation that there are only two feature points. Focusing on the attitude estimation, we propose to fuse a camera with low-cost inertial sensors based on a nonlinear complementary filter design. An implicit geometry measurement model is derived using two feature points in an image. This geometry measurement is fused with the angle rate measurement and vector measurement from inertial sensors using the proposed nonlinear complementary filter with only two parameters to be adjusted. The proposed nonlinear complementary filter is posed directly on the special orthogonal group SO(3). Based on the theory of nonlinear system stability analysis, the proposed filter ensures locally asymptotic stability. A quaternion-based discrete implementation of the filter is also given in this paper for computational efficiency. The proposed algorithm is validated using a smartphone with built-in inertial sensors and a rear camera. The experimental results indicate that the proposed algorithm outperforms all the compared counterparts in estimated accuracy and provides competitive computational complexity.<\/jats:p>","DOI":"10.3390\/s20236752","type":"journal-article","created":{"date-parts":[[2020,11,26]],"date-time":"2020-11-26T09:04:15Z","timestamp":1606381455000},"page":"6752","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Nonlinear Complementary Filter for Attitude Estimation by Fusing Inertial Sensors and a Camera"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7533-8116","authenticated-orcid":false,"given":"Lingxiao","family":"Zheng","sequence":"first","affiliation":[{"name":"School of Aeronautics and Astronautics, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7655-067X","authenticated-orcid":false,"given":"Xingqun","family":"Zhan","sequence":"additional","affiliation":[{"name":"School of Aeronautics and Astronautics, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3397-9924","authenticated-orcid":false,"given":"Xin","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Aeronautics and Astronautics, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"4544","DOI":"10.1109\/JSEN.2015.2423562","article-title":"A High Reliability Wearable Device for Elderly Fall Detection","volume":"15","author":"Pierleoni","year":"2015","journal-title":"IEEE Sens. J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"8731","DOI":"10.1109\/JSEN.2020.2985025","article-title":"Heading Estimation for Multimode Pedestrian Dead Reckoning","volume":"20","author":"Zheng","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1109\/TNSRE.2012.2205706","article-title":"An Adaptive-Gain Complementary Filter for Real-Time Human Motion Tracking with MARG Sensors in Free-Living Environments","volume":"21","author":"Tian","year":"2013","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1214","DOI":"10.1109\/TCST.2015.2480012","article-title":"UAV State Estimation Using Adaptive Complementary Filters","volume":"24","author":"Marantos","year":"2016","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1837","DOI":"10.1109\/TCST.2015.2510324","article-title":"Attitude Estimation Using Redundant Inertial Measurement Units for the Control of a Camera Stabilization Platform","volume":"24","author":"Kugi","year":"2016","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TMAG.2014.2327166","article-title":"A Calibration Method of Three-Axis Magnetometer with Noise Suppression","volume":"50","author":"Zhongguo","year":"2014","journal-title":"IEEE Trans. Magn."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1007\/s10851-005-3617-z","article-title":"PnP Problem Revisited","volume":"24","author":"Wu","year":"2006","journal-title":"J. Math. Imaging Vision"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s11263-008-0152-6","article-title":"EPnP: An Accurate O(n) Solution to the PnP Problem","volume":"81","author":"Lepetit","year":"2009","journal-title":"Int. J. Comput. Vision"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wang, J., and Olson, E. (2016, January 9\u201314). AprilTag 2: Efficient and robust fiducial detection. Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea.","DOI":"10.1109\/IROS.2016.7759617"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1109\/LPT.2018.2883345","article-title":"VLIP: Tightly Coupled Visible-Light\/Inertial Positioning System to Cope With Intermittent Outage","volume":"31","author":"Qin","year":"2019","journal-title":"IEEE Photonics Technol. Lett."},{"key":"ref_11","first-page":"1","article-title":"Enhancement of Signal Performance in LED Visible Light Communications Using Mobile Phone Camera","volume":"7","author":"Chow","year":"2015","journal-title":"IEEE Photonics J."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"19","DOI":"10.2514\/2.4228","article-title":"Strapdown inertial navigation integration algorithm design part 1: Attitude algorithms","volume":"21","author":"Savage","year":"1998","journal-title":"J. Guidance Control Dyn. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1109\/TIM.2007.911646","article-title":"A Simplified Quaternion-Based Algorithm for Orientation Estimation From Earth Gravity and Magnetic Field Measurements","volume":"57","author":"Yun","year":"2008","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"70","DOI":"10.2514\/3.19717","article-title":"Three-axis attitude determination from vector observations","volume":"4","author":"Shuster","year":"1981","journal-title":"J. Guidance Control Dyn. Syst."},{"key":"ref_15","first-page":"245","article-title":"Attitude determination using vector observations and the singular value decomposition","volume":"36","author":"Markley","year":"1988","journal-title":"J. Astronaut. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1346","DOI":"10.1109\/TBME.2006.875664","article-title":"Quaternion-based extended Kalman filter for determining orientation by inertial and magnetic sensing","volume":"53","author":"Sabatini","year":"2006","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_17","unstructured":"Marins, J.L., Xiaoping, Y., Bachmann, E.R., McGhee, R.B., and Zyda, M.J. (November, January 29). An extended Kalman filter for quaternion-based orientation estimation using MARG sensors. Proceedings of the 2001 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Maui, HI, USA."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1203","DOI":"10.1109\/TAC.2008.923738","article-title":"Nonlinear complementary filters on the special orthogonal group","volume":"53","author":"Mahony","year":"2008","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1109\/JSEN.2010.2053353","article-title":"A Nonlinear Filtering Approach for the Attitude and Dynamic Body Acceleration Estimation Based on Inertial and Magnetic Sensors: Bio-Logging Application","volume":"11","author":"Fourati","year":"2011","journal-title":"IEEE Sens. J."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"15138","DOI":"10.3390\/s131115138","article-title":"A robust nonlinear observer for real-time attitude estimation using low-cost MEMS inertial sensors","volume":"13","author":"Durand","year":"2013","journal-title":"Sensors"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Madgwick, S.O.H., Harrison, A.J.L., and Vaidyanathan, R. (July, January 29). Estimation of IMU and MARG orientation using a gradient descent algorithm. Proceedings of the 2011 IEEE International Conference on Rehabilitation Robotics (Icorr), Zurich, Switzerland.","DOI":"10.1109\/ICORR.2011.5975346"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"6997","DOI":"10.1109\/JSEN.2016.2589660","article-title":"Fast Complementary Filter for Attitude Estimation Using Low-Cost MARG Sensors","volume":"16","author":"Wu","year":"2016","journal-title":"IEEE Sens. J."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/j.ymssp.2019.04.064","article-title":"Formulation of a new gradient descent MARG orientation algorithm: Case study on robot teleoperation","volume":"130","author":"Wilson","year":"2019","journal-title":"Mech. Syst. Sig. Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3816","DOI":"10.3390\/s110403816","article-title":"Gain-scheduled complementary filter design for a MEMS based attitude and heading reference system","volume":"11","author":"Yoo","year":"2011","journal-title":"Sensors"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"580","DOI":"10.1109\/34.601246","article-title":"In defense of the eight-point algorithm","volume":"19","author":"Hartley","year":"1997","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"756","DOI":"10.1109\/TPAMI.2004.17","article-title":"An efficient solution to the five-point relative pose problem","volume":"26","author":"Nister","year":"2004","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Mourikis, A.I., and Roumeliotis, S.I. (2007, January 10\u201314). A multi-state constraint Kalman filter for vision-aided inertial navigation. Proceedings of the 2007 IEEE International Conference on Robotics and Automation, Roma, Italy.","DOI":"10.1109\/ROBOT.2007.364024"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1109\/TRO.2018.2853729","article-title":"VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator","volume":"34","author":"Qin","year":"2018","journal-title":"IEEE Trans. Rob."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/TASE.2018.2888908","article-title":"Generalized Linear Quaternion Complementary Filter for Attitude Estimation From Multisensor Observations: An Optimization Approach","volume":"16","author":"Wu","year":"2019","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1109\/TAC.2002.808464","article-title":"Pose estimation using line-based dynamic vision and inertial sensors","volume":"48","author":"Rehbinder","year":"2003","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1007\/s42401-019-00028-8","article-title":"Error characteristics analysis and calibration testing for MEMS IMU gyroscope","volume":"2","author":"Zhang","year":"2019","journal-title":"Aerosp. Syst."},{"key":"ref_32","unstructured":"Barfoot, T.D. (2016). State Estimation for Robotics: A Matrix Lie Group Approach, Cambridge University Press."},{"key":"ref_33","unstructured":"Khalil, H.K. (2002). Nonlinear Systems, Prentice Hall."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/23\/6752\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:37:34Z","timestamp":1760179054000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/23\/6752"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,26]]},"references-count":34,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["s20236752"],"URL":"https:\/\/doi.org\/10.3390\/s20236752","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,11,26]]}}}