{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T23:32:56Z","timestamp":1780356776613,"version":"3.54.1"},"reference-count":35,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2019,8,3]],"date-time":"2019-08-03T00:00:00Z","timestamp":1564790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Major Program of Science and Technology Planning Project of Guangdong Province","award":["2017B010116003"],"award-info":[{"award-number":["2017B010116003"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Autonomous vision-based aerial grasping is an essential and challenging task for aerial manipulation missions. In this paper, we propose a vision-based aerial grasping system for a Rotorcraft Unmanned Aerial Vehicle (UAV) to grasp a target object. The UAV system is equipped with a monocular camera, a 3-DOF robotic arm with a gripper and a Jetson TK1 computer. Efficient and reliable visual detectors and control laws are crucial for autonomous aerial grasping using limited onboard sensing and computational capabilities. To detect and track the target object in real time, an efficient proposal algorithm is presented to reliably estimate the region of interest (ROI), then a correlation filter-based classifier is developed to track the detected object. Moreover, a support vector regression (SVR)-based grasping position detector is proposed to improve the grasp success rate with high computational efficiency. Using the estimated grasping position and the UAV?\u00c4\u00f4s states, novel control laws of the UAV and the robotic arm are proposed to perform aerial grasping. Extensive simulations and outdoor flight experiments have been implemented. The experimental results illustrate that the proposed vision-based aerial grasping system can autonomously and reliably grasp the target object while working entirely onboard.<\/jats:p>","DOI":"10.3390\/s19153410","type":"journal-article","created":{"date-parts":[[2019,8,5]],"date-time":"2019-08-05T03:25:22Z","timestamp":1564975522000},"page":"3410","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["Autonomous Vision-Based Aerial Grasping for Rotorcraft Unmanned Aerial Vehicles"],"prefix":"10.3390","volume":"19","author":[{"given":"Lishan","family":"Lin","sequence":"first","affiliation":[{"name":"School of Data and Computer Science, Sun Yat-sen University, Guangzhou 510006, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2510-6365","authenticated-orcid":false,"given":"Yuji","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Data and Computer Science, Sun Yat-sen University, Guangzhou 510006, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2579-7004","authenticated-orcid":false,"given":"Hui","family":"Cheng","sequence":"additional","affiliation":[{"name":"School of Data and Computer Science, Sun Yat-sen University, Guangzhou 510006, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7683-2933","authenticated-orcid":false,"given":"Xuechen","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Data and Computer Science, Sun Yat-sen University, Guangzhou 510006, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1177\/0278364909348805","article-title":"On the design and use of a micro air vehicle to track and avoid adversaries","volume":"29","author":"He","year":"2010","journal-title":"Int. J. Robot. Res."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"G\u00f3mez-de Gabriel, J.M., Gandarias, J.M., P\u00e9rez-Maldonado, F.J., Garc\u00eda-N\u00fa\u00f1cz, F.J., Fern\u00e1ndez-Garc\u00eda, E.J., and Garc\u00eda-Cerezo, A.J. (2018, January 1\u20135). Methods for Autonomous Wristband Placement with a Search-and-Rescue Aerial Manipulator. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8594202"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.robot.2018.06.012","article-title":"Aerial manipulation\u2014A literature survey","volume":"107","author":"Khamseh","year":"2018","journal-title":"Robot. Auton. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1957","DOI":"10.1109\/LRA.2018.2808541","article-title":"Aerial manipulation: A literature review","volume":"3","author":"Ruggiero","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1007\/s10846-012-9723-4","article-title":"Modeling and control of MM-UAV: Mobile manipulating unmanned aerial vehicle","volume":"69","author":"Orsag","year":"2013","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Thomas, J., Polin, J., Sreenath, K., and Kumar, V. (2013, January 4\u20137). Avian-inspired grasping for quadrotor micro UAVs. Proceedings of the ASME 2013 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Portland, OR, USA.","DOI":"10.1115\/DETC2013-13289"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Bellicoso, C.D., Buonocore, L.R., Lippiello, V., and Siciliano, B. (2015, January 16\u201319). Design, modeling and control of a 5-DoF light-weight robot arm for aerial manipulation. Proceedings of the 2015 23rd Mediterranean Conference on Control and Automation (MED), Torremolinos, Spain.","DOI":"10.1109\/MED.2015.7158852"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1109\/TPAMI.2014.2345390","article-title":"High-speed tracking with kernelized correlation filters","volume":"37","author":"Henriques","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Achanta, R., Hemami, S., Estrada, F., and Susstrunk, S. (2009, January 20\u201325). Frequency-tuned salient region detection. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 2009), Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206596"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1007\/s10514-010-9205-0","article-title":"Cooperative manipulation and transportation with aerial robots","volume":"30","author":"Michael","year":"2011","journal-title":"Auton. Robot."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Mellinger, D., Lindsey, Q., Shomin, M., and Kumar, V. (2011, January 25\u201330). Design, modeling, estimation and control for aerial grasping and manipulation. Proceedings of the 2011 IEEE\/RSJ International Conference on Intelligent Robots and Systems, San Francisco, CA, USA.","DOI":"10.1109\/IROS.2011.6094871"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Pounds, P.E., Bersak, D.R., and Dollar, A.M. (2011, January 9\u201313). Grasping from the air: Hovering capture and load stability. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980314"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lindsey, Q., Mellinger, D., and Kumar, V. (2011, January 27\u201330). Construction of cubic structures with quadrotor teams. Proceedings of the Robotics: Science and Systems VII, University of Southern California, Los Angeles, CA, USA.","DOI":"10.15607\/RSS.2011.VII.025"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1177\/0278364910382803","article-title":"Planning and control for cooperative manipulation and transportation with aerial robots","volume":"30","author":"Fink","year":"2011","journal-title":"Int. J. Robot. Res."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Thomas, J., Loianno, G., Sreenath, K., and Kumar, V. (June, January 31). Toward image based visual servoing for aerial grasping and perching. Proceedings of the Robotics and Automation (ICRA), 2014 IEEE International Conference, Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907149"},{"key":"ref_16","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7\u201312). Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_18","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_19","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201326). Histograms of oriented gradients for human detection. Proceedings of the Computer Vision and Pattern Recognition, CVPR 2005, San Diego, CA, USA."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ramon Soria, P., Arrue, B., and Ollero, A. (2017). Detection, location and grasping objects using a stereo sensor on uav in outdoor environments. Sensors, 17.","DOI":"10.3390\/s17010103"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Heredia, G., Jimenez-Cano, A., Sanchez, I., Llorente, D., Vega, V., Braga, J., Acosta, J., and Ollero, A. (2014, January 9\u201314). Control of a multirotor outdoor aerial manipulator. Proceedings of the 2014 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Daejeon, Korea.","DOI":"10.1109\/IROS.2014.6943038"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lai, Z., Yang, R., Cheng, H., Deng, W., Wu, K., and Xiao, J. (2018, January 1\u20135). Dance of the Dragonfly: A Vision-Based Agile Aerial Touch Solution for IARC Mission 7. Proceedings of the 2018 IEEE International Conference on Real-time Computing and Robotics (RCAR), Kandima, Maldives.","DOI":"10.1109\/RCAR.2018.8621785"},{"key":"ref_23","unstructured":"Hui, C., Yousheng, C., Xiaokun, L., and Shing, W.W. (2013, January 26\u201328). Autonomous takeoff, tracking and landing of a UAV on a moving UGV using onboard monocular vision. Proceedings of the 32nd Chinese Control Conference, Xi\u2019an, China."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Qi, J., Kang, J., and Lu, X. (2017, January 27\u201329). Design and research of UAV autonomous grasping system. Proceedings of the Unmanned Systems (ICUS), 2017 IEEE International Conference, Beijing, China.","DOI":"10.1109\/ICUS.2017.8278328"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, G., He, Y., Dai, B., Gu, F., Yang, L., Han, J., Liu, G., and Qi, J. (2018, January 21\u201325). Grasp a Moving Target from the Air: System & Control of an Aerial Manipulator. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8461103"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Fang, L., Chen, H., Lou, Y., Li, Y., and Liu, Y. (2018, January 21\u201325). Visual Grasping for a Lightweight Aerial Manipulator Based on NSGA-II and Kinematic Compensation. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8460520"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Staub, N., Bicego, D., Sable, Q., Arellano, V., and Franchi, A. (2018, January 21\u201325). Towards a Flying Assistant Paradigm: The OTHex. Proceedings of the IEEE 2018 International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8460877"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wang, Q., Zhang, L., Bertinetto, L., Hu, W., and Torr, P.H. (2019, January 15\u201320). Fast online object tracking and segmentation: A unifying approach. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00142"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Cheng, H., Lin, L., Zheng, Z., Guan, Y., and Liu, Z. (2017, January 24\u201328). An autonomous vision-based target tracking system for rotorcraft unmanned aerial vehicles. Proceedings of the Intelligent Robots and Systems (IROS), 2017 IEEE\/RSJ International Conference, Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8205986"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2933","DOI":"10.1109\/TSMC.2016.2531700","article-title":"Ensemble learning with weak classifiers for fast and reliable unknown terrain classification using mobile robots","volume":"47","author":"Dutta","year":"2016","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_31","first-page":"131","article-title":"Regularized least-squares classification","volume":"190","author":"Rifkin","year":"2003","journal-title":"Nato Sci. Ser. Sub Ser. III Comput. Syst. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Sch\u00f6lkopf, B., Smola, A.J., and Bach, F. (2002). Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond, MIT Press.","DOI":"10.7551\/mitpress\/4175.001.0001"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1177\/0278364914549607","article-title":"Deep learning for detecting robotic grasps","volume":"34","author":"Lenz","year":"2015","journal-title":"Int. J. Robot. Res."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1109\/TPAMI.2007.1144","article-title":"Groups of adjacent contour segments for object detection","volume":"30","author":"Ferrari","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Pinto, L., and Gupta, A. (2016, January 16\u201321). Supersizing self-supervision: Learning to grasp from 50k tries and 700 robot hours. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweeden.","DOI":"10.1109\/ICRA.2016.7487517"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/15\/3410\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:13:07Z","timestamp":1760188387000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/15\/3410"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,3]]},"references-count":35,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["s19153410"],"URL":"https:\/\/doi.org\/10.3390\/s19153410","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,8,3]]}}}