{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,25]],"date-time":"2025-11-25T14:04:35Z","timestamp":1764079475911,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2019,5,25]],"date-time":"2019-05-25T00:00:00Z","timestamp":1558742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Funds for Creative Research Groups of Natural Science Foundation of Hubei Province","award":["2018CFA006"],"award-info":[{"award-number":["2018CFA006"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Autonomous Unmanned Aerial Manipulators (UAMs) have shown promising potential in mobile 3-dimensional grasping applications, but they still suffer from some difficulties impeding their board applications, such as target detection and indoor positioning. For the autonomous grasping mission, the UAMs need ability to recognize the objects and grasp them. Considering the efficiency and precision, we present a novel oriented-object detection method called Rotation-SqueezeDet. This method can run on embedded-platforms in near real-time. Besides, this method can give the oriented bounding box of an object in images to enable a rotation-aware grasping. Based on this method, a UAM platform was designed and built. We have given the formulation, positioning, control, and planning of the whole UAM system. All the mechanical designs are fully provided as open-source hardware for reuse by the community. Finally, the effectiveness of the proposed scheme was validated in multiple experimental trials, highlighting its applicability of autonomous aerial rotational grasping in Global Positioning System (GPS) denied environments. We believe this system can be deployed to many potential workplaces which need UAM to accomplish difficult manipulation tasks.<\/jats:p>","DOI":"10.3390\/s19102396","type":"journal-article","created":{"date-parts":[[2019,5,26]],"date-time":"2019-05-26T23:07:27Z","timestamp":1558912047000},"page":"2396","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Development of an Autonomous Unmanned Aerial Manipulator Based on a Real-Time Oriented-Object Detection Method"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0916-5699","authenticated-orcid":false,"given":"Shijie","family":"Lin","sequence":"first","affiliation":[{"name":"School of Electronic Information, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6220-4848","authenticated-orcid":false,"given":"Jinwang","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Electronic Information, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rui","family":"Peng","sequence":"additional","affiliation":[{"name":"School of Electronic Information, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3263-8768","authenticated-orcid":false,"given":"Wen","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Electronic Information, Wuhan University, Wuhan 430072, China"},{"name":"State Key Laboratory for Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,5,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lendzioch, T., Langhammer, J., and Jenicek, M. (2019). Estimating Snow Depth and Leaf Area Index Based on UAV Digital Photogrammetry. Sensors, 19.","DOI":"10.3390\/s19051027"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"31362","DOI":"10.3390\/s151229861","article-title":"Towards an Autonomous Vision-Based Unmanned Aerial System against Wildlife Poachers","volume":"15","author":"Fu","year":"2015","journal-title":"Sensors"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1957","DOI":"10.1109\/LRA.2018.2808541","article-title":"Aerial Manipulation: A Literature Review","volume":"3","author":"Ruggiero","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_4","unstructured":"Kim, S., Choi, S., and Kim, H.J. (2013, January 3\u20137). Aerial manipulation using a quadrotor with a two DOF robotic arm. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Tokyo, Japan."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Korpela, C., Orsag, M., Danko, T., and Oh, P. (2014, January 14\u201315). Insertion tasks using an aerial manipulator. Proceedings of the 2014 IEEE International Conference on Technologies for Practical Robot Applications (TePRA), Woburn, MA, USA.","DOI":"10.1109\/TePRA.2014.6869148"},{"key":"ref_6","first-page":"1","article-title":"Navigation control and stability investigation of a mobile robot based on a hexacopter equipped with an integrated manipulator","volume":"14","author":"Ibrahim","year":"2017","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Arleo, G., Caccavale, F., Muscio, G., and Pierri, F. (2013, January 25\u201328). Control of quadrotor aerial vehicles equipped with a robotic arm. Proceedings of the 21st Mediterranean Conference on Control and Automation (MED), Chania, Greece.","DOI":"10.1109\/MED.2013.6608869"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Jimenez-Cano, A., Martin, J., Heredia, G., Ollero, A., and Cano, R. (2013, January 6\u201310). Control of an aerial robot with multi-link arm for assembly tasks. Proceedings of the 2013 IEEE International Conference on Robotics and Automation (ICRA), Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6631279"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ruggiero, F., Trujillo, M.A., Cano, R., Ascorbe, H., Viguria, A., Per\u00e9z, C., Lippiello, V., Ollero, A., and Siciliano, B. (2015, January 26\u201330). A multilayer control for multirotor UAVs equipped with a servo robot arm. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7139760"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ohnishi, Y., Takaki, T., Aoyama, T., and Ishii, I. (2017, January 24\u201328). Development of a 4-joint 3-DOF robotic arm with anti-reaction force mechanism for a multicopter. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8202265"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1016\/j.compeleceng.2019.01.026","article-title":"Automatic system supporting multicopter swarms with manual guidance","volume":"74","author":"Fabra","year":"2019","journal-title":"Comput. Electr. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Barka, E., Kerrache, C., Hussain, R., Lagraa, N., Lakas, A., and Bouk, S. (2018). A Trusted Lightweight Communication Strategy for Flying Named Data Networking. Sensors, 18.","DOI":"10.3390\/s18082683"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1912","DOI":"10.1109\/TMECH.2016.2523602","article-title":"Vision-Guided Aerial Manipulation Using a Multirotor With a Robotic Arm","volume":"21","author":"Kim","year":"2016","journal-title":"IEEE\/ASME Trans. Mech."},{"key":"ref_14","unstructured":"Ramon Soria, P., Arrue, B.C., and Ollero, A. (2017). Detection, location and grasping objects using a stereo sensor on UAV in outdoor environments. Sensors, 17."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Kanellakis, C., Terreran, M., Kominiak, D., and Nikolakopoulos, G. (2017, January 12\u201315). On vision enabled aerial manipulation for multirotors. Proceedings of the 22nd IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Limassol, Cyprus.","DOI":"10.1109\/ETFA.2017.8247653"},{"key":"ref_16","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7\u201312). Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems 28: 29th Annual Conference on Neural Information Processing Systems 2015, Montreal, QC, Canada."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (July, January 26). You only look once: Unified, real-time object detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wu, B., Wan, A., Iandola, F., Jin, P.H., and Keutzer, K. (2017, January 21\u201326). SqueezeDet: Unified, Small, Low Power Fully Convolutional Neural Networks for Real-Time Object Detection for Autonomous Driving. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.60"},{"key":"ref_19","unstructured":"Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., and Keutzer, K. (arXiv, 2016). SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size, arXiv."},{"key":"ref_20","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). ImageNet classification with deep convolutional neural networks. Proceedings of the 25th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3111","DOI":"10.1109\/TMM.2018.2818020","article-title":"Arbitrary-Oriented Scene Text Detection via Rotation Proposals","volume":"20","author":"Ma","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Yang, X., Sun, H., Fu, K., Yang, J., Sun, X., Yan, M., and Guo, Z. (2018). Automatic ship detection in remote sensing images from google earth of complex scenes based on multiscale rotation dense feature pyramid networks. Remote Sens., 10.","DOI":"10.3390\/rs10010132"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1109\/TRO.2018.2853729","article-title":"Vins-mono: A robust and versatile monocular visual-inertial state estimator","volume":"34","author":"Qin","year":"2018","journal-title":"IEEE Trans. Robot."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Siciliano, B., Sciavicco, L., Villani, L., and Oriolo, G. (2010). Robotics: Modelling, Planning And Control, Springer.","DOI":"10.1007\/978-1-84628-642-1"},{"key":"ref_25","unstructured":"Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., and Ng, A.Y. (2009, January 17). ROS: An open-source Robot Operating System. Proceedings of the ICRA Workshop on Open Source Software, Kobe, Japan."},{"key":"ref_26","first-page":"20","article-title":"A Benchmark Comparison of Monocular Visual-Inertial Odometry Algorithms for Flying Robots","volume":"10","author":"Delmerico","year":"2018","journal-title":"Memory"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Rehder, J., Nikolic, J., Schneider, T., Hinzmann, T., and Siegwart, R. (2016, January 16\u201321). Extending kalibr: Calibrating the extrinsics of multiple IMUs and of individual axes. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487628"},{"key":"ref_28","unstructured":"Diaz, P.V., and Yoony, S. (2018, January 8\u201312). High-Fidelity Computational Aerodynamics of Multi-Rotor Unmanned Aerial Vehicles. Proceedings of the 2018 56th AIAA Aerospace Sciences Meeting, Kissimmee, FL, USA."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Tripathi, S., Dane, G., Kang, B., Bhaskaran, V., and Nguyen, T. (2017, January 21\u201326). LCDet: Low-Complexity Fully-Convolutional Neural Networks for Object Detection in Embedded Systems. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.56"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1109\/TITS.2017.2784093","article-title":"A New CNN-Based Method for Multi-Directional Car License Plate Detection","volume":"19","author":"Xie","year":"2018","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. (2017, January 21\u201326). YOLO9000: Better, Faster, Stronger. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Wang, J., Guo, W., Pan, T., Yu, H., Duan, L., and Yang, W. (2018, January 10\u201313). Bottle Detection in the Wild Using Low-Altitude Unmanned Aerial Vehicles. Proceedings of the 2018 21st International Conference on Information Fusion (FUSION), Cambridge, UK.","DOI":"10.23919\/ICIF.2018.8455565"},{"key":"ref_33","unstructured":"Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 2\u20134). Tensorflow: A system for large-scale machine learning. Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI), Savannah, GA, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/10\/2396\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:55:05Z","timestamp":1760187305000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/10\/2396"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,5,25]]},"references-count":33,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2019,5]]}},"alternative-id":["s19102396"],"URL":"https:\/\/doi.org\/10.3390\/s19102396","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,5,25]]}}}