{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T21:06:02Z","timestamp":1740171962085,"version":"3.37.3"},"reference-count":27,"publisher":"American Institute of Aeronautics and Astronautics (AIAA)","issue":"8","license":[{"start":{"date-parts":[[2024,6,7]],"date-time":"2024-06-07T00:00:00Z","timestamp":1717718400000},"content-version":"am","delay-in-days":311,"URL":"https:\/\/www.aiaa.org\/userlicenses\/1.0\/#CompEndUserLicense"}],"funder":[{"DOI":"10.13039\/100000104","name":"National Aeronautics and Space Administration","doi-asserted-by":"publisher","award":["Transformational Tools and Technologies (TTT) Auto","UAS Traffic Management (UTM)","Autonomy Teaming and TRAjectories for Complex Trus"],"award-info":[{"award-number":["Transformational Tools and Technologies (TTT) Auto","UAS Traffic Management (UTM)","Autonomy Teaming and TRAjectories for Complex Trus"]}],"id":[{"id":"10.13039\/100000104","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["arc.aiaa.org"],"crossmark-restriction":true},"short-container-title":["Journal of Aerospace Information Systems"],"published-print":{"date-parts":[[2023,8]]},"abstract":"<jats:p> This work proposes a vision-based perception algorithm that combines image-processing-based detection and tracking of aerial objects with convolutional neural networks (CNNs) integrated for classification of general aviation aircraft, multirotor small uncrewed aerial systems (SUAS), fixed-wing SUAS, and birds to enable improved onboard avoidance algorithm decision making. Furthermore, we integrate adversarial learning during the training of the CNNs and evaluate performance with class balanced and imbalanced datasets because this maximizes the utility of resource-expensive flight experiments to collect aviation datasets. We compare our proposed CNN with adversarial learning (CNN+ADVL) model with a state-of-the-art CNN as well as a you only look once (YOLO, v4) model retrained (YOLO v4 aircraft) on the same data. The CNN+ADVL trained on the imbalanced dataset achieves the highest 10-fold cross-validation classification accuracy of 76.2% for aircraft and birds for all ranges while achieving 87.0% aircraft classification accuracy, meeting proposed self-assurance separation distances derived from Federal Aviation Administration (FAA) guidelines. In comparison, the CNNs achieved 74.4% 10-fold cross-validation classification accuracy for aircraft and birds as well as 83.4% accuracy for the aircraft, meeting proposed self-assurance separation distances derived from FAA guidelines. Furthermore, we demonstrate that the integration of adversarial learning improves the classification performance for the perception of aerial objects using a class imbalanced dataset. <\/jats:p>","DOI":"10.2514\/1.i011185","type":"journal-article","created":{"date-parts":[[2023,6,7]],"date-time":"2023-06-07T14:50:15Z","timestamp":1686149415000},"page":"489-507","update-policy":"https:\/\/doi.org\/10.2514\/aiaa_crossmarkpolicy","source":"Crossref","is-referenced-by-count":3,"title":["Adversarial Learning Improves Vision-Based Perception from Drones with Imbalanced Datasets"],"prefix":"10.2514","volume":"20","author":[{"given":"Chester V.","family":"Dolph","sequence":"first","affiliation":[]},{"given":"Corey","family":"Ippolito","sequence":"additional","affiliation":[]},{"given":"Louis J.","family":"Glaab","sequence":"additional","affiliation":[]},{"given":"Michael J.","family":"Logan","sequence":"additional","affiliation":[]},{"given":"Loc D.","family":"Tran","sequence":"additional","affiliation":[]},{"given":"B.","family":"Danette Allen","sequence":"additional","affiliation":[]},{"given":"Mahbubul","family":"Alam","sequence":"additional","affiliation":[{"name":"Hitachi America, Ltd., Santa Clara, California 95054"}]},{"given":"Jiang","family":"Li","sequence":"additional","affiliation":[]},{"given":"Khan","family":"Iftekharuddin","sequence":"additional","affiliation":[]}],"member":"1387","reference":[{"key":"r1","doi-asserted-by":"publisher","DOI":"10.9745\/GHSP-D-19-00119"},{"key":"r2","doi-asserted-by":"publisher","DOI":"10.1080\/19475705.2016.1238852"},{"key":"r3","doi-asserted-by":"publisher","DOI":"10.1007\/s00502-010-0717-2"},{"key":"r4","doi-asserted-by":"publisher","DOI":"10.1108\/IJCHM-08-2020-0839"},{"volume-title":"AIAA Aviation","year":"2016","author":"Locascio D.","key":"r5"},{"key":"r7","doi-asserted-by":"publisher","DOI":"10.1613\/jair.1.12162"},{"issue":"4","key":"r8","first-page":"4663","volume":"36","author":"Shuai Z.","year":"2021","journal-title":"IEEE Transactions on Power Electronics"},{"key":"r9","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-010-0362-z"},{"key":"r10","doi-asserted-by":"publisher","DOI":"10.1007\/s42064-018-0053-6"},{"key":"r11","doi-asserted-by":"publisher","DOI":"10.2514\/1.I010911"},{"key":"r12","doi-asserted-by":"publisher","DOI":"10.2514\/6.2021-1114"},{"issue":"6532","key":"r13","first-page":"1","volume":"60","author":"Mohammed A.","year":"2020","journal-title":"Sensors"},{"key":"r14","doi-asserted-by":"publisher","DOI":"10.2514\/6.2021-2331"},{"key":"r17","doi-asserted-by":"publisher","DOI":"10.2514\/6.2021-2332"},{"issue":"3923","key":"r18","first-page":"1","volume":"20","author":"Jamil S.","year":"2020","journal-title":"Sensors"},{"key":"r19","doi-asserted-by":"publisher","DOI":"10.1177\/1756829321992137"},{"key":"r20","doi-asserted-by":"publisher","DOI":"10.1016\/j.ast.2015.08.010"},{"key":"r21","doi-asserted-by":"publisher","DOI":"10.2514\/6.2022-0498"},{"issue":"3035","key":"r22","first-page":"1","volume":"12","author":"Lai Y.","year":"2020","journal-title":"Remote Sensing"},{"key":"r23","unstructured":"AskelsonM.CatheyH. \u201cSmall UAS Detect and Avoid Requirements Necessary for Limited Beyond Visual Line of Sight (BVLOS) Operations,\u201d U.S. Dept. of Transportation, Federal Aviation Administration, Alliance for System Safety of UAS through Research Excellence (ASSURE), Washington, D.C., 2017."},{"key":"r33","unstructured":"KopardekarP.RiosJ.PrevotT.JohnsonM.JungJ.RobinsonJ. \u201cUnmanned Aircraft System Traffic Management (UTM) Concept of Operations,\u201d AIAA Paper 2016-3292, 2016.10.2514\/6.2016-3292"},{"key":"r36","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2019.02.023"},{"key":"r37","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0224365"},{"key":"r38","doi-asserted-by":"publisher","DOI":"10.5121\/ijdkp.2015.5201"},{"key":"r39","doi-asserted-by":"publisher","DOI":"10.2514\/6.2015-0481"},{"key":"r41","doi-asserted-by":"publisher","DOI":"10.2514\/1.D0091"},{"key":"r47","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"}],"container-title":["Journal of Aerospace Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/arc.aiaa.org\/doi\/am-pdf\/10.2514\/1.I011185","content-type":"application\/pdf","content-version":"am","intended-application":"unspecified"},{"URL":"https:\/\/arc.aiaa.org\/doi\/pdf\/10.2514\/1.I011185","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/arc.aiaa.org\/doi\/pdf\/10.2514\/1.I011185","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,14]],"date-time":"2023-09-14T00:34:46Z","timestamp":1694651686000},"score":1,"resource":{"primary":{"URL":"https:\/\/arc.aiaa.org\/doi\/10.2514\/1.I011185"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8]]},"references-count":27,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2023,8]]}},"alternative-id":["10.2514\/1.I011185"],"URL":"https:\/\/doi.org\/10.2514\/1.i011185","relation":{},"ISSN":["1940-3151","2327-3097"],"issn-type":[{"type":"print","value":"1940-3151"},{"type":"electronic","value":"2327-3097"}],"subject":[],"published":{"date-parts":[[2023,8]]},"assertion":[{"value":"2022-08-14","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-03-17","order":1,"name":"revised","label":"Revised","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-03-27","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-06-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}