{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,6]],"date-time":"2026-11-06T22:39:53Z","timestamp":1794004793191,"version":"4.8.0"},"reference-count":31,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,1,24]],"date-time":"2025-01-24T00:00:00Z","timestamp":1737676800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>In recent years, Unmanned Aerial Vehicles (UAVs) have increasingly been deployed in various applications such as autonomous navigation, surveillance, and object detection. Traditional methods for UAV navigation and object detection have often relied on either handcrafted features or unimodal deep learning approaches. While these methods have seen some success, they frequently encounter limitations in dynamic environments, where robustness and computational efficiency become critical for real-time performance. Additionally, these methods often fail to effectively integrate multimodal inputs, which restricts their adaptability and generalization capabilities when facing complex and diverse scenarios.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>To address these challenges, we introduce NavBLIP, a novel visual-language model specifically designed to enhance UAV navigation and object detection by utilizing multimodal data. NavBLIP incorporates transfer learning techniques along with a Nuisance-Invariant Multimodal Feature Extraction (NIMFE) module. The NIMFE module plays a key role in disentangling relevant features from intricate visual and environmental inputs, allowing UAVs to swiftly adapt to new environments and improve object detection accuracy. Furthermore, NavBLIP employs a multimodal control strategy that dynamically selects context-specific features to optimize real-time performance, ensuring efficiency in high-stakes operations.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results and discussion<\/jats:title>\n                    <jats:p>Extensive experiments on benchmark datasets such as RefCOCO, CC12M, and Openlmages reveal that NavBLIP outperforms existing state-of-the-art models in terms of accuracy, recall, and computational efficiency. Additionally, our ablation study emphasizes the significance of the NIMFE and transfer learning components in boosting the model's performance, underscoring NavBLIP's potential for real-time UAV applications where adaptability and computational efficiency are paramount.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fnbot.2024.1513354","type":"journal-article","created":{"date-parts":[[2025,1,24]],"date-time":"2025-01-24T02:15:29Z","timestamp":1737684929000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["NavBLIP: a visual-language model for enhancing unmanned aerial vehicles navigation and object detection"],"prefix":"10.3389","volume":"18","author":[{"given":"Ye","family":"Li","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Li","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Meifang","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fei","family":"Yan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tonghua","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chensi","family":"Guo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rufeng","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,1,24]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"110804","DOI":"10.1115\/1.4047855","article-title":"Artificial intelligence in advanced manufacturing: current status and future outlook","volume":"142","author":"Arinez","year":"2020","journal-title":"J. Manuf. Sci. Eng"},{"key":"B2","doi-asserted-by":"publisher","first-page":"108713","DOI":"10.1016\/j.compag.2024.108713","article-title":"Monitoring mammalian herbivores via convolutional neural networks implemented on thermal UAV imagery","volume":"218","author":"Barrios","year":"2024","journal-title":"Comput. Electron. Agric"},{"key":"B3","doi-asserted-by":"publisher","first-page":"3107","DOI":"10.1109\/TGRS.2018.2790926","article-title":"Convolutional SVM networks for object detection in UAV imagery","volume":"56","author":"Bazi","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens"},{"key":"B4","doi-asserted-by":"publisher","first-page":"3558","DOI":"10.1109\/CVPR46437.2021.00356","author":"Changpinyo","year":"2021"},{"key":"B5","doi-asserted-by":"publisher","first-page":"82118","DOI":"10.1109\/ACCESS.2021.3083518","article-title":"Multi-modal chatbot in intelligent manufacturing","volume":"9","author":"Chen","year":"2021","journal-title":"IEEE Access"},{"key":"B6","doi-asserted-by":"publisher","first-page":"1477232","DOI":"10.3389\/fnbot.2024.1477232","article-title":"Design and analysis of exoskeleton devices for rehabilitation of distal radius fracture","volume":"18","author":"Chen","year":"2024","journal-title":"Front. Neurorobot"},{"key":"B7","doi-asserted-by":"publisher","first-page":"10086","DOI":"10.1109\/CVPR42600.2020.01010","author":"Chen","year":"2020"},{"key":"B8","doi-asserted-by":"publisher","first-page":"1784","DOI":"10.1109\/TASE.2022.3159595","article-title":"Human-robot collaboration with commonsense reasoning in smart manufacturing contexts","volume":"19","author":"Conti","year":"2022","journal-title":"IEEE Trans. Autom. Sci. Eng"},{"key":"B9","doi-asserted-by":"publisher","first-page":"548","DOI":"10.3390\/agriculture14040548","article-title":"Crop classification combining object-oriented method and random forest model using unmanned aerial vehicle (UAV) multispectral image","volume":"14","author":"Deng","year":"2024","journal-title":"Agriculture"},{"key":"B10","doi-asserted-by":"publisher","first-page":"562","DOI":"10.1177\/09544054231167209","article-title":"HRC for dual-robot intelligent assembly system based on multimodal perception","volume":"238","author":"Duan","year":"2024","journal-title":"Proc. Inst. Mech. Eng., Part B J. Eng. Manuf"},{"key":"B11","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1007\/s43154-020-00006-5","article-title":"Trends in smart manufacturing: Role of humans and industrial robots in smart factories","volume":"1","author":"Evjemo","year":"2020","journal-title":"Curr. Robot. Rep"},{"key":"B12","doi-asserted-by":"crossref","unstructured":"Real-time UAV path planning based on LSTM network\n          \n          374\n          385\n          \n            \n              Jiandong\n              Z.\n            \n            \n              Yukun\n              G.\n            \n            \n              Lihui\n              Z.\n            \n            \n              Qiming\n              Y.\n            \n            \n              Guoqing\n              S.\n            \n            \n              Yong\n              W.\n            \n          \n          J. Syst. Eng. Electron\n          35\n          2024","DOI":"10.23919\/JSEE.2023.000157"},{"key":"B13","doi-asserted-by":"publisher","first-page":"1956","DOI":"10.1007\/s11263-020-01316-z","article-title":"The open images dataset v4: unified image classification, object detection, and visual relationship detection at scale","volume":"128","author":"Kuznetsova","year":"2020","journal-title":"Int. J. Comput. Vis"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1753","DOI":"10.32604\/iasc.2023.039600","article-title":"Attentive neighborhood feature augmentation for semi-supervised learning","volume":"37","author":"Liu","year":"2023","journal-title":"Intell. Autom. Soft Comput"},{"key":"B15","doi-asserted-by":"publisher","first-page":"1448482","DOI":"10.3389\/fnbot.2024.1448482","article-title":"Fast reconstruction of milling temperature field based on CNN-GRU machine learning models","volume":"18","author":"Ma","year":"2024","journal-title":"Front. Neurorobot"},{"key":"B16","doi-asserted-by":"publisher","first-page":"40532","DOI":"10.1109\/JIOT.2024.3451248","article-title":"Mission planning of UAVs and CAVs based on graph neural networks transformer model","volume":"11","author":"Ma","year":"2024","journal-title":"IEEE Internet Things J"},{"key":"B17","doi-asserted-by":"publisher","first-page":"031009","DOI":"10.1115\/1.4048950","article-title":"Human-robot collaboration in smart manufacturing: robot reactive behavior intelligence","volume":"143","author":"Nicora","year":"2021","journal-title":"J. Manuf. Sci. Eng"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1243","DOI":"10.32604\/iasc.2023.038241","article-title":"Instance reweighting adversarial training based on confused label","volume":"37","author":"Qiu","year":"2023","journal-title":"Intell. Autom. Soft Comput"},{"key":"B19","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1007\/978-3-031-19839-7_4","author":"Sampieri","year":"2022"},{"key":"B20","doi-asserted-by":"publisher","first-page":"103868","DOI":"10.1016\/j.engappai.2020.103868","article-title":"Multi-modal recognition of worker activity for human-centered intelligent manufacturing","volume":"95","author":"Tao","year":"2020","journal-title":"Eng. Appl. Artif. Intell"},{"key":"B21","doi-asserted-by":"publisher","first-page":"3421","DOI":"10.32604\/cmc.2024.055327","article-title":"Confusing object detection: a survey","volume":"80","author":"Tong","year":"2024","journal-title":"Comput. Mater. Contin"},{"key":"B22","doi-asserted-by":"publisher","first-page":"3147","DOI":"10.1109\/ICCV51070.2023.00292","author":"Wang","year":"2023"},{"key":"B23","doi-asserted-by":"publisher","first-page":"2300359","DOI":"10.2991\/978-94-6463-512-6","article-title":"Multimodal human-robot interaction for human-centric smart manufacturing: a survey","volume":"6","author":"Wang","year":"2024","journal-title":"Adv. Intell. Syst"},{"key":"B24","doi-asserted-by":"publisher","first-page":"121136","DOI":"10.1016\/j.eswa.2023.121136","article-title":"Data-driven and knowledge-based predictive maintenance method for industrial robots for the production stability of intelligent manufacturing","volume":"234","author":"Wang","year":"2023","journal-title":"Expert Syst. Appl"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2024.3509521","article-title":"A lightweight reinforcement learning-based real-time path planning method for unmanned aerial vehicles","author":"Xi","year":"2024","journal-title":"IEEE Internet Things J"},{"key":"B26","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1186\/1471-2202-12-S1-P381","article-title":"The effect of movement noise on internal estimations: possible implications for neural coding","volume":"12","author":"Zacksenhouse","year":"2011","journal-title":"BMC Neurosci"},{"key":"B27","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1186\/1471-2202-11-S1-P126","article-title":"Signal-to-noise ratio of binned spike-counts and the timescales of neural coding","volume":"11","author":"Zacksenhouse","year":"2010","journal-title":"BMC Neurosci"},{"key":"B28","doi-asserted-by":"publisher","first-page":"91","DOI":"10.3389\/fncom.2014.00091","article-title":"Signal-independent timescale analysis (SITA) and its application for neural coding during reaching and walking","volume":"8","author":"Zacksenhouse","year":"2014","journal-title":"Front. Comput. Neurosci"},{"key":"B29","doi-asserted-by":"publisher","first-page":"3463","DOI":"10.32604\/cmc.2024.054886","article-title":"Machine fault diagnosis using audio sensors data and explainable AI techniques-lime and SHAP","volume":"80","author":"Zereen","year":"2024","journal-title":"Comput. Mater. Contin"},{"key":"B30","first-page":"303","author":"Zhang","year":"2023"},{"key":"B31","doi-asserted-by":"publisher","first-page":"1471327","DOI":"10.3389\/fnbot.2024.1471327","article-title":"ACA-NET: adaptive context-aware network for basketball action recognition","volume":"18","author":"Zhang","year":"2024","journal-title":"Front. Neurorobot"}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1513354\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,24]],"date-time":"2025-01-24T02:15:37Z","timestamp":1737684937000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1513354\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,24]]},"references-count":31,"alternative-id":["10.3389\/fnbot.2024.1513354"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2024.1513354","relation":{},"ISSN":["1662-5218"],"issn-type":[{"value":"1662-5218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,24]]},"article-number":"1513354"}}