{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T06:32:22Z","timestamp":1773729142273,"version":"3.50.1"},"reference-count":46,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2025,6,26]],"date-time":"2025-06-26T00:00:00Z","timestamp":1750896000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006769","name":"Russian Science Foundation","doi-asserted-by":"publisher","award":["24-71-10016"],"award-info":[{"award-number":["24-71-10016"]}],"id":[{"id":"10.13039\/501100006769","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006769","name":"Russian Science Foundation","doi-asserted-by":"publisher","award":["24-71-00024"],"award-info":[{"award-number":["24-71-00024"]}],"id":[{"id":"10.13039\/501100006769","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>The rapid development of unmanned aerial vehicles (UAVs) has had a significant impact on the growth of the economic, industrial, and social welfare of society. The possibility of reaching places that are difficult and dangerous for humans to access with minimal use of third-party resources increases the efficiency and quality of maintenance of construction structures, agriculture, and exploration, which are carried out with the help of drones with a predetermined trajectory. The widespread use of UAVs has caused problems with the control of the drones\u2019 correctness following a given route, which leads to emergencies and accidents. Therefore, UAV monitoring with video cameras is of great importance. In this paper, we propose a Yolov12 architecture with positive\u2013negative pulse-based optimization algorithms to solve the problem of drone detection on video data. Self-attention-based mechanisms in transformer neural networks (NNs) improved the quality of drone detection on video. The developed algorithms for training NN architectures improved the accuracy of drone detection by achieving the global extremum of the loss function in fewer epochs using positive\u2013negative pulse-based optimization algorithms. The proposed approach improved object detection accuracy by 2.8 percentage points compared to known state-of-the-art analogs.<\/jats:p>","DOI":"10.3390\/bdcc9070167","type":"journal-article","created":{"date-parts":[[2025,6,26]],"date-time":"2025-06-26T03:39:59Z","timestamp":1750909199000},"page":"167","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Enhancing Drone Detection via Transformer Neural Network and Positive\u2013Negative Momentum Optimizers"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0487-4779","authenticated-orcid":false,"given":"Pavel","family":"Lyakhov","sequence":"first","affiliation":[{"name":"Department of Mathematical Modelling, North-Caucasus Federal University, 355009 Stavropol, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8941-4220","authenticated-orcid":false,"given":"Denis","family":"Butusov","sequence":"additional","affiliation":[{"name":"Computer-Aided Design Department, St. Petersburg Electrotechnical University \u201cLETI\u201d, 5 Professora Popova St., 197022 Saint Petersburg, Russia"}]},{"given":"Vadim","family":"Pismennyy","sequence":"additional","affiliation":[{"name":"Department of Mathematical Modelling, North-Caucasus Federal University, 355009 Stavropol, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7792-1666","authenticated-orcid":false,"given":"Ruslan","family":"Abdulkadirov","sequence":"additional","affiliation":[{"name":"Department of Mathematical Modelling, North-Caucasus Federal University, 355009 Stavropol, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9423-3555","authenticated-orcid":false,"given":"Nikolay","family":"Nagornov","sequence":"additional","affiliation":[{"name":"Department of Mathematical Modelling, North-Caucasus Federal University, 355009 Stavropol, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6750-2337","authenticated-orcid":false,"given":"Valerii","family":"Ostrovskii","sequence":"additional","affiliation":[{"name":"Computer-Aided Design Department, St. Petersburg Electrotechnical University \u201cLETI\u201d, 5 Professora Popova St., 197022 Saint Petersburg, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0966-3455","authenticated-orcid":false,"given":"Diana","family":"Kalita","sequence":"additional","affiliation":[{"name":"Department of Mathematical Modelling, North-Caucasus Federal University, 355009 Stavropol, Russia"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Murad\u00e1s Odriozola, G., Pauly, K., Oswald, S., and Raymaekers, D. (2024). Automating Ground Control Point Detection in Drone Imagery: From Computer Vision to Deep Learning. Remote Sens., 16.","DOI":"10.3390\/rs16050794"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Honarmand, M., and Shahriari, H. (2021). Geological Mapping Using Drone-Based Photogrammetry: An Application for Exploration of Vein-Type Cu Mineralization. Minerals, 11.","DOI":"10.3390\/min11060585"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Munawar, H.S., Ullah, F., Heravi, A., Thaheem, M.J., and Maqsoom, A. (2021). Inspecting Buildings Using Drones and Computer Vision: A Machine Learning Approach to Detect Cracks and Damages. Drones, 6.","DOI":"10.3390\/drones6010005"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1007\/s11676-015-0088-y","article-title":"Drone Remote Sensing for Forestry Research and Practices","volume":"26","author":"Tang","year":"2015","journal-title":"J. For. Res."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Benarbia, T., and Kyamakya, K. (2021). A Literature Review of Drone-Based Package Delivery Logistics Systems and Their Implementation Feasibility. Sustainability, 14.","DOI":"10.3390\/su14010360"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Rold\u00e1n-G\u00f3mez, J.J., Gonz\u00e1lez-Gironda, E., and Barrientos, A. (2021). A Survey on Robotic Technologies for Forest Firefighting: Applying Drone Swarms to Improve Firefighters\u2019 Efficiency and Safety. Appl. Sci., 11.","DOI":"10.3390\/app11010363"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Chen, Z., Yan, L., Wang, H., and Adamyk, B. (2024). Improved Facial Expression Recognition Algorithm Based on Local Feature Enhancement and Global Information Association. Electronics, 13.","DOI":"10.3390\/electronics13142813"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Lee, D., Gyu La, W., and Kim, H. (2018, January 17\u201319). Drone Detection and Identification System Using Artificial Intelligence. Proceedings of the 2018 International Conference on Information and Communication Technology Convergence (ICTC), Jeju Island, Republic of Korea.","DOI":"10.1109\/ICTC.2018.8539442"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Mubarak, A.S., Vubangsi, M., Al-Turjman, F., Ameen, Z.S., Mahfudh, A.S., and Alturjman, S. (2022, January 2\u20134). Computer Vision Based Drone Detection Using Mask R-CNN. Proceedings of the 2022 International Conference on Artificial Intelligence in Everything (AIE), Nicosia, Turkey.","DOI":"10.1109\/AIE57029.2022.00108"},{"key":"ref_10","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. Proceedings of the Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"26185","DOI":"10.1007\/s11042-022-12939-4","article-title":"YOLO-V3 Based Real-Time Drone Detection Algorithm","volume":"81","author":"Alsanad","year":"2022","journal-title":"Multimed. Tools Appl."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"416","DOI":"10.3390\/eng4010025","article-title":"Drone Detection Using Yolov5","volume":"4","author":"Aydin","year":"2023","journal-title":"Eng"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yan, L., Li, K., Gao, R., Wang, C., and Xiong, N. (2022). An Intelligent Weighted Object Detector for Feature Extraction to Enrich Global Image Information. Appl. Sci., 12.","DOI":"10.3390\/app12157825"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhai, X., Huang, Z., Li, T., Liu, H., and Wang, S. (2023). YOLO-Drone: An Optimized YOLOv8 Network for Tiny UAV Object Detection. Electronics, 12.","DOI":"10.3390\/electronics12173664"},{"key":"ref_15","unstructured":"Khanam, R., and Hussain, M. (2024). YOLOv11: An Overview of the Key Architectural Enhancements. arXiv."},{"key":"ref_16","unstructured":"Tian, Y., Ye, Q., and Doermann, D. (2025). YOLOv12: Attention-Centric Real-Time Object Detectors. arXiv."},{"key":"ref_17","first-page":"6000","article-title":"Attention Is All You Need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_18","unstructured":"Gower, R.M., Loizou, N., Qian, X., Sailanbayev, A., Shulgin, E., and Richt\u00e1rik, P. (2019, January 9\u201315). SGD: General Analysis and Improved Rates. Proceedings of the International Conference on Machine Learning, PMLR, Long Beach, CA, USA."},{"key":"ref_19","first-page":"18795","article-title":"Adabelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients","volume":"33","author":"Zhuang","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_20","unstructured":"Xie, Z., Yuan, L., Zhu, Z., and Sugiyama, M. (2021, January 18\u201324). Positive-Negative Momentum: Manipulating Stochastic Gradient Noise to Improve Generalization. Proceedings of the International Conference on Machine Learning, PMLR, Online."},{"key":"ref_21","unstructured":"Alif, M.A.R., and Hussain, M. (2024). YOLOv1 to YOLOv10: A Comprehensive Review of YOLO Variants and Their Application in the Agricultural Domain. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Gui, H., Jiao, H., Li, L., Jiang, X., Su, T., and Pang, Z. (2024). Breast Tumor Detection and Diagnosis Using an Improved Faster R-CNN in DCE-MRI. Bioengineering, 11.","DOI":"10.3390\/bioengineering11121217"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Magalh\u00e3es, S.A., Castro, L., Moreira, G., dos Santos, F.N., Cunha, M., Dias, J., and Moreira, A.P. (2021). Evaluating the Single-Shot MultiBox Detector and YOLO Deep Learning Models for the Detection of Tomatoes in a Greenhouse. Sensors, 21.","DOI":"10.3390\/s21103569"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Dollar, P. (2017, January 22\u201329). Focal Loss for Dense Object Detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Tan, M., Pang, R., and Le, Q.V. (2020, January 14\u201319). EfficientDet: Scalable and Efficient Object Detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01079"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Rahman, M.H., Sejan, M.A.S., Aziz, M.A., Tabassum, R., Baik, J.I., and Song, H.K. (2024). A Comprehensive Survey of Unmanned Aerial Vehicles Detection and Classification Using Machine Learning Approach: Challenges, Solutions, and Future Directions. Remote Sens., 16.","DOI":"10.3390\/rs16050879"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1186\/s41074-019-0059-x","article-title":"Deep learning-based strategies for the detection and tracking of drones using several cameras","volume":"11","author":"Unlu","year":"2019","journal-title":"IPSJ Trans. Comput. Vis. Appl."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Shi, Q., and Li, J. (2020, January 14\u201316). Objects Detection of UAV for Anti-UAV Based on YOLOv4. Proceedings of the 2020 IEEE 2nd International Conference on Civil Aviation Safety and Information Technology ICCASIT, Weihai, China.","DOI":"10.1109\/ICCASIT50869.2020.9368788"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hamadi, R., Ghazzai, H., and Massoud, Y. (2023, January 19\u201321). Image-based Automated Framework for Detecting and Classifying Unmanned Aerial Vehicles. Proceedings of the 2023 IEEE International Conference on Smart Mobility (SM), Thuwal, Saudi Arabia.","DOI":"10.1109\/SM57895.2023.10112531"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Tejera-Berengue, D., Zhu-Zhou, F., Utrilla-Manso, M., Gil-Pita, R., and Rosa-Zurera, M. (2023, January 18\u201320). Acoustic-Based Detection of UAVs Using Machine Learning: Analysis of Distance and Environmental Effects. Proceedings of the 2023 IEEE Sensors Applications Symposium (SAS), Ottawa, ON, Canada.","DOI":"10.1109\/SAS58821.2023.10254127"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Mahdavi, F., and Rajabi, R. (2020, January 23\u201324). Drone Detection Using Convolutional Neural Networks. Proceedings of the 2020 6th Iranian Conference on Signal Processing and Intelligent Systems (ICSPIS), Mashhad, Iran.","DOI":"10.1109\/ICSPIS51611.2020.9349620"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Abdulkadirov, R., Lyakhov, P., and Nagornov, N. (2023). Survey of Optimization Algorithms in Modern Neural Networks. Mathematics, 11.","DOI":"10.20944\/preprints202304.0648.v1"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"4500","DOI":"10.1109\/TNNLS.2019.2955777","article-title":"diffGrad: An Optimization Method for Convolutional Neural Networks","volume":"31","author":"Dubey","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1016\/j.procs.2020.09.038","article-title":"Optimization of Convolutional Neural Networks for Imbalanced Set Classification","volume":"176","author":"Valova","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Plevris, V., and Solorzano, G. (2022). A Collection of 30 Multidimensional Functions for Global Optimization Benchmarking. Data, 7.","DOI":"10.3390\/data7040046"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"174394","DOI":"10.1109\/ACCESS.2020.3026192","article-title":"Real World Object Detection Dataset for Quadcopter Unmanned Aerial Vehicle Detection","volume":"8","author":"Wojtyra","year":"2020","journal-title":"IEEE Access"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"90629","DOI":"10.1109\/ACCESS.2024.3420730","article-title":"Enhanced Small Drone Detection Using Optimized YOLOv8 with Attention Mechanisms","volume":"12","author":"Zamri","year":"2024","journal-title":"IEEE Access"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.jcp.2019.03.008","article-title":"A review of definitions of fractional derivatives and other operators","volume":"388","author":"Teodoro","year":"2019","journal-title":"J. Comput. Phys."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Nielsen, F. (2020). An Elementary Introduction to Information Geometry. Entropy, 22.","DOI":"10.3390\/e22101100"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Salman, S., Mir, J., Farooq, M.T., Malik, A.N., and Haleemdeen, R. (2021, January 12\u201316). Machine Learning Inspired Efficient Audio Drone Detection Using Acoustic Features. Proceedings of the 2021 International Bhurban Conference on Applied Sciences and Technologies (IBCAST), Islamabad, Pakistan.","DOI":"10.1109\/IBCAST51254.2021.9393232"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.future.2019.05.007","article-title":"RF-Based Drone Detection and Identification Using Deep Learning Approaches: An Initiative towards a Large Open Source Drone Database","volume":"100","author":"Mohamed","year":"2019","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Yang, X.-J. (2019). General Fractional Derivatives. Theory, Methods and Applications, CRC Press, Taylor and Francis Group.","DOI":"10.1201\/9780429284083"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"He, Y., Xue, G., Chen, W., and Tian, Z. (2022). Three-Dimensional Inversion of Semi-Airborne Transient Electromagnetic Data Based on a Particle Swarm Optimization-Gradient Descent Algorithm. Appl. Sci., 12.","DOI":"10.3390\/app12063042"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"5461","DOI":"10.1103\/PhysRevLett.81.5461","article-title":"Natural Gradient Descent for OnLine Learning","volume":"81","author":"Rattray","year":"1998","journal-title":"Phys. Rev. Lett."},{"key":"ref_45","first-page":"160","article-title":"A survey on scheduling techniques in computing and network convergence","volume":"26","author":"Tang","year":"2023","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"162950","DOI":"10.1109\/ACCESS.2019.2949814","article-title":"A Survey on Tensor Techniques and Applications in Machine Learning","volume":"7","author":"Ji","year":"2019","journal-title":"IEEE Access"}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/7\/167\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:58:52Z","timestamp":1760032732000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/7\/167"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,26]]},"references-count":46,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2025,7]]}},"alternative-id":["bdcc9070167"],"URL":"https:\/\/doi.org\/10.3390\/bdcc9070167","relation":{},"ISSN":["2504-2289"],"issn-type":[{"value":"2504-2289","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,26]]}}}