{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T04:37:14Z","timestamp":1770525434472,"version":"3.49.0"},"reference-count":51,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2024,9,8]],"date-time":"2024-09-08T00:00:00Z","timestamp":1725753600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&amp;D Program of China","doi-asserted-by":"publisher","award":["2023YFB3906200"],"award-info":[{"award-number":["2023YFB3906200"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Entomological radar is one of the most effective tools for monitoring insect migration, capable of detecting migratory insects concentrated in layers and facilitating the analysis of insect migration behavior. However, traditional entomological radar, with its low resolution, can only provide a rough observation of layer concentrations. The advent of High-Resolution Phased Array Radar (HPAR) has transformed this situation. With its high range resolution and high data update rate, HPAR can generate detailed concentration spatiotemporal distribution heatmaps. This technology facilitates the detection of changes in insect concentrations across different time periods and altitudes, thereby enabling the observation of large-scale take-off, landing, and layering phenomena. However, the lack of effective techniques for extracting insect concentration data of different phenomena from these heatmaps significantly limits detailed analyses of insect migration patterns. This paper is the first to apply instance segmentation technology to the extraction of insect data, proposing a method for segmenting and extracting insect concentration data from spatiotemporal distribution heatmaps at different phenomena. To address the characteristics of concentrations in spatiotemporal distributions, we developed the Heatmap Feature Fusion Network (HFF-Net). In HFF-Net, we incorporate the Global Context (GC) module to enhance feature extraction of concentration distributions, utilize the Atrous Spatial Pyramid Pooling with Depthwise Separable Convolution (SASPP) module to extend the receptive field for understanding various spatiotemporal distributions of concentrations, and refine segmentation masks with the Deformable Convolution Mask Fusion (DCMF) module to enhance segmentation detail. Experimental results show that our proposed network can effectively segment concentrations of different phenomena from heatmaps, providing technical support for detailed and systematic studies of insect migration behavior.<\/jats:p>","DOI":"10.3390\/rs16173330","type":"journal-article","created":{"date-parts":[[2024,9,9]],"date-time":"2024-09-09T04:15:01Z","timestamp":1725855301000},"page":"3330","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Application of Instance Segmentation to Identifying Insect Concentrations in Data from an Entomological Radar"],"prefix":"10.3390","volume":"16","author":[{"given":"Rui","family":"Wang","sequence":"first","affiliation":[{"name":"School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China"},{"name":"Advanced Technology Research Institute, Beijing Institute of Technology, Jinan 250300, China"}]},{"given":"Jiahao","family":"Ren","sequence":"additional","affiliation":[{"name":"School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China"}]},{"given":"Weidong","family":"Li","sequence":"additional","affiliation":[{"name":"School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China"},{"name":"Advanced Technology Research Institute, Beijing Institute of Technology, Jinan 250300, China"}]},{"given":"Teng","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China"},{"name":"Advanced Technology Research Institute, Beijing Institute of Technology, Jinan 250300, China"}]},{"given":"Fan","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China"}]},{"given":"Jiangtao","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1098\/rsbl.2012.0384","article-title":"Radar Aeroecology: Exploring the Movements of Aerial Fauna through Radio-Wave Remote Sensing","volume":"8","author":"Chilson","year":"2012","journal-title":"Biol. Lett."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1584","DOI":"10.1126\/science.aah4379","article-title":"Mass Seasonal Bioflows of High-Flying Insect Migrants","volume":"354","author":"Hu","year":"2016","journal-title":"Science"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Drake, V.A., and Reynolds, D.R. (2012). Radar Entomology: Observing Insect Flight and Migration, Cabi.","DOI":"10.1079\/9781845935566.0000"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1146\/annurev-ento-120709-144820","article-title":"Recent Insights from Radar Studies of Insect Flight","volume":"56","author":"Chapman","year":"2011","journal-title":"Annu. Rev. Entomol."},{"key":"ref_5","first-page":"39","article-title":"Radar Studies of Locust, Moth and Butterfly Migration in the Sahara","volume":"34","author":"Schaefer","year":"1969","journal-title":"Proc. R. Entomol. Soc. Lond. Ser. C"},{"key":"ref_6","unstructured":"Drake, V.A. (1981). Quantitative Observation and Analysis Procedures for a Manually Operated Entomological Radar, Commonwealth Scientific and Industrial Research Organization."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1017\/S0007485300009172","article-title":"The Nocturnal Migration of the Australian Plague Locust, Chortoicetes Terminifera (Walker) (Orthoptera: Acrididae): Quantitative Radar Observations of a Series of Northward Flights","volume":"73","author":"Drake","year":"1983","journal-title":"Bull. Entomol. Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1016\/0022-5193(81)90305-2","article-title":"Target Density Estimation in Radar Biology","volume":"90","author":"Drake","year":"1981","journal-title":"J. Theor. Biol."},{"key":"ref_9","first-page":"67","article-title":"Radar-Based Studies of the Migratory Flight of Grasshoppers in the Middle Niger Area of Mali","volume":"204","author":"Riley","year":"1979","journal-title":"Proc. R. Soc. Lond. Ser. B Biol. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1098\/rstb.1993.0081","article-title":"A Method for Routine Monitoring of the Aerial Migration of Insects by Using a Vertical-Looking Radar","volume":"340","author":"Smith","year":"1993","journal-title":"Philos. Trans. R. Soc. Lond. Ser. B Biol. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"682","DOI":"10.1126\/science.1182990","article-title":"Flight Orientation Behaviors Promote Optimal Migration Trajectories in High-Flying Insects","volume":"327","author":"Chapman","year":"2010","journal-title":"Science"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1111\/j.1744-7917.2002.tb00169.x","article-title":"Automatically Operating Radars for Monitoring Insect Pest Migrations","volume":"9","author":"Drake","year":"2002","journal-title":"Insect Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/S0168-1699(02)00024-8","article-title":"Insect Monitoring Radar: Remote and Network Operation","volume":"35","author":"Drake","year":"2002","journal-title":"Comput. Electron. Agric."},{"key":"ref_14","unstructured":"Drake, V.A., Harman, I.T., and Bourne, I.A. (1994, January 7\u201311). Simultaneous Entomological and Atmospheric Profiling: A Novel Technique for Studying the Biometeorology of Insect Migration. Proceedings of the 21st Conference on Agricultural and Forest Meteorology & 11th Conference on Biometeorology and Aerobiology, San Diego, CA, USA."},{"key":"ref_15","unstructured":"Rainey, R.C. (1976). Radar observations of insect flight. Insect Flight, Blackwell Scientific."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1111\/j.1365-2311.2006.00813.x","article-title":"Nocturnal Migration of Dragonflies over the Bohai Sea in Northern China","volume":"31","author":"Feng","year":"2006","journal-title":"Ecol. Entomol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1111\/j.1461-9563.2009.00459.x","article-title":"Layers of Nocturnal Insect Migrants at High-Altitude: The Influence of Atmospheric Conditions on Their Formation","volume":"12","author":"Wood","year":"2010","journal-title":"Agric. For. Entomol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"883","DOI":"10.1080\/01431161.2018.1519283","article-title":"Ascent and Descent Rates of High-Flying Insect Migrants Determined with a Non-Coherent Vertical-Beam Entomological Radar","volume":"40","author":"Drake","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Drake, V.A., Hatty, S., Symons, C., and Wang, H. (2020). Insect Monitoring Radar: Maximizing Performance and Utility. Remote Sens., 12.","DOI":"10.3390\/rs12040596"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1109\/MAES.2019.2955575","article-title":"Entomological Radar Overview: System and Signal Processing","volume":"35","author":"Long","year":"2020","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"227301","DOI":"10.1007\/s11432-023-3889-7","article-title":"High-Resolution, Multi-Frequency and Full-Polarization Radar Database of Small and Group Targets in Clutter Environment","volume":"66","author":"Hu","year":"2023","journal-title":"Sci. China Inf. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"6212","DOI":"10.1109\/TGRS.2019.2904869","article-title":"Insect Biological Parameter Estimation Based on the Invariant Target Parameters of the Scattering Matrix","volume":"57","author":"Hu","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"5120511","DOI":"10.1109\/TGRS.2022.3224618","article-title":"Estimating Insect Body Size from Radar Observations Using Feature Selection and Machine Learning","volume":"60","author":"Hu","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"7334","DOI":"10.1109\/TAES.2023.3286830","article-title":"A Multisubobject Approach to Dynamic Formation Target Tracking Using Random Matrices","volume":"59","author":"Jiang","year":"2023","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1445","DOI":"10.1109\/TPAMI.2020.2975798","article-title":"Deep Multi-View Enhancement Hashing for Image Retrieval","volume":"43","author":"Yan","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1145\/3404374","article-title":"Depth Image Denoising Using Nuclear Norm and Learning Graph Model","volume":"16","author":"Yan","year":"2020","journal-title":"ACM Trans. Multimed. Comput. Commun. Appl."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/TCSVT.2021.3067449","article-title":"Task-Adaptive Attention for Image Captioning","volume":"32","author":"Yan","year":"2022","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1145\/3468872","article-title":"Precise No-Reference Image Quality Evaluation Based on Distortion Identification","volume":"17","author":"Yan","year":"2021","journal-title":"ACM Trans. Multimed. Comput. Commun. Appl."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1145\/3472810","article-title":"Age-Invariant Face Recognition by Multi-Feature Fusionand Decomposition with Self-Attention","volume":"18","author":"Yan","year":"2022","journal-title":"ACM Trans. Multimed. Comput. Commun. Appl."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the 27th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully Convolutional Networks for Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"He, K.M., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the 16th IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1483","DOI":"10.1109\/TPAMI.2019.2956516","article-title":"Cascade R-CNN: High Quality Object Detection and Instance Segmentation","volume":"43","author":"Cai","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Chen, K., Pang, J.M., Wang, J.Q., Xiong, Y., Li, X.X., Sun, S.Y., Feng, W.S., Liu, Z.W., Shi, J.P., and Ouyang, W.L. (2019, January 16\u201320). Hybrid Task Cascade for Instance Segmentation. Proceedings of the 32nd IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00511"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Fang, Y., Yang, S., Wang, X., Li, Y., Fang, C., Shan, Y., Feng, B., and Liu, W. (2021, January 10\u201317). Instances as Queries. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00683"},{"key":"ref_36","unstructured":"Bolya, D., Zhou, C., Xiao, F.Y., and Lee, Y.J. (November, January 27). YOLACT Real-time Instance Segmentation. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wang, X., Kong, T., Shen, C., Jiang, Y., and Li, L. (2020, January 23\u201328). SOLO: Segmenting Objects by Locations. Proceedings of the European Conference on Computer Vision (ECCV 2020), Glasgow, UK.","DOI":"10.1007\/978-3-030-58523-5_38"},{"key":"ref_38","unstructured":"Wang, X., Zhang, R., Kong, T., Li, L., and Shen, C. (2020, January 6\u201312). SOLOv2: Dynamic and Fast Instance Segmentation. Proceedings of the Advances in Neural Information Processing Systems 33 (NeurIPS 2020), Online."},{"key":"ref_39","unstructured":"Cao, Y., Xu, J.R., Lin, S., Wei, F.Y., and Hu, H. (November, January 27). GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Chen, L.C.E., Zhu, Y.K., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8\u201314). Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. Proceedings of the 15th European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1016\/B978-0-12-336156-1.50061-6","article-title":"Contrast Limited Adaptive Histogram Equalization","volume":"4","author":"Zuiderveld","year":"1994","journal-title":"Graph. Gems"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/34.41384","article-title":"Multichannel Texture Analysis Using Localized Spatial Filters","volume":"12","author":"Bovik","year":"1990","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., and Aila, T. (2020, January 13\u201319). Analyzing and Improving the Image Quality of StyleGAN. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00813"},{"key":"ref_44","unstructured":"Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8\u201313). Generative Adversarial Nets. Proceedings of the 28th Conference on Neural Information Processing Systems (NIPS), Montreal, QC, Canada."},{"key":"ref_45","unstructured":"Karras, T., Aittala, M., Hellsten, J., Laine, S., Lehtinen, J., and Aila, T. (December, January Canada). Training Generative Adversarial Networks with Limited Data. Proceedings of the Advances in Neural Information Processing Systems 33 (NeurIPS 2020), Virtual, Vancouver, BC."},{"key":"ref_46","unstructured":"Hensel, M., Ramsauer, H., Unterthiner, T., Nessler, B., and Hochreiter, S. (2017, January 4\u20139). GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. Proceedings of the 31st Annual Conference on Neural Information Processing Systems (NIPS), Long Beach, CA, USA."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature Pyramid Networks for Object Detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Dai, J.F., Qi, H.Z., Xiong, Y.W., Li, Y., Zhang, G.D., Hu, H., and Wei, Y.C. (2017, January 22\u201329). Deformable Convolutional Networks. Proceedings of the 16th IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.89"},{"key":"ref_50","unstructured":"Chen, K., Wang, J., Pang, J., Cao, Y., Xiong, Y., Li, X., Sun, S., Feng, W., Liu, Z., and Xu, J. (2019). MMDetection: Open MMLab Detection Toolbox and Benchmark. arXiv."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/17\/3330\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:51:36Z","timestamp":1760111496000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/17\/3330"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,8]]},"references-count":51,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["rs16173330"],"URL":"https:\/\/doi.org\/10.3390\/rs16173330","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,8]]}}}