{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,12]],"date-time":"2026-09-12T17:36:04Z","timestamp":1789234564755,"version":"build-2803163510"},"reference-count":30,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2025,5,5]],"date-time":"2025-05-05T00:00:00Z","timestamp":1746403200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Natural Science Foundation of Hunan Province","award":["2023JJ30185"],"award-info":[{"award-number":["2023JJ30185"]}]},{"name":"Natural Science Foundation of Hunan Province","award":["22A0640"],"award-info":[{"award-number":["22A0640"]}]},{"name":"Natural Science Foundation of Hunan Province","award":["232CXCYT-105010501"],"award-info":[{"award-number":["232CXCYT-105010501"]}]},{"name":"Scientific Research Fund of Hunan Provincial Education Department","award":["2023JJ30185"],"award-info":[{"award-number":["2023JJ30185"]}]},{"name":"Scientific Research Fund of Hunan Provincial Education Department","award":["22A0640"],"award-info":[{"award-number":["22A0640"]}]},{"name":"Scientific Research Fund of Hunan Provincial Education Department","award":["232CXCYT-105010501"],"award-info":[{"award-number":["232CXCYT-105010501"]}]},{"name":"166 Engineering Project","award":["2023JJ30185"],"award-info":[{"award-number":["2023JJ30185"]}]},{"name":"166 Engineering Project","award":["22A0640"],"award-info":[{"award-number":["22A0640"]}]},{"name":"166 Engineering Project","award":["232CXCYT-105010501"],"award-info":[{"award-number":["232CXCYT-105010501"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Panoptic segmentation, as a key task in the field of computer vision, holds significant importance in practical applications such as autonomous driving and robot vision. Currently, among deep-learning-based panoptic segmentation methods, query-based methods have received widespread attention. However, existing methods, such as Mask2Former, typically rely on a static query mechanism. This makes it difficult for the model to adapt to changes in the number of instances in different scenes and can lead to instance loss or confusion, thus limiting performance in complex scenes. Furthermore, it is prone to insufficient feature extraction and a loss of global information. To address these problems, this paper proposes a panoptic segmentation method based on dynamic instance queries (PSM-DIQ). PSM-DIQ uses a multi-dimensional attention mechanism to enhance feature extraction, utilizes instance-activation-guided dynamic query generation to improve the ability to distinguish between different instances, and optimizes pixel\u2013query interactions through a dual-path Transformer decoder. Experiments on the Cityscapes and MS COCO datasets show that, based on the ResNet-50 backbone, PSM-DIQ significantly outperforms the Mask2Former baseline, with PQ values improving by 1.8 and 1.7 percentage points, respectively. The experimental results verify the effectiveness of PSM-DIQ in complex scene panoptic segmentation. Finally, this work will be released as an open-source software package on GitHub (v1.0).<\/jats:p>","DOI":"10.3390\/s25092919","type":"journal-article","created":{"date-parts":[[2025,5,5]],"date-time":"2025-05-05T21:42:09Z","timestamp":1746481329000},"page":"2919","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Panoptic Image Segmentation Method Based on Dynamic Instance Query"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-6730-9301","authenticated-orcid":false,"given":"Lanshi","family":"Yang","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Changsha University of Science and Technology, Changsha 410076, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2566-6848","authenticated-orcid":false,"given":"Shiguo","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Changsha University of Science and Technology, Changsha 410076, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1099-7276","authenticated-orcid":false,"given":"Shuhua","family":"Teng","sequence":"additional","affiliation":[{"name":"School of Electronic Information, Hunan First Normal University, Changsha 410205, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,5,5]]},"reference":[{"key":"ref_1","first-page":"3523","article-title":"Image segmentation using deep learning: A survey","volume":"44","author":"Minaee","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1007\/s13735-017-0141-z","article-title":"A review of semantic segmentation using deep neural networks","volume":"7","author":"Guo","year":"2018","journal-title":"Int. J. Multimed. Inf. Retr."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1007\/s13735-020-00195-x","article-title":"A survey on instance segmentation: State of the art","volume":"9","author":"Hafiz","year":"2020","journal-title":"Int. J. Multimed. Inf. Retr."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kirillov, A., He, K., Girshick, R., Doll\u00e1r, P., and Kaiming, H. (2019, January 15\u201320). Panoptic segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00963"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Kirillov, A., Girshick, R., He, K., and Doll\u00e1r, P. (2019, January 15\u201320). Panoptic feature pyramid networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00656"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Xiong, Y., Liao, R., Zhao, H., Hu, R., Bai, M., Yumer, E., and Urtasun, R. (2019, January 15\u201320). Upsnet: A unified panoptic segmentation network. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00902"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Cheng, B., Collins, M., Zhu, Y., Liu, T., Huang, T., Adam, H., and Chen, L. (2020, January 13\u201319). Panoptic-deeplab: A simple, strong, and fast baseline for bottom-up panoptic segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01249"},{"key":"ref_8","unstructured":"Yang, T., Collins, M., Zhu, Y., Hwang, J., Liu, T., Zhang, X., Sze, V., Papandreou, G., and Chen, L. (2019). Deeperlab: Single-shot image parser. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020, January 23\u201328). End-to-end object detection with transformers. Proceedings of the European Conference on Computer Vision, Online.","DOI":"10.1007\/978-3-030-58452-8_13"},{"key":"ref_10","first-page":"3408","article-title":"Transformer model for panorama segmentation based on convolutional neural network","volume":"34","author":"Mao","year":"2023","journal-title":"J. Softw."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Cheng, B., Misra, I., Schwing, A., Kirillov, A., and Girdhar, R. (2022, January 18\u201324). Masked-attention mask transformer for universal image segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00135"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., and Hu, Q. (2020, January 13\u201319). ECA-Net: Efficient channel attention for deep convolutional neural networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01155"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lee, Y., Hwang, J., Lee, S., Bae, Y., and Park, J. (2019). An Energy and GPU-Computation Efficient Backbone Network for Real-Time Object Detection. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Long Beach, CA, USA, 16\u201317 June 2019, IEEE.","DOI":"10.1109\/CVPRW.2019.00103"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"He, J., Li, P., Geng, Y., Chen, R., Zhang, P., Gao, X., Kong, D., and Luo, P. (2023, January 17\u201324). Fastinst: A simple query-based model for real-time instance segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.02266"},{"key":"ref_17","unstructured":"Loshchilov, I., and Hutter, F. (2019, January 6\u20139). Decoupled weight decay regularization. Proceedings of the ICLR, New Orleans, LA, USA."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Hou, R., Li, J., Bhargava, A., Raizen, A., Vargas, J., Gupta, V., Schootman, M., Huang, C., and Siskind, J. (2020, January 13\u201319). Real-time panoptic segmentation from dense detections. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00855"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Li, Y., Chen, X., Zhu, Z., Xie, L., Huang, G., Du, D., and Wang, X. (2019). Attention-guided unified network for panoptic segmentation. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 15\u201320 June 2019, IEEE.","DOI":"10.1109\/CVPR.2019.00719"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"103736","DOI":"10.1016\/j.jvcir.2022.103736","article-title":"Se-psnet: Silhouette-based enhancement feature for panoptic segmentation network","volume":"90","author":"Chang","year":"2023","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1551","DOI":"10.1007\/s11263-021-01445-z","article-title":"Efficientps: Efficient panoptic segmentation","volume":"129","author":"Mohan","year":"2021","journal-title":"Int. J. Comput. Vis."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1489021","DOI":"10.3389\/fnbot.2024.1489021","article-title":"Cascade contour-enhanced panoptic segmentation for robotic vision perception","volume":"18","author":"Xu","year":"2024","journal-title":"Front. Neurorobotics"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Li, Q., Qi, X., and Torr, P. (2020, January 13\u201319). Unifying training and inference for panoptic segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01333"},{"key":"ref_24","unstructured":"Gao, N., Shan, Y., Wang, Y., Zhao, X., Yu, Y., Yang, M., and Huang, K. (November, January 27). SSAP: Single-shot instance segmentation with affinity pyramid. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_25","unstructured":"Sofiiuk, K., Barinova, O., and Konushin, A. (November, January 27). Adaptis: Adaptive instance selection network. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Li, Y., Zhao, H., Qi, X., Wang, L., Li, Z., Sun, J., and Jia, J. (2021, January 20\u201325). Fully convolutional networks for panoptic segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00028"},{"key":"ref_27","first-page":"1693","article-title":"K-Query: Panoptic segmentation method based on keypoint query","volume":"46","author":"Yao","year":"2023","journal-title":"J. Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1487","DOI":"10.1109\/TIP.2023.3234499","article-title":"IDNet: Information decomposition network for fast panoptic segmentation","volume":"33","author":"Lin","year":"2023","journal-title":"IEEE Trans. Image Process."},{"key":"ref_29","first-page":"10326","article-title":"K-net: Towards unified image segmentation","volume":"34","author":"Zhang","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Wang, H., Zhu, Y., Adam, H., Yuille, A., and Chen, L. (2021, January 20\u201325). Max-deeplab: End-to-end panoptic segmentation with mask transformers. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00542"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/25\/9\/2919\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:27:17Z","timestamp":1760030837000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/25\/9\/2919"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,5]]},"references-count":30,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2025,5]]}},"alternative-id":["s25092919"],"URL":"https:\/\/doi.org\/10.3390\/s25092919","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,5]]}}}