{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T03:55:53Z","timestamp":1772596553618,"version":"3.50.1"},"reference-count":42,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2021,7,7]],"date-time":"2021-07-07T00:00:00Z","timestamp":1625616000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Guangdong Basic and Applied Basic Research Projects","award":["2019A1515111082"],"award-info":[{"award-number":["2019A1515111082"]}]},{"name":"Fund for High Level Talents Afforded by University of Electronic Science and Technology of China, Zhongshan Institute","award":["417YKQ12, 419YKQN15"],"award-info":[{"award-number":["417YKQ12, 419YKQN15"]}]},{"name":"Social Welfare Major Project of Zhongshan","award":["2019B2010, 2019B2011"],"award-info":[{"award-number":["2019B2010, 2019B2011"]}]},{"name":"Achievement Cultivation Project of Zhongshan Industrial Technology Research Institute","award":["419N26"],"award-info":[{"award-number":["419N26"]}]},{"name":"Young innovative talents project of Education Department of Guangdong Province","award":["419YIY04"],"award-info":[{"award-number":["419YIY04"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Conveyors are used commonly in industrial production lines and automated sorting systems. Many applications require fast, reliable, and dynamic detection and recognition for the objects on conveyors. Aiming at this goal, we design a framework that involves three subtasks: one-class instance segmentation (OCIS), multiobject tracking (MOT), and zero-shot fine-grained recognition of 3D objects (ZSFGR3D). A new level set map network (LSMNet) and a multiview redundancy-free feature network (MVRFFNet) are proposed for the first and third subtasks, respectively. The level set map (LSM) is used to annotate instances instead of the traditional multichannel binary mask, and each peak of the LSM represents one instance. Based on the LSM, LSMNet can adopt a pix2pix architecture to segment instances. MVRFFNet is a generalized zero-shot learning (GZSL) framework based on the Wasserstein generative adversarial network for 3D object recognition. Multi-view features of an object are combined into a compact registered feature. By treating the registered features as the category attribution in the GZSL setting, MVRFFNet learns a mapping function that maps original retrieve features into a new redundancy-free feature space. To validate the performance of the proposed methods, a segmentation dataset and a fine-grained classification dataset about objects on a conveyor are established. Experimental results on these datasets show that LSMNet can achieve a recalling accuracy close to the light instance segmentation framework You Only Look At CoefficienTs (YOLACT), while its computing speed on an NVIDIA GTX1660TI GPU is 80 fps, which is much faster than YOLACT\u2019s 25 fps. Redundancy-free features generated by MVRFFNet perform much better than original features in the retrieval task.<\/jats:p>","DOI":"10.3390\/fi13070176","type":"journal-article","created":{"date-parts":[[2021,7,7]],"date-time":"2021-07-07T12:31:25Z","timestamp":1625661085000},"page":"176","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Dynamic Detection and Recognition of Objects Based on Sequential RGB Images"],"prefix":"10.3390","volume":"13","author":[{"given":"Shuai","family":"Dong","sequence":"first","affiliation":[{"name":"Artificial Intelligence and Computer Vision Laboratory, Zhongshan Institute, University of Electronic Science and Technology of China, Zhongshan 528402, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhihua","family":"Yang","sequence":"additional","affiliation":[{"name":"Artificial Intelligence and Computer Vision Laboratory, Zhongshan Institute, University of Electronic Science and Technology of China, Zhongshan 528402, China"},{"name":"School of Automation, Guangdong University of Technology, Guangzhou 510006, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wensheng","family":"Li","sequence":"additional","affiliation":[{"name":"Artificial Intelligence and Computer Vision Laboratory, Zhongshan Institute, University of Electronic Science and Technology of China, Zhongshan 528402, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kun","family":"Zou","sequence":"additional","affiliation":[{"name":"Artificial Intelligence and Computer Vision Laboratory, Zhongshan Institute, University of Electronic Science and Technology of China, Zhongshan 528402, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Dong, S., Zou, K., and Li, W. (2020, January 15\u201317). Fine-Grained Recognition of 3D Shapes Based on Multi-View Recurrent Neural Network. Proceedings of the 12th International Conference on Machine Learning and Computing, Shenzhen, China.","DOI":"10.1145\/3383972.3383983"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Su, H., Maji, S., Kalogerakis, E., and Learned-Miller, E. (2015, January 7\u201313). Multi-View Convolutional Neural Networks for 3d Shape Recognition. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.114"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Han, Z., Fu, Z., and Yang, J. (2020, January 14\u201319). Learning the Redundancy-Free Features for Generalized Zero-Shot Object Recognition. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01288"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Han, Z., Fu, Z., Chen, S., and Yang, J. (2021). Contrastive Embedding for Generalized Zero-Shot Learning. arXiv.","DOI":"10.1109\/CVPR46437.2021.00240"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Wojke, N., Bewley, A., and Paulus, D. (2017, January 17\u201320). Simple Online and Realtime Tracking with a Deep Association Metric. Proceedings of the IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8296962"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"103448","DOI":"10.1016\/j.artint.2020.103448","article-title":"Multiple Object Tracking: A Literature Review","volume":"293","author":"Luo","year":"2020","journal-title":"Artif. Intell."},{"key":"ref_7","unstructured":"Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv."},{"key":"ref_8","unstructured":"Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Law, H., and Deng, J. (2019). CornerNet: Detecting Objects as Paired Keypoints. arXiv.","DOI":"10.1007\/s11263-019-01204-1"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Duan, K., Bai, S., Xie, L., Qi, H., Huang, Q., and Tian, Q. (2019). CenterNet: Object Detection with Keypoint Triplets. arXiv.","DOI":"10.1109\/ICCV.2019.00667"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kim, Y., Kim, S., Kim, T., and Kim, C. (2019, January 7\u201311). CNN-Based Semantic Segmentation Using Level Set Loss. Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa Village, HI, USA.","DOI":"10.1109\/WACV.2019.00191"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Peng, S., Jiang, W., Pi, H., Li, X., Bao, H., and Zhou, X. (2020, January 13\u201319). Deep Snake for Real-Time Instance Segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00856"},{"key":"ref_13","unstructured":"Microsoft (2017, September 01). Microsoft Common Objects in Context 2017. Available online: https:\/\/cocodataset.org\/#detection-2017."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bolya, D., Zhou, C., Xiao, F., and Lee, Y.J. (2019). YOLACT: Real-Time Instance Segmentation. arXiv.","DOI":"10.1109\/ICCV.2019.00925"},{"key":"ref_15","unstructured":"Arjovsky, M., Chintala, S., and Bottou, L. (2017). Wasserstein GAN. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Minaee, S., Boykov, Y.Y., Porikli, F., Plaza, A.J., Kehtarnavaz, N., and Terzopoulos, D. (2021). Image Segmentation Using Deep Learning: A Survey. IEEE Trans. Pattern Anal. Mach. Intell., 1\u201322.","DOI":"10.1109\/TPAMI.2021.3059968"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Leibe, B., Matas, J., Sebe, N., and Welling, M. (2016). Instance-Sensitive Fully Convolutional Networks. Computer Vision\u2013ECCV 2016, Springer.","DOI":"10.1007\/978-3-319-46478-7"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Li, Y., Qi, H., Dai, J., Ji, X., and Wei, Y. (2017, January 21\u201326). Fully Convolutional Instance-Aware Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.472"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Bolya, D., Zhou, C., Xiao, F., and Lee, Y.J. (2019). YOLACT++: Better Real-Time Instance Segmentation. arXiv.","DOI":"10.1109\/ICCV.2019.00925"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Xie, E., Sun, P., Song, X., Wang, W., Liu, X., Liang, D., Shen, C., and Luo, P. (2020, January 16\u201318). Polarmask: Single Shot Instance Segmentation with Polar Representation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01221"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lee, Y., and Park, J. (2020, January 13\u201319). Centermask: Real-Time Anchor-Free Instance Segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01392"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, Y., Xu, Z., Shen, H., Cheng, B., and Yang, L. (2020, January 13\u201319). Centermask: Single Shot Instance Segmentation with Point Representation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00933"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, R., Tian, Z., Shen, C., You, M., and Yan, Y. (2020, January 16\u201318). Mask Encoding for Single Shot Instance Segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01024"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Chen, H., Sun, K., Tian, Z., Shen, C., Huang, Y., and Yan, Y. (2020, January 16\u201318). BlendMask: Top-down Meets Bottom-up for Instance Segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00860"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Lampert, C.H., Nickisch, H., and Harmeling, S. (2009, January 20\u201325). Learning to Detect Unseen Object Classes by Between-Class Attribute Transfer. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206594"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2251","DOI":"10.1109\/TPAMI.2018.2857768","article-title":"Zero-Shot Learning\u2014A Comprehensive Evaluation of the Good, the Bad and the Ugly","volume":"41","author":"Xian","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bendale, A., and Boult, T. (2016, January 27\u201330). Towards Open Set Deep Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.173"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Xian, Y., Sharma, S., Schiele, B., and Akata, Z. (2019, January 16\u201320). F-VAEGAN-D2: A Feature Generating Framework for Any-Shot Learning. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01052"},{"key":"ref_31","unstructured":"Palatucci, M., Pomerleau, D., Hinton, G.E., and Mitchell, T.M. (2009, January 7\u201310). Zero-Shot Learning with Semantic Output Codes. Proceedings of the Advances in Neural Information Processing Systems 22: 23rd Annual Conference on Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Akata, Z., Reed, S., Walter, D., Lee, H., and Schiele, B. (2015, January 7\u201312). Evaluation of Output Embeddings for Fine-Grained Image Classification. Proceedings of the IEEE Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298911"},{"key":"ref_33","unstructured":"Bucher, M., Herbin, S., and Jurie, F. (2017, January 22\u201329). Generating Visual Representations for Zero-Shot Classification. Proceedings of the IEEE International Conference on Computer Vision Workshops, Venice, Italy."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Xian, Y., Lorenz, T., Schiele, B., and Akata, Z. (2018, January 18\u201323). Feature Generating Networks for Zero-Shot Learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00581"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Felix, R., Kumar, B., Reid, I., and Carneiro, G. (2018, January 8\u201314). Multi-Modal Cycle-Consistent Generalized Zero-Shot Learning. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01231-1_2"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Huang, H., Wang, C., Yu, P.S., and Wang, C.-D. (2019, January 15\u201321). Generative Dual Adversarial Network for Generalized Zero-Shot Learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00089"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhu, J., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Verma, V.K., Arora, G., Mishra, A., and Rai, P. (2018, January 18\u201323). Generalized Zero-Shot Learning via Synthesized Examples. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00450"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Chen, L., Zhang, H., Xiao, J., Liu, W., and Chang, S.-F. (2018, January 18\u201323). Zero-Shot Visual Recognition Using Semantics-Preserving Adversarial Embedding Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00115"},{"key":"ref_40","unstructured":"Bengio, S., Wallach, H., Larochelle, H., Grauman, K., Cesa-Bianchi, N., and Garnett, R. (2018). Generalized Zero-Shot Learning with Deep Calibration Network. Advances in Neural Information Processing Systems, Curran Associates Inc."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Vu, T., Kang, H., and Yoo, C.D. (2021). SCNet: Training Inference Sample Consistency for Instance Segmentation. arXiv.","DOI":"10.1609\/aaai.v35i3.16374"},{"key":"ref_42","unstructured":"Chen, K., Wang, J., Pang, J., Cao, Y., Xiong, Y., Li, X., Sun, S., Feng, W., Liu, Z., and Xu, J. (2019). Open MMLab Detection Toolbox and Benchmark. arXiv."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/7\/176\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:27:09Z","timestamp":1760164029000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/7\/176"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,7]]},"references-count":42,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["fi13070176"],"URL":"https:\/\/doi.org\/10.3390\/fi13070176","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,7]]}}}