{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T10:57:29Z","timestamp":1769511449098,"version":"3.49.0"},"reference-count":33,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2023,3,23]],"date-time":"2023-03-23T00:00:00Z","timestamp":1679529600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The grade of wheat quality depends on the proportion of unsound kernels. Therefore, the rapid detection of unsound wheat kernels is important for wheat rating and evaluation. However, in practice, unsound kernels are hand-picked, which makes the process time-consuming and inefficient. Meanwhile, methods based on traditional image processing cannot divide adherent particles well. To solve the above problems, this paper proposed an unsound wheat kernel recognition algorithm based on an improved mask RCNN. First, we changed the feature pyramid network (FPN) to a bottom-up pyramid network to strengthen the low-level information. Then, an attention mechanism (AM) module was added between the feature extraction network and the pyramid network to improve the detection accuracy for small targets. Finally, the regional proposal network (RPN) was optimized to improve the prediction performance. Experiments showed that the improved mask RCNN algorithm could identify the unsound kernels more quickly and accurately while handling adhesion problems well. The precision and recall were 86% and 91%, respectively, and the inference time on the test set with about 200 targets for each image was 7.83 s. Additionally, we compared the improved model with other existing segmentation models, and experiments showed that our model achieved higher accuracy and performance than the other models, laying the foundation for wheat grading.<\/jats:p>","DOI":"10.3390\/s23073379","type":"journal-article","created":{"date-parts":[[2023,3,23]],"date-time":"2023-03-23T05:19:24Z","timestamp":1679548764000},"page":"3379","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Segmentation of Unsound Wheat Kernels Based on Improved Mask RCNN"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8075-1159","authenticated-orcid":false,"given":"Ran","family":"Shen","sequence":"first","affiliation":[{"name":"College of Information Science and Engineering, Henan University of Technology, Zhengzhou 450001, China"},{"name":"Key Laboratory of Grain Information Processing and Control, Henan University of Technology, Ministry of Education, Zhengzhou 450001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tong","family":"Zhen","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Henan University of Technology, Zhengzhou 450001, China"},{"name":"Key Laboratory of Grain Information Processing and Control, Henan University of Technology, Ministry of Education, Zhengzhou 450001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhihui","family":"Li","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Henan University of Technology, Zhengzhou 450001, China"},{"name":"Key Laboratory of Grain Information Processing and Control, Henan University of Technology, Ministry of Education, Zhengzhou 450001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Velesaca, H.O., Mira, R., Su\u00e1rez, P.L., Larrea, C.X., and Sappa, A.D. (2020, January 14\u201319). Deep Learning based Corn Kernel Classification. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), New Orleans, LA, USA.","DOI":"10.1109\/CVPRW50498.2020.00041"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Su, W.-H., Zhang, J., Yang, C., Page, R., Szinyei, T., Hirsch, C.D., and Steffenson, B.J. (2021). Automatic Evaluation of Wheat Resistance to Fusarium Head Blight Using Dual Mask-RCNN Deep Learning Frameworks in Computer Vision. Remote Sens., 13.","DOI":"10.3390\/rs13010026"},{"key":"ref_3","first-page":"1074","article-title":"Research on hyperspectral image detection method of wheat unsound kernel","volume":"31","author":"Dong","year":"2017","journal-title":"J. Electron. Meas. Instrum."},{"key":"ref_4","unstructured":"Platt, J.C. (1998). Sequential Minimal Optimization: A Fast Algorithm for Training Support Vector Machines, Microsoft."},{"key":"ref_5","first-page":"223","article-title":"Study on Detection Method of Wheat Unsound Kernel Based on Near-Infrared Hyperspectral Imaging Technology","volume":"39","author":"Liu","year":"2019","journal-title":"Spectrosc. Spectr. Anal."},{"key":"ref_6","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_7","unstructured":"Pearson, T.C., Cetin, A.E., and Tewfik, A.H. (2005, January 23\u201323). Detection of insect damaged wheat kernels by impact acoustics. Proceedings of the (ICASSP \u201805), IEEE International Conference on Acoustics, Speech, and Signal Processing, Philadelphia, PA, USA."},{"key":"ref_8","first-page":"993","article-title":"Latent dirichlet allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_9","unstructured":"Shlens, J. (2014). A Tutorial on Principal Component Analysis. arXiv."},{"key":"ref_10","first-page":"47","article-title":"Survey of image semantic segmentation methods based on deep neural network","volume":"15","author":"Hui","year":"2021","journal-title":"J. Front. Comput. Sci. Technol."},{"key":"ref_11","first-page":"9","article-title":"Identification of Unsound Kernels in Wheat Based on CNN Deep Model","volume":"36","author":"Cao","year":"2017","journal-title":"Mod. Comput."},{"key":"ref_12","first-page":"911","article-title":"Imperfect wheat kernel recognition combined with image enhancement and conventional neural network","volume":"41","author":"He","year":"2021","journal-title":"J. Comput. Appl."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"645","DOI":"10.13031\/2013.27877","article-title":"Digital image analysis for software separation and classification of touching grains. II. Classification","volume":"38","author":"Shatadal","year":"1995","journal-title":"Trans. ASABE"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"515","DOI":"10.4028\/www.scientific.net\/AMM.781.515","article-title":"Rice Kernel Separations Using Contour Analysis and Skeleton","volume":"781","author":"Siriwongkul","year":"2015","journal-title":"Appl. Mech. Mater."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Hou, Q., Zhou, D., and Feng, J. (2021, January 20\u201325). Coordinate Attention for Efficient Mobile Network Design. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01350"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhu, X., Cheng, D., Zhang, Z., Lin, S., and Dai, J. (November, January 27). An Empirical Study of Spatial Attention Mechanisms in Deep Networks. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00679"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., and Hu, Q. (2020, January 13\u201319). ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01155"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Wang, S., Sun, G., Zheng, B., and Du, Y. (2021). A Crop Image Segmentation and Extraction Algorithm Based on Mask RCNN. Entropy, 23.","DOI":"10.3390\/e23091160"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"106864","DOI":"10.1016\/j.compag.2022.106864","article-title":"Fusion of Mask RCNN and attention mechanism for instance segmentation of apples under complex background","volume":"196","author":"Wang","year":"2022","journal-title":"Comput. Electron. Agric."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Liu, S., Qi, L., Qin, H., Shi, J., and Jia, J. (2018, January 18\u201323). Path Aggregation Network for Instance Segmentation. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00913"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Neubeck, A., and Gool, L.V. (2006, January 20\u201324). Efficient Non-Maximum Suppression. Proceedings of the 18th International Conference on Pattern Recognition (ICPR\u201906), Hong Kong, China.","DOI":"10.1109\/ICPR.2006.479"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27\u201330). Learning Deep Features for Discriminative Localization. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.319"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10\u201317). Swin Transformer: Hierarchical Vision Transformer using Shifted Windows. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Huang, Z., Huang, L., Gong, Y., Huang, C., and Wang, X. (2019, January 15\u201320). Mask Scoring R-CNN. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00657"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Xie, E., Sun, P., Song, X., Wang, W., Liu, X., Liang, D., Shen, C., and Luo, P. (2020, January 13\u201319). PolarMask: Single Shot Instance Segmentation With Polar Representation. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01221"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, X., Kong, T., Shen, C., Jiang, Y., and Li, L. (2019). SOLO: Segmenting Objects by Locations. arXiv.","DOI":"10.1007\/978-3-030-58523-5_38"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2017, January 18\u201322). Squeeze-and-Excitation Networks. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.-Y., and Kweon, I.-S. (2018, January 8\u201314). CBAM: Convolutional Block Attention Module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Qiao, S., Chen, L.-C., and Yuille, A.L. (2020, January 19\u201325). DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolution. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Virtual.","DOI":"10.1109\/CVPR46437.2021.01008"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs","volume":"40","author":"Chen","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3379\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:01:21Z","timestamp":1760122881000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3379"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,23]]},"references-count":33,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["s23073379"],"URL":"https:\/\/doi.org\/10.3390\/s23073379","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,23]]}}}