{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T04:27:21Z","timestamp":1777696041982,"version":"3.51.4"},"reference-count":46,"publisher":"SAGE Publications","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IDA"],"published-print":{"date-parts":[[2021,7,9]]},"abstract":"<jats:p>Instance segmentation has a wide range of applications, including video surveillance, autonomous driving, and behavior analysis. Nevertheless, as a type of pixel-level segmentation, its prediction performance in practice is substantially affected by low-resolution (LR) images resulting from the limitations of image acquisition equipment and poor acquisition conditions. Moreover, because their immense computational costs prevent the implementation of existing segmentation models on embedded devices, the development of a lightweight segmentation model has become an urgent necessity. However, it is challenging to achieve sound results with high efficiency and portability. From another perspective, to improve understanding of detailed objects, an architecture is needed that promotes an advanced interpretation of the segmentation, that is, a refined mask with texture. Our main contribution, called TextureMask, consists of the MobileNet-FPN for Mask R-CNN methods, segmentation with cropping, and a gradient sensitivity map, which are then merged into a unified map to refine and enrich the mask with texture information. Furthermore, preprocessing and post-processing algorithms are incorporated. Experiments demonstrated that our technique exhibits good pixel-level segmentation performance in terms of both accuracy and computational efficiency for a given LR input, and it can be easily implemented in embedded platforms.<\/jats:p>","DOI":"10.3233\/ida-205250","type":"journal-article","created":{"date-parts":[[2021,7,13]],"date-time":"2021-07-13T14:24:51Z","timestamp":1626186291000},"page":"993-1012","source":"Crossref","is-referenced-by-count":0,"title":["TextureMask: A merged architecture for low-resolution instance segmentation"],"prefix":"10.1177","volume":"25","author":[{"given":"Ting","family":"Da","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liang","family":"Yang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"key":"10.3233\/IDA-205250_ref1","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2012","journal-title":"Communications of the ACM"},{"key":"10.3233\/IDA-205250_ref2","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1109\/TPAMI.2018.2844175","article-title":"Mask R-CNN","volume":"42","author":"He","year":"2020","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"10.3233\/IDA-205250_ref4","doi-asserted-by":"crossref","unstructured":"H. Zhao et al., Pyramid scene parsing network, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 6230\u20136239.","DOI":"10.1109\/CVPR.2017.660"},{"key":"10.3233\/IDA-205250_ref5","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1109\/TITS.2019.2900426","article-title":"A 3D CNN-LSTM-based Image-to-Image foreground segmentation","volume":"21","author":"Akilan","year":"2020","journal-title":"IEEE Transactions on Intelligent Transportation Systems"},{"key":"10.3233\/IDA-205250_ref6","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1109\/MNET.001.1900260","article-title":"Salient object detection in the distributed cloud-edge intelligent network","volume":"34","author":"Gao","year":"2020","journal-title":"IEEE Network"},{"key":"10.3233\/IDA-205250_ref7","doi-asserted-by":"crossref","first-page":"4898","DOI":"10.1109\/TIP.2020.2975717","article-title":"A spatially constrained probabilistic model for robust image segmentation","volume":"29","author":"Banerjee","year":"2020","journal-title":"IEEE Transactions on Image Processing"},{"key":"10.3233\/IDA-205250_ref8","doi-asserted-by":"crossref","unstructured":"F. Perazzi et al., Learning video object segmentation from static images, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 3491\u20133500.","DOI":"10.1109\/CVPR.2017.372"},{"key":"10.3233\/IDA-205250_ref9","doi-asserted-by":"crossref","unstructured":"S. Caelles et al., One-shot video object segmentation, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 5320\u20135329.","DOI":"10.1109\/CVPR.2017.565"},{"key":"10.3233\/IDA-205250_ref10","doi-asserted-by":"crossref","unstructured":"J. Cheng et al., SegFlow: Joint learning for video object segmentation and optical flow, in: IEEE International Conference on Computer Vision (ICCV), 2017, pp. 686\u2013695.","DOI":"10.1109\/ICCV.2017.81"},{"key":"10.3233\/IDA-205250_ref11","doi-asserted-by":"crossref","unstructured":"J. Cheng et al., Fast and accurate online video object segmentation via tracking parts, in: IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 7415\u20137424.","DOI":"10.1109\/CVPR.2018.00774"},{"key":"10.3233\/IDA-205250_ref14","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1007\/s11760-018-1322-9","article-title":"Unsupervised video object segmentation using conditional random fields","volume":"13","author":"Bhatti","year":"2019","journal-title":"Signal, Image and Video Processing"},{"key":"10.3233\/IDA-205250_ref15","doi-asserted-by":"crossref","unstructured":"S. Lin et al., Towards optimal structured CNN pruning via generative adversarial learning, in: IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 2785\u20132794.","DOI":"10.1109\/CVPR.2019.00290"},{"key":"10.3233\/IDA-205250_ref17","doi-asserted-by":"crossref","first-page":"735","DOI":"10.1109\/JETCAS.2019.2952137","article-title":"Memory-reduced network stacking for edge-level CNN architecture with structured weight pruning","volume":"9","author":"Moon","year":"2019","journal-title":"IEEE Journal on Emerging and Selected Topics in Circuits and Systems"},{"key":"10.3233\/IDA-205250_ref18","doi-asserted-by":"crossref","unstructured":"W. Nogami et al., Optimizing weight value quantization for CNN inference, in: International Joint Conference on Neural Networks (IJCNN), 2019, pp. 1\u20138.","DOI":"10.1109\/IJCNN.2019.8852331"},{"key":"10.3233\/IDA-205250_ref20","doi-asserted-by":"crossref","unstructured":"J. Zhang and J. Li, Unleashing the power of soft logic for convolutional neural network acceleration via product quantization, in: Proceedings of the 2019 ACM\/SIGDA International Symposium on Field-Programmable Gate Arrays, 2019.","DOI":"10.1145\/3289602.3293951"},{"key":"10.3233\/IDA-205250_ref21","doi-asserted-by":"crossref","unstructured":"M. Chandra, Data bandwidth reduction in deep neural network SoCs using history buffer and Huffman coding, in: International Conference on Computing, Power and Communication Technologies (GUCON), 2018, pp. 1\u20133.","DOI":"10.1109\/GUCON.2018.8675036"},{"key":"10.3233\/IDA-205250_ref23","doi-asserted-by":"crossref","unstructured":"M. Sandler et al., MobileNetV2: Inverted residuals and linear bottlenecks, in: IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 4510\u20134520.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"10.3233\/IDA-205250_ref24","doi-asserted-by":"crossref","unstructured":"X. Zhang et al., ShuffleNet: An extremely efficient convolutional neural network for mobile devices, in: IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 6848\u20136856.","DOI":"10.1109\/CVPR.2018.00716"},{"key":"10.3233\/IDA-205250_ref27","doi-asserted-by":"crossref","unstructured":"R.B. Girshick et al., Rich feature hierarchies for accurate object detection and semantic segmentation, in: IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 580\u2013587.","DOI":"10.1109\/CVPR.2014.81"},{"key":"10.3233\/IDA-205250_ref28","doi-asserted-by":"crossref","unstructured":"R.B. Girshick, Fast R-CNN, in: IEEE International Conference on Computer Vision (ICCV), 2015, pp. 1440\u20131448.","DOI":"10.1109\/ICCV.2015.169"},{"key":"10.3233\/IDA-205250_ref29","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2015","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"10.3233\/IDA-205250_ref30","doi-asserted-by":"crossref","first-page":"1904","DOI":"10.1109\/TPAMI.2015.2389824","article-title":"Spatial pyramid pooling in deep convolutional networks for visual recognition","volume":"37","author":"He","year":"2015","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"10.3233\/IDA-205250_ref31","doi-asserted-by":"crossref","unstructured":"C. Ventura et al., RVOS: End-to-end recurrent network for video object segmentation, in: IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 5272\u20135281.","DOI":"10.1109\/CVPR.2019.00542"},{"key":"10.3233\/IDA-205250_ref32","doi-asserted-by":"crossref","unstructured":"Y. Zhu et al., Improving semantic segmentation via video propagation and label relaxation, in: IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 8848\u20138857.","DOI":"10.1109\/CVPR.2019.00906"},{"key":"10.3233\/IDA-205250_ref33","doi-asserted-by":"crossref","unstructured":"A. Vuola, S. Akram and J. Kannala, Mask-RCNN and U-net ensembled for nuclei segmentation, in: IEEE 16th International Symposium on Biomedical Imaging (ISBI), 2019, pp. 208\u2013212.","DOI":"10.1109\/ISBI.2019.8759574"},{"key":"10.3233\/IDA-205250_ref34","doi-asserted-by":"crossref","unstructured":"J. Johnander et al., A generative appearance model for end-to-end video object segmentation, IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 8945\u20138954.","DOI":"10.1109\/CVPR.2019.00916"},{"key":"10.3233\/IDA-205250_ref35","doi-asserted-by":"crossref","unstructured":"H. Zhang et al., Context encoding for semantic segmentation, in: IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 7151\u20137160.","DOI":"10.1109\/CVPR.2018.00747"},{"key":"10.3233\/IDA-205250_ref36","doi-asserted-by":"crossref","unstructured":"X. Zeng et al., Dmm-net: Differentiable mask-matching network for video object segmentation, in: IEEE\/CVF International Conference on Computer Vision (ICCV), 2019, pp. 3928\u20133937.","DOI":"10.1109\/ICCV.2019.00403"},{"key":"10.3233\/IDA-205250_ref38","doi-asserted-by":"crossref","unstructured":"K. Chen et al., Hybrid task cascade for instance segmentation, in: IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 4969\u20134978.","DOI":"10.1109\/CVPR.2019.00511"},{"key":"10.3233\/IDA-205250_ref39","doi-asserted-by":"crossref","unstructured":"P. Wang et al., Understanding convolution for semantic segmentation, in: IEEE Winter Conference on Applications of Computer Vision (WACV), 2018, pp. 1451\u20131460.","DOI":"10.1109\/WACV.2018.00163"},{"key":"10.3233\/IDA-205250_ref40","doi-asserted-by":"crossref","unstructured":"E. Xie et al., Polarmask: Single shot instance segmentation with polar representation, in: IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 12190\u201312199.","DOI":"10.1109\/CVPR42600.2020.01221"},{"key":"10.3233\/IDA-205250_ref41","doi-asserted-by":"crossref","first-page":"1515","DOI":"10.1109\/TPAMI.2018.2838670","article-title":"Video object segmentation without temporal information","volume":"41","author":"Maninis","year":"2019","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"10.3233\/IDA-205250_ref42","doi-asserted-by":"crossref","unstructured":"X. Lu et al., See more, know more: Unsupervised video object segmentation with co-attention siamese networks, in: IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 3618\u20133627.","DOI":"10.1109\/CVPR.2019.00374"},{"key":"10.3233\/IDA-205250_ref44","doi-asserted-by":"crossref","unstructured":"Z. Wang et al., Deep networks for image super-resolution with sparse prior, in: IEEE International Conference on Computer Vision (ICCV), 2015, pp. 370\u2013378.","DOI":"10.1109\/ICCV.2015.50"},{"key":"10.3233\/IDA-205250_ref45","unstructured":"K. Gregor and Y. LeCun, Learning fast approximations of sparse coding, in: International Conference on International Conference on Machine Learning (ICML), 2010, pp. 399\u2013406."},{"key":"10.3233\/IDA-205250_ref46","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TPAMI.2015.2439281","article-title":"Image super-resolution using deep convolutional networks","volume":"38","author":"Dong","year":"2016","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"10.3233\/IDA-205250_ref48","first-page":"886","article-title":"Histograms of oriented gradients for human detection","volume":"1","author":"Dalal","year":"2005","journal-title":"IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)"},{"key":"10.3233\/IDA-205250_ref50","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2004","journal-title":"Machine Learning"},{"key":"10.3233\/IDA-205250_ref51","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1006\/jcss.1997.1504","article-title":"A decision-theoretic generalization of on-line learning and an application to boosting","volume":"55","author":"Freund","year":"1995","journal-title":"J. Comput. Syst. Sci."},{"key":"10.3233\/IDA-205250_ref52","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1023\/A:1018628609742","article-title":"Least squares support vector machine classifiers","volume":"9","author":"Suykens","year":"2004","journal-title":"Neural Processing Letters"},{"key":"10.3233\/IDA-205250_ref56","doi-asserted-by":"crossref","unstructured":"K. Hara, H. Kataoka and Y. Satoh, Learning spatio-temporal features with 3D residual networks for action recognition, in: IEEE International Conference on Computer Vision Workshops (ICCVW), 2017, pp. 3154\u20133160.","DOI":"10.1109\/ICCVW.2017.373"},{"key":"10.3233\/IDA-205250_ref57","doi-asserted-by":"crossref","unstructured":"L. Sun et al., Human action recognition using factorized spatio-temporal convolutional networks, in: IEEE International Conference on Computer Vision (ICCV), 2015, pp. 4597\u20134605.","DOI":"10.1109\/ICCV.2015.522"},{"key":"10.3233\/IDA-205250_ref60","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1109\/76.322998","article-title":"One-dimensional full search motion estimation algorithm for video coding","volume":"4","author":"Chen","year":"1994","journal-title":"IEEE Trans, Circuits Syst. Video Technol"},{"key":"10.3233\/IDA-205250_ref61","doi-asserted-by":"crossref","first-page":"800","DOI":"10.1049\/el:20080522","article-title":"Scope of validity of PSNR in image\/video quality assessment","volume":"44","author":"Huynh-Thu","year":"2008","journal-title":"Electronics Letters"},{"key":"10.3233\/IDA-205250_ref62","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: from error visibility to structural similarity","volume":"13","author":"Wang","journal-title":"IEEE Transactions on Image Processing"},{"key":"10.3233\/IDA-205250_ref63","doi-asserted-by":"crossref","first-page":"2378","DOI":"10.1109\/TIP.2011.2109730","article-title":"FSIM: a feature similarity index for image quality assessment","volume":"20","author":"Zhang","year":"2011","journal-title":"IEEE Transactions on Image Processing"}],"container-title":["Intelligent Data Analysis"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IDA-205250","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:19:07Z","timestamp":1777454347000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IDA-205250"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,9]]},"references-count":46,"journal-issue":{"issue":"4"},"URL":"https:\/\/doi.org\/10.3233\/ida-205250","relation":{},"ISSN":["1088-467X","1571-4128"],"issn-type":[{"value":"1088-467X","type":"print"},{"value":"1571-4128","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,9]]}}}