{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T16:04:16Z","timestamp":1740153856776,"version":"3.37.3"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2017,3,14]],"date-time":"2017-03-14T00:00:00Z","timestamp":1489449600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2017,3,14]],"date-time":"2017-03-14T00:00:00Z","timestamp":1489449600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001700","name":"Japanese Ministry for Education, Science, Culture and Sports","doi-asserted-by":"crossref","award":["15K00253"],"award-info":[{"award-number":["15K00253"]}],"id":[{"id":"10.13039\/501100001700","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["IPSJ T Comput Vis Appl"],"published-print":{"date-parts":[[2017,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>In this paper, we describe a novel local descriptor of image texture representation for visual recognition. The image features based on micro-descriptors such as local binary patterns (LBP) and local ternary patterns (LTP) have been very successful in a number of applications including face recognition, object detection, and texture analysis. Instead of binary quantization in LBP, LTP thresholds the differential values between a focused pixel and its neighborhood pixels into three gray levels, which can be explained as the active status (i.e., positively activated, negatively activated, and not activated) of the neighborhood pixels compared to the focused pixel. However, regardless of the magnitude of the focused pixel, the thresholding strategy remains fixed, which would violate the principle of human perception. Therefore, in this study, we design LTP with a data-driven threshold according to Weber\u2019s law, a human perception principle; further, our approach incorporates the contexts of spatial and orientation co-occurrences (i.e., co-occurrence context) among adjacent Weber-based local ternary patterns (WLTPs, i.e., data-driven quantized LTPs) for texture representation. The explored WLTP is formulated by adaptively quantizing differential values between neighborhood pixels and the focused pixel as negative or positive stimuli if the normalized differential values are large; otherwise, the stimulus is set to 0. Our approach here is based on the fact that human perception of a distinguished pattern depends not only on the absolute intensity of the stimulus but also on the relative variance of the stimulus. By integrating co-occurrence context information, we further propose a rotation invariant co-occurrence WLTP (RICWLTP) approach to be more discriminant for image representation. In order to validate the efficiency of our proposed strategy, we apply this to three different visual recognition applications including two texture datasets and one food image dataset and prove the promising performance that can be achieved compared with the state-of-the-art approaches.<\/jats:p>","DOI":"10.1186\/s41074-017-0017-4","type":"journal-article","created":{"date-parts":[[2017,3,14]],"date-time":"2017-03-14T13:17:08Z","timestamp":1489497428000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Co-occurrence context of the data-driven quantized local ternary patterns for visual recognition"],"prefix":"10.1186","volume":"9","author":[{"given":"Xian-Hua","family":"Han","sequence":"first","affiliation":[]},{"given":"Yen-Wei","family":"Chen","sequence":"additional","affiliation":[]},{"given":"Gang","family":"Xu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2017,3,14]]},"reference":[{"key":"17_CR1","volume-title":"Scalable recognition with a vocabulary tree. CVPR","author":"D Nister","year":"2006","unstructured":"Nister D, Stewenius H (2006) Scalable recognition with a vocabulary tree. CVPR. IEEE, New York. pp. 2161\u20132168."},{"key":"17_CR2","volume-title":"Hamming embedding and weak geometric consistency for large scale image search. ECCV","author":"H Jegou","year":"2008","unstructured":"Jegou H, Douze M, Schmid C (2008) Hamming embedding and weak geometric consistency for large scale image search. ECCV. Springer, Berlin."},{"key":"17_CR3","volume-title":"Lost in quantization: improving particular object retrieval in large scale image databases. CVPR","author":"J Philbin","year":"2008","unstructured":"Philbin J, Chum O, Isard M, Sivic J, Zisserman A (2008) Lost in quantization: improving particular object retrieval in large scale image databases. CVPR. IEEE, New York."},{"issue":"3","key":"17_CR4","doi-asserted-by":"publisher","first-page":"1314","DOI":"10.1109\/TIP.2011.2168417","volume":"21","author":"X-H Han","year":"2012","unstructured":"Han X-H, Chen Y-W, Ruan X (2012) Multilinear supervised neighborhood embedding of local descriptor tensor for scene\/object recognition. IEEE Trans Image Process 21(3): 1314\u20131326.","journal-title":"IEEE Trans Image Process"},{"key":"17_CR5","volume-title":"Video Google: a text retrieval approach to object matching in videos. ICCV","author":"J Sivic","year":"2003","unstructured":"Sivic J, Zisserman A (2003) Video Google: a text retrieval approach to object matching in videos. ICCV. IEEE, New York. pp. 1470\u20131477."},{"key":"17_CR6","volume-title":"Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. CVPR","author":"S Lazebnik","year":"2006","unstructured":"Lazebnik S, Schmid C, Ponce J (2006) Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. CVPR. IEEE, New York. pp. 2169\u20132178."},{"key":"17_CR7","unstructured":"Harris C, Stephens M (1998) A combined corner and edge detector In: Proc. Alvey Vision Conference."},{"key":"17_CR8","volume-title":"Object recognition from local scale-invariant features. Proc Int Conf Comput Vision","author":"D Lowe","year":"1999","unstructured":"Lowe D (1999) Object recognition from local scale-invariant features. Proc Int Conf Comput Vision. IEEE, New York. Vol. 2, pp. 1150-1157."},{"issue":"2","key":"17_CR9","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","volume":"60","author":"D Lowe","year":"2004","unstructured":"Lowe D (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2): 91\u2013110.","journal-title":"Int J Comput Vis"},{"key":"17_CR10","volume-title":"PCA-SIFT: A More Distinctive Representation for Local Image Descriptors. Proc. IEEE Int Conf Comput Vision Pattern Recognit","author":"Y Ke","year":"2004","unstructured":"Ke Y, Sukthankar R (2004) PCA-SIFT: A More Distinctive Representation for Local Image Descriptors. Proc. IEEE Int Conf Comput Vision Pattern Recognit. IEEE, New York. pp. 506\u2013513."},{"key":"17_CR11","volume-title":"Histograms of Oriented Gradients for Human Detection. Proc. IEEE Int Conf Comput Vision Pattern Recognit","author":"N Dalal","year":"2005","unstructured":"Dalal N, Triggs B (2005) Histograms of Oriented Gradients for Human Detection. Proc. IEEE Int Conf Comput Vision Pattern Recognit. IEEE, New York. pp. 886-893."},{"key":"17_CR12","volume-title":"An HOG-LBP human detector with partial occlusion handling. ICCV","author":"XY Wang","year":"2009","unstructured":"Wang XY, Han TX, Yan SC (2009) An HOG-LBP human detector with partial occlusion handling. ICCV. Springer, Berlin."},{"issue":"4","key":"17_CR13","doi-asserted-by":"publisher","first-page":"657","DOI":"10.1109\/TPAMI.2006.68","volume":"28","author":"M Heikkila","year":"2006","unstructured":"Heikkila M, Pietikainen M (2006) A texture-based method for modeling the background and detecting moving objects. IEEE Trans Pattern Anal Mach Intell 28(4): 657\u2013662.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"4","key":"17_CR14","first-page":"51","volume":"4","author":"C Kertesz","year":"2011","unstructured":"Kertesz C (2011) Texture-based foreground detection. Int J Signal Process Image Process Pattern Recognit (IJSIP) 4(4): 51\u201362.","journal-title":"Int J Signal Process Image Process Pattern Recognit (IJSIP)"},{"key":"17_CR15","doi-asserted-by":"crossref","unstructured":"Louis W, Plataniotis KN (2011) Co-occurrence of local binary patterns features for frontal face detection in surveillance applications. EURASIP J Image Video Process.","DOI":"10.1155\/2011\/745487"},{"key":"17_CR16","first-page":"82","volume-title":"The 5th Pacific-Rim Symposium on Image and Video Technology (PSIVT2011), LNCS","author":"R Nosaka","year":"2011","unstructured":"Nosaka R, Ohkawa Y, Fukui K (2011) Feature extraction based on co-occurrence of adjacent local binary patterns In: The 5th Pacific-Rim Symposium on Image and Video Technology (PSIVT2011), LNCS, 82\u201391.. IEEE, New York."},{"key":"17_CR17","doi-asserted-by":"publisher","first-page":"2428","DOI":"10.1016\/j.patcog.2013.09.018","volume":"47","author":"R Nosaka","year":"2013","unstructured":"Nosaka R, Fukui K (2013) HEp-2 cell classification using rotation invariant co-occurrence among local binary patterns. Pattern Recogn47: 2428\u20132436.","journal-title":"Pattern Recogn"},{"key":"17_CR18","volume-title":"Rotation invariant co-occurrence among adjacent LBPs. Computer Vision: ACCV 2012, Workshops, Lecture Notes in Computer Science","author":"R Nosaka","year":"2013","unstructured":"Nosaka R, Suryanto CH, Fukui K (2013) Rotation invariant co-occurrence among adjacent LBPs. Computer Vision: ACCV 2012, Workshops, Lecture Notes in Computer Science, Vol. 7728. Springer, Berlin. pp. 15\u201325."},{"key":"17_CR19","volume-title":"12th European Conference on Computer Vision (ECCV2012)","author":"XB Qi","year":"2012","unstructured":"Qi XB, Xiao R, Zhang L, Guo J (2012) Pairwise rotation invariant co-occurrence local binary pattern In: 12th European Conference on Computer Vision (ECCV2012).. Springer, Berlin."},{"issue":"6","key":"17_CR20","doi-asserted-by":"publisher","first-page":"1635","DOI":"10.1109\/TIP.2010.2042645","volume":"19","author":"XY Tan","year":"2010","unstructured":"Tan XY, Triggs B (2010) Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans Image Process 19(6): 1635\u20131650.","journal-title":"IEEE Trans Image Process"},{"issue":"3\/4","key":"17_CR21","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1016\/S0167-2789(02)00734-0","volume":"175","author":"JJ Shen","year":"2003","unstructured":"Shen JJ (2003) On the foundations of vision modeling I. Weber\u2019s law and Weberized TV (total variation) restoration. Physica D: Nonlinear Phenom 175(3\/4): 241\u2013251.","journal-title":"Physica D: Nonlinear Phenom"},{"key":"17_CR22","doi-asserted-by":"publisher","first-page":"971","DOI":"10.1109\/TPAMI.2002.1017623","volume":"25","author":"T Ojala","year":"2002","unstructured":"Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. PAMI 25: 971\u2013987.","journal-title":"PAMI"},{"key":"17_CR23","volume-title":"Texture classification: are filter banks necessary? CVPRI","author":"M Varma","year":"2003","unstructured":"Varma M, Zissermann A (2003) Texture classification: are filter banks necessary? CVPRI. IEEE, New York. pp. 691\u2013698."},{"key":"17_CR24","volume-title":"A new texture descriptor using multifractal analysis in multi-orientation wavelet pyramid. CVPR","author":"Y Xu","year":"2010","unstructured":"Xu Y, Yang X, Ling H, Ji H (2010) A new texture descriptor using multifractal analysis in multi-orientation wavelet pyramid. CVPR. IEEE, New York. pp. 161\u2013168."},{"key":"17_CR25","doi-asserted-by":"publisher","first-page":"1265","DOI":"10.1109\/TPAMI.2005.151","volume":"27","author":"S Lazebnik","year":"2005","unstructured":"Lazebnik S, Schmid C, Ponce J (2005) A sparse texture representation using local affine regions. PAMI 27: 1265\u20131278.","journal-title":"PAMI"},{"key":"17_CR26","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1007\/s11263-006-9794-4","volume":"73","author":"J Zhang","year":"2007","unstructured":"Zhang J, Marszalek M, Lazebnik S, Schmid C (2007) Local features and kernels for classification of texture and object categories: A comprehensive study. IJCV 73: 213\u2013238.","journal-title":"IJCV"},{"key":"17_CR27","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1007\/s11263-005-4635-4","volume":"62","author":"M Varma","year":"2005","unstructured":"Varma M, Zisserman A (2005) A statistical approach to texture classification from single images. IJCV 62: 61\u201381.","journal-title":"IJCV"},{"key":"17_CR28","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1007\/s11263-009-0315-0","volume":"88","author":"M Crosier","year":"2010","unstructured":"Crosier M, Griffin LD (2010) Using basic image features for texture classification. IJCV 88: 447\u2013460.","journal-title":"IJCV"},{"key":"17_CR29","first-page":"37","volume-title":"The 3rd IEEE Pacific-Rim Symposium on Image and Video Technology","author":"T Watanabe","year":"2009","unstructured":"Watanabe T, Ito S, Yokoi K (2009) Co-occurrence histograms of oriented gradients for pedestrian detection In: The 3rd IEEE Pacific-Rim Symposium on Image and Video Technology, 37\u2013447.. IEEE, New York."},{"key":"17_CR30","first-page":"346","volume":"5302","author":"T Kobayashi","year":"2008","unstructured":"Kobayashi T, Otsu N (2008) Image feature extraction using gradient local auto-correlations. ECCV2008 5302: 346\u2013358.","journal-title":"ECCV2008"},{"key":"17_CR31","doi-asserted-by":"publisher","first-page":"1257","DOI":"10.1109\/TPAMI.2007.70767","volume":"30","author":"T Mita","year":"2008","unstructured":"Mita T, Kaneko T, Stenger B, Hori O (2008) Discriminative feature co-occurrence selection for object detection. IEEE Trans Pattern Anal Mach Intell 30: 1257\u20131268.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"3","key":"17_CR32","first-page":"331","volume":"53","author":"JJ Shen","year":"2006","unstructured":"Shen JJ, Jung Y-M (2006) Weberized Mumford\u2013Shah model with Bose-Einstein photon noise. IJCV 53(3): 331\u2013358.","journal-title":"IJCV"},{"key":"17_CR33","volume-title":"Textures: a photographic album for artists and designers","author":"P Brodatz","year":"1966","unstructured":"Brodatz P (1966) Textures: a photographic album for artists and designers. Dover Publications, New York."},{"key":"17_CR34","volume-title":"the Proceedings of the 10th International Conference on Computer Vision","author":"B Caputo","year":"2005","unstructured":"Caputo B, Hayman E, Mallikarjuna P (2005) Class-specific material categorisation In: the Proceedings of the 10th International Conference on Computer Vision.. IEEE, New York."},{"issue":"3","key":"17_CR35","doi-asserted-by":"publisher","first-page":"727","DOI":"10.1016\/S0031-3203(00)00010-8","volume":"34","author":"T Ojala","year":"2001","unstructured":"Ojala T, Valkealahti K, Oja E, Pietikainen M (2001) Texture discrimination with multidimensional distributions of signed gray level differences. Pattern Recogn 34(3): 727\u2013739.","journal-title":"Pattern Recogn"},{"key":"17_CR36","doi-asserted-by":"publisher","first-page":"1705","DOI":"10.1109\/TPAMI.2009.155","volume":"32","author":"J Chen","year":"2010","unstructured":"Chen J, Shan S, He C, Zhao G, Pietikainen M, Chen X, Gao W (2010) WLD: a robust local image descriptor. PAMI 32: 1705\u20131720.","journal-title":"PAMI"},{"key":"17_CR37","volume-title":"Local higher-order statistics (LHS) for texture categorization and facial analysis. ECCV","author":"G Sharma","year":"2012","unstructured":"Sharma G, Hussain S, Jurie F (2012) Local higher-order statistics (LHS) for texture categorization and facial analysis. ECCV. Springer, Berlin. Lecture Notes in Computer Science, vol 7578. pp.1\u201312."},{"key":"17_CR38","first-page":"289","volume-title":"The 16th IEEE international conference on Image processing","author":"M Chen","year":"2009","unstructured":"Chen M, Dhingra K, Wu W, Yang L, Sukthankar R, Yang J (2009) PFID: Pittsburgh Fast-Food Image Dataset In: The 16th IEEE international conference on Image processing, 289\u2013292.. IEEE, New York."},{"key":"17_CR39","volume-title":"Food recognition using statistics of pairwise local features. Proc. IEEE Int Conf Comput Vision","author":"SL Yang","year":"2010","unstructured":"Yang SL, Chen M, Pomerleau D, Sukthankar R (2010) Food recognition using statistics of pairwise local features. Proc. IEEE Int Conf Comput Vision. IEEE, New York. pp. 2246\u20132256."},{"issue":"5","key":"17_CR40","doi-asserted-by":"publisher","first-page":"901","DOI":"10.1016\/j.patcog.2003.09.009","volume":"37","author":"AC Jalba","year":"2004","unstructured":"Jalba AC, Wilkinson MHF, Roerdink JBTM (2004) Morphological hat-transform scale spaces and their use in pattern classification. Pattern Recogn 37(5): 901\u2013905.","journal-title":"Pattern Recogn"},{"issue":"2","key":"17_CR41","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1109\/TPAMI.2007.28","volume":"29","author":"ER Urbach","year":"2007","unstructured":"Urbach ER, Roerdink JBTM, Wilkinson MHF (2007) Connected shape-size pattern spectra for rotation and scale-invariant classification of gray-scale images. IEEE Trans Pattern Anal Mach Intell 29(2): 272\u2013285.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"8","key":"17_CR42","doi-asserted-by":"publisher","first-page":"837","DOI":"10.1109\/34.531803","volume":"18","author":"B Manjunath","year":"1996","unstructured":"Manjunath B, Ma W (1996) Texture features for browsing and retrieval of image data. IEEE Trans Pattern Anal Mach Intell 18(8): 837\u2013842.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"5","key":"17_CR43","first-page":"1184","volume":"4","author":"T Leung","year":"2013","unstructured":"Leung T, Malik J (2013) Effects of image retrieval from image database using linear Kernel and Hellinger Kernel mapping of SVM. Int J Sci Eng Res 4(5): 1184\u20131190.","journal-title":"Int J Sci Eng Res"},{"key":"17_CR44","doi-asserted-by":"crossref","unstructured":"Han X-H, Chen Y-W (2011) Biomedical imaging modality classification using combined visual features and textual terms. Int J Biomed Imaging 2011.","DOI":"10.1155\/2011\/241396"},{"issue":"3","key":"17_CR45","doi-asserted-by":"publisher","first-page":"1314","DOI":"10.1109\/TIP.2011.2168417","volume":"21","author":"X-H Han","year":"2012","unstructured":"Han X-H, Chen Y-W, Ruan X (2012) Multilinear supervised neighborhood embedding of local descriptor tensor for scene\/object recognition. IEEE Trans Image Process 21(3): 1314\u20131326.","journal-title":"IEEE Trans Image Process"}],"container-title":["IPSJ Transactions on Computer Vision and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41074-017-0017-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s41074-017-0017-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41074-017-0017-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T11:49:25Z","timestamp":1627645765000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s41074-017-0017-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,3,14]]},"references-count":45,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2017,12]]}},"alternative-id":["17"],"URL":"https:\/\/doi.org\/10.1186\/s41074-017-0017-4","relation":{},"ISSN":["1882-6695"],"issn-type":[{"type":"electronic","value":"1882-6695"}],"subject":[],"published":{"date-parts":[[2017,3,14]]},"assertion":[{"value":"16 April 2016","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 March 2017","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 March 2017","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"4"}}