{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T22:09:29Z","timestamp":1740175769643,"version":"3.37.3"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T00:00:00Z","timestamp":1698624000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T00:00:00Z","timestamp":1698624000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62102368"],"award-info":[{"award-number":["62102368"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Joint Construction Project for Medical Science and Technology of Henan Province","award":["LHGJ20200318","62206251"],"award-info":[{"award-number":["LHGJ20200318","62206251"]}]},{"name":"Joint Construction Project for Medical Science and Technology of Henan Province","award":["LHGJ20220431"],"award-info":[{"award-number":["LHGJ20220431"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Social image data refer to the annotated image with tags in social media, in which the tags are always labeled by users. Integrating the visual and textual information of social image can obtain accurate and comprehensive feature and improve clustering performance. However, the heterogeneous gap between tags and images makes it difficult to reasonably organize the social images. In addition, the tags are often sparse and incomplete due to personal preference and cognition differences of users. To solve these problems, we propose a novel knowledge-aware progressive clustering (KAPC) method, which employs human knowledge to guide the cross-modal clustering of social images. Firstly, we design a dual-similarity semantic expansion strategy to complement the sparse tags with human knowledge, which constructs a more complete semantic similarity matrix for tags through knowledge graphs. Secondly, we define an objective function based on information theory to bridge the heterogeneous gap, which align inter-modal cluster distribution to explore the correlation between visual and textual information. Finally, a progressive iteration method is designed to make the two modalities guide each other and obtain better performance of social image clustering. Extensive experiments on four social image datasets verify the effectiveness of the proposed KAPC method.<\/jats:p>","DOI":"10.1007\/s40747-023-01267-1","type":"journal-article","created":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T03:01:32Z","timestamp":1698634892000},"page":"2173-2185","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Knowledge-aware progressive clustering for social image"],"prefix":"10.1007","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5864-6160","authenticated-orcid":false,"given":"Mingyuan","family":"Li","sequence":"first","affiliation":[]},{"given":"Yadong","family":"Dong","sequence":"additional","affiliation":[]},{"given":"Dongqing","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Xiaoqiang","family":"Yan","sequence":"additional","affiliation":[]},{"given":"Caitong","family":"Yue","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2116-9545","authenticated-orcid":false,"given":"Xiangyang","family":"Ren","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,10,30]]},"reference":[{"issue":"9","key":"1267_CR1","doi-asserted-by":"publisher","first-page":"2070","DOI":"10.1109\/TPAMI.2018.2852750","volume":"41","author":"Z Li","year":"2019","unstructured":"Li Z, Tang J, Mei T (2019) Deep collaborative embedding for social image understanding. IEEE Trans Pattern Anal Mach Intell 41(9):2070\u20132083","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"1267_CR2","doi-asserted-by":"crossref","unstructured":"Zhang J, Wu Q, Zhang J, Shen C, Lu J (2018) Kill two birds with one stone: weakly-supervised neural network for image annotation and tag refinement. In: The AAAI Conference on Artificial Intelligence, pp 7550\u20137557","DOI":"10.1609\/aaai.v32i1.12261"},{"key":"1267_CR3","doi-asserted-by":"crossref","unstructured":"Guo J, Ye J (2019) Anchors bring ease: an embarrassingly simple approach to partial multi-view clustering. In: The AAAI Conference on Artificial Intelligence, pp 118\u2013125","DOI":"10.1609\/aaai.v33i01.3301118"},{"key":"1267_CR4","doi-asserted-by":"crossref","unstructured":"Zhang Z, Liu L, Qin J, Zhu F, Shen F, Xu Y, Shao L, Tao\u00a0Shen H (2018) Highly-economized multi-view binary compression for scalable image clustering. In: The European Conference on Computer Vision, pp 731\u2013748","DOI":"10.1007\/978-3-030-01258-8_44"},{"issue":"7","key":"1267_CR5","doi-asserted-by":"publisher","first-page":"1774","DOI":"10.1109\/TPAMI.2018.2847335","volume":"41","author":"Z Zhang","year":"2019","unstructured":"Zhang Z, Liu L, Shen F, Shen HT, Shao L (2019) Binary multi-view clustering. IEEE Trans Pattern Anal Mach Intell 41(7):1774\u20131782","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"1267_CR6","doi-asserted-by":"crossref","unstructured":"Luo S, Zhang C, Zhang W, Cao X (2018) Consistent and specific multi-view subspace clustering. In: The AAAI Conference on Artificial Intelligence, pp 3730\u20133737","DOI":"10.1609\/aaai.v32i1.11617"},{"key":"1267_CR7","doi-asserted-by":"crossref","unstructured":"Xu J, Tang H, Ren Y, Peng L, Zhu X, He L (2022) Multi-level feature learning for contrastive multi-view clustering. In: IEEE Conference on Computer Vision and Pattern Recognition, pp 16030\u201316039","DOI":"10.1109\/CVPR52688.2022.01558"},{"key":"1267_CR8","unstructured":"Kumar A, Rai P, III HD (2011) Co-regularized multi-view spectral clustering. In: Advances in Neural Information Processing Systems, pp 1413\u20131421"},{"key":"1267_CR9","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1016\/j.inffus.2017.12.002","volume":"44","author":"L Houthuys","year":"2018","unstructured":"Houthuys L, Langone R, Suykens JAK (2018) Multi-view kernel spectral clustering. Inform Fusion 44:46\u201356","journal-title":"Inform Fusion"},{"issue":"10","key":"1267_CR10","doi-asserted-by":"publisher","first-page":"5147","DOI":"10.1109\/TIP.2019.2913096","volume":"28","author":"Z Yang","year":"2019","unstructured":"Yang Z, Xu Q, Zhang W, Cao X, Huang Q (2019) Split multiplicative multi-view subspace clustering. IEEE Trans Image Process 28(10):5147\u20135160","journal-title":"IEEE Trans Image Process"},{"key":"1267_CR11","doi-asserted-by":"crossref","unstructured":"Xu J, Ren Y, Tang H, Yang Z, Pan L, Yang Y, Pu X, Yu PS, He L (2022) Self-supervised discriminative feature learning for deep multi-view clustering. IEEE Transactions on Knowledge and Data Engineering, pp 1\u201312","DOI":"10.1109\/TKDE.2022.3193569"},{"key":"1267_CR12","doi-asserted-by":"crossref","unstructured":"Yan X, Mao Y, Ye Y, Yu H (2023) Cross-modal clustering with deep correlated information bottleneck method. IEEE Transactions on Neural Networks and Learning Systems Early access, pp 1\u201315","DOI":"10.1109\/TNNLS.2023.3269789"},{"issue":"6","key":"1267_CR13","doi-asserted-by":"publisher","first-page":"3974","DOI":"10.1109\/TII.2019.2939278","volume":"16","author":"X Yan","year":"2020","unstructured":"Yan X, Ye Y, Qiu X, Manic M, Yu H (2020) CMIB: unsupervised image object categorization in multiple visual contexts. IEEE Trans Indus Inf 16(6):3974\u20133986","journal-title":"IEEE Trans Indus Inf"},{"key":"1267_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.ins.2022.01.065","volume":"593","author":"X Yan","year":"2022","unstructured":"Yan X, Mao Y, Ye Y, Yu H, Wang F (2022) Explanation guided cross-modal social image clustering. Inf Sci 593:1\u201316","journal-title":"Inf Sci"},{"key":"1267_CR15","doi-asserted-by":"crossref","unstructured":"You C, Robinson DP, Vidal R (2016) Scalable sparse subspace clustering by orthogonal matching pursuit. In: IEEE Conference on Computer Vision and Pattern Recognition, pp 3918\u20133927","DOI":"10.1109\/CVPR.2016.425"},{"key":"1267_CR16","doi-asserted-by":"crossref","unstructured":"Mao Y, Yan X, Guo Q, Ye Y (2021) Deep mutual information maximin for cross-modal clustering. In: The AAAI Conference on Artificial Intelligence, pp 8893\u20138901","DOI":"10.1609\/aaai.v35i10.17076"},{"key":"1267_CR17","unstructured":"Yan X, Mao Y, Li M, Ye Y, Yu H (2023) Multitask image clustering via deep information bottleneck. IEEE Transactions on Cybernetics Early access, pp 1\u201314"},{"key":"1267_CR18","doi-asserted-by":"crossref","unstructured":"Chen X, Chen M, Shi W, Sun Y (2019) Embedding uncertain knowledge graphs. In: The AAAI Conference on Artificial Intelligence, pp 3363\u20133370","DOI":"10.1609\/aaai.v33i01.33013363"},{"key":"1267_CR19","doi-asserted-by":"crossref","unstructured":"Lee C, Fang W, Yeh C, Wang YF (2018) Multi-label zero-shot learning with structured knowledge graphs. In: IEEE Conference on Computer Vision and Pattern Recognition, pp 1576\u20131585","DOI":"10.1109\/CVPR.2018.00170"},{"key":"1267_CR20","unstructured":"Devlin J, Chang M, Lee K, Toutanova K (2018) BERT: pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805"},{"key":"1267_CR21","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.knosys.2018.10.008","volume":"164","author":"N Guan","year":"2019","unstructured":"Guan N, Song D, Liao L (2019) Knowledge graph embedding with concepts. Knowl Based Syst 164:38\u201344","journal-title":"Knowl Based Syst"},{"key":"1267_CR22","doi-asserted-by":"crossref","unstructured":"Huang D, Wang C-D, Lai J-H (2018) Locally weighted ensemble clustering. IEEE Transactions on Cybernetics, pp 1460\u20131473","DOI":"10.1109\/TCYB.2017.2702343"},{"issue":"10","key":"1267_CR23","doi-asserted-by":"publisher","first-page":"5076","DOI":"10.1109\/TIP.2018.2848470","volume":"27","author":"X Peng","year":"2018","unstructured":"Peng X, Feng J, Xiao S, Yau W, Zhou JT, Yang S (2018) Structured autoencoders for subspace clustering. IEEE Trans Image Process 27(10):5076\u20135086","journal-title":"IEEE Trans Image Process"},{"issue":"8","key":"1267_CR24","doi-asserted-by":"publisher","first-page":"2027","DOI":"10.1109\/TPAMI.2019.2906603","volume":"41","author":"J Tang","year":"2019","unstructured":"Tang J, Shu X, Li Z, Jiang Y, Tian Q (2019) Social anchor-unit graph regularized tensor completion for large-scale image retagging. IEEE Trans Pattern Anal Mach Intell 41(8):2027\u20132034","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"1","key":"1267_CR25","doi-asserted-by":"publisher","first-page":"276","DOI":"10.1109\/TIP.2016.2624140","volume":"26","author":"Z Li","year":"2017","unstructured":"Li Z, Tang J (2017) Weakly supervised deep matrix factorization for social image understanding. IEEE Trans Image Process 26(1):276\u2013288","journal-title":"IEEE Trans Image Process"},{"key":"1267_CR26","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/7287.001.0001","volume-title":"WordNet: an electronic lexical database","author":"C Fellbaum","year":"1998","unstructured":"Fellbaum C, Miller GA (1998) WordNet: an electronic lexical database. MIT Press, Cambridge"},{"issue":"4","key":"1267_CR27","doi-asserted-by":"publisher","first-page":"661","DOI":"10.1007\/s13198-019-00794-w","volume":"10","author":"PS Kumar","year":"2019","unstructured":"Kumar PS (2019) Intuitionistic fuzzy solid assignment problems: a software-based approach. Int J Syst Assur Eng Manage 10(4):661\u2013675","journal-title":"Int J Syst Assur Eng Manage"},{"issue":"4","key":"1267_CR28","first-page":"62","volume":"7","author":"PS Kumar","year":"2018","unstructured":"Kumar PS (2018) Psk method for solving intuitionistic fuzzy solid transportation problems. Int J Fuzzy Syst Appl (IJFSA) 7(4):62\u201399","journal-title":"Int J Fuzzy Syst Appl (IJFSA)"},{"issue":"4","key":"1267_CR29","doi-asserted-by":"publisher","first-page":"225","DOI":"10.5391\/IJFIS.2016.16.4.225","volume":"16","author":"PS Kumar","year":"2016","unstructured":"Kumar PS (2016) A simple method for solving type-2 and type-4 fuzzy transportation problems. Int J Fuzzy Logic Intell Syst 16(4):225\u2013237","journal-title":"Int J Fuzzy Logic Intell Syst"},{"issue":"1","key":"1267_CR30","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1007\/s13198-019-00941-3","volume":"11","author":"PS Kumar","year":"2020","unstructured":"Kumar PS (2020) Algorithms for solving the optimization problems using fuzzy and intuitionistic fuzzy set. Int J Syst Assur Eng Manage 11(1):189\u2013222","journal-title":"Int J Syst Assur Eng Manage"},{"key":"1267_CR31","doi-asserted-by":"crossref","unstructured":"Kumar PS (2022) Computationally simple and efficient method for solving real-life mixed intuitionistic fuzzy 3d assignment problems. Int J Softw Sci Comput Intell (IJSSCI) 14(1):1\u201342","DOI":"10.4018\/IJSSCI.291715"},{"key":"1267_CR32","doi-asserted-by":"crossref","unstructured":"Kumar PS (2020) Developing a new approach to solve solid assignment problems under intuitionistic fuzzy environment. Int J Fuzzy Syst Appl (IJFSA) 9(1):1\u201334","DOI":"10.4018\/IJFSA.2020010101"},{"issue":"1","key":"1267_CR33","first-page":"102","volume":"29","author":"PS Kumar","year":"2018","unstructured":"Kumar PS (2018) A note on a new approach for solving intuitionistic fuzzy transportation problem of type-2. Int J Logist Syst Manage 29(1):102\u2013129","journal-title":"Int J Logist Syst Manage"},{"key":"1267_CR34","doi-asserted-by":"crossref","unstructured":"Kumar PS (2020) Intuitionistic fuzzy zero point method for solving type-2 intuitionistic fuzzy transportation problem. Int J Oper Res 37(3):418\u2013451","DOI":"10.1504\/IJOR.2020.10027072"},{"key":"1267_CR35","doi-asserted-by":"crossref","unstructured":"Slonim N, Friedman N, Tishby N (2002) Unsupervised document classification using sequential information maximization. In: Tthe International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR.ACM, pp 129\u2013136","DOI":"10.1145\/564376.564401"},{"key":"1267_CR36","volume-title":"Elements of information theory","author":"TM Cover","year":"2012","unstructured":"Cover TM, Thomas JA (2012) Elements of information theory. Wiley, New York"},{"key":"1267_CR37","doi-asserted-by":"crossref","unstructured":"Chua T-S, Tang J, Hong R, Li H, Luo Z, Zheng Y (2009) Nus-wide: A real-world web image database from national university of Singapore. In: The ACM International Conference on Image and Video Retrieval, CIVR.ACM, pp 48\u20131489","DOI":"10.1145\/1646396.1646452"},{"key":"1267_CR38","unstructured":"Michael G, Paul C, Henning M, Deselaers T (2006) The iapr tc-12 benchmark: a new evaluation resource for visual information systems. In: The International Conference on Language Resources and Evaluation, pp 13\u201323"},{"key":"1267_CR39","doi-asserted-by":"crossref","unstructured":"Huiskes MJ, Lew MS (2008) The mir flickr retrieval evaluation. In: The 11th ACM SIGMM International Conference on Multimedia Information Retrieval, MIR.ACM, pp 39\u201343","DOI":"10.1145\/1460096.1460104"},{"key":"1267_CR40","doi-asserted-by":"crossref","unstructured":"Ahn L, Dabbish L (2004) Labeling images with a computer game. In: The Conference on Human Factors in Computing Systems, CHI, pp 319\u2013326","DOI":"10.1145\/985692.985733"},{"key":"1267_CR41","first-page":"583","volume":"3","author":"A Strehl","year":"2002","unstructured":"Strehl A, Ghosh J (2002) Cluster ensembles\u2014a knowledge reuse framework for combining multiple partitions. J Mach Learn Res 3:583\u2013617","journal-title":"J Mach Learn Res"},{"key":"1267_CR42","doi-asserted-by":"crossref","unstructured":"Huang D, Lai J-H, Wang C-D (2016) Robust ensemble clustering using probability trajectories. IEEE Transactions on Knowledge and Data Engineering, pp 1312\u20131326","DOI":"10.1109\/TKDE.2015.2503753"},{"key":"1267_CR43","doi-asserted-by":"crossref","unstructured":"Lau JH, Baldwin T (2016) An empirical evaluation of doc2vec with practical insights into document embedding generation. In: Rep4NLP@ACL, pp 78\u201386","DOI":"10.18653\/v1\/W16-1609"},{"key":"1267_CR44","unstructured":"Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp 3111\u20133119"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01267-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-023-01267-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01267-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,30]],"date-time":"2024-03-30T15:25:48Z","timestamp":1711812348000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-023-01267-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,30]]},"references-count":44,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,4]]}},"alternative-id":["1267"],"URL":"https:\/\/doi.org\/10.1007\/s40747-023-01267-1","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"type":"print","value":"2199-4536"},{"type":"electronic","value":"2198-6053"}],"subject":[],"published":{"date-parts":[[2023,10,30]]},"assertion":[{"value":"18 June 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 October 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}