{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T14:49:44Z","timestamp":1776350984087,"version":"3.51.2"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,4,8]],"date-time":"2021-04-08T00:00:00Z","timestamp":1617840000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Innovation Group Project of the National Natural Science Foundation of China","award":["61821003"],"award-info":[{"award-number":["61821003"]}]},{"name":"National Key Research and Development Program of China","award":["2016YFB0800402"],"award-info":[{"award-number":["2016YFB0800402"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61902135"],"award-info":[{"award-number":["61902135"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM\/IMS Trans. Data Sci."],"published-print":{"date-parts":[[2021,5,31]]},"abstract":"<jats:p>Data mining can hardly solve but always faces a problem that there is little meaningful information within the dataset serving a given requirement. Faced with multiple unknown datasets, to allocate data mining resources to acquire more desired data, it is necessary to establish a data quality assessment framework based on the relevance between the dataset and requirements. This framework can help the user to judge the potential benefits in advance, so as to optimize the resource allocation to those candidates. However, the unstructured data (e.g., image data) often presents dark data states, which makes it tricky for the user to understand the relevance based on content of the dataset in real time. Even if all data have label descriptions, how to measure the relevance between data efficiently under semantic propagation remains an urgent problem. Based on this, we propose a Deep Hash-based Relevance-aware Data Quality Assessment framework, which contains off-line learning and relevance mining parts as well as an on-line assessing part. In the off-line part, we first design a Graph Convolution Network (GCN)-AutoEncoder hash (GAH) algorithm to recognize the data (i.e., lighten the dark data), then construct a graph with restricted Hamming distance, and finally design a Cluster PageRank (CPR) algorithm to calculate the importance score for each node (image) so as to obtain the relevance representation based on semantic propagation. In the on-line part, we first retrieve the importance score by hash codes and then quickly get the assessment conclusion in the importance list. On the one hand, the introduction of GCN and co-occurrence probability in the GAH promotes the perception ability for dark data. On the other hand, the design of CPR utilizes hash collision to reduce the scale of graph and iteration matrix, which greatly decreases the consumption of space and computing resources. We conduct extensive experiments on both single-label and multi-label datasets to assess the relevance between data and requirements as well as test the resources allocation. Experimental results show our framework can gain the most desired data with the same mining resources. Besides, the test results on Tencent1M dataset demonstrate the framework can complete the assessment with a stability for given different requirements.<\/jats:p>","DOI":"10.1145\/3420038","type":"journal-article","created":{"date-parts":[[2021,4,8]],"date-time":"2021-04-08T16:54:59Z","timestamp":1617900899000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Deep Hash-based Relevance-aware Data Quality Assessment for Image Dark Data"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1964-9278","authenticated-orcid":false,"given":"Yu","family":"Liu","sequence":"first","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yangtao","family":"Wang","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lianli","family":"Gao","sequence":"additional","affiliation":[{"name":"University of Electronic Science and Technology of China, Chengdu, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chan","family":"Guo","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanzhao","family":"Xie","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhili","family":"Xiao","sequence":"additional","affiliation":[{"name":"Tencent Inc., Shenzhen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,4,8]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2018.07.014"},{"key":"e_1_2_1_2_1","doi-asserted-by":"crossref","unstructured":"Michael J. Cafarella Ihab F. Ilyas Marcel Kornacker Tim Kraska and Christopher R\u00e9. 2016. Dark data: Are we solving the right problems? In ICDE. 1444\u20131445.","DOI":"10.1109\/ICDE.2016.7498366"},{"key":"e_1_2_1_3_1","volume-title":"The challenges of data quality and data quality assessment in the big data era. Data Sci. J. 14","author":"Cai Li","year":"2015","unstructured":"Li Cai and Yangyong Zhu. 2015. The challenges of data quality and data quality assessment in the big data era. Data Sci. J. 14 (2015), 2."},{"key":"e_1_2_1_4_1","doi-asserted-by":"crossref","unstructured":"Yue Cao Mingsheng Long Bin Liu and Jianmin Wang. 2018. Deep cauchy hashing for hamming space retrieval. In CVPR. 1229\u20131237.","DOI":"10.1109\/CVPR.2018.00134"},{"key":"e_1_2_1_5_1","unstructured":"Zhao-Min Chen Xiu-Shen Wei Peng Wang and Yanwen Guo. 2019. Multi-label image recognition with graph convolutional networks. In CVPR. 5177\u20135186."},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Yueqi Duan Ziwei Wang Jiwen Lu Xudong Lin and Jie Zhou. 2018. GraphBit: Bitwise interaction mining via deep reinforcement learning. In CVPR. 8270\u20138279.","DOI":"10.1109\/CVPR.2018.00863"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-009-0275-4"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","unstructured":"Lianli Gao Xiaosu Zhu Jingkuan Song Zhou Zhao and Heng Tao Shen. 2019. Beyond product quantization: Deep progressive quantization for image retrieval. In IJCAI. 723\u2013729. 10.5555\/3367032.3367136","DOI":"10.5555\/3367032.3367136"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","unstructured":"Tao He Yuan-Fang Li Lianli Gao Dongxiang Zhang and Jingkuan Song. 2019. One network for multi-domains: Domain adaptive hashing with intersectant generative adversarial networks. In IJCAI. 2477\u20132483. 10.5555\/3367243.3367384","DOI":"10.5555\/3367243.3367384"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1353\/lib.0.0036"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2839522"},{"key":"e_1_2_1_12_1","first-page":"159","article-title":"Developing a framework for assessing information quality on the world wide web","volume":"8","author":"Janice Burn Knight","year":"2005","unstructured":"Shirlee-ann Knight and Janice Burn. 2005. Developing a framework for assessing information quality on the world wide web. Inf. Sci. 8 (2005), 159--172.","journal-title":"Inf. Sci."},{"key":"e_1_2_1_13_1","volume-title":"et\u00a0al","author":"Krizhevsky Alex","year":"2009","unstructured":"Alex Krizhevsky, Geoffrey Hinton, et\u00a0al. 2009. Learning Multiple Layers of Features from Tiny Images. Technical Report. Citeseer."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2016.2545300"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","unstructured":"Yu Lei Wenjie Li Ziyu Lu and Miao Zhao. 2017. Alternating pointwise-pairwise learning for personalized item ranking. In CIKM. 2155\u20132158. 10.1145\/3132847.3133100","DOI":"10.1145\/3132847.3133100"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2020.2965434"},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Yanghao Li Naiyan Wang Jiaying Liu and Xiaodi Hou. 2017. Factorized bilinear models for image recognition. In ICCV. 2098\u20132106.","DOI":"10.1109\/ICCV.2017.229"},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Kevin Lin Jiwen Lu Chu-Song Chen and Jie Zhou. 2016. Learning compact binary descriptors with unsupervised deep neural networks. In CVPR. 1183\u20131192.","DOI":"10.1109\/CVPR.2016.133"},{"key":"e_1_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Tsung-Yi Lin Michael Maire Serge J. Belongie James Hays Pietro Perona Deva Ramanan Piotr Doll\u00e1r and C. Lawrence Zitnick. 2014. Microsoft COCO: Common objects in context. In ECCV. 740\u2013755.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2020.2965992"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2018.2822781"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2019.07.063"},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Yu Liu Yangtao Wang Ke Zhou Yujuan Yang Yifei Liu Jingkuan Song and Zhili Xiao. 2019. A framework for image dark data assessment. In APWeb-WAIM. 3\u201318.","DOI":"10.1007\/978-3-030-26072-9_1"},{"key":"e_1_2_1_24_1","unstructured":"Lawrence Page Sergey Brin Rajeev Motwani and Terry Winograd. 1999. The PageRank Citation Ranking: Bringing Order to the Web. Technical Report. Stanford InfoLab."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2019.2951462"},{"key":"e_1_2_1_26_1","volume-title":"Manning","author":"Pennington Jeffrey","year":"2014","unstructured":"Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. Glove: Global vectors for word representation. In EMNLP. 1532\u20131543."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","unstructured":"Fabian Richter Stefan Romberg Eva H\u00f6rster and Rainer Lienhart. 2010. Multimodal ranking for image search on community databases. In MIR. 63\u201372. 10.1145\/1743384.1743402","DOI":"10.1145\/1743384.1743402"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2810103.2810131"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2017.03.021"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","unstructured":"Jingkuan Song Xiaosu Zhu Lianli Gao Xin-Shun Xu Wu Liu and Heng Tao Shen. 2019. Deep recurrent quantization for generating sequential binary codes. In IJCAI. 912\u2013918. 10.5555\/3367032.3367162","DOI":"10.5555\/3367032.3367162"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2699960"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1080\/07421222.1996.11518099"},{"key":"e_1_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Yangtao Wang Yu Liu Yifei Liu Ke Zhou Yujuan Yang Jiangfeng Zeng Xiaodong Xu and Zhili Xiao. 2019. Analysis and management to hash-based graph and rank. In APWeb-WAIM. 289\u2013296.","DOI":"10.1007\/978-3-030-26072-9_22"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2019.2947197"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2020.2978593"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2020.2963957"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","unstructured":"Ruiqing Xu Chao Li Junchi Yan Cheng Deng and Xianglong Liu. 2019. Graph convolutional network hashing for cross-modal retrieval. In IJCAI. 982\u2013988. 10.5555\/3367032.3367172","DOI":"10.5555\/3367032.3367172"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2020.2977459"},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Erkun Yang Tongliang Liu Cheng Deng Wei Liu and Dacheng Tao. 2019. DistillHash: Unsupervised deep hashing by distilling data pairs. In CVPR. 2946\u20132955.","DOI":"10.1109\/CVPR.2019.00306"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2666812"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","unstructured":"Yang Yang Yadan Luo Weilun Chen Fumin Shen Jie Shao and Heng Tao Shen. 2016. Zero-shot hashing via transferring supervised knowledge. In MM. 1286\u20131295. 10.1145\/2964284.2964319","DOI":"10.1145\/2964284.2964319"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3356338"},{"key":"e_1_2_1_43_1","doi-asserted-by":"crossref","unstructured":"Zhou Yu Jun Yu Jianping Fan and Dacheng Tao. 2017. Multi-modal factorized bilinear pooling with co-attention learning for visual question answering. In ICCV. 1839\u20131848.","DOI":"10.1109\/ICCV.2017.202"},{"key":"e_1_2_1_44_1","doi-asserted-by":"crossref","first-page":"3235","DOI":"10.1109\/TII.2018.2809730","article-title":"Deep learning-based feature representation and its application for soft sensor modeling with variable-wise weighted SAE","volume":"14","author":"Yuan Xiaofeng","year":"2018","unstructured":"Xiaofeng Yuan, Biao Huang, Yalin Wang, Chunhua Yang, and Weihua Gui. 2018. Deep learning-based feature representation and its application for soft sensor modeling with variable-wise weighted SAE. IEEE Trans. Industr. Inf. 14, 7 (2018), 3235\u20133243.","journal-title":"IEEE Trans. Industr. Inf."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","unstructured":"Ce Zhang Vidhya Govindaraju Jackson Borchardt Tim Foltz Christopher R\u00e9 and Shanan Peters. 2013. GeoDeepDive: Statistical inference using familiar data-processing languages. In SIGMOD. 993\u2013996. 10.1145\/2463676.2463680","DOI":"10.1145\/2463676.2463680"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","unstructured":"Ce Zhang Jaeho Shin Christopher R\u00e9 Michael J. Cafarella and Feng Niu. 2016. Extracting databases from dark data with deepdive. In SIGMOD. 847\u2013859. 10.1145\/2882903.2904442","DOI":"10.1145\/2882903.2904442"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2017.2781422"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","unstructured":"Ke Zhou Yu Liu Jingkuan Song Linyu Yan Fuhao Zou and Fumin Shen. 2015. Deep self-taught hashing for image retrieval. In MM. 1215\u20131218. 10.1145\/2733373.2806320","DOI":"10.1145\/2733373.2806320"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11280-020-00779-x"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2018.2883970"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.14778\/2994509.2994534"}],"container-title":["ACM\/IMS Transactions on Data Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3420038","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3420038","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T13:55:37Z","timestamp":1776347737000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3420038"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,8]]},"references-count":51,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,5,31]]}},"alternative-id":["10.1145\/3420038"],"URL":"https:\/\/doi.org\/10.1145\/3420038","relation":{},"ISSN":["2691-1922"],"issn-type":[{"value":"2691-1922","type":"print"}],"subject":[],"published":{"date-parts":[[2021,4,8]]},"assertion":[{"value":"2020-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-08-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}