{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:19:16Z","timestamp":1750220356915,"version":"3.41.0"},"reference-count":68,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,7,20]],"date-time":"2021-07-20T00:00:00Z","timestamp":1626739200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2018YFB1004003"],"award-info":[{"award-number":["2018YFB1004003"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["62025206 and 61972338"],"award-info":[{"award-number":["62025206 and 61972338"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2022,2,28]]},"abstract":"<jats:p>Text classification is a fundamental task in content analysis. Nowadays, deep learning has demonstrated promising performance in text classification compared with shallow models. However, almost all the existing models do not take advantage of the wisdom of human beings to help text classification. Human beings are more intelligent and capable than machine learning models in terms of understanding and capturing the implicit semantic information from text. In this article, we try to take guidance from human beings to classify text. We propose Crowd-powered learning for Text Classification (CrowdTC for short). We design and post the questions on a crowdsourcing platform to extract keywords in text. Sampling and clustering techniques are utilized to reduce the cost of crowdsourcing. Also, we present an attention-based neural network and a hybrid neural network to incorporate the extracted keywords as human guidance into deep neural networks. Extensive experiments on public datasets confirm that CrowdTC improves the text classification accuracy of neural networks by using the crowd-powered keyword guidance.<\/jats:p>","DOI":"10.1145\/3457216","type":"journal-article","created":{"date-parts":[[2021,7,20]],"date-time":"2021-07-20T21:06:18Z","timestamp":1626815178000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["CrowdTC: Crowd-powered Learning for Text Classification"],"prefix":"10.1145","volume":"16","author":[{"given":"Keyu","family":"Yang","sequence":"first","affiliation":[{"name":"Zhejiang University, China"}]},{"given":"Yunjun","family":"Gao","sequence":"additional","affiliation":[{"name":"Zhejiang University, China"}]},{"given":"Lei","family":"Liang","sequence":"additional","affiliation":[{"name":"Zhejiang University, China"}]},{"given":"Song","family":"Bian","sequence":"additional","affiliation":[{"name":"Zhejiang University, China"}]},{"given":"Lu","family":"Chen","sequence":"additional","affiliation":[{"name":"Zhejiang University, China"}]},{"given":"Baihua","family":"Zheng","sequence":"additional","affiliation":[{"name":"Singapore Management University, Singapore"}]}],"member":"320","published-online":{"date-parts":[[2021,7,20]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3380744"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.4018\/IJSWIS.2016070101"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 6th International Joint Conference on Natural Language Processing. 543\u2013551","author":"Bougouin Adrien","year":"2013","unstructured":"Adrien Bougouin , Florian Boudin , and B\u00e9atrice Daille . 2013 . TopicRank: Graph-based topic ranking for keyphrase extraction . In Proceedings of the 6th International Joint Conference on Natural Language Processing. 543\u2013551 . Retrieved from https:\/\/www.aclweb.org\/anthology\/I13-1062\/. Adrien Bougouin, Florian Boudin, and B\u00e9atrice Daille. 2013. TopicRank: Graph-based topic ranking for keyphrase extraction. In Proceedings of the 6th International Joint Conference on Natural Language Processing. 543\u2013551. Retrieved from https:\/\/www.aclweb.org\/anthology\/I13-1062\/."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2019.09.013"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1150"},{"volume-title":"Proceedings of the 3rd Annual Symposium on Document Analysis and Information Retrieval. 161\u2013175","author":"William","key":"e_1_2_1_6_1","unstructured":"William B. Cavnar and John M. Trenkle. 1994. N-gram-based text categorization . In Proceedings of the 3rd Annual Symposium on Document Analysis and Information Retrieval. 161\u2013175 . Retrieved from http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.21.3248&rep=rep1&type=pdf. William B. Cavnar and John M. Trenkle. 1994. N-gram-based text categorization. In Proceedings of the 3rd Annual Symposium on Document Analysis and Information Retrieval. 161\u2013175. Retrieved from http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.21.3248&rep=rep1&type=pdf."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.400568"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-4012"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-1104"},{"key":"e_1_2_1_10_1","first-page":"19","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 4171\u20134186","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of deep bidirectional transformers for language understanding . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 4171\u20134186 . DOI:https:\/\/doi.org\/10.18653\/v1\/n 19 - 1423 10.18653\/v1 Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 4171\u20134186. DOI:https:\/\/doi.org\/10.18653\/v1\/n19-1423"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2008.05.002"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/3001460.3001507"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.14778\/3402755.3402777"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00078"},{"key":"e_1_2_1_15_1","volume-title":"Data Mining: Concepts and Techniques","author":"Han Jiawei","year":"2011","unstructured":"Jiawei Han , Micheline Kamber , and Jian Pei . 2011 . Data Mining: Concepts and Techniques , 3 rd Edition. Morgan Kaufmann . Retrieved from http:\/\/hanj.cs.illinois.edu\/bk3\/. Jiawei Han, Micheline Kamber, and Jian Pei. 2011. Data Mining: Concepts and Techniques, 3rd Edition. Morgan Kaufmann. Retrieved from http:\/\/hanj.cs.illinois.edu\/bk3\/.","edition":"3"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-1119"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2484028.2484140"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1108\/00220410410560573"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1181"},{"volume-title":"Proceedings of the International Conference on Learning Representations.","author":"Diederik","key":"e_1_2_1_21_1","unstructured":"Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization . In Proceedings of the International Conference on Learning Representations. Retrieved from http:\/\/arxiv.org\/abs\/1412.6980. Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of the International Conference on Learning Representations. Retrieved from http:\/\/arxiv.org\/abs\/1412.6980."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.3390\/info10040150"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/2886521.2886636"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2016.2535242"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/3016100.3016157"},{"volume-title":"Attention-based recurrent neural network models for joint intent detection and slot filling","author":"Liu Bing","key":"e_1_2_1_26_1","unstructured":"Bing Liu and Ian Lane . 2016. Attention-based recurrent neural network models for joint intent detection and slot filling . In Interspeech, Nelson Morgan (Ed.). ISCA , 685\u2013689. DOI:https:\/\/doi.org\/10.21437\/Interspeech.2016-1352 10.21437\/Interspeech.2016-1352 Bing Liu and Ian Lane. 2016. Attention-based recurrent neural network models for joint intent detection and slot filling. In Interspeech, Nelson Morgan (Ed.). ISCA, 685\u2013689. DOI:https:\/\/doi.org\/10.21437\/Interspeech.2016-1352"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the 5th Biennial Conference on Innovative Data Systems Research. 211\u2013214","author":"Marcus Adam","year":"2011","unstructured":"Adam Marcus , Eugene Wu , Samuel Madden , and Robert C. Miller . 2011. Crowdsourced databases: Query processing with people . In Proceedings of the 5th Biennial Conference on Innovative Data Systems Research. 211\u2013214 . Retrieved from http:\/\/cidrdb.org\/cidr 2011 \/Papers\/CIDR11_Paper29.pdf. Adam Marcus, Eugene Wu, Samuel Madden, and Robert C. Miller. 2011. Crowdsourced databases: Query processing with people. In Proceedings of the 5th Biennial Conference on Innovative Data Systems Research. 211\u2013214. Retrieved from http:\/\/cidrdb.org\/cidr2011\/Papers\/CIDR11_Paper29.pdf."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/1699648.1699678"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.30"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1054"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380278"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3271737"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33016826"},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. 9006\u20139017","author":"Meng Yu","year":"2020","unstructured":"Yu Meng , Yunyi Zhang , Jiaxin Huang , Chenyan Xiong , Heng Ji , Chao Zhang , and Jiawei Han . 2020 . Text classification using label names only: A language model self-training approach . In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. 9006\u20139017 . DOI:https:\/\/doi.org\/10.18653\/v1\/2020.emnlp-main.724 10.18653\/v1 Yu Meng, Yunyi Zhang, Jiaxin Huang, Chenyan Xiong, Heng Ji, Chao Zhang, and Jiawei Han. 2020. Text classification using label names only: A language model self-training approach. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. 9006\u20139017. DOI:https:\/\/doi.org\/10.18653\/v1\/2020.emnlp-main.724"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing. 404\u2013411","author":"Mihalcea Rada","year":"2004","unstructured":"Rada Mihalcea and Paul Tarau . 2004 . TextRank: Bringing order into text . In Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing. 404\u2013411 . Retrieved from https:\/\/www.aclweb.org\/anthology\/W04-3252\/. Rada Mihalcea and Paul Tarau. 2004. TextRank: Bringing order into text. In Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing. 404\u2013411. Retrieved from https:\/\/www.aclweb.org\/anthology\/W04-3252\/."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3439726"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.14778\/2735471.2735474"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/1780653.1780707"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.3115\/1118693.1118704"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1002\/widm.1339"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.14778\/2367502.2367555"},{"key":"e_1_2_1_42_1","first-page":"14","volume-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. 1532\u20131543","author":"Pennington Jeffrey","unstructured":"Jeffrey Pennington , Richard Socher , and Christopher D. Manning . 2014. Glove: Global vectors for word representation . In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. 1532\u20131543 . DOI:https:\/\/doi.org\/10.3115\/v1\/d 14 - 1162 10.3115\/v1 Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. 1532\u20131543. DOI:https:\/\/doi.org\/10.3115\/v1\/d14-1162"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics ACL Short Papers. 866\u2013872","author":"Post Matt","year":"2013","unstructured":"Matt Post and Shane Bergsma . 2013 . Explicit and implicit syntactic features for text classification . In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics ACL Short Papers. 866\u2013872 . Retrieved from https:\/\/www.aclweb.org\/anthology\/P13-2150\/. Matt Post and Shane Bergsma. 2013. Explicit and implicit syntactic features for text classification. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics ACL Short Papers. 866\u2013872. Retrieved from https:\/\/www.aclweb.org\/anthology\/P13-2150\/."},{"key":"e_1_2_1_44_1","unstructured":"Chao Qiao Bo Huang Guocheng Niu Daren Li Daxiang Dong Wei He Dianhai Yu and Hua Wu. 2018. A new method of region embedding for text classification. In ICLR. Retrieved from https:\/\/openreview.net\/forum?id=BkSDMA36Z.  Chao Qiao Bo Huang Guocheng Niu Daren Li Daxiang Dong Wei He Dianhai Yu and Hua Wu. 2018. A new method of region embedding for text classification. In ICLR. Retrieved from https:\/\/openreview.net\/forum?id=BkSDMA36Z."},{"key":"e_1_2_1_45_1","first-page":"627","article-title":"An improved model of semantic similarity based on lexical co-occurrence","volume":"8","author":"Rohde Douglas LT","year":"2006","unstructured":"Douglas LT Rohde , Laura M Gonnerman , and David C Plaut . 2006 . An improved model of semantic similarity based on lexical co-occurrence . Commun. ACM 8 , 627 - 633 (2006), 116. Retrieved from http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.131.9401&rep=rep1&type=pdf. Douglas LT Rohde, Laura M Gonnerman, and David C Plaut. 2006. An improved model of semantic similarity based on lexical co-occurrence. Commun. ACM 8, 627-633 (2006), 116. Retrieved from http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.131.9401&rep=rep1&type=pdf.","journal-title":"Commun. ACM"},{"key":"e_1_2_1_46_1","first-page":"1","article-title":"Automatic keyword extraction from individual documents","volume":"1","author":"Rose Stuart","year":"2010","unstructured":"Stuart Rose , Dave Engel , Nick Cramer , and Wendy Cowley . 2010 . Automatic keyword extraction from individual documents . Text Mining: Applications and Theory 1 (2010), 1 \u2013 20 . Stuart Rose, Dave Engel, Nick Cramer, and Wendy Cowley. 2010. Automatic keyword extraction from individual documents. Text Mining: Applications and Theory 1 (2010), 1\u201320.","journal-title":"Text Mining: Applications and Theory"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.868688"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.5555\/2892753.2892772"},{"key":"#cr-split#-e_1_2_1_49_1.1","doi-asserted-by":"crossref","unstructured":"Chi Sun Xipeng Qiu Yige Xu and Xuanjing Huang. 2019. How to fine-tune BERT for text classification? In CCL. 194-206. DOI:https:\/\/doi.org\/10.1007\/978-3-030-32381-3_16 10.1007\/978-3-030-32381-3_16","DOI":"10.1007\/978-3-030-32381-3_16"},{"key":"#cr-split#-e_1_2_1_49_1.2","doi-asserted-by":"crossref","unstructured":"Chi Sun Xipeng Qiu Yige Xu and Xuanjing Huang. 2019. How to fine-tune BERT for text classification? In CCL. 194-206. DOI:https:\/\/doi.org\/10.1007\/978-3-030-32381-3_16","DOI":"10.1007\/978-3-030-32381-3_16"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1167"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732977.2732982"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143967"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.5555\/1620163.1620205"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1215"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1216"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-2037"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2723739"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2010.5543189"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/313238.313437"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.585893"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3014812.3014815"},{"key":"e_1_2_1_62_1","unstructured":"Yijun Xiao and Kyunghyun Cho. 2016. Efficient character-level document classification by combining convolution and recurrent layers. arxiv:1602.00367 Retrieved from http:\/\/arxiv.org\/abs\/1602.00367.  Yijun Xiao and Kyunghyun Cho. 2016. Efficient character-level document classification by combining convolution and recurrent layers. arxiv:1602.00367 Retrieved from http:\/\/arxiv.org\/abs\/1602.00367."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3454804"},{"key":"e_1_2_1_64_1","first-page":"16","volume-title":"Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies NAACL\u2013HLT. 1480\u20131489","author":"Yang Zichao","year":"1865","unstructured":"Zichao Yang , Diyi Yang , Chris Dyer , Xiaodong He , Alexander J. Smola , and Eduard H. Hovy . 2016. Hierarchical attention networks for document classification . In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies NAACL\u2013HLT. 1480\u20131489 . DOI:https:\/\/doi.org\/10. 1865 3\/v1\/n 16 - 1174 10.18653\/v1 Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alexander J. Smola, and Eduard H. Hovy. 2016. Hierarchical attention networks for document classification. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies NAACL\u2013HLT. 1480\u20131489. DOI:https:\/\/doi.org\/10.18653\/v1\/n16-1174"},{"key":"e_1_2_1_65_1","unstructured":"Wenpeng Yin Katharina Kann Mo Yu and Hinrich Sch\u00fctze. 2017. Comparative study of CNN and RNN for natural language processing. arxiv:1702.01923 Retrieved from http:\/\/arxiv.org\/abs\/1702.01923.  Wenpeng Yin Katharina Kann Mo Yu and Hinrich Sch\u00fctze. 2017. Comparative study of CNN and RNN for natural language processing. arxiv:1702.01923 Retrieved from http:\/\/arxiv.org\/abs\/1702.01923."},{"key":"e_1_2_1_66_1","unstructured":"Dani Yogatama Chris Dyer Wang Ling and Phil Blunsom. 2017. Generative and discriminative text classification with recurrent neural networks. arxiv:1703.01898 Retrieved from http:\/\/arxiv.org\/abs\/1703.01898.  Dani Yogatama Chris Dyer Wang Ling and Phil Blunsom. 2017. Generative and discriminative text classification with recurrent neural networks. arxiv:1703.01898 Retrieved from http:\/\/arxiv.org\/abs\/1703.01898."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.5555\/2969239.2969312"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3457216","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3457216","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:19Z","timestamp":1750191439000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3457216"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,20]]},"references-count":68,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,2,28]]}},"alternative-id":["10.1145\/3457216"],"URL":"https:\/\/doi.org\/10.1145\/3457216","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"type":"print","value":"1556-4681"},{"type":"electronic","value":"1556-472X"}],"subject":[],"published":{"date-parts":[[2021,7,20]]},"assertion":[{"value":"2020-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-07-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}