{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,19]],"date-time":"2026-01-19T15:01:47Z","timestamp":1768834907470,"version":"3.49.0"},"reference-count":86,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2021,10,18]],"date-time":"2021-10-18T00:00:00Z","timestamp":1634515200000},"content-version":"vor","delay-in-days":5,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2026513"],"award-info":[{"award-number":["2026513"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["NRF-2019R1A2C4070420"],"award-info":[{"award-number":["NRF-2019R1A2C4070420"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,10,13]]},"abstract":"<jats:p>Capturing human annotators' subjective responses in image annotation has become crucial as vision-based classifiers expand the range of application areas. While there has been significant progress in image annotation interface design in general, relatively little research has been conducted to understand how to elicit reliable and cost-efficient human annotation when the nature of the task includes a certain level of subjectivity. To bridge this gap, we aim to understand how different sampling methods in image batch labeling, a design that allows human annotators to label a batch of images simultaneously, can impact human annotation performances. In particular, we developed three different strategies in forming image batches: (1) uncertainty-based labeling (UL) that prioritizes images that a classifier predicts with the highest uncertainty, (2) certainty-based labeling (CL), a reverse strategy of UL, and (3) random, a baseline approach that randomly selects images. Although UL and CL solely select images to be labeled from a classifier's point of view, we hypothesized that human-side perception and labeling performance may also vary depending on the different sampling strategies. In our study, we observed that participants were able to recognize a different level of perceived cognitive load across three conditions (CL the easiest while UL the most difficult). We also observed a trade-off between annotation task effectiveness (CL and UL more reliable than random) and task efficiency (UL the most efficient while CL the least efficient). Based on the results, we discuss the implications of design and possible future research directions of image batch labeling.<\/jats:p>","DOI":"10.1145\/3476037","type":"journal-article","created":{"date-parts":[[2021,10,19]],"date-time":"2021-10-19T02:39:17Z","timestamp":1634611157000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Understanding Human-side Impact of Sampling Image Batches in Subjective Attribute Labeling"],"prefix":"10.1145","volume":"5","author":[{"given":"Chaeyeon","family":"Chung","sequence":"first","affiliation":[{"name":"KAIST, Daejeon, Republic of Korea"}]},{"given":"Jungsoo","family":"Lee","sequence":"additional","affiliation":[{"name":"KAIST, Daejeon, Republic of Korea"}]},{"given":"Kyungmin","family":"Park","sequence":"additional","affiliation":[{"name":"Shinhan Bank, Seoul, Republic of Korea"}]},{"given":"Junsoo","family":"Lee","sequence":"additional","affiliation":[{"name":"KAIST, Daejeon, Republic of Korea"}]},{"given":"Minjae","family":"Kim","sequence":"additional","affiliation":[{"name":"NCSOFT AI Center Vision AI Lab, Seongnam-si, Republic of Korea"}]},{"given":"Mookyung","family":"Song","sequence":"additional","affiliation":[{"name":"NCSOFT AI Center Vision AI Lab, SeongNam, Republic of Korea"}]},{"given":"Yeonwoo","family":"Kim","sequence":"additional","affiliation":[{"name":"NCSOFT AI Center Vision AI Lab, SEOUL, Republic of Korea"}]},{"given":"Jaegul","family":"Choo","sequence":"additional","affiliation":[{"name":"KAIST, Daejeon, Republic of Korea"}]},{"given":"Sungsoo Ray","family":"Hong","sequence":"additional","affiliation":[{"name":"George Mason University, Fairfax, VA, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,10,18]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209542.3209558"},{"key":"e_1_2_1_2_1","unstructured":"Najork Alonso Marshall. 2014. Crowdsourcing a Subjective Labeling Task: A Human-Centered Framework to Ensure Reliable Results. Technical Report."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2046396.2046416"},{"key":"e_1_2_1_4_1","volume-title":"Proc. the International Conference on Machine Learning (ICML).","author":"Arjovsky Martin","year":"2017","unstructured":"Martin Arjovsky, Soumith Chintala, and L\u00e9on Bottou. 2017. Wasserstein Generative Adversarial Networks. In Proc. the International Conference on Machine Learning (ICML)."},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"James V. Bradley. 1958. Complete Counterbalancing of Immediate Sequential Effects in a Latin Square Design. J. Amer. Statist. Assoc. (1958).","DOI":"10.2307\/2281872"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858237"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2014.6836031"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300460"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00916"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359164"},{"key":"e_1_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Corinna Cortes and Vladimir Vapnik. 1995. Support-Vector Networks. Mach. Learn. (1995).","DOI":"10.1007\/BF00994018"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00482"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557011"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.12277"},{"key":"e_1_2_1_15_1","volume-title":"Proc. of the 8th International Conference on Intelligent User Interfaces.","author":"Fails Jerry Alan","unstructured":"Jerry Alan Fails and Dan R. Olsen, Jr. 2003. Interactive Machine Learning. In Proc. of the 8th International Conference on Intelligent User Interfaces."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242596"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242596"},{"key":"e_1_2_1_18_1","volume-title":"Certainty-based active learning for sampling imbalanced datasets. Neurocomputing","author":"Fu JuiHsi","year":"2013","unstructured":"JuiHsi Fu and SingLing Lee. 2013. Certainty-based active learning for sampling imbalanced datasets. Neurocomputing (2013). Intelligent Processing Techniques for Semantic-based Image and Video Retrieval."},{"key":"e_1_2_1_19_1","volume-title":"Certainty-Enhanced Active Learning for Improving Imbalanced Data Classification. In IEEE 11th International Conference on Data Mining Workshops.","author":"Fu J. H.","unstructured":"J. H. Fu and S. L. Lee. 2011. Certainty-Enhanced Active Learning for Improving Imbalanced Data Classification. In IEEE 11th International Conference on Data Mining Workshops."},{"key":"e_1_2_1_20_1","volume-title":"A 20-Year Community Roadmap for Artificial Intelligence Research in the US. arXiv","author":"Gil Yolanda","year":"2019","unstructured":"Yolanda Gil and Bart Selman. 2019. A 20-Year Community Roadmap for Artificial Intelligence Research in the US. arXiv (2019)."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.4135\/9781412983419"},{"key":"e_1_2_1_22_1","volume-title":"Fast R-CNN. In Proc. of the IEEE international conference on computer vision (ICCV).","author":"Girshick Ross","year":"2015","unstructured":"Ross Girshick. 2015. Fast R-CNN. In Proc. of the IEEE international conference on computer vision (ICCV)."},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Shantanu Godbole Abhay Harpale Sunita Sarawagi and Soumen Chakrabarti. 2004. Document Classification Through Interactive Supervision of Document and Term Labels.","DOI":"10.1007\/978-3-540-30116-5_61"},{"key":"e_1_2_1_24_1","volume-title":"Proc. the Advances in Neural Information Processing Systems (NeurIPS).","author":"Goodfellow Ian","year":"2014","unstructured":"Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In Proc. the Advances in Neural Information Processing Systems (NeurIPS)."},{"key":"e_1_2_1_25_1","volume-title":"Vincent Dumoulin, and Aaron C. Courville.","author":"Gulrajani Ishaan","year":"2017","unstructured":"Ishaan Gulrajani, Faruk Ahmed, Mart'i n Arjovsky, Vincent Dumoulin, and Aaron C. Courville. 2017. Improved Training of Wasserstein GANs. Proc. the Advances in Neural Information Processing Systems (NeurIPS)."},{"key":"e_1_2_1_26_1","volume-title":"Proc. the Advances in Neural Information Processing Systems (NeurIPS).","author":"Guo Yuhong","year":"2007","unstructured":"Yuhong Guo and Dale Schuurmans. 2007. Discriminative Batch Mode Active Learning. In Proc. the Advances in Neural Information Processing Systems (NeurIPS)."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_1_28_1","volume-title":"Proc. the Advances in Neural Information Processing Systems (NeurIPS).","author":"Heusel Martin","year":"2017","unstructured":"Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, G\u00fc nter Klambauer, and Sepp Hochreiter. 2017. GANs Trained by a Two Time-Scale Update Rule Converge to a Nash Equilibrium. Proc. the Advances in Neural Information Processing Systems (NeurIPS)."},{"key":"e_1_2_1_29_1","volume-title":"Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontiers","author":"Hohman Fred","year":"2018","unstructured":"Fred Hohman, Minsuk Kahng, Robert Pienta, and Duen Horng Chau. 2018. Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontiers. IEEE Transactions on Visualization and Computer Graphics (TVCG) (2018)."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376177"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173640"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359208"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392878"},{"key":"e_1_2_1_34_1","volume-title":"Jooyoung Lee, Juho Kim, and Mark Zachry.","author":"Hong Sungsoo","year":"2018","unstructured":"Sungsoo (Ray) Hong, Minhyang (Mia) Suh, Nathalie Henry Riche, Jooyoung Lee, Juho Kim, and Mark Zachry. 2018b. Collaborative Dynamic Queries: Supporting Distributed Small Group Decision-making. Proc. of the ACM on Human-Computer Interaction (CSCW)."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.167"},{"key":"e_1_2_1_36_1","volume-title":"Proc. the Advances in Neural Information Processing Systems (NeurIPS)","author":"Kirsch Andreas","year":"2019","unstructured":"Andreas Kirsch, Joost R. van Amersfoort, and Yarin Gal. 2019. BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learning. Proc. the Advances in Neural Information Processing Systems (NeurIPS) (2019)."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170427.3188667"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2017.285"},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the Winter Simulation Conference (WSC).","author":"Krell C.","unstructured":"C. Krell and H. Grant. 2010. Na\u00efve learning algorithms utilized for the prediction of stock prices to compare economic models of decision making. In Proceedings of the Winter Simulation Conference (WSC)."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858115"},{"key":"e_1_2_1_41_1","volume-title":"Hinton","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet Classification with Deep Convolutional Neural Networks. In Neural Information Processing Systems (NIPS)."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557238"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858144"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1394445.1394491"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the Seventeenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR).","author":"David","unstructured":"David D. Lewis and William A. Gale. 1994. A Sequential Algorithm for Training Text Classifiers. In Proceedings of the Seventeenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2858826"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.713"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.425"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1646396.1646434"},{"key":"e_1_2_1_50_1","volume-title":"Table: Robust Gesture Recognition Using Acoustic Sensing in Your Hand","author":"Luo G.","year":"2020","unstructured":"G. Luo, P. Yang, M. Chen, and P. Li. 2020. HCI on the Table: Robust Gesture Recognition Using Acoustic Sensing in Your Hand. IEEE Access (2020)."},{"key":"e_1_2_1_51_1","volume-title":"Crowdsourced data management: Industry and academic perspectives. Foundations and Trends in Databases","author":"Marcus Adam","year":"2015","unstructured":"Adam Marcus and Aditya Parameswaran. 2015. Crowdsourced data management: Industry and academic perspectives. Foundations and Trends in Databases (2015)."},{"key":"e_1_2_1_52_1","unstructured":"Francisco Massa and Ross Girshick. 2018. maskrcnn-benchmark: Fast modular reference implementation of Instance Segmentation and Object Detection algorithms in PyTorch."},{"key":"e_1_2_1_53_1","volume-title":"Reducing systematic review workload through certainty-based screening. Journal of Biomedical Informatics","author":"Miwa Makoto","year":"2014","unstructured":"Makoto Miwa, James Thomas, Alison O'Mara-Eves, and Sophia Ananiadou. 2014. Reducing systematic review workload through certainty-based screening. Journal of Biomedical Informatics (2014)."},{"key":"e_1_2_1_54_1","volume-title":"A Unifying View on Dataset Shift in Classification. Pattern Recognition","author":"Moreno-Torres Jose G.","year":"2012","unstructured":"Jose G. Moreno-Torres, Troy Raeder, Roc'iO Alaiz-Rodr'iGuez, Nitesh V. Chawla, and Francisco Herrera. 2012. A Unifying View on Dataset Shift in Classification. Pattern Recognition (2012)."},{"key":"e_1_2_1_55_1","doi-asserted-by":"crossref","unstructured":"Fionn Murtagh and Pierre Legendre. 2014. Ward's Hierarchical Agglomerative Clustering Method: Which Algorithms Implement Ward's Criterion? J. Classif. (2014).","DOI":"10.1007\/s00357-014-9161-z"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858490"},{"key":"e_1_2_1_57_1","unstructured":"Erik Ofgang. 2021 (accessed January 7th). Remote vs. In-person Classes: What the Data Shows. https:\/\/www.techlearninguniversity.com\/news\/remote-vs-in-person-classes-what-the-data-show"},{"key":"e_1_2_1_58_1","volume-title":"Deep Face Recognition. In British Machine Vision Conference.","author":"Parkhi O. M.","unstructured":"O. M. Parkhi, A. Vedaldi, and A. Zisserman. 2015. Deep Face Recognition. In British Machine Vision Conference."},{"key":"e_1_2_1_59_1","volume-title":"Bring Up Genius! Interart","author":"Polg\u00e1r L\u00e1szl\u00f3","unstructured":"L\u00e1szl\u00f3 Polg\u00e1r. 1989. Bring Up Genius! Interart, Budapest, Hungary."},{"key":"e_1_2_1_60_1","volume-title":"Seventh International Conference on Contemporary Computing (IC3).","author":"Prasad S.","unstructured":"S. Prasad, P. Kumar, and K. P. Sinha. 2014. A wireless dynamic gesture user interface for HCI using hand data glove. In Seventh International Conference on Contemporary Computing (IC3)."},{"key":"e_1_2_1_61_1","unstructured":"Shaoqing Ren Kaiming He Ross Girshick and Jian Sun. 2015. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. In Neural Information Processing Systems (NIPS)."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.5555\/647967.741626"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.74"},{"key":"e_1_2_1_64_1","unstructured":"Burr Settles. 2010. Active Learning Literature Survey. (2010)."},{"key":"e_1_2_1_65_1","doi-asserted-by":"crossref","unstructured":"Burr Settles and Mark Craven. 2008. An Analysis of Active Learning Strategies for Sequence Labeling Tasks. Empirical Methods in Natural Language Processing (EMNLP).","DOI":"10.3115\/1613715.1613855"},{"key":"e_1_2_1_66_1","volume-title":"A Mathematical Theory of Communication. The Bell System Technical Journal","author":"Shannon Claude Elwood","year":"1948","unstructured":"Claude Elwood Shannon. 1948. A Mathematical Theory of Communication. The Bell System Technical Journal (1948)."},{"key":"e_1_2_1_67_1","volume-title":"Proc. of the IEEE conference on computer vision and pattern recognition (CVPR).","author":"Shen Y.","unstructured":"Y. Shen, P. Luo, P. Luo, J. Yan, X. Wang, and X. Tang. 2018. FaceID-GAN: Learning a Symmetry Three-Player GAN for Identity-Preserving Face Synthesis. In Proc. of the IEEE conference on computer vision and pattern recognition (CVPR)."},{"key":"e_1_2_1_68_1","volume-title":"Very Deep Convolutional Networks for Large-Scale Image Recognition. Computing Research Repository (CoRR)","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan and Andrew Zisserman. 2014. Very Deep Convolutional Networks for Large-Scale Image Recognition. Computing Research Repository (CoRR) (2014)."},{"key":"e_1_2_1_69_1","volume-title":"Proc. of the IEEE conference on computer vision and pattern recognition (CVPR).","author":"Szegedy C.","unstructured":"C. Szegedy, Wei Liu, Yangqing Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. 2015. Going deeper with convolutions. In Proc. of the IEEE conference on computer vision and pattern recognition (CVPR)."},{"key":"e_1_2_1_70_1","volume-title":"Proc. the International Conference on Machine Learning (ICML).","author":"Tan Mingxing","unstructured":"Mingxing Tan and Quoc V. Le. 2019. EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. In Proc. the International Conference on Machine Learning (ICML)."},{"key":"e_1_2_1_71_1","volume-title":"Perceptual grouping and attention in visual search for features and for objects. Journal of experimental psychology: human perception and performance","author":"Treisman Anne","year":"1982","unstructured":"Anne Treisman. 1982. Perceptual grouping and attention in visual search for features and for objects. Journal of experimental psychology: human perception and performance (1982)."},{"key":"e_1_2_1_72_1","unstructured":"Alexey Tsymbal. 2004. The Problem of Concept Drift: Definitions and Related Work. (2004)."},{"key":"e_1_2_1_73_1","volume-title":"Viualizing data using t-SNE. Journal of Machine Learning Research","author":"van der Maaten Laurens","year":"2008","unstructured":"Laurens van der Maaten and Geoffrey Hinton. 2008. Viualizing data using t-SNE. Journal of Machine Learning Research (2008)."},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985733"},{"key":"e_1_2_1_75_1","volume-title":"On the Efficient Design of Statistical Investigations. The Annals of Mathematical Statistics","author":"Wald Abraham","year":"1943","unstructured":"Abraham Wald. 1943. On the Efficient Design of Statistical Investigations. The Annals of Mathematical Statistics (1943)."},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00552"},{"key":"e_1_2_1_77_1","volume-title":"Learning in the presence of concept drift and hidden contexts. Machine Learning","author":"Widmer Gerhard","year":"1996","unstructured":"Gerhard Widmer and Miroslav Kubat. 1996. Learning in the presence of concept drift and hidden contexts. Machine Learning (1996)."},{"key":"e_1_2_1_78_1","doi-asserted-by":"crossref","unstructured":"Janyce Wiebe Theresa Wilson Rebecca Bruce Matthew Bell and Melanie Martin. 2004. Learning Subjective Language. Comput. Linguist. (2004).","DOI":"10.1162\/0891201041850885"},{"key":"e_1_2_1_79_1","doi-asserted-by":"crossref","unstructured":"J. Wright A. Y. Yang A. Ganesh S. S. Sastry and Y. Ma. 2009. Robust Face Recognition via Sparse Representation. IEEE Transactions on Pattern Analysis and Machine Intelligence (2009).","DOI":"10.1109\/TPAMI.2008.79"},{"key":"e_1_2_1_80_1","volume-title":"Yueting Zhuang, and Alexander G Hauptmann.","author":"Yang Yi","year":"2011","unstructured":"Yi Yang, Fei Wu, Feiping Nie, Heng Tao Shen, Yueting Zhuang, and Alexander G Hauptmann. 2011. Web and personal image annotation by mining label correlation with relaxed visual graph embedding. IEEE Transactions on Image Processing (2011)."},{"key":"e_1_2_1_81_1","volume-title":"International Conference on Biometrics (ICB).","author":"Zhang T.","unstructured":"T. Zhang, A. Wiliem, S. Yang, and B. Lovell. 2018. TV-GAN: Generative Adversarial Network Based Thermal to Visible Face Recognition. In International Conference on Biometrics (ICB)."},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/2072298.2071970"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359158"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/2733373.2806298"},{"key":"e_1_2_1_85_1","volume-title":"Face Recognition: A Literature Survey. Comput. Surveys","author":"Zhao W.","year":"2003","unstructured":"W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld. 2003. Face Recognition: A Literature Survey. Comput. Surveys (2003)."},{"key":"e_1_2_1_86_1","doi-asserted-by":"crossref","unstructured":"Jingbo Zhu and Matthew Ma. 2012. Uncertainty-Based Active Learning with Instability Estimation for Text Classification. ACM Trans. Speech Lang. Process. (2012).","DOI":"10.1145\/2093153.2093154"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3476037","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3476037","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3476037","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T04:56:10Z","timestamp":1752468970000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3476037"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,13]]},"references-count":86,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2021,10,13]]}},"alternative-id":["10.1145\/3476037"],"URL":"https:\/\/doi.org\/10.1145\/3476037","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,13]]},"assertion":[{"value":"2021-10-18","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}