{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,2]],"date-time":"2025-09-02T06:10:07Z","timestamp":1756793407948,"version":"3.44.0"},"reference-count":30,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,9,2]],"date-time":"2025-09-02T00:00:00Z","timestamp":1756771200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:p>Active Learning (AL) leverages the principle that machine learning models can achieve high accuracy with fewer labeled samples by strategically selecting the most informative data points for training. However, when human annotators provide these labels, their decisions might exhibit a systematic bias. For example, humans frequently rely on a limited subset of the available attributes, or even on a single attribute, when making decisions, as when employing fast and frugal heuristics. This paper introduces a mathematically grounded approach to quantify the probability of mislabeling based on one attribute. We present a novel dropout mechanism designed to influence the attribute selection process used in annotation, effectively reducing the impact of bias. The proposed mechanism is evaluated using multiple AL algorithms and heuristic strategies across diverse prediction tasks. Experimental results demonstrate that the dropout mechanism significantly enhances active learning (AL) performance, achieving a minimum 70% improvement in effectiveness. These findings highlight the mechanism's potential to improve the reliability and accuracy of AL systems, providing valuable insights for designing and implementing robust intelligent systems.<\/jats:p>","DOI":"10.3389\/frai.2025.1562916","type":"journal-article","created":{"date-parts":[[2025,9,2]],"date-time":"2025-09-02T05:34:43Z","timestamp":1756791283000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["A drop-out mechanism for active learning based on one-attribute heuristics"],"prefix":"10.3389","volume":"8","author":[{"given":"Sriram","family":"Ravichandran","sequence":"first","affiliation":[]},{"given":"Nandan","family":"Sudarsanam","sequence":"additional","affiliation":[]},{"given":"Balaraman","family":"Ravindran","sequence":"additional","affiliation":[]},{"given":"Konstantinos V.","family":"Katsikopoulos","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2025,9,2]]},"reference":[{"key":"B1","first-page":"256","article-title":"\u201cImpacts of behavioral biases on active learning strategies,\u201d","volume-title":"International Conference on Artificial Intelligence in Information and Communication (ICAIIC)","author":"Agarwal","year":""},{"key":"B2","first-page":"256","article-title":"\u201cImpacts of behavioral biases on active learning strategies,\u201d","author":"Agarwal","year":"","journal-title":"International Conference on Artificial Intelligence in Information and Communication (ICAIIC)"},{"key":"B3","doi-asserted-by":"publisher","first-page":"120391","DOI":"10.1016\/j.eswa.2023.120391","article-title":"Deep learning based active learning technique for data annotation and improve the overall performance of classification models","volume":"228","author":"Amin","year":"2023","journal-title":"Expert Syst. Appl"},{"key":"B4","doi-asserted-by":"publisher","first-page":"116981","DOI":"10.1016\/j.eswa.2022.116981","article-title":"Fair active learning","volume":"199","author":"Anahideh","year":"2022","journal-title":"Expert Syst. Appl"},{"key":"B5","volume-title":"Predictably Irrational: the Hidden Forces That Shape Our Decisions","author":"Ariely","year":"2010"},{"key":"B6","doi-asserted-by":"crossref","first-page":"18","DOI":"10.3115\/1564131.1564136","article-title":"\u201cEstimating annotation cost for active learning in a multi-annotator environment,\u201d","volume-title":"Proceedings Of The NAACL HLT 2009 Workshop On Active Learning For Natural Language Processing","author":"Arora","year":"2009"},{"key":"B7","first-page":"8","article-title":"\u201cQuery learning can work poorly when a human oracle is used,\u201d","volume-title":"Proc. Int. Joint Conf. Neural Netw","author":"Baum","year":"1992"},{"key":"B8","first-page":"797","article-title":"\u201cActive learning with human-like noisy oracle,\u201d","volume-title":"Proceedings with IEEE International Conference on Data Mining","author":"Du","year":"2010"},{"key":"B9","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780199744282.001.0001","volume-title":"Heuristics: The Foundations of Adaptive Behavior","author":"Gigerenzer","year":"2011"},{"key":"B10","first-page":"159","article-title":"\u201cLearning from multiple annotators with Gaussian processes,\u201d","author":"Groot","year":"2011","journal-title":"Proc. Artif. Neural Networks Mach. Learn"},{"key":"B11","first-page":"20","article-title":"\u201cDiscriminative batch mode active learning,\u201d","volume-title":"Advances in Neural Information Processing Systems","author":"Guo","year":"2007"},{"key":"B12","first-page":"91","article-title":"\u201cPersonalized active learning for collaborative filtering,\u201d","author":"Harpale","year":"2008","journal-title":"Proc. ACM SIGIR 2008"},{"key":"B13","doi-asserted-by":"publisher","first-page":"6453","DOI":"10.1007\/s10994-024-06567-2","article-title":"Evidential uncertainty sampling strategies for active learning","volume":"113","author":"Hoarau","year":"2024","journal-title":"Mach. Learn"},{"key":"B14","doi-asserted-by":"crossref","first-page":"633","DOI":"10.1145\/1135777.1135870","article-title":"\u201cLarge-scale text categorization by batch mode active learning,\u201d","volume-title":"Proceedings Of The 15th International Conference On World Wide Web","author":"Hoi","year":"2006"},{"key":"B15","article-title":"\u201cLearning and applying case adaptation rules for classification: an ensemble approach,\u201d","author":"Jalali","year":"2017","journal-title":"International Joint Conference on Artificial Intelligence"},{"key":"B16","volume-title":"Classification in the Wild: The Science and Art of Transparent Decision Making","author":"Katsikopoulos","year":"2020"},{"key":"B17","author":"Kelly","year":"2023","journal-title":"The UCI Machine Learning Repository"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2307.02719","article-title":"Understanding uncertainty sampling","author":"Liu","year":"2023","journal-title":"arXiv"},{"key":"B19","volume-title":"Human-in-the-Loop Machine Learning: Active Learning and Annotation for Human-Centered AI","author":"Monarch","year":"2021"},{"key":"B20","unstructured":"Active learning with feedback on features and instances\n          \n          1655\n          1686\n          \n            \n              Raghavan\n              H.\n            \n            \n              Madani\n              O.\n            \n            \n              Jones\n              R.\n            \n          \n          J. Mach. Learn. Res\n          7\n          2006"},{"key":"B21","first-page":"18310","article-title":"\u201cConvergence of uncertainty sampling for active learning,\u201d","author":"Raj","year":"2022"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1491932","DOI":"10.3389\/frai.2024.1491932","article-title":"Active learning with human heuristics: an algorithm robust to labeling bias","volume":"7","author":"Ravichandran","year":"2024","journal-title":"Front. Artif. Intellig"},{"key":"B23","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1007\/s10618-024-01026-x","article-title":"Active learning with biased non-response to label requests","volume":"2024","author":"Robinson","year":"2024","journal-title":"Data Mining Knowl. Discov"},{"key":"B24","volume-title":"Active Learning Literature Survey","author":"Settles","year":"2009"},{"key":"B25","first-page":"1070","article-title":"\u201cAn analysis of active learning strategies for sequence labeling tasks,\u201d","volume-title":"Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing","author":"Settles","year":"2008"},{"key":"B26","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"Mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J"},{"key":"B27","unstructured":"Dropout: a simple way to prevent neural networks from overfitting\n          \n          1929\n          1958\n          \n            \n              Srivastava\n              N.\n            \n            \n              Hinton\n              G.\n            \n            \n              Krizhevsky\n              A.\n            \n            \n              Sutskever\n              I.\n            \n            \n              Salakhutdinov\n              R.\n            \n          \n          33259321\n          J. Mach. Learn. Res\n          15\n          2014"},{"key":"B28","volume-title":"Simple Heuristics That Make Us Smart","author":"Todd","year":"1999"},{"key":"B29","doi-asserted-by":"publisher","first-page":"118228","DOI":"10.1016\/j.eswa.2022.118228","article-title":"A reinforced active learning approach for optimal sampling in aspect term extraction for sentiment analysis","volume":"209","author":"Venugopalan","year":"2022","journal-title":"Expert Syst. Appl"},{"key":"B30","doi-asserted-by":"publisher","first-page":"1176935119860822","DOI":"10.1177\/1176935119860822","article-title":"On the bias of precision estimation under separate sampling","volume":"18","author":"Xie","year":"2019","journal-title":"Cancer Inform"}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2025.1562916\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,2]],"date-time":"2025-09-02T05:34:48Z","timestamp":1756791288000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2025.1562916\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,2]]},"references-count":30,"alternative-id":["10.3389\/frai.2025.1562916"],"URL":"https:\/\/doi.org\/10.3389\/frai.2025.1562916","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,2]]},"article-number":"1562916"}}