{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T03:10:26Z","timestamp":1772593826054,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":23,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,3,22]],"date-time":"2022-03-22T00:00:00Z","timestamp":1647907200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,3,22]]},"DOI":"10.1145\/3490099.3511110","type":"proceedings-article","created":{"date-parts":[[2022,3,21]],"date-time":"2022-03-21T23:24:13Z","timestamp":1647905053000},"page":"584-593","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Efficiently correcting machine learning: considering the role of example ordering in human-in-the-loop training of image classification models"],"prefix":"10.1145","author":[{"given":"Geoff","family":"Holmes","sequence":"first","affiliation":[{"name":"University of Waikato, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eibe","family":"Frank","sequence":"additional","affiliation":[{"name":"University of Waikato, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dale","family":"Fletcher","sequence":"additional","affiliation":[{"name":"University of Waikato, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Corey","family":"Sterling","sequence":"additional","affiliation":[{"name":"University of Waikato, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,3,22]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Machine Learning for Data Streams with Practical Examples in MOA","author":"Bifet Albert","unstructured":"Albert Bifet , Ricard Gavald\u00e0 , Geoff Holmes , and Bernhard Pfahringer . 2018. Machine Learning for Data Streams with Practical Examples in MOA . MIT Press . https:\/\/moa.cms.waikato.ac.nz\/book\/. Albert Bifet, Ricard Gavald\u00e0, Geoff Holmes, and Bernhard Pfahringer. 2018. Machine Learning for Data Streams with Practical Examples in MOA. MIT Press. https:\/\/moa.cms.waikato.ac.nz\/book\/."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"crossref","unstructured":"Samuel Budd Emma\u00a0C Robinson and Bernhard Kainz. 2021. A survey on active learning and human-in-the-loop deep learning for medical image analysis. Medical Image Analysis(2021) 102062.  Samuel Budd Emma\u00a0C Robinson and Bernhard Kainz. 2021. A survey on active learning and human-in-the-loop deep learning for medical image analysis. Medical Image Analysis(2021) 102062.","DOI":"10.1016\/j.media.2021.102062"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/3023549.3023562"},{"key":"e_1_3_2_1_4_1","volume-title":"Proceedings of the Twenty-Sixth ACM Conference on Intelligent User Interfaces, IUI","author":"Desmond Michael","year":"2021","unstructured":"Michael Desmond , Zahra Ashktorab , Michelle Brachman , Kristina Brimijoin , Evelyn Duesterwald , Casey Dugan , Catherine Finegan-Dollak , Michael Muller , Narrendra\u00a0Nath Joshi , Qian Pan , and Aabhas Sharma . 2021 . Increasing the speed and Accuracy of Data Labelling Through an AI Assisted Interface . In Proceedings of the Twenty-Sixth ACM Conference on Intelligent User Interfaces, IUI 2021. 392\u2013401. Michael Desmond, Zahra Ashktorab, Michelle Brachman, Kristina Brimijoin, Evelyn Duesterwald, Casey Dugan, Catherine Finegan-Dollak, Michael Muller, Narrendra\u00a0Nath Joshi, Qian Pan, and Aabhas Sharma. 2021. Increasing the speed and Accuracy of Data Labelling Through an AI Assisted Interface. In Proceedings of the Twenty-Sixth ACM Conference on Intelligent User Interfaces, IUI 2021. 392\u2013401."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/0-387-25465-X_62"},{"key":"e_1_3_2_1_6_1","volume-title":"Deep learning with Keras","author":"Gulli Antonio","unstructured":"Antonio Gulli and Sujit Pal . 2017. Deep learning with Keras . Packt Publishing Ltd . Antonio Gulli and Sujit Pal. 2017. Deep learning with Keras. Packt Publishing Ltd."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21072514"},{"key":"e_1_3_2_1_9_1","unstructured":"Andreas Kirsch Sebastian Farquhar and Yarin Gal. 2021. A Simple Baseline for Batch Active Learning with Stochastic Acquisition Functions. arXiv preprint arXiv:2106.12059(2021).  Andreas Kirsch Sebastian Farquhar and Yarin Gal. 2021. A Simple Baseline for Batch Active Learning with Stochastic Acquisition Functions. arXiv preprint arXiv:2106.12059(2021)."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-1-55860-335-6.50026-X"},{"key":"e_1_3_2_1_11_1","volume-title":"An integrated iterative annotation technique for easing neural network training in medical image analysis. Nature machine intelligence 1, 2","author":"Lutnick Brendon","year":"2019","unstructured":"Brendon Lutnick , Brandon Ginley , Darshana Govind , Sean\u00a0 D McGarry , Peter\u00a0 S LaViolette , Rabi Yacoub , Sanjay Jain , John\u00a0 E Tomaszewski , Kuang-Yu Jen , and Pinaki Sarder . 2019. An integrated iterative annotation technique for easing neural network training in medical image analysis. Nature machine intelligence 1, 2 ( 2019 ), 112\u2013119. Brendon Lutnick, Brandon Ginley, Darshana Govind, Sean\u00a0D McGarry, Peter\u00a0S LaViolette, Rabi Yacoub, Sanjay Jain, John\u00a0E Tomaszewski, Kuang-Yu Jen, and Pinaki Sarder. 2019. An integrated iterative annotation technique for easing neural network training in medical image analysis. Nature machine intelligence 1, 2 (2019), 112\u2013119."},{"key":"e_1_3_2_1_12_1","volume-title":"2020 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC). IEEE, 1226\u20131233","author":"Madono Koki","year":"2020","unstructured":"Koki Madono , Teppei Nakano , Tetsunori Kobayashi , and Tetsuji Ogawa . 2020 . Efficient Human-In-The-Loop Object Detection using Bi-Directional Deep SORT and Annotation-Free Segment Identification . In 2020 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC). IEEE, 1226\u20131233 . Koki Madono, Teppei Nakano, Tetsunori Kobayashi, and Tetsuji Ogawa. 2020. Efficient Human-In-The-Loop Object Detection using Bi-Directional Deep SORT and Annotation-Free Segment Identification. In 2020 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC). IEEE, 1226\u20131233."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"crossref","unstructured":"Mohammad\u00a0Amin Morid Alireza Borjali and Guilherme Del\u00a0Fiol. 2020. A scoping review of transfer learning research on medical image analysis using ImageNet. Computers in biology and medicine(2020) 104115.  Mohammad\u00a0Amin Morid Alireza Borjali and Guilherme Del\u00a0Fiol. 2020. A scoping review of transfer learning research on medical image analysis using ImageNet. Computers in biology and medicine(2020) 104115.","DOI":"10.1016\/j.compbiomed.2020.104115"},{"key":"e_1_3_2_1_14_1","volume-title":"Interactive machine teaching: a human-centered approach to building machine-learned models. Human\u2013Computer Interaction 35, 5-6","author":"Ramos Gonzalo","year":"2020","unstructured":"Gonzalo Ramos , Christopher Meek , Patrice Simard , Jina Suh , and Soroush Ghorashi . 2020. Interactive machine teaching: a human-centered approach to building machine-learned models. Human\u2013Computer Interaction 35, 5-6 ( 2020 ), 413\u2013451. Gonzalo Ramos, Christopher Meek, Patrice Simard, Jina Suh, and Soroush Ghorashi. 2020. Interactive machine teaching: a human-centered approach to building machine-learned models. Human\u2013Computer Interaction 35, 5-6 (2020), 413\u2013451."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_3_2_1_16_1","unstructured":"Soumya Roy Asim Unmesh and Vinay\u00a0P Namboodiri. 2018. Deep active learning for object detection.. In BMVC Vol.\u00a0362. 91.  Soumya Roy Asim Unmesh and Vinay\u00a0P Namboodiri. 2018. Deep active learning for object detection.. In BMVC Vol.\u00a0362. 91."},{"key":"e_1_3_2_1_17_1","volume-title":"Active Learning","author":"Settles Burr","unstructured":"Burr Settles . 2012. Active Learning . Morgan & Claypool Publishers . Burr Settles. 2012. Active Learning. Morgan & Claypool Publishers."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.3390\/jimaging6060052"},{"key":"e_1_3_2_1_19_1","volume-title":"21st Annual Conference on Learning Theory (COLT","author":"Sriperumbudur K","year":"2008","unstructured":"Bharath\u00a0 K Sriperumbudur , Arthur Gretton , Kenji Fukumizu , Gert Lanckriet , and Bernhard Sch\u00f6lkopf . 2008 . Injective Hilbert space embeddings of probability measures . In 21st Annual Conference on Learning Theory (COLT 2008). Omnipress, 111\u2013122. Bharath\u00a0K Sriperumbudur, Arthur Gretton, Kenji Fukumizu, Gert Lanckriet, and Bernhard Sch\u00f6lkopf. 2008. Injective Hilbert space embeddings of probability measures. In 21st Annual Conference on Learning Theory (COLT 2008). Omnipress, 111\u2013122."},{"key":"e_1_3_2_1_20_1","volume-title":"Convolutional neural networks for medical image analysis: Full training or fine tuning?IEEE transactions on medical imaging 35, 5","author":"Tajbakhsh Nima","year":"2016","unstructured":"Nima Tajbakhsh , Jae\u00a0 Y Shin , Suryakanth\u00a0 R Gurudu , R\u00a0Todd Hurst , Christopher\u00a0 B Kendall , Michael\u00a0 B Gotway , and Jianming Liang . 2016. Convolutional neural networks for medical image analysis: Full training or fine tuning?IEEE transactions on medical imaging 35, 5 ( 2016 ), 1299\u20131312. Nima Tajbakhsh, Jae\u00a0Y Shin, Suryakanth\u00a0R Gurudu, R\u00a0Todd Hurst, Christopher\u00a0B Kendall, Michael\u00a0B Gotway, and Jianming Liang. 2016. Convolutional neural networks for medical image analysis: Full training or fine tuning?IEEE transactions on medical imaging 35, 5 (2016), 1299\u20131312."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-019-05855-6"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3147.3165"},{"key":"e_1_3_2_1_23_1","unstructured":"Xingjiao Wu Luwei Xiao Yixuan Sun Junhang Zhang Tianlong Ma and Liang He. 2021. A Survey of Human-in-the-loop for Machine Learning. arXiv preprint arXiv:2108.00941(2021).  Xingjiao Wu Luwei Xiao Yixuan Sun Junhang Zhang Tianlong Ma and Liang He. 2021. A Survey of Human-in-the-loop for Machine Learning. arXiv preprint arXiv:2108.00941(2021)."}],"event":{"name":"IUI '22: 27th International Conference on Intelligent User Interfaces","location":"Helsinki Finland","acronym":"IUI '22","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["27th International Conference on Intelligent User Interfaces"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3490099.3511110","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3490099.3511110","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:23Z","timestamp":1750188683000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3490099.3511110"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,22]]},"references-count":23,"alternative-id":["10.1145\/3490099.3511110","10.1145\/3490099"],"URL":"https:\/\/doi.org\/10.1145\/3490099.3511110","relation":{},"subject":[],"published":{"date-parts":[[2022,3,22]]},"assertion":[{"value":"2022-03-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}