{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T04:38:23Z","timestamp":1780720703756,"version":"3.54.1"},"reference-count":27,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2022,3,3]],"date-time":"2022-03-03T00:00:00Z","timestamp":1646265600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"US National Science Foundation","doi-asserted-by":"crossref","award":["ECCS-2029978, ECCS-2033671, and CNS-2002902"],"award-info":[{"award-number":["ECCS-2029978, ECCS-2033671, and CNS-2002902"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"crossref"}]},{"name":"US ONR and NSF"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Healthcare"],"published-print":{"date-parts":[[2022,4,30]]},"abstract":"<jats:p>This article studies the problem of automated information processing from large volumes of unstructured, heterogeneous, and sometimes untrustworthy data sources. The main contribution is a novel framework called Machine Assisted Record Selection (MARS). Instead of today\u2019s standard practice of relying on human experts to manually decide the order of records for processing, MARS learns the optimal record selection via an online learning algorithm. It further integrates algorithm-based record selection and processing with human-based error resolution to achieve a balanced task allocation between machine and human. Both fixed and adaptive MARS algorithms are proposed, leveraging different statistical knowledge about the existence, quality, and cost associated with the records. Experiments using semi-synthetic data that are generated from real-world patients record processing in the UK national cancer registry are carried out, which demonstrate significant (3 to 4 fold) performance gain over the fixed-order processing. MARS represents one of the few examples demonstrating that machine learning can assist humans with complex jobs by automating complex triaging tasks.<\/jats:p>","DOI":"10.1145\/3494582","type":"journal-article","created":{"date-parts":[[2022,3,3]],"date-time":"2022-03-03T19:31:12Z","timestamp":1646335872000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["MARS: Assisting Human with Information Processing Tasks Using Machine Learning"],"prefix":"10.1145","volume":"3","author":[{"given":"Cong","family":"Shen","sequence":"first","affiliation":[{"name":"University of Virginia, Charlottesville, VA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhaozhi","family":"Qian","sequence":"additional","affiliation":[{"name":"University of Cambridge, Cambridge, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alihan","family":"Huyuk","sequence":"additional","affiliation":[{"name":"University of Cambridge, Cambridge, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mihaela","family":"Van Der Schaar","sequence":"additional","affiliation":[{"name":"University of Cambridge and University of California, Los Angeles, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,3,3]]},"reference":[{"key":"e_1_3_3_2_2","article-title":"Creativity vs. robots","author":"Bakhshi Hasan","year":"2015","unstructured":"Hasan Bakhshi, Carl B. Frey, and Michael Osborne. 2015. Creativity vs. robots. The Creative Economy and The Future of Employment. Nesta, London (2015).","journal-title":"The Creative Economy and The Future of Employment. Nesta, London"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.aap8062"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-018-0003-2"},{"key":"e_1_3_3_5_2","first-page":"151","volume-title":"Proceedings of the 30th International Conference on Machine Learning","author":"Chen Wei","year":"2013","unstructured":"Wei Chen, Yajun Wang, and Yang Yuan. 2013. Combinatorial multi-armed bandit: General framework and applications. In Proceedings of the 30th International Conference on Machine Learning. 151\u2013159."},{"key":"e_1_3_3_6_2","volume-title":"Proceedings of the ICML Workshop on Role of Machine Learning in Transforming Healthcare","author":"Cobb Ryan","year":"2013","unstructured":"Ryan Cobb, Sahil Puri, D. Zhe Wang, Tezcan Baslanti, and Azra Bihorac. 2013. Knowledge extraction and outcome prediction using medical notes. In Proceedings of the ICML Workshop on Role of Machine Learning in Transforming Healthcare."},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-018-0316-z"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.techfore.2016.08.019"},{"key":"e_1_3_3_9_2","volume-title":"Submodular Functions and Optimization","author":"Fujishige Satoru","year":"2005","unstructured":"Satoru Fujishige. 2005. Submodular Functions and Optimization. Elsevier."},{"key":"e_1_3_3_10_2","first-page":"2697","volume-title":"Proceedings of the Advances in Neural Information Processing Systems 26","author":"Gabillon Victor","year":"2013","unstructured":"Victor Gabillon, Branislav Kveton, Zheng Wen, Brian Eriksson, and S. Muthukrishnan. 2013. Adaptive submodular maximization in bandit setting. In Proceedings of the Advances in Neural Information Processing Systems 26, C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K. Q. Weinberger (Eds.). Curran Associates, Inc., 2697\u20132705."},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2009.2026513"},{"issue":"3","key":"e_1_3_3_12_2","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1016\/j.yebeh.2013.09.025","article-title":"Validating a natural language processing tool to exclude psychogenic nonepileptic seizures in electronic medical record-based epilepsy research","volume":"29","author":"Hamid H.","year":"2013","unstructured":"H. Hamid, S. J. Fodeh, A. G. Lizama, R. Czlapinski, M. J. Pugh, W. C. LaFrance Jr, and C. A. Brandt. 2013. Validating a natural language processing tool to exclude psychogenic nonepileptic seizures in electronic medical record-based epilepsy research. Epilepsy & Behavior 29, 3 (2013), 578\u2013580.","journal-title":"Epilepsy & Behavior"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.5555\/3158938"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-0190(99)00031-9"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/tsp.2019.2892020"},{"key":"e_1_3_3_16_2","article-title":"Scottish Cancer Registry","author":"Scotland NHS National Services","year":"2019","unstructured":"NHS National Services Scotland. 2019. Scottish Cancer Registry. Retrieved from https:\/\/www.isdscotland.org\/Health-Topics\/Cancer\/Scottish-Cancer-Registry\/. [Online; accessed: 2020-02-06].","journal-title":"https:\/\/www.isdscotland.org\/Health-Topics\/Cancer\/Scottish-Cancer-Registry\/"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMra1814259"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298824"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2014.2329213"},{"key":"e_1_3_3_20_2","first-page":"103174","article-title":"Machines as teammates: A research agenda on AI in team collaboration","author":"Seeber Isabella","year":"2019","unstructured":"Isabella Seeber, Eva Bittner, Robert O. Briggs, Triparna de Vreede, Gert-Jan de Vreede, Aaron Elkins, Ronald Maier, Alexander B. Merz, Sarah Oeste-Reib, Nils Randrup, Gerhard Schwabe, and Matthias Sollner. 2019. Machines as teammates: A research agenda on AI in team collaboration. Information & Management 57, 2 (2019), 103174.","journal-title":"Information & Management"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2002.800395"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2017.2767063"},{"issue":"1","key":"e_1_3_3_23_2","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1186\/1478-7954-4-10","article-title":"Consistency and accuracy of diagnostic cancer codes generated by automated registration: comparison with manual registration","volume":"4","author":"Tagliabue Giovanna","year":"2006","unstructured":"Giovanna Tagliabue, Anna Maghini, Sabrina Fabiano, Andrea Tittarelli, Emanuela Frassoldi, Enrica Costa, Silvia Nobile, Tiziana Codazzi, Paolo Crosignani, Roberto Tessandori, and Paolo Contiero. 2006. Consistency and accuracy of diagnostic cancer codes generated by automated registration: comparison with manual registration. Population Health Metrics 4, 1 (2006), 10.","journal-title":"Population Health Metrics"},{"key":"e_1_3_3_24_2","article-title":"The impact of artificial intelligence on work","author":"Society The Royal","year":"2018","unstructured":"The Royal Society. 2018. The impact of artificial intelligence on work. Retrieved from https:\/\/royalsociety.org\/topics-policy\/projects\/ai-and-work\/. Accessed: 2020-06-01.","journal-title":"https:\/\/royalsociety.org\/topics-policy\/projects\/ai-and-work\/"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3209889.3209897"},{"key":"e_1_3_3_26_2","volume-title":"Joint Proceedings of the ACM IUI 2019 Workshops \u2013 Explainable Smart Systems","author":"Yang Yiwei","year":"2019","unstructured":"Yiwei Yang, Eser Kandogan, Yunyao Li, Prithviraj Sen, and Walter Lasecki. 2019. A study on interaction in human-in-the-loop machine learning for text analytics. In Joint Proceedings of the ACM IUI 2019 Workshops \u2013 Explainable Smart Systems."},{"key":"e_1_3_3_27_2","unstructured":"Fisher Yu Ari Seff Yinda Zhang Shuran Song Thomas Funkhouser and Jianxiong Xiao. 2015. LSUN: Construction of a large-scale image dataset using deep learning with humans in the loop. arXiv:1506.03365. Retrieved from https:\/\/arxiv.org\/abs\/1506.03365. arXiv:1506.03365"},{"key":"e_1_3_3_28_2","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1613\/jair.1.11345","article-title":"Viewpoint: Human-in-the-loop artificial intelligence","volume":"64","author":"Zanzotto Fabio Massimo","year":"2019","unstructured":"Fabio Massimo Zanzotto. 2019. Viewpoint: Human-in-the-loop artificial intelligence. Journal of Artificial Intelligence Research 64, 1 (2019), 243\u2013252.","journal-title":"Journal of Artificial Intelligence Research"}],"container-title":["ACM Transactions on Computing for Healthcare"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3494582","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3494582","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:16Z","timestamp":1750188676000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3494582"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,3]]},"references-count":27,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,4,30]]}},"alternative-id":["10.1145\/3494582"],"URL":"https:\/\/doi.org\/10.1145\/3494582","relation":{},"ISSN":["2691-1957","2637-8051"],"issn-type":[{"value":"2691-1957","type":"print"},{"value":"2637-8051","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,3]]},"assertion":[{"value":"2021-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-03-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}