{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,11]],"date-time":"2026-02-11T17:52:30Z","timestamp":1770832350322,"version":"3.50.1"},"reference-count":62,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2020,12,30]],"date-time":"2020-12-30T00:00:00Z","timestamp":1609286400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["NS\/A000050\/1"],"award-info":[{"award-number":["NS\/A000050\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Healthcare"],"published-print":{"date-parts":[[2021,1,31]]},"abstract":"<jats:p>\n            Colonoscopy, the visual inspection of the large bowel using an endoscope, offers protection against colorectal cancer by allowing for the detection and removal of pre-cancerous polyps. The literature on polyp detection shows widely varying miss rates among clinicians, with averages ranging around 22%--27%. While recent work has considered the use of AI support systems for polyp detection, how to visualise and integrate these systems into clinical practice is an open question. In this work, we explore the design of visual markers as used in an AI support system for colonoscopy. Supported by the gastroenterologists in our team, we designed seven unique visual markers and rendered them on real-life patient video footage. Through an online survey targeting relevant clinical staff (\n            <jats:italic>N<\/jats:italic>\n            = 36), we evaluated these designs and obtained initial insights and understanding into the way in which clinical staff envision AI to integrate in their daily work-environment. Our results provide concrete recommendations for the future deployment of AI support systems in continuous, adaptive scenarios.\n          <\/jats:p>","DOI":"10.1145\/3422156","type":"journal-article","created":{"date-parts":[[2020,12,31]],"date-time":"2020-12-31T05:06:56Z","timestamp":1609391216000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["Designing Visual Markers for Continuous Artificial Intelligence Support"],"prefix":"10.1145","volume":"2","author":[{"given":"Niels","family":"van Berkel","sequence":"first","affiliation":[{"name":"UCL Interaction Centre, United Kingdom and Aalborg University, Aalborg, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Omer F.","family":"Ahmad","sequence":"additional","affiliation":[{"name":"Wellcome\/EPSRC Centre for Interventional 8 Surgical Sciences, University College London, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Danail","family":"Stoyanov","sequence":"additional","affiliation":[{"name":"Medical Physics and Bioengineering, University College London, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Laurence","family":"Lovat","sequence":"additional","affiliation":[{"name":"University College London Hospitals, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ann","family":"Blandford","sequence":"additional","affiliation":[{"name":"UCL Interaction Centre, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,12,30]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/S2468-1253(18)30282-6","article-title":"Artificial intelligence and computer-aided diagnosis in colonoscopy: Current evidence and future directions","volume":"4","author":"Ahmad Omer F.","year":"2019","unstructured":"Omer F. Ahmad , Antonio S. Soares , Evangelos Mazomenos , Patrick Brandao , Roser Vega , Edward Seward , Danail Stoyanov , Manish Chand , and Laurence B. Lovat . 2019 . Artificial intelligence and computer-aided diagnosis in colonoscopy: Current evidence and future directions . Lancet Gastroenterol. Hepatol. 4 , 1 (2019), 71 -- 80 . DOI:https:\/\/doi.org\/10.1016\/S2468-1253(18)30282-6 10.1016\/S2468-1253(18)30282-6 Omer F. Ahmad, Antonio S. Soares, Evangelos Mazomenos, Patrick Brandao, Roser Vega, Edward Seward, Danail Stoyanov, Manish Chand, and Laurence B. Lovat. 2019. Artificial intelligence and computer-aided diagnosis in colonoscopy: Current evidence and future directions. Lancet Gastroenterol. Hepatol. 4, 1 (2019), 71--80. DOI:https:\/\/doi.org\/10.1016\/S2468-1253(18)30282-6","journal-title":"Lancet Gastroenterol. Hepatol."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919)","author":"Amershi Saleema","year":"2019","unstructured":"Saleema Amershi , Dan Weld , Mihaela Vorvoreanu , Adam Fourney , Besmira Nushi , Penny Collisson , Jina Suh , Shamsi Iqbal , Paul N. Bennett , Kori Inkpen , Jaime Teevan , Ruth Kikin-Gil , and Eric Horvitz . 2019 . Guidelines for human-AI interaction . In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919) . ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3290605.3300233 10.1145\/3290605.3300233 Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for human-AI interaction. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919). ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3290605.3300233"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2012.03.002"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201918)","author":"Binns Reuben","year":"2018","unstructured":"Reuben Binns , Max Van Kleek , Michael Veale , Ulrik Lyngs , Jun Zhao , and Nigel Shadbolt . 2018 . \u201c It\u2019s reducing a human being to a percentage\u201d: Perceptions of justice in algorithmic decisions . In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201918) . ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3173574.3173951 10.1145\/3173574.3173951 Reuben Binns, Max Van Kleek, Michael Veale, Ulrik Lyngs, Jun Zhao, and Nigel Shadbolt. 2018. \u201cIt\u2019s reducing a human being to a percentage\u201d: Perceptions of justice in algorithmic decisions. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201918). ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3173574.3173951"},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video (TVX\u201918)","author":"Block Florian","unstructured":"Florian Block , Victoria Hodge , Stephen Hobson , Nick Sephton , Sam Devlin , Marian F. Ursu , Anders Drachen , and Peter I. Cowling . 2018. Narrative bytes: Data-driven content production in esports . In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video (TVX\u201918) . ACM, New York, NY, 29--41. DOI:https:\/\/doi.org\/10.1145\/3210825.3210833 10.1145\/3210825.3210833 Florian Block, Victoria Hodge, Stephen Hobson, Nick Sephton, Sam Devlin, Marian F. Ursu, Anders Drachen, and Peter I. Cowling. 2018. Narrative bytes: Data-driven content production in esports. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video (TVX\u201918). ACM, New York, NY, 29--41. DOI:https:\/\/doi.org\/10.1145\/3210825.3210833"},{"key":"e_1_2_1_6_1","volume-title":"The OpenCV library. Dr. Dobb\u2019s Journal of Software Tools 25","author":"Bradski G.","year":"2000","unstructured":"G. Bradski . 2000. The OpenCV library. Dr. Dobb\u2019s Journal of Software Tools 25 ( 2000 ), 120--125. G. Bradski. 2000. The OpenCV library. Dr. Dobb\u2019s Journal of Software Tools 25 (2000), 120--125."},{"key":"e_1_2_1_7_1","article-title":"Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries","volume":"68","author":"Bray F.","year":"2018","unstructured":"F. Bray , J. Ferlay , I. Soerjomataram , R. L. Siegel , L. A. Torre , and A. Jemal . 2018 . Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries . CA: Canc. J. Clinic. 68 , 6 (11 2018), 394--424. F. Bray, J. Ferlay, I. Soerjomataram, R. L. Siegel, L. A. Torre, and A. Jemal. 2018. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA: Canc. J. Clinic. 68, 6 (11 2018), 394--424.","journal-title":"CA: Canc. J. Clinic."},{"key":"e_1_2_1_8_1","unstructured":"Amaury Br\u00e9h\u00e9ret. 2017. Pixel Annotation Tool. Retrieved from https:\/\/github.com\/abreheret\/PixelAnnotationTool.  Amaury Br\u00e9h\u00e9ret. 2017. Pixel Annotation Tool. Retrieved from https:\/\/github.com\/abreheret\/PixelAnnotationTool."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919)","author":"Cai Carrie J.","year":"2019","unstructured":"Carrie J. Cai , Emily Reif , Narayan Hegde , Jason Hipp , Been Kim , Daniel Smilkov , Martin Wattenberg , Fernanda Viegas , Greg S. Corrado , Martin C. Stumpe , and Michael Terry . 2019 . Human-centered tools for coping with imperfect algorithms during medical decision-making . In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919) . ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3290605.3300234 10.1145\/3290605.3300234 Carrie J. Cai, Emily Reif, Narayan Hegde, Jason Hipp, Been Kim, Daniel Smilkov, Martin Wattenberg, Fernanda Viegas, Greg S. Corrado, Martin C. Stumpe, and Michael Terry. 2019. Human-centered tools for coping with imperfect algorithms during medical decision-making. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919). ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3290605.3300234"},{"key":"e_1_2_1_10_1","volume-title":"Doing Better Statistics in Human-Computer Interaction","author":"Cairns Paul","unstructured":"Paul Cairns . 2019. Doing Better Statistics in Human-Computer Interaction . Cambridge University Press . DOI:https:\/\/doi.org\/10.1017\/9781108685139 10.1017\/9781108685139 Paul Cairns. 2019. Doing Better Statistics in Human-Computer Interaction. Cambridge University Press. DOI:https:\/\/doi.org\/10.1017\/9781108685139"},{"key":"e_1_2_1_11_1","first-page":"4","article-title":"Endoscopist can be more powerful than age and male gender in predicting adenoma detection at colonoscopy","volume":"102","author":"Chen S. C.","year":"2007","unstructured":"S. C. Chen and D. K. Rex . 2007 . Endoscopist can be more powerful than age and male gender in predicting adenoma detection at colonoscopy . Amer. J. Gastroenterol. 102 , 4 (Apr. 2007), 856--861. S. C. Chen and D. K. Rex. 2007. Endoscopist can be more powerful than age and male gender in predicting adenoma detection at colonoscopy. Amer. J. Gastroenterol. 102, 4 (Apr. 2007), 856--861.","journal-title":"Amer. J. Gastroenterol."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1177\/002224378001700401"},{"key":"e_1_2_1_13_1","first-page":"5","article-title":"The molecular basis of variation in human color vision","volume":"67","author":"Deeb S. S.","year":"2005","unstructured":"S. S. Deeb . 2005 . The molecular basis of variation in human color vision . Clin. Gen. 67 , 5 (May 2005), 369--377. S. S. Deeb. 2005. The molecular basis of variation in human color vision. Clin. Gen. 67, 5 (May 2005), 369--377.","journal-title":"Clin. Gen."},{"key":"e_1_2_1_14_1","unstructured":"Alan Dix Janet Finlay Gregory D. Abowd and Russell Beale. 2004. Human-Computer Interaction. Pearson\/Prentice-Hall Harlow England New York.  Alan Dix Janet Finlay Gregory D. Abowd and Russell Beale. 2004. Human-Computer Interaction. Pearson\/Prentice-Hall Harlow England New York."},{"key":"e_1_2_1_15_1","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1055\/s-2005-861352","article-title":"Update on the Paris classification of superficial neoplastic lesions in the digestive tract","volume":"37","author":"Endoscopic Classification Review Group","year":"2005","unstructured":"Endoscopic Classification Review Group . 2005 . Update on the Paris classification of superficial neoplastic lesions in the digestive tract . Endoscopy 37 , 6 (2005), 570 -- 578 . DOI:https:\/\/doi.org\/10.1055\/s-2005-861352 10.1055\/s-2005-861352 Endoscopic Classification Review Group. 2005. Update on the Paris classification of superficial neoplastic lesions in the digestive tract. Endoscopy 37, 6 (2005), 570--578. DOI:https:\/\/doi.org\/10.1055\/s-2005-861352","journal-title":"Endoscopy"},{"key":"e_1_2_1_16_1","first-page":"51","article-title":"European guidelines for quality assurance in colorectal cancer screening and diagnosis: Overview and introduction to the full Supplement publication","volume":"45","author":"European Colorectal Cancer Screening Guidelines Working Group","year":"2013","unstructured":"European Colorectal Cancer Screening Guidelines Working Group . 2013 . European guidelines for quality assurance in colorectal cancer screening and diagnosis: Overview and introduction to the full Supplement publication . Endoscopy 45 , 01 (2013), 51 -- 59 . DOI:https:\/\/doi.org\/10.1055\/s-0032-1325997 10.1055\/s-0032-1325997 European Colorectal Cancer Screening Guidelines Working Group. 2013. European guidelines for quality assurance in colorectal cancer screening and diagnosis: Overview and introduction to the full Supplement publication. Endoscopy 45, 01 (2013), 51--59. DOI:https:\/\/doi.org\/10.1055\/s-0032-1325997","journal-title":"Endoscopy"},{"key":"e_1_2_1_17_1","first-page":"3","article-title":"Response interpolation and scale sensitivity: Evidence against 5-point scales","volume":"5","author":"Finstad Kraig","year":"2010","unstructured":"Kraig Finstad . 2010 . Response interpolation and scale sensitivity: Evidence against 5-point scales . J. Usab. Stud. 5 , 3 (May 2010), 104--110. Kraig Finstad. 2010. Response interpolation and scale sensitivity: Evidence against 5-point scales. J. Usab. Stud. 5, 3 (May 2010), 104--110.","journal-title":"J. Usab. Stud."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2012.2195314"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.4037\/ajcc2010651"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2909132.2909254"},{"key":"e_1_2_1_21_1","volume-title":"Kell","author":"Holzinger Andreas","year":"2017","unstructured":"Andreas Holzinger , Chris Biemann , Constantinos S. Pattichis , and Douglas B . Kell . 2017 . What do we need to build explainable AI systems for the medical domain? arXiv e-prints (Dec 2017), arXiv:1712.09923. Andreas Holzinger, Chris Biemann, Constantinos S. Pattichis, and Douglas B. Kell. 2017. What do we need to build explainable AI systems for the medical domain? arXiv e-prints (Dec 2017), arXiv:1712.09923."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/widm.1312"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41568-018-0016-5"},{"key":"e_1_2_1_24_1","unstructured":"N. Howlader A. M. Noone M. Krapcho D. Miller A. Brest M. Yu J. Ruhl Z. Tatalovich A. Mariotto D. R. Lewis H. S. Chen E. J. Feuer and K. A. Cronin. 2018. SEER Cancer Statistics Review 1975--2016 National Cancer Institute. Retrieved from https:\/\/seer.cancer.gov\/csr\/1975_2016\/.  N. Howlader A. M. Noone M. Krapcho D. Miller A. Brest M. Yu J. Ruhl Z. Tatalovich A. Mariotto D. R. Lewis H. S. Chen E. J. Feuer and K. A. Cronin. 2018. SEER Cancer Statistics Review 1975--2016 National Cancer Institute. Retrieved from https:\/\/seer.cancer.gov\/csr\/1975_2016\/."},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","first-page":"2479","DOI":"10.1002\/cncr.30070","article-title":"Colorectal cancer screening: Estimated future colonoscopy need and current volume and capacity","volume":"122","author":"Joseph Djenaba A.","year":"2016","unstructured":"Djenaba A. Joseph , Reinier G. S. Meester , Ann G. Zauber , Diane L. Manninen , Linda Winges , Fred B. Dong , Brandy Peaker , and Marjolein van Ballegooijen . 2016 . Colorectal cancer screening: Estimated future colonoscopy need and current volume and capacity . Cancer 122 , 16 (2016), 2479 -- 2486 . DOI:https:\/\/doi.org\/10.1002\/cncr.30070 10.1002\/cncr.30070 Djenaba A. Joseph, Reinier G. S. Meester, Ann G. Zauber, Diane L. Manninen, Linda Winges, Fred B. Dong, Brandy Peaker, and Marjolein van Ballegooijen. 2016. Colorectal cancer screening: Estimated future colonoscopy need and current volume and capacity. Cancer 122, 16 (2016), 2479--2486. DOI:https:\/\/doi.org\/10.1002\/cncr.30070","journal-title":"Cancer"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753686"},{"key":"e_1_2_1_27_1","volume-title":"Wobbrock","author":"Kay Matthew","year":"2019","unstructured":"Matthew Kay and Jacob O . Wobbrock . 2019 . ARTool: Aligned Rank Transform for Nonparametric Factorial ANOVAs . DOI:https:\/\/doi.org\/10.5281\/zenodo.594511 R package version 0.10.6. 10.5281\/zenodo.594511 Matthew Kay and Jacob O. Wobbrock. 2019. ARTool: Aligned Rank Transform for Nonparametric Factorial ANOVAs. DOI:https:\/\/doi.org\/10.5281\/zenodo.594511 R package version 0.10.6."},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919)","author":"Kittley-Davies Jacob","year":"2019","unstructured":"Jacob Kittley-Davies , Ahmed Alqaraawi , Rayoung Yang , Enrico Costanza , Alex Rogers , and Sebastian Stein . 2019 . Evaluating the effect of feedback from different computer vision processing stages: A comparative lab study . In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919) . ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3290605.3300273 10.1145\/3290605.3300273 Jacob Kittley-Davies, Ahmed Alqaraawi, Rayoung Yang, Enrico Costanza, Alex Rogers, and Sebastian Stein. 2019. Evaluating the effect of feedback from different computer vision processing stages: A comparative lab study. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919). ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3290605.3300273"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1097\/00006199-199003000-00019"},{"key":"e_1_2_1_30_1","doi-asserted-by":"crossref","first-page":"1094","DOI":"10.1016\/j.gie.2011.06.033","article-title":"Participation by experienced endoscopy nurses increases the detection rate of colon polyps during a screening colonoscopy: A multicenter, prospective, randomized study","volume":"74","author":"Lee Chang Kyun","year":"2011","unstructured":"Chang Kyun Lee , Dong Il Park , Suck-Ho Lee , Young Hwangbo , Chang Soo Eun , Dong Soo Han , Jae Myung Cha , Bo-In Lee , and Jeong Eun Shin . 2011 . Participation by experienced endoscopy nurses increases the detection rate of colon polyps during a screening colonoscopy: A multicenter, prospective, randomized study . Gastroint. Endosc. 74 , 5 (2011), 1094 -- 1102 . DOI:https:\/\/doi.org\/10.1016\/j.gie.2011.06.033 10.1016\/j.gie.2011.06.033 Chang Kyun Lee, Dong Il Park, Suck-Ho Lee, Young Hwangbo, Chang Soo Eun, Dong Soo Han, Jae Myung Cha, Bo-In Lee, and Jeong Eun Shin. 2011. Participation by experienced endoscopy nurses increases the detection rate of colon polyps during a screening colonoscopy: A multicenter, prospective, randomized study. Gastroint. Endosc. 74, 5 (2011), 1094--1102. DOI:https:\/\/doi.org\/10.1016\/j.gie.2011.06.033","journal-title":"Gastroint. Endosc."},{"key":"e_1_2_1_31_1","first-page":"5","article-title":"Factors influencing the miss rate of polyps in a back-to-back colonoscopy study","volume":"44","author":"Leufkens A. M.","year":"2012","unstructured":"A. M. Leufkens , M. G. van Oijen , F. P. Vleggaar , and P. D. Siersema . 2012 . Factors influencing the miss rate of polyps in a back-to-back colonoscopy study . Endoscopy 44 , 5 (May 2012), 470--475. DOI:https:\/\/doi.org\/10.1055\/s-0031-1291666 10.1055\/s-0031-1291666 A. M. Leufkens, M. G. van Oijen, F. P. Vleggaar, and P. D. Siersema. 2012. Factors influencing the miss rate of polyps in a back-to-back colonoscopy study. Endoscopy 44, 5 (May 2012), 470--475. DOI:https:\/\/doi.org\/10.1055\/s-0031-1291666","journal-title":"Endoscopy"},{"key":"e_1_2_1_32_1","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1056\/NEJM199305133281901","article-title":"Reducing mortality from colorectal cancer by screening for fecal occult blood. Minnesota Colon Cancer Control Study","volume":"328","author":"Mandel J. S.","year":"1993","unstructured":"J. S. Mandel , J. H. Bond , T. R. Church , D. C. Snover , G. M. Bradley , L. M. Schuman , and F. Ederer . 1993 . Reducing mortality from colorectal cancer by screening for fecal occult blood. Minnesota Colon Cancer Control Study . New Eng. J. Med. 328 , 19 (May 1993), 1365--1371. J. S. Mandel, J. H. Bond, T. R. Church, D. C. Snover, G. M. Bradley, L. M. Schuman, and F. Ederer. 1993. Reducing mortality from colorectal cancer by screening for fecal occult blood. Minnesota Colon Cancer Control Study. New Eng. J. Med. 328, 19 (May 1993), 1365--1371.","journal-title":"New Eng. J. Med."},{"key":"e_1_2_1_33_1","volume-title":"Rebooting AI: Building Artificial Intelligence We Can Trust","author":"Marcus Gary","year":"2019","unstructured":"Gary Marcus and Ernest Davis . 2019 . Rebooting AI: Building Artificial Intelligence We Can Trust . Pantheon . Gary Marcus and Ernest Davis. 2019. Rebooting AI: Building Artificial Intelligence We Can Trust. Pantheon."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919)","author":"McCormack Jon","year":"2019","unstructured":"Jon McCormack , Toby Gifford , Patrick Hutchings , Maria Teresa Llano Rodriguez , Matthew Yee-King , and Mark d\u2019 Inverno . 2019 . In a silent way: Communication between AI and improvising musicians beyond sound . In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919) . ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3290605.3300268 10.1145\/3290605.3300268 Jon McCormack, Toby Gifford, Patrick Hutchings, Maria Teresa Llano Rodriguez, Matthew Yee-King, and Mark d\u2019Inverno. 2019. In a silent way: Communication between AI and improvising musicians beyond sound. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919). ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3290605.3300268"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1055\/s-0038-1634767"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1053\/j.gastro.2018.04.003"},{"key":"e_1_2_1_37_1","volume-title":"Greenes","author":"Musen Mark A.","year":"2014","unstructured":"Mark A. Musen , Blackford Middleton , and Robert A . Greenes . 2014 . Clinical Decision-Support Systems. Springer London , London, 643--674. DOI:https:\/\/doi.org\/10.1007\/978-1-4471-4474-8_22 10.1007\/978-1-4471-4474-8_22 Mark A. Musen, Blackford Middleton, and Robert A. Greenes. 2014. Clinical Decision-Support Systems. Springer London, London, 643--674. DOI:https:\/\/doi.org\/10.1007\/978-1-4471-4474-8_22"},{"key":"e_1_2_1_38_1","volume-title":"Human-Computer Interaction -- INTERACT","author":"Newn Joshua","year":"2019","unstructured":"Joshua Newn , Ronal Singh , Fraser Allison , Prashan Madumal , Eduardo Velloso , and Frank Vetere . 2019. Designing interactions with intention-aware gaze-enabled artificial agents . In Human-Computer Interaction -- INTERACT 2019 . Springer International Publishing , Cham , 255--281. Joshua Newn, Ronal Singh, Fraser Allison, Prashan Madumal, Eduardo Velloso, and Frank Vetere. 2019. Designing interactions with intention-aware gaze-enabled artificial agents. In Human-Computer Interaction -- INTERACT 2019. Springer International Publishing, Cham, 255--281."},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201918)","author":"Oh Changhoon","year":"2018","unstructured":"Changhoon Oh , Jungwoo Song , Jinhan Choi , Seonghyeon Kim , Sungwoo Lee , and Bongwon Suh . 2018 . I lead, you help but only with enough details: Understanding user experience of co-creation with artificial intelligence . In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201918) . ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3173574.3174223 10.1145\/3173574.3174223 Changhoon Oh, Jungwoo Song, Jinhan Choi, Seonghyeon Kim, Sungwoo Lee, and Bongwon Suh. 2018. I lead, you help but only with enough details: Understanding user experience of co-creation with artificial intelligence. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201918). ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3173574.3174223"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979298"},{"key":"e_1_2_1_41_1","first-page":"5","article-title":"A colon video analysis framework for polyp detection","volume":"59","author":"Park S. Y.","year":"2012","unstructured":"S. Y. Park , D. Sargent , I. Spofford , K. G. Vosburgh , and Y. A.- Rahim . 2012 . A colon video analysis framework for polyp detection . IEEE Trans. Biomed. Eng. 59 , 5 (May 2012), 1408--1418. DOI:https:\/\/doi.org\/10.1109\/TBME.2012.2188397 10.1109\/TBME.2012.2188397 S. Y. Park, D. Sargent, I. Spofford, K. G. Vosburgh, and Y. A.-Rahim. 2012. A colon video analysis framework for polyp detection. IEEE Trans. Biomed. Eng. 59, 5 (May 2012), 1408--1418. DOI:https:\/\/doi.org\/10.1109\/TBME.2012.2188397","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1198\/1061860043515"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1055\/s-2007-966182"},{"key":"e_1_2_1_44_1","volume-title":"Hershel Mehta, Tony Duan, Daisy Ding, Aarti Bagul, Curtis Langlotz, Katie Shpanskaya, Matthew P. Lungren, and Andrew Y. Ng.","author":"Rajpurkar Pranav","year":"2017","unstructured":"Pranav Rajpurkar , Jeremy Irvin , Kaylie Zhu , Brand on Yang , Hershel Mehta, Tony Duan, Daisy Ding, Aarti Bagul, Curtis Langlotz, Katie Shpanskaya, Matthew P. Lungren, and Andrew Y. Ng. 2017 . CheXNet: Radiologist-level pneumonia detection on chest X-rays with deep learning. arXiv e-prints (Nov. 2017), arXiv:1711.05225. Pranav Rajpurkar, Jeremy Irvin, Kaylie Zhu, Brand on Yang, Hershel Mehta, Tony Duan, Daisy Ding, Aarti Bagul, Curtis Langlotz, Katie Shpanskaya, Matthew P. Lungren, and Andrew Y. Ng. 2017. CheXNet: Radiologist-level pneumonia detection on chest X-rays with deep learning. arXiv e-prints (Nov. 2017), arXiv:1711.05225."},{"key":"e_1_2_1_45_1","doi-asserted-by":"crossref","first-page":"1923","DOI":"10.1136\/gutjnl-2016-312044","article-title":"UK key performance indicators and quality assurance standards for colonoscopy","volume":"65","author":"Rees Colin J.","year":"2016","unstructured":"Colin J. Rees , Siwan Thomas Gibson , Matt D. Rutter , Phil Baragwanath , Rupert Pullan , Mark Feeney , and Neil Haslam . 2016 . UK key performance indicators and quality assurance standards for colonoscopy . Gut 65 , 12 (2016), 1923 -- 1929 . DOI:https:\/\/doi.org\/10.1136\/gutjnl-2016-312044 10.1136\/gutjnl-2016-312044 Colin J. Rees, Siwan Thomas Gibson, Matt D. Rutter, Phil Baragwanath, Rupert Pullan, Mark Feeney, and Neil Haslam. 2016. UK key performance indicators and quality assurance standards for colonoscopy. Gut 65, 12 (2016), 1923--1929. DOI:https:\/\/doi.org\/10.1136\/gutjnl-2016-312044","journal-title":"Gut"},{"key":"e_1_2_1_46_1","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1016\/j.bpg.2017.05.010","article-title":"Polyp detection at colonoscopy: Endoscopist and technical factors","volume":"31","author":"Rex Douglas K.","year":"2017","unstructured":"Douglas K. Rex . 2017 . Polyp detection at colonoscopy: Endoscopist and technical factors . Best Pract. Res. Clin. Gastroent. 31 , 4 (2017), 425 -- 433 . DOI:https:\/\/doi.org\/10.1016\/j.bpg.2017.05.010 10.1016\/j.bpg.2017.05.010 Douglas K. Rex. 2017. Polyp detection at colonoscopy: Endoscopist and technical factors. Best Pract. Res. Clin. Gastroent. 31, 4 (2017), 425--433. DOI:https:\/\/doi.org\/10.1016\/j.bpg.2017.05.010","journal-title":"Best Pract. Res. Clin. Gastroent."},{"key":"e_1_2_1_47_1","volume-title":"Randy Van Ommeren, and Phedias Diamandis","author":"Sarwar Shihab","year":"2019","unstructured":"Shihab Sarwar , Anglin Dent , Kevin Faust , Maxime Richer , Ugljesa Djuric , Randy Van Ommeren, and Phedias Diamandis . 2019 . Physician perspectives on integration of artificial intelligence into diagnostic pathology. npj Digital Medicine 2, 1 (2019), 28. DOI:https:\/\/doi.org\/10.1038\/s41746-019-0106-0 10.1038\/s41746-019-0106-0 Shihab Sarwar, Anglin Dent, Kevin Faust, Maxime Richer, Ugljesa Djuric, Randy Van Ommeren, and Phedias Diamandis. 2019. Physician perspectives on integration of artificial intelligence into diagnostic pathology. npj Digital Medicine 2, 1 (2019), 28. DOI:https:\/\/doi.org\/10.1038\/s41746-019-0106-0"},{"key":"e_1_2_1_48_1","article-title":"Real-time camera tracking using sports pitch markings","volume":"2","author":"Thomas Graham","year":"2007","unstructured":"Graham Thomas . 2007 . Real-time camera tracking using sports pitch markings . J. Real-time Image Proc. 2 , 2 (1 Nov. 2007), 117--132. DOI:https:\/\/doi.org\/10.1007\/s11554-007-0041-1 10.1007\/s11554-007-0041-1 Graham Thomas. 2007. Real-time camera tracking using sports pitch markings. J. Real-time Image Proc. 2, 2 (1 Nov. 2007), 117--132. DOI:https:\/\/doi.org\/10.1007\/s11554-007-0041-1","journal-title":"J. Real-time Image Proc."},{"key":"e_1_2_1_49_1","volume-title":"Proc. ACM Hum.-comput. Interact. 3, CSCW","author":"van Berkel Niels","year":"2019","unstructured":"Niels van Berkel , Jorge Goncalves , Danula Hettiachchi , Senuri Wijenayake , Ryan M. Kelly , and Vassilis Kostakos . 2019 . Crowdsourcing perceptions of fair predictors for machine learning: A recidivism case study . Proc. ACM Hum.-comput. Interact. 3, CSCW (2019), 21. DOI:https:\/\/doi.org\/10.1145\/3359130 10.1145\/3359130 Niels van Berkel, Jorge Goncalves, Danula Hettiachchi, Senuri Wijenayake, Ryan M. Kelly, and Vassilis Kostakos. 2019. Crowdsourcing perceptions of fair predictors for machine learning: A recidivism case study. Proc. ACM Hum.-comput. Interact. 3, CSCW (2019), 21. DOI:https:\/\/doi.org\/10.1145\/3359130"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the 11th Nordic Conference on Human-computer Interaction (NordiCHI\u201920)","author":"van Berkel Niels","unstructured":"Niels van Berkel , Lefteris Papachristos , Anastasia Giachanou , Simo Hosio , and Mikael B. Skov . 2020. A systematic assessment of national artificial intelligence policies: Perspectives from the Nordics and beyond . In Proceedings of the 11th Nordic Conference on Human-computer Interaction (NordiCHI\u201920) . 1--18. Niels van Berkel, Lefteris Papachristos, Anastasia Giachanou, Simo Hosio, and Mikael B. Skov. 2020. A systematic assessment of national artificial intelligence policies: Perspectives from the Nordics and beyond. In Proceedings of the 11th Nordic Conference on Human-computer Interaction (NordiCHI\u201920). 1--18."},{"key":"e_1_2_1_51_1","article-title":"Polyp miss rate determined by tandem colonoscopy: A systematic review","volume":"101","author":"van Rijn Jeroen C.","year":"2006","unstructured":"Jeroen C. van Rijn , Johannes B. Reitsma , Jaap Stoker , Patrick M. Bossuyt , Sander J. van Deventer , and Evelien Dekker . 2006 . Polyp miss rate determined by tandem colonoscopy: A systematic review . Amer. J. Gastroent. 101 , 2 (2006). Jeroen C. van Rijn, Johannes B. Reitsma, Jaap Stoker, Patrick M. Bossuyt, Sander J. van Deventer, and Evelien Dekker. 2006. Polyp miss rate determined by tandem colonoscopy: A systematic review. Amer. J. Gastroent. 101, 2 (2006).","journal-title":"Amer. J. Gastroent."},{"key":"e_1_2_1_52_1","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1177\/0163278707307899","article-title":"Methodologies for improving response rates in surveys of physicians: A systematic review","volume":"30","author":"VanGeest Jonathan B.","year":"2007","unstructured":"Jonathan B. VanGeest , Timothy P. Johnson , and Verna L. Welch . 2007 . Methodologies for improving response rates in surveys of physicians: A systematic review . Eval. Health Prof. 30 , 4 (2007), 303 -- 321 . DOI:https:\/\/doi.org\/10.1177\/0163278707307899 10.1177\/0163278707307899 Jonathan B. VanGeest, Timothy P. Johnson, and Verna L. Welch. 2007. Methodologies for improving response rates in surveys of physicians: A systematic review. Eval. Health Prof. 30, 4 (2007), 303--321. DOI:https:\/\/doi.org\/10.1177\/0163278707307899","journal-title":"Eval. Health Prof."},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201918)","author":"Veale Michael","year":"2018","unstructured":"Michael Veale , Max Van Kleek , and Reuben Binns . 2018 . Fairness and accountability design needs for algorithmic support in high-stakes public sector decision-making . In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201918) . ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3173574.3174014 10.1145\/3173574.3174014 Michael Veale, Max Van Kleek, and Reuben Binns. 2018. Fairness and accountability design needs for algorithmic support in high-stakes public sector decision-making. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201918). ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3173574.3174014"},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919)","author":"Wang Danding","unstructured":"Danding Wang , Qian Yang , Ashraf Abdul , and Brian Y. Lim . 2019. Designing theory-driven user-centric explainable AI . In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919) . ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3290605.3300831 10.1145\/3290605.3300831 Danding Wang, Qian Yang, Ashraf Abdul, and Brian Y. Lim. 2019. Designing theory-driven user-centric explainable AI. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919). ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3290605.3300831"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1136\/gutjnl-2018-317500"},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI\u201911)","author":"Wobbrock Jacob O.","year":"1978","unstructured":"Jacob O. Wobbrock , Leah Findlater , Darren Gergle , and James J. Higgins . 2011. The aligned rank transform for nonparametric factorial analyses using only ANOVA procedures . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI\u201911) . ACM, New York, NY, 143--146. DOI:https:\/\/doi.org\/10.1145\/ 1978 942.1978963 10.1145\/1978942.1978963 Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The aligned rank transform for nonparametric factorial analyses using only ANOVA procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI\u201911). ACM, New York, NY, 143--146. DOI:https:\/\/doi.org\/10.1145\/1978942.1978963"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrn1411"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-017-0058"},{"key":"e_1_2_1_59_1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919)","author":"Yang Qian","year":"2019","unstructured":"Qian Yang , Aaron Steinfeld , and John Zimmerman . 2019 . Unremarkable AI: Fitting intelligent decision support into critical, clinical decision-making processes . In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919) . ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3290605.3300468 10.1145\/3290605.3300468 Qian Yang, Aaron Steinfeld, and John Zimmerman. 2019. Unremarkable AI: Fitting intelligent decision support into critical, clinical decision-making processes. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201919). ACM, New York, NY. DOI:https:\/\/doi.org\/10.1145\/3290605.3300468"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41551-018-0305-z"},{"key":"e_1_2_1_61_1","volume-title":"risk factors, and factors associated with adenoma miss rate of tandem colonoscopy: A systematic review and meta-analysis. Gastroenterology 156, 6 (1","author":"Zhao Shengbing","year":"2019","unstructured":"Shengbing Zhao , Shuling Wang , Peng Pan , Tian Xia , Xin Chang , Xia Yang , Liliangzi Guo , Qianqian Meng , Fan Yang , Wei Qian , Zhichao Xu , Yuanqiong Wang , Zhijie Wang , Lun Gu , Rundong Wang , Fangzhou Jia , Jun Yao , Zhaoshen Li , and Yu Bai . 2019. Magnitude , risk factors, and factors associated with adenoma miss rate of tandem colonoscopy: A systematic review and meta-analysis. Gastroenterology 156, 6 (1 May 2019 ), 1661--1674.e11. DOI:https:\/\/doi.org\/10.1053\/j.gastro.2019.01.260 10.1053\/j.gastro.2019.01.260 Shengbing Zhao, Shuling Wang, Peng Pan, Tian Xia, Xin Chang, Xia Yang, Liliangzi Guo, Qianqian Meng, Fan Yang, Wei Qian, Zhichao Xu, Yuanqiong Wang, Zhijie Wang, Lun Gu, Rundong Wang, Fangzhou Jia, Jun Yao, Zhaoshen Li, and Yu Bai. 2019. Magnitude, risk factors, and factors associated with adenoma miss rate of tandem colonoscopy: A systematic review and meta-analysis. Gastroenterology 156, 6 (1 May 2019), 1661--1674.e11. DOI:https:\/\/doi.org\/10.1053\/j.gastro.2019.01.260"},{"key":"e_1_2_1_62_1","volume-title":"Proc. ACM Hum.-comput. Interact. 2, CSCW (Nov.","author":"Zhu Haiyi","year":"2018","unstructured":"Haiyi Zhu , Bowen Yu , Aaron Halfaker , and Loren Terveen . 2018 . Value-sensitive algorithm design: Method, case study, and lessons . Proc. ACM Hum.-comput. Interact. 2, CSCW (Nov. 2018). DOI:https:\/\/doi.org\/10.1145\/3274463 10.1145\/3274463 Haiyi Zhu, Bowen Yu, Aaron Halfaker, and Loren Terveen. 2018. Value-sensitive algorithm design: Method, case study, and lessons. Proc. ACM Hum.-comput. Interact. 2, CSCW (Nov. 2018). DOI:https:\/\/doi.org\/10.1145\/3274463"}],"container-title":["ACM Transactions on Computing for Healthcare"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3422156","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3422156","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:03:20Z","timestamp":1750197800000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3422156"}},"subtitle":["A Colonoscopy Case Study"],"short-title":[],"issued":{"date-parts":[[2020,12,30]]},"references-count":62,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1,31]]}},"alternative-id":["10.1145\/3422156"],"URL":"https:\/\/doi.org\/10.1145\/3422156","relation":{},"ISSN":["2691-1957","2637-8051"],"issn-type":[{"value":"2691-1957","type":"print"},{"value":"2637-8051","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,30]]},"assertion":[{"value":"2020-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-12-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}