{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T15:10:15Z","timestamp":1775056215441,"version":"3.50.1"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2017,9,18]],"date-time":"2017-09-18T00:00:00Z","timestamp":1505692800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["SES-1461535, DRL-1631428, SBE-0542013 and SMA-1041755"],"award-info":[{"award-number":["SES-1461535, DRL-1631428, SBE-0542013 and SMA-1041755"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Appl. Percept."],"published-print":{"date-parts":[[2018,1,31]]},"abstract":"<jats:p>Advances in machine learning have produced systems that attain human-level performance on certain visual tasks, e.g., object identification. Nonetheless, other tasks requiring visual expertise are unlikely to be entrusted to machines for some time, e.g., satellite and medical imagery analysis. We describe a human-machine cooperative approach to visual search, the aim of which is to outperform either human or machine acting alone. The traditional route to augmenting human performance with automatic classifiers is to draw boxes around regions of an image deemed likely to contain a target. Human experts typically reject this type of hard highlighting. We propose instead a soft highlighting technique in which the saliency of regions of the visual field is modulated in a graded fashion based on classifier confidence level. We report on experiments with both synthetic and natural images showing that soft highlighting achieves a performance synergy surpassing that attained by hard highlighting.<\/jats:p>","DOI":"10.1145\/3129669","type":"journal-article","created":{"date-parts":[[2017,9,18]],"date-time":"2017-09-18T12:20:54Z","timestamp":1505737254000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Improving Human-Machine Cooperative Visual Search With Soft Highlighting"],"prefix":"10.1145","volume":"15","author":[{"given":"Ronald T.","family":"Kneusel","sequence":"first","affiliation":[{"name":"University of Colorado, Boulder, CO"}]},{"given":"Michael C.","family":"Mozer","sequence":"additional","affiliation":[{"name":"University of Colorado, Boulder, CO"}]}],"member":"320","published-online":{"date-parts":[[2017,9,18]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.acra.2004.05.012"},{"key":"e_1_2_1_2_1","first-page":"379","article-title":"Land-use classification schemes","volume":"37","author":"Anderson J. R.","year":"1971","unstructured":"J. R. Anderson . 1971 . Land-use classification schemes . Photogram. Eng. 37 , 4 (1971), 379 -- 387 . J. R. Anderson. 1971. Land-use classification schemes. Photogram. Eng. 37, 4 (1971), 379--387.","journal-title":"Photogram. Eng."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejrad.2004.11.021"},{"key":"e_1_2_1_4_1","volume-title":"Handbook of Medical Image Processing and Analysis","author":"Bankman I.","unstructured":"I. Bankman . 2008. Handbook of Medical Image Processing and Analysis , 2 nd ed. Academic Press , San Diego, CA . I. Bankman. 2008. Handbook of Medical Image Processing and Analysis, 2nd ed. Academic Press, San Diego, CA.","edition":"2"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0098-3004(01)00051-6"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(03)00192-4"},{"key":"e_1_2_1_7_1","doi-asserted-by":"crossref","unstructured":"C. A. Cunningham T. Drew and J. M. Wolfe. 2016. Analog computer-aided detection (CAD) information can be more effective than binary marks (2016). Submitted for publication.  C. A. Cunningham T. Drew and J. M. Wolfe. 2016. Analog computer-aided detection (CAD) information can be more effective than binary marks (2016). Submitted for publication.","DOI":"10.3758\/s13414-016-1250-0"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.2213011476"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.acra.2012.05.013"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1071-5819(03)00038-7"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.2203001282"},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","unstructured":"M. L. Giger K. Doi H. MacMahon R. M. Nishikawa K. R. Hoffmann R. A. Vyborny C. J. Schmidt H. Jia K. Abe and X. Chen. 1993. An \u201cintelligent\u201d workstation for computer-aided diagnosis.Radiographics 13 3 (1993) 647--656.  M. L. Giger K. Doi H. MacMahon R. M. Nishikawa K. R. Hoffmann R. A. Vyborny C. J. Schmidt H. Jia K. Abe and X. Chen. 1993. An \u201cintelligent\u201d workstation for computer-aided diagnosis.Radiographics 13 3 (1993) 647--656.","DOI":"10.1148\/radiographics.13.3.8316671"},{"key":"e_1_2_1_13_1","unstructured":"D. M. Green and J. A. Swets. 1966. Signal Detection Theory and Psychophysics. Wiley New York.  D. M. Green and J. A. Swets. 1966. Signal Detection Theory and Psychophysics. Wiley New York."},{"key":"e_1_2_1_14_1","unstructured":"T. Hengl and N. Toomanian. 2006. Maps are not what they seem: Representing uncertainty in soil-property maps. In Proceedings of the 7th International Symposium on Spatial Accuracy Assessment in Natural Resources and Environmental Sciences M. Caetano and M. Painho (Eds.). Instituto Geographico Portugues IGP 805--813.  T. Hengl and N. Toomanian. 2006. Maps are not what they seem: Representing uncertainty in soil-property maps. In Proceedings of the 7th International Symposium on Spatial Accuracy Assessment in Natural Resources and Environmental Sciences M. Caetano and M. Painho (Eds.). Instituto Geographico Portugues IGP 805--813."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.12120218"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5121\/acij.2011.2613"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03205200"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature14539"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1386-5056(00)00067-8"},{"key":"e_1_2_1_22_1","first-page":"1828","article-title":"Diagnostic accuracy of digital screening mammography with and without computer-aided detection","volume":"11","author":"Lehman C. D.","year":"2016","unstructured":"C. D. Lehman , R. D. Wellman , D. S. M. Buist , K. Kerlikowske , A. N. A. Tosteson , and D. L. Miglioretti . 2016 . Diagnostic accuracy of digital screening mammography with and without computer-aided detection . JAMA Intern. Med. 11 (2016), 1828 -- 1837 . C. D. Lehman, R. D. Wellman, D. S. M. Buist, K. Kerlikowske, A. N. A. Tosteson, and D. L. Miglioretti. 2016. Diagnostic accuracy of digital screening mammography with and without computer-aided detection. JAMA Intern. Med. 11 (2016), 1828--1837.","journal-title":"JAMA Intern. Med."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1559\/1523040054738936"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0087426"},{"key":"e_1_2_1_25_1","volume-title":"The Perception of Multiple Objects: A Connectionist Approach","author":"Mozer M. C.","unstructured":"M. C. Mozer . 1991. The Perception of Multiple Objects: A Connectionist Approach . MIT Press , Cambridge, MA . M. C. Mozer. 1991. The Perception of Multiple Objects: A Connectionist Approach. MIT Press, Cambridge, MA."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1518\/001872097778543886"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.2531090689"},{"key":"e_1_2_1_28_1","doi-asserted-by":"crossref","unstructured":"J. A. Richards and X. Jia. 1999. Remote Sensing Digital Image Analysis: An Introduction 4th ed. Springer Berlin.   J. A. Richards and X. Jia. 1999. Remote Sensing Digital Image Analysis: An Introduction 4th ed. Springer Berlin.","DOI":"10.1007\/978-3-662-03978-6"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.acra.2009.08.006"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of SPIE 7263","author":"Samulski M.","year":"2009","unstructured":"M. Samulski , A. Hupse , C. Boetes , G. den Heeten , and N. Karssemeijer . 2009. Analysis of probed regions in an interactive CAD system for the detection of masses in mammograms . Proceedings of SPIE 7263 ( 2009 ), 726314--726314--9. M. Samulski, A. Hupse, C. Boetes, G. den Heeten, and N. Karssemeijer. 2009. Analysis of probed regions in an interactive CAD system for the detection of masses in mammograms. Proceedings of SPIE 7263 (2009), 726314--726314--9."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00330-010-1821-8"},{"key":"e_1_2_1_32_1","unstructured":"J. Snoek H. Larochelle and R. P. Adams. 2012. Practical bayesian optimization of machine learning algorithms. In Advances in Neural Information Processing Systems 25 F. Pereira C. J. C. Burges L. Bottou and K. Q. Weinberger (Eds.). Curran Associates Inc. La Jolla CA 2951--2959.   J. Snoek H. Larochelle and R. P. Adams. 2012. Practical bayesian optimization of machine learning algorithms. In Advances in Neural Information Processing Systems 25 F. Pereira C. J. C. Burges L. Bottou and K. Q. Weinberger (Eds.). Curran Associates Inc. La Jolla CA 2951--2959."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0285(80)90005-5"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0098-3004(97)00120-9"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/0034-4257(78)90003-2"},{"key":"e_1_2_1_36_1","first-page":"1192","article-title":"Brain image enhancement\u2014A survey","volume":"17","author":"Yasmin M.","year":"2012","unstructured":"M. Yasmin , M. Sharif , S. Masood , M. Raza , and S. Mohsin . 2012 . Brain image enhancement\u2014A survey . World Appl. Sci. J. 17 , 9 (2012), 1192 -- 1204 . M. Yasmin, M. Sharif, S. Masood, M. Raza, and S. Mohsin. 2012. Brain image enhancement\u2014A survey. World Appl. Sci. J. 17, 9 (2012), 1192--1204.","journal-title":"World Appl. Sci. J."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.2213010308"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1076-6332(03)00677-9"}],"container-title":["ACM Transactions on Applied Perception"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3129669","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3129669","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3129669","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:30:32Z","timestamp":1750217432000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3129669"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,9,18]]},"references-count":37,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,1,31]]}},"alternative-id":["10.1145\/3129669"],"URL":"https:\/\/doi.org\/10.1145\/3129669","relation":{},"ISSN":["1544-3558","1544-3965"],"issn-type":[{"value":"1544-3558","type":"print"},{"value":"1544-3965","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,9,18]]},"assertion":[{"value":"2016-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-09-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}