{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T06:56:28Z","timestamp":1771484188519,"version":"3.50.1"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,11,4]],"date-time":"2022-11-04T00:00:00Z","timestamp":1667520000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2022,12,31]]},"abstract":"<jats:p>Online research is a frequent and important activity people perform on the Internet, yet current support for this task is basic, fragmented and not well integrated into web browser experiences. Guided by sensemaking theory, we present ForSense, a browser extension for accelerating people\u2019s online research experience. The two primary sources of novelty of ForSense\u00a0 are the integration of multiple stages of online research and providing machine assistance to the user by leveraging recent advances in neural-driven machine reading. We use ForSense\u00a0 as a design probe to explore (1) the benefits of integrating multiple stages of online research, (2) the opportunities to accelerate online research using current advances in machine reading, (3) the opportunities to support online research tasks in the presence of imprecise machine suggestions, and (4) insights about the behaviors people exhibit when performing online research, the pages they visit, and the artifacts they create. Through our design probe, we observe people performing online research tasks, and see that they benefit from ForSense\u2019s integration and machine support for online research. From the information and insights we collected, we derive and share key recommendations for designing and supporting imprecise machine assistance for research tasks.<\/jats:p>","DOI":"10.1145\/3532853","type":"journal-article","created":{"date-parts":[[2022,5,11]],"date-time":"2022-05-11T11:52:35Z","timestamp":1652269955000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["ForSense: Accelerating Online Research Through Sensemaking Integration and Machine Research Support"],"prefix":"10.1145","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4198-5021","authenticated-orcid":false,"given":"Gonzalo","family":"Ramos","sequence":"first","affiliation":[{"name":"Microsoft Research, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7183-8789","authenticated-orcid":false,"given":"Napol","family":"Rachatasumrit","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7646-5563","authenticated-orcid":false,"given":"Jina","family":"Suh","sequence":"additional","affiliation":[{"name":"Microsoft Research, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5895-2480","authenticated-orcid":false,"given":"Rachel","family":"Ng","sequence":"additional","affiliation":[{"name":"Microsoft Research, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1696-6152","authenticated-orcid":false,"given":"Christopher","family":"Meek","sequence":"additional","affiliation":[{"name":"Microsoft Research, USA"}]}],"member":"320","published-online":{"date-parts":[[2022,11,4]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"M. J. Adler and C. Van Doren. 2014. How to read a book: The classic guide to intelligent reading (Touchstone ed.)."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300233"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/258549.258563"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/1029383.1074069"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240789"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.5555\/2817912.2817913"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858498"},{"key":"e_1_3_2_9_2","first-page":"4171","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171\u20134186."},{"key":"e_1_3_2_10_2","first-page":"44","volume-title":"Personal Information Management-Special Interest Group for Information Retrieval Workshop","author":"Dontcheva Mira","year":"2006","unstructured":"Mira Dontcheva, Steven M. Drucker, Geraldine Wade, David Salesin, and Michael F. Cohen. 2006. Collecting and organizing web content. In Personal Information Management-Special Interest Group for Information Retrieval Workshop. 44\u201347."},{"key":"e_1_3_2_11_2","unstructured":"Evernote. 2020. Evernote is the home for everything you need to remember and everything you want to achieve.https:\/\/evernote.com\/. Accessed October 2020."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/2528394.2528398"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300809"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/302979.303030"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240730"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3334480.3383104"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.5555\/1241540.1241550"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531644"},{"key":"e_1_3_2_19_2","first-page":"113","volume-title":"A Data-frame Theory of Sensemaking.","author":"Klein Gary","year":"2007","unstructured":"Gary Klein, Jennifer K. Phillips, Erica L. Rall, and Deborah A. Peluso. 2007. A Data-frame Theory of Sensemaking.Lawrence Erlbaum Associates Publishers, Mahwah, NJ, US, 113\u2013155."},{"key":"e_1_3_2_20_2","volume-title":"Sprint: How to Solve Big Problems and Test New Ideas in Just Five Days","author":"Knapp J.","year":"2016","unstructured":"J. Knapp, J. Zeratsky, and B. Kowitz. 2016. Sprint: How to Solve Big Problems and Test New Ideas in Just Five Days. Simon & Schuster."},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/1056808.1057106"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/2757226.2757251"},{"key":"e_1_3_2_23_2","unstructured":"Jiasen Lu Dhruv Batra Devi Parikh and Stefan Lee. 2019. ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks. arxiv:1908.02265 [cs.CV]"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7552(97)00050-0"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1054989"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2016.7883515"},{"key":"e_1_3_2_27_2","unstructured":"Notion. 2020. Notion: All in one workplace.https:\/\/www.notion.so\/. Accessed October 2020."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.5555\/1816508"},{"key":"e_1_3_2_29_2","unstructured":"Pinterest. 2020. Pinterest: Welcome to visual discovery. https:\/\/www.pinterest.com\/. Accessed October 2020."},{"key":"e_1_3_2_30_2","first-page":"2","volume-title":"Proceedings of International Conference on Intelligence Analysis","volume":"5","author":"Pirolli Peter","year":"2005","unstructured":"Peter Pirolli and Stuart Card. 2005. The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis. In Proceedings of International Conference on Intelligence Analysis, Vol. 5. McLean, VA, USA, 2\u20134."},{"key":"e_1_3_2_31_2","unstructured":"Pocket. 2020. Pocket. https:\/\/app.getpocket.com\/. Accessed October 2020."},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/286498.286510"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1080\/07370024.2020.1734931"},{"key":"e_1_3_2_34_2","article-title":"Do machine teachers dream of algorithms?","author":"Ramos Gonzalo","year":"2019","unstructured":"Gonzalo Ramos, Felicia Ng, Nicole Sultanum, Chris Meek, Jina Suh, and Soroush Ghorashi. 2019. Do machine teachers dream of algorithms? Workshop on Human-Centric Machine Learning at the 33rd Conference on Neural Information Processing Systems. (December 2019).","journal-title":"Workshop on Human-Centric Machine Learning at the 33rd Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_35_2","unstructured":"Pew Research. 2020. 53% of Americans Say the Internet Has Been Essential During the COVID-19 Outbreak. https:\/\/tinyurl.com\/y7lvxmkr. Accessed October 2020."},{"key":"e_1_3_2_36_2","unstructured":"Pew Research. 2020. Most Americans rely on their own research to make big decisions and that often means online searches. https:\/\/tinyurl.com\/yaay6vbr. Accessed September 2020."},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/169059.169209"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/504216.504247"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/511446.511469"},{"key":"e_1_3_2_40_2","doi-asserted-by":"crossref","unstructured":"Chen Sun Austin Myers Carl Vondrick Kevin Murphy and Cordelia Schmid. 2019. VideoBERT: A Joint Model for Video and Language Representation Learning. arxiv:1904.01766 [cs.CV]","DOI":"10.1109\/ICCV.2019.00756"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-29387-1_34"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.4324\/9781315665177"},{"key":"e_1_3_2_43_2","unstructured":"Han Xiao. 2018. bert-as-service. https:\/\/github.com\/hanxiao\/bert-as-service."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357161"},{"key":"e_1_3_2_45_2","unstructured":"Luowei Zhou Hamid Palangi Lei Zhang Houdong Hu Jason J. Corso and Jianfeng Gao. 2019. Unified Vision-Language Pre-Training for Image Captioning and VQA. arxiv:1909.11059 [cs.CV]"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3532853","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3532853","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:00:37Z","timestamp":1750186837000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3532853"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,4]]},"references-count":44,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,12,31]]}},"alternative-id":["10.1145\/3532853"],"URL":"https:\/\/doi.org\/10.1145\/3532853","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,4]]},"assertion":[{"value":"2021-07-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-04-11","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-11-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}