{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T21:28:37Z","timestamp":1776115717285,"version":"3.50.1"},"reference-count":73,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2023,9,25]],"date-time":"2023-09-25T00:00:00Z","timestamp":1695600000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2023,12,31]]},"abstract":"<jats:p>We explore the design of Marvista\u2014a human-AI collaborative tool that employs a suite of natural language processing models to provide end-to-end support for reading online news articles. Before reading an article, Marvista helps a user plan what to read by filtering text based on how much time one can spend and what questions one is interested to find out from the article. During reading, Marvista helps the user reflect on their understanding of each paragraph with AI-generated questions. After reading, Marvista generates an explainable human-AI summary that combines AI\u2019s processing of the text, the user\u2019s reading behavior, and user-generated data in the reading process. In contrast to prior work that offered (content-independent) interaction techniques or devices for reading, Marvista takes a human-AI collaborative approach that contributes text-specific guidance (content-aware) to support the entire reading process.<\/jats:p>","DOI":"10.1145\/3609331","type":"journal-article","created":{"date-parts":[[2023,7,21]],"date-time":"2023-07-21T12:01:25Z","timestamp":1689940885000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Marvista: Exploring the Design of a Human-AI Collaborative News Reading Tool"],"prefix":"10.1145","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8527-1744","authenticated-orcid":false,"given":"Xiang \u201cAnthony\u201d","family":"Chen","sequence":"first","affiliation":[{"name":"UCLA HCI Research"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5598-5324","authenticated-orcid":false,"given":"Chien-Sheng","family":"Wu","sequence":"additional","affiliation":[{"name":"Salesforce Research"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6885-2507","authenticated-orcid":false,"given":"Lidiya","family":"Murakhovs\u2019ka","sequence":"additional","affiliation":[{"name":"Salesforce Research"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9685-3961","authenticated-orcid":false,"given":"Philippe","family":"Laban","sequence":"additional","affiliation":[{"name":"Salesforce Research"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-3453-0738","authenticated-orcid":false,"given":"Tong","family":"Niu","sequence":"additional","affiliation":[{"name":"Salesforce Research"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-9828-6736","authenticated-orcid":false,"given":"Wenhao","family":"Liu","sequence":"additional","affiliation":[{"name":"Faire"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0349-8628","authenticated-orcid":false,"given":"Caiming","family":"Xiong","sequence":"additional","affiliation":[{"name":"Salesforce Research"}]}],"member":"320","published-online":{"date-parts":[[2023,9,25]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"219","volume-title":"Reading Expository Material","author":"Anderson Thomas H.","year":"1982","unstructured":"Thomas H. Anderson and Bonnie B. Armbruster. 1982. Reader and text-studying strategies. In Reading Expository Material, Wayne Otto and Sandra White (Eds.). Academic, 219\u2013242."},{"key":"e_1_3_2_3_2","article-title":"Paper plain: Making medical research papers approachable to healthcare consumers with natural language processing","author":"August Tal","year":"2022","unstructured":"Tal August, Lucy Lu Wang, Jonathan Bragg, Marti A. Hearst, Andrew Head, and Kyle Lo. 2022. Paper plain: Making medical research papers approachable to healthcare consumers with natural language processing. arXiv preprint arXiv:2203.00130 (2022).","journal-title":"arXiv preprint arXiv:2203.00130"},{"key":"e_1_3_2_4_2","article-title":"Longformer: The long-document transformer","author":"Beltagy Iz","year":"2020","unstructured":"Iz Beltagy, Matthew E. Peters, and Arman Cohan. 2020. Longformer: The long-document transformer. arXiv preprint arXiv:2004.05150 (2020).","journal-title":"arXiv preprint arXiv:2004.05150"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702303"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702303"},{"key":"e_1_3_2_7_2","article-title":"Hone as you read: A practical type of interactive summarization","author":"Bohn Tanner","year":"2021","unstructured":"Tanner Bohn and Charles X. Ling. 2021. Hone as you read: A practical type of interactive summarization. arXiv preprint arXiv:2105.02923 (2021).","journal-title":"arXiv preprint arXiv:2105.02923"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1037\/13620-004"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3449287"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300234"},{"key":"e_1_3_2_11_2","volume-title":"The Shallows: What the Internet Is Doing to Our Brains","author":"Carr Nicholas","year":"2020","unstructured":"Nicholas Carr. 2020. The Shallows: What the Internet Is Doing to Our Brains. WW Norton & Company."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v34i3.2486"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330723"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/2362364.2362366"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174070"},{"key":"e_1_3_2_16_2","first-page":"arXiv\u20132110","article-title":"CaPE: Contrastive parameter ensembling for reducing hallucination in abstractive summarization","author":"Choubey Prafulla Kumar","year":"2021","unstructured":"Prafulla Kumar Choubey, Alexander R. Fabbri, Jesse Vig, Chien-Sheng Wu, Wenhao Liu, and Nazneen Fatema Rajani. 2021. CaPE: Contrastive parameter ensembling for reducing hallucination in abstractive summarization. arXiv e-prints (2021), arXiv\u20132110.","journal-title":"arXiv e-prints"},{"key":"e_1_3_2_17_2","unstructured":"Caleb Crain and Katy Waldman. 2018. Why we don\u2019t read revisited. https:\/\/www.newyorker.com\/culture\/cultural-comment\/why-we-dont-read-revisited"},{"key":"e_1_3_2_18_2","article-title":"BERT: Pre-training of deep bidirectional transformers for language understanding","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).","journal-title":"arXiv preprint arXiv:1810.04805"},{"key":"e_1_3_2_19_2","article-title":"Improving factual consistency in summarization with compression-based post-editing","author":"Fabbri Alexander R.","year":"2022","unstructured":"Alexander R. Fabbri, Prafulla Kumar Choubey, Jesse Vig, Chien-Sheng Wu, and Caiming Xiong. 2022. Improving factual consistency in summarization with compression-based post-editing. arXiv preprint arXiv:2211.06196 (2022).","journal-title":"arXiv preprint arXiv:2211.06196"},{"key":"e_1_3_2_20_2","article-title":"QAFactEval: Improved QA-based factual consistency evaluation for summarization","author":"Fabbri Alexander R.","year":"2021","unstructured":"Alexander R. Fabbri, Chien-Sheng Wu, Wenhao Liu, and Caiming Xiong. 2021. QAFactEval: Improved QA-based factual consistency evaluation for summarization. arXiv preprint arXiv:2112.08542 (2021).","journal-title":"arXiv preprint arXiv:2112.08542"},{"key":"e_1_3_2_21_2","article-title":"Scim: Intelligent faceted highlights for interactive, multi-pass skimming of scientific papers","author":"Fok Raymond","year":"2022","unstructured":"Raymond Fok, Andrew Head, Jonathan Bragg, Kyle Lo, Marti A. Hearst, and Daniel S. Weld. 2022. Scim: Intelligent faceted highlights for interactive, multi-pass skimming of scientific papers. arXiv preprint arXiv:2205.04561 (2022).","journal-title":"arXiv preprint arXiv:2205.04561"},{"key":"e_1_3_2_22_2","volume-title":"The Psychology of Reading.","author":"Gibson Eleanor J.","year":"1975","unstructured":"Eleanor J. Gibson and Harry Levin. 1975. The Psychology of Reading.The MIT Press."},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3449084"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2006.12683"},{"key":"e_1_3_2_25_2","article-title":"An update to compiled ORF norms","author":"Hasbrouck Jan","year":"2017","unstructured":"Jan Hasbrouck and Gerald Tindal. 2017. An update to compiled ORF norms. Behav. Res. Teach. (2017).","journal-title":"Behav. Res. Teach."},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445648"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208327"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208327"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518996"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/302979.303030"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3402569.3402594"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/1281500.1281531"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3126594.3126662"},{"key":"e_1_3_2_34_2","article-title":"Designing and evaluating interfaces that highlight news coverage diversity using discord questions","author":"Laban Philippe","year":"2023","unstructured":"Philippe Laban, Chien-Sheng Wu, Lidiya Murakhovs\u2019ka, Xiang \u201cAnthony\u201d Chen, and Caiming Xiong. 2023. Designing and evaluating interfaces that highlight news coverage diversity using discord questions. arXiv preprint arXiv:2302.08997 (2023).","journal-title":"arXiv preprint arXiv:2302.08997"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.findings-naacl.9"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858299"},{"key":"e_1_3_2_37_2","unstructured":"Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. In Proceedings of the Workshop on Text Summarization Branches Out ."},{"key":"e_1_3_2_38_2","unstructured":"arXiv preprint arXiv:2212.07981 2022 Revisiting the gold standard: Grounding summarization evaluation with robust human evaluation"},{"key":"e_1_3_2_39_2","article-title":"Text summarization with pretrained encoders","author":"Liu Yang","year":"2019","unstructured":"Yang Liu and Mirella Lapata. 2019. Text summarization with pretrained encoders. arXiv preprint arXiv:1908.08345 (2019).","journal-title":"arXiv preprint arXiv:1908.08345"},{"key":"e_1_3_2_40_2","article-title":"RoBERTa: A robustly optimized bert pretraining approach","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. RoBERTa: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019).","journal-title":"arXiv preprint arXiv:1907.11692"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.lisr.2016.08.007"},{"key":"e_1_3_2_42_2","article-title":"From learning to read to reading to learn","author":"Lunzer E.","year":"1979","unstructured":"E. Lunzer and Keith Gardner. 1979. From learning to read to reading to learn. The Effective Use of Reading. Heinemann Educational Books Ltd. London.","journal-title":"The Effective Use of Reading. Heinemann Educational Books Ltd. London"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1080\/07370024.2002.9667313"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/2254556.2254669"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/3131609"},{"key":"e_1_3_2_46_2","article-title":"Leveraging BERT for extractive text summarization on lectures","author":"Miller Derek","year":"2019","unstructured":"Derek Miller. 2019. Leveraging BERT for extractive text summarization on lectures. arXiv preprint arXiv:1906.04165 (2019).","journal-title":"arXiv preprint arXiv:1906.04165"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/TABLETOP.2007.12"},{"key":"e_1_3_2_48_2","article-title":"MixQG: Neural question generation with mixed answer types","author":"Murakhovs\u2019ka Lidiya","year":"2021","unstructured":"Lidiya Murakhovs\u2019ka, Chien-Sheng Wu, Tong Niu, Wenhao Liu, and Caiming Xiong. 2021. MixQG: Neural question generation with mixed answer types. arXiv preprint arXiv:2110.08175 (2021).","journal-title":"arXiv preprint arXiv:2110.08175"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K16-1028"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1206"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242666"},{"key":"e_1_3_2_52_2","unstructured":"K. O\u2019Hara. 1996. Towards a typology of reading goals: Technical report EPC-1996-107. Cambridge UK: Rank Xerox Research Centre Cambridge Laboratory (1996)."},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/258549.258787"},{"key":"e_1_3_2_54_2","article-title":"Training language models to follow instructions with human feedback","author":"Ouyang Long","year":"2022","unstructured":"Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, and Ryan Lowe. 2022. Training language models to follow instructions with human feedback. arXiv preprint arXiv:2203.02155 (2022).","journal-title":"arXiv preprint arXiv:2203.02155"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518772"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3379350.3416154"},{"issue":"4","key":"e_1_3_2_57_2","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1080\/1461670032000136596","article-title":"News and its communicative quality: The inverted pyramid-When and why did it appear?","volume":"4","author":"ttker Horst P\u00f6","year":"2003","unstructured":"Horst P\u00f6 ttker. 2003. News and its communicative quality: The inverted pyramid-When and why did it appear? Journal. Stud. 4, 4 (2003), 501\u2013511.","journal-title":"Journal. Stud."},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445315"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1145\/286498.286510"},{"key":"e_1_3_2_60_2","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","author":"Raffel Colin","year":"2019","unstructured":"Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2019. Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv preprint arXiv:1910.10683 (2019).","journal-title":"arXiv preprint arXiv:1910.10683"},{"key":"e_1_3_2_61_2","unstructured":"Francis P. Robinson. 1946. Effective study Rev. (1946). https:\/\/psycnet.apa.org\/record\/1947-01658-000"},{"issue":"2","key":"e_1_3_2_62_2","article-title":"Paper or pixels: What are people reading online","volume":"6","author":"Shaikh D.","year":"2004","unstructured":"D. Shaikh. 2004. Paper or pixels: What are people reading online. Usabil. News 6, 2 (2004).","journal-title":"Usabil. News"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1002\/rrq.137"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979430"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1016\/0950-7051(95)98369-H"},{"key":"e_1_3_2_66_2","unstructured":"Mark Thomas. 2020. What is the average reading speed and the best rate of reading? Retrieved from https:\/\/www.healthguidance.org\/entry\/13263\/1\/What-Is-the-Average-Reading-Speed-and-the-Best-Rate-of-Reading.html"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985767"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-020-0942-0"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185582"},{"key":"e_1_3_2_70_2","first-page":"5998","volume-title":"Proceedings of the Conference on Advances in Neural Information Processing Systems","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 5998\u20136008."},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359313"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242612"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/1502650.1502656"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807510"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3609331","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3609331","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:22Z","timestamp":1750178782000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3609331"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,25]]},"references-count":73,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,12,31]]}},"alternative-id":["10.1145\/3609331"],"URL":"https:\/\/doi.org\/10.1145\/3609331","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,25]]},"assertion":[{"value":"2022-12-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-06-21","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-09-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}