{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T02:39:26Z","timestamp":1772159966427,"version":"3.50.1"},"reference-count":70,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,2,23]],"date-time":"2023-02-23T00:00:00Z","timestamp":1677110400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Internet Technol."],"published-print":{"date-parts":[[2023,2,28]]},"abstract":"<jats:p>\n            Product reviews play a key role in e-commerce platforms. Studies show that many users read product reviews before a purchase and trust them to the same extent as personal recommendations. However, in many cases, the number of reviews per product is large and extracting useful information becomes a challenging task. Several websites have recently added an option to post\n            <jats:italic>tips<\/jats:italic>\n            \u2014short, concise, practical, and self-contained pieces of advice about the products. These tips are complementary to the reviews and usually add a new non-trivial insight about the product, beyond its title, attributes, and description. Yet, most if not all major e-commerce platforms lack the notion of a tip as a first-class citizen and customers typically express their advice through other means, such as reviews.\n          <\/jats:p>\n          <jats:p>In this work, we propose an extractive method for tip generation from product reviews. We focus on five popular e-commerce domains whose reviews tend to contain useful non-trivial tips that are beneficial for potential customers. We formally define the task of tip extraction in e-commerce by providing the list of tip types, tip timing (before and\/or after the purchase), and connection to the surrounding context sentences. To extract the tips, we propose a supervised approach and leverage a publicly available dataset, annotated by human editors, containing 14,000 product reviews. To demonstrate the potential of our approach, we compare different tip generation methods and evaluate them both manually and over the labeled set. Our approach demonstrates particularly high performance for popular products in the Baby, Home Improvement, and Sports &amp; Outdoors domains, with precision of over 95% for the top 3 tips per product. In addition, we evaluate the performance of our methods on previously unseen domains. Finally, we discuss the practical usage of our approach in real-world applications. Concretely, we explain how tips generated from user reviews can be integrated in various use cases within e-commerce platforms and benefit both buyers and sellers.<\/jats:p>","DOI":"10.1145\/3547140","type":"journal-article","created":{"date-parts":[[2022,7,14]],"date-time":"2022-07-14T11:14:57Z","timestamp":1657797297000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["The Tip of the Buyer: Extracting Product Tips from Reviews"],"prefix":"10.1145","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3503-510X","authenticated-orcid":false,"given":"Sharon","family":"Hirsch","sequence":"first","affiliation":[{"name":"Ben-Gurion University of the Negev, Beer Sheva, Israel"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4082-7128","authenticated-orcid":false,"given":"Slava","family":"Novgorodov","sequence":"additional","affiliation":[{"name":"Tel Aviv University, Tel Aviv, Israel"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5525-1064","authenticated-orcid":false,"given":"Ido","family":"Guy","sequence":"additional","affiliation":[{"name":"Ben-Gurion University of the Negev, Beer Sheva, Israel"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7573-0628","authenticated-orcid":false,"given":"Alexander","family":"Nus","sequence":"additional","affiliation":[{"name":"eBay Research, Netanya, Israel"}]}],"member":"320","published-online":{"date-parts":[[2023,2,23]]},"reference":[{"key":"e_1_3_2_2_2","volume-title":"Proc. of ICWSM","author":"Akoglu Leman","year":"2013","unstructured":"Leman Akoglu, Rishi Chandy, and Christos Faloutsos. 2013. Opinion fraud detection in online reviews by network effects. In Proc. of ICWSM, Vol. 7."},{"key":"e_1_3_2_3_2","first-page":"1770","volume-title":"Proc. of SIGMOD","author":"Avron Uri","year":"2022","unstructured":"Uri Avron, Shay Gershtein, Ido Guy, Tova Milo, and Slava Novgorodov. 2022. Automated category tree construction in e-commerce. In Proc. of SIGMOD. 1770\u20131783."},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-00958-7_41"},{"key":"e_1_3_2_5_2","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1145\/312624.312681","volume-title":"Proc. of SIGIR","author":"Berger Adam","year":"1999","unstructured":"Adam Berger and John Lafferty. 1999. Information retrieval as statistical translation. In Proc. of SIGIR. 222\u2013229."},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00051"},{"key":"e_1_3_2_7_2","unstructured":"BrightLocal. 2018. Local Consumer Review Survey. https:\/\/www.brightlocal.com\/research\/local-consumer-review-survey\/."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/2337542.2337545"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-5529-2_5"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2010.08.023"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-021-01567-3"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.116234"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2021.107521"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1509\/jmkr.43.3.345"},{"key":"e_1_3_2_15_2","first-page":"355","volume-title":"Proc. of AVI","author":"Cremonesi Paolo","year":"2014","unstructured":"Paolo Cremonesi, Raffaele Facendola, Franca Garzotto, Matteo Guarnerio, Mattia Natali, and Roberto Pagano. 2014. Polarized review summarization as decision making tool. In Proc. of AVI. 355\u2013356."},{"key":"e_1_3_2_16_2","first-page":"102","volume-title":"Proc. of SIGIR","author":"Dagan Arnon","year":"2021","unstructured":"Arnon Dagan, Ido Guy, and Slava Novgorodov. 2021. An image is worth a thousand terms? Analysis of visual e-commerce search. In Proc. of SIGIR. 102\u2013112."},{"key":"e_1_3_2_17_2","article-title":"Bert: Pre-training of deep bidirectional transformers for language understanding","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).","journal-title":"arXiv preprint arXiv:1810.04805"},{"key":"e_1_3_2_18_2","first-page":"1383","volume-title":"Proc. of ACL","author":"Dror Rotem","year":"2018","unstructured":"Rotem Dror, Gili Baumer, Segev Shlomov, and Roi Reichart. 2018. The hitchhiker\u2019s guide to testing statistical significance in natural language processing. In Proc. of ACL. 1383\u20131392."},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2008.04.001"},{"key":"e_1_3_2_20_2","first-page":"389","volume-title":"Proc. of CIKM","author":"Elad Guy","year":"2019","unstructured":"Guy Elad, Ido Guy, Slava Novgorodov, Benny Kimelfeld, and Kira Radinsky. 2019. Learning to generate personalized product descriptions. In Proc. of CIKM. 389\u2013398."},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0031619"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33016399"},{"key":"e_1_3_2_23_2","first-page":"1602","volume-title":"Proc. of EMNLP","author":"Gerani Shima","year":"2014","unstructured":"Shima Gerani, Yashar Mehdad, Giuseppe Carenini, Raymond T. Ng, and Bita Nejat. 2014. Abstractive summarization of product reviews using discourse structure. In Proc. of EMNLP. 1602\u20131613."},{"key":"e_1_3_2_24_2","first-page":"987","volume-title":"Proc. of WWW","author":"Guy Ido","year":"2017","unstructured":"Ido Guy, Avihai Mejer, Alexander Nus, and Fiana Raiber. 2017. Extracting and ranking travel tips from user-generated reviews. In Proc. of WWW. 987\u2013996."},{"key":"e_1_3_2_25_2","first-page":"835","volume-title":"Proc. of SIGIR","author":"Guy Ido","year":"2018","unstructured":"Ido Guy and Bracha Shapira. 2018. From royals to vegans: Characterizing question trolling on a community question answering website. In Proc. of SIGIR. 835\u2013844."},{"key":"e_1_3_2_26_2","article-title":"A joint many-task model: Growing a neural network for multiple NLP tasks","volume":"1611","author":"Hashimoto Kazuma","year":"2016","unstructured":"Kazuma Hashimoto, Caiming Xiong, Yoshimasa Tsuruoka, and Richard Socher. 2016. A joint many-task model: Growing a neural network for multiple NLP tasks. arXiv preprint abs\/1611.01587 (2016).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_27_2","first-page":"507","volume-title":"Proc. of WWW","author":"He Ruining","year":"2016","unstructured":"Ruining He and Julian McAuley. 2016. Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering. In Proc. of WWW. 507\u2013517."},{"key":"e_1_3_2_28_2","first-page":"1319","volume-title":"Proc. of SIGIR","author":"Hirsch Sharon","year":"2020","unstructured":"Sharon Hirsch, Ido Guy, Alexander Nus, Arnon Dagan, and Oren Kurland. 2020. Query reformulation in e-commerce search. In Proc. of SIGIR. 1319\u20131328."},{"key":"e_1_3_2_29_2","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1145\/3437963.3441755","volume-title":"Proc. of WSDM","author":"Hirsch Sharon","year":"2021","unstructured":"Sharon Hirsch, Slava Novgorodov, Ido Guy, and Alexander Nus. 2021. Generating tips from product reviews. In Proc. of WSDM. 310\u2013318."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_3_2_31_2","first-page":"168","volume-title":"Proc. of KDD","author":"Hu Minqing","year":"2004","unstructured":"Minqing Hu and Bing Liu. 2004. Mining and summarizing customer reviews. In Proc. of KDD. 168\u2013177."},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2011.11.002"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3414841"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2013.6639081"},{"key":"e_1_3_2_35_2","first-page":"423","volume-title":"Proc. of EMNLP","author":"Kim Soo-Min","year":"2006","unstructured":"Soo-Min Kim, Patrick Pantel, Tim Chklovski, and Marco Pennacchiotti. 2006. Automatically assessing review helpfulness. In Proc. of EMNLP. 423\u2013430."},{"key":"e_1_3_2_36_2","article-title":"Adam: A method for stochastic optimization","volume":"1412","author":"Kingma Diederik P.","year":"2014","unstructured":"Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint abs\/1412.6980 (2014).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_37_2","first-page":"832","volume-title":"Proc. of KDD","author":"Lappas Theodoros","year":"2012","unstructured":"Theodoros Lappas, Mark Crovella, and Evimaria Terzi. 2012. Selecting a characteristic set of reviews. In Proc. of KDD. 832\u2013840."},{"key":"e_1_3_2_38_2","first-page":"195","volume-title":"ECML PKDD","author":"Lappas Theodoros","year":"2010","unstructured":"Theodoros Lappas and Dimitrios Gunopulos. 2010. Efficient confident search in large review corpora. In ECML PKDD. Springer, 195\u2013210."},{"key":"e_1_3_2_39_2","first-page":"250","volume-title":"Proc. of ECNLP 5","author":"Lavee Gal","year":"2022","unstructured":"Gal Lavee and Ido Guy. 2022. Lot or not: Identifying multi-quantity offerings in e-commerce. In Proc. of ECNLP 5. 250\u2013262."},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313496"},{"key":"e_1_3_2_41_2","first-page":"345","volume-title":"Proc. of SIGIR","author":"Li Piji","year":"2017","unstructured":"Piji Li, Zihao Wang, Zhaochun Ren, Lidong Bing, and Wai Lam. 2017. Neural rating regression with abstractive tips generation for recommendation. In Proc. of SIGIR. 345\u2013354."},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tourman.2007.05.011"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.12141"},{"key":"e_1_3_2_44_2","doi-asserted-by":"crossref","unstructured":"Mitchell Marcus Beatrice Santorini and Mary Ann Marcinkiewicz. 1993. Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics 19 2 (1993) 313\u2013330.","DOI":"10.21236\/ADA273556"},{"key":"e_1_3_2_45_2","article-title":"Efficient estimation of word representations in vector space","volume":"1301","author":"Mikolov Tomas","year":"2013","unstructured":"Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint abs\/1301.37810 (2013).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_46_2","first-page":"1067","volume-title":"Proc. of CIKM","author":"Nguyen Thanh-Son","year":"2013","unstructured":"Thanh-Son Nguyen, Hady W. Lauw, and Panayiotis Tsaparas. 2013. Using micro-reviews to select an efficient set of reviews. In Proc. of CIKM. 1067\u20131076."},{"key":"e_1_3_2_47_2","volume-title":"Computer-intensive Methods for Testing Hypotheses","author":"Noreen Eric W.","year":"1989","unstructured":"Eric W. Noreen. 1989. Computer-intensive Methods for Testing Hypotheses. Wiley New York."},{"key":"e_1_3_2_48_2","first-page":"1354","volume-title":"Proc. of WWW","author":"Novgorodov Slava","year":"2019","unstructured":"Slava Novgorodov, Ido Guy, Guy Elad, and Kira Radinsky. 2019. Generating product descriptions from user reviews. In Proc. of WWW. 1354\u20131364."},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3418202"},{"key":"e_1_3_2_50_2","first-page":"1532","volume-title":"Proc. of EMNLP","author":"Pennington Jeffrey","year":"2014","unstructured":"Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. Glove: Global vectors for word representation. In Proc. of EMNLP, Vol. 14. 1532\u20131543."},{"key":"e_1_3_2_51_2","first-page":"41","volume-title":"IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence","author":"Rish Irina","year":"2001","unstructured":"Irina Rish. 2001. An empirical study of the naive Bayes classifier. In IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence, Vol. 3. 41\u201346."},{"key":"e_1_3_2_52_2","first-page":"272","volume-title":"TSD","author":"Ryu Jihee","year":"2012","unstructured":"Jihee Ryu, Yuchul Jung, and Sung-Hyon Myaeng. 2012. Actionable clause detection from non-imperative sentences in howto instructions: A step for actionable information extraction. In TSD. Springer, 272\u2013281."},{"issue":"3","key":"e_1_3_2_53_2","first-page":"284","article-title":"Uncovering consumers\u2019 returning behaviour: A study of fashion e-commerce","volume":"27","author":"Saarij\u00e4rvi Hannu","year":"2017","unstructured":"Hannu Saarij\u00e4rvi, Ulla-Maija Sutinen, and Lloyd C. Harris. 2017. Uncovering consumers\u2019 returning behaviour: A study of fashion e-commerce. International Review of Retail, Distribution and Consumer Research 27, 3 (2017), 284\u2013299.","journal-title":"International Review of Retail, Distribution and Consumer Research"},{"key":"e_1_3_2_54_2","first-page":"1853","volume-title":"Proc. of CIKM","author":"Sipos Ruben","year":"2013","unstructured":"Ruben Sipos and Thorsten Joachims. 2013. Generating comparative summaries from reviews. In Proc. of CIKM. 1853\u20131856."},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1016\/0361-3682(80)90005-7"},{"key":"e_1_3_2_56_2","first-page":"231","volume-title":"Proc. of ACL","author":"S\u00f8gaard Anders","year":"2016","unstructured":"Anders S\u00f8gaard and Yoav Goldberg. 2016. Deep multi-task learning with low level tasks supervised at lower layers. In Proc. of ACL, Vol. 2. 231\u2013235."},{"key":"e_1_3_2_57_2","first-page":"1245","volume-title":"Proc. of SIGIR","author":"Sondhi Parikshit","year":"2018","unstructured":"Parikshit Sondhi, Mohit Sharma, Pranam Kolari, and ChengXiang Zhai. 2018. A taxonomy of queries for e-commerce search. In Proc. of SIGIR. 1245\u20131248."},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-5915.1999.tb01613.x"},{"key":"e_1_3_2_59_2","volume-title":"Proc. of ICWSM","author":"Tsur Oren","year":"2009","unstructured":"Oren Tsur and Ari Rappoport. 2009. Revrank: A fully unsupervised algorithm for selecting the most helpful book reviews. In Proc. of ICWSM."},{"key":"e_1_3_2_60_2","first-page":"1465","volume-title":"Proc. of CIKM","author":"Tsurel David","year":"2020","unstructured":"David Tsurel, Michael Doron, Alexander Nus, Arnon Dagan, Ido Guy, and Dafna Shahaf. 2020. E-commerce dispute resolution prediction. In Proc. of CIKM. 1465\u20131474."},{"key":"e_1_3_2_61_2","first-page":"791","volume-title":"Proc. of SIGIR","author":"Tzaban Hen","year":"2020","unstructured":"Hen Tzaban, Ido Guy, Asnat Greenstein-Messica, Arnon Dagan, Lior Rokach, and Bracha Shapira. 2020. Product bundle identification using semi-supervised learning. In Proc. of SIGIR. 791\u2013800."},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2019.00058"},{"key":"e_1_3_2_63_2","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1145\/2124295.2124369","volume-title":"Proc. of WSDM","author":"Weber Ingmar","year":"2012","unstructured":"Ingmar Weber, Antti Ukkonen, and Aris Gionis. 2012. Answers, not links: Extracting tips from yahoo! answers to address how-to web queries. In Proc. of WSDM. 613\u2013622."},{"key":"e_1_3_2_64_2","first-page":"2347","volume-title":"Proc. of CIKM","author":"Wicaksono Alfan Farizki","year":"2012","unstructured":"Alfan Farizki Wicaksono and Sung-Hyon Myaeng. 2012. Mining advices from weblogs. In Proc. of CIKM. 2347\u20132350."},{"key":"e_1_3_2_65_2","first-page":"2039","volume-title":"Proc. of CIKM","author":"Wicaksono Alfan Farizki","year":"2013","unstructured":"Alfan Farizki Wicaksono and Sung-Hyon Myaeng. 2013. Toward advice mining: Conditional random fields for extracting advice-revealing text units. In Proc. of CIKM. 2039\u20132048."},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7439(00)00122-2"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.3390\/jtaer16050090"},{"key":"e_1_3_2_68_2","first-page":"1480","volume-title":"Proc. of NAACL","author":"Yang Zichao","year":"2016","unstructured":"Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, and Eduard Hovy. 2016. Hierarchical attention networks for document classification. In Proc. of NAACL. 1480\u20131489."},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhm.2008.06.011"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2018.01.011"},{"key":"e_1_3_2_71_2","first-page":"3718","volume-title":"Proc. of IJCAI","author":"Zhu Yada","year":"2018","unstructured":"Yada Zhu, Jianbo Li, Jingrui He, Brian Leo Quanz, and Ajay A. Deshpande. 2018. A local algorithm for product return prediction in e-commerce. In Proc. of IJCAI. 3718\u20133724."}],"container-title":["ACM Transactions on Internet Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3547140","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3547140","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:55Z","timestamp":1750186975000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3547140"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,23]]},"references-count":70,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,2,28]]}},"alternative-id":["10.1145\/3547140"],"URL":"https:\/\/doi.org\/10.1145\/3547140","relation":{},"ISSN":["1533-5399","1557-6051"],"issn-type":[{"value":"1533-5399","type":"print"},{"value":"1557-6051","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,23]]},"assertion":[{"value":"2021-11-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-06-21","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-02-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}