{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,5]],"date-time":"2025-07-05T04:47:28Z","timestamp":1751690848155,"version":"3.41.0"},"reference-count":59,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,1,13]],"date-time":"2021-01-13T00:00:00Z","timestamp":1610496000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"IMT Scuola Alti Studi Lucca"},{"name":"IIT-CNR project DESIRE"},{"name":"European Union's Horizon 2020 programme","award":["830892, SPARTA"],"award-info":[{"award-number":["830892, SPARTA"]}]},{"name":"Integrated Activity Project TOFFEe"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Data and Information Quality"],"published-print":{"date-parts":[[2021,3,31]]},"abstract":"<jats:p>Over the past few years, online reviews have become very important, since they can influence the purchase decision of consumers and the reputation of businesses. Therefore, the practice of writing fake reviews can have severe consequences on customers and service providers. Various approaches have been proposed for detecting opinion spam in online reviews, especially based on supervised classifiers. In this contribution, we start from a set of effective features used for classifying opinion spam and we re-engineered them by considering the Cumulative Relative Frequency Distribution of each feature. By an experimental evaluation carried out on real data from Yelp.com, we show that the use of the distributional features is able to improve the performances of classifiers.<\/jats:p>","DOI":"10.1145\/3439307","type":"journal-article","created":{"date-parts":[[2021,1,13]],"date-time":"2021-01-13T11:17:11Z","timestamp":1610536631000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Experience"],"prefix":"10.1145","volume":"13","author":[{"given":"Michela","family":"Fazzolari","sequence":"first","affiliation":[{"name":"Istituto di Informatica e Telematica, Consiglio Nazionale delle Ricerche, Pisa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Francesco","family":"Buccafurri","sequence":"additional","affiliation":[{"name":"DIIES, Universit\u00e0 Mediterranea di Reggio Calabria, Reggio Calabria, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gianluca","family":"Lax","sequence":"additional","affiliation":[{"name":"DIIES, Universit\u00e0 Mediterranea di Reggio Calabria, Reggio Calabria, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marinella","family":"Petrocchi","sequence":"additional","affiliation":[{"name":"Istituto di Informatica e Telematica, Consiglio Nazionale delle Ricerche, Pisa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,1,13]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_2_1_1_1","DOI":"10.1103\/PhysRevE.64.046135"},{"key":"e_1_2_1_2_1","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1080\/00031305.1992.10475879","article-title":"An introduction to kernel and nearest-neighbor nonparametric regression","volume":"46","author":"Altman N. S.","year":"1992","unstructured":"N. S. Altman . 1992 . An introduction to kernel and nearest-neighbor nonparametric regression . Am. Stat. 46 , 3 (1992), 175 -- 185 . N. S. Altman. 1992. An introduction to kernel and nearest-neighbor nonparametric regression. Am. Stat. 46, 3 (1992), 175--185.","journal-title":"Am. Stat."},{"unstructured":"Amazon. 2019. Amazon Mechanical Turk. Retrieved from https:\/\/www.mturk.com\/. Amazon. 2019. Amazon Mechanical Turk. Retrieved from https:\/\/www.mturk.com\/.","key":"e_1_2_1_3_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_4_1","DOI":"10.1140\/epjb\/e2004-00130-1"},{"key":"e_1_2_1_5_1","volume-title":"Characterizing the 2016 Russian IRA influence campaign. Soc. Netw. Anal. Min. 9, 1","author":"Badawy Adam","year":"2019","unstructured":"Adam Badawy , Aseel Addawood , Kristina Lerman , and Emilio Ferrara . 2019. Characterizing the 2016 Russian IRA influence campaign. Soc. Netw. Anal. Min. 9, 1 ( 2019 ), 31:1--31:11. Adam Badawy, Aseel Addawood, Kristina Lerman, and Emilio Ferrara. 2019. Characterizing the 2016 Russian IRA influence campaign. Soc. Netw. Anal. Min. 9, 1 (2019), 31:1--31:11."},{"unstructured":"L. Breiman J. H. Friedman R. A. Olshen and C. J. Stone. 2002. Applied Logistic Regression Analysis. Chapman 8 Hall. L. Breiman J. H. Friedman R. A. Olshen and C. J. Stone. 2002. Applied Logistic Regression Analysis. Chapman 8 Hall.","key":"e_1_2_1_6_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_7_1","DOI":"10.1038\/s42005-020-0340-4"},{"doi-asserted-by":"publisher","key":"e_1_2_1_8_1","DOI":"10.1137\/070710111"},{"doi-asserted-by":"publisher","key":"e_1_2_1_9_1","DOI":"10.1162\/coli_a_00338"},{"doi-asserted-by":"publisher","key":"e_1_2_1_10_1","DOI":"10.1023\/A:1022627411411"},{"doi-asserted-by":"publisher","key":"e_1_2_1_11_1","DOI":"10.1186\/s40537-015-0029-9"},{"doi-asserted-by":"publisher","key":"e_1_2_1_12_1","DOI":"10.1145\/3409116"},{"doi-asserted-by":"publisher","key":"e_1_2_1_13_1","DOI":"10.1145\/3292522.3326030"},{"doi-asserted-by":"publisher","key":"e_1_2_1_14_1","DOI":"10.1016\/j.osnem.2018.10.005"},{"key":"e_1_2_1_15_1","volume-title":"Devijver and Josef Kittler","author":"Pierre","year":"1982","unstructured":"Pierre A. Devijver and Josef Kittler . 1982 . Pattern Recognition : A Statistical Approach. Prentice-Hall . Pierre A. Devijver and Josef Kittler. 1982. Pattern Recognition: A Statistical Approach. Prentice-Hall."},{"doi-asserted-by":"publisher","key":"e_1_2_1_16_1","DOI":"10.1007\/s13042-017-0768-3"},{"volume-title":"Proceedings of the 7th International Conference on Weblogs and Social Media (ICWSM\u201913)","author":"Fei G.","unstructured":"G. Fei , A. Mukherjee , B. Liu , M. Hsu , M. Castellanos , and R. Ghosh . 2013. Exploiting burstiness in reviews for review spammer detection . In Proceedings of the 7th International Conference on Weblogs and Social Media (ICWSM\u201913) . AAAI Press, 175--184. G. Fei, A. Mukherjee, B. Liu, M. Hsu, M. Castellanos, and R. Ghosh. 2013. Exploiting burstiness in reviews for review spammer detection. In Proceedings of the 7th International Conference on Weblogs and Social Media (ICWSM\u201913). AAAI Press, 175--184.","key":"e_1_2_1_17_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_18_1","DOI":"10.1145\/3299768"},{"key":"e_1_2_1_19_1","volume-title":"Popularity effect","author":"Goes Paulo B.","year":"2014","unstructured":"Paulo B. Goes , Mingfeng Lin , and Ching man Au Yeung . 2014. \u201d Popularity effect \u201d in user-generated content: Evidence from online product reviews. Inf. Syst. Res . 25, 2 ( 2014 ), 222--238. Paulo B. Goes, Mingfeng Lin, and Ching man Au Yeung. 2014. \u201dPopularity effect\u201d in user-generated content: Evidence from online product reviews. Inf. Syst. Res. 25, 2 (2014), 222--238."},{"doi-asserted-by":"publisher","key":"e_1_2_1_20_1","DOI":"10.1016\/0740-624X(95)90052-7"},{"doi-asserted-by":"publisher","key":"e_1_2_1_21_1","DOI":"10.14201\/ADCAIJ2019826171"},{"volume-title":"Proceedings of the 7th IEEE International Conference on Data Mining (ICDM\u201907)","author":"Jindal N.","unstructured":"N. Jindal and B. Liu . 2007. Analyzing and detecting review spam . In Proceedings of the 7th IEEE International Conference on Data Mining (ICDM\u201907) , Omaha, NE. 547--552. N. Jindal and B. Liu. 2007. Analyzing and detecting review spam. In Proceedings of the 7th IEEE International Conference on Data Mining (ICDM\u201907), Omaha, NE. 547--552.","key":"e_1_2_1_22_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_23_1","DOI":"10.1145\/1341531.1341560"},{"doi-asserted-by":"publisher","key":"e_1_2_1_24_1","DOI":"10.1145\/3159652.3159726"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 14th International Joint Conference on Artificial Intelligence","volume":"2","author":"Kohavi Ron","year":"1995","unstructured":"Ron Kohavi . 1995 . A study of cross-validation and bootstrap for accuracy estimation and model selection . In Proceedings of the 14th International Joint Conference on Artificial Intelligence , Volume 2 (IJCAI\u201995). Morgan Kaufmann, San Francisco, CA, 1137--1143. Ron Kohavi. 1995. A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proceedings of the 14th International Joint Conference on Artificial Intelligence, Volume 2 (IJCAI\u201995). Morgan Kaufmann, San Francisco, CA, 1137--1143."},{"doi-asserted-by":"publisher","key":"e_1_2_1_26_1","DOI":"10.1145\/1871437.1871557"},{"key":"e_1_2_1_27_1","volume-title":"AUC: A better measure than accuracy in comparing learning algorithms. In Advances in Artificial Intelligence, Yang Xiang and Brahim Chaib-draa (Eds.)","author":"Ling Charles X.","year":"2003","unstructured":"Charles X. Ling , Jin Huang , and Harry Zhang . 2003 . AUC: A better measure than accuracy in comparing learning algorithms. In Advances in Artificial Intelligence, Yang Xiang and Brahim Chaib-draa (Eds.) . Springer , Berlin , 329--341. Charles X. Ling, Jin Huang, and Harry Zhang. 2003. AUC: A better measure than accuracy in comparing learning algorithms. In Advances in Artificial Intelligence, Yang Xiang and Brahim Chaib-draa (Eds.). Springer, Berlin, 329--341."},{"doi-asserted-by":"crossref","unstructured":"Bing Liu. 2012. Sentiment Analysis and Opinion Mining. Morgan 8 Claypool. Bing Liu. 2012. Sentiment Analysis and Opinion Mining. Morgan 8 Claypool.","key":"e_1_2_1_28_1","DOI":"10.1007\/978-3-031-02145-9"},{"key":"e_1_2_1_29_1","article-title":"Fake it till you make it: Reputation, competition, and yelp review fraud","volume":"62","author":"Luca Michael","year":"2013","unstructured":"Michael Luca and Georgios Zervas . 2013 . Fake it till you make it: Reputation, competition, and yelp review fraud . SSRN Electr. J. 62 , 12 (01 2013). Michael Luca and Georgios Zervas. 2013. Fake it till you make it: Reputation, competition, and yelp review fraud. SSRN Electr. J. 62, 12 (01 2013).","journal-title":"SSRN Electr. J."},{"doi-asserted-by":"publisher","key":"e_1_2_1_30_1","DOI":"10.1145\/321075.321084"},{"doi-asserted-by":"publisher","key":"e_1_2_1_31_1","DOI":"10.1016\/0005-2795(75)90109-9"},{"volume-title":"Discriminant Analysis and Statistical Pattern Recognition","author":"McLachlan Geoffrey J.","unstructured":"Geoffrey J. McLachlan . 2004. Discriminant Analysis and Statistical Pattern Recognition . John Wiley 8 Sons. Geoffrey J. McLachlan. 2004. Discriminant Analysis and Statistical Pattern Recognition. John Wiley 8 Sons.","key":"e_1_2_1_32_1"},{"unstructured":"Scott Menard. 1984. Classification and Regression Trees. SAGE. Scott Menard. 1984. Classification and Regression Trees. SAGE.","key":"e_1_2_1_33_1"},{"key":"e_1_2_1_34_1","first-page":"1","article-title":"Origins of power-law degree distribution in the heterogeneity of human activity in social networks. Sci","volume":"3","author":"Muchnik Lev","year":"2013","unstructured":"Lev Muchnik , Sen Pei , Lucas C. Parra , Saulo D. S. Reis , Jos\u00e9 S. Andrade Jr , Shlomo Havlin , and Hern\u00e1n A. Makse . 2013 . Origins of power-law degree distribution in the heterogeneity of human activity in social networks. Sci . Rep. 3 , 1 (2013), 1 -- 8 . Lev Muchnik, Sen Pei, Lucas C. Parra, Saulo D. S. Reis, Jos\u00e9 S. Andrade Jr, Shlomo Havlin, and Hern\u00e1n A. Makse. 2013. Origins of power-law degree distribution in the heterogeneity of human activity in social networks. Sci. Rep. 3, 1 (2013), 1--8.","journal-title":"Rep."},{"doi-asserted-by":"publisher","key":"e_1_2_1_35_1","DOI":"10.1145\/2487575.2487580"},{"volume-title":"Proceedings of the 21st World Wide Web Conference 2012 (WWW\u201912)","author":"Mukherjee Arjun","unstructured":"Arjun Mukherjee , Bing Liu , and Natalie S. Glance . 2012. Spotting fake reviewer groups in consumer reviews . In Proceedings of the 21st World Wide Web Conference 2012 (WWW\u201912) . ACM, 191--200. Arjun Mukherjee, Bing Liu, and Natalie S. Glance. 2012. Spotting fake reviewer groups in consumer reviews. In Proceedings of the 21st World Wide Web Conference 2012 (WWW\u201912). ACM, 191--200.","key":"e_1_2_1_36_1"},{"volume-title":"Proceedings of the Conference on Weblogs and Social Media. AAAI Press, 409--418","author":"Mukherjee Animesh","unstructured":"Animesh Mukherjee , V. Venkataraman , B. Liu , and N. Glance . 2013. What Yelp fake review filter might be doing? In Proceedings of the Conference on Weblogs and Social Media. AAAI Press, 409--418 . Animesh Mukherjee, V. Venkataraman, B. Liu, and N. Glance. 2013. What Yelp fake review filter might be doing? In Proceedings of the Conference on Weblogs and Social Media. AAAI Press, 409--418.","key":"e_1_2_1_37_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_39_1","DOI":"10.1145\/2187836.2187864"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Ott Myle","unstructured":"Myle Ott , Yejin Choi , Claire Cardie , and Jeffrey T. Hancock . 2011. Finding deceptive opinion spam by any stretch of the imagination . In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies , Volume 1 (HLT\u201911). Association for Computational Linguistics, Stroudsburg, PA, 309--319. Myle Ott, Yejin Choi, Claire Cardie, and Jeffrey T. Hancock. 2011. Finding deceptive opinion spam by any stretch of the imagination. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (HLT\u201911). Association for Computational Linguistics, Stroudsburg, PA, 309--319."},{"unstructured":"Gabriella Pasi and Marco Viviani. 2020. Information credibility in the social web: Contexts approaches and open issues. CoRR abs\/2001.09473. Gabriella Pasi and Marco Viviani. 2020. Information credibility in the social web: Contexts approaches and open issues. CoRR abs\/2001.09473.","key":"e_1_2_1_41_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_42_1","DOI":"10.1016\/j.ins.2019.07.037"},{"doi-asserted-by":"publisher","key":"e_1_2_1_43_1","DOI":"10.5555\/1953048.2078195"},{"doi-asserted-by":"publisher","key":"e_1_2_1_44_1","DOI":"10.1108\/10662240910965342"},{"doi-asserted-by":"publisher","key":"e_1_2_1_45_1","DOI":"10.1002\/sam.11264"},{"doi-asserted-by":"publisher","key":"e_1_2_1_46_1","DOI":"10.1145\/2783258.2783370"},{"doi-asserted-by":"publisher","key":"e_1_2_1_47_1","DOI":"10.1109\/ACCESS.2017.2655032"},{"doi-asserted-by":"publisher","key":"e_1_2_1_48_1","DOI":"10.1145\/3374664.3375744"},{"doi-asserted-by":"publisher","key":"e_1_2_1_49_1","DOI":"10.1145\/2817946.2817964"},{"doi-asserted-by":"publisher","key":"e_1_2_1_50_1","DOI":"10.1002\/int.21844"},{"doi-asserted-by":"publisher","key":"e_1_2_1_51_1","DOI":"10.18653\/v1\/P17-1034"},{"key":"e_1_2_1_52_1","volume-title":"Grace Ngai, and Hong-Va Leong.","author":"Wang Yuanyuan","year":"2013","unstructured":"Yuanyuan Wang , Stephen Chi Fai Chan , Grace Ngai, and Hong-Va Leong. 2013 . Quantifying reviewer credibility in online tourism. In Database and Expert Systems Applications, Hendrik Decker, Lenka Lhotsk\u00e1, Sebastian Link, Josef Basl, and A. Min Tjoa (Eds.). Springer , Berlin, 381--395. Yuanyuan Wang, Stephen Chi Fai Chan, Grace Ngai, and Hong-Va Leong. 2013. Quantifying reviewer credibility in online tourism. In Database and Expert Systems Applications, Hendrik Decker, Lenka Lhotsk\u00e1, Sebastian Link, Josef Basl, and A. Min Tjoa (Eds.). Springer, Berlin, 381--395."},{"doi-asserted-by":"publisher","key":"e_1_2_1_53_1","DOI":"10.2307\/25148667"},{"doi-asserted-by":"publisher","key":"e_1_2_1_54_1","DOI":"10.1016\/j.dss.2020.113280"},{"volume-title":"Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD\u201912)","author":"Xie Sihong","unstructured":"Sihong Xie , Guan Wang , Shuyang Lin , and Philip S. Yu . 2012. Review spam detection via temporal pattern discovery . In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD\u201912) . ACM, 823--831. Sihong Xie, Guan Wang, Shuyang Lin, and Philip S. Yu. 2012. Review spam detection via temporal pattern discovery. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD\u201912). ACM, 823--831.","key":"e_1_2_1_55_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_56_1","DOI":"10.1145\/2513166.2513176"},{"unstructured":"Yelp. 2019. YelpCHI Dataset. Retrieved from http:\/\/odds.cs.stonybrook.edu\/yelpchi-dataset\/. Yelp. 2019. YelpCHI Dataset. Retrieved from http:\/\/odds.cs.stonybrook.edu\/yelpchi-dataset\/.","key":"e_1_2_1_57_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_58_1","DOI":"10.1080\/07421222.2016.1205907"},{"doi-asserted-by":"publisher","key":"e_1_2_1_59_1","DOI":"10.1080\/07421222.2016.1172460"},{"volume-title":"Human Behaviour and the Principle of Least-effort","author":"Zipf George Kingsley","unstructured":"George Kingsley Zipf . 1949. Human Behaviour and the Principle of Least-effort . Addison-Wesley Press . George Kingsley Zipf. 1949. Human Behaviour and the Principle of Least-effort. Addison-Wesley Press.","key":"e_1_2_1_60_1"}],"container-title":["Journal of Data and Information Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3439307","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3439307","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:03:08Z","timestamp":1750197788000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3439307"}},"subtitle":["Improving Opinion Spam Detection by Cumulative Relative Frequency Distribution"],"short-title":[],"issued":{"date-parts":[[2021,1,13]]},"references-count":59,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,3,31]]}},"alternative-id":["10.1145\/3439307"],"URL":"https:\/\/doi.org\/10.1145\/3439307","relation":{},"ISSN":["1936-1955","1936-1963"],"issn-type":[{"type":"print","value":"1936-1955"},{"type":"electronic","value":"1936-1963"}],"subject":[],"published":{"date-parts":[[2021,1,13]]},"assertion":[{"value":"2020-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-01-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}