{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T18:08:49Z","timestamp":1754158129275,"version":"3.41.2"},"reference-count":33,"publisher":"Emerald","issue":"5","license":[{"start":{"date-parts":[[2009,9,25]],"date-time":"2009-09-25T00:00:00Z","timestamp":1253836800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2009,9,25]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-heading\">Purpose<\/jats:title><jats:p>The purpose of this paper is to examine the usefulness of fusion as a means of improving the precision of automated opinion detection.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Design\/methodology\/approach<\/jats:title><jats:p>Five system fusion methods are proposed and tested using runs submitted by the Text REtrieval Conference (TREC) Blog06 participants as input. The methods include a voting method, an inverse rank method (IRM), a linear\u2010normalised score method and two weighted methods that use a weighted IRM score to rank the document.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Findings<\/jats:title><jats:p>Mean average precision (MAP) is used as an indicator of the performance of the runs in this study. The best system fusion method achieves a 55.5 percent higher MAP result compared with the highest MAP result of any individual run submitted by the Blog06 participants. This equates to an increase in detection of 2,398 relevant opinion documents (21 percent).<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Practical implications<\/jats:title><jats:p>System fusion can be used to improve upon the results achieved by existing individual opinion detection systems. On the other hand, multiple opinion detection approaches can be combined into one system and fusion used to combine the results to build in diversity. Diversity within fusion inputs can increase the improvements achieved by fusion methods. The improved output from a diverse opinion detection system will then contain a higher number of relevant documents and reduce the incidence of high\u2010ranking non\u2010relevant documents and low\u2010ranking relevant documents.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Originality\/value<\/jats:title><jats:p>The fusion methods proposed in this study demonstrate that simple fusion of opinion detection systems can improve performance.<\/jats:p><\/jats:sec>","DOI":"10.1108\/14684520911001882","type":"journal-article","created":{"date-parts":[[2009,10,10]],"date-time":"2009-10-10T07:08:21Z","timestamp":1255158501000},"page":"873-888","source":"Crossref","is-referenced-by-count":4,"title":["Weblogs for market research: finding more relevant opinion documents using system fusion"],"prefix":"10.1108","volume":"33","author":[{"given":"Deanna","family":"Osman","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John","family":"Yearwood","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Vamplew","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"key":"key2022020920280818100_b1","unstructured":"Andreevskaia, A., Bergler, S. and Urseanu, M. (2007), \u201cAll blogs are not made equal: exploring genre differences in sentiment tagging of blogs\u201d, Proceedings of the International Conference on Weblogs and Social Media (ICWSM\u20102007), Boulder, CO, 26\u201028 March, available at: www.icwsm.org\/blog\/2007\/03\/all\u2010blogs\u2010are\u2010not\u2010made\u2010equal\u2010exploring.html (accessed 15 February 2007)."},{"key":"key2022020920280818100_b2","doi-asserted-by":"crossref","unstructured":"Attardi, G. and Simi, M. (2006), \u201cBlog mining through opinionated words\u201d, in Voorhees, E.M. and Buckland, L.P. (Eds.), The Fifteenth Text REtrieval Conference Proceedings (TREC 2006), National Institute of Standards and Technology (NIST), Gaithersburg, MD, available at: http:\/\/trec.nist.gov\/pubs\/trec15\/papers\/upisa.blog.final.pdf (accessed 28 February 2007).","DOI":"10.6028\/NIST.SP.500-272.blog-upisa.attardi"},{"key":"key2022020920280818100_b3","doi-asserted-by":"crossref","unstructured":"Bartell, B.T., Cottrell, G.W. and Belew, R.K. (1994), \u201cAutomatic combination of multiple ranked retrieval systems\u201d, SIGIR '94: Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Springer\u2010Verlag, New York, NY, pp. 173\u201081.","DOI":"10.1007\/978-1-4471-2099-5_18"},{"key":"key2022020920280818100_b4","unstructured":"Bethard, S., Yu, H., Thornton, A., Hatzivassiloglou, V. and Jurafsky, D. (2005), \u201cAutomatic extraction of opinion propositions and their holders\u201d, in Shanahan, J. and Qu, Y. (Eds), Computing Attitude and Affect in Text: Theory and Applications, Springer, New York, NY, pp. 125\u201041."},{"key":"key2022020920280818100_b5","doi-asserted-by":"crossref","unstructured":"Caruana, R., Niculescu\u2010Mizil, A., Crew, G. and Ksikes, A. (2004), \u201cEnsemble selection from libraries of models\u201d, ICML '04: Proceedings of the Twenty\u2010first International Conference on Machine Learning, Vol. 04, ACM Press, New York, NY, p. 18.","DOI":"10.1145\/1015330.1015432"},{"key":"key2022020920280818100_b6","doi-asserted-by":"crossref","unstructured":"Dong, Y.\u2010S. and Han, K.\u2010S. (2005), \u201cText classification based on data partitioning and parameter varying ensembles\u201d, SAC '05: Proceedings of the 2005 ACM Symposium on Applied Computing, ACM Press, New York, NY, pp. 1044\u20108.","DOI":"10.1145\/1066677.1066916"},{"key":"key2022020920280818100_b7","doi-asserted-by":"crossref","unstructured":"Eguchi, K. and Shah, C. (2006), \u201cOpinion retrieval experiments using generative models: experiments for the TREC 2006 blog track\u201d, in Voorhees, E.M. and Buckland, L.P. (Eds), The Fifteenth Text REtrieval Conference Proceedings (TREC 2006), National Institute of Standards and Technology (NIST), Gaithersburg, MD, available at: http:\/\/trec.nist.gov\/pubs\/trec15\/papers\/nii.blog.final.pdf (accessed 28 February 2007).","DOI":"10.6028\/NIST.SP.500-272.blog-nii-eguchi"},{"key":"key2022020920280818100_b8","doi-asserted-by":"crossref","unstructured":"Farah, M. and Vanderpooten, D. (2007), \u201cAn outranking approach for rank aggregation in information retrieval\u201d, SIGIR '07: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM Press, New York, NY, pp. 591\u20108.","DOI":"10.1145\/1277741.1277843"},{"key":"key2022020920280818100_b9","unstructured":"Fox, E.A. and Shaw, J.A. (1995), \u201cCombination of multiple searches\u201d, in Harman, D.K. (Ed.), The 3rd Text Retrieval Conference (TREC\u20103), National Institute of Standards and Technology (NIST), Gaithersburg, MD, pp. 105\u20108."},{"key":"key2022020920280818100_b10","doi-asserted-by":"crossref","unstructured":"Fuller, M., Kaszkiel, M., Ng, C.L., Vines, P., Wilkinson, R. and Zobel, J. (1997) Vol. 15, \u201cMDS TREC6 report\u201d, Text REtrieval Conference, pp. 241\u201057, available at: citeseer.ist.psu.edu\/70787.html (accessed 15 December 2007).","DOI":"10.6028\/NIST.SP.500-240.sdr-MDS"},{"key":"key2022020920280818100_b11","doi-asserted-by":"crossref","unstructured":"Harman, D. (1993), \u201cOverview of the first TREC conference\u201d, SIGIR '93: Proceedings of the 16th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM Press, New York, NY, pp. 36\u201047.","DOI":"10.1145\/160688.160692"},{"key":"key2022020920280818100_b12","unstructured":"Internet World Stats (2007), \u201cUsage and population statistics\u201d, available at: www.internetworldstats.com\/stats.htm (accessed 15 December 2007)."},{"key":"key2022020920280818100_b13","doi-asserted-by":"crossref","unstructured":"Jansen, B.J., Spink, A. and Saracevic, T. (2000), \u201cReal life, real users, and real needs: A study and analysis of user queries on the web\u201d, Information Processing and Management, Vol. 36 No. 2, pp. 207\u201027.","DOI":"10.1016\/S0306-4573(99)00056-4"},{"key":"key2022020920280818100_b14","doi-asserted-by":"crossref","unstructured":"Joshi, H., Bayrak, C. and Xu, X. (2006), (2006), \u201cUALR at TREC: Blog track\u201d, in Voorhees, E.M. and Buckland, L.P. (Eds), The Fifteenth Text REtrieval Conference Proceedings (TREC 2006), National Institute of Standards and Technology (NIST), Gaithersburg, MD, available at: http:\/\/trec.nist.gov\/pubs\/trec15\/papers\/uarkansas.blog.final.pdf (accessed 28 February 2007).","DOI":"10.6028\/NIST.SP.500-272.blog-uarkansas-littlerock.joshi"},{"key":"key2022020920280818100_b15","unstructured":"Kim, S. and Hovy, E. (2005), \u201cAutomatic detection of opinion bearing words and sentences\u201d, Companion Volume to the Proceedings of the International Joint Conference on Natural Language Processing \u2010 IJCNLP 2005, Springer, New York, NY, pp. 61\u20106."},{"key":"key2022020920280818100_b16","doi-asserted-by":"crossref","unstructured":"Kim, S. and Hovy, E. (2006a) \u201cIdentifying and analyzing judgment opinions\u201d, Proceedings of the Human Language Technology Conference of the NAACL, Main Conference, Association for Computational Linguistics, New York, NY, pp. 200\u20107, available at: www.aclweb.org\/anthology\/N\/N06\/N06\u20101026 (accessed 12 February 2007).","DOI":"10.3115\/1220835.1220861"},{"key":"key2022020920280818100_b17","doi-asserted-by":"crossref","unstructured":"Kim, S. and Hovy, E. (2006b), \u201cAutomatic identification of pro and con reasons in online reviews\u201d, Proceedings of the COLING\/ACL on Main Conference poster sessions, Association for Computational Linguistics, Morristown, NJ, pp. 483\u201090.","DOI":"10.3115\/1273073.1273136"},{"key":"key2022020920280818100_b18","unstructured":"Lenhart, A. and Fox, S. (2006), \u201cBloggers: A portrait of the internet's new storytellers\u201d, Pew Internet and American Life Project, Technical Report, available at: www.pewinternet.org\/PPF\/r\/186\/report_display.asp (accessed 15 February 2007)."},{"key":"key2022020920280818100_b19","unstructured":"Mishne, G. (2006), \u201cMultiple ranking strategies for opinion retrieval in blogs\u201d, in Voorhees, E.M. and Buckland, L.P. (Eds), The Fifteenth Text REtrieval Conference Proceedings (TREC 2006), National Institute of Standards and Technology (NIST), Gaithersburg, MD, available at: http:\/\/trec.nist.gov\/pubs\/trec15\/papers\/uamsterdam.blog.final.pdf (accessed 28 February 2007)."},{"key":"key2022020920280818100_b20","unstructured":"National Institute of Standards and Techology (NIST) (2005), \u201cCommon evaluation measures\u201d, available at: http:\/\/trec.nist.gov\/pubs\/trec14\/appendices\/CE.MEASURES05.pdf (accessed 28 February 2007)."},{"key":"key2022020920280818100_b21","doi-asserted-by":"crossref","unstructured":"Oard, D., Elsayed, T., Wang, J. and Wu, Y. (2006), \u201cTREC\u20102006 at Maryland: Blog, enterprise, legal and QA tracks\u201d, in Voorhees, E.M. and Buckland, L.P. (Eds.), The Fifteenth Text Retrieval Conference Proceedings (TREC 2006), National Institute of Standards and Technology (NIST), Gaithersburg, MD, available at: http:\/\/trec.nist.gov\/pubs\/trec15\/papers\/umd.blog.ent.legal.qa.final.pdf (accessed 28 February 2007).","DOI":"10.21236\/ADA463747"},{"key":"key2022020920280818100_b22","unstructured":"Osman, D., Yearwood, J. and Vamplew, P. (2008), \u201cAutomated opinion detection: Implications of the level of agreement between human raters\u201d, Information Processing and Management, accepted for publication."},{"key":"key2022020920280818100_b23","doi-asserted-by":"crossref","unstructured":"Ounis, I., de Rijke, M., MacDonald, C., Mishne, G. and Soboroff, I. (2006), \u201cOverview of the TREC\u20102006 blog track\u201d, in Voorhees, E.M. and Buckland, L.P. (Eds), The Fifteenth Text Retrieval Conference Proceedings (TREC 2006), National Institute of Standards and Technology (NIST), Gaithersburg, MD, available at: http:\/\/trec.nist.gov\/pubs\/trec15\/papers\/BLOG06.OVERVIEW.pdf (accessed 28 February 2007).","DOI":"10.6028\/NIST.SP.500-272.blog-overview"},{"key":"key2022020920280818100_b24","doi-asserted-by":"crossref","unstructured":"Rosenbloom, A. (2004), \u201cIntroduction: The blogosphere\u201d, Communications of the ACM, Vol. 47 No. 12, pp. 30\u20103.","DOI":"10.1145\/1035134.1035161"},{"key":"key2022020920280818100_b25","doi-asserted-by":"crossref","unstructured":"Singhal, A., Buckley, C. and Mitra, M. (1996), \u201cPivoted document length normalization\u201d, SIGIR '96: Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM Press, New York, NY, pp. 21\u20109.","DOI":"10.1145\/243199.243206"},{"key":"key2022020920280818100_b26","unstructured":"Technorati (2007), \u201cAbout Technorati\u201d, available at: www.technorati.com\/about\/. (accessed 15 December 2007)."},{"key":"key2022020920280818100_b27","doi-asserted-by":"crossref","unstructured":"Vogt, C. and Cottrell, G. (1998), \u201cPredicting the performance of linearly combined IR systems\u201d, SIGIR '98: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM Press, New York, NY, pp. 190\u20106.","DOI":"10.1145\/290941.290991"},{"key":"key2022020920280818100_b28","doi-asserted-by":"crossref","unstructured":"Voorhees, E.M. (1998), \u201cVariations in relevance judgments and the measurement of retrieval effectiveness\u201d, SIGIR \u201898: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM Press, New York, NY, pp. 315\u201023.","DOI":"10.1145\/290941.291017"},{"key":"key2022020920280818100_b29","unstructured":"Wilkinson, R. (1997), \u201cUsing combination of evidence for term expansion\u201d, in Furner, J. and Harper, D. (Eds), Proceedings of the 19th Annual BCS\u2010IRSG Colloquium on IR Research, Springer, New York, NY, p. NY."},{"key":"key2022020920280818100_b30","doi-asserted-by":"crossref","unstructured":"Yang, H., Si, L. and Callan, J. (2006a), \u201cKnowledge transfer and opinion detection in the TREC2006 blog track\u201d, in Voorhees, E.M. and Buckland, L.P. (Eds), The Fifteenth Text REtrieval Conference Proceedings (TREC 2006), National Institute of Standards and Technology (NIST), Gaithersburg, MD, available at: http:\/\/trec.nist.gov\/pubs\/trec15\/papers\/cmu.blog.final.pdf (accessed 28 February 2007).","DOI":"10.6028\/NIST.SP.500-272.blog-cmu.dir.callan"},{"key":"key2022020920280818100_b31","doi-asserted-by":"crossref","unstructured":"Yang, K., Yu, N., Valerio, A. and Zhang, H. (2006b), \u201cWIDIT in TREC\u20102006 blog track\u201d, in Voorhees, E.M. and Buckland, L.P. (Eds), The Fifteenth Text REtrieval Conference Proceedings (TREC 2006), National Institute of Standards and Technology (NIST), Gaithersburg, MD, available at: http:\/\/trec.nist.gov\/pubs\/trec15\/papers\/indianau.blog.final.pdf (accessed 28 February 2007).","DOI":"10.6028\/NIST.SP.500-272.blog-indianau.yang"},{"key":"key2022020920280818100_b32","doi-asserted-by":"crossref","unstructured":"Yu, H. and Hatzivassiloglou, V. (2003), \u201cTowards answering opinion questions: Separating facts from opinions and identifying the polarity of opinion sentences\u201d, Proceedings of the 2003 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Vol. 2003, Association for Computational Linguistics, Morristown, NJ, pp. 129\u201036.","DOI":"10.3115\/1119355.1119372"},{"key":"key2022020920280818100_b33","unstructured":"Zhang, E. and Zhang, Y. (2006), \u201cUCSC on TREC 2006 blog opinion mining\u201d, in Voorhees, E.M. and Buckland, L.P. (Eds), The Fifteenth Text REtrieval Conference Proceedings (TREC 2006), National Institute of Standards and Technology (NIST), Gaithersburg, MD, available at: http:\/\/trec.nist.gov\/pubs\/trec15\/papers\/ucalifornia\u2010sc.blog.pdf (accessed 28 February 2007)."}],"container-title":["Online Information Review"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/14684520911001882","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/14684520911001882\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/14684520911001882\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T00:41:20Z","timestamp":1753404080000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/oir\/article\/33\/5\/873-888\/315398"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,9,25]]},"references-count":33,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2009,9,25]]}},"alternative-id":["10.1108\/14684520911001882"],"URL":"https:\/\/doi.org\/10.1108\/14684520911001882","relation":{},"ISSN":["1468-4527"],"issn-type":[{"type":"print","value":"1468-4527"}],"subject":[],"published":{"date-parts":[[2009,9,25]]}}}