{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,22]],"date-time":"2026-03-22T16:01:03Z","timestamp":1774195263440,"version":"3.50.1"},"reference-count":64,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2011,12,1]],"date-time":"2011-12-01T00:00:00Z","timestamp":1322697600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003593","name":"Conselho Nacional de Desenvolvimento Cient\u00edfico e Tecnol\u00f3gico","doi-asserted-by":"publisher","award":["57.3871\/2008-6"],"award-info":[{"award-number":["57.3871\/2008-6"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Data and Information Quality"],"published-print":{"date-parts":[[2011,12]]},"abstract":"<jats:p>The old dream of a universal repository containing all of human knowledge and culture is becoming possible through the Internet and the Web. Moreover, this is happening with the direct collaborative participation of people. Wikipedia is a great example. It is an enormous repository of information with free access and open edition, created by the community in a collaborative manner. However, this large amount of information, made available democratically and virtually without any control, raises questions about its quality. In this work, we explore a significant number of quality indicators and study their capability to assess the quality of articles from three Web collaborative digital libraries. Furthermore, we explore machine learning techniques to combine these quality indicators into one single assessment. Through experiments, we show that the most important quality indicators are those which are also the easiest to extract, namely, the textual features related to the structure of the article. Moreover, to the best of our knowledge, this work is the first that shows an empirical comparison between Web collaborative digital libraries regarding the task of assessing article quality.<\/jats:p>","DOI":"10.1145\/2063504.2063507","type":"journal-article","created":{"date-parts":[[2011,12,20]],"date-time":"2011-12-20T17:49:14Z","timestamp":1324403354000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":30,"title":["Automatic Assessment of Document Quality in Web Collaborative Digital Libraries"],"prefix":"10.1145","volume":"2","author":[{"given":"Daniel Hasan","family":"Dalip","sequence":"first","affiliation":[{"name":"Universidade Federal de Minas Gerais"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marcos Andr\u00e9","family":"Gon\u00e7alves","sequence":"additional","affiliation":[{"name":"Universidade Federal de Minas Gerais"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marco","family":"Cristo","sequence":"additional","affiliation":[{"name":"Federal University of Amazonas"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"P\u00e1vel","family":"Calado","sequence":"additional","affiliation":[{"name":"Instituto Superior T\u00e9cnico\/INESC-ID"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2011,12]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242608"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1341531.1341557"},{"key":"e_1_2_1_3_1","unstructured":"Alexander J. E. and Tate M. A. 1999. Web Wisdom; How to Evaluate and Create Information Quality on the Web. L. Erlbaum Associates Inc. Hillsdale NJ. Alexander J. E. and Tate M. A. 1999. Web Wisdom; How to Evaluate and Create Information Quality on the Web . L. Erlbaum Associates Inc. Hillsdale NJ."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1515\/text.2003.014"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1571941.1572047"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1555400.1555436"},{"key":"e_1_2_1_7_1","volume-title":"Simp\u00f3sio Brasileiro de Sistemas Multim\u00eddia e Web - Webmedia","author":"Bigonha C.","year":"2010","unstructured":"Bigonha , C. , Cardoso , T. N. , Moro , M. M. , Almeida , V. , and Gon\u00e7alves , M. A . 2010. Detecting evangelists and detractors on twitter . In Simp\u00f3sio Brasileiro de Sistemas Multim\u00eddia e Web - Webmedia 2010 , Belo Horizonte, Minas Gerais, Brazil, 107--114. Bigonha, C., Cardoso, T. N., Moro, M. M., Almeida, V., and Gon\u00e7alves, M. A. 2010. Detecting evangelists and detractors on twitter. In Simp\u00f3sio Brasileiro de Sistemas Multim\u00eddia e Web - Webmedia 2010, Belo Horizonte, Minas Gerais, Brazil, 107--114."},{"key":"e_1_2_1_8_1","volume-title":"Lesbarkeit durch Lix","author":"Bj\u00f6rnsson C.","unstructured":"Bj\u00f6rnsson , C. 1968. Lesbarkeit durch Lix . Stockholm : Pedagogiskt Centrum . Bj\u00f6rnsson, C. 1968. Lesbarkeit durch Lix. Stockholm: Pedagogiskt Centrum."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/988672.988752"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the 6th Workshop on Very Large Corpora.","author":"Borthwick A.","unstructured":"Borthwick , A. , Sterling , J. , Agichtein , E. , and Grishman , R . 1998. Exploiting diverse knowledge sources via maximum entropy in named entity recognition . In Proceedings of the 6th Workshop on Very Large Corpora. Borthwick, A., Sterling, J., Agichtein, E., and Grishman, R. 1998. Exploiting diverse knowledge sources via maximum entropy in named entity recognition. In Proceedings of the 6th Workshop on Very Large Corpora."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7552(98)00110-X"},{"key":"e_1_2_1_12_1","unstructured":"Brown R. 2009. Does fundamentalist religion cause the rejection of evolution? or is it the other way around? http:\/\/karmatics.com\/docs\/evolution-and-wisdom-of-crowds.html. Brown R. 2009. Does fundamentalist religion cause the rejection of evolution? or is it the other way around? http:\/\/karmatics.com\/docs\/evolution-and-wisdom-of-crowds.html."},{"key":"e_1_2_1_13_1","volume-title":"LIBSVM: A library for support vector machines","author":"Chang C. C.","year":"2001","unstructured":"Chang , C. C. and Lin , C. J . 2001 . LIBSVM: A library for support vector machines . http:\/\/www.csie.ntu.edu.tw\/ cjlin\/libsvm. Chang, C. C. and Lin, C. J. 2001. LIBSVM: A library for support vector machines. http:\/\/www.csie.ntu.edu.tw\/ cjlin\/libsvm."},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the Pacific Visualization Symposium (PacificVis). IEEE, 49--56","author":"Chevalier F.","unstructured":"Chevalier , F. , Huot , S. , and Fekete , J . -D. 2010. Wikipediaviz: Conveying article quality for casual wikipedia readers . In Proceedings of the Pacific Visualization Symposium (PacificVis). IEEE, 49--56 . Chevalier, F., Huot, S., and Fekete, J.-D. 2010. Wikipediaviz: Conveying article quality for casual wikipedia readers. In Proceedings of the Pacific Visualization Symposium (PacificVis). IEEE, 49--56."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772938.1772942"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the 18th International Conference on Machine Learning (ICML\u201901)","author":"Chu W.","unstructured":"Chu , W. , Keerthi , S. S. , and Ong , C. J . 2001. A unified loss function in bayesian framework for support vector regression . In Proceedings of the 18th International Conference on Machine Learning (ICML\u201901) . Morgan Kaufmann Publishers Inc., San Francisco, CA, 51--58. Chu, W., Keerthi, S. S., and Ong, C. J. 2001. A unified loss function in bayesian framework for support vector regression. In Proceedings of the 18th International Conference on Machine Learning (ICML\u201901). Morgan Kaufmann Publishers Inc., San Francisco, CA, 51--58."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0076540"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1526993.1527001"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1555400.1555449"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772938.1772943"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/11839569_35"},{"key":"e_1_2_1_23_1","unstructured":"Dorogovtsev S. N. and Mendes J. F. F. 2003. Evolution of Networks: From Biological Nets to the Internet and WWW (Physics). Oxford University Press. Dorogovtsev S. N. and Mendes J. F. F. 2003. Evolution of Networks: From Biological Nets to the Internet and WWW (Physics) . Oxford University Press."},{"key":"e_1_2_1_24_1","unstructured":"Drucker H. Burges C. J. C. Kaufman L. Smola A. J. and Vapnik V. 1996. Support vector regression machines. In Advances in Neural Information Processing Systems (NIPS). M. Mozer M. I. Jordan and T. Petsche Eds. MIT Press 155--161. Drucker H. Burges C. J. C. Kaufman L. Smola A. J. and Vapnik V. 1996. Support vector regression machines. In Advances in Neural Information Processing Systems (NIPS) . M. Mozer M. I. Jordan and T. Petsche Eds. MIT Press 155--161."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0057532"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/365024.365037"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/997078.997097"},{"key":"e_1_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Giles J. 2005. Internet encyclopaedias go head to head. Nature 438 7070 901--902. Giles J. 2005. Internet encyclopaedias go head to head. Nature 438 7070 901--902.","DOI":"10.1038\/438902b"},{"key":"e_1_2_1_29_1","volume-title":"The Technique of Clear Writing","author":"Gunning R.","unstructured":"Gunning , R. 1952. The Technique of Clear Writing . McGraw-Hill International Book Co. Gunning, R. 1952. The Technique of Clear Writing. McGraw-Hill International Book Co."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944968"},{"key":"e_1_2_1_31_1","first-page":"1","article-title":"A practical guide to support vector classification","volume":"1","author":"Hsu C.-W.","year":"2000","unstructured":"Hsu , C.-W. , Chang , C.-C. , and Lin , C.-J. 2000 . A practical guide to support vector classification . Bioinformatics 1 , 1 . Hsu, C.-W., Chang, C.-C., and Lin, C.-J. 2000. A practical guide to support vector classification. Bioinformatics 1, 1.","journal-title":"Bioinformatics"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1321440.1321476"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/345508.345545"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1460563.1460572"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1108\/14684520610675780"},{"key":"e_1_2_1_36_1","first-page":"1082","article-title":"Building a digital library the commons-based peer production way","volume":"9","author":"Krowne A.","year":"2003","unstructured":"Krowne , A. 2003 . Building a digital library the commons-based peer production way . D-Lib Mag. 9 , 1082 . Krowne, A. 2003. Building a digital library the commons-based peer production way. D-Lib Mag. 9, 1082.","journal-title":"D-Lib Mag."},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Maged K. B. Maramba I. and Wheeler S. 2006. Wikis blogs and podcasts: A new generation of web-based tools for virtual collaborative clinical practice and education. BMC Medical Educ. 6 41+. Maged K. B. Maramba I. and Wheeler S. 2006. Wikis blogs and podcasts: A new generation of web-based tools for virtual collaborative clinical practice and education. BMC Medical Educ. 6 41+.","DOI":"10.1186\/1472-6920-6-41"},{"key":"e_1_2_1_38_1","unstructured":"McLaughlin G. H. 1969. Smog grading: A new readability formula. J. Read. 639--646. McLaughlin G. H. 1969. Smog grading: A new readability formula. J. Read. 639--646."},{"key":"e_1_2_1_39_1","unstructured":"Mingus B. 2008. personal communication. Mingus B. 2008. personal communication."},{"key":"e_1_2_1_40_1","volume-title":"Machine Learning","author":"Mitchell T. M.","unstructured":"Mitchell , T. M. 1997. Machine Learning . McGraw-Hill Higher Education . Mitchell, T. M. 1997. Machine Learning. McGraw-Hill Higher Education."},{"key":"e_1_2_1_41_1","unstructured":"Muppet. 2010. Statistics-Muppet wiki. http:\/\/muppet.wikia.com\/wiki\/Special:Statistics. Muppet . 2010. Statistics-Muppet wiki. http:\/\/muppet.wikia.com\/wiki\/Special:Statistics."},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the IADIS International Conference on e-Society.","author":"Dondio S. B.","unstructured":"P. Dondio , S. B. and Weber , S . 2006. Calculating the trustworthiness of a Wikipedia article using dante methodology . In Proceedings of the IADIS International Conference on e-Society. P. Dondio, S. B. and Weber, S. 2006. Calculating the trustworthiness of a Wikipedia article using dante methodology. In Proceedings of the IADIS International Conference on e-Society."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518929"},{"key":"e_1_2_1_44_1","unstructured":"Rassbach L. Pincock T. and Mingus B. 2007. Exploring the feasibility of automatically rating online article quality. http:\/\/upload.wikimedia.org\/wikipedia\/wikimania2007\/d\/d3\/RassbachPincockMingus07.pdf. Rassbach L. Pincock T. and Mingus B. 2007. Exploring the feasibility of automatically rating online article quality. http:\/\/upload.wikimedia.org\/wikipedia\/wikimania2007\/d\/d3\/RassbachPincockMingus07.pdf."},{"key":"e_1_2_1_45_1","volume-title":"Perspectives on Electronic Publishing: Standards, Solutions, and More","author":"Ressler S.","unstructured":"Ressler , S. 1993. Perspectives on Electronic Publishing: Standards, Solutions, and More . Prentice-Hall, Inc. , Upper Saddle River, NJ. Ressler, S. 1993. Perspectives on Electronic Publishing: Standards, Solutions, and More. Prentice-Hall, Inc., Upper Saddle River, NJ."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1002\/cae.20218"},{"key":"e_1_2_1_47_1","unstructured":"Smith E. A. and Senter R. J. 1967. Automated readability index. Aerospace Medical Division. Smith E. A. and Senter R. J. 1967. Automated readability index. Aerospace Medical Division ."},{"key":"e_1_2_1_48_1","volume-title":"The Nature of Statistical Learning Theory","author":"Vapnik V. N.","unstructured":"Vapnik , V. N. 1995. The Nature of Statistical Learning Theory . Springer-Verlag , Berlin, Germany . Vapnik, V. N. 1995. The Nature of Statistical Learning Theory. Springer-Verlag, Berlin, Germany."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.2201\/NiiPi.2005.2.3"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622434.1622445"},{"key":"e_1_2_1_51_1","unstructured":"Wikipedia. 2010a. http:\/\/en.wikipedia.org\/wiki\/Wikipedia. Wikipedia . 2010a. http:\/\/en.wikipedia.org\/wiki\/Wikipedia."},{"key":"e_1_2_1_52_1","unstructured":"Wikipedia. 2010b. Featured article candidates. http:\/\/en.wikipedia.org\/wiki\/Wikipedia:Featured_article_candidates. Wikipedia . 2010b. Featured article candidates. http:\/\/en.wikipedia.org\/wiki\/Wikipedia:Featured_article_candidates."},{"key":"e_1_2_1_53_1","unstructured":"Wikipedia. 2010c. Good article nominations. http:\/\/en.wikipedia.org\/wiki\/Wikipedia:Good_article_nominations. Wikipedia . 2010c. Good article nominations. http:\/\/en.wikipedia.org\/wiki\/Wikipedia:Good_article_nominations."},{"key":"e_1_2_1_54_1","unstructured":"Wikipedia. 2010d. Version 1.0 editorial team\/assessment. http:\/\/en.wikipedia.org\/wiki\/Wikipedia:Version_1.0_Editorial_Team\/Assessment. Wikipedia . 2010d. Version 1.0 editorial team\/assessment. http:\/\/en.wikipedia.org\/wiki\/Wikipedia:Version_1.0_Editorial_Team\/Assessment."},{"key":"e_1_2_1_55_1","unstructured":"Wikipedia. 2010e. Version 1.0 editorial team\/release version criteria. http:\/\/en.wikipedia.org\/wiki\/Wikipedia:Version_1.0_Editorial_Team\/Release_Version_Criteria. Wikipedia . 2010e. Version 1.0 editorial team\/release version criteria. http:\/\/en.wikipedia.org\/wiki\/Wikipedia:Version_1.0_Editorial_Team\/Release_Version_Criteria."},{"key":"e_1_2_1_56_1","unstructured":"Wikipedia. 2010f. Wikipedia:database download-wikipedia the free encyclopedia. http:\/\/en.wikipedia.org\/wiki\/Wikipedia_database. Wikipedia . 2010f. Wikipedia:database download-wikipedia the free encyclopedia. http:\/\/en.wikipedia.org\/wiki\/Wikipedia_database."},{"key":"e_1_2_1_57_1","unstructured":"Wikipedia. 2010g. Wikipedia:wikiproject. http:\/\/en.wikipedia.org\/wiki\/Wikipedia:WikiProject. Wikipedia . 2010g. Wikipedia:wikiproject. http:\/\/en.wikipedia.org\/wiki\/Wikipedia:WikiProject."},{"key":"e_1_2_1_58_1","doi-asserted-by":"crossref","unstructured":"Wilcoxon F. 1945. Individual comparisons by ranking methods. Biometrics 80--83. Wilcoxon F. 1945. Individual comparisons by ranking methods. Biometrics 80--83.","DOI":"10.2307\/3001968"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1296951.1296968"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/1641309.1641333"},{"key":"e_1_2_1_61_1","unstructured":"Wookieepedia. 2010a. Statistics-wookieepedia the star wars wiki. http:\/\/starwars.wikia.com\/wiki\/Special:Statistics. Wookieepedia . 2010a. Statistics-wookieepedia the star wars wiki. http:\/\/starwars.wikia.com\/wiki\/Special:Statistics."},{"key":"e_1_2_1_62_1","volume-title":"Wookieepedia: Featured article nominations","author":"Wookieepedia","year":"2010","unstructured":"Wookieepedia . 2010 b. Wookieepedia: Featured article nominations . http:\/\/starwars.wikia.com\/wiki\/Wookieepedia:Featured_article_nominations. Wookieepedia. 2010b. Wookieepedia: Featured article nominations. http:\/\/starwars.wikia.com\/wiki\/Wookieepedia:Featured_article_nominations."},{"key":"e_1_2_1_63_1","volume-title":"Wookieepedia: Good article nominations","author":"Wookieepedia","year":"2010","unstructured":"Wookieepedia . 2010 c. Wookieepedia: Good article nominations . http:\/\/starwars.wikia.com\/wiki\/Wookieepedia:Good_article_nominations. Wookieepedia. 2010c. Wookieepedia: Good article nominations. http:\/\/starwars.wikia.com\/wiki\/Wookieepedia:Good_article_nominations."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/1501434.1501445"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.v57:3"}],"container-title":["Journal of Data and Information Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2063504.2063507","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2063504.2063507","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T10:06:08Z","timestamp":1750241168000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2063504.2063507"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,12]]},"references-count":64,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2011,12]]}},"alternative-id":["10.1145\/2063504.2063507"],"URL":"https:\/\/doi.org\/10.1145\/2063504.2063507","relation":{},"ISSN":["1936-1955","1936-1963"],"issn-type":[{"value":"1936-1955","type":"print"},{"value":"1936-1963","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,12]]},"assertion":[{"value":"2010-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2011-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2011-12-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}