{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T18:08:31Z","timestamp":1754158111212,"version":"3.41.2"},"reference-count":18,"publisher":"Emerald","issue":"3","license":[{"start":{"date-parts":[[2001,6,1]],"date-time":"2001-06-01T00:00:00Z","timestamp":991353600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2001,6,1]]},"abstract":"<jats:p>Through an evaluation of system performance and user satisfaction for the Mercurio system, considers the general applicability and usefulness of different methods of specifying user interest for the general case of digital news services. Outlines the specific characteristics distinguishing such systems from more general information systems and discusses their effect. Proposes an evaluation blueprint for them starting from information retrieval procedures, existing work on search engine evaluation, and a close study of the working principles and the required evaluation according to the particular properties and conditions of the services under consideration. Presents and discusses actual evaluation results for system tests based both on real users and customised test cases. Conclusions cover the nature of the information handling tasks that digital news services are faced with, the relative merits of sections, categories and keywords with respect to this particular set of tasks, and the risks of careless application of recall and precision measures in systems such as these.<\/jats:p>","DOI":"10.1108\/14684520110395272","type":"journal-article","created":{"date-parts":[[2007,4,13]],"date-time":"2007-04-13T10:06:23Z","timestamp":1176458783000},"page":"149-160","source":"Crossref","is-referenced-by-count":4,"title":["Sections, categories and keywords as interest specification tools for personalised news services"],"prefix":"10.1108","volume":"25","author":[{"given":"Alberto","family":"D\u00edaz","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pablo","family":"Gerv\u00e1s","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antonio","family":"Garc\u00eda","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Inmaculada","family":"Chac\u00f3n","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"key":"key2021010521395170000_B1","unstructured":"Amato, G. and Straccia, U. (1999), \u201cUser profile modelling and applications to digital libraries\u201d, Proceedings of the Third European Conference on Research and Advanced Technology for Digital Libraries, Lecture Notes in Computer Science, Springer Verlag, Paris, pp. 184\u201097."},{"key":"key2021010521395170000_B2","unstructured":"Baeza\u2010Yates, R. and Ribeiro\u2010Neto, B. (1999), Modern Information Retrieval, ACM Press Books, New York, NY."},{"key":"key2021010521395170000_B3","doi-asserted-by":"crossref","unstructured":"Clarke, S. and Willet, P. (1997), \u201cEstimating the recall performance of web search engines\u201d, Aslib Proceedings, Vol. 4 No. 7, pp. 184\u20109.","DOI":"10.1108\/eb051463"},{"key":"key2021010521395170000_B4","unstructured":"D\u00edaz, A., Gerv\u00e1s, P. and Garc\u00eda, A. (2000), \u201cEvaluating a user\u2010model based personalisation architecture for digital news services\u201d, Proceedings of the Fourth European Conference on Research and Advanced Technology for Digital Libraries, Lecture Notes in Computer Science, Springer Verlag, Lisbon,  pp. 259\u201068."},{"key":"key2021010521395170000_B5","unstructured":"Dong, X. and Su, L.T. (1997), \u201cSearch engines on the World Wide Web and information retrieval from the Internet: a review and evaluation\u201d, Online and CD\u2010ROM Review, Vol. 21 No. 2, pp. 67\u201081."},{"key":"key2021010521395170000_B6","unstructured":"Garc\u00eda, A., Chac\u00f3n, I., D\u00edaz, A. and Gerv\u00e1s, P. (2000), \u201cNuevos sistemas de informaci\u00f3n: tendencias y evaluaci\u00f3n\u201d, Cuadernos de Documentaci\u00f3n Multimedia, No. 9, http:\/\/www.ucm.es\/info\/multidoc\/multidoc\/revista\/num9\/prensa\/jime\u2010chacon.htm"},{"key":"key2021010521395170000_B7","unstructured":"Gerv\u00e1s, P., San Miguel, B., D\u00edaz, A. and Garc\u00eda, A. (1999), \u201cMercurio: un servidor personalizado de noticias basado en modelos de usuario obtenidos a trav\u00e9s de la WWW\u201d, III Congreso de Investigadores Audiovisuales (Los medios del tercer milenio), 10\u201012 November, Facultad de Ciencias de la Informaci\u00f3n, Universidad Complutense de Madrid, Madrid."},{"key":"key2021010521395170000_B8","unstructured":"G\u00f3mez, J.M. and Buenaga, M. (1997), \u201cIntegrating a Lexical Database and a training collection for text categorisation\u201d, ACL\/EACL Workshop on Automatic Information Extraction and Building of Lexical Semantic Resources for NLP, Madrid."},{"key":"key2021010521395170000_B9","unstructured":"Gordon, M. and Pathak, P. (1999), \u201cFinding information on the World Wide Web: the retrieval effectiveness of search engines\u201d, Information Processing and Management, Vol. 35, pp. 141\u201080."},{"key":"key2021010521395170000_B10","unstructured":"Leighton, V.H. and Srivastava, J. (1999), \u201cFirst 20 precision among World Wide Web search services (search engines)\u201d, Journal of the American Society for Information Science, Vol. 50 No. 10, pp. 870\u201081."},{"key":"key2021010521395170000_B11","unstructured":"Lewis, D.D., Schapire, R.E., Callan, J.P. and Papka, R. (1996), \u201cTraining algorithms for linear text classifiers\u201d, Proceedings of SIGIR \u201996, 19th ACM International Conference on Research and Development in Information Retrieval, ACM Press, New York, NY, pp. 298\u2010306."},{"key":"key2021010521395170000_B12","unstructured":"Maldonado, A. and Fern\u00e1ndez, E. (1998), \u201cEvaluaci\u00f3n de los principales buscadores desde un punto de vista documental: recogida, an\u00e1lisis y recuperaci\u00f3n de recursos de informaci\u00f3n\u201d, Actas de las VI Jornadas Espa\u00f1olas de Documentaci\u00f3n, Vol. 2, pp. 529\u201052."},{"key":"key2021010521395170000_B13","unstructured":"Olvera Lobo, M.D. (2000), \u201cRendimiento de los sistemas de recuperaci\u00f3n de informaci\u00f3n en la world wide web: revisi\u00f3n metodol\u00f3gica\u201d, Revista Espa\u00f1ola de Documentaci\u00f3n Cient\u00edfica, Vol. 23 No. 1, pp. 63\u201077."},{"key":"key2021010521395170000_B14","unstructured":"Pastor, J.A. and Asensi, V. (1999), \u201cUn modelo para la Evaluaci\u00f3n de Interfaces en Sistemas de Recuperaci\u00f3n de Informaci\u00f3n\u201d, IV Congreso Isko\u2010Espa\u00f1a Eoconsid\u201999, Granada."},{"key":"key2021010521395170000_B15","unstructured":"Salton, G. (1989), Automatic Text Processing: The Transformation, Analysis and Retrieval of Information by Computer, Addison\u2010Wesley, Reading, MA."},{"key":"key2021010521395170000_B16","unstructured":"Schwartz, C. (1998), \u201cWeb search engines\u201d, Journal of the American Society for Information Science, Vol. 49 No. 11, pp. 973\u201082."},{"key":"key2021010521395170000_B17","unstructured":"Sebastiani, F. (1999), \u201cA tutorial on automated text categorisation\u201d, Proceedings of the First Argentinian Symposium on Artificial Intelligence (ASAI\u201099),  pp. 7\u201035."},{"key":"key2021010521395170000_B18","unstructured":"Yang, Y. (1999), \u201cAn evaluation of statistical approaches to text categorisation\u201d, Information Retrieval, Vol. 1 No. 1\/2, pp. 69\u201090."}],"container-title":["Online Information Review"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/14684520110395272","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/14684520110395272\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/14684520110395272\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T00:39:43Z","timestamp":1753403983000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/oir\/article\/25\/3\/149-160\/303146"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2001,6,1]]},"references-count":18,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2001,6,1]]}},"alternative-id":["10.1108\/14684520110395272"],"URL":"https:\/\/doi.org\/10.1108\/14684520110395272","relation":{},"ISSN":["1468-4527"],"issn-type":[{"type":"print","value":"1468-4527"}],"subject":[],"published":{"date-parts":[[2001,6,1]]}}}