{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T05:28:44Z","timestamp":1775021324289,"version":"3.50.1"},"reference-count":24,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2020,2,7]],"date-time":"2020-02-07T00:00:00Z","timestamp":1581033600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,2,7]],"date-time":"2020-02-07T00:00:00Z","timestamp":1581033600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Digit Libr"],"published-print":{"date-parts":[[2020,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>To classify and search various kinds of scientific data, it is useful to annotate those data with keywords from a controlled vocabulary. Data providers, such as researchers, annotate their own data with keywords from the provided vocabulary. However, for the selection of suitable keywords, extensive knowledge of both the research domain and the controlled vocabulary is required. Therefore, the annotation of scientific data with keywords from a controlled vocabulary is a time-consuming task for data providers. In this paper, we discuss methods for recommending relevant keywords from a controlled vocabulary for the annotation of scientific data through their metadata. Many previous studies have proposed approaches based on keywords in similar existing metadata; we call this the <jats:italic>indirect method<\/jats:italic>. However, when the quality of the existing metadata set is insufficient, the indirect method tends to be ineffective. Because the controlled vocabularies for scientific data usually provide definition sentences for each keyword, it is also possible to recommend keywords based on the target metadata and the keyword definitions; we call this the <jats:italic>direct method<\/jats:italic>. The direct method does not utilize the existing metadata set and therefore is independent of its quality. Also, for the evaluation of keyword recommendation methods, we propose evaluation metrics based on a hierarchical vocabulary structure, which is a distinctive feature of most controlled vocabularies. Using our proposed evaluation metrics, we can evaluate keyword recommendation methods with an emphasis on keywords that are more difficult for data providers to select. In experiments using real earth science datasets, we compare the direct and indirect methods to verify their effectiveness, and observe how the indirect method depends on the quality of the existing metadata set. The results show the importance of metadata quality in recommending keywords.\n<\/jats:p>","DOI":"10.1007\/s00799-020-00279-3","type":"journal-article","created":{"date-parts":[[2020,2,7]],"date-time":"2020-02-07T09:04:16Z","timestamp":1581066256000},"page":"307-327","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["An analysis and comparison of keyword recommendation methods for scientific data"],"prefix":"10.1007","volume":"21","author":[{"given":"Youichi","family":"Ishida","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1677-2366","authenticated-orcid":false,"given":"Toshiyuki","family":"Shimizu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Masatoshi","family":"Yoshikawa","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,2,7]]},"reference":[{"key":"279_CR1","doi-asserted-by":"crossref","unstructured":"Bel\u00e9m, F., Martins, E.F., Pontes, T., Almeida, J.M., Gon\u00e7alves, M.A.: Associative tag recommendation exploiting multiple textual features. In: Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1033\u20131042 (2011)","DOI":"10.1145\/2009916.2010053"},{"key":"279_CR2","first-page":"993","volume":"3","author":"DM Blei","year":"2003","unstructured":"Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 3, 993\u20131022 (2003)","journal-title":"J. Mach. Learn. Res."},{"key":"279_CR3","unstructured":"Bruce, T.R., Hillmann, D.I.: The continuum of metadata quality: defining, expressing, exploiting. In: Metadata in Practice, ALA Editions (2004)"},{"key":"279_CR4","doi-asserted-by":"crossref","unstructured":"Chernyak, E.: An approach to the problem of annotation of research publications. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, pp. 429\u2013434 (2015)","DOI":"10.1145\/2684822.2697032"},{"key":"279_CR5","unstructured":"Dangerfield, M.C., Kalshoven, L.: Report and recommendations from the task force on metadata quality. Technical Report, Europeana (2015). https:\/\/pro.europeana.eu\/post\/metadata-quality-task-force-report"},{"key":"279_CR6","doi-asserted-by":"crossref","unstructured":"Fetahu, B., Dietze, S., Nunes, B.P., Casanova, M.A., Taibi, D., Nejdl, W.: A scalable approach for efficiently generating structured dataset topic profiles. In: Proceedings of the 11th European Semantic Web Conference, pp. 519\u2013534 (2014)","DOI":"10.1007\/978-3-319-07443-6_35"},{"key":"279_CR7","unstructured":"Global Change Master Directory (GCMD): GCMD Keywords, Version 8.6. Greenbelt, MD: Earth Science Data and Information System, Earth Science Projects Division, Goddard Space Flight Center (GSFC) National Aeronautics and Space Administration (NASA). URL (GCMD Keyword Forum Page) (2019). https:\/\/wiki.earthdata.nasa.gov\/display\/gcmdkey"},{"issue":"suppl 1","key":"279_CR8","doi-asserted-by":"publisher","first-page":"5228","DOI":"10.1073\/pnas.0307752101","volume":"101","author":"TL Griffiths","year":"2004","unstructured":"Griffiths, T.L., Steyvers, M.: Finding scientific topics. Proc. Natl. Acad. Sci. 101(suppl 1), 5228\u20135235 (2004)","journal-title":"Proc. Natl. Acad. Sci."},{"key":"279_CR9","doi-asserted-by":"crossref","unstructured":"Ishida, Y., Shimizu, T., Yoshikawa, M.: A keyword recommendation method using CorKeD words and its application to earth science data. In: Proceedings of the 11th Asia Information Retrieval Societies Conference, pp. 96\u2013108 (2015)","DOI":"10.1007\/978-3-319-28940-3_8"},{"issue":"41","key":"279_CR10","first-page":"1","volume":"16","author":"A Kawasaki","year":"2017","unstructured":"Kawasaki, A., Yamamoto, A., Koudelova, P., Acierto, R., Nemoto, T., Kitsuregawa, M., Koike, T.: Data integration and analysis system (DIAS) contributing to climate change analysis and disaster risk reduction. Data Sci. J. 16(41), 1\u201317 (2017)","journal-title":"Data Sci. J."},{"key":"279_CR11","doi-asserted-by":"crossref","unstructured":"Krestel, R., Fankhauser, P., Nejdl, W.: Latent dirichlet allocation for tag recommendation. In: Proceedings of the 2009 ACM Conference on Recommender Systems, pp. 61\u201368 (2009)","DOI":"10.1145\/1639714.1639726"},{"issue":"1","key":"279_CR12","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1145\/1273221.1273225","volume":"41","author":"M Lalmas","year":"2007","unstructured":"Lalmas, M., Tombros, A.: Evaluating XML retrieval effectiveness at INEX. SIGIR Forum 41(1), 40\u201357 (2007)","journal-title":"SIGIR Forum"},{"key":"279_CR13","unstructured":"Lu, Y., Yu, S., Chang, T., Hsu, J.Y.: A content-based method to enhance tag recommendation. In: Proceedings of the 21st International Joint Conference on Artificial Intelligence, pp. 2064\u20132069 (2009)"},{"issue":"2\u20133","key":"279_CR14","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1007\/s00799-009-0054-4","volume":"10","author":"X Ochoa","year":"2009","unstructured":"Ochoa, X., Duval, E.: Automatic evaluation of metadata quality in digital repositories. Int. J. Digit. Libr. 10(2\u20133), 67\u201391 (2009)","journal-title":"Int. J. Digit. Libr."},{"key":"279_CR15","doi-asserted-by":"crossref","unstructured":"Paik, J.H.: A novel TF-IDF weighting scheme for effective ranking. In: Proceeding of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 343\u2013352 (2013)","DOI":"10.1145\/2484028.2484070"},{"key":"279_CR16","doi-asserted-by":"crossref","unstructured":"Ramage, D., Hall, D.L.W., Nallapati, R., Manning, C.D.: Labeled LDA: a supervised topic model for credit attribution in multi-labeled corpora. In: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pp. 248\u2013256 (2009)","DOI":"10.3115\/1699510.1699543"},{"key":"279_CR17","doi-asserted-by":"crossref","unstructured":"Ramnandan, S.K., Mittal, A., Knoblock, C.A., Szekely, P.A.: Assigning semantic labels to data sources. In: Proceedings of the 12th European Semantic Web Conference, pp. 403\u2013417 (2015)","DOI":"10.1007\/978-3-319-18818-8_25"},{"key":"279_CR18","volume-title":"Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer","author":"G Salton","year":"1989","unstructured":"Salton, G.: Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer. Addison-Wesley, Boston (1989)"},{"key":"279_CR19","unstructured":"Santos, A.P., Rodrigues, F.: Multi-label hierarchical text classification using the ACM taxonomy. In: Proceedings of the 14th Portuguese Conference on Artificial Intelligence, pp. 553\u2013564 (2009)"},{"key":"279_CR20","doi-asserted-by":"crossref","unstructured":"Schaible, J., Gottron, T., Scherp, A.: Termpicker: Enabling the reuse of vocabulary terms by exploiting data from the linked open data cloud. In: Proceedings of the 13th International Semantic Web Conference, pp. 101\u2013117 (2016a)","DOI":"10.1007\/978-3-319-34129-3_7"},{"key":"279_CR21","doi-asserted-by":"crossref","unstructured":"Schaible, J., Szekely, P.A., Scherp, A.: Comparing vocabulary term recommendations using association rules and learning to rank: a user study. In: Proceedings of the 13th International Semantic Web Conference, pp. 214\u2013230 (2016b)","DOI":"10.1007\/978-3-319-34129-3_14"},{"key":"279_CR22","doi-asserted-by":"crossref","unstructured":"Shimizu, T., Sueki, T., Yoshikawa, M.: Supporting keyword selection in generating earth science metadata. In: Proceedings of the 37th Annual IEEE Computer Software and Applications Conference, pp. 603\u2013604 (2013)","DOI":"10.1109\/COMPSAC.2013.96"},{"issue":"6","key":"279_CR23","doi-asserted-by":"publisher","first-page":"1194","DOI":"10.1016\/j.ipm.2013.05.003","volume":"49","author":"A Tani","year":"2013","unstructured":"Tani, A., Candela, L., Castelli, D.: Dealing with metadata quality: the legacy of digital library efforts. Inf. Process. Manag. 49(6), 1194\u20131205 (2013)","journal-title":"Inf. Process. Manag."},{"key":"279_CR24","doi-asserted-by":"crossref","unstructured":"Tuarob, S., Pouchard, L.C., Giles, C.L.: Automatic tag recommendation for metadata annotation using probabilistic topic modeling. In: Proceedings of the 13th ACM\/IEEE-CS Joint Conference on Digital Libraries, pp. 239\u2013248 (2013)","DOI":"10.1145\/2467696.2467706"}],"container-title":["International Journal on Digital Libraries"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s00799-020-00279-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s00799-020-00279-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s00799-020-00279-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,2,8]],"date-time":"2021-02-08T22:04:46Z","timestamp":1612821886000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s00799-020-00279-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,7]]},"references-count":24,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,9]]}},"alternative-id":["279"],"URL":"https:\/\/doi.org\/10.1007\/s00799-020-00279-3","relation":{},"ISSN":["1432-5012","1432-1300"],"issn-type":[{"value":"1432-5012","type":"print"},{"value":"1432-1300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,7]]},"assertion":[{"value":"4 September 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 August 2019","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 January 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 February 2020","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}