{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T12:41:54Z","timestamp":1760964114512,"version":"build-2065373602"},"reference-count":24,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2005,1,31]],"date-time":"2005-01-31T00:00:00Z","timestamp":1107129600000},"content-version":"vor","delay-in-days":488,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc of Assoc for Info"],"published-print":{"date-parts":[[2003,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In this paper we report on the methodology used in an experiment whose objective was to discover whether information seekers display experimentally demonstrable preferences for index terms with particular properties, and if so, to analyze those preferences. For the experiment, we merged three sets of terms: two sets were identified automatically and one manually. 23 subjects used the merged list of terms via ESBI (Experimental Searching and Browsing Interface) to answer a predetermined set of questions of varying degrees of difficulty. By design, the interface discourages direct searching and forces users to access content indirectly via index terms. Our results provide strong evidence that it is indeed possible to measure human preference for index terms: subjects displayed a strong preference for the manual index terms, which on average were significantly longer and structurally more complex than the automatically identified terms. However, the automatically identified index terms were selected often enough to suggest that they too are of value. We discuss the design of the computer interface, the process of question selection, the preparation of the merged list of index terms, the techniques for assessment of question difficulty, the experimental protocol, and the methods we used for assessing the validity of the experimental results.<\/jats:p>","DOI":"10.1002\/meet.1450400123","type":"journal-article","created":{"date-parts":[[2005,1,31]],"date-time":"2005-01-31T11:49:14Z","timestamp":1107172154000},"page":"184-192","source":"Crossref","is-referenced-by-count":0,"title":["Experimental study of index terms and information access"],"prefix":"10.1002","volume":"40","author":[{"given":"Nina","family":"Wacholder","sequence":"first","affiliation":[]},{"given":"Lu","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Mark","family":"Sharp","sequence":"additional","affiliation":[]},{"given":"Xiaojun","family":"Yuan","sequence":"additional","affiliation":[]},{"given":"Peng","family":"Song","sequence":"additional","affiliation":[]}],"member":"311","published-online":{"date-parts":[[2005,1,31]]},"reference":[{"key":"e_1_2_8_2_1","unstructured":"Anderson J. D.(1997). Guidelines for indexes and related information retrieval devices. NISO Technical Report 2. NISO\u2010TR02\u20101997. Available fromhttp:\/\/www.niso.org\/standards\/std_resources.html"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(1998110)49:13<1185::AID-ASI6>3.0.CO;2-V"},{"key":"e_1_2_8_4_1","unstructured":"Boguraev B. &Kennedy C.(1997). Salience\u2010based content characterisation of text documents. Proceedings of the ACL'97\/EACL'97 Workshop on Intelligent Scalable Text Summarization (pp.2\u20139). Madrid Spain."},{"key":"e_1_2_8_5_1","doi-asserted-by":"crossref","unstructured":"Byrd R. Klavans J. Aronoff M. &Anshen F.(1986).Computer methods for morphological analysis. Proceedings of the 24th Annual Meeting of the Association for Computational Linguistics. New Brunswick NJ: ACL.","DOI":"10.3115\/981131.981150"},{"key":"e_1_2_8_6_1","doi-asserted-by":"crossref","unstructured":"Church K. W.(1988).A Stochastic parts program and noun phrase parser for unrestricted text. Proceedings of Second Applied Natural Language Processing Conference 136\u2013143.","DOI":"10.3115\/974235.974260"},{"key":"e_1_2_8_7_1","doi-asserted-by":"crossref","unstructured":"Dagan I. &Church K. W.(1994).TERMIGHT: Identifying and translating technical terminology. Proceedings of the Fourth ACL Conference on Applied Natural Language Processing 34\u201340.","DOI":"10.3115\/974358.974367"},{"key":"e_1_2_8_8_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199108)42:7<490::AID-ASI4>3.0.CO;2-V"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199409)45:8<572::AID-ASI11>3.0.CO;2-X"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/1097-4571(2000)9999:9999<::AID-ASI1001>3.0.CO;2-E"},{"key":"e_1_2_8_11_1","first-page":"103","article-title":"Structural ambiguity and lexical relations","volume":"19","author":"Hindle D.","year":"1993","journal-title":"Computational Linguistics"},{"volume-title":"Spotting and Discovering Terms through Natural Language Processing","year":"2001","author":"Jacquemin C.","key":"e_1_2_8_12_1"},{"key":"e_1_2_8_13_1","unstructured":"Jorgensen C.&Liddy E. D.(1994). An analysis of information seeking behaviors in index use or opening Pandora's box. Proceedings of the 15th National Online Meeting."},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324900000048"},{"key":"e_1_2_8_15_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb026918"},{"key":"e_1_2_8_16_1","doi-asserted-by":"crossref","first-page":"64","DOI":"10.3828\/indexer.1996.20.2.3","article-title":"Information access or information anxiety?\u2010An exploratory evaluation of book index features","volume":"20","author":"Liddy E. D.","year":"1996","journal-title":"The Indexer"},{"key":"e_1_2_8_17_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199409)45:8<577::AID-ASI12>3.0.CO;2-P"},{"key":"e_1_2_8_18_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/1066.001.0001"},{"key":"e_1_2_8_19_1","unstructured":"Sharp M. &Yuan X.(2002). What makes short phrases useful as indexing terms? A methodology development pilot study [Online]. Available:http:\/\/scils.rutgers.edu\/\u223cmsharp\/696_NLP\/612\u2010final.doc."},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199708)48:8<741::AID-ASI7>3.0.CO;2-S"},{"key":"e_1_2_8_21_1","unstructured":"Vakkari P.(2000). Cognition and changes of search terms and tactics during task performance: A longitudinal case study. Proceedings of the RIAO 2000 Conference 894\u2013907."},{"key":"e_1_2_8_22_1","series-title":"Proceedings of the Workshop on the Computational Treatment of Nominals, COLING\u2010ACL 1998","first-page":"70","volume-title":"Simplex NPs clustered by head: a method for identifying significant topics within a document","author":"Wacholder N.","year":"1998"},{"key":"e_1_2_8_23_1","doi-asserted-by":"crossref","unstructured":"Wacholder N. Klavans J. L. &Evans D. K.(2000). Evaluation of automatically identified index terms for browsing electronic documents. Proceedings of the NAACL\/ANLP2000 Association for Computational Linguistics. Seattle Washington.","DOI":"10.3115\/974147.974189"},{"key":"e_1_2_8_24_1","doi-asserted-by":"crossref","unstructured":"Wacholder N. &Song P.(2003). Toward a task\u2010based gold standard for evaluation of NP chunks and technical terms. Proceedings of HLT\u2010NAACL 2003 Human Language Technology\u2010North American Association of Computational Linguistics (to appear) Edmonton Alberta Canada.","DOI":"10.3115\/1073445.1073480"},{"key":"e_1_2_8_25_1","first-page":"307","volume-title":"Information Seeking in Context","author":"Wang P.","year":"1997"}],"container-title":["Proceedings of the American Society for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fmeet.1450400123","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/meet.1450400123","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T12:02:37Z","timestamp":1760961757000},"score":1,"resource":{"primary":{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/10.1002\/meet.1450400123"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2003,10]]},"references-count":24,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2003,10]]}},"alternative-id":["10.1002\/meet.1450400123"],"URL":"https:\/\/doi.org\/10.1002\/meet.1450400123","archive":["Portico"],"relation":{},"ISSN":["0044-7870","1550-8390"],"issn-type":[{"type":"print","value":"0044-7870"},{"type":"electronic","value":"1550-8390"}],"subject":[],"published":{"date-parts":[[2003,10]]}}}