{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T01:11:11Z","timestamp":1759972271960,"version":"build-2065373602"},"reference-count":36,"publisher":"Wiley","issue":"5","license":[{"start":{"date-parts":[[2007,3,22]],"date-time":"2007-03-22T00:00:00Z","timestamp":1174521600000},"content-version":"vor","delay-in-days":7872,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Am. Soc. Inf. Sci."],"published-print":{"date-parts":[[1985,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Since the introduction of the Zipf distribution, many functions have been suggested for the frequency of words in text. Some of these models have also been applied to the distribution of index terms in a set of documents. The models are of two forms: rank\u2010frequency and frequency\u2010size. The former serve well to describe the distribution of high\u2010frequency terms; the latter the distribution of low\u2010frequency terms. In this article, a split model is proposed, which uses both a rank function for the high frequency terms and a size function for the low frequency terms, with the point of transition being determined either empirically or by rule. This model is fitted to the marginal empirical term distributions for four document datasets. Distributions to describe index term exhaustivity and term co\u2010occurrence are also considered briefly.<\/jats:p>","DOI":"10.1002\/asi.4630360502","type":"journal-article","created":{"date-parts":[[2007,6,28]],"date-time":"2007-06-28T18:21:37Z","timestamp":1183054897000},"page":"283-296","source":"Crossref","is-referenced-by-count":20,"title":["Split size\u2010rank models for the distribution of index terms"],"prefix":"10.1002","volume":"36","author":[{"given":"Michael J.","family":"Nelson","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jean M.","family":"Tague","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2007,3,22]]},"reference":[{"key":"e_1_2_1_2_2","first-page":"236","volume-title":"Information Retrieval Research","author":"Tague J.","year":"1981"},{"key":"e_1_2_1_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/1013228.511764"},{"key":"e_1_2_1_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/BFb0036347"},{"key":"e_1_2_1_5_2","first-page":"324","article-title":"Interactions of Statistical Phenomena in Human and Automatic Indexing","volume":"19","author":"Weinburg B. H.","year":"1982","journal-title":"Proceedings of the 45th ASIS Annual Meeting."},{"volume-title":"Human Behaviour and the Principle of Least Effort","year":"1949","author":"Zipf G. K.","key":"e_1_2_1_6_2"},{"key":"e_1_2_1_7_2","first-page":"486","volume-title":"Communication Theory","author":"Mandelbrot B.","year":"1953"},{"key":"e_1_2_1_8_2","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1093\/biomet\/40.3-4.237","article-title":"The population frequencies of species and the estimation of population parameters","volume":"40","author":"Good I. J.","journal-title":"Biometrika."},{"key":"e_1_2_1_9_2","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/42.3-4.425"},{"key":"e_1_2_1_10_2","doi-asserted-by":"publisher","DOI":"10.2307\/2285930"},{"key":"e_1_2_1_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00286478"},{"key":"e_1_2_1_12_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630330507"},{"key":"e_1_2_1_13_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630220206"},{"volume-title":"Information Retrieval: A Critical View","year":"1967","author":"Raver N.","key":"e_1_2_1_14_2"},{"key":"e_1_2_1_15_2","doi-asserted-by":"publisher","DOI":"10.1108\/eb026521"},{"key":"e_1_2_1_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(79)90060-8"},{"key":"e_1_2_1_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(76)90035-2"},{"key":"e_1_2_1_18_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.5090120402"},{"key":"e_1_2_1_19_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.5090150208"},{"key":"e_1_2_1_20_2","first-page":"233","volume-title":"International Computing Symposium 1975","author":"Bennett J. M.","year":"1975"},{"key":"e_1_2_1_21_2","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1021\/ci60007a003","article-title":"Analysis of term distribution in the toxline inverted file","volume":"16","author":"Doszkocs T.","year":"1976","journal-title":"Journal of Chemical Information and Computer Sciences."},{"key":"e_1_2_1_22_2","doi-asserted-by":"publisher","DOI":"10.1108\/eb026600"},{"key":"e_1_2_1_23_2","unstructured":"Griffiths J.\u2010M.The Computer Simulation of Information Retrieval Systems.Ph.D. dissertation University College London England 1977."},{"key":"e_1_2_1_24_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630290104"},{"key":"e_1_2_1_25_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630250505"},{"key":"e_1_2_1_26_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630260402"},{"key":"e_1_2_1_27_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630260504"},{"key":"e_1_2_1_28_2","doi-asserted-by":"publisher","DOI":"10.1108\/eb026586"},{"key":"e_1_2_1_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF02098003"},{"key":"e_1_2_1_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF02016597"},{"key":"e_1_2_1_31_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630290311"},{"key":"e_1_2_1_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0019-9958(67)90201-X"},{"volume-title":"Distributions in Statistics: Discrete Distributions","year":"1969","author":"Johnson N. L.","key":"e_1_2_1_33_2"},{"key":"e_1_2_1_34_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630320206"},{"key":"e_1_2_1_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/321921.321930"},{"key":"e_1_2_1_36_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630270302"},{"key":"e_1_2_1_37_2","first-page":"67","article-title":"The use of term co\u2010occurrence information in information retrieval","volume":"8","author":"Nelson M. J.","year":"1983","journal-title":"The Canadian Journal for Information Science."}],"container-title":["Journal of the American Society for Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fasi.4630360502","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/asi.4630360502","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T20:42:36Z","timestamp":1759956156000},"score":1,"resource":{"primary":{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/10.1002\/asi.4630360502"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1985,9]]},"references-count":36,"journal-issue":{"issue":"5","published-print":{"date-parts":[[1985,9]]}},"alternative-id":["10.1002\/asi.4630360502"],"URL":"https:\/\/doi.org\/10.1002\/asi.4630360502","archive":["Portico"],"relation":{},"ISSN":["0002-8231","1097-4571"],"issn-type":[{"type":"print","value":"0002-8231"},{"type":"electronic","value":"1097-4571"}],"subject":[],"published":{"date-parts":[[1985,9]]}}}