{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,5]],"date-time":"2026-01-05T22:12:09Z","timestamp":1767651129010,"version":"3.41.0"},"reference-count":42,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2021,12,8]],"date-time":"2021-12-08T00:00:00Z","timestamp":1638921600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2022,7,31]]},"abstract":"<jats:p>\n            Existing probabilistic retrieval models do not restrict the domain of the random variables that they deal with. In this article, we show that the upper bound of the normalized term frequency (\n            <jats:italic>tf<\/jats:italic>\n            ) from the relevant documents is much smaller than the upper bound of the normalized\n            <jats:italic>tf<\/jats:italic>\n            from the whole collection. As a result, the existing models suffer from two major problems: (i) the domain mismatch causes data modeling error, (ii) since the outliers have very large magnitude and the retrieval models follow\n            <jats:italic>tf<\/jats:italic>\n            hypothesis, the combination of these two factors tends to overestimate the relevance score. In an attempt to address these problems, we propose novel weighted probabilistic models based on truncated distributions. We evaluate our models on a set of large document collections. Significant performance improvement over six existing probabilistic models is demonstrated.\n          <\/jats:p>","DOI":"10.1145\/3476837","type":"journal-article","created":{"date-parts":[[2021,12,8]],"date-time":"2021-12-08T20:03:55Z","timestamp":1638993835000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Truncated Models for Probabilistic Weighted Retrieval"],"prefix":"10.1145","volume":"40","author":[{"given":"Jiaul H.","family":"Paik","sequence":"first","affiliation":[{"name":"Indian Institute of Technology, Kharagpur, West Bengal"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yash","family":"Agrawal","sequence":"additional","affiliation":[{"name":"AlphaGrep Securities Inc., Faridabad, Haryana, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sahil","family":"Rishi","sequence":"additional","affiliation":[{"name":"Mercari Inc., Urbana, IL, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vaishal","family":"Shah","sequence":"additional","affiliation":[{"name":"Google Inc., Sunnyvale, California"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,12,8]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/11735106_3"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/582415.582416"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1108\/eb026739"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630250505"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177731607"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1646033"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835490"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-010-9143-7"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-3675-0"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/322047.322053"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-011-9162-z"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.5555\/275537.275710"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/2396761.2398662"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/2746231"},{"key":"e_1_3_1_16_2","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1214\/aoms\/1177728494","article-title":"Estimation of parameters of truncated or censored exponential distributions","author":"Jr Walter L Deemer","year":"1955","unstructured":"Walter L Deemer Jr and David F Votaw Jr. 1955. Estimation of parameters of truncated or censored exponential distributions. The Annals of Mathematical Statistics 26, 3 (1955), 498\u2013504.","journal-title":"The Annals of Mathematical Statistics"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/CEEC.2013.6659437"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/1961209.1961210"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(89)90091-5"},{"key":"e_1_3_1_20_2","volume-title":"Statistics of Extremes","author":"Gumbel Emil Julius","year":"2012","unstructured":"Emil Julius Gumbel. 2012. Statistics of Extremes. Courier Corporation."},{"key":"e_1_3_1_21_2","first-page":"2168","volume-title":"Probability Ranking Principle","author":"He Ben","year":"2009","unstructured":"Ben He. 2009. Probability Ranking Principle. Springer US, Boston, MA, 2168\u20132169. DOI:DOI:https:\/\/doi.org\/10.1007\/978-0-387-39940-9_930"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/582415.582418"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-016-9282-6"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-28997-2_21"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/290941.290995"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/2484028.2484070"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767762"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/2800794"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/290941.291008"},{"key":"e_1_3_1_30_2","first-page":"197","article-title":"A probabilistic approach to automatic keyword indexing. Part I. On the distribution of specialty words in a technical literature","volume":"26","author":"Robertson Stephen","year":"1975","unstructured":"Stephen Robertson and P. Harter. 1975. A probabilistic approach to automatic keyword indexing. Part I. On the distribution of specialty words in a technical literature. Journal of the Association for Information Science 26 (1975), 197\u2013206.","journal-title":"Journal of the Association for Information Science"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1561\/1500000019"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.5555\/106765.106783"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.5555\/636669.636673"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.5555\/188490.188561"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.2307\/2334193"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277756"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.5555\/576628"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/243199.243206"},{"key":"e_1_3_1_39_2","unstructured":"Karen Sparck Jones. 1988. Document retrieval systems. Chapter A statistical interpretation of term specificity and its application in retrieval."},{"key":"e_1_3_1_40_2","volume-title":"All of Statistics: A Concise Course in Statistical Inference","author":"Wasserman Larry","year":"2013","unstructured":"Larry Wasserman. 2013. All of Statistics: A Concise Course in Statistical Inference. Springer Science & Business Media."},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/195705.195713"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1137\/1037125"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/984321.984322"}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3476837","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3476837","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T17:49:20Z","timestamp":1750268960000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3476837"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,8]]},"references-count":42,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,7,31]]}},"alternative-id":["10.1145\/3476837"],"URL":"https:\/\/doi.org\/10.1145\/3476837","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"type":"print","value":"1046-8188"},{"type":"electronic","value":"1558-2868"}],"subject":[],"published":{"date-parts":[[2021,12,8]]},"assertion":[{"value":"2020-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}