{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T15:44:12Z","timestamp":1759938252494,"version":"3.41.0"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2015,2,17]],"date-time":"2015-02-17T00:00:00Z","timestamp":1424131200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"IT R&D program of MSIP\/KEIT"},{"name":"Busan University of Foreign Studies in 2014"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2015,2,26]]},"abstract":"<jats:p>The standard approach for term frequency normalization is based only on the document length. However, it does not distinguish the verbosity from the scope, these being the two main factors determining the document length. Because the verbosity and scope have largely different effects on the increase in term frequency, the standard approach can easily suffer from insufficient or excessive penalization depending on the specific type of long document. To overcome these problems, this article proposes two-stage normalization by performing verbosity and scope normalization separately, and by employing different penalization functions. In verbosity normalization, each document is prenormalized by dividing the term frequency by the verbosity of the document. In scope normalization, an existing retrieval model is applied in a straightforward manner to the prenormalized document, finally leading us to formulate our proposed verbosity normalized (VN) retrieval model. Experimental results carried out on standard TREC collections demonstrate that the VN model leads to marginal but statistically significant improvements over standard retrieval models.<\/jats:p>","DOI":"10.1145\/2699669","type":"journal-article","created":{"date-parts":[[2015,2,18]],"date-time":"2015-02-18T13:24:05Z","timestamp":1424265845000},"page":"1-40","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Two-Stage Document Length Normalization for Information Retrieval"],"prefix":"10.1145","volume":"33","author":[{"given":"Seung-Hoon","family":"Na","sequence":"first","affiliation":[{"name":"Busan University of Foreign Studies, South Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2015,2,17]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/215206.215380"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the 9th Text Retrieval Conference (TREC-9).","author":"Allan James","year":"2000","unstructured":"James Allan , Margaret E. Connell , W. Bruce Croft , Fang-Fang Feng , David Fisher , and Xioayan Li . 2000 . INQUERY and TREC-9 . In Proceedings of the 9th Text Retrieval Conference (TREC-9). James Allan, Margaret E. Connell, W. Bruce Croft, Fang-Fang Feng, David Fisher, and Xioayan Li. 2000. INQUERY and TREC-9. In Proceedings of the 9th Text Retrieval Conference (TREC-9)."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/645319.649744"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/582415.582416"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1793274.1793297"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-009-9118-8"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718487.1718492"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2009998"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/188490.188589"},{"volume-title":"Proceedings of the 3rd International Conference on Database and Expert Systems Applications. 78--83","author":"Callan James","key":"e_1_2_1_10_1","unstructured":"James Callan , W. Bruce Croft , and Stephen M. Harding . 1992. The INQUERY retrieval system . In Proceedings of the 3rd International Conference on Database and Expert Systems Applications. 78--83 . James Callan, W. Bruce Croft, and Stephen M. Harding. 1992. The INQUERY retrieval system. In Proceedings of the 3rd International Conference on Database and Expert Systems Applications. 78--83."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835490"},{"volume-title":"Proceedings of the Conf\u00e9rence en Recherche d\u2019Infomations et Applications\u2014the 8th French Information Retrieval Conference (CORIA\u201911)","author":"St\u00e9phane","key":"e_1_2_1_12_1","unstructured":"St\u00e9phane Clinchant and \u00c9ric Gaussier. 2011. A document frequency constraint for pseudo-relevance feedback models . In Proceedings of the Conf\u00e9rence en Recherche d\u2019Infomations et Applications\u2014the 8th French Information Retrieval Conference (CORIA\u201911) . 73--88. St\u00e9phane Clinchant and \u00c9ric Gaussier. 2011. A document frequency constraint for pseudo-relevance feedback models. In Proceedings of the Conf\u00e9rence en Recherche d\u2019Infomations et Applications\u2014the 8th French Information Retrieval Conference (CORIA\u201911). 73--88."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2499178.2499179"},{"key":"e_1_2_1_14_1","volume-title":"Search Engines: Information Retrieval in Practice","author":"Croft Bruce","year":"2009","unstructured":"Bruce Croft , Donald Metzler , and Trevor Strohman . 2009 . Search Engines: Information Retrieval in Practice . Addison-Wesley . Bruce Croft, Donald Metzler, and Trevor Strohman. 2009. Search Engines: Information Retrieval in Practice. Addison-Wesley."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-007-9034-5"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1008992.1009004"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1961209.1961210"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1076034.1076116"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148193"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/956863.956867"},{"key":"e_1_2_1_21_1","volume-title":"Information Retrieval: Computational and Theoretical Aspects","author":"Heaps Harold S.","year":"1978","unstructured":"Harold S. Heaps . 1978 . Information Retrieval: Computational and Theoretical Aspects . Academic Press , Orlando, FL . Harold S. Heaps. 1978. Information Retrieval: Computational and Theoretical Aspects. Academic Press, Orlando, FL."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-28997-2_23"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/258525.258561"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/326440.326445"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-011-9168-6"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1877766.1877769"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1076034.1076087"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1508850.1508851"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1871437.1871473"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1571941.1572023"},{"volume-title":"Learning to Rank for Information Retrieval and Natural Language Processing. Morgan &amp","author":"Hang Li.","key":"e_1_2_1_31_1","unstructured":"Hang Li. 2011. Learning to Rank for Information Retrieval and Natural Language Processing. Morgan &amp ; Claypool . Hang Li. 2011. Learning to Rank for Information Retrieval and Natural Language Processing. Morgan &amp; Claypool."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000016"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/584792.584854"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1646259"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1571941.1571994"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835546"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2063576.2063871"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2063576.2063584"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2010070"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-006-9019-z"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1076034.1076115"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277796"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.5555\/188490.188593"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.5555\/1793274.1793321"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.5555\/1786374.1786378"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5555\/188490.188561"},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the 3rd Text Retrieval Conference (TREC-3).","author":"Robertson Stephen","year":"1995","unstructured":"Stephen Robertson , Stephen Walker , Susan Jones , Micheline Hancock-Beaulieu , and Mike Gatford . 1995 . Okapi at TREC-3 . In Proceedings of the 3rd Text Retrieval Conference (TREC-3). Stephen Robertson, Stephen Walker, Susan Jones, Micheline Hancock-Beaulieu, and Mike Gatford. 1995. Okapi at TREC-3. In Proceedings of the 3rd Text Retrieval Conference (TREC-3)."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000019"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/160688.160693"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/122860.122863"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/243199.243206"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277794"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835475"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/383952.384019"}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2699669","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2699669","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:16:59Z","timestamp":1750227419000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2699669"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,2,17]]},"references-count":54,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2015,2,26]]}},"alternative-id":["10.1145\/2699669"],"URL":"https:\/\/doi.org\/10.1145\/2699669","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"type":"print","value":"1046-8188"},{"type":"electronic","value":"1558-2868"}],"subject":[],"published":{"date-parts":[[2015,2,17]]},"assertion":[{"value":"2013-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-02-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}