{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T23:33:04Z","timestamp":1774308784483,"version":"3.50.1"},"reference-count":54,"publisher":"Wiley","issue":"7","license":[{"start":{"date-parts":[[2009,3,25]],"date-time":"2009-03-25T00:00:00Z","timestamp":1237939200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Am. Soc. Inf. Sci."],"published-print":{"date-parts":[[2009,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Query reformulation is a key user behavior during Web search. Our research goal is to develop predictive models of query reformulation during Web searching. This article reports results from a study in which we automatically classified the query\u2010reformulation patterns for 964,780 Web searching sessions, composed of 1,523,072 queries, to predict the next query reformulation. We employed an n\u2010gram modeling approach to describe the probability of users transitioning from one query\u2010reformulation state to another to predict their next state. We developed first\u2010, second\u2010, third\u2010, and fourth\u2010order models and evaluated each model for accuracy of prediction, coverage of the dataset, and complexity of the possible pattern set. The results show that <jats:italic>Reformulation<\/jats:italic> and <jats:italic>Assistance<\/jats:italic> account for approximately 45% of all query reformulations; furthermore, the results demonstrate that the first\u2010 and second\u2010order models provide the best predictability, between 28 and 40% overall and higher than 70% for some patterns. Implications are that the n\u2010gram approach can be used for improving searching systems and searching assistance.<\/jats:p>","DOI":"10.1002\/asi.21071","type":"journal-article","created":{"date-parts":[[2009,3,25]],"date-time":"2009-03-25T19:46:41Z","timestamp":1238010401000},"page":"1358-1371","source":"Crossref","is-referenced-by-count":81,"title":["Patterns of query reformulation during Web searching"],"prefix":"10.1002","volume":"60","author":[{"given":"Bernard J.","family":"Jansen","sequence":"first","affiliation":[]},{"given":"Danielle L.","family":"Booth","sequence":"additional","affiliation":[]},{"given":"Amanda","family":"Spink","sequence":"additional","affiliation":[]}],"member":"311","published-online":{"date-parts":[[2009,3,25]]},"reference":[{"key":"e_1_2_9_2_1","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1145\/985692.985727","volume-title":"E. Dykstra\u2010Erickson&M. Tscheligi (Chairs), Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 04)","author":"Adamczyk P.D.","year":"2004"},{"key":"e_1_2_9_3_1","first-page":"88","volume-title":"Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Anick P.","year":"2003"},{"key":"e_1_2_9_4_1","doi-asserted-by":"crossref","unstructured":"Belkin N. Cool C. Kelly D. Lee H.\u2010J. Muresan G. Tang M.\u2010C. et al. (2003 July\/August).Query length in interactive information retrieval(pp. 205\u2013 212). Paper presented at the 26th annual International ACM Conference on Research and Development in Information Retrieval Toronto Canada.","DOI":"10.1145\/860435.860474"},{"key":"e_1_2_9_5_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb026722"},{"key":"e_1_2_9_6_1","doi-asserted-by":"publisher","DOI":"10.3115\/977035.977052"},{"key":"e_1_2_9_7_1","unstructured":"Callan J. &Smeaton A.(2003). Personalisation and recommender systems in digital libraries. Retrieved January 1 2009 fromhttp:\/\/www\u20102.cs.cmu.edu\/?callan\/Papers\/Personalisation03\u2010WG.pdf"},{"key":"e_1_2_9_8_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630320503"},{"key":"e_1_2_9_9_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.1159"},{"key":"e_1_2_9_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.10076"},{"key":"e_1_2_9_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/564376.564390"},{"key":"e_1_2_9_12_1","first-page":"290","volume-title":"Proceedings of the 61st Annual Meeting of the American Society for Information Science (ASIS)","author":"Choo C.","year":"1998"},{"key":"e_1_2_9_13_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(198711)38:6<389::AID-ASI1>3.0.CO;2-4"},{"key":"e_1_2_9_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1099554.1099726"},{"key":"e_1_2_9_15_1","first-page":"66","volume-title":"Using association rules to discovery search engines'related queries. Proceedings of the 1st Latin American Web Congress (LA\u2010Web 2003)","author":"Fonseca B.M.","year":"2003"},{"key":"e_1_2_9_16_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199304)44:3<124::AID-ASI2>3.0.CO;2-C"},{"key":"e_1_2_9_17_1","volume-title":"A guide to chi\u2010squared testing","author":"Greenwood P.E.","year":"1996"},{"key":"e_1_2_9_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.10166"},{"key":"e_1_2_9_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(01)00060-7"},{"key":"e_1_2_9_20_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.10256"},{"key":"e_1_2_9_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1121949.1121986"},{"key":"e_1_2_9_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20242"},{"key":"e_1_2_9_23_1","doi-asserted-by":"publisher","DOI":"10.1002\/1097-4571(2000)9999:9999<::AID-ASI1607>3.0.CO;2-F"},{"key":"e_1_2_9_24_1","unstructured":"Jansen B.J. &Spink A.(2003 June).An analysis of Web information seeking and use: Documents retrieved versus documents viewed. Paper presented at the 4th International Conference on Internet Computing Las Vegas Nevada."},{"issue":"1","key":"e_1_2_9_25_1","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1016\/j.ipm.2004.10.007","article-title":"How are we searching the World Wide Web? A comparison of nine search engine transaction logs","volume":"42","author":"Jansen B.J.","year":"2005","journal-title":"Information Processing & Management"},{"issue":"4","key":"e_1_2_9_26_1","first-page":"1875","article-title":"Web searcher interactions with the dogpile.com meta\u2010search engine","volume":"58","author":"Jansen B.J.","year":"2006","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"e_1_2_9_27_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20564"},{"key":"e_1_2_9_28_1","doi-asserted-by":"crossref","unstructured":"Lau T. &Horvitz E.(1999 June).Patterns of search: Analyzing and modeling Web query refinement(pp. 119\u2013 128). Paper presented at the 7th International Conference on User Modeling Banff Alberta Canada.","DOI":"10.1007\/978-3-7091-2490-1_12"},{"key":"e_1_2_9_29_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(198901)40:1<54::AID-ASI6>3.0.CO;2-R"},{"key":"e_1_2_9_30_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630330514"},{"key":"e_1_2_9_31_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630330602"},{"key":"e_1_2_9_32_1","first-page":"38","volume-title":"Modeling information content using observable behavior. Proceedings of the 64th Annual Meeting of the American Society for Information Science and Technology,","author":"Oard D.","year":"2001"},{"key":"e_1_2_9_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2004.04.018"},{"key":"e_1_2_9_34_1","first-page":"1","volume-title":"Neural network applications for automatic new topic identification on Excite Web search engine data logs. Proceedings of the 67th Annual Meeting of the American Society for Information Science and Technology","author":"\u00d6zmutlu H.C.","year":"2004"},{"key":"e_1_2_9_35_1","doi-asserted-by":"crossref","unstructured":"\u00d6zmutlu H.C. \u00c7avdur F. Spink A. &\u00d6zmutlu S.(2005 October\/November).Cross validation of neural network applications for automatic new topic identification(pp. 1\u2013 10). Paper presented at the Association for the American Society of Information Science and Technology Charlotte NC.","DOI":"10.1002\/meet.1450420135"},{"key":"e_1_2_9_35_2","unstructured":"Retrieved March 17 2009 fromhttp:\/\/eprints.rclis.org\/5263\/1\/Ozmutlu_Cross.pdf"},{"key":"e_1_2_9_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.lisr.2005.01.013"},{"key":"e_1_2_9_37_1","volume-title":"Syskill & Webert: Identifying interesting web sites","author":"Pazzani M.","year":"1996"},{"key":"e_1_2_9_38_1","first-page":"147","volume-title":"Proceedings of the 38th Annual Meeting of the American Society for Information Science (ASIS)","author":"Penniman W.D.","year":"1975"},{"key":"e_1_2_9_39_1","first-page":"231","volume-title":"Proceedings of the 45th Annual Meeting of the American Society for Information Science","author":"Penniman W.D.","year":"1982"},{"key":"e_1_2_9_40_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199308)44:7<413::AID-ASI7>3.0.CO;2-D"},{"key":"e_1_2_9_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2005.05.005"},{"key":"e_1_2_9_42_1","first-page":"1102","volume-title":"Proceedings of the 14th International Conference on WorldWideWeb","author":"Shen X.","year":"2005"},{"key":"e_1_2_9_43_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20632"},{"key":"e_1_2_9_44_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199306)44:5<273::AID-ASI3>3.0.CO;2-X"},{"key":"e_1_2_9_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/331403.331405"},{"key":"e_1_2_9_46_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199705)48:5<382::AID-ASI2>3.0.CO;2-R"},{"key":"e_1_2_9_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/354384.354394"},{"key":"e_1_2_9_48_1","first-page":"247","volume-title":"Proceedings of the 7th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Tolle J.E.","year":"1984"},{"key":"e_1_2_9_49_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630360203"},{"key":"e_1_2_9_50_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.10262"},{"issue":"2","key":"e_1_2_9_51_1","first-page":"52","article-title":"Term co\u2010occurrence in Internet search engine queries: An analysis of the Excite data set","volume":"39","author":"White R.W.","year":"2005","journal-title":"Term co\u2010occurrence in Internet search engine queries: An analysis of the Excite data set"},{"issue":"2","key":"e_1_2_9_52_1","first-page":"12","article-title":"Term co\u2010occurrence in Internet search engine queries: An analysis of the Excite data set","volume":"24","author":"Wolfram D.","year":"1999","journal-title":"Canadian Journal of Information and Library Science"},{"key":"e_1_2_9_53_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20988"},{"key":"e_1_2_9_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/WI.2007.4427162"}],"container-title":["Journal of the American Society for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fasi.21071","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/asi.21071","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,11]],"date-time":"2023-10-11T00:18:01Z","timestamp":1696983481000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/asi.21071"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,3,25]]},"references-count":54,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2009,7]]}},"alternative-id":["10.1002\/asi.21071"],"URL":"https:\/\/doi.org\/10.1002\/asi.21071","archive":["Portico"],"relation":{},"ISSN":["1532-2882","1532-2890"],"issn-type":[{"value":"1532-2882","type":"print"},{"value":"1532-2890","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,3,25]]}}}