{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,6,2]],"date-time":"2023-06-02T06:12:13Z","timestamp":1685686333901},"reference-count":35,"publisher":"World Scientific Pub Co Pte Ltd","issue":"04","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Info. Tech. Dec. Mak."],"published-print":{"date-parts":[[2010,7]]},"abstract":"<jats:p>The problem of predicting the next request during a user's navigation session has been extensively studied. In this context, higher-order Markov models have been widely used to model navigation sessions and to predict the next navigation step, while prediction accuracy has been mainly evaluated with the hit and miss score. We claim that this score, although useful, is not sufficient for evaluating next link prediction models with the aim of finding a sufficient order of the model, the size of a recommendation set, and assessing the impact of unexpected events on the prediction accuracy. Herein, we make use of a variable length Markov model to compare the usefulness of three alternatives to the hit and miss score: the Mean Absolute Error, the Ignorance Score, and the Brier score. We present an extensive evaluation of the methods on real data sets and a comprehensive comparison of the scoring methods.<\/jats:p>","DOI":"10.1142\/s0219622010003956","type":"journal-article","created":{"date-parts":[[2010,7,19]],"date-time":"2010-07-19T10:37:41Z","timestamp":1279535861000},"page":"547-573","source":"Crossref","is-referenced-by-count":6,"title":["A COMPARISON OF SCORING METRICS FOR PREDICTING THE NEXT NAVIGATION STEP WITH MARKOV MODEL-BASED SYSTEMS"],"prefix":"10.1142","volume":"09","author":[{"given":"JOS\u00c9","family":"BORGES","sequence":"first","affiliation":[{"name":"School of Engineering, University of Porto, R. Dr. Roberto Frias, 4200 \u2014 Porto, Portugal"}]},{"given":"MARK","family":"LEVENE","sequence":"additional","affiliation":[{"name":"School of Computer Science and Information Systems, Birkbeck, University of London, Malet Street, London WC1E 7HX, UK"}]}],"member":"219","published-online":{"date-parts":[[2011,11,20]]},"reference":[{"key":"rf1","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622008003150"},{"key":"rf2","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622008003204"},{"key":"rf3","doi-asserted-by":"crossref","unstructured":"B.\u00a0Mobasher, The Adaptive Web \u2014 Methods and Strategies of Web Personalization, Chap. Data mining for web personalization (Springer, 2007)\u00a0pp. 90\u2013135.","DOI":"10.1007\/978-3-540-72079-9_3"},{"key":"rf4","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622008002806"},{"key":"rf5","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622008002983"},{"key":"rf6","doi-asserted-by":"publisher","DOI":"10.1145\/345124.345169"},{"key":"rf7","doi-asserted-by":"publisher","DOI":"10.1287\/ijoc.15.2.171.14445"},{"key":"rf8","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622008002971"},{"key":"rf9","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-44934-5_6"},{"key":"rf11","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btg489"},{"key":"rf12","doi-asserted-by":"publisher","DOI":"10.1007\/s00500-006-0115-1"},{"key":"rf13","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2007.1012"},{"key":"rf14","volume-title":"Data Mining, Practical Machine Learning Tools and Techniques","author":"Witten I.","year":"2005"},{"key":"rf15","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0493(2002)130<1653:EPFUIT>2.0.CO;2"},{"key":"rf16","doi-asserted-by":"publisher","DOI":"10.1017\/S0269888905000408"},{"key":"rf17","volume":"38","author":"Geng L.","journal-title":"ACM Computing Surveys"},{"key":"rf18","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2004.06.003"},{"key":"rf21","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1023\/A:1015750423727","volume":"5","author":"Wu Y.-H.","journal-title":"World Wide Web: Internet and Web Information Systems"},{"key":"rf23","doi-asserted-by":"publisher","DOI":"10.1109\/MCISE.2002.1046594"},{"key":"rf24","first-page":"1","volume":"12","author":"Sen R.","journal-title":"Journal of Computational and Graphical Statistics"},{"key":"rf25","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2003.1185219"},{"key":"rf29","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-10874-1_18"},{"key":"rf30","doi-asserted-by":"publisher","DOI":"10.1145\/990301.990304"},{"key":"rf32","doi-asserted-by":"publisher","DOI":"10.1504\/IJEB.2005.007279"},{"key":"rf33","series-title":"LNAI","first-page":"135","author":"Berka P.","year":"2007"},{"key":"rf35","doi-asserted-by":"publisher","DOI":"10.1145\/1216016.1216022"},{"key":"rf36","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-72830-6_23"},{"key":"rf37","doi-asserted-by":"publisher","DOI":"10.1504\/IJWET.2007.012057"},{"key":"rf39","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-006-0014-1"},{"key":"rf40","volume-title":"Finite Markov Chains","author":"Kemeny J.","year":"1960"},{"key":"rf41","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(99)00098-3"},{"key":"rf42","doi-asserted-by":"publisher","DOI":"10.1145\/963770.963772"},{"key":"rf43","doi-asserted-by":"publisher","DOI":"10.1145\/984321.984322"},{"key":"rf45","doi-asserted-by":"crossref","first-page":"27","DOI":"10.55630\/sjc.2007.1.27-44","volume":"1","author":"Koychev I.","journal-title":"Serdica Journal of Computing"},{"key":"rf46","doi-asserted-by":"publisher","DOI":"10.1137\/S0895480102412856"}],"container-title":["International Journal of Information Technology &amp; Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0219622010003956","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,2]],"date-time":"2023-06-02T05:31:23Z","timestamp":1685683883000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0219622010003956"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,7]]},"references-count":35,"journal-issue":{"issue":"04","published-online":{"date-parts":[[2011,11,20]]},"published-print":{"date-parts":[[2010,7]]}},"alternative-id":["10.1142\/S0219622010003956"],"URL":"https:\/\/doi.org\/10.1142\/s0219622010003956","relation":{},"ISSN":["0219-6220","1793-6845"],"issn-type":[{"value":"0219-6220","type":"print"},{"value":"1793-6845","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,7]]}}}