{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,5]],"date-time":"2025-10-05T16:49:25Z","timestamp":1759682965274},"reference-count":9,"publisher":"World Scientific Pub Co Pte Lt","issue":"08","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Artif. Intell. Tools"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:p> Recommender systems\u2019 evaluation is usually based on predictive accuracy and information retrieval metrics, with better scores meaning recommendations are of higher quality. However, new algorithms are constantly developed and the comparison of results of algorithms within an evaluation framework is difficult since different settings are used in the design and implementation of experiments. In this paper, we propose a guidelines-based approach that can be followed to reproduce experiments and results within an evaluation framework. We have evaluated our approach using a real dataset, and well-known recommendation algorithms and metrics; to show that it can be difficult to reproduce results if certain settings are missing, thus resulting in more evaluation cycles required to identify the optimal settings. <\/jats:p>","DOI":"10.1142\/s021821301960011x","type":"journal-article","created":{"date-parts":[[2019,12,3]],"date-time":"2019-12-03T03:31:45Z","timestamp":1575343905000},"page":"1960011","source":"Crossref","is-referenced-by-count":3,"title":["A Guideline-Based Approach for Assisting with the Reproducibility of Experiments in Recommender Systems Evaluation"],"prefix":"10.1142","volume":"28","author":[{"given":"Nikolaos","family":"Polatidis","sequence":"first","affiliation":[{"name":"School of Computing, Engineering and Mathematics, University of Brighton, Lewes Road, Brighton, BN2 4GJ, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elias","family":"Pimenidis","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Creative Technologies, University of the West of England, Bristol, BS16 1QY, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew","family":"Fish","sequence":"additional","affiliation":[{"name":"School of Computing, Engineering and Mathematics, University of Brighton, Lewes Road, Brighton, BN2 4GJ, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stelios","family":"Kapetanakis","sequence":"additional","affiliation":[{"name":"School of Computing, Engineering and Mathematics, University of Brighton, Lewes Road, Brighton, BN2 4GJ, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2019,12,2]]},"reference":[{"key":"p_4","doi-asserted-by":"publisher","DOI":"10.1145\/963770.963772"},{"key":"p_5","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2015.11.023"},{"key":"p_7","first-page":"133","author":"Ekstrand M. D.","year":"2011","journal-title":"NY, USA"},{"key":"p_11","first-page":"23","author":"Konstan J. A.","year":"2013","journal-title":"NY, USA"},{"key":"p_13","doi-asserted-by":"publisher","DOI":"10.1145\/2641383.2641389"},{"key":"p_14","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-016-9174-x"},{"key":"p_17","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2007.07.047"},{"key":"p_19","doi-asserted-by":"publisher","DOI":"10.1145\/2827872"},{"key":"p_20","first-page":"71","author":"Polatidis N.","year":"2017","journal-title":"Expert Syst. Appl."}],"container-title":["International Journal on Artificial Intelligence Tools"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S021821301960011X","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,12,3]],"date-time":"2019-12-03T03:31:54Z","timestamp":1575343914000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S021821301960011X"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12]]},"references-count":9,"journal-issue":{"issue":"08","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["10.1142\/S021821301960011X"],"URL":"https:\/\/doi.org\/10.1142\/s021821301960011x","relation":{},"ISSN":["0218-2130","1793-6349"],"issn-type":[{"value":"0218-2130","type":"print"},{"value":"1793-6349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12]]}}}