{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,18]],"date-time":"2026-01-18T03:05:00Z","timestamp":1768705500276,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":46,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,9,10]],"date-time":"2019-09-10T00:00:00Z","timestamp":1568073600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,9,10]]},"DOI":"10.1145\/3298689.3347010","type":"proceedings-article","created":{"date-parts":[[2019,9,11]],"date-time":"2019-09-11T13:21:31Z","timestamp":1568208091000},"page":"447-451","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["On the discriminative power of hyper-parameters in cross-validation and how to choose them"],"prefix":"10.1145","author":[{"given":"Vito Walter","family":"Anelli","sequence":"first","affiliation":[{"name":"Polytechnic University of Bari, Bari, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tommaso","family":"Di Noia","sequence":"additional","affiliation":[{"name":"Polytechnic University of Bari, Bari, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eugenio","family":"Di Sciascio","sequence":"additional","affiliation":[{"name":"Polytechnic University of Bari, Bari, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Claudio","family":"Pomo","sequence":"additional","affiliation":[{"name":"Polytechnic University of Bari, Bari, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Azzurra","family":"Ragone","sequence":"additional","affiliation":[{"name":"Independent Researcher, Milan, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,9,10]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Eugenio Di Sciascio, Azzurra Ragone, and Joseph Trotta.","author":"Anelli Vito Walter","year":"2019","unstructured":"Vito Walter Anelli , Tommaso Di Noia , Eugenio Di Sciascio, Azzurra Ragone, and Joseph Trotta. 2019 . The importance of being dissimilar in Recommendation . to appear. Vito Walter Anelli, Tommaso Di Noia, Eugenio Di Sciascio, Azzurra Ragone, and Joseph Trotta. 2019. The importance of being dissimilar in Recommendation. to appear."},{"key":"e_1_3_2_1_2_1","volume-title":"ECIR 2019, Cologne, Germany, April 14--18, 2019, Proc., Part I. 861--868","author":"Anelli Vito Walter","year":"2019","unstructured":"Vito Walter Anelli , Tommaso Di Noia , Eugenio Di Sciascio , Azzurra Ragone , and Joseph Trotta . 2019 . Local Popularity and Time in top-N Recommendation. In Advances in Information Retrieval - 41st European Conf. on IR Research , ECIR 2019, Cologne, Germany, April 14--18, 2019, Proc., Part I. 861--868 . Vito Walter Anelli, Tommaso Di Noia, Eugenio Di Sciascio, Azzurra Ragone, and Joseph Trotta. 2019. Local Popularity and Time in top-N Recommendation. In Advances in Information Retrieval - 41st European Conf. on IR Research, ECIR 2019, Cologne, Germany, April 14--18, 2019, Proc., Part I. 861--868."},{"key":"e_1_3_2_1_3_1","volume-title":"Proc. of the 1st Workshop on Temporal Reasoning in Recommender Systems co-located with 11th Int. Conf. on Recommender Systems (RecSys 2017","author":"Bellog\u00edn Alejandro","year":"2017","unstructured":"Alejandro Bellog\u00edn and Pablo S\u00e1nchez . 2017 . Revisiting Neighbourhood-Based Recommenders For Temporal Scenarios . In Proc. of the 1st Workshop on Temporal Reasoning in Recommender Systems co-located with 11th Int. Conf. on Recommender Systems (RecSys 2017 ), Como, Italy, August 27--31 , 2017. 40--44. Alejandro Bellog\u00edn and Pablo S\u00e1nchez. 2017. Revisiting Neighbourhood-Based Recommenders For Temporal Scenarios. In Proc. of the 1st Workshop on Temporal Reasoning in Recommender Systems co-located with 11th Int. Conf. on Recommender Systems (RecSys 2017), Como, Italy, August 27--31, 2017. 40--44."},{"key":"e_1_3_2_1_4_1","volume-title":"Proc. of KDD cup and workshop","volume":"2007","author":"Bennett James","year":"2007","unstructured":"James Bennett , Stan Lanning , 2007 . The netflix prize . In Proc. of KDD cup and workshop , Vol. 2007 . New York, NY, USA., 35. James Bennett, Stan Lanning, et al. 2007. The netflix prize. In Proc. of KDD cup and workshop, Vol. 2007. New York, NY, USA., 35."},{"key":"e_1_3_2_1_5_1","volume-title":"Algorithms for Hyper-Parameter Optimization. In Advances in Neural Information Processing Systems 24: 25th Annual Conf. on Neural Information Processing Systems 2011. Proc. of a meeting held 12--14","author":"Bergstra James","year":"2011","unstructured":"James Bergstra , R\u00e9mi Bardenet , Yoshua Bengio , and Bal\u00e1zs K\u00e9gl . 2011 . Algorithms for Hyper-Parameter Optimization. In Advances in Neural Information Processing Systems 24: 25th Annual Conf. on Neural Information Processing Systems 2011. Proc. of a meeting held 12--14 December 2011, Granada, Spain. 2546--2554. James Bergstra, R\u00e9mi Bardenet, Yoshua Bengio, and Bal\u00e1zs K\u00e9gl. 2011. Algorithms for Hyper-Parameter Optimization. In Advances in Neural Information Processing Systems 24: 25th Annual Conf. on Neural Information Processing Systems 2011. Proc. of a meeting held 12--14 December 2011, Granada, Spain. 2546--2554."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/2188385.2188395"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1088\/1749-4699\/8\/1\/014008"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.25080\/Majora-8b375195-003"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052713"},{"key":"e_1_3_2_1_10_1","volume-title":"A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning. CoRR abs\/1012.2599","author":"Brochu Eric","year":"2010","unstructured":"Eric Brochu , Vlad M. Cora , and Nando de Freitas . 2010. A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning. CoRR abs\/1012.2599 ( 2010 ). Eric Brochu, Vlad M. Cora, and Nando de Freitas. 2010. A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning. CoRR abs\/1012.2599 (2010)."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-012-9136-x"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Pablo Castells Neil J. Hurley and Saul Vargas. 2015. Novelty and Diversity in Recommender Systems. See {35} 881--918.  Pablo Castells Neil J. Hurley and Saul Vargas. 2015. Novelty and Diversity in Recommender Systems. See {35} 881--918.","DOI":"10.1007\/978-1-4899-7637-6_26"},{"key":"e_1_3_2_1_13_1","volume-title":"Novelty and Diversity in Recommender Systems","author":"Castells Pablo","unstructured":"Pablo Castells , Neil J. Hurley , and Saul Vargas . 2015. Novelty and Diversity in Recommender Systems . Springer US , Boston, MA , 881--918. Pablo Castells, Neil J. Hurley, and Saul Vargas. 2015. Novelty and Diversity in Recommender Systems. Springer US, Boston, MA, 881--918."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2013.6691595"},{"key":"e_1_3_2_1_15_1","volume-title":"Conf.","author":"Cremonesi Paolo","year":"2011","unstructured":"Paolo Cremonesi , Franca Garzotto , Sara Negro , Alessandro Vittorio Papadopoulos , and Roberto Turrin . 2011 . Looking for \"Good\" Recommendations: A Comparative Evaluation of Recommender Systems. In Human-Computer Interaction - INTERACT 2011 - 13th IFIP TC 13 Int . Conf. , Lisbon, Portugal, September 5--9 , 2011, Proc., Part III. 152--168. Paolo Cremonesi, Franca Garzotto, Sara Negro, Alessandro Vittorio Papadopoulos, and Roberto Turrin. 2011. Looking for \"Good\" Recommendations: A Comparative Evaluation of Recommender Systems. In Human-Computer Interaction - INTERACT 2011 - 13th IFIP TC 13 Int. Conf., Lisbon, Portugal, September 5--9, 2011, Proc., Part III. 152--168."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1864708.1864721"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/AXMEDIS.2008.13"},{"key":"e_1_3_2_1_18_1","volume-title":"Multiclass SVM Model Selection Using Particle Swarm Optimization. In 6th Int. Conf. on Hybrid Intelligent Systems (HIS 2006","author":"de Souza Bruno Feres","year":"2006","unstructured":"Bruno Feres de Souza , Andr\u00e9 Carlos Ponce de Leon Ferreira de Carvalho , Rodrigo Calvo , and Renato Porfirio Ishii . 2006 . Multiclass SVM Model Selection Using Particle Swarm Optimization. In 6th Int. Conf. on Hybrid Intelligent Systems (HIS 2006 ), 13--15 December 2006, Auckland, New Zealand. 31. Bruno Feres de Souza, Andr\u00e9 Carlos Ponce de Leon Ferreira de Carvalho, Rodrigo Calvo, and Renato Porfirio Ishii. 2006. Multiclass SVM Model Selection Using Particle Swarm Optimization. In 6th Int. Conf. on Hybrid Intelligent Systems (HIS 2006), 13--15 December 2006, Auckland, New Zealand. 31."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2004.11.022"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/963770.963772"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1944339.1944341"},{"key":"e_1_3_2_1_22_1","volume-title":"Proc. of the 31th Int. Conf. on Machine Learning, ICML 2014, Beijing, China, 21--26 June 2014 (JMLR Workshop and Conf. Proc.)","volume":"32","author":"Hutter Frank","year":"2014","unstructured":"Frank Hutter , Holger H. Hoos , and Kevin Leyton-Brown . 2014 . An Efficient Approach for Assessing Hyperparameter Importance . In Proc. of the 31th Int. Conf. on Machine Learning, ICML 2014, Beijing, China, 21--26 June 2014 (JMLR Workshop and Conf. Proc.) , Vol. 32 . JMLR.org, 754--762. Frank Hutter, Holger H. Hoos, and Kevin Leyton-Brown. 2014. An Efficient Approach for Assessing Hyperparameter Importance. In Proc. of the 31th Int. Conf. on Machine Learning, ICML 2014, Beijing, China, 21--26 June 2014 (JMLR Workshop and Conf. Proc.), Vol. 32. JMLR.org, 754--762."},{"key":"e_1_3_2_1_23_1","first-page":"329","article-title":"Beyond Manual Tuning of Hyperparameters","volume":"29","author":"Hutter Frank","year":"2015","unstructured":"Frank Hutter , J\u00f6rg L\u00fccke , and Lars Schmidt-Thieme . 2015 . Beyond Manual Tuning of Hyperparameters . KI 29 , 4 (2015), 329 -- 337 . Frank Hutter, J\u00f6rg L\u00fccke, and Lars Schmidt-Thieme. 2015. Beyond Manual Tuning of Hyperparameters. KI 29, 4 (2015), 329--337.","journal-title":"KI"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835804.1835893"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/582415.582418"},{"key":"e_1_3_2_1_26_1","volume-title":"Proc. of the Fourteenth Int. Joint Conf. on Artificial Intelligence, IJCAI 95","author":"Kohavi Ron","year":"1995","unstructured":"Ron Kohavi . 1995 . A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection . In Proc. of the Fourteenth Int. Joint Conf. on Artificial Intelligence, IJCAI 95 , Montr\u00e9al Qu\u00e9bec, Canada, August 20--25 1995, 2 Volumes. Morgan Kaufmann, 1137--1145. Ron Kohavi. 1995. A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection. In Proc. of the Fourteenth Int. Joint Conf. on Artificial Intelligence, IJCAI 95, Montr\u00e9al Qu\u00e9bec, Canada, August 20--25 1995, 2 Volumes. Morgan Kaufmann, 1137--1145."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390351"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-016-9282-6"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2015.2415257"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/304182.304204"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488466"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1125451.1125659"},{"key":"e_1_3_2_1_33_1","volume-title":"Cox","author":"Pinto Nicolas","year":"2009","unstructured":"Nicolas Pinto , David Doukhan , James J. DiCarlo , and David D . Cox . 2009 . A High-Throughput Screening Approach to Discovering Good Forms of Biologically Inspired Visual Representation. PLoS Computational Biology 5, 11 (2009). Nicolas Pinto, David Doukhan, James J. DiCarlo, and David D. Cox. 2009. A High-Throughput Screening Approach to Discovering Good Forms of Biologically Inspired Visual Representation. PLoS Computational Biology 5, 11 (2009)."},{"key":"e_1_3_2_1_34_1","volume-title":"UAI 2009, Proc. of the Twenty-Fifth Conf. on Uncertainty in Artificial Intelligence, Montreal, QC, Canada, June 18--21","author":"Rendle Steffen","year":"2009","unstructured":"Steffen Rendle , Christoph Freudenthaler , Zeno Gantner , and Lars Schmidt-Thieme . 2009 . BPR: Bayesian Personalized Ranking from Implicit Feedback . In UAI 2009, Proc. of the Twenty-Fifth Conf. on Uncertainty in Artificial Intelligence, Montreal, QC, Canada, June 18--21 , 2009. 452--461. Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian Personalized Ranking from Implicit Feedback. In UAI 2009, Proc. of the Twenty-Fifth Conf. on Uncertainty in Artificial Intelligence, Montreal, QC, Canada, June 18--21, 2009. 452--461."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"crossref","unstructured":"Francesco Ricci Lior Rokach and Bracha Shapira (Eds.). 2015. Recommender Systems Handbook. Springer.   Francesco Ricci Lior Rokach and Bracha Shapira (Eds.). 2015. Recommender Systems Handbook . Springer.","DOI":"10.1007\/978-1-4899-7637-6"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148261"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/352871.352887"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"crossref","unstructured":"Guy Shani and Asela Gunawardana. 2011. Evaluating Recommendation Systems. In Recommender Systems Handbook. 257--297.  Guy Shani and Asela Gunawardana. 2011. Evaluating Recommendation Systems. In Recommender Systems Handbook . 257--297.","DOI":"10.1007\/978-0-387-85820-3_8"},{"key":"e_1_3_2_1_39_1","volume-title":"Proc. of the Int. Workshop on Meta-learning and Algorithm Selection co-located with 21st European Conf. on Artificial Intelligence, MetaSel@ECAI 2014","author":"Smith Michael R.","year":"2014","unstructured":"Michael R. Smith , Logan Mitchell , Christophe G. Giraud-Carrier , and Tony R. Martinez . 2014. Recommending Learning Algorithms and Their Associated Hyperparameters . In Proc. of the Int. Workshop on Meta-learning and Algorithm Selection co-located with 21st European Conf. on Artificial Intelligence, MetaSel@ECAI 2014 , Prague, Czech Republic , August 19, 2014 . 39--40. Michael R. Smith, Logan Mitchell, Christophe G. Giraud-Carrier, and Tony R. Martinez. 2014. Recommending Learning Algorithms and Their Associated Hyperparameters. In Proc. of the Int. Workshop on Meta-learning and Algorithm Selection co-located with 21st European Conf. on Artificial Intelligence, MetaSel@ECAI 2014, Prague, Czech Republic, August 19, 2014. 39--40."},{"key":"e_1_3_2_1_40_1","volume-title":"Adams","author":"Snoek Jasper","year":"2012","unstructured":"Jasper Snoek , Hugo Larochelle , and Ryan P . Adams . 2012 . Practical Bayesian Optimization of Machine Learning Algorithms. In Advances in Neural Information Processing Systems 25:26th Annual Conf. on Neural Information Processing Systems 2012. December 3--6, 2012, Lake Tahoe, Nevada, United States . 2960--2968. Jasper Snoek, Hugo Larochelle, and Ryan P. Adams. 2012. Practical Bayesian Optimization of Machine Learning Algorithms. In Advances in Neural Information Processing Systems 25:26th Annual Conf. on Neural Information Processing Systems 2012. December 3--6, 2012, Lake Tahoe, Nevada, United States. 2960--2968."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2507157.2507160"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1454008.1454049"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.5555\/1577069.1577091"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3240323.3240347"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2043932.2043955"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-68880-8_32"}],"event":{"name":"RecSys '19: Thirteenth ACM Conference on Recommender Systems","location":"Copenhagen Denmark","acronym":"RecSys '19"},"container-title":["Proceedings of the 13th ACM Conference on Recommender Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3298689.3347010","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3298689.3347010","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:12:55Z","timestamp":1750201975000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3298689.3347010"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,10]]},"references-count":46,"alternative-id":["10.1145\/3298689.3347010","10.1145\/3298689"],"URL":"https:\/\/doi.org\/10.1145\/3298689.3347010","relation":{},"subject":[],"published":{"date-parts":[[2019,9,10]]},"assertion":[{"value":"2019-09-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}