{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:27:29Z","timestamp":1750220849042,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":23,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,11,3]],"date-time":"2019-11-03T00:00:00Z","timestamp":1572739200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,11,3]]},"DOI":"10.1145\/3357384.3358123","type":"proceedings-article","created":{"date-parts":[[2019,11,4]],"date-time":"2019-11-04T14:11:35Z","timestamp":1572876695000},"page":"2217-2220","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Towards Stochastic Simulations of Relevance Profiles"],"prefix":"10.1145","author":[{"given":"Kevin","family":"Roitero","sequence":"first","affiliation":[{"name":"University of Udine, Udine, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrea","family":"Brunello","sequence":"additional","affiliation":[{"name":"University of Udine, Udine, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juli\u00e1n","family":"Urbano","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefano","family":"Mizzaro","sequence":"additional","affiliation":[{"name":"University of Udine, Udine, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,11,3]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","unstructured":"L. Azzopardi M. de Rijke and K. Balog. 2007. Building Simulated Queries for Known-item Topics: An Analysis Using Six European Languages. In ACM SIGIR .  L. Azzopardi M. de Rijke and K. Balog. 2007. Building Simulated Queries for Known-item Topics: An Analysis Using Six European Languages. In ACM SIGIR .","DOI":"10.1145\/1277741.1277820"},{"key":"e_1_3_2_1_2_1","volume-title":"Report on the SIGIR 2010 Workshop on the Simulation of Interaction. SIGIR Forum","author":"Azzopardi L.","year":"2011","unstructured":"L. Azzopardi , K. J\"arvelin, J. Kamps , and M.D. Smucker . 2011 . Report on the SIGIR 2010 Workshop on the Simulation of Interaction. SIGIR Forum ( 2011 ). L. Azzopardi, K. J\"arvelin, J. Kamps, and M.D. Smucker. 2011. Report on the SIGIR 2010 Workshop on the Simulation of Interaction. SIGIR Forum (2011)."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"crossref","unstructured":"F. Baskaya H. Keskustalo and K. J\"arvelin. 2013. Modeling Behavioral Factors Ininteractive Information Retrieval. In ACM CIKM .  F. Baskaya H. Keskustalo and K. J\"arvelin. 2013. Modeling Behavioral Factors Ininteractive Information Retrieval. In ACM CIKM .","DOI":"10.1145\/2505515.2505660"},{"volume-title":"Risk-Reward Trade-offs in Rank Fusion. In Australasian Document Computing Symposium .","author":"Benham R.","key":"e_1_3_2_1_4_1","unstructured":"R. Benham and J.S. Culpepper . 2017 . Risk-Reward Trade-offs in Rank Fusion. In Australasian Document Computing Symposium . R. Benham and J.S. Culpepper. 2017. Risk-Reward Trade-offs in Rank Fusion. In Australasian Document Computing Symposium ."},{"key":"e_1_3_2_1_5_1","volume-title":"A simulation model of an information retrieval system. Information Storage and Retrieval","author":"Cooper M.D.","year":"1973","unstructured":"M.D. Cooper . 1973. A simulation model of an information retrieval system. Information Storage and Retrieval ( 1973 ). M.D. Cooper. 1973. A simulation model of an information retrieval system. Information Storage and Retrieval (1973)."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","unstructured":"G.V. Cormack C.L.A. Clarke and S. Buettcher. 2009. Reciprocal Rank Fusion Outperforms Condorcet and Individual Rank Learning Methods. In ACM SIGIR .  G.V. Cormack C.L.A. Clarke and S. Buettcher. 2009. Reciprocal Rank Fusion Outperforms Condorcet and Individual Rank Learning Methods. In ACM SIGIR .","DOI":"10.1145\/1571941.1572114"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"crossref","unstructured":"G.V. Cormack and M.R. Grossman. 2018. Beyond Pooling. In ACM SIGIR .  G.V. Cormack and M.R. Grossman. 2018. Beyond Pooling. In ACM SIGIR .","DOI":"10.1145\/3209978.3210119"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"crossref","unstructured":"K. Deb A. Pratap S. Agarwal and T. Meyarivan. 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II . IEEE Trans. on Evolutionary Comp. (2002).  K. Deb A. Pratap S. Agarwal and T. Meyarivan. 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II . IEEE Trans. on Evolutionary Comp. (2002).","DOI":"10.1109\/4235.996017"},{"volume-title":"IEEE CEC 2010 .","author":"Durillo J.J.","key":"e_1_3_2_1_9_1","unstructured":"J.J. Durillo , A.J. Nebro , and E. Alba . 2010 . IEEE CEC 2010 . J.J. Durillo, A.J. Nebro, and E. Alba. 2010. IEEE CEC 2010 ."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"crossref","unstructured":"D. Maxwell and L. Azzopardi. 2016. Agents Simulated Users and Humans: An Analysis of Performance and Behaviour. In ACM CIKM .  D. Maxwell and L. Azzopardi. 2016. Agents Simulated Users and Humans: An Analysis of Performance and Behaviour. In ACM CIKM .","DOI":"10.1145\/2983323.2983805"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"S. Mizzaro J. Mothe K. Roitero and M.Z. Ullah. 2018. Query Performance Prediction and Effectiveness Evaluation Without Relevance Judgments: Two Sides of the Same Coin. In ACM SIGIR .  S. Mizzaro J. Mothe K. Roitero and M.Z. Ullah. 2018. Query Performance Prediction and Effectiveness Evaluation Without Relevance Judgments: Two Sides of the Same Coin. In ACM SIGIR .","DOI":"10.1145\/3209978.3210146"},{"volume-title":"Networks: An Introduction","author":"Newman M.","key":"e_1_3_2_1_12_1","unstructured":"M. Newman . 2010. Networks: An Introduction . Oxford University Press, Inc. M. Newman. 2010. Networks: An Introduction .Oxford University Press, Inc."},{"key":"e_1_3_2_1_13_1","volume-title":"Inf. Proc. & Mgmt.","author":"Nuray R.","year":"2006","unstructured":"R. Nuray and F. Can . 2006. Automatic ranking of information retrieval systems using data fusion . Inf. Proc. & Mgmt. ( 2006 ). R. Nuray and F. Can. 2006. Automatic ranking of information retrieval systems using data fusion. Inf. Proc. & Mgmt. (2006)."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"crossref","unstructured":"S.E. Robertson and E. Kanoulas. 2012. On Per-topic Variance in IR Evaluation. In ACM SIGIR .  S.E. Robertson and E. Kanoulas. 2012. On Per-topic Variance in IR Evaluation. In ACM SIGIR .","DOI":"10.1145\/2348283.2348402"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","unstructured":"K. Roitero M. Passon G. Serra and S. Mizzaro. 2018a. Reproduce. Generalize. Extend. On Information Retrieval Evaluation Without Relevance Judgments. J. Data and Information Quality (2018).  K. Roitero M. Passon G. Serra and S. Mizzaro. 2018a. Reproduce. Generalize. Extend. On Information Retrieval Evaluation Without Relevance Judgments. J. Data and Information Quality (2018).","DOI":"10.1145\/3241064"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"crossref","unstructured":"K. Roitero M. Soprano A. Brunello and S. Mizzaro. 2018b. Reproduce and Improve: An Evolutionary Approach to Select a Few Good Topics for Information Retrieval Evaluation. J. Data and Information Quality (2018).  K. Roitero M. Soprano A. Brunello and S. Mizzaro. 2018b. Reproduce and Improve: An Evolutionary Approach to Select a Few Good Topics for Information Retrieval Evaluation. J. Data and Information Quality (2018).","DOI":"10.1145\/3239573"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"crossref","unstructured":"J. Tague M. Nelson and H. Wu. 1981. Problems in the Simulation of Bibliographic Retrieval Systems. In ACM SIGIR .  J. Tague M. Nelson and H. Wu. 1981. Problems in the Simulation of Bibliographic Retrieval Systems. In ACM SIGIR .","DOI":"10.1145\/511754.511764"},{"key":"e_1_3_2_1_18_1","volume-title":"Test collection reliability: a study of bias and robustness to statistical assumptions via stochastic simulation. Inf. Retrieval Journal","author":"Urbano J.","year":"2016","unstructured":"J. Urbano . 2016. Test collection reliability: a study of bias and robustness to statistical assumptions via stochastic simulation. Inf. Retrieval Journal ( 2016 ). J. Urbano. 2016. Test collection reliability: a study of bias and robustness to statistical assumptions via stochastic simulation. Inf. Retrieval Journal (2016)."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"crossref","unstructured":"J. Urbano and T. Nagler. 2018. Stochastic Simulation of Test Collections: Evaluation Scores. In ACM SIGIR .  J. Urbano and T. Nagler. 2018. Stochastic Simulation of Test Collections: Evaluation Scores. In ACM SIGIR .","DOI":"10.1145\/3209978.3210043"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"crossref","unstructured":"W. Webber A. Moffat and J. Zobel. 2010. A Similarity Measure for Indefinite Rankings. ACM TOIS (2010).  W. Webber A. Moffat and J. Zobel. 2010. A Similarity Measure for Indefinite Rankings. ACM TOIS (2010).","DOI":"10.1145\/1852102.1852106"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2006.02.005"},{"key":"e_1_3_2_1_22_1","volume-title":"Evaluating Implicit Feedback Models Using Searcher Simulations. ACM TOIS","author":"White R.W.","year":"2005","unstructured":"R.W. White , I. Ruthven , J. Joemon , and C.J. van Rijsbergen . 2005. Evaluating Implicit Feedback Models Using Searcher Simulations. ACM TOIS ( 2005 ). R.W. White, I. Ruthven, J. Joemon, and C.J. van Rijsbergen. 2005. Evaluating Implicit Feedback Models Using Searcher Simulations. ACM TOIS (2005)."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"crossref","unstructured":"E. Yilmaz . Kanoulas and J.A. Aslam. 2008. A Simple and Efficient Sampling Method for Estimating AP and NDCG. In ACM SIGIR .  E. Yilmaz . Kanoulas and J.A. Aslam. 2008. A Simple and Efficient Sampling Method for Estimating AP and NDCG. In ACM SIGIR .","DOI":"10.1145\/1390334.1390437"}],"event":{"name":"CIKM '19: The 28th ACM International Conference on Information and Knowledge Management","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"],"location":"Beijing China","acronym":"CIKM '19"},"container-title":["Proceedings of the 28th ACM International Conference on Information and Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3357384.3358123","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3357384.3358123","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:23:10Z","timestamp":1750202590000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3357384.3358123"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,3]]},"references-count":23,"alternative-id":["10.1145\/3357384.3358123","10.1145\/3357384"],"URL":"https:\/\/doi.org\/10.1145\/3357384.3358123","relation":{},"subject":[],"published":{"date-parts":[[2019,11,3]]},"assertion":[{"value":"2019-11-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}