{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,23]],"date-time":"2025-08-23T05:21:08Z","timestamp":1755926468179,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":39,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,7,25]],"date-time":"2020-07-25T00:00:00Z","timestamp":1595635200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"EU Horizon 2020 research and innovation programme","award":["780751"],"award-info":[{"award-number":["780751"]}]},{"name":"Italian Ministry of Education and Research (MIUR)","award":["ARS01_00917"],"award-info":[{"award-number":["ARS01_00917"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,7,25]]},"DOI":"10.1145\/3397271.3401094","type":"proceedings-article","created":{"date-parts":[[2020,7,25]],"date-time":"2020-07-25T07:50:08Z","timestamp":1595663408000},"page":"529-538","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Training Curricula for Open Domain Answer Re-Ranking"],"prefix":"10.1145","author":[{"given":"Sean","family":"MacAvaney","sequence":"first","affiliation":[{"name":"Georgetown University, Washington, DC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Franco Maria","family":"Nardini","sequence":"additional","affiliation":[{"name":"ISTI-CNR, Pisa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raffaele","family":"Perego","sequence":"additional","affiliation":[{"name":"ISTI-CNR, Pisa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicola","family":"Tonellotto","sequence":"additional","affiliation":[{"name":"University of Pisa, Pisa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nazli","family":"Goharian","sequence":"additional","affiliation":[{"name":"Georgetown University, Washington, DC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ophir","family":"Frieder","sequence":"additional","affiliation":[{"name":"Georgetown University, Washington, DC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,7,25]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Y. Bengio J. Louradour R. Collobert and J. Weston. 2009. Curriculum Learning. In ICML. 41--48. Y. Bengio J. Louradour R. Collobert and J. Weston. 2009. Curriculum Learning. In ICML. 41--48.","DOI":"10.1145\/1553374.1553380"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00051"},{"volume-title":"Weakly Supervised Learning of Convolutional Networks. In International Conference on Computer Vision. 1431--1439","author":"Chen X.","key":"e_1_3_2_1_3_1","unstructured":"X. Chen and A. Gupta . 2015 . Weakly Supervised Learning of Convolutional Networks. In International Conference on Computer Vision. 1431--1439 . X. Chen and A. Gupta. 2015. Weakly Supervised Learning of Convolutional Networks. In International Conference on Computer Vision. 1431--1439."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00229301"},{"key":"e_1_3_2_1_5_1","article-title":"Natural Language Processing (Almost) from Scratch","volume":"12","author":"Collobert R.","year":"2011","unstructured":"R. Collobert , J. Weston , L. Bottou , M. Karlen , K. Kavukcuoglu , and P. Kuksa . 2011 . Natural Language Processing (Almost) from Scratch . The Journal of Machine Learning Research , Vol. 12 ( August 2011), 2493--2537. R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu, and P. Kuksa. 2011. Natural Language Processing (Almost) from Scratch. The Journal of Machine Learning Research, Vol. 12 (August 2011), 2493--2537.","journal-title":"The Journal of Machine Learning Research"},{"key":"e_1_3_2_1_6_1","volume-title":"Overview of the TREC 2019 Deep Learning Track. In TREC.","author":"Craswell Nick","year":"2019","unstructured":"Nick Craswell , Bhaskar Mitra , and Daniel Campos . 2019 . Overview of the TREC 2019 Deep Learning Track. In TREC. Nick Craswell, Bhaskar Mitra, and Daniel Campos. 2019. Overview of the TREC 2019 Deep Learning Track. In TREC."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"crossref","unstructured":"Zhuyun Dai Chenyan Xiong Jamie Callan and Zhiyuan Liu. 2018. Convolutional Neural Networks for Soft-Matching N-Grams in Ad-hoc Search. In WSDM. 126--134. Zhuyun Dai Chenyan Xiong Jamie Callan and Zhiyuan Liu. 2018. Convolutional Neural Networks for Soft-Matching N-Grams in Ad-hoc Search. In WSDM. 126--134.","DOI":"10.1145\/3159652.3159659"},{"key":"e_1_3_2_1_8_1","unstructured":"Mostafa Dehghani Arash Mehrjou Stephan Gouws Jaap Kamps and Bernhard Sch\u00f6lkopf. 2017. Fidelity-Weighted Learning. In ICLR. Mostafa Dehghani Arash Mehrjou Stephan Gouws Jaap Kamps and Bernhard Sch\u00f6lkopf. 2017. Fidelity-Weighted Learning. In ICLR."},{"key":"e_1_3_2_1_9_1","volume-title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL.","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Laura Dietz Ben Gamari Jeff Dalton and Nick Craswell. 2017. TREC Complex Answer Retrieval Overview. In TREC. Laura Dietz Ben Gamari Jeff Dalton and Nick Craswell. 2017. TREC Complex Answer Retrieval Overview. In TREC.","DOI":"10.6028\/NIST.SP.500-324.car-overview"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"N. Ferro C. Lucchese M. Maistro and R. Perego. 2018. Continuation Methods and Curriculum Learning for Learning to Rank. In CIKM. 1523--1526. N. Ferro C. Lucchese M. Maistro and R. Perego. 2018. Continuation Methods and Curriculum Learning for Learning to Rank. In CIKM. 1523--1526.","DOI":"10.1145\/3269206.3269239"},{"key":"e_1_3_2_1_12_1","unstructured":"Jiafeng Guo Yixing Fan Qingyao Ai and W. Bruce Croft. 2016. A Deep Relevance Matching Model for Ad-hoc Retrieval. In CIKM. 55--64. http:\/\/arxiv.org\/abs\/1711.08611 arXiv: 1711.08611. Jiafeng Guo Yixing Fan Qingyao Ai and W. Bruce Croft. 2016. A Deep Relevance Matching Model for Ad-hoc Retrieval. In CIKM. 55--64. http:\/\/arxiv.org\/abs\/1711.08611 arXiv: 1711.08611."},{"key":"e_1_3_2_1_13_1","volume-title":"ANTIQUE: A Non-Factoid Question Answering Benchmark. ArXiv","author":"Hashemi Helia","year":"2019","unstructured":"Helia Hashemi , Mohammad Aliannejadi , Hamed Zamani , and W. Bruce Croft . 2019 . ANTIQUE: A Non-Factoid Question Answering Benchmark. ArXiv , Vol. abs\/ 1905 .08957 (2019). Helia Hashemi, Mohammad Aliannejadi, Hamed Zamani, and W. Bruce Croft. 2019. ANTIQUE: A Non-Factoid Question Answering Benchmark. ArXiv, Vol. abs\/1905.08957 (2019)."},{"key":"e_1_3_2_1_14_1","unstructured":"Baotian Hu Zhengdong Lu Hang Li and Qingcai Chen. 2014a. Convolutional Neural Network Architectures for Matching Natural Language Sentences. In NIPS. Baotian Hu Zhengdong Lu Hang Li and Qingcai Chen. 2014a. Convolutional Neural Network Architectures for Matching Natural Language Sentences. In NIPS."},{"key":"e_1_3_2_1_15_1","unstructured":"B. Hu Z. Lu H. Li and Q. Chen. 2014b. Convolutional Neural Network Architectures for Matching Natural Language Sentences. In NIPS. 2042--2050. B. Hu Z. Lu H. Li and Q. Chen. 2014b. Convolutional Neural Network Architectures for Matching Natural Language Sentences. In NIPS. 2042--2050."},{"key":"e_1_3_2_1_16_1","volume-title":"Heck","author":"Huang Po-Sen","year":"2013","unstructured":"Po-Sen Huang , Xiaodong He , Jianfeng Gao , Li Deng , Alex Acero , and Larry P . Heck . 2013 . Learning deep structured semantic models for web search using clickthrough data. In CIKM. Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, and Larry P. Heck. 2013. Learning deep structured semantic models for web search using clickthrough data. In CIKM."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Kai Hui Andrew Yates Klaus Berberich and Gerard de Melo. 2018. Co-PACRR: A Context-Aware Neural IR Model for Ad-hoc Retrieval. In WSDM. ACM 279--287. Kai Hui Andrew Yates Klaus Berberich and Gerard de Melo. 2018. Co-PACRR: A Context-Aware Neural IR Model for Ad-hoc Retrieval. In WSDM. ACM 279--287.","DOI":"10.1145\/3159652.3159689"},{"key":"e_1_3_2_1_18_1","unstructured":"Shiyu Ji Jinjin Shao and Tao Yang. 2019. Efficient Interaction-based Neural Ranking with Locality Sensitive Hashing. In WWW. Shiyu Ji Jinjin Shao and Tao Yang. 2019. Efficient Interaction-based Neural Ranking with Locality Sensitive Hashing. In WWW."},{"key":"e_1_3_2_1_19_1","volume-title":"Hauptmann","author":"Jiang Lu","year":"2014","unstructured":"Lu Jiang , Deyu Meng , Shoou- I Yu , Zhen-Zhong Lan , Shiguang Shan , and Alexander G . Hauptmann . 2014 . Self-Paced Learning with Diversity. In NIPS. Lu Jiang, Deyu Meng, Shoou-I Yu, Zhen-Zhong Lan, Shiguang Shan, and Alexander G. Hauptmann. 2014. Self-Paced Learning with Diversity. In NIPS."},{"key":"e_1_3_2_1_20_1","volume-title":"Hauptmann","author":"Jiang Lu","year":"2015","unstructured":"Lu Jiang , Deyu Meng , Qian Zhao , Shiguang Shan , and Alexander G . Hauptmann . 2015 . Self-Paced Curriculum Learning. In AAAI. Lu Jiang, Deyu Meng, Qian Zhao, Shiguang Shan, and Alexander G. Hauptmann. 2015. Self-Paced Curriculum Learning. In AAAI."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308774.3308781"},{"volume-title":"SIGIR","author":"Lin Jimmy","key":"e_1_3_2_1_22_1","unstructured":"Jimmy Lin and Peilin Yang . 2019. The Impact of Score Ties on Repeatability in Document Ranking . In SIGIR . http:\/\/arxiv.org\/abs\/1807.05798 arXiv: 1807.05798. Jimmy Lin and Peilin Yang. 2019. The Impact of Score Ties on Repeatability in Document Ranking. In SIGIR. http:\/\/arxiv.org\/abs\/1807.05798 arXiv: 1807.05798."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331317"},{"key":"e_1_3_2_1_24_1","volume-title":"Overcoming Low-Utility Facets for Complex Answer Retrieval. Information Retrieval Journal","author":"MacAvaney Sean","year":"2018","unstructured":"Sean MacAvaney , Andrew Yates , Arman Cohan , Luca Soldaini , Kai Hui , Nazli Goharian , and Ophir Frieder . 2018. Overcoming Low-Utility Facets for Complex Answer Retrieval. Information Retrieval Journal ( 2018 ). Sean MacAvaney, Andrew Yates, Arman Cohan, Luca Soldaini, Kai Hui, Nazli Goharian, and Ophir Frieder. 2018. Overcoming Low-Utility Facets for Complex Answer Retrieval. Information Retrieval Journal (2018)."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Donald Metzler and W. Bruce Croft. 2005. A Markov random field model for term dependencies. In SIGIR. Donald Metzler and W. Bruce Croft. 2005. A Markov random field model for term dependencies. In SIGIR.","DOI":"10.1145\/1076034.1076115"},{"key":"e_1_3_2_1_26_1","volume-title":"Neural Models for Information Retrieval. ArXiv","author":"Mitra Bhaskar","year":"2017","unstructured":"Bhaskar Mitra and Nick Craswell . 2017. Neural Models for Information Retrieval. ArXiv , Vol. abs\/ 1705 .01509 ( 2017 ). Bhaskar Mitra and Nick Craswell. 2017. Neural Models for Information Retrieval. ArXiv, Vol. abs\/1705.01509 (2017)."},{"key":"e_1_3_2_1_27_1","volume-title":"MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. In CoCo@NIPS.","author":"Nguyen Tri","year":"2016","unstructured":"Tri Nguyen , Mir Rosenberg , Xia Song , Jianfeng Gao , Saurabh Tiwary , Rangan Majumder , and Li Deng . 2016 . MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. In CoCo@NIPS. Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, and Li Deng. 2016. MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. In CoCo@NIPS."},{"key":"e_1_3_2_1_28_1","volume-title":"Passage Re-ranking with BERT. arXiv:1901.04085","author":"Nogueira Rodrigo","year":"2019","unstructured":"Rodrigo Nogueira and Kyunghyun Cho . 2019. Passage Re-ranking with BERT. arXiv:1901.04085 ( 2019 ). Rodrigo Nogueira and Kyunghyun Cho. 2019. Passage Re-ranking with BERT. arXiv:1901.04085 (2019)."},{"key":"e_1_3_2_1_29_1","volume-title":"Document Expansion by Query Prediction. ArXiv","author":"Nogueira Rodrigo","year":"2019","unstructured":"Rodrigo Nogueira , Wei Yang , Jimmy Lin , and Kyunghyun Cho . 2019. Document Expansion by Query Prediction. ArXiv , Vol. abs\/ 1904 .08375 ( 2019 ). Rodrigo Nogueira, Wei Yang, Jimmy Lin, and Kyunghyun Cho. 2019. Document Expansion by Query Prediction. ArXiv, Vol. abs\/1904.08375 (2019)."},{"key":"e_1_3_2_1_30_1","unstructured":"Liang Pang Yanyan Lan Jiafeng Guo Jun Xu and Xueqi Cheng. 2016. A Study of MatchPyramid Models on Ad-hoc Retrieval. In NeuIR @ SIGIR. Liang Pang Yanyan Lan Jiafeng Guo Jun Xu and Xueqi Cheng. 2016. A Study of MatchPyramid Models on Ad-hoc Retrieval. In NeuIR @ SIGIR."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Liang Pang Yanyan Lan Jiafeng Guo Jun Xu Jingfang Xu and Xueqi Cheng. 2017. DeepRank: A New Deep Architecture for Relevance Ranking in Information Retrieval. In CIKM. 257--266. Liang Pang Yanyan Lan Jiafeng Guo Jun Xu Jingfang Xu and Xueqi Cheng. 2017. DeepRank: A New Deep Architecture for Relevance Ranking in Information Retrieval. In CIKM. 257--266.","DOI":"10.1145\/3132847.3132914"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"crossref","unstructured":"Gustavo Penha and Claudia Hauff. 2020. Curriculum Learning Strategies for IR: An Empirical Study on Conversation Response Ranking. In ECIR. Gustavo Penha and Claudia Hauff. 2020. Curriculum Learning Strategies for IR: An Empirical Study on Conversation Response Ranking. In ECIR.","DOI":"10.1007\/978-3-030-45439-5_46"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"crossref","unstructured":"M. Qu J. Tang and J. Han. 2018. Curriculum Learning for Heterogeneous Star Network Embedding via Deep Reinforcement Learning. In WSDM. 468--476. M. Qu J. Tang and J. Han. 2018. Curriculum Learning for Heterogeneous Star Network Embedding via Deep Reinforcement Learning. In WSDM. 468--476.","DOI":"10.1145\/3159652.3159711"},{"key":"e_1_3_2_1_34_1","volume-title":"Xing","author":"Sachan Mrinmaya","year":"2016","unstructured":"Mrinmaya Sachan and Eric P . Xing . 2016 . Easy Questions First? A Case Study on Curriculum Learning for Question Answering. In ACL. Mrinmaya Sachan and Eric P. Xing. 2016. Easy Questions First? A Case Study on Curriculum Learning for Question Answering. In ACL."},{"volume-title":"Multivariate density estimation: theory, practice, and visualization","author":"Scott David W","key":"e_1_3_2_1_35_1","unstructured":"David W Scott . 2015. Multivariate density estimation: theory, practice, and visualization . John Wiley & Sons . David W Scott. 2015. Multivariate density estimation: theory, practice, and visualization. John Wiley & Sons."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Yelong Shen Xiaodong He Jianfeng Gao Li Deng and Gr\u00e9goire Mesnil. 2014. Learning semantic representations using convolutional neural networks for web search. In WWW. Yelong Shen Xiaodong He Jianfeng Gao Li Deng and Gr\u00e9goire Mesnil. 2014. Learning semantic representations using convolutional neural networks for web search. In WWW.","DOI":"10.1145\/2567948.2577348"},{"key":"e_1_3_2_1_37_1","unstructured":"Chenyan Xiong Zhuyun Dai Jamie Callan Zhiyuan Liu and Russell Power. 2017. End-to-End Neural Ad-hoc Ranking with Kernel Pooling. In SIGIR. 55--64. http:\/\/arxiv.org\/abs\/1706.06613 arXiv: 1706.06613. Chenyan Xiong Zhuyun Dai Jamie Callan Zhiyuan Liu and Russell Power. 2017. End-to-End Neural Ad-hoc Ranking with Kernel Pooling. In SIGIR. 55--64. http:\/\/arxiv.org\/abs\/1706.06613 arXiv: 1706.06613."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3239571"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Wei Yang Kuang Lu Peilin Yang and Jimmy Lin. 2019. Critically Examining the \"Neural Hype\": Weak Baselines and the Additivity of Effectiveness Gains from Neural Ranking Models. In SIGIR. Wei Yang Kuang Lu Peilin Yang and Jimmy Lin. 2019. Critically Examining the \"Neural Hype\": Weak Baselines and the Additivity of Effectiveness Gains from Neural Ranking Models. In SIGIR.","DOI":"10.1145\/3331184.3331340"}],"event":{"name":"SIGIR '20: The 43rd International ACM SIGIR conference on research and development in Information Retrieval","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval"],"location":"Virtual Event China","acronym":"SIGIR '20"},"container-title":["Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3397271.3401094","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3397271.3401094","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:38Z","timestamp":1750195898000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3397271.3401094"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,25]]},"references-count":39,"alternative-id":["10.1145\/3397271.3401094","10.1145\/3397271"],"URL":"https:\/\/doi.org\/10.1145\/3397271.3401094","relation":{},"subject":[],"published":{"date-parts":[[2020,7,25]]},"assertion":[{"value":"2020-07-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}