{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T23:20:53Z","timestamp":1775604053990,"version":"3.50.1"},"reference-count":83,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2018,10,30]],"date-time":"2018-10-30T00:00:00Z","timestamp":1540857600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"ANR Agence nationale de la recherche CAAS project","award":["ANR-10-CORD-001 01"],"award-info":[{"award-number":["ANR-10-CORD-001 01"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2019,1,31]]},"abstract":"<jats:p>\n            Modern Information Retrieval (IR) systems have become more and more complex, involving a large number of parameters. For example, a system may choose from a set of possible retrieval models (BM25, language model, etc.), or various query expansion parameters, whose values greatly influence the overall retrieval effectiveness. Traditionally, these parameters are set at a system level based on training queries, and the same parameters are then used for different queries. We observe that it may not be easy to set all these parameters separately, since they can be dependent. In addition, a global setting for all queries may not best fit all individual queries with different characteristics. The parameters should be set according to these characteristics. In this article, we propose a novel approach to tackle this problem by dealing with the entire\n            <jats:italic>system configurations<\/jats:italic>\n            (i.e., a set of parameters representing an IR system behaviour) instead of selecting a single parameter at a time. The selection of the best configuration is cast as a problem of ranking different possible configurations given a query. We apply learning-to-rank approaches for this task. We exploit both the query features and the system configuration features in the learning-to-rank method so that the selection of configuration is query dependent. The experiments we conducted on four TREC ad hoc collections show that this approach can significantly outperform the traditional method to tune system configuration globally (i.e., grid search) and leads to higher effectiveness than the top performing systems of the TREC tracks. We also perform an ablation analysis on the impact of different features on the model learning capability and show that query expansion features are among the most important for adaptive systems.\n          <\/jats:p>","DOI":"10.1145\/3231937","type":"journal-article","created":{"date-parts":[[2018,10,30]],"date-time":"2018-10-30T12:11:00Z","timestamp":1540901460000},"page":"1-41","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":27,"title":["Learning to Adaptively Rank Document Retrieval System Configurations"],"prefix":"10.1145","volume":"37","author":[{"given":"Romain","family":"Deveaud","sequence":"first","affiliation":[{"name":"IRIT, UMR5505 CNRS, Universit\u00e9 de Toulouse, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9273-2193","authenticated-orcid":false,"given":"Josiane","family":"Mothe","sequence":"additional","affiliation":[{"name":"IRIT, UMR5505 CNRS, Universit\u00e9 de Toulouse, France"}]},{"given":"Md Zia","family":"Ullah","sequence":"additional","affiliation":[{"name":"IRIT, UMR5505 CNRS, Universit\u00e9 de Toulouse, France"}]},{"given":"Jian-Yun","family":"Nie","sequence":"additional","affiliation":[{"name":"Universit\u00e9 de Montr\u00e9al, Canada"}]}],"member":"320","published-online":{"date-parts":[[2018,10,30]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.10217"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-24752-4_10"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390517"},{"key":"e_1_2_1_4_1","first-page":"1767","article-title":"Statistical analysis to establish the importance of information retrieval parameters","volume":"21","author":"Ayter Julie","year":"2015","unstructured":"Julie Ayter , Adrian Chifu , S\u00e9bastien D\u00e9jean , Cecile Desclaux , and Josiane Mothe . 2015 . Statistical analysis to establish the importance of information retrieval parameters . J. Univ. Comput. Sci. Inf. Retriev. Recommend. 21 , 13 (2015) (2015), 1767 -- 1789 . Julie Ayter, Adrian Chifu, S\u00e9bastien D\u00e9jean, Cecile Desclaux, and Josiane Mothe. 2015. Statistical analysis to establish the importance of information retrieval parameters. J. Univ. Comput. Sci. Inf. Retriev. Recommend. 21, 13 (2015) (2015), 1767--1789.","journal-title":"J. Univ. Comput. Sci. Inf. Retriev. Recommend."},{"key":"e_1_2_1_5_1","volume-title":"How many performance measures to evaluate information retrieval systems? Knowl. Inf. Syst. 30, 3","author":"Baccini Alain","year":"2012","unstructured":"Alain Baccini , S\u00e9bastien D\u00e9jean , Laetitia Lafage , and Josiane Mothe . 2012. How many performance measures to evaluate information retrieval systems? Knowl. Inf. Syst. 30, 3 ( 2012 ). Alain Baccini, S\u00e9bastien D\u00e9jean, Laetitia Lafage, and Josiane Mothe. 2012. How many performance measures to evaluate information retrieval systems? Knowl. Inf. Syst. 30, 3 (2012)."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009984519381"},{"key":"e_1_2_1_7_1","volume-title":"Random search for hyper-parameter optimization. J. Mach. Learn. Res. 13 (Feb","author":"Bergstra James","year":"2012","unstructured":"James Bergstra and Yoshua Bengio . 2012. Random search for hyper-parameter optimization. J. Mach. Learn. Res. 13 (Feb . 2012 ), 281--305. James Bergstra and Yoshua Bengio. 2012. Random search for hyper-parameter optimization. J. Mach. Learn. Res. 13 (Feb. 2012), 281--305."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/2070786.2070818"},{"key":"e_1_2_1_9_1","first-page":"1726","article-title":"Learning to choose the best system configuration in information retrieval: The case of repeated queries","volume":"21","author":"Bigot Anthony","year":"2015","unstructured":"Anthony Bigot , S\u00e9bastien D\u00e9jean , and Josiane Mothe . 2015 . Learning to choose the best system configuration in information retrieval: The case of repeated queries . J. Univ. Comput. Sci. 21 , 13 (2015), 1726 -- 1745 . Anthony Bigot, S\u00e9bastien D\u00e9jean, and Josiane Mothe. 2015. Learning to choose the best system configuration in information retrieval: The case of repeated queries. J. Univ. Comput. Sci. 21, 13 (2015), 1726--1745.","journal-title":"J. Univ. Comput. Sci."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/215206.215383"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1102351.1102363"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390377"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273513"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/1855038"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2071389.2071390"},{"key":"e_1_2_1_17_1","volume-title":"Yahoo&excl","author":"Chapelle Olivier","unstructured":"Olivier Chapelle , Yi Chang , and Tie-Yan Liu . 2011. Future directions in learning to rank . In Yahoo&excl ; Learning to Rank Challenge (Proceedings of Machine Learning Research), Olivier Chapelle, Yi Chang, and Tie-Yan Liu (Eds.). Vol. 14 . PMLR, Haifa, Israel , 91--100. Olivier Chapelle, Yi Chang, and Tie-Yan Liu. 2011. Future directions in learning to rank. In Yahoo&excl; Learning to Rank Challenge (Proceedings of Machine Learning Research), Olivier Chapelle, Yi Chang, and Tie-Yan Liu (Eds.). Vol. 14. PMLR, Haifa, Israel, 91--100."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-009-9109-9"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210121"},{"key":"e_1_2_1_20_1","volume-title":"Overview of the TREC 2004 terabyte track. In Proceedings of the Text REtrieval Conference (TREC\u201904)","volume":"4","author":"Clarke Charles L. A.","year":"2004","unstructured":"Charles L. A. Clarke , Nick Craswell , and Ian Soboroff . 2004 . Overview of the TREC 2004 terabyte track. In Proceedings of the Text REtrieval Conference (TREC\u201904) , Vol. 4 . 74. Charles L. A. Clarke, Nick Craswell, and Ian Soboroff. 2004. Overview of the TREC 2004 terabyte track. In Proceedings of the Text REtrieval Conference (TREC\u201904), Vol. 4. 74."},{"key":"e_1_2_1_21_1","volume-title":"TREC 2013 Web Track Overview. Technical Report. University of Michingan at Ann Arbor.","author":"Collins-Thompson Kevyn","unstructured":"Kevyn Collins-Thompson , Paul Bennett , Charles L. A. Clarke , Fernando Diaz , and Ellen M. Voorhees . 2014 . TREC 2013 Web Track Overview. Technical Report. University of Michingan at Ann Arbor. Kevyn Collins-Thompson, Paul Bennett, Charles L. A. Clarke, Fernando Diaz, and Ellen M. Voorhees. 2014. TREC 2013 Web Track Overview. Technical Report. University of Michingan at Ann Arbor."},{"key":"e_1_2_1_22_1","volume-title":"TREC 2014 Web Track Overview. Technical Report. University of Michigan at Ann Arbor.","author":"Collins-Thompson Kevyn","unstructured":"Kevyn Collins-Thompson , Craig Macdonald , Paul Bennett , Fernando Diaz , and Ellen M. Voorhees . 2015 . TREC 2014 Web Track Overview. Technical Report. University of Michigan at Ann Arbor. Kevyn Collins-Thompson, Craig Macdonald, Paul Bennett, Fernando Diaz, and Ellen M. Voorhees. 2015. TREC 2014 Web Track Overview. Technical Report. University of Michigan at Ann Arbor."},{"key":"e_1_2_1_23_1","volume-title":"Josiane Mothe, and Joelson Randriamparany.","author":"Compaor\u00e9 Jonathan","year":"2011","unstructured":"Jonathan Compaor\u00e9 , S\u00e9bastien D\u00e9jean , Adji Ma\u0155ram Gueye , Josiane Mothe, and Joelson Randriamparany. 2011 . Mining information retrieval results: Significant IR parameters. Adv. Inf. Min. Manage . (Oct. 2011). Jonathan Compaor\u00e9, S\u00e9bastien D\u00e9jean, Adji Ma\u0155ram Gueye, Josiane Mothe, and Joelson Randriamparany. 2011. Mining information retrieval results: Significant IR parameters. Adv. Inf. Min. Manage. (Oct. 2011)."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/564376.564429"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1031171.1031220"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983323.2983894"},{"key":"e_1_2_1_27_1","first-page":"4","article-title":"Statistical principal components analysis for retrieval experiments: Research articles","volume":"58","author":"Din\u00e7er Bekir Taner","year":"2007","unstructured":"Bekir Taner Din\u00e7er . 2007 . Statistical principal components analysis for retrieval experiments: Research articles . J. Assoc. Inf. Sci. Technol. 58 , 4 (Feb. 2007), 560--574. Bekir Taner Din\u00e7er. 2007. Statistical principal components analysis for retrieval experiments: Research articles. J. Assoc. Inf. Sci. Technol. 58, 4 (Feb. 2007), 560--574.","journal-title":"J. Assoc. Inf. Sci. Technol."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2017.09.001"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3106371"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-44564-9_2"},{"key":"e_1_2_1_31_1","volume-title":"An efficient boosting algorithm for combining preferences. J. Mach. Learn. Res. 4 (Nov","author":"Freund Yoav","year":"2003","unstructured":"Yoav Freund , Raj Iyer , Robert E. Schapire , and Yoram Singer . 2003. An efficient boosting algorithm for combining preferences. J. Mach. Learn. Res. 4 (Nov . 2003 ), 933--969. Yoav Freund, Raj Iyer, Robert E. Schapire, and Yoram Singer. 2003. An efficient boosting algorithm for combining preferences. J. Mach. Learn. Res. 4 (Nov. 2003), 933--969."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1013203451"},{"key":"e_1_2_1_33_1","volume-title":"Preference Learning","author":"F\u00fcrnkranz Johannes","unstructured":"Johannes F\u00fcrnkranz and Eyke H\u00fcllermeier . 2011. Preference Learning . Springer . Johannes F\u00fcrnkranz and Eyke H\u00fcllermeier. 2011. Preference Learning. Springer."},{"key":"e_1_2_1_34_1","volume-title":"Probabilistic matrix factorization for automated machine learning. arXiv preprint arXiv:1705.05355","author":"Fusi Nicolo","year":"2017","unstructured":"Nicolo Fusi and Huseyn Melih Elibol . 2017. Probabilistic matrix factorization for automated machine learning. arXiv preprint arXiv:1705.05355 ( 2017 ). Nicolo Fusi and Huseyn Melih Elibol. 2017. Probabilistic matrix factorization for automated machine learning. arXiv preprint arXiv:1705.05355 (2017)."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2016.11.003"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/133160.133167"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-009-9101-4"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1458082.1458311"},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the Text REtrieval Conference (TREC\u201900)","author":"Hawking David","year":"2000","unstructured":"David Hawking . 2000 . Overview of the TREC-9 web track . In Proceedings of the Text REtrieval Conference (TREC\u201900) . National Institute of Standards and Technology. David Hawking. 2000. Overview of the TREC-9 web track. In Proceedings of the Text REtrieval Conference (TREC\u201900). National Institute of Standards and Technology."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2005.11.003"},{"key":"e_1_2_1_41_1","unstructured":"Djoerd Hiemstra. 2001. Using Language Models for Information Retrieval. Univ. Twente. I--VIII 1--163 pages.  Djoerd Hiemstra. 2001. Using Language Models for Information Retrieval. Univ. Twente. I--VIII 1--163 pages."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775067"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the Text REtrieval Conference (TREC\u201999)","author":"Kwok K. L.","unstructured":"K. L. Kwok , Laszlo Grunfeld , and M. Chan . 1999. TREC-8 Ad-Hoc, query and filtering track experiments using PIRCS . In Proceedings of the Text REtrieval Conference (TREC\u201999) . K. L. Kwok, Laszlo Grunfeld, and M. Chan. 1999. TREC-8 Ad-Hoc, query and filtering track experiments using PIRCS. In Proceedings of the Text REtrieval Conference (TREC\u201999)."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2012.62"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2013.2286696"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/383952.383972"},{"key":"e_1_2_1_47_1","volume-title":"Int. J. Mach. Learn. Cybernet.","author":"Lin Yuan","year":"2017","unstructured":"Yuan Lin , Jiajin Wu , Bo Xu , Kan Xu , and Hongfei Lin . 2017. Learning to rank using multiple loss functions . Int. J. Mach. Learn. Cybernet. ( 2017 ), 1--10. Yuan Lin, Jiajin Wu, Bo Xu, Kan Xu, and Hongfei Lin. 2017. Learning to rank using multiple loss functions. Int. J. Mach. Learn. Cybernet. (2017), 1--10."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000016"},{"key":"e_1_2_1_49_1","volume-title":"Learning to Rank for Information Retrieval","author":"Liu Tie-Yan","unstructured":"Tie-Yan Liu . 2011. Learning to Rank for Information Retrieval . Springer Science 8 Business Media. Tie-Yan Liu. 2011. Learning to Rank for Information Retrieval. Springer Science 8 Business Media."},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the 2015 IEEE 22nd International Conference on Software Analysis, Evolution and Reengineering (SANER\u201915)","author":"Lu Meili","year":"2015","unstructured":"Meili Lu , Xiaobing Sun , Shaowei Wang , David Lo , and Yucong Duan . 2015 . Query expansion via wordnet for effective code search . In Proceedings of the 2015 IEEE 22nd International Conference on Software Analysis, Evolution and Reengineering (SANER\u201915) . IEEE, 545--549. Meili Lu, Xiaobing Sun, Shaowei Wang, David Lo, and Yucong Duan. 2015. Query expansion via wordnet for effective code search. In Proceedings of the 2015 IEEE 22nd International Conference on Software Analysis, Evolution and Reengineering (SANER\u201915). IEEE, 545--549."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493175.2493176"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-012-9209-9"},{"key":"e_1_2_1_53_1","volume-title":"Lucene in Action: Covers Apache Lucene 3.0","author":"McCandless Michael","unstructured":"Michael McCandless , Erik Hatcher , and Otis Gospodnetic . 2010. Lucene in Action: Covers Apache Lucene 3.0 . Manning Publications Co. Michael McCandless, Erik Hatcher, and Otis Gospodnetic. 2010. Lucene in Action: Covers Apache Lucene 3.0. Manning Publications Co."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-006-9019-z"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/219717.219748"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277824"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-65813-1_6"},{"key":"e_1_2_1_58_1","volume-title":"Proceedings of the Workshop in ACM SIGIR Conference on Research and Development in Information Retrieval.","author":"Mothe Josiane","year":"2005","unstructured":"Josiane Mothe and Ludovic Tanguy . 2005 . Linguistic features to predict query difficulty . In Proceedings of the Workshop in ACM SIGIR Conference on Research and Development in Information Retrieval. Josiane Mothe and Ludovic Tanguy. 2005. Linguistic features to predict query difficulty. In Proceedings of the Workshop in ACM SIGIR Conference on Research and Development in Information Retrieval."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2017.08.116"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-009-9104-1"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31865-1_37"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/290941.291008"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-009-9123-y"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-1010"},{"key":"e_1_2_1_65_1","volume-title":"VLC and interactive track. NIST Special Publication SP500","author":"Robertson Stephen E.","year":"1999","unstructured":"Stephen E. Robertson , Steve Walker , Micheline Beaulieu , and Peter Willett . 1999. Okapi at TREC-7: Automatic ad hoc, filtering , VLC and interactive track. NIST Special Publication SP500 ( 1999 ), 253--264. Stephen E. Robertson, Steve Walker, Micheline Beaulieu, and Peter Willett. 1999. Okapi at TREC-7: Automatic ad hoc, filtering, VLC and interactive track. NIST Special Publication SP500 (1999), 253--264."},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of The 1st Text REtrieval Conference (TREC","author":"Robertson Stephen E.","year":"1992","unstructured":"Stephen E. Robertson , Steve Walker , Micheline Hancock-Beaulieu , Aarron Gull , and Marianna Lau . 1992 . Okapi at TREC . In Proceedings of The 1st Text REtrieval Conference (TREC 1992), Donna K. Harman (Ed.). 500-207. National Institute of Standards and Technology, 21--30. Stephen E. Robertson, Steve Walker, Micheline Hancock-Beaulieu, Aarron Gull, and Marianna Lau. 1992. Okapi at TREC. In Proceedings of The 1st Text REtrieval Conference (TREC 1992), Donna K. Harman (Ed.). 500-207. National Institute of Standards and Technology, 21--30."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3121050.3121051"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-04417-5_30"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/2180868.2180873"},{"key":"e_1_2_1_70_1","volume-title":"Proceedings of the International Conference on Intelligent Analysis","volume":"2","author":"Strohman Trevor","unstructured":"Trevor Strohman , Donald Metzler , Howard Turtle , and W. Bruce Croft . 2005. Indri: A language model-based search engine for complex queries . In Proceedings of the International Conference on Intelligent Analysis , Vol. 2 . 2--6. Trevor Strohman, Donald Metzler, Howard Turtle, and W. Bruce Croft. 2005. Indri: A language model-based search engine for complex queries. In Proceedings of the International Conference on Intelligent Analysis, Vol. 2. 2--6."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/988672.988764"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2015.07.002"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/1183614.1183698"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/1067268.1067272"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-009-9112-1"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390306"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23476"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277809"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/1076034.1076121"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/383952.384019"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348354"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277835"},{"key":"e_1_2_1_83_1","volume-title":"Writing for Computer Science","author":"Zobel Justin","unstructured":"Justin Zobel . 2004. Writing up . In Writing for Computer Science . Springer , 137--156. Justin Zobel. 2004. Writing up. In Writing for Computer Science. Springer, 137--156."}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3231937","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3231937","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:08:17Z","timestamp":1750208897000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3231937"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,30]]},"references-count":83,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,1,31]]}},"alternative-id":["10.1145\/3231937"],"URL":"https:\/\/doi.org\/10.1145\/3231937","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"value":"1046-8188","type":"print"},{"value":"1558-2868","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,10,30]]},"assertion":[{"value":"2017-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-10-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}