{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:20:04Z","timestamp":1750306804725,"version":"3.41.0"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2013,10,1]],"date-time":"2013-10-01T00:00:00Z","timestamp":1380585600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001711","name":"Swiss National Science Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2013,10]]},"abstract":"<jats:p>With the steady advances in tooling to support software engineering, mastering all the features of modern IDEs, version control systems, and project trackers is becoming increasingly difficult. Answering even the most common developer questions can be surprisingly tedious and difficult. In this article we present a user study with 35 subjects to evaluate our quasi-natural language interface that provides access to various facets of the evolution of a software system but requires almost zero learning effort. Our approach is tightly woven into the Eclipse IDE and allows developers to answer questions related to source code, development history, or bug and issue management. The results of our evaluation show that our query interface can outperform classical software engineering tools in terms of correctness, while yielding significant time savings to its users and greatly advancing the state of the art in terms of usability and learnability.<\/jats:p>","DOI":"10.1145\/2522920.2522931","type":"journal-article","created":{"date-parts":[[2013,10,17]],"date-time":"2013-10-17T12:23:34Z","timestamp":1382012614000},"page":"1-38","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Evaluating a query framework for software evolution data"],"prefix":"10.1145","volume":"22","author":[{"given":"Michael","family":"W\u00fcrsch","sequence":"first","affiliation":[{"name":"University of Zurich, Switzerland"}]},{"given":"Emanuel","family":"Giger","sequence":"additional","affiliation":[{"name":"University of Zurich, Switzerland"}]},{"given":"Harald C.","family":"Gall","sequence":"additional","affiliation":[{"name":"University of Zurich, Switzerland"}]}],"member":"320","published-online":{"date-parts":[[2013,10,22]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447310802205776"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1985404.1985406"},{"key":"e_1_2_1_3_1","doi-asserted-by":"crossref","unstructured":"Berners-Lee T. Fielding R. and Masinter L. 1998. RFC 2396 - Uniform resource identifiers (URI). IETF rfc. http:\/\/www.ietf.org\/rfc\/rfc2396.txt.   Berners-Lee T. Fielding R. and Masinter L. 1998. RFC 2396 - Uniform resource identifiers (URI). IETF rfc. http:\/\/www.ietf.org\/rfc\/rfc2396.txt.","DOI":"10.17487\/rfc2396"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1038\/scientificamerican0501-34"},{"volume-title":"Proceedings of the Jena User Conference. 2--4.","author":"Bernstein A.","key":"e_1_2_1_5_1"},{"volume-title":"Usability Evaluation in Industry","author":"Brooke J.","key":"e_1_2_1_6_1"},{"key":"e_1_2_1_7_1","unstructured":"Brooks F. P. Jr. 1995. The Mythical Man-Month. Addison-Wesley Longman Publishing Boston MA.   Brooks F. P. Jr. 1995. The Mythical Man-Month. Addison-Wesley Longman Publishing Boston MA."},{"key":"e_1_2_1_8_1","unstructured":"Chowdhury G. G. 2004. Introduction to Modern Information Retrieval 2nd Ed. Facet London.  Chowdhury G. G. 2004. Introduction to Modern Information Retrieval 2 nd Ed. Facet London."},{"volume-title":"Proceedings of the USENIX Conference on Domain-Specific Languages. 229--242","year":"1997","author":"Crew R. F.","key":"e_1_2_1_9_1"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1368088.1368092"},{"key":"e_1_2_1_11_1","unstructured":"Dean M. and Schreiber G Eds. 2004. OWL web ontology language reference. W3C recommendation. http:\/\/www.w3.org\/TR\/owl-ref\/.  Dean M. and Schreiber G Eds. 2004. OWL web ontology language reference. W3C recommendation. http:\/\/www.w3.org\/TR\/owl-ref\/."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/103167.103172"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2000064.2019525"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2007.70731"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1806799.1806828"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1006\/knac.1993.1008"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/11785477_2"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1162\/coli.2007.33.1.105"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPC.2011.39"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/52.311059"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2009.5070524"},{"key":"e_1_2_1_22_1","first-page":"65","article-title":"A simple sequentially rejective multiple test procedure","volume":"6","author":"Holm S.","year":"1979","journal-title":"Scandinav. J. Statist."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/643603.643622"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2010.06.001"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2007.66"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2011.6100076"},{"key":"e_1_2_1_27_1","unstructured":"Klyne G. Brickley D. and Guha R. V. Eds. 2004. Resource description framework (rdf): Concepts and abstract syntax. W3C recommendation. http:\/\/www.w3.org\/TR\/2004\/REC-rdf-schema-20040210\/.  Klyne G. Brickley D. and Guha R. V. Eds. 2004. Resource description framework (rdf): Concepts and abstract syntax. W3C recommendation. http:\/\/www.w3.org\/TR\/2004\/REC-rdf-schema-20040210\/."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2007.45"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0013066"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1134285.1134355"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1177\/154193129203601617"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-02806-9_12"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00127447"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/219717.219748"},{"key":"e_1_2_1_35_1","unstructured":"Norusis M. 2010. SPSS 18 Advanced Statistical Procedures Companion. Prentice Hall.  Norusis M. 2010. SPSS 18 Advanced Statistical Procedures Companion. Prentice Hall."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.489080"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2011.6100074"},{"volume-title":"Proceedings of the 13th Biennial European Conference on Artificial Intelligence. 675--681","author":"Power R.","key":"e_1_2_1_38_1"},{"key":"e_1_2_1_39_1","unstructured":"Prudhommeaux E. and Abou-Zahra S. Eds. 2008. SPARQL query language for RDF. W3C recommendation. http:\/\/www.w3.org\/TR\/rdf-sparql-query\/.  Prudhommeaux E. and Abou-Zahra S. Eds. 2008. SPARQL query language for RDF. W3C recommendation. http:\/\/www.w3.org\/TR\/rdf-sparql-query\/."},{"key":"e_1_2_1_40_1","unstructured":"Sauro J. 2010. If you could only ask one question use this one. Personal blog. http:\/\/www.measuringusability.com\/blog\/single-question.php.  Sauro J. 2010. If you could only ask one question use this one. Personal blog. http:\/\/www.measuringusability.com\/blog\/single-question.php."},{"key":"e_1_2_1_41_1","unstructured":"Sauro J. 2011. A Practical Guide to the System Usability Scale: Background Benchmarks & Best Practices. CreateSpace Independent Publishing Platform.  Sauro J. 2011. A Practical Guide to the System Usability Scale: Background Benchmarks & Best Practices. CreateSpace Independent Publishing Platform."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518946"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518947"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1181775.1181779"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2008.26"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2007.03.004"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPC.2008.18"},{"volume-title":"Proceedings of the European Semantic Web Conference Ph.D. Symposium.","year":"2008","author":"Tappolet J.","key":"e_1_2_1_48_1"},{"key":"e_1_2_1_49_1","unstructured":"Tappolet J. 2011. Managing temporal graph data while preserving semantics. Ph.D. thesis University of Zurich. http:\/\/www.zora.uzh.ch\/74542\/.  Tappolet J. 2011. Managing temporal graph data while preserving semantics. Ph.D. thesis University of Zurich. http:\/\/www.zora.uzh.ch\/74542\/."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2005.135"},{"volume-title":"Software Engineering: An Introduction","year":"2000","author":"Wohlin C.","key":"e_1_2_1_51_1"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00607-012-0204-1"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1806799.1806827"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2522920.2522931","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2522920.2522931","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T07:34:53Z","timestamp":1750232093000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2522920.2522931"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,10]]},"references-count":53,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2013,10]]}},"alternative-id":["10.1145\/2522920.2522931"],"URL":"https:\/\/doi.org\/10.1145\/2522920.2522931","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"type":"print","value":"1049-331X"},{"type":"electronic","value":"1557-7392"}],"subject":[],"published":{"date-parts":[[2013,10]]},"assertion":[{"value":"2012-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-10-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}