{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,7]],"date-time":"2025-05-07T13:47:20Z","timestamp":1746625640292,"version":"3.40.3"},"publisher-location":"Singapore","reference-count":40,"publisher":"Springer Nature Singapore","isbn-type":[{"type":"print","value":"9789811999475"},{"type":"electronic","value":"9789811999482"}],"license":[{"start":{"date-parts":[[2023,1,1]],"date-time":"2023-01-01T00:00:00Z","timestamp":1672531200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2023,1,1]],"date-time":"2023-01-01T00:00:00Z","timestamp":1672531200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023]]},"DOI":"10.1007\/978-981-19-9948-2_5","type":"book-chapter","created":{"date-parts":[[2023,7,19]],"date-time":"2023-07-19T14:05:16Z","timestamp":1689775516000},"page":"121-153","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Statistical Models and Machine Learning to Advance Code Completion: Are We There Yet?"],"prefix":"10.1007","author":[{"given":"Tien N.","family":"Nguyen","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,7,20]]},"reference":[{"key":"5_CR1","unstructured":"Using google N-Gram corpus. http:\/\/googlesystem.blogspot.com\/2008\/05\/using-googles-n-gram-corpus.html"},{"key":"5_CR2","doi-asserted-by":"crossref","unstructured":"M. Acharya, T. Xie, J. Pei, J. Xu, Mining api patterns as partial orders from source code: from usage scenarios to specifications, in ESEC-FSE \u201907: Proceedings of the 6th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, (ACM, 2007), pp. 25\u201334","DOI":"10.1145\/1287624.1287630"},{"key":"5_CR3","unstructured":"E. Arisoy, T.N. Sainath, B. Kingsbury, B. Ramabhadran, Deep neural network language models, in Proceedings of the NAACL-HLT 2012 Workshop: Will We Ever Really Replace the N-gram Model? On the Future of Language Modeling for HLT, WLM \u201912, (Association for Computational Linguistics, 2012), pp. 20\u201328"},{"key":"5_CR4","first-page":"1137","volume":"3","author":"Y Bengio","year":"2003","unstructured":"Y. Bengio, R. Ducharme, P. Vincent, C. Janvin, A neural probabilistic language model. J. Mach. Learn. Res. 3, 1137\u20131155 (2003)","journal-title":"J. Mach. Learn. Res."},{"key":"5_CR5","doi-asserted-by":"crossref","unstructured":"M. Bruch, M. Monperrus, M. Mezini, Learning from examples to improve code completion systems, in Proceedings of the the 7th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering, ESEC\/FSE \u201909, (ACM, 2009), pp. 213\u2013222","DOI":"10.1145\/1595696.1595728"},{"key":"5_CR6","unstructured":"M. Chen, J. Tworek, H. Jun, Q. Yuan, H.P. de Oliveira Pinto, J. Kaplan, H. Edwards, Y. Burda, N. Joseph, G. Brockman, A. Ray, R. Puri, G. Krueger, M. Petrov, H. Khlaaf, G. Sastry, P. Mishkin, B. Chan, S. Gray, N. Ryder, M. Pavlov, A. Power, L. Kaiser, M. Bavarian, C. Winter, P. Tillet, F.P. Such, D. Cummings, M. Plappert, F. Chantzis, E. Barnes, A. Herbert-Voss, W.H. Guss, A. Nichol, A. Paino, N. Tezak, J. Tang, I. Babuschkin, S. Balaji, S. Jain, W. Saunders, C. Hesse, A.N. Carr, J. Leike, J. Achiam, V. Misra, E. Morikawa, A. Radford, M. Knight, M. Brundage, M. Murati, K. Mayer, P. Welinder, B. McGrew, D. Amodei, S. McCandlish, I. Sutskever, W. Zaremba, Evaluating large language models trained on code (2021)"},{"key":"5_CR7","doi-asserted-by":"publisher","unstructured":"M. Ciniselli, N. Cooper, L. Pascarella, A. Mastropaolo, E. Aghajani, D. Poshyvanyk, M.D. Penta, G. Bavota, An empirical study on the usage of transformer models for code completion. IEEE Trans. Softw. Eng. 01, 4818\u20134837 (5555). https:\/\/doi.org\/10.1109\/TSE.2021.3128234","DOI":"10.1109\/TSE.2021.3128234"},{"key":"5_CR8","doi-asserted-by":"crossref","unstructured":"R. Collobert, J. Weston, A unified architecture for natural language processing: deep neural networks with multitask learning, in Proceedings of the 25th International Conference on Machine Learning, ICML \u201908, (ACM, 2008), pp. 160\u2013167","DOI":"10.1145\/1390156.1390177"},{"key":"5_CR9","unstructured":"Copilot. https:\/\/copilot.github.com\/"},{"key":"5_CR10","doi-asserted-by":"crossref","unstructured":"B. Dagenais, L. Hendren, Enabling static analysis for partial java programs, in Proceedings of the 23rd ACM SIGPLAN Conference on Object-oriented Programming Systems Languages and Applications, OOPSLA \u201908, (ACM, 2008), pp. 313\u2013328","DOI":"10.1145\/1449764.1449790"},{"key":"5_CR11","unstructured":"Eclipse. www.eclipse.org"},{"key":"5_CR12","doi-asserted-by":"crossref","unstructured":"D. Engler, D.Y. Chen, S. Hallem, A. Chou, B. Chelf, Bugs as deviant behavior: a general approach to inferring errors in systems code, in SOSP \u201901: Proceedings of the eighteenth ACM symposium on Operating systems principles, (ACM, 2001), pp. 57\u201372","DOI":"10.1145\/502059.502041"},{"key":"5_CR13","doi-asserted-by":"crossref","unstructured":"V.J. Hellendoorn, S. Proksch, H.C. Gall, A. Bacchelli, When code completion fails: a case study on real-world completions, in Proceedings of the 41st International Conference on Software Engineering, ICSE \u201919, (IEEE Press, Piscataway, NJ, USA, 2019), pp. 960\u2013970 https:\/\/doi.org\/10.1109\/ICSE.2019.00101","DOI":"10.1109\/ICSE.2019.00101"},{"key":"5_CR14","unstructured":"M. Hermans, B. Schrauwen, Training and analysing deep recurrent neural networks, in Advances in Neural Information Processing Systems 26, (2013), pp. 190\u2013198"},{"key":"5_CR15","doi-asserted-by":"crossref","unstructured":"R. Hill, J. Rideout, Automatic method completion, in Proceedings of the 19th IEEE International Conference on Automated Software Engineering, ASE \u201904, (IEEE Computer Society, 2004), pp. 228\u2013235","DOI":"10.1109\/ASE.2004.1342740"},{"key":"5_CR16","doi-asserted-by":"crossref","unstructured":"A. Hindle, E.T. Barr, Z. Su, M. Gabel, P. Devanbu, On the naturalness of software, in Proceedings of the 34th International Conference on Software Engineering, ICSE \u201912, (IEEE Press, 2012), pp. 837\u2013847","DOI":"10.1109\/ICSE.2012.6227135"},{"key":"5_CR17","doi-asserted-by":"crossref","unstructured":"A. Hindle, E.T. Barr, Z. Su, M. Gabel, P. Devanbu, On the naturalness of software, in Proceedings of the 2012 International Conference on Software Engineering, ICSE 2012, (IEEE Press, 2012), pp. 837\u2013847","DOI":"10.1109\/ICSE.2012.6227135"},{"key":"5_CR18","unstructured":"E.H. Huang, R. Socher, C.D. Manning, A.Y. Ng, Improving word representations via global context and multiple word prototypes, in Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1, ACL \u201912, (Association for Computational Linguistics, 2012), pp. 873\u2013882"},{"key":"5_CR19","doi-asserted-by":"publisher","unstructured":"S. Kim, J. Zhao, Y. Tian, S. Chandra, Code prediction by feeding trees to transformers, in 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE), (2021), pp. 150\u2013162 https:\/\/doi.org\/10.1109\/ICSE43902.2021.00026","DOI":"10.1109\/ICSE43902.2021.00026"},{"issue":"1","key":"5_CR20","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1109\/TASL.2012.2215599","volume":"21","author":"H Le","year":"2013","unstructured":"H. Le, I. Oparin, A. Allauzen, J.L. Gauvain, F. Yvon, Structured output layer neural network language models for speech recognition. IEEE Trans. Audio Speech Lang. Process. 21(1), 197\u2013206 (2013)","journal-title":"IEEE Trans. Audio Speech Lang. Process."},{"key":"5_CR21","doi-asserted-by":"crossref","unstructured":"J. Li, Y. Wang, M.R. Lyu, I. King, Code completion with neural attention and pointer networks, in Proceedings of the 27th International Joint Conference on Artificial Intelligence, IJCAI\u201918, (AAAI Press, 2018), pp. 4159\u20134165","DOI":"10.24963\/ijcai.2018\/578"},{"issue":"5","key":"5_CR22","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1145\/1095430.1081754","volume":"30","author":"B Livshits","year":"2005","unstructured":"B. Livshits, T. Zimmermann, Dynamine: finding common error patterns by mining software revision histories. SIGSOFT Softw. Eng. Notes. 30(5), 296\u2013305 (2005)","journal-title":"SIGSOFT Softw. Eng. Notes."},{"key":"5_CR23","unstructured":"C.D. Manning, H. Sch\u00fctze, Foundations of Statistical Natural Language Processing, (MIT Press, Cambridge, MA, USA, 1999)"},{"key":"5_CR24","unstructured":"M. Marasoiu, L. Church, A.F. Blackwell, An empirical investigation of code completion usage by professional software developers, in PPIG (2015)"},{"key":"5_CR25","doi-asserted-by":"crossref","unstructured":"T. Mikolov, A. Deoras, D. Povey, L. Burget, Cernocky, J.: Strategies for training large scale neural network language models, in Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), ASRU\u201911, (IEEE, 2011)","DOI":"10.1109\/ASRU.2011.6163930"},{"key":"5_CR26","doi-asserted-by":"crossref","unstructured":"T. Mikolov, M. Karafiat, L. Burget, J. Cernocky, S. Khudanpur, Recurrent neural network based language model, in Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP), ICASSP\u201910, (IEEE, 2010), pp. 1045\u20131048","DOI":"10.1109\/ICASSP.2011.5947611"},{"issue":"4","key":"5_CR27","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1109\/MS.2006.105","volume":"23","author":"GC Murphy","year":"2006","unstructured":"G.C. Murphy, M. Kersten, L. Findlater, How are java software developers using the eclipse ide? IEEE Softw. 23(4), 76\u201383 (2006). https:\/\/doi.org\/10.1109\/MS.2006.105","journal-title":"IEEE Softw."},{"key":"5_CR28","doi-asserted-by":"crossref","unstructured":"A.T. Nguyen, M. Hilton, M. Codoban, H.A. Nguyen, L. Mast, E. Rademacher, T.N. Nguyen, D. Dig, Api code recommendation using statistical learning from fine-grained changes, in Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, FSE 2016, (Association for Computing Machinery, New York, NY, USA, 2016), pp. 511\u2013522 https:\/\/doi.org\/10.1145\/2950290.2950333","DOI":"10.1145\/2950290.2950333"},{"key":"5_CR29","doi-asserted-by":"publisher","unstructured":"A.T. Nguyen, T.D. Nguyen, H.D. Phan, T.N. Nguyen, A deep neural network language model with contexts for source code, in 2018 IEEE 25th International Conference on Software Analysis, Evolution and Reengineering (SANER), (2018), pp. 323\u2013334. https:\/\/doi.org\/10.1109\/SANER.2018.8330220","DOI":"10.1109\/SANER.2018.8330220"},{"key":"5_CR30","doi-asserted-by":"crossref","unstructured":"A.T. Nguyen, T.N. Nguyen, Graph-based statistical language model for code, in Proceedings of the 37th International Conference on Software Engineering - Volume 1, ICSE \u201915, (IEEE Press, 2015), pp. 858\u2013868","DOI":"10.1109\/ICSE.2015.336"},{"key":"5_CR31","doi-asserted-by":"crossref","unstructured":"A.T. Nguyen, T.T. Nguyen, H.A. Nguyen, A. Tamrawi, H.V. Nguyen, J. Al-Kofahi, T.N. Nguyen, Graph-based pattern-oriented, context-sensitive source code completion, in Proceedings of the 34th International Conference on Software Engineering, ICSE \u201912, (IEEE Press, Piscataway, NJ, USA, 2012), pp. 69\u201379. http:\/\/dl.acm.org\/citation.cfm?id=2337223.2337232","DOI":"10.1109\/ICSE.2012.6227205"},{"key":"5_CR32","doi-asserted-by":"crossref","unstructured":"S. Nguyen, T.N. Nguyen, Y. Li, S. Wang, Combining Program Analysis and Statistical Language Model for Code Statement Completion, (IEEE Press, 2019), pp. 710\u2013721. https:\/\/doi.org\/10.1109\/ASE.2019.00072","DOI":"10.1109\/ASE.2019.00072"},{"key":"5_CR33","doi-asserted-by":"crossref","unstructured":"T.T. Nguyen, H.A. Nguyen, N.H. Pham, J.M. Al-Kofahi, T.N. Nguyen, Graph-based mining of multiple object usage patterns, in Proceedings of the the 7th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering, ESEC\/FSE \u201909, (ACM, 2009), pp. 383\u2013392","DOI":"10.1145\/1595696.1595767"},{"key":"5_CR34","unstructured":"R. Pascanu,\u00c7. G\u00fcl\u00e7ehre, K. Cho, Y. Bengio, How to construct deep recurrent neural networks. CoRR abs\/1312.6026 (2013)"},{"key":"5_CR35","doi-asserted-by":"crossref","unstructured":"R. Robbes, M. Lanza, How program history can improve code completion, in Proceedings of the 2008 23rd IEEE\/ACM International Conference on Automated Software Engineering, ASE \u201908, (IEEE Computer Society, 2008), pp. 317\u2013326","DOI":"10.1109\/ASE.2008.42"},{"key":"5_CR36","doi-asserted-by":"crossref","unstructured":"R. Sarikaya, M. Afify, B. Kingsbury, Tied-mixture language modeling in continuous space, in Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, NAACL \u201909, (Association for Computational Linguistics, 2009), pp. 459\u2013467","DOI":"10.3115\/1620754.1620821"},{"issue":"3","key":"5_CR37","doi-asserted-by":"publisher","first-page":"492","DOI":"10.1016\/j.csl.2006.09.003","volume":"21","author":"H Schwenk","year":"2007","unstructured":"H. Schwenk, Continuous space language models. Comput. Speech Lang. 21(3), 492\u2013518 (2007)","journal-title":"Comput. Speech Lang."},{"key":"5_CR38","doi-asserted-by":"crossref","unstructured":"H. Schwenk, J.L. Gauvain, Training neural network language models on very large corpora, in Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing, HLT \u201905, (Association for Computational Linguistics, 2005), pp. 201\u2013208","DOI":"10.3115\/1220575.1220601"},{"issue":"6","key":"5_CR39","doi-asserted-by":"publisher","first-page":"466","DOI":"10.1109\/TSE.2005.63","volume":"31","author":"CC Williams","year":"2005","unstructured":"C.C. Williams, J.K. Hollingsworth, Automatic mining of source code repositories to improve bug finding techniques. IEEE Trans. Softw. Eng. 31(6), 466\u2013480 (2005)","journal-title":"IEEE Trans. Softw. Eng."},{"key":"5_CR40","doi-asserted-by":"crossref","unstructured":"Y. Yang, Y. Jiang, M. Gu, J. Sun, J. Gao, H. Liu, A language model for statements of software code, in Proceedings of the 32nd IEEE\/ACM International Conference on Automated Software Engineering, ASE 2017, (IEEE Press, 2017), pp. 682\u2013687","DOI":"10.1109\/ASE.2017.8115678"}],"container-title":["Natural Computing Series","Optimising the Software Development Process with Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-981-19-9948-2_5","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T13:40:22Z","timestamp":1729777222000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-981-19-9948-2_5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"ISBN":["9789811999475","9789811999482"],"references-count":40,"URL":"https:\/\/doi.org\/10.1007\/978-981-19-9948-2_5","relation":{},"ISSN":["1619-7127"],"issn-type":[{"type":"print","value":"1619-7127"}],"subject":[],"published":{"date-parts":[[2023]]},"assertion":[{"value":"20 July 2023","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}}]}}