{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,25]],"date-time":"2026-05-25T13:04:43Z","timestamp":1779714283803,"version":"3.53.1"},"reference-count":71,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2026,5,25]],"date-time":"2026-05-25T00:00:00Z","timestamp":1779667200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,5,25]],"date-time":"2026-05-25T00:00:00Z","timestamp":1779667200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2026,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Software analytics often builds from labeled data. Labeling can be slow, error prone, and expensive. When human expertise is scarce, SE researchers sometimes ask large language models (LLMs) for the missing labels. While this has been successful in some domains, recent results show that LLM-based labeling has blind spots. Specifically, their labeling is not effective for higher dimensional multi-objective problems. To address this task, we propose a novel LLM prompting strategy called SynthCore. When one opinion fails, SynthCore\u2019s combines multiple separated opinions generated by LLMs (with no knowledge of each others\u2019 answers) into an ensemble of few-shot learners. Simpler than other strategies (e.g. chain-of-thought, multi-agent-debate, etc) SynthCore aggregates results from multiple single prompt sessions (with no crossover between them). SynthCore has been tested on 49 SE multi-objective optimization tasks, handling tasks as diverse as software project management, Makefile configuration, and hyperparameter optimization. SynthCore\u2019s ensemble found optimizations that are better than state-of-the-art alternative approaches (Gaussian Process Models, Tree of Parzen Estimators, active learners in both exploration and exploitation mode). Importantly, these optimizations were made using data labeled by LLMs, without any human opinions. From these experiments, we conclude that ensembles of few shot learners can successfully annotate high dimensional multi-objective tasks. Further, we speculate that other successful few-shot prompting results could be quickly and easily enhanced using SynthCore\u2019s ensemble approach. To support open science, all our data and scripts are available at\n                    <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/github.com\/lohithsowmiyan\/lazy-llm\/tree\/clusters\" ext-link-type=\"uri\">https:\/\/github.com\/lohithsowmiyan\/lazy-llm\/tree\/clusters<\/jats:ext-link>\n                    .\n                  <\/jats:p>","DOI":"10.1007\/s10664-026-10823-5","type":"journal-article","created":{"date-parts":[[2026,5,25]],"date-time":"2026-05-25T12:39:00Z","timestamp":1779712740000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["From brittle to robust: Improving LLM annotations for SE optimization"],"prefix":"10.1007","volume":"31","author":[{"given":"Lohith","family":"Senthilkumar","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5040-3196","authenticated-orcid":false,"given":"Tim","family":"Menzies","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,5,25]]},"reference":[{"key":"10823_CR1","doi-asserted-by":"crossref","unstructured":"Ahmed T, Devanbu P (2022) Few-shot training llms for project-specific code-summarization. In: Proceedings of the 37th IEEE\/ACM international conference on automated software engineering, pp 1\u20135","DOI":"10.1145\/3551349.3559555"},{"key":"10823_CR2","doi-asserted-by":"crossref","unstructured":"Ahmed T, Devanbu P (2023) Better patching using llm prompting, via self-consistency. In: 2023 38th IEEE\/ACM International Conference on Automated Software Engineering (ASE), pp 1742\u20131746. IEEE","DOI":"10.1109\/ASE56229.2023.00065"},{"key":"10823_CR3","doi-asserted-by":"crossref","unstructured":"Ahmed T, Devanbu P, Treude C, Pradel M (2025) Can llms replace manual annotation of software engineering artifacts? In: MSR\u201925","DOI":"10.1109\/MSR66628.2025.00086"},{"key":"10823_CR4","doi-asserted-by":"crossref","unstructured":"Bender EM, Gebru T, McMillan-Major A, Shmitchell S (2021) On the dangers of stochastic parrots: Can language models be too big? ACM Conference on Fairness, Accountability, and Transparency (FAccT \u201921), pp 610\u2013623","DOI":"10.1145\/3442188.3445922"},{"key":"10823_CR5","unstructured":"Bergstra J, Bardenet R, Bengio Y, K\u00e9gl B (2011) Algorithms for hyper-parameter optimization. Adv Neural Inf Process Syst 24"},{"key":"10823_CR6","doi-asserted-by":"crossref","unstructured":"Boehm BW, Turner R (2004) Balancing agility and discipline: A guide for the perplexed. Addison-Wesley Professional","DOI":"10.1007\/978-3-540-24675-6_1"},{"key":"10823_CR7","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L (2001) Random forests. Mach Learn 45:5\u201332","journal-title":"Mach Learn"},{"key":"10823_CR8","unstructured":"Brochu E, Cora VM, De Freitas N (2010) A tutorial on bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning. arXiv preprint arXiv:1012.2599"},{"key":"10823_CR9","unstructured":"Chen P, Chen T (2026) Promisetune: Unveiling causally promising and explainable configuration tuning. In: Proceedings of the 48th IEEE\/ACM International Conference on Software Engineering"},{"key":"10823_CR10","doi-asserted-by":"crossref","unstructured":"Chen J, Xu N, Chen P, Zhang H (2021) Efficient compiler autotuning via bayesian optimization. In: 43rd IEEE\/ACM Int. Conf. Softw. Eng. ICSE 2021, Madrid, Spain, 22\u201330 May 2021, pp 1198\u20131209","DOI":"10.1109\/ICSE43902.2021.00110"},{"issue":"3","key":"10823_CR11","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1037\/0033-2909.114.3.494","volume":"114","author":"N Cliff","year":"1993","unstructured":"Cliff N (1993) Dominance statistics: Ordinal analyses to answer ordinal questions. Psychol Bull 114(3):494\u2013509","journal-title":"Psychol Bull"},{"key":"10823_CR12","unstructured":"Cohen J (2016) A power primer"},{"key":"10823_CR13","doi-asserted-by":"crossref","unstructured":"Deng Y, Xia CS, Peng H, Yang C, Zhang L (2023) Large language models are zero-shot fuzzers: Fuzzing deep-learning libraries via large language models. In: Proceedings of the 32nd ACM SIGSOFT international symposium on software testing and analysis, pp 423\u2013435","DOI":"10.1145\/3597926.3598067"},{"key":"10823_CR14","doi-asserted-by":"crossref","unstructured":"Di Fiore F, Nardelli M, Mainini L (2024) Active learning and bayesian optimization: A unified perspective to learn with a goal. Archives of Computational Methods in Engineering, pp 1\u201329","DOI":"10.1007\/s11831-024-10064-z"},{"key":"10823_CR15","doi-asserted-by":"crossref","unstructured":"Dietterich TG (2000) Ensemble methods in machine learning. Multiple classifier systems: First international workshop, MCS 2000 Cagliari, Italy, June 21\u201323, 2000 Proceedings 1, pp 1\u201315","DOI":"10.1007\/3-540-45014-9_1"},{"key":"10823_CR16","unstructured":"Du Z, Qian C, Liu W, Xie Z, Wang Y, Dang Y, Chen W, Yang C (2024) Multi-agent software development through cross-team collaboration. arXiv preprint arXiv:2406.08979"},{"key":"10823_CR17","doi-asserted-by":"crossref","unstructured":"Easterbrook S, Singer J, Storey M-A, Damian D (2008) Selecting empirical methods for software engineering research. Guide Adv Empiric Softw Eng 285\u2013311","DOI":"10.1007\/978-1-84800-044-5_11"},{"issue":"1","key":"10823_CR18","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/S0020-7373(80)80032-0","volume":"13","author":"M Easterby-Smith","year":"1980","unstructured":"Easterby-Smith M (1980) The design, analysis and interpretation of repertory grids. Int J Man Mach Stud 13(1):3\u201324","journal-title":"Int J Man Mach Stud"},{"issue":"1","key":"10823_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1214\/aos\/1176344552","volume":"7","author":"B Efron","year":"1979","unstructured":"Efron B (1979) Bootstrap methods: Another look at the jackknife. Ann Stat 7(1):1\u201326","journal-title":"Ann Stat"},{"key":"10823_CR20","doi-asserted-by":"crossref","unstructured":"Efron B, Tibshirani RJ (1993) An Introduction to the Bootstrap. Monographs on Statistics and Applied Probability. Chapman & Hall\/CRC","DOI":"10.1007\/978-1-4899-4541-9"},{"issue":"1","key":"10823_CR21","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1006\/jcss.1997.1504","volume":"55","author":"Y Freund","year":"1997","unstructured":"Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55(1):119\u2013139","journal-title":"J Comput Syst Sci"},{"key":"10823_CR22","doi-asserted-by":"crossref","unstructured":"Fu W, Menzies T (2017) Revisiting unsupervised learning for defect prediction. In: Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, ESEC\/FSE 2017, pp 72\u201383, New York, NY, USA. ACM","DOI":"10.1145\/3106237.3106257"},{"issue":"8","key":"10823_CR23","first-page":"1070","volume":"26","author":"CE Gates","year":"1991","unstructured":"Gates CE, Bilbro JD (1991) Illustration of a cluster analysis method for mean separation. HortScience 26(8):1070\u20131070","journal-title":"HortScience"},{"key":"10823_CR24","doi-asserted-by":"crossref","unstructured":"Gong J, Chen T (2025) Deep configuration performance learning: A systematic survey and taxonomy. ACM Trans Softw Eng Methodol","DOI":"10.1145\/3702986"},{"key":"10823_CR25","doi-asserted-by":"crossref","unstructured":"Green P, Menzies T, Williams S, El-Rawas O (2009) Understanding the value of software engineering technologies. In: 2009 IEEE\/ACM International Conference on Automated Software Engineering, pp 52\u201361. IEE","DOI":"10.1109\/ASE.2009.93"},{"key":"10823_CR26","doi-asserted-by":"crossref","unstructured":"Grinsztajn L, Oyallon E, Varoquaux G (2022) Why do tree-based models still outperform deep learning on typical tabular data? In: NeurIPS\u201922","DOI":"10.52202\/068431-0037"},{"key":"10823_CR27","doi-asserted-by":"crossref","unstructured":"Hou X, Zhao Y, Liu Y, Yang Z, Wang K, Li L, Luo X, Lo D, Grundy J, Wang H (2024) Large language models for software engineering: A systematic literature review. ACM Trans Softw Eng Methodol 33(8)","DOI":"10.1145\/3695988"},{"key":"10823_CR28","doi-asserted-by":"crossref","unstructured":"Islam MdR, Zibran MF (2017) Leveraging automated sentiment analysis in software engineering. In: 2017 IEEE\/ACM 14th International Conference on Mining Software Repositories (MSR), pp 203\u2013214","DOI":"10.1109\/MSR.2017.9"},{"key":"10823_CR29","doi-asserted-by":"crossref","unstructured":"Jamshidi P, Casale G (2016) An uncertainty-aware approach to optimal configuration of stream processing systems. In: Proc. 24th IEEE Int. Symp. Modeling, Analysis and Simulation of Computer and Telecommunication Systems","DOI":"10.1109\/MASCOTS.2016.17"},{"issue":"6","key":"10823_CR30","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1109\/MS.2024.3439138","volume":"41","author":"B Johnson","year":"2024","unstructured":"Johnson B, Menzies T (2024) Ai over-hype: A dangerous threat (and how to fix it). IEEE Softw 41(6):131\u2013138","journal-title":"IEEE Softw"},{"key":"10823_CR31","doi-asserted-by":"crossref","unstructured":"Kamp M, Kreutzer P, Philippsen M (2019) Sesame: A data set of semantically similar java methods. In: 2019 IEEE\/ACM 16th International Conference on Mining Software Repositories (MSR), pp 529\u2013533. IEEE","DOI":"10.1109\/MSR.2019.00079"},{"issue":"1","key":"10823_CR32","doi-asserted-by":"publisher","first-page":"13","DOI":"10.4103\/2153-3539.129450","volume":"5","author":"MD Krasowski","year":"2014","unstructured":"Krasowski MD, Davis SR, Drees D, Morris C, Kulhavy J, Crone C, Bebber T, Clark I, Nelson DL, Teul S et al (2014) Autoverification in a core clinical chemistry laboratory at an academic medical center. J Pathol Inf 5(1):13","journal-title":"J Pathol Inf"},{"key":"10823_CR33","doi-asserted-by":"crossref","unstructured":"Krishna R, Yu Z, Agrawal A, Dominguez M, Wolf D (2016) The \u201cbigse\u201d project: Lessons learned from validating industrial text mining. In: Proceedings of the 2Nd International Workshop on BIG Data Software Engineering, BIGDSE \u201916, pp 65\u201371","DOI":"10.1145\/2896825.2896836"},{"key":"10823_CR34","doi-asserted-by":"crossref","unstructured":"Le V-H, Zhang H (2023) Log parsing with prompt-based few-shot learning. In: 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE), pp 2438\u20132449. IEEE","DOI":"10.1109\/ICSE48619.2023.00204"},{"issue":"2","key":"10823_CR35","first-page":"1","volume":"34","author":"J Li","year":"2025","unstructured":"Li J, Li G, Li Y, Jin Z (2025) Structured chain-of-thought prompting for code generation. ACM Trans Softw Eng Methodol 34(2):1\u201323","journal-title":"ACM Trans Softw Eng Methodol"},{"issue":"3","key":"10823_CR36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3630252","volume":"33","author":"A Lustosa","year":"2024","unstructured":"Lustosa A, Menzies T (2024) Learning from very little data: On the value of landscape analysis for predicting software project health. ACM Trans Softw Eng Methodol 33(3):1\u201322","journal-title":"ACM Trans Softw Eng Methodol"},{"key":"10823_CR37","doi-asserted-by":"crossref","unstructured":"Majumder S, Balaji N, Brey K, Fu W, Menzies T (2018) 500+ times faster than deep learning. In: Proceedings of the 15th International Conference on Mining Software Repositories. ACM","DOI":"10.1145\/3196398.3196424"},{"key":"10823_CR38","doi-asserted-by":"crossref","unstructured":"Markus Dollmann and Michaela Geierhos. On-and off-topic classification and semantic annotation of user-generated software requirements. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1807\u20131816, 2016","DOI":"10.18653\/v1\/D16-1186"},{"key":"10823_CR39","doi-asserted-by":"crossref","unstructured":"Menzies T (2025) Retrospective: Data mining static code attributes to learn defect predictors. IEEE Trans Softw Eng","DOI":"10.1109\/TSE.2025.3537406"},{"key":"10823_CR40","unstructured":"Menzies T, Black J, Fleming J, Dean M (1992) An expert system for raising pigs. In: The first Conference on Practical Applications of Prolog"},{"key":"10823_CR41","unstructured":"Menzies T, Chen T (2025) Moot repository of multi-objective optimization tests"},{"key":"10823_CR42","doi-asserted-by":"crossref","unstructured":"Menzies T, Elrawas O, Hihn J, Feather M, Madachy R, Boehm B (2007) The business case for automated software engineering. In: Proceedings of the twenty-second IEEE\/ACM international conference on Automated software engineering, pp 303\u2013312. ACM","DOI":"10.1145\/1321631.1321676"},{"key":"10823_CR43","doi-asserted-by":"crossref","unstructured":"Menzies T, Williams S, El-Rawas O, Boehm B, Hihn J (2009) How to avoid drastic software process change (using stochastic stability). In: 2009 IEEE 31st International Conference on Software Engineering, pp 540\u2013550. IEEE","DOI":"10.1109\/ICSE.2009.5070552"},{"issue":"2","key":"10823_CR44","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1177\/160940690200100202","volume":"1","author":"JM Morse","year":"2002","unstructured":"Morse JM, Barrett M, Mayan M, Olson K, Spiers J (2002) Verification strategies for establishing reliability and validity in qualitative research. Int J Qual Methods 1(2):13\u201322","journal-title":"Int J Qual Methods"},{"issue":"7","key":"10823_CR45","doi-asserted-by":"publisher","first-page":"794","DOI":"10.1109\/TSE.2018.2870895","volume":"46","author":"V Nair","year":"2020","unstructured":"Nair V, Zhe Yu, Menzies T, Siegmund N, Apel S (2020) Finding faster configurations using FLASH. IEEE Trans Software Eng 46(7):794\u2013811","journal-title":"IEEE Trans Software Eng"},{"key":"10823_CR46","doi-asserted-by":"crossref","unstructured":"Nair V, Menzies T, Chen J (2016) An (accidental) exploration of alternatives to evolutionary algorithms for sbse. In: International Symposium on Search Based Software Engineering, pp 96\u2013111. Springer","DOI":"10.1007\/978-3-319-47106-8_7"},{"key":"10823_CR47","doi-asserted-by":"crossref","unstructured":"Nashid N, Sintaha M, Mesbah A (2023) Retrieval-based prompt selection for code-related few-shot learning. In: 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE), pp 2450\u20132462. IEEE","DOI":"10.1109\/ICSE48619.2023.00205"},{"key":"10823_CR48","doi-asserted-by":"crossref","unstructured":"Patra J, Pradel M (2022) Nalin: learning from runtime behavior to find name-value inconsistencies in jupyter notebooks. In: Proceedings of the 44th International Conference on Software Engineering, pp 1469\u20131481","DOI":"10.1145\/3510003.3510144"},{"key":"10823_CR49","doi-asserted-by":"crossref","unstructured":"Port D, Olkov A, Menzies T (2008) Using simulation to investigate requirements prioritization strategies. In: 2008 23rd IEEE\/ACM International Conference on Automated Software Engineering, pp 268\u2013277. IEEE","DOI":"10.1109\/ASE.2008.37"},{"key":"10823_CR50","unstructured":"Pourreza M, Rafiei D (2023) NormTab: Improving symbolic reasoning. In: LLMs through tabular data normalization. In: Findings of the Association for Computational Linguistics: EMNLP 2023, pp 11025\u201311038. Association for Computational Linguistics"},{"key":"10823_CR51","doi-asserted-by":"crossref","unstructured":"Rigby PC, Bird C (2013) Convergent contemporary software peer review practices. In: Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering, ESEC\/FSE 2013, pp 202\u2013212, New York, NY, USA. Association for Computing Machinery","DOI":"10.1145\/2491411.2491444"},{"key":"10823_CR52","doi-asserted-by":"crossref","unstructured":"Ross SM (2014) Introduction to Probability Models, 11 edn. Academic Press","DOI":"10.1016\/B978-0-12-407948-9.00001-3"},{"issue":"3","key":"10823_CR53","doi-asserted-by":"publisher","first-page":"507","DOI":"10.2307\/2529204","volume":"30","author":"CW Scott","year":"1974","unstructured":"Scott CW, Knott M (1974) A cluster analysis method for grouping means in the analysis of variance. Biometrics 30(3):507\u2013512","journal-title":"Biometrics"},{"key":"10823_CR54","unstructured":"Senthilkumar L, Menzies T (2024) Can large language models improve se active learning via warm-starts? arXiv preprint arXiv:2501.00125"},{"key":"10823_CR55","first-page":"8634","volume":"36","author":"N Shinn","year":"2023","unstructured":"Shinn N, Cassano F, Gopinath A, Narasimhan K, Yao S (2023) Reflexion: Language agents with verbal reinforcement learning. Adv Neural Inf Process Syst 36:8634\u20138652","journal-title":"Adv Neural Inf Process Syst"},{"key":"10823_CR56","unstructured":"Smit AP, Duckworth P, Grinsztajn N, Tessera K, Barrett TD, Pretorius A (2023) Are we going mad? benchmarking multi-agent debate between language models for medical q&a. In: Deep Generative Models for Health Workshop NeurIPS 2023"},{"key":"10823_CR57","unstructured":"Somvanshi S, Das S, Javed SA, Antariksa G, Hossain A (2024) A survey on deep tabular learning. arXiv preprint arXiv:2410.12034"},{"key":"10823_CR58","doi-asserted-by":"crossref","unstructured":"Svyatkovskiy A, Deng SK, Fu S, Sundaresan N (2020) Intellicode compose: Code generation using transformer. In: Proceedings of the 28th ACM joint meeting on European software engineering conference and symposium on the foundations of software engineering, pp 1433\u20131443","DOI":"10.1145\/3368089.3417058"},{"issue":"4","key":"10823_CR59","first-page":"2677","volume":"49","author":"V Tawosi","year":"2023","unstructured":"Tawosi V, Moussa R, Sarro F (2023) Agile effort estimation: Have we solved the problem yet? insights from a replication study. IEEE TSE 49(4):2677\u20132697","journal-title":"IEEE TSE"},{"issue":"1","key":"10823_CR60","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1109\/JSYST.2010.2065131","volume":"5","author":"R Valerdi","year":"2010","unstructured":"Valerdi R (2010) Heuristics for systems engineering cost estimation. IEEE Syst J 5(1):91\u201398","journal-title":"IEEE Syst J"},{"key":"10823_CR61","doi-asserted-by":"crossref","unstructured":"Valov P, Petkovich J-C, Guo J, Fischmeister S, Czarnecki K (2017) Transferring performance prediction models across different hardware platforms. In: Proc. of the 8th ACM\/SPEC on Int. Conf. Perf. Eng., pp 39\u201350","DOI":"10.1145\/3030207.3030216"},{"key":"10823_CR62","doi-asserted-by":"crossref","unstructured":"Vasilescu B, Yu Y, Wang H, Devanbu P, Filkov V (2015) Quality and productivity outcomes relating to continuous integration in github. In: Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, pp 805\u2013816. ACM","DOI":"10.1145\/2786805.2786850"},{"key":"10823_CR63","first-page":"61501","volume":"36","author":"W Wang","year":"2023","unstructured":"Wang W, Chen Z, Chen X, Jiannan W, Zhu X, Zeng G, Luo P, Tong L, Zhou J, Qiao Y et al (2023) Visionllm: Large language model is also an open-ended decoder for vision-centric tasks. Adv Neural Inf Process Syst 36:61501\u201361513","journal-title":"Adv Neural Inf Process Syst"},{"key":"10823_CR64","unstructured":"Wang X, Wei J, Schuurmans D, Le QV, Chi EdH, Narang S, Chowdhery A, Zhou D (2023) Self-consistency improves chain of thought reasoning in language models. In: International Conference on Learning Representations (ICLR)"},{"key":"10823_CR65","doi-asserted-by":"crossref","unstructured":"Wan M, Safavi T, Jauhar SK, Kim Y, Counts S, Neville J, Suri S, Shah C, White RW, Yang L et al (2024) Tnt-llm: Text mining at scale with large language models. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp 5836\u20135847","DOI":"10.1145\/3637528.3671647"},{"key":"10823_CR66","unstructured":"Williams C, Rasmussen C (1995) Gaussian processes for regression. Adv Neural Inf Process Syst 8"},{"key":"10823_CR67","doi-asserted-by":"crossref","unstructured":"Xia CS, Paltenghi M, Tian JL, Pradel M, Zhang L (2024) Fuzz4all: Universal fuzzing with large language models. In: Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering, pp 1\u201313","DOI":"10.1145\/3597503.3639121"},{"key":"10823_CR68","doi-asserted-by":"crossref","unstructured":"Yang G, Zhou Y, Chen X, Zhang X, Zhuo TY, Chen T (2024) Chain-of-thought in neural code generation: From and for lightweight language models. IEEE Trans Softw Eng","DOI":"10.1109\/TSE.2024.3440503"},{"issue":"5","key":"10823_CR69","doi-asserted-by":"publisher","first-page":"1676","DOI":"10.1109\/TSE.2020.3031401","volume":"48","author":"Z Yu","year":"2022","unstructured":"Yu Z, Fahid FM, Tu H, Menzies T (2022) Identifying self-admitted technical debts with jitterbug: A two-step approach. IEEE Trans Software Eng 48(5):1676\u20131691","journal-title":"IEEE Trans Software Eng"},{"issue":"2","key":"10823_CR70","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10515-025-00509-5","volume":"32","author":"D Yuan","year":"2025","unstructured":"Yuan D, Yang G, Zhang T (2025) Ui2html: utilizing llm agents with chain of thought to convert ui into html code. Autom Softw Eng 32(2):1\u201324","journal-title":"Autom Softw Eng"},{"issue":"6","key":"10823_CR71","doi-asserted-by":"publisher","first-page":"712","DOI":"10.1109\/TEVC.2007.892759","volume":"11","author":"Q Zhang","year":"2007","unstructured":"Zhang Q, Li H (2007) Moea\/d: A multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evol Comput 11(6):712\u2013731","journal-title":"IEEE Trans Evol Comput"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-026-10823-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-026-10823-5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-026-10823-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,25]],"date-time":"2026-05-25T12:39:14Z","timestamp":1779712754000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-026-10823-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,25]]},"references-count":71,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2026,11]]}},"alternative-id":["10823"],"URL":"https:\/\/doi.org\/10.1007\/s10664-026-10823-5","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,25]]},"assertion":[{"value":"19 June 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 February 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 May 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declared that they have no conflict of interest. The authors have no competing interests to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}},{"value":"The authors have no relevant financial or non-financial interests to disclose. All authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Financial or Non-financial Interests"}},{"value":"Lacking human or animal subjects, an ethical review was not required.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval"}},{"value":"This study had no human subjects.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed Consent"}},{"value":"Not applicable.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Clinical Trial Number"}}],"article-number":"155"}}