{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T05:06:46Z","timestamp":1786684006488,"version":"3.56.0"},"reference-count":59,"publisher":"ASME International","issue":"2","license":[{"start":{"date-parts":[[2025,1,16]],"date-time":"2025-01-16T00:00:00Z","timestamp":1736985600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.asme.org\/publications-submissions\/publishing-information\/legal-policies"}],"content-domain":{"domain":["asmedigitalcollection.asme.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,2,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Requirement elicitation, a critical, yet time-consuming and challenging step in product development, often fails to capture the full spectrum of user needs. This may lead to products that fall short of user expectations. This article introduces a novel framework that leverages large language models (LLMs) to automate and enhance the requirement elicitation process. LLMs are used to generate a vast array of simulated users (LLM agents), enabling the exploration of a much broader range of user needs and unforeseen use cases. These agents engage in product experience scenarios, explaining their actions, observations, and challenges. Subsequent agent interviews and analysis uncover valuable user needs, including latent ones. We validate our framework with three experiments. First, we explore different methodologies for the challenge of diverse agent generation, discussing their advantages and shortcomings. We measure the diversity of identified user needs and demonstrate that context-aware agent generation leads to greater diversity. Second, we show how our framework effectively mimics empathic lead user interviews, identifying a greater number of latent needs than conventional human interviews. Third, we show that LLMs can be used to analyze interviews, capture needs, and classify them as latent or not. Our work highlights the potential of using LLMs to accelerate early-stage product development with minimal costs and increase innovation.<\/jats:p>","DOI":"10.1115\/1.4067388","type":"journal-article","created":{"date-parts":[[2024,12,11]],"date-time":"2024-12-11T15:55:42Z","timestamp":1733932542000},"update-policy":"https:\/\/doi.org\/10.1115\/crossmarkpolicy-asme","source":"Crossref","is-referenced-by-count":40,"title":["Elicitron: A Large Language Model Agent-Based Simulation Framework for Design Requirements Elicitation"],"prefix":"10.1115","volume":"25","author":[{"given":"Mohammadmehdi","family":"Ataei","sequence":"first","affiliation":[{"name":"Autodesk Research , 661 University Avenue, , \u00a0 ,","place":["Toronto, ON, Canada, M5G 1M1"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hyunmin","family":"Cheong","sequence":"additional","affiliation":[{"name":"Autodesk Research , 661 University Avenue, , \u00a0 ,","place":["Toronto, ON, Canada, M5G 1M1"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniele","family":"Grandi","sequence":"additional","affiliation":[{"name":"Autodesk Research , The Landmark @ One Market, Ste. 400, , \u00a0","place":["San Francisco, CA, 94105"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ye","family":"Wang","sequence":"additional","affiliation":[{"name":"Autodesk Research , The Landmark @ One Market, Ste. 400, , \u00a0","place":["San Francisco, CA, 94105"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nigel","family":"Morris","sequence":"additional","affiliation":[{"name":"Autodesk Research , 661 University Avenue, , \u00a0 ,","place":["Toronto, ON, Canada, M5G 1M1"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Tessier","sequence":"additional","affiliation":[{"name":"Autodesk Research , 661 University Avenue, , \u00a0 ,","place":["Toronto, ON, Canada, M5G 1M1"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"33","published-online":{"date-parts":[[2025,1,16]]},"reference":[{"issue":"4","key":"2025011617233298700_CIT0001","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1145\/267580.267581","article-title":"Classification of Research Efforts in Requirements Engineering","volume":"29","author":"Zave","year":"1997","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"2025011617233298700_CIT0002","first-page":"1","article-title":"Ambiguity in Natural Language Requirements Documents","author":"Berry","year":"2007"},{"key":"2025011617233298700_CIT0003","first-page":"1877","volume-title":"Language Models Are Few-Shot Learners","author":"Brown","year":"2020"},{"key":"2025011617233298700_CIT0004","first-page":"6000","article-title":"Attention Is All You Need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2025011617233298700_CIT0005","doi-asserted-by":"publisher","first-page":"24824","DOI":"10.48550\/arXiv.2201.11903","article-title":"Chain-of-thought Prompting Elicits Reasoning in Large Language Models","volume":"35","author":"Wei","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"issue":"1","key":"2025011617233298700_CIT0006","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1109\/MS.2015.153","article-title":"Toward Data-Driven Requirements Engineering","volume":"33","author":"Maalej","year":"2015","journal-title":"IEEE Softw."},{"key":"2025011617233298700_CIT0007","first-page":"289","article-title":"Empathic Lead Users: The Effects of Extraordinary User Experiences on Customer Needs Analysis and Product Redesign","author":"Lin","year":"2007"},{"issue":"1","key":"2025011617233298700_CIT0008","doi-asserted-by":"publisher","first-page":"261","DOI":"10.5334\/pme.1072","article-title":"Writing With ChatGPT: An Illustration of Its Capacity, Limitations & Implications for Academic Writers","volume":"12","author":"Lingard","year":"2023","journal-title":"Perspect. Med. Educ."},{"key":"2025011617233298700_CIT0009","first-page":"43","volume-title":"Advanced Applications of Generative AI and Natural Language Processing Models","author":"Htet","year":"2024"},{"issue":"2","key":"2025011617233298700_CIT0010","doi-asserted-by":"publisher","first-page":"380","DOI":"10.33395\/jmp.v12i1.12407","article-title":"Improving Customer Service Quality in MSMEs Through the Use of ChatGPT","volume":"12","author":"Subagja","year":"2023","journal-title":"J. Minfo Polgan"},{"issue":"6624","key":"2025011617233298700_CIT0011","doi-asserted-by":"publisher","first-page":"1092","DOI":"10.1126\/science.abq1158","article-title":"Competition-Level Code Generation With AlphaCode","volume":"378","author":"Li","year":"2022","journal-title":"Science"},{"key":"2025011617233298700_CIT0012","article-title":"DesignQA: A Multimodal Benchmark for Evaluating Large Language Models\u2019 Understanding of Engineering Documentation","author":"Doris","year":"2024"},{"key":"2025011617233298700_CIT0013","article-title":"Deep Generative Model for Mechanical System Configuration Design","author":"Etesam","year":"2024"},{"issue":"7987","key":"2025011617233298700_CIT0014","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1038\/s41586-023-06647-8","article-title":"Role Play With Large Language Models","volume":"623","author":"Shanahan","year":"2023","journal-title":"Nature"},{"key":"2025011617233298700_CIT0015","article-title":"The Effect of Context-Aware LLM-Based NPC Conversations on Player Engagement in Role-Playing Video Games","author":"Csepregi","year":"2021"},{"key":"2025011617233298700_CIT0016","first-page":"380","article-title":"CALYPSO: LLMs as Dungeon Master\u2019s Assistants","author":"Zhu","year":"2023"},{"key":"2025011617233298700_CIT0017","doi-asserted-by":"crossref","DOI":"10.18260\/p.24208","article-title":"Idea Generation Through Empathy: Reimagining the \u2018Cognitive Walkthrough","author":"Gray","year":"2015"},{"key":"2025011617233298700_CIT0018","article-title":"Teaching Students Designer Empathy in Senior Capstone Design","author":"Schmitt","year":"2016"},{"key":"2025011617233298700_CIT0019","first-page":"25","article-title":"Exploring the Role of Empathy in Engineering Communication Through a Transdisciplinary Dialogue","author":"Walther","year":"2012"},{"key":"2025011617233298700_CIT0020","first-page":"243","article-title":"Identifying Customer Needs: Disabled Persons as Lead Users","author":"Hannukainen","year":"2006"},{"key":"2025011617233298700_CIT0021","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1142\/9789814295505_0016","article-title":"Spark Innovation Through Empathic Design","volume":"75","author":"Leonard","year":"1997","journal-title":"Harv. Bus. Rev."},{"key":"2025011617233298700_CIT0022","volume-title":"Product Design: Techniques in Reverse Engineering and New Product Development","author":"Otto","year":"2003"},{"key":"2025011617233298700_CIT0023","volume-title":"Product Design and Development","author":"Ulrich","year":"2016"},{"key":"2025011617233298700_CIT0024","volume-title":"The Principles of Design","author":"Suh","year":"1990"},{"issue":"7","key":"2025011617233298700_CIT0025","doi-asserted-by":"publisher","first-page":"791","DOI":"10.1287\/mnsc.32.7.791","article-title":"Lead Users: A Source of Novel Product Concepts","volume":"32","author":"Von Hippel","year":"1986","journal-title":"Manage. Sci."},{"issue":"5","key":"2025011617233298700_CIT0026","doi-asserted-by":"publisher","first-page":"569","DOI":"10.1287\/mnsc.34.5.569","article-title":"Lead User Analyses for the Development of New Industrial Products","volume":"34","author":"Urban","year":"1988","journal-title":"Manage. Sci."},{"issue":"1","key":"2025011617233298700_CIT0027","first-page":"19","article-title":"Proposition and Verification of a Design Method to Discover Latent Needs Based on Empathy, Experiences, and Working Prototype by Designing Autonomous Childcare Vehicle","volume":"14","author":"Issa","year":"2023","journal-title":"J. Adv. Vehicle Syst."},{"issue":"12","key":"2025011617233298700_CIT0028","doi-asserted-by":"publisher","first-page":"121401","DOI":"10.1115\/1.4063161","article-title":"Document Understanding-Based Design Support: Application of Language Model for Design Knowledge Extraction","volume":"145","author":"Qiu","year":"2023","journal-title":"ASME J. Mech. Des."},{"issue":"11","key":"2025011617233298700_CIT0029","doi-asserted-by":"publisher","first-page":"111703","DOI":"10.1115\/1.4065487","article-title":"DesignFusion: Integrating Generative Models for Conceptual Design Enrichment","volume":"146","author":"Chen","year":"2024","journal-title":"ASME J. Mech. Des."},{"key":"2025011617233298700_CIT0030","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2303.10583","article-title":"Toward Artificial Empathy for Human-Centered Design: A Framework","author":"Zhu","year":"2023"},{"key":"2025011617233298700_CIT0031","doi-asserted-by":"crossref","DOI":"10.1115\/DETC2024-143961","article-title":"Reading Users\u2019 Minds From What They Say: An Investigation Into LLM-Based Empathic Mental Inference","author":"Zhu","year":"2024"},{"key":"2025011617233298700_CIT0032","article-title":"Automating Customer Needs Analysis: A Comparative Study of Large Language Models in the Travel Industry","author":"Barandoni","year":"2024"},{"issue":"2","key":"2025011617233298700_CIT0033","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1080\/19378629.2013.814136","article-title":"Empathy and Care Within Engineering: Qualitative Perspectives From Engineering Faculty and Practicing Engineers","volume":"5","author":"Strobel","year":"2013","journal-title":"Eng. Stud."},{"key":"2025011617233298700_CIT0034","first-page":"V007T06A011","article-title":"Demographic Factors and Their Influence on Designer Creativity and Empathy Evoked Through User Extreme Conditions","author":"Raviselvam","year":"2017"},{"key":"2025011617233298700_CIT0035","article-title":"An Analysis of Designer Empathy in the Early Phases of Design Projects","author":"Surma-Aho","year":"2018"},{"key":"2025011617233298700_CIT0036","doi-asserted-by":"crossref","DOI":"10.18260\/1-2--30538","article-title":"From \u2018Empathic Design\u2019 to \u2018Empathic Engineering\u2019: Toward a Genealogy of Empathy in Engineering Education","author":"Tang","year":"2018"},{"issue":"3","key":"2025011617233298700_CIT0037","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1609\/aimag.v30i3.2254","article-title":"Computer Models of Creativity","volume":"30","author":"Boden","year":"2009","journal-title":"AI Mag."},{"issue":"1","key":"2025011617233298700_CIT0038","first-page":"123","article-title":"A Model of Creativity and Innovation in Organizations","volume":"10","author":"Amabile","year":"1988","journal-title":"Res. Organ. Behav."},{"issue":"5","key":"2025011617233298700_CIT0039","doi-asserted-by":"publisher","first-page":"997","DOI":"10.1037\/0022-3514.43.5.997","article-title":"Social Psychology of Creativity: A Consensual Assessment Technique","volume":"43","author":"Amabile","year":"1982","journal-title":"J. Personal. Soc. Psychol."},{"issue":"3","key":"2025011617233298700_CIT0040","doi-asserted-by":"publisher","first-page":"031404","DOI":"10.1115\/1.4049061","article-title":"How Should We Measure Creativity in Engineering Design? A Comparison Between Social Science and Engineering Approaches","volume":"143","author":"Miller","year":"2021","journal-title":"ASME J. Mech. Des."},{"key":"2025011617233298700_CIT0041","doi-asserted-by":"crossref","DOI":"10.4324\/9780429501234","volume-title":"Creativity in Context: Update to the Social Psychology of Creativity","author":"Amabile","year":"2018"},{"key":"2025011617233298700_CIT0042","doi-asserted-by":"publisher","first-page":"103609","DOI":"10.1016\/j.cad.2023.103609","article-title":"Beyond Statistical Similarity: Rethinking Metrics for Deep Generative Models in Engineering Design","volume":"165","author":"Regenwetter","year":"2023","journal-title":"Comput. Aid. Des."},{"key":"2025011617233298700_CIT0043","doi-asserted-by":"crossref","DOI":"10.1115\/DETC2023-116838","article-title":"Conceptual Design Generation Using Large Language Models","author":"Ma","year":"2023"},{"key":"2025011617233298700_CIT0044","volume-title":"Advances in Neural Information Processing Systems","author":"Jiralerspong","year":"2024"},{"key":"2025011617233298700_CIT0045","article-title":"Innovation Slowdown: Decelerating Concept Creation and Declining Originality in New Technological Concepts","author":"Sarica","year":"2023"},{"key":"2025011617233298700_CIT0046","doi-asserted-by":"crossref","DOI":"10.1115\/DETC2023-111609","article-title":"DATED: Guidelines for Creating Synthetic Datasets for Engineering Design Applications","author":"Picard","year":"2023"},{"key":"2025011617233298700_CIT0047","first-page":"V03AT03A008","article-title":"Counterfactuals for Design: A Model-agnostic Method for Design Recommendations","author":"Regenwetter","year":"2023"},{"issue":"12","key":"2025011617233298700_CIT0048","doi-asserted-by":"publisher","first-page":"2215","DOI":"10.3390\/jmse11122215","article-title":"ShipGen: A Diffusion Model for Parametric Ship Hull Generation With Multiple Objectives and Constraints","volume":"11","author":"Bagazinski","year":"2023","journal-title":"J. Marine Sci. Eng."},{"key":"2025011617233298700_CIT0049","article-title":"On the Noise Scheduling for Generating Plausible Designs With Diffusion Models","author":"Fan","year":"2023"},{"key":"2025011617233298700_CIT0050","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1016\/0377-0427(87)90125-7","article-title":"Silhouettes: A Graphical Aid to the Interpretation and Validation of Cluster Analysis","volume":"20","author":"Rousseeuw","year":"1987","journal-title":"J. Comput. Appl. Math."},{"issue":"2","key":"2025011617233298700_CIT0051","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1556\/ComEc.10.2009.2.15","article-title":"Convex Hulls, Habitat Filtering, and Functional Diversity: Mathematical Elegance Versus Ecological Interpretability","volume":"10","author":"Podani","year":"2009","journal-title":"Commun. Ecol."},{"key":"2025011617233298700_CIT0052","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1016\/j.autcon.2015.02.011","article-title":"Combining Structural Performance and Designer Preferences in Evolutionary Design Space Exploration","volume":"52","author":"Mueller","year":"2015","journal-title":"Autom. Construct."},{"issue":"1","key":"2025011617233298700_CIT0053","first-page":"40","article-title":"Quantifying Diversity in Parametric Design: A Comparison of Possible Metrics","volume":"33","author":"Brown","year":"2019","journal-title":"AI EDAM"},{"key":"2025011617233298700_CIT0054","author":"Zanitti","year":"2022"},{"key":"2025011617233298700_CIT0055","first-page":"7","article-title":"Advanced Feature Identification Towards Research Article Recommendation: A Machine Learning Based Approach","author":"Chaudhuri","year":"2019"},{"issue":"1","key":"2025011617233298700_CIT0056","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1145\/382294.382725","article-title":"A Scenario-Based Methodology for Conducting Requirements Elicitation","volume":"15","author":"Holbrook III","year":"1990","journal-title":"ACM SIGSOFT Softw. Eng. Notes"},{"key":"2025011617233298700_CIT0057","article-title":"GPT-4 Technical Report","author":"OpenAI","year":"2024"},{"issue":"11","key":"2025011617233298700_CIT0058","first-page":"2579","article-title":"Visualizing Data Using t-SNE","volume":"9","author":"Van der Maaten","year":"2008","journal-title":"J. Mach. Learn. Res."},{"issue":"3","key":"2025011617233298700_CIT0059","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1197\/jamia.M1733","article-title":"Agreement, the f-Measure, and Reliability in Information Retrieval","volume":"12","author":"Hripcsak","year":"2005","journal-title":"J. Am. Med. Inf. Assoc."}],"container-title":["Journal of Computing and Information Science in Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/25\/2\/021012\/7423688\/jcise_25_2_021012.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/25\/2\/021012\/7423688\/jcise_25_2_021012.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,16]],"date-time":"2025-01-16T17:23:44Z","timestamp":1737048224000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article\/25\/2\/021012\/1210336\/Elicitron-A-Large-Language-Model-Agent-Based"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,16]]},"references-count":59,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,2,1]]}},"URL":"https:\/\/doi.org\/10.1115\/1.4067388","relation":{},"ISSN":["1530-9827","1944-7078"],"issn-type":[{"value":"1530-9827","type":"print"},{"value":"1944-7078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,16]]},"article-number":"021012"}}