{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T02:31:57Z","timestamp":1785465117924,"version":"3.56.0"},"reference-count":107,"publisher":"ASME International","issue":"2","license":[{"start":{"date-parts":[[2024,11,14]],"date-time":"2024-11-14T00:00:00Z","timestamp":1731542400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.asme.org\/publications-submissions\/publishing-information\/legal-policies"}],"content-domain":{"domain":["asmedigitalcollection.asme.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,2,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Material selection is a crucial step in conceptual design due to its significant impact on the functionality, aesthetics, manufacturability, and sustainability impact of the final product. This study investigates the use of large language models (LLMs) for material selection in the product design process and compares the performance of LLMs against expert choices for various design scenarios. By collecting a dataset of expert material preferences, the study provides a basis for evaluating how well LLMs can align with expert recommendations through prompt engineering and hyperparameter tuning. The divergence between LLM and expert recommendations is measured across different model configurations, prompt strategies, and temperature settings. This approach allows for a detailed analysis of factors influencing the LLMs' effectiveness in recommending materials. The results from this study highlight two failure modes: the low variance of recommendations across different design scenarios and the tendency toward overestimating material appropriateness. Parallel prompting is identified as a useful prompt-engineering method when using LLMs for material selection. The findings further suggest that, while LLMs can provide valuable assistance, their recommendations often vary significantly from those of human experts. This discrepancy underscores the need for further research into how LLMs can be better tailored to replicate expert decision-making in material selection. This work contributes to the growing body of knowledge on how LLMs can be integrated into the design process, offering insights into their current limitations and potential for future improvements.<\/jats:p>","DOI":"10.1115\/1.4066730","type":"journal-article","created":{"date-parts":[[2024,9,30]],"date-time":"2024-09-30T11:26:01Z","timestamp":1727695561000},"update-policy":"https:\/\/doi.org\/10.1115\/crossmarkpolicy-asme","source":"Crossref","is-referenced-by-count":21,"title":["Evaluating Large Language Models for Material Selection"],"prefix":"10.1115","volume":"25","author":[{"given":"Daniele","family":"Grandi","sequence":"first","affiliation":[{"name":"Autodesk Research , San Francisco, CA 94111"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yash Patawari","family":"Jain","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/05x2bcf33","id-type":"ROR","asserted-by":"publisher"}],"name":"Carnegie Mellon University , Pittsburgh, PA 15232"},{"name":"Carnegie Mellon University , Pittsburgh, PA 15232"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Allin","family":"Groom","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/01dzqde20","id-type":"ROR","asserted-by":"publisher"}],"name":"Autodesk (United Kingdom) , London WC2R 0QE ,","place":["UK"]},{"name":"Autodesk Research , London WC2R 0QE ,","place":["UK"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brandon","family":"Cramer","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/00pkt4594","id-type":"ROR","asserted-by":"publisher"}],"name":"Autodesk (United States) , Boston, MA 02210"},{"name":"Autodesk Research , Boston, MA 02210"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher","family":"McComb","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University Department of Mechanical Engineering, , Pittsburgh, PA 15232"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"33","published-online":{"date-parts":[[2024,11,14]]},"reference":[{"issue":"1","key":"2024111417485401800_CIT0001","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1016\/S0261-3069(03)00159-6","article-title":"Selection Strategies for Materials and Processes","volume":"25","author":"Ashby","year":"2004","journal-title":"Mater. Des."},{"key":"2024111417485401800_CIT0002","first-page":"772","volume-title":"Manufacturing Process and Material Selection During Conceptual Design","author":"Giachetti","year":"1997"},{"key":"2024111417485401800_CIT0003","author":"Rasheed","year":"2022"},{"key":"2024111417485401800_CIT0004","volume-title":"Materials Science and Engineering: an Introduction","author":"Callister","year":"2007"},{"issue":"5","key":"2024111417485401800_CIT0005","doi-asserted-by":"publisher","first-page":"4715","DOI":"10.1007\/s00366-022-01736-0","article-title":"Integrating Material Selection With Design Optimization via Neural Networks","volume":"38","author":"Chandrasekhar","year":"2022","journal-title":"Eng. Comput."},{"issue":"18","key":"2024111417485401800_CIT0006","doi-asserted-by":"publisher","first-page":"11191","DOI":"10.3390\/su141811191","article-title":"A New Multi-Criteria Approach for Sustainable Material Selection Problem","volume":"14","author":"Aires","year":"2022","journal-title":"Sustainability"},{"issue":"5","key":"2024111417485401800_CIT0007","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1016\/S0261-3069(02)00019-5","article-title":"Materials Selection Combined With Optimal Structural Design: Concept and Some Results","volume":"23","author":"Ermolaeva","year":"2002","journal-title":"Mater. Des."},{"key":"2024111417485401800_CIT0008","author":"Ma","year":"2023"},{"issue":"9","key":"2024111417485401800_CIT0009","doi-asserted-by":"publisher","first-page":"885","DOI":"10.1007\/s00170-011-3362-y","article-title":"A Material Selection Methodology and Expert System for Sustainable Product Design","volume":"57","author":"Zarandi","year":"2011","journal-title":"Int. J. Adv. Manuf. Technol."},{"issue":"3","key":"2024111417485401800_CIT0010","doi-asserted-by":"publisher","first-page":"031007","DOI":"10.1115\/1.4035675","article-title":"Energy-Aware Material Selection for Product With Multicomponent Under Cloud Environment","volume":"17","author":"Bi","year":"2017","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"issue":"3","key":"2024111417485401800_CIT0011","article-title":"Materials in Products Selection: Tools for Including User-Interaction in Materials Selection","volume":"1","author":"van Kesteren","year":"2007","journal-title":"Int. J. Des."},{"key":"2024111417485401800_CIT0012","author":"US EPA, O.","year":"2024"},{"issue":"9","key":"2024111417485401800_CIT0013","doi-asserted-by":"publisher","first-page":"091011","DOI":"10.1115\/1.4002130","article-title":"Checklist-Based Assessment Methodology for Sustainable Design","volume":"132","author":"Kishita","year":"2010","journal-title":"ASME J. Mech. Des."},{"issue":"2","key":"2024111417485401800_CIT0014","doi-asserted-by":"publisher","first-page":"020301","DOI":"10.1115\/1.4064362","article-title":"Joint Special Issue: Advances in Design and Manufacturing for Sustainability","volume":"146","author":"Banu","year":"2024","journal-title":"ASME J. Mech. Des."},{"issue":"9","key":"2024111417485401800_CIT0015","doi-asserted-by":"publisher","first-page":"091004","DOI":"10.1115\/1.4002308","article-title":"Integrated Sustainable Life Cycle Design: A Review","volume":"132","author":"Ramani","year":"2010","journal-title":"ASME J. Mech. Des."},{"issue":"1","key":"2024111417485401800_CIT0016","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1016\/j.matdes.2012.05.016","article-title":"A Framework for Concurrent Material and Process Selection During Conceptual Product Design Stages","volume":"41","author":"Albi\u00f1ana","year":"2012","journal-title":"Mater. Des."},{"key":"2024111417485401800_CIT0017","doi-asserted-by":"crossref","DOI":"10.2514\/4.104893","volume-title":"Aerospace Materials and Applications","author":"Bhat","year":"2018"},{"issue":"6","key":"2024111417485401800_CIT0018","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1179\/mst.1989.5.6.517","article-title":"Materials Selection in Conceptual Design","volume":"5","author":"Ashby","year":"1989","journal-title":"Mater. Sci. Technol."},{"issue":"10","key":"2024111417485401800_CIT0019","doi-asserted-by":"publisher","first-page":"102001","DOI":"10.1115\/1.4050303","article-title":"Favoring Complexity: A Mixed Methods Exploration of Factors That Influence Concept Selection When Designing for Additive Manufacturing","volume":"143","author":"Prabhu","year":"2021","journal-title":"ASME J. Mech. Des."},{"issue":"4","key":"2024111417485401800_CIT0020","doi-asserted-by":"publisher","first-page":"633","DOI":"10.1115\/1.2917054","article-title":"An Approach for Concurrent and Integrated Material Selection and Dimensional Synthesis","volume":"114","author":"Karandikar","year":"1992","journal-title":"ASME J. Mech. Des."},{"key":"2024111417485401800_CIT0021","volume-title":"Materials Selection in Mechanical Design","author":"Ashby","year":"2011","edition":"4th ed."},{"issue":"7","key":"2024111417485401800_CIT0022","doi-asserted-by":"publisher","first-page":"071003","DOI":"10.1115\/1.3125886","article-title":"Optimal Product Design Under Price Competition","volume":"131","author":"Shiau","year":"2009","journal-title":"ASME J. Mech. Des."},{"issue":"2","key":"2024111417485401800_CIT0023","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1115\/1.2826235","article-title":"On Irrationality in Engineering Design","volume":"119","author":"Hazelrigg","year":"1997","journal-title":"ASME J. Mech. Des."},{"issue":"2","key":"2024111417485401800_CIT0024","first-page":"52","article-title":"Investigation on Material Selection for the Columns of Universal Testing Machine (UTM) Using Granta's Design CES Edupack","volume":"25","author":"Ullah","year":"2020","journal-title":"Tech. J."},{"issue":"7","key":"2024111417485401800_CIT0025","doi-asserted-by":"publisher","first-page":"538","DOI":"10.1557\/mrs.2019.158","article-title":"Artificial Intelligence for Materials Discovery","volume":"44","author":"Gomes","year":"2019","journal-title":"MRS Bull."},{"issue":"7990","key":"2024111417485401800_CIT0026","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1038\/s41586-023-06735-9","article-title":"Scaling Deep Learning for Materials Discovery","volume":"624","author":"Merchant","year":"2023","journal-title":"Nature"},{"key":"2024111417485401800_CIT0027","author":"Chen","year":"2024"},{"issue":"2","key":"2024111417485401800_CIT0028","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1039\/D3DD00188A","article-title":"MaScQA: Investigating Materials Science Knowledge of Large Language Models","volume":"3","author":"Zaki","year":"2024","journal-title":"Digit. Discovery"},{"key":"2024111417485401800_CIT0029","author":"Miret","year":"2024"},{"issue":"6","key":"2024111417485401800_CIT0030","doi-asserted-by":"publisher","first-page":"266","DOI":"10.1002\/evan.21948","article-title":"Subjective Selection and the Evolution of Complex Culture","volume":"31","author":"Singh","year":"2022","journal-title":"Evol. Anthropol."},{"issue":"9","key":"2024111417485401800_CIT0031","doi-asserted-by":"publisher","first-page":"6439","DOI":"10.1007\/s12144-020-01124-1","article-title":"How You Choose Is as Important as What You Choose: Subjective Quality of Choice Predicts Well-Being and Academic Performance","volume":"41","author":"Leontiev","year":"2022","journal-title":"Curr. Psychol."},{"issue":"2","key":"2024111417485401800_CIT0032","doi-asserted-by":"publisher","first-page":"020401","DOI":"10.1063\/5.0144454","article-title":"Design, Material, Function, and Fabrication of Metamaterials","volume":"11","author":"Zadpoor","year":"2023","journal-title":"APL Mater."},{"issue":"2","key":"2024111417485401800_CIT0033","doi-asserted-by":"publisher","first-page":"179","DOI":"10.15302\/J-ENG-2015036","article-title":"Metamaterials: Reshape and Rethink","volume":"1","author":"Liu","year":"2015","journal-title":"Engineering"},{"issue":"6","key":"2024111417485401800_CIT0034","doi-asserted-by":"publisher","first-page":"305","DOI":"10.14445\/22315381\/IJETT-V19P254","article-title":"A Review of Metamaterials and Its Applications","volume":"19","author":"Govt. Polytechnic College","year":"2015","journal-title":"Int. J. Eng. Trends Technol."},{"issue":"11","key":"2024111417485401800_CIT0035","doi-asserted-by":"publisher","first-page":"111416","DOI":"10.1115\/1.4030997","article-title":"Design for Additive Manufacture of Fine Medical Instrumentation\u2014DragonFlex Case Study","volume":"137","author":"Jel\u00ednek","year":"2015","journal-title":"ASME J. Mech. Des."},{"issue":"10","key":"2024111417485401800_CIT0036","doi-asserted-by":"publisher","first-page":"100906","DOI":"10.1115\/1.4037305","article-title":"A Survey of Modeling of Lattice Structures Fabricated by Additive Manufacturing","volume":"139","author":"Dong","year":"2017","journal-title":"ASME J. Mech. Des."},{"issue":"1","key":"2024111417485401800_CIT0037","doi-asserted-by":"publisher","first-page":"2877","DOI":"10.21437\/Interspeech.2011-720","article-title":"Recurrent Neural Network Based Language Modeling in Meeting Recognition","volume":"11","author":"Kombrink","year":"2011","journal-title":"Interspeech"},{"issue":"2","key":"2024111417485401800_CIT0038","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1145\/1034780.1034781","article-title":"Introduction to the Special Issue on Statistical Language Modeling","volume":"3","author":"Gao","year":"2004","journal-title":"ACM Trans. Asian Lang. Inf. Proc."},{"key":"2024111417485401800_CIT0039","author":"Devlin","year":"2019"},{"issue":"1","key":"2024111417485401800_CIT0040","doi-asserted-by":"publisher","first-page":"102274","DOI":"10.1016\/j.lindif.2023.102274","article-title":"ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education","volume":"103","author":"Kasneci","year":"2023","journal-title":"Learn. Individ. Differ."},{"key":"2024111417485401800_CIT0041","author":"Chen","year":"2021"},{"key":"2024111417485401800_CIT0042","author":"Zhao","year":"2023"},{"key":"2024111417485401800_CIT0043"},{"key":"2024111417485401800_CIT0044","author":"OpenAI","year":"2024"},{"issue":"1","key":"2024111417485401800_CIT0045","article-title":"Attention Is All You Need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"2024111417485401800_CIT0046","doi-asserted-by":"publisher","author":"Brown","year":"2020","DOI":"10.48550\/arXiv.2005.14165"},{"key":"2024111417485401800_CIT0047","author":"White","year":"2023"},{"key":"2024111417485401800_CIT0048","author":"Zhou","year":"2023"},{"key":"2024111417485401800_CIT0049","author":"Clavi\u00e9","year":"2023"},{"key":"2024111417485401800_CIT0050","doi-asserted-by":"publisher","first-page":"100817","DOI":"10.1016\/j.iheduc.2021.100817","article-title":"Online Question and Answer Sessions: How Students Support Their Own and Other Students' Processes of Inquiry in a Text-Based Learning Environment","volume":"51","author":"Jansson","year":"2021","journal-title":"Internet Higher Educ."},{"key":"2024111417485401800_CIT0051","author":"Chang","year":"2023"},{"key":"2024111417485401800_CIT0052","first-page":"248","article-title":"ImageNet: A Large-Scale Hierarchical Image Database","author":"Deng","year":"2009"},{"key":"2024111417485401800_CIT0053","author":"Lin","year":"2015"},{"key":"2024111417485401800_CIT0054","author":"Wang","year":"2019"},{"key":"2024111417485401800_CIT0055","author":"Wang","year":"2020"},{"key":"2024111417485401800_CIT0056","author":"Lin","year":"2023"},{"key":"2024111417485401800_CIT0057","author":"Wang","year":"2023"},{"key":"2024111417485401800_CIT0058","author":"Jain","year":"2023"},{"key":"2024111417485401800_CIT0059","author":"Hendrycks","year":"2021"},{"key":"2024111417485401800_CIT0060","author":"Liang","year":"2023"},{"key":"2024111417485401800_CIT0061","doi-asserted-by":"publisher","author":"Huang","year":"2023","DOI":"10.48550\/arXiv.2305.08322"},{"key":"2024111417485401800_CIT0062","doi-asserted-by":"publisher","author":"Zhong","year":"2023","DOI":"10.48550\/arXiv.2304.06364"},{"key":"2024111417485401800_CIT0063","doi-asserted-by":"publisher","author":"Dubois","year":"2024","DOI":"10.48550\/arXiv.2305.14387"},{"key":"2024111417485401800_CIT0064","author":"Chiang","year":"2024"},{"key":"2024111417485401800_CIT0065","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/D17-1238","article-title":"Why We Need New Evaluation Metrics for NLG","author":"Novikova","year":"2017"},{"key":"2024111417485401800_CIT0066","author":"Bubeck","year":"2023"},{"key":"2024111417485401800_CIT0067","author":"Bang","year":"2023"},{"key":"2024111417485401800_CIT0068","author":"Ziems","year":"2024"},{"issue":"4","key":"2024111417485401800_CIT0069","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1037\/1082-989X.2.4.329","article-title":"Validity Problems Comparing Values Across Cultures and Possible Solutions","volume":"2","author":"Peng","year":"1997","journal-title":"Psychol. Meth."},{"key":"2024111417485401800_CIT0070","doi-asserted-by":"publisher","author":"Tjuatja","year":"2024","DOI":"10.48550\/arXiv.2311.04076"},{"key":"2024111417485401800_CIT0071","author":"Hopkins","year":"2023"},{"issue":"2","key":"2024111417485401800_CIT0072","doi-asserted-by":"publisher","first-page":"021001","DOI":"10.1115\/1.4054507","article-title":"Material Selection and Corrosion Studies of Candidate Bearing Materials for Use in Molten Chloride Salts","volume":"145","author":"Keiser","year":"2023","journal-title":"ASME J. Sol. Energy Eng."},{"issue":"12","key":"2024111417485401800_CIT0073","doi-asserted-by":"publisher","first-page":"121006","DOI":"10.1115\/1.4054937","article-title":"Numerical Study of Material Selection for Optimal Directed Energy Deposition Single Nozzle Powder Efficiency","volume":"144","author":"Odum","year":"2022","journal-title":"ASME J. Manuf. Sci. Eng."},{"key":"2024111417485401800_CIT0074","first-page":"31","article-title":"MultiMaterial Selection: Material Selection for Sandwich Beams","author":"Sirisalee","year":"2004"},{"key":"2024111417485401800_CIT0075","first-page":"51","article-title":"Materials Selection for Product Design Using Artificial Neural Network Technique","volume":"1","author":"Somkuwar","year":"2010","journal-title":"J. Eng. Sci. Manage. Educ."},{"key":"2024111417485401800_CIT0076","doi-asserted-by":"crossref","DOI":"10.1115\/DETC2014-34280","article-title":"A Robust Surrogate Modeling Approach for Material Selection in Sustainable Design of Products","author":"Eddy","year":"2014"},{"issue":"1","key":"2024111417485401800_CIT0077","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/j.matdes.2005.06.023","article-title":"A Novel Method for Materials Selection in Mechanical Design: Combination of Non-Linear Normalization and a Modified Digital Logic Method","volume":"28","author":"Dehghan-Manshadi","year":"2007","journal-title":"Mater. Des."},{"issue":"2","key":"2024111417485401800_CIT0078","doi-asserted-by":"publisher","first-page":"1","DOI":"10.14445\/23948884\/IJMSE-V7I2P101","article-title":"Application of Neural Network for Material Selection: A Review","volume":"7","author":"Mamoon","year":"2021","journal-title":"Int. J. Mater. Sci. Eng."},{"issue":"4","key":"2024111417485401800_CIT0079","doi-asserted-by":"publisher","first-page":"1209","DOI":"10.1016\/j.matdes.2008.06.006","article-title":"Multi-Objective Optimization of Material Selection for Sustainable Products: Artificial Neural Networks and Genetic Algorithm Approach","volume":"30","author":"Zhou","year":"2009","journal-title":"Mater. Des."},{"key":"2024111417485401800_CIT0080","doi-asserted-by":"crossref","DOI":"10.1115\/DETC2022-88049","article-title":"Material Prediction for Design Automation Using Graph Representation Learning","author":"Bian","year":"2022"},{"issue":"1","key":"2024111417485401800_CIT0081","doi-asserted-by":"publisher","first-page":"011007","DOI":"10.1115\/1.4063226","article-title":"HG-CAD: Hierarchical Graph Learning for Material Prediction and Recommendation in Computer-Aided Design","volume":"24","author":"Bian","year":"2024","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"issue":"159","key":"2024111417485401800_CIT0082","doi-asserted-by":"publisher","first-page":"1877","DOI":"10.48550\/arXiv.2005.14165","article-title":"Language Models Are Few-Shot Learners","volume":"33","author":"Brown","year":"2020","journal-title":"Adv. Neural Inf. Proc. Syst."},{"key":"2024111417485401800_CIT0083","author":"Wei","year":"2022"},{"key":"2024111417485401800_CIT0084","author":"Touvron","year":"2023"},{"key":"2024111417485401800_CIT0085","author":"Driess","year":"2023"},{"issue":"4","key":"2024111417485401800_CIT0086","doi-asserted-by":"publisher","first-page":"041003","DOI":"10.1115\/1.4056220","article-title":"Generative Transformers for Design Concept Generation","volume":"23","author":"Zhu","year":"2023","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"issue":"6","key":"2024111417485401800_CIT0087","doi-asserted-by":"publisher","first-page":"060902","DOI":"10.1115\/1.4054802","article-title":"Patent Data for Engineering Design: A Critical Review and Future Directions","volume":"22","author":"Jiang","year":"2022","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"key":"2024111417485401800_CIT0088","author":"Picard","year":"2023"},{"issue":"9","key":"2024111417485401800_CIT0089","doi-asserted-by":"publisher","first-page":"091705","DOI":"10.1115\/1.4064811","article-title":"Untrained and Unmatched: Fast and Accurate Zero-Training Classification for Tabular Engineering Data","volume":"146","author":"Picard","year":"2024","journal-title":"ASME J. Mech. Des."},{"issue":"1","key":"2024111417485401800_CIT0090","doi-asserted-by":"publisher","first-page":"011002","DOI":"10.1115\/1.4062454","article-title":"What's in a Name? Evaluating Assembly-Part Semantic Knowledge in Language Models Through User-Provided Names in Computer Aided Design Files","volume":"24","author":"Meltzer","year":"2024","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"issue":"1","key":"2024111417485401800_CIT0091","doi-asserted-by":"publisher","first-page":"010801","DOI":"10.1115\/1.4063954","article-title":"Multi-Modal Machine Learning in Engineering Design: A Review and Future Directions","volume":"24","author":"Song","year":"2024","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"key":"2024111417485401800_CIT0092","author":"Saka","year":"2023"},{"key":"2024111417485401800_CIT0093","author":"Makatura","year":"2023"},{"key":"2024111417485401800_CIT0094","author":"Buehler","year":"2023"},{"key":"2024111417485401800_CIT0095","author":"OpenAI","year":"2023"},{"key":"2024111417485401800_CIT0096","author":"Shaham","year":"2023"},{"key":"2024111417485401800_CIT0097","author":"Chiang","year":"2024"},{"key":"2024111417485401800_CIT0098","author":"Jiang","year":"2024"},{"issue":"2","key":"2024111417485401800_CIT0099","doi-asserted-by":"publisher","first-page":"021001","DOI":"10.1115\/1.4063843","article-title":"MechGPT, a Language-Based Strategy for Mechanics and Materials Modeling That Connects Knowledge Across Scales, Disciplines, and Modalities","volume":"76","author":"Buehler","year":"2024","journal-title":"ASME Appl. Mech. Rev."},{"key":"2024111417485401800_CIT0100","author":"Lee","year":"2023"},{"key":"2024111417485401800_CIT0101","author":"Kojima","year":"2023"},{"issue":"1008","key":"2024111417485401800_CIT0102","doi-asserted-by":"publisher","first-page":"24824","DOI":"10.48550\/arXiv.2201.11903","article-title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","volume":"35","author":"Wei","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"issue":"1","key":"2024111417485401800_CIT0103","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2305.10601","article-title":"Tree of Thoughts: Deliberate Problem Solving With Large Language Models","volume":"36","author":"Yao","year":"2024","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"2024111417485401800_CIT0104","author":"Shinn","year":"2023"},{"key":"2024111417485401800_CIT0105","author":"White","year":"2023"},{"key":"2024111417485401800_CIT0106","author":"Renze","year":"2024"},{"key":"2024111417485401800_CIT0107","doi-asserted-by":"crossref","DOI":"10.1115\/DETC2023-116838","article-title":"Conceptual Design Generation Using Large Language Models","author":"Ma","year":"2023"}],"container-title":["Journal of Computing and Information Science in Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/25\/2\/021004\/7404714\/jcise_25_2_021004.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/25\/2\/021004\/7404714\/jcise_25_2_021004.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,14]],"date-time":"2024-11-14T12:49:04Z","timestamp":1731588544000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article\/25\/2\/021004\/1206935\/Evaluating-Large-Language-Models-for-Material"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,14]]},"references-count":107,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,2,1]]}},"URL":"https:\/\/doi.org\/10.1115\/1.4066730","relation":{},"ISSN":["1530-9827","1944-7078"],"issn-type":[{"value":"1530-9827","type":"print"},{"value":"1944-7078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,14]]},"article-number":"021004"}}