{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,23]],"date-time":"2026-06-23T21:16:26Z","timestamp":1782249386701,"version":"3.54.5"},"reference-count":53,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T00:00:00Z","timestamp":1727308800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>This research investigates the possible influence of students\u2019 perceptions of emerging AI technologies on university courses, focusing on their knowledge and perceived usefulness within engineering design. An evaluation tool implemented in a Microsoft Excel workbook was developed and tested to perform the process of data collection through well-known questionnaires, data analysis, and the generation of results, facilitating attention to class compositions and measuring AI awareness and perceived usefulness. The study considers traditional aspects such as roles within design teams and the psychological factors that may influence these roles, alongside contemporary topics like Large Language Models (LLMs). Questionnaires based on well-established theories were administered during courses on product innovation and representation, assessing both primary and secondary design roles. Primary roles focus on technical skills and knowledge, while secondary roles emphasize problem-solving approaches. The Big Five questionnaire was used to characterize students\u2019 psychological profiles based on the main personality traits. Students\u2019 perceptions of AI involvement and usefulness in engineering design were evaluated using questionnaires derived from the consolidated literature as well. Data were collected via Google forms from both in-class and off-line students. The first results of the workbook adoption highlight some relationships between personality traits, perceived roles in design teams, and AI knowledge and usefulness. These findings aim to help educators enhance course effectiveness and align courses with current AI advancements. The workbook is available to the readers to collect data and perform analyses in different countries, education disciplines, and as time goes by, in order to add the longitudinal point of view to the research.<\/jats:p>","DOI":"10.3390\/mti8100084","type":"journal-article","created":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T11:38:34Z","timestamp":1727350714000},"page":"84","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Development of a Tool for Evaluating the Influence of Engineering Students\u2019 Perception of Generative AI on University Courses Based on Personality, Perceived Roles in Design Teams, and Course Engagement"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6281-8690","authenticated-orcid":false,"given":"Stefano","family":"Filippi","sequence":"first","affiliation":[{"name":"DPIA Department, University of Udine, 33100 Udine, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Barbara","family":"Motyl","sequence":"additional","affiliation":[{"name":"DPIA Department, University of Udine, 33100 Udine, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.indmarman.2018.07.005","article-title":"The Drivers of Success in New-Product Development","volume":"76","author":"Cooper","year":"2019","journal-title":"Ind. Mark. Manag."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1111\/jpim.12523","article-title":"Innovation and Design in the Age of Artificial Intelligence","volume":"37","author":"Verganti","year":"2020","journal-title":"J. Prod. Innov. Manag."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Grech, A., Mehnen, J., and Wodehouse, A. (2023). An Extended AI-Experience: Industry 5.0 in Creative Product Innovation. Sensors, 23.","DOI":"10.3390\/s23063009"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1080\/09544820310001641245","article-title":"The Use and Perception of Methods and Product Representations in Product Development: A Survey of Swedish Industry","volume":"15","author":"Engelbrektsson","year":"2004","journal-title":"J. Eng. Des."},{"key":"ref_5","first-page":"64","article-title":"A Taxonomic Classification of Visual Design Representations Used by Industrial Designers and Engineering Designers","volume":"14","author":"Pei","year":"2011","journal-title":"Des. J."},{"key":"ref_6","first-page":"159","article-title":"Prototyping in Smart Product Design: Investigating Prototyping Tools to Support Communication in the Early Stage Smart Product Development","volume":"11","author":"Wang","year":"2023","journal-title":"Int. J. Des. Creat. Innov."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1111\/j.1540-5885.2012.00887.x","article-title":"Antecedents and Consequences of Creativity in Product Innovation Teams","volume":"30","author":"Im","year":"2013","journal-title":"J. Prod. Innov. Manag."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"121598","DOI":"10.1016\/j.techfore.2022.121598","article-title":"How AI revolutionizes innovation management\u2014Perceptions and implementation preferences of AI-based innovators","volume":"178","author":"Hutter","year":"2022","journal-title":"Technol. Forecast. Soc. Chang."},{"key":"ref_9","first-page":"85","article-title":"Toward AI assistants that let designers design","volume":"44","author":"Oulasvirta","year":"2023","journal-title":"AI Mag."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"258","DOI":"10.30574\/wjaets.2023.8.1.0045","article-title":"Artificial Intelligence AI-Based Chatbot Study of ChatGPT, Google AI Bard and Baidu AI","volume":"8","author":"Ram","year":"2023","journal-title":"World J. Adv. Eng. Technol. Sci."},{"key":"ref_11","first-page":"113","article-title":"Relationships among Personality Traits, ChatGPT Usage and Concept Generation in Innovation Design","volume":"Volume 113","author":"Karwowski","year":"2023","journal-title":"Artificial Intelligence, Social Computing and Wearable Technologies, Proceedings of the AHFE (2023) International Conference, San Francisco, CA, USA, 20\u201324 July 2023"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"941","DOI":"10.2224\/sbp.2009.37.7.941","article-title":"Do Big Five Personality Factors Affect Individual Creativity? The Moderating Role of Extrinsic Motivation","volume":"37","author":"Sung","year":"2009","journal-title":"Soc. Behav. Pers."},{"key":"ref_13","unstructured":"Ullman, D.G. (2016). The Mechanical Design Process, McGraw-Hill Higher Education. [5th ed.]."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Filippi, S., and Motyl, B. (2024). Large Language Models (LLMs) in Engineering Education: A Systematic Review and Suggestions for Practical Adoption. Information, 15.","DOI":"10.3390\/info15060345"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Filippi, S. (2020). PERSEL, a Ready-to-Use PERsonality-Based User SELection Tool to Maximize User Experience Redesign Effectiveness. Multimodal Technol. Interact., 4.","DOI":"10.3390\/mti4020013"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.sbspro.2012.01.029","article-title":"A Computational Model of Personality","volume":"32","author":"Karimi","year":"2012","journal-title":"Procedia Soc. Behav. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1216","DOI":"10.1037\/0022-3514.59.6.1216","article-title":"An alternative \u201cdescription of personality\u201d: The Big-Five factor structure","volume":"59","author":"Goldberg","year":"1990","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1037\/0022-3514.52.1.81","article-title":"Validation of the five-factor model of personality across instruments and observers","volume":"52","author":"McCrae","year":"1987","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"68","DOI":"10.4102\/sajip.v29i1.88","article-title":"The big five personality dimensions and job performance","volume":"29","author":"Rothmann","year":"2003","journal-title":"SA J. Ind. Psychol."},{"key":"ref_20","first-page":"155","article-title":"The Use of Personality Measures in Personnel Selection: What Does Current Research Support?","volume":"16","author":"Rothstein","year":"2006","journal-title":"Hum. Resour. Manag. Rev."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/S0923-4748(97)00010-6","article-title":"The Big Five Personality Factors and Team Performance: Implications for Selecting Successful Product Design Teams","volume":"14","author":"Kichuk","year":"1997","journal-title":"J. Eng. Technol. Manag."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1186\/s41239-021-00252-3","article-title":"The Effects of Gender, Educational Level, and Personality on Online Learning Outcomes during the COVID-19 Pandemic","volume":"18","author":"Yu","year":"2021","journal-title":"Int. J. Educ. Technol. High. Educ."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1016\/j.paid.2011.04.019","article-title":"The Big Five Personality Traits, Learning Styles, and Academic Achievement","volume":"51","author":"Komarraju","year":"2011","journal-title":"Personal. Individ. Differ."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Av\u015far, A.Z., Valencia-Romero, A., and Grogan, P.T. (2019, January 18). The Effects of Locus of Control and Big Five Personality Traits on Collaborative Engineering Design Tasks with Negotiation. Proceedings of the Volume 7: 31st International Conference on Design Theory and Methodology, Anaheim, CA, USA.","DOI":"10.1115\/DETC2019-97311"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1108\/HESWBL-11-2019-0153","article-title":"Personality Traits, Teamwork Competencies and Academic Performance among First-Year Engineering Students","volume":"11","author":"Tang","year":"2021","journal-title":"High. Educ. Ski. Work. Based Learn."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"35","DOI":"10.5296\/rbm.v6i2.15147","article-title":"Impact of Big Five Personality Traits on Entrepreneurial Intention of Engineering Undergraduates","volume":"6","author":"Udayanganie","year":"2019","journal-title":"Res. Bus. Manag."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Stetter, R., and Ullman, D.G. (1996, January 18). Team-Roles in Mechanical Design. Proceedings of the Volume 4: 8th International Conference on Design Theory and Methodology, Irvine, CA, USA.","DOI":"10.1115\/96-DETC\/DTM-1508"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"100172","DOI":"10.1016\/j.caeai.2023.100172","article-title":"Students\u2019 Use of Large Language Models in Engineering Education: A Case Study on Technology Acceptance, Perceptions, Efficacy, and Detection Chances","volume":"5","author":"Bernabei","year":"2023","journal-title":"Comput. Educ. Artif. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"S\u00e1nchez-Ruiz, L.M., Moll-L\u00f3pez, S., Nu\u00f1ez-P\u00e9rez, A., Mora\u00f1o-Fern\u00e1ndez, J.A., and Vega-Fleitas, E. (2023). ChatGPT Challenges Blended Learning Methodologies in Engineering Education: A Case Study in Mathematics. Appl. Sci., 13.","DOI":"10.3390\/app13106039"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"100180","DOI":"10.1016\/j.caeai.2023.100180","article-title":"Analyzing the Students\u2019 Views, Concerns, and Perceived Ethics about Chat GPT Usage","volume":"5","author":"Farhi","year":"2023","journal-title":"Comput. Educ. Artif. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"57","DOI":"10.58693\/ier.114","article-title":"Student Attitudes towards Chat GPT: A Technology Acceptance Model Survey","volume":"1","author":"Yilmaz","year":"2023","journal-title":"Int. Educ. Rev."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1007\/s40979-024-00149-4","article-title":"Student Perspectives on the Use of Generative Artificial Intelligence Technologies in Higher Education","volume":"20","author":"Johnston","year":"2024","journal-title":"Int. J. Educ. Integr."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1207\/s15327752jpa8403_05","article-title":"The NEO\u2013PI\u20133: A More Readable Revised NEO Personality Inventory","volume":"84","author":"McCrae","year":"2005","journal-title":"J. Personal. Assess."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1016\/j.jrp.2005.08.007","article-title":"The International Personality Item Pool and the Future of Public-Domain Personality Measures","volume":"40","author":"Goldberg","year":"2006","journal-title":"J. Res. Personal."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1016\/j.jrp.2008.10.002","article-title":"Ten Facet Scales for the Big Five Inventory: Convergence with NEO PI-R Facets, Self-Peer Agreement, and Discriminant Validity","volume":"43","author":"Soto","year":"2009","journal-title":"J. Res. Personal."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Shaer, O., Cooper, A., Mokryn, O., Kun, A.L., and Ben Shoshan, H. (2024, January 11\u201316). AI-Augmented Brainwriting: Investigating the use of LLMs in group ideation. Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201924), Honolulu, HI, USA. Article 1050.","DOI":"10.1145\/3613904.3642414"},{"key":"ref_37","unstructured":"Gray, C., Ciliotta Chehade, E., Hekkert, P., Forlano, L., Ciuccarelli, P., and Lloyd, P. (2024). A LLM-Augmented Morphological Analysis Approach for Conceptual Design, DRS2024."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1825","DOI":"10.1017\/pds.2022.185","article-title":"Generative Pre-Trained Transformer for Design Concept Generation: An Exploration","volume":"2","author":"Zhu","year":"2022","journal-title":"Proc. Des. Soc."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Savin, P.S., Rusu, G., Prelipcean, M., and Barbu, L.N. (2024, January 21\u201323). Cognitive Shifts: Exploring the Impact of AI on Generation Z and Millennials. Proceedings of the International Conference on Business Excellence, Bucharest, Romania.","DOI":"10.2478\/picbe-2024-0019"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1186\/s40561-023-00269-3","article-title":"The AI Generation Gap: Are Gen Z Students More Interested in Adopting Generative AI Such as ChatGPT in Teaching and Learning than Their Gen X and Millennial Generation Teachers?","volume":"10","author":"Chan","year":"2023","journal-title":"Smart Learn. Environ."},{"key":"ref_41","first-page":"2","article-title":"Using Microsoft Excel to code and thematically analyse qualitative data: A simple, cost-effective approach","volume":"8","author":"Bree","year":"2016","journal-title":"All Irel. J. High. Educ."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Rahal, R.M., Mercer, J., Kuziemsky, C., and Yaya, S. (2021). Factors Affecting the Mature Use of Electronic Medical Records by Primary Care Physicians: A Systematic Review. BMC Med. Inform. Decis. Mak., 21.","DOI":"10.1186\/s12911-021-01434-9"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1108\/TQM-06-2021-0180","article-title":"Conceptualizing Industry 4.0 Readiness Model Dimensions: An Exploratory Sequential Mixed-Method Study","volume":"35","author":"Antony","year":"2023","journal-title":"TQM J."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1177\/21676968211025128","article-title":"A Qualitative Study of COVID-19 Distress in University Students","volume":"9","author":"Farris","year":"2021","journal-title":"Emerg. Adulthood"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"5187","DOI":"10.1002\/bse.3412","article-title":"An Exploratory Study of Green-lean-six Sigma Motivators for Environmental Sustainability: Managerial Insights from a Developed and Developing Economy","volume":"32","author":"Farrukh","year":"2023","journal-title":"Bus. Strategy Environ."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1016\/j.jad.2020.10.005","article-title":"Mobile Phone Addiction and Psychological Distress among Chinese Adolescents: The Mediating Role of Rumination and Moderating Role of the Capacity to Be Alone","volume":"279","author":"Lian","year":"2021","journal-title":"J. Affect. Disord."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Rossi, C., and Rivetti, F. (2020). Assessing Young Consumers\u2019 Responses to Sustainable Labels: Insights from a Factorial Experiment in Italy. Sustainability, 12.","DOI":"10.3390\/su122310115"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.genhosppsych.2014.09.009","article-title":"A Diagnostic Meta-Analysis of the Patient Health Questionnaire-9 (PHQ-9) Algorithm Scoring Method as a Screen for Depression","volume":"37","author":"Manea","year":"2015","journal-title":"Gen. Hosp. Psychiatry"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1092","DOI":"10.1001\/archinte.166.10.1092","article-title":"A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7","volume":"166","author":"Spitzer","year":"2006","journal-title":"Arch. Intern. Med."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Abdaljaleel, M., Barakat, M., Alsanafi, M., Salim, N.A., Abazid, H., Malaeb, D., Mohammed, A.H., Hassan, B.A., Wayyes, A.M., and Farhan, S.S. (2024). A multinational study on the factors influencing university students\u2019 attitudes and usage of ChatGPT. Sci. Rep., 14.","DOI":"10.1038\/s41598-024-52549-8"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Yang, X., and Tong, W. (2024). University Students\u2019 Attitudes Toward ChatGPT Profiles and Their Relation to ChatGPT Intentions. Int. J. Hum. Comput. Interact., 1\u201314.","DOI":"10.1080\/10447318.2024.2331882"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Bahroun, Z., Anane, C., Ahmed, V., and Zacca, A. (2023). Transforming Education: A Comprehensive Review of Generative Artificial Intelligence in Educational Settings through Bibliometric and Content Analysis. Sustainability, 15.","DOI":"10.3390\/su151712983"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1111\/bjet.13370","article-title":"Practical and ethical challenges of large language models in education: A systematic scoping review","volume":"55","author":"Yan","year":"2024","journal-title":"Br. J. Educ. Technol."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/8\/10\/84\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:04:04Z","timestamp":1760112244000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/8\/10\/84"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,26]]},"references-count":53,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2024,10]]}},"alternative-id":["mti8100084"],"URL":"https:\/\/doi.org\/10.3390\/mti8100084","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,26]]}}}