{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T16:15:49Z","timestamp":1774887349745,"version":"3.50.1"},"reference-count":54,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T00:00:00Z","timestamp":1774828800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"FAP Uninove"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>The use of Large Language Models (LLMs) in organizational contexts has grown rapidly, particularly in project management activities. Despite this expansion, a relevant methodological gap can be observed in the literature: the absence of psychometrically validated instruments capable of measuring the acceptability of these technologies prior to their effective adoption, especially in project-oriented governance contexts. Traditional technology adoption models predominantly focus on a posteriori assessment of individual use, providing limited support for prospective analyses that inform strategic decision-making and organizational coordination mechanisms. In response to this gap, this study aims to develop and validate a psychometric scale to indirectly measure the acceptability, through outcome beliefs and with behavioral predispositions serving as structural proxies of the latent construct of LLM use by project management teams, with a focus on a priori judgments that precede the effective adoption of the technology. The initial scale, composed of 17 items, underwent content validation and was administered to a sample of 154 project management professionals. The latent structure was examined through Exploratory and Confirmatory Factor Analyses, resulting in the refinement of the instrument to 13 items distributed across two correlated factors. The results indicate that LLM acceptability is adequately represented by a bidimensional structure comprising the dimensions Intention\/Predisposition and Trust\/Perceived Benefit, both demonstrating high internal consistency and good statistical fit, and nomological validity evidenced by significant associations with respondents\u2019 self-reported LLM usage frequency. These findings reinforce the conceptualization of acceptability as a prospective and multidimensional construct, relevant for supporting governance decisions and the adoption of artificial intelligence-based technologies in project-oriented organizational systems. The indirect measurement approach adopted here is theoretically grounded in the premise that a priori acceptability is not directly observable but is constituted by cognitive and dispositional beliefs formed prior to use.<\/jats:p>","DOI":"10.3390\/systems14040366","type":"journal-article","created":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T15:20:47Z","timestamp":1774884047000},"page":"366","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Acceptability Scale for the Use of Large Language Models (LLMs) by Project Teams: Development and Preliminary Validation"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-5126-0053","authenticated-orcid":false,"given":"Murilo Zanini de","family":"Carvalho","sequence":"first","affiliation":[{"name":"Programa de P\u00f3s Gradua\u00e7\u00e3o em Gest\u00e3o de Projetos, Universidade Nove de Julho, Sao Paulo 01156-050, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Renato","family":"Penha","sequence":"additional","affiliation":[{"name":"Programa de P\u00f3s Gradua\u00e7\u00e3o em Gest\u00e3o de Projetos, Universidade Nove de Julho, Sao Paulo 01156-050, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3059-1967","authenticated-orcid":false,"given":"Leonardo","family":"Vils","sequence":"additional","affiliation":[{"name":"Programa de P\u00f3s Gradua\u00e7\u00e3o em Gest\u00e3o de Projetos, Universidade Nove de Julho, Sao Paulo 01156-050, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fl\u00e1vio Santino","family":"Bizarrias","sequence":"additional","affiliation":[{"name":"ESPM\u2014Escola Superior de Propaganda e Marketing, Sao Paulo 04018-010, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fernando Antonio Ribeiro","family":"Serra","sequence":"additional","affiliation":[{"name":"Programa de P\u00f3s Gradua\u00e7\u00e3o em Gest\u00e3o de Projetos, Universidade Nove de Julho, Sao Paulo 01156-050, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,30]]},"reference":[{"key":"ref_1","first-page":"49","article-title":"IT projects success factors: A literature review","volume":"8","author":"Iriarte","year":"2020","journal-title":"Int. J. Inf. Syst. Proj. Manag."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1177\/8756972820973082","article-title":"Agile, traditional, and hybrid approaches to project success: Is hybrid a poor second choice?","volume":"52","author":"Gemino","year":"2021","journal-title":"Proj. Manag. J."},{"key":"ref_3","first-page":"5","article-title":"Definitions, characteristics and measures of IT project complexity: A systematic literature review","volume":"8","author":"Morcov","year":"2021","journal-title":"Int. J. Inf. Syst. Proj. Manag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"100327","DOI":"10.1016\/j.jik.2023.100327","article-title":"Impact of absorptive capacity on project success through mediating role of strategic agility: Project complexity as a moderator","volume":"8","author":"Mata","year":"2023","journal-title":"J. Innov. Knowl."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Cruz, R.N., and Ros\u00e1rio, A.T. (2025). Data-driven decision-making in marketing: A systematic literature review of emerging themes and research gaps. Systems, 13.","DOI":"10.3390\/systems13121114"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3445","DOI":"10.1007\/s13132-021-00854-2","article-title":"The futures of Europe: Society 5.0 and Industry 5.0 as driving forces of future universities","volume":"13","author":"Carayannis","year":"2022","journal-title":"J. Knowl. Econ."},{"key":"ref_7","unstructured":"Hofmann, P., J\u00f6hnk, J., Protschky, D., and Urbach, N. (2020, January 9\u201311). Developing purposeful AI use cases: A structured method and its application in project management. Proceedings of the 15th International Conference on Wirtschaftsinformatik (WI), Potsdam, Germany. Available online: https:\/\/www.researchgate.net\/publication\/337482021_Developing_Purposeful_AI_Use_Cases_-_A_Structured_Method_and_Its_Application_in_Project_Management."},{"key":"ref_8","unstructured":"Abbas, Q., Younus, W., Malik, S., and Hassan, M.H. (2023). ChatGPT: The next frontier in software project management. Int. Eur. Ext. Enablement Sci. Eng. Manag., 11, Available online: https:\/\/www.ieeesem.com\/journal_volume11_issue9_September_2023_edition.html."},{"key":"ref_9","first-page":"146","article-title":"AI-assisted project management: Enhancing decision-making and forecasting","volume":"3","author":"Dukhiram","year":"2023","journal-title":"J. Artif. Intell. Res."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Khalil, M., Bravo, A., Vieira, D., and Carvalho, M.M. (2025). Mapping the AI landscape in project management context: A systematic literature review. Systems, 13.","DOI":"10.3390\/systems13100913"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Rane, N. (2023). Role of ChatGPT and similar generative artificial intelligence (AI) in construction industry. SSRN Electron. J.","DOI":"10.2139\/ssrn.4598258"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"319","DOI":"10.2307\/249008","article-title":"Perceived usefulness, perceived ease of use, and user acceptance of information technology","volume":"13","author":"Davis","year":"1989","journal-title":"MIS Q."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"157","DOI":"10.2307\/41410412","article-title":"Consumer acceptance and use of information technology: Extending the unified theory of acceptance and use of technology","volume":"36","author":"Venkatesh","year":"2012","journal-title":"MIS Q."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1057\/palgrave.jit.2000056","article-title":"A review of the predictors, linkages, and biases in IT innovation adoption research","volume":"21","author":"Jeyaraj","year":"2006","journal-title":"J. Inf. Technol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1287\/isre.12.2.121.9700","article-title":"Desperately seeking the \u201cIT\u201d in IT research: A call to theorizing the IT artifact","volume":"12","author":"Orlikowski","year":"2001","journal-title":"Inf. Syst. Res."},{"key":"ref_16","first-page":"124","article-title":"Acceptability of new technologies: Ergonomic and cognitive aspects","volume":"25","author":"Barcenilla","year":"2009","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_17","first-page":"204","article-title":"Acceptability and acceptance of new technologies: A conceptual distinction and future research agenda","volume":"133","author":"Alexandre","year":"2018","journal-title":"Technol. Forecast. Soc. Change"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"100101","DOI":"10.1016\/j.plas.2023.100101","article-title":"Who is better in project planning? Generative artificial intelligence or project managers?","volume":"4","author":"Barcaui","year":"2023","journal-title":"Proj. Leadersh. Soc."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"100545","DOI":"10.1016\/j.jik.2024.100545","article-title":"Artificial intelligence and project management: An empirical investigation on the appropriation of generative chatbots by project managers","volume":"9","author":"Felicetti","year":"2024","journal-title":"J. Innov. Knowl."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1007\/s11301-020-00181-x","article-title":"Understanding the interplay of artificial intelligence and strategic management: Four decades of research in review","volume":"71","author":"Keding","year":"2021","journal-title":"Manag. Rev. Q."},{"key":"ref_21","first-page":"47","article-title":"Building trust in artificial intelligence, machine learning, and robotics","volume":"31","author":"Siau","year":"2018","journal-title":"Cutter Bus. Technol. J."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1109\/3468.844354","article-title":"A model for types and levels of human interaction with automation","volume":"30","author":"Parasuraman","year":"2000","journal-title":"IEEE Trans. Syst. Man Cybern. Part A"},{"key":"ref_23","first-page":"1","article-title":"Integrating AI for agile project management: Innovations, challenges, and benefits","volume":"1","author":"Zadeh","year":"2024","journal-title":"Int. J. Ind. Eng. Constr. Manag."},{"key":"ref_24","unstructured":"Tricot, A., Pl\u00e9gat-Soutjis, F., Camps, J.F., Amiel, A., Lutz, G., and Morcillo, A. (2025, November 03). Utilit\u00e9, Utilisabilit\u00e9, Acceptabilit\u00e9: Interpr\u00e9ter les Relations Entre Trois Dimensions de l\u2019\u00c9valuation des EIAH. In Environnements Informatiques pour l\u2019Apprentissage Humain (EIAH). Available online: https:\/\/edutice.hal.science\/edutice-00000154v1."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/0749-5978(91)90020-T","article-title":"The theory of planned behavior","volume":"50","author":"Ajzen","year":"1991","journal-title":"Organ. Behav. Hum. Decis. Process."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Fishbein, M., and Ajzen, I. (2010). Predicting and Changing Behavior: The Reasoned Action Approach, Psychology Press.","DOI":"10.4324\/9780203838020"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"51","DOI":"10.2307\/30036519","article-title":"Trust and TAM in online shopping: An integrated model","volume":"27","author":"Gefen","year":"2003","journal-title":"MIS Q."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1108\/RAUSP-05-2019-0098","article-title":"Development and validation of attitudes measurement scales: Fundamental and practical aspects","volume":"54","author":"Hair","year":"2019","journal-title":"RAUSP Manag. J."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Boateng, G.O., Neilands, T.B., Frongillo, E.A., Melgar-Qui\u00f1onez, H.R., and Young, S.L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Front. Public Health, 6.","DOI":"10.3389\/fpubh.2018.00149"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1109\/TSE.2012.30","article-title":"Self-organizing roles on agile software development teams","volume":"39","author":"Hoda","year":"2013","journal-title":"IEEE Trans. Softw. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1287\/orsc.5.2.121","article-title":"Capturing the complexity in advanced technology use: Adaptive structuration theory","volume":"5","author":"Poole","year":"1994","journal-title":"Organ. Sci."},{"key":"ref_32","first-page":"1","article-title":"Artificial intelligence: A survey on evolution, models, applications and future trends","volume":"6","author":"Lu","year":"2019","journal-title":"J. Manag. Anal."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3641289","article-title":"A survey on evaluation of large language models","volume":"15","author":"Chang","year":"2024","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_34","unstructured":"Topsakal, O., and Akinci, T.C. (2023, January 10\u201312). Creating large language model applications utilizing LangChain: A primer on developing LLM apps fast. Proceedings of the 5th International Conference on Applied Engineering and Natural Sciences, Konya, Turkey."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"100211","DOI":"10.1016\/j.hcc.2024.100211","article-title":"A survey on large language model (LLM) security and privacy: The good, the bad, and the ugly","volume":"4","author":"Yao","year":"2024","journal-title":"High-Confid. Comput."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"e13406","DOI":"10.1111\/exsy.13406","article-title":"Artificial intelligence governance: Ethical considerations and opportunities","volume":"41","author":"Camilleri","year":"2024","journal-title":"Expert Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1038\/s42256-024-00976-7","article-title":"What large language models know and what people think they know","volume":"7","author":"Steyvers","year":"2024","journal-title":"Nat. Mach. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"101260","DOI":"10.1016\/j.patter.2025.101260","article-title":"Unleashing the potential of prompt engineering for large language models","volume":"6","author":"Chen","year":"2025","journal-title":"Patterns"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Liao, Q.V., and Wortman Vaughan, J. (2024). AI transparency in the age of LLMs: A human-centered research roadmap. Harv. Data Sci. Rev.","DOI":"10.1162\/99608f92.8036d03b"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1145\/3639372","article-title":"Explainability for large language models: A survey","volume":"15","author":"Zhao","year":"2024","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1145\/3560815","article-title":"Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing","volume":"55","author":"Liu","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"213","DOI":"10.2307\/249689","article-title":"Task-technology fit and individual performance","volume":"19","author":"Goodhue","year":"1995","journal-title":"MIS Q."},{"key":"ref_43","unstructured":"White, J., Fu, Q., Hays, S., Sandborn, M., Olea, C., Gilbert, H., Elnashar, A., Spencer-Smith, J., and Schmidt, D.C. (2023). A prompt pattern catalog to enhance prompt engineering with ChatGPT. Proceedings of the 30th Conference on Pattern Languages of Programs (PLoP \u201923), The Hillside Group. Available online: https:\/\/dl.acm.org\/doi\/10.5555\/3721041.3721046."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Marvin, G., Raudha, N.H., Jjingo, D., and Nakatumba-Nabende, J. (2024). Prompt engineering in large language models. Data Intelligence and Cognitive Informatics. ICDICI 2023. Algorithms for Intelligent Systems, Springer.","DOI":"10.1007\/978-981-99-7962-2_30"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Sekhon, M., Cartwright, M., and Francis, J.J. (2017). Acceptability of healthcare interventions: An overview of reviews and development of a theoretical framework. BMC Health Serv. Res., 17.","DOI":"10.1186\/s12913-017-2031-8"},{"key":"ref_46","first-page":"967","article-title":"A review of scale development practices in the study of organizations","volume":"21","author":"Hinkin","year":"1995","journal-title":"J. Manag."},{"key":"ref_47","first-page":"5","article-title":"La validation s\u00e9mantique dans la construction d\u2019outils de mesure","volume":"25","author":"Fernandez","year":"2012","journal-title":"Rev. Int. Psychol. Soc."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1037\/h0040957","article-title":"Construct validity in psychological tests","volume":"52","author":"Cronbach","year":"1955","journal-title":"Psychol. Bull."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1037\/0033-2909.103.3.411","article-title":"Structural equation modeling in practice: A review and recommended two-step approach","volume":"103","author":"Anderson","year":"1988","journal-title":"Psychol. Bull."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1177\/109442819800100106","article-title":"A brief tutorial on the development of measures for use in survey questionnaires","volume":"1","author":"Hinkin","year":"1998","journal-title":"Organ. Res. Methods"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1177\/002224378101800104","article-title":"Evaluating structural equation models with unobservable variables and measurement error","volume":"18","author":"Fornell","year":"1981","journal-title":"J. Mark. Res."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/s11747-014-0403-8","article-title":"A new criterion for assessing discriminant validity in variance-based structural equation modeling","volume":"43","author":"Henseler","year":"2015","journal-title":"J. Acad. Mark. Sci."},{"key":"ref_53","unstructured":"Weick, K.E., and Sutcliffe, K.M. (2007). Managing the Unexpected: Resilient Performance in an Age of Uncertainty, Jossey-Bass. [2nd ed.]. Available online: https:\/\/www.researchgate.net\/publication\/265106124_Managing_the_Unexpected_Resilient_Performance_in_an_Age_of_Uncertainty."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1037\/0021-9010.88.5.879","article-title":"Common method biases in behavioral research: A critical review of the literature and recommended remedies","volume":"88","author":"Podsakoff","year":"2003","journal-title":"J. Appl. Psychol."}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/14\/4\/366\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T15:30:58Z","timestamp":1774884658000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/14\/4\/366"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,30]]},"references-count":54,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2026,4]]}},"alternative-id":["systems14040366"],"URL":"https:\/\/doi.org\/10.3390\/systems14040366","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,30]]}}}