{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T11:29:30Z","timestamp":1781004570012,"version":"3.54.1"},"reference-count":148,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2025,5,16]],"date-time":"2025-05-16T00:00:00Z","timestamp":1747353600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,5,16]],"date-time":"2025-05-16T00:00:00Z","timestamp":1747353600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Centre for Research & Technology Hellas"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Rev"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>During the past decade, there has been rapid emergence, continuous development and advancements in the field of Artificial Intelligence (AI), and a broad adaptation ofLarge Language Models (LLMs) in a wide variety of application domains transforming and streamlining industry practices. However, the construction industry has yet to fully incorporate these technologies, delaying their wide-scale adaptation. Only a limited number of recent studies have explored the opportunities, capabilities and potential of current LLM implementations in the broad domain of Architecture Engineering and Construction (AEC) industry, leaving a significant gap in this field of research. This study aims to address this gap and provide an extensive review of already established state-of-the-art applications and use case scenarios of LLMs in the AEC industry. Apart from that, by exploring the key contributions and limitations of these applications, and by considering relative reviews on this subject, it was possible to categorize them, to extract the emerging challenges and future directions of the field and propose actionable recommendations for industry stakeholders. This study also includes an introduction to important concepts and recent advancements of LLM technologies, focusing on transformer-based architectures and providing an extensive list of LLM families.<\/jats:p>","DOI":"10.1007\/s10462-025-11241-7","type":"journal-article","created":{"date-parts":[[2025,5,16]],"date-time":"2025-05-16T05:54:56Z","timestamp":1747374896000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["A review of LLMs and their applications in the architecture, engineering and construction industry"],"prefix":"10.1007","volume":"58","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5839-4335","authenticated-orcid":false,"given":"Dimitrios","family":"Kampelopoulos","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6599-4446","authenticated-orcid":false,"given":"Athina","family":"Tsanousa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2505-9178","authenticated-orcid":false,"given":"Stefanos","family":"Vrochidis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6447-9020","authenticated-orcid":false,"given":"Ioannis","family":"Kompatsiaris","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,5,16]]},"reference":[{"key":"11241_CR1","doi-asserted-by":"publisher","first-page":"103299","DOI":"10.1016\/j.jobe.2021.103299","volume":"44","author":"SO Abioye","year":"2021","unstructured":"Abioye SO, Oyedele LO, Akanbi L, Ajayi A, Delgado JMD, Bilal M, Akinade OO, Ahmed A (2021) Artificial intelligence in the construction industry: a review of present status, opportunities and future challenges. J Build Eng 44:103299. https:\/\/doi.org\/10.1016\/j.jobe.2021.103299","journal-title":"J Build Eng"},{"issue":"2","key":"11241_CR2","doi-asserted-by":"publisher","first-page":"300","DOI":"10.1108\/ijmpb-02-2019-0047","volume":"14","author":"F Afzal","year":"2019","unstructured":"Afzal F, Yunfei S, Nazir M, Bhatti SM (2019) A review of artificial intelligence based risk assessment methods for capturing complexity-risk interdependencies. Int J Manag Projects Bus 14(2):300\u2013328. https:\/\/doi.org\/10.1108\/ijmpb-02-2019-0047","journal-title":"Int J Manag Projects Bus"},{"key":"11241_CR3","doi-asserted-by":"publisher","unstructured":"Ahia O, Kumar S, Gonen H, Kasai J, Mortensen DR, Smith NA, Tsvetkov Y (2023) Do all languages cost the same? Tokenization in the era of commercial language models. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2305.13707","DOI":"10.48550\/arxiv.2305.13707"},{"key":"11241_CR5","doi-asserted-by":"publisher","unstructured":"Almazrouei E, Alobeidli H, Alshamsi A, Cappelli A, Cojocaru R, Hesslow D, Launay J, Malartic Q, Mazzotta D, Noune B, Pannier B, Penedo G (2023) The Falcon series of open Language models. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2311.16867","DOI":"10.48550\/arxiv.2311.16867"},{"key":"11241_CR6","doi-asserted-by":"publisher","first-page":"103929","DOI":"10.1016\/j.autcon.2021.103929","volume":"132","author":"F Amer","year":"2021","unstructured":"Amer F, Jung Y, Golparvar-Fard M (2021) Transformer machine learning language model for auto-alignment of long-term and short-term plans in construction. Autom Constr 132:103929. https:\/\/doi.org\/10.1016\/j.autcon.2021.103929","journal-title":"Autom Constr"},{"issue":"10","key":"11241_CR7","doi-asserted-by":"publisher","first-page":"189","DOI":"10.3390\/buildings10100189","volume":"10","author":"E Anden\u00e6s","year":"2020","unstructured":"Anden\u00e6s E, Engeb\u00f8 A, Time B, Lohne J, Torp O, Kvande T (2020) Perspectives on quality risk in the building process of blue-green roofs in Norway. Buildings 10(10):189. https:\/\/doi.org\/10.3390\/buildings10100189","journal-title":"Buildings"},{"key":"11241_CR8","doi-asserted-by":"publisher","unstructured":"Anil R, Dai AM, Firat O et al (2023) PALM 2 Technical Report. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2305.10403","DOI":"10.48550\/arxiv.2305.10403"},{"key":"11241_CR9","unstructured":"Anthropic (2024) Introducing the next generation of Claude. https:\/\/www.anthropic.com\/news\/claude-3-family"},{"key":"11241_CR10","doi-asserted-by":"publisher","unstructured":"Arora D, Kini A, Chowdhury SR, Natarajan N, Sinha G, Sharma A (2023) GAR-meets-RAG paradigm for zero-shot information retrieval. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2310.20158","DOI":"10.48550\/arxiv.2310.20158"},{"key":"11241_CR11","doi-asserted-by":"publisher","first-page":"104440","DOI":"10.1016\/j.autcon.2022.104440","volume":"141","author":"SK Baduge","year":"2022","unstructured":"Baduge SK, Thilakarathna S, Perera JS, Arashpour M, Sharafi P, Teodosio B, Shringi A, Mendis P (2022) Artificial intelligence and smart vision for building and construction 4.0: machine and deep learning methods and applications. Autom Constr 141:104440. https:\/\/doi.org\/10.1016\/j.autcon.2022.104440","journal-title":"Autom Constr"},{"key":"11241_CR12","unstructured":"Barbosa F, Woetzel J, Mischke J (2017) Reinventing construction: a route of higher productivity. McKinsey Global Institute, New York"},{"key":"11241_CR13","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1051\/smdo\/2023005","volume":"14","author":"D Bassir","year":"2023","unstructured":"Bassir D, Lodge H, Chang H, Majak J, Chen G (2023) Application of artificial intelligence and machine learning for BIM: review. Int J Simul Multi Design Optim 14:5. https:\/\/doi.org\/10.1051\/smdo\/2023005","journal-title":"Int J Simul Multi Design Optim"},{"key":"11241_CR14","doi-asserted-by":"publisher","unstructured":"Bender EM, Gebru T, McMillan-Major A, Shmitchell S (2021) On the dangers of stochastic parro0ts. In: Proceedings of the 2021 ACM conference on fairness, accountability, and transparency, pp 610\u2013623. https:\/\/doi.org\/10.1145\/3442188.3445922","DOI":"10.1145\/3442188.3445922"},{"key":"11241_CR15","doi-asserted-by":"publisher","first-page":"69812","DOI":"10.1109\/access.2024.3397775","volume":"12","author":"S Bengesi","year":"2024","unstructured":"Bengesi S, El-Sayed H, Sarker MK, Houkpati Y, Irungu J, Oladunni T (2024) Advancements in generative AI: a comprehensive review of GANs, GPT, autoencoders, diffusion model, and transformers. IEEE Access 12:69812\u201369837. https:\/\/doi.org\/10.1109\/access.2024.3397775","journal-title":"IEEE Access"},{"key":"11241_CR17","doi-asserted-by":"publisher","unstructured":"Bommasani R, Hudson DA, Adeli E et al (2021) On the opportunities and risks of foundation models. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2108.07258","DOI":"10.48550\/arxiv.2108.07258"},{"key":"11241_CR18","doi-asserted-by":"publisher","unstructured":"Borgeaud S, Mensch A, Hoffmann J, Cai T, Rutherford E, Millican K, Van Den Driessche G, Lespiau J-B, Damoc B, Clark A, De Las Casas D, Guy A, Menick J, Ring R, Hennigan T, Huang S, Maggiore L, Jones C, Cassirer A, Brock A, Paganini M, Irving G, Vinyals O, Osindero S, Simonyan K, Rae JW, Elsen E, Sifre L (2021) Improving language models by retrieving from trillions of tokens. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2112.04426","DOI":"10.48550\/arxiv.2112.04426"},{"key":"11241_CR19","doi-asserted-by":"publisher","unstructured":"Brown TB, Mann B, Ryder N, Subbiah M, Kaplan J, Dhariwal P, Neelakantan A, Shyam P, Sastry G, Askell A, Agarwal S, Herbert-Voss A, Krueger G, Henighan T, Child R, Ramesh A, Ziegler DM, Wu J, Winter C, Hesse C, Chen M, Sigler E, Litwin M, Gray S, Chess B, Clark J, Berner C, McCandlish S, Radford A, Sutskever I, Amodei D (2020) Language Models are Few-Shot Learners. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2005.14165","DOI":"10.48550\/arxiv.2005.14165"},{"key":"11241_CR20","doi-asserted-by":"publisher","first-page":"130","DOI":"10.29007\/d9j3","volume":"5","author":"LMC Castro","year":"2024","unstructured":"Castro LMC, Castelblanco G, Antonenko PD (2024) LLM-based system for technical writing real-time review in urban construction and technology. EPiC Ser Built Environ 5:130\u2013120. https:\/\/doi.org\/10.29007\/d9j3","journal-title":"EPiC Ser Built Environ"},{"key":"11241_CR21","doi-asserted-by":"publisher","unstructured":"Chen M, Tworek J, Jun H et al (2021) Evaluating large language models trained on code. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2107.03374","DOI":"10.48550\/arxiv.2107.03374"},{"issue":"7","key":"11241_CR22","doi-asserted-by":"publisher","first-page":"1983","DOI":"10.3390\/buildings14071983","volume":"14","author":"N Chen","year":"2024","unstructured":"Chen N, Lin X, Jiang H, An Y (2024) Automated Building information modeling compliance check through a large Language model combined with deep learning and ontology. Buildings 14(7):1983. https:\/\/doi.org\/10.3390\/buildings14071983","journal-title":"Buildings"},{"key":"11241_CR23","unstructured":"Chiang WL, Li Z, Lin Z, Sheng Y, Wu Z, Zhang H, Zheng L, Zhuang S, Zhuang Y, Gonzalez JE, Stoica I, Xing EP (2023) Vicuna: an Open-Source chatbot impressing GPT-4 with 90%* ChatGPT quality. https:\/\/lmsys.org\/blog\/2023-03-30-vicuna\/"},{"issue":"1","key":"11241_CR24","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1061\/(asce)cp.1943-5487.0000197","volume":"27","author":"J-S Chou","year":"2012","unstructured":"Chou J-S, Lin C (2012) Predicting disputes in public-private partnership projects: classification and ensemble models. J Comput Civil Eng 27(1):51\u201360. https:\/\/doi.org\/10.1061\/(asce)cp.1943-5487.0000197","journal-title":"J Comput Civil Eng"},{"key":"11241_CR25","doi-asserted-by":"publisher","DOI":"10.48550\/arxiv.2204.02311","author":"A Chowdhery","year":"2022","unstructured":"Chowdhery A, Narang S, Devlin J et al (2022) PaLM: scaling Language modeling with pathways. Cornell University. Preprint athttps:\/\/doi.org\/10.48550\/arxiv.2204.02311","journal-title":"ArXiv"},{"key":"11241_CR26","doi-asserted-by":"publisher","unstructured":"Christiano P, Leike J, Brown TB, Martic M, Legg S, Amodei D (2017) Deep reinforcement learning from human preferences. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.1706.03741","DOI":"10.48550\/arxiv.1706.03741"},{"key":"11241_CR27","doi-asserted-by":"publisher","unstructured":"Chung HW, Hou L, Longpre S, Zoph B, Tay Y, Fedus W, Li E, Wang X, Dehghani M, Brahma S, Webson A, Gu SS, Dai Z, Suzgun M, Chen X, Chowdhery A, Narang S, Mishra G, Yu A, Zhao V, Huang Y, Dai A, Yu H, Petrov S, Chi EH, Dean J, Devlin J, Roberts A, Zhou D, Le QV, Wei J (2022) Scaling Instruction-Finetuned Language Models. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2210.11416","DOI":"10.48550\/arxiv.2210.11416"},{"key":"11241_CR28","doi-asserted-by":"publisher","unstructured":"Das BC, Amini MH, Wu Y (2024) Security and privacy Challenges of large language Models: a survey. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2402.00888","DOI":"10.48550\/arxiv.2402.00888"},{"key":"11241_CR29","doi-asserted-by":"publisher","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K (2018) BERT: pre-training of deep bidirectional transformers for language understanding. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.1810.04805","DOI":"10.48550\/arxiv.1810.04805"},{"key":"11241_CR30","doi-asserted-by":"publisher","first-page":"104169","DOI":"10.1016\/j.autcon.2022.104169","volume":"136","author":"Y Ding","year":"2022","unstructured":"Ding Y, Ma J, Luo X (2022) Applications of natural Language processing in construction. Autom Constr 136:104169. https:\/\/doi.org\/10.1016\/j.autcon.2022.104169","journal-title":"Autom Constr"},{"key":"11241_CR31","doi-asserted-by":"publisher","unstructured":"Dubey A, Jauhri A, Pandey A et al (2024) The Llama 3 Herd of models. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2407.21783","DOI":"10.48550\/arxiv.2407.21783"},{"issue":"7","key":"11241_CR32","doi-asserted-by":"publisher","first-page":"621","DOI":"10.1080\/01446190210163543","volume":"20","author":"A Dubois","year":"2002","unstructured":"Dubois A, Gadde L-E (2002) The construction industry as a loosely coupled system: implications for productivity and innovation. Constr Manage Econ 20(7):621\u2013631. https:\/\/doi.org\/10.1080\/01446190210163543","journal-title":"Constr Manage Econ"},{"issue":"10","key":"11241_CR33","doi-asserted-by":"publisher","first-page":"2289","DOI":"10.1108\/ecam-09-2018-0386","volume":"26","author":"Y Fang","year":"2019","unstructured":"Fang Y, Ng ST (2019) Genetic algorithm for determining the construction logistics of precast components. Eng Constr Architect Manage 26(10):2289\u20132306. https:\/\/doi.org\/10.1108\/ecam-09-2018-0386","journal-title":"Eng Constr Architect Manage"},{"key":"11241_CR34","doi-asserted-by":"publisher","first-page":"110287","DOI":"10.1016\/j.rser.2020.110287","volume":"133","author":"S Fathi","year":"2020","unstructured":"Fathi S, Srinivasan R, Fenner A, Fathi S (2020) Machine learning applications in urban building energy performance forecasting: a systematic review. Renew Sustain Energy Rev 133:110287. https:\/\/doi.org\/10.1016\/j.rser.2020.110287","journal-title":"Renew Sustain Energy Rev"},{"key":"11241_CR35","doi-asserted-by":"publisher","unstructured":"Fedus W, Zoph B, Shazeer N (2021) Switch transformers: scaling to trillion parameter models with simple and efficient sparsity. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2101.03961","DOI":"10.48550\/arxiv.2101.03961"},{"issue":"5","key":"11241_CR36","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1080\/01446193.2011.570355","volume":"29","author":"JA Gambatese","year":"2011","unstructured":"Gambatese JA, Hallowell M (2011) Factors that influence the development and diffusion of technical innovations in the construction industry. Constr Manage Econ 29(5):507\u2013517. https:\/\/doi.org\/10.1080\/01446193.2011.570355","journal-title":"Constr Manage Econ"},{"key":"11241_CR37","doi-asserted-by":"publisher","DOI":"10.48550\/arxiv.2312.10997","author":"Y Gao","year":"2023","unstructured":"Gao Y, Xiong Y, Gao X, Jia K, Pan J, Bi Y, Dai Y, Sun J, Wang H (2023) Retrieval-augmented generation for large language models: a survey. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2312.10997","journal-title":"ArXiv"},{"issue":"1","key":"11241_CR38","doi-asserted-by":"publisher","first-page":"220","DOI":"10.3390\/buildings14010220","volume":"14","author":"P Ghimire","year":"2024","unstructured":"Ghimire P, Kim K, Acharya M (2024) Opportunities and challenges of generative AI in construction industry: focusing on adoption of text-based models. Buildings 14(1):220. https:\/\/doi.org\/10.3390\/buildings14010220","journal-title":"Buildings"},{"issue":"3","key":"11241_CR39","doi-asserted-by":"publisher","first-page":"43","DOI":"10.3390\/designs8030043","volume":"8","author":"M Giudici","year":"2024","unstructured":"Giudici M, Padalino L, Paolino G, Paratici I, Pascu AI, Garzotto F (2024) Designing home automation routines using an LLM-based chatbot. Designs 8(3):43. https:\/\/doi.org\/10.3390\/designs8030043","journal-title":"Designs"},{"key":"11241_CR40","doi-asserted-by":"publisher","unstructured":"Gu A, Dao T (2023) Mamba: linear-time sequence modeling with selective state spaces. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2312.00752","DOI":"10.48550\/arxiv.2312.00752"},{"key":"11241_CR41","doi-asserted-by":"publisher","unstructured":"Guan L, Valmeekam K, Sreedharan S, Kambhampati S (2023) Leveraging pre-trained large Language models to construct and utilize world models for model-based task planning. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2305.14909","DOI":"10.48550\/arxiv.2305.14909"},{"key":"11241_CR42","doi-asserted-by":"publisher","unstructured":"Han D, Zhao W, Yin H, Qu M, Zhu J, Ma F, Ying Y, Pan A (2024) Large Language models driven BIM-based DfMA method for free-form prefabricated buildings: framework and a usefulness case study. J Asian Archit Build Eng. https:\/\/doi.org\/10.1080\/13467581.2024.2329351","DOI":"10.1080\/13467581.2024.2329351"},{"key":"11241_CR43","doi-asserted-by":"crossref","unstructured":"Hassan HA, Marengo E, Nutt W (2022) A BERT-based model for question answering on construction incident reports. In: Natural language processing and information systems, 27th international conference on applications of natural language to information systems, NLDB 2022. Lecture notes in computer science. Springer, pp 215\u2013223","DOI":"10.1007\/978-3-031-08473-7_20"},{"key":"11241_CR44","doi-asserted-by":"publisher","unstructured":"Hatami M, Franz B, Paneru S, Flood I (2022) Using deep learning artificial intelligence to improve foresight method in the optimization of planning and scheduling of construction processes. Comput Civil Eng. https:\/\/doi.org\/10.1061\/9780784483893.143","DOI":"10.1061\/9780784483893.143"},{"key":"11241_CR45","doi-asserted-by":"publisher","DOI":"10.48550\/arxiv.2006.03654","author":"P He","year":"2020","unstructured":"He P, Liu X, Gao J, Chen W (2020) DeBERTa: decoding-enhanced BERT with disentangled attention. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2006.03654","journal-title":"ArXiv"},{"key":"11241_CR46","doi-asserted-by":"publisher","unstructured":"Houlsby N, Giurgiu A, Jastrzebski S, Morrone B, De Laroussilhe Q, Gesmundo A, Attariyan M, Gelly S (2019) Parameter-efficient transfer learning for NLP. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.1902.00751","DOI":"10.48550\/arxiv.1902.00751"},{"key":"11241_CR47","doi-asserted-by":"publisher","unstructured":"Howard J, Ruder S (2018) Universal language model fine-tuning for text classification. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.1801.06146","DOI":"10.48550\/arxiv.1801.06146"},{"key":"11241_CR48","doi-asserted-by":"publisher","unstructured":"Hu EJ, Shen Y, Wallis P, Allen-Zhu Z, Li Y, Wang S, Chen W (2021) LORA: low-rank adaptation of large Language models. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2106.09685","DOI":"10.48550\/arxiv.2106.09685"},{"key":"11241_CR49","doi-asserted-by":"publisher","unstructured":"Hu Y, Kim H, Ye K, Lu N (2024) Applying fine-tuned LLMs for reducing data needs in load profile analysis. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2406.02479","DOI":"10.48550\/arxiv.2406.02479"},{"key":"11241_CR50","doi-asserted-by":"publisher","unstructured":"Jang S, Lee G (2023) Interactive design by integrating a large pre-trained language model and building information modeling. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2306.14165","DOI":"10.48550\/arxiv.2306.14165"},{"key":"11241_CR51","doi-asserted-by":"publisher","first-page":"102532","DOI":"10.1016\/j.aei.2024.102532","volume":"61","author":"S Jang","year":"2024","unstructured":"Jang S, Lee G, Oh J, Lee J, Koo B (2024) Automated detailing of exterior walls using NADIA: natural-language-based architectural detailing through interaction with AI. Adv Eng Inform 61:102532. https:\/\/doi.org\/10.1016\/j.aei.2024.102532","journal-title":"Adv Eng Inform"},{"key":"11241_CR52","doi-asserted-by":"publisher","unstructured":"Jiang AQ, Sablayrolles A, Mensch A, Bamford C, Chaplot DS, De Las Casas D, Bressand F, Lengyel G, Lample G, Saulnier L, Lavaud LR, Lachaux M-A, Stock P, Scao TL, Lavril T, Wang T, Lacroix T, Sayed WE (2023) Mistral 7B. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2310.06825","DOI":"10.48550\/arxiv.2310.06825"},{"key":"11241_CR53","doi-asserted-by":"publisher","unstructured":"Jiang AQ, Sablayrolles A, Roux A, Mensch A, Savary B, Bamford C, Chaplot DS, De Las Casas D, Hanna EB, Bressand F, Lengyel G, Bour G, Lample G, Lavaud LR, Saulnier L, Lachaux M-A, Stock P, Subramanian S, Yang S, Antoniak S, Scao TL, Gervet T, Lavril T, Wang T, Lacroix T, Sayed WE (2024a) Mixtral of experts. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2401.04088","DOI":"10.48550\/arxiv.2401.04088"},{"key":"11241_CR54","doi-asserted-by":"publisher","first-page":"123431","DOI":"10.1016\/j.apenergy.2024.123431","volume":"367","author":"G Jiang","year":"2024","unstructured":"Jiang G, Ma Z, Zhang L, Chen J (2024b) EPlus-LLM: a large language model-based computing platform for automated Building energy modeling. Appl Energy 367:123431. https:\/\/doi.org\/10.1016\/j.apenergy.2024.123431","journal-title":"Appl Energy"},{"key":"11241_CR55","doi-asserted-by":"publisher","unstructured":"Jin Y, Shen X, Peng H, Liu X, Qin J, Li J, Xie J, Gao P, Zhou G, Gong J (2023) SurrealDriver: designing generative driver agent simulation framework in urban contexts based on large language model. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2309.13193","DOI":"10.48550\/arxiv.2309.13193"},{"key":"11241_CR56","doi-asserted-by":"publisher","unstructured":"Kaddour J, Harris J, Mozes M, Bradley H, Raileanu R, McHardy R (2023) Challenges and applications of large language models. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2307.10169","DOI":"10.48550\/arxiv.2307.10169"},{"issue":"1","key":"11241_CR57","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1115\/1.3662552","volume":"82","author":"RE Kalman","year":"1960","unstructured":"Kalman RE (1960) A new approach to linear filtering and prediction problems. J Basic Eng 82(1):35\u201345. https:\/\/doi.org\/10.1115\/1.3662552","journal-title":"J Basic Eng"},{"key":"11241_CR58","unstructured":"Kaplan J, McCandlish S, Henighan T, Brown TB, Chess B, Child R, Gray S, Radford A, Wu J, Amodei D (2020) Scaling laws for neural language models. arXiv Preprint. https:\/\/arxiv.org\/abs\/2001.08361"},{"key":"11241_CR59","doi-asserted-by":"publisher","first-page":"134120","DOI":"10.1016\/j.jclepro.2022.134120","volume":"376","author":"AK Kar","year":"2022","unstructured":"Kar AK, Choudhary SK, Singh VK (2022) How can artificial intelligence impact sustainability: a systematic literature review. J Clean Prod 376:134120. https:\/\/doi.org\/10.1016\/j.jclepro.2022.134120","journal-title":"J Clean Prod"},{"key":"11241_CR60","doi-asserted-by":"publisher","unstructured":"Lan Z, Chen M, Goodman S, Gimpel K, Sharma P, Soricut R (2019) ALBERT: A lite BERT for self-supervised learning of Language representations. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.1909.11942","DOI":"10.48550\/arxiv.1909.11942"},{"key":"11241_CR61","doi-asserted-by":"publisher","unstructured":"Lepikhin D, Lee H, Xu Y, Chen D, Firat O, Huang Y, Krikun M, Shazeer N, Chen Z (2020) GShard: scaling giant models with conditional computation and automatic sharding. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2006.16668","DOI":"10.48550\/arxiv.2006.16668"},{"key":"11241_CR62","doi-asserted-by":"publisher","unstructured":"Lester B, Al-Rfou R, Constant N (2021) The power of scale for parameter-efficient prompt tuning. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2104.08691","DOI":"10.48550\/arxiv.2104.08691"},{"key":"11241_CR63","doi-asserted-by":"publisher","unstructured":"Lewis M, Liu Y, Goyal N, Ghazvininejad M, Mohamed A, Levy O, Stoyanov V, Zettlemoyer L (2019) BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.1910.13461","DOI":"10.48550\/arxiv.1910.13461"},{"key":"11241_CR64","doi-asserted-by":"publisher","unstructured":"Lewis P, Perez E, Piktus A, Petroni F, Karpukhin V, Goyal N, K\u00fcttler H, Lewis M, Yih W-T, Rockt\u00e4schel T, Riedel S, Kiela D (2020) Retrieval-Augmented Generation for Knowledge-Intensive NLP tasks. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2005.11401","DOI":"10.48550\/arxiv.2005.11401"},{"key":"11241_CR66","doi-asserted-by":"publisher","unstructured":"Li XL, Liang P (2021) Prefix-tuning: optimizing continuous prompts for generation. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2101.00190","DOI":"10.48550\/arxiv.2101.00190"},{"key":"11241_CR65","unstructured":"Li D, Shao R, Xie A, Sheng Y, Zheng L, Gonzalez JE, Stoica I, Ma X, Zhang H (2023) How long can Open-Source LLMs truly promise on context length? https:\/\/lmsys.org\/blog\/2023-06-29-longchat\/"},{"key":"11241_CR68","doi-asserted-by":"publisher","unstructured":"Lin Z, Li M, Zheng Z, Cheng Y, Yuan C (2020) Self-attention ConVLSTM for spatiotemporal prediction. In: Proceedings of the AAAI conference on artificial intelligence, vol 34(07), pp 11531\u201311538. https:\/\/doi.org\/10.1609\/aaai.v34i07.6819","DOI":"10.1609\/aaai.v34i07.6819"},{"key":"11241_CR67","doi-asserted-by":"publisher","unstructured":"Lin X, Wang W, Li Y, Yang S, Feng F, Wei Y, Chua T-S (2024) Data-efficient fine-tuning for LLM-based recommendation. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2401.17197","DOI":"10.48550\/arxiv.2401.17197"},{"key":"11241_CR71","doi-asserted-by":"publisher","unstructured":"Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, Levy O, Lewis M, Zettlemoyer L, Stoyanov V (2019) ROBERTA: a robustly optimized BERT pretraining approach. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.1907.11692","DOI":"10.48550\/arxiv.1907.11692"},{"key":"11241_CR70","doi-asserted-by":"publisher","unstructured":"Liu Y, Gu J, Goyal N, Li X, Edunov S, Ghazvininejad M, Lewis M, Zettlemoyer L (2020) Multilingual denoising pre-training for neural machine translation. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2001.08210","DOI":"10.48550\/arxiv.2001.08210"},{"key":"11241_CR69","doi-asserted-by":"publisher","first-page":"104302","DOI":"10.1016\/j.autcon.2022.104302","volume":"140","author":"J Liu","year":"2022","unstructured":"Liu J, Luo H, Liu H (2022) Deep learning-based data analytics for safety in construction. Autom Constr 140:104302. https:\/\/doi.org\/10.1016\/j.autcon.2022.104302","journal-title":"Autom Constr"},{"issue":"4","key":"11241_CR72","doi-asserted-by":"publisher","first-page":"798","DOI":"10.1016\/j.jmat.2023.05.001","volume":"9","author":"Y Liu","year":"2023","unstructured":"Liu Y, Yang Z, Yu Z, Liu Z, Liu D, Lin H, Li M, Ma S, Avdeev M, Shi S (2023a) Generative artificial intelligence and its applications in materials science: current situation and future perspectives. J Materiomics 9(4):798\u2013816. https:\/\/doi.org\/10.1016\/j.jmat.2023.05.001","journal-title":"J Materiomics"},{"key":"11241_CR73","doi-asserted-by":"publisher","unstructured":"Liu Z, Zhang Y, Li P, Liu Y, Yang D (2023b) Dynamic LLM-Agent network: an LLM-agent collaboration framework with agent team optimization. arXiv Preprint. Cornell University https:\/\/doi.org\/10.48550\/arxiv.2310.02170","DOI":"10.48550\/arxiv.2310.02170"},{"key":"11241_CR75","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1016\/j.wasman.2021.08.012","volume":"134","author":"W Lu","year":"2021","unstructured":"Lu W, Lou J, Webster C, Xue F, Bao Z, Chi B (2021) Estimating construction waste generation in the greater Bay area, China using machine learning. Waste Manag 134:78\u201388. https:\/\/doi.org\/10.1016\/j.wasman.2021.08.012","journal-title":"Waste Manag"},{"key":"11241_CR76","doi-asserted-by":"publisher","unstructured":"Lu Y, Bartolo M, Moore A, Riedel S, Stenetorp P (2022) Fantastically ordered prompts and where to find them: overcoming few-shot prompt order sensitivity. In: Proceedings of the 60th annual meeting of the Association for Computational Linguistics (volume 1: long papers). https:\/\/doi.org\/10.18653\/v1\/2022.acl-long.556","DOI":"10.18653\/v1\/2022.acl-long.556"},{"key":"11241_CR74","doi-asserted-by":"publisher","unstructured":"Lu J, Tian X, Zhang C, Zhao Y, Zhang J, Zhang W, Feng C, He J, Wang J, He F (2024) Evaluation of large language models (LLMs) on the mastery of knowledge and skills in the heating, ventilation and air conditioning (HVAC) industry. Energy Built Environ. https:\/\/doi.org\/10.1016\/j.enbenv.2024.03.010","DOI":"10.1016\/j.enbenv.2024.03.010"},{"key":"11241_CR77","doi-asserted-by":"publisher","unstructured":"Malartic Q, Chowdhury NR, Cojocaru R, Farooq M, Campesan G, Djilali YAD, Narayan S, Singh A, Velikanov M, Boussaha BEA, Al-Yafeai M, Alobeidli H, Qadi LA, Seddik MEA, Fedyanin K, Alami R, Hacid H (2024) Falcon2-11B Technical Report. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2407.14885","DOI":"10.48550\/arxiv.2407.14885"},{"key":"11241_CR78","doi-asserted-by":"publisher","unstructured":"Mehmood MU, Chun D, Zeeshan N, Han H, Jeon G, Chen K (2019) A review of the applications of artificial intelligence and big data to buildings for energy-efficiency and a comfortable indoor living environment. Energy Build 202:109383. https:\/\/doi.org\/10.1016\/j.enbuild.2019.109383","DOI":"10.1016\/j.enbuild.2019.109383"},{"key":"11241_CR79","doi-asserted-by":"publisher","first-page":"130303","DOI":"10.1016\/j.energy.2024.130303","volume":"291","author":"F Meng","year":"2024","unstructured":"Meng F, Lu Z, Li X, Han W, Peng J, Liu X, Niu Z (2024) Demand-side energy management reimagined: a comprehensive literature analysis leveraging large language models. Energy 291:130303. https:\/\/doi.org\/10.1016\/j.energy.2024.130303","journal-title":"Energy"},{"key":"11241_CR80","doi-asserted-by":"publisher","unstructured":"Minaee S, Mikolov T, Nikzad N, Chenaghlu M, Socher R, Amatriain X, Gao J (2024) Large language models: a survey. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2402.06196","DOI":"10.48550\/arxiv.2402.06196"},{"key":"11241_CR81","unstructured":"Mistral AI (2024a) Cheaper, better, faster, stronger. In: Mistral AI| Frontier AI in your hands. https:\/\/mistral.ai\/news\/mixtral-8x22b\/"},{"key":"11241_CR82","unstructured":"Mistral AI (2024b) Math\u03a3tral. In: Mistral AI| Frontier AI in your Hands. https:\/\/mistral.ai\/news\/mathstral\/"},{"key":"11241_CR83","unstructured":"Mistral AI (2024c) Codestral Mamba. In: Mistral AI| Frontier AI in Your Hands. https:\/\/mistral.ai\/news\/codestral-mamba\/"},{"key":"11241_CR84","unstructured":"Mistral AI (2024d) Codestral: Hello, World! In: Mistral AI| Frontier AI in your hands. https:\/\/mistral.ai\/news\/codestral\/"},{"key":"11241_CR85","doi-asserted-by":"publisher","first-page":"104465","DOI":"10.1016\/j.autcon.2022.104465","volume":"142","author":"S Moon","year":"2022","unstructured":"Moon S, Chi S, Im S-B (2022) Automated detection of contractual risk clauses from construction specifications using bidirectional encoder representations from transformers (BERT). Autom Constr 142:104465. https:\/\/doi.org\/10.1016\/j.autcon.2022.104465","journal-title":"Autom Constr"},{"key":"11241_CR86","doi-asserted-by":"publisher","unstructured":"Naveed H, Khan AU, Qiu S, Saqib M, Anwar S, Usman M, Barnes N, Mian A (2023) A comprehensive overview of large Language models. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2307.06435","DOI":"10.48550\/arxiv.2307.06435"},{"key":"11241_CR87","doi-asserted-by":"publisher","unstructured":"Ngiam J, Peng D, Vasudevan V, Kornblith S, Le QV, Pang R (2018) Domain adaptive transfer learning with specialist models. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.1811.07056","DOI":"10.48550\/arxiv.1811.07056"},{"key":"11241_CR88","doi-asserted-by":"publisher","unstructured":"OpenAI (2023a) GPT-4 Technical Report. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2303.08774","DOI":"10.48550\/arxiv.2303.08774"},{"key":"11241_CR89","volume-title":"GPT-4V(ision) system card","author":"OpenAI","year":"2023","unstructured":"OpenAI (2023b) GPT-4V(ision) system card. OpenAI, San Francisco. https:\/\/openai.com\/index\/gpt-4v-system-card\/"},{"key":"11241_CR91","doi-asserted-by":"publisher","unstructured":"Ouyang X, Srivastava M (2024) LLMSENSE: Harnessing LLMS for high-level reasoning over spatiotemporal sensor traces. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2403.19857","DOI":"10.48550\/arxiv.2403.19857"},{"key":"11241_CR90","doi-asserted-by":"publisher","unstructured":"Ouyang L, Wu J, Jiang X, Almeida D, Wainwright CL, Mishkin P, Zhang C, Agarwal S, Slama K, Ray A, Schulman J, Hilton J, Kelton F, Miller L, Simens M, Askell A, Welinder P, Christiano P, Leike J, Lowe R (2022) Training Language models to follow instructions with human feedback. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2203.02155","DOI":"10.48550\/arxiv.2203.02155"},{"issue":"7","key":"11241_CR92","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/mc.2022.3148714","volume":"55","author":"D Patterson","year":"2022","unstructured":"Patterson D, Gonzalez J, Holzle U, Le Q, Liang C, Munguia L-M, Rothchild D, So DR, Texier M, Dean J (2022) The carbon footprint of machine learning training will plateau, then shrink. Computer 55(7):18\u201328. https:\/\/doi.org\/10.1109\/mc.2022.3148714","journal-title":"Computer"},{"key":"11241_CR93","doi-asserted-by":"publisher","unstructured":"Petrov A, Emanuele LM, Torr PHS, Bibi A (2023) Language model tokenizers introduce unfairness between languages. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2305.15425","DOI":"10.48550\/arxiv.2305.15425"},{"key":"11241_CR94","doi-asserted-by":"publisher","unstructured":"Plant R, Giuffrida V, Gkatzia D (2022) You are what you write: preserving privacy in the era of large Language models. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2204.09391","DOI":"10.48550\/arxiv.2204.09391"},{"issue":"12","key":"11241_CR95","doi-asserted-by":"publisher","first-page":"2997","DOI":"10.3390\/en17122997","volume":"17","author":"M P\u0142oszaj-Mazurek","year":"2024","unstructured":"P\u0142oszaj-Mazurek M, Ry\u0144ska E (2024) Artificial intelligence and digital tools for assisting low-carbon architectural design: merging the use of machine learning, large language models, and building information modeling for life cycle assessment tool development. Energies 17(12):2997. https:\/\/doi.org\/10.3390\/en17122997","journal-title":"Energies"},{"key":"11241_CR96","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1016\/j.autcon.2018.03.022","volume":"93","author":"CQX Poh","year":"2018","unstructured":"Poh CQX, Ubeynarayana CU, Goh YM (2018) Safety leading indicators for construction sites: a machine learning approach. Autom Constr 93:375\u2013386. https:\/\/doi.org\/10.1016\/j.autcon.2018.03.022","journal-title":"Autom Constr"},{"key":"11241_CR97","doi-asserted-by":"publisher","first-page":"108250","DOI":"10.1016\/j.ijpe.2021.108250","volume":"241","author":"M Pournader","year":"2021","unstructured":"Pournader M, Ghaderi H, Hassanzadegan A, Fahimnia B (2021) Artificial intelligence applications in supply chain management. Int J Prod Econ 241:108250. https:\/\/doi.org\/10.1016\/j.ijpe.2021.108250","journal-title":"Int J Prod Econ"},{"key":"11241_CR98","doi-asserted-by":"publisher","first-page":"142824","DOI":"10.1016\/j.jclepro.2024.142824","volume":"466","author":"N Preuss","year":"2024","unstructured":"Preuss N, Alshehri AS, You F (2024) Large language models for life cycle assessments: opportunities, challenges, and risks. J Clean Prod 466:142824. https:\/\/doi.org\/10.1016\/j.jclepro.2024.142824","journal-title":"J Clean Prod"},{"issue":"4","key":"11241_CR99","doi-asserted-by":"publisher","first-page":"857","DOI":"10.3390\/buildings13040857","volume":"13","author":"SA Prieto","year":"2023","unstructured":"Prieto SA, Mengiste ET, De Soto BG (2023) Investigating the use of ChatGPT for the scheduling of construction projects. Buildings 13(4):857. https:\/\/doi.org\/10.3390\/buildings13040857","journal-title":"Buildings"},{"key":"11241_CR100","doi-asserted-by":"publisher","first-page":"124601","DOI":"10.1016\/j.eswa.2024.124601","volume":"255","author":"H Pu","year":"2024","unstructured":"Pu H, Yang X, Li J, Guo R (2024) AutoRepo: a general framework for multimodal LLM-based automated construction reporting. Expert Syst Appl 255:124601. https:\/\/doi.org\/10.1016\/j.eswa.2024.124601","journal-title":"Expert Syst Appl"},{"key":"11241_CR101","unstructured":"Radford A, Narasimhan K, Salimans T, Sutskever I (2018) Improving language understanding by generative pre-training. OpenAI, San Francisco. https:\/\/cdn.openai.com\/research-covers\/language-unsupervised\/language_understanding_paper.pdf. Accessed 8 Jan 2025"},{"key":"11241_CR102","unstructured":"Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I (2019) Language models are unsupervised multitask learners. https:\/\/api.semanticscholar.org\/CorpusID:160025533"},{"key":"11241_CR103","doi-asserted-by":"publisher","unstructured":"Raffel C, Shazeer N, Roberts A, Lee K, Narang S, Matena M, Zhou Y, Li W, Liu PJ (2019) Exploring the limits of transfer learning with a unified text-to-text transformer. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.1910.10683","DOI":"10.48550\/arxiv.1910.10683"},{"key":"11241_CR104","doi-asserted-by":"publisher","first-page":"26839","DOI":"10.1109\/access.2024.3365742","volume":"12","author":"MAK Raiaan","year":"2024","unstructured":"Raiaan MAK, Mukta MSH, Fatema K, Fahad NM, Sakib S, Mim MMJ, Ahmad J, Ali ME, Azam S (2024) A review on large language models: architectures, applications, taxonomies, open issues and challenges. IEEE Access 12:26839\u201326874. https:\/\/doi.org\/10.1109\/access.2024.3365742","journal-title":"IEEE Access"},{"key":"11241_CR105","doi-asserted-by":"publisher","unstructured":"Rane N (2023) ChatGPT and similar generative artificial intelligence (AI) for building and construction industry: contribution, opportunities and challenges of large language models for Industry 4.0, Industry 5.0, and Society 5.0. SSRN Electron J. https:\/\/doi.org\/10.2139\/ssrn.4603221","DOI":"10.2139\/ssrn.4603221"},{"key":"11241_CR106","unstructured":"Ribeirinho M, Mischke J, Strube J, Sj\u00f6din E, Blanco J, Palter R, Bi\u00f6rck J, Rockhill D, Andersson T (2020) The next normal in construction: how disruption is reshaping the world\u2019s largest ecosystem. McKinsey & Company, New York"},{"key":"11241_CR107","doi-asserted-by":"publisher","unstructured":"Rozi\u00e8re B, Gehring J, Gloeckle F, Sootla S, Gat I, Tan XE, Adi Y, Liu J, Remez T, Rapin J, Kozhevnikov A, Evtimov I, Bitton J, Bhatt M, Ferrer CC, Grattafiori A, Xiong W, D\u00e9fossez A, Copet J, Azhar F, Touvron H, Martin L, Usunier N, Scialom T, Synnaeve G (2023) Code Llama: open foundation models for code. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2308.12950","DOI":"10.48550\/arxiv.2308.12950"},{"key":"11241_CR108","unstructured":"Rumbelow J, Mwatkins (2023) SolidGoldMagikarp (plus, prompt generation). https:\/\/www.lesswrong.com\/posts\/aPeJE8bSo6rAFoLqg\/solidgoldmagikarp-plus-prompt-generation"},{"key":"11241_CR109","doi-asserted-by":"publisher","first-page":"100300","DOI":"10.1016\/j.dibe.2023.100300","volume":"17","author":"A Saka","year":"2023","unstructured":"Saka A, Taiwo R, Saka N, Salami BA, Ajayi S, Akande K, Kazemi H (2023a) GPT models in construction industry: opportunities, limitations, and a use case validation. Dev Built Environ 17:100300. https:\/\/doi.org\/10.1016\/j.dibe.2023.100300","journal-title":"Dev Built Environ"},{"key":"11241_CR110","doi-asserted-by":"publisher","first-page":"101869","DOI":"10.1016\/j.aei.2022.101869","volume":"55","author":"AB Saka","year":"2023","unstructured":"Saka AB, Oyedele LO, Akanbi LA, Ganiyu SA, Chan DWM, Bello SA (2023b) Conversational artificial intelligence in the AEC industry: A review of present status, challenges and opportunities. Adv Eng Inform 55:101869. https:\/\/doi.org\/10.1016\/j.aei.2022.101869","journal-title":"Adv Eng Inform"},{"key":"11241_CR111","doi-asserted-by":"publisher","unstructured":"Sanh V, Debut L, Chaumond J, Wolf T (2019) DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.1910.01108","DOI":"10.48550\/arxiv.1910.01108"},{"issue":"11","key":"11241_CR112","doi-asserted-by":"publisher","first-page":"2134","DOI":"10.1080\/15623599.2020.1768326","volume":"22","author":"MO Sanni-Anibire","year":"2020","unstructured":"Sanni-Anibire MO, Zin RM, Olatunji SO (2020) Machine learning model for delay risk assessment in tall building projects. Int J Constr Manage 22(11):2134\u20132143. https:\/\/doi.org\/10.1080\/15623599.2020.1768326","journal-title":"Int J Constr Manage"},{"key":"11241_CR113","doi-asserted-by":"publisher","unstructured":"Scao TL, Fan A, Akiki C et al (2022) BLOOM: a 176B-parameter open-access multilingual language model. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2211.05100","DOI":"10.48550\/arxiv.2211.05100"},{"issue":"20","key":"11241_CR114","doi-asserted-by":"publisher","first-page":"7347","DOI":"10.3390\/app10207347","volume":"10","author":"J Seo","year":"2020","unstructured":"Seo J, Park H, Choo S (2020) Inference of drawing elements and space usage on architectural drawings using semantic segmentation. Appl Sci 10(20):7347. https:\/\/doi.org\/10.3390\/app10207347","journal-title":"Appl Sci"},{"key":"11241_CR115","doi-asserted-by":"publisher","unstructured":"Shazeer N, Mirhoseini A, Maziarz K, Davis A, Le Q, Hinton G, Dean J (2017) Outrageously large neural networks: the sparsely-gated mixture-of-experts layer. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.1701.06538","DOI":"10.48550\/arxiv.1701.06538"},{"key":"11241_CR116","doi-asserted-by":"publisher","unstructured":"Shinn N, Labash B, Gopinath A (2023) Reflexion: language agents with verbal reinforcement learning. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2303.11366","DOI":"10.48550\/arxiv.2303.11366"},{"key":"11241_CR117","doi-asserted-by":"publisher","unstructured":"Singhal K, Azizi S, Tu T, Mahdavi SS, Wei J, Chung HW, Scales N, Tanwani A, Cole-Lewis H, Pfohl S, Payne P, Seneviratne M, Gamble P, Kelly C, Scharli N, Chowdhery A, Mansfield P, Arcas BAY, Webster D, Corrado GS, Matias Y, Chou K, Gottweis J, Tomasev N, Liu Y, Rajkomar A, Barral J, Semturs C, Karthikesalingam A, Natarajan V (2022) Large Language models encode clinical knowledge. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2212.13138","DOI":"10.48550\/arxiv.2212.13138"},{"key":"11241_CR118","doi-asserted-by":"publisher","unstructured":"Singhal K, Tu T, Gottweis J, Sayres R, Wulczyn E, Hou L, Clark K, Pfohl S, Cole-Lewis H, Neal D, Schaekermann M, Wang A, Amin M, Lachgar S, Mansfield P, Prakash S, Green B, Dominowska E, Arcas BAY, Tomasev N, Liu Y, Wong R, Semturs C, Mahdavi SS, Barral J, Webster D, Corrado GS, Matias Y, Azizi S, Karthikesalingam A, Natarajan V (2023) Towards expert-level medical question answering with large language models. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2305.09617","DOI":"10.48550\/arxiv.2305.09617"},{"issue":"4","key":"11241_CR119","doi-asserted-by":"publisher","first-page":"1352","DOI":"10.3390\/app14041352","volume":"14","author":"M Smetana","year":"2024","unstructured":"Smetana M, De Salles LS, Sukharev I, Khazanovich L (2024) Highway construction safety analysis using large language models. Appl Sci 14(4):1352. https:\/\/doi.org\/10.3390\/app14041352","journal-title":"Appl Sci"},{"key":"11241_CR120","doi-asserted-by":"publisher","unstructured":"Sorscher B, Geirhos R, Shekhar S, Ganguli S, Morcos AS (2022) Beyond neural scaling laws: beating power law scaling via data pruning. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2206.14486","DOI":"10.48550\/arxiv.2206.14486"},{"key":"11241_CR121","doi-asserted-by":"publisher","unstructured":"Taiwo R, Bello IT, Abdulai SF, Yussif A-M, Salami BA, Saka A, Zayed T (2024) Generative AI in the construction industry: a state-of-the-art analysis. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2402.09939","DOI":"10.48550\/arxiv.2402.09939"},{"key":"11241_CR122","doi-asserted-by":"publisher","unstructured":"Talebirad Y, Nadiri A (2023) Multi-agent collaboration: harnessing the power of intelligent LLM agents. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2306.03314","DOI":"10.48550\/arxiv.2306.03314"},{"key":"11241_CR123","doi-asserted-by":"publisher","unstructured":"Tan K (2018) The framework of combining artificial intelligence and construction 3D printing in civil engineering. MATEC Web Conf 206:01008. https:\/\/doi.org\/10.1051\/matecconf\/201820601008","DOI":"10.1051\/matecconf\/201820601008"},{"key":"11241_CR124","unstructured":"Taori R, Gulrajani I, Zhang T, Dubois Y, Li X, Guestrin C, Liang P, Hashimoto TB (2023) Alpaca: a strong, replicable Instruction-following model. In: Stanford CRFM. https:\/\/crfm.stanford.edu\/2023\/03\/13\/alpaca.html"},{"key":"11241_CR125","doi-asserted-by":"publisher","unstructured":"Touvron H, Lavril T, Izacard G, Martinet X, Lachaux M-A, Lacroix T, Rozi\u00e8re B, Goyal N, Hambro E, Azhar F, Rodriguez A, Joulin A, Grave E, Lample G (2023a) LLAMA: open and efficient foundation language models. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2302.13971","DOI":"10.48550\/arxiv.2302.13971"},{"key":"11241_CR126","doi-asserted-by":"publisher","unstructured":"Touvron H, Martin L, Stone K et al (2023b) Llama 2: open foundation and fine-tuned chat models. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2307.09288","DOI":"10.48550\/arxiv.2307.09288"},{"key":"11241_CR127","doi-asserted-by":"publisher","unstructured":"Tsai Y-HH, Bai S, Yamada M, Morency L-P, Salakhutdinov R (2019) Transformer dissection: a unified understanding of transformer\u2019s attention via the lens of kernel. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.1908.11775","DOI":"10.48550\/arxiv.1908.11775"},{"issue":"9","key":"11241_CR128","doi-asserted-by":"publisher","first-page":"7121","DOI":"10.3390\/su15097121","volume":"15","author":"SMJ Uddin","year":"2023","unstructured":"Uddin SMJ, Albert A, Ovid A, Alsharef A (2023) Leveraging CHATGPT to aid construction hazard recognition and support safety education and training. Sustainability 15(9):7121. https:\/\/doi.org\/10.3390\/su15097121","journal-title":"Sustainability"},{"key":"11241_CR129","doi-asserted-by":"publisher","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.1706.03762","DOI":"10.48550\/arxiv.1706.03762"},{"key":"11241_CR130","doi-asserted-by":"publisher","unstructured":"Wang G, Xie Y, Jiang Y, Mandlekar A, Xiao C, Zhu Y, Fan L, Anandkumar A (2023) Voyager: an open-ended embodied agent with large language models. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2305.16291","DOI":"10.48550\/arxiv.2305.16291"},{"key":"11241_CR131","unstructured":"Wang J, Jiang H, Liu Y, Ma C, Zhang X, Pan Y, Liu M, Gu P, Xia S, Li W, Zhang Y, Wu Z, Liu Z, Zhong T, Ge B, Zhang T, Qiang N, Hu X, Jiang X, Zhang X, Zhang W, Shen D, Liu T, Zhang S (2024) A comprehensive review of multimodal large language models: performance and challenges across different tasks. Cornell University. Preprint at https:\/\/arxiv.org\/abs\/2408.01319"},{"key":"11241_CR132","doi-asserted-by":"publisher","unstructured":"Webson A, Pavlick E (2022) Do Prompt-Based models really understand the meaning of their prompts? In: Proceedings of the 2022 conference of the North American Chapter of the Association for Computational Linguistics: human language technologies. https:\/\/doi.org\/10.18653\/v1\/2022.naacl-main.167","DOI":"10.18653\/v1\/2022.naacl-main.167"},{"key":"11241_CR133","doi-asserted-by":"publisher","unstructured":"Wei J, Bosma M, Zhao VY, Guu K, Yu AW, Lester B, Du N, Dai AM, Le QV (2021) Finetuned language models are zero-shot learners. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2109.01652","DOI":"10.48550\/arxiv.2109.01652"},{"key":"11241_CR134","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1016\/j.autcon.2014.02.014","volume":"43","author":"TP Williams","year":"2014","unstructured":"Williams TP, Gong J (2014) Predicting construction cost overruns using text mining, numerical data and ensemble classifiers. Autom Constr 43:23\u201329. https:\/\/doi.org\/10.1016\/j.autcon.2014.02.014","journal-title":"Autom Constr"},{"key":"11241_CR135","doi-asserted-by":"publisher","unstructured":"Xie R, Yu F, Wang J, Wang Y, Zhang L (2019) Multi-level domain adaptive learning for cross-domain detection. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.1907.11484","DOI":"10.48550\/arxiv.1907.11484"},{"key":"11241_CR136","doi-asserted-by":"publisher","unstructured":"Xie Y, Yu C, Zhu T, Bai J, Gong Z, Soh H (2023) Translating natural language to planning goals with large-language models. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2302.05128","DOI":"10.48550\/arxiv.2302.05128"},{"key":"11241_CR137","doi-asserted-by":"publisher","unstructured":"Xue L, Constant N, Roberts A, Kale M, Al-Rfou R, Siddhant A, Barua A, Raffel C (2020) mT5: a massively multilingual pre-trained text-to-text transformer. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2010.11934","DOI":"10.48550\/arxiv.2010.11934"},{"key":"11241_CR138","doi-asserted-by":"publisher","unstructured":"Yang H, Siew M, Joe-Wong C (2024) An LLM-based digital twin for optimizing human-in-the loop systems. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2403.16809","DOI":"10.48550\/arxiv.2403.16809"},{"issue":"19","key":"11241_CR139","doi-asserted-by":"publisher","first-page":"8646","DOI":"10.3390\/app14198646","volume":"14","author":"H-G Yeom","year":"2024","unstructured":"Yeom H-G, An K-M (2024) A simplified query-only attention for encoder-based transformer models. Appl Sci 14(19):8646. https:\/\/doi.org\/10.3390\/app14198646","journal-title":"Appl Sci"},{"key":"11241_CR140","doi-asserted-by":"publisher","unstructured":"You H, Ye Y, Zhou T, Zhu Q, Du J (2023) Robot-enabled construction assembly with automated sequence planning based on ChatGPT: RoboGPT. arXiv Preprint. Cornell University https:\/\/doi.org\/10.48550\/arxiv.2304.11018","DOI":"10.48550\/arxiv.2304.11018"},{"key":"11241_CR141","doi-asserted-by":"publisher","first-page":"106492","DOI":"10.1016\/j.eiar.2020.106492","volume":"86","author":"KH Yu","year":"2020","unstructured":"Yu KH, Zhang Y, Li D, Montenegro-Marin CE, Kumar PM (2020) Environmental planning based on reduce, reuse, recycle and recover using artificial intelligence. Environ Impact Assess Rev 86:106492. https:\/\/doi.org\/10.1016\/j.eiar.2020.106492","journal-title":"Environ Impact Assess Rev"},{"key":"11241_CR142","doi-asserted-by":"publisher","first-page":"101474","DOI":"10.1016\/j.aei.2021.101474","volume":"51","author":"A Zabin","year":"2021","unstructured":"Zabin A, Gonz\u00e1lez VA, Zou Y, Amor R (2021) Applications of machine learning to BIM: a systematic literature review. Adv Eng Inform 51:101474. https:\/\/doi.org\/10.1016\/j.aei.2021.101474","journal-title":"Adv Eng Inform"},{"key":"11241_CR143","doi-asserted-by":"publisher","unstructured":"Zaheer M, Guruganesh G, Dubey A, Ainslie J, Alberti C, Ontanon S, Pham P, Ravula A, Wang Q, Yang L, Ahmed A (2020) Big Bird: transformers for longer sequences. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2007.14062","DOI":"10.48550\/arxiv.2007.14062"},{"key":"11241_CR145","doi-asserted-by":"publisher","first-page":"114278","DOI":"10.1016\/j.enbuild.2024.114278","volume":"313","author":"L Zhang","year":"2024","unstructured":"Zhang L, Chen Z (2024) Large Language model-based interpretable machine learning control in Building energy systems. Energy Build 313:114278. https:\/\/doi.org\/10.1016\/j.enbuild.2024.114278","journal-title":"Energy Build"},{"key":"11241_CR144","doi-asserted-by":"publisher","unstructured":"Zhang C, Kuppannagari SR, Kannan R, Prasanna VK (2019) Building HVAC scheduling using reinforcement learning via neural network based model approximation. In: Proceedings of the 6th ACM international conference on systems for energy-efficient buildings, cities, and transportation (BuildSys \u201919). https:\/\/doi.org\/10.1145\/3360322.3360861","DOI":"10.1145\/3360322.3360861"},{"key":"11241_CR146","doi-asserted-by":"publisher","first-page":"114788","DOI":"10.1016\/j.enbuild.2024.114788","volume":"323","author":"L Zhang","year":"2024","unstructured":"Zhang L, Chen Z, Ford V (2024) Advancing building energy modeling with large language models: exploration and case studies. Energy Build 323:114788. https:\/\/doi.org\/10.1016\/j.enbuild.2024.114788","journal-title":"Energy Build"},{"key":"11241_CR147","doi-asserted-by":"publisher","first-page":"105067","DOI":"10.1016\/j.autcon.2023.105067","volume":"155","author":"J Zheng","year":"2023","unstructured":"Zheng J, Fischer M (2023) Dynamic prompt-based virtual assistant framework for BIM information search. Autom Constr 155:105067. https:\/\/doi.org\/10.1016\/j.autcon.2023.105067","journal-title":"Autom Constr"},{"key":"11241_CR148","doi-asserted-by":"publisher","first-page":"105316","DOI":"10.1016\/j.autcon.2024.105316","volume":"160","author":"Y Zhong","year":"2024","unstructured":"Zhong Y, Goodfellow SD (2024) Domain-specific language models pre-trained on construction management systems corpora. Autom Constr 160:105316. https:\/\/doi.org\/10.1016\/j.autcon.2024.105316","journal-title":"Autom Constr"},{"issue":"7","key":"11241_CR149","doi-asserted-by":"publisher","first-page":"944","DOI":"10.1016\/j.autcon.2010.06.008","volume":"19","author":"Z Zhu","year":"2010","unstructured":"Zhu Z, Brilakis I (2010) Parameter optimization for automated concrete detection in image data. Autom Constr 19(7):944\u2013953. https:\/\/doi.org\/10.1016\/j.autcon.2010.06.008","journal-title":"Autom Constr"},{"key":"11241_CR150","doi-asserted-by":"publisher","unstructured":"Zong M, Krishnamachari B (2022) A survey on GPT-3. Cornell University. Preprint at https:\/\/doi.org\/10.48550\/arxiv.2212.00857","DOI":"10.48550\/arxiv.2212.00857"}],"container-title":["Artificial Intelligence Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-025-11241-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10462-025-11241-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-025-11241-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T10:35:43Z","timestamp":1750674943000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10462-025-11241-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,16]]},"references-count":148,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2025,8]]}},"alternative-id":["11241"],"URL":"https:\/\/doi.org\/10.1007\/s10462-025-11241-7","relation":{},"ISSN":["1573-7462"],"issn-type":[{"value":"1573-7462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,16]]},"assertion":[{"value":"17 April 2025","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 May 2025","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"250"}}