{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T04:31:20Z","timestamp":1787027480248,"version":"3.56.0"},"reference-count":83,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,1,31]],"date-time":"2025-01-31T00:00:00Z","timestamp":1738281600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["GRK 2839"],"award-info":[{"award-number":["GRK 2839"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["KR 5148\/3-1"],"award-info":[{"award-number":["KR 5148\/3-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["KR 5148\/5-1"],"award-info":[{"award-number":["KR 5148\/5-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["SCHI 1482\/3-1"],"award-info":[{"award-number":["SCHI 1482\/3-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:p>Understanding how language and linguistic constructions are processed in the brain is a fundamental question in cognitive computational neuroscience. In this study, we investigate the processing and representation of Argument Structure Constructions (ASCs) in the BERT language model, extending previous analyses conducted with Long Short-Term Memory (LSTM) networks. We utilized a custom GPT-4 generated dataset comprising 2000 sentences, evenly distributed among four ASC types: transitive, ditransitive, caused-motion, and resultative constructions. BERT was assessed using the various token embeddings across its 12 layers. Our analyses involved visualizing the embeddings with Multidimensional Scaling (MDS) and t-Distributed Stochastic Neighbor Embedding (t-SNE), and calculating the Generalized Discrimination Value (GDV) to quantify the degree of clustering. We also trained feedforward classifiers (probes) to predict construction categories from these embeddings. Results reveal that CLS token embeddings cluster best according to ASC types in layers 2, 3, and 4, with diminished clustering in intermediate layers and a slight increase in the final layers. Token embeddings for DET and SUBJ showed consistent intermediate-level clustering across layers, while VERB embeddings demonstrated a systematic increase in clustering from layer 1 to 12. OBJ embeddings exhibited minimal clustering initially, which increased substantially, peaking in layer 10. Probe accuracies indicated that initial embeddings contained no specific construction information, as seen in low clustering and chance-level accuracies in layer 1. From layer 2 onward, probe accuracies surpassed 90 percent, highlighting latent construction category information not evident from GDV clustering alone. Additionally, Fisher Discriminant Ratio (FDR) analysis of attention weights revealed that OBJ tokens had the highest FDR scores, indicating they play a crucial role in differentiating ASCs, followed by VERB and DET tokens. SUBJ, CLS, and SEP tokens did not show significant FDR scores. Our study underscores the complex, layered processing of linguistic constructions in BERT, revealing both similarities and differences compared to recurrent models like LSTMs. Future research will compare these computational findings with neuroimaging data during continuous speech perception to better understand the neural correlates of ASC processing. This research demonstrates the potential of both recurrent and transformer-based neural language models to mirror linguistic processing in the human brain, offering valuable insights into the computational and neural mechanisms underlying language understanding.<\/jats:p>","DOI":"10.3389\/frai.2025.1477246","type":"journal-article","created":{"date-parts":[[2025,1,31]],"date-time":"2025-01-31T01:41:15Z","timestamp":1738287675000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Analysis of argument structure constructions in the large language model BERT"],"prefix":"10.3389","volume":"8","author":[{"given":"Pegah","family":"Ramezani","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Achim","family":"Schilling","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patrick","family":"Krauss","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,1,31]]},"reference":[{"key":"B1","unstructured":"Spacy-Industrial-Strength Natural Language Processing in Python\n          \n          2017"},{"key":"B2","article-title":"Understanding intermediate layers using linear classifier probes","author":"Alain","year":"2016","journal-title":"arXiv [Preprint]"},{"key":"B3","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1162\/coli_a_00422","article-title":"Probing classifiers: promises, shortcomings, and advances","volume":"48","author":"Belinkov","year":"2022","journal-title":"Comput. Linguist"},{"key":"B4","first-page":"243","article-title":"\u201cA construction grammar corpus of varying schematicity: a dataset for the evaluation of abstractions in language models,\u201d","author":"Bonial","year":"2024","journal-title":"Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.acl-long.14","article-title":"A method for studying semantic construal in grammatical constructions with interpretable contextual embedding spaces","author":"Chronis","year":"2023","journal-title":"arXiv"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-4828","article-title":"What does bert look at? an analysis of bert's attention","author":"Clark","year":"2019","journal-title":"arXiv"},{"key":"B7","doi-asserted-by":"publisher","first-page":"8514","DOI":"10.1523\/JNEUROSCI.1503-22.2022","article-title":"Recent advances at the interface of neuroscience and artificial neural networks","volume":"42","author":"Cohen","year":"2022","journal-title":"J. Neurosci"},{"key":"B8","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1007\/978-3-540-33037-0_14","article-title":"\u201cMultidimensional scaling,\u201d","volume-title":"Handbook of Data Visualization","author":"Cox","year":"2008"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1810.04805","article-title":"Bert: Pre-training of deep bidirectional transformers for language understanding","author":"Devlin","year":"2018","journal-title":"arXiv"},{"key":"B10","first-page":"213","article-title":"\u201cKnowledge of language: its nature, origin, and use,\u201d","author":"Fujita","year":"1989","journal-title":"The Convergence Series"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctvc772nn","author":"Goldberg","year":"2019","journal-title":"Explain Me This"},{"key":"B12","volume-title":"Constructions: A Construction Grammar Approach to Argument Structure","author":"Goldberg","year":"1995"},{"key":"B13","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1016\/S1364-6613(03)00080-9","article-title":"Constructions: a new theoretical approach to language","volume":"7","author":"Goldberg","year":"2003","journal-title":"Trends Cogn. Sci"},{"key":"B14","volume-title":"Constructions at Work: The Nature of Generalization in Language","author":"Goldberg","year":"2006"},{"key":"B15","author":"Goldberg","year":"2009","journal-title":"The Nature of Generalization in Language"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.coling-main.342","article-title":"How far does bert look at distance-based clustering and analysis of bert \u2032 s attention","author":"Guan","year":"2020","journal-title":"arXiv"},{"key":"B17","doi-asserted-by":"crossref","DOI":"10.25080\/TCWV9851","volume-title":"Exploring network structure, dynamics, and function using NetworkX","author":"Hagberg","year":"2008"},{"key":"B18","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1038\/s41586-020-2649-2","article-title":"Array programming with NumPy","volume":"585","author":"Harris","year":"2020","journal-title":"Nature"},{"key":"B19","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.neuron.2017.06.011","article-title":"Neuroscience-inspired artificial intelligence","volume":"95","author":"Hassabis","year":"2017","journal-title":"Neuron"},{"key":"B20","doi-asserted-by":"publisher","first-page":"2533","DOI":"10.1007\/s00426-021-01591-6","article-title":"Modelling concrete and abstract concepts using brain-constrained deep neural networks","volume":"86","author":"Henningsen-Schomers","year":"2022","journal-title":"Psychol. Res"},{"key":"B21","first-page":"4129","article-title":"\u201cA structural probe for finding syntax in word representations,\u201d","author":"Hewitt","year":"2019","journal-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput"},{"key":"B23","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1109\/MCSE.2007.55","article-title":"Matplotlib: A 2D graphics environment","volume":"9","author":"Hunter","year":"2007","journal-title":"Comp. Sci. Eng"},{"key":"B24","article-title":"Attention is not explanation","author":"Jain","year":"2019","journal-title":"arXiv [Preprint]"},{"key":"B25","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/P19-1356","article-title":"\u201cWhat does bert learn about the structure of language?,\u201d","author":"Jawahar","year":"2019","journal-title":"ACL 2019-57th Annual Meeting of the Association for Computational Linguistics"},{"key":"B26","article-title":"\u201cRobust fisher discriminant analysis,\u201d","author":"Kim","year":"2005","journal-title":"Advances in Neural Information Processing Systems"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1445","article-title":"Revealing the dark secrets of bert","author":"Kovaleva","year":"2019","journal-title":"arXiv"},{"key":"B28","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-662-67179-5","volume-title":"K\u00fcnstliche Intelligenz und Hirnforschung: Neuronale Netze, Deep Learning und die Zukunft der Kognition","author":"Krauss","year":"2023"},{"key":"B29","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-662-68980-6","volume-title":"Artificial Intelligence and Brain Research: Neural Networks, Deep Learning and the Future of Cognition","author":"Krauss","year":"2024"},{"key":"B30","doi-asserted-by":"publisher","first-page":"100064","DOI":"10.1016\/j.nbscr.2021.100064","article-title":"Analysis and visualization of sleep stages based on deep neural networks","volume":"10","author":"Krauss","year":"2021","journal-title":"Neurobiol. Sleep Circad. Rhythms"},{"key":"B31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-018-23765-w","article-title":"A statistical method for analyzing and comparing spatiotemporal cortical activation patterns","volume":"8","author":"Krauss","year":"","journal-title":"Sci. Rep"},{"key":"B32","doi-asserted-by":"publisher","first-page":"64","DOI":"10.3389\/fncom.2019.00064","article-title":"Recurrence resonance in three-neuron motifs","volume":"13","author":"Krauss","year":"","journal-title":"Front. Comput. Neurosci"},{"key":"B33","doi-asserted-by":"publisher","first-page":"121","DOI":"10.3389\/fnhum.2018.00121","article-title":"Analysis of multichannel eeg patterns during human sleep: a novel approach","volume":"12","author":"Krauss","year":"","journal-title":"Front. Hum. Neurosci"},{"key":"B34","doi-asserted-by":"publisher","first-page":"e0214541","DOI":"10.1371\/journal.pone.0214541","article-title":"Weight statistics controls dynamics in recurrent neural networks","volume":"14","author":"Krauss","year":"","journal-title":"PLoS ONE"},{"key":"B35","doi-asserted-by":"publisher","first-page":"5","DOI":"10.3389\/fncom.2019.00005","article-title":"Analysis of structure and dynamics in three-neuron motifs","volume":"13","author":"Krauss","year":"","journal-title":"Front. Comput. Neurosci"},{"key":"B36","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1007\/BF02289694","article-title":"Nonmetric multidimensional scaling: a numerical method","volume":"29","author":"Kruskal","year":"1964","journal-title":"Psychometrika"},{"key":"B37","doi-asserted-by":"crossref","DOI":"10.4135\/9781412985130","volume-title":"Multidimensional Scaling","author":"Kruskal","year":"1978"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.acl-long.512","article-title":"Neural reality of argument structure constructions","author":"Li","year":"2022","journal-title":"arXiv"},{"key":"B39","first-page":"367","article-title":"\u201cOn quick kisses and how to make them count: A study on event construal in light verb constructions with BERT,\u201d","author":"Liu","year":"2023","journal-title":"Proceedings of the 6th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2011.04134","article-title":"CxGBERT: BERT meets construction grammar","author":"Madabushi","year":"2020","journal-title":"arXiv"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.eacl-main.20","article-title":"A discerning several thousand judgments: GPT-3 rates the article+ adjective+ numeral+ noun construction","author":"Mahowald","year":"2023","journal-title":"arXiv"},{"key":"B42","doi-asserted-by":"publisher","first-page":"876315","DOI":"10.3389\/fncom.2022.876315","article-title":"Dynamics and information import in recurrent neural networks","volume":"16","author":"Metzner","year":"2022","journal-title":"Front. Comput. Neurosci"},{"key":"B43","doi-asserted-by":"publisher","first-page":"1385","DOI":"10.1038\/s42003-021-02912-6","article-title":"Sleep as a random walk: a super-statistical analysis of eeg data across sleep stages","volume":"4","author":"Metzner","year":"2021","journal-title":"Commun. Biol"},{"key":"B44","doi-asserted-by":"publisher","first-page":"100097","DOI":"10.1016\/j.nbscr.2023.100097","article-title":"Extracting continuous sleep depth from eeg data without machine learning","volume":"14","author":"Metzner","year":"","journal-title":"Neurobiol. Sleep Circad. Rhythms"},{"key":"B45","doi-asserted-by":"publisher","first-page":"22121","DOI":"10.1038\/s41598-022-26498-z","article-title":"Classification at the accuracy limit: facing the problem of data ambiguity","volume":"12","author":"Metzner","year":"2022","journal-title":"Sci. Rep"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2301.12892","article-title":"Quantifying and maximizing the information flux in recurrent neural networks","author":"Metzner","year":"","journal-title":"arXiv"},{"key":"B47","doi-asserted-by":"publisher","first-page":"351","DOI":"10.1162\/neco_a_01651","article-title":"Quantifying and maximizing the information flux in recurrent neural networks","volume":"36","author":"Metzner","year":"2024","journal-title":"Neural Comput"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.emnlp-main.53","article-title":"Language models learn rare phenomena from less rare phenomena: The case of the missing aanns","author":"Misra","year":"2024","journal-title":"arXiv"},{"key":"B49","doi-asserted-by":"publisher","first-page":"1482","DOI":"10.1038\/s41587-019-0336-3","article-title":"Visualizing structure and transitions in high-dimensional biological data","volume":"37","author":"Moon","year":"2019","journal-title":"Nat. Biotechnol"},{"key":"B50","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1109\/MCSE.2007.58","article-title":"Python for scientific computing","volume":"9","author":"Oliphant","year":"2007","journal-title":"Comp. Sci. Eng"},{"key":"B51","doi-asserted-by":"publisher","first-page":"13613","DOI":"10.1609\/aaai.v35i15.17605","article-title":"The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in bert","volume":"35","author":"Pande","year":"2021","journal-title":"Proc. AAAI Conf. Artif. Intellig"},{"key":"B52","first-page":"2825","article-title":"Scikit-learn: machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res"},{"key":"B53","volume-title":"The Neuroscience of Language: On Brain Circuits of Words and Serial Order","author":"Pulverm\u00fcller","year":"2002"},{"key":"B54","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1016\/j.jneuroling.2011.03.004","article-title":"Meaning and the brain: the neurosemantics of referential, interactive, and combinatorial knowledge","volume":"25","author":"Pulverm\u00fcller","year":"2012","journal-title":"J. Neurolinguistics"},{"key":"B55","doi-asserted-by":"publisher","first-page":"102511","DOI":"10.1016\/j.pneurobio.2023.102511","article-title":"Neurobiological mechanisms for language, symbols and concepts: clues from brain-constrained deep neural networks","volume":"230","author":"Pulverm\u00fcller","year":"2023","journal-title":"Prog. Neurobiol"},{"key":"B56","doi-asserted-by":"publisher","first-page":"488","DOI":"10.1038\/s41583-021-00473-5","article-title":"Biological constraints on neural network models of cognitive function","volume":"22","author":"Pulverm\u00fcller","year":"2021","journal-title":"Nat. Rev. Neurosci"},{"key":"B57","unstructured":"Radford\n              A.\n            \n            \n              Narasimhan\n              K.\n            \n            \n              Salimans\n              T.\n            \n            \n              Sutskever\n              I.\n            \n          \n          Improving Language Understanding With Unsupervised Learning\n          \n          2018"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2408.03062","article-title":"Analysis of argument structure constructions in a deep recurrent language model","author":"Ramezani","year":"2024","journal-title":"arXiv"},{"key":"B59","doi-asserted-by":"publisher","first-page":"S15","DOI":"10.1038\/d41586-019-02212-4","article-title":"How ai and neuroscience drive each other forwards","volume":"571","author":"Savage","year":"2019","journal-title":"Nature"},{"key":"B60","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1016\/j.neunet.2021.03.035","article-title":"Quantifying the separability of data classes in neural networks","volume":"139","author":"Schilling","year":"","journal-title":"Neural Netw"},{"key":"B61","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1080\/23273798.2020.1803375","article-title":"Analysis of continuous neuronal activity evoked by natural speech with computational corpus linguistics methods","volume":"36","author":"Schilling","year":"","journal-title":"Lang, Cognit. Neurosci"},{"key":"B62","doi-asserted-by":"crossref","first-page":"7302","DOI":"10.18653\/v1\/2024.emnlp-main.415","article-title":"\u201cLeveraging pre-trained language models for linguistic analysis: A case of argument structure constructions,\u201d","author":"Sung","year":"2024","journal-title":"Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing"},{"key":"B63","doi-asserted-by":"crossref","first-page":"1481","DOI":"10.1109\/ICMLA58977.2023.00223","article-title":"\u201cWord class representations spontaneously emerge in a deep neural network trained on next word prediction,\u201d","author":"Surendra","year":"2023","journal-title":"2023 International Conference on Machine Learning and Applications (ICMLA)"},{"key":"B64","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1452","article-title":"BERT rediscovers the classical nlp pipeline","author":"Tenney","year":"","journal-title":"arXiv"},{"key":"B65","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1905.06316","article-title":"What do you learn from context? Probing for sentence structure in contextualized word representations","author":"Tenney","year":"","journal-title":"arXiv"},{"key":"B66","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1007\/BF02288916","article-title":"Multidimensional scaling: I. theory and method","volume":"17","author":"Torgerson","year":"1952","journal-title":"Psychometrika"},{"key":"B67","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1007\/s11818-019-0201-0","article-title":"Microstructure of cortical activity during sleep reflects respiratory events and state of daytime vigilance","volume":"23","author":"Traxdorf","year":"2019","journal-title":"Somnologie"},{"key":"B68","first-page":"6361","article-title":"\u201cCxLM: A construction and context-aware language model,\u201d","author":"Tseng","year":"2022","journal-title":"Proceedings of the Thirteenth Language Resources and Evaluation Conference"},{"key":"B69","doi-asserted-by":"publisher","first-page":"1423","DOI":"10.1038\/s41587-019-0330-9","article-title":"Exploring a world of a thousand dimensions","volume":"37","author":"Vallejos","year":"2019","journal-title":"Nat. Biotechnol"},{"key":"B70","first-page":"11","article-title":"Visualizing data using t-sne","volume":"9","author":"Van der Maaten","year":"2008","journal-title":"J. Mach. Learn. Res"},{"key":"B71","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1109\/MCSE.2011.37","article-title":"The numpy array: a structure for efficient numerical computation","volume":"13","author":"Van Der Walt","year":"2011","journal-title":"Comp. Sci. Eng"},{"key":"B72","article-title":"Attention is all you need","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"B73","first-page":"12937","article-title":"\u201cUsing collostructional analysis to evaluate BERT'S representation of linguistic constructions,\u201d","author":"Veenboer","year":"2023","journal-title":"Findings of the Association for Computational Linguistics: ACL 2023"},{"key":"B74","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1512.08849","article-title":"Learning natural language inference with LSTM","author":"Wang","year":"2015","journal-title":"arXiv"},{"key":"B75","doi-asserted-by":"publisher","first-page":"8696","DOI":"10.1016\/j.eswa.2011.01.077","article-title":"A feature selection method based on improved fisher's discriminant ratio for text sentiment classification","volume":"38","author":"Wang","year":"2011","journal-title":"Expert Syst. Appl"},{"key":"B76","doi-asserted-by":"publisher","first-page":"3021","DOI":"10.21105\/joss.03021","article-title":"Seaborn: statistical data visualization","volume":"6","author":"Waskom","year":"2021","journal-title":"J. Open Source Softw"},{"key":"B77","doi-asserted-by":"publisher","first-page":"e2","DOI":"10.23915\/distill.00002","article-title":"How to use T-SNE effectively","volume":"1","author":"Wattenberg","year":"2016","journal-title":"Distill"},{"key":"B78","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2302.02178","article-title":"Construction grammar provides unique insight into neural language models","author":"Weissweiler","year":"","journal-title":"arXiv"},{"key":"B79","doi-asserted-by":"crossref","first-page":"10859","DOI":"10.18653\/v1\/2022.emnlp-main.746","article-title":"\u201cThe better your syntax, the better your semantics? probing pretrained language models for the english comparative correlative,\u201d","author":"Weissweiler","year":"2022","journal-title":"Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing"},{"key":"B80","doi-asserted-by":"publisher","first-page":"1225791","DOI":"10.3389\/frai.2023.1225791","article-title":"Explaining pretrained language models' understanding of linguistic structures using construction grammar","volume":"6","author":"Weissweiler","year":"","journal-title":"Front. Artif. Intellig"},{"key":"B81","doi-asserted-by":"publisher","first-page":"1377","DOI":"10.1162\/tacl_a_00608","article-title":"How abstract is linguistic generalization in large language models? experiments with argument structure","volume":"11","author":"Wilson","year":"2023","journal-title":"Trans. Assoc. Comp. Linguist"},{"key":"B82","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.acl-long.258","article-title":"Enhancing language representation with constructional information for natural language understanding","author":"Xu","year":"2023","journal-title":"arXiv"},{"key":"B83","first-page":"3804","article-title":"\u201cConstructions are so difficult that even large language models get them right for the wrong reasons,\u201d","author":"Zhou","year":"2024","journal-title":"Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)"}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2025.1477246\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,31]],"date-time":"2025-01-31T01:41:30Z","timestamp":1738287690000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2025.1477246\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,31]]},"references-count":83,"alternative-id":["10.3389\/frai.2025.1477246"],"URL":"https:\/\/doi.org\/10.3389\/frai.2025.1477246","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,31]]},"article-number":"1477246"}}