{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:41:25Z","timestamp":1760146885200,"version":"build-2065373602"},"reference-count":28,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2024,12,28]],"date-time":"2024-12-28T00:00:00Z","timestamp":1735344000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computation"],"abstract":"<jats:p>Natural language understanding (NLU) includes temporal text understanding, which can be complex and encompasses temporal common sense understanding. There are many challenges in comprehending common sense within a text. Currently, there is a limited number of datasets containing temporal common sense in English and there is an absence of such datasets specifically for the Arabic language. In this study, an Arabic dataset was constructed based on an available English dataset. This dataset is considered a valuable resource for the Arabic community. Consequently, different multilingual pre-trained language models (PLMs) were applied to both the English and new Arabic datasets. Based on this, the effectiveness of these models in Arabic and English is compared and discussed. After analyzing the errors, a new categorization of errors was proposed. Finally, the ability of the PLMs to understand the input text and predict temporal features was evaluated. Through this detailed categorization of errors and classification of temporal elements, this study establishes a comprehensive framework aimed at clarifying the specific challenges encountered by PLMs in temporal common sense understanding (TCU). This methodology underscores the urgent need for further research on PLMs\u2019 capabilities for TCU tasks.<\/jats:p>","DOI":"10.3390\/computation13010005","type":"journal-article","created":{"date-parts":[[2024,12,31]],"date-time":"2024-12-31T14:21:12Z","timestamp":1735654872000},"page":"5","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Arabic Temporal Common Sense Understanding"],"prefix":"10.3390","volume":"13","author":[{"given":"Reem","family":"Alqifari","sequence":"first","affiliation":[{"name":"College of Computer and Information Sciences, King Saud University, Riyadh 11421, Saudi Arabia"},{"name":"Department of Computer Science, University of York, York YO10 5GH, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7328-4935","authenticated-orcid":false,"given":"Hend","family":"Al-Khalifa","sequence":"additional","affiliation":[{"name":"College of Computer and Information Sciences, King Saud University, Riyadh 11421, Saudi Arabia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5957-2474","authenticated-orcid":false,"given":"Simon","family":"O\u2019Keefe","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of York, York YO10 5GH, UK"}]}],"member":"1968","published-online":{"date-parts":[[2024,12,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Sap, M., Shwartz, V., Bosselut, A., Choi, Y., and Roth, D. (2020, January 5). Commonsense Reasoning for Natural Language Processing. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: Tutorial Abstracts, Online.","DOI":"10.18653\/v1\/2020.acl-tutorials.7"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Schockaert, S., Ahn, D., Cock, M.D., and Kerre, E.E. (2006). Question Answering with Imperfect Temporal Information. Proceedings of the Flexible Query Answering Systems, Springer. Lecture Notes in Computer Science.","DOI":"10.1007\/11766254_55"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zhou, B., Khashabi, D., Ning, Q., and Roth, D. (2019, January 3\u20137). \u201cGoing on a vacation\u201d takes longer than \u201cGoing for a walk\u201d: A Study of Temporal Commonsense Understanding. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1332"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Yang, Z., Du, X., Rush, A., and Cardie, C. (2020, January 16\u201320). Improving Event Duration Prediction via Time-aware Pre-training. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, Online.","DOI":"10.18653\/v1\/2020.findings-emnlp.302"},{"key":"ref_5","unstructured":"Virgo, F., Cheng, F., and Kurohashi, S. (2022, January 20\u201325). Improving Event Duration Question Answering by Leveraging Existing Temporal Information Extraction Data. Proceedings of the Thirteenth Language Resources and Evaluation Conference, Marseille, France."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Zhou, B., Ning, Q., Khashabi, D., and Roth, D. (2020, January 5\u201310). Temporal Common Sense Acquisition with Minimal Supervision. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.678"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Habash, N. (2010). Introduction to Arabic Natural Language Processing, Morgan & Claypool Publishers. Synthesis Lectures on Human Language Technologies.","DOI":"10.1007\/978-3-031-02139-8"},{"key":"ref_8","first-page":"358","article-title":"A Hybrid Approach for the Morpho-Lexical Disambiguation of Arabic","volume":"12","author":"Bousmaha","year":"2016","journal-title":"J. Inf. Process. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Boudaa, T., El Marouani, M., and Enneya, N. (2018, January 4\u20135). Arabic Temporal Expression Tagging and Normalization. Proceedings of the Big Data, Cloud and Applications, Kenitra, Morocco.","DOI":"10.1007\/978-3-319-96292-4_43"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"832","DOI":"10.1145\/182.358434","article-title":"Maintaining Knowledge about Temporal Intervals","volume":"26","author":"Allen","year":"1983","journal-title":"Commun. ACM"},{"key":"ref_11","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2\u20137). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, MN, USA."},{"key":"ref_12","unstructured":"Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kaddari, Z., Mellah, Y., Berrich, J., Bouchentouf, T., and Belkasmi, M.G. (2020, January 9\u201311). Applying the T5 language model and duration units normalization to address temporal common sense understanding on the MCTACO dataset. Proceedings of the 2020 International Conference on Intelligent Systems and Computer Vision (ISCV), Fez, Morocco.","DOI":"10.1109\/ISCV49265.2020.9204142"},{"key":"ref_14","first-page":"140","article-title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","volume":"21","author":"Raffel","year":"2019","journal-title":"J. Mach. Learn. Res."},{"key":"ref_15","unstructured":"He, P., Gao, J., and Chen, W. (2023, January 1\u20135). DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing. Proceedings of the Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda."},{"key":"ref_16","unstructured":"Clark, K., Luong, M.T., Le, Q.V., and Manning, C.D. (2020, January 26\u201330). ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators. Proceedings of the 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Han, R., Ren, X., and Peng, N. (2021, January 7\u201311). ECONET: Effective Continual Pretraining of Language Models for Event Temporal Reasoning. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Online and Punta Cana, Dominican Republic.","DOI":"10.18653\/v1\/2021.emnlp-main.436"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kimura, M., Pereira, L.K., and Kobayashi, I. (December, January 29). Effective Masked Language Modeling for Temporal Commonsense Reasoning. Proceedings of the 2022 Joint 12th International Conference on Soft Computing and Intelligent Systems and 23rd International Symposium on Advanced Intelligent Systems (SCIS&ISIS), Ise, Japan.","DOI":"10.1109\/SCISISIS55246.2022.10002012"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kimura, M., Kanashiro Pereira, L., and Kobayashi, I. (2022, January 20). Toward Building a Language Model for Understanding Temporal Commonsense. Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing: Student Research Workshop, Online.","DOI":"10.18653\/v1\/2022.aacl-srw.3"},{"key":"ref_20","unstructured":"Kimura, M., Kanashiro Pereira, L., and Kobayashi, I. (2021, January 2\u20133). Towards a Language Model for Temporal Commonsense Reasoning. Proceedings of the Student Research Workshop Associated with RANLP 2021, Online."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Pereira, L., Cheng, F., Asahara, M., and Kobayashi, I. (2021, January 5\u20137). ALICE++: Adversarial Training for Robust and Effective Temporal Reasoning. Proceedings of the 35th Pacific Asia Conference on Language, Information and Computation, Shanghai, China.","DOI":"10.18653\/v1\/2020.repl4nlp-1.8"},{"key":"ref_22","unstructured":"Tawalbeh, S., and AL-Smadi, M. (2020). Is this sentence valid? An Arabic Dataset for Commonsense Validation. arXiv."},{"key":"ref_23","unstructured":"Antoun, W., Baly, F., and Hajj, H. (2020, January 12). AraBERT: Transformer-based Model for Arabic Language Understanding. Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection, Marseille, France."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Alammary, A.S. (2022). BERT Models for Arabic Text Classification: A Systematic Review. Appl. Sci., 12.","DOI":"10.3390\/app12115720"},{"key":"ref_25","unstructured":"Inoue, G., Alhafni, B., Baimukan, N., Bouamor, H., and Habash, N. (2021, January 9). The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models. Proceedings of the Sixth Arabic Natural Language Processing Workshop, Kyiv, Ukraine (Virtual)."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Shwartz, V. (2022, January 22\u201327). Good Night at 4 pm?! Time Expressions in Different Cultures. Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, Dublin, Ireland.","DOI":"10.18653\/v1\/2022.findings-acl.224"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Huang, P., Bu, J., Chen, C., and Kang, Z. (September, January 30). Question Classification via Multiclass Kernel-based Vector Machines. Proceedings of the 2007 International Conference on Natural Language Processing and Knowledge Engineering, Beijing, China.","DOI":"10.1109\/NLPKE.2007.4368052"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"5412","DOI":"10.1016\/j.ins.2011.07.047","article-title":"A survey on question answering technology from an information retrieval perspective","volume":"181","author":"Kolomiyets","year":"2011","journal-title":"Inf. Sci."}],"container-title":["Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3197\/13\/1\/5\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:55:23Z","timestamp":1760115323000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3197\/13\/1\/5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,28]]},"references-count":28,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,1]]}},"alternative-id":["computation13010005"],"URL":"https:\/\/doi.org\/10.3390\/computation13010005","relation":{},"ISSN":["2079-3197"],"issn-type":[{"type":"electronic","value":"2079-3197"}],"subject":[],"published":{"date-parts":[[2024,12,28]]}}}