{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T07:27:56Z","timestamp":1767338876013,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2022,9,20]],"date-time":"2022-09-20T00:00:00Z","timestamp":1663632000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>The aim of the research is to semi-automate the process of generating formal specifications from legal contracts in natural language text form. Towards this end, the paper presents a tool, named ContrattoA, that semi-automatically conducts semantic annotation of legal contract text using an ontology for legal contracts. ContrattoA was developed through two iterations where lexical patterns were defined for legal concepts and their effectiveness was evaluated with experiments. The first iteration was based on a handful of sample contracts and resulted in defining lexical patterns for recognizing concepts in the ontology; these were evaluated with an empirical study where one group of subjects was asked to annotate legal text manually, while a second group edited the annotations generated by ContrattoA. The second iteration focused on the lexical patterns for the core contract concepts of obligation and power where results of the first iteration were mixed. On the basis of an extended set of sample contracts, new lexical patterns were derived and those were shown to substantially improve the performance of ContrattoA, nearing in quality the performance of experts. The experiments suggest that good quality annotations can be generated for a broad range of contracts with minor refinements to the lexical patterns.<\/jats:p>","DOI":"10.3390\/informatics9040072","type":"journal-article","created":{"date-parts":[[2022,9,20]],"date-time":"2022-09-20T22:36:44Z","timestamp":1663713404000},"page":"72","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Semantic Annotation of Legal Contracts with ContrattoA"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8519-1034","authenticated-orcid":false,"given":"Michele","family":"Soavi","sequence":"first","affiliation":[{"name":"Department of Industrial Engineering, University of Trento, Via Sommarive 14, 38123 Trento, TN, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1296-0140","authenticated-orcid":false,"given":"Nicola","family":"Zeni","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, University of Trento, Via Sommarive 14, 38123 Trento, TN, Italy"}]},{"given":"John","family":"Mylopoulos","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering and Computer Science, University of Ottawa, 800 King Edward Ave, Ottawa, ON K1N 6N5, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0018-6883","authenticated-orcid":false,"given":"Luisa","family":"Mich","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, University of Trento, Via Sommarive 14, 38123 Trento, TN, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,20]]},"reference":[{"key":"ref_1","unstructured":"Clarke, E.M., Grumberg, O., and Peled, D.A. (2018). Model Checking, MIT Press."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1007\/s10817-018-09508-6","article-title":"OptiMathSAT: A tool for optimization modulo theories","volume":"64","author":"Sebastiani","year":"2020","journal-title":"J. Autom. Reas."},{"key":"ref_3","first-page":"2","article-title":"Smart contracts: Building blocks for digital markets","volume":"18","author":"Szabo","year":"2020","journal-title":"EXTROPY J. Transhumanist Thought"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1007\/s10506-018-9223-3","article-title":"On legal contracts, imperative and declarative smart contracts, and blockchain systems","volume":"26","author":"Governatori","year":"2018","journal-title":"Artif. Intell. Law"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s00766-013-0181-8","article-title":"GaiusT: Supporting the extraction of rights and obligations for regulatory compliance","volume":"20","author":"Zeni","year":"2015","journal-title":"Requir. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1016\/j.datak.2018.04.009","article-title":"N\u00f3mosT building large models of law with a tool-supported process","volume":"117","author":"Zeni","year":"2018","journal-title":"Data Knowl. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Soavi, M., Zeni, N., Mylopoulos, J., and Mich, L. (2020, January 25\u201327). ContracT\u2013from Legal Contracts to Formal Specifications: Preliminary Results. Proceedings of the IFIP Working Conference on the Practice of Enterprise Modeling, Riga, Latvia.","DOI":"10.1007\/978-3-030-63479-7_9"},{"key":"ref_8","unstructured":"Daskalopulu, A. (2000, January 4\u20138). Modelling legal contracts as processes. Proceedings of the 11th International Workshop on Database and Expert Systems Applications, London, UK."},{"key":"ref_9","unstructured":"Parvizimosaed, A., Sharifi, S., Amyot, D., Logrippo, L., Roveri, M., Roudak, A., Rasti, A., and Mylopoulos, J. Specification and Analysis of Legal Contracts with Symboleo, Softw. Syst. Model., in press."},{"key":"ref_10","unstructured":"Griffo, C., Almeida, J.P.A., and Guizzardi, G. (2015, January 8\u201312). Towards a legal core ontology based on Alexy\u2019s theory of fundamental rights. Proceedings of the Multilingual Workshop on Artificial Intelligence and Law, ICAIL, San Diego, CA, USA."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"28","DOI":"10.2307\/785533","article-title":"Some fundamental legal conceptions as applied in judicial reasoning","volume":"23","author":"Hohfeld","year":"1913","journal-title":"Yale Law J."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Bix, B.H. (2012). Contract Law: Rules, Theory, and Context, Cambridge University Press.","DOI":"10.1017\/CBO9781139024877"},{"key":"ref_13","unstructured":"Manning, C., and Schutze, H. (1999). Foundations of Statistical Natural Language Processing, MIT Press."},{"key":"ref_14","first-page":"25","article-title":"Can computers make contracts?","volume":"9","author":"Allen","year":"1996","journal-title":"Harvard J. Law Technol."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chalkidis, I., Androutsopoulos, I., and Michos, A. (2017, January 12\u201316). Extracting contract elements. Proceedings of the 16th edition of the International Conference on Artificial Intelligence and Law, London, UK.","DOI":"10.1145\/3086512.3086515"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Libal, T., and Pascucci, M. (2019, January 17\u201321). Automated reasoning in normative detachment structures with ideal conditions. Proceedings of the Seventeenth International Conference on Artificial Intelligence and Law, Montreal, QC, Canada.","DOI":"10.1145\/3322640.3326707"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Nijssen, S., Dulfer, D., Bollen, P., and Rozendaal, J. (2017, January 23\u201328). Meaning Based Structured Legal Code. Proceedings of the OTM Confederated International Conferences \u201cOn the Move to Meaningful Internet Systems\u201d, Rhodes, Greece.","DOI":"10.1007\/978-3-319-73805-5_20"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Bulles, J., Cartigny, B., and Bollen, P. (2017, January 23\u201328). Analyzing the new 2019 dutch environment and planning act. Proceedings of the OTM Confederated International Conferences \u201cOn the Move to Meaningful Internet Systems\u201d, Rhodes, Greece.","DOI":"10.1007\/978-3-319-73805-5_17"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Grover, C., Hachey, B., Hughson, I., and Korycinski, C. (2003, January 24\u201328). Automatic summarisation of legal documents. Proceedings of the 9th International Conference on Artificial Intelligence and Law, Edinburgh, UK.","DOI":"10.1145\/1047788.1047839"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Biagioli, C., Francesconi, E., Passerini, A., Montemagni, S., and Soria, C. (2005, January 6\u201311). Automatic semantics extraction in law documents. Proceedings of the 10th International Conference on Artificial Intelligence and Law, Bologna, Italy.","DOI":"10.1145\/1165485.1165506"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Breaux, T.D., Vail, M.W., and Anton, A.I. (2006, January 11\u201315). Towards regulatory compliance: Extracting rights and obligations to align requirements with regulations. Proceedings of the 14th IEEE International Requirements Engineering Conference (RE\u201906), St. Paul, MN, USA.","DOI":"10.1109\/RE.2006.68"},{"key":"ref_22","unstructured":"Wyner, A.Z., Peters, W., and Katz, D. (2013, January 11\u201313). A Case Study on Legal Case Annotation. Proceedings of the International Conference on Legal Knowledge and Information Systems (JURIX), Bologna, Italy."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kiyavitskaya, N., Zeni, N., Breaux, T.D., Ant\u00f3n, A.I., Cordy, J.R., Mich, L., and Mylopoulos, J. (2008, January 20\u201324). Automating the extraction of rights and obligations for regulatory compliance. Proceedings of the International Conference on Conceptual Modeling, Barcelona, Spain.","DOI":"10.1007\/978-3-540-87877-3_13"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ga\u0161par, A., Seljan, S., and Ku\u010di\u0161, V. (2022). Measuring Terminology Consistency in Translated Corpora: Implementation of the Herfindahl-Hirshman Index. Information, 13.","DOI":"10.3390\/info13020043"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Amardeilh, F., Laublet, P., and Minel, J.L. (2005, January 2\u20135). Document annotation and ontology population from linguistic extractions. Proceedings of the 3rd International Conference on Knowledge Capture, Banff, AB, Canada.","DOI":"10.1145\/1088622.1088651"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Amato, F., Mazzeo, A., Penta, A., and Picariello, A. (2008, January 4\u20137). Building RDF Ontologies from Semi-Structured Legal Documents. Proceedings of the International Conference on Complex, Intelligent and Software Intensive Systems, Barcelona, Spain.","DOI":"10.1109\/CISIS.2008.146"},{"key":"ref_27","unstructured":"Alexy, R., Rivers, J., and Rivers, P. (2002). A Theory of Constitutional Rights, Oxford University Press. Available online: https:\/\/books.google.it\/books?id=4G1U8JMSJDcC."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1016\/j.is.2015.01.012","article-title":"A commit-ment-based reference ontology for services","volume":"54","author":"Nardi","year":"2015","journal-title":"Inf. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"101454","DOI":"10.1016\/j.is.2019.101454","article-title":"Service contract modeling in enterprise architecture: An ontology-based approach","volume":"101","author":"Griffo","year":"2021","journal-title":"Inf. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Griffo, C., Almeida, J.P.A., Guizzardi, G., and Nardi, J.C. (2017, January 10\u201313). From an ontology of service contracts to contract modeling in enterprise architecture. Proceedings of the International Enterprise Distributed Object Computing Conference (EDOC), Quebec City, QC, Canada.","DOI":"10.1109\/EDOC.2017.15"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Sleimi, A., Sannier, N., Sabetzadeh, M., Briand, L., and Dann, J. (2018, January 20\u201324). Automated extraction of semantic legal metadata using natural language processing. Proceedings of the International Requirements Engineering Conference (RE\u201918), Banff, AB, Canada.","DOI":"10.1109\/RE.2018.00022"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1142\/S0218843006001529","article-title":"A formal analysis of a business contract language","volume":"15","author":"Governatori","year":"2006","journal-title":"Int. J. Coop. Inf. Syst."},{"key":"ref_33","unstructured":"Athan, T., Governatori, G., Palmirani, M., Paschke, A., and Wyner, A. (August, January 31). LegalRuleML: Design principles and foundations. Proceedings of the Rea-soning Web International Summer School, Berlin, Germany."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1142\/S0218843005001092","article-title":"Representing business contracts in RuleML","volume":"14","author":"Governatori","year":"2005","journal-title":"Int. J. Coop. Inf. Syst."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Prisacariu, C., and Schneider, G. (2009, January 8\u201312). Abstract specification of legal contracts. Proceedings of the 12th International Conference on Artificial Intelligence and Law, Barcelona, Spain.","DOI":"10.1145\/1568234.1568262"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Farmer, W.M., and Hu, Q. (2016, January 28\u201330). FCL: A formal language for writing contracts. Proceedings of the 4th IEEE International Workshop on Formal Methods Integration\u2014The IEEE FMi 2016, Pittsburgh, PA, USA.","DOI":"10.1109\/IRI.2016.25"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Dalpiaz, F., Cardoso, E., Canobbio, G., Giorgini, P., and Mylopoulos, J. (2015, January 13\u201315). Social specifications of business processes with Azzurra. Proceedings of the International Conference on Research Challenges in Information Science (RCIS), Athens, Greece.","DOI":"10.1109\/RCIS.2015.7128859"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Soavi, M., Zeni, N., Mylopoulos, J., and Mich, L. (2022, January 17\u201320). Contratto\u2014A method for transforming legal contracts into formal specifications. Proceedings of the International Conference on Research Challenges in Information Science (RCIS), Barcelona, Spain.","DOI":"10.1007\/978-3-031-05760-1_20"}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/9\/4\/72\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:34:53Z","timestamp":1760142893000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/9\/4\/72"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,20]]},"references-count":38,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["informatics9040072"],"URL":"https:\/\/doi.org\/10.3390\/informatics9040072","relation":{},"ISSN":["2227-9709"],"issn-type":[{"type":"electronic","value":"2227-9709"}],"subject":[],"published":{"date-parts":[[2022,9,20]]}}}