{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T09:46:59Z","timestamp":1775641619186,"version":"3.50.1"},"reference-count":46,"publisher":"Wiley","issue":"3","license":[{"start":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T00:00:00Z","timestamp":1773619200000},"content-version":"vor","delay-in-days":15,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,3,1]],"date-time":"2026-03-01T00:00:00Z","timestamp":1772323200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"funder":[{"DOI":"10.13039\/501100002946","name":"Deutsches Zentrum f\u00fcr Luft- und Raumfahrt","doi-asserted-by":"publisher","award":["50RM2100A"],"award-info":[{"award-number":["50RM2100A"]}],"id":[{"id":"10.13039\/501100002946","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["J Software Evolu Process"],"published-print":{"date-parts":[[2026,3]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:p>In regulated domains such as aerospace or automotive software, compliance with standards like ECSS and ISO\/IEC 26262 is mandatory to ensure safety and reliability. Artifacts, such as process or product models, lay the foundation for planning and managing development projects, as well as for measurement and evaluation tasks. Manually extracting such artifacts from PDF\u2010based standards is time\u2010consuming and error\u2010prone. To address this issue, we developed a large language model (LLM)\u2010based approach for automatically generating artifact models from standards. However, the evolution of AI models constitutes a challenge, since the extraction results might differ when updating the LLM to a newer version. In this article, we present an enhanced approach that strengthens the artifact\u2010generation process against such challenges. The approach generates machine\u2010readable artifact models that allow for automated measurement systems, for example, for monitoring compliance and controlling complex projects. The performance of the artifact model generation was evaluated using the ECSS standards from the aerospace domain and resulted in an average completeness of 100.00% and an average precision of 71.33% of the generated models.<\/jats:p>","DOI":"10.1002\/smr.70093","type":"journal-article","created":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T08:51:39Z","timestamp":1773651099000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Robust AI\u2010Driven Artifact Model Generation for Development Standards in Regulated Domains"],"prefix":"10.1002","volume":"38","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-3868-5789","authenticated-orcid":false,"given":"Philipp","family":"Straub","sequence":"first","affiliation":[{"name":"Reutlingen University Herman Hollerith Center  B\u00f6blingen Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mustafa","family":"B\u00fclb\u00fcl","sequence":"additional","affiliation":[{"name":"TRUMPF SE + Co. KG  Ditzingen Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-7628-9533","authenticated-orcid":false,"given":"Robin","family":"Korfmann","sequence":"additional","affiliation":[{"name":"Reutlingen University Herman Hollerith Center  B\u00f6blingen Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J\u00fcrgen","family":"M\u00fcnch","sequence":"additional","affiliation":[{"name":"Reutlingen University Herman Hollerith Center  B\u00f6blingen Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6101-8931","authenticated-orcid":false,"given":"Marco","family":"Kuhrmann","sequence":"additional","affiliation":[{"name":"Reutlingen University Herman Hollerith Center  B\u00f6blingen Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2026,3,16]]},"reference":[{"key":"e_1_2_10_2_1","unstructured":"ISO\/IEC 26262\u201010:2018.Road Vehicles \u2010 Functional Safety \u2010 Part 10: Guidelines on ISO 26262. International Organization for Standardization; (2018)."},{"key":"e_1_2_10_3_1","volume-title":"ECSS\u2010E\u2010ST\u201010C: Space Engineering \u2013 Systems Engineering General Requirements","author":"ECSS Secretariat","year":"2009"},{"key":"e_1_2_10_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-019-00714-3"},{"key":"e_1_2_10_5_1","volume-title":"ECSS\u2010M\u2010ST\u201080C: Space Project Management \u2010 Risk Management","author":"ECSS Secretariat","year":"2008"},{"key":"e_1_2_10_6_1","unstructured":"ISO\/IEC 25023:2016.Systems and software Engineering \u2013 Systems and Software Quality Requirements and Evaluation (SQuaRE) \u2013 Measurement of System and Software Product Quality. International Organization for Standardization; (2016)."},{"key":"e_1_2_10_7_1","first-page":"395","volume-title":"Product\u2010Focused Software Process Improvement","author":"Guzman J. C.","year":"2024"},{"key":"e_1_2_10_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.scico.2012.03.007"},{"key":"e_1_2_10_9_1","first-page":"77","volume-title":"ICSSPACM","author":"Oliver G.","year":"2024"},{"key":"e_1_2_10_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-03673-7_21"},{"issue":"2","key":"e_1_2_10_11_1","first-page":"1","article-title":"Metrics in Automotive Software Development: A Systematic Literature Review","volume":"33","author":"Martin V.","year":"2021","journal-title":"Journal of Software: Evolution and Process"},{"key":"e_1_2_10_12_1","first-page":"272","volume-title":"Product\u2010Focused Software Process Improvement","author":"Mustafa B.","year":"2024"},{"issue":"2","key":"e_1_2_10_13_1","article-title":"How Is ChatGPTs Behavior Changing Over Time?","volume":"6","author":"Lingjiao C.","year":"2024","journal-title":"Harvard Data Science Review"},{"key":"e_1_2_10_14_1","first-page":"7320","volume-title":"2024 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Jessica E.","year":"2024"},{"key":"e_1_2_10_15_1","first-page":"325","volume-title":"Product\u2010Focused Software Process Improvement","author":"Kseniia V.","year":"2025"},{"key":"e_1_2_10_16_1","unstructured":"Secretariat ECSS.Document Tree https:\/\/ecss.nl\/standards\/ecss\u2010tree\/.2025."},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-31545-4_8"},{"key":"e_1_2_10_18_1","volume-title":"ECSS\u2010E\u2010ST\u201040C: Space Engineering \u2010 Software","author":"ECSS Secretariat","year":"2009"},{"key":"e_1_2_10_19_1","volume-title":"Software Engineering \u2010 Software Product Quality Requirements and Evaluation (SQuaRE)","author":"ISO\/IEC 25000:2005","year":"2005"},{"key":"e_1_2_10_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/11669487_13"},{"key":"e_1_2_10_21_1","volume-title":"Knowledge Science \u2013 Grundlagen, Methoden der K\u00fcnstlichen Intelligenz f\u00fcr die Wissensextraktion aus Texten","author":"Carsten L.","year":"2023"},{"key":"e_1_2_10_22_1","doi-asserted-by":"publisher","DOI":"10.1177\/0165551509360123"},{"key":"e_1_2_10_23_1","doi-asserted-by":"publisher","DOI":"10.1002\/iis2.12997"},{"key":"e_1_2_10_24_1","unstructured":"H.Ridong P.Tao C.Yang B.Wang L.Lu X.Wan.Is Information Extraction Solved by ChatGPT? An Analysis of Performance Evaluation Criteria Robustness and Errors https:\/\/doi.org\/10.48550\/ARXIV.2305.14450.2023."},{"key":"e_1_2_10_25_1","unstructured":"L.Bo F.Gexiang Y.Yang et\u00a0al. Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance Explainability Calibration and Faithfulness https:\/\/doi.org\/10.48550\/ARXIV.2304.11633.2023."},{"key":"e_1_2_10_26_1","first-page":"183","volume-title":"Proceedings of the 2023 6th International Conference on Algorithms, Computing and Artificial Intelligence (ACAI\u201923)","author":"Vijayan A.","year":"2024"},{"key":"e_1_2_10_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.health.2024.100378"},{"key":"e_1_2_10_28_1","first-page":"1877","volume-title":"Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems","author":"Brown T.","year":"2020"},{"key":"e_1_2_10_29_1","first-page":"3816","volume-title":"In\u2009Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing","author":"Gao T.","year":"2021"},{"key":"e_1_2_10_30_1","first-page":"1","volume-title":"AIMLSystems 2024","author":"Isha S.","year":"2024"},{"key":"e_1_2_10_31_1","unstructured":"H.Yaojie Z.Qiang C.Qihong et\u00a0al. QualityFlow: An Agentic Workflow for Program Synthesis Controlled by LLM Quality Checks https:\/\/doi.org\/10.48550\/arXiv.2501.17167.2025."},{"key":"e_1_2_10_32_1","first-page":"1","volume-title":"2024 8th SLAAI International Conference on Artificial Intelligence (SLAAI\u2010ICAI)","author":"Hasali E.","year":"2024"},{"key":"e_1_2_10_33_1","first-page":"2314","volume-title":"Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering","author":"Luciano B.","year":"2024"},{"key":"e_1_2_10_34_1","first-page":"1","volume-title":"In\u2009Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology","author":"Shankar S.","year":"2024"},{"key":"e_1_2_10_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3640544.3645216"},{"key":"e_1_2_10_36_1","first-page":"36","volume-title":"Perspectives in Business Informatics Research","author":"Kurt S.","year":"2024"},{"key":"e_1_2_10_37_1","first-page":"952","volume-title":"In\u2009Proceedings of the 30th International Conference on Intelligent User Interfaces","author":"Szymanski A.","year":"2025"},{"issue":"2","key":"e_1_2_10_38_1","first-page":"224","article-title":"Accuracy of ChatGPT 3.5, 4.0, 4o and Gemini in Diagnosing Oral Potentially Malignant Lesions Based on Clinical Case Reports and Image Recognition","volume":"30","author":"Pragya P.","year":"2025","journal-title":"Medicina Oral, Patolog\u00eda Oral y Cirug\u00eda Bucal"},{"key":"e_1_2_10_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejrad.2024.111842"},{"key":"e_1_2_10_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29044-2_1"},{"key":"e_1_2_10_41_1","volume-title":"ECSS\u2010M\u2010ST\u201010C: Space Project Management \u2013 Project Planning and Implementation","author":"ECSS Secretariat","year":"2009"},{"key":"e_1_2_10_42_1","volume-title":"ECSS\u2010Q\u2010ST\u201010C: Space Product Assurance \u2013 Product Assurance Management","author":"ECSS Secretariat","year":"2009"},{"key":"e_1_2_10_43_1","volume-title":"ECSS\u2010E\u2010ST\u201040C: Space Engineering \u2010 Software","author":"ECSS Secretariat","year":"2025"},{"key":"e_1_2_10_44_1","volume-title":"Experimentation in Software Engineering","author":"Claes W.","year":"2012"},{"key":"e_1_2_10_45_1","volume-title":"Managing Successful Projects With PRINCE2","author":"AXELOS","year":"2017"},{"key":"e_1_2_10_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/IV64158.2025.11097503"},{"key":"e_1_2_10_47_1","doi-asserted-by":"publisher","DOI":"10.3390\/app14031046"}],"container-title":["Journal of Software: Evolution and Process"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/smr.70093","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/smr.70093","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/smr.70093","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T08:51:49Z","timestamp":1775638309000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/smr.70093"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3]]},"references-count":46,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,3]]}},"alternative-id":["10.1002\/smr.70093"],"URL":"https:\/\/doi.org\/10.1002\/smr.70093","archive":["Portico"],"relation":{},"ISSN":["2047-7473","2047-7481"],"issn-type":[{"value":"2047-7473","type":"print"},{"value":"2047-7481","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3]]},"assertion":[{"value":"2025-06-10","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-02-26","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-03-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70093"}}