{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T16:07:06Z","timestamp":1779379626694,"version":"3.53.1"},"reference-count":34,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T00:00:00Z","timestamp":1779321600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>Technical debt (TD) poses a significant systemic risk in aerospace systems engineering, yet existing frameworks inadequately address debt irreversibility at hardware\u2013software integration boundaries. Current detection approaches operate on structured code artifacts rather than the unstructured test and evaluation (T&amp;E) documentation where integration debt often becomes visible. This paper presents the Technical Debt Management Framework (TDMF), a proof-of-concept architecture for identifying, quantifying, and prioritizing TD across the systems engineering lifecycle. The TDMF proposes an integrative architecture combining leading indicator (LI) monitoring with an AI detection module using large language model (LLM) analysis to surface debt indicators within unstructured aerospace documentation. The framework is grounded in a systematic review of 143 publications and illustrated through retrospective application to the Hubble Space Telescope and Mars Climate Orbiter failures, with an Evidence Traceability Matrix bounding historical claims against hindsight bias. An initial pilot evaluation of the ATLAS prototype\u2014conducted on a single-program aerospace T&amp;E documentation using GPT-4 with expert annotation\u2014yielded a preliminary F1 score of 0.82 and an observed 45% reduction in median review time, providing initial evidence of computational feasibility within that scope. The framework is positioned as an early-stage design-science artifact at Technology Readiness Level 2\u20133. Prospective multi-program validation constitutes the required next study. This work contributes a proof-of-concept management architecture, a documented prompt engineering approach for TD classification, and a structured research agenda for empirical validation for TD classification in mission-critical systems engineering.<\/jats:p>","DOI":"10.3390\/systems14050591","type":"journal-article","created":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T15:02:27Z","timestamp":1779375747000},"page":"591","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["An AI-Enhanced Technical Debt Management Framework for Aerospace and Defense Systems Engineering: Framework Design and Illustrative Application"],"prefix":"10.3390","volume":"14","author":[{"given":"Zakaria","family":"Ouzzif","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, Worcester Polytechnic Institute, Worcester, MA 01609, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9869-2137","authenticated-orcid":false,"given":"Shamsnaz V.","family":"Bhada","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Worcester Polytechnic Institute, Worcester, MA 01609, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,5,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Cunningham, W. (1992). The WyCash Portfolio Management System. Addendum to the Proceedings on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA \u201892), Vancouver, BC, Canada, 18\u201322 October 1992, ACM.","DOI":"10.1145\/157709.157715"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Campagna, J.M., and Bhada, S.V. (2024). Strategic Adoption of Digital Innovations Leading to Digital Transformation: A Literature Review and Discussion. Systems, 12.","DOI":"10.3390\/systems12040118"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ottaviani, F.M., De Marco, A., Rafele, C., and Castelblanco, G. (2024). Risk Perception-Based Project Contingency Management Framework. Systems, 12.","DOI":"10.3390\/systems12030093"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/sys.20017","article-title":"Requirements development, verification, and validation exhibited in famous failures","volume":"8","author":"Bahill","year":"2005","journal-title":"Syst. Eng."},{"key":"ref_5","unstructured":"Allen, L., Angel, R., Mangus, J.D., Rodney, G.A., Shannon, R.R., and Spoelhof, C.P. (2025, February 01). The Hubble Space Telescope Optical Systems Failure Report, Available online: https:\/\/ntrs.nasa.gov\/citations\/19910003124."},{"key":"ref_6","unstructured":"NASA Mars Climate Orbiter Mishap Investigation Board (2025, February 01). Mars Climate Orbiter Mishap Investigation Board Phase I Report, Available online: https:\/\/llis.nasa.gov\/llis_lib\/pdf\/1009464main1_0641-mr.pdf."},{"key":"ref_7","unstructured":"Yang, Y., Verma, D., and Anton, P.S. (2022). Technical Debt in the Engineering of Complex Systems, RAND Corporation. Report No. RR-A1257-1."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1002\/sys.21681","article-title":"Technical debt in systems engineering\u2014A systematic literature review","volume":"26","author":"Kleinwaks","year":"2023","journal-title":"Syst. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1109\/2.962984","article-title":"Software Defect Reduction Top 10 List","volume":"34","author":"Boehm","year":"2001","journal-title":"Computer"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Deissenboeck, F., Juergens, E., Lochmann, K., and Wagner, S. (2009). Software quality models: Purposes, usage scenarios and requirements. Proceedings of the ICSE Workshop on Software Quality (WoSQ 2009), Vancouver, BC, Canada, 18 May 2009, IEEE.","DOI":"10.1109\/WOSQ.2009.5071551"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/j.jss.2014.12.027","article-title":"A systematic mapping study on technical debt and its management","volume":"101","author":"Li","year":"2015","journal-title":"J. Syst. Softw."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MS.2012.167","article-title":"Technical Debt: From Metaphor to Theory and Practice","volume":"29","author":"Kruchten","year":"2012","journal-title":"IEEE Softw."},{"key":"ref_13","first-page":"111797","article-title":"Architectural Technical Debt\u2014A Systematic Mapping Study","volume":"205","author":"Sousa","year":"2023","journal-title":"J. Syst. Softw."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bi, F., Vogel-Heuser, B., and Sapera, E.B. (2023). Towards an Interdisciplinary Technical Debt Interaction and Visualization Tool. Proceedings of the 6th IEEE International Conference on Industrial Cyber-Physical Systems (ICPS 2023), Wuhan, China, 22\u201325 May 2023, IEEE.","DOI":"10.1109\/ICPS58381.2023.10128069"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/s11740-019-00897-0","article-title":"Technical Debt as an indicator for weaknesses in engineering of automated production systems","volume":"13","author":"Dong","year":"2019","journal-title":"Prod. Eng. Res. Devel."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Rosser, L.A., and Ouzzif, Z. (2021). Technical Debt in Hardware Systems and Elements. Proceedings of the 2021 IEEE Aerospace Conference (AEROCONF 2021), Big Sky, MT, USA, 6\u201313 March 2021, IEEE.","DOI":"10.1109\/AERO50100.2021.9438332"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1109\/OJSE.2023.3316395","article-title":"Ontology for Technical Debt in Systems Engineering","volume":"1","author":"Kleinwaks","year":"2023","journal-title":"IEEE Open J. Syst. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1002\/sys.20105","article-title":"Systems engineering leading indicators for assessing program and technical effectiveness during concept development","volume":"12","author":"Rhodes","year":"2009","journal-title":"Syst. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"943","DOI":"10.1109\/32.177364","article-title":"Orthogonal Defect Classification\u2014A Concept for In-Process Measurements","volume":"18","author":"Chillarege","year":"1992","journal-title":"IEEE Trans. Softw. Eng."},{"key":"ref_20","first-page":"2503","article-title":"Hidden Technical Debt in Machine Learning Systems","volume":"Volume 28","author":"Cortes","year":"2015","journal-title":"Advances in Neural Information Processing Systems"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1007\/s10664-022-10128-3","article-title":"Automatic identification of self-admitted technical debt from four different sources","volume":"27","author":"Li","year":"2022","journal-title":"Empir. Softw. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sklavenitis, D., and Kalles, D. (2025). A Scoping Review and Assessment Framework for Technical Debt in the Development and Operation of AI\/ML Competition Platforms. Appl. Sci., 15.","DOI":"10.3390\/app15137165"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ouzzif, Z., and Bhada, S. (2024). Introducing Technical Debt Link to Leading Indicators in Test and Evaluation Phase of Systems Engineering\u2014A Thought Experiment. Proceedings of the 21st Conference on Systems Engineering Research (CSER 2023), Hoboken, NJ, USA, 16\u201317 March 2023, Springer.","DOI":"10.1007\/978-3-031-49179-5_16"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Leveson, N.G. (2011). Engineering a Safer World: Systems Thinking Applied to Safety, MIT Press.","DOI":"10.7551\/mitpress\/8179.001.0001"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"75","DOI":"10.2307\/25148625","article-title":"Design Science in Information Systems Research","volume":"28","author":"Hevner","year":"2004","journal-title":"MIS Q."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"45","DOI":"10.2753\/MIS0742-1222240302","article-title":"A Design Science Research Methodology for Information Systems Research","volume":"24","author":"Peffers","year":"2007","journal-title":"J. Manag. Inf. Syst."},{"key":"ref_27","unstructured":"Kitchenham, B., and Charters, S. (2007). Guidelines for Performing Systematic Literature Reviews in Software Engineering, Department of Computer Science, University of Durham. EBSE Technical Report EBSE-2007-01."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yang, Y., Boehm, B., and Wu, D. (2006). COCOTS Risk Analyzer. Proceedings of the Fifth International Conference on COTS-Based Software Systems (ICCBSS 2006), Orlando, FL, USA, 14\u201316 February 2006, IEEE.","DOI":"10.1109\/ICCBSS.2006.8"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1109\/TSE.1976.233837","article-title":"A Complexity Measure","volume":"2","author":"McCabe","year":"1976","journal-title":"IEEE Trans. Softw. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lami, G., and Spagnolo, G. (2022). Technical Debt Management in Automotive Software Industry. Proceedings of the 2022 48th Euromicro Conference on Software Engineering and Advanced Applications (SEAA 2022), Gran Canaria, Spain, 31 August\u20132 September 2022, IEEE.","DOI":"10.1109\/SEAA56994.2022.00053"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Klinger, T., Tarr, P., Wagstrom, P., and Williams, C. (2011). An enterprise perspective on technical debt. Proceedings of the 2nd Workshop on Managing Technical Debt (MTD \u201811), Honolulu, HI, USA, 21 May 2011, ACM.","DOI":"10.1145\/1985362.1985371"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Stochel, M., \u015amieta\u0144ski, M., and Smagowicz, J. (2022). Technical Debt Prioritization and Management in Telecommunication Applications. Appl. Sci., 12.","DOI":"10.3390\/app122211347"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1016\/j.jom.2007.06.007","article-title":"Six Sigma: Definition and underlying theory","volume":"26","author":"Schroeder","year":"2008","journal-title":"J. Oper. Manag."},{"key":"ref_34","unstructured":"Friedenthal, S., Moore, A., and Steiner, R. (2014). A Practical Guide to SysML: The Systems Modeling Language, Morgan Kaufmann. [3rd ed.]."}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/14\/5\/591\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T15:32:46Z","timestamp":1779377566000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/14\/5\/591"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,21]]},"references-count":34,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2026,5]]}},"alternative-id":["systems14050591"],"URL":"https:\/\/doi.org\/10.3390\/systems14050591","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,21]]}}}