{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T04:10:57Z","timestamp":1775707857081,"version":"3.50.1"},"reference-count":42,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2022,10,4]],"date-time":"2022-10-04T00:00:00Z","timestamp":1664841600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"DFG within the Scientific Network \u201cTowards a holistic quality assessment for guided wave-based SHM\u201d","award":["424954879"],"award-info":[{"award-number":["424954879"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>To assess the ability of structural health monitoring (SHM) systems, a variety of prerequisites and contributing factors have to be taken into account. Within this publication, this variety is analyzed for actively introduced guided wave-based SHM systems. For these systems, it is not possible to analyze their performance without taking into account their structure and their applied system parameters. Therefore, interdependencies of performance assessment are displayed in an SHM pyramid based on the structure and its monitoring requirements. Factors influencing the quality, capability and reliability of the monitoring system are given and put into relation with state-of-the-art performance analysis in a non-destructive evaluation. While some aspects are similar and can be treated in similar ways, others, such as location, environmental condition and structural dependency, demand novel solutions. Using an open-access data set from the Open Guided Waves platform, a detailed method description and analysis of path-based performance assessment is presented.The adopted approach clearly begs the question about the decision framework, as the threshold affects the reliability of the system. In addition, the findings show the effect of the propagation path according to the damage position. Indeed, the distance of damage directly affects the system performance. Otherwise, the propagation direction does not alter the potentiality of the detection approach despite the anisotropy of composites. Nonetheless, the finite waveguide makes it necessary to look at the whole paths, as singular phenomena associated with the reflections may appear. Numerical investigation helps to clarify the centrality of wave mechanics and the necessity to take sensor position into account as an influencing factor. Starting from the findings achieved, all the issues are discussed, and potential future steps are outlined.<\/jats:p>","DOI":"10.3390\/s22197529","type":"journal-article","created":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T05:12:21Z","timestamp":1665378741000},"page":"7529","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Performance Assessment for a Guided Wave-Based SHM System Applied to a Stiffened Composite Structure"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8888-2682","authenticated-orcid":false,"given":"Inka","family":"Mueller","sequence":"first","affiliation":[{"name":"Institute for Mechanics, Bochum University of Applied Sciences, Am Hochschulcampus 1, 44801 Bochum, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1249-918X","authenticated-orcid":false,"given":"Vittorio","family":"Memmolo","sequence":"additional","affiliation":[{"name":"Aerospace Structures and Materials Laboratory, Department of Industrial Engineering, Universit\u00e0 degli Studi di Napoli Federico II, Via Claudio 21, 80125 Naples, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3971-1515","authenticated-orcid":false,"given":"Kilian","family":"Tsch\u00f6ke","sequence":"additional","affiliation":[{"name":"Fraunhofer Institute for Ceramic Technologies and Systems IKTS, Maria-Reiche-Str. 2, 01109 Dresden, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1327-0080","authenticated-orcid":false,"given":"Maria","family":"Moix-Bonet","sequence":"additional","affiliation":[{"name":"Institute of Composite Structures and Adaptive Systems, German Aerospace Center (DLR), 38108 Braunschweig, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7861-3892","authenticated-orcid":false,"given":"Kathrin","family":"M\u00f6llenhoff","sequence":"additional","affiliation":[{"name":"Mathematical Institute, Heinrich Heine University D\u00fcsseldorf, 40225 D\u00fcsseldorf, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4927-9623","authenticated-orcid":false,"given":"Mikhail","family":"Golub","sequence":"additional","affiliation":[{"name":"Institute for Mechanics, Mathematics and Computer Sciences, Kuban State University, 350040 Krasnodar, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3029-8429","authenticated-orcid":false,"given":"Ramanan Sridaran","family":"Venkat","sequence":"additional","affiliation":[{"name":"Department of Non-Destructive Testing & Quality Assurance, Saarland University, 66123 Saarbr\u00fccken, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5953-6331","authenticated-orcid":false,"given":"Yevgeniya","family":"Lugovtsova","sequence":"additional","affiliation":[{"name":"Department of Non-Destructive Testing, Bundesanstalt f\u00fcr Materialforschung und -pr\u00fcfung, Unter den Eichen 87, 12205 Berlin, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3168-2214","authenticated-orcid":false,"given":"Artem","family":"Eremin","sequence":"additional","affiliation":[{"name":"Institute for Mechanics, Mathematics and Computer Sciences, Kuban State University, 350040 Krasnodar, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2299-2250","authenticated-orcid":false,"given":"Jochen","family":"Moll","sequence":"additional","affiliation":[{"name":"Department of Physics, Goethe University Frankfurt, Max von Laue Str. 1, 60438 Frankfurt am Main, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"053001","DOI":"10.1088\/0964-1726\/25\/5\/053001","article-title":"Guided Wave Based Structural Health Monitoring: A Review","volume":"25","author":"Mitra","year":"2016","journal-title":"Smart Mater. Struct."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Olisa, S.C., Khan, M.A., and Starr, A. (2021). Review of Current Guided Wave Ultrasonic Testing (GWUT) Limitations and Future Directions. Sensors, 21.","DOI":"10.3390\/s21030811"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1225","DOI":"10.1177\/1475921717750047","article-title":"Structural health monitoring: Closing the gap between research and industrial deployment","volume":"17","author":"Cawley","year":"2018","journal-title":"Struct. Health Monit."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Moll, J., Kexel, C., Kathol, J., Fritzen, C.P., Moix-Bonet, M., Willberg, C., Rennoch, M., Koerdt, M., and Herrmann, A. (2020). Guided Waves for Damage Detection in Complex Composite Structures: The Influence of Omega Stringer and Different Reference Damage Size. Appl. Sci., 10.","DOI":"10.3390\/app10093068"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Department of Defense (2009). Department of Defense Handbook Nondestructive Evaluation System Reliability Assessment, Department of Defense. MIL-HDBK-1823A.","DOI":"10.21236\/ADA512950"},{"key":"ref_6","unstructured":"Pfeiffer, H., and Wevers, M. (2007, January 1). Pseudo-Defects for the Validation and Tuning of Structural Health Monitoring in Plate-like Structures using Lamb Waves. Proceedings of the EU Project Meeting on Aircraft Integratied Strucutral Health Assessment, Leuven, Belgium."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2349","DOI":"10.1016\/j.jsv.2009.07.020","article-title":"The use of pseudo-faults for novelty detection in SHM","volume":"329","author":"Papatheou","year":"2010","journal-title":"J. Sound Vib."},{"key":"ref_8","unstructured":"Tsch\u00f6ke, K., Gaul, T., Schubert, L., and Mueller, I. (2019, January 27\u201329). Rechnergest\u00fctzte POD-Bestimmung f\u00fcr SHM-Verfahren basierend auf gef\u00fchrten Wellen im Automobilbereich. Proceedings of the DACH Jahrestagung, Friedrichshafen, Germany."},{"key":"ref_9","unstructured":"Berthold, J., Vrana, J., Heckel, T., Kanzler, D., Jatzlau, P., and Grosse, C. (2019, January 27\u201329). Modellgest\u00fctzte Bestimmung der Fehlerauffindwahrscheinlichkeit (POD) bei der Ultraschallpr\u00fcfung gro\u00dfer Schmiedeteile. Proceedings of the DGZfP DACH-Jahrestagung, Friedrichshafen, Germany."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Cobb, A.C., Michaels, J.E., Michaels, T.E., Thompson, D.O., and Chimenti, D.E. (2009). Ultrasonic structural health monitoring: A probability of detection case study. AIP Conference Proceedings, American Institute of Physics.","DOI":"10.1063\/1.3114177"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1177\/1475921715627490","article-title":"Damage detection sensitivity characterization of acousto-ultrasound-based structural health monitoring techniques","volume":"15","author":"Janapati","year":"2016","journal-title":"Struct. Health Monit. An Int. J."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"200002","DOI":"10.1063\/1.4940646","article-title":"Best practices for evaluating the capability of nondestructive evaluation (NDE) and structural health monitoring (SHM) techniques for damage characterization","volume":"1706","author":"Aldrin","year":"2016","journal-title":"Aip Conf. Proc."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Meeker, W.Q., Roach, D., and Kessler, S.S. (2019, January 10\u201312). Statistical Methods for Probability od Detection in Structural Health Monitoring. Proceedings of the International Workshop on Structural Health Monitoring IWSHM, Stanford, CA, USA.","DOI":"10.12783\/shm2019\/32095"},{"key":"ref_14","unstructured":"Kessler, S.S., Dunn, C.T., Swindell, P., and Meeker, W. (2019, January 10\u201312). Detection Sensitivtiy Analysis for a Guided Wave (GW) Structural Health Monitoring System. Proceedings of the International Workshop on Structural Health Monitoring IWSHM, Stanford, CA, USA."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1177\/1475921717724614","article-title":"Integration of Non-Destructive Evaluation-based Ultrasonic Simulation: A means for simulation in structural health monitoring","volume":"16","author":"Boller","year":"2017","journal-title":"Struct. Health Monit. Int. J."},{"key":"ref_16","unstructured":"Woelcken, P., and Papadopoulos, M. (2015). Path-based MAPOD using Numerical Simulations. Smart Intelligent Aircraft Structures (SARISTU), Springer."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kundu, T. (2016). Model assisted probability of detection for a guided waves based SHM technique. Health Monitoring of Structural and Biological Systems 2016, SPIE.","DOI":"10.1117\/12.2219306"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Schubert Kabban, C., Uber, R., Lin, K., Lin, B., Bhuiyan, M., and Giurgiutiu, V. (2018). Uncertainty Evaluation in the Design of Structural Health Monitoring Systems for Damage Detection. Aerospace, 5.","DOI":"10.3390\/aerospace5020045"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.wavemoti.2018.07.002","article-title":"On the numerical convergence and performance of different spatial discretization techniques for transient elastodynamic wave propagation problems","volume":"82","author":"Gravenkamp","year":"2018","journal-title":"Wave Motion"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1016\/j.ymssp.2009.09.003","article-title":"A Bayesian approach to optimal sensor placement for structural health monitoring with application to active sensing","volume":"24","author":"Flynn","year":"2010","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Falcetelli, F., Yue, N., Sante, R.D., and Zarouchas, D. (2021). Probability of detection, localization, and sizing: The evolution of reliability metrics in Structural Health Monitoring. Struct. Health Monit., 14759217211060780.","DOI":"10.1177\/14759217211060780"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Yue, N., and Aliabadi, M. (2020). Hierarchical approach for uncertainty quantification and reliability assessment of guided wave-based structural health monitoring. Struct. Health Monit., 1475921720940642.","DOI":"10.1177\/1475921720940642"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"996","DOI":"10.3390\/applmech2040058","article-title":"Determination of Detection Probability and Localization Accuracy for a Guided Wave-Based Structural Health Monitoring System on a Composite Structure","volume":"2","author":"Bayoumi","year":"2021","journal-title":"Appl. Mech."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1460","DOI":"10.1177\/1475921717744679","article-title":"A model-based approach for statistical assessment of detection and localization performance of guided wave\u2013based imaging techniques","volume":"17","author":"Moriot","year":"2018","journal-title":"Struct. Health Monit."},{"key":"ref_25","unstructured":"Rizzo, P., and Milazzo, A. (2022, January 4\u20137). Performance Assessment for Artificial Intelligence-Based Data Analysis in Ultrasonic Guided Wave-Based Inspection: A Comparison to Classic Path-Based Probability of Detection. Proceedings of the European Workshop on Structural Health Monitoring, Palermo, Italy."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"448","DOI":"10.1016\/j.ymssp.2016.05.035","article-title":"Uncertainty quantification for acoustic nonlinearity parameter in Lamb wave-based prediction of barely visible impact damage in composites","volume":"82","author":"Hong","year":"2017","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_27","first-page":"20160736","article-title":"Efficient generation of receiver operating characteristics for the evaluation of damage detection in practical structural health monitoring applications","volume":"473","author":"Liu","year":"2017","journal-title":"Proc. R. Soc. A Math. Phys. Eng. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1177\/1475921716670841","article-title":"Feasibility study of a multi-parameter probability of detection formulation for a Lamb waves\u2013based structural health monitoring approach to light alloy aeronautical plates","volume":"16","author":"Gianneo","year":"2017","journal-title":"Struct. Health Monit."},{"key":"ref_29","unstructured":"Rizzo, P., and Milazzo, A. (2022, January 4\u20137). A Model-Assisted Case Study Using Data from Open Guided Waves to Evaluate the Performance of Guided Wave-Based Structural Health Monitoring Systems. Proceedings of the European Workshop on Structural Health Monitoring, Palermo, Italy."},{"key":"ref_30","unstructured":"Rytter, A. (1993). Vibrational based inspection of civil engineering structures. [Ph.D. Thesis, Department of Building Technology and Structural Engineering, Aalborg University]."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1177\/1475921712466756","article-title":"Statistically-based damage detection in geometrically-complex structures using ultrasonic interrogation","volume":"12","author":"Haynes","year":"2013","journal-title":"Struct. Health Monit."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Sturges, D.J., Gilmore, R.S., and Hovey, P.W. (1986). Estimating Probability of Detection for Subsurface Ultrasonic Inspection. Review of Progress in Quantitative Nondestructive Evaluation, Springer Science+Business Media.","DOI":"10.1007\/978-1-4615-7763-8_100"},{"key":"ref_33","unstructured":"Rummel, W.D. (2012, January 16\u201320). Nondestructive Inspection Reliability\u2014History, Status and Future Path. Proceedings of the 18th World Conference on Non-Destructive Testing, Durban, South Africa."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1824","DOI":"10.1063\/1.3114180","article-title":"Application of POD to complex industrial problems: New approaches","volume":"1096","author":"Takahashi","year":"2009","journal-title":"Aip Conf. Proc."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/17686733.2016.1229246","article-title":"Probability of detection analysis of round robin test results performed by flash thermography","volume":"14","author":"Rothbart","year":"2016","journal-title":"Quant. Infrared Thermogr. J."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.prostr.2017.07.002","article-title":"Investigations to introduce the probability of detection method for ultrasonic inspection of hollow axles at Deutsche Bahn","volume":"4","author":"Pavlovic","year":"2017","journal-title":"Procedia Struct. Integr."},{"key":"ref_37","unstructured":"Bertovic, M. (2015). Human Factors in Non-Destructive Testing (NDT): Risks and Challenges of Mechanised NDT. [Doctoral Thesis, Technische Universit\u00e4t Berlin, Fakult\u00e4t V\u2014Verkehrs- und Maschinensysteme]."},{"key":"ref_38","unstructured":"Berens, A. (1993). NDE Reliability Data Analysis. ASM Handbook: Nondestructive Evaluation and Quality Control, ASM International. [3rd ed.]. ASM Handbook."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Memmolo, V., Boffa, N., Maio, L., Monaco, E., and Ricci, F. (2018). Damage localization in composite structures using a guided waves based multi-parameter approach. Aerospace, 5.","DOI":"10.3390\/aerospace5040111"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1903","DOI":"10.1177\/1475921718817169","article-title":"Open Guided Waves: Online platform for ultrasonic guided wave measurements","volume":"18","author":"Moll","year":"2019","journal-title":"Struct. Health Monit."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Bach, M., Pouilly, A., Eckstein, B., and Moix-Bonet, M. (2017, January 5\u20138). Reference Damages for Verification of Probability of Detection with Guided Waves. Proceedings of the Structural Health Monitoring 2017, Brisbane, Australia.","DOI":"10.12783\/shm2017\/14213"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1080\/01621459.1976.10481508","article-title":"The Equivalence of Generalized Least Squares and Maximum Likelihood Estimates in the Exponential Family","volume":"71","author":"Charnes","year":"1976","journal-title":"J. Am. Stat. Assoc."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/19\/7529\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:46:32Z","timestamp":1760143592000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/19\/7529"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,4]]},"references-count":42,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["s22197529"],"URL":"https:\/\/doi.org\/10.3390\/s22197529","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,4]]}}}