{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,18]],"date-time":"2026-02-18T23:34:10Z","timestamp":1771457650526,"version":"3.50.1"},"reference-count":44,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2021,5,20]],"date-time":"2021-05-20T00:00:00Z","timestamp":1621468800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Reliable fault detection and diagnostics are crucial in order to ensure efficient operations in industrial assets. Data-driven solutions have shown great potential in various fields but pose many challenges in Prognostics and Health Management (PHM) applications: Changing external in-service factors and operating conditions cause variations in the condition monitoring (CM) data resulting in false alarms. Furthermore, novel types of faults can also cause variations in CM data. Since faults occur rarely in complex safety critical systems, a training dataset typically does not cover all possible fault types. To enable the detection of novel fault types, the models need to be sensitive to novel variations. Simultaneously, to decrease the false alarm rate, invariance to variations in CM data caused by changing operating conditions is required. We propose contrastive learning for the task of fault detection and diagnostics in the context of changing operating conditions and novel fault types. In particular, we evaluate how a feature representation trained by the triplet loss is suited to fault detection and diagnostics under the aforementioned conditions. We showcase that classification and clustering based on the learned feature representations are (1) invariant to changing operating conditions while also being (2) suited to the detection of novel fault types. Our evaluation is conducted on the bearing benchmark dataset provided by the Case Western Reserve University (CWRU).<\/jats:p>","DOI":"10.3390\/s21103550","type":"journal-article","created":{"date-parts":[[2021,5,20]],"date-time":"2021-05-20T06:13:45Z","timestamp":1621491225000},"page":"3550","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["Contrastive Learning for Fault Detection and Diagnostics in the Context of Changing Operating Conditions and Novel Fault Types"],"prefix":"10.3390","volume":"21","author":[{"given":"Katharina","family":"Rombach","sequence":"first","affiliation":[{"name":"Swiss Federal Institute of Technology, ETH Z\u00fcrich, 8092 Z\u00fcrich, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6882-2906","authenticated-orcid":false,"given":"Gabriel","family":"Michau","sequence":"additional","affiliation":[{"name":"Swiss Federal Institute of Technology, ETH Z\u00fcrich, 8092 Z\u00fcrich, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9546-1488","authenticated-orcid":false,"given":"Olga","family":"Fink","sequence":"additional","affiliation":[{"name":"Swiss Federal Institute of Technology, ETH Z\u00fcrich, 8092 Z\u00fcrich, Switzerland"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Fink, O. (2020). Data-driven intelligent predictive maintenance of industrial assets. Women in Industrial and Systems Engineering, Springer.","DOI":"10.1007\/978-3-030-11866-2_25"},{"key":"ref_2","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_3","unstructured":"Chen, T., Kornblith, S., Norouzi, M., and Hinton, G. (2020, January 13\u201318). A simple framework for contrastive learning of visual representations. Proceedings of the International Conference on Machine Learning, PMLR, Virtual."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"106816","DOI":"10.1016\/j.knosys.2021.106816","article-title":"Unsupervised transfer learning for anomaly detection: Application to complementary operating condition transfer","volume":"216","author":"Michau","year":"2021","journal-title":"Knowl. Based Syst."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., and Liu, C. (2018). A survey on deep transfer learning. International Conference on Artificial Neural Networks, Springer.","DOI":"10.1007\/978-3-030-01424-7_27"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"103678","DOI":"10.1016\/j.engappai.2020.103678","article-title":"Potential, challenges and future directions for deep learning in prognostics and health management applications","volume":"92","author":"Fink","year":"2020","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Jaiswal, A., Babu, A.R., Zadeh, M.Z., Banerjee, D., and Makedon, F. (2021). A survey on contrastive self-supervised learning. Technologies, 9.","DOI":"10.3390\/technologies9010002"},{"key":"ref_8","unstructured":"Hermans, A., Beyer, L., and Leibe, B. (2017). In defense of the triplet loss for person re-identification. arXiv."},{"key":"ref_9","unstructured":"Hadsell, R., Chopra, S., and LeCun, Y. (2006, January 17\u201322). Dimensionality reduction by learning an invariant mapping. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906), New York, NY, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Gomez, R., Gomez, L., Gibert, J., and Karatzas, D. (2018, January 8\u201314). Learning to learn from web data through deep semantic embeddings. Proceedings of the European Conference on Computer Vision (ECCV) Workshops, Munich, Germany.","DOI":"10.1007\/978-3-030-11024-6_40"},{"key":"ref_11","unstructured":"Dosovitskiy, A., Springenberg, J.T., Riedmiller, M., and Brox, T. (2014, January 8\u201311). Discriminative Unsupervised Feature Learning with Convolutional Neural Networks. Proceedings of the Twenty-eighth Conference on Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_12","unstructured":"Oord, A.V.D., Li, Y., and Vinyals, O. (2018). Representation learning with contrastive predictive coding. arXiv."},{"key":"ref_13","unstructured":"Bachman, P., Hjelm, R.D., and Buchwalter, W. (2019). Learning representations by maximizing mutual information across views. arXiv."},{"key":"ref_14","unstructured":"Franceschi, J.Y., Dieuleveut, A., and Jaggi, M. (2019, January 10\u201312). Unsupervised scalable representation learning for multivariate time series. Proceedings of the Thirty-third Conference on Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_15","first-page":"207","article-title":"Distance metric learning for large margin nearest neighbor classification","volume":"10","author":"Weinberger","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7\u201312). Facenet: A unified embedding for face recognition and clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Nguyen, T.P.K., Khlaief, A., Medjaher, K., Picot, A., Maussion, P., Tobon, D., Chauchat, B., and Cheron, R. (2018, January 3\u20136). Analysis and comparison of multiple features for fault detection and prognostic in ball bearings. Proceedings of the Fourth European Conference of the Prognostics and Health Management Society 2018, Utrecht, The Netherlands.","DOI":"10.36001\/phme.2018.v4i1.435"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1176","DOI":"10.1109\/TITS.2017.2720721","article-title":"Wheel defect detection with machine learning","volume":"19","author":"Krummenacher","year":"2017","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_19","unstructured":"Arias Chao, M., Adey, B.T., and Fink, O. (2019). Implicit supervision for fault detection and segmentation of emerging fault types with Deep Variational Autoencoders. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1016\/j.pisc.2016.04.068","article-title":"Feature selection and classification of mechanical fault of an induction motor using random forest classifier","volume":"8","author":"Patel","year":"2016","journal-title":"Perspect. Sci."},{"key":"ref_21","unstructured":"Yoon, A.S., Lee, T., Lim, Y., Jung, D., Kang, P., Kim, D., Park, K., and Choi, Y. (2017). Semi-supervised learning with deep generative models for asset failure prediction. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3506","DOI":"10.1109\/TIM.2019.2932162","article-title":"Robust interpretable deep learning for intelligent fault diagnosis of induction motors","volume":"69","author":"Abid","year":"2019","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1016\/j.engappai.2018.09.010","article-title":"An automatic and robust features learning method for rotating machinery fault diagnosis based on contractive autoencoder","volume":"76","author":"Shen","year":"2018","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, X., and Liu, F. (2020). Triplet loss guided adversarial domain adaptation for bearing fault diagnosis. Sensors, 20.","DOI":"10.3390\/s20010320"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Torrey, L., and Shavlik, J. (2010). Transfer learning. Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques, IGI Global.","DOI":"10.4018\/978-1-60566-766-9.ch011"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.neucom.2020.04.045","article-title":"A systematic review of deep transfer learning for machinery fault diagnosis","volume":"407","author":"Li","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1109\/TIE.2019.2962438","article-title":"Missing-class-robust domain adaptation by unilateral alignment","volume":"68","author":"Wang","year":"2020","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wang, Q., Michau, G., and Fink, O. (2019, January 2\u20135). Domain adaptive transfer learning for fault diagnosis. Proceedings of the 2019 Prognostics and System Health Management Conference (PHM-Paris), Paris, France.","DOI":"10.1109\/PHM-Paris.2019.00054"},{"key":"ref_29","unstructured":"Zhang, B., Li, W., Hao, J., Li, X.L., and Zhang, M. (2018). Adversarial adaptive 1-D convolutional neural networks for bearing fault diagnosis under varying working condition. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2296","DOI":"10.1109\/TIE.2016.2627020","article-title":"Deep model based domain adaptation for fault diagnosis","volume":"64","author":"Lu","year":"2016","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1145\/304181.304187","article-title":"OPTICS: Ordering points to identify the clustering structure","volume":"28","author":"Ankerst","year":"1999","journal-title":"ACM Sigmod Rec."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1109\/TIT.1982.1056489","article-title":"Least squares quantization in PCM","volume":"28","author":"Lloyd","year":"1982","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/0377-0427(87)90125-7","article-title":"Silhouettes: A graphical aid to the interpretation and validation of cluster analysis","volume":"20","author":"Rousseeuw","year":"1987","journal-title":"J. Comput. Appl. Math."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.ymssp.2015.04.021","article-title":"Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study","volume":"64","author":"Smith","year":"2015","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/j.sigpro.2016.07.028","article-title":"Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification","volume":"130","author":"Lu","year":"2017","journal-title":"Signal Process."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Shenfield, A., and Howarth, M. (2020). A novel deep learning model for the detection and identification of rolling element-bearing faults. Sensors, 20.","DOI":"10.3390\/s20185112"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"93155","DOI":"10.1109\/ACCESS.2020.2990528","article-title":"Bearing Fault Detection and Diagnosis Using Case Western Reserve University Dataset With Deep Learning Approaches: A Review","volume":"8","author":"Neupane","year":"2020","journal-title":"IEEE Access"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/MASSP.1984.1162257","article-title":"Gauss and the history of the fast Fourier transform","volume":"1","author":"Heideman","year":"1984","journal-title":"IEEE ASSP Mag."},{"key":"ref_39","first-page":"2837","article-title":"Information theoretic measures for clusterings comparison: Variants, properties, normalization and correction for chance","volume":"11","author":"Vinh","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_40","unstructured":"Rosenberg, A., and Hirschberg, J. (2007, January 28\u201330). V-measure: A conditional entropy-based external cluster evaluation measure. Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), Prague, Czech Republic."},{"key":"ref_41","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Hinton","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_42","first-page":"226","article-title":"A density-based algorithm for discovering clusters in large spatial databases with noise","volume":"96","author":"Ester","year":"1996","journal-title":"Kdd"},{"key":"ref_43","unstructured":"Buitinck, L., Louppe, G., Blondel, M., Pedregosa, F., Mueller, A., Grisel, O., Niculae, V., Prettenhofer, P., Gramfort, A., and Grobler, J. (2013, January 22\u201326). API design for machine learning software: Experiences from the scikit-learn project. Proceedings of the ECML PKDD Workshop: Languages for Data Mining and Machine Learning, Prague, Czech Republic."},{"key":"ref_44","unstructured":"MacQueen, J. (1967, January 21). Some methods for classification and analysis of multivariate observations. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Oakland, CA, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/10\/3550\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:04:21Z","timestamp":1760162661000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/10\/3550"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,20]]},"references-count":44,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["s21103550"],"URL":"https:\/\/doi.org\/10.3390\/s21103550","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,20]]}}}