{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T00:55:04Z","timestamp":1760057704102,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2025,2,25]],"date-time":"2025-02-25T00:00:00Z","timestamp":1740441600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["52305544","STKJ202209065"],"award-info":[{"award-number":["52305544","STKJ202209065"]}]},{"name":"Project of Guangdong Science and Technology Innovation Strategy","award":["52305544","STKJ202209065"],"award-info":[{"award-number":["52305544","STKJ202209065"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Smart manufacturing systems aim to enhance the efficiency, adaptability, and reliability of industrial operations through advanced data-driven approaches. Achieving these objectives hinges on accurate fault detection and timely maintenance, especially in highly dynamic industrial environments. However, capturing nonlinear and temporal dependencies in dynamic nonlinear industrial processes poses significant challenges for traditional data-driven fault detection methods. To address these limitations, this study presents an Incremental Pyraformer\u2013Deep Canonical Correlation Analysis (DCCA) framework that integrates the Pyramidal Attention Mechanism of the Pyraformer with the Broad Learning System for incremental learning in a DCCA basis. The Pyraformer model effectively captures multi-scale temporal features, while the BLS-based incremental learning mechanism adapts to evolving data without full retraining. The proposed framework enhances both spatial and temporal representation, enabling robust fault detection in high-dimensional and continuously changing industrial environments. Experimental validation on the Tennessee Eastman (TE) process, Continuous Stirred-Tank Reactor (CSTR) system, and injection molding process demonstrated superior detection performance. In the TE scenario, our framework achieved a 100% Fault Detection Rate with a 4.35% False Alarm Rate, surpassing DCCA variants. Similarly, in the CSTR case, the approach reached a perfect 100% Fault Detection Rate (FDR) and 3.48% False Alarm Rate (FAR), while in the injection molding process, it delivered a 97.02% FDR with 0% FAR. The findings underline the framework\u2019s effectiveness in handling complex and dynamic data streams, thereby providing a powerful approach for real-time monitoring and proactive maintenance.<\/jats:p>","DOI":"10.3390\/a18030130","type":"journal-article","created":{"date-parts":[[2025,2,25]],"date-time":"2025-02-25T07:45:08Z","timestamp":1740469508000},"page":"130","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Incremental Pyraformer\u2013Deep Canonical Correlation Analysis: A Novel Framework for Effective Fault Detection in Dynamic Nonlinear Processes"],"prefix":"10.3390","volume":"18","author":[{"given":"Yucheng","family":"Ding","sequence":"first","affiliation":[{"name":"Department of Mechanical Engineering, Shantou University, Shantou 515063, China"}]},{"given":"Yingfeng","family":"Zhang","sequence":"additional","affiliation":[{"name":"Goertek Inc., Weifang 261061, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2610-6722","authenticated-orcid":false,"given":"Jianfeng","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, Shantou University, Shantou 515063, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8490-8985","authenticated-orcid":false,"given":"Shitong","family":"Peng","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, Shantou University, Shantou 515063, China"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1611","DOI":"10.1007\/s10845-018-1431-x","article-title":"Data-Driven Prognostic Method Based on Self-Supervised Learning Approaches for Fault Detection","volume":"31","author":"Wang","year":"2020","journal-title":"J. Intell. Manuf."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"108865","DOI":"10.1016\/j.ress.2022.108865","article-title":"An Uncertainty-Informed Framework for Trustworthy Fault Diagnosis in Safety-Critical Applications","volume":"229","author":"Zhou","year":"2023","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1016\/j.ymssp.2013.06.004","article-title":"Prognostics and Health Management Design for Rotary Machinery Systems\u2014Reviews, Methodology and Applications","volume":"42","author":"Lee","year":"2014","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1007\/s10845-014-0933-4","article-title":"Data-Driven Prognostic Method Based on Bayesian Approaches for Direct Remaining Useful Life Prediction","volume":"27","author":"Mosallam","year":"2016","journal-title":"J. Intell. Manuf."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.ymssp.2016.10.012","article-title":"Fault Detection, Diagnosis, and Performance Assessment Scheme for Multiple Redundancy Aileron Actuator","volume":"113","author":"Lu","year":"2018","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1186\/s10033-020-00459-x","article-title":"Advanced Data Collection and Analysis in Data-Driven Manufacturing Process","volume":"33","author":"Xu","year":"2020","journal-title":"Chin. J. Mech. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"108063","DOI":"10.1016\/j.ress.2021.108063","article-title":"Prognostics and Health Management: A Review from the Perspectives of Design, Development and Decision","volume":"217","author":"Hu","year":"2022","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1010","DOI":"10.1016\/j.eng.2019.01.019","article-title":"Data Analytics and Machine Learning for Smart Process Manufacturing: Recent Advances and Perspectives in the Big Data Era","volume":"5","author":"Shang","year":"2019","journal-title":"Engineering"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"4819","DOI":"10.1109\/TVT.2018.2818538","article-title":"Deep PCA Based Real-Time Incipient Fault Detection and Diagnosis Methodology for Electrical Drive in High-Speed Trains","volume":"67","author":"Chen","year":"2018","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1016\/j.automatica.2009.10.030","article-title":"Geometric Properties of Partial Least Squares for Process Monitoring","volume":"46","author":"Li","year":"2010","journal-title":"Automatica"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kotz, S., and Johnson, N.L. (1992). Relations Between Two Sets of Variates. Breakthroughs in Statistics, Springer. Springer Series in Statistics.","DOI":"10.1007\/978-1-4612-4380-9"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"6158","DOI":"10.1109\/TNNLS.2021.3072491","article-title":"A Comparative Study of Deep Neural Network-Aided Canonical Correlation Analysis-Based Process Monitoring and Fault Detection Methods","volume":"33","author":"Chen","year":"2022","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.jprocont.2016.11.009","article-title":"Dynamic Concurrent Kernel CCA for Strip-Thickness Relevant Fault Diagnosis of Continuous Annealing Processes","volume":"67","author":"Liu","year":"2018","journal-title":"J. Process Control"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1016\/j.media.2013.10.010","article-title":"Correspondence between fMRI and SNP Data by Group Sparse Canonical Correlation Analysis","volume":"18","author":"Lin","year":"2014","journal-title":"Med. Image Anal."},{"key":"ref_15","unstructured":"Andrew, G., Arora, R., Bilmes, J., and Livescu, K. (2013, January 16\u201321). Deep Canonical Correlation Analysis. Proceedings of the 30th International Conference on Machine Learning, PMLR, Atlanta, GA, USA."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, G., Han, D., Wang, C., Hu, W., Calhoun, V.D., and Wang, Y.-P. (2020). Application of Deep Canonically Correlated Sparse Autoencoder for the Classification of Schizophrenia. Comput. Methods Programs Biomed., 183.","DOI":"10.1016\/j.cmpb.2019.105073"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3355","DOI":"10.1109\/TNNLS.2020.2985223","article-title":"Local\u2013Global Modeling and Distributed Computing Framework for Nonlinear Plant-Wide Process Monitoring With Industrial Big Data","volume":"32","author":"Jiang","year":"2021","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2839","DOI":"10.1109\/TII.2019.2952931","article-title":"Data-Driven Two-Dimensional Deep Correlated Representation Learning for Nonlinear Batch Process Monitoring","volume":"16","author":"Jiang","year":"2020","journal-title":"IEEE Trans. Ind. Inf."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"6690","DOI":"10.1109\/TII.2021.3121770","article-title":"Deep Canonical Correlation Analysis Using Sparsity-Constrained Optimization for Nonlinear Process Monitoring","volume":"18","author":"Xiu","year":"2022","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_20","unstructured":"Liu, S., Yu, H., Liao, C., Li, J., Lin, W., Liu, A.X., and Dustdar, S. (2022, January 25\u201329). Pyraformer: Low-Complexity Pyramidal at- Tention for Long-Range Time Series Modeling and forecasting. Proceedings of the Tenth International Conference on Learning Representations (ICLR 2022), Virtual Event."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"61958","DOI":"10.1109\/ACCESS.2023.3273596","article-title":"Short-Term Power Load Forecasting Based on VMD-Pyraformer-Adan","volume":"11","author":"Tang","year":"2023","journal-title":"IEEE Access"},{"key":"ref_22","unstructured":"(2024, December 20). Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture|IEEE Journals & Magazine|IEEE Xplore. Available online: https:\/\/ieeexplore.ieee.org\/abstract\/document\/7987745."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"8922","DOI":"10.1109\/TCYB.2021.3061094","article-title":"Research Review for Broad Learning System: Algorithms, Theory, and Applications","volume":"52","author":"Gong","year":"2022","journal-title":"IEEE Trans. Cybern."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.conengprac.2015.10.006","article-title":"Canonical Correlation Analysis-Based Fault Detection Methods with Application to Alumina Evaporation Process","volume":"46","author":"Chen","year":"2016","journal-title":"Control Eng. Pract."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/0098-1354(93)80018-I","article-title":"A Plant-Wide Industrial Process Control Problem","volume":"17","author":"Downs","year":"1993","journal-title":"Comput. Chem. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Chiang, L.H., Russell, E.L., and Braatz, R.D. (2001). Fault Detection and Diagnosis in Industrial Systems, Springer. Advanced Textbooks in Control and Signal Processing.","DOI":"10.1007\/978-1-4471-0347-9"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2222","DOI":"10.1109\/TNNLS.2016.2582924","article-title":"LSTM: A Search Space Odyssey","volume":"28","author":"Greff","year":"2017","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Dey, R., and Salem, F.M. (2017, January 6\u20139). Gate-Variants of Gated Recurrent Unit (GRU) Neural Networks. Proceedings of the 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS), Boston, MA, USA.","DOI":"10.1109\/MWSCAS.2017.8053243"},{"key":"ref_29","unstructured":"Zhou, T., Ma, Z., Wen, Q., Wang, X., Sun, L., and Jin, R. (2022, January 17\u201323). FEDformer: Frequency Enhanced Decomposed Transformer for Long-Term Series Forecasting. Proceedings of the 39th International Conference on Machine Learning, PMLR, Baltimore, MA, USA."},{"key":"ref_30","unstructured":"(2024, December 20). Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting. Available online: https:\/\/proceedings.neurips.cc\/paper\/2021\/hash\/bcc0d400288793e8bdcd7c19a8ac0c2b-Abstract.html."},{"key":"ref_31","unstructured":"Zhang, Y., and Yan, J. (2023, January 1\u20135). Crossformer: Transformer Utilizing Cross-Dimension Dependency for Multivariate Time Series Forecasting. Proceedings of the Eleventh International Conference on Learning Representations (ICLR), Kigali, Rwanda."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"5308","DOI":"10.1109\/TII.2018.2810822","article-title":"Canonical Variate Dissimilarity Analysis for Process Incipient Fault Detection","volume":"14","author":"Pilario","year":"2018","journal-title":"IEEE Trans. Ind. Inform."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/3\/130\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:42:11Z","timestamp":1760028131000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/3\/130"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,25]]},"references-count":32,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,3]]}},"alternative-id":["a18030130"],"URL":"https:\/\/doi.org\/10.3390\/a18030130","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2025,2,25]]}}}