{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T04:27:25Z","timestamp":1787632045971,"version":"build-2736575974"},"reference-count":50,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2026,8,20]],"date-time":"2026-08-20T00:00:00Z","timestamp":1787184000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Petrochemical plants are complex facilities composed of interconnected equipment to produce essential products for daily human activities. In view of the adoption of the Industrial Internet of Things (IIoT), these facilities use various sensors, including those for level, flow, temperature, and pressure, to monitor and control operations. Several process faults can be detected and classified using data from these sensors. Detecting and classifying these faults helps mitigate production losses, improve product quality, decrease environmental concerns, and improve human safety. Conventional static learning, which learns from historical data, and continual learning, which learns incremental tasks with known preset boundaries, fall short on asynchronous online unknown streaming boundary tasks such as the OpenWorld Problem, which is the true representation of real-world dynamic plant scenarios. To tackle these challenges, we propose a novel online asynchronous framework termed OD-ViTFScL. Our framework utilizes a dual-attention backbone, which concatenates orthogonal information from attention on the vertical time-series data and horizontal inter-sensor relationships. The fused MLP from the temporal and sensor streams learns independent weights for each orthogonal axis. Our framework also uses ODIN, an out-of-distribution technique, to trigger the arrival of a new fault class in the streaming data. Extensive experiments on the Tennessee Eastman Process (TEP) and Case Western Reserve University (CWRU) bearing datasets validate that our proposed OD-ViTFScL outperforms other state-of-the-art fault detection and diagnosis (FDD) approaches.<\/jats:p>","DOI":"10.3390\/s26165283","type":"journal-article","created":{"date-parts":[[2026,8,20]],"date-time":"2026-08-20T16:05:19Z","timestamp":1787241919000},"page":"5283","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["OD-ViTFScL: Asynchronous Few-Shot Continual Learning for Intelligent Process Monitoring and Fault Diagnosis in Petrochemical Plants"],"prefix":"10.3390","volume":"26","author":[{"given":"Oyekunle","family":"Oshidele","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Houston, Houston, TX 77004, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sen","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Houston, Houston, TX 77004, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,8,20]]},"reference":[{"key":"ref_1","unstructured":"Maschler, B., and Weyrich, M. (2021). Deep transfer learning for industrial fault diagnosis: A survey and systematic evaluation. arXiv."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"111113","DOI":"10.1016\/j.ress.2025.111113","article-title":"An intelligent failure feature learning method for failure and maintenance data management of wind turbines","volume":"261","author":"Li","year":"2025","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Liu, S., Chen, X., Zhang, Y., and Wang, J. (2025). Incremental Pyraformer\u2013Deep Canonical Correlation Analysis: A novel framework for effective fault detection in dynamic nonlinear processes. Algorithms, 18.","DOI":"10.3390\/a18030130"},{"key":"ref_4","unstructured":"Le, L., Hussing, M., and Eaton, E. (2024). Distributed continual learning. arXiv."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Shi, Z., Meng, Y., Eslaminia, A., Nahrstedt, K., and Shao, C. (2025). Adaptive unknown fault detection and few-shot continual learning for condition monitoring in ultrasonic metal welding. arXiv.","DOI":"10.1016\/j.jmsy.2024.09.023"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Macas, M., Wu, C., and Fuertes, W. (2024). An attention-based deep generative model for anomaly detection in industrial control systems. arXiv.","DOI":"10.5220\/0012264000003584"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/0169-7439(95)00076-3","article-title":"Disturbance detection and isolation by dynamic principal component analysis","volume":"30","author":"Ku","year":"1995","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_8","first-page":"12389","article-title":"Study on modifications of PLS approach for process monitoring","volume":"44","author":"Yin","year":"2011","journal-title":"IFAC Proc."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"470","DOI":"10.1016\/j.ifacol.2018.09.380","article-title":"Fault detection and classification using artificial neural networks","volume":"51","author":"Heo","year":"2018","journal-title":"IFAC-PapersOnLine"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/j.compchemeng.2018.04.009","article-title":"Deep convolutional neural network model based chemical process fault diagnosis","volume":"115","author":"Wu","year":"2018","journal-title":"Comput. Chem. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Park, P., Di Marco, P., Shin, H., and Bang, J. (2019). Fault detection and diagnosis using combined autoencoder and long short-term memory network. Sensors, 19.","DOI":"10.3390\/s19214612"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Chen, Z., and Liu, B. (2018). Lifelong Machine Learning, Morgan & Claypool. [2nd ed.]. Synthesis Lectures on Artificial Intelligence and Machine Learning.","DOI":"10.1007\/978-3-031-01581-6"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3933","DOI":"10.1109\/TASE.2023.3290202","article-title":"An order-invariant and interpretable dilated convolution neural network for chemical process fault detection and diagnosis","volume":"21","author":"Li","year":"2023","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3630","DOI":"10.1109\/TII.2021.3112988","article-title":"An imbalance modified convolutional neural network with incremental learning for chemical fault diagnosis","volume":"18","author":"Gu","year":"2022","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_15","unstructured":"Zhao, D., Sharma, K., Yin, H., Qi, Y., and Zhang, S. (2024). SRTFD: Scalable real-time fault diagnosis through online continual learning. arXiv."},{"key":"ref_16","first-page":"110670","article-title":"Hybrid variable monitoring: An unsupervised process monitoring framework with binary and continuous variables","volume":"2022","author":"Wang","year":"2022","journal-title":"Automatica"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s00521-022-08017-3","article-title":"Challenges and opportunities of deep learning-based process fault detection and diagnosis: A review","volume":"35","author":"Yu","year":"2023","journal-title":"Neural Comput. Appl."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1016\/j.compchemeng.2017.02.041","article-title":"A deep belief network based fault diagnosis model for complex chemical processes","volume":"107","author":"Zhang","year":"2017","journal-title":"Comput. Chem. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1007\/s13349-024-00895-6","article-title":"Ground penetrating radar-based automated defect identification of bridge decks: A hybrid approach","volume":"15","author":"Yu","year":"2025","journal-title":"J. Civ. Struct. Health Monit."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ouyang, X., Zhang, Y., Hua, L., and Yin, Y. (2025). AF-TAD:Transformer-Based Anomaly Detection for Aircraft Fuel Systems. Aerospace, 12.","DOI":"10.3390\/aerospace12121066"},{"key":"ref_21","first-page":"3555218","article-title":"IWOA-Optimized Deep Learning for Bearing Fault Diagnosis Under Noisy and Variable Conditions","volume":"74","author":"Chen","year":"2025","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Chen, P., Song, Y., and Xia, Y. (2025). Adaptively diagnosing system faults in microservice architecture: An autonomous predictive model construction framework. Future, 10.","DOI":"10.1016\/j.future.2025.108256"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3568417","DOI":"10.1109\/TIM.2025.3643085","article-title":"PCASTNet: A Physics-Constrained Adaptive Style Transfer Network for Sample Generation in Cross-Machine Small-Sample Fault Diagnosis","volume":"74","author":"Hu","year":"2025","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3521","DOI":"10.1073\/pnas.1611835114","article-title":"Overcoming catastrophic forgetting in neural networks","volume":"114","author":"Kirkpatrick","year":"2017","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_25","unstructured":"Wen, S., and Itti, L. (2018). Overcoming catastrophic forgetting problem by weight consolidation and long-term memory. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Maracani, A., Michieli, U., Toldo, M., and Zanuttigh, P. (2021, January 10\u201317). RECALL: Replay-based continual learning in semantic segmentation. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV 2021), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00694"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1109\/TIE.2018.2798633","article-title":"An imbalance modified deep neural network with dynamical incremental learning for chemical fault diagnosis","volume":"66","author":"Hu","year":"2019","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, T., Peng, S., Gao, L., Zhang, H., Zhu, X., and Lei, Z. (2025). Unifying locality of KANs and feature drift compensation projection for data-free replay based continual face forgery detection. arXiv.","DOI":"10.1609\/aaai.v40i15.38274"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"112944","DOI":"10.1016\/j.ymssp.2025.112862","article-title":"Task similarity-based continual learning for multi-phase environments and its application in few-shot fault diagnosis","volume":"235","author":"Gao","year":"2025","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"115417","DOI":"10.1016\/j.knosys.2026.115417","article-title":"DCCIL: Mitigating Class Conflicts in Incremental Learning through Dynamic Isolation for Intelligent Fault Diagnosis","volume":"337","author":"Wang","year":"2025","journal-title":"Knowl.-Based Syst."},{"key":"ref_31","unstructured":"Wang, L., Zhang, X., Yang, K., Yu, L., Li, C., Hong, L., Zhang, S., Li, Z., Zhong, Y., and Zhu, J. (2022, January 25\u201329). Memory replay with data compression for continual learning. Proceedings of the Tenth International Conference on Learning Representations (ICLR 2022), Virtual. Available online: https:\/\/openreview.net\/forum?id=a7H7OucbWaU."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2935","DOI":"10.1109\/TPAMI.2017.2773081","article-title":"Learning without forgetting","volume":"40","author":"Li","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","unstructured":"Lopez-Paz, D., and Ranzato, M. (2017, January 4\u20139). Gradient episodic memory for continual learning. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS 2017), Long Beach, CA, USA. Available online: https:\/\/proceedings.neurips.cc\/paper\/2017\/hash\/f87522788a2be2d171666752f97ddebb-Abstract.html."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1464","DOI":"10.1109\/TPAMI.2024.3498346","article-title":"A comprehensive survey of forgetting in deep learning beyond continual learning","volume":"47","author":"Wang","year":"2024","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.neunet.2019.01.012","article-title":"Continual lifelong learning with neural networks: A review","volume":"113","author":"Parisi","year":"2019","journal-title":"Neural Netw."},{"key":"ref_36","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16 \u00d7 16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"061001","DOI":"10.1115\/1.4066799","article-title":"Adaptive online continual learning for in-situ quality prediction in manufacturing processes","volume":"147","author":"Chen","year":"2025","journal-title":"J. Manuf. Sci. Eng."},{"key":"ref_38","first-page":"3744","article-title":"Multimodal continual learning for process monitoring: A novel weighted canonical correlation analysis with attention mechanism","volume":"36","author":"Zhang","year":"2025","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_39","unstructured":"Liang, S., Li, Y., and Srikant, R. (May, January 30). Enhancing the reliability of out-of-distribution image detection in neural networks. Proceedings of the Sixth International Conference on Learning Representations (ICLR 2018), Vancouver, BC, Canada. Available online: https:\/\/openreview.net\/forum?id=H1VGkIxRZ."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.eswa.2017.04.008","article-title":"On the reliable detection of concept drift from streaming unlabeled data","volume":"82","author":"Sethi","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_41","unstructured":"Hang, Q., Matthew, B., and David, L. (2018). Low-Shot Learning with Imprinting Weights. arXiv."},{"key":"ref_42","unstructured":"Liu, X., and Chang, X. (2026). Elastic weight consolidation done right for continual learning. arXiv."},{"key":"ref_43","unstructured":"Rieth, C., Amsel, B., Tran, R., and Cook, M. (2026, July 09). Additional Tennessee Eastman Process Simulation Data for Anomaly Detection Evaluation. Harvard Dataverse, Available online: https:\/\/dataverse.harvard.edu\/dataset.xhtml?persistentId=doi:10.7910\/DVN\/6C3JR1."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Zarch, M.G., and Soltani, M. (2020, January 18\u201321). An artificial intelligence approach to fault isolation based on sensor data in Tennessee Eastman process. Proceedings of the 46th Annual Conference of the IEEE Industrial Electronics Society (IECON 2020), Singapore.","DOI":"10.1109\/IECON43393.2020.9255330"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"5362","DOI":"10.1109\/TPAMI.2024.3367329","article-title":"A comprehensive survey of continual learning: Theory, method and application","volume":"46","author":"Wang","year":"2024","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_46","unstructured":"Rolnick, D., Ahuja, A., Schwarz, J., Lillicrap, T.P., and Wayne, G. (2019, January 8\u201314). Experience replay for continual learning. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS 2019), Vancouver, BC, Canada. Available online: https:\/\/papers.nips.cc\/paper\/2019\/hash\/fa7cdfad1a5aaf8370ebeda47a1ff1c3-Abstract.html."},{"key":"ref_47","unstructured":"Yang, Z., Wang, J., Zong, L., Liu, X., Qian, Q., and Chen, S. (2025). Few-shot class-incremental fault diagnosis by preserving class-agnostic knowledge with dual-granularity representations. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Rebuffi, S.A., Kolesnikov, A., Sperl, G., and Lampert, C.H. (2017, January 21\u201326). iCaRL: Incremental classifier and representation learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.587"},{"key":"ref_49","unstructured":"Kim, D.Y., Han, D.J., Seo, J., and Moon, J. (2023, January 1\u20135). Warping the space: Weight space rotation for class-incremental few-shot learning. Proceedings of the Eleventh International Conference on Learning Representations (ICLR 2023), Kigali, Rwanda. Available online: https:\/\/openreview.net\/forum?id=kPLzOfPfA2l."},{"key":"ref_50","unstructured":"Peng, P., Zhang, H., Li, M., Peng, G., Wang, H., and Shen, W. (2023). SCLIFD: Supervised contrastive knowledge distillation for incremental fault diagnosis under limited fault data. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/16\/5283\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T04:12:05Z","timestamp":1787631125000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/16\/5283"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,20]]},"references-count":50,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2026,8]]}},"alternative-id":["s26165283"],"URL":"https:\/\/doi.org\/10.3390\/s26165283","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,20]]}}}