{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,15]],"date-time":"2026-11-15T22:21:11Z","timestamp":1794781271369,"version":"4.9.1"},"reference-count":46,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,6,22]],"date-time":"2026-06-22T00:00:00Z","timestamp":1782086400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,9,14]],"date-time":"2026-09-14T00:00:00Z","timestamp":1789344000000},"content-version":"vor","delay-in-days":84,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Electrical Submersible Pumps (ESPs) are widely used in oil and gas production but are highly vulnerable to mechanical, electrical, hydraulic, and thermal degradation under harsh downhole conditions. Unexpected ESP failures can result in severe production losses, costly interventions, and reduced operational reliability, highlighting the importance of predictive maintenance and Remaining Useful Life (RUL) estimation. Existing prognostic approaches often rely on single-modality data and lack physical consistency in degradation modeling. This study proposes HF-ESPNet, a physics-informed multi-modal transformer framework for joint ESP failure prediction and RUL estimation. The proposed model integrates heterogeneous operational data, including electrical telemetry, pressure, temperature, vibration indicators, well metadata, and maintenance history within a unified transformer-based architecture. Domain-specific physics-informed constraints related to hydraulic behavior, thermal dynamics, and vibration degradation are incorporated into the learning objective to improve physical consistency and prognostic reliability. The framework was evaluated using an anonymized real-world ESP dataset containing more than 58,000 multivariate time-series samples under diverse operational conditions. Experimental results demonstrate that HF-ESPNet outperforms conventional machine learning, deep learning, and transformer-based baseline models in both failure prediction and RUL estimation tasks. Ablation analysis further confirms the importance of vibration-derived features and physics-informed constraints in improving predictive robustness and degradation modeling accuracy. The results demonstrate that combining multi-modal representation learning, transformer-based temporal modeling, and physics-informed learning provides a robust and interpretable framework for ESP prognostics, supporting improved maintenance scheduling, reduced unplanned downtime, and enhanced operational reliability in oil and gas production systems.<\/jats:p>","DOI":"10.1038\/s41598-026-56666-4","type":"journal-article","created":{"date-parts":[[2026,6,22]],"date-time":"2026-06-22T13:57:23Z","timestamp":1782136643000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["A physics-informed multi-modal transformer framework for predictive maintenance and remaining useful life estimation of electrical submersible pumps"],"prefix":"10.1038","volume":"16","author":[{"given":"Yasin","family":"Khalili","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammad","family":"Ahmadi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mostafa Keshavarz","family":"Moraveji","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,6,22]]},"reference":[{"key":"56666_CR1","doi-asserted-by":"crossref","unstructured":"Abdalla, R. et al. Deep insight into electrical submersible pump maintenance: A predictive approach with deep learning. in SPE Offshore Europe Conference and Exhibition. SPE. (2023).","DOI":"10.2118\/215596-MS"},{"issue":"10","key":"56666_CR2","first-page":"3799","volume":"11","author":"S Fakher","year":"2021","unstructured":"Fakher, S. et al. Rigorous Rev. Electr. Submers. pump. Fail. Mech. their mitigation measures 11(10): 3799\u20133814. (2021).","journal-title":"Rigorous Rev. Electr. Submers. pump. Fail. Mech. their mitigation measures"},{"key":"56666_CR3","doi-asserted-by":"crossref","unstructured":"Khalili, Y. et al. A comprehensive review of failure modes in electrical submersible pumps: Diagnosis, predictive maintenance, and engineer\u2019s guide. 50(24): 20445\u201320466. (2025).","DOI":"10.1007\/s13369-025-10536-9"},{"key":"56666_CR4","doi-asserted-by":"crossref","unstructured":"Nwulu, E. O. et al. Machine learning applications in predictive maintenance: Enhancing efficiency across the oil and gas industry. 5(1): 17\u201330. (2023).","DOI":"10.53430\/ijeru.2023.5.1.0017"},{"key":"56666_CR5","unstructured":"Zhu, T. et al. A survey of predictive maintenance: Systems, purposes and approaches. (2019)."},{"key":"56666_CR6","doi-asserted-by":"crossref","unstructured":"Alrowayyeh, J., Dhote, P. & Alqenaei, A. Machine Learning Model for Efficient Surveillance of Electrostatic Pump Operations & Predictive Analytics for Early Alarming System. in SPE EOR Conference at Oil and Gas West Asia. SPE. (2024).","DOI":"10.2118\/218659-MS"},{"key":"56666_CR7","unstructured":"Paroha, A. D., A.J.I.J.o.C, A. & Chotrani A comparative analysis of TimeGPT and Time-LLM in predicting ESP maintenance needs in the oil and gas sector. 975: 8887. (2024)."},{"key":"56666_CR8","unstructured":"Jin, M. et al. Time-llm: Time series forecasting by reprogramming large language models. (2023)."},{"key":"56666_CR9","doi-asserted-by":"crossref","unstructured":"Drakaki, M. et al. Machine learning and deep learning based methods toward industry 4.0 predictive maintenance in induction motors: State of the art survey. 15(1): 31\u201357. (2022).","DOI":"10.3926\/jiem.3597"},{"key":"56666_CR10","unstructured":"Garza, A. & Challu, C. and M.J.a.p.a. Mergenthaler-Canseco, TimeGPT-1. (2023)."},{"key":"56666_CR11","doi-asserted-by":"crossref","unstructured":"Khalili, Y. et al. Time-aware predictive maintenance of electrical submersible pumps using catboost ensemble learning and trend-based labeling. 15(9): 1\u201324. (2025).","DOI":"10.1007\/s13202-025-02070-z"},{"key":"56666_CR12","unstructured":"Khalili, Y. et al. Predictive Maintenance for ESPs: Enhancing Reliability, Efficiency, and Sustainability in Oil & Gas Production. : e239077. (2026)."},{"key":"56666_CR13","doi-asserted-by":"crossref","unstructured":"Abdalla, R. et al. Machine learning approach for predictive maintenance of the electrical submersible pumps (ESPS). 7(21): 17641\u201317651. (2022).","DOI":"10.1021\/acsomega.1c05881"},{"key":"56666_CR14","doi-asserted-by":"crossref","unstructured":"Abdelaziz, M., Lastra, R. & Xiao, J. ESP data analytics: Predicting failures for improved production performance. in Abu Dhabi International Petroleum Exhibition and Conference. SPE. (2017).","DOI":"10.2118\/188513-MS"},{"key":"56666_CR15","unstructured":"Khalili, Y., Rafiei, Y. & Sharifi, M. Reservoir Characterization by Applying Pressure Transient Analysis on Data Obtained from Electrical Submersible Pumps. (2022)."},{"key":"56666_CR16","unstructured":"Nirtl, M. Sophisticated ESP Sensor Data Analysis and Failure Classification. (2017)."},{"key":"56666_CR17","doi-asserted-by":"crossref","unstructured":"Zhang, J. et al. Review on Fault Diagnosis of Electric Submersible Pump using Machine Learning. in Journal of Physics: Conference Series. IOP Publishing. (2025).","DOI":"10.1088\/1742-6596\/3129\/1\/012056"},{"key":"56666_CR18","unstructured":"Sobhy, M. A. Detecting Electrical Submersible Pump (ESP) Failures and Estimating Run Life Using Artificial Neural Networks. (2025)."},{"key":"56666_CR19","unstructured":"Chu, T. H. T. Investigating and Predicting Pump Vibration Under Various Operating Conditions (New Mexico Institute of Mining and Technology, 2024)."},{"key":"56666_CR20","doi-asserted-by":"crossref","unstructured":"Cardona, L., Sanchez, P. V. & Joya, B. Failure prediction methodology for ESP and operational behavior. in SPE Latin America and Caribbean Petroleum Engineering Conference. SPE. (2023).","DOI":"10.2118\/213140-MS"},{"key":"56666_CR21","doi-asserted-by":"crossref","unstructured":"Lim, B. et al. Temporal fusion transformers for interpretable multi-horizon time series forecasting. 37(4): 1748\u20131764. (2021).","DOI":"10.1016\/j.ijforecast.2021.03.012"},{"key":"56666_CR22","doi-asserted-by":"crossref","unstructured":"Zhang, X. et al. Benchmarking a Time-Series Foundation Model (TimeGPT) for Real-World Forecasting Applications. : p. 100801. (2025).","DOI":"10.1016\/j.mlwa.2025.100801"},{"key":"56666_CR23","doi-asserted-by":"crossref","unstructured":"Silvia, S. et al. Case study: predicting electrical submersible pump failures using artificial intelligence and physics-based hybrid models. in SPE Middle East Intelligent Oil and Gas Symposium. SPE. (2023).","DOI":"10.2118\/214722-MS"},{"issue":"6","key":"56666_CR24","first-page":"422","volume":"3","author":"GE Karniadakis","year":"2021","unstructured":"Karniadakis, G. E. et al. Physics-informed Mach. Learn. 3(6): 422\u2013440. (2021).","journal-title":"Physics-informed Mach. Learn."},{"key":"56666_CR25","unstructured":"Willard, J. et al. Integrating physics-based modeling with machine learning: A survey. 1(1): 1\u201334. (2020)."},{"key":"56666_CR26","doi-asserted-by":"crossref","unstructured":"Zemouri, R. J. M. Power transformer prognostics and health management using machine learning: A review and future directions. 13(2): p. 125. (2025).","DOI":"10.3390\/machines13020125"},{"key":"56666_CR27","doi-asserted-by":"crossref","unstructured":"Zhao, R. et al. Learning to monitor machine health with convolutional bi-directional LSTM networks. 17(2): 273. (2017).","DOI":"10.3390\/s17020273"},{"key":"56666_CR28","doi-asserted-by":"crossref","unstructured":"Bousdekis, A. et al. A review of data-driven decision-making methods for industry 4.0 maintenance applications. 10(7): 828. (2021).","DOI":"10.3390\/electronics10070828"},{"key":"56666_CR29","doi-asserted-by":"crossref","unstructured":"Malihi, S. et al. Review multimodal data their Appl. road. maintenance 1(2). (2024).","DOI":"10.55092\/sc20240010"},{"key":"56666_CR30","doi-asserted-by":"crossref","unstructured":"AlBallam, S. Applying machine learning models to diagnose failures in electrical submersible pumps. (2022).","DOI":"10.2118\/214632-MS"},{"key":"56666_CR31","unstructured":"Van Jansen, N., Kamin, L. & Davis, S. Using machine learning-based predictive models to enable preventative maintenance and prevent ESP downtime. in Abu Dhabi International Petroleum Exhibition and Conference. SPE. (2019)."},{"key":"56666_CR32","doi-asserted-by":"crossref","unstructured":"Faizanbasha, A., Rizwan, U. J. R. E. & Safety, S. Deep learning-stochastic ensemble for RUL prediction and predictive maintenance with dynamic mission abort policies. 259: 110919. (2025).","DOI":"10.1016\/j.ress.2025.110919"},{"key":"56666_CR33","doi-asserted-by":"crossref","unstructured":"Ramirez, I. et al. Bayesian physics informed neural networks for reliable transformer prognostics. (2025).","DOI":"10.36001\/phmconf.2025.v17i1.4344"},{"key":"56666_CR34","doi-asserted-by":"crossref","unstructured":"Faizanbasha, A. et al. Deep learning ensemble for dynamic burn-in optimization with precise Remaining Useful Life prediction for lithium-ion batteries. : 148001. (2025).","DOI":"10.1016\/j.electacta.2025.148001"},{"key":"56666_CR35","unstructured":"Mohannad, A., Rafael, L. & Xiao, J. ESP Data Analytics: Predicting Failures for Improved Production Performance. (2017)."},{"key":"56666_CR36","unstructured":"Han, J., Kamber, M. & Pei, J. J. S. F. Data mining: concepts and techniques Morgan Kaufmann. (2006)."},{"issue":"3","key":"56666_CR37","first-page":"972","volume":"12","author":"M Tiboni","year":"2022","unstructured":"Tiboni, M. et al. Rev. vibration-based condition Monit. rotating Mach. 12(3): 972. (2022).","journal-title":"Rev. vibration-based condition Monit. rotating Mach."},{"issue":"4","key":"56666_CR38","first-page":"461","volume":"5","author":"F Ahmadzadeh","year":"2014","unstructured":"Ahmadzadeh, F., J.J.I.J.o.S.A, E., Lundberg & Management Remaining useful life estimation 5(4): 461\u2013474. (2014).","journal-title":"Remaining useful life estimation"},{"key":"56666_CR39","doi-asserted-by":"crossref","unstructured":"Sateesh Babu, G., Zhao, P. & Li, X. L. Deep convolutional neural network based regression approach for estimation of remaining useful life. in International conference on database systems for advanced applications. Springer. (2016).","DOI":"10.1007\/978-3-319-32025-0_14"},{"key":"56666_CR40","unstructured":"Lyu, H. et al. Advances neural Inform. Process. systems 32. (2019)."},{"key":"56666_CR41","doi-asserted-by":"crossref","unstructured":"Raissi, M. & Perdikaris, P. and G.E.J.J.o.C.p. Karniadakis, Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. 378: pp. 686\u2013707. (2019).","DOI":"10.1016\/j.jcp.2018.10.045"},{"issue":"11","key":"56666_CR42","first-page":"110805","volume":"142","author":"J Lee","year":"2020","unstructured":"Lee, J. et al. Intell. maintenance Syst. predictive Manuf. 142(11): 110805. (2020).","journal-title":"Intell. maintenance Syst. predictive Manuf."},{"key":"56666_CR43","doi-asserted-by":"crossref","unstructured":"Saxena, A. et al. Damage propagation modeling for aircraft engine run-to-failure simulation2008 international conference on prognostics and health management.IEEE. (2008).","DOI":"10.1109\/PHM.2008.4711414"},{"issue":"11","key":"56666_CR44","first-page":"e0000290","volume":"2","author":"M Owusu-Adjei","year":"2023","unstructured":"Owusu-Adjei, M. et al. Imbalanced class distribution and performance evaluation metrics: A systematic review of prediction accuracy for determining model performance. Healthc. Syst. 2 (11), e0000290 (2023).","journal-title":"Healthc. Syst."},{"key":"56666_CR45","doi-asserted-by":"crossref","unstructured":"Kumar, S. et al. A Comprehensive Review of Remaining Useful Life Estimation Approaches for Rotating Machinery. 17(22): 5538. (2024).","DOI":"10.3390\/en17225538"},{"key":"56666_CR46","unstructured":"Lundberg, S. M., S.-I.J & Lee A.i.n.i.p.s. A unified approach interpreting model. predictions 30. (2017)."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-56666-4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-56666-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-56666-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,13]],"date-time":"2026-09-13T23:00:29Z","timestamp":1789340429000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-56666-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,22]]},"references-count":46,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["56666"],"URL":"https:\/\/doi.org\/10.1038\/s41598-026-56666-4","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,22]]},"assertion":[{"value":"2 January 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 June 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 June 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Declarations"}}],"article-number":"28543"}}