{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,5]],"date-time":"2026-03-05T07:10:02Z","timestamp":1772694602736,"version":"3.50.1"},"reference-count":39,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T00:00:00Z","timestamp":1763078400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science and Technology Research Program of the Chongqing Municipal Education Commission","award":["KJQN202403212"],"award-info":[{"award-number":["KJQN202403212"]}]},{"name":"BAYU Scholar Program","award":["YS2024074"],"award-info":[{"award-number":["YS2024074"]}]},{"name":"Doctoral Fund of Chongqing Industry Polytechnic College","award":["2024GZYBSZK1-17"],"award-info":[{"award-number":["2024GZYBSZK1-17"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Accurate prediction of drilling speed is essential in mechanical drilling operations, as it improves operational efficiency, enhances safety, and reduces overall costs. Traditional prediction methods, however, are often constrained by delayed responsiveness, limited exploitation of real-time parameters, and inadequate capability to model complex temporal dependencies, ultimately resulting in suboptimal performance. To overcome these limitations, this study introduces a novel model termed CTLSF (CNN-TCN-LSTM with Self-Attention), which integrates multiple neural network architectures within a symmetry-aware framework. The model achieves architectural symmetry through the coordinated interplay of spatial and temporal learning modules, each contributing complementary strengths to the prediction task. Specifically, Convolutional Neural Networks (CNNs) extract localized spatial features from sequential drilling data, while Temporal Convolutional Networks (TCNs) capture long-range temporal dependencies through dilated convolutions and residual connections. In parallel, Long Short-Term Memory (LSTM) networks model unidirectional temporal dynamics, and a self-attention mechanism adaptively highlights salient temporal patterns. Furthermore, a sliding window strategy is employed to enable real-time prediction on streaming data. Comprehensive experiments conducted on the Volve oilfield dataset demonstrate that the proposed CTLSF model substantially outperforms conventional data-driven approaches, achieving a low Mean Absolute Error (MAE) of 0.8439, a Mean Absolute Percentage Error (MAPE) of 2.19%, and a high coefficient of determination (R2) of 0.9831. These results highlight the effectiveness, robustness, and symmetry-aware design of the CTLSF model in predicting mechanical drilling speed under complex real-world conditions.<\/jats:p>","DOI":"10.3390\/sym17111962","type":"journal-article","created":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T11:49:43Z","timestamp":1763120983000},"page":"1962","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Temporal Convolutional and LSTM Networks for Complex Mechanical Drilling Speed Prediction"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5904-8258","authenticated-orcid":false,"given":"Yang","family":"Huang","sequence":"first","affiliation":[{"name":"School of Architectural Engineering, Chongqing Industry Polytechnic University, Chongqing 401120, China"}]},{"given":"Wu","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Architectural Engineering, Chongqing Industry Polytechnic University, Chongqing 401120, China"}]},{"given":"Junrui","family":"Hu","sequence":"additional","affiliation":[{"name":"Faculty of Economics, L.N. Gumilyov Eurasian National University, 010008 Astana, Kazakhstan"},{"name":"China Chemicalgeology and Mine Bureau, Beijing 100020, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6188-539X","authenticated-orcid":false,"given":"Yihang","family":"Zhao","sequence":"additional","affiliation":[{"name":"CEC Technical & Economic Consulting Center of Power Construction, Electric Power Development Research Institute Co., Ltd., Beijing 100053, China"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.petrol.2018.09.027","article-title":"Computational Intelligence-Based Prediction of Drilling Rate of Penetration: A Comparative Study","volume":"172","author":"Ahmed","year":"2019","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"110396","DOI":"10.1016\/j.petrol.2022.110396","article-title":"Real-Time Prediction of Rate of Penetration by Combining Attention-Based Gated Recurrent Unit Network and Fully Connected Neural Networks","volume":"213","author":"Zhang","year":"2022","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"106332","DOI":"10.1016\/j.petrol.2019.106332","article-title":"Machine learning methods applied to drilling rate of penetration prediction and optimization\u2014A review","volume":"183","author":"Barbosa","year":"2019","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1016\/j.dam.2024.07.030","article-title":"The Diagnosability of Interconnection Networks","volume":"357","author":"Wang","year":"2024","journal-title":"Discrete Appl. Math."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"115027","DOI":"10.1016\/j.tcs.2024.115027","article-title":"G-Good-Neighbor Diagnosability under the Modified Comparison Model for Multiprocessor Systems","volume":"1028","author":"Xiang","year":"2025","journal-title":"Theor. Comput. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2040004","DOI":"10.1142\/S0129626420400046","article-title":"Connectivity and Diagnosability of Leaf-Sort Graphs","volume":"30","author":"Wang","year":"2020","journal-title":"Parallel Process. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Al-AbdulJabbar, A., Elkatatny, S., Mahmoud, M., and Abdulraheem, A. (2018, January 23\u201326). Predicting rate of penetration using artificial intelligence techniques. Proceedings of the SPE Kingdom of Saudi Arabia Annual Technical Symposium and Exhibition, Dammam, Saudi Arabia.","DOI":"10.2118\/192343-MS"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"6297","DOI":"10.1007\/s13369-017-3022-0","article-title":"New approach to optimize the rate of penetration using artificial neural network","volume":"43","author":"Elkatatny","year":"2018","journal-title":"Arab. J. Sci. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"917","DOI":"10.1016\/j.asej.2020.05.014","article-title":"Real-Time Prediction of Rate of Penetration While Drilling Complex Lithologies Using Artificial Intelligence Techniques","volume":"12","author":"Elkatatny","year":"2021","journal-title":"Ain Shams Eng. J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"127","DOI":"10.4236\/ajcm.2017.72011","article-title":"The tightly super 3-extra connectivity and diagnosability of locally twisted cubes","volume":"7","author":"Wang","year":"2017","journal-title":"Am. J. Comput. Math."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.dam.2021.01.028","article-title":"Connectivity and Diagnosability of Center k-ary n-Cubes","volume":"294","author":"Wang","year":"2021","journal-title":"Discrete Appl. Math."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"109861","DOI":"10.1016\/j.ymssp.2022.109861","article-title":"An unsupervised chatter detection method based on AE and merging GMM and K-means","volume":"186","author":"Liu","year":"2023","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sun, X., Yang, Z., Xia, M., Xia, M., Liu, C., Zhou, Y., and Guo, Y. (2025). Tool condition monitoring model based on DAE\u2013SVR. Machines, 13.","DOI":"10.3390\/machines13020115"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1940007","DOI":"10.1142\/S0219265919400073","article-title":"Connectivity and matching preclusion for leaf-sort graphs","volume":"19","author":"Wang","year":"2019","journal-title":"J. Interconnect. Netw."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1051\/ita\/2017008","article-title":"The connectivity and nature diagnosability of expanded k-ary n-cubes","volume":"51","author":"Wang","year":"2017","journal-title":"RAIRO-Theor. Inform. Appl.-Inform. Th\u00e9or. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"104071","DOI":"10.1016\/j.trd.2024.104071","article-title":"Robustness of Bilayer Railway-Aviation Transportation Network Considering Discrete Cross-Layer Traffic Flow Assignment","volume":"127","author":"Jiang","year":"2024","journal-title":"Transp. Res. Part D Transp. Environ."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1394","DOI":"10.1016\/j.renene.2020.04.029","article-title":"Improving Rate of Penetration Prediction by Combining Data from an Adjacent Well in a Geothermal Project","volume":"155","author":"Diaz","year":"2020","journal-title":"Renew. Energy"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1016\/j.petsci.2024.12.014","article-title":"Real-time drilling torque prediction ahead of the bit with just-in-time learning","volume":"22","author":"Bai","year":"2025","journal-title":"Pet. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liu, N., Zhang, D., Gao, H., Hu, Y., and Duan, L. (2021). Real-time measurement of drilling fluid rheological properties: A review. Sensors, 21.","DOI":"10.3390\/s21113592"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1016\/j.petrol.2017.09.020","article-title":"Analysis of Rate of Penetration (ROP) Prediction in Drilling Using Physics-Based and Data-Driven Models","volume":"159","author":"Hegde","year":"2017","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2901","DOI":"10.1016\/j.petsci.2024.05.013","article-title":"A Systematic Review of Machine Learning Modeling Processes and Applications in ROP Prediction in the Past Decade","volume":"21","author":"Li","year":"2024","journal-title":"Pet. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"103190","DOI":"10.1016\/j.advengsoft.2022.103190","article-title":"Implementation of deep learning methods in prediction of adsorption processes","volume":"173","author":"Skrobek","year":"2022","journal-title":"Adv. Eng. Softw."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"109335","DOI":"10.1016\/j.petrol.2021.109335","article-title":"Rate of penetration prediction while drilling vertical complex lithology using an ensemble learning model","volume":"208","author":"Alsaihati","year":"2022","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"106200","DOI":"10.1016\/j.petrol.2019.106200","article-title":"Prediction of Drilling Rate of Penetration (ROP) Using Hybrid Support Vector Regression: A Case Study on the Shennongjia Area, Central China","volume":"181","author":"Gan","year":"2019","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"604","DOI":"10.1016\/j.petrol.2018.12.013","article-title":"Application of Hybrid Artificial Neural Networks for Predicting Rate of Penetration (ROP): A Case Study from Marun Oil Field","volume":"175","author":"Ashrafi","year":"2019","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2443","DOI":"10.3390\/eng4030139","article-title":"Machine learning-based real-time prediction of formation lithology and tops using drilling parameters with a web app integration","volume":"4","author":"Khalifa","year":"2023","journal-title":"Eng"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"934","DOI":"10.1016\/j.petrol.2018.08.083","article-title":"Real-Time Predictive Capabilities of Analytical and Machine Learning Rate of Penetration (ROP) Models","volume":"172","author":"Soares","year":"2019","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1806","DOI":"10.2118\/225417-PA","article-title":"Real-Time Inversion of Formation Drillability and Concurrent Speedup Strategies for Microdrilling Time Optimization","volume":"30","author":"Yang","year":"2025","journal-title":"SPE J."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"116375","DOI":"10.1016\/j.oceaneng.2023.116375","article-title":"A real-time drilling parameters optimization method for offshore large-scale cluster extended reach drilling based on intelligent optimization algorithm and machine learning","volume":"291","author":"Chen","year":"2024","journal-title":"Ocean Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.jprocont.2021.12.002","article-title":"A Novel Dynamic Model for the Online Prediction of Rate of Penetration and Its Industrial Application to a Drilling Process","volume":"109","author":"Gan","year":"2022","journal-title":"J. Process Control"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1016\/j.petsci.2023.10.011","article-title":"Interpretation and Characterization of Rate of Penetration Intelligent Prediction Model","volume":"21","author":"Pei","year":"2024","journal-title":"Pet. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Caicedo, H.U., Calhoun, W.M., and Ewy, R.T. (2005, January 23\u201325). Unique ROP Predictor Using Bit-Specific Coefficient of Sliding Friction and Mechanical Efficiency as a Function of Confined Compressive Strength Impacts Drilling Performance. Proceedings of the SPE\/IADC Drilling Conference and Exhibition, Amsterdam, The Netherlands.","DOI":"10.2523\/92576-MS"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"117144","DOI":"10.1016\/j.measurement.2025.117144","article-title":"Deep learning approach to prediction of drill-bit torque in directional drilling sliding mode: Energy saving","volume":"250","author":"Cao","year":"2025","journal-title":"Measurement"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Bhatt, D., Patel, C., Talsania, H., Patel, J., Vaghela, R., Pandya, S., Modi, K., and Ghayvat, H. (2021). CNN Variants for Computer Vision: History, Architecture, Application, Challenges, and Future Scope. Electronics, 10.","DOI":"10.3390\/electronics10202470"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1016\/j.procs.2018.05.041","article-title":"Automated Detection of Diabetes Using CNN and CNN-LSTM Network and Heart Rate Signals","volume":"132","author":"Swapna","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"118122","DOI":"10.1016\/j.enconman.2024.118122","article-title":"A Hybrid Deep Learning Model Based on Parallel Architecture TCN-LSTM with Savitzky-Golay Filter for Wind Power Prediction","volume":"302","author":"Liu","year":"2024","journal-title":"Energy Convers. Manag."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"109686","DOI":"10.1016\/j.petrol.2021.109686","article-title":"Well Performance Prediction Based on Long Short-Term Memory (LSTM) Neural Network","volume":"208","author":"Huang","year":"2022","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"111615","DOI":"10.1016\/j.asoc.2024.111615","article-title":"A Self-Attention-LSTM Method for Dam Deformation Prediction Based on CEEMDAN Optimization","volume":"159","author":"Cai","year":"2024","journal-title":"Appl. Soft Comput."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"128701","DOI":"10.1016\/j.energy.2023.128701","article-title":"Oil Well Production Prediction Based on CNN-LSTM Model with Self-Attention Mechanism","volume":"284","author":"Pan","year":"2023","journal-title":"Energy"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/17\/11\/1962\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T12:12:13Z","timestamp":1763122333000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/17\/11\/1962"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,14]]},"references-count":39,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["sym17111962"],"URL":"https:\/\/doi.org\/10.3390\/sym17111962","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,14]]}}}