{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,28]],"date-time":"2026-06-28T11:12:53Z","timestamp":1782645173868,"version":"3.54.5"},"reference-count":39,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2024,5,16]],"date-time":"2024-05-16T00:00:00Z","timestamp":1715817600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Qinglan Project of Jiangsu Universities","award":["TZXY2018QDJJ006"],"award-info":[{"award-number":["TZXY2018QDJJ006"]}]},{"DOI":"10.13039\/501100016110","name":"the Talent Development Project of Taizhou University","doi-asserted-by":"publisher","award":["TZXY2018QDJJ006"],"award-info":[{"award-number":["TZXY2018QDJJ006"]}],"id":[{"id":"10.13039\/501100016110","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the Young Science and Technology Talent Support Project of Taizhou","award":["TZXY2018QDJJ006"],"award-info":[{"award-number":["TZXY2018QDJJ006"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Petrographic prediction is crucial in identifying target areas and understanding reservoir lithology in oil and gas exploration. Traditional logging methods often rely on manual interpretation and experiential judgment, which can introduce subjectivity and constraints due to data quality and geological variability. To enhance the precision and efficacy of lithology prediction, this study employed a Savitzky\u2013Golay filter with a symmetric window for anomaly data processing, coupled with a residual temporal convolutional network (ResTCN) model tasked with completing missing logging data segments. A comparative analysis against the support vector regression and random forest regression model revealed that the ResTCN achieves the smallest MAE, at 0.030, and the highest coefficient of determination, at 0.716, which are indicative of its proximity to the ground truth. These methodologies significantly enhance the quality of the training data. Subsequently, a Transformer\u2013long short-term memory (T-LS) model was applied to identify and classify the lithology of unexplored wells. The input layer of the Transformer model follows an embedding-like principle for data preprocessing, while the encoding block encompasses multi-head attention, Add &amp; Norm, and feedforward components, integrating the multi-head attention mechanism. The output layer interfaces with the LSTM layer through dropout. A performance evaluation of the T-LS model against established rocky prediction techniques such as logistic regression, k-nearest neighbor, and random forest demonstrated its superior identification and classification capabilities. Specifically, the T-LS model achieved a precision of 0.88 and a recall of 0.89 across nine distinct lithology features. A Shapley analysis of the T-LS model underscored the utility of amalgamating multiple logging data sources for lithology classification predictions. This advancement partially addresses the challenges associated with imprecise predictions and limited generalization abilities inherent in traditional machine learning and deep learning models applied to lithology identification, and it also helps to optimize oil and gas exploration and development strategies and improve the efficiency of resource extraction.<\/jats:p>","DOI":"10.3390\/sym16050616","type":"journal-article","created":{"date-parts":[[2024,5,16]],"date-time":"2024-05-16T06:44:31Z","timestamp":1715841871000},"page":"616","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["A Transformer and LSTM-Based Approach for Blind Well Lithology Prediction"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-3071-9365","authenticated-orcid":false,"given":"Danyan","family":"Xie","sequence":"first","affiliation":[{"name":"College of Information Engineering, Taizhou University, Taizhou 225300, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zeyang","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Taizhou University, Taizhou 225300, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fuhao","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Taizhou University, Taizhou 225300, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6163-0503","authenticated-orcid":false,"given":"Zhenyu","family":"Song","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Taizhou University, Taizhou 225300, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,5,16]]},"reference":[{"key":"ref_1","first-page":"125","article-title":"Status and prospects of exploration and exploitation key technologies of the deep petroleum resources in onshore Chinan","volume":"31","author":"Yao","year":"2018","journal-title":"J. Nat. Gas Geosci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"109267","DOI":"10.1016\/j.petrol.2021.109267","article-title":"A method of predicting oil and gas resource spatial distribution based on Bayesian network and its application","volume":"208","author":"Guo","year":"2022","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"744","DOI":"10.1007\/s12182-018-0261-y","article-title":"Intelligent prediction and integral analysis of shale oil and gas sweet spots","volume":"15","author":"Qian","year":"2018","journal-title":"Pet. Sci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3195","DOI":"10.1007\/s11053-022-10121-z","article-title":"Evaluation and development of a predictive model for geophysical well log data analysis and reservoir characterization: Machine learning applications to lithology prediction","volume":"31","author":"Mishra","year":"2022","journal-title":"Nat. Resour. Res."},{"key":"ref_5","first-page":"119","article-title":"Reservoir characteristics of oil sands and logging evaluation methods: A case study from Ganchaigou area, Qaidam Basin","volume":"27","author":"Logging","year":"2015","journal-title":"Lithol. Reserv."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"103929","DOI":"10.1016\/j.jappgeo.2019.103929","article-title":"Research and application of logging lithology identification for igneous reservoirs based on deep learning","volume":"173","author":"Min","year":"2020","journal-title":"J. Appl. Geophys."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1819","DOI":"10.1109\/LGRS.2019.2911473","article-title":"A lithology identification approach based on machine learning with evolutionary parameter tuning","volume":"16","author":"Saporetti","year":"2019","journal-title":"IEEE Geosci. Remote. Sens. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"109840","DOI":"10.1016\/j.petrol.2021.109840","article-title":"Application of machine learning to quantification of mineral composition on gas hydrate-bearing sediments, Ulleung Basin, Korea","volume":"209","author":"Park","year":"2022","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"109482","DOI":"10.1016\/j.petrol.2021.109482","article-title":"Spatial assessment of gross vertical reservoir heterogeneity using geostatistics and GIS-based machine-learning classifiers: A case study from the Zubair Formation, Rumaila oil field, southern Iraq","volume":"208","author":"Handhal","year":"2022","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"109250","DOI":"10.1016\/j.petrol.2021.109250","article-title":"Performance evaluation of machine learning-based classification with rock-physics analysis of geological lithofacies in Tarakan Basin, Indonesia","volume":"208","author":"Antariksa","year":"2022","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_11","unstructured":"Mukhopadhyay, P. (2024). Unconventional Shale Gas Exploration and Exploitation: Current Trends in Shale Gas Exploitation, Springer International Publishing."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"105346","DOI":"10.1016\/j.jappgeo.2024.105346","article-title":"A novel hybrid CNN\u2013SVM method for lithology identification in shale reservoirs based on logging measurements","volume":"223","author":"Li","year":"2024","journal-title":"J. Appl. Geophys."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"211917","DOI":"10.1016\/j.geoen.2023.211917","article-title":"Formation lithology predictions based on measurement while drilling (MWD) using gradient boosting algorithms","volume":"227","author":"Lee","year":"2023","journal-title":"Geoenergy Sci. Eng."},{"key":"ref_14","first-page":"043003","article-title":"Real-time prediction of Litho-facies from drilling data using an Artificial Neural Network: A comparative field data study with optimizing algorithms","volume":"144","author":"Agrawal","year":"2022","journal-title":"J. Energy Resour. Technol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2778","DOI":"10.2118\/202477-PA","article-title":"Automated well-log processing and lithology classification by identifying optimal features through unsupervised and supervised machine-learning algorithms","volume":"25","author":"Singh","year":"2020","journal-title":"SPE J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1007\/s10708-021-10502-6","article-title":"Prediction of sonic log and correlation of lithology by comparing geophysical well log data using machine learning principles","volume":"88","author":"Joshi","year":"2021","journal-title":"GeoJournal"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"7506405","DOI":"10.1109\/LGRS.2023.3322677","article-title":"A Lithology Identification Approach Using Well Logs Data and Convolutional Long Short-Term Memory networks","volume":"20","author":"Wang","year":"2023","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5919912","DOI":"10.1109\/TGRS.2022.3205301","article-title":"Reservoir prediction based on closed-loop CNN and virtual well-logging labels","volume":"60","author":"Song","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wu, L., Dong, Z., and Li, W. (2021). Well-logging prediction based on hybrid neural network model. IEEE Trans. Geosci. Remote Sens., 14.","DOI":"10.3390\/en14248583"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"105950","DOI":"10.1016\/j.engappai.2023.105950","article-title":"Oil logging reservoir recognition based on TCN and SA-BiLSTM deep learning method","volume":"121","author":"Yang","year":"2023","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1190\/tle41090617.1","article-title":"Predicting sonic and density logs from drilling parameters using temporal convolutional networks","volume":"41","author":"Smith","year":"2022","journal-title":"Lead. Edge"},{"key":"ref_22","unstructured":"Vaswani, A., Shazeer, N., and Parmar, N. (2017). Attention is all you need. Adv. Neural Inf. Process. Syst., 30."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_24","unstructured":"Jacinto, M.V.G., Silva, M.A., de Oliveira, L.H.L., Medeiros, D.R., de Medeiros, G.C., Rodrigues, T.C., and de Almeida, R.V. (2023, January 2\u20135). Lithostratigraphy Modeling with Transformer-Based Deep Learning and Natural Language Processing Techniques. Proceedings of the Abu Dhabi International Petroleum Exhibition and Conference, Abu Dhabi, United Arab Emirates. SPE, D031S110R003."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3107539","DOI":"10.1016\/j.petrol.2020.107539","article-title":"Automatic interpretation of cement evaluation logs from cased boreholes using supervised deep neural networks","volume":"195","author":"Viggen","year":"2020","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1016\/S1876-3804(18)30068-5","article-title":"Synthetic Well Logs Generation via Recurrent Neural Networks","volume":"45","author":"Zhang","year":"2018","journal-title":"Pet. Explor. Dev."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"700","DOI":"10.1093\/jge\/gxab046","article-title":"A method for well log data generation based on a spatio-temporal neural network","volume":"18","author":"Wang","year":"2021","journal-title":"J. Geophys. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1849","DOI":"10.1007\/s13202-020-00839-y","article-title":"A comparative study of heterogeneous ensemble methods for the identification of geological lithofacies.Journal of Petroleum","volume":"10","author":"Tewari","year":"2020","journal-title":"Explor. Prod. Technol."},{"key":"ref_29","first-page":"59","article-title":"Identification of gas zones and chimneys using seismic attributes analysis at the Scarab field, offshore, Nile Delta, Egypt","volume":"5","author":"Ismail","year":"2020","journal-title":"Pet. Res."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1515\/acgeo-2015-0062","article-title":"Applications of savitzky-golay filter for seismic random noise reduction","volume":"64","author":"Liu","year":"2016","journal-title":"Acta Geophys."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1041","DOI":"10.1111\/1365-2478.12892","article-title":"An optimal Savitzky\u2013Golay derivative filter with geophysical applications: An example of self-potential data","volume":"68","author":"Roy","year":"2020","journal-title":"Geophys. Prospect."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1007\/s12145-019-00381-4","article-title":"A machine learning approach to predict drilling rate using petrophysical and mud logging data","volume":"12","author":"Sabah","year":"2019","journal-title":"Earth Sci. Inform."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1627","DOI":"10.1021\/ac60214a047","article-title":"Smoothing and differentiation of data by simplified least squares procedures","volume":"36","author":"Savitzky","year":"1964","journal-title":"Anal. Chem."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1190\/geo2019-0429.1","article-title":"A gradient boosting decision tree algorithm combining synthetic minority oversampling technique for lithology identification","volume":"85","author":"Zhou","year":"2020","journal-title":"Geophysics"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"106326","DOI":"10.1016\/j.gexplo.2019.06.008","article-title":"Predictive lithologic mapping of South Korea from geochemical data using decision trees","volume":"205","author":"Bacal","year":"2019","journal-title":"J. Geochem. Explor."},{"key":"ref_36","first-page":"SPWLA-2004-v45n3a4","article-title":"Well log normalization: Methods and guidelines","volume":"45","author":"Shier","year":"2004","journal-title":"Petrophys.-SPWLA J. Form. Eval. Reserv. Descr."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/j.petrol.2019.01.006","article-title":"Optimization of models for a rapid identification of lithology while drilling-A win-win strategy based on machine learning","volume":"176","author":"Sun","year":"2019","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_38","unstructured":"Jiang, H., and Nachum, O. (2020, January 26\u201328). Identifying and correcting label bias in machine learning. Proceedings of the International Conference on Artificial Intelligence and Statistics, Online. PLMR."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Elmgerbi, A., Chuykov, E., Thonhauser, G., and Nascimento, A. (2022, January 21\u201323). Machine learning techniques application for real-time drilling hydraulic optimization. Proceedings of the International Petroleum Technology Conference, Dhahran, Saudi Arabia. IPTC; D011S018R002.","DOI":"10.2523\/IPTC-22662-MS"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/16\/5\/616\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:43:22Z","timestamp":1760107402000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/16\/5\/616"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,16]]},"references-count":39,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,5]]}},"alternative-id":["sym16050616"],"URL":"https:\/\/doi.org\/10.3390\/sym16050616","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,16]]}}}