{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T16:36:25Z","timestamp":1783096585794,"version":"3.54.6"},"reference-count":65,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,1,17]],"date-time":"2023-01-17T00:00:00Z","timestamp":1673913600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["42174135"],"award-info":[{"award-number":["42174135"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["42074143"],"award-info":[{"award-number":["42074143"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2018YFA0702503"],"award-info":[{"award-number":["2018YFA0702503"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["33550006-20-ZC0699-0011"],"award-info":[{"award-number":["33550006-20-ZC0699-0011"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["33550006-22-FW0399-0019"],"award-info":[{"award-number":["33550006-22-FW0399-0019"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["42174135"],"award-info":[{"award-number":["42174135"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["42074143"],"award-info":[{"award-number":["42074143"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2018YFA0702503"],"award-info":[{"award-number":["2018YFA0702503"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["33550006-20-ZC0699-0011"],"award-info":[{"award-number":["33550006-20-ZC0699-0011"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["33550006-22-FW0399-0019"],"award-info":[{"award-number":["33550006-22-FW0399-0019"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Key R &amp; D Program of China","award":["42174135"],"award-info":[{"award-number":["42174135"]}]},{"name":"National Key R &amp; D Program of China","award":["42074143"],"award-info":[{"award-number":["42074143"]}]},{"name":"National Key R &amp; D Program of China","award":["2018YFA0702503"],"award-info":[{"award-number":["2018YFA0702503"]}]},{"name":"National Key R &amp; D Program of China","award":["33550006-20-ZC0699-0011"],"award-info":[{"award-number":["33550006-20-ZC0699-0011"]}]},{"name":"National Key R &amp; D Program of China","award":["33550006-22-FW0399-0019"],"award-info":[{"award-number":["33550006-22-FW0399-0019"]}]},{"name":"SINOPEC Key Laboratory of Geophysics","award":["42174135"],"award-info":[{"award-number":["42174135"]}]},{"name":"SINOPEC Key Laboratory of Geophysics","award":["42074143"],"award-info":[{"award-number":["42074143"]}]},{"name":"SINOPEC Key Laboratory of Geophysics","award":["2018YFA0702503"],"award-info":[{"award-number":["2018YFA0702503"]}]},{"name":"SINOPEC Key Laboratory of Geophysics","award":["33550006-20-ZC0699-0011"],"award-info":[{"award-number":["33550006-20-ZC0699-0011"]}]},{"name":"SINOPEC Key Laboratory of Geophysics","award":["33550006-22-FW0399-0019"],"award-info":[{"award-number":["33550006-22-FW0399-0019"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Picking the reflection horizon is an important step in velocity inversion and seismic interpretation. Manual picking is time-consuming and no longer suitable for current large-scale seismic data processing. Automatic algorithms using different seismic attributes such as instantaneous phase or dip attributes have been proposed. However, the computed attributes are usually inaccurate near discontinuities. The waveforms in the horizontal direction often change dramatically, which makes it difficult to track a horizon using the similarity of attributes. In this paper, we propose a novel method for automatic horizon picking using multiple seismic attributes and the Markov decision process (MDP). For the design of the MDP model, the decision time and state are defined as the horizontal and vertical spatial position on a seismic image, respectively. The reward function is defined in multi-dimensional feature attribute space. Multiple attributes can highlight different aspects of a seismic image and therefore overcome the limitations of the single-attribute MDP through the cross-constraint of multiple attributes. The optimal decision is made by searching the largest state value function in the reward function space. By considering cumulative reward, the lateral continuity of a seismic image can be effectively considered, and the impacts of abnormal waveform changes or bad traces in local areas for automatic horizon picking can be effectively avoided. An effective implementation scheme is designed for picking multiple reflection horizons. The proposed method has been successfully tested on both synthetic and field data.<\/jats:p>","DOI":"10.3390\/rs15030552","type":"journal-article","created":{"date-parts":[[2023,1,17]],"date-time":"2023-01-17T05:40:02Z","timestamp":1673934002000},"page":"552","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Automatic Horizon Picking Using Multiple Seismic Attributes and Markov Decision Process"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2036-2597","authenticated-orcid":false,"given":"Chengliang","family":"Wu","sequence":"first","affiliation":[{"name":"State Key Laboratory of Marine Geology, School of Ocean and Earth Science, Tongji University, Shanghai 200092, China"},{"name":"Wave Phenomena and Intelligent Inversion Imaging Group (WPI), School of Ocean and Earth Science, Tongji University, Shanghai 200092, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bo","family":"Feng","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Marine Geology, School of Ocean and Earth Science, Tongji University, Shanghai 200092, China"},{"name":"Wave Phenomena and Intelligent Inversion Imaging Group (WPI), School of Ocean and Earth Science, Tongji University, Shanghai 200092, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaonan","family":"Song","sequence":"additional","affiliation":[{"name":"Wave Phenomena and Intelligent Inversion Imaging Group (WPI), School of Ocean and Earth Science, Tongji University, Shanghai 200092, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huazhong","family":"Wang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Marine Geology, School of Ocean and Earth Science, Tongji University, Shanghai 200092, China"},{"name":"Wave Phenomena and Intelligent Inversion Imaging Group (WPI), School of Ocean and Earth Science, Tongji University, Shanghai 200092, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rongwei","family":"Xu","sequence":"additional","affiliation":[{"name":"Wave Phenomena and Intelligent Inversion Imaging Group (WPI), School of Ocean and Earth Science, Tongji University, Shanghai 200092, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shen","family":"Sheng","sequence":"additional","affiliation":[{"name":"Wave Phenomena and Intelligent Inversion Imaging Group (WPI), School of Ocean and Earth Science, Tongji University, Shanghai 200092, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,17]]},"reference":[{"key":"ref_1","unstructured":"Howard, R.E. (1991). Method for Attribute Tracking in Seismic Data. (No. 5,1991,056-066), U.S. Patent."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1190\/1.1444351","article-title":"Stratal slicing\u2014Part 1: Realistic 3D seismic model","volume":"63","author":"Zeng","year":"1998","journal-title":"Geophysics"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Stark, T.J. (2003). Unwrapping instantaneous phase to generate a relative geologic time volume. 73rd Annual International Meeting, SEG, Expanded Abstracts, Society of Exploration Geophysicists.","DOI":"10.1190\/1.1844072"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"O21","DOI":"10.1190\/geo2011-0351.1","article-title":"Generating a relative geologic time volume by 3D graph-cut phase unwrapping method with horizon and unconformity constraints","volume":"77","author":"Wu","year":"2012","journal-title":"Geophysics"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"H23","DOI":"10.1190\/geo2015-0098.1","article-title":"Automated reflection picking and polarity assessment through attribute analysis: Theory and application to synthetic and real ground-penetrating radar data","volume":"80","author":"Dossi","year":"2015","journal-title":"Geophysics"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"V141","DOI":"10.1190\/geo2015-0333.1","article-title":"Automated phase attribute-based picking applied to reflection seismic","volume":"81","author":"Forte","year":"2016","journal-title":"Geophysics"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1150","DOI":"10.1190\/1.1444415","article-title":"3-D seismic attributes using a semblance-based coherency algorithm","volume":"63","author":"Marfurt","year":"1998","journal-title":"Geophysics"},{"key":"ref_8","unstructured":"Lacaze, F., and Valding, T. (2009). Autopicking Velocity by Path-Integral Optimization and Surface Fairing. 79th Annual International Meeting, SEG Expanded Abstracts, Society of Exploration Geophysicists."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zou, G., Ji, R., Liu, W., and Zhang, J. (2013, January 23\u201324). Horizon auto-tracking technology based on the waveform similarity for the coalmining area seismic data. Proceedings of the 2013 2nd International Symposium on Instrumentation and Measurement, Sensor Network and Automation (IMSNA), Toronto, ON, Canada.","DOI":"10.1109\/IMSNA.2013.6743259"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1468","DOI":"10.1190\/1.1444651","article-title":"Eigenstructure-based coherence computations as an aid to 3-D structural and stratigraphic mapping","volume":"64","author":"Gersztenkorn","year":"1999","journal-title":"Geophysics"},{"key":"ref_11","unstructured":"Bakker, P. (2002). Image Structure Analysis for Seismic Interpretation. [Ph.D. Thesis, Delft University of Technology]."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"P13","DOI":"10.1190\/1.2210848","article-title":"Flattening without picking","volume":"71","author":"Lomask","year":"2006","journal-title":"Geophysics"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"888","DOI":"10.1190\/1.2756869","article-title":"Volumetric flattening: An interpretation tool","volume":"26","author":"Lomask","year":"2007","journal-title":"Lead. Edge"},{"key":"ref_14","unstructured":"Parks, D. (2010). Seismic Image Flattening as a Linear Inverse Problem. [Master\u2019s Thesis, Colorado School of Mines]."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"A13","DOI":"10.1190\/geo2016-0473.1","article-title":"Directional structure-tensor-based coherence to detect seismic faults and channels","volume":"82","author":"Wu","year":"2017","journal-title":"Geophysics"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"IM29","DOI":"10.1190\/geo2017-0830.1","article-title":"Least-squares horizons with local slopes and multigrid correlations","volume":"83","author":"Wu","year":"2018","journal-title":"Geophysics"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"SN47","DOI":"10.1190\/INT-2018-0053.1","article-title":"3D dip vector-guided auto-tracking for weak seismic reflections: A new tool for shale reservoir visualization and interpretation","volume":"6","author":"Di","year":"2018","journal-title":"Interpretation"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lou, Y., and Zhang, B. (2018). Automatic horizon picking using multiple seismic attributes. 88th Annual International Meeting, SEG Expanded Abstracts, Society of Exploration Geophysicists.","DOI":"10.1190\/segam2018-2997698.1"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"SQ39","DOI":"10.1190\/INT-2019-0296.1","article-title":"Tracking 3D seismic horizons with a new hybrid tracking algorithm","volume":"8","author":"Gogia","year":"2020","journal-title":"Interpretation"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Li, S., Zhao, J., Zhang, H., Bi, Z., and Qu, S. (2020). A Novel Horizon Picking Method on Sub-Bottom Profiler Sonar Images. Remote Sens., 12.","DOI":"10.3390\/rs12203322"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"O37","DOI":"10.1190\/geo2018-0303.1","article-title":"Seismic horizon picking by integrating reflector dip and instantaneous phase attributes","volume":"85","author":"Lou","year":"2020","journal-title":"Geophysics"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"979","DOI":"10.1109\/LGRS.2020.2991775","article-title":"Generating seismic horizon using multiple seismic attributes","volume":"18","author":"Zhang","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"e2019EA000680","DOI":"10.1029\/2019EA000680","article-title":"A Comprehensive Horizon-Picking Method on Subbottom Profiles by Combining Envelope, Phase Attributes, and Texture Analysis","volume":"7","author":"Zhao","year":"2020","journal-title":"Earth Space Sci."},{"key":"ref_24","unstructured":"Admasu, F., and T\u00f6nnies, K.D. (2004, January 4\u20135). Model-based Approach to Automatic 3D Seismic Horizon Correlation across Faults. Proceedings of the Simulation und Visualisierung 2004 (SimVis), Magdeburg, Germany."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1111\/j.1365-2478.1992.tb00552.x","article-title":"Seismic horizon detection using image processing algorithms","volume":"40","year":"1992","journal-title":"Geophys. Prospect."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1109\/TEVC.2004.841307","article-title":"A genetic algorithm for automated horizon correlation across faults in seismic images","volume":"9","author":"Aurnhammer","year":"2005","journal-title":"IEEE Trans. Evol. Comput."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Pauget, F., Lacaze, S., and Valding, T. (2009). A global approach in seismic interpretation based on cost function minimization. 79th Annual International Meeting, SEG Expanded Abstracts, Society of Exploration Geophysicists.","DOI":"10.1190\/1.3255384"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1190\/1.3535431","article-title":"A review of global interpretation methods for automated 3D horizon picking","volume":"30","author":"Hoyes","year":"2011","journal-title":"Lead. Edge"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"T131","DOI":"10.1190\/INT-2018-0210.1","article-title":"Global seismic horizon interpretation based on data mining\u2014A new tool for seismic geomorphologic study","volume":"8","author":"Hong","year":"2020","journal-title":"Interpretation"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"T227","DOI":"10.1190\/INT-2015-0160.1","article-title":"Automatically interpreting all faults, unconformities, and horizons from 3D seismic images","volume":"4","author":"Wu","year":"2016","journal-title":"Interpretation"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1138","DOI":"10.1088\/1742-2140\/aa7309","article-title":"Automatic seismic event tracking using a dynamic time warping algorithm","volume":"14","author":"Jin","year":"2017","journal-title":"J. Geophys. Eng."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"IM77","DOI":"10.1190\/geo2019-0029.1","article-title":"Automatic extraction of dislocated horizons from 3D seismic data using nonlocal trace matching","volume":"84","author":"Bugge","year":"2019","journal-title":"Geophysics"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"O1","DOI":"10.1190\/geo2020-0021.1","article-title":"Simulating the procedure of manual seismic horizon picking","volume":"86","author":"Lou","year":"2021","journal-title":"Geophysics"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1190\/geo2020-0039.1","article-title":"Seismic horizon extraction with dynamic programming","volume":"86","author":"Yan","year":"2021","journal-title":"Geophysics"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Harrigan, E., Kroh, J.R., Sandham, W.A., and Durrani, T.S. (1992, January 23\u201326). Seismic horizon picking using an artificial neural network. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, San Francisco, CA, USA.","DOI":"10.1109\/ICASSP.1992.226265"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Huang, K. (1997). Hopfield neural network for seismic horizon picking. 75th Annual International Meeting, SEG, Expanded Abstracts, Society of Exploration Geophysicists.","DOI":"10.1190\/1.1885963"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1840","DOI":"10.1109\/IJCNN.1998.687137","article-title":"Neural network for seismic horizon picking","volume":"Volume 3","author":"Huang","year":"1998","journal-title":"IEEE International Joint Conference on Neural Networks Proceedings"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Leggett, M., Sandham, W.A., and Durrani, T.S. (2003). Automated 3-D Horizon Tracking and Seismic Classification Using Artificial Neural Networks, Springer.","DOI":"10.1007\/978-94-017-0271-3_3"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"SE201","DOI":"10.1190\/INT-2018-0225.1","article-title":"Multi-resolution neural networks for tracking seismic horizons from few training images","volume":"7","author":"Peters","year":"2019","journal-title":"Interpretation"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1190\/tle37070529.1","article-title":"Convolutional neural networks for automated seismic interpretation","volume":"37","author":"Waldeland","year":"2018","journal-title":"Lead. Edge"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"SE113","DOI":"10.1190\/INT-2018-0235.1","article-title":"SaltSeg: Automatic 3D salt segmentation using a deep convolutional neural network","volume":"7","author":"Shi","year":"2019","journal-title":"Interpretation"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"B403","DOI":"10.1190\/geo2018-0672.1","article-title":"Semiautomated seismic horizon interpretation using the encoder-decoder convolutional neural network","volume":"84","author":"Wu","year":"2019","journal-title":"Geophysics"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"106709","DOI":"10.1016\/j.petrol.2019.106709","article-title":"Seismic horizon tracking using a deep convolutional neural network","volume":"187","author":"Yang","year":"2020","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"N17","DOI":"10.1190\/geo2019-0569.1","article-title":"Extracting horizon surfaces from 3D seismic data using deep learning","volume":"85","author":"Tschannen","year":"2020","journal-title":"Geophysics"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"109441","DOI":"10.1016\/j.petrol.2021.109441","article-title":"Automatic tracking for seismic horizons using convolution feature analysis and optimization algorithm","volume":"208","author":"Zhang","year":"2021","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Huang, K., Chang, W., and Lin, C. (1990). Self-organizing neural network for picking seismic horizons. 60th Annual International Meeting, SEG Expanded Abstracts, Society of Exploration Geophysicists.","DOI":"10.1190\/1.1890183"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"WA67","DOI":"10.1190\/geo2019-0438.1","article-title":"Waveform embedding: Automatic horizon picking with unsupervised deep learning","volume":"85","author":"Shi","year":"2020","journal-title":"Geophysics"},{"key":"ref_48","first-page":"279","article-title":"Foundations of a general theory of sequential decision functions. Econometrica","volume":"15","author":"Wald","year":"1947","journal-title":"J. Econom. Soc."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1095","DOI":"10.1073\/pnas.39.10.1095","article-title":"Stochastic games","volume":"39","author":"Shapley","year":"1953","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_50","first-page":"679","article-title":"Markovian decision process","volume":"6","author":"Bellman","year":"1957","journal-title":"J. Math. Mech."},{"key":"ref_51","unstructured":"Howard, R.A. (1960). Dynamic Programming and Markov Processes, John Wiley."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1214\/aoms\/1177704593","article-title":"Discrete dynamic programming","volume":"33","author":"Blackwell","year":"1962","journal-title":"Ann. Math. Stat."},{"key":"ref_53","unstructured":"Puterman, M.L. (2014). Markov Decision Processes: Discrete Stochastic Dynamic Programming, John Wiley & Sons."},{"key":"ref_54","unstructured":"Barto, A.G., Sutton, R.S., and Watkins, C. (1989). Learning and Sequential Decision Making, University of Massachusetts."},{"key":"ref_55","unstructured":"Littman, M.L. (1996). Algorithms for Sequential Decision-Making, Brown University."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"2654","DOI":"10.1016\/j.energy.2004.07.003","article-title":"Bio-energy with carbon storage (BECS): A sequential decision approach to the threat of abrupt climate change","volume":"30","author":"Read","year":"2005","journal-title":"Energy"},{"key":"ref_57","unstructured":"Bertsekas, D. (2012). Dynamic Programming and Optimal Control: Volume I, Athena Scientific."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/BF00992698","article-title":"Q-learning","volume":"8","author":"Watkins","year":"1992","journal-title":"Mach. Learn."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Sutton, R.S., and Barto, A.G. (1998). Reinforcement Learning, MIT Press.","DOI":"10.1109\/TNN.1998.712192"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Ma, Y., Fei, T., and Luo, Y. (2019). A new insight into automatic first-arrival picking based on reinforcement learning. 81st EAGE Conference and Exhibition, Expanded Abstracts, European Association of Geoscientists and Engineers.","DOI":"10.3997\/2214-4609.201901615"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1093\/jge\/gxab026","article-title":"Automatic first-arrival picking method via intelligent Markov optimal decision processes","volume":"18","author":"Luo","year":"2021","journal-title":"J. Geophys. Eng."},{"key":"ref_62","unstructured":"Sutton, R.S. (1996). Generalization in reinforcement learning: Successful examples using sparse coarse coding. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_63","first-page":"1375","article-title":"RTM angle gathers based on the Combining Local and Global (CLG) optical flow method and wavefield decomposition method","volume":"64","author":"Wu","year":"2021","journal-title":"Chin. J. Geophys."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Wu, C., Wang, T., Wang, H., Luo, F., and Xu, P. (2019). Improving the quality of Common-Image Gathers using DTW and Local Similarity. 89th SEG Annual International Meeting, Expanded Abstracts, Society of Exploration Geophysicists.","DOI":"10.1190\/segam2019-3211300.1"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/3\/552\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:08:17Z","timestamp":1760119697000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/3\/552"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,17]]},"references-count":65,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["rs15030552"],"URL":"https:\/\/doi.org\/10.3390\/rs15030552","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,17]]}}}