{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,26]],"date-time":"2026-10-26T13:33:33Z","timestamp":1793021613067,"version":"4.5.0"},"reference-count":75,"publisher":"American Chemical Society (ACS)","issue":"20","license":[{"start":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T00:00:00Z","timestamp":1791849600000},"content-version":"stm-asf","delay-in-days":0,"URL":"https:\/\/doi.org\/10.15223\/policy-029"},{"start":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T00:00:00Z","timestamp":1791849600000},"content-version":"stm-asf","delay-in-days":0,"URL":"https:\/\/doi.org\/10.15223\/policy-037"},{"start":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T00:00:00Z","timestamp":1791849600000},"content-version":"stm-asf","delay-in-days":0,"URL":"https:\/\/doi.org\/10.15223\/policy-045"}],"funder":[{"DOI":"10.13039\/501100003395","name":"Shanghai Municipal Education Commission","doi-asserted-by":"publisher","award":["2024AIYB005"],"award-info":[{"award-number":["2024AIYB005"]}],"id":[{"id":"10.13039\/501100003395","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003399","name":"Science and Technology Commission of Shanghai Municipality","doi-asserted-by":"publisher","award":["25JS2850100"],"award-info":[{"award-number":["25JS2850100"]}],"id":[{"id":"10.13039\/501100003399","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003399","name":"Science and Technology Commission of Shanghai Municipality","doi-asserted-by":"publisher","award":["25ZR1402261"],"award-info":[{"award-number":["25ZR1402261"]}],"id":[{"id":"10.13039\/501100003399","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Natural Science Foundation of China (NSFC)","award":["32370587"],"award-info":[{"award-number":["32370587"]}],"id":[{"id":"https:\/\/ror.org\/01h0zpd94","id-type":"ROR","asserted-by":"crossref"}]},{"name":"National Natural Science Foundation of China (NSFC)","award":["32500568"],"award-info":[{"award-number":["32500568"]}],"id":[{"id":"https:\/\/ror.org\/01h0zpd94","id-type":"ROR","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,10,26]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Accurate prediction of RNA tertiary structure remains a central challenge in structural biology, yet existing computational approaches face fundamental limitations arising from the ruggedness of the RNA free-energy landscape and the scarcity of experimentally resolved structures. Here we present RNADaemon, a framework that formulates RNA tertiary structure prediction as a Markov Decision Process and trains a Soft Actor-Critic agent to apply adaptive external force-field biases that steer all-atom molecular dynamics toward native-like conformations to minimize the eRMSD metric. Trained on 479 monomeric RNA structures and evaluated on 14 test cases from CASP16, RNA-Puzzles, and the PDB, the agent trains stably, approaches SimRNA and FARFAR2 in median RMSD, and recovers the global fold of most reference structures. However, performance remains markedly inferior to that of AlphaFold 3 and trRosettaRNA. We identify the scalar Bellman error as a fundamental information bottleneck that currently limits the performance of the agent. To our knowledge, this is the first application of continuous-action deep reinforcement learning (RL) with all-atom force fields to RNA tertiary structure prediction. This study establishes a benchmark for future comparisons and provides diagnostic insights for RL-guided RNA structure modeling.<\/jats:p>","DOI":"10.1021\/acs.jcim.6c02247","type":"journal-article","created":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T14:25:37Z","timestamp":1791901537000},"page":"13534-13547","source":"Crossref","is-referenced-by-count":0,"title":["RNADaemon: Reinforcement\nLearning-Guided Molecular\nDynamics for RNA Tertiary Structure Prediction"],"prefix":"10.1021","volume":"66","author":[{"given":"Wentao","family":"Xu","sequence":"first","affiliation":[{"name":"Shanghai Jiao Tong University , , ,","place":["Shanghai, China, 200240"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"You","family":"Wu","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University , , ,","place":["Shanghai, China, 200240"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5730-8802","authenticated-orcid":true,"given":"Xiang","family":"Yu","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University , , ,","place":["Shanghai, China, 200240"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"316","published-online":{"date-parts":[[2026,10,13]]},"reference":[{"issue":"5258","key":"2026102608084777100_cit1","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1038\/227561a0","article-title":"Central dogma\nof molecular biology","volume":"227","author":"Crick","year":"1970","journal-title":"Nature"},{"issue":"1","key":"2026102608084777100_cit2","doi-asserted-by":"publisher","first-page":"543","DOI":"10.1146\/annurev.bi.59.070190.002551","article-title":"Self-splicing\nof group I introns","volume":"59","author":"Cech","year":"1990","journal-title":"Annu. Rev. Biochem."},{"issue":"2","key":"2026102608084777100_cit3","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1080\/10409230600602634","article-title":"Ribonuclease P: the evolution of an ancient RNA enzyme","volume":"41","author":"Walker","year":"2006","journal-title":"Crit Rev. Biochem. Mol. Biol."},{"issue":"2","key":"2026102608084777100_cit4","doi-asserted-by":"publisher","DOI":"10.1101\/cshperspect.a003566","article-title":"Riboswitches\nand the RNA world","volume":"4","author":"Breaker","year":"2012","journal-title":"Cold Spring Harbor Perspect.\nBiol."},{"issue":"4","key":"2026102608084777100_cit5","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1002\/wrna.1113","article-title":"G-quadruplexes in RNA\nbiology","volume":"3","author":"Millevoi","year":"2012","journal-title":"WIREs RNA"},{"issue":"1","key":"2026102608084777100_cit6","doi-asserted-by":"publisher","DOI":"10.1038\/s41392-022-00916-0","article-title":"Cryo-EM advances in RNA structure\ndetermination","volume":"7","author":"Ma","year":"2022","journal-title":"Signal Transduction Targeted\nTher."},{"issue":"3","key":"2026102608084777100_cit7","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1038\/s41576-022-00546-w","article-title":"Probing the dynamic RNA structurome\nand its functions","volume":"24","author":"Spitale","year":"2023","journal-title":"Nat. Rev. Genet."},{"issue":"1","key":"2026102608084777100_cit8","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1073\/pnas.0806929106","article-title":"Accurate SHAPE-directed\nRNA structure determination","volume":"106","author":"Deigan","year":"2009","journal-title":"Proc. Natl. Acad.\nSci."},{"issue":"14","key":"2026102608084777100_cit9","doi-asserted-by":"publisher","DOI":"10.3390\/molecules28145532","article-title":"RNA 3D structure\nprediction: progress and perspective","volume":"28","author":"Wang","year":"2023","journal-title":"Molecules"},{"issue":"10","key":"2026102608084777100_cit10","doi-asserted-by":"publisher","first-page":"615","DOI":"10.1038\/s41576-018-0034-x","article-title":"High-throughput determination of\nRNA structures","volume":"19","author":"Strobel","year":"2018","journal-title":"Nat. Rev. Genet."},{"issue":"7","key":"2026102608084777100_cit11","doi-asserted-by":"publisher","first-page":"e63","DOI":"10.1093\/nar\/gkv1479","article-title":"SimRNA: a coarse-grained method for RNA folding\nsimulations and 3D structure prediction","volume":"44","author":"Boniecki","year":"2016","journal-title":"Nucleic\nAcids Res."},{"issue":"7","key":"2026102608084777100_cit12","doi-asserted-by":"publisher","first-page":"3341","DOI":"10.1093\/nar\/gkad122","article-title":"RNAJP:\nenhanced RNA 3D structure predictions with non-canonical\ninteractions and global topology sampling","volume":"51","author":"Li","year":"2023","journal-title":"Nucleic\nAcids Res."},{"issue":"14","key":"2026102608084777100_cit13","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gks339","article-title":"Automated 3D structure composition for large RNAs","volume":"40","author":"Popenda","year":"2012","journal-title":"Nucleic Acids Res."},{"issue":"4","key":"2026102608084777100_cit14","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1038\/nmeth.1433","article-title":"Atomic accuracy in predicting and\ndesigning noncanonical RNA structure","volume":"7","author":"Das","year":"2010","journal-title":"Nat. Methods"},{"issue":"37","key":"2026102608084777100_cit15","doi-asserted-by":"publisher","first-page":"14664","DOI":"10.1073\/pnas.0703836104","article-title":"Automated de novo prediction of native-like RNA\ntertiary structures","volume":"104","author":"Das","year":"2007","journal-title":"Proc. Natl. Acad. Sci."},{"issue":"8","key":"2026102608084777100_cit16","doi-asserted-by":"publisher","first-page":"963","DOI":"10.1016\/j.str.2020.05.011","article-title":"FARFAR2: improved de novo rosetta\nprediction of complex global RNA folds","volume":"28","author":"Watkins","year":"2020","journal-title":"Structure"},{"issue":"9","key":"2026102608084777100_cit17","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0107504","article-title":"Vfold:\na web server for RNA structure\nand folding thermodynamics prediction","volume":"9","author":"Xu","year":"2014","journal-title":"PLoS\nOne"},{"key":"2026102608084777100_cit18","doi-asserted-by":"crossref","unstructured":"Pearce, R.; Omenn, G. S.; Zhang, Y.\n          \n            De novo RNA\ntertiary structure prediction at atomic resolution using geometric\npotentials from deep learning\n          Bioinformatics\n          2022\n          http:\/\/biorxiv.org\/lookup\/doi\/10.1101\/2022.05.15.491755\n          10.1101\/2022.05.15.491755.","DOI":"10.1101\/2022.05.15.491755"},{"issue":"1","key":"2026102608084777100_cit19","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1038\/s41592-023-02086-5","article-title":"Accurate prediction of protein\u2013nucleic acid\ncomplexes using RoseTTAFoldNA","volume":"21","author":"Baek","year":"2024","journal-title":"Nat. Methods"},{"issue":"1","key":"2026102608084777100_cit20","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-023-42528-4","article-title":"trRosettaRNA: automated prediction of RNA 3D structure\nwith transformer network","volume":"14","author":"Wang","year":"2023","journal-title":"Nat. Commun."},{"issue":"8016","key":"2026102608084777100_cit21","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1038\/s41586-024-07487-w","article-title":"Accurate structure prediction of biomolecular interactions\nwith AlphaFold 3","volume":"630","author":"Abramson","year":"2024","journal-title":"Nature"},{"issue":"12","key":"2026102608084777100_cit22","doi-asserted-by":"publisher","first-page":"2287","DOI":"10.1038\/s41592-024-02487-0","article-title":"Accurate RNA 3D structure\nprediction using a language model-based\ndeep learning approach","volume":"21","author":"Shen","year":"2024","journal-title":"Nat. Methods"},{"issue":"1","key":"2026102608084777100_cit23","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-025-56261-7","article-title":"NuFold: end-to-end approach for RNA\ntertiary structure prediction with flexible nucleobase center representation","volume":"16","author":"Kagaya","year":"2025","journal-title":"Nat. Commun."},{"key":"2026102608084777100_cit24","doi-asserted-by":"crossref","unstructured":"Sarma, S.; Truscott, H.; Xu, D.; Reid, K.; Chu, L. S.; Chen, J.; Gray, J. J.\n          Can we extract physics-like energies from generative\nprotein diffusion models?\n          Biophysics\n          2025\n          http:\/\/biorxiv.org\/lookup\/doi\/doi:10.1101\/2025.11.28.690021\n          10.1101\/2025.11.28.690021.","DOI":"10.1101\/2025.11.28.690021"},{"issue":"12","key":"2026102608084777100_cit25","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1012715","article-title":"Systematic benchmarking\nof deep-learning methods for tertiary RNA structure prediction","volume":"20","author":"Bahai","year":"2024","journal-title":"PLOS Comput. Biol."},{"issue":"13","key":"2026102608084777100_cit26","doi-asserted-by":"publisher","first-page":"7465","DOI":"10.1093\/nar\/gkae541","article-title":"Comparative\nanalysis of RNA 3D structure prediction methods: towards enhanced\nmodeling of RNA\u2013ligand interactions","volume":"52","author":"Nithin","year":"2024","journal-title":"Nucleic Acids Res."},{"issue":"2","key":"2026102608084777100_cit27","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1107\/S2059798325000592","article-title":"Has AlphaFold 3 achieved success for RNA?","volume":"81","author":"Bernard","year":"2025","journal-title":"Acta Crystallogr.,\nSect. D:Struct. Biol."},{"issue":"7873","key":"2026102608084777100_cit28","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1038\/s41586-021-03819-2","article-title":"Highly accurate protein structure prediction\nwith AlphaFold","volume":"596","author":"Jumper","year":"2021","journal-title":"Nature"},{"key":"2026102608084777100_cit29","first-page":"526","volume-title":"Reinforcement Learning:\nAn Introduction","author":"Sutton","year":"2018","edition":"2"},{"key":"2026102608084777100_cit30","volume-title":"Understanding Molecular Simulation:\nfrom Algorithms to Applications","author":"Frenkel","year":"2002","edition":"2"},{"issue":"4","key":"2026102608084777100_cit31","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1038\/s42254-020-0153-0","article-title":"Using metadynamics\nto explore complex free-energy landscapes","volume":"2","author":"Bussi","year":"2020","journal-title":"Nat.\nRev. Phys."},{"issue":"6","key":"2026102608084777100_cit32","doi-asserted-by":"publisher","first-page":"932","DOI":"10.1002\/wcms.66","article-title":"Umbrella sampling","volume":"1","author":"Ka\u0308stner","year":"2011","journal-title":"WIREs Comput.\nMol. Sci."},{"issue":"1","key":"2026102608084777100_cit33","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1146\/annurev.biophys.37.032807.125957","article-title":"RNA folding:\nconformational statistics, folding kinetics, and ion electrostatics","volume":"37","author":"Chen","year":"2008","journal-title":"Annu. Rev. Biophys."},{"issue":"9","key":"2026102608084777100_cit34","doi-asserted-by":"publisher","first-page":"5422","DOI":"10.1021\/acs.jctc.2c00683","article-title":"Multiagent reinforcement\nlearning-based adaptive sampling\nfor conformational dynamics of proteins","volume":"18","author":"Kleiman","year":"2022","journal-title":"J.\nChem. Theory Comput."},{"key":"2026102608084777100_cit35","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1710.00495","article-title":"REinforcement learning based\nAdaptive samPling: REAPing rewards by exploring protein conformational\nlandscapes","author":"Shamsi","year":"2017"},{"key":"2026102608084777100_cit36","unstructured":"Haarnoja, T.; Zhou, A.; Hartikainen, K.; Tucker, G.; Ha, S.; Tan, J.; et al.\n          Soft actor-critic algorithms and applications. 2018, arXiv:1812.05905. arXiv.org e-Printarchive. https:\/\/arxiv.org\/abs\/1812.0590510.48550\/arXiv.1812.05905."},{"key":"2026102608084777100_cit37","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1016\/B978-0-08-050755-2.50052-X","article-title":"Newell\u2019s\nmethod for computing the plane equation of a polygon","volume-title":"Graphics Gems III (IBM Version)","author":"Tampieri","year":"1992"},{"issue":"2\u20136","key":"2026102608084777100_cit38","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1080\/08927029308022170","article-title":"Targeted molecular\ndynamics simulation of conformational change-application to the T\u2013R\ntransition in insulin","volume":"10","author":"Schlitter","year":"1993","journal-title":"Mol. Simul."},{"issue":"21","key":"2026102608084777100_cit39","doi-asserted-by":"publisher","first-page":"13306","DOI":"10.1093\/nar\/gku972","article-title":"The role of nucleobase interactions\nin RNA structure and dynamics","volume":"42","author":"Bottaro","year":"2014","journal-title":"Nucleic Acids\nRes."},{"issue":"21","key":"2026102608084777100_cit40","doi-asserted-by":"publisher","first-page":"2722","DOI":"10.1093\/bioinformatics\/btt473","article-title":"lDDT: a local superposition-free\nscore for comparing protein structures and models using distance difference\ntests","volume":"29","author":"Mariani","year":"2013","journal-title":"Bioinformatics"},{"issue":"10","key":"2026102608084777100_cit41","doi-asserted-by":"publisher","first-page":"1875","DOI":"10.1261\/rna.1700409","article-title":"New metrics for comparing\nand assessing discrepancies between RNA 3D structures and models","volume":"15","author":"Parisien","year":"2009","journal-title":"RNA"},{"issue":"4","key":"2026102608084777100_cit42","doi-asserted-by":"publisher","first-page":"702","DOI":"10.1002\/prot.20264","article-title":"Scoring function for automated assessment of protein\nstructure template quality","volume":"57","author":"Zhang","year":"2004","journal-title":"Proteins:Struct.,\nFunct., Bioinf."},{"issue":"9","key":"2026102608084777100_cit43","doi-asserted-by":"publisher","first-page":"1109","DOI":"10.1038\/s41592-022-01585-1","article-title":"US-align: universal\nstructure alignments of proteins, nucleic acids, and macromolecular\ncomplexes","volume":"19","author":"Zhang","year":"2022","journal-title":"Nat. Methods"},{"issue":"1","key":"2026102608084777100_cit44","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1021\/acs.jpcb.3c06662","article-title":"OpenMM 8: molecular dynamics simulation with\nmachine learning potentials","volume":"128","author":"Eastman","year":"2024","journal-title":"J. Phys. Chem.\nB"},{"issue":"4","key":"2026102608084777100_cit45","doi-asserted-by":"publisher","first-page":"2020","DOI":"10.1021\/ct3010485","article-title":"Improved generalized\nborn solvent\nmodel parameters for protein simulations","volume":"9","author":"Nguyen","year":"2013","journal-title":"J.\nChem. Theory Comput."},{"issue":"8","key":"2026102608084777100_cit46","doi-asserted-by":"publisher","first-page":"3714","DOI":"10.1021\/acs.jctc.5b00271","article-title":"Refinement\nof generalized born implicit solvation parameters for nucleic acids\nand their complexes with proteins","volume":"11","author":"Nguyen","year":"2015","journal-title":"J. Chem.\nTheory Comput."},{"issue":"1","key":"2026102608084777100_cit47","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1146\/annurev.bb.19.060190.001505","article-title":"Electrostatic interactions\nin macromolecules: theory and applications","volume":"19","author":"Sharp","year":"1990","journal-title":"Annu. Rev. Biophys. Biophys. Chem."},{"issue":"19","key":"2026102608084777100_cit48","doi-asserted-by":"publisher","first-page":"5179","DOI":"10.1021\/ja00124a002","article-title":"A second\ngeneration force field for the simulation\nof proteins, nucleic acids, and organic molecules","volume":"117","author":"Cornell","year":"1995","journal-title":"J. Am. Chem. Soc."},{"issue":"9","key":"2026102608084777100_cit49","doi-asserted-by":"publisher","first-page":"2886","DOI":"10.1021\/ct200162x","article-title":"Refinement\nof the cornell et al. Nucleic acids force field based on reference\nquantum chemical calculations of glycosidic torsion profiles","volume":"7","author":"Zgarbova\u0301","year":"2011","journal-title":"J. Chem. Theory Comput."},{"issue":"1","key":"2026102608084777100_cit50","doi-asserted-by":"publisher","DOI":"10.1093\/amrx\/abs010","article-title":"Rational construction\nof stochastic numerical methods\nfor molecular sampling","volume":"2013","author":"Leimkuhler","year":"2012","journal-title":"Appl. Math. Res. Express"},{"issue":"5","key":"2026102608084777100_cit51","doi-asserted-by":"publisher","first-page":"911","DOI":"10.1006\/jmbi.1999.2700","article-title":"Expanded sequence\ndependence of thermodynamic parameters improves prediction of RNA\nsecondary structure","volume":"288","author":"Mathews","year":"1999","journal-title":"J. Mol. Biol."},{"issue":"1","key":"2026102608084777100_cit52","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1093\/nar\/28.1.235","article-title":"The protein\ndata bank","volume":"28","author":"Berman","year":"2000","journal-title":"Nucleic Acids Res."},{"issue":"D1","key":"2026102608084777100_cit53","doi-asserted-by":"publisher","first-page":"D564","DOI":"10.1093\/nar\/gkae1091","article-title":"Updated resources for\nexploring experimentally-determined\nPDB structures and Computed Structure Models at the RCSB Protein Data\nBank","volume":"53","author":"Burley","year":"2025","journal-title":"Nucleic Acids Res."},{"key":"2026102608084777100_cit54","doi-asserted-by":"crossref","unstructured":"Kretsch, R. C.; Hummer, A. M.; He, S.; Yuan, R.; Zhang, J.; Karagianes, T.; et al.\n          Assessment of nucleic acid structure\nprediction in CASP16\n          Biophysics\n          2025\n          http:\/\/biorxiv.org\/lookup\/doi\/doi:10.1101\/2025.05.06.652459\n          10.1101\/2025.05.06.652459.","DOI":"10.1101\/2025.05.06.652459"},{"issue":"2","key":"2026102608084777100_cit55","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1038\/s41592-024-02543-9","article-title":"RNA-Puzzles round V: blind predictions\nof 23 RNA structures","volume":"22","author":"Bu","year":"2025","journal-title":"Nat. Methods"},{"issue":"4","key":"2026102608084777100_cit56","doi-asserted-by":"publisher","first-page":"610","DOI":"10.1261\/rna.031054.111","article-title":"RNA-Puzzles: A CASP-like evaluation\nof RNA three-dimensional structure prediction","volume":"18","author":"Cruz","year":"2012","journal-title":"RNA"},{"issue":"14","key":"2026102608084777100_cit57","doi-asserted-by":"publisher","first-page":"3668","DOI":"10.1093\/bioinformatics\/btac386","article-title":"RNAsolo: a repository of cleaned\nPDB-derived RNA 3D structures","volume":"38","author":"Adamczyk","year":"2022","journal-title":"Bioinformatics"},{"key":"2026102608084777100_cit58","doi-asserted-by":"publisher","DOI":"10.12688\/f1000research.18458.2","article-title":"3D based on 2D:\ncalculating helix angles and stacking patterns using forgi 2.0, an\nRNA python library centered on secondary structure elements","volume":"8","author":"Thiel","year":"2019","journal-title":"F1000Research"},{"key":"2026102608084777100_cit59","unstructured":"Chen, X.; Wang, C.; Zhou, Z.; Ross, K.\n          Randomized ensembled double Q-learning: learning\nfast without a model. 2021, arXiv:2101.05982.\narXiv.org e-Printarchive. https:\/\/arxiv.org\/abs\/2101.0598210.48550\/arXiv.2101.05982."},{"key":"2026102608084777100_cit60","unstructured":"Hiraoka, T.; Imagawa, T.; Hashimoto, T.; Onishi, T.; Tsuruoka, Y.\n          Dropout Q-functions\nfor doubly efficient reinforcement learning. 2021, arXiv:2110.02034. arXiv.org e-Printarchive. https:\/\/arxiv.org\/abs\/2110.0203410.48550\/arXiv.2110.02034."},{"key":"2026102608084777100_cit61","unstructured":"Ba, J. L.; Kiros, J. R.; Hinton, G. E.\n          Layer normalization. 2016, arXiv:1607.06450. arXiv.org e-Printarchive. https:\/\/arxiv.org\/abs\/1607.0645010.48550\/ARXIV.1607.06450."},{"issue":"1","key":"2026102608084777100_cit62","first-page":"1929","article-title":"Dropout: a simple way to prevent neural networks from\noverfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"2026102608084777100_cit63","unstructured":"Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A. N.; et al.\n          Attention is all\nyou need. 2017, arXiv:1706.03762. arXiv.org\ne-Printarchive. https:\/\/arxiv.org\/abs\/1706.0376210.48550\/arXiv.1706.03762."},{"key":"2026102608084777100_cit64","unstructured":"Xiong, R.; Yang, Y.; He, D.; Zheng, K.; Zheng, S.; Xing, C.; et al.\n          On layer normalization\nin the transformer\narchitecture. 2020, arXiv:2002.04745.\narXiv.org e-Printarchive. http:\/\/arxiv.org\/abs\/2002.0474510.48550\/arXiv.2002.04745."},{"key":"2026102608084777100_cit65","unstructured":"Lin, M.; Chen, Q.; Yan, S.\n          Network in network. 2013, arXiv:1312.4400. arXiv.org e-Printarchive. https:\/\/arxiv.org\/abs\/1312.440010.48550\/arXiv.1312.4400."},{"key":"2026102608084777100_cit66","doi-asserted-by":"crossref","unstructured":"Watkins, A.; Das, R.\n          RNA 3D modeling with FARFAR2,\nonline\n          Biochemistry\n          2020\n          http:\/\/biorxiv.org\/lookup\/doi\/doi:10.1101\/2020.11.26.399451\n          10.1101\/2020.11.26.399451.","DOI":"10.1101\/2020.11.26.399451"},{"issue":"2","key":"2026102608084777100_cit67","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbae064","article-title":"RNAdvisor: a comprehensive\nbenchmarking tool for the measure and prediction of RNA structural\nmodel quality","volume":"25","author":"Bernard","year":"2024","journal-title":"Briefings Bioinf."},{"issue":"1","key":"2026102608084777100_cit68","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-025-23326-y","article-title":"RNAdvisor 2: A unified\nplatform for RNA 3D model quality assessment using metrics, scoring\nfunctions, and meta-metrics","volume":"15","author":"Bernard","year":"2025","journal-title":"Sci. Rep."},{"issue":"1","key":"2026102608084777100_cit69","doi-asserted-by":"publisher","DOI":"10.1063\/1.4811489","article-title":"Identification of slow molecular order parameters for\nMarkov model construction","volume":"139","author":"Pe\u0301rez-Herna\u0301ndez","year":"2013","journal-title":"J. Chem. Phys."},{"issue":"11","key":"2026102608084777100_cit70","doi-asserted-by":"publisher","DOI":"10.1002\/pro.4792","article-title":"UCSF CHIMERAX:\ntools for structure\nbuilding and analysis","volume":"32","author":"Meng","year":"2023","journal-title":"Protein Sci."},{"key":"2026102608084777100_cit71","unstructured":"Brehmer, J.; Behrends, S.; de Haan, P.; Cohen, T.\n          Does equivariance matter at\nscale?. 2025, arXiv:2410.23179.arXiv.org\ne-Printarchive. http:\/\/arxiv.org\/abs\/2410.2317910.48550\/arXiv.2410.23179."},{"key":"2026102608084777100_cit72","unstructured":"Suh, H. J. T.; Simchowitz, M.; Zhang, K.; Tedrake, R.\n          Do differentiable simulators\ngive better policy gradients?. 2022,\narXiv:2202.00817. arXiv.org e-Printarchive. http:\/\/arxiv.org\/abs\/2202.0081710.48550\/arXiv.2202.00817."},{"key":"2026102608084777100_cit73","unstructured":"Xing, E.; Luk, V.; Oh, J.\n          Stabilizing reinforcement learning\nin differentiable multiphysics simulation. 2024, arXiv:2412.12089. arXiv.org e-Printarchive. https:\/\/arxiv.org\/abs\/2412.1208910.48550\/arXiv.2412.12089."},{"issue":"4","key":"2026102608084777100_cit74","doi-asserted-by":"publisher","first-page":"2355","DOI":"10.1021\/acs.jctc.0c01343","article-title":"TorchMD: a deep learning\nframework for molecular simulations","volume":"17","author":"Doerr","year":"2021","journal-title":"J. Chem.\nTheory Comput."},{"key":"2026102608084777100_cit75","unstructured":"LeCun, Y.\n           In  Predictive learning\n[Invited Talk]; Conference on Neural Information Processing\nSystems NIPS: Barcelona,\nSpain, 2016https:\/\/nips.cc\/virtual\/2016\/invited-talk\/6197."}],"container-title":["Journal of Chemical Information\nand Modeling"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.acs.org\/doi\/pdf\/10.1021\/acs.jcim.6c02247","content-type":"application\/pdf","content-version":"vor","intended-application":"unspecified"},{"URL":"https:\/\/pubs.acs.org\/jcisd8\/article-pdf\/66\/20\/13534\/68834326\/acs.jcim.6c02247.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pubs.acs.org\/jcisd8\/article-pdf\/66\/20\/13534\/68834326\/acs.jcim.6c02247.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,26]],"date-time":"2026-10-26T12:43:14Z","timestamp":1793018594000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.acs.org\/jcisd8\/article\/66\/20\/13534\/5449784\/RNADaemon-Reinforcement-Learning-Guided-Molecular"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,13]]},"references-count":75,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2026,10,13]]},"published-print":{"date-parts":[[2026,10,26]]}},"URL":"https:\/\/doi.org\/10.1021\/acs.jcim.6c02247","relation":{},"ISSN":["1549-9596","1549-960X"],"issn-type":[{"value":"1549-9596","type":"print"},{"value":"1549-960X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,13]]}}}