{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T04:03:04Z","timestamp":1773460984936,"version":"3.50.1"},"reference-count":161,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,12,28]],"date-time":"2023-12-28T00:00:00Z","timestamp":1703721600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,12,28]],"date-time":"2023-12-28T00:00:00Z","timestamp":1703721600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["90621612"],"award-info":[{"award-number":["90621612"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Appl Intell"],"published-print":{"date-parts":[[2024,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The advent of AlphaGo and its successors marked the beginning of a new paradigm in playing games using artificial intelligence. This was achieved by combining Monte Carlo tree search, a planning procedure, and deep learning. While the impact on the domain of games has been undeniable, it is less clear how useful similar approaches are in applications beyond games and how they need to be adapted from the original methodology. We perform a systematic literature review of peer-reviewed articles detailing the application of neural Monte Carlo tree search methods in domains other than games. Our goal is to systematically assess how such methods are structured in practice and if their success can be extended to other domains. We find applications in a variety of domains, many distinct ways of guiding the tree search using learned policy and value functions, and various training methods. Our review maps the current landscape of algorithms in the family of neural monte carlo tree search as they are applied to practical problems, which is a first step towards a more principled way of designing such algorithms for specific problems and their requirements.<\/jats:p>","DOI":"10.1007\/s10489-023-05240-w","type":"journal-article","created":{"date-parts":[[2023,12,28]],"date-time":"2023-12-28T11:02:28Z","timestamp":1703761348000},"page":"1020-1046","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Beyond games: a systematic review of neural Monte Carlo tree search applications"],"prefix":"10.1007","volume":"54","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0141-2050","authenticated-orcid":false,"given":"Marco","family":"Kemmerling","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7070-8018","authenticated-orcid":false,"given":"Daniel","family":"L\u00fctticke","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0011-5962","authenticated-orcid":false,"given":"Robert H.","family":"Schmitt","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,12,28]]},"reference":[{"issue":"4","key":"5240_CR1","doi-asserted-by":"crossref","first-page":"2980","DOI":"10.1109\/TSG.2020.2972208","volume":"11","author":"M Al-Saffar","year":"2020","unstructured":"Al-Saffar M, Musilek P (2020) Reinforcement learning-based distributed BESS management for mitigating overvoltage issues in systems with high PV penetration. IEEE Trans Smart Grid 11(4):2980\u20132994","journal-title":"IEEE Trans Smart Grid"},{"key":"5240_CR2","unstructured":"Anthony T, Tian Z, Barber D (2017) Thinking fast and slow with deep learning and tree search. Adv Neural Inf Process Syst 30"},{"issue":"1","key":"5240_CR3","doi-asserted-by":"crossref","first-page":"15916","DOI":"10.1038\/s41598-019-51111-1","volume":"9","author":"G Audrey","year":"2019","unstructured":"Audrey G, Francesco M (2019) Deep neural network and Monte Carlo tree search applied to fluid-structure topology optimization. Sci Rep 9(1):15916","journal-title":"Sci Rep"},{"issue":"2","key":"5240_CR4","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1023\/A:1013689704352","volume":"47","author":"P Auer","year":"2002","unstructured":"Auer P, Cesa-Bianchi N, Fischer P (2002) Finite-time analysis of the multiarmed bandit problem. Mach Learn 47(2):235\u2013256","journal-title":"Mach Learn"},{"issue":"3","key":"5240_CR5","first-page":"100047","volume":"2","author":"F Bai","year":"2022","unstructured":"Bai F, Meng F, Liu J, Wang J, Meng MQ (2022) Hierarchical policy with deep-reinforcement learning for nonprehensile multiobject rearrangement. Biomim Intell Robot 2(3):100047","journal-title":"Biomim Intell Robot"},{"key":"5240_CR6","unstructured":"Bitter C, Thun T, Meisen T (2022) Karolos: an open-source reinforcement learning framework for robot-task environments. arXiv:2212.00906"},{"key":"5240_CR7","unstructured":"Brockman G, Cheung V, Pettersson L, Schneider J, Schulman J, Tang J, Zaremba W (2016) OpenAI Gym. arXiv:1606.01540"},{"issue":"1","key":"5240_CR8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TCIAIG.2012.2186810","volume":"4","author":"CB Browne","year":"2012","unstructured":"Browne CB, Powley E, Whitehouse D, Lucas SM, Cowling PI, Rohlfshagen P, Tavener S, Perez D, Samothrakis S, Colton S (2012) A survey of Monte Carlo tree search methods. IEEE Trans Comput Intell AI Games 4(1):1\u201343","journal-title":"IEEE Trans Comput Intell AI Games"},{"issue":"47","key":"5240_CR9","doi-asserted-by":"crossref","first-page":"35949","DOI":"10.1007\/s11042-020-09178-w","volume":"79","author":"V Carfora","year":"2020","unstructured":"Carfora V, Di Massimo F, Rastelli R, Catellani P, Piastra M (2020) Dialogue management in conversational agents through psychology of persuasion and machine learning. Multimed Tools Appl 79(47):35949\u201335971","journal-title":"Multimed Tools Appl"},{"key":"5240_CR10","doi-asserted-by":"crossref","unstructured":"Challita U, Sandberg D (2021) Deep reinforcement learning for dynamic spectrum sharing of LTE and NR. In ICC 2021 - IEEE international conference on communications, pp.\u00a01\u20136","DOI":"10.1109\/ICC42927.2021.9500325"},{"issue":"4","key":"5240_CR11","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1016\/j.dcan.2020.04.008","volume":"6","author":"J Chen","year":"2020","unstructured":"Chen J, Chen S, Luo S, Wang Q, Cao B, Li X (2020) An intelligent task offloading algorithm (iTOA) for UAV edge computing network. Digit Commun Netw 6(4):433\u2013443","journal-title":"Digit Commun Netw"},{"issue":"4","key":"5240_CR12","doi-asserted-by":"crossref","first-page":"7011","DOI":"10.1109\/JIOT.2019.2913162","volume":"6","author":"J Chen","year":"2019","unstructured":"Chen J, Chen S, Wang Q, Cao B, Feng G, Hu J (2019) iRAF: A deep reinforcement learning approach for collaborative mobile edge computing IoT networks. IEEE Internet Things J 6(4):7011\u20137024","journal-title":"IEEE Internet Things J"},{"issue":"3","key":"5240_CR13","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1016\/j.dcan.2020.07.009","volume":"7","author":"J Chen","year":"2021","unstructured":"Chen J, Luo S, Zhang L, Zhang C, Cao B (2021) iPAS: A deep Monte Carlo Tree Search-based intelligent pilot-power allocation scheme for massive MIMO system. Digit Commun Netw 7(3):362\u2013372","journal-title":"Digit Commun Netw"},{"issue":"7","key":"5240_CR14","doi-asserted-by":"crossref","first-page":"7146","DOI":"10.1109\/TVT.2020.2991584","volume":"69","author":"J Chen","year":"2020","unstructured":"Chen J, Zhang C, Luo J, Xie J, Wan Y (2020) Driving maneuvers prediction based autonomous driving control by deep Monte Carlo tree search. IEEE Trans Veh Technol 69(7):7146\u20137158","journal-title":"IEEE Trans Veh Technol"},{"key":"5240_CR15","doi-asserted-by":"crossref","unstructured":"Chen P-Y, Ke B-T, Lee T-C, Tsai I-C, Kung T-W, Lin L-Y, Liu E-C, Chang Y-C, Li Y-L, Chao MC-T (2022) A reinforcement learning agent for obstacle-avoiding rectilinear steiner tree construction. In Proceedings of the 2022 international symposium on physical design, pp.\u00a0107\u2013115","DOI":"10.1145\/3505170.3506721"},{"issue":"3","key":"5240_CR16","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1038\/s42256-022-00446-y","volume":"4","author":"Y-Q Chen","year":"2022","unstructured":"Chen Y-Q, Chen Y, Lee C-K, Zhang S, Hsieh C-Y (2022) Optimizing quantum annealing schedules with Monte Carlo tree search enhanced with neural networks. Nat Mach Intell 4(3):269\u2013278","journal-title":"Nat Mach Intell"},{"key":"5240_CR17","doi-asserted-by":"crossref","unstructured":"Chen Z, Huang J, Ahn H, Ning X (2021) Costly features classification using Monte Carlo tree search. In 2021 International joint conference on neural networks (IJCNN), pp.\u00a01\u20138","DOI":"10.1109\/IJCNN52387.2021.9533593"},{"key":"5240_CR18","doi-asserted-by":"crossref","unstructured":"Chen Z, Zhong S, Chen J, Zhao Y (2021) DeepPursuit: uniting classical wisdom and deep RL for sparse recovery. In 2021 55th Asilomar conference on signals, systems, and computers, pp.\u00a01361\u20131366","DOI":"10.1109\/IEEECONF53345.2021.9723110"},{"key":"5240_CR19","first-page":"7","volume":"11","author":"Y Cheng","year":"1826","unstructured":"Cheng Y, Wu Z, Liu K, Wu Q (1826) Wang Y (2019) Smart dag tasks scheduling between trusted and untrusted entities using the mcts method. Sustainability 11:7","journal-title":"Sustainability"},{"key":"5240_CR20","doi-asserted-by":"crossref","unstructured":"Dai Y, Wang P, Zhang L (2021) Reinforcement syntactic dependency tree reasoning for target-oriented opinion word extraction. In: International conference on artificial neural networks, Springer, pp.\u00a0531\u2013543","DOI":"10.1007\/978-3-030-86380-7_43"},{"key":"5240_CR21","doi-asserted-by":"crossref","unstructured":"Dai Z, Liu CH, Ye Y, Han R, Yuan Y, Wang G, Tang J (2022) AoI-minimal UAV crowdsensing by model-based graph convolutional reinforcement learning. In IEEE INFOCOM 2022 - IEEE conference on computer communications, pp.\u00a01029\u20131038","DOI":"10.1109\/INFOCOM48880.2022.9796732"},{"issue":"1","key":"5240_CR22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41534-019-0241-0","volume":"6","author":"M Dalgaard","year":"2020","unstructured":"Dalgaard M, Motzoi F, S\u00f8rensen JJ, Sherson J (2020) Global optimization of quantum dynamics with AlphaZero deep exploration. NPJ Quantum Inf 6(1):1\u20139","journal-title":"NPJ Quantum Inf"},{"issue":"5","key":"5240_CR23","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1002\/tee.23556","volume":"17","author":"H Deng","year":"2022","unstructured":"Deng H, Yuan X, Tian Y, Hu J (2022) Neural-augmented two-stage Monte Carlo tree search with over-sampling for protein folding in HP Model. IEEJ Trans Electr Electron Eng 17(5):685-694","journal-title":"IEEJ Trans Electr Electron Eng"},{"issue":"7","key":"5240_CR24","doi-asserted-by":"crossref","first-page":"074901","DOI":"10.1063\/5.0012351","volume":"128","author":"S Dieb","year":"2020","unstructured":"Dieb S, Song Z, Yin W-J, Ishii M (2020) Optimization of depth-graded multilayer structure for x-ray optics using machine learning. J Appl Phys 128(7):074901","journal-title":"J Appl Phys"},{"issue":"1","key":"5240_CR25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13321-021-00572-6","volume":"13","author":"D Erikawa","year":"2021","unstructured":"Erikawa D, Yasuo N, Sekijima M (2021) MERMAID: an open source automated hit-to-lead method based on deep reinforcement learning. J Cheminformatics 13(1):1\u201310","journal-title":"J Cheminformatics"},{"issue":"7","key":"5240_CR26","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1038\/s41586-022-05172-4","volume":"610","author":"A Fawzi","year":"2022","unstructured":"Fawzi A, Balog M, Huang A, Hubert T, Romera-Paredes B, Barekatain M, Novikov A, R Ruiz FJ, Schrittwieser J, Swirszcz G, Silver D, Hassabis D, Kohli P (2022) Discovering faster matrix multiplication algorithms with reinforcement learning. Nature 610(7):47\u201353","journal-title":"Nature"},{"issue":"11","key":"5240_CR27","doi-asserted-by":"crossref","first-page":"1455","DOI":"10.1049\/cmu2.12161","volume":"15","author":"Y Feng","year":"2021","unstructured":"Feng Y, Li B, Zheng Q, Wang D, Xu X, Zhang R (2021) Electromagnetic situation analysis and judgment based on deep learning. IET Commun 15(11):1455\u20131466","journal-title":"IET Commun"},{"key":"5240_CR28","doi-asserted-by":"crossref","unstructured":"Fong J, Campolo D, Acar C, Tee KP (2021) Model-based reinforcement learning with LSTM networks for non-prehensile manipulation planning. In: 2021 21st international conference on control, automation and systems (ICCAS), pp.\u00a01152\u20131158","DOI":"10.23919\/ICCAS52745.2021.9649940"},{"key":"5240_CR29","doi-asserted-by":"crossref","unstructured":"Fricke C, Wolff D, Kemmerling M, Elgeti S (2023) Investigation of reinforcement learning for shape optimization of 2D profile extrusion die geometries. Advances in computational science and engineering. Publisher: Advances in Computational Science and Engineering","DOI":"10.3934\/acse.2023001"},{"key":"5240_CR30","doi-asserted-by":"crossref","unstructured":"Fu Z, Fan Q, Zhang X, Li X, Wang S, Wang Y (2021) Policy network assisted Monte Carlo Tree search for intelligent service function chain deployment. In 2021 IEEE 20th international conference on trust, security and privacy in computing and communications (TrustCom), pp.\u00a01161\u20131168","DOI":"10.1109\/TrustCom53373.2021.00157"},{"key":"5240_CR31","doi-asserted-by":"crossref","unstructured":"Gaafar M, Shaghaghi M, Adve RS, Ding Z (2019) Reinforcement learning for cognitive radar task scheduling. In: 2019 53rd Asilomar conference on signals, systems, and computers, pp.\u00a01653\u20131657","DOI":"10.1109\/IEEECONF44664.2019.9048892"},{"key":"5240_CR32","doi-asserted-by":"crossref","first-page":"107184","DOI":"10.1109\/ACCESS.2021.3100706","volume":"9","author":"J Gabirondo-L\u00f3pez","year":"2021","unstructured":"Gabirondo-L\u00f3pez J, Ega\u00f1a J, Miguel-Alonso J, Orduna Urrutia R (2021) Towards autonomous defense of SDN networks using MuZero based intelligent agents. IEEE Access 9:107184\u2013107199","journal-title":"IEEE Access"},{"key":"5240_CR33","doi-asserted-by":"crossref","unstructured":"Ganapathi\u00a0Subramanian S, Crowley M (2018) Combining MCTS and A3C for prediction of spatially spreading processes in forest wildfire settings. In: Canadian conference on artificial intelligence, Springer, pp.\u00a0285\u2013291","DOI":"10.1007\/978-3-319-89656-4_28"},{"key":"5240_CR34","doi-asserted-by":"crossref","unstructured":"Gannouni A, Samsonov V, Behery M, Meisen T, Lakemeyer G (2020) Neural combinatorial optimization for production scheduling with sequence-dependent setup waste. In 2020 IEEE international conference on systems, man, and cybernetics (SMC), pp.\u00a02640\u20132647","DOI":"10.1109\/SMC42975.2020.9282869"},{"key":"5240_CR35","doi-asserted-by":"crossref","unstructured":"Gauthier T (2020) Deep reinforcement learning for synthesizing functions in higher-order logic. EPiC Series in Computing 73:230\u2013248","DOI":"10.29007\/7jmg"},{"issue":"1","key":"5240_CR36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13321-020-00472-1","volume":"12","author":"S Genheden","year":"2020","unstructured":"Genheden S, Thakkar A, Chadimov\u00e1 V, Reymond J-L, Engkvist O, Bjerrum E (2020) AiZynthFinder: a fast, robust and flexible open-source software for retrosynthetic planning. J Cheminformatics 12(1):1\u20139","journal-title":"J Cheminformatics"},{"key":"5240_CR37","doi-asserted-by":"crossref","unstructured":"Gros TP, Gro\u00df J, Wolf V (2020) Real-time decision making for a car manufacturing process using deep reinforcement learning. In: 2020 winter simulation conference (WSC), pp.\u00a03032\u20133044","DOI":"10.1109\/WSC48552.2020.9383884"},{"issue":"5","key":"5240_CR38","doi-asserted-by":"crossref","first-page":"619","DOI":"10.1007\/s11740-021-01057-z","volume":"15","author":"A G\u00f6ppert","year":"2021","unstructured":"G\u00f6ppert A, Mohring L, Schmitt RH (2021) Predicting performance indicators with ANNs for AI-based online scheduling in dynamically interconnected assembly systems. Prod Eng 15(5):619\u2013633","journal-title":"Prod Eng"},{"key":"5240_CR39","doi-asserted-by":"crossref","unstructured":"Ha T, Cho K, Cha G, Lee K, Oh S (2020) Vehicle control with prediction model based Monte-Carlo tree search. In 2020 17th international conference on ubiquitous robots (UR), pp.\u00a0303\u2013308","DOI":"10.1109\/UR49135.2020.9144958"},{"issue":"3","key":"5240_CR40","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1109\/TBDATA.2018.2805363","volume":"8","author":"L He","year":"2018","unstructured":"He L, Shao B, Xiao Y, Li Y, Liu T-Y, Chen E, Xia H (2018) Neurally-guided semantic navigation in knowledge graph. IEEE Trans Big Data 8(3):607\u2013615","journal-title":"IEEE Trans Big Data"},{"key":"5240_CR41","doi-asserted-by":"crossref","unstructured":"He Y, Li H, Jin T, Bao FS (2022) Circuit routing using Monte Carlo Tree Search and deep reinforcement learning. In: 2022 International symposium on vlsi design, automation and test (VLSI-DAT), pp.\u00a01\u20135","DOI":"10.1109\/VLSI-DAT54769.2022.9768074"},{"key":"5240_CR42","doi-asserted-by":"crossref","unstructured":"He Y, Tao S, Xu J, Guo J, Lan Y, Cheng X (2018) Text matching with Monte Carlo tree search. In China conference on information retrieval, Springer, pp\u00a041\u201352","DOI":"10.1007\/978-3-030-01012-6_4"},{"key":"5240_CR43","doi-asserted-by":"crossref","unstructured":"Hernandez D, Denamgana\u00ef K, Gao Y, York P, Devlin S, Samothrakis S, Walker JA (2019) A generalized framework for self-play training. In: 2019 IEEE conference on games (CoG), IEEE, pp\u00a01\u20138","DOI":"10.1109\/CIG.2019.8848006"},{"issue":"2","key":"5240_CR44","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1109\/TIV.2019.2955905","volume":"5","author":"C-J Hoel","year":"2020","unstructured":"Hoel C-J, Driggs-Campbell K, Wolff K, Laine L, Kochenderfer MJ (2020) Combining planning and deep reinforcement learning in tactical decision making for autonomous driving. IEEE Trans Intell Veh 5(2):294\u2013305","journal-title":"IEEE Trans Intell Veh"},{"key":"5240_CR45","doi-asserted-by":"crossref","unstructured":"Hu Z, Tu J, Li B (2019) Spear: optimized dependency-aware task scheduling with deep reinforcement learning. In: 2019 IEEE 39th international conference on distributed computing systems (ICDCS), pp\u00a02037\u20132046","DOI":"10.1109\/ICDCS.2019.00201"},{"key":"5240_CR46","unstructured":"Huang J, Patwary M, Diamos G (2019) Coloring big graphs with alphagozero. arXiv:1902.10162"},{"key":"5240_CR47","doi-asserted-by":"crossref","unstructured":"Huang Y, Yu Y (2018) Distilling deep neural networks with reinforcement learning. In 2018 IEEE international conference on information and automation (ICIA), pp\u00a0133\u2013138","DOI":"10.1109\/ICInfA.2018.8812321"},{"issue":"6","key":"5240_CR48","doi-asserted-by":"crossref","first-page":"1357","DOI":"10.1021\/acs.jcim.1c01074","volume":"62","author":"S Ishida","year":"2022","unstructured":"Ishida S, Terayama K, Kojima R, Takasu K, Okuno Y (2022) AI-driven synthetic route design incorporated with retrosynthesis knowledge. J Chem Inf Model 62(6):1357\u20131367","journal-title":"J Chem Inf Model"},{"key":"5240_CR49","doi-asserted-by":"crossref","unstructured":"Jang Y, Lee J, Kim K-E (2020) Bayes-adaptive Monte-Carlo planning and learning for goal-oriented dialogues. In: Proceedings of the AAAI conference on artificial intelligence, vol\u00a034, pp\u00a07994\u20138001. Issue: 05","DOI":"10.1609\/aaai.v34i05.6308"},{"issue":"11","key":"5240_CR50","doi-asserted-by":"crossref","first-page":"11595","DOI":"10.3934\/mbe.2022540","volume":"19","author":"Y Jiang","year":"2022","unstructured":"Jiang Y, Liu M, Li J, Zhang J (2022) Reinforced MCTS for non-intrusive online load identification based on cognitive green computing in smart grid. Math Biosci Eng 19(11):11595\u201311627","journal-title":"Math Biosci Eng"},{"key":"5240_CR51","unstructured":"Kemmerling M, Samsonov V, L\u00fctticke, D., Schuh G, G\u00fctzlaff A, Schmidhuber M, Janke T, Meisen T (2021) Towards production-ready reinforcement learning scheduling agents: A hybrid two-step training approach based on discrete-event simulations. Simulation in Produktion und Logistik, 325\u2013336"},{"key":"5240_CR52","doi-asserted-by":"crossref","unstructured":"Kim M, Park J-K, Moon S-M (2022) Solving PBQP-based register allocation using deep reinforcement learning. In 2022 IEEE\/ACM international symposium on code generation and optimization (CGO), pp\u00a01\u201312","DOI":"10.1109\/CGO53902.2022.9741272"},{"key":"5240_CR53","doi-asserted-by":"crossref","unstructured":"Kocsis L, Szepesv\u00e1ri C (2006) Bandit based Monte-Carlo planning. In European conference on machine learning, Springer, pp\u00a0282\u2013293","DOI":"10.1007\/11871842_29"},{"key":"5240_CR54","unstructured":"Kocsis L, Szepesv\u00e1ri C, Willemson J (2006) Improved Monte-Carlo search. Univ. Tartu, Estonia, Tech. Rep 1"},{"key":"5240_CR55","doi-asserted-by":"crossref","unstructured":"Kovari B, Becsi T, Szabo A., Aradi, S (2020) Policy gradient based control of a pneumatic actuator enhanced with Monte Carlo Tree search. In: 2020 6th international conference on mechatronics and robotics engineering (ICMRE), pp\u00a0177\u2013182","DOI":"10.1109\/ICMRE49073.2020.9065122"},{"issue":"20","key":"5240_CR56","doi-asserted-by":"crossref","first-page":"7171","DOI":"10.3390\/app10207171","volume":"10","author":"B Kov\u00e1ri","year":"2020","unstructured":"Kov\u00e1ri B, Heged\u00fcs F, B\u00e9csi T (2020) Design of a reinforcement learning-based lane keeping planning agent for automated vehicles. Appl Sci 10(20):7171","journal-title":"Appl Sci"},{"issue":"11","key":"5240_CR57","doi-asserted-by":"crossref","first-page":"7434","DOI":"10.1109\/TCOMM.2022.3211071","volume":"70","author":"Z Kuai","year":"2022","unstructured":"Kuai Z, Wang T, Wang S (2022) Fair virtual network function mapping and scheduling using proximal policy optimization. IEEE Trans Commun 70(11):7434\u20137445","journal-title":"IEEE Trans Commun"},{"key":"5240_CR58","doi-asserted-by":"crossref","first-page":"107644","DOI":"10.1016\/j.asoc.2021.107644","volume":"110","author":"A Kumar","year":"2021","unstructured":"Kumar A, Dimitrakopoulos R (2021) Production scheduling in industrial mining complexes with incoming new information using tree search and deep reinforcement learning. Appl Soft Comput 110:107644","journal-title":"Appl Soft Comput"},{"key":"5240_CR59","doi-asserted-by":"crossref","unstructured":"Lao Y, Xu J, Gao S, Guo J, Wen J-R (2019) Name entity recognition with policy-value networks. In: Proceedings of the 42nd International ACM SIGIR conference on research and development in information retrieval, pp\u00a01245\u20131248","DOI":"10.1145\/3331184.3331349"},{"key":"5240_CR60","unstructured":"Laterre A, Fu Y, Jabri M, Cohen A, Kas D, Hajjar K, Dahl T, Kerkeni A, Beguir K (2018) Ranked reward: enabling self-play reinforcement learning for combinatorial optimization. Advances in neural information processing systems 31 (NeurIPS 2018)"},{"key":"5240_CR61","doi-asserted-by":"crossref","unstructured":"Lei L, Luo R, Zheng R, Wang J, Zhang J, Qiu C, Ma L, Jin L, Zhang P, Chen J (2021) KB-Tree: learnable and continuous Monte-Carlo tree search for autonomous driving planning. In: 2021 IEEE\/RSJ international conference on intelligent robots and systems (IROS), pp\u00a04493\u20134500","DOI":"10.1109\/IROS51168.2021.9636442"},{"issue":"4","key":"5240_CR62","first-page":"1","volume":"15","author":"H Li","year":"2021","unstructured":"Li H, Hu Y, Cao Y, Zhou G, Luo P (2021) Rich-text document styling restoration via reinforcement learning. Front Comput Sci 15(4):1\u201311","journal-title":"Front Comput Sci"},{"issue":"41","key":"5240_CR63","doi-asserted-by":"crossref","first-page":"13664","DOI":"10.1039\/D1SC04444C","volume":"12","author":"Y Li","year":"2021","unstructured":"Li Y, Pei J, Lai L (2021) Structure-based de novo drug design using 3D deep generative models. Chem Sci 12(41):13664\u201313675","journal-title":"Chem Sci"},{"issue":"14","key":"5240_CR64","doi-asserted-by":"crossref","first-page":"8495","DOI":"10.1007\/s00521-020-05602-2","volume":"33","author":"Q Lu","year":"2021","unstructured":"Lu Q, Tao F, Zhou S, Wang Z (2021) Incorporating Actor-Critic in Monte Carlo tree search for symbolic regression. Neural Comput Appl 33(14):8495\u20138511","journal-title":"Neural Comput Appl"},{"issue":"7","key":"5240_CR65","doi-asserted-by":"crossref","first-page":"3304","DOI":"10.1021\/acs.jcim.1c00679","volume":"61","author":"B Ma","year":"2021","unstructured":"Ma B, Terayama K, Matsumoto S, Isaka Y, Sasakura Y, Iwata H, Araki M, Okuno Y (2021) Structure-based de novo molecular generator combined with artificial intelligence and docking simulations. J Chem Inf Model 61(7):3304\u20133313","journal-title":"J Chem Inf Model"},{"key":"5240_CR66","unstructured":"Mandhane A, Zhernov A, Rauh M, Gu C, Wang M, Xue F, Shang W, Pang D, Claus R, Chiang C-H, et al (2022) Muzero with self-competition for rate control in vp9 video compression. arXiv:2202.06626"},{"issue":"15","key":"5240_CR67","doi-asserted-by":"crossref","first-page":"4420","DOI":"10.3390\/molecules26154420","volume":"26","author":"K Mao","year":"2021","unstructured":"Mao K, Xiao Y (2021) Learning the fastest RNA folding path based on reinforcement learning and Monte Carlo tree search. Molecules 26(15):4420","journal-title":"Molecules"},{"key":"5240_CR68","doi-asserted-by":"crossref","unstructured":"Ma\u0144dziuk J (2018) MCTS\/UCT in solving real-life problems. In: Advances in data analysis with computational intelligence methods. Springer, pp\u00a0277\u2013292","DOI":"10.1007\/978-3-319-67946-4_11"},{"key":"5240_CR69","doi-asserted-by":"crossref","unstructured":"Meng X, Inaltekin H, Krongold B (2019) Deep reinforcement learning-based topology optimization for self-organized wireless sensor networks. In: 2019 IEEE global communications conference (GLOBECOM), pp\u00a01\u20136","DOI":"10.1109\/GLOBECOM38437.2019.9014179"},{"issue":"7","key":"5240_CR70","doi-asserted-by":"crossref","first-page":"6766","DOI":"10.1109\/TITS.2021.3061627","volume":"23","author":"S Mo","year":"2022","unstructured":"Mo S, Pei X, Wu C (2022) Safe reinforcement learning for autonomous vehicle using Monte Carlo tree search. IEEE Trans Intell Transp Syst 23(7):6766\u20136773","journal-title":"IEEE Trans Intell Transp Syst"},{"key":"5240_CR71","doi-asserted-by":"crossref","unstructured":"Mo T-W, Chang RY, Kan T-Y (2022) DeepMCTS: deep reinforcement learning assisted Monte Carlo tree search for MIMO detection. In: 2022 IEEE 95th vehicular technology conference: (VTC2022-Spring), pp\u00a01\u20136","DOI":"10.1109\/VTC2022-Spring54318.2022.9860565"},{"key":"5240_CR72","unstructured":"Moerland TM, Broekens J, Plaat A, Jonker CM (2018) A0c: Alpha zero in continuous action space. arXiv:1805.09613"},{"key":"5240_CR73","doi-asserted-by":"crossref","unstructured":"Moerland TM, Broekens J, Plaat A, Jonker CM (2022) A unifying framework for reinforcement learning and planning. Front Artif Intell 5","DOI":"10.3389\/frai.2022.908353"},{"issue":"3","key":"5240_CR74","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1002\/jcc.26441","volume":"42","author":"T Motomichi","year":"2021","unstructured":"Motomichi T, Yutaka I, Michio K. De (2021) novo generation of optically active small organic molecules using Monte Carlo tree search combined with recurrent neural network. J Comput Chem 42(3):136\u2013143","journal-title":"J Comput Chem"},{"key":"5240_CR75","doi-asserted-by":"crossref","unstructured":"Oren J, Ross C, Lefarov M, Richter F, Taitler A, Feldman Z, Di\u00a0Castro D, Daniel C (2021) SOLO: search online, learn offline for combinatorial optimization problems. In: Proceedings of the international symposium on combinatorial search, vol\u00a012, pp\u00a097\u2013105. Issue: 1","DOI":"10.1609\/socs.v12i1.18556"},{"key":"5240_CR76","doi-asserted-by":"crossref","unstructured":"Paxton C, Raman V, Hager GD, Kobilarov M (2017) Combining neural networks and tree search for task and motion planning in challenging environments. In: 2017 IEEE\/RSJ international conference on intelligent robots and systems (IROS), pp.\u00a06059\u20136066","DOI":"10.1109\/IROS.2017.8206505"},{"key":"5240_CR77","doi-asserted-by":"crossref","unstructured":"Peng H, Wu C, Zhan Y, Xia Y (2022) Lore: a learning-based approach for workflow scheduling in clouds. In: Proceedings of the conference on research in adaptive and convergent systems, pp\u00a047\u201352","DOI":"10.1145\/3538641.3561487"},{"issue":"4","key":"5240_CR78","doi-asserted-by":"crossref","first-page":"pgac227","DOI":"10.1093\/pnasnexus\/pgac227","volume":"1","author":"H Qian","year":"2022","unstructured":"Qian H, Lin C, Zhao D, Tu S, Xu L (2022) AlphaDrug: protein target specific de novo molecular generation. PNAS Nexus 1(4):pgac227","journal-title":"PNAS Nexus"},{"issue":"268","key":"5240_CR79","first-page":"1","volume":"22","author":"A Raffin","year":"2021","unstructured":"Raffin A, Hill A, Gleave A, Kanervisto A, Ernestus M, Dormann N (2021) Stable-Baselines3: reliable reinforcement learning implementations. J Mach Learn Res 22(268):1\u20138","journal-title":"J Mach Learn Res"},{"issue":"3","key":"5240_CR80","doi-asserted-by":"crossref","first-page":"031402","DOI":"10.1115\/1.4056221","volume":"145","author":"A Raina","year":"2022","unstructured":"Raina A, Cagan J, McComb C (2022) Learning to design without prior data: Discovering generalizable design strategies using deep learning and tree search. J Mech Des 145(3):031402","journal-title":"J Mech Des"},{"key":"5240_CR81","unstructured":"Rinciog A, Mieth C, Scheikl PM, Meyer A (2020) Sheet-metal production scheduling using AlphaGo Zero. In: Proceedings of the conference on production systems and logistics: CPSL 2020"},{"issue":"4","key":"5240_CR82","doi-asserted-by":"crossref","first-page":"6868","DOI":"10.1109\/LRA.2021.3096758","volume":"6","author":"B Riviere","year":"2021","unstructured":"Riviere B, H\u00f6nig W, Anderson M, Chung S-J (2021) Neural tree expansion for multi-robot planning in non-cooperative environments. IEEE Robot Autom Lett 6(4):6868\u20136875","journal-title":"IEEE Robot Autom Lett"},{"issue":"3","key":"5240_CR83","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1007\/s10472-011-9258-6","volume":"61","author":"CD Rosin","year":"2011","unstructured":"Rosin CD (2011) Multi-armed bandits with episode context. Ann Math Artif Intell 61(3):203\u2013230","journal-title":"Ann Math Artif Intell"},{"issue":"3","key":"5240_CR84","first-page":"035013","volume":"2","author":"A Sadeghnejad-Barkousaraie","year":"2021","unstructured":"Sadeghnejad-Barkousaraie A, Bohara G, Jiang S, Nguyen D (2021) A reinforcement learning application of a guided Monte Carlo Tree Search algorithm for beam orientation selection in radiation therapy. Mach Learn: Sci Technol 2(3):035013","journal-title":"Mach Learn: Sci Technol"},{"key":"5240_CR85","doi-asserted-by":"crossref","unstructured":"Sadeghnejad\u00a0Barkousaraie A, Ogunmolu O, Jiang S, Nguyen D (2019) Using supervised learning and guided Monte Carlo tree search for beam orientation optimization in radiation therapy. In: Workshop on artificial intelligence in radiation therapy, Springer, pp\u00a01\u20139","DOI":"10.1007\/978-3-030-32486-5_1"},{"key":"5240_CR86","doi-asserted-by":"crossref","unstructured":"Samsonov V, Kemmerling M, Paegert M, L\u00fctticke D, Sauermann F, G\u00fctzlaff A, Schuh G, Meisen T (2021) Manufacturing control in job shop environments with reinforcement learning. In: Proceedings of the 13th international conference on agents and artificial intelligence, pp\u00a0589\u2013597","DOI":"10.5220\/0010202405890597"},{"key":"5240_CR87","doi-asserted-by":"crossref","unstructured":"Sandberg D, Kvernvik T, Calabrese FD (2022) Learning robust scheduling with search and attention. In: ICC 2022-IEEE international conference on communications, IEEE, pp\u00a01549\u20131555","DOI":"10.1109\/ICC45855.2022.9838584"},{"key":"5240_CR88","unstructured":"Schmidt D, Moran N, Rosenfeld JS, Rosenthal J, Yedidia J (2019) Self-play learning without a reward metric. arXiv:1912.07557"},{"issue":"7839","key":"5240_CR89","doi-asserted-by":"crossref","first-page":"604","DOI":"10.1038\/s41586-020-03051-4","volume":"588","author":"J Schrittwieser","year":"2020","unstructured":"Schrittwieser J, Antonoglou I, Hubert T, Simonyan K, Sifre L, Schmitt S, Guez A, Lockhart E, Hassabis D, Graepel T et al (2020) Mastering ATARI, GO, Chess and Shogi by planning with a learned model. Nature 588(7839):604\u2013609","journal-title":"Nature"},{"issue":"7698","key":"5240_CR90","doi-asserted-by":"crossref","first-page":"604","DOI":"10.1038\/nature25978","volume":"555","author":"MH Segler","year":"2018","unstructured":"Segler MH, Preuss M, Waller MP (2018) Planning chemical syntheses with deep neural networks and symbolic AI. Nature 555(7698):604\u2013610","journal-title":"Nature"},{"key":"5240_CR91","unstructured":"Segler MHS, Preuss M, Waller MP (2017) Towards \"AlphaChem\": chemical synthesis planning with tree search and deep neural network policies. In: 5th International conference on learning representations, ICLR 2017, Toulon, France, April 24-26, 2017, Workshop Track Proceedings"},{"key":"5240_CR92","doi-asserted-by":"crossref","first-page":"97897","DOI":"10.1109\/ACCESS.2022.3206035","volume":"10","author":"H Shafieirad","year":"2022","unstructured":"Shafieirad H, Adve RS (2022) On meeting a maximum delay constraint using reinforcement learning. IEEE Access 10:97897\u201397911","journal-title":"IEEE Access"},{"key":"5240_CR93","doi-asserted-by":"crossref","unstructured":"Shaghaghi M, Adve RS, Ding Z (2019) Resource management for multifunction multichannel cognitive radars. In: 2019 53rd Asilomar conference on signals, systems, and computers, pp\u00a01550\u20131554","DOI":"10.1109\/IEEECONF44664.2019.9049014"},{"issue":"9","key":"5240_CR94","doi-asserted-by":"crossref","first-page":"3319","DOI":"10.1109\/TNNLS.2019.2942951","volume":"31","author":"Y Shao","year":"2020","unstructured":"Shao Y, Liew SC, Wang T (2020) AlphaSeq: sequence discovery with deep reinforcement learning. IEEE Trans Neural Netw Learn Syst 31(9):3319\u20133333","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"5240_CR95","unstructured":"Shen Y, Chen J, Huang P-S, Guo Y, Gao J (2018) M-walk: Learning to walk over graphs using Monte Carlo tree search. Adv Neural Inf Process Syst 31"},{"key":"5240_CR96","doi-asserted-by":"crossref","unstructured":"Shuai H, He H (2021) Online scheduling of a residential microgrid via Monte-Carlo tree search and a learned model. In: 2021 IEEE power & energy society general meeting (PESGM), pp\u00a001","DOI":"10.1109\/PESGM46819.2021.9637996"},{"issue":"4","key":"5240_CR97","doi-asserted-by":"crossref","first-page":"108477","DOI":"10.1016\/j.ijepes.2022.108477","volume":"144","author":"H Shuai","year":"2023","unstructured":"Shuai H, Li F, She B, Wang X, Zhao J (2023) Post-storm repair crew dispatch for distribution grid restoration using stochastic Monte Carlo tree search and deep neural networks. Int J Electr Power Energy Syst 144(4):108477","journal-title":"Int J Electr Power Energy Syst"},{"key":"5240_CR98","doi-asserted-by":"crossref","unstructured":"Silva K, Abeyasekare W, Dasanayake D, Nandisena T, Kasthurirathna D, Kugathasan A (2021) Dynamic user interface personalization based on deep reinforcement learning. In: 2021 3rd international conference on advancements in computing (ICAC), IEEE, pp\u00a025\u201330","DOI":"10.1109\/ICAC54203.2021.9671076"},{"issue":"7587","key":"5240_CR99","doi-asserted-by":"crossref","first-page":"484","DOI":"10.1038\/nature16961","volume":"529","author":"D Silver","year":"2016","unstructured":"Silver D, Huang A, Maddison CJ, Guez A, Sifre L, Van Den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M et al (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529(7587):484\u2013489","journal-title":"Nature"},{"issue":"6419","key":"5240_CR100","doi-asserted-by":"crossref","first-page":"1140","DOI":"10.1126\/science.aar6404","volume":"362","author":"D Silver","year":"2018","unstructured":"Silver D, Hubert T, Schrittwieser J, Antonoglou I, Lai M, Guez A, Lanctot M, Sifre L, Kumaran D, Graepel T, Lillicrap T, Simonyan K, Hassabis D (2018) A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play. Science 362(6419):1140\u20131144","journal-title":"Science"},{"issue":"7676","key":"5240_CR101","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1038\/nature24270","volume":"550","author":"D Silver","year":"2017","unstructured":"Silver D, Schrittwieser J, Simonyan K, Antonoglou I, Huang A, Guez A, Hubert T, Baker L, Lai M, Bolton A et al (2017) Mastering the game of go without human knowledge. Nature 550(7676):354\u2013359","journal-title":"Nature"},{"key":"5240_CR102","doi-asserted-by":"crossref","unstructured":"Sinha A, Azad U, Singh H (2022) Qubit routing using graph neural network aided Monte Carlo tree search. In: Proceedings of the AAAI conference on artificial intelligence, vol\u00a036, pp\u00a09935\u20139943. Issue: 9","DOI":"10.1609\/aaai.v36i9.21231"},{"key":"5240_CR103","doi-asserted-by":"crossref","first-page":"126034","DOI":"10.1109\/ACCESS.2021.3111321","volume":"9","author":"A Skrynnik","year":"2021","unstructured":"Skrynnik A, Yakovleva A, Davydov V, Yakovlev K, Panov AI (2021) Hybrid policy learning for multi-agent pathfinding. IEEE Access 9:126034\u2013126047","journal-title":"IEEE Access"},{"key":"5240_CR104","first-page":"24","volume":"20","author":"S Song","year":"2020","unstructured":"Song S, Chen H, Sun H, Liu M (2020) Data efficient reinforcement learning for integrated lateral planning and control in automated parking system. Sensors 20:24","journal-title":"Sensors"},{"key":"5240_CR105","doi-asserted-by":"crossref","first-page":"4924","DOI":"10.1021\/acs.jpclett.2c00624","volume":"13","author":"B Sridharan","year":"2022","unstructured":"Sridharan B, Mehta S, Pathak Y, Priyakumar UD (2022) Deep reinforcement learning for molecular inverse problem of nuclear magnetic resonance spectra to molecular structure. J Phys Chem Lett 13:4924\u20134933","journal-title":"J Phys Chem Lett"},{"issue":"19","key":"5240_CR106","doi-asserted-by":"crossref","first-page":"12557","DOI":"10.1021\/acsomega.1c00477","volume":"6","author":"S Srinivasan","year":"2021","unstructured":"Srinivasan S, Batra R, Chan H, Kamath G, Cherukara MJ, Sankaranarayanan SK (2021) Artificial intelligence-guided De novo molecular design targeting COVID-19. ACS Omega 6(19):12557\u201312566","journal-title":"ACS Omega"},{"key":"5240_CR107","unstructured":"Sun R, Liu Y (2021) Hybrid reinforcement learning for power transmission network self-healing considering wind power. IEEE Trans Neural Netw Learn Syst 1\u201311"},{"key":"5240_CR108","unstructured":"Sutton RS, Barto AG (2018) Reinforcement learning: An introduction. MIT press"},{"issue":"8","key":"5240_CR109","doi-asserted-by":"crossref","first-page":"720","DOI":"10.1038\/s42256-022-00506-3","volume":"4","author":"SV Ss","year":"2022","unstructured":"Ss SV, Law JN, Tripp CE, Duplyakin D, Skordilis E, Biagioni D, Paton RS, St. John PC (2022) Multi-objective goal-directed optimization of de novo stable organic radicals for aqueous redox flow batteries. Nat Mach Intell 4(8):720\u2013730","journal-title":"Nat Mach Intell"},{"key":"5240_CR110","doi-asserted-by":"crossref","unstructured":"Tang C, Fu S, Liu F (2021) Design and implementation of system for generating MOFs for hydrogen storage in hydrogen-fueled vehicles. In: 2021 IEEE international conference on artificial intelligence and industrial design (AIID), IEEE, pp\u00a0549\u2013553","DOI":"10.1109\/AIID51893.2021.9456565"},{"key":"5240_CR111","doi-asserted-by":"crossref","unstructured":"Thacker HK, Kumar A, Barari A, Damini D, Gupta A, Jagannathachar KK, Yoon D (2021) AlphaRA: an alphazero based approach to redundancy analysis. In: 2021 20th IEEE international conference on machine learning and applications (ICMLA), pp\u00a0477\u2013483","DOI":"10.1109\/ICMLA52953.2021.00080"},{"issue":"1","key":"5240_CR112","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1039\/C9SC04944D","volume":"11","author":"A Thakkar","year":"2020","unstructured":"Thakkar A, Kogej T, Reymond J-L, Engkvist O, Bjerrum EJ (2020) Datasets and their influence on the development of computer assisted synthesis planning tools in the pharmaceutical domain. Chem Sci 11(1):154\u2013168","journal-title":"Chem Sci"},{"key":"5240_CR113","doi-asserted-by":"crossref","unstructured":"Todi K, Bailly G, Leiva L, Oulasvirta A (2021) Adapting user interfaces with model-based reinforcement learning. In: Proceedings of the 2021 CHI conference on human factors in computing systems, pp\u00a01\u201313","DOI":"10.1145\/3411764.3445497"},{"issue":"6","key":"5240_CR114","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1134\/S1064230720050111","volume":"59","author":"N Tomin","year":"2020","unstructured":"Tomin N (2020) The concept of constructing an artificial dispatcher intelligent system based on deep reinforcement learning for the automatic control system of electric networks. J Comput Syst Sci Int 59(6):939\u2013956","journal-title":"J Comput Syst Sci Int"},{"key":"5240_CR115","unstructured":"Van\u00a0Eyck J, Ramon J, Guiza F, Meyfroidt G, Bruynooghe M, Van\u00a0den Berghe G (2013) Guided Monte Carlo tree search for planning in learned environments. In: Asian conference on machine learning, PMLR, pp\u00a033\u201347"},{"key":"5240_CR116","doi-asserted-by":"crossref","first-page":"881","DOI":"10.1613\/jair.5507","volume":"60","author":"T Vodopivec","year":"2017","unstructured":"Vodopivec T, Samothrakis S, Ster B (2017) On Monte Carlo tree search and reinforcement learning. J Artif Intell Res 60:881\u2013936","journal-title":"J Artif Intell Res"},{"issue":"1","key":"5240_CR117","first-page":"9","volume":"37","author":"J Vom Brocke","year":"2015","unstructured":"Vom Brocke J, Simons A, Riemer K, Niehaves B, Plattfaut R, Cleven A (2015) Standing on the shoulders of giants: Challenges and recommendations of literature search in information systems research. Commun Assoc Inf Syst 37(1):9","journal-title":"Commun Assoc Inf Syst"},{"key":"5240_CR118","doi-asserted-by":"crossref","unstructured":"Wang C, Chen X, Luo Y, Zhang G (2022) Solving virtual network mapping fast by combining neural network and MCTS. In: 2021 Ninth international conference on advanced cloud and big data (CBD), pp\u00a019\u201324","DOI":"10.1109\/CBD54617.2021.00013"},{"issue":"6","key":"5240_CR119","first-page":"1","volume":"39","author":"H Wang","year":"2020","unstructured":"Wang H, Liang W, Yu L-F (2020) Scene mover: automatic move planning for scene arrangement by deep reinforcement learning. ACM Trans Graph 39(6):1\u201315","journal-title":"ACM Trans Graph"},{"key":"5240_CR120","doi-asserted-by":"crossref","unstructured":"Wang H, Yang R, Yin C, Zou X, Wang X (2021) Research on the difficulty of mobile node deployment\u2019s self-play in wireless Ad Hoc networks based on deep reinforcement learning. Wirel Commun Mob Comput 2021","DOI":"10.1155\/2021\/4361650"},{"key":"5240_CR121","doi-asserted-by":"crossref","unstructured":"Wang JH, Cheng Luo P, Xiong HQ, Zhang BW, Peng JY (2020) Parallel machine workshop scheduling using the integration of proximal policy optimization training and Monte Carlo tree search. In: 2020 Chinese automation congress (CAC), pp\u00a03277\u20133282","DOI":"10.1109\/CAC51589.2020.9327564"},{"key":"5240_CR122","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.cma.2018.11.026","volume":"346","author":"K Wang","year":"2019","unstructured":"Wang K, Sun W (2019) Meta-modeling game for deriving theory-consistent, microstructure-based traction-separation laws via deep reinforcement learning. Comput Methods Appl Mech Eng 346:216\u2013241","journal-title":"Comput Methods Appl Mech Eng"},{"key":"5240_CR123","doi-asserted-by":"crossref","first-page":"104422","DOI":"10.1016\/j.engappai.2021.104422","volume":"105","author":"Q Wang","year":"2021","unstructured":"Wang Q, Hao Y, Cao J (2021) Learning to traverse over graphs with a Monte Carlo tree search-based self-play framework. Eng Appl Artif Intell 105:104422","journal-title":"Eng Appl Artif Intell"},{"key":"5240_CR124","doi-asserted-by":"crossref","unstructured":"Wang R, Zhou M, Li Y, Zhang Q, Dong H (2019) A timetable rescheduling approach for railway based on Monte Carlo tree search. In: 2019 IEEE intelligent transportation systems conference (ITSC), pp\u00a03738\u20133743","DOI":"10.1109\/ITSC.2019.8916963"},{"key":"5240_CR125","doi-asserted-by":"crossref","unstructured":"Wang S, Zhou K, Lai K, Shen J (2020) Task-completion dialogue policy learning via Monte Carlo tree search with dueling network. In Proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP), pp\u00a03461\u20133471","DOI":"10.18653\/v1\/2020.emnlp-main.278"},{"issue":"40","key":"5240_CR126","doi-asserted-by":"crossref","first-page":"10959","DOI":"10.1039\/D0SC04184J","volume":"11","author":"X Wang","year":"2020","unstructured":"Wang X, Qian Y, Gao H, Coley CW, Mo Y, Barzilay R, Jensen KF (2020) Towards efficient discovery of green synthetic pathways with Monte Carlo tree search and reinforcement learning. Chem Sci 11(40):10959\u201310972","journal-title":"Chem Sci"},{"key":"5240_CR127","doi-asserted-by":"crossref","first-page":"108682","DOI":"10.1016\/j.comnet.2021.108682","volume":"206","author":"X Wang","year":"2022","unstructured":"Wang X, Thomas JD, Piechocki RJ, Kapoor S, Santos-Rodr\u00edguez R, Parekh A (2022) Self-play learning strategies for resource assignment in Open-RAN networks. Comput Netw 206:108682","journal-title":"Comput Netw"},{"key":"5240_CR128","doi-asserted-by":"crossref","unstructured":"Wang Y, Sun M, Wang H, Sun Y (2022) Research on knowledge graph completion model combining temporal convolutional network and Monte Carlo tree search. Math Prob Eng 2022","DOI":"10.1155\/2022\/2290540"},{"key":"5240_CR129","doi-asserted-by":"crossref","unstructured":"Wang Z, Li C (2022) Channel pruning via lookahead search guided reinforcement learning. In 2022 IEEE\/CVF winter conference on applications of computer vision (WACV), pp\u00a03513\u20133524","DOI":"10.1109\/WACV51458.2022.00357"},{"key":"5240_CR130","unstructured":"Webster J, Watson RT (2002) Analyzing the past to prepare for the future: writing a literature review. MIS Q xiii-xxiii"},{"key":"5240_CR131","doi-asserted-by":"crossref","unstructured":"Weingertner P, Ho M, Timofeev A, Aubert S, Pita-Gil G (2020) Monte Carlo Tree search with reinforcement learning for motion planning. In: 2020 IEEE 23rd international conference on intelligent transportation systems (ITSC), pp\u00a01\u20137","DOI":"10.1109\/ITSC45102.2020.9294697"},{"issue":"1","key":"5240_CR132","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1021\/ci00057a005","volume":"28","author":"D Weininger","year":"1988","unstructured":"Weininger D (1988) SMILES, a chemical language and information system. 1. Introduction to methodology and encoding rules. J Chem Inf Comput Sci 28(1):31\u201336","journal-title":"J Chem Inf Comput Sci"},{"issue":"12","key":"5240_CR133","doi-asserted-by":"crossref","first-page":"8254","DOI":"10.1109\/TII.2021.3066257","volume":"17","author":"Q Wu","year":"2021","unstructured":"Wu Q, Feng Q, Ren Y, Xia Q, Wang Z, Cai B (2021) An intelligent preventive maintenance method based on reinforcement learning for battery energy storage systems. IEEE Trans Industr Inform 17(12):8254\u20138264","journal-title":"IEEE Trans Industr Inform"},{"key":"5240_CR134","doi-asserted-by":"crossref","unstructured":"Wu Y, Yao L (2021) Research on the problem of 3D bin packing under incomplete information based on deep reinforcement learning. In: 2021 International conference on e-commerce and e-management (ICECEM), pp\u00a038\u201342","DOI":"10.1109\/ICECEM54757.2021.00016"},{"issue":"1","key":"5240_CR135","doi-asserted-by":"crossref","first-page":"734","DOI":"10.1021\/acsami.9b17867","volume":"12","author":"Z Xiangyu","year":"2020","unstructured":"Xiangyu Z, Kexin Z, Yongjin L (2020) Machine learning enabled tailor-made design of application-specific metal-organic frameworks. ACS Appl Mater Interfaces 12(1):734\u2013743","journal-title":"ACS Appl Mater Interfaces"},{"key":"5240_CR136","doi-asserted-by":"crossref","first-page":"108418","DOI":"10.1109\/ACCESS.2020.3000236","volume":"8","author":"Z Xing","year":"2020","unstructured":"Xing Z, Tu S (2020) A graph neural network assisted Monte Carlo tree search approach to traveling salesman problem. IEEE Access 8:108418\u2013108428","journal-title":"IEEE Access"},{"key":"5240_CR137","unstructured":"Xing Z, Tu S, Xu L (2020) Solve traveling salesman problem by Monte Carlo tree search and deep neural network. arXiv:2005.06879"},{"key":"5240_CR138","unstructured":"Xu R, Lieberherr K (2019) Learning self-game-play agents for combinatorial optimization problems. In: Proceedings of the 18th international conference on autonomous agents and multiagent systems, pp\u00a02276\u20132278"},{"key":"5240_CR139","doi-asserted-by":"crossref","unstructured":"Xu R, Lieberherr K (2020) Learning self-play agents for combinatorial optimization problems. Knowl Eng Rev 35","DOI":"10.1017\/S026988892000020X"},{"key":"5240_CR140","doi-asserted-by":"crossref","unstructured":"Xu R, Lieberherr K (2022) On-the-fly model checking with neural MCTS. In: NASA formal methods symposium, Springer, pp\u00a0557\u2013575","DOI":"10.1007\/978-3-031-06773-0_30"},{"key":"5240_CR141","doi-asserted-by":"crossref","unstructured":"Xu R, Lieberherr K (2022) Towards tackling QSAT problems with deep learning and Monte Carlo tree search. In: Science and information conference, Springer, pp\u00a045\u201358","DOI":"10.1007\/978-3-031-10464-0_4"},{"issue":"5","key":"5240_CR142","doi-asserted-by":"crossref","first-page":"4539","DOI":"10.1109\/TVT.2018.2793186","volume":"67","author":"M Yan","year":"2018","unstructured":"Yan M, Feng G, Zhou J, Qin S (2018) Smart multi-RAT access based on multiagent reinforcement learning. IEEE Trans Veh Technol 67(5):4539\u20134551","journal-title":"IEEE Trans Veh Technol"},{"key":"5240_CR143","doi-asserted-by":"crossref","unstructured":"Yang J, Hou X, Hu YH, Liu Y, Pan Q (2020) A reinforcement learning scheme for active multi-debris removal mission planning with modified upper confidence bound tree search. IEEE Access 8:108461\u2013108473","DOI":"10.1109\/ACCESS.2020.3001311"},{"key":"5240_CR144","doi-asserted-by":"crossref","unstructured":"Yang R, Zou X, Nie Z, Yin C (2018) Research on deployment of communication node vehicles based on deep reinforcement learning. In: 2018 5th IEEE international conference on cloud computing and intelligence systems (CCIS), pp\u00a0484\u2013487","DOI":"10.1109\/CCIS.2018.8691383"},{"issue":"1","key":"5240_CR145","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1080\/14686996.2017.1401424","volume":"18","author":"X Yang","year":"2017","unstructured":"Yang X, Zhang J, Yoshizoe K, Terayama K, Tsuda K (2017) ChemTS: an efficient python library for de novo molecular generation. Sci Technol Adv Mater 18(1):972\u2013976","journal-title":"Sci Technol Adv Mater"},{"issue":"1","key":"5240_CR146","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1587\/transcom.2020EBP3061","volume":"104","author":"C Yin","year":"2021","unstructured":"Yin C, Yang R, Zhu W, Zou X, Zhang J (2021) Optimal planning of emergency communication network using deep reinforcement learning. IEICE Trans Commun 104(1):20\u201326","journal-title":"IEICE Trans Commun"},{"key":"5240_CR147","doi-asserted-by":"crossref","unstructured":"Yu T, Huang J, Chang Q (2020) Mastering the working sequence in human-robot collaborative assembly based on reinforcement learning. IEEE Access 8:163868\u2013163877","DOI":"10.1109\/ACCESS.2020.3021904"},{"issue":"41","key":"5240_CR148","doi-asserted-by":"crossref","first-page":"e2212711119","DOI":"10.1073\/pnas.2212711119","volume":"119","author":"B Zhang","year":"2022","unstructured":"Zhang B, Zhang X, Du W, Song Z, Zhang G, Zhang G, Wang Y, Chen X, Jiang J, Luo Y (2022) Chemistry-informed molecular graph as reaction descriptor for machine-learned retrosynthesis planning. Proc Natl Acad Sci 119(41):e2212711119","journal-title":"Proc Natl Acad Sci"},{"key":"5240_CR149","first-page":"1621","volume":"33","author":"C Zhang","year":"2020","unstructured":"Zhang C, Song W, Cao Z, Zhang J, Tan PS, Chi X (2020) Learning to dispatch for job shop scheduling via deep reinforcement learning. Adv Neural Inf Process Syst 33:1621\u20131632","journal-title":"Adv Neural Inf Process Syst"},{"key":"5240_CR150","doi-asserted-by":"crossref","first-page":"154485","DOI":"10.1109\/ACCESS.2020.3017770","volume":"8","author":"J Zhang","year":"2020","unstructured":"Zhang J, Chen H, Song S, Hu F (2020) Reinforcement learning-based motion planning for automatic parking system. IEEE Access 8:154485\u2013154501","journal-title":"IEEE Access"},{"key":"5240_CR151","unstructured":"Zhang J, Zhou K, Schelter S (2020) Alphajoin: join order selection \u00e1 la AlphaGo. In: CEUR workshop proceedings, vol\u00a02652"},{"key":"5240_CR152","doi-asserted-by":"crossref","first-page":"119117","DOI":"10.1016\/j.seppur.2021.119117","volume":"275","author":"K Zhang","year":"2021","unstructured":"Zhang K, Wu J, Yoo H, Lee Y (2021) Machine learning-based approach for tailor-made design of ionic liquids: Application to CO2 capture. Sep Purif Technol 275:119117","journal-title":"Sep Purif Technol"},{"key":"5240_CR153","doi-asserted-by":"crossref","unstructured":"Zhang M, Huang Q, Wang S, Wang Z (2018) Construction of LDPC codes based on deep reinforcement learning. In: 2018 10th international conference on wireless communications and signal processing (WCSP), pp\u00a01\u20134","DOI":"10.1109\/WCSP.2018.8555714"},{"issue":"6","key":"5240_CR154","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1109\/MAES.2021.3089252","volume":"37","author":"Y Zhang","year":"2022","unstructured":"Zhang Y, Wang W, Zhang P, Huang P (2022) Reinforcement-learning-based task planning for self-reconfiguration of cellular satellites. IEEE Aerosp Electron Syst Mag 37(6):38\u201347","journal-title":"IEEE Aerosp Electron Syst Mag"},{"key":"5240_CR155","doi-asserted-by":"crossref","unstructured":"Zhong S, Zhao Y, Chen J (2019) Learning to recover sparse signals. In: 2019 57th Annual allerton conference on communication, control, and computing (Allerton), pp\u00a0995\u20131000","DOI":"10.1109\/ALLERTON.2019.8919947"},{"key":"5240_CR156","doi-asserted-by":"crossref","unstructured":"Zombori Z, Urban J, Brown CE (2020) Prolog technology reinforcement learning prover. In: International joint conference on automated reasoning, Springer, pp\u00a0489\u2013507","DOI":"10.1007\/978-3-030-51054-1_33"},{"key":"5240_CR157","doi-asserted-by":"crossref","unstructured":"Zombori Z, Urban J, Ol\u0161\u00e1k M (2021) The role of entropy in guiding a connection prover. In: International conference on automated reasoning with analytic tableaux and related methods, Springer, pp\u00a0218\u2013235","DOI":"10.1007\/978-3-030-86059-2_13"},{"key":"5240_CR158","doi-asserted-by":"crossref","unstructured":"Zou L, Xia L, Ding Z, Yin D, Song J, Liu W (2019) Reinforcement learning to diversify top-n recommendation. In: International conference on database systems for advanced applications, Springer, pp\u00a0104\u2013120","DOI":"10.1007\/978-3-030-18579-4_7"},{"key":"5240_CR159","doi-asserted-by":"crossref","unstructured":"Zou X, Yang R, Yin C (2019) Research on node layout model optimization of MANET based on AlphaZero technology under incomplete visual terrain. In: Proceedings of the 2019 international conference on artificial intelligence and computer science, pp\u00a0562\u2013565","DOI":"10.1145\/3349341.3349468"},{"issue":"9","key":"5240_CR160","doi-asserted-by":"crossref","first-page":"1392","DOI":"10.1049\/iet-com.2019.0349","volume":"14","author":"X Zou","year":"2020","unstructured":"Zou X, Yang R, Yin C, Nie Z, Wang H (2020) Deploying tactical communication node vehicles with AlphaZero algorithm. IET Commun 14(9):1392\u20131396","journal-title":"IET Commun"},{"key":"5240_CR161","doi-asserted-by":"crossref","unstructured":"\u015awiechowski M, Godlewski K, Sawicki B, Ma\u0144dziuk J (2022) Monte, Carlo tree search: A review of recent modifications and applications. Artif Intell Rev 1\u201366","DOI":"10.1007\/s10462-022-10228-y"}],"container-title":["Applied Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-023-05240-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10489-023-05240-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-023-05240-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,13]],"date-time":"2024-01-13T10:28:57Z","timestamp":1705141737000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10489-023-05240-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,28]]},"references-count":161,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,1]]}},"alternative-id":["5240"],"URL":"https:\/\/doi.org\/10.1007\/s10489-023-05240-w","relation":{},"ISSN":["0924-669X","1573-7497"],"issn-type":[{"value":"0924-669X","type":"print"},{"value":"1573-7497","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,28]]},"assertion":[{"value":"12 December 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 December 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant financial or non- financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}