{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T08:00:21Z","timestamp":1761897621409,"version":"3.41.2"},"reference-count":39,"publisher":"ASME International","issue":"4","license":[{"start":{"date-parts":[[2022,2,7]],"date-time":"2022-02-07T00:00:00Z","timestamp":1644192000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.asme.org\/publications-submissions\/publishing-information\/legal-policies"}],"content-domain":{"domain":["asmedigitalcollection.asme.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,8,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>When maintenance resources in a manufacturing system are limited, a challenge arises in determining how to allocate these resources among multiple competing maintenance jobs. This work formulates an online prioritization problem to tackle this challenge using a Markov decision process (MDP) to model the system behavior and Monte Carlo tree search (MCTS) to seek optimal maintenance actions in various states of the system. Further, case-based reasoning (CBR) is adopted to retain and reuse search experience gathered from MCTS to reduce the computational effort needed over time and to improve decision-making efficiency. The proposed method results in increased system throughput when compared to existing methods of maintenance prioritization while also reducing the computation time needed to identify optimal maintenance actions as more information is gathered. This is especially beneficial in manufacturing settings where maintenance decisions must be made quickly to minimize the negative performance impact of machine downtime.<\/jats:p>","DOI":"10.1115\/1.4053408","type":"journal-article","created":{"date-parts":[[2022,1,6]],"date-time":"2022-01-06T07:49:00Z","timestamp":1641455340000},"update-policy":"https:\/\/doi.org\/10.1115\/crossmarkpolicy-asme","source":"Crossref","is-referenced-by-count":5,"title":["Online Maintenance Prioritization Via Monte Carlo Tree Search and Case-Based Reasoning"],"prefix":"10.1115","volume":"22","author":[{"given":"Michael","family":"Hoffman","sequence":"first","affiliation":[{"name":"Department of Industrial and Manufacturing Engineering, Pennsylvania State University, University Park, PA 16802"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eunhye","family":"Song","sequence":"additional","affiliation":[{"name":"Department of Industrial and Manufacturing Engineering, Pennsylvania State University, University Park, PA 16802"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Brundage","sequence":"additional","affiliation":[{"name":"National Institute of Standards and Technology, Gaithersburg, MD 20899"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Soundar","family":"Kumara","sequence":"additional","affiliation":[{"name":"Department of Industrial and Manufacturing Engineering, Pennsylvania State University, University Park, PA 16802"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"33","published-online":{"date-parts":[[2022,2,7]]},"reference":[{"issue":"1","key":"2022020714353934300_CIT0001","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1287\/opre.1040.0145","article-title":"An Adaptive Sampling Algorithm for Solving Markov Decision Processes","volume":"53","author":"Chang","year":"2005","journal-title":"Oper. Res."},{"key":"2022020714353934300_CIT0002","doi-asserted-by":"crossref","DOI":"10.1201\/9781420072747-c3","article-title":"Online Scheduling","volume-title":"Introduction to Scheduling","author":"Albers","year":"2009"},{"issue":"2","key":"2022020714353934300_CIT0003","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1016\/j.ejor.2017.02.044","article-title":"Condition-Based Maintenance Policies for Systems With Multiple Dependent Components: A Review","volume":"261","author":"Keizer","year":"2017","journal-title":"Eur. J. Oper. Res."},{"key":"2022020714353934300_CIT0004","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1016\/j.cie.2014.12.022","article-title":"State of the Art in Simulation-Based Optimisation for Maintenance Systems","volume":"82","author":"Alrabghi","year":"2015","journal-title":"Comput. Ind. Eng."},{"issue":"1","key":"2022020714353934300_CIT0005","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1108\/JFM-11-2017-0058","article-title":"Maintenance Prioritization\u2013a Review on Factors and Methods","volume":"17","author":"Chong","year":"2019","journal-title":"J. Facil. Manage."},{"issue":"1","key":"2022020714353934300_CIT0006","first-page":"83","article-title":"Decision Making with the Analytic Hierarchy Process","volume":"1","author":"Saaty","year":"2008","journal-title":"Int. J. Serv. Sci."},{"issue":"1","key":"2022020714353934300_CIT0007","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1007\/s40903-016-0040-2","article-title":"Prioritization of Tools in Joint Production-Maintenance Environment of Auto Component Manufacturer Using AHP\u2013Fuzzy\u2013TOPSIS","volume":"2","author":"Sharma","year":"2016","journal-title":"Intell. Ind. Syst."},{"issue":"2","key":"2022020714353934300_CIT0008","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1016\/j.cie.2007.07.002","article-title":"Prioritizing Equipments for Preventive Maintenance (PM) Activities Using Fuzzy Rules","volume":"54","author":"Khanlari","year":"2008","journal-title":"Comput. Ind. Eng."},{"issue":"2","key":"2022020714353934300_CIT0009","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1109\/TASE.2012.2210874","article-title":"Energy Saving Opportunity Analysis of Automotive Serial Production Systems","volume":"10","author":"Chang","year":"2013","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"issue":"3","key":"2022020714353934300_CIT0010","doi-asserted-by":"publisher","first-page":"031017","DOI":"10.1115\/1.4029906","article-title":"Prediction of Passive Maintenance Opportunity Windows on Bottleneck Machines in Complex Manufacturing Systems","volume":"137","author":"Gu","year":"2015","journal-title":"ASME J. Manuf. Sci. Eng."},{"issue":"2","key":"2022020714353934300_CIT0011","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1016\/0377-2217(94)00260-J","article-title":"Integrating Optimisation, Priority Setting, Planning and Combining of Maintenance Activities","volume":"82","author":"Dekker","year":"1995","journal-title":"Eur. J. Oper. Res."},{"issue":"2","key":"2022020714353934300_CIT0012","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1016\/s0951-8320(98)83004-4","article-title":"On the Impact of Optimisation Models in Maintenance Decision Making: the State of the Art","volume":"60","author":"Dekker","year":"1998","journal-title":"Reliab. Eng. Syst. Saf."},{"issue":"5","key":"2022020714353934300_CIT0013","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1108\/02656719610118151","article-title":"Failure Mode and Effects Analysis","volume":"13","author":"Teng","year":"1996","journal-title":"Int. J. Qual. Reliab. Manage."},{"issue":"3","key":"2022020714353934300_CIT0014","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1108\/JMTM-03-2012-0032","article-title":"Maintenance Policy Selection Model\u2013a Case Study in the Palm Oil Industry","volume":"25","author":"Ding","year":"2014","journal-title":"J. Manuf. Technol. Manage."},{"issue":"2","key":"2022020714353934300_CIT0015","doi-asserted-by":"publisher","first-page":"435","DOI":"10.1115\/1.2336257","article-title":"Maintenance Priority Assignment Utilizing on-line Production Information","volume":"129","author":"Yang","year":"2007","journal-title":"ASME J. Manuf. Sci. Eng."},{"key":"2022020714353934300_CIT0016","article-title":"On The Importance of Different Components in A Multicomponent System","volume-title":"Technical Report","author":"Birnbaum","year":"1968"},{"issue":"4","key":"2022020714353934300_CIT0017","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1080\/23302674.2014.983582","article-title":"Condition-Based Maintenance for Multi-Component Systems Using Importance Measure and Predictive Information","volume":"1","author":"Nguyen","year":"2014","journal-title":"Int. J. Syst. Sci.: Oper. Logist."},{"issue":"3","key":"2022020714353934300_CIT0018","doi-asserted-by":"publisher","first-page":"831","DOI":"10.1109\/TR.2019.2897026","article-title":"System Reliability Allocation and Optimization Based on Generalized Birnbaum Importance Measure","volume":"68","author":"Si","year":"2019","journal-title":"IEEE Trans. Reliab."},{"key":"2022020714353934300_CIT0019","doi-asserted-by":"crossref","DOI":"10.36001\/phmconf.2018.v10i1.537","article-title":"Condition-Based Maintenance Policy Optimization Using Genetic Algorithms and Gaussian Markov Improvement Algorithm","author":"Hoffman","year":"2018"},{"volume-title":"Reinforcement Learning: An Introduction","year":"2018","author":"Sutton","key":"2022020714353934300_CIT0020"},{"issue":"2","key":"2022020714353934300_CIT0021","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1023\/A:1017932429737","article-title":"A Sparse Sampling Algorithm for Near-Optimal Planning in Large Markov Decision Processes","volume":"49","author":"Kearns","year":"2002","journal-title":"Mach. Learn."},{"key":"2022020714353934300_CIT0022","first-page":"282","article-title":"Bandit Based Monte-Carlo Planning","author":"Kocsis","year":"2006"},{"issue":"1","key":"2022020714353934300_CIT0023","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TCIAIG.2012.2186810","article-title":"A Survey of Monte Carlo Tree Search Methods","volume":"4","author":"Browne","year":"2012","journal-title":"IEEE Trans. Comput. Intell. AI in Games"},{"key":"2022020714353934300_CIT0024","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TASE.2021.3088603","article-title":"Online Improvement of Condition-Based Maintenance Policy Via Monte Carlo Tree Search","author":"Hoffman","year":"2021","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"issue":"1","key":"2022020714353934300_CIT0025","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/BF00155578","article-title":"An Introduction to Case-Based Reasoning","volume":"6","author":"Kolodner","year":"1992","journal-title":"Artif. Intell. Rev."},{"issue":"1","key":"2022020714353934300_CIT0026","doi-asserted-by":"publisher","first-page":"39","DOI":"10.3233\/AIC-1994-7104","article-title":"Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches","volume":"7","author":"Aamodt","year":"1994","journal-title":"AI Commun."},{"key":"2022020714353934300_CIT0027","first-page":"28","article-title":"On the Role of Abstraction in Case-Based Reasoning","author":"Bergmann","year":"1996"},{"article-title":"Technical Design of Condition Based Maintenance System-A Case Study Using Sound Analysis and Case-Based Reasoning","year":"2004","author":"Bengtsson","key":"2022020714353934300_CIT0028"},{"issue":"10","key":"2022020714353934300_CIT0029","doi-asserted-by":"publisher","first-page":"2431","DOI":"10.1243\/09544062JMES1588","article-title":"Applying a Case-Based Reasoning Method for Fault Diagnosis During Maintenance","volume":"223","author":"Tsai","year":"2009","journal-title":"Proc. Inst. Mech. Eng., Part C: J. Mech. Eng. Sci."},{"key":"2022020714353934300_CIT0030","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1016\/j.rcim.2019.01.012","article-title":"A Knowledge Based Machine Tool Maintenance Planning System Using Case-Based Reasoning Techniques","volume":"58","author":"Wan","year":"2019","journal-title":"Rob. Comput.-Integr. Manuf."},{"issue":"4","key":"2022020714353934300_CIT0031","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1016\/S0952-1976(03)00079-4","article-title":"A Multi-Agents Based E-Maintenance System with Case-Based Reasoning Decision Support","volume":"16","author":"Yu","year":"2003","journal-title":"Eng. Appl. Artif. Intell."},{"key":"2022020714353934300_CIT0032","first-page":"206","article-title":"CBR For State Value Function Approximation in Reinforcement Learning","author":"Gabel","year":"2005"},{"issue":"5","key":"2022020714353934300_CIT0033","doi-asserted-by":"publisher","first-page":"336","DOI":"10.3103\/S0147688210050096","article-title":"Modeling of Case-Based Reasoning in Intelligent Decision Support Systems","volume":"37","author":"Varshavskii","year":"2010","journal-title":"Sci. Techn. Inf. Process."},{"volume-title":"Production Systems Engineering","year":"2008","author":"Li","key":"2022020714353934300_CIT0034"},{"key":"2022020714353934300_CIT0035","first-page":"477","article-title":"Learning Classification With Auxiliary Probabilistic Information","author":"Nguyen","year":"2011"},{"volume-title":"Lazy Learning","year":"2013","author":"Aha","key":"2022020714353934300_CIT0036"},{"key":"2022020714353934300_CIT0037","doi-asserted-by":"crossref","DOI":"10.1109\/WSC52266.2021.9715474","article-title":"Selection of The Most Probable Best Under Input Uncertainty","author":"Kim","year":"2021"},{"year":"2021","author":"Hoffman","key":"2022020714353934300_CIT0038"},{"key":"2022020714353934300_CIT0039","first-page":"V003T02A027","article-title":"Developing Maintenance Key Performance Indicators From Maintenance Work Order Data","author":"Brundage","year":"2018"}],"container-title":["Journal of Computing and Information Science in Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/22\/4\/041005\/6836985\/jcise_22_4_041005.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/22\/4\/041005\/6836985\/jcise_22_4_041005.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,22]],"date-time":"2023-01-22T01:51:53Z","timestamp":1674352313000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article\/22\/4\/041005\/1131039\/Online-Maintenance-Prioritization-Via-Monte-Carlo"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,7]]},"references-count":39,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,8,1]]}},"URL":"https:\/\/doi.org\/10.1115\/1.4053408","relation":{},"ISSN":["1530-9827","1944-7078"],"issn-type":[{"type":"print","value":"1530-9827"},{"type":"electronic","value":"1944-7078"}],"subject":[],"published":{"date-parts":[[2022,2,7]]},"article-number":"041005"}}