{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T16:25:15Z","timestamp":1771518315158,"version":"3.50.1"},"reference-count":85,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2025,8,23]],"date-time":"2025-08-23T00:00:00Z","timestamp":1755907200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,8,23]],"date-time":"2025-08-23T00:00:00Z","timestamp":1755907200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005727","name":"Universidade de Coimbra","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005727","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Oper. Res. Forum"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Industry 5.0, the fifth industrial revolution, envisions collaboration between humans and machines, where human intelligence directs decision-making and machines handle empirical processing. This paper presents a decision support framework that combines human-centered design with a multi-objective reinforcement learning model (MORL), specifically multi-criteria decision-making with deep Q-networks (MCDM-DQN). This approach evaluates the importance of maintenance factors in achieving sustainability in manufacturing, emphasizing the perspectives of various stakeholders. By fostering collaboration between stakeholders and the MCDM-DQN, the framework effectively integrates their feedback, improving prioritization according to the operational context of the organization. The experiments confirmed the effectiveness of the method, demonstrating that MCDM-DQN efficiently ranks key factors while adhering to conventional methods and offering advanced features such as real-time feedback. These results assist decision-makers in selecting appropriate sustainable strategies and improve the synergy between advanced automation and human insight within the Industry 5.0 framework, providing valuable guidance to leaders and practitioners.<\/jats:p>","DOI":"10.1007\/s43069-025-00539-5","type":"journal-article","created":{"date-parts":[[2025,8,23]],"date-time":"2025-08-23T11:25:16Z","timestamp":1755948316000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A Multi-objective Reinforcement Learning Model to Support Decision-Makers in Assessing Key Maintenance Factors for Sustainable Manufacturing"],"prefix":"10.1007","volume":"6","author":[{"given":"Jos\u00e9 Carlos","family":"Almeida","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bernardete","family":"Ribeiro","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alberto","family":"Cardoso","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,8,23]]},"reference":[{"key":"539_CR1","doi-asserted-by":"publisher","unstructured":"Longo F, Padovano A, Umbrello S (2020) Value-oriented and ethical technology engineering in Industry 5.0: a human-centric perspective for the design of the factory of the future. Appl Sci 10(12):4182. https:\/\/doi.org\/10.3390\/app10124182","DOI":"10.3390\/app10124182"},{"issue":"11","key":"539_CR2","doi-asserted-by":"publisher","first-page":"3800","DOI":"10.3390\/ijerph17113800","volume":"17","author":"S Hendiani","year":"2020","unstructured":"Hendiani S, Liao H, Bagherpour M, Tvaronavi\u010dien\u0117 M, Banaitis A, Antucheviciene J (2020) Analyzing the status of sustainable development in the manufacturing sector using multi-expert multi-criteria fuzzy decision-making and integrated triple bottom lines. Int J Environ Res Pub Health 17(11):3800. https:\/\/doi.org\/10.3390\/ijerph17113800","journal-title":"Int J Environ Res Pub Health"},{"key":"539_CR3","doi-asserted-by":"publisher","unstructured":"Farsi M, Mishra RK, Erkoyuncu JA (2021) Industry 5.0 for sustainable reliability centered maintenance. SSRN Electron J. https:\/\/doi.org\/10.2139\/ssrn.3944533","DOI":"10.2139\/ssrn.3944533"},{"key":"539_CR4","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1016\/j.jmsy.2023.04.009","volume":"68","author":"F Psarommatis","year":"2023","unstructured":"Psarommatis F, May G, Azamfirei V (2023) Envisioning maintenance 5.0: insights from a systematic literature review of Industry 4.0 and a proposed framework. J Manuf Syst 68:376\u2013399. https:\/\/doi.org\/10.1016\/j.jmsy.2023.04.009","journal-title":"J Manuf Syst"},{"key":"539_CR5","doi-asserted-by":"publisher","unstructured":"Molamohamadi O, Ismail N (2013) Developing a new scheme for sustainable manufacturing. Int J Mater Mech Manuf 1\u20135. https:\/\/doi.org\/10.7763\/ijmmm.2013.v1.1","DOI":"10.7763\/ijmmm.2013.v1.1"},{"issue":"5","key":"539_CR6","doi-asserted-by":"publisher","first-page":"1436","DOI":"10.3390\/en14051436","volume":"14","author":"M Jasiulewicz-Kaczmarek","year":"2021","unstructured":"Jasiulewicz-Kaczmarek M, Antosz K, Wycz\u00f3\u0142kowski R, Mazurkiewicz D, Sun B, Qian C, Ren Y (2021) Application of MICMAC, Fuzzy AHP, and Fuzzy TOPSIS for evaluation of the maintenance factors affecting sustainable manufacturing. Energies 14(5):1436. https:\/\/doi.org\/10.3390\/en14051436","journal-title":"Energies"},{"key":"539_CR7","doi-asserted-by":"publisher","unstructured":"Campos RSd, Simon AT (2019) Insertion of sustainability concepts in the maintenance strategies to achieve sustainable manufacturing. Independent J Manage Prod 10(6):1908\u20131931. https:\/\/doi.org\/10.14807\/ijmp.v10i6.939","DOI":"10.14807\/ijmp.v10i6.939"},{"issue":"1","key":"539_CR8","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1108\/jqme-05-2021-0038","volume":"29","author":"M Suresh","year":"2021","unstructured":"Suresh M, Dharunanand R (2021) Factors influencing sustainable maintenance in manufacturing industries. J Qual Maint Eng 29(1):94\u2013113. https:\/\/doi.org\/10.1108\/jqme-05-2021-0038","journal-title":"J Qual Maint Eng"},{"key":"539_CR9","doi-asserted-by":"publisher","unstructured":"Franciosi C, Iung B, Miranda S, Riemma S (2018) Maintenance for sustainability in the industry 4.0 context: a scoping literature review. IFAC-PapersOnLine 51(11):903\u2013908. https:\/\/doi.org\/10.1016\/j.ifacol.2018.08.459","DOI":"10.1016\/j.ifacol.2018.08.459"},{"issue":"5\u20136","key":"539_CR10","doi-asserted-by":"publisher","first-page":"2843","DOI":"10.1007\/s00170-020-05202-3","volume":"107","author":"M Baur","year":"2020","unstructured":"Baur M, Albertelli P, Monno M (2020) A review of prognostics and health management of machine tools. Int J Adv Manuf Technol 107(5\u20136):2843\u20132863. https:\/\/doi.org\/10.1007\/s00170-020-05202-3","journal-title":"Int J Adv Manuf Technol"},{"key":"539_CR11","doi-asserted-by":"publisher","unstructured":"Krupitzer C, Wagenhals T, Z\u00fcfle M, Lesch V, Sch\u00e4fer D, Mozaffarin A, Edinger J, Becker C, Kounev S (2020) A survey on predictive maintenance for Industry 4.0. arXiv. https:\/\/doi.org\/10.48550\/ARXIV.2002.08224https:\/\/arxiv.org\/abs\/2002.08224","DOI":"10.48550\/ARXIV.2002.08224"},{"key":"539_CR12","doi-asserted-by":"publisher","unstructured":"T\u00f3th A, Nagy L, Kennedy R, Bohu\u0161 B, Abonyi J, Ruppert T (2023) The human-centric Industry 5.0 collaboration architecture. MethodsX 11:102260. https:\/\/doi.org\/10.1016\/j.mex.2023.102260","DOI":"10.1016\/j.mex.2023.102260"},{"key":"539_CR13","doi-asserted-by":"publisher","unstructured":"Frazzon E.M, Agostino aRS, Broda E, Freitag M (2020) Manufacturing networks in the era of digital production and operations: a socio-cyber-physical perspective. Annu Rev Control 49:288\u2013294. https:\/\/doi.org\/10.1016\/j.arcontrol.2020.04.008","DOI":"10.1016\/j.arcontrol.2020.04.008"},{"key":"539_CR14","doi-asserted-by":"publisher","unstructured":"Balali A, Valipour A, Edwards R, Moehler R (2021) Ranking effective risks on human resources threats in natural gas supply projects using ANP-COPRAS method: case study of shiraz. Reliab Eng Syst Safety 208:107442. https:\/\/doi.org\/10.1016\/j.ress.2021.107442","DOI":"10.1016\/j.ress.2021.107442"},{"key":"539_CR15","doi-asserted-by":"publisher","unstructured":"Sahoo SK, Goswami SS (2023) A comprehensive review of multiple criteria decision-making (MCDM) methods: advancements, applications, and future directions. Decis Making Adv 1(1):25\u201348. https:\/\/doi.org\/10.31181\/dma1120237","DOI":"10.31181\/dma1120237"},{"key":"539_CR16","doi-asserted-by":"publisher","unstructured":"Singh V, Chen S-S, Singhania M, Nanavati B, kar Ak, Gupta A (2022) How are reinforcement learning and deep learning algorithms used for big data based decision making in financial industries\u2013a review and research agenda. Int J Inf Manage Data Insights 2(2):100094. https:\/\/doi.org\/10.1016\/j.jjimei.2022.100094","DOI":"10.1016\/j.jjimei.2022.100094"},{"issue":"10\u201311","key":"539_CR17","doi-asserted-by":"publisher","first-page":"1269","DOI":"10.1080\/0951192x.2022.2025623","volume":"35","author":"Y Liu","year":"2022","unstructured":"Liu Y, Yang M, Guo Z (2022) Reinforcement learning based optimal decision making towards product lifecycle sustainability. Int J Comput Integr Manuf 35(10\u201311):1269\u20131296. https:\/\/doi.org\/10.1080\/0951192x.2022.2025623","journal-title":"Int J Comput Integr Manuf"},{"issue":"2","key":"539_CR18","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1007\/s12293-022-00357-w","volume":"14","author":"J Xu","year":"2022","unstructured":"Xu J, Li K, Abusara M (2022) Preference based multi-objective reinforcement learning for multi-microgrid system optimization problem in smart grid. Memetic Comput 14(2):225\u2013235. https:\/\/doi.org\/10.1007\/s12293-022-00357-w","journal-title":"Memetic Comput"},{"key":"539_CR19","doi-asserted-by":"publisher","unstructured":"Zhang L, Qi Z, Shi Y (2023) Multi-objective reinforcement learning \u2013 concept, approaches and applications. Procedia Comput Sci 221:526\u2013532. https:\/\/doi.org\/10.1016\/j.procs.2023.08.018","DOI":"10.1016\/j.procs.2023.08.018"},{"key":"539_CR20","doi-asserted-by":"publisher","unstructured":"Almeida JC, Ribeiro B, Cardoso A (2023) A human-centric approach to aid in assessing maintenance from the sustainable manufacturing perspective. Procedia Comput Sci 220:600\u2013607. https:\/\/doi.org\/10.1016\/j.procs.2023.03.076","DOI":"10.1016\/j.procs.2023.03.076"},{"issue":"7540","key":"539_CR21","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","volume":"518","author":"V Mnih","year":"2015","unstructured":"Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A, Riedmiller M, Fidjeland AK, Ostrovski G, Petersen S, Beattie C, Sadik A, Antonoglou I, King H, Kumaran D, Wierstra D, Legg S, Hassabis D (2015) Human-level control through deep reinforcement learning. Nature 518(7540):529\u2013533. https:\/\/doi.org\/10.1038\/nature14236","journal-title":"Nature"},{"key":"539_CR22","doi-asserted-by":"publisher","unstructured":"Werbi\u0144ska-Wojciechowska S, Winiarska K (2023) Maintenance performance in the age of Industry 4.0: a bibliometric performance analysis and a systematic literature review. Sensors 23(3):1409. https:\/\/doi.org\/10.3390\/s23031409","DOI":"10.3390\/s23031409"},{"issue":"17","key":"539_CR23","doi-asserted-by":"publisher","first-page":"3449","DOI":"10.3390\/electronics13173449","volume":"13","author":"M Rakyta","year":"2024","unstructured":"Rakyta M, Bubenik P, Binasova V, Gabajova G, Staffenova K (2024) The change in maintenance strategy on the efficiency and quality of the production system. Electronics 13(17):3449. https:\/\/doi.org\/10.3390\/electronics13173449","journal-title":"Electronics"},{"issue":"4","key":"539_CR24","doi-asserted-by":"publisher","first-page":"873","DOI":"10.1108\/jqme-10-2020-0109","volume":"28","author":"SA Raza","year":"2021","unstructured":"Raza SA, Hameed A (2021) Models for maintenance planning and scheduling \u2013 a citation-based literature review and content analysis. J Qual Maint Eng 28(4):873\u2013914. https:\/\/doi.org\/10.1108\/jqme-10-2020-0109","journal-title":"J Qual Maint Eng"},{"issue":"8","key":"539_CR25","doi-asserted-by":"publisher","first-page":"4271","DOI":"10.3390\/su13084271","volume":"13","author":"A Bastas","year":"2021","unstructured":"Bastas A (2021) Sustainable manufacturing technologies: a systematic review of latest trends and themes. Sustainability 13(8):4271. https:\/\/doi.org\/10.3390\/su13084271","journal-title":"Sustainability"},{"key":"539_CR26","doi-asserted-by":"publisher","unstructured":"Xing X, Chen T, Yang X, Jiang Z (2022) Factors affecting manufacturing enterprises\u2019 sustainable development performance \u2013 based on the fsQCA method. Pol J Environ Stud 32(1):353\u2013369. https:\/\/doi.org\/10.15244\/pjoes\/152989","DOI":"10.15244\/pjoes\/152989"},{"key":"539_CR27","doi-asserted-by":"publisher","unstructured":"Franciosi C, Voisin A, Miranda S, Riemma S, Iung B (2020) Measuring maintenance impacts on sustainability of manufacturing industries: from a systematic literature review to a framework proposal. J Clean Prod 260:121065. https:\/\/doi.org\/10.1016\/j.jclepro.2020.121065","DOI":"10.1016\/j.jclepro.2020.121065"},{"issue":"2","key":"539_CR28","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1108\/jqme-03-2019-0033","volume":"27","author":"C Franciosi","year":"2020","unstructured":"Franciosi C, Di Pasquale V, Iannone R, Miranda S (2020) Multi-stakeholder perspectives on indicators for sustainable maintenance performance in production contexts: an exploratory study. J Qual Maint Eng 27(2):308\u2013330. https:\/\/doi.org\/10.1108\/jqme-03-2019-0033","journal-title":"J Qual Maint Eng"},{"key":"539_CR29","doi-asserted-by":"publisher","unstructured":"Jasiulewicz-Kaczmarek M (2024) Maintenance 4.0 technologies for sustainable manufacturing. Appl Sci 14(16):7360. https:\/\/doi.org\/10.3390\/app14167360","DOI":"10.3390\/app14167360"},{"issue":"1","key":"539_CR30","doi-asserted-by":"publisher","first-page":"77","DOI":"10.3390\/encyclopedia3010006","volume":"3","author":"H Taherdoost","year":"2023","unstructured":"Taherdoost H, Madanchian M (2023) Multi-criteria decision making (MCDM) methods and concepts. Encyclopedia 3(1):77\u201387. https:\/\/doi.org\/10.3390\/encyclopedia3010006","journal-title":"Encyclopedia"},{"key":"539_CR31","doi-asserted-by":"crossref","unstructured":"Saaty TL (1980) The analytic hierarchy process McGraw Hill, New York. Agric Econ Rev 70:34","DOI":"10.21236\/ADA214804"},{"key":"539_CR32","unstructured":"Chang D-Y (1992) Extent analysis and synthetic decision. Optim Tech Appl 1(1):352\u2013355"},{"key":"539_CR33","doi-asserted-by":"crossref","unstructured":"Hwang C-L, Yoon K, Hwang C-L, Yoon K (1981) Methods for multiple attribute decision making. Multiple attribute decision making: methods and applications a state-of-the-art survey 58\u2013191","DOI":"10.1007\/978-3-642-48318-9_3"},{"issue":"3","key":"539_CR34","doi-asserted-by":"publisher","first-page":"439","DOI":"10.1016\/S0377-2217(96)00252-4","volume":"97","author":"A Karagiannidis","year":"1997","unstructured":"Karagiannidis A, Moussiopoulos N (1997) Application of ELECTRE III for the integrated management of municipal solid wastes in the Greater Athens Area. Eur J Oper Res 97(3):439\u2013449","journal-title":"Eur J Oper Res"},{"key":"539_CR35","unstructured":"Brans J-P, Nadeau R, Landry M (1982) L\u2019ing\u00e9nierie de la d\u00e9cision. Elaboration d\u2019instruments d\u2019aide \u00e0 la d\u00e9cision. La m\u00e9thode PROMETHEE. In l\u2019Aide \u00e0 la D\u00e9cision: Nature, Instruments et Perspectives d\u2019Avenir 183\u2013213"},{"key":"539_CR36","doi-asserted-by":"publisher","unstructured":"Ighravwe DE, Oke SA (2017) A multi-hierarchical framework for ranking maintenance sustainability strategies using PROMETHEE and fuzzy entropy methods. J Build Pathol Rehab 2(1). https:\/\/doi.org\/10.1007\/s41024-017-0028-7","DOI":"10.1007\/s41024-017-0028-7"},{"key":"539_CR37","doi-asserted-by":"crossref","unstructured":"Hendiani S, Liao H, Bagherpour M, Tvaronavi\u010dien\u0117 M, Banaitis A, Antucheviciene J (2020) Analyzing the status of sustainable development in the manufacturing sector using multi-expert multi-criteria fuzzy decision-making and integrated triple bottom lines. Int J Environ Res Public Health 17(11):3800","DOI":"10.3390\/ijerph17113800"},{"key":"539_CR38","doi-asserted-by":"publisher","unstructured":"Mainar-Toledo MD, G\u00f3mez Palmero M, D\u00edaz-Ram\u00edrez M, Mendioroz I, Zambrana-Vasquez D (2023) A multi-criteria approach to evaluate sustainability: a case study of the Navarrese wine sector. Energies 16(18):6589. https:\/\/doi.org\/10.3390\/en16186589","DOI":"10.3390\/en16186589"},{"key":"539_CR39","doi-asserted-by":"publisher","unstructured":"Agrawal N (2021) Multi-criteria decision-making toward supplier selection: exploration of PROMETHEE II method. Benchmarking Int J 29(7):2122\u20132146. https:\/\/doi.org\/10.1108\/bij-02-2021-0071","DOI":"10.1108\/bij-02-2021-0071"},{"issue":"8","key":"539_CR40","doi-asserted-by":"publisher","first-page":"1331","DOI":"10.3390\/sym13081331","volume":"13","author":"SS Goswami","year":"2021","unstructured":"Goswami SS, Behera DK, Afzal A, Razak Kaladgi A, Khan SA, Rajendran P, Subbiah R, Asif M (2021) Analysis of a robot selection problem using two newly developed hybrid MCDM models of TOPSIS-ARAS and COPRAS-ARAS. Symmetry 13(8):1331. https:\/\/doi.org\/10.3390\/sym13081331","journal-title":"Symmetry"},{"key":"539_CR41","doi-asserted-by":"publisher","unstructured":"Erol I, Ar IM, Peker I (2022) Scrutinizing blockchain applicability in sustainable supply chains through an integrated fuzzy multi-criteria decision making framework. Appl Soft Comput 116:108331. https:\/\/doi.org\/10.1016\/j.asoc.2021.108331","DOI":"10.1016\/j.asoc.2021.108331"},{"issue":"02","key":"539_CR42","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1142\/s0219622021300020","volume":"21","author":"R Pelissari","year":"2021","unstructured":"Pelissari R, Khan SA, Ben-Amor S (2021) Application of multi-criteria decision-making methods in sustainable manufacturing management: a systematic literature review and analysis of the prospects. Int J Inf Technol Decis Mak 21(02):493\u2013515. https:\/\/doi.org\/10.1142\/s0219622021300020","journal-title":"Int J Inf Technol Decis Mak"},{"key":"539_CR43","doi-asserted-by":"publisher","unstructured":"Yenugula M, Sahoo SK, Goswami SS (2024) Cloud computing for sustainable development: an analysis of environmental, economic and social benefits. J Future Sustain 4(1):59\u201366. https:\/\/doi.org\/10.5267\/j.jfs.2024.1.005","DOI":"10.5267\/j.jfs.2024.1.005"},{"key":"539_CR44","doi-asserted-by":"publisher","unstructured":"Sharma M, Sehrawat R (2020) A hybrid multi-criteria decision-making method for cloud adoption: evidence from the healthcare sector. Technol Soc 61:101258. https:\/\/doi.org\/10.1016\/j.techsoc.2020.101258","DOI":"10.1016\/j.techsoc.2020.101258"},{"key":"539_CR45","doi-asserted-by":"publisher","unstructured":"Cai Y, Jin F, Liu J, Zhou L, Tao Z (2023) A survey of collaborative decision-making: bibliometrics, preliminaries, methodologies, applications and future directions. Eng Appl Artif Intell 122:106064. https:\/\/doi.org\/10.1016\/j.engappai.2023.106064","DOI":"10.1016\/j.engappai.2023.106064"},{"issue":"25","key":"539_CR46","doi-asserted-by":"publisher","first-page":"37291","DOI":"10.1007\/s11356-021-17851-2","volume":"29","author":"A Afrasiabi","year":"2022","unstructured":"Afrasiabi A, Tavana M, Di Caprio D (2022) An extended hybrid fuzzy multi-criteria decision model for sustainable and resilient supplier selection. Environ Sci Pollut Res 29(25):37291\u201337314. https:\/\/doi.org\/10.1007\/s11356-021-17851-2","journal-title":"Environ Sci Pollut Res"},{"issue":"1\u20132","key":"539_CR47","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1007\/s10479-020-03856-6","volume":"308","author":"S Gupta","year":"2021","unstructured":"Gupta S, Modgil S, Bhattacharyya S, Bose I (2021) Artificial intelligence for decision support systems in the field of operations research: review and future scope of research. Ann Oper Res 308(1\u20132):215\u2013274. https:\/\/doi.org\/10.1007\/s10479-020-03856-6","journal-title":"Ann Oper Res"},{"key":"539_CR48","doi-asserted-by":"publisher","unstructured":"Alavi B, Tavana M, Mina H (2021) A dynamic decision support system for sustainable supplier selection in circular economy. Sustain Prod Consum 27:905\u2013920. https:\/\/doi.org\/10.1016\/j.spc.2021.02.015","DOI":"10.1016\/j.spc.2021.02.015"},{"key":"539_CR49","doi-asserted-by":"publisher","unstructured":"Mateen A, Nam SY, Haider MA, Hanan A (2021) A dynamic decision support system for selection of cloud storage provider. Appl Sci 11(23):11296. https:\/\/doi.org\/10.3390\/app112311296","DOI":"10.3390\/app112311296"},{"issue":"3","key":"539_CR50","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3697350","volume":"57","author":"Y Kalyani","year":"2024","unstructured":"Kalyani Y, Collier R (2024) The role of multi-agents in digital twin implementation: short survey. ACM Comput Surv 57(3):1\u201315. https:\/\/doi.org\/10.1145\/3697350","journal-title":"ACM Comput Surv"},{"key":"539_CR51","doi-asserted-by":"publisher","unstructured":"Tan L, Hai X, Ma K, Fan D, Qiu H, Feng Q (2023) Digital twin-enabled decision-making framework for multi-UAV mission planning: a multiagent deep reinforcement learning perspective. In: IECON 2023- 49th annual conference of the IEEE industrial electronics society, pp 1\u20136. IEEE, ???. https:\/\/doi.org\/10.1109\/iecon51785.2023.10312492http:\/\/dx.doi.org\/10.1109\/iecon51785.2023.10312492","DOI":"10.1109\/iecon51785.2023.10312492"},{"key":"539_CR52","doi-asserted-by":"publisher","unstructured":"Li YL, Tsang YP, Wu CH, Lee CKM (2024) A multi-agent digital twin\u2013enabled decision support system for sustainable and resilient supplier management. Comput Ind Eng 187:109838. https:\/\/doi.org\/10.1016\/j.cie.2023.109838","DOI":"10.1016\/j.cie.2023.109838"},{"key":"539_CR53","doi-asserted-by":"publisher","unstructured":"Abdelfattah S (2019) Intrinsically motivated multi-objective reinforcement learning. PhD thesis. https:\/\/doi.org\/10.26190\/UNSWORKS\/21416","DOI":"10.26190\/UNSWORKS\/21416"},{"key":"539_CR54","doi-asserted-by":"publisher","unstructured":"Mnih V, Kavukcuoglu K, Silver D, Graves A, Antonoglou I, Wierstra D, Riedmiller M (2013) Playing Atari with deep reinforcement learning. arXiv. https:\/\/doi.org\/10.48550\/ARXIV.1312.5602","DOI":"10.48550\/ARXIV.1312.5602"},{"key":"539_CR55","unstructured":"Tajmajer T (2017) Multi-objective deep q-learning with subsumption architecture. ArXiv arXiv:1704.06676"},{"key":"539_CR56","unstructured":"Sutton RS, Barto AG et al (1998) Introduction to reinforcement learning vol. 135. MIT press Cambridge, ???"},{"key":"539_CR57","doi-asserted-by":"publisher","unstructured":"Tajmajer T (2018) Modular multi-objective deep reinforcement learning with decision values. In: Proceedings of the 2018 federated conference on computer science and information systems. FedCSIS 2018, vol 15, pp 85\u201393. IEEE, ???. https:\/\/doi.org\/10.15439\/2018f231http:\/\/dx.doi.org\/10.15439\/2018F231","DOI":"10.15439\/2018f231"},{"key":"539_CR58","doi-asserted-by":"publisher","unstructured":"Mossalam H, Assael YM, Roijers DM, Whiteson S (2016) Multi-objective deep reinforcement learning. arXiv. https:\/\/doi.org\/10.48550\/ARXIV.1610.02707","DOI":"10.48550\/ARXIV.1610.02707"},{"key":"539_CR59","doi-asserted-by":"publisher","unstructured":"Yang R, Sun X, Narasimhan K (2019) A generalized algorithm for multi-objective reinforcement learning and policy adaptation. arXiv. https:\/\/doi.org\/10.48550\/ARXIV.1908.08342","DOI":"10.48550\/ARXIV.1908.08342"},{"key":"539_CR60","doi-asserted-by":"publisher","unstructured":"Zhou Z, Kearnes S, Li L, Zare RN, Riley P (2019) Optimization of molecules via deep reinforcement learning. Sci Reports 9(1). https:\/\/doi.org\/10.1038\/s41598-019-47148-x","DOI":"10.1038\/s41598-019-47148-x"},{"key":"539_CR61","doi-asserted-by":"publisher","unstructured":"Hasanvand S, Rafiei M, Gheisarnejad M, Khooban M-H (2020) Reliable power scheduling of an emission-free ship: multiobjective deep reinforcement learning. IEEE Trans Transp Electrification 6(2):832\u2013843. https:\/\/doi.org\/10.1109\/tte.2020.2983247","DOI":"10.1109\/tte.2020.2983247"},{"key":"539_CR62","unstructured":"Xu J, Tian Y, Ma P, Rus D, Sueda S, Matusik W (2020) Prediction-guided multi-objective reinforcement learning for continuous robot control. In: International conference on machine learning. https:\/\/api.semanticscholar.org\/CorpusID:220444563"},{"key":"539_CR63","doi-asserted-by":"publisher","unstructured":"Nguyen T.T, Nguyen N.D, Vamplew P, Nahavandi S, Dazeley R, Lim CP (2020) A multi-objective deep reinforcement learning framework. Eng Appl Artif Intell 96:103915. https:\/\/doi.org\/10.1016\/j.engappai.2020.103915","DOI":"10.1016\/j.engappai.2020.103915"},{"key":"539_CR64","doi-asserted-by":"publisher","unstructured":"Oliveira THFd, Medeiros LPdS, Neto ADD, Melo JD (2021) Q-managed: a new algorithm for a multiobjective reinforcement learning. Expert Syst Appl 168:114228. https:\/\/doi.org\/10.1016\/j.eswa.2020.114228","DOI":"10.1016\/j.eswa.2020.114228"},{"key":"539_CR65","doi-asserted-by":"publisher","DOI":"10.1007\/s10845-023-02208-y","author":"L Zhang","year":"2023","unstructured":"Zhang L, Yan Y, Hu Y (2023) Deep reinforcement learning for dynamic scheduling of energy-efficient automated guided vehicles. Journal of Intelligent Manufacturing. https:\/\/doi.org\/10.1007\/s10845-023-02208-y","journal-title":"Journal of Intelligent Manufacturing"},{"key":"539_CR66","doi-asserted-by":"publisher","unstructured":"Wu JJ, Song DF, Zhang XM, Duan CS, Yang DP (2023) Multi-objective reinforcement learning-based energy management for fuel cell vehicles considering lifecycle costs. Int J Hydrog Energy 48(95):37385\u201337401. https:\/\/doi.org\/10.1016\/j.ijhydene.2023.06.145","DOI":"10.1016\/j.ijhydene.2023.06.145"},{"key":"539_CR67","doi-asserted-by":"publisher","unstructured":"Seurin P, Shirvan K (2024) Multi-objective reinforcement learning-based approach for pressurized water reactor optimization. Ann Nucl Energy 205:110582. https:\/\/doi.org\/10.1016\/j.anucene.2024.110582","DOI":"10.1016\/j.anucene.2024.110582"},{"key":"539_CR68","doi-asserted-by":"publisher","unstructured":"Anbarkhan SH (2023) A fuzzy-TOPSIS-based approach to assessing sustainability in software engineering: an Industry 5.0 perspective. Sustainability 15(18):13844. https:\/\/doi.org\/10.3390\/su151813844","DOI":"10.3390\/su151813844"},{"issue":"1\u20132","key":"539_CR69","doi-asserted-by":"publisher","first-page":"1","DOI":"10.5937\/jouproman2301001s","volume":"11","author":"S Sahoo","year":"2023","unstructured":"Sahoo S, Das A, Samanta S, Goswami S (2023) Assessing the role of sustainable development in mitigating the issue of global warming. J Process Manage New Technol 11(1\u20132):1\u201321. https:\/\/doi.org\/10.5937\/jouproman2301001s","journal-title":"J Process Manage New Technol"},{"key":"539_CR70","doi-asserted-by":"publisher","unstructured":"Hosouli S, Elvins J, Searle J, Boudjabeur S, Bowyer J, Jewell E (2023) A multi-criteria decision making (MCDM) methodology for high temperature thermochemical storage material selection using graph theory and matrix approach. Materials Des 227:111685. https:\/\/doi.org\/10.1016\/j.matdes.2023.111685","DOI":"10.1016\/j.matdes.2023.111685"},{"key":"539_CR71","doi-asserted-by":"publisher","unstructured":"Agyekum EB, Amjad F, Mohsin M, Ansah MNS (2021) A bird\u2019s eye view of Ghana\u2019s renewable energy sector environment: a multi-criteria decision-making approach. Utilities Pol 70:101219. https:\/\/doi.org\/10.1016\/j.jup.2021.101219","DOI":"10.1016\/j.jup.2021.101219"},{"issue":"3","key":"539_CR72","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1108\/ijqrm-04-2021-0105","volume":"39","author":"A Patil","year":"2021","unstructured":"Patil A, Soni G, Prakash A, Karwasra K (2021) Maintenance strategy selection: a comprehensive review of current paradigms and solution approaches. Int J Qual Reliab Manage 39(3):675\u2013703. https:\/\/doi.org\/10.1108\/ijqrm-04-2021-0105","journal-title":"Int J Qual Reliab Manage"},{"key":"539_CR73","doi-asserted-by":"publisher","unstructured":"Jun Yi\u00a0Tey D, Fei\u00a0Gan Y, Selvachandran G, Gai\u00a0Quek S, Smarandache F, Hoang\u00a0Son L, Abdel-Basset M, Viet\u00a0Long H (2019) A novel neutrosophic data analytic hierarchy process for multi-criteria decision making method: a case study in Kuala Lumpur stock exchange. IEEE Access 7:53687\u201353697. https:\/\/doi.org\/10.1109\/access.2019.2912913","DOI":"10.1109\/access.2019.2912913"},{"key":"539_CR74","doi-asserted-by":"publisher","unstructured":"Goulart\u00a0Coelho LM, Lange LC, Coelho HM (2016) Multi-criteria decision making to support waste management: a critical review of current practices and methods. Waste Manage Res J Sustain Circular Econ 35(1):3\u201328. https:\/\/doi.org\/10.1177\/0734242x16664024","DOI":"10.1177\/0734242x16664024"},{"key":"539_CR75","doi-asserted-by":"publisher","unstructured":"Dhiman R, Kalbar P, Inamdar AB (2018) GIS coupled multiple criteria decision making approach for classifying urban coastal areas in India. Habitat Int 71:125\u2013134. https:\/\/doi.org\/10.1016\/j.habitatint.2017.12.002","DOI":"10.1016\/j.habitatint.2017.12.002"},{"key":"539_CR76","doi-asserted-by":"publisher","unstructured":"Nguyen NBT, Lin G-H, Dang T-T (2021) Fuzzy multi-criteria decision-making approach for online food delivery (OFD) companies evaluation and selection: a case study in Vietnam. Processes 9(8):1274. https:\/\/doi.org\/10.3390\/pr9081274","DOI":"10.3390\/pr9081274"},{"key":"539_CR77","doi-asserted-by":"publisher","unstructured":"Goswami SS, Jena S, Behera DK (2022) Selecting the best AISI steel grades and their proper heat treatment process by integrated entropy-TOPSIS decision making techniques. Materials Today Proc 60:1130\u20131139. https:\/\/doi.org\/10.1016\/j.matpr.2022.02.286","DOI":"10.1016\/j.matpr.2022.02.286"},{"key":"539_CR78","doi-asserted-by":"publisher","unstructured":"Hayes CF, R\u0103dulescu R, Bargiacchi E, K\u00e4llstr\u00f6m J, Macfarlane M, Reymond M, Verstraeten T, Zintgraf LM, Dazeley R, Heintz F, Howley E, Irissappane AA, Mannion P, Now\u00e9 A, Ramos G, Restelli M, Vamplew P, Roijers DM (2022) A practical guide to multi-objective reinforcement learning and planning. Autonomous Agents Multi-Agent Syst 36(1). https:\/\/doi.org\/10.1007\/s10458-022-09552-y","DOI":"10.1007\/s10458-022-09552-y"},{"key":"539_CR79","unstructured":"Van\u00a0Moffaert K (2016) Multi-criteria reinforcement learning for sequential decision-making problems. PhD thesis, Vrije Universiteit, Brussel"},{"key":"539_CR80","unstructured":"Ruksha K (2025) Why AI development is different: the role of experimentation in data science. https:\/\/medium.com\/godel-technologies\/why-ai-development-is-different-the-role-of-experimentation-in-data-science-7ce20339f006. Accessed 26 Feb 2025"},{"key":"539_CR81","unstructured":"Hasselt H (2010) Double q-learning. In: Lafferty J, Williams C, Shawe-Taylor J, Zemel R, Culotta A (eds) Advances in neural information processing systems, vol 23. Curran Associates, Inc., ???"},{"key":"539_CR82","unstructured":"Paszke A, Gross S, Chintala S, Chanan G, Yang E, DeVito Z, Lin Z, Desmaison A, Antiga L, Lerer A (2017) Automatic differentiation in pytorch. In: NIPS 2017 Workshop on Autodiff. https:\/\/openreview.net\/forum?id=BJJsrmfCZ"},{"key":"539_CR83","doi-asserted-by":"publisher","unstructured":"Lin L-J (1992) Self-improving reactive agents based on reinforcement learning, planning and teaching. Mach Learn 8(3\u20134):293\u2013321. https:\/\/doi.org\/10.1007\/bf00992699","DOI":"10.1007\/bf00992699"},{"key":"539_CR84","unstructured":"Alegre LN, Felten F, Talbi E-G, Danoy G, Now\u00e9 A, Bazzan AL, Silva BC (2022) MO-Gym: a library of multi-objective reinforcement learning environments. In: Proceedings of the 34th benelux conference on artificial intelligence BNAIC\/Benelearn"},{"key":"539_CR85","doi-asserted-by":"publisher","unstructured":"Brockman G, Cheung V, Pettersson L, Schneider J, Schulman J, Tang J, Zaremba W (2016) OpenAI Gym. arXiv. https:\/\/doi.org\/10.48550\/ARXIV.1606.01540","DOI":"10.48550\/ARXIV.1606.01540"}],"container-title":["Operations Research Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43069-025-00539-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s43069-025-00539-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43069-025-00539-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,10]],"date-time":"2025-12-10T16:08:06Z","timestamp":1765382886000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s43069-025-00539-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,23]]},"references-count":85,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,9]]}},"alternative-id":["539"],"URL":"https:\/\/doi.org\/10.1007\/s43069-025-00539-5","relation":{},"ISSN":["2662-2556"],"issn-type":[{"value":"2662-2556","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,23]]},"assertion":[{"value":"3 October 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 August 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 August 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"Not applicable","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Participate"}},{"value":"Not applicable","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for Publication"}},{"value":"The authors declare no competing interests.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}}],"article-number":"124"}}