{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T07:11:21Z","timestamp":1777705881642,"version":"3.51.4"},"reference-count":49,"publisher":"SAGE Publications","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IFS"],"published-print":{"date-parts":[[2023,6,1]]},"abstract":"<jats:p>Energy-aware scheduling has been viewed as a feasible way to reduce energy consumption during the production process. Recently, energy-aware job shop scheduling problems (EAJSPs) have received wide attention in the manufacturing area. However, the majority of previous literature about EAJSPs supposed that all jobs are fabricated in the in-house workshop, while the outsourcing of jobs to some available subcontractors is neglected. To get close to practical production, the outsourcing and scheduling are simultaneously determined in an energy-aware job shop problem with outsourcing option (EAJSP-OO). To formulate the considered problem, a novel mathematical model is constructed to minimize the sum of completion time cost, outsourcing cost and energy consumption cost. Considering the strong complexity, a self-learning interior search algorithm (SLISA) is developed based on reinforcement learning. In the SLISA, a new Q-learning algorithm is embedded to dynamically select search strategies to prevent blind search in the iteration process. Extensive experiments are carried out to evaluate the performance of the proposed algorithm. Simulation results indicate that the SLISA is superior to the compared existing algorithms in more than 50% of the instances of the considered EAFJSP-OO problem.<\/jats:p>","DOI":"10.3233\/jifs-224624","type":"journal-article","created":{"date-parts":[[2023,4,4]],"date-time":"2023-04-04T11:50:48Z","timestamp":1680609048000},"page":"10085-10100","source":"Crossref","is-referenced-by-count":8,"title":["A self-learning interior search algorithm based on reinforcement learning for energy-aware job shop scheduling problem with outsourcing option"],"prefix":"10.1177","volume":"44","author":[{"given":"Xinyu","family":"Liu","sequence":"first","affiliation":[{"name":"School of Vehicle Application Engineering, Yantai Automobile Engineering Professional College, Yantai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lu","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Transportation, Ludong University, Yantai, Shandong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tianhua","family":"Jiang","sequence":"additional","affiliation":[{"name":"School of Transportation, Ludong University, Yantai, Shandong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"issue":"2022","key":"10.3233\/JIFS-224624_ref1","first-page":"100680","article-title":"Energy-conscious flexible job shop scheduling problem considering transportationtime and deterioration effect simultaneously","volume":"35","author":"Jiang","journal-title":"Sustainable Computing: Informatics and Systems"},{"issue":"7","key":"10.3233\/JIFS-224624_ref2","doi-asserted-by":"crossref","first-page":"306","DOI":"10.3390\/axioms11070306","article-title":"A new interior search algorithm for energy-saving flexible job shop scheduling with overlapping operations and transportation times","volume":"11","author":"Liu","year":"2022","journal-title":"Axioms"},{"key":"10.3233\/JIFS-224624_ref3","doi-asserted-by":"crossref","first-page":"126121","DOI":"10.1016\/j.jclepro.2021.126121","article-title":"Energy-efficient scheduling for a permutation flow shop with variable transportation time using an improved discrete whale swarm optimization","volume":"293","author":"Xin","year":"2021","journal-title":"Journal of Cleaner Production"},{"key":"10.3233\/JIFS-224624_ref4","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.jclepro.2017.01.011","article-title":"Energy-efficient permutation flow shop scheduling problem using a hybrid multi-objective backtracking search algorithm","volume":"144","author":"Lu","year":"2017","journal-title":"Journal of Cleaner Production"},{"key":"10.3233\/JIFS-224624_ref6","doi-asserted-by":"crossref","first-page":"106032","DOI":"10.1016\/j.knosys.2020.106032","article-title":"An improved Jaya algorithm for solving the flexible job shop scheduling problem with transportation and setup times","volume":"200","author":"Li","year":"2020","journal-title":"Knowledge-Based Systems"},{"key":"10.3233\/JIFS-224624_ref7","doi-asserted-by":"crossref","first-page":"765","DOI":"10.1016\/j.jclepro.2018.11.231","article-title":"Integrated green scheduling optimization of flexible job shop and crane transportation considering comprehensive energy consumption","volume":"211","author":"Liu","year":"2019","journal-title":"Journal of Cleaner Production"},{"key":"10.3233\/JIFS-224624_ref8","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.rcim.2019.04.006","article-title":"Multi-objective optimization for energy-efficient flexible job shop scheduling problem with transportation constraints","volume":"59","author":"Dai","year":"2019","journal-title":"Robotics and Computer-Integrated Manufacturing"},{"issue":"10","key":"10.3233\/JIFS-224624_ref9","first-page":"1667","article-title":"A novel heuristic method for the energy-efficient flexible job-shop scheduling problem with sequence-dependent set-up and transportation time","volume":"54","author":"Zhang","year":"1646","journal-title":"Engineering Optimization"},{"key":"10.3233\/JIFS-224624_ref10","doi-asserted-by":"crossref","first-page":"104307","DOI":"10.1016\/j.engappai.2021.104307","article-title":"An imperialist competitive algorithm with feedback for energy-efficient flexible job shop scheduling with transportation and sequence-dependent setup times","volume":"103","author":"Li","year":"2021","journal-title":"Engineering Applications of Artificial Intelligence"},{"issue":"9","key":"10.3233\/JIFS-224624_ref11","doi-asserted-by":"crossref","first-page":"1315","DOI":"10.1007\/s11573-020-00971-5","article-title":"Multi-objective hybrid flow shop scheduling with variable discrete production speed levels and time-of-use energy prices","volume":"90","author":"Schulz","year":"2020","journal-title":"Journal of Business Economics"},{"key":"10.3233\/JIFS-224624_ref12","doi-asserted-by":"crossref","first-page":"1365","DOI":"10.1016\/j.jclepro.2019.06.151","article-title":"Energy-efficient scheduling for multi-objective flexible job shops with variable processing speeds by grey wolf optimization","volume":"234","author":"Luo","year":"2019","journal-title":"Journal of Cleaner Production"},{"key":"10.3233\/JIFS-224624_ref13","doi-asserted-by":"crossref","first-page":"106544","DOI":"10.1016\/j.asoc.2020.106544","article-title":"An improved artificial bee colony algorithm for solving multi-objective low-carbon flexible job shop scheduling problem","volume":"95","author":"Li","year":"2020","journal-title":"Applied Soft Computing"},{"key":"10.3233\/JIFS-224624_ref14","doi-asserted-by":"crossref","first-page":"116785","DOI":"10.1016\/j.eswa.2022.116785","article-title":"Hybrid energy-efficient scheduling measures for flexible job-shop problem with variable machining speeds","volume":"197","author":"Wei","year":"2022","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/JIFS-224624_ref15","doi-asserted-by":"crossref","first-page":"3361","DOI":"10.1016\/j.jclepro.2015.09.097","article-title":"Solving the energy-efficient job shop scheduling problem: A multi-objective genetic algorithm with enhanced local search for minimizing the total weighted tardiness and total energy consumption","volume":"112","author":"Zhang","year":"2016","journal-title":"Journal of Cleaner Production"},{"issue":"5","key":"10.3233\/JIFS-224624_ref16","doi-asserted-by":"crossref","first-page":"1303","DOI":"10.1007\/s00170-015-7987-0","article-title":"A genetic algorithm for energy-efficiency in job-shop scheduling","volume":"85","author":"Salido","year":"2016","journal-title":"The International Journal of Advanced Manufacturing Technology"},{"issue":"4","key":"10.3233\/JIFS-224624_ref17","doi-asserted-by":"crossref","DOI":"10.1177\/1687814017695959","article-title":"Energy-efficient job shop scheduling problem with variable spindle speed using a novel multi-objective algorithm","volume":"9","author":"Yin","year":"2017","journal-title":"Advances in Mechanical Engineering"},{"issue":"6","key":"10.3233\/JIFS-224624_ref18","doi-asserted-by":"crossref","first-page":"10617","DOI":"10.3233\/JIFS-201522","article-title":"Multi-objective discrete water wave optimization algorithm for solving the energy-saving job shop scheduling problem with variable processing speeds","volume":"40","author":"Zhu","year":"2021","journal-title":"Journal of Intelligent & Fuzzy Systems"},{"key":"10.3233\/JIFS-224624_ref19","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1016\/j.cie.2019.06.048","article-title":"The flexible job-shop scheduling problem considering deterioration effect and energy consumption simultaneously","volume":"135","author":"Wu","year":"2019","journal-title":"Computers & Industrial Engineering"},{"key":"10.3233\/JIFS-224624_ref20","doi-asserted-by":"crossref","first-page":"113348","DOI":"10.1016\/j.eswa.2020.113348","article-title":"A multi-population, multi-objective memetic algorithm for energy-efficient job-shop scheduling with deteriorating machines","volume":"157","author":"Abedi","year":"2020","journal-title":"Expert Systems with Applications"},{"issue":"1","key":"10.3233\/JIFS-224624_ref21","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1049\/iet-cim.2019.0056","article-title":"NSGA-III for solving dynamic flexible job shop scheduling problem considering deterioration effect","volume":"2","author":"Wu","year":"2020","journal-title":"IET Collaborative Intelligent Manufacturing"},{"issue":"1-2","key":"10.3233\/JIFS-224624_ref22","doi-asserted-by":"crossref","first-page":"813","DOI":"10.1007\/s10479-018-2969-x","article-title":"Multi-objective genetic algorithm for energy-efficient hybrid flow shop scheduling with lot streaming","volume":"290","author":"Tzu-Li","year":"2020","journal-title":"Annals of Operations Research"},{"issue":"1","key":"10.3233\/JIFS-224624_ref23","doi-asserted-by":"crossref","first-page":"813","DOI":"10.1007\/s10479-018-2969-x","article-title":"Multi-objective genetic algorithm for energy-efficient hybrid flow shop scheduling with lot streaming","volume":"290","author":"Chen","year":"2020","journal-title":"Annals of Operations Research"},{"issue":"6","key":"10.3233\/JIFS-224624_ref25","doi-asserted-by":"crossref","first-page":"1725","DOI":"10.1007\/s10845-020-01713-8","article-title":"Research on flexible job-shop scheduling problem in green sustainable manufacturing based on learning effect","volume":"33","author":"Peng","year":"2022","journal-title":"Journal of Intelligent Manufacturing"},{"issue":"2","key":"10.3233\/JIFS-224624_ref26","doi-asserted-by":"crossref","first-page":"44","DOI":"10.3390\/a13020044","article-title":"Modified migrating birds optimization for energy-aware flexible job shop scheduling problem","volume":"13","author":"Li","year":"2020","journal-title":"Algorithms"},{"issue":"4","key":"10.3233\/JIFS-224624_ref27","doi-asserted-by":"crossref","first-page":"3431","DOI":"10.3233\/JIFS-211399","article-title":"A discrete animal migration algorithm for dual-resource constrained energy-saving flexible job shop scheduling problem","volume":"42","author":"Jiang","year":"2022","journal-title":"Journal of Intelligent & Fuzzy Systems"},{"key":"10.3233\/JIFS-224624_ref28","doi-asserted-by":"crossref","first-page":"107430","DOI":"10.1016\/j.knosys.2021.107430","article-title":"A non-dominated ensemble fitness ranking algorithm for multi-objective flexible job-shop scheduling problem considering worker flexibility and green factors","volume":"231","author":"Gong","year":"2021","journal-title":"Knowledge-Based Systems"},{"issue":"1","key":"10.3233\/JIFS-224624_ref29","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1007\/s40747-020-00193-w","article-title":"Discrete imperialist competitive algorithm for the resource-constrained hybrid flowshop problem with energy consumption","volume":"7","author":"Tao","year":"2021","journal-title":"Complex & Intelligent Systems"},{"issue":"1","key":"10.3233\/JIFS-224624_ref30","doi-asserted-by":"crossref","first-page":"409","DOI":"10.3233\/JIFS-212258","article-title":"Energy-efficient scheduling for flexible job shop under multi-resource constraints using non-dominated sorting teaching-learning-based optimization algorithm","volume":"43","author":"Wang","year":"2022","journal-title":"Journal of Intelligent & Fuzzy Systems"},{"key":"10.3233\/JIFS-224624_ref31","doi-asserted-by":"crossref","first-page":"112902","DOI":"10.1016\/j.eswa.2019.112902","article-title":"Energy-efficient flexible flow shop scheduling with worker flexibility","volume":"141","author":"Gong","year":"2020","journal-title":"Expert Systems with Applications"},{"issue":"4","key":"10.3233\/JIFS-224624_ref32","doi-asserted-by":"crossref","first-page":"2863","DOI":"10.1007\/s00500-020-05347-z","article-title":"A novel multi-objective optimization algorithm for the integrated scheduling of flexible job shops considering preventive maintenance activities and transportation processes","volume":"25","author":"Wang","year":"2021","journal-title":"Soft Computing"},{"key":"10.3233\/JIFS-224624_ref33","doi-asserted-by":"crossref","first-page":"104359","DOI":"10.1016\/j.engappai.2021.104359","article-title":"Energy-efficient production scheduling through machine on\/off control during preventive maintenance","volume":"104","author":"Gong","year":"2021","journal-title":"Engineering Applications of Artificial Intelligence"},{"key":"10.3233\/JIFS-224624_ref34","doi-asserted-by":"crossref","first-page":"118869","DOI":"10.1016\/j.jclepro.2019.118869","article-title":"Bi-objective optimization approach for energy aware scheduling considering electricity cost and preventive maintenance using genetic algorithm","volume":"244","author":"Sin","year":"2020","journal-title":"Journal of Cleaner Production"},{"issue":"6","key":"10.3233\/JIFS-224624_ref35","doi-asserted-by":"crossref","first-page":"8089","DOI":"10.3233\/JIFS-220494","article-title":"A novel discrete elephant herding optimization for energy-saving flexible job shop scheduling problem with preventive maintenance","volume":"43","author":"Liu","year":"2022","journal-title":"Journal of Intelligent & Fuzzy Systems"},{"issue":"2","key":"10.3233\/JIFS-224624_ref36","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1016\/j.ijpe.2007.02.036","article-title":"Single machine scheduling with outsourcing allowed","volume":"111","author":"Lee","year":"2008","journal-title":"International Journal of Production Economics"},{"issue":"01","key":"10.3233\/JIFS-224624_ref37","doi-asserted-by":"crossref","first-page":"1950033","DOI":"10.1142\/S0217595919500337","article-title":"Single machine scheduling with outsourcing under different fill rates or quantity discount rates","volume":"37","author":"Lu","year":"2020","journal-title":"Asia-Pacific Journal of Operational Research"},{"issue":"3","key":"10.3233\/JIFS-224624_ref38","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1007\/s10845-013-0811-5","article-title":"An ant colony optimization approach for the parallel machine scheduling problem with outsourcing allowed","volume":"26","author":"Tavares Neto","year":"2015","journal-title":"Journal of Intelligent Manufacturing"},{"issue":"1","key":"10.3233\/JIFS-224624_ref39","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.ejor.2011.03.017","article-title":"Two-machine flow shop scheduling problem with an outsourcing option","volume":"213","author":"Choi","year":"2011","journal-title":"European Journal of Operational Research"},{"issue":"9","key":"10.3233\/JIFS-224624_ref40","doi-asserted-by":"crossref","first-page":"1286","DOI":"10.1016\/j.cor.2010.11.010","article-title":"An ant colony optimization approach to a permutational flowshop scheduling problem with outsourcing allowed","volume":"38","author":"Neto","year":"2011","journal-title":"Computers & Operations Research"},{"issue":"1","key":"10.3233\/JIFS-224624_ref41","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1080\/21693277.2019.1620651","article-title":"A robust just-in-time flow shop scheduling problem with outsourcing option on subcontractors","volume":"7","author":"Goli","year":"2019","journal-title":"Production & Manufacturing Research"},{"key":"10.3233\/JIFS-224624_ref42","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.cie.2019.02.015","article-title":"Outsourcing and rescheduling for a two-machine flow shop with the disruption of new arriving jobs: A hybrid variable neighborhood search algorithm","volume":"130","author":"Liu","year":"2019","journal-title":"Computers & Industrial Engineering"},{"issue":"16","key":"10.3233\/JIFS-224624_ref43","doi-asserted-by":"crossref","first-page":"4793","DOI":"10.1080\/00207543.2015.1088970","article-title":"A shuffled frog-leaping algorithm for job shop scheduling with outsourcing options","volume":"54","author":"Lei","year":"2016","journal-title":"International Journal of Production Research"},{"issue":"13","key":"10.3233\/JIFS-224624_ref44","doi-asserted-by":"crossref","first-page":"3832","DOI":"10.1080\/00207543.2013.848488","article-title":"Bi-objective job shop scheduling with outsourcing options","volume":"52","author":"Guo","year":"2014","journal-title":"International Journal of Production Research"},{"key":"10.3233\/JIFS-224624_ref45","doi-asserted-by":"crossref","first-page":"117182","DOI":"10.1016\/j.eswa.2022.117182","article-title":"A hybrid differential evolution algorithm for flexible job shop scheduling with outsourcing operations and job priority constraints","volume":"201","author":"Li","year":"2022","journal-title":"Expert Systems with Applications"},{"issue":"11","key":"10.3233\/JIFS-224624_ref46","doi-asserted-by":"crossref","first-page":"2772","DOI":"10.1109\/TFUZZ.2020.2998174","article-title":"Fuzzy mathematical programming and self-adaptive artificial fish swarm algorithm for just-in-time energy-aware flow shop scheduling problem with outsourcing option","volume":"28","author":"Tirkolaee","year":"2020","journal-title":"IEEE Transactions on Fuzzy Systems"},{"issue":"4","key":"10.3233\/JIFS-224624_ref47","doi-asserted-by":"crossref","first-page":"1168","DOI":"10.1016\/j.isatra.2014.03.018","article-title":"Interior search algorithm (ISA): a novel approach for global optimization","volume":"53","author":"Gandomi","year":"2014","journal-title":"ISA Transactions"},{"key":"10.3233\/JIFS-224624_ref48","doi-asserted-by":"crossref","unstructured":"Cai J. , Lei D. , Wang J. , et al. A novel shuffled frog-leaping algorithm with reinforcement learning for distributed assembly hybrid flow shop scheduling, International Journal of Production Research 61(4) (2023), 1233\u20131251.","DOI":"10.1080\/00207543.2022.2031331"},{"issue":"4","key":"10.3233\/JIFS-224624_ref50","doi-asserted-by":"crossref","first-page":"e6658","DOI":"10.1002\/cpe.6658","article-title":"A self-learning artificial bee colony algorithm based on reinforcement learning for a flexible job-shop scheduling problem","volume":"34","author":"Long","year":"2022","journal-title":"Concurrency and Computation: Practice and Experience"},{"issue":"2","key":"10.3233\/JIFS-224624_ref51","doi-asserted-by":"crossref","first-page":"113","DOI":"10.23919\/CSMS.2022.0002","article-title":"Q-Learning-based teaching-learning optimization for distributed two-stage hybrid flow shop scheduling with fuzzy processing time","volume":"2","author":"Xi","year":"2022","journal-title":"Complex System Modeling and Simulation"},{"key":"10.3233\/JIFS-224624_ref53","doi-asserted-by":"crossref","first-page":"107645","DOI":"10.1016\/j.knosys.2021.107645","article-title":"A reinforcement learning brain storm optimization algorithm (BSO) with learning mechanism","volume":"235","author":"Zhao","year":"2022","journal-title":"Knowledge-Based Systems"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/JIFS-224624","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:45:30Z","timestamp":1777455930000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/JIFS-224624"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,1]]},"references-count":49,"journal-issue":{"issue":"6"},"URL":"https:\/\/doi.org\/10.3233\/jifs-224624","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,1]]}}}