{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T20:43:06Z","timestamp":1760647386894,"version":"build-2065373602"},"reference-count":90,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,1,14]],"date-time":"2021-01-14T00:00:00Z","timestamp":1610582400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"partially funded by the German University of Jordan, the Graduate School of Logistics in Dortmund (Germany) and by thyssenkrupp Materials International GmbH","award":["PhD Grant"],"award-info":[{"award-number":["PhD Grant"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>The distribution process in business-to-business materials trading is among the most complex and in transparent ones within logistics. The highly volatile environment requires continuous adaptations by the responsible decision-makers, who face a substantial number of potential improvement actions with conflicting goals, such as simultaneously maintaining a high service level and low costs. Simulation-optimisation approaches have been proposed in this context, for example based on evolutionary algorithms. But, on real-world system dimensions, they face impractically long computation times. This paper addresses this challenge in two principal streams. On the one hand, reinforcement learning is investigated to reduce the response time of the system in a concrete decision situation. On the other hand, domain-specific information and defining equivalent solutions are exploited to support a metaheuristic algorithm. For these approaches, we have developed suitable implementations and evaluated them with subsets of real-world data. The results demonstrate that reinforcement learning exploits the idle time between decision situations to learn which decisions might be most promising, thus adding computation time but significantly reducing the response time. Using domain-specific information reduces the number of required simulation runs and guides the search for promising actions. In our experimentation, defining equivalent solutions decreased the number of required simulation runs up to 15%.<\/jats:p>","DOI":"10.3390\/a14010023","type":"journal-article","created":{"date-parts":[[2021,1,14]],"date-time":"2021-01-14T11:39:14Z","timestamp":1610624354000},"page":"23","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Simheuristics Approaches for Efficient Decision-Making Support in Materials Trading Networks"],"prefix":"10.3390","volume":"14","author":[{"given":"Markus","family":"Rabe","sequence":"first","affiliation":[{"name":"IT in Production and Logistics, Faculty of Mechanical Engineering, TU Dortmund, 44227 Dortmund, Germany"}]},{"given":"Majsa","family":"Ammouriova","sequence":"additional","affiliation":[{"name":"IT in Production and Logistics, Faculty of Mechanical Engineering, TU Dortmund, 44227 Dortmund, Germany"}]},{"given":"Dominik","family":"Schmitt","sequence":"additional","affiliation":[{"name":"IT in Production and Logistics, Faculty of Mechanical Engineering, TU Dortmund, 44227 Dortmund, Germany"}]},{"given":"Felix","family":"Dross","sequence":"additional","affiliation":[{"name":"IT in Production and Logistics, Faculty of Mechanical Engineering, TU Dortmund, 44227 Dortmund, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Stadtler, H., and Kilger, C. (2008). Supply Chain Management\u2014An Overview. Supply Chain Management and Advanced Planning: Concepts, Models, Software, and Case Studies, Springer.","DOI":"10.1007\/978-3-540-74512-9"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ravindran, A.R. (2016). Managing Supply Chains: An Introduction. Multiple Criteria Decision Making in Supply Chain Management, CRC Press, Taylor and Francis Group.","DOI":"10.1201\/b20114"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Stadtler, H., and Kilger, C. (2008). Supply Chain Analysis. Supply Chain Management and Advanced Planning: Concepts, Models, Software, and Case Studies, Springer.","DOI":"10.1007\/978-3-540-74512-9"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Mart\u00ed, R., Pardalos, P.M., and Resende, M.G.C. (2018). Network Optimization. Handbook of Heuristics, Springer.","DOI":"10.1007\/978-3-319-07124-4"},{"key":"ref_5","unstructured":"Law, A.M. (2015). Simulation Modeling and Analysis, McGraw-Hill. [5th ed.]."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1007\/s11047-008-9098-4","article-title":"A Survey on Metaheuristics for Stochastic Combinatorial Optimization","volume":"8","author":"Bianchi","year":"2009","journal-title":"Nat. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Talbi, E.G. (2009). Metaheuristics: From Design to Implementation, John Wiley and Sons.","DOI":"10.1002\/9780470496916"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Datta, S., and Davim, J.P. (2019). Optimization Techniques: An Overview. Optimization in Industry: Present Practices and Future Scopes, Springer International Publishing. Management and Industrial Engineering.","DOI":"10.1007\/978-3-030-01641-8"},{"key":"ref_9","first-page":"62","article-title":"A Review of Simheuristics: Extending Metaheuristics to Deal with Stochastic Combinatorial Optimization Problems","volume":"2","author":"Juan","year":"2015","journal-title":"Oper. Res. Perspect."},{"key":"ref_10","unstructured":"Banks, J., Carson, J.S., Nelson, B.L., and Nicol, D.M. (2010). Discrete-Event System Simulation, Pearson. [5th ed.]."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1080\/00207540802426540","article-title":"Stochastic Multi-objective Production-distribution Network Design Using Simulation-based Optimization","volume":"47","author":"Ding","year":"2009","journal-title":"Int. J. Prod. Res."},{"key":"ref_12","unstructured":"Deininger, M. (2019). Modellierungsmethode f\u00fcr die Simulationsbasierte Optimierung Rekonfigurierbarer Produktionssysteme, Fortschritte in der IT in Produktion und Logistik, Cuvillier."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Mart\u00ed, R., Pardalos, P.M., and Resende, M.G.C. (2018). Guided Local Search. Handbook of Heuristics, Springer.","DOI":"10.1007\/978-3-319-07124-4"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1613\/jair.859","article-title":"Optimizing Dialogue Management with Reinforcement Learning: Experiments with the NJFun System","volume":"16","author":"Singh","year":"2002","journal-title":"J. Artif. Intell. Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level Control through Deep Reinforcement Learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_16","unstructured":"Wenzel, S., and Peter, T. (2017). Decision Support for Logistics Networks in Materials Trading Using a Simheuristic Framework and User-generated Action Types. Simulation in Production and Logistics 2017, Kassel University Press."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Rabe, M., Schmitt, D., and Ammouriova, M. (2018, January 9\u201312). Improving the Performance of a Logistics Assistance System for Materials Trading Networks by Grouping Similar Actions. Proceedings of the 2018 Winter Simulation Conference, Gothenburg, Sweden.","DOI":"10.1109\/WSC.2018.8632225"},{"key":"ref_18","unstructured":"(2014). VDI-Guideline 3633.1. Simulation of Systems in Materials Handling, Logistics, and Production: Fundamentals, Beuth."},{"key":"ref_19","unstructured":"Schmidt, J.W., and Taylor, R.E. (1970). Simulation and Analysis of Industrial Systems, Irwin."},{"key":"ref_20","unstructured":"Rabe, M., Spieckermann, S., and Wenzel, S. (2008). Verifikation und Validierung f\u00fcr die Simulation in Produktion und Logistik: Vorgehensmodelle und Techniken, Springer."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Gutenschwager, K., Rabe, M., Spieckermann, S., and Wenzel, S. (2017). Simulation in Produktion und Logistik: Grundlagen und Anwendungen, Springer Vieweg.","DOI":"10.1007\/978-3-662-55745-7"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Balci, O., Fujimoto, R.M., Goldsman, D., Nance, R.E., and Zeigler, B.P. (2017, January 3\u20136). The State of Innovation in Modeling and Simulation: The Last 50 Years. Proceedings of the 2017 Winter Simulation Conference, Las Vegas, NV, USA.","DOI":"10.1109\/WSC.2017.8247835"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.jocs.2014.10.003","article-title":"A Simulation Based Decision Support System for Logistics Management","volume":"10","author":"Fanti","year":"2015","journal-title":"J. Comput. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"913","DOI":"10.1108\/IJPDLM-08-2014-0198","article-title":"An Integrated Shipment Planning and Storage Capacity Decision Under Uncertainty: A Simulation Study","volume":"45","author":"Pujawan","year":"2015","journal-title":"Int. J. Phys. Distr. Log."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"377","DOI":"10.2507\/IJSIMM13(3)CO15","article-title":"Simulation-based Hybrid Approach to Robust Multi-echelon Inventory Policies for Complex Distribution Networks","volume":"13","author":"Fang","year":"2014","journal-title":"Int. J. Simul. Model."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2083","DOI":"10.1080\/00207543.2016.1275873","article-title":"Simulation-based Ripple Effect Modelling in the Supply Chain","volume":"55","author":"Ivanov","year":"2017","journal-title":"Int. J. Prod. Res."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Spall, J.C. (2003). Introduction to Stochastic Search and Optimization: Estimation, Simulation and Control, Wiley-Interscience.","DOI":"10.1002\/0471722138"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Gass, S.I., and Fu, M.C. (2013). Combinatorics. Encyclopedia of Operations Research and Management Science, Springer.","DOI":"10.1007\/978-1-4419-1153-7"},{"key":"ref_29","first-page":"59","article-title":"Polyhedral Combinatorics and Combinatorial Optimization","volume":"15","author":"Schrijver","year":"2004","journal-title":"J. Ann.-Rech. Oper."},{"key":"ref_30","unstructured":"Taylor, B.W. (2013). Introduction to Management Science, Pearson. [11th ed.]."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Korte, B., and Vygen, J. (2018). Combinatorial Optimization: Theory and Algorithms, Springer. [6th ed.]. Algorithms and Combinatorics.","DOI":"10.1007\/978-3-662-56039-6"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"960","DOI":"10.1007\/978-1-4419-1153-7_200461","article-title":"Metaheuristics","volume":"Volume 1","author":"Gass","year":"2013","journal-title":"Encyclopedia of Operations Research and Management Science"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Osaba, E., Carballedo, R., Diaz, F., Onieva, E., de La Iglesia, I., and Perallos, A. (2014). Crossover Versus Mutation: A Comparative Analysis of the Evolutionary Strategy of Genetic Algorithms Applied to Combinatorial Optimization Problems. Sci. World J.","DOI":"10.1155\/2014\/154676"},{"key":"ref_34","unstructured":"Cybulski, R. (2018). Vergleich zwischen Algorithmen zur Optimierung Logistischer Netzwerke. [Bachelor\u2019s Thesis, TU Dortmund University]."},{"key":"ref_35","unstructured":"Dangelmaier, W., Laroque, C., and Klaas, A. (2013). Combining Simulation with Heuristics to Solve Stochastic Routing and Scheduling Problems. Simulation in Production andLogistics\u2014Entscheidungsunterst\u00fctzung von der Planung bis zur Steuerung, HNI-Verlagsschriftenreihe."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1016\/j.simpat.2014.03.007","article-title":"Hybrid Simulation\u2014Optimization Methods: A Taxonomy and Discussion","volume":"46","author":"Figueira","year":"2014","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_37","unstructured":"(2016). VDI-Guideline 3633.12. Simulation of Systems in Materials Handling, Logistics, and Production: Simulation and Optimisation, Beuth."},{"key":"ref_38","first-page":"233","article-title":"The Combination of Discrete-event Simulation and Genetic Algorithm for Solving the Stochastic Multi-product Inventory Optimization Problem","volume":"19","author":"Jackson","year":"2018","journal-title":"Transp. Telecommun. J."},{"key":"ref_39","unstructured":"Rabe, M., Juan, A.A., Mustafee, N., Skoogh, A., Jain, S., and Johansson, B. (2018). Speeding up Simulation-based Optimization of Supply Networks by Means of a Multi-population Genetic Algorithm and Reuse of Partial Solutions. Proceedings of the 2018 Winter Simulation Conference, IEEE."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1111\/itor.12433","article-title":"Designing e-Commerce Supply Chains: A Stochastic Facility\u2014Location Approach","volume":"26","author":"Ramalhinho","year":"2019","journal-title":"Int. Trans. Oper. Res."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2257","DOI":"10.1029\/2018WR023133","article-title":"Search Space Representation and Reduction Methods to Enhance Multiobjective Water Supply Monitoring Design","volume":"55","author":"Bode","year":"2019","journal-title":"Water Resour. Res."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.cie.2017.06.019","article-title":"Biased Randomization of Heuristics Using Skewed Probability Distributions: A Survey and some Applications","volume":"110","author":"Grasas","year":"2017","journal-title":"Comput. Ind. Eng."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"P\u00e9trowski, A., and Ben-Hamida, S. (2017). Evolutionary Algorithms, Wiley-Iste. Metaheuristics Set.","DOI":"10.1002\/9781119136378"},{"key":"ref_44","unstructured":"Ahn, C.W. (2006). Advances in Evolutionary Algorithms: Theory, Design and Practice, Springer. Studies in Computational Intelligence."},{"key":"ref_45","unstructured":"Chong, E.K.P., and \u017bak, S.H. (2013). An Introduction to Optimization, Wiley. [4th ed.]."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1007\/s12293-019-00292-3","article-title":"An Adaptive Island Evolutionary Algorithm for the Berth Scheduling Problem","volume":"12","author":"Dulebenets","year":"2020","journal-title":"Memetic Comput."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"134743","DOI":"10.1109\/ACCESS.2020.3010176","article-title":"An Optimization Model and Solution Algorithms for the Vehicle Routing Problem With a \u201cFactory-in-a-Box\u201d","volume":"8","author":"Pasha","year":"2020","journal-title":"IEEE Access"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"6741","DOI":"10.1007\/s00500-019-04312-9","article-title":"The New Optimization Algorithm for the Vehicle Routing Problem with Time Windows using Multi-objective Discrete Learnable Evolution Model","volume":"24","author":"Moradi","year":"2020","journal-title":"Soft Comput."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ins.2019.08.069","article-title":"An Online-learning-based Evolutionary Many-objective Algorithm","volume":"509","author":"Zhao","year":"2020","journal-title":"Inf. Sci."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Mart\u00ed, R., Pardalos, P.M., and Resende, M.G.C. (2018). Multi-objective Optimization. Handbook of Heuristics, Springer.","DOI":"10.1007\/978-3-319-07124-4"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"3382","DOI":"10.1080\/00207543.2018.1533653","article-title":"A Probability Guided Evolutionary Algorithm for Multi-objective Green Express Cabinet Assignment in Urban Last-mile Logistics","volume":"57","author":"Ji","year":"2019","journal-title":"Int. J. Prod. Res."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1756","DOI":"10.1080\/00207543.2018.1504251","article-title":"An Improved Multi-objective Evolutionary Algorithm based on Decomposition for Energy-efficient Permutation Flow Shop Scheduling Problem with Sequence-dependent Setup Time","volume":"57","author":"Jiang","year":"2019","journal-title":"Int. J. Prod. Res."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1020","DOI":"10.1108\/BPMJ-07-2017-0188","article-title":"Continuous Process Improvement Implementation Framework using Multi-objective Genetic Algorithms and Discrete Event Simulation","volume":"25","author":"Kang","year":"2019","journal-title":"Bus. Process. Manag. J."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Kohl, N., and Stone, P. (May, January 26). Policy Gradient Reinforcement Learning for Fast Quadrupedal Locomotion. Proceedings of the IEEE International Conference on Robotics and Automation, 2004. ICRA \u201904. 2004, New Orleans, LA, USA.","DOI":"10.1109\/ROBOT.2004.1307456"},{"key":"ref_55","first-page":"363","article-title":"Autonomous Inverted Helicopter Flight via Reinforcement Learning","volume":"Volume 21","author":"Siciliano","year":"2006","journal-title":"Experimental Robotics IX"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/MSP.2017.2743240","article-title":"Deep Reinforcement Learning: A Brief Survey","volume":"34","author":"Arulkumaran","year":"2017","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"486","DOI":"10.1038\/518486a","article-title":"Artificial Intelligence: Learning to See and Act","volume":"518","author":"Scholkopf","year":"2015","journal-title":"Nature"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1126\/science.1127647","article-title":"Reducing the Dimensionality of Data with Neural Networks","volume":"313","author":"Hinton","year":"2006","journal-title":"Science"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000006","article-title":"Learning Deep Architectures for AI","volume":"2","author":"Bengio","year":"2009","journal-title":"Found. Trends Mach. Learn."},{"key":"ref_60","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the Advances in Neural Information Processing Systems 25 (NIPS 2012), Lake Tahoe, NV, USA."},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"McClelland, J.L., and Rumelhart, D.E. (1986). Parallel Distributed Processing: Explorations in the Microstructure of Cognition, MIT Press. [1st ed.]. A Bradford Book.","DOI":"10.7551\/mitpress\/5237.001.0001"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep Learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_63","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based Learning Applied to Document Recognition","volume":"86","author":"Lecun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_65","unstructured":"Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., and Riedmiller, M. (2020, December 14). Playing Atari with Deep Reinforcement Learning. Available online: arxiv.org\/abs\/1312.5602."},{"key":"ref_66","unstructured":"Li, Y. (2020, December 14). Deep Reinforcement Learning: An Overview. Available online: arxiv.org\/abs\/1701.07274."},{"key":"ref_67","unstructured":"Dross, F., and Rabe, M. (2014, January 3\u20135). A SimHeuristic Framework as a Decision Support System for Large Logistics Networks with Complex KPIs. Proceedings of the 22nd Symposium Simulationstechnik, Berlin, Germany."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Rabe, M., Ammouriova, M., and Schmitt, D. (2018, January 9\u201312). Utilizing Domain-specific Information for the Optimization of Logistics Networks. Proceedings of the 2018 Winter Simulation Conference, Gothenburg, Sweden.","DOI":"10.1109\/WSC.2018.8632340"},{"key":"ref_69","unstructured":"SimPlan AG (2020, December 14). SimChain. Available online: www.simchain.net."},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Rabe, M., Gutenschwager, K., Fechteler, T., and Sari, M.U. (2013, January 8\u201311). A Data Model for Carbon Footprint Simulation in Consumer Goods Supply Chain. Proceedings of the 2013 Winter Simulation Conference, Washington, DC, USA.","DOI":"10.1109\/WSC.2013.6721639"},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Rabe, M., Schmitt, D., and Dross, F. (2017, January 3\u20136). Method to Model Actions for Discrete-event Simulation of Logistics Networks. Proceedings of the 2017 Winter Simulation Conference, Las Vegas, NV, USA.","DOI":"10.1109\/WSC.2017.8248053"},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Rabe, M., and Schmitt, D. (2019, January 8\u201311). Domain-specific Language for Modeling and Simulating Actions in Logistics Networks. Proceedings of the 2019 Winter Simulation Conference, National Harbor, MD, USA.","DOI":"10.1109\/WSC40007.2019.9004662"},{"key":"ref_73","doi-asserted-by":"crossref","unstructured":"Freitag, M., Kotzab, H., and Pannek, J. (2018). Utilizing Domain-specific Information in Decision Support for Logistics Networks. Dynamics in Logistics: Proceedings of the 6th International Conference LDIC 2018, Bremen, Germany, Springer International Publishing. Lecture Notes in Logistics.","DOI":"10.1007\/978-3-319-74225-0"},{"key":"ref_74","unstructured":"Rabe, M., and Ammouriova, M. (2020, January 7\u20139). Constructing Action Plans Based on Correlation between Sequential Actions and their Performance in Logistics Distribution Networks. Proceedings of the 13th International Conference of Research in Logistics and Supply Chain Management, Le Havre, France."},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"Clausen, U., Langkau, S., and Kreuz, F. (2019). Decoupling the Modeling of Actions in Logistics Networks from the Underlying Simulation Data Model. Advances in Production, Logistics and Traffic: Proceedings of the 4th Interdisciplinary Conference on Production Logistics and Traffic (ICPLT), Springer.","DOI":"10.1007\/978-3-030-13535-5"},{"key":"ref_76","unstructured":"Watkins, C. (1989). Learning from Delayed Rewards. [Ph.D. Thesis, Kings College]."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1613\/jair.3912","article-title":"The Arcade Learning Environment: An Evaluation Platform for General Agents","volume":"47","author":"Bellemare","year":"2013","journal-title":"J. Artif. Intell. Res."},{"key":"ref_78","unstructured":"ALE (2020, December 14). The Arcade Learning Environment. Available online: https:\/\/github.com\/mgbellemare\/Arcade-Learning-Environment."},{"key":"ref_79","unstructured":"(2020, December 14). TensorFlow. Available online: https:\/\/www.tensorflow.org\/."},{"key":"ref_80","unstructured":"Rabe, M., Dross, F., and Wuttke, A. (2017, January 4\u20137). Combining a Discrete-event Simulation Model of a Logistics Network with Deep Reinforcement Learning. Proceedings of the 12th Metaheuristics International Conference (MIC), Barcelona, Spain."},{"key":"ref_81","unstructured":"Putz, M., and Schlegel, A. (2019). An Approach for Reducing the Search Space for Simheuristics Applications in Logistics Network in Trading. Simulation in Production and Logistics, Verlag Wissenschaftliche Skripten."},{"key":"ref_82","unstructured":"Rabe, M., and Clausen, U. (2015). A Procedure Model for the Credible Measurability of Data Warehouse Metrics on Discrete-event Simulation Models of Logistics Systems. Simulation in Production and Logistics 2015, Fraunhofer Verlag."},{"key":"ref_83","doi-asserted-by":"crossref","unstructured":"Gendreau, M., and Potvin, J.Y. (2019). Computational Comparison of Metaheuristics. Handbook of Metaheuristics, Springer International Publishing. International Series in Operation Research and Management Science.","DOI":"10.1007\/978-3-319-91086-4"},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"1387","DOI":"10.1007\/s11227-016-1814-8","article-title":"QoS-aware Service Composition in Cloud Computing Using Data Mining Techniques and Genetic Algorithm","volume":"73","author":"Karimi","year":"2017","journal-title":"J. Supercomput."},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.cor.2015.11.006","article-title":"On the Abstraction Method for the Container Relocation Problem","volume":"68","author":"Ku","year":"2016","journal-title":"Comput. Oper. Res."},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"3072","DOI":"10.1109\/TITS.2017.2673247","article-title":"Simultaneous Optimization of Airspace Congestion and Flight Delay in Air Traffic Network Flow Management","volume":"18","author":"Cai","year":"2017","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_87","doi-asserted-by":"crossref","unstructured":"Blenk, A., Kalmbach, P., Kellerer, W., and Schmid, S. (2017). O\u2019zapft is: Tap Your Network Algorithm\u2019s Big Data. Proceedings of the Workshop on Big Data Analytics and Machine Learning for Data Communication Networks (Big-DAM\u201917), Association for Computing Machinery.","DOI":"10.1145\/3098593.3098597"},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.ejor.2017.05.025","article-title":"Exploiting Variable Associations to Configure Efficient Local Search Algorithms in Large-scale Binary Integer Programs","volume":"263","author":"Umetani","year":"2017","journal-title":"Eur. J. Oper. Res."},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1007\/s10479-015-2019-x","article-title":"Simulation Optimization: A Review of Algorithms and Applications","volume":"240","author":"Amaran","year":"2016","journal-title":"Ann. Oper. Res."},{"key":"ref_90","unstructured":"Sheskin, D. (2011). Handbook of Parametric and Nonparametric Statistical Procedures, CRC Press. [5th ed.]."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/14\/1\/23\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:11:00Z","timestamp":1760159460000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/14\/1\/23"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,14]]},"references-count":90,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,1]]}},"alternative-id":["a14010023"],"URL":"https:\/\/doi.org\/10.3390\/a14010023","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2021,1,14]]}}}