{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T05:46:35Z","timestamp":1790142395737,"version":"4.0.1"},"reference-count":63,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2020,7,3]],"date-time":"2020-07-03T00:00:00Z","timestamp":1593734400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the special research plan on \u201cImpact and Control of Covid-19\u201d of School of Business, Shandong University","award":["No. 14"],"award-info":[{"award-number":["No. 14"]}]},{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["No.71772106"],"award-info":[{"award-number":["No.71772106"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Humanities and Social Sciences Foundation of the Ministry of Education of China","award":["No.17YJCZH198"],"award-info":[{"award-number":["No.17YJCZH198"]}]},{"name":"the research project of Shandong Science and Technology Committee","award":["No. ZR2017MG012"],"award-info":[{"award-number":["No. ZR2017MG012"]}]},{"name":"The Youth Team Grant Fund of Shandong University and Business School-The Culture Image and Competitiveness of Tourism in China","award":["2018WQTDXM003"],"award-info":[{"award-number":["2018WQTDXM003"]}]},{"name":"the Research project of Humanities and social sciences of Shandong University","award":["No. IFWF2029"],"award-info":[{"award-number":["No. IFWF2029"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>The infectious disease COVID-19 has swept across the world in 2020, and it continues to cause massive losses of life and severe economic problems in all countries. Providing emergency supplies such as protective medical equipment and materials required to secure people\u2019s livelihood is thus currently prioritized by governments. Establishing a reliable emergency logistics system is critical in this regard. This paper used the Delphi method to design a formal decision structure to assess emergency logistics system reliability (ELSR) by obtaining a consensus from a panel of experts. Assessing ELSR is a typical multiple-attribute decision making (MADM) problem, and the related MADM methods are usually on the basis of symmetry principles. A hybrid MADM model, called the Decision Making Trial and Evaluation Laboratory (DEMATEL)-based Analytical Network Process (D-ANP), was developed to identify the critical factors influencing ELSR. An analysis of empirical evidence showed that the emergency logistics command and coordination system and the emergency material supply system play important roles in ELSR, while the emergency logistics transportation and distribution system and the emergency information system are not so important. This conclusion is different from previous research about traditional disaster emergency logistics. Moreover, the cause\u2013effect relationships among the key factors indicated that the system of command and coordination for emergency logistics and the supply system for emergency materials should be improved. Accordingly, effective suggestions for emergency logistics services for epidemic prevention are provided in this paper. The main contributions of this paper are (1) establishing a comprehensive and systematic evaluating index of ELSR for epidemic prevention; (2) employing a kind of structured, namely D-ANP, to identify the critical factors with non-commensurable and conflicting (competing) characteristics; and (3) comparing the differences of reliable criteria between the emergency logistics of epidemic prevention and the traditional disaster emergency logistics.<\/jats:p>","DOI":"10.3390\/sym12071115","type":"journal-article","created":{"date-parts":[[2020,7,6]],"date-time":"2020-07-06T11:07:42Z","timestamp":1594033662000},"page":"1115","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["Evaluating Critical Factors Influencing the Reliability of Emergency Logistics Systems Using Multiple-Attribute Decision Making"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4876-693X","authenticated-orcid":false,"given":"Peng","family":"Jiang","sequence":"first","affiliation":[{"name":"School of Business, Shandong University, Weihai 264209, China"},{"name":"International Institute of Tourism Science, Shandong University, Weihai 264209, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yixin","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Business, Shandong University, Weihai 264209, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chao","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Business, Shandong University, Weihai 264209, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3090-1515","authenticated-orcid":false,"given":"Yi-Chung","family":"Hu","sequence":"additional","affiliation":[{"name":"Department of Business Administration, Chung Yuan Christian University, Taoyuan 32023, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7018-5483","authenticated-orcid":false,"given":"Jingci","family":"Xie","sequence":"additional","affiliation":[{"name":"School of Management, Shandong University, Jinan 250100, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,7,3]]},"reference":[{"key":"ref_1","unstructured":"(2020, June 18). Available online: https:\/\/www.who.int\/docs\/default-source\/coronaviruse\/situation-reports\/20200617-covid-19-sitrep-149.pdf?sfvrsn=3b3137b0_4."},{"key":"ref_2","first-page":"164","article-title":"Emergency logistics","volume":"27","author":"Ou","year":"2004","journal-title":"J. Chongqing Univ. (Nat. Sci. Ed.)"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.cor.2015.12.002","article-title":"Heuristic approaches for the multiperiod location-transportation problem with reuse of vehicles in emergency logistics","volume":"69","author":"Moreno","year":"2016","journal-title":"Comput. Oper. Res."},{"key":"ref_4","first-page":"157","article-title":"Healthcare logistics in disaster planning and emergency management: A perspective","volume":"10","author":"Vanvactor","year":"2017","journal-title":"J. Bus. Contin. Emerg. Plan."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yang, X., Hao, W., and Lu, Y. (2018). Inventory slack routing application in emergency logistics and relief distributions. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0198443"},{"key":"ref_6","first-page":"400","article-title":"Research on efficient online planning of emergency logistics path based on double-layer ant colony optimization algorithm","volume":"41","author":"Liu","year":"2019","journal-title":"Int. J. Comput. Appl."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1002\/atr.5670330207","article-title":"A capacity related reliability for transportation networks","volume":"33","author":"Chen","year":"1999","journal-title":"J. Adv. Transp."},{"key":"ref_8","first-page":"35","article-title":"Emergency legal mechanism of humanitarian logistics in public health emergencies","volume":"34","author":"Peng","year":"2020","journal-title":"China Bus. Mark."},{"key":"ref_9","first-page":"160","article-title":"A novel hybrid MCDM model combined with DEMATEL and ANP with applications","volume":"5","author":"Ouyang","year":"2008","journal-title":"Int. J. Oper. Res."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"482","DOI":"10.1016\/j.ins.2011.09.012","article-title":"A VIKOR technique based on DEMATEL and ANP for information security risk control assessment","volume":"232","author":"Ouyang","year":"2013","journal-title":"Inf. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Saaty, T.L. (1980). The Analytic Hierarchy Process, McGraw-Hill.","DOI":"10.21236\/ADA214804"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Hwang, C.L., and Yoon, K. (1981). Multiple attribute decision making. Lecture Notes in Economics and Mathematical Systems, Springer.","DOI":"10.1007\/978-3-642-48318-9"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.tre.2009.07.005","article-title":"Dynamic relief-demand management for emergency logistics operations under large-scale disasters","volume":"46","author":"Sheu","year":"2010","journal-title":"Transp. Res. Part E Logist. Transp. Rev."},{"key":"ref_14","first-page":"69","article-title":"Inventory accuracy: An over looked component of supply chain reliability","volume":"49","author":"Luton","year":"2004","journal-title":"Mater. Manag. Distrib."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.elerap.2006.11.007","article-title":"Simulation-based experimentation for designing reliable and efficient Web service orchestrations in supply chains","volume":"7","author":"Tamrat","year":"2008","journal-title":"Electron. Commer. Res. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1209","DOI":"10.1016\/j.cie.2012.06.023","article-title":"Reliability evaluation for a manufacturing network with multiple production lines","volume":"63","author":"Lin","year":"2012","journal-title":"Comput. Ind. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1007\/s10479-017-2600-6","article-title":"Evaluation of system reliability for a stochastic delivery-flow distribution network with inventory","volume":"277","author":"Huang","year":"2019","journal-title":"Ann. Oper. Res."},{"key":"ref_18","first-page":"156","article-title":"Research on the reliability of the fourth party logistics system","volume":"2","author":"Shen","year":"2008","journal-title":"Mark. Mod."},{"key":"ref_19","first-page":"9","article-title":"Effects of trans-routing flexibility on logistic dependability","volume":"8","author":"Yao","year":"2007","journal-title":"New Technol. New Process"},{"key":"ref_20","first-page":"29","article-title":"Application of reliability technology in logistics machines","volume":"9","author":"Tao","year":"2003","journal-title":"Logist. Technol."},{"key":"ref_21","first-page":"50","article-title":"Dynamic analysis on reliability of transportation scheduling nodes on emergency logistics supply chain","volume":"17","author":"Li","year":"2015","journal-title":"J. Acad. Mil. Transp."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"He, M., Wu, X., and Mou, N. (2012, January 8\u201310). Capability coordination in logistics service supply chain based on reliability. Proceedings of the International Conference of Logistics Engineering and Management 2012, Chengdu, China.","DOI":"10.1061\/9780784412602.0144"},{"key":"ref_23","first-page":"85","article-title":"Reliability research of coal mine flood emergency logistics system based on extension theory","volume":"38","author":"Wang","year":"2011","journal-title":"Min. Saf. Environ. Prot."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1016\/j.egypro.2012.01.046","article-title":"Fuzzy entropy clustering approach to evaluate the reliability of emergency logistics system","volume":"16","author":"Gong","year":"2012","journal-title":"Energy Procedia"},{"key":"ref_25","unstructured":"Guo, Y.M. (2018). Reliability Analysis of Emergency Logistics Systems. [Ph.D. Thesis, Chang\u2019an University]."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.jom.2016.05.003","article-title":"Models and metrics to assess humanitarian response capacity","volume":"45","author":"Acimovic","year":"2016","journal-title":"J. Oper. Manag."},{"key":"ref_27","first-page":"134","article-title":"Simulation of reliability index about ELS","volume":"11","author":"Han","year":"2006","journal-title":"Comput. Appl. Res."},{"key":"ref_28","first-page":"69","article-title":"Discussion on the reliability of emergency logistics supply chain","volume":"31","author":"Chen","year":"2009","journal-title":"Railw. Transp. Econ."},{"key":"ref_29","first-page":"101","article-title":"The routing problem for emergency logistics considering the reliability and time- varying in the earthquake disasters","volume":"8","author":"Cai","year":"2011","journal-title":"J. Railw. Sci. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"137","DOI":"10.5267\/j.uscm.2014.5.004","article-title":"Disaster relief routing by considering heterogeneous vehicles and reliability of routes using an MADM approach","volume":"2","author":"Nasiri","year":"2014","journal-title":"Uncertain Supply Chain Manag."},{"key":"ref_31","first-page":"169","article-title":"Route selection method for emergency logistics based on cumulative prospect theory","volume":"27","author":"Wang","year":"2017","journal-title":"China Saf. Sci. J."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.tre.2015.05.005","article-title":"Transportation network reliability in emergency response","volume":"80","author":"Edrissi","year":"2015","journal-title":"Transp. Res. Part E"},{"key":"ref_33","first-page":"48","article-title":"Reliability analysis of a class of resource transfer network models","volume":"3","author":"Wang","year":"2000","journal-title":"J. Airf. Radar Acad."},{"key":"ref_34","first-page":"229","article-title":"Study on the evaluation of emergency logistics network cascading failure invulnerability based on ci-topsis fuzzy multi criteria group decision making tactics","volume":"30","author":"Zhu","year":"2018","journal-title":"Manag. Rev."},{"key":"ref_35","first-page":"45","article-title":"Emergency logistics supplier evaluation based on grey entropy model","volume":"3","author":"Gao","year":"2013","journal-title":"Stat. Decis."},{"key":"ref_36","first-page":"63","article-title":"Study on the evaluating of supplier in the emergency logistics of military integration based on set pair analysis","volume":"6","author":"Wang","year":"2012","journal-title":"Oper. Res. Manag. Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/j.seps.2011.04.004","article-title":"Optimization models in emergency logistics: A literature review","volume":"46","author":"Caunhye","year":"2012","journal-title":"Socio-Economic Plan. Sci."},{"key":"ref_38","unstructured":"Liu, J., Li, J., and Zhao, J. (2006). The research on supply chain reliability based on meta-graphs. Proceedings of the Fourth International Conference on Control and Automation, Montreal, QC, Canada, 12 June 2003, IEEE."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Thomas, M.U. (2002). Supply chain reliability for contingency operations. Proceedings of the Reliability and Maintainability Symposium, Seattle, WA, USA, 28\u201331 January 2002, IEEE.","DOI":"10.1109\/RAMS.2002.981621"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.ress.2005.03.006","article-title":"Complex system reliability modeling with dynamic object oriented bayesian networks","volume":"91","author":"Philippe","year":"2006","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_41","unstructured":"Yao, Y. (2017). Research on Performance Evaluation of Emergency Logistics Based on BP Artificial Neural Network. [Master\u2019s Thesis, Wuhan University of Technology]."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"413203","DOI":"10.1155\/2015\/413203","article-title":"Identifying key factors of introducing GPS-based fleet management systems to the logistics industry","volume":"2015","author":"Hu","year":"2015","journal-title":"Math. Probl. Eng."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"763","DOI":"10.1111\/j.1540-5915.1997.tb01330.x","article-title":"Managing Delphi surveys using nonparametric statistical techniques","volume":"8","author":"Schmidt","year":"1997","journal-title":"Decis. Sci."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/BF02297509","article-title":"Future issues of computer-mediated communication: The results of a Delphi study","volume":"41","author":"Holden","year":"1993","journal-title":"Educ. Technol. Res. Dev."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"458","DOI":"10.1287\/mnsc.9.3.458","article-title":"An experimental application of the Delphi method to the use of experts","volume":"9","author":"Dalkey","year":"1963","journal-title":"Manag. Sci."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1016\/0040-1625(91)90039-I","article-title":"Delphi: A re-evaluation of research and theory","volume":"39","author":"Rowe","year":"1991","journal-title":"Technol. Forecast. Soc. Change"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"890","DOI":"10.1002\/sd.1860","article-title":"Green supplier selection for sustainable development of the automotive industry using grey decision-making","volume":"26","author":"Jiang","year":"2018","journal-title":"Sustain. Dev."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.im.2003.11.002","article-title":"The Delphi method as a research tool: An example, design considerations and applications","volume":"42","author":"Okoli","year":"2004","journal-title":"Inf. Manag."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1016\/j.im.2007.06.001","article-title":"A Delphi study of knowledge management systems: Scope and requirements","volume":"44","author":"Nevo","year":"2007","journal-title":"Inf. Manag."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1016\/j.im.2013.05.005","article-title":"Understanding the most critical skills for managing IT projects: A Delphi study of IT project managers","volume":"50","author":"Keil","year":"2013","journal-title":"Inf. Manag."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Hu, Y.-C., Lee, P.-C., Chuang, Y.-S., and Chiu, Y.-J. (2018). Improving the sustainable competitiveness of service quality within air cargo terminals. Sustainability, 10.","DOI":"10.3390\/su10072319"},{"key":"ref_52","first-page":"305","article-title":"BIM applications toward key performance indicators of construction projects in Iran","volume":"20","author":"Khanzadi","year":"2020","journal-title":"Int. J. Constr. Manag."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1080\/00220612.1979.10671539","article-title":"Continuing social work education: Results of a Delphi survey","volume":"15","author":"Faherty","year":"1979","journal-title":"J. Educ. Soc. Work"},{"key":"ref_54","unstructured":"Saaty, T.L. (1996). Decision Making with Dependence and Feedback: Analytic Network Process, RWS Publications."},{"key":"ref_55","first-page":"53","article-title":"Backpropagation multi-layer perceptron for incomplete pairwise comparison matrices in analytic hierarchy process","volume":"180","author":"Hu","year":"2006","journal-title":"Appl. Math. Comput."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1016\/S0377-2217(98)00109-X","article-title":"Consistency improving method in the analytic hierarchy process","volume":"116","author":"Xu","year":"1999","journal-title":"Eur. J. Oper. Res."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Jiang, P., Hu, Y.C., Yen, G.F., Jiang, H., and Chiu, Y.J. (2018). Using a novel grey DANP model to identify interactions between manufacturing and logistics industries in China. Sustainability, 10.","DOI":"10.3390\/su10103456"},{"key":"ref_58","unstructured":"(2020, June 20). Available online: http:\/\/www.gov.cn\/zhengce\/gwylflkjzwj.htm."},{"key":"ref_59","unstructured":"(2020, June 20). Available online: http:\/\/www.why.com.cn\/wx\/article\/2020\/04\/13\/15867572091150833690.html."},{"key":"ref_60","unstructured":"(2020, June 20). Available online: https:\/\/www.sohu.com\/a\/369886102_100119860."},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Jiang, Y., and Yuan, Y. (2019). Emergency logistics in a large-scale disaster context: Achievements and challenges. Int. J. Environ. Res. Public Health, 16.","DOI":"10.3390\/ijerph16050779"},{"key":"ref_62","first-page":"171","article-title":"Genetic algorithms for determining fuzzy measures from data","volume":"6","author":"Wang","year":"1998","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_63","unstructured":"Deng, Z.Y. (2012). Multiple Criteria Decision Making: Methods and Applications, Tingmao."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/7\/1115\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:47:12Z","timestamp":1760176032000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/7\/1115"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,3]]},"references-count":63,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2020,7]]}},"alternative-id":["sym12071115"],"URL":"https:\/\/doi.org\/10.3390\/sym12071115","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,3]]}}}