{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T09:45:07Z","timestamp":1769507107363,"version":"3.49.0"},"reference-count":42,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,1,16]],"date-time":"2023-01-16T00:00:00Z","timestamp":1673827200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Key Project of the Civil Aviation Joint Fund of the National Natural Science Foundation of China","award":["U2033213"],"award-info":[{"award-number":["U2033213"]}]},{"name":"Key Project of the Civil Aviation Joint Fund of the National Natural Science Foundation of China","award":["FZ2022ZX50"],"award-info":[{"award-number":["FZ2022ZX50"]}]},{"name":"Key Project of the Civil Aviation Joint Fund of the National Natural Science Foundation of China","award":["FZ2021ZZ01"],"award-info":[{"award-number":["FZ2021ZZ01"]}]},{"name":"Key Laboratory of Civil Aviation Flight Technology and Flight Safety","award":["U2033213"],"award-info":[{"award-number":["U2033213"]}]},{"name":"Key Laboratory of Civil Aviation Flight Technology and Flight Safety","award":["FZ2022ZX50"],"award-info":[{"award-number":["FZ2022ZX50"]}]},{"name":"Key Laboratory of Civil Aviation Flight Technology and Flight Safety","award":["FZ2021ZZ01"],"award-info":[{"award-number":["FZ2021ZZ01"]}]},{"name":"Independent Project of the Research Base of Civil Aviation Flight Technology and Flight Safety","award":["U2033213"],"award-info":[{"award-number":["U2033213"]}]},{"name":"Independent Project of the Research Base of Civil Aviation Flight Technology and Flight Safety","award":["FZ2022ZX50"],"award-info":[{"award-number":["FZ2022ZX50"]}]},{"name":"Independent Project of the Research Base of Civil Aviation Flight Technology and Flight Safety","award":["FZ2021ZZ01"],"award-info":[{"award-number":["FZ2021ZZ01"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sustainability"],"abstract":"<jats:p>Due to the unavoidable operational risks and insufficient risk management capabilities of beginner pilots in flight training, the challenge of risk control in aviation schools has become increasingly prominent. To ensure the safety of flight training in aviation schools and to reduce costs and increase revenue, the essential prerequisite for improving efficiency is risk management. Therefore, it is necessary to explore risk identification and assessment methods. This paper adopts the holographic modeling (HHM) method and risk filtering, rating and management (RFRM) theory. First, the HHM idea is used to construct a risk identification framework (HHM-PAVE) for flight training. Second, based on the dual criteria, multiple criteria and cloud model (CM) in the RFRM approach, an improved risk assessment matrix-cloud model (IPC-CM) is proposed and combined with the N-K model and Bayes\u2019 theorem to propose a coupled risk scenario hazard measurement model (CR-HM) based on the HHM-RFRM approach in risk assessment. In the assessment process, the impact of risk factors on system stability as well as the uncertainty problem and coupling\u2013risk quantification problem in expert assessment are considered to obtain scientific and objective quantitative assessment results. Finally, the risk identification and assessment experiments were conducted using HHM-RFRM on the flight training. The results show that the method can more accurately identify critical risk factors in a flight training system and provide a new perspective for risk prevention and control.<\/jats:p>","DOI":"10.3390\/su15021693","type":"journal-article","created":{"date-parts":[[2023,1,16]],"date-time":"2023-01-16T04:06:47Z","timestamp":1673842007000},"page":"1693","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Flight Training Risk Identification and Assessment Based on the HHM-RFRM Model"],"prefix":"10.3390","volume":"15","author":[{"given":"Hong","family":"Sun","sequence":"first","affiliation":[{"name":"Flight Technology and Flight Safety Research Base, Civil Aviation Flight University of China, Guanghan 618307, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7636-3591","authenticated-orcid":false,"given":"Fangquan","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Airport, Civil Aviation Flight University of China, Guanghan 618307, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5923-474X","authenticated-orcid":false,"given":"Peiwen","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Economics and Management, Civil Aviation Flight University of China, Guanghan 618307, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yunxiang","family":"Zhao","sequence":"additional","affiliation":[{"name":"Flight Training Standards Branch, Civil Aviation Flight University of China, Guanghan 618307, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,16]]},"reference":[{"key":"ref_1","unstructured":"(2022, January 04). ASN Safety Databases. Available online: https:\/\/aviation-safety.net\/database\/databases.php."},{"key":"ref_2","unstructured":"Zhang, W.-J., Zhang, Y.-J., and Zhang, C. (2022). Intelligent ship navigation risk identification and screening based on HHM-RFRM method. J. Saf. Environ., 1\u201310."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.retrec.2012.12.001","article-title":"Analyzing aviation safety: Problems, challenges, opportunities","volume":"43","author":"Oster","year":"2013","journal-title":"Res. Transp. Econ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.cie.2007.06.032","article-title":"A quantitative model for aviation safety risk assessment","volume":"54","author":"Shyur","year":"2008","journal-title":"Comput. Ind. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Sun, R., and Shi, R. (2011, January 26). Analysis of Civil Aviation Communications Error Events Based on SHEL Model. Proceedings of the ICTIS 2011: Multimodal Approach to Sustained Transportation System Development: Information, Technology, Implementation, Wuhan, China.","DOI":"10.1061\/41177(415)267"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"768","DOI":"10.1136\/bmj.320.7237.768","article-title":"Human error: Models and management","volume":"320","author":"Reason","year":"2000","journal-title":"BMJ"},{"key":"ref_7","first-page":"1","article-title":"Safety analysis for resilient complex socio-technical systems with an extended functional resonance analysis method","volume":"2","author":"Hirose","year":"2017","journal-title":"Int. J. Astronaut. Aeronaut. Eng."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1115","DOI":"10.1016\/j.conengprac.2008.10.003","article-title":"Qualitative temporal analysis: Towards a full implementation of the Fault Tree Handbook","volume":"17","author":"Walker","year":"2009","journal-title":"Control. Eng. Pract."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhu, J., Liu, B., Dong, P., and Zeng, L. (2021, January 8\u201310). Quality-Risk Identification and Screening of Aircraft Major Overhaul Project Based on HHM-RFRM. Proceedings of the Journal of Physics: Conference Series, Harbin, China.","DOI":"10.1088\/1742-6596\/1827\/1\/012194"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"072026","DOI":"10.1088\/1757-899X\/780\/7\/072026","article-title":"Risk Assessment and Management of National Defense Engineering Construction Based on HHM-RFRM","volume":"780","author":"Liu","year":"2020","journal-title":"IOP Conf. Ser. Mater. Sci. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1054","DOI":"10.1080\/07421222.2017.1394056","article-title":"A data-mining approach to identification of risk factors in safety management systems","volume":"34","author":"Shi","year":"2017","journal-title":"J. Manag. Inform. Syst."},{"key":"ref_12","unstructured":"Wu, P.F., Duanmu, J.S., Du, J.Y., Yang, J., and Zhang, C. (2012, January 29\u201330). Risk factor identification and classification of flight safety based on fault tree approach. Proceedings of the International Conference on Mechatronics and Control Engineering (ICMCE 2012), Guangzhou, China."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1080\/13669877.2012.729518","article-title":"Towards a new approach for the identification of atypical accident scenarios","volume":"16","author":"Paltrinieri","year":"2013","journal-title":"J. Risk Res."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"s9","DOI":"10.1136\/heartjnl-2018-313052","article-title":"Assessing aeromedical risk: A three-dimensional risk matrix approach","volume":"105","author":"Gray","year":"2019","journal-title":"Heart"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1016\/j.ress.2011.03.009","article-title":"Risk assessment techniques for civil aviation security","volume":"96","author":"Tamasi","year":"2011","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_16","first-page":"104","article-title":"NK model based analysis of risk coupling in civil aviation maintenance unsafe events","volume":"28","author":"Chen","year":"2018","journal-title":"China Saf. Sci. J."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wu, F., Mu, H., and Feng, S. (2015, January 21). Analysis of the Risk of Air Traffic Controllers\u2019 Fatigue Based on the SHEL Model. Proceedings of the ICTE 2015, Dalian, China.","DOI":"10.1061\/9780784479384.376"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wang, L., Sun, R., and Yang, Z. (2009, January 8\u201311). Analysis and evaluation of human factors in aviation maintenance based on fuzzy and AHP method. Proceedings of the 2009 IEEE International Conference on Industrial Engineering and Engineering Management, Hong Kong, China.","DOI":"10.1109\/IEEM.2009.5372887"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s11518-016-5296-2","article-title":"Risk reduction in a project portfolio","volume":"26","author":"Guan","year":"2017","journal-title":"J. Syst. Sci. Syst. Eng."},{"key":"ref_20","first-page":"90","article-title":"Project portfolio risk components and analysis from a complex systems perspective","volume":"35","author":"Guan","year":"2015","journal-title":"Modern. Manag."},{"key":"ref_21","first-page":"151","article-title":"Research on the Similarity of the Structured Emergency Events Based on Scenario","volume":"25","author":"Lian","year":"2017","journal-title":"Chin. J. Manag. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Alwi, A., and Ariffin, K.A.Z. (2018, January 13\u201315). Information Security Risk Assessment for the Malaysian Aeronautical Information Management System. Proceedings of the 2018 Cyber Resilience Conference (CRC), Putrajaya, Malaysia.","DOI":"10.1109\/CR.2018.8626841"},{"key":"ref_23","first-page":"77","article-title":"Coupling analysis of risk factors in flight operation","volume":"27","author":"Yantao","year":"2017","journal-title":"China Saf. Sci. J."},{"key":"ref_24","first-page":"606","article-title":"Aircraft operational safety risk coupling based on N-K model","volume":"22","author":"Dan","year":"2022","journal-title":"J. Saf. Environ."},{"key":"ref_25","first-page":"267","article-title":"Analysis of Coupled Risk of Air Traffic Safety Based on N-K Model","volume":"33","author":"Luo","year":"2011","journal-title":"J. Wuhan Univ. Technol. (Inform. Manag. Eng.)"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1111\/0272-4332.215153","article-title":"Fitting hierarchical holographic modeling into the theory of scenario structuring and a resulting refinement to the quantitative definition of risk","volume":"21","author":"Kaplan","year":"2001","journal-title":"Risk Anal."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1111\/0272-4332.00020","article-title":"Risk filtering, ranking, and management framework using hierarchical holographic modeling","volume":"22","author":"Haimes","year":"2002","journal-title":"Risk Anal."},{"key":"ref_28","unstructured":"Lambert, J.H., Ling, C.W., and Haimes, Y.Y. (1991, January 3\u20138). Remediation site prioritization by the risk ranking and filtering method. Proceedings of the Risk-Based Decision Making in Water Resources V, Santa Barbara, CA, USA."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1111\/j.1539-6924.1981.tb01350.x","article-title":"On the quantitative definition of risk","volume":"1","author":"Kaplan","year":"1981","journal-title":"Risk Anal."},{"key":"ref_30","first-page":"121","article-title":"Risk Analysis, Pilot Motivation, and Decision-Making: Application of the PAVE Personal Minimums Checklist to Pilot Decision-Making in Three General Aviation Accidents","volume":"19","author":"Ruiz","year":"2001","journal-title":"Colleg. Aviat. Rev. Int."},{"key":"ref_31","unstructured":"Bryson, R.A. (1977). Water-resource systems planning. Climate, Climatic Change, and Water Supply. Studies in Geophysics, National Academy of Sciences."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1002\/int.20340","article-title":"A new cognitive model: Cloud model","volume":"24","author":"Li","year":"2009","journal-title":"Int. J. Intell. Syst."},{"key":"ref_33","first-page":"1320","article-title":"Statistics on atomized feature of normal cloud model","volume":"36","author":"Liu","year":"2010","journal-title":"J. Beijing Univ. Aeronaut. Astronaut."},{"key":"ref_34","first-page":"37","article-title":"Improved R = P \u00d7 C Risk Evaluation Method Based on Cloud Model","volume":"31","year":"2014","journal-title":"J. Civ. Eng. Manag."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1007\/s00477-014-0878-3","article-title":"Developing a cloud model based risk assessment methodology for tunnel-induced damage to existing pipelines","volume":"29","author":"Zhang","year":"2015","journal-title":"Stoch. Env. Res. Risk A"},{"key":"ref_36","first-page":"140","article-title":"Study on Risk Quantitative Assessment Model for Civil Aviation Safety","volume":"17","author":"Yuan","year":"2007","journal-title":"China Saf. Sci. J."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"4626","DOI":"10.1103\/PhysRevE.51.4626","article-title":"Testing mode-coupling theory for a supercooled binary Lennard-Jones mixture I: The van Hove correlation function","volume":"51","author":"Kob","year":"1995","journal-title":"Phys. Rev. E"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1177","DOI":"10.1126\/science.1236536","article-title":"Bayes\u2019 theorem in the 21st century","volume":"340","author":"Efron","year":"2013","journal-title":"Science"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jsr.2019.03.009","article-title":"An analysis of human factors in fifty controlled flight into terrain aviation accidents from 2007 to 2017","volume":"69","author":"Kelly","year":"2019","journal-title":"J. Saf. Res."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1515\/CORRREV.2007.25.1-2.107","article-title":"Preventative maintenance and failure analysis of aircraft components","volume":"25","author":"Eliaz","year":"2007","journal-title":"Corros. Rev."},{"key":"ref_41","first-page":"611","article-title":"The Impact of Cultural Values on Chinese Students in American Higher Education","volume":"21","author":"Wang","year":"2016","journal-title":"Qualit. Rep."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1037\/0022-3514.77.6.1121","article-title":"Unskilled and unaware of it: How difficulties in recognizing one\u2019s own incompetence lead to inflated self-assessments","volume":"77","author":"Kruger","year":"1999","journal-title":"J. Pers. Soc. Psychol."}],"container-title":["Sustainability"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2071-1050\/15\/2\/1693\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:07:10Z","timestamp":1760119630000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2071-1050\/15\/2\/1693"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,16]]},"references-count":42,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["su15021693"],"URL":"https:\/\/doi.org\/10.3390\/su15021693","relation":{},"ISSN":["2071-1050"],"issn-type":[{"value":"2071-1050","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,16]]}}}