{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T12:45:28Z","timestamp":1787316328923,"version":"build-2736575974"},"reference-count":25,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2023,5,22]],"date-time":"2023-05-22T00:00:00Z","timestamp":1684713600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U2033213"],"award-info":[{"award-number":["U2033213"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["FZ2021ZZ01"],"award-info":[{"award-number":["FZ2021ZZ01"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Fundamental Research Funds for the Central Universities\u201d","award":["U2033213"],"award-info":[{"award-number":["U2033213"]}]},{"name":"Fundamental Research Funds for the Central Universities\u201d","award":["FZ2021ZZ01"],"award-info":[{"award-number":["FZ2021ZZ01"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Sciences"],"abstract":"<jats:p>Ensuring training safety is paramount to flight schools. In response to the inadequacy of traditional flight training assessment for comprehensive quantitative evaluation of cadet competency, an initial flight training competency assessment standard based on behavioral indicators was developed and optimized using the VENN model. Firstly, the Assessor Score Measurement Form (ASMF) was constructed according to the requirements of the Training Evaluation Worksheet specification, such as typical subjects, observations, and completion criteria. Secondly, based on the basic principles of the experience of the flight expert and the Competency-Based Training and Assessment (CBTA), a matrix of correlations between the observations and each competency-based behavioral indicator was created to construct a competency assessment matrix. In addition, a two-dimensional model for representing competency items characterized by behavioral indicators was established and an optimization model for competency assessment criteria was constructed. Finally, through combining actual flight training data, the proposed method was validated in the flight screening check phase. The results show that the optimized flight training competency assessment scheme can be well quantified and matched to real instructor ratings with an accuracy of 84%. The assessment worksheet, the assessment matrix, and the VENN competency rating model can be adapted to the different teaching requirements of each flight phase, achieving a perfect match between the behavioral indicators and the competency items, which is highly versatile. The proposed model can more accurately reflect the core competencies of flight trainees, enable quantitative assessment of behavioral indicators and competency items, and provide support for subsequent training of trainees.<\/jats:p>","DOI":"10.3390\/app13106346","type":"journal-article","created":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T02:02:27Z","timestamp":1684807347000},"page":"6346","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Behavioral Indicator-Based Initial Flight Training Competency Assessment Model"],"prefix":"10.3390","volume":"13","author":[{"given":"Hong","family":"Sun","sequence":"first","affiliation":[{"name":"Flight Technology and Flight Safety Research Base, Civil Aviation Flight University of China, Guanghan 618307, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7636-3591","authenticated-orcid":false,"given":"Fangquan","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Airport, Civil Aviation Flight University of China, Guanghan 618307, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5923-474X","authenticated-orcid":false,"given":"Peiwen","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Economics and Management, Civil Aviation Flight University of China, Guanghan 618307, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qingqing","family":"Hu","sequence":"additional","affiliation":[{"name":"School of Airport, Civil Aviation Flight University of China, Guanghan 618307, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ouyang, T., Sun, H., and Li, F. (2021, January 11). Researches on the Education Reform for the Core Competencies -oriented Flight Training of Civil Aviation Pilots. Proceedings of the Proceedings of 2021 6th International Conference on Education Reform and Modern Management (ERMM2021), Beijing, China.","DOI":"10.2991\/assehr.k.210513.088"},{"key":"ref_2","unstructured":"Holbrook, J. (2021, January 5). Exploring methods to collect and analyze data on human contributions to aviation safety. Proceedings of the 49th International Symposium on Aviation Psychology, Online."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Rose, R.L., Puranik, T.G., and Mavris, D.N. (2020). Natural language processing based method for clustering and analysis of aviation safety narratives. Aerospace, 7.","DOI":"10.3390\/aerospace7100143"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Pate, J., and Adegbija, T. (2018, January 12\u201315). AMELIA: An application of the Internet of Things for aviation safety. Proceedings of the 2018 15th IEEE Annual Consumer Communications & Networking Conference (CCNC), Las Vegas, NV, USA.","DOI":"10.1109\/CCNC.2018.8319163"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1080\/00140139.2018.1502806","article-title":"A method of applying flight data to evaluate landing operation performance","volume":"62","author":"Wang","year":"2019","journal-title":"Ergonomics"},{"key":"ref_6","unstructured":"Feigl, F. (2018). Combination of ADS-B and QAR Data for Mid-Air Collision Analysis, Technische Universit\u00e4t M\u00fcnchen."},{"key":"ref_7","first-page":"1","article-title":"Investigating the impacts of COVID-19 on aviation safety based on occurrences captured through Flight Data Monitoring","volume":"2022","author":"Li","year":"2022","journal-title":"Ergonomics"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gavrilovski, A., Jimenez, H., Mavris, D.N., Rao, A.H., Shin, S., Hwang, I., and Marais, K. (2016, January 4\u20138). Challenges and opportunities in flight data mining: A review of the state of the art. Proceedings of the AIAA SciTech Forum, San Diego, CA, USA.","DOI":"10.2514\/6.2016-0923"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wang, L., Wu, C., Sun, R., and Cui, Z. (2014, January 22\u201327). An analysis of hard landing incidents based on flight QAR data. Proceedings of the Engineering Psychology and Cognitive Ergonomics: 11th International Conference, EPCE 2014, Heraklion, Crete, Greece.","DOI":"10.1007\/978-3-319-07515-0_40"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wang, L., Wu, C., and Sun, R. (2013, January 21\u201326). Pilot operating characteristics analysis of long landing based on flight QAR data. Proceedings of the Engineering Psychology and Cognitive Ergonomics. Applications and Services: 10th International Conference, EPCE 2013, Las Vegas, NV, USA.","DOI":"10.1007\/978-3-642-39354-9_18"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.ress.2014.03.013","article-title":"An analysis of flight Quick Access Recorder (QAR) data and its applications in preventing landing incidents","volume":"127","author":"Wang","year":"2014","journal-title":"Reliab. Eng. Syst. Safety"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2357","DOI":"10.1016\/j.promfg.2015.07.383","article-title":"Fatigue detection in commercial flight operations: Results using physiological measures","volume":"3","author":"Thomas","year":"2015","journal-title":"Procedia Manuf."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"185360","DOI":"10.1109\/ACCESS.2019.2959626","article-title":"A new assessment method of the pilot stress using ECG signals during complex special flight operation","volume":"7","author":"Shao","year":"2019","journal-title":"IEEE Access"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1016\/j.cja.2021.11.010","article-title":"Real-time evaluation method of flight mission load based on sensitivity analysis of physiological factors","volume":"35","author":"Jun","year":"2022","journal-title":"Chin. J. Aeronaut."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1027\/2192-0923\/a000120","article-title":"An input\u2013process\u2013output model of pilot core competencies","volume":"7","author":"Mansikka","year":"2017","journal-title":"Aviat. Psychol. Appl. Human Factors"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Liu, S., Zhang, Y., and Chen, J. (2018, January 15\u201320). A system for evaluating pilot performance based on flight data. Proceedings of the Engineering Psychology and Cognitive Ergonomics: 15th International Conference, EPCE 2018, Las Vegas, NV, USA.","DOI":"10.1007\/978-3-319-91122-9_49"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sembiring, J., Drees, L., and Holzapfel, F. (2013, January 19\u201322). Extracting unmeasured parameters based on quick access recorder data using parameter-estimation method. Proceedings of the AIAA Atmospheric Flight Mechanics (AFM) Conference, Boston, MA, USA.","DOI":"10.2514\/6.2013-4848"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wang, L., Ren, Y., Sun, H., and Dong, C. (2017, January 9\u201314). A landing operation performance evaluation system based on flight data. Proceedings of the Engineering Psychology and Cognitive Ergonomics: Cognition and Design: 14th International Conference, EPCE 2017, Vancouver, BC, Canada.","DOI":"10.1007\/978-3-319-58475-1_22"},{"key":"ref_19","first-page":"387","article-title":"Heart rate and performance during combat missions in a flight simulator","volume":"78","author":"Lahtinen","year":"2007","journal-title":"Aviat. Space Environ. Med."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1016\/j.trpro.2021.11.116","article-title":"Case study of pilot\u2019s Heart Rate Variability (HRV) during flight operation","volume":"59","author":"Maciejewska","year":"2021","journal-title":"Transp. Res. Procedia"},{"key":"ref_21","first-page":"267","article-title":"Models of pilot behavior and their use to evaluate the state of pilot training","volume":"67","author":"Jirgl","year":"2016","journal-title":"J. Electr. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"253","DOI":"10.2478\/orga-2013-0025","article-title":"Competency based training need assessment\u2013approach in Indian companies","volume":"46","author":"Sarkar","year":"2013","journal-title":"Organizacija"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chen, J., Xue, L., and Liu, Z. (2020, January 21\u201324). A pilot workload evaluation method based on EEG data and physiological data. Proceedings of the 2020 IEEE international conference on signal processing, communications and computing (ICSPCC), Macau, China.","DOI":"10.1109\/ICSPCC50002.2020.9259473"},{"key":"ref_24","unstructured":"Dehais, F., Causse, M., and Pastor, J. (2008, January 1\u20134). Embedded eye tracker in a real aircraft: New perspectives on pilot\/aircraft interaction monitoring. Proceedings of the 3rd International Conference on Research in Air Transportation, Fairfax, VA, USA."},{"key":"ref_25","unstructured":"Arana, R. (2023, May 16). Horizontaliza\u00e7\u00e3o na Observa\u00e7\u00e3o de Habilidades N\u00e3o-T\u00e9cnicas nos Treinamentos em Simulador. Available online: https:\/\/repositorio.animaeducacao.com.br\/handle\/ANIMA\/13557."}],"container-title":["Applied Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3417\/13\/10\/6346\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:40:15Z","timestamp":1760125215000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3417\/13\/10\/6346"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,22]]},"references-count":25,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,5]]}},"alternative-id":["app13106346"],"URL":"https:\/\/doi.org\/10.3390\/app13106346","relation":{},"ISSN":["2076-3417"],"issn-type":[{"value":"2076-3417","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,22]]}}}