{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T21:41:13Z","timestamp":1773524473980,"version":"3.50.1"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2023,9,15]],"date-time":"2023-09-15T00:00:00Z","timestamp":1694736000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,9,15]],"date-time":"2023-09-15T00:00:00Z","timestamp":1694736000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"the Key Project of the Civil Aviation Joint Fund of the National Natural Science Foundation of China","award":["U2033213"],"award-info":[{"award-number":["U2033213"]}]},{"name":"the Independent Project of the Research Base of Civil Aviation Flight Technology and Flight Safety","award":["FZ2021ZZ01"],"award-info":[{"award-number":["FZ2021ZZ01"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Cogn Tech Work"],"published-print":{"date-parts":[[2023,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>A pilot's control behavior has a direct impact on aviation safety. To adapt to new flight training reforms, a competency-based assessment method is proposed in this paper. First, assessment scenarios, key competencies and observable behaviours were determined. Then, observable behavior assessment indexes were developed based on standard operating procedures and practical examination standards. Flight training data were analyzed based on curve similarity theory and a time series fast retrieval algorithm, and the assessment indexes were scored. The competency assessment method was established by quantifying \u201cHOW MANY\u201d and \u201cHOW OFTEN\u201d observable behaviors according to the assessment indexes score results. Finally, the fuzzy C-means clustering algorithm was used to classify the assessment values, and assessment results were obtained. A teardrop pattern procedure was used to test the reliability of the assessment method. The results indicate that the correlation coefficient between the model evaluation and the expert evaluation is 0.947 with a significance level of 0.01, reliably and objectively quantifying manual flight performance and improving the scientific nature of manual flight performance assessment methods. Flight training institutions can use this method to establish diverse assessment scenarios and formulate corresponding assessment indexes based on the characteristics of each pilot to reasonably evaluate the manual flight performance of pilot. Targeted training methods can then be adopted for pilot with different performance levels to improve their competency.<\/jats:p>","DOI":"10.1007\/s10111-023-00737-3","type":"journal-article","created":{"date-parts":[[2023,9,15]],"date-time":"2023-09-15T12:01:54Z","timestamp":1694779314000},"page":"345-356","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Competency-based assessment of pilots\u2019 manual flight performance during instrument flight training"],"prefix":"10.1007","volume":"25","author":[{"given":"Hong","family":"Sun","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0009-0006-7947-4744","authenticated-orcid":false,"given":"Xin","family":"Zhou","sequence":"additional","affiliation":[]},{"given":"Peiwen","family":"Zhang","sequence":"additional","affiliation":[]},{"given":"Xin","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Yunsong","family":"Lu","sequence":"additional","affiliation":[]},{"given":"Hong","family":"Huang","sequence":"additional","affiliation":[]},{"given":"Wuyang","family":"Song","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,9,15]]},"reference":[{"issue":"2","key":"737_CR1","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1137\/130920526","volume":"43","author":"PK Agarwal","year":"2014","unstructured":"Agarwal PK, Avraham RB, Kaplan H, Sharir M (2014) Computing the discrete Fr\u00e9chet distance in subquadratic time. SIAM J Comput 43(2):429\u2013449","journal-title":"SIAM J Comput"},{"key":"737_CR2","doi-asserted-by":"publisher","DOI":"10.1016\/j.enpol.2022.112923","author":"J Ahlrichs","year":"2022","unstructured":"Ahlrichs J, Rockstuhl S (2022) Estimating fair rent increases after building retrofits: a max-min fairness approach. Energy Policy. https:\/\/doi.org\/10.1016\/j.enpol.2022.112923","journal-title":"Energy Policy"},{"issue":"4","key":"737_CR3","doi-asserted-by":"publisher","first-page":"2197","DOI":"10.3390\/ijerph19042197","volume":"19","author":"HM Alidrisi","year":"2022","unstructured":"Alidrisi HM, Mohamed S (2022) Developing a personal leadership competency model for safety managers: a systems thinking approach. Int J Environ Res Public Health 19(4):2197\u20132197","journal-title":"Int J Environ Res Public Health"},{"key":"737_CR4","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1016\/j.ipl.2018.06.011","volume":"138","author":"TM Chan","year":"2018","unstructured":"Chan TM, Rahmati Z (2018) An improved approximation algorithm for the discrete Fr\u00e9chet distance. Inf Process Lett 138:72\u201374","journal-title":"Inf Process Lett"},{"key":"737_CR5","doi-asserted-by":"crossref","unstructured":"Chen R, Jin J (2021) Detection of influential features of hard landing based on QAR data. In: 2021 IEEE 3rd international conference on civil aviation safety and information technology. https:\/\/ieeexplore.ieee.org\/document\/9633658","DOI":"10.1109\/ICCASIT53235.2021.9633658"},{"issue":"3","key":"737_CR6","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1080\/01969722.2021.1983701","volume":"53","author":"CC Chen","year":"2022","unstructured":"Chen CC, Wei CC, Chen SH, Sun LM, Lin HH (2022) AI predicted competency model to maximize job performance. Cybernet Syst 53(3):298\u2013317","journal-title":"Cybernet Syst"},{"key":"737_CR7","unstructured":"EASA (2022) Annual safety review 2022. https:\/\/www.easa.europa.eu\/en\/document-library\/general-publications\/annual-safety-review-2022.  Accessed 12 May 2023"},{"key":"737_CR8","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2021.103867","author":"V Fr\u00e9d\u00e9ric","year":"2021","unstructured":"Fr\u00e9d\u00e9ric V (2021) Heuristic-based method for conflict discovery of shared control between humans and autonomous systems\u2014a driving automation case study. Robot Auton Syst. https:\/\/doi.org\/10.1016\/j.robot.2021.103867","journal-title":"Robot Auton Syst"},{"key":"737_CR9","doi-asserted-by":"publisher","DOI":"10.3390\/ijgi6110326","author":"N Guo","year":"2017","unstructured":"Guo N, Ma M, Xiong W, Chen L, Jing N (2017) An efficient query algorithm for trajectory similarity based on Fr\u00e9chet distance threshold. ISPRS Int J Geo Inf. https:\/\/doi.org\/10.3390\/ijgi6110326","journal-title":"ISPRS Int J Geo Inf"},{"issue":"1","key":"737_CR10","first-page":"33","volume":"109","author":"M Hashemian","year":"2021","unstructured":"Hashemian M, ZareFarashbandi F, Yamani N, Rahimi A, Adibi P (2021) A core competency model for clinical informationists. J Med Lib Assoc JMLA 109(1):33\u201343","journal-title":"J Med Lib Assoc JMLA"},{"key":"737_CR11","unstructured":"IATA (2021) Competency assessment and evaluation for pilots, instructors and evaluators. https:\/\/www.iata.org\/contentassets\/c0f61fc821dc4f62bb6441d7abedb076\/competency-assessment-and-evaluation-for-pilots-instructors-and-evaluators-gm.pdf. Accessed 12 May 2023"},{"key":"737_CR12","unstructured":"ICAO (2013) Manual of evidence-based training (Doc 9995). https:\/\/store.icao.int\/en\/manual-of-evidence-based-training-doc-9995. Accessed 12 May 2023"},{"key":"737_CR13","unstructured":"ICAO (2020) Procedures for air navigation services-training (Doc 9868). https:\/\/store.icao.int\/en\/procedures-for-air-navigation-services-training-doc-9868. Accessed 12 May 2023"},{"issue":"4","key":"737_CR14","doi-asserted-by":"publisher","first-page":"129","DOI":"10.12985\/ksaa.2018.26.4.129","volume":"26","author":"GM Jeong","year":"2018","unstructured":"Jeong GM, Lee Y, Lee CH, Kim MK, Lee JW (2018) Assessment of pilot training effectiveness of VR HMD based flight training device. J Korean Soc Aviat Aeronaut 26(4):129\u2013141","journal-title":"J Korean Soc Aviat Aeronaut"},{"issue":"17","key":"737_CR15","doi-asserted-by":"publisher","first-page":"4452","DOI":"10.3390\/en13174452","volume":"13","author":"M Jirgl","year":"2020","unstructured":"Jirgl M, Boril J, Jalovecky R (2020) Statistical evaluation of Pilot\u2019s behavior models parameters connected to military flight training. Energies 13(17):4452\u20134452","journal-title":"Energies"},{"issue":"2","key":"737_CR16","doi-asserted-by":"publisher","first-page":"595","DOI":"10.1111\/biom.12812","volume":"74","author":"Q Liu","year":"2018","unstructured":"Liu Q, Li C, Wanga V, Shepherd BE (2018) Covariate-adjusted Spearman\u2019s rank correlation with probability-scale residuals. Biometrics 74(2):595\u2013605","journal-title":"Biometrics"},{"issue":"8","key":"737_CR17","first-page":"250","volume":"42","author":"H Liu","year":"2021","unstructured":"Liu H, Wang H, Meng G, Hao Wu, Zhou M (2021) Flight training evaluation based on dynamic Bayesian network and fuzzy gray theory. Acta Aeronaut Astronaut Sin 42(8):250\u2013261","journal-title":"Acta Aeronaut Astronaut Sin"},{"key":"737_CR18","doi-asserted-by":"publisher","DOI":"10.1142\/S0218001421500191","author":"W Luo","year":"2021","unstructured":"Luo W, Li Y, Yao F, Wang S, Li Z, Zhan P, Li X (2021) Multi-resolution representation for streaming time series retrieval. Int J Pattern Recognit Artif Intell. https:\/\/doi.org\/10.1142\/S0218001421500191","journal-title":"Int J Pattern Recognit Artif Intell"},{"issue":"1","key":"737_CR19","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1037\/h0038240","volume":"29","author":"DC McClelland","year":"1974","unstructured":"McClelland DC (1974) \u201cTesting for competence rather than for \u2018intelligence\u2019\u201d: reply. Am Psychol 29(1):59\u201359","journal-title":"Am Psychol"},{"issue":"8","key":"737_CR20","doi-asserted-by":"publisher","first-page":"178","DOI":"10.3390\/economies10080178","volume":"10","author":"SP Migkos","year":"2022","unstructured":"Migkos SP, Sakas DP, Giannakopoulos NT, Georgios K, Anastasia M (2022) Analyzing Greece 2010 memorandum\u2019s impact on macroeconomic and financial figures through FCM. Economies 10(8):178\u2013178","journal-title":"Economies"},{"issue":"1","key":"737_CR21","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1177\/1071181320641047","volume":"64","author":"CG Oh","year":"2020","unstructured":"Oh CG (2020) Pros and cons of a VR-based flight training simulator; empirical evaluations by student and instructor pilots. Proc Hum Fact Ergon Soc Annu Meet 64(1):193\u2013197","journal-title":"Proc Hum Fact Ergon Soc Annu Meet"},{"issue":"23","key":"737_CR22","doi-asserted-by":"publisher","first-page":"3951","DOI":"10.3390\/rs12233951","volume":"12","author":"S Pailot-Bonn\u00e9tat","year":"2020","unstructured":"Pailot-Bonn\u00e9tat S, Harris AJ, Calvari S, De Michele M, Gurioli L (2020) Plume height time-series retrieval using shadow in single spatial resolution satellite images. Remote Sens 12(23):3951. https:\/\/doi.org\/10.3390\/rs12233951","journal-title":"Remote Sens"},{"key":"737_CR23","doi-asserted-by":"publisher","DOI":"10.1016\/j.enpol.2022.112923","author":"SK Panda","year":"2015","unstructured":"Panda SK, Jana PK (2015) Efficient task scheduling algorithms for heterogeneous multi-cloud environment. J Supercomput. https:\/\/doi.org\/10.1016\/j.enpol.2022.112923","journal-title":"J Supercomput"},{"issue":"12","key":"737_CR24","doi-asserted-by":"publisher","first-page":"660","DOI":"10.1089\/omi.2022.0135","volume":"26","author":"JC Rosa","year":"2022","unstructured":"Rosa JC, Aleman JO, Mohabir J, Liang Y, Breslow JL, Holt PR (2022) The application of Spearman partial correlation for screening predictors of weight loss in a multiomics dataset. OMICS J Integr Biol 26(12):660\u2013670","journal-title":"OMICS J Integr Biol"},{"issue":"6","key":"737_CR25","doi-asserted-by":"publisher","first-page":"2921","DOI":"10.3390\/app12062921","volume":"12","author":"J Rymarz","year":"2022","unstructured":"Rymarz J, Niewczas A, Ho\u0142yszko P, D\u0119bicka E (2022) Application of Spearman\u2019s method for the analysis of the causes of long-term post-failure downtime of city buses. Appl Sci 12(6):2921\u20132921","journal-title":"Appl Sci"},{"issue":"12","key":"737_CR26","first-page":"429","volume":"42","author":"YK Saheed","year":"2022","unstructured":"Saheed YK, Abiodun AI, Misra S, Holone MK, Colomo-Palacios R (2022) A machine learning-based intrusion detection for detecting internet of things network attacks. Alex Eng J 42(12):429\u2013449","journal-title":"Alex Eng J"},{"issue":"23","key":"737_CR27","doi-asserted-by":"publisher","first-page":"3916","DOI":"10.3390\/electronics11233916","volume":"11","author":"Y Shi","year":"2022","unstructured":"Shi Y (2022) Application of FCM clustering algorithm in digital library management system. Electronics 11(23):3916\u20133916. https:\/\/doi.org\/10.3390\/electronics11233916","journal-title":"Electronics"},{"issue":"5","key":"737_CR28","doi-asserted-by":"publisher","first-page":"914","DOI":"10.3390\/healthcare10050914","volume":"10","author":"Y Song","year":"2022","unstructured":"Song Y, Chun D, Xiong P, Wang X (2022) Construction of talent competency model for senior care professionals in intelligent institutions. Healthcare 10(5):914\u2013914","journal-title":"Healthcare"},{"issue":"1","key":"737_CR29","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1097\/RNJ.0000000000000350","volume":"47","author":"S Vaughn","year":"2022","unstructured":"Vaughn S, Rye J, Allen A, Bok A, Mauk K, Park L, Pierce L, Holler WW (2022) Updated competency model for professional rehabilitation nursing: practice applications. Rehabil Nurs J 47(1):12\u201323","journal-title":"Rehabil Nurs J"},{"issue":"1","key":"737_CR30","first-page":"80","volume":"37","author":"B Wang","year":"2019","unstructured":"Wang B, Jun Du, Ding C, Zhentao Wu, Zhang S (2019) Flight quality evaluation of aircraft take-off stage based on AHP-TOPSIS method. Flight Dyn 37(1):80\u201384","journal-title":"Flight Dyn"},{"issue":"7","key":"737_CR31","doi-asserted-by":"publisher","first-page":"5194","DOI":"10.1166\/asl.2018.11700","volume":"24","author":"Q Wu","year":"2018","unstructured":"Wu Q, Wang P, Liu E et al (2018b) Design and implementation of learning management platform for aviation flight training based on SCORM\/AICC standard\u2014a case study of k airline company flight training learning platform. Adv Sci Lett 24(7):5194\u20135198","journal-title":"Adv Sci Lett"},{"issue":"S1","key":"737_CR32","first-page":"24","volume":"38","author":"Y Yao","year":"2017","unstructured":"Yao Y, Xu K (2017) Quality assessment of flight training based on BP neural network. Acta Aeronaut Astronaut Sin 38(S1):24\u201332","journal-title":"Acta Aeronaut Astronaut Sin"},{"issue":"6","key":"737_CR33","doi-asserted-by":"publisher","first-page":"1012","DOI":"10.1108\/AEAT-04-2018-0133","volume":"90","author":"E Yazgan","year":"2018","unstructured":"Yazgan E (2018) Development taxonomy of human risk factors for corporate sustainability in aviation sector. Aircr Eng Aerosp Technol 90(6):1012\u20131022","journal-title":"Aircr Eng Aerosp Technol"},{"key":"737_CR34","first-page":"395","volume":"2","author":"C Yin","year":"2008","unstructured":"Yin C, Ye Sh (2008) CBR algorithm supporting time series data. Appl Res Comput 2:395\u2013397+400","journal-title":"Appl Res Comput"},{"issue":"C","key":"737_CR35","doi-asserted-by":"publisher","first-page":"4493","DOI":"10.1016\/j.promfg.2015.07.463","volume":"3","author":"L Zhang","year":"2015","unstructured":"Zhang L, Zhang W, Zhu Z, Ding L (2015) Probing into the evaluation of flight training in special environment based on EMGs. Procedia Manuf 3(C):4493\u20134500","journal-title":"Procedia Manuf"},{"issue":"3","key":"737_CR36","doi-asserted-by":"publisher","first-page":"876","DOI":"10.1002\/cae.22491","volume":"30","author":"Z Zhang","year":"2022","unstructured":"Zhang Z, Ning M, Wu Z, Liu C, Li J (2022) Construction of a competition practice system for robotics engineering based on a competency model. Comput Appl Eng Educ 30(3):876\u2013891","journal-title":"Comput Appl Eng Educ"},{"issue":"6","key":"737_CR37","first-page":"75","volume":"39","author":"Z Zhu","year":"2021","unstructured":"Zhu Z, Qian Y, Wang J, Yi X (2021) Evaluation of flight training quality based on time series similarity. Flight Dyn 39(6):75\u201381","journal-title":"Flight Dyn"}],"container-title":["Cognition, Technology &amp; Work"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10111-023-00737-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10111-023-00737-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10111-023-00737-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T05:05:01Z","timestamp":1697864701000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10111-023-00737-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,15]]},"references-count":37,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,11]]}},"alternative-id":["737"],"URL":"https:\/\/doi.org\/10.1007\/s10111-023-00737-3","relation":{},"ISSN":["1435-5558","1435-5566"],"issn-type":[{"value":"1435-5558","type":"print"},{"value":"1435-5566","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,15]]},"assertion":[{"value":"26 June 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 September 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}