{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T03:09:23Z","timestamp":1778900963741,"version":"3.51.4"},"reference-count":63,"publisher":"Wiley","issue":"6","license":[{"start":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T00:00:00Z","timestamp":1777420800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"},{"start":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T00:00:00Z","timestamp":1777420800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Expert Systems"],"published-print":{"date-parts":[[2026,6]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:p>Measurement of executive function (EF) in early childhood is critical for the identification of developmental pathways and the planning of timely interventions, but standard behavioural measures are frequently subjective, time\u2010consuming and of limited scalability. Standard unimodal methods that depend exclusively on video or audio are not robust enough to be able to capture the richness of children's cognitive and behavioural signals. To overcome these limitations, we introduce a multimodal fusion and deep learning\u2010based behaviour recognition approach that combines video, audio and sensor\u2010derived features for the automated EF assessment. The novelty of this research is to combine heterogeneous data streams using multimodal fusion and provide a richer and more accurate representation of cognitive states in contrast to single\u2010modality baselines. Experimental findings show that the model proposed by us achieves 97.75% accuracy, with precision (0.9809), recall (0.976) and F1\u2010score (0.9781) but with low RMSE and high correlation with human\u2010rated EF scores. Comparative analysis identifies that our framework is much superior to baseline models like ResNet50\u2009+\u2009LSTM (53.37%), Bi\u2010LSTM with MFCCs (25.72%) and MS\u2010RRBR (94.94%), validating the advantage of multimodal integration. The method yields consistent and strong classification across levels of cognition, backed up by ROC\/PR curves with nearly perfect AUC values and confusion matrix evaluation with negligible misclassification. Aside from improved performance, the methodology presents a scalable and unbiased instrument for early cognitive testing, with possible uses in educational technology and clinical applications. Overall, this research provides an effective and explainable AI\u2010based approach for progressing personalised learning and early child development assessment.<\/jats:p>","DOI":"10.1111\/exsy.70263","type":"journal-article","created":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T01:05:16Z","timestamp":1777511116000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Multimodal Fusion and Deep Learning\u2010Based Behaviour Recognition Model for Assessing Executive Function in Young Children"],"prefix":"10.1111","volume":"43","author":[{"given":"Teng","family":"Xie","sequence":"first","affiliation":[{"name":"College of Teacher Education Longyan University  Longyan Fujian China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dingyu","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Teacher Education Longyan University  Longyan Fujian China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-7932-9115","authenticated-orcid":false,"given":"Wei","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Foreign Languages Longyan University  Longyan Fujian China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2026,4,29]]},"reference":[{"key":"e_1_2_11_2_1","doi-asserted-by":"publisher","DOI":"10.3390\/technologies11050115"},{"key":"e_1_2_11_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2023.122864"},{"key":"e_1_2_11_4_1","doi-asserted-by":"publisher","DOI":"10.3390\/jimaging6060046"},{"key":"e_1_2_11_5_1","doi-asserted-by":"publisher","DOI":"10.3390\/diagnostics15010060"},{"key":"e_1_2_11_6_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598\u2010025\u201009862\u20107"},{"key":"e_1_2_11_7_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12888\u2010024\u201005987\u20107"},{"key":"e_1_2_11_8_1","unstructured":"BAAI.2025.\u201cBAAI\/ChildMandarin Datasets at Hugging Face.\u201dhttps:\/\/huggingface.co\/datasets\/BAAI\/ChildMandarin."},{"key":"e_1_2_11_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803\u2010022\u201005767\u2010w"},{"key":"e_1_2_11_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371\u2010021\u201002166\u20107"},{"key":"e_1_2_11_11_1","doi-asserted-by":"publisher","DOI":"10.3390\/electronics14142837"},{"key":"e_1_2_11_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-83314-4_1"},{"key":"e_1_2_11_13_1","doi-asserted-by":"publisher","DOI":"10.1111\/bjet.12959"},{"key":"e_1_2_11_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12021\u2010019\u201009419\u2010w"},{"key":"e_1_2_11_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042\u2010024\u201018918\u20101"},{"key":"e_1_2_11_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00521\u2010024\u201010821\u2010y"},{"key":"e_1_2_11_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12144\u2010024\u201007076\u20100"},{"key":"e_1_2_11_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2021.3057635"},{"key":"e_1_2_11_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogsys.2025.101379"},{"key":"e_1_2_11_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2025.122704"},{"key":"e_1_2_11_21_1","doi-asserted-by":"publisher","DOI":"10.3389\/fphys.2024.1344887"},{"key":"e_1_2_11_22_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0299127"},{"key":"e_1_2_11_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10032\u2010024\u201000464\u2010z"},{"key":"e_1_2_11_24_1","doi-asserted-by":"publisher","DOI":"10.3390\/s23010246"},{"key":"e_1_2_11_25_1","doi-asserted-by":"publisher","DOI":"10.24272\/j.issn.2095\u20108137.2022.449"},{"key":"e_1_2_11_26_1","doi-asserted-by":"publisher","DOI":"10.20944\/preprints202502"},{"key":"e_1_2_11_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s44163\u2010025\u201000480\u2010w"},{"key":"e_1_2_11_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2025.130113"},{"key":"e_1_2_11_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2022.3219551"},{"key":"e_1_2_11_30_1","doi-asserted-by":"publisher","DOI":"10.3390\/s24082467"},{"key":"e_1_2_11_31_1","doi-asserted-by":"publisher","DOI":"10.3390\/app122211457"},{"key":"e_1_2_11_32_1","doi-asserted-by":"publisher","DOI":"10.3390\/diagnostics15172232"},{"key":"e_1_2_11_33_1","doi-asserted-by":"publisher","DOI":"10.1177\/00131644231193625"},{"key":"e_1_2_11_34_1","doi-asserted-by":"publisher","DOI":"10.3390\/technologies12020015"},{"key":"e_1_2_11_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11831\u2010021\u201009682\u20108"},{"key":"e_1_2_11_36_1","doi-asserted-by":"publisher","DOI":"10.3390\/s23042182"},{"key":"e_1_2_11_37_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20236856"},{"key":"e_1_2_11_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00521\u2010024\u201009628\u20108"},{"key":"e_1_2_11_39_1","doi-asserted-by":"publisher","DOI":"10.3390\/s24124016"},{"key":"e_1_2_11_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2023.3312172"},{"key":"e_1_2_11_41_1","doi-asserted-by":"publisher","DOI":"10.3390\/s22208066"},{"key":"e_1_2_11_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40747\u2010025\u201002012\u20106"},{"key":"e_1_2_11_43_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40708\u2010023\u201000217\u20104"},{"key":"e_1_2_11_44_1","doi-asserted-by":"publisher","DOI":"10.1159\/000512394"},{"key":"e_1_2_11_45_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21124246"},{"key":"e_1_2_11_46_1","doi-asserted-by":"publisher","DOI":"10.1080\/08839514.2021.2004655"},{"key":"e_1_2_11_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042\u2010023\u201017504\u20101"},{"key":"e_1_2_11_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12559\u2010024\u201010346\u20105"},{"key":"e_1_2_11_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2025.111447"},{"key":"e_1_2_11_50_1","doi-asserted-by":"publisher","DOI":"10.18280\/isi.290633"},{"key":"e_1_2_11_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2024.114371"},{"key":"e_1_2_11_52_1","doi-asserted-by":"publisher","DOI":"10.3390\/buildings15132291"},{"key":"e_1_2_11_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00521\u2010024\u201010371\u20103"},{"key":"e_1_2_11_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2025.3543226"},{"key":"e_1_2_11_55_1","doi-asserted-by":"publisher","DOI":"10.3390\/app15031577"},{"key":"e_1_2_11_56_1","article-title":"ICANet: A Method of Short Video Emotion Recognition Driven by Multimodal Data","author":"Wu X.","year":"2022","journal-title":"arXiv preprint"},{"key":"e_1_2_11_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11227\u2010025\u201007494\u20102"},{"key":"e_1_2_11_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00607\u2010019\u201000722\u20107"},{"key":"e_1_2_11_59_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ergon.2026.103892"},{"key":"e_1_2_11_60_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21020370"},{"key":"e_1_2_11_61_1","doi-asserted-by":"publisher","DOI":"10.1002\/brb3.70556"},{"key":"e_1_2_11_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2020.2985082"},{"key":"e_1_2_11_63_1","unstructured":"zhou91ying.2025.\u201czhou91ying\/CSMACD. GitHub.\u201dhttps:\/\/github.com\/zhou91ying\/CSMACD."},{"key":"e_1_2_11_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12559\u2010024\u201010287\u2010z"}],"container-title":["Expert Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/exsy.70263","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/exsy.70263","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/exsy.70263","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T02:11:09Z","timestamp":1778897469000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/exsy.70263"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,29]]},"references-count":63,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2026,6]]}},"alternative-id":["10.1111\/exsy.70263"],"URL":"https:\/\/doi.org\/10.1111\/exsy.70263","archive":["Portico"],"relation":{},"ISSN":["0266-4720","1468-0394"],"issn-type":[{"value":"0266-4720","type":"print"},{"value":"1468-0394","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,29]]},"assertion":[{"value":"2025-09-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-04-13","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-04-29","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70263"}}