{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T19:40:14Z","timestamp":1781206814480,"version":"3.54.1"},"reference-count":52,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2023,4,14]],"date-time":"2023-04-14T00:00:00Z","timestamp":1681430400000},"content-version":"vor","delay-in-days":103,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62106117"],"award-info":[{"award-number":["62106117"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"publisher","award":["2022M711741"],"award-info":[{"award-number":["2022M711741"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007129","name":"Natural Science Foundation of Shandong Province","doi-asserted-by":"publisher","award":["ZR2021QF084"],"award-info":[{"award-number":["ZR2021QF084"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["International Journal of Intelligent Systems"],"published-print":{"date-parts":[[2023,1]]},"abstract":"<jats:p>Currently, hand motion recognition of single\u2010modality data has been extensively explored for the analysis of various contact and noncontact sensors, and it is recognized that all the existing technologies have both strengths and limitations. As a significant motor symptom, hand tremor is usually utilized for the diagnosis and evaluation of Parkinson\u2019s disease; furthermore, a multimodal analysis of the handwriting pattern of the patient has made up for the one\u2010sided way of learning the hand movement in a single measurement dimension. Especially, considering a variety of measurement resources, it shows promising performance in recognizing handwriting patterns of Parkinson\u2019s disease. In this work, a novel Spatio\u2010temporal Siamese neural network (ST\u2010SiamNN) is proposed to learn the handwriting differences between healthy individuals and patients with Parkinson\u2019s disease, process data onto multiple sensors, and enhance the characteristics of handwriting in Parkinson\u2019s disease. Uniquely, it is a discriminative model of multilabel and multinetwork constructed by a Siamese network, which consists of four modules: a preprocessor for handwritten data enhancement, a Siamese bidirectional memory neural network (SiamBiMNN) for temporal and texture feature extraction and difference enhancement, a Siamese octave convolutional neural network (SiamOctCNN) for spatial feature extraction and difference enhancement, and a decision\u2010making layer to rejudge the output features of the Siamese networks to obtain more accurate auxiliary diagnosis results. The framework proposed in this article is verified on two handwritten datasets of multiple modalities, i.e., images, smart pen signals, and graphics tablet signals, which are compared with several state\u2010of\u2010the\u2010art studies.<\/jats:p>","DOI":"10.1155\/2023\/9921809","type":"journal-article","created":{"date-parts":[[2023,4,14]],"date-time":"2023-04-14T19:35:10Z","timestamp":1681500910000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["A Spatio\u2010Temporal Siamese Neural Network for Multimodal Handwriting Abnormality Screening of Parkinson\u2019s Disease"],"prefix":"10.1155","volume":"2023","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3494-175X","authenticated-orcid":false,"given":"Aite","family":"Zhao","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8416-7710","authenticated-orcid":false,"given":"Huimin","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2797-5564","authenticated-orcid":false,"given":"Ming","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5299-0611","authenticated-orcid":false,"given":"Nana","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2023,4,14]]},"reference":[{"key":"e_1_2_10_1_2","doi-asserted-by":"publisher","DOI":"10.1038\/503029a"},{"key":"e_1_2_10_2_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41582-019-0294-x"},{"key":"e_1_2_10_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/tcyb.2021.3056104"},{"key":"e_1_2_10_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/tmm.2021.3060280"},{"key":"e_1_2_10_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-022-12659-9"},{"key":"e_1_2_10_6_2","doi-asserted-by":"publisher","DOI":"10.1002\/int.22839"},{"key":"e_1_2_10_7_2","article-title":"Cmba-svm: a clinical approach for Parkinson disease diagnosis","volume":"1","author":"Sahu B.","year":"2021","journal-title":"International Journal on Information Technology"},{"key":"e_1_2_10_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2020.104283"},{"key":"e_1_2_10_9_2","doi-asserted-by":"publisher","DOI":"10.1166\/jmihi.2017.2033"},{"key":"e_1_2_10_10_2","doi-asserted-by":"crossref","unstructured":"AliL. KhanS. U. ArshadM. AliS. andAnwarM. A multi-model framework for evaluating type of speech samples having complementary information about Parkinson\u2019s disease Proceedings of the 2019 International Conference on Electrical Communication and Computer Engineering (ICECCE) July 2019 Swat Pakistan.","DOI":"10.1109\/ICECCE47252.2019.8940696"},{"key":"e_1_2_10_11_2","doi-asserted-by":"crossref","unstructured":"BevilacquaV. LoconsoleC. BrunettiA. CascaranoG. D. andSciascioE. D. A model-free computer-assisted handwriting analysis exploiting optimal topology ANNs on biometric signals in Parkinson\u2019s disease research Proceedings of the Intelligent Computing Theories and Application August 2018 Wuhan China.","DOI":"10.1007\/978-3-319-95933-7_74"},{"key":"e_1_2_10_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/tie.2022.3161812"},{"key":"e_1_2_10_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/tmc.2022.3174816"},{"key":"e_1_2_10_14_2","first-page":"86","article-title":"Diagnosis and classification of Parkinsons disease using data mining techniques","volume":"3","author":"Durga P.","year":"2016","journal-title":"International Journal of Advanced Research Trends in Engineering and Technology (IJARTET)"},{"key":"e_1_2_10_15_2","article-title":"Detection of Parkinson\u2019s disease from handwriting using deep learning: a comparative study","volume":"1","author":"Taleb C.","year":"2020","journal-title":"Evolutionary Intelligence"},{"key":"e_1_2_10_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/tmm.2022.3176751"},{"key":"e_1_2_10_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.aei.2022.101678"},{"key":"e_1_2_10_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/thms.2021.3086008"},{"key":"e_1_2_10_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2022.116764"},{"key":"e_1_2_10_20_2","article-title":"Sequence-based dynamic handwriting analysis for Parkinson\u2019s disease detection with one-dimensional convolutions and bigrus","volume":"168","author":"Diaz M.","year":"2020","journal-title":"Expert Systems with Applications"},{"key":"e_1_2_10_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-16-0425-6_10"},{"key":"e_1_2_10_22_2","doi-asserted-by":"publisher","DOI":"10.1002\/int.22846"},{"key":"e_1_2_10_23_2","doi-asserted-by":"publisher","DOI":"10.1002\/int.22370"},{"key":"e_1_2_10_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10489-020-02182-5"},{"key":"e_1_2_10_25_2","unstructured":"Abdul HamidN. Handwritten recognition using svm knn and neural network 2017 https:\/\/arxiv.org\/abs\/1702.00723."},{"key":"e_1_2_10_26_2","doi-asserted-by":"crossref","unstructured":"OuyangJ. Combining extreme learning machine rf and hog for feature extraction Proceedings of the 2017 IEEE Third International Conference on Multimedia Big Data (BigMM) April 2017 Laguna Hills CA USA IEEE.","DOI":"10.1109\/BigMM.2017.60"},{"key":"e_1_2_10_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2020.03.309"},{"key":"e_1_2_10_28_2","doi-asserted-by":"crossref","unstructured":"JiaY. ZhaoY. ZhangY. andFanS. A lightweight handwriting recognition system based on an improved convolutional neural network Proceedings of the 2020 9th International Conference on Computing and Pattern Recognition October 2020 Xiamen China.","DOI":"10.1145\/3436369.3436463"},{"key":"e_1_2_10_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/s42979-020-00133-y"},{"key":"e_1_2_10_30_2","article-title":"Multiple-fine-tuned convolutional neural networks for Parkinson\u2019s disease diagnosis from offline handwriting","volume":"52","author":"Gazda M.","year":"2021","journal-title":"IEEE Transactions on Systems Man and Cybernetics"},{"key":"e_1_2_10_31_2","doi-asserted-by":"publisher","DOI":"10.32628\/cseit2062105"},{"key":"e_1_2_10_32_2","doi-asserted-by":"crossref","unstructured":"VoigtlaenderP. DoetschP. andNeyH. Handwriting recognition with large multidimensional long short-term memory recurrent neural networks Proceedings of the 2016 15th International Conference on Frontiers in Handwriting Recognition (ICFHR) October 2017 Shenzhen China.","DOI":"10.1109\/ICFHR.2016.0052"},{"key":"e_1_2_10_33_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_10_34_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-24271-9"},{"key":"e_1_2_10_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.106273"},{"key":"e_1_2_10_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/tpami.2016.2646371"},{"key":"e_1_2_10_37_2","doi-asserted-by":"crossref","unstructured":"LeeI. KimD. KangS. andLeeS. Ensemble deep learning for skeleton-based action recognition using temporal sliding lstm networks Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV) October 2017 Venice Italy.","DOI":"10.1109\/ICCV.2017.115"},{"key":"e_1_2_10_38_2","unstructured":"JiaoW. YangH. KingI. andLyuM. R. HiGRU: hierarchical gated recurrent units for utterance-level emotion recognition Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies June 2019 Minneapolis Minnesota Association for Computational Linguistics 397\u2013406."},{"key":"e_1_2_10_39_2","unstructured":"TanM. QuocV. andEfficientnetL. Rethinking model scaling for convolutional neural networks 2019 https:\/\/arxiv.org\/abs\/1905.11946."},{"key":"e_1_2_10_40_2","article-title":"An image is worth 16x16 words: transformers for image recognition at scale","author":"Dosovitskiy A.","year":"2020","journal-title":"CoRR"},{"key":"e_1_2_10_41_2","article-title":"Mobilevit: light-weight, general-purpose, and mobile-friendly vision transformer","author":"Mehta S.","year":"2021","journal-title":"CoRR"},{"key":"e_1_2_10_42_2","article-title":"A convnet for the 2020s","author":"Liu Z.","year":"2022","journal-title":"CoRR"},{"key":"e_1_2_10_43_2","doi-asserted-by":"crossref","unstructured":"SandlerM. HowardA. ZhuM. ZhmoginovA. andChenL.-C. Mobilenetv2: inverted residuals and linear bottlenecks Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition June 2018 Salt Lake City UT USA 4510\u20134520.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"e_1_2_10_44_2","doi-asserted-by":"crossref","unstructured":"PereiraC. R. WeberS. A. T. HookC. RosaG. H. andPapaJ. P. Deep learning-aided Parkinson\u2019s disease diagnosis from handwritten dynamics Proceedings of the 2016 29th SIBGRAPI Conference on Graphics Patterns and Images (SIBGRAPI) October 2016 Sao Paulo Brazil 340\u2013346.","DOI":"10.1109\/SIBGRAPI.2016.054"},{"key":"e_1_2_10_45_2","unstructured":"IsenkulM. E. SakarB. E. andKursunO. Improved spiral test using digitized graphics tablet for monitoring Parkinson\u2019s disease Proceedings of the 2nd International Conference on E-Health and TeleMedicine-ICEHTM 2014 May 2014 Istanbul Turkey."},{"key":"e_1_2_10_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/jbhi.2013.2245674"},{"key":"e_1_2_10_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2016.08.005"},{"key":"e_1_2_10_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2018.04.001"},{"key":"e_1_2_10_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2019.103477"},{"key":"e_1_2_10_50_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.114405"},{"key":"e_1_2_10_51_2","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1848\/1\/012098"},{"key":"e_1_2_10_52_2","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1631\/1\/012168"}],"container-title":["International Journal of Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/ijis\/2023\/9921809.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/ijis\/2023\/9921809.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/2023\/9921809","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,31]],"date-time":"2024-12-31T05:25:11Z","timestamp":1735622711000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/2023\/9921809"}},"subtitle":[],"editor":[{"given":"Subrata Kumar","family":"Sarker","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2023,1]]},"references-count":52,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,1]]}},"alternative-id":["10.1155\/2023\/9921809"],"URL":"https:\/\/doi.org\/10.1155\/2023\/9921809","archive":["Portico"],"relation":{},"ISSN":["0884-8173","1098-111X"],"issn-type":[{"value":"0884-8173","type":"print"},{"value":"1098-111X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1]]},"assertion":[{"value":"2023-01-13","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-03-23","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-04-14","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"9921809"}}