{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T23:45:40Z","timestamp":1784763940427,"version":"3.55.0"},"reference-count":34,"publisher":"Wiley","issue":"3","license":[{"start":{"date-parts":[[2026,2,9]],"date-time":"2026-02-09T00:00:00Z","timestamp":1770595200000},"content-version":"vor","delay-in-days":8,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"},{"start":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T00:00:00Z","timestamp":1769904000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Eur J of Neuroscience"],"published-print":{"date-parts":[[2026,2]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:p>Freezing of gait is a common, debilitating symptom that affects many patients with Parkinson's disease. The lack of a standard, objective method to quantify freezing obstructs research and treatment. Wearable sensors combined with automatic detection algorithms have demonstrated increasingly promising results; nonetheless, video annotation remains the gold standard. After organizing a global machine learning contest to expedite the development of acceleration\u2010based algorithms designed to automatically detect freezing, we tested the transferability of the winning models to a new dataset. Experts reviewed and annotated a test protocol conducted and videotaped in the homes of 12 patients. The models were applied to acceleration data from a lower back sensor worn by the patients. F1\u2010scores, accuracy, recall, specificity, and precision were computed. Intraclass correlations quantified the agreement between model\u2010estimated and annotation\u2010based gold standard outcomes, including the percent time frozen, the number of episodes, and the total freezing duration. While there was a relatively large drop in performance for some of the models, the performance of the third place model showed good transferability to new data. Indeed, the agreement between the third place model and gold standard annotations was similar to or better than that seen when comparing two raters. These results further support the idea that if the goal is to detect freezing duration or percent time frozen, the combination of a single, lower back sensor and the third place model can be used to automatically detect freezing. Still, if the goal is to count episodes or detect freezing subtypes, additional sensors or other modelling approaches are needed.<\/jats:p>","DOI":"10.1111\/ejn.70424","type":"journal-article","created":{"date-parts":[[2026,2,9]],"date-time":"2026-02-09T08:18:23Z","timestamp":1770625103000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Beyond the Leaderboard: Evaluating the Robustness of Deep Learning Models for Detecting Freezing of Gait"],"prefix":"10.1111","volume":"63","author":[{"given":"Amit","family":"Salomon","sequence":"first","affiliation":[{"name":"Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Medical Center  Tel Aviv Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eran","family":"Gazit","sequence":"additional","affiliation":[{"name":"Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Medical Center  Tel Aviv Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nathaniel","family":"Shimoni","sequence":"additional","affiliation":[{"name":"Datadudes AI  Beer Sheva Israel"},{"name":"Ben Gurion University  Beer Sheva Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lior","family":"Nisimov","sequence":"additional","affiliation":[{"name":"Ben Gurion University  Beer Sheva Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Talia","family":"Herman","sequence":"additional","affiliation":[{"name":"Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Medical Center  Tel Aviv Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valeri","family":"Sandler","sequence":"additional","affiliation":[{"name":"School of Graduate Studies Tel Aviv University  Tel Aviv Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1608-0776","authenticated-orcid":false,"given":"Jeffrey\u00a0M.","family":"Hausdorff","sequence":"additional","affiliation":[{"name":"Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Medical Center  Tel Aviv Israel"},{"name":"Department of Physical Therapy, Gray Faculty of Medical &amp; Health Sciences Tel Aviv University  Tel Aviv Israel"},{"name":"Sagol School of Neuroscience Tel Aviv University  Tel Aviv Israel"},{"name":"Rush Alzheimer's Disease Center and Department of Orthopedic Surgery Rush University Medical Center  Chicago Illinois USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,2,9]]},"reference":[{"key":"e_1_2_12_2_1","doi-asserted-by":"publisher","DOI":"10.3233\/jpd\u2010160927"},{"key":"e_1_2_12_3_1","doi-asserted-by":"publisher","DOI":"10.1177\/1877718x241302766"},{"key":"e_1_2_12_4_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598\u2010024\u201062330\u20106"},{"key":"e_1_2_12_5_1","doi-asserted-by":"publisher","DOI":"10.3390\/s25165054"},{"key":"e_1_2_12_6_1","doi-asserted-by":"publisher","DOI":"10.1002\/mds.27417"},{"key":"e_1_2_12_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10072\u2010021\u201005796\u2010w"},{"key":"e_1_2_12_8_1","doi-asserted-by":"publisher","DOI":"10.3390\/s25165101"},{"key":"e_1_2_12_9_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnagi.2023.1119956"},{"key":"e_1_2_12_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/mdc3.12893"},{"key":"e_1_2_12_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0140\u20106736(14)61393\u20103"},{"key":"e_1_2_12_12_1","doi-asserted-by":"publisher","DOI":"10.2196\/50035"},{"key":"e_1_2_12_13_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2022.828355"},{"key":"e_1_2_12_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/1073858414559101"},{"key":"e_1_2_12_15_1","doi-asserted-by":"publisher","DOI":"10.1177\/1877718x241301065"},{"key":"e_1_2_12_16_1","doi-asserted-by":"publisher","DOI":"10.21037\/mhealth-21-17"},{"key":"e_1_2_12_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.parkreldis.2012.03.001"},{"key":"e_1_2_12_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1474\u20104422(11)70143\u20100"},{"key":"e_1_2_12_19_1","doi-asserted-by":"publisher","DOI":"10.1002\/mds.23588"},{"key":"e_1_2_12_20_1","doi-asserted-by":"publisher","DOI":"10.3390\/s19235141"},{"key":"e_1_2_12_21_1","unstructured":"Parkinson's Freezing of Gait Prediction Code.2023.https:\/\/www.kaggle.com\/competitions\/tlvmc\u2010parkinsons\u2010freezing\u2010gait\u2010prediction\/code."},{"key":"e_1_2_12_22_1","unstructured":"Parkinson's Freezing of Gait Prediction LeaderBoard.2023.https:\/\/www.kaggle.com\/competitions\/tlvmc\u2010parkinsons\u2010freezing\u2010gait\u2010prediction\/leaderboard."},{"key":"e_1_2_12_23_1","doi-asserted-by":"publisher","DOI":"10.3390\/diagnostics15010036"},{"key":"e_1_2_12_24_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41467\u2010024\u201049027\u20100"},{"key":"e_1_2_12_25_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.1468\u20101331.2003.00611.x"},{"key":"e_1_2_12_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/09593985.2023.2252059"},{"key":"e_1_2_12_27_1","doi-asserted-by":"publisher","DOI":"10.1002\/mds.22144"},{"key":"e_1_2_12_28_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41531\u2010018\u20100052\u20106"},{"key":"e_1_2_12_29_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12984\u2010024\u201001320\u20101"},{"key":"e_1_2_12_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10072\u2010023\u201007017\u2010y"},{"key":"e_1_2_12_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00415\u2010021\u201010685\u20105"},{"key":"e_1_2_12_32_1","doi-asserted-by":"publisher","DOI":"10.1002\/mds.22993"},{"key":"e_1_2_12_33_1","doi-asserted-by":"publisher","DOI":"10.3233\/jpd\u2010240134"},{"key":"e_1_2_12_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.conctc.2021.100817"},{"key":"e_1_2_12_35_1","doi-asserted-by":"publisher","DOI":"10.1002\/mds.29762"}],"container-title":["European Journal of Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/ejn.70424","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/ejn.70424","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/ejn.70424","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T18:20:34Z","timestamp":1770920434000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/ejn.70424"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2]]},"references-count":34,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,2]]}},"alternative-id":["10.1111\/ejn.70424"],"URL":"https:\/\/doi.org\/10.1111\/ejn.70424","archive":["Portico"],"relation":{"has-review":[{"id-type":"doi","id":"10.1111\/EJN.70424\/v1\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1111\/EJN.70424\/v1\/review2","asserted-by":"object"},{"id-type":"doi","id":"10.1111\/EJN.70424\/v1\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1111\/EJN.70424\/v2\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1111\/EJN.70424\/v2\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1111\/EJN.70424\/v2\/response1","asserted-by":"object"}]},"ISSN":["0953-816X","1460-9568"],"issn-type":[{"value":"0953-816X","type":"print"},{"value":"1460-9568","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2]]},"assertion":[{"value":"2025-09-09","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-01-28","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-02-09","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70424"}}