{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T05:10:40Z","timestamp":1777439440094,"version":"3.51.4"},"reference-count":35,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2017,10,13]],"date-time":"2017-10-13T00:00:00Z","timestamp":1507852800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Cyclic signals are an intrinsic part of daily life, such as human motion and heart activity. The detailed analysis of them is important for clinical applications such as pathological gait analysis and for sports applications such as performance analysis. Labeled training data for algorithms that analyze these cyclic data come at a high annotation cost due to only limited annotations available under laboratory conditions or requiring manual segmentation of the data under less restricted conditions. This paper presents a smart annotation method that reduces this cost of labeling for sensor-based data, which is applicable to data collected outside of strict laboratory conditions. The method uses semi-supervised learning of sections of cyclic data with a known cycle number. A hierarchical hidden Markov model (hHMM) is used, achieving a mean absolute error of 0.041 \u00b1 0.020 s relative to a manually-annotated reference. The resulting model was also used to simultaneously segment and classify continuous, \u2018in the wild\u2019 data, demonstrating the applicability of using hHMM, trained on limited data sections, to label a complete dataset. This technique achieved comparable results to its fully-supervised equivalent. Our semi-supervised method has the significant advantage of reduced annotation cost. Furthermore, it reduces the opportunity for human error in the labeling process normally required for training of segmentation algorithms. It also lowers the annotation cost of training a model capable of continuous monitoring of cycle characteristics such as those employed to analyze the progress of movement disorders or analysis of running technique.<\/jats:p>","DOI":"10.3390\/s17102328","type":"journal-article","created":{"date-parts":[[2017,10,13]],"date-time":"2017-10-13T11:34:09Z","timestamp":1507894449000},"page":"2328","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Smart Annotation of Cyclic Data Using Hierarchical Hidden Markov Models"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9397-5944","authenticated-orcid":false,"given":"Christine","family":"Martindale","sequence":"first","affiliation":[{"name":"Machine Learning and Data Analytics Lab, Department of Computer Science, Friedrich-Alexander University Erlangen-N\u00fcrnberg (FAU), 91054 Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Florian","family":"Hoenig","sequence":"additional","affiliation":[{"name":"Speech Group, Department of Computer Science, Friedrich-Alexander-University Erlangen-N\u00fcrnberg (FAU), 91054 Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christina","family":"Strohrmann","sequence":"additional","affiliation":[{"name":"Bosch Sensortec GmbH, Gerhard-Kindler-Strasse 9, 72770 Reutlingen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0417-0336","authenticated-orcid":false,"given":"Bjoern","family":"Eskofier","sequence":"additional","affiliation":[{"name":"Machine Learning and Data Analytics Lab, Department of Computer Science, Friedrich-Alexander University Erlangen-N\u00fcrnberg (FAU), 91054 Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,10,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Klucken, J., Barth, J., Kugler, P., Schlachetzki, J., Henze, T., Marxreiter, F., Kohl, Z., Steidl, R., Hornegger, J., and Eskofier, B. (2013). Unbiased and mobile gait analysis detects motor impairment in Parkinson\u2019s disease. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0056956"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1016\/j.humov.2015.07.009","article-title":"Effect of walking speed on gait sub phase durations","volume":"43","author":"Hebenstreit","year":"2015","journal-title":"Hum. Mov. Sci."},{"key":"ref_3","unstructured":"Hughes, N., Tarassenko, L., and Roberts, S. (2003). Markov models for automated ECG interval analysis. NIPS, 611\u2013618."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Brajdic, A., and Harle, R. (2013, January 8\u201312). Walk Detection and Step Counting on Unconstrained Smartphones. Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp\u201913), Zurich, Switzerland.","DOI":"10.1145\/2493432.2493449"},{"key":"ref_5","first-page":"6419","article-title":"Stride segmentation during free walk movements using multi-dimensional subsequence dynamic time warping on inertial sensor data","volume":"15","author":"Barth","year":"2015","journal-title":"IEEE Sens. J."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Mannini, A., Trojaniello, D., Croce, U., and Sabatini, A. (2015, January 25\u201329). Hidden Markov Model-Based Strategy for Gait Segmentation using Inertial Sensors: Application to Elderly, Hemiparetic Patients and Huntington\u2019s Disease Patients. Proceedings of the 2015 37th International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy.","DOI":"10.1109\/EMBC.2015.7319558"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Crea, S., De Rossi, S.M.M., Donati, M., Reber\u0161ek, P., Novak, D., Vitiello, N., Lenzi, T., Podobnik, J., Munih, M., and Carrozza, M.C. (September, January 28). Development of gait segmentation methods for wearable foot pressure sensors. Proceedings of the 2012 International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), San Diego, CA, USA.","DOI":"10.1109\/EMBC.2012.6347120"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Liu, R., Chen, T., and Huang, L. (2010, January 11\u201314). Research on human activity recognition based on active learning. Proceedings of the 2010 International Conference on Machine Learning and Cybernetics (ICMLC), Qingdao, China.","DOI":"10.1109\/ICMLC.2010.5581050"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Miu, T., Missier, P., and Plotz, T. (2015, January 26\u201328). Bootstrapping Personalised Human Activity Recognition Models Using Online Active Learning. Proceedings of the 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing (CIT\/IUCC\/DASC\/PICOM), Liverpool, UK.","DOI":"10.1109\/CIT\/IUCC\/DASC\/PICOM.2015.170"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1109\/THMS.2015.2489688","article-title":"Toward Personalized Activity Recognition Systems with a Semipopulation Approach","volume":"46","author":"Hong","year":"2016","journal-title":"IEEE Trans. Hum. Mach. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Maekawa, T., and Watanabe, S. (2011, January 12\u201315). Unsupervised Activity Recognition with User\u2019s Physical Characteristics Data. Proceedings of the 2011 15th International Symposium on Wearable Computers (ISWC), San Francisco, CA, USA.","DOI":"10.1109\/ISWC.2011.24"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2521","DOI":"10.1109\/TPAMI.2011.36","article-title":"Weakly Supervised Recognition of Daily Life Activities with Wearable Sensors","volume":"33","author":"Stikic","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yao, L., Nie, F., Sheng, Q.Z., Gu, T., Li, X., and Wang, S. (2016, January 12\u201316). Learning from less for better: Semi-supervised activity recognition via shared structure discovery. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp\u201916), Heidelberg, Germany.","DOI":"10.1145\/2971648.2971701"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1109\/TPAMI.2012.137","article-title":"Hierarchical Aligned Cluster Analysis for Temporal Clustering of Human Motion","volume":"35","author":"Zhou","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"797","DOI":"10.1109\/TMM.2016.2635030","article-title":"Efficient Unsupervised Temporal Segmentation of Motion Data","volume":"19","author":"Kruger","year":"2017","journal-title":"IEEE Trans. Multimed."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kohlmorgen, J., and Lemm, S. (2001, January 3\u20138). A dynamic HMM for on\u2013line segmentation of sequential data. Proceedings of the 14th International Conference on Neural Information Processing Systems: Natural and Synthetic, Vancouver, BC, Canada.","DOI":"10.7551\/mitpress\/1120.003.0106"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1158","DOI":"10.1109\/TRO.2009.2026508","article-title":"Online Segmentation and Clustering From Continuous Observation of Whole Body Motions","volume":"25","author":"Kulic","year":"2009","journal-title":"IEEE Trans. Robot."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1281","DOI":"10.1214\/14-AOAS742","article-title":"Joint modeling of multiple time series via the beta process with application to motion capture segmentation","volume":"8","author":"Fox","year":"2014","journal-title":"Ann. Appl. Stat."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Riboni, D., Sztyler, T., Civitarese, G., and Stuckenschmidt, H. (2016, January 12\u201316). Unsupervised recognition of interleaved activities of daily living through ontological and probabilistic reasoning. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp\u201916), Heidelberg, Germany.","DOI":"10.1145\/2971648.2971691"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1016\/j.pmcj.2010.01.002","article-title":"Wearable sensor activity analysis using semi-Markov models with a grammar","volume":"6","author":"Thomas","year":"2010","journal-title":"Pervasive Mob. Comput."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Joukov, V., Bonnet, V., Karg, M., Venture, G., and Kulic, D. (2017). Rhythmic Extended Kalman Filter for Gait Rehabilitation Motion Estimation and Segmentation. IEEE Trans. Neural Syst. Rehabil. Eng.","DOI":"10.1109\/TNSRE.2017.2659730"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Aoki, T., Venture, G., and Kulic, D. (2013, January 13\u201316). Segmentation of Human Body Movement Using Inertial Measurement Unit. Proceedings of the 2013 IEEE International Conference on Systems, Man, and Cybernetics, Manchester, UK.","DOI":"10.1109\/SMC.2013.205"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Mannini, A., Trojaniello, D., Cereatti, A., and Sabatini, A. (2016). A Machine Learning Framework for Gait Classification Using Inertial Sensors: Application to Elderly, Post-Stroke and Huntington\u2019s Disease Patients. Sensors, 16.","DOI":"10.3390\/s16010134"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1541","DOI":"10.1109\/TBME.2006.877103","article-title":"ECG signal analysis through hidden markov models","volume":"53","author":"Andreao","year":"2006","journal-title":"IEEE Trans. Biomed. Eng"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1023\/A:1007469218079","article-title":"The Hierarchical Hidden Markov Model: Analysis and Applications","volume":"32","author":"Fine","year":"1998","journal-title":"Mach. Learn."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lv, F., and Nevatia, R. (2006). Recognition and Segmentation of 3-D Human Action Using HMM and Multi-Class AdaBoost, Springer.","DOI":"10.1007\/11744085_28"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1109\/TNSRE.2013.2259640","article-title":"Online Segmentation of Human Motion for Automated Rehabilitation Exercise Analysis","volume":"22","author":"Lin","year":"2014","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1109\/5.18626","article-title":"A tutorial on hidden Markov models and selected applications in speech recognition","volume":"77","author":"Rabiner","year":"1989","journal-title":"Proc. IEEE"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1073","DOI":"10.1109\/TIM.2012.2236792","article-title":"Continuous Hidden Markov Model for Pedestrian Activity Classification and Gait Analysis","volume":"62","author":"Panahandeh","year":"2013","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1639","DOI":"10.1109\/29.60082","article-title":"The segmental K-means algorithm for estimating parameters of hidden Markov models","volume":"38","author":"Juang","year":"1990","journal-title":"IEEE Trans. Acoust. Speech Signal Process."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1016\/0167-6393(93)90083-W","article-title":"Automatic segmentation and labeling of speech based on Hidden Markov Models","volume":"12","author":"Brugnara","year":"1993","journal-title":"Speech Commun."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Steidl, S., Riedhammer, K., and Bocklet, T. (2011, January 28\u201331). Java visual speech components for rapid application development of GUI based speech processing applications. Proceedings of the 12th Conference of the International Speech Communication Association (INTERSPEECH 2011), Florence, Italy.","DOI":"10.21437\/Interspeech.2011-821"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Taborri, J., Palermo, E., Rossi, S., and Cappa, P. (2016). Gait Partitioning Methods: A Systematic Review. Sensors, 16.","DOI":"10.3390\/s16010066"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1089","DOI":"10.1109\/TBME.2014.2368211","article-title":"Inertial Sensor Based Stride Parameter Calculation from Gait Sequences in Geriatric Patients","volume":"62","author":"Rampp","year":"2014","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1016\/j.gaitpost.2012.06.017","article-title":"Gait phase detection and discrimination between walking-jogging activities using hidden Markov models applied to foot motion data from a gyroscope","volume":"36","author":"Mannini","year":"2012","journal-title":"Gait Posture"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/10\/2328\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:47:16Z","timestamp":1760208436000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/10\/2328"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,10,13]]},"references-count":35,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2017,10]]}},"alternative-id":["s17102328"],"URL":"https:\/\/doi.org\/10.3390\/s17102328","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,10,13]]}}}