{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T14:31:14Z","timestamp":1762353074710,"version":"build-2065373602"},"reference-count":54,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2021,6,30]],"date-time":"2021-06-30T00:00:00Z","timestamp":1625011200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001807","name":"Funda\u00e7\u00e3o de Amparo \u00e0 Pesquisa do Estado de S\u00e3o Paulo","doi-asserted-by":"publisher","award":["15\/14358-0"],"award-info":[{"award-number":["15\/14358-0"]}],"id":[{"id":"10.13039\/501100001807","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["K02 NS104207","R01 LM013316"],"award-info":[{"award-number":["K02 NS104207","R01 LM013316"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"American Heart Association fellowship","award":["19AMTG35210398"],"award-info":[{"award-number":["19AMTG35210398"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>A large number of stroke survivors suffer from a significant decrease in upper extremity (UE) function, requiring rehabilitation therapy to boost recovery of UE motion. Assessing the efficacy of treatment strategies is a challenging problem in this context, and is typically accomplished by observing the performance of patients during their execution of daily activities. A more detailed assessment of UE impairment can be undertaken with a clinical bedside test, the UE Fugl\u2013Meyer Assessment, but it fails to examine compensatory movements of functioning body segments that are used to bypass impairment. In this work, we use a graph learning method to build a visualization tool tailored to support the analysis of stroke patients. Called NE-Motion, or Network Environment for Motion Capture Data Analysis, the proposed analytic tool handles a set of time series captured by motion sensors worn by patients so as to enable visual analytic resources to identify abnormalities in movement patterns. Developed in close collaboration with domain experts, NE-Motion is capable of uncovering important phenomena, such as compensation while revealing differences between stroke patients and healthy individuals. The effectiveness of NE-Motion is shown in two case studies designed to analyze particular patients and to compare groups of subjects.<\/jats:p>","DOI":"10.3390\/s21134482","type":"journal-article","created":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T02:44:39Z","timestamp":1625107479000},"page":"4482","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["NE-Motion: Visual Analysis of Stroke Patients Using Motion Sensor Networks"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4003-7791","authenticated-orcid":false,"given":"Rodrigo Colnago","family":"Contreras","sequence":"first","affiliation":[{"name":"Department of Applied Mathematics and Statistics, Institute of Mathematics and Computer Sciences, University of S\u00e3o Paulo, S\u00e3o Carlos 13566-590, SP, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6786-1222","authenticated-orcid":false,"given":"Avinash","family":"Parnandi","sequence":"additional","affiliation":[{"name":"School of Medicine, New York University, New York, NY 10017, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3093-9217","authenticated-orcid":false,"given":"Bruno Gomes","family":"Coelho","sequence":"additional","affiliation":[{"name":"Tandon School of Engineering, New York University, New York, NY 10012, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2452-2295","authenticated-orcid":false,"given":"Claudio","family":"Silva","sequence":"additional","affiliation":[{"name":"Tandon School of Engineering, New York University, New York, NY 10012, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1886-2288","authenticated-orcid":false,"given":"Heidi","family":"Schambra","sequence":"additional","affiliation":[{"name":"School of Medicine, New York University, New York, NY 10017, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8514-8033","authenticated-orcid":false,"given":"Luis Gustavo","family":"Nonato","sequence":"additional","affiliation":[{"name":"Department of Applied Mathematics and Statistics, Institute of Mathematics and Computer Sciences, University of S\u00e3o Paulo, S\u00e3o Carlos 13566-590, SP, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,30]]},"reference":[{"key":"ref_1","unstructured":"Warlow, C.P., Van Gijn, J., Dennis, M.S., Wardlaw, J.M., Bamford, J.M., Hankey, G.J., Sandercock, P.A., Rinkel, G., Langhorne, P., and Sudlow, C. (2011). Stroke: Practical Management, John Wiley & Sons."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1016\/S1474-4422(04)00800-2","article-title":"The global stroke initiative","volume":"3","author":"Bonita","year":"2004","journal-title":"Lancet Neurol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"13","DOI":"10.2340\/1650197771331","article-title":"The post-stroke hemiplegic patient. 1. A method for evaluation of physical performance","volume":"7","author":"Leyman","year":"1975","journal-title":"Scand. J. Rehabil. Med."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Del Din, S., Patel, S., Cobelli, C., and Bonato, P. (September, January 30). Estimating Fugl-Meyer clinical scores in stroke survivors using wearable sensors. Proceedings of the 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA.","DOI":"10.1109\/IEMBS.2011.6091444"},{"key":"ref_5","unstructured":"Wang, J., Yu, L., Wang, J., Guo, L., Gu, X., and Fang, Q. (2014, January 11\u201314). Automated Fugl-Meyer assessment using SVR model. Proceedings of the 2014 IEEE International Symposium on Bioelectronics and Bioinformatics (IEEE ISBB 2014), Chung Li, Taiwan."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.cmpb.2016.02.012","article-title":"A remote quantitative Fugl-Meyer assessment framework for stroke patients based on wearable sensor networks","volume":"128","author":"Yu","year":"2016","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"280","DOI":"10.15406\/mojabb.2018.02.00082","article-title":"A survey of wearable sensor networks in health and entertainment","volume":"2","author":"Olson","year":"2018","journal-title":"MOJ Appl. Bionics Biomech."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2222","DOI":"10.1088\/1361-6579\/aa9835","article-title":"Identifying compensatory movement patterns in the upper extremity using a wearable sensor system","volume":"38","author":"Ranganathan","year":"2017","journal-title":"Physiol. Meas."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1550147718768994","DOI":"10.1177\/1550147718768994","article-title":"The state-of-the-art wireless body area sensor networks: A survey","volume":"14","author":"Khan","year":"2018","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1109\/TMSCS.2017.2675888","article-title":"Wearable Medical Sensor-Based System Design: A Survey","volume":"3","author":"Mosenia","year":"2017","journal-title":"IEEE Trans. Multi-Scale Comput. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2644","DOI":"10.1109\/TVCG.2014.2346451","article-title":"Trend-centric motion visualization: Designing and applying a new strategy for analyzing scientific motion collections","volume":"20","author":"Schroeder","year":"2014","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"34","DOI":"10.2352\/ISSN.2470-1173.2017.1.VDA-387","article-title":"Visual-interactive semi-supervised labeling of human motion capture data","volume":"2017","author":"Bernard","year":"2017","journal-title":"Electron. Imaging"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1111\/j.1467-8659.2009.01681.x","article-title":"Visual Analysis of Multi-Joint Kinematic Data","volume":"29","author":"Krekel","year":"2010","journal-title":"Comput. Graph. Forum"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"981","DOI":"10.1109\/TVCG.2019.2934280","article-title":"Motion Browser: Visualizing and Understanding Complex Upper Limb Movement Under Obstetrical Brachial Plexus Injuries","volume":"26","author":"Chan","year":"2019","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Nguyen, K.T., Gauffin, H., Ynnerman, A., and Ropinski, T. (2016). Quantitative Analysis of Knee Movement Patterns Through Comparative Visualization. Visualization in Medicine and Life Sciences III, Springer.","DOI":"10.1007\/978-3-319-24523-2_12"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1528","DOI":"10.1109\/TVCG.2017.2785271","article-title":"KAVAGait: Knowledge-assisted visual analytics for clinical gait analysis","volume":"25","author":"Wagner","year":"2018","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_17","first-page":"93970F","article-title":"Furyexplorer: Visual-interactive exploration of horse motion capture data","volume":"Volume 9397","author":"Wilhelm","year":"2015","journal-title":"Visualization and Data Analysis 2015"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2257","DOI":"10.1109\/TVCG.2013.178","article-title":"Motionexplorer: Exploratory search in human motion capture data based on hierarchical aggregation","volume":"19","author":"Bernard","year":"2013","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Jang, S., Elmqvist, N., and Ramani, K. (2014, January 4\u20135). GestureAnalyzer: Visual analytics for pattern analysis of mid-air hand gestures. Proceedings of the 2nd ACM Symposium on Spatial User Interaction, Honolulu, HI, USA.","DOI":"10.1145\/2659766.2659772"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/TVCG.2015.2468292","article-title":"Motionflow: Visual abstraction and aggregation of sequential patterns in human motion tracking data","volume":"22","author":"Jang","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1016\/j.cag.2007.01.030","article-title":"Visualizing time-oriented data\u2014A systematic view","volume":"31","author":"Aigner","year":"2007","journal-title":"Comput. Graph."},{"key":"ref_22","unstructured":"Keim, D.A., Nietzschmann, T., Schelwies, N., Schneidewind, J., Schreck, T., and Ziegler, H. (2006, January 8\u201310). A spectral visualization system for analyzing financial time series data. Proceedings of the Eurographics\/IEEE TCVG Symposium on Visualization, Lisbon, Portugal."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2422","DOI":"10.1109\/TVCG.2011.195","article-title":"Exploratory analysis of time-series with chronolenses","volume":"17","author":"Zhao","year":"2011","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1111\/j.1467-8659.2011.01919.x","article-title":"Visual Exploration of Time-Series Data with Shape Space Projections","volume":"30","author":"Ward","year":"2011","journal-title":"Comput. Graph. Forum."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1111\/cgf.13698","article-title":"Visual-Interactive Preprocessing of Multivariate Time Series Data","volume":"38","author":"Bernard","year":"2019","journal-title":"Comput. Graph. Forum."},{"key":"ref_26","first-page":"239","article-title":"Interactive feature specification for focus+ context visualization of complex simulation data","volume":"3","author":"Doleisch","year":"2003","journal-title":"VisSym"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1579","DOI":"10.1109\/TVCG.2008.139","article-title":"Hypothesis generation in climate research with interactive visual data exploration","volume":"14","author":"Kehrer","year":"2008","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1111\/cgf.12390","article-title":"SimilarityExplorer: A Visual Inter-Comparison Tool for Multifaceted Climate Data","volume":"33","author":"Poco","year":"2014","journal-title":"Comput. Graph. Forum"},{"key":"ref_29","first-page":"102268","article-title":"Introducing the Time Series Change Visualization and Interpretation (TSCVI) method for the interpretation of global NDVI changes","volume":"96","author":"Julien","year":"2021","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1109\/TVCG.2016.2598415","article-title":"A visual analytics approach for understanding reasons behind snowballing and comeback in moba games","volume":"23","author":"Li","year":"2016","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Valdivia, P., Dias, F., Petronetto, F., Silva, C.T., and Nonato, L.G. (2015, January 25\u201330). Wavelet-based visualization of time-varying data on graphs. Proceedings of the 2015 IEEE Conference on Visual Analytics Science and Technology (VAST), Chicago, IL, USA.","DOI":"10.1109\/VAST.2015.7347624"},{"key":"ref_32","first-page":"2456","article-title":"Wavelet-based visual analysis of dynamic networks","volume":"24","author":"Valdivia","year":"2017","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_33","unstructured":"Zanabria, G.G., Silveira, J.A., Poco, J., Paiva, A., Nery, M.B., Silva, C.T., de Abreu, S.F.A., and Nonato, L.G. (2020). CrimAnalyzer: Understanding Crime Patterns in S\u00e3o Paulo. IEEE Trans. Vis. Comput. Graph., in press."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2970","DOI":"10.1109\/TITS.2015.2436897","article-title":"A survey of traffic data visualization","volume":"16","author":"Chen","year":"2015","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1109\/TVCG.2012.110","article-title":"Visualization and visual analysis of multifaceted scientific data: A survey","volume":"19","author":"Kehrer","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Goodyear, M.D., Krleza-Jeric, K., and Lemmens, T. (2007). The Declaration of Helsinki, BMJ Publishing Group Ltd.","DOI":"10.1136\/bmj.39339.610000.BE"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"650","DOI":"10.2471\/BLT.08.050955","article-title":"The Declaration of Helsinki and public health","volume":"86","author":"Williams","year":"2008","journal-title":"Bull. World Health Organ."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Averbuch, A.Z., Neittaanmaki, P., and Zheludev, V.A. (2014). Spline and Spline Wavelet Methods with Applications to Signal and Image Processing: Volume I: Periodic Splines, Springer Science & Business Media.","DOI":"10.1007\/978-94-017-8926-4"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1109\/MSP.2018.2887284","article-title":"Learning graphs from data: A signal representation perspective","volume":"36","author":"Dong","year":"2019","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zosso, D., Osting, B., and Osher, S.J. (2015, January 14\u201317). A dirichlet energy criterion for graph-based image segmentation. Proceedings of the 2015 IEEE International Conference on Data Mining Workshop (ICDMW), Washington, DC, USA.","DOI":"10.1109\/ICDMW.2015.112"},{"key":"ref_41","unstructured":"Kalofolias, V. (2016). How to learn a graph from smooth signals. Artificial Intelligence and Statistics, PMLR."},{"key":"ref_42","unstructured":"Kalofolias, V., and Perraudin, N. (2017). Large scale graph learning from smooth signals. arXiv."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1109\/MSP.2014.2377273","article-title":"Playing with duality: An overview of recent primal-dual approaches for solving large-scale optimization problems","volume":"32","author":"Komodakis","year":"2015","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1090\/S0002-9939-1992-1126193-4","article-title":"Characterization of Lower Semicontinuous Convex Functions","volume":"116","author":"Correa","year":"1992","journal-title":"Proc. Am. Math. Soc."},{"key":"ref_45","unstructured":"Jech, T. (2013). Set Theory, Springer Science & Business Media."},{"key":"ref_46","unstructured":"Wattenberg, M. (2002, January 28\u201329). Arc diagrams: Visualizing structure in strings. Proceedings of the IEEE Symposium on Information Visualization, Boston, MA, USA."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.socnet.2010.03.006","article-title":"Node centrality in weighted networks: Generalizing degree and shortest paths","volume":"32","author":"Opsahl","year":"2010","journal-title":"Soc. Netw."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1080\/0022250X.2001.9990249","article-title":"A faster algorithm for betweenness centrality","volume":"25","author":"Brandes","year":"2001","journal-title":"J. Math. Sociol."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1080\/15427951.2005.10129098","article-title":"A survey on pagerank computing","volume":"2","author":"Berkhin","year":"2005","journal-title":"Internet Math."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1038\/30918","article-title":"Collective dynamics of \u2018small-world\u2019networks","volume":"393","author":"Watts","year":"1998","journal-title":"Nature"},{"key":"ref_51","unstructured":"Defferrard, M., Martin, L., Pena, R., and Perraudin, N. (2017). PyGSP: Graph Signal Processing in Python. Zenodo."},{"key":"ref_52","first-page":"297","article-title":"Training the \u201cless-affected\u201d forelimb after unilateral cortical infarcts interferes with functional recovery of the impaired forelimb in rats","volume":"23","author":"Allred","year":"2005","journal-title":"Restor. Neurol. Neurosci."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"8604","DOI":"10.1523\/JNEUROSCI.0829-15.2015","article-title":"Experience with the \u201cgood\u201d limb induces aberrant synaptic plasticity in the perilesion cortex after stroke","volume":"35","author":"Kim","year":"2015","journal-title":"J. Neurosci."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1161\/01.STR.0000196940.20446.c9","article-title":"Task-specific training with trunk restraint on arm recovery in stroke: Randomized control trial","volume":"37","author":"Michaelsen","year":"2006","journal-title":"Stroke"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/13\/4482\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:23:50Z","timestamp":1760163830000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/13\/4482"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,30]]},"references-count":54,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["s21134482"],"URL":"https:\/\/doi.org\/10.3390\/s21134482","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,6,30]]}}}