{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:14:45Z","timestamp":1760238885567,"version":"build-2065373602"},"reference-count":44,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2020,9,13]],"date-time":"2020-09-13T00:00:00Z","timestamp":1599955200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61672299","61972208","61702281"],"award-info":[{"award-number":["61672299","61972208","61702281"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Natural Science Foundation of University of 601 Jiangsu Province of China","award":["19KJB520047"],"award-info":[{"award-number":["19KJB520047"]}]},{"DOI":"10.13039\/501100012456","name":"Chinese National Funding of Social Sciences","doi-asserted-by":"publisher","award":["18BC051"],"award-info":[{"award-number":["18BC051"]}],"id":[{"id":"10.13039\/501100012456","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Visual browse and exploration in motion capture data take resource acquisition as a human\u2013computer interaction problem, and it is an essential approach for target motion search. This paper presents a progressive schema which starts from pose browse, then locates the interesting region and then switches to online relevant motion exploration. It mainly addresses three core issues. First, to alleviate the contradiction between the limited visual space and ever-increasing size of real-world database, it applies affinity propagation to numerical similarity measure of pose to perform data abstraction and obtains representative poses of clusters. Second, to construct a meaningful neighborhood for user browsing, it further merges logical similarity measures of pose with the weight quartets and casts the isolated representative poses into a structure of phylogenetic tree. Third, to support online motion exploration including motion ranking and clustering, a biLSTM-based auto-encoder is proposed to encode the high-dimensional pose context into compact latent space. Experimental results on CMU\u2019s motion capture data verify the effectiveness of the proposed method.<\/jats:p>","DOI":"10.3390\/s20185224","type":"journal-article","created":{"date-parts":[[2020,9,13]],"date-time":"2020-09-13T21:11:32Z","timestamp":1600031492000},"page":"5224","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Visual Browse and Exploration in Motion Capture Data with Phylogenetic Tree of Context-Aware Poses"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1463-7670","authenticated-orcid":false,"given":"Songle","family":"Chen","sequence":"first","affiliation":[{"name":"Key Lab of Broadband Wireless Communication and Sensor Network Technology of Ministry of Education, Nanjing University of Posts and Telecommunications, Nanjing 210003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuejian","family":"Zhao","sequence":"additional","affiliation":[{"name":"Key Lab of Broadband Wireless Communication and Sensor Network Technology of Ministry of Education, Nanjing University of Posts and Telecommunications, Nanjing 210003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bingqing","family":"Luo","sequence":"additional","affiliation":[{"name":"Jiangsu Key Laboratory of Big Data Security &amp; Intelligent Processing, Nanjing University of Posts and Telecommunications, Nanjing 210003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhixin","family":"Sun","sequence":"additional","affiliation":[{"name":"Key Lab of Broadband Wireless Communication and Sensor Network Technology of Ministry of Education, Nanjing University of Posts and Telecommunications, Nanjing 210003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,13]]},"reference":[{"key":"ref_1","unstructured":"(2020, September 12). Carnegie Mellon University Motion Capture Database. Available online: http:\/\/mocap.cs.cmu.edu\/."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1325","DOI":"10.1109\/TPAMI.2013.248","article-title":"Human3. 6m: Large scale datasets and predictive methods for 3d human sensing in natural environments","volume":"36","author":"Ionescu","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1676","DOI":"10.1109\/TVCG.2010.272","article-title":"Learning a 3D human pose distance metric from geometric pose descriptor","volume":"17","author":"Chen","year":"2010","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1145\/1073204.1073247","article-title":"Efficient content-based retrieval of motion capture data","volume":"24","author":"Clausen","year":"2005","journal-title":"ACM Trans. Graph. TOG"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"729","DOI":"10.1109\/TVCG.2011.53","article-title":"Human motion retrieval from hand-drawn sketch","volume":"18","author":"Chao","year":"2011","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1016\/j.patrec.2011.06.005","article-title":"Retrieval of logically relevant 3D human motions by adaptive feature selection with graded relevance feedback","volume":"33","author":"Tang","year":"2012","journal-title":"Pattern Recognit. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1007\/s11042-014-2325-3","article-title":"Relevance feedback for human motion retrieval using a boosting approach","volume":"75","author":"Chen","year":"2016","journal-title":"Multimed. Tools Appl."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1969","DOI":"10.1109\/TVCG.2017.2702620","article-title":"Generic content-based retrieval of marker-based motion capture data","volume":"24","author":"Lv","year":"2017","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1002\/cav.1602","article-title":"Human motion retrieval based on freehand sketch","volume":"25","author":"Tang","year":"2014","journal-title":"Comput. Animat. Virtual Worlds"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2257","DOI":"10.1109\/TVCG.2013.178","article-title":"Motionexplorer: Exploratory search in human motion capture data based on hierarchical aggregation","volume":"19","author":"Bernard","year":"2013","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_11","first-page":"1","article-title":"Exploratory search: Beyond the query-response paradigm","volume":"1","author":"White","year":"2009","journal-title":"Synth. Lect. Inf. Concept. Retr. Serv."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1007\/s11042-008-0207-2","article-title":"A survey of browsing models for content based image retrieval","volume":"40","author":"Heesch","year":"2008","journal-title":"Multimed. Tools Appl."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.cag.2020.02.006","article-title":"Qualitative photo collage by quartet analysis and active learning","volume":"88","author":"Gan","year":"2020","journal-title":"Comput. Graph."},{"key":"ref_14","first-page":"113","article-title":"The video browser showdown: A live evaluation of interactive video search tools","volume":"3","author":"Schoeffmann","year":"2014","journal-title":"Int. J. Multimed. Inf. Retr."},{"key":"ref_15","first-page":"1","article-title":"Qualitative organization of collections of shapes via quartet analysis","volume":"32","author":"Huang","year":"2013","journal-title":"ACM Trans. Graph. TOG"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/TASSP.1978.1163055","article-title":"Dynamic programming algorithm optimization for spoken word recognition","volume":"26","author":"Sakoe","year":"1978","journal-title":"IEEE Trans. Acoust. Speech Signal Process."},{"key":"ref_17","first-page":"159","article-title":"A Survey on Content-based Image Retrieval","volume":"8","author":"Ismail","year":"2017","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.is.2018.04.002","article-title":"Searching for variable-speed motions in long sequences of motion capture data","volume":"80","author":"Sedmidubsky","year":"2019","journal-title":"Inf. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1109\/TVCG.2007.13","article-title":"Human motion capture data compression by model-based indexing: A power aware approach","volume":"13","author":"Chattopadhyay","year":"2006","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Liu, G., Zhang, J., Wang, W., and McMillan, L. (2005, January 14\u201316). A System for Analyzing and Indexing Human-Motion Databases. Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data, Baltimore, MD, USA.","DOI":"10.1145\/1066157.1066290"},{"key":"ref_21","unstructured":"Keogh, E., Palpanas, T., Zordan, V.B., Gunopulos, D., and Cardle, M. (September, January 29). Indexing Large Human-Motion Databases. Proceedings of the Thirtieth International Conference on Very Large Data Bases, Toronto, ON, Canada."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"802","DOI":"10.1109\/TITB.2009.2021262","article-title":"Indexing 3-D human motion repositories for content-based retrieval","volume":"13","author":"Pradhan","year":"2009","journal-title":"IEEE Trans. Inf. Technol. Biomed."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1145\/566654.566605","article-title":"Motion Graphs","volume":"21","author":"Kovar","year":"2002","journal-title":"ACM Trans. Graph. TOG"},{"key":"ref_24","first-page":"153","article-title":"Motion graphs++: A compact generative model for semantic motion analysis and synthesis","volume":"31","author":"Min","year":"2012","journal-title":"ACM Trans. Graph. TOG"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"34","DOI":"10.2352\/ISSN.2470-1173.2017.1.VDA-387","article-title":"Visual-interactive semi-supervised labeling of human motion capture data","volume":"2017","author":"Bernard","year":"2017","journal-title":"Electron. Imaging"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1528","DOI":"10.1109\/TVCG.2017.2785271","article-title":"KAVAGait: Knowledge-assisted visual analytics for clinical gait analysis","volume":"25","author":"Wagner","year":"2018","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/TVCG.2015.2468292","article-title":"Motionflow: Visual abstraction and aggregation of sequential patterns in human motion tracking data","volume":"22","author":"Jang","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2644","DOI":"10.1109\/TVCG.2014.2346451","article-title":"Trend-centric motion visualization: Designing and applying a new strategy for analyzing scientific motion collections","volume":"20","author":"Schroeder","year":"2014","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Jang, S., Elmqvist, N., and Ramani, K. (2014, January 4\u20135). GestureAnalyzer: Visual analytics for pattern analysis of mid-air hand gestures. Proceedings of the 2nd ACM Symposium on Spatial User Interaction, Honolulu, HI, USA.","DOI":"10.1145\/2659766.2659772"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Chen, S., Sun, Z., and Zhang, Y. (2015, January 23\u201326). Scalable organization of collections of motion capture data via quantitative and qualitative analysis. Proceedings of the 5th ACM on International Conference on Multimedia Retrieval, Shanghai, China.","DOI":"10.1145\/2671188.2749384"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Holden, D., Saito, J., Komura, T., and Joyce, T. (2015, January 2\u20135). Learning motion manifolds with convolutional autoencoders. Proceedings of the SIGGRAPH Asia 2015 Technical Briefs, Kobe, Japan.","DOI":"10.1145\/2820903.2820918"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Wang, Y., and Neff, M. (2016, January 7\u20138). Deep signatures for indexing and retrieval in large motion databases. Proceedings of the 8th ACM SIGGRAPH Conference on Motion in Games, Lisbon, Portugal.","DOI":"10.1145\/2822013.2822024"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"12073","DOI":"10.1007\/s11042-017-4859-7","article-title":"Effective and efficient similarity searching in motion capture data","volume":"77","author":"Sedmidubsky","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1126\/science.1136800","article-title":"Clustering by passing messages between data points","volume":"315","author":"Frey","year":"2007","journal-title":"Science"},{"key":"ref_36","first-page":"100","article-title":"Algorithm AS 136: A k-means clustering algorithm","volume":"28","author":"Hartigan","year":"1979","journal-title":"J. R. Stat. Soc. Ser. C Appl. Stat."},{"key":"ref_37","first-page":"1762","article-title":"Distributed affinity propagation clustering based on map reduce","volume":"49","author":"Weiming","year":"2012","journal-title":"J. Comput. Res. Dev."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1002\/cav.260","article-title":"Emulating human perception of motion similarity","volume":"19","author":"Tang","year":"2008","journal-title":"Comput. Animat. Virtual Worlds"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1093\/sysbio\/syu087","article-title":"Weighted quartets phylogenetics","volume":"64","author":"Avni","year":"2015","journal-title":"Syst. Biol."},{"key":"ref_40","unstructured":"Zhuang, Y., Rui, Y., Huang, T.S., and Mehrotra, S. (1998, January 4\u20137). Adaptive key frame extraction using unsupervised clustering. Proceedings of the International Conference on Image Processing, Chicago, IL, USA."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1373","DOI":"10.1631\/jzus.A0720058","article-title":"Local and global approaches of affinity propagation clustering for large scale data","volume":"9","author":"Xia","year":"2008","journal-title":"J. Zhejiang Univ. Sci. A"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/0169-7439(87)80084-9","article-title":"Principal component analysis","volume":"2","author":"Wold","year":"1987","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_43","first-page":"406","article-title":"The neighbor-joining method: A new method for reconstructing phylogenetic trees","volume":"4","author":"Saitou","year":"1987","journal-title":"Mol. Biol. Evol."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Pe\u010denovi\u00f3, Z., Do, M.N., Vetterli, M., and Pu, P. (2000, January 2\u20134). Integrated browsing and searching of large image collections. Proceedings of the International Conference on Advances in Visual Information Systems, Lyon, France.","DOI":"10.1007\/3-540-40053-2_25"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5224\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:09:37Z","timestamp":1760177377000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5224"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,13]]},"references-count":44,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["s20185224"],"URL":"https:\/\/doi.org\/10.3390\/s20185224","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,9,13]]}}}