{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,23]],"date-time":"2026-02-23T22:35:51Z","timestamp":1771886151845,"version":"3.50.1"},"reference-count":39,"publisher":"SAGE Publications","issue":"5","license":[{"start":{"date-parts":[[2022,5,1]],"date-time":"2022-05-01T00:00:00Z","timestamp":1651363200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["51975051"],"award-info":[{"award-number":["51975051"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["International Journal of Distributed Sensor Networks"],"published-print":{"date-parts":[[2022,5]]},"abstract":"<jats:p> Skeleton tracking based on multiple Kinects data fusion has been proved to have better accuracy and robustness than single Kinect. However, previous works did not consider the inconsistency of tracking accuracy in the tracking field of Kinect and the self-occlusion of human body in assembly operation, which are of vital importance to the fusion performance of the multiple Kinects data in assembly task simulation. In this work, we developed a multi-Kinect fusion algorithm to achieve robust full-body tracking in virtual reality (VR)-aided assembly simulation. Two reliability functions are first applied to evaluate the tracking confidences reflecting the impacts of the position-related error and the self-occlusion error on the tracked skeletons. Then, the tracking skeletons from multiple Kinects are fused based on weighted arithmetic average and generalized covariance intersection. To evaluate the tracking confidence, the ellipsoidal surface fitting was used to model the tracking accuracy distribution of Kinect, and the relations between the user-Kinect crossing angles and the influences of the self-occlusion on the tracking of different parts of body were studied. On the basis, the two reliability functions were developed. We implemented a prototype system leveraging six Kinects and applied the distributed computing in the system to improve the computing efficiency. Experiment results showed that the proposed algorithm has superior fusion performance compared to the peer works. <\/jats:p>","DOI":"10.1177\/15501329221097591","type":"journal-article","created":{"date-parts":[[2022,5,18]],"date-time":"2022-05-18T22:50:14Z","timestamp":1652914214000},"page":"155013292210975","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":12,"title":["Multi-Kinects fusion for full-body tracking in virtual reality-aided assembly simulation"],"prefix":"10.1177","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6318-0446","authenticated-orcid":false,"given":"Yu","family":"Wang","sequence":"first","affiliation":[{"name":"Scene Simulation Lab, Beijing Institute of Technology, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fuxiang","family":"Chang","sequence":"additional","affiliation":[{"name":"Scene Simulation Lab, Beijing Institute of Technology, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuanjie","family":"Wu","sequence":"additional","affiliation":[{"name":"University of Canterbury, Christchurch, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ziran","family":"Hu","sequence":"additional","affiliation":[{"name":"Scene Simulation Lab, Beijing Institute of Technology, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lihui","family":"Li","sequence":"additional","affiliation":[{"name":"Scene Simulation Lab, Beijing Institute of Technology, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pengyu","family":"Li","sequence":"additional","affiliation":[{"name":"Harbin First Machinery Group Ltd., Harbin, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pu","family":"Lang","sequence":"additional","affiliation":[{"name":"Inner Mongolia First Machinery Group Ltd., Baotou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shouwen","family":"Yao","sequence":"additional","affiliation":[{"name":"Scene Simulation Lab, Beijing Institute of Technology, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2022,5,16]]},"reference":[{"key":"bibr1-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1016\/S0007-8506(07)63249-1"},{"key":"bibr2-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1080\/00207543.2016.1154210"},{"key":"bibr3-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1016\/j.rcim.2018.03.009"},{"key":"bibr4-15501329221097591","volume-title":"Proceedings of the ASME 2018 international design engineering technical conferences and computers and information in engineering conference","volume":"51845","author":"De Casenave L"},{"key":"bibr5-15501329221097591","volume-title":"Proceedings of the ASME 2013 international design engineering technical conferences and computers and information in engineering conference","volume":"55867","author":"Puthenveetil SC"},{"key":"bibr6-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1007\/s10055-016-0293-9"},{"key":"bibr7-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1016\/j.apergo.2015.06.024"},{"key":"bibr8-15501329221097591","unstructured":"Microsoft. Kinect for Windows, https:\/\/developer.microsoft.com\/zh-cn\/windows\/kinect\/ (accessed 19 August 2021)."},{"key":"bibr9-15501329221097591","volume-title":"Proceedings of the 26th international conference on artificial reality and telexistence and the 21st eurographics symposium on virtual environments: posters and demos","volume":"10","author":"Fri\u00f0riksson FA"},{"key":"bibr10-15501329221097591","doi-asserted-by":"publisher","DOI":"10.30880\/ijie.2018.10.08.027"},{"key":"bibr11-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1016\/j.apergo.2016.10.015"},{"key":"bibr12-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1016\/j.entcom.2019.100303"},{"key":"bibr13-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2015.2416651"},{"key":"bibr14-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-016-3546-4"},{"key":"bibr15-15501329221097591","doi-asserted-by":"publisher","DOI":"10.37965\/jait.2020.0051"},{"key":"bibr16-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1049\/cit2.12014"},{"key":"bibr17-15501329221097591","volume-title":"Proceedings of the 2013 international computer science and engineering conference (ICSEC)","author":"Kaenchan S"},{"key":"bibr18-15501329221097591","volume-title":"Proceedings of the 6th international conference on computer vision\/computer graphics collaboration techniques and applications","author":"Asteriadis S"},{"key":"bibr19-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1115\/1.4025404"},{"key":"bibr20-15501329221097591","volume-title":"Proceedings of the 2012 IEEE virtual reality workshops (VRW)","author":"Livingston MA"},{"key":"bibr21-15501329221097591","volume-title":"Proceedings of the 13th Asian conference on computer vision","author":"Wasenm\u00fcller O"},{"key":"bibr22-15501329221097591","unstructured":"Microsoft. TrackingState Enumeration, https:\/\/docs.microsoft.com\/en-us\/previous-versions\/windows\/kinect\/dn758898(v=ieb.10) (2014, accessed 19 August 2021)."},{"key":"bibr23-15501329221097591","volume-title":"Proceedings of the 2018 10th international conference on virtual worlds and games for serious applications (VS-Games)","author":"Wu Y"},{"key":"bibr24-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1587\/transfun.E98.A.2004"},{"key":"bibr25-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1049\/iet-cvi.2015.0146"},{"key":"bibr26-15501329221097591","doi-asserted-by":"publisher","DOI":"10.5772\/62415"},{"key":"bibr27-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1177\/1550147717696083"},{"key":"bibr28-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1115\/1.4025810"},{"key":"bibr29-15501329221097591","unstructured":"Otto MM, Agethen P, Geiselhart F, et al. Towards ubiquitous tracking: presenting a scalable, markerless tracking approach using multiple depth cameras. In: Proceedings of the EuroVR 2015, https:\/\/www.uni-ulm.de\/fileadmin\/website_uni_ulm\/iui.inst.100\/institut\/Papers\/Prof_Rukzio\/2015\/OttoEtAl_Towards_ubiquituous_tracking.pdf"},{"key":"bibr30-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2020.3021834"},{"key":"bibr31-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2013.11.042"},{"key":"bibr32-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2015.2441709"},{"key":"bibr33-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1109\/TAES.2019.2893083"},{"key":"bibr34-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1016\/j.sigpro.2019.107246"},{"key":"bibr35-15501329221097591","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2021.3082988"},{"key":"bibr36-15501329221097591","unstructured":"OptiTrack. Flex 13, https:\/\/www.optitrack.com\/cameras\/flex-13\/ (accessed 19 August 2021)."},{"key":"bibr37-15501329221097591","unstructured":"Microsoft. JointType Enumeration, https:\/\/docs.microsoft.com\/en-us\/previous-versions\/windows\/kinect\/dn758663(v=ieb.10) (2014, accessed 19 August 2021)."},{"key":"bibr38-15501329221097591","unstructured":"Homepage of Rug.Osc, https:\/\/bitbucket.org\/rugcode\/rug.osc\/src\/master\/ (2021, accessed 19 August 2021)."},{"key":"bibr39-15501329221097591","unstructured":"Microsoft. Kinect for Windows SDK, https:\/\/docs.microsoft.com\/en-us\/previous-versions\/windows\/kinect\/dn799271(v=ieb.10) (2014, accessed 19 August 2021)."}],"container-title":["International Journal of Distributed Sensor Networks"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/15501329221097591","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/15501329221097591","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/15501329221097591","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,18]],"date-time":"2022-05-18T22:50:30Z","timestamp":1652914230000},"score":1,"resource":{"primary":{"URL":"http:\/\/journals.sagepub.com\/doi\/10.1177\/15501329221097591"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5]]},"references-count":39,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2022,5]]}},"alternative-id":["10.1177\/15501329221097591"],"URL":"https:\/\/doi.org\/10.1177\/15501329221097591","relation":{},"ISSN":["1550-1329","1550-1477"],"issn-type":[{"value":"1550-1329","type":"print"},{"value":"1550-1477","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5]]}}}