{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T17:23:28Z","timestamp":1754155408460,"version":"3.41.2"},"reference-count":37,"publisher":"Emerald","issue":"6","license":[{"start":{"date-parts":[[2019,9,2]],"date-time":"2019-09-02T00:00:00Z","timestamp":1567382400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IR"],"published-print":{"date-parts":[[2019,11,14]]},"abstract":"<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title>\n<jats:p>The purpose of this paper is the research of a novel gesture-based dual-robot collaborative interaction interface, which achieves the gesture recognition when both hands overlap. This paper designs a hybrid-sensor gesture recognition platform to detect the both-hand data for dual-robot control.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title>\n<jats:p>This paper uses a combination of Leap Motion and PrimeSense in the vertical direction, which detects both-hand data in real time. When there is occlusion between hands, each hand is detected by one of the sensors, and a quaternion-based algorithm is used to realize the conversion of two sensors corresponding to different coordinate systems. When there is no occlusion, the data are fused by a self-adaptive weight fusion algorithm. Then the collision detection algorithm is used to detect the collision between robots to ensure safety. Finally, the data are transmitted to the dual robots.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Findings<\/jats:title>\n<jats:p>This interface is implemented on a dual-robot system consisting of two 6-DOF robots. The dual-robot cooperative experiment indicates that the proposed interface is feasible and effective, and it takes less time to operate and has higher interaction efficiency.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title>\n<jats:p>A novel gesture-based dual-robot collaborative interface is proposed. It overcomes the problem of gesture occlusion in two-hand interaction with low computational complexity and low equipment cost. The proposed interface can perform a long-term stable tracking of the two-hand gestures even if there is occlusion between the hands. Meanwhile, it reduces the number of hand reset to reduce the operation time. The proposed interface achieves a natural and safe interaction between the human and the dual robot.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/ir-11-2018-0245","type":"journal-article","created":{"date-parts":[[2019,9,2]],"date-time":"2019-09-02T07:10:40Z","timestamp":1567408240000},"page":"800-811","source":"Crossref","is-referenced-by-count":7,"title":["Gesture-based human-robot interface for dual-robot with hybrid sensors"],"prefix":"10.1108","volume":"46","author":[{"given":"Bo","family":"Zhang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guanglong","family":"Du","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenming","family":"Shen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fang","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","published-online":{"date-parts":[[2019,9,2]]},"reference":[{"article-title":"Assessment of PrimeSense RGB-D camera for using in robotics: application to human body modeling","volume-title":"Proceeding of XIII Workshop of Physical Agent, WAF 2012","year":"2012","key":"key2022112510142327000_ref001"},{"key":"key2022112510142327000_ref002","doi-asserted-by":"crossref","first-page":"2527","DOI":"10.1145\/2207676.2208639","article-title":"1\u20acfilter: a simple speed-based low-pass filter for noisy input in interactive systems","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","year":"2012"},{"key":"key2022112510142327000_ref003","unstructured":"Chen, B. (2011), \u201cGesture tracking research and implementation of gesture recognition application platform\u201d, MS, Sun Yat-sen University."},{"key":"key2022112510142327000_ref004","first-page":"581","article-title":"Hand gesture based robot control system using leap motion","volume-title":"International Conference on Intelligent Robotics and Applications (ICIRA)","year":"2015"},{"key":"key2022112510142327000_ref005","first-page":"45","article-title":"Key technologies of EEG signal control rehabilitation robots","volume":"4","year":"2003","journal-title":"Robot Technique and Application"},{"issue":"2","key":"key2022112510142327000_ref006","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1109\/TVCG.2008.80","article-title":"Continuous collision detection for ellipsoids","volume":"15","year":"2009","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"issue":"1","key":"key2022112510142327000_ref007","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/j.rcim.2010.07.005","article-title":"Safe human\u2013robot interaction based on dynamic sphere-swept line bounding volumes","volume":"27","year":"2011","journal-title":"Robotics and Computer-Integrated Manufacturing"},{"issue":"4","key":"key2022112510142327000_ref008","doi-asserted-by":"crossref","first-page":"2257","DOI":"10.1109\/TIE.2014.2362095","article-title":"A markerless human\u2013robot interface using particle filter and kalman filter for dual robots","volume":"62","year":"2015","journal-title":"IEEE Transactions on Industrial Electronics"},{"key":"key2022112510142327000_ref009","first-page":"248","article-title":"Hidden-Markov-model-based hand gesture recognition techniques used for a human-robot interaction system","volume-title":"International Conference on Human-Computer Interaction","year":"2011"},{"issue":"8","key":"key2022112510142327000_ref010","first-page":"1901","article-title":"Multi-sensor adaptive filter data fusion algorithm","volume":"30","year":"2008","journal-title":"Journal of Electronics & Information Technology"},{"issue":"1","key":"key2022112510142327000_ref011","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.trit.2016.03.010","article-title":"Multi-LeapMotion sensor based demonstration for robotic refine tabletop object manipulation task","volume":"1","year":"2016","journal-title":"CAAI Transactions on Intelligence Technology"},{"issue":"3","key":"key2022112510142327000_ref012","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1109\/TRO.2008.921566","article-title":"Analysis of humanoid appearances in human-robot interaction","volume":"24","year":"2008","journal-title":"IEEE Transactions on Robotics"},{"issue":"2","key":"key2022112510142327000_ref013","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.3390\/s120201437","article-title":"Accuracy and resolution of kinect depth data for indoor mapping applications","volume":"12","year":"2012","journal-title":"Sensors"},{"key":"key2022112510142327000_ref014","first-page":"918","article-title":"Robot-human handover based on position and posture of human hand","volume-title":"International Conference on Soft Computing and Intelligent Systems (SCIS)","year":"2014"},{"key":"key2022112510142327000_ref015","first-page":"619","article-title":"Object recognition through human-robot interaction by speech","volume-title":"IEEE International Workshop on Robot and Human Interactive Communication (RO-MAN)","year":"2004"},{"issue":"1","key":"key2022112510142327000_ref016","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1080\/21642583.2017.1300109","article-title":"Teleoperation control of baxter robot using kalman filter-based sensor fusion","volume":"5","year":"2017","journal-title":"Systems Science & Control Engineering"},{"key":"key2022112510142327000_ref017","unstructured":"Li, J. (2014), \u201cResearch on multi-bipod robot cooperative control based on speech\u201d, MS, Xidian University."},{"issue":"2","key":"key2022112510142327000_ref018","doi-asserted-by":"crossref","first-page":"769","DOI":"10.1109\/TASE.2014.2359006","article-title":"Toward welding robot with human knowledge: a remotely-controlled approach","volume":"12","year":"2015","journal-title":"IEEE Transactions on Automation Science and Engineering"},{"key":"key2022112510142327000_ref019","first-page":"323","article-title":"Real time human pose recognition using leap motion sensor","volume-title":"IEEE International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN)","year":"2015"},{"key":"key2022112510142327000_ref020","first-page":"1565","article-title":"Hand gesture recognition with leap motion and kinect devices","volume-title":"IEEE International Conference on Image Processing (ICIP)","year":"2014"},{"issue":"1","key":"key2022112510142327000_ref021","doi-asserted-by":"crossref","first-page":"38565","DOI":"10.1038\/srep38565","article-title":"Noninvasive electroencephalogram based control of a robotic arm for reach and grasp tasks","volume":"6","year":"2016","journal-title":"Scientific Reports"},{"key":"key2022112510142327000_ref022","unstructured":"Pang, Q. (2015), \u201cResearch on 3D gesture data processing for human-computer interaction\u201d, MS, South China University of Technology."},{"volume-title":"Numerical Recipes 3rd Edition: The Art of Scientific Computing","year":"2007","key":"key2022112510142327000_ref023"},{"issue":"1","key":"key2022112510142327000_ref024","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10462-012-9356-9","article-title":"Vision based hand gesture recognition for human computer interaction: a survey","volume":"43","year":"2015","journal-title":"Artificial Intelligence Review"},{"issue":"12","key":"key2022112510142327000_ref025","doi-asserted-by":"crossref","first-page":"31268","DOI":"10.3390\/s151229853","article-title":"Control and guidance of low-cost robots via gesture perception for monitoring activities in the home","volume":"15","year":"2015","journal-title":"Sensors"},{"first-page":"252","article-title":"Resolving visual uncertainty and occlusion through probabilistic reasoning","year":"2000","key":"key2022112510142327000_ref026"},{"key":"key2022112510142327000_ref027","first-page":"407","article-title":"Adaptive emotional expression in robot-child interaction","volume-title":"ACM\/IEEE International Conference on Human-robot interaction","year":"2014"},{"key":"key2022112510142327000_ref028","first-page":"473","article-title":"Multiple-hand-gesture tracking using multiple cameras","volume-title":"IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)","year":"1999"},{"issue":"2","key":"key2022112510142327000_ref029","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1023\/A:1008918401478","article-title":"A gesture based interface for human-robot interaction","volume":"9","year":"2000","journal-title":"Autonomous Robots"},{"issue":"9\/12","key":"key2022112510142327000_ref030","first-page":"1921","article-title":"Continuous tool wear prediction based on Gaussian mixture regression model","volume":"66","year":"2013","journal-title":"The International Journal of Advanced Manufacturing Technology"},{"key":"key2022112510142327000_ref031","first-page":"107","article-title":"Industrial robot components assembly based on machine vision technology","volume":"8","year":"2015","journal-title":"Modular Machine Tool & Automatic Manufacturing Technique"},{"key":"key2022112510142327000_ref032","first-page":"143","article-title":"Design of human-computer interaction control system based on hand-gesture recognition","volume-title":"Youth Academic Annual Conference of Chinese Association of Automation (YAC)","year":"2017"},{"issue":"5","key":"key2022112510142327000_ref033","doi-asserted-by":"crossref","first-page":"6380","DOI":"10.3390\/s130506380","article-title":"Analysis of the accuracy and robustness of the leap motion controller","volume":"13","year":"2013","journal-title":"Sensors (Basel, Switzerland)"},{"issue":"4","key":"key2022112510142327000_ref034","doi-asserted-by":"crossref","first-page":"948","DOI":"10.1109\/TNN.2002.1021895","article-title":"Nonstationary color tracking for vision-based human-computer interaction","volume":"13","year":"2002","journal-title":"IEEE Transactions on Neural Networks"},{"issue":"1","key":"key2022112510142327000_ref035","first-page":"35","article-title":"Comparison of three-dimensional coordinate transformation algorithm","volume":"36","year":"2016","journal-title":"Journal on Journal of Geodesy and Geodynamics"},{"key":"key2022112510142327000_ref036","first-page":"70","article-title":"Study of adaptive weighted fusion estimated algorithm of multisensor data","volume":"1","year":"1998","journal-title":"Acta Metrologica Sinica"},{"issue":"3","key":"key2022112510142327000_ref037","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1108\/IR-12-2015-0222","article-title":"Ensuring safety in human-robot coexisting environment based on two-level protection","volume":"43","year":"2016","journal-title":"Industrial Robot: An International Journal"}],"container-title":["Industrial Robot: the international journal of robotics research and application"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IR-11-2018-0245\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IR-11-2018-0245\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T21:40:24Z","timestamp":1753393224000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/ir\/article\/46\/6\/800-811\/433917"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,2]]},"references-count":37,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2019,9,2]]},"published-print":{"date-parts":[[2019,11,14]]}},"alternative-id":["10.1108\/IR-11-2018-0245"],"URL":"https:\/\/doi.org\/10.1108\/ir-11-2018-0245","relation":{},"ISSN":["0143-991X","0143-991X"],"issn-type":[{"type":"print","value":"0143-991X"},{"type":"electronic","value":"0143-991X"}],"subject":[],"published":{"date-parts":[[2019,9,2]]}}}