{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T16:24:50Z","timestamp":1776183890412,"version":"3.50.1"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2020,11,23]],"date-time":"2020-11-23T00:00:00Z","timestamp":1606089600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,11,23]],"date-time":"2020-11-23T00:00:00Z","timestamp":1606089600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100010418","name":"Institute for Information and communications Technology Promotion","doi-asserted-by":"publisher","award":["2017-0-00383"],"award-info":[{"award-number":["2017-0-00383"]}],"id":[{"id":"10.13039\/501100010418","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003621","name":"Ministry of Science, ICT and Future Planning","doi-asserted-by":"publisher","award":["IITP-2018-2016-0-00314"],"award-info":[{"award-number":["IITP-2018-2016-0-00314"]}],"id":[{"id":"10.13039\/501100003621","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2021,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>A real-time fingertip-gesture-based interface is still challenging for human\u2013computer interactions, due to sensor noise, changing light levels, and the complexity of tracking a fingertip across a variety of subjects. Using fingertip tracking as a virtual mouse is a popular method of interacting with computers without a mouse device. In this work, we propose a novel virtual-mouse method using RGB-D images and fingertip detection. The hand region of interest and the center of the palm are first extracted using in-depth skeleton-joint information images from a Microsoft Kinect Sensor version 2, and then converted into a binary image. Then, the contours of the hands are extracted and described by a border-tracing algorithm. The K-cosine algorithm is used to detect the fingertip location, based on the hand-contour coordinates. Finally, the fingertip location is mapped to RGB images to control the mouse cursor based on a virtual screen. The system tracks fingertips in real-time at 30 FPS on a desktop computer using a single CPU and Kinect V2. The experimental results showed a high accuracy level; the system can work well in real-world environments with a single CPU. This fingertip-gesture-based interface allows humans to easily interact with computers by hand.<\/jats:p>","DOI":"10.1007\/s11042-020-10156-5","type":"journal-article","created":{"date-parts":[[2020,11,24]],"date-time":"2020-11-24T00:05:10Z","timestamp":1606176310000},"page":"10473-10490","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":45,"title":["Real-time virtual mouse system using RGB-D images and fingertip detection"],"prefix":"10.1007","volume":"80","author":[{"given":"Dinh-Son","family":"Tran","sequence":"first","affiliation":[]},{"given":"Ngoc-Huynh","family":"Ho","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3024-5060","authenticated-orcid":false,"given":"Hyung-Jeong","family":"Yang","sequence":"additional","affiliation":[]},{"given":"Soo-Hyung","family":"Kim","sequence":"additional","affiliation":[]},{"given":"Guee Sang","family":"Lee","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,11,23]]},"reference":[{"key":"10156_CR1","unstructured":"Abhilash S S, Lisho Thomas, NWCC (2018) Virtual Mouse Using Hand Gesture. International Research Journal of Engineering and Technology (IRJET)"},{"key":"10156_CR2","doi-asserted-by":"crossref","unstructured":"Bakar MZA, Samad R, Pebrianti D, et al (2015) Finger application using K-curvature method and Kinect sensor in real-time. In: technology management and emerging technologies (ISTMET), 2015 international symposium on. Pp 218\u2013222","DOI":"10.1109\/ISTMET.2015.7359032"},{"key":"10156_CR3","unstructured":"Banerjee A, Ghosh A, Bharadwaj K, Saikia H (2014) Mouse control using a web camera based on colour detection. arXiv Prepr arXiv14034722"},{"key":"10156_CR4","doi-asserted-by":"publisher","first-page":"4313","DOI":"10.1007\/s11042-016-3374-6","volume":"76","author":"Z Cai","year":"2017","unstructured":"Cai Z, Han J, Liu L, Shao L (2017) RGB-D datasets using microsoft kinect or similar sensors: a survey. Multimed Tools Appl 76:4313\u20134355","journal-title":"Multimed Tools Appl"},{"key":"10156_CR5","unstructured":"Cao Z, Hidalgo G, Simon T, et al (2018) OpenPose: realtime multi-person 2D pose estimation using part affinity fields. arXiv Prepr arXiv181208008"},{"key":"10156_CR6","doi-asserted-by":"crossref","unstructured":"Chen Z, Kim J-T, Liang J, et al (2014) Real-time hand gesture recognition using finger segmentation. Sci World J 2014:","DOI":"10.1155\/2014\/267872"},{"key":"10156_CR7","unstructured":"Coroiu ADCA, Coroiu A (2018) Interchangeability of Kinect and Orbbec sensors for gesture recognition. In: 2018 IEEE 14th international conference on intelligent computer communication and processing (ICCP). Pp 309\u2013315"},{"key":"10156_CR8","doi-asserted-by":"crossref","unstructured":"Fossati A, Gall J, Grabner H, et al (2012) Consumer depth cameras for computer vision: research topics and applications. Springer Science & Business Media","DOI":"10.1007\/978-1-4471-4640-7"},{"key":"10156_CR9","doi-asserted-by":"publisher","first-page":"4422","DOI":"10.1109\/TIP.2018.2834824","volume":"27","author":"L Ge","year":"2018","unstructured":"Ge L, Liang H, Yuan J, Thalmann D (2018) Robust 3D hand pose estimation from single depth images using multi-view CNNs. IEEE Trans Image Process 27:4422\u20134436","journal-title":"IEEE Trans Image Process"},{"key":"10156_CR10","doi-asserted-by":"crossref","unstructured":"Ge L, Liang H, Yuan J, Thalmann D (2018) Real-time 3D hand pose estimation with 3D convolutional neural networks. IEEE Trans Pattern Anal Mach Intell","DOI":"10.1109\/TPAMI.2018.2827052"},{"key":"10156_CR11","unstructured":"Gonzalez, RWR (2008) Digital image processing. In: digital image processing, 3rd edn, Upeer Saddle River, NJ: Prentice Hall"},{"key":"10156_CR12","doi-asserted-by":"publisher","first-page":"657","DOI":"10.1016\/j.protcy.2016.01.137","volume":"22","author":"H-S Grif","year":"2016","unstructured":"Grif H-S, Farcas CC (2016) Mouse cursor control system based on hand gesture. Procedia Technol 22:657\u2013661","journal-title":"Procedia Technol"},{"key":"10156_CR13","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1016\/j.procs.2017.09.092","volume":"115","author":"A Haria","year":"2017","unstructured":"Haria A, Subramanian A, Asokkumar N, Poddar S, Nayak JS (2017) Hand gesture recognition for human computer interaction. Procedia Comput Sci 115:367\u2013374","journal-title":"Procedia Comput Sci"},{"key":"10156_CR14","unstructured":"Ismail NHB, Basah SNB (2015) The applications of Microsoft Kinect for human motion capture and analysis: a review. In: biomedical engineering (ICoBE), 2015 2nd international conference on. Pp 1\u20134"},{"key":"10156_CR15","doi-asserted-by":"publisher","first-page":"25181","DOI":"10.1109\/ACCESS.2017.2768405","volume":"5","author":"C Jeon","year":"2017","unstructured":"Jeon C, Kwon O-J, Shin D, Shin D (2017) Hand-mouse Interface using virtual monitor concept for natural interaction. IEEE Access 5:25181\u201325188","journal-title":"IEEE Access"},{"key":"10156_CR16","doi-asserted-by":"publisher","first-page":"29953","DOI":"10.1007\/s11042-018-6748-0","volume":"78","author":"D Jiang","year":"2019","unstructured":"Jiang D, Li G, Sun Y, Kong J, Tao B (2019) Gesture recognition based on skeletonization algorithm and CNN with ASL database. Multimed Tools Appl 78:29953\u201329970","journal-title":"Multimed Tools Appl"},{"key":"10156_CR17","doi-asserted-by":"crossref","unstructured":"Kadam S, Sharma N, Shetty T, Divekar R (2015) Mouse operations using finger tracking. Int J Comput Appl 116","DOI":"10.5120\/20455-2812"},{"key":"10156_CR18","doi-asserted-by":"crossref","unstructured":"Khamis S, Taylor J, Shotton J, et al (2015) Learning an efficient model of hand shape variation from depth images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 2540\u20132548","DOI":"10.1109\/CVPR.2015.7298869"},{"key":"10156_CR19","unstructured":"Le PD, Nguyen VH (2014) Remote mouse control using fingertip tracking technique. In: AETA 2013: recent advances in electrical engineering and related sciences. Springer, pp 467\u2013476"},{"key":"10156_CR20","doi-asserted-by":"crossref","unstructured":"Ma M, Meyer BJ, Lin L, et al (2018) VicoVR-based wireless daily activity recognition and assessment system for stroke rehabilitation. In: 2018 IEEE international conference on bioinformatics and biomedicine (BIBM). Pp 1117\u20131121","DOI":"10.1109\/BIBM.2018.8621151"},{"key":"10156_CR21","doi-asserted-by":"crossref","unstructured":"Murugeswari M, Veluchamy S (2014) Hand gesture recognition system for real-time application. In: advanced communication control and computing technologies (ICACCCT), 2014 international conference on. Pp 1220\u20131225","DOI":"10.1109\/ICACCCT.2014.7019293"},{"key":"10156_CR22","doi-asserted-by":"crossref","unstructured":"Oikonomidis I, Kyriazis N, Argyros AA (2011) Efficient model-based 3d tracking of hand articulations using kinect. In: BmVC. p 3","DOI":"10.5244\/C.25.101"},{"key":"10156_CR23","first-page":"156","volume":"4","author":"R Pradhan","year":"2010","unstructured":"Pradhan R, Kumar S, Agarwal R et al (2010) Contour line tracing algorithm for digital topographic maps. Int J Image Process 4:156\u2013163","journal-title":"Int J Image Process"},{"key":"10156_CR24","doi-asserted-by":"publisher","first-page":"21","DOI":"10.5121\/iju.2012.3103","volume":"3","author":"SS Rautaray","year":"2012","unstructured":"Rautaray SS, Agrawal A (2012) Real time hand gesture recognition system for dynamic applications. Int J UbiComp 3:21\u201331","journal-title":"Int J UbiComp"},{"key":"10156_CR25","doi-asserted-by":"crossref","unstructured":"Reza MN, Hossain MS, Ahmad M (2015) Real time mouse cursor control based on bare finger movement using webcam to improve HCI. In: electrical engineering and information communication technology (ICEEICT), 2015 international conference on. Pp 1\u20135","DOI":"10.1109\/ICEEICT.2015.7307391"},{"key":"10156_CR26","unstructured":"Robotix (2012) Technology robotix society. In: https:\/\/2018.robotix.in\/https:\/\/2018.robotix.in\/tutorial\/imageprocessing\/blob_detection\/"},{"key":"10156_CR27","doi-asserted-by":"crossref","unstructured":"Sanchez-Riera J, Srinivasan K, Hua K-L, et al (2017) Robust rgb-d hand tracking using deep learning priors. IEEE Trans Circuits Syst Video Technol","DOI":"10.1109\/TCSVT.2017.2718622"},{"key":"10156_CR28","doi-asserted-by":"crossref","unstructured":"Sharp T, Keskin C, Robertson D, et al (2015) Accurate, robust, and flexible real-time hand tracking. In: proceedings of the 33rd annual ACM conference on human factors in computing systems. Pp 3633\u20133642","DOI":"10.1145\/2702123.2702179"},{"key":"10156_CR29","unstructured":"Sun T-H (2008) K-cosine corner detection. JCP 3:16\u201322"},{"key":"10156_CR30","doi-asserted-by":"publisher","first-page":"1374","DOI":"10.1109\/TPAMI.2016.2599170","volume":"39","author":"D Tang","year":"2017","unstructured":"Tang D, Chang HJ, Tejani A, Kim T-K (2017) Latent regression forest: structured estimation of 3d hand poses. IEEE Trans Pattern Anal Mach Intell 39:1374\u20131387","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"10156_CR31","unstructured":"Tsai T-H, Huang C-C, Zhang K-L (2015) Embedded virtual mouse system by using hand gesture recognition. In: consumer electronics-Taiwan (ICCE-TW), 2015 IEEE international conference on. Pp 352\u2013353"},{"key":"10156_CR32","first-page":"63","volume":"28","author":"RY Wang","year":"2009","unstructured":"Wang RY, Popovi\u0107 J (2009) Real-time hand-tracking with a color glove. ACM Trans Graph 28:63","journal-title":"ACM Trans Graph"},{"key":"10156_CR33","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1016\/j.cviu.2018.04.007","volume":"171","author":"P Wang","year":"2018","unstructured":"Wang P, Li W, Ogunbona P, Wan J, Escalera S (2018) RGB-D-based human motion recognition with deep learning: a survey. Comput Vis Image Underst 171:118\u2013139","journal-title":"Comput Vis Image Underst"},{"key":"10156_CR34","unstructured":"Xu P (2017) A real-time hand gesture recognition and human-computer interaction system. arXiv Prepr arXiv170407296"},{"key":"10156_CR35","unstructured":"Zhao W, Chai J, Xu Y-Q (2012) Combining marker-based mocap and RGB-D camera for acquiring high-fidelity hand motion data. In: Proceedings of the ACM SIGGRAPH\/eurographics symposium on computer animation. pp. 33\u201342"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-10156-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11042-020-10156-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-10156-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,26]],"date-time":"2021-03-26T00:08:44Z","timestamp":1616717324000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11042-020-10156-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,23]]},"references-count":35,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2021,3]]}},"alternative-id":["10156"],"URL":"https:\/\/doi.org\/10.1007\/s11042-020-10156-5","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"value":"1380-7501","type":"print"},{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,23]]},"assertion":[{"value":"2 March 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 August 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 November 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 November 2020","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}