{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,5]],"date-time":"2026-02-05T11:45:11Z","timestamp":1770291911668,"version":"3.49.0"},"reference-count":34,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T00:00:00Z","timestamp":1625097600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/M025977\/1"],"award-info":[{"award-number":["EP\/M025977\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/R004242\/1"],"award-info":[{"award-number":["EP\/R004242\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"name":"INSPIRE Fellowship, Ministry of Science and Technology, Government of India.","award":["DST\/ INSPIRE Fellow-432ship\/ 2014\/[249]"],"award-info":[{"award-number":["DST\/ INSPIRE Fellow-432ship\/ 2014\/[249]"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Humans typically fixate on objects before moving their arm to grasp the object. Patients with ALS disorder can also select the object with their intact eye movement, but are unable to move their limb due to the loss of voluntary muscle control. Though several research works have already achieved success in generating the correct grasp type from their brain measurement, we are still searching for fine controll over an object with a grasp assistive device (orthosis\/exoskeleton\/robotic arm). Object orientation and object width are two important parameters for controlling the wrist angle and the grasp aperture of the assistive device to replicate a human-like stable grasp. Vision systems are already evolved to measure the geometrical attributes of the object to control the grasp with a prosthetic hand. However, most of the existing vision systems are integrated with electromyography and require some amount of voluntary muscle movement to control the vision system. Due to that reason, those systems are not beneficial for the users with brain-controlled assistive devices. Here, we implemented a vision system which can be controlled through the human gaze. We measured the vertical and horizontal electrooculogram signals and controlled the pan and tilt of a cap-mounted webcam to keep the object of interest in focus and at the centre of the picture. A simple \u2018signature\u2019 extraction procedure was also utilized to reduce the algorithmic complexity and system storage capacity. The developed device has been tested with ten healthy participants. We approximated the object orientation and the size of the object and determined an appropriate wrist orientation angle and the grasp aperture size within 22 ms. The combined accuracy exceeded 75%. The integration of the proposed system with the brain-controlled grasp assistive device and increasing the number of grasps can offer more natural manoeuvring in grasp for ALS patients.<\/jats:p>","DOI":"10.3390\/s21134515","type":"journal-article","created":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T05:00:10Z","timestamp":1625115610000},"page":"4515","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["An Electro-Oculogram Based Vision System for Grasp Assistive Devices\u2014A Proof of Concept Study"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9009-9611","authenticated-orcid":false,"given":"Rinku","family":"Roy","sequence":"first","affiliation":[{"name":"Advanced Technology and Development Centre, Indian Institute of Technology, Kharagpur 721302, India"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4700-9080","authenticated-orcid":false,"given":"Manjunatha","family":"Mahadevappa","sequence":"additional","affiliation":[{"name":"Indian Institute of Technology, School of Medical Science and Technology, Kharagpur 721302, India"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4217-0254","authenticated-orcid":false,"given":"Kianoush","family":"Nazarpour","sequence":"additional","affiliation":[{"name":"Edinburgh Neuroprosthetics Laboratory, The University of Edinburgh, Edinburgh EH8 9AB, UK"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1167\/12.1.3","article-title":"Decoupling eye and hand movement control: Visual short-term memory influences reach planning more than saccade planning","volume":"12","author":"Issen","year":"2012","journal-title":"J. Vis."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1037\/0096-1523.16.2.248","article-title":"Eye-hand coordination: Oculomotor control in rapid aimed limb movements","volume":"16","author":"Abrams","year":"1990","journal-title":"J. Exp. Psychol. Hum. Percept. Perform."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"056028","DOI":"10.1088\/1741-2552\/aad727","article-title":"A hybrid auricular control system: Direct, simultaneous, and proportional myoelectric control of two degrees of freedom in prosthetic hands","volume":"15","author":"Schmalfuss","year":"2018","journal-title":"J. Neural Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/j.humov.2018.08.005","article-title":"The target as an obstacle: Grasping an object at different heights","volume":"61","author":"Verheij","year":"2018","journal-title":"Hum. Mov. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/S0167-9457(02)00120-3","article-title":"Coordinated control of eye and hand movements in dynamic reaching","volume":"21","author":"Neggers","year":"2002","journal-title":"Hum. Mov. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Shaw, C., Quinn, A., and Daniel, E. (2014). Amyotrophic lateral sclerosis\/motor neurone disease. Palliative Care in Amyotrophic Lateral Sclerosis: From Diagnosis to Bereavement, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780199686025.003.0001"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"046002","DOI":"10.1088\/1741-2560\/7\/4\/046002","article-title":"Electrocorticographic amplitude predicts finger positions during slow grasping motions of the hand","volume":"7","author":"Acharya","year":"2010","journal-title":"J. Neural Eng."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"121","DOI":"10.3389\/fnins.2015.00121","article-title":"Global cortical activity predicts shape of hand during grasping","volume":"9","author":"Agashe","year":"2015","journal-title":"Front. Neurosci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2095","DOI":"10.1007\/s11517-018-1833-0","article-title":"A fingertip force prediction model for grasp patterns characterised from the chaotic behaviour of EEG","volume":"56","author":"Roy","year":"2018","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/s00401-012-1058-5","article-title":"Unravelling the enigma of selective vulnerability in neurodegeneration: Motor neurons resistant to degeneration in ALS show distinct gene expression characteristics and decreased susceptibility to excitotoxicity","volume":"125","author":"Brockington","year":"2013","journal-title":"Acta Neuropathol."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Taverne, L.T., Cognolato, M., B\u00fctzer, T., Gassert, R., and Hilliges, O. (2019, January 20\u201324). Video-based Prediction of Hand-grasp Preshaping with Application to Prosthesis Control. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794175"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"046001","DOI":"10.1088\/1741-2560\/11\/4\/046001","article-title":"Stereovision and augmented reality for closed-loop control of grasping in hand prostheses","volume":"11","author":"Markovic","year":"2014","journal-title":"J. Neural Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2576","DOI":"10.1109\/TBME.2015.2448457","article-title":"Depth sensing for improved control of lower limb prostheses","volume":"62","author":"Krausz","year":"2015","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"066022","DOI":"10.1088\/1741-2560\/12\/6\/066022","article-title":"Sensor fusion and computer vision for context-aware control of a multi degree-of-freedom prosthesis","volume":"12","author":"Markovic","year":"2015","journal-title":"J. Neural Eng."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ghazaei, G., Alameer, A., Degenaar, P., Morgan, G., and Nazarpour, K. (2015, January 1\u20132). An exploratory study on the use of convolutional neural networks for object grasp classification. Proceedings of the 2nd IET International Conference on Intelligent Signal Processing 2015 (ISP), London, UK.","DOI":"10.1049\/cp.2015.1760"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"036025","DOI":"10.1088\/1741-2552\/aa6802","article-title":"Deep learning-based artificial vision for grasp classification in myoelectric hands","volume":"14","author":"Ghazaei","year":"2017","journal-title":"J. Neural Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1186\/1743-0003-7-42","article-title":"Cognitive vision system for control of dexterous prosthetic hands: Experimental evaluation","volume":"7","author":"Cipriani","year":"2010","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1111\/j.1525-1594.2010.01040.x","article-title":"Transradial prosthesis: Artificial vision for control of prehension","volume":"35","year":"2011","journal-title":"Artif. Organs"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Nazarpour, K. (2020). The future of myoelectric prosthetics control. Control of Prosthetic Hands: Challenges and Emerging Avenues, Institution of Engineering and Technology.","DOI":"10.1049\/PBHE022E"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Alameer, A., Degenaar, P., and Nazarpour, K. (2019). Context-Based Object Recognition: Indoor Versus Outdoor Environments. Sci. Inform. Conf., 473\u2013490.","DOI":"10.1007\/978-3-030-17798-0_38"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"102698","DOI":"10.1016\/j.jvcir.2019.102698","article-title":"Objects and scenes classification with selective use of central and peripheral image content","volume":"66","author":"Alameer","year":"2020","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1177\/0278364914549607","article-title":"Deep learning for detecting robotic grasps","volume":"34","author":"Lenz","year":"2015","journal-title":"Int. J. Robot. Res."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1177\/0278364915594244","article-title":"One-shot learning and generation of dexterous grasps for novel objects","volume":"35","author":"Kopicki","year":"2016","journal-title":"Int. J. Robot. Res."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2090","DOI":"10.1109\/TNSRE.2020.3007625","article-title":"Computer vision-based grasp pattern recognition with application to myoelectric control of dexterous hand prosthesis","volume":"28","author":"Shi","year":"2020","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Roy, R., and Nazarpour, K. (2020, January 23\u201325). A low-cost Raspberry PI-based vision system for upper-limb prosthetics. Proceedings of the 2020 27th IEEE International Conference on Electronics, Circuits and Systems (ICECS), Glasgow, Scotland.","DOI":"10.1109\/ICECS49266.2020.9294901"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"e6444","DOI":"10.1097\/MD.0000000000006444","article-title":"A crucial temporal accuracy test of combining EEG and Tobii eye tracker","volume":"96","author":"Xue","year":"2017","journal-title":"Medicine"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"670","DOI":"10.1080\/001401398186838","article-title":"Brain potentials associated with eye fixations during visual tasks under different lighting systems","volume":"41","author":"Yagi","year":"1998","journal-title":"Ergonomics"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Bulling, A., Roggen, D., and Tr\u00f6ster, G. (2009). Wearable EOG goggles: Eye-based interaction in everyday environments. CHI\u201909 Extended Abstracts on Human Factors in Computing Systems, Association for Computing Machinery.","DOI":"10.1145\/1520340.1520468"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Roy, R., Kumar, A., Mahadevappa, M., and Kumar, C.S. (2018, January 28\u201331). Deep Learning Based Object Shape Identification from EOG Controlled Vision System. Proceedings of the 2018 IEEE SENSORS, New Delhi, India.","DOI":"10.1109\/ICSENS.2018.8589722"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1109\/THMS.2015.2470657","article-title":"The grasp taxonomy of human grasp types","volume":"46","author":"Feix","year":"2015","journal-title":"IEEE Trans. Hum. Mach. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Bae, J.H., Park, S.W., Kim, D., Baeg, M.H., and Oh, S.R. (2012, January 14\u201318). A grasp strategy with the geometric centroid of a groped object shape derived from contact spots. Proceedings of the 2012 IEEE International Conference on Robotics and Automation, St. Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6225379"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Eppner, C., and Brock, O. (2013, January 3\u20137). Grasping unknown objects by exploiting shape adaptability and environmental constraints. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696928"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Cotton, D., Cranny, A., Chappell, P., White, N., and Beeby, S. (2006, January 31). Control strategies for a multiple degree of freedom prosthetic hand. Proceedings of the 2006 UKACC Control 2006 Mini Symposia, Glasgow, UK.","DOI":"10.1049\/ic:20060274"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Rigelsford, J. (2001). Control of Movement for the Physically Disabled. Ind. Robot. Int. J., 28.","DOI":"10.1108\/ir.2001.04928eae.001"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/13\/4515\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:24:33Z","timestamp":1760163873000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/13\/4515"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,1]]},"references-count":34,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["s21134515"],"URL":"https:\/\/doi.org\/10.3390\/s21134515","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,1]]}}}