{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T21:24:36Z","timestamp":1776374676704,"version":"3.51.2"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2022,1,10]],"date-time":"2022-01-10T00:00:00Z","timestamp":1641772800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,1,10]],"date-time":"2022-01-10T00:00:00Z","timestamp":1641772800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004070","name":"khalifa university of science, technology and research","doi-asserted-by":"publisher","award":["CIRA-2018-55 and RC1- 2018-KUCARS"],"award-info":[{"award-number":["CIRA-2018-55 and RC1- 2018-KUCARS"]}],"id":[{"id":"10.13039\/501100004070","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Intell Manuf"],"published-print":{"date-parts":[[2022,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Robotic vision plays a key role for perceiving the environment in grasping applications. However, the conventional framed-based robotic vision, suffering from motion blur and low sampling rate, may not meet the automation needs of evolving industrial requirements. This paper, for the first time, proposes an event-based robotic grasping framework for multiple known and unknown objects in a cluttered scene. With advantages of microsecond-level sampling rate and no motion blur of event camera, the model-based and model-free approaches are developed for known and unknown objects\u2019 grasping respectively. The event-based multi-view approach is used to localize the objects in the scene in the model-based approach, and then point cloud processing is utilized to cluster and register the objects. The proposed model-free approach, on the other hand, utilizes the developed event-based object segmentation, visual servoing and grasp planning to localize, align to, and grasp the targeting object. Using a UR10 robot with an eye-in-hand neuromorphic camera and a Barrett hand gripper, the proposed approaches are experimentally validated with objects of different sizes. Furthermore, it demonstrates robustness and a significant advantage over grasping with a traditional frame-based camera in low-light conditions.<\/jats:p>","DOI":"10.1007\/s10845-021-01887-9","type":"journal-article","created":{"date-parts":[[2022,1,10]],"date-time":"2022-01-10T16:02:55Z","timestamp":1641830575000},"page":"593-615","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["Real-time grasping strategies using event camera"],"prefix":"10.1007","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2782-9068","authenticated-orcid":false,"given":"Xiaoqian","family":"Huang","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8478-2729","authenticated-orcid":false,"given":"Mohamad","family":"Halwani","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5372-0154","authenticated-orcid":false,"given":"Rajkumar","family":"Muthusamy","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3006-2320","authenticated-orcid":false,"given":"Abdulla","family":"Ayyad","sequence":"additional","affiliation":[]},{"given":"Dewald","family":"Swart","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6405-8402","authenticated-orcid":false,"given":"Lakmal","family":"Seneviratne","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5327-1902","authenticated-orcid":false,"given":"Dongming","family":"Gan","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4331-7254","authenticated-orcid":false,"given":"Yahya","family":"Zweiri","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,1,10]]},"reference":[{"key":"1887_CR1","doi-asserted-by":"crossref","unstructured":"Asadi, K., Haritsa, V. R., Han, K., & Ore, J.-P. (2021). Automated object manipulation using vision-based mobile robotic system for construction applications. Journal of Computing in Civil Engineering, 35(1), 04020058.","DOI":"10.1061\/(ASCE)CP.1943-5487.0000946"},{"key":"1887_CR2","doi-asserted-by":"crossref","unstructured":"Barranco, F., Fermuller, C., & Ros, E. (2018). Real-time clustering and multi-target tracking using event-based sensors. In 2018 IEEE\/RSJ international conference on intelligent robots and systems (IROS) (pp. 5764\u20135769). IEEE.","DOI":"10.1109\/IROS.2018.8593380"},{"key":"1887_CR3","doi-asserted-by":"publisher","first-page":"51","DOI":"10.3389\/fnbot.2020.00051","volume":"14","author":"H Bin Li","year":"2020","unstructured":"Bin Li, H., Cao, Z. Q., Yingbai, H., Wang, Z., & Liang, Z. (2020). Event-based robotic grasping detection with neuromorphic vision sensor and event-grasping dataset. Frontiers in Neurorobotics, 14, 51.","journal-title":"Frontiers in Neurorobotics"},{"issue":"2","key":"1887_CR4","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1109\/TRO.2013.2289018","volume":"30","author":"J Bohg","year":"2013","unstructured":"Bohg, J., Morales, A., Asfour, T., & Kragic, D. (2013). Data-driven grasp synthesis-a survey. IEEE Transactions on Robotics, 30(2), 289\u2013309.","journal-title":"IEEE Transactions on Robotics"},{"key":"1887_CR5","doi-asserted-by":"crossref","unstructured":"Bolya, D., Zhou, C., Xiao, F., & Lee, Y.\u00a0J. (2019). Yolact: Real-time instance segmentation. In Proceedings of the IEEE\/CVF international conference on computer vision (pp. 9157\u20139166).","DOI":"10.1109\/ICCV.2019.00925"},{"issue":"12","key":"1887_CR6","doi-asserted-by":"publisher","first-page":"3205","DOI":"10.1109\/TMM.2019.2916104","volume":"21","author":"C Chen","year":"2019","unstructured":"Chen, C., & Ling, Q. (2019). Adaptive convolution for object detection. IEEE Transactions on Multimedia, 21(12), 3205\u20133217.","journal-title":"IEEE Transactions on Multimedia"},{"issue":"3","key":"1887_CR7","first-page":"273","volume":"20","author":"C Cortes","year":"1995","unstructured":"Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine learning, 20(3), 273\u2013297.","journal-title":"Machine learning"},{"key":"1887_CR8","unstructured":"Davis 346. https:\/\/inivation.com\/wp-content\/uploads\/2019\/08\/DAVIS346.pdf. Accessed 08 2019."},{"key":"1887_CR9","doi-asserted-by":"crossref","unstructured":"Du, G., Wang, K., & Lian, S. (2019). Vision-based robotic grasping from object localization pose estimation grasp detection to motion planning: A review. arXiv preprint arXiv:1905.06658.","DOI":"10.1007\/s10462-020-09888-5"},{"issue":"1\u20132","key":"1887_CR10","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1016\/0924-4247(96)01277-0","volume":"56","author":"R Etienne-Cummings","year":"1996","unstructured":"Etienne-Cummings, R., & der Spiegel, J. V. (1996). Neuromorphic vision sensors. Sensors and Actuators A: Physical, 56(1\u20132), 19\u201329.","journal-title":"Sensors and Actuators A: Physical"},{"issue":"1","key":"1887_CR11","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1109\/TIT.1975.1055330","volume":"21","author":"K Fukunaga","year":"1975","unstructured":"Fukunaga, K., & Hostetler, L. (1975). The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Transactions on Information Theory, 21(1), 32\u201340.","journal-title":"IEEE Transactions on Information Theory"},{"key":"1887_CR12","doi-asserted-by":"crossref","unstructured":"Gallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., et al. (2019). Event-based vision: A survey. arXiv preprint arXiv:1904.08405.","DOI":"10.1109\/TPAMI.2020.3008413"},{"key":"1887_CR13","unstructured":"Hill, J. (1979). Real time control of a robot with a mobile camera. In 9th International symposium on industrial robots, 1979 (pp. 233\u2013246)."},{"key":"1887_CR14","doi-asserted-by":"crossref","unstructured":"Hu, Y., Fua, P., Wang, W., & Salzmann, M. (2020). Single-stage 6d object pose estimation. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 2930\u20132939).","DOI":"10.1109\/CVPR42600.2020.00300"},{"issue":"17","key":"1887_CR15","doi-asserted-by":"publisher","first-page":"4724","DOI":"10.3390\/s20174724","volume":"20","author":"X Huang","year":"2020","unstructured":"Huang, X., Muthusamy, R., Hassan, E., Niu, Z., Seneviratne, L., Gan, D., & Zweiri, Y. (2020). Neuromorphic vision based contact-level classification in robotic grasping applications. Sensors, 20(17), 4724.","journal-title":"Sensors"},{"issue":"5469","key":"1887_CR16","doi-asserted-by":"publisher","first-page":"1189","DOI":"10.1126\/science.288.5469.1189","volume":"288","author":"G Indiveri","year":"2000","unstructured":"Indiveri, G., & Douglas, R. (2000). Neuromorphic vision sensors. Science, 288(5469), 1189\u20131190.","journal-title":"Science"},{"key":"1887_CR17","doi-asserted-by":"crossref","unstructured":"Kleeberger, K., Bormann, R., Kraus, W., & Huber, M.\u00a0F. (2020). A survey on learning-based robotic grasping. Current Robotics Reports, 1\u201311.","DOI":"10.1007\/s43154-020-00021-6"},{"issue":"2","key":"1887_CR18","doi-asserted-by":"publisher","first-page":"451","DOI":"10.1016\/S0031-3203(02)00060-2","volume":"36","author":"A Likas","year":"2003","unstructured":"Likas, A., Vlassis, N., & Verbeek, J. J. (2003). The global k-means clustering algorithm. Pattern recognition, 36(2), 451\u2013461.","journal-title":"Pattern recognition"},{"key":"1887_CR19","unstructured":"Milford, M., Kim, H., Leutenegger, S., & Davison, A. (2015). Towards visual slam with event-based cameras. In The problem of mobile sensors workshop in conjunction with RSS."},{"key":"1887_CR20","doi-asserted-by":"crossref","unstructured":"Mitrokhin, A., Ferm\u00fcller, C., Parameshwara, C., & Aloimonos, Y. (2018) Event-based moving object detection and tracking. In 2018 IEEE\/RSJ international conference on intelligent robots and systems (IROS) (pp. 1\u20139). IEEE.","DOI":"10.1109\/IROS.2018.8593805"},{"key":"1887_CR21","unstructured":"Multi-fingered programmable grasper. https:\/\/advanced.barrett.com\/barretthand. Accessed 08 2019."},{"key":"1887_CR22","doi-asserted-by":"crossref","unstructured":"Muthusamy, R., Huang, X., Zweiri, Y., Seneviratne, L., & Gan, D. (2020). Neuromorphic event-based slip detection and suppression in robotic grasping and manipulation. arXiv preprint arXiv:2004.07386.","DOI":"10.1109\/ACCESS.2020.3017738"},{"key":"1887_CR23","doi-asserted-by":"publisher","first-page":"55853","DOI":"10.1109\/ACCESS.2021.3071261","volume":"9","author":"R Muthusamy","year":"2021","unstructured":"Muthusamy, R., Ayyad, A., Halwani, M., Swart, D., Gan, D., Seneviratne, L., & Zweiri, Y. (2021). Neuromorphic eye-in-hand visual servoing. IEEE Access, 9, 55853\u201355870.","journal-title":"IEEE Access"},{"issue":"5","key":"1887_CR24","doi-asserted-by":"publisher","first-page":"1881","DOI":"10.1109\/TIM.2019.2919354","volume":"69","author":"FB Naeini","year":"2019","unstructured":"Naeini, F. B., AlAli, A. M., Al-Husari, R., Rigi, A., Al-Sharman, M. K., Makris, D., & Zweiri, Y. (2019). A novel dynamic-vision-based approach for tactile sensing applications. IEEE Transactions on Instrumentation and Measurement, 69(5), 1881\u20131893.","journal-title":"IEEE Transactions on Instrumentation and Measurement"},{"issue":"16","key":"1887_CR25","doi-asserted-by":"publisher","first-page":"4469","DOI":"10.3390\/s20164469","volume":"20","author":"FB Naeini","year":"2020","unstructured":"Naeini, F. B., Makris, D., Gan, D., & Zweiri, Y. (2020). Dynamic-vision-based force measurements using convolutional recurrent neural networks. Sensors, 20(16), 4469.","journal-title":"Sensors"},{"issue":"2","key":"1887_CR26","doi-asserted-by":"publisher","first-page":"1883","DOI":"10.4249\/scholarpedia.1883","volume":"4","author":"LE Peterson","year":"2009","unstructured":"Peterson, L. E. (2009). K-nearest neighbor. Scholarpedia, 4(2), 1883.","journal-title":"Scholarpedia"},{"key":"1887_CR27","doi-asserted-by":"crossref","unstructured":"Rebecq, H., Gallego, G. & Davide, S. (2016). Emvs: Event-based multi-view stereo.","DOI":"10.5244\/C.30.63"},{"key":"1887_CR28","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016). You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 779\u2013788).","DOI":"10.1109\/CVPR.2016.91"},{"key":"1887_CR29","unstructured":"Ren, S., He, K., Girshick, R., & Sun, J. (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. arXiv preprint arXiv:1506.01497."},{"issue":"2","key":"1887_CR30","doi-asserted-by":"publisher","first-page":"333","DOI":"10.3390\/s18020333","volume":"18","author":"A Rigi","year":"2018","unstructured":"Rigi, A., Naeini, F. B., Makris, D., & Zweiri, Y. (2018). A novel event-based incipient slip detection using dynamic active-pixel vision sensor (Davis). Sensors, 18(2), 333.","journal-title":"Sensors"},{"key":"1887_CR31","doi-asserted-by":"crossref","unstructured":"Rusinkiewicz, S., & Levoy, M. (2001). Efficient variants of the ICP algorithm. In Proceedings third international conference on 3-D digital imaging and modeling (pp. 145\u2013152). IEEE.","DOI":"10.1109\/IM.2001.924423"},{"key":"1887_CR32","doi-asserted-by":"crossref","unstructured":"Rusu, R. B., & Cousins, S. (2011). 3d is here: Point cloud library (PCL). In 2011 IEEE international conference on robotics and automation, (pp. 1\u20134).","DOI":"10.1109\/ICRA.2011.5980567"},{"issue":"3","key":"1887_CR33","doi-asserted-by":"publisher","first-page":"326","DOI":"10.1016\/j.robot.2011.07.016","volume":"60","author":"A Sahbani","year":"2012","unstructured":"Sahbani, A., El-Khoury, S., & Bidaud, P. (2012). An overview of 3d object grasp synthesis algorithms. Robotics and Autonomous Systems, 60(3), 326\u2013336.","journal-title":"Robotics and Autonomous Systems"},{"issue":"2","key":"1887_CR34","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1016\/j.cag.2006.11.011","volume":"31","author":"J Sankaranarayanan","year":"2007","unstructured":"Sankaranarayanan, J., Samet, H., & Varshney, A. (2007). A fast all nearest neighbor algorithm for applications involving large point-clouds. Computers&amp; Graphics, 31(2), 157\u2013174.","journal-title":"Computers & Graphics"},{"issue":"7","key":"1887_CR35","doi-asserted-by":"publisher","first-page":"2366","DOI":"10.3390\/s18072366","volume":"18","author":"A \u00dabeda","year":"2018","unstructured":"\u00dabeda, A., Zapata-Impata, B. S., Puente, S. T., Gil, P., Candelas, F., & Torres, F. (2018). A vision-driven collaborative robotic grasping system tele-operated by surface electromyography. Sensors, 18(7), 2366.","journal-title":"Sensors"},{"issue":"04","key":"1887_CR36","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1109\/34.88573","volume":"13","author":"S Umeyama","year":"1991","unstructured":"Umeyama, S. (1991). Least-squares estimation of transformation parameters between two point patterns. IEEE Transactions on Pattern Analysis&amp; Machine Intelligence, 13(04), 376\u2013380.","journal-title":"IEEE Transactions on Pattern Analysis & Machine Intelligence"},{"key":"1887_CR37","unstructured":"Ur10 technical specifications. https:\/\/www.universal-robots.com\/media\/50895\/ur10_en.pdf. Accessed 09 2016."},{"key":"1887_CR38","doi-asserted-by":"crossref","unstructured":"Vasco, V., Glover, A., & Bartolozzi, C. (2016). Fast event-based Harris corner detection exploiting the advantages of event-driven cameras. In 2016 IEEE\/RSJ international conference on intelligent robots and systems (IROS) (pp. 4144\u20134149).","DOI":"10.1109\/IROS.2016.7759610"},{"key":"1887_CR39","doi-asserted-by":"crossref","unstructured":"Wang, X., Kong, T., Shen, C., Jiang, Y., & Li, L. (2020). Solo: Segmenting objects by locations. In European Conference on Computer Vision, (pp. 649\u2013665). Springer.","DOI":"10.1007\/978-3-030-58523-5_38"},{"key":"1887_CR40","doi-asserted-by":"crossref","unstructured":"Zaidi, L., Corrales, J. A., Bouzgarrou, B. C., Mezouar, Y., & Sabourin, L. (2017). Model-based strategy for grasping 3d deformable objects using a multi-fingered robotic hand. Robotics and Autonomous Systems, 95, 196\u2013206.","DOI":"10.1016\/j.robot.2017.06.011"},{"key":"1887_CR41","doi-asserted-by":"crossref","unstructured":"Zhang, Y., & Cheng, W. (2019) Vision-based robot sorting system. In IOP conference series: Materials science and engineering (Vol. 592, p. 012154). IOP Publishing.","DOI":"10.1088\/1757-899X\/592\/1\/012154"},{"key":"1887_CR42","doi-asserted-by":"crossref","unstructured":"Zhihong, C., Hebin, Z., Yanbo, W., Binyan, L., & Yu, L. (2017). A vision-based robotic grasping system using deep learning for garbage sorting. In 2017 36th Chinese control conference (CCC) (pp. 11223\u201311226). IEEE.","DOI":"10.23919\/ChiCC.2017.8029147"},{"key":"1887_CR43","unstructured":"Zhou, Y., & Hauser, K. (2017). 6dof grasp planning by optimizing a deep learning scoring function. In Robotics: Science and systems (RSS) workshop on revisiting contact-turning a problem into a solution, (Vol. 2, p. 6)."},{"key":"1887_CR44","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Gallego, G., Rebecq, H., Kneip, L., Li, H., & Scaramuzza, D. (2018). Semi-dense 3d reconstruction with a stereo event camera. In Proceedings of the European conference on computer vision (ECCV) (pp. 235\u2013251).","DOI":"10.1007\/978-3-030-01246-5_15"},{"key":"1887_CR45","doi-asserted-by":"crossref","unstructured":"Zhou, Q.-Y., Park, J., & Koltun, V. (2016). Fast global registration. In European conference on computer vision (pp. 766\u2013782). Springer.","DOI":"10.1007\/978-3-319-46475-6_47"}],"container-title":["Journal of Intelligent Manufacturing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10845-021-01887-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10845-021-01887-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10845-021-01887-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,18]],"date-time":"2022-01-18T14:42:52Z","timestamp":1642516972000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10845-021-01887-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,10]]},"references-count":45,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,2]]}},"alternative-id":["1887"],"URL":"https:\/\/doi.org\/10.1007\/s10845-021-01887-9","relation":{},"ISSN":["0956-5515","1572-8145"],"issn-type":[{"value":"0956-5515","type":"print"},{"value":"1572-8145","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,10]]},"assertion":[{"value":"16 July 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 November 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 January 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}