{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T11:12:07Z","timestamp":1778238727337,"version":"3.51.4"},"reference-count":60,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T00:00:00Z","timestamp":1658448000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Australian Research Council","award":["ARC IH150100006"],"award-info":[{"award-number":["ARC IH150100006"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Robotic harvesting research has seen significant achievements in the past decade, with breakthroughs being made in machine vision, robot manipulation, autonomous navigation and mapping. However, the missing capability of obstacle handling during the grasping process has severely reduced harvest success rate and limited the overall performance of robotic harvesting. This work focuses on leaf interference caused slip detection and handling, where solutions to robotic grasping in an unstructured environment are proposed. Through analysis of the motion and force of fruit grasping under leaf interference, the connection between object slip caused by leaf interference and inadequate harvest performance is identified for the first time in the literature. A learning-based perception and manipulation method is proposed to detect slip that causes problematic grasps of objects, allowing the robot to implement timely reaction. Our results indicate that the proposed algorithm detects grasp slip with an accuracy of 94%. The proposed sensing-based manipulation demonstrated great potential in robotic fruit harvesting, and could be extended to other pick-place applications.<\/jats:p>","DOI":"10.3390\/s22155483","type":"journal-article","created":{"date-parts":[[2022,7,25]],"date-time":"2022-07-25T04:52:47Z","timestamp":1658724767000},"page":"5483","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Learning-Based Slip Detection for Robotic Fruit Grasping and Manipulation under Leaf Interference"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6602-7714","authenticated-orcid":false,"given":"Hongyu","family":"Zhou","sequence":"first","affiliation":[{"name":"Laboratory of Motion Generation and Analysis, Faculty of Engineering, Monash University, Clayton, VIC 3800, Australia"}]},{"given":"Jinhui","family":"Xiao","sequence":"additional","affiliation":[{"name":"Laboratory of Motion Generation and Analysis, Faculty of Engineering, Monash University, Clayton, VIC 3800, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5553-9239","authenticated-orcid":false,"given":"Hanwen","family":"Kang","sequence":"additional","affiliation":[{"name":"Laboratory of Motion Generation and Analysis, Faculty of Engineering, Monash University, Clayton, VIC 3800, Australia"}]},{"given":"Xing","family":"Wang","sequence":"additional","affiliation":[{"name":"Laboratory of Motion Generation and Analysis, Faculty of Engineering, Monash University, Clayton, VIC 3800, Australia"}]},{"given":"Wesley","family":"Au","sequence":"additional","affiliation":[{"name":"Laboratory of Motion Generation and Analysis, Faculty of Engineering, Monash University, Clayton, VIC 3800, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1201-2039","authenticated-orcid":false,"given":"Chao","family":"Chen","sequence":"additional","affiliation":[{"name":"Laboratory of Motion Generation and Analysis, Faculty of Engineering, Monash University, Clayton, VIC 3800, Australia"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"343","DOI":"10.13031\/2013.39405","article-title":"Basic considerations in mechanizing citrus harvest","volume":"11","author":"Schertz","year":"1968","journal-title":"Trans. ASAE"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1027","DOI":"10.1002\/rob.21937","article-title":"Development of a sweet pepper harvesting robot","volume":"37","author":"Arad","year":"2020","journal-title":"J. Field Robot."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1108\/IR-11-2019-0243","article-title":"Fruit picking robots: Has their time come?","volume":"47","author":"Bogue","year":"2020","journal-title":"Ind. Robot."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kang, H., Zhou, H., Wang, X., and Chen, C. (2020). Real-time fruit recognition and grasping estimation for robotic apple harvesting. Sensors, 20.","DOI":"10.3390\/s20195670"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"107079","DOI":"10.1016\/j.compag.2022.107079","article-title":"Rachis detection and three-dimensional localization of cut-off point for vision-based banana robot","volume":"198","author":"Wu","year":"2022","journal-title":"Comput. Electron. Agric."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Fu, L., Yang, Z., Wu, F., Zou, X., Lin, J., Cao, Y., and Duan, J. (2022). YOLO-Banana: A Lightweight Neural Network for Rapid Detection of Banana Bunches and Stalks in the Natural Environment. Agronomy, 12.","DOI":"10.3390\/agronomy12020391"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Wang, H., Lin, Y., Xu, X., Chen, Z., Wu, Z., and Tang, Y. (2022). A Study on Long-Close Distance Coordination Control Strategy for Litchi Picking. Agronomy, 12.","DOI":"10.3390\/agronomy12071520"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"106350","DOI":"10.1016\/j.compag.2021.106350","article-title":"Collision-free path planning for a guava-harvesting robot based on recurrent deep reinforcement learning","volume":"188","author":"Lin","year":"2021","journal-title":"Comput. Electron. Agric."},{"key":"ref_9","first-page":"36","article-title":"Performance testing of thermal cutting systems for sweet pepper harvesting robot in greenhouse horticulture","volume":"7","author":"Bachche","year":"2013","journal-title":"J. Adv. Mech. Des. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"125001","DOI":"10.1088\/1361-665X\/ac2e19","article-title":"Bio-inspired soft bistable actuator with dual actuations","volume":"30","author":"Wang","year":"2021","journal-title":"Smart Mater. Struct."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1002\/rob.21889","article-title":"An autonomous strawberry-harvesting robot: Design, development, integration, and field evaluation","volume":"37","author":"Xiong","year":"2020","journal-title":"J. Field Robot."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhou, H., Wang, X., Au, W., Kang, H., and Chen, C. (2022). Intelligent robots for fruit harvesting: Recent developments and future challenges. Precis. Agric., 1\u201352.","DOI":"10.21203\/rs.3.rs-497056\/v1"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.mechmachtheory.2016.08.010","article-title":"Path planning and assembly mode-changes of 6-DOF Stewart-Gough-type parallel manipulators","volume":"106","author":"Au","year":"2016","journal-title":"Mech. Mach. Theory"},{"key":"ref_14","first-page":"58","article-title":"Design and simulation of an integrated end-effector for picking kiwifruit by robot","volume":"7","author":"Mu","year":"2020","journal-title":"Inf. Process. Agric."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"105232","DOI":"10.1016\/j.compag.2020.105232","article-title":"Optimization design of compliant constant-force mechanism for apple picking actuator","volume":"170","author":"Miao","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"105694","DOI":"10.1016\/j.compag.2020.105694","article-title":"State-of-the-art robotic grippers, grasping and control strategies, as well as their applications in agricultural robots: A review","volume":"177","author":"Zhang","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1140","DOI":"10.1002\/rob.21715","article-title":"Design, integration, and field evaluation of a robotic apple harvester","volume":"34","author":"Silwal","year":"2017","journal-title":"J. Field Robot."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1002\/rob.21709","article-title":"Performance evaluation of a harvesting robot for sweet pepper","volume":"34","author":"Bac","year":"2017","journal-title":"J. Field Robot."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1002\/rob.21987","article-title":"Design and evaluation of a modular robotic plum harvesting system utilizing soft components","volume":"38","author":"Brown","year":"2021","journal-title":"J. Field Robot."},{"key":"ref_20","first-page":"19","article-title":"Compliance grasp force control for end-effector of fruit-vegetable picking robot","volume":"30","author":"Wei","year":"2014","journal-title":"Trans. Chin. Soc. Agric. Eng."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1108\/01439910510582255","article-title":"A prototype of an orange picking robot: Past history, the new robot and experimental results","volume":"32","author":"Muscato","year":"2005","journal-title":"Ind. Robot Int. J."},{"key":"ref_22","first-page":"45","article-title":"Slipping detection and control in gripping fruits and vegetables for agricultural robot","volume":"11","author":"Tian","year":"2018","journal-title":"Int. J. Agric. Biol. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chi, C., Sun, X., Xue, N., Li, T., and Liu, C. (2018). Recent progress in technologies for tactile sensors. Sensors, 18.","DOI":"10.3390\/s18040948"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"73027","DOI":"10.1109\/ACCESS.2020.2987849","article-title":"Methods and sensors for slip detection in robotics: A survey","volume":"8","author":"Romeo","year":"2020","journal-title":"IEEE Access"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"12851","DOI":"10.1021\/nn506293y","article-title":"Fully printed flexible fingerprint-like three-axis tactile and slip force and temperature sensors for artificial skin","volume":"8","author":"Harada","year":"2014","journal-title":"ACS Nano"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Okatani, T., Nakai, A., Takahata, T., and Shimoyama, I. (2017, January 18\u201322). A MEMS slip sensor: Estimations of triaxial force and coefficient of static friction for prediction of a slip. Proceedings of the 2017 19th International Conference On Solid-State Sensors, Actuators and Microsystems (TRANSDUCERS), Kaohsiung, Taiwan.","DOI":"10.1109\/TRANSDUCERS.2017.7993991"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kaboli, M., Yao, K., and Cheng, G. (2016, January 15\u201317). Tactile-based manipulation of deformable objects with dynamic center of mass. Proceedings of the 2016 IEEE-RAS 16th International Conference On Humanoid Robots (Humanoids), Cancun, Mexico.","DOI":"10.1109\/HUMANOIDS.2016.7803358"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1080\/00150193.2016.1238723","article-title":"PVDF tactile sensors for detecting contact force and slip: A review","volume":"504","author":"Xin","year":"2016","journal-title":"Ferroelectrics"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.robot.2012.07.016","article-title":"Detection and prevention of slip using sensors with different properties embedded in elastic artificial skin on the basis of previous experience","volume":"62","author":"Shirafuji","year":"2014","journal-title":"Robot. Auton. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.sna.2012.02.010","article-title":"Detection system of incident slippage and friction coefficient based on a flexible tactile sensor with structural electrodes","volume":"188","author":"Chuang","year":"2012","journal-title":"Sens. Actuators A Phys."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"709","DOI":"10.3390\/s140100709","article-title":"Micro-vibration-based slip detection in tactile force sensors","volume":"14","author":"Fernandez","year":"2014","journal-title":"Sensors"},{"key":"ref_32","first-page":"942","article-title":"Slippage detection generalizing to grasping of unknown objects using machine learning with novel features","volume":"3","author":"Agriomallos","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1260","DOI":"10.1109\/JSEN.2018.2881831","article-title":"Identification of slippage on naturalistic surfaces via wavelet transform of tactile signals","volume":"19","author":"Romeo","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Romeo, R., Oddo, C., Carrozza, M., Guglielmelli, E., and Zollo, L. (2017). Slippage detection with piezoresistive tactile sensors. Sensors, 17.","DOI":"10.3390\/s17081844"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1687814016665082","DOI":"10.1177\/1687814016665082","article-title":"Multilevel control of an anthropomorphic prosthetic hand for grasp and slip prevention","volume":"8","author":"Barone","year":"2016","journal-title":"Adv. Mech. Eng."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"eaau9924","DOI":"10.1126\/scirobotics.aau9924","article-title":"Restoring tactile sensations via neural interfaces for real-time force-and-slippage closed-loop control of bionic hands","volume":"4","author":"Zollo","year":"2019","journal-title":"Sci. Robot."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1016\/j.mechatronics.2014.05.006","article-title":"Slipping detection and avoidance based on Kalman filter","volume":"24","author":"Cavallo","year":"2014","journal-title":"Mechatronics"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"929","DOI":"10.1007\/s12555-017-0151-x","article-title":"Development of direct-printed tactile sensors for gripper control through contact and slip detection","volume":"16","author":"Lee","year":"2018","journal-title":"Int. J. Control Autom. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Osborn, L., Thakor, N., and Kaliki, R. (2013, January 3\u20136). Utilizing tactile feedback for biomimetic grasping control in upper limb prostheses. Proceedings of the SENSORS, 2013 IEEE, Baltimore, MD, USA.","DOI":"10.1109\/ICSENS.2013.6688445"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Cordella, F., Gentile, C., Zollo, L., Barone, R., Sacchetti, R., Davalli, A., Siciliano, B., and Guglielmelli, E. (2016, January 16\u201321). A force-and-slippage control strategy for a poliarticulated prosthetic hand. Proceedings of the 2016 IEEE International Conference On Robotics In addition, Automation (ICRA), Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487533"},{"key":"ref_41","first-page":"215","article-title":"A novel approach to control the robotic hand grasping process by using an artificial neural network algorithm","volume":"26","author":"Nacy","year":"2017","journal-title":"J. Intell. Syst."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Van Wyk, K., and Falco, J. (2018, January 21\u201326). Calibration and analysis of tactile sensors as slip detectors. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8461117"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1109\/TOH.2018.2837744","article-title":"Grip stabilization of novel objects using slip prediction","volume":"11","author":"Veiga","year":"2018","journal-title":"IEEE Trans. Haptics"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Le\u00f3n, B., Morales, A., and Sancho-Bru, J. (2014). From Robot to Human Grasping Simulation. Cognitive Systems Monographs, Springer.","DOI":"10.1007\/978-3-319-01833-1"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"106353","DOI":"10.1016\/j.compag.2021.106353","article-title":"Three-finger grasp planning and experimental analysis of picking patterns for robotic apple harvesting","volume":"188","author":"Fan","year":"2021","journal-title":"Comput. Electron. Agric."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Xu, F., Li, X., Shi, Y., Li, L., Wang, W., He, L., and Liu, R. (2018). Recent developments for flexible pressure sensors: A review. Micromachines, 9.","DOI":"10.3390\/mi9110580"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1038\/s41586-019-1234-z","article-title":"Learning the signatures of the human grasp using a scalable tactile glove","volume":"569","author":"Sundaram","year":"2019","journal-title":"Nature"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Alessandrini, M., Biagetti, G., Crippa, P., Falaschetti, L., Luzzi, S., and Turchetti, C. (2022). EEG-Based Alzheimer\u2019s Disease Recognition Using Robust-PCA and LSTM Recurrent Neural Network. Sensors, 22.","DOI":"10.3390\/s22103696"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"9983","DOI":"10.1109\/JSEN.2021.3055565","article-title":"Touch modality classification using recurrent neural networks","volume":"21","author":"Alameh","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"e12589","DOI":"10.1111\/jfpe.12589","article-title":"Grasping damage analysis of apple by end-effector in harvesting robot","volume":"40","author":"Ji","year":"2017","journal-title":"J. Food Process. Eng."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1016\/j.compag.2019.05.022","article-title":"Apple viscoelastic complex model for bruise damage analysis in constant velocity grasping by gripper","volume":"162","author":"Ji","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Cho, C., Choi, W., and Kim, T. (2020). Leveraging uncertainties in Softmax decision-making models for low-power IoT devices. Sensors, 20.","DOI":"10.3390\/s20164603"},{"key":"ref_53","unstructured":"Brownlee, J. (2022, June 16). Ordinal and One-Hot Encodings for Categorical Data. Machine Learning Mastery Website, Available online: https:\/\/machinelearningmastery.com\/one-hot-encoding-for-categorical-data\/."},{"key":"ref_54","unstructured":"Decoteau, D. (2022, June 16). Photocontrol of Leaf Abscission. Available online: https:\/\/scholarworks.umass.edu\/cgi\/viewcontent.cgi?article=4576&context=theses."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1139","DOI":"10.1104\/pp.44.8.1139","article-title":"Abscission: Quantitative measurement with a recording abscissor","volume":"44","author":"Craker","year":"1969","journal-title":"Plant Physiol."},{"key":"ref_56","unstructured":"Tong, J., Zhang, Q., Karkee, M., Jiang, H., and Zhou, J. (2014, January 13\u201316). Understanding the dynamics of hand picking patterns of fresh market apples. Proceedings of the 2014 American Society of Agricultural and Biological Engineers, Montreal, QC, Canada."},{"key":"ref_57","unstructured":"Brownlee, J. (2020). Train-test split for evaluating machine learning algorithms. Mach. Learn. Mastery, 23, Available online: https:\/\/machinelearningmastery.com\/train-test-split-for-evaluating-machine-learning-algorithms\/."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Melinte, D., and Vladareanu, L. (2020). Facial expressions recognition for human\u2013robot interaction using deep convolutional neural networks with rectified adam optimizer. Sensors, 20.","DOI":"10.3390\/s20082393"},{"key":"ref_59","first-page":"8778","article-title":"Generalized cross entropy loss for training deep neural networks with noisy labels","volume":"31","author":"Zhang","year":"2018","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_60","first-page":"315","article-title":"Accelerating stochastic gradient descent using predictive variance reduction","volume":"26","author":"Johnson","year":"2013","journal-title":"Adv. Neural Inf. Process. Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/15\/5483\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:55:14Z","timestamp":1760140514000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/15\/5483"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,22]]},"references-count":60,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["s22155483"],"URL":"https:\/\/doi.org\/10.3390\/s22155483","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,22]]}}}