{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,17]],"date-time":"2026-02-17T04:26:10Z","timestamp":1771302370687,"version":"3.50.1"},"reference-count":30,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2014,6,30]],"date-time":"2014-06-30T00:00:00Z","timestamp":1404086400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper proposes the development of an automatic fruit harvesting system by combining a low cost stereovision camera and a robotic arm placed in the gripper tool.  The stereovision camera is used to estimate the size, distance and position of the fruits whereas the robotic arm is used to mechanically pickup the fruits. The low cost stereovision system has been tested in laboratory conditions with a reference small object, an apple and a pear at 10 different intermediate distances from the camera. The average distance error was from 4% to 5%, and the average diameter error was up to 30% in the case of a small object and in a range from 2% to 6% in the case of a pear and an apple.  The stereovision system has been attached to the gripper tool in order to obtain relative distance, orientation and size of the fruit. The harvesting stage requires the initial fruit location, the computation of the inverse kinematics of the robotic arm in order to place the gripper tool in front of the fruit, and a final pickup approach by iteratively adjusting the vertical and horizontal position of the gripper tool in a closed visual loop. The complete system has been tested in controlled laboratory conditions with uniform illumination applied to the fruits. As a future work, this system will be tested and improved in conventional outdoor farming conditions.<\/jats:p>","DOI":"10.3390\/s140711557","type":"journal-article","created":{"date-parts":[[2014,6,30]],"date-time":"2014-06-30T10:34:47Z","timestamp":1404124487000},"page":"11557-11579","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":85,"title":["A Proposal for Automatic Fruit Harvesting by Combining a Low Cost Stereovision Camera and a Robotic Arm"],"prefix":"10.3390","volume":"14","author":[{"given":"Davinia","family":"Font","sequence":"first","affiliation":[{"name":"Department of Computer Science and Industrial Engineering, Universitat de Lleida, Jaume II, 69, Lleida 25001, Spain"}]},{"given":"Tom\u00e0s","family":"Pallej\u00e0","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Industrial Engineering, Universitat de Lleida, Jaume II, 69, Lleida 25001, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7965-0086","authenticated-orcid":false,"given":"Marcel","family":"Tresanchez","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Industrial Engineering, Universitat de Lleida, Jaume II, 69, Lleida 25001, Spain"}]},{"given":"David","family":"Runcan","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Industrial Engineering, Universitat de Lleida, Jaume II, 69, Lleida 25001, Spain"}]},{"given":"Javier","family":"Moreno","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Industrial Engineering, Universitat de Lleida, Jaume II, 69, Lleida 25001, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5814-5489","authenticated-orcid":false,"given":"Dani","family":"Mart\u00ednez","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Industrial Engineering, Universitat de Lleida, Jaume II, 69, Lleida 25001, Spain"}]},{"given":"Merc\u00e8","family":"Teixid\u00f3","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Industrial Engineering, Universitat de Lleida, Jaume II, 69, Lleida 25001, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8210-3262","authenticated-orcid":false,"given":"Jordi","family":"Palac\u00edn","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Industrial Engineering, Universitat de Lleida, Jaume II, 69, Lleida 25001, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2014,6,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"12132","DOI":"10.3390\/s130912132","article-title":"Sensors in Agriculture and Forestry","volume":"13","author":"Pajares","year":"2013","journal-title":"Sensors"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3313","DOI":"10.3390\/s130303313","article-title":"Development and Evaluation of a Combined Cultivator and Band Sprayer with a Row-Centering RTK-GPS Guidance System","volume":"13","author":"Carballido","year":"2013","journal-title":"Sensors"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"516","DOI":"10.3390\/s130100516","article-title":"Use of a Terrestrial LIDAR Sensor for Drift Detection in Vineyard Spraying","volume":"13","author":"Gil","year":"2013","journal-title":"Sensors"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2384","DOI":"10.3390\/s130202384","article-title":"Rapid Characterization of Vegetation Structure with a Microsoft Kinect Sensor","volume":"13","author":"Azzari","year":"2013","journal-title":"Sensors"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1007\/978-3-540-75404-6_51","article-title":"Autonomous Fruit Picking Machine: A Robotic Apple Harvester","volume":"Volume 43","author":"Baeten","year":"2008","journal-title":"Field and Service Robotics"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"14129","DOI":"10.3390\/s121014129","article-title":"An Embedded Real-Time Red Peach Detection System Based on an OV7670 Camera, ARM Cortex-M4 Processor and 3D Look-Up Tables","volume":"12","author":"Font","year":"2012","journal-title":"Sensors"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"7701","DOI":"10.3390\/s120607701","article-title":"Definition of Linear Color Models in the RGB Vector Color Space to Detect Red Peaches in Orchard Images Taken under Natural Illumination","volume":"12","author":"Font","year":"2012","journal-title":"Sensors"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"6109","DOI":"10.3390\/s130506109","article-title":"A Wearable Mobile Sensor Platform to Assist Fruit Grading","volume":"13","author":"Aroca","year":"2013","journal-title":"Sensors"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.compag.2013.02.008","article-title":"Development of an automatic grading machine for oil palm fresh fruits bunches (FFBs) based on machine vision","volume":"93","author":"Makky","year":"2013","journal-title":"Comput. Electron. Agric."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Mustafah, Y.M., Noor, R., Hasbi, H., and Azma, A.W. (2012, January 3\u20135). Stereo vision images processing for real-time object distance and size measurements. Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICCCE.2012.6271270"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Font, D., Pallej\u00e0, T., Tresanchez, M., Teixid\u00f3, M., Martinez, D., Moreno, J., and Palac\u00edn, J. (2014). Counting red grapes in vineyards by detecting specular spherical reflection peaks in RGB images obtained at night with artificial illumination, submitted.","DOI":"10.1016\/j.compag.2014.07.006"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"S10","DOI":"10.1016\/j.compag.2009.09.005","article-title":"Nondestructive measurement of internal quality of Nanfeng mandarin fruit by charge coupled device near infrared spectroscopy","volume":"71S","author":"Liu","year":"2010","journal-title":"Comput. Electron. Agric."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3215","DOI":"10.3390\/s120303215","article-title":"Application of the Biospeckle Method for Monitoring Bull's Eye Rot Development and Quality Changes of Apples Subjected to Various Storage Methods\u2014Preliminary Studies","volume":"12","author":"Adamiak","year":"2012","journal-title":"Sensors"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.compag.2014.01.013","article-title":"An image processing method for in-line nectarine variety verification based on the comparison of skin feature histogram vectors","volume":"102","author":"Font","year":"2014","journal-title":"Comput. Electron. Agric."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lv, J., Zhao, D-A., Ji, W., Chen, Y., and Shen, H. (,  2011). Design and Research on Vision System of Apple Harvesting Robot. Zhejiang, China.","DOI":"10.1109\/IHMSC.2011.49"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5040","DOI":"10.3390\/s130405040","article-title":"3D Image Acquisition System Based on Shape from Focus Technique","volume":"13","author":"Billiot","year":"2013","journal-title":"Sensors"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1109\/TPAMI.2003.1217603","article-title":"Advances in computational stereo","volume":"25","author":"Brown","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","unstructured":"Jian, L., Shujuan, C., Chengyan, Z., and Haifeng, C. (August, January 31). Research on Localization of Apples Based on Binocular Stereo Vision Marked by Cancroids Matching. Guilin, China."},{"key":"ref_19","first-page":"19","article-title":"Design of structured-light vision system for tomato harvesting robot","volume":"7","author":"Feng","year":"2014","journal-title":"Int. J. Agric. Biol. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/s00138-010-0291-y","article-title":"Virtual manipulator-based binocular stereo vision positioning system and errors modeling","volume":"23","author":"Zou","year":"2012","journal-title":"Mach. Vis. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.compag.2014.01.003","article-title":"Vision-based control of robotic manipulator for citrus harvesting","volume":"102","author":"Mehtaa","year":"2014","journal-title":"Comput. Electron. Agric."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Irie, N., Taguchi, N., Horie, T., and Ishimatsu, T. (2009, January 10\u201313). Asparagus harvesting robot coordinated with 3-D vision sensor. In.","DOI":"10.1109\/ICIT.2009.4939556"},{"key":"ref_23","first-page":"203","article-title":"Fruit detection system and an end effector for robotic harvesting of Fuji apples","volume":"12","author":"Bulanon","year":"2010","journal-title":"Agric. Eng. Int."},{"key":"ref_24","unstructured":"Wang, Y., Liu, K., Hao, Q., Wang, X., Lau, D.L., and Hassebrook, L.G. (, January March). Robust Active Stereo Vision Using Kullback-Leibler Divergence."},{"key":"ref_25","unstructured":"Minoru3D Available online: http:\/\/www.minoru3d.com."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1723","DOI":"10.3390\/s140101723","article-title":"The Control of Tendon-Driven Dexterous Hands with Joint Simulation","volume":"14","author":"Chen","year":"2014","journal-title":"Sensors"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3227","DOI":"10.3390\/s140203227","article-title":"Object Recognition and Localization: The Role of Tactile Sensors","volume":"14","author":"Aggarwal","year":"2014","journal-title":"Sensors"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1115\/1.4011045","article-title":"A Kinematic Notation for Lower Pair Mechanisms based on Matrices","volume":"23","author":"Denavit","year":"1955","journal-title":"Trans. ASME J. Appl. Mech."},{"key":"ref_29","unstructured":"Camera Calibration Toolbox. Available online: http:\/\/www.vision.caltech.edu\/bouguetj\/calib_doc\/index.html."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A Threshold Selection Method from Gray-Level Histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Syst. Man Cybern."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/14\/7\/11557\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:13:07Z","timestamp":1760217187000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/14\/7\/11557"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,6,30]]},"references-count":30,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2014,7]]}},"alternative-id":["s140711557"],"URL":"https:\/\/doi.org\/10.3390\/s140711557","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,6,30]]}}}