{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T06:28:49Z","timestamp":1775024929203,"version":"3.50.1"},"reference-count":42,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2019,1,21]],"date-time":"2019-01-21T00:00:00Z","timestamp":1548028800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the National Key Research and Development Program of China","award":["2017YFD0700103"],"award-info":[{"award-number":["2017YFD0700103"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Fruit detection in real outdoor conditions is necessary for automatic guava harvesting, and the branch-dependent pose of fruits is also crucial to guide a robot to approach and detach the target fruit without colliding with its mother branch. To conduct automatic, collision-free picking, this study investigates a fruit detection and pose estimation method by using a low-cost red\u2013green\u2013blue\u2013depth (RGB-D) sensor. A state-of-the-art fully convolutional network is first deployed to segment the RGB image to output a fruit and branch binary map. Based on the fruit binary map and RGB-D depth image, Euclidean clustering is then applied to group the point cloud into a set of individual fruits. Next, a multiple three-dimensional (3D) line-segments detection method is developed to reconstruct the segmented branches. Finally, the 3D pose of the fruit is estimated using its center position and nearest branch information. A dataset was acquired in an outdoor orchard to evaluate the performance of the proposed method. Quantitative experiments showed that the precision and recall of guava fruit detection were 0.983 and 0.948, respectively; the 3D pose error was 23.43\u00b0 \u00b1 14.18\u00b0; and the execution time per fruit was 0.565 s. The results demonstrate that the developed method can be applied to a guava-harvesting robot.<\/jats:p>","DOI":"10.3390\/s19020428","type":"journal-article","created":{"date-parts":[[2019,1,22]],"date-time":"2019-01-22T03:08:22Z","timestamp":1548126502000},"page":"428","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":138,"title":["Guava Detection and Pose Estimation Using a Low-Cost RGB-D Sensor in the Field"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1762-0647","authenticated-orcid":false,"given":"Guichao","family":"Lin","sequence":"first","affiliation":[{"name":"Key Laboratory of Key Technology on Agricultural Machine and Equipment, Ministry of Education, South China Agricultural University, Guangzhou 510642, China"},{"name":"College of Mechanical and Automotive Engineering, Chuzhou University, Chuzhou 239000, China"}]},{"given":"Yunchao","family":"Tang","sequence":"additional","affiliation":[{"name":"School of Urban and Rural Construction, Zhongkai University of Agriculture and Engineering, Guangzhou 510006, China"}]},{"given":"Xiangjun","family":"Zou","sequence":"additional","affiliation":[{"name":"Key Laboratory of Key Technology on Agricultural Machine and Equipment, Ministry of Education, South China Agricultural University, Guangzhou 510642, China"}]},{"given":"Juntao","family":"Xiong","sequence":"additional","affiliation":[{"name":"Key Laboratory of Key Technology on Agricultural Machine and Equipment, Ministry of Education, South China Agricultural University, Guangzhou 510642, China"}]},{"given":"Jinhui","family":"Li","sequence":"additional","affiliation":[{"name":"Key Laboratory of Key Technology on Agricultural Machine and Equipment, Ministry of Education, South China Agricultural University, Guangzhou 510642, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1080\/17538963.2018.1458431","article-title":"Recalculating the agricultural labor force in china","volume":"11","author":"Dong","year":"2018","journal-title":"China Econ. J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1140","DOI":"10.1002\/rob.21715","article-title":"Design, integration, and field evaluation of a robotic apple harvester","volume":"34","author":"Silwal","year":"2017","journal-title":"J. Field Robot."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1002\/rob.21709","article-title":"Performance evaluation of a harvesting robot for sweet pepper","volume":"36","author":"Bac","year":"2017","journal-title":"J. Field Robot."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1505","DOI":"10.1002\/rob.21726","article-title":"3d-vision based detection, localization, and sizing of broccoli heads in the field","volume":"34","author":"Kusumam","year":"2017","journal-title":"J. Field Robot."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.biosystemseng.2013.12.008","article-title":"Automatic fruit recognition and counting from multiple images","volume":"118","author":"Song","year":"2014","journal-title":"Biosyst. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.biosystemseng.2013.07.007","article-title":"Identification and determination of the number of immature green citrus fruit in a canopy under different ambient light conditions","volume":"117","author":"Sengupta","year":"2014","journal-title":"Biosyst. Eng."},{"key":"ref_7","first-page":"1","article-title":"Machine vision for counting fruit on mango tree canopies","volume":"17","author":"Qureshi","year":"2016","journal-title":"Precis. Agric."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Luo, L., Tang, Y., Zou, X., Wang, C., Zhang, P., and Feng, W. (2016). Robust grape cluster detection in a vineyard by combining the adaboost framework and multiple color components. Sensors, 16.","DOI":"10.3390\/s16122098"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1062","DOI":"10.1007\/s11119-018-9574-5","article-title":"Detection and counting of immature green citrus fruit based on the local binary patterns (lbp) feature using illumination-normalized images","volume":"19","author":"Wang","year":"2018","journal-title":"Precis. Agric."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Sa, I., Ge, Z., Dayoub, F., Upcroft, B., Perez, T., and Mccool, C. (2016). Deepfruits: A fruit detection system using deep neural networks. Sensors, 16.","DOI":"10.3390\/s16081222"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Stein, M., Bargoti, S., and Underwood, J. (2016). Image based mango fruit detection, localisation and yield estimation using multiple view geometry. Sensors, 16.","DOI":"10.3390\/s16111915"},{"key":"ref_12","unstructured":"Bargoti, S., and Underwood, J. (June, January 29). Deep fruit detection in orchards. Proceedings of the IEEE International Conference on Robotics & Automation, Singapore."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1039","DOI":"10.1002\/rob.21699","article-title":"Image segmentation for fruit detection and yield estimation in apple orchards","volume":"34","author":"Bargoti","year":"2017","journal-title":"J. Field Robot."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.biosystemseng.2016.01.013","article-title":"Colour-Agnostic Shape-Based 3D Fruit Detection for Crop Harvesting Robots","volume":"146","author":"Barnea","year":"2016","journal-title":"Biosyst. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.biosystemseng.2016.01.007","article-title":"Detection of red and bicoloured apples on tree with an RGB-D camera","volume":"146","author":"Nguyen","year":"2016","journal-title":"Biosyst. Eng."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Rusu, R.B. (2009). Semantic 3d Object maps for Everyday Manipulation in Human Living Environment. [Ph.D. Thesis, Computer Science Department, Technische Universit\u00e4t M\u00fcnchen].","DOI":"10.1007\/s13218-010-0059-6"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wang, Z., Walsh, K., and Verma, B. (2017). On-tree mango fruit size estimation using RGB-D images. Sensors, 17.","DOI":"10.3390\/s17122738"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.compag.2016.08.024","article-title":"3d pose estimation of green pepper fruit for automated harvesting","volume":"128","author":"Eizentals","year":"2016","journal-title":"Comput. Electron. Agric."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Lehnert, C., Sa, I., Mccool, C., Upcroft, B., and Perez, T. (2016, January 16\u201321). Sweet pepper pose detection and grasping for automated crop harvesting. Proceedings of the IEEE International Conference on Robotics & Automation, Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487394"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Li, H., Zhu, Q., Huang, M., Guo, Y., and Qin, J. (2018). Pose Estimation of Sweet Pepper through Symmetry Axis Detection. Sensors, 18.","DOI":"10.3390\/s18093083"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1016\/j.biosystemseng.2006.03.005","article-title":"An autonomous robot for de-leafing cucumber plants grown in a high-wire cultivation system","volume":"94","author":"Hoogakker","year":"2006","journal-title":"Biosyst. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lu, Q., Tang, M., and Cai, J. (2011, January 17\u201318). Obstacle recognition using multi-spectral imaging for citrus picking robot. Proceedings of the 2011 3rd Pacific\u2013Asia Conference on Circuits, Communications and System, Wuhan, China.","DOI":"10.1109\/PACCS.2011.5990203"},{"key":"ref_23","unstructured":"Noble, S., and Li, D. (2012, January 8\u201312). Segmentation of greenhouse cucumber plants in multispectral imagery. Proceedings of the International Conference of Agricultural Engineering, CIGR-Ageng, Valencia, Spain."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.compag.2013.05.004","article-title":"Robust pixel-based classification of obstacles for robotic harvesting of sweet-pepper","volume":"96","author":"Bac","year":"2013","journal-title":"Comput. Electron. Agric."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/j.compag.2014.04.011","article-title":"Stem localization of sweet-pepper plants using the support wire as a visual cue","volume":"105","author":"Bac","year":"2014","journal-title":"Comput. Electron. Agric."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"4465","DOI":"10.1038\/s41598-018-22568-3","article-title":"Unsupervised segmentation of greenhouse plant images based on statistical method","volume":"8","author":"Zhang","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_27","first-page":"75","article-title":"Apple Tree Trunk and Branch Segmentation for Automatic Trellis Training Using Convolutional Neural Network Based Semantic Segmentation","volume":"51","author":"Majeed","year":"2018","journal-title":"IFAC"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","article-title":"SegNet: A deep convolutional encoder-decoder architecture for scene segmentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1109\/TPAMI.2016.2572683","article-title":"Fully convolutional networks for semantic segmentation","volume":"39","author":"Shelhamer","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","unstructured":"Simonyan, K., and Andrew, Z. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 8\u201310). Going Deeper with Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_33","unstructured":"GitHub (2018, June 15). FCN. Available online: https:\/\/github.com\/shelhamer\/fcn.berkeleyvision.org."},{"key":"ref_34","unstructured":"Kingma, D., and Ba, J. (2015, January 7\u20139). Adam: A Method for Stochastic Optimization. Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_35","unstructured":"Serra, J. (1982). Image Analysis and Mathematical Morphology, Academic Press."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1100","DOI":"10.1002\/rob.21680","article-title":"A robot system for pruning grape vines","volume":"34","author":"Botterill","year":"2017","journal-title":"J. Field Robot."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1111\/j.1467-8659.2007.01016.x","article-title":"Efficient ransac for point-cloud shape detection","volume":"26","author":"Schnabel","year":"2007","journal-title":"Comput. Graph. Forum"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T. (2014, January 3\u20137). Caffe: Convolutional architecture for fast feature embedding. Proceedings of the 22nd ACM International Conference on Multimedia, Orlando, FL, USA.","DOI":"10.1145\/2647868.2654889"},{"key":"ref_39","unstructured":"Schmid, C. (2001, January 8\u201314). Constructing models for content-based image retrieval. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Fankhauser, P., Bloesch, M., Rodriguez, D., Kaestner, R., Hutter, M., and Siegwart, R. (2015, January 27\u201331). Kinect v2 for Mobile Robot Navigation: Evaluation and Modeling. Proceedings of the International Conference on Advanced Robotics (ICAR), Istanbul, Turkey.","DOI":"10.1109\/ICAR.2015.7251485"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.compag.2018.10.031","article-title":"RRT-based path planning for an intelligent litchi-picking manipulator","volume":"156","author":"Cao","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"888","DOI":"10.1002\/rob.21525","article-title":"Harvesting robots for high-value crops: State-of-the-art review and challenges ahead","volume":"31","author":"Bac","year":"2014","journal-title":"J. Field Robot."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/2\/428\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:27:41Z","timestamp":1760185661000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/2\/428"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,21]]},"references-count":42,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2019,1]]}},"alternative-id":["s19020428"],"URL":"https:\/\/doi.org\/10.3390\/s19020428","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,21]]}}}