{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,11]],"date-time":"2026-08-11T16:13:59Z","timestamp":1786464839864,"version":"3.56.0"},"reference-count":39,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2016,11,15]],"date-time":"2016-11-15T00:00:00Z","timestamp":1479168000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper presents a novel multi-sensor framework to efficiently identify, track, localise and map every piece of fruit in a commercial mango orchard. A multiple viewpoint approach is used to solve the problem of occlusion, thus avoiding the need for labour-intensive field calibration to estimate actual yield. Fruit are detected in images using a state-of-the-art faster R-CNN detector, and pair-wise correspondences are established between images using trajectory data provided by a navigation system. A novel LiDAR component automatically generates image masks for each canopy, allowing each fruit to be associated with the corresponding tree. The tracked fruit are triangulated to locate them in 3D, enabling a number of spatial statistics per tree, row or orchard block. A total of 522 trees and 71,609 mangoes were scanned on a Calypso mango orchard near Bundaberg, Queensland, Australia, with 16 trees counted by hand for validation, both on the tree and after harvest. The results show that single, dual and multi-view methods can all provide precise yield estimates, but only the proposed multi-view approach can do so without calibration, with an error rate of only 1.36% for individual trees.<\/jats:p>","DOI":"10.3390\/s16111915","type":"journal-article","created":{"date-parts":[[2016,11,15]],"date-time":"2016-11-15T10:25:31Z","timestamp":1479205531000},"page":"1915","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":254,"title":["Image Based Mango Fruit Detection, Localisation and Yield Estimation Using Multiple View Geometry"],"prefix":"10.3390","volume":"16","author":[{"given":"Madeleine","family":"Stein","sequence":"first","affiliation":[{"name":"Division of Automatic Control Department of Electrical Engineering, Link\u00f6ping University, Link\u00f6ping SE-581 83, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Suchet","family":"Bargoti","sequence":"additional","affiliation":[{"name":"The Australian Centre for Field Robotics (ACFR), Department of Aerospace, Mechanical and Mechatronic Engineering (AMME),The University of Sydney, Sydney, NSW 2006, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0189-0706","authenticated-orcid":false,"given":"James","family":"Underwood","sequence":"additional","affiliation":[{"name":"The Australian Centre for Field Robotics (ACFR), Department of Aerospace, Mechanical and Mechatronic Engineering (AMME),The University of Sydney, Sydney, NSW 2006, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2016,11,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.compag.2012.11.009","article-title":"Estimation of mango crop yield using image analysis\u2013segmentation method","volume":"91","author":"Payne","year":"2013","journal-title":"Comput. Electron. Agric."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1911","DOI":"10.13031\/2013.3096","article-title":"A survey of computer vision methods for locating fruit on trees","volume":"43","author":"Jimenez","year":"2000","journal-title":"Trans. Am. Soc. Agric. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.compag.2015.05.021","article-title":"Sensors and systems for fruit detection and localization: A review","volume":"116","author":"Gongal","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_4","unstructured":"Wang, Q., Nuske, S., Bergerman, M., and Singh, S. (2013). Experimental Robotics, Springer."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Mejias, L., Corke, P., and Roberts, J. (2015). Field and Service Robotics: Results of the 9th International Conference, Springer.","DOI":"10.1007\/978-3-319-07488-7"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bargoti, S., and Underwood, J. (2016, January 16\u201321). Image classification with orchard metadata. Proceedings of the International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487721"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.compag.2016.09.014","article-title":"Mapping almond orchard canopy volume, flowers, fruit and yield using LiDAR and vision sensors","volume":"130","author":"Underwood","year":"2016","journal-title":"Comput. Electron. Agric."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1109\/MIE.2013.2252957","article-title":"Agricultural robotics: Unmanned robotic service units in agricultural tasks","volume":"7","author":"Cheein","year":"2013","journal-title":"IEEE Ind. Electron. Mag."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Das, J., Cross, G., Qu, C., Makineni, A., Tokekar, P., Mulgaonkar, Y., and Kumar, V. (2015, January 24\u201328). Devices, systems, and methods for automated monitoring enabling precision agriculture. Proceedings of the International Conference on Autonomation and Science and Engineering, Gothenburg, Sweden.","DOI":"10.1109\/CoASE.2015.7294123"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Hung, C., Nieto, J., Taylor, Z., Underwood, J., and Sukkarieh, S. (2013, January 3\u20137). Orchard fruit segmentation using multi-spectral feature learning. Proceedings of the International Conference on Intelligent Robots and Systems (IROS), Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6697125"},{"key":"ref_11","unstructured":"Payne, A., and Walsh, K. (2014). Plant Image Analysis: Fundamentals and Applications, CRC Press."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Qureshi, W., Payne, A., Walsh, K., Linker, R., Cohen, O., and Dailey, M. (2016). Machine vision for counting fruit on mango tree canopies. Precis. Agric.","DOI":"10.1007\/s11119-016-9458-5"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/S0168-1699(03)00086-3","article-title":"Estimation of number and diameter of apple fruits in an orchard during the growing season by thermal imaging","volume":"42","author":"Stajnko","year":"2004","journal-title":"Comput. Electron. Agric."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.compag.2011.11.007","article-title":"Determination of the number of green apples in RGB images recorded in orchards","volume":"81","author":"Linker","year":"2012","journal-title":"Comput. Electron. Agric."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Bargoti, S., and Underwood, J. (2016). Image Segmentation for Fruit Detection and Yield Estimation in Apple Orchards. J. Field Robot., in press.","DOI":"10.1002\/rob.21699"},{"key":"ref_16","unstructured":"Bargoti, S., and Underwood, J. Deep Fruit Detection in Orchards. Available online: https:\/\/arxiv.org\/abs\/1610.03677."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sa, I., Ge, Z., Dayoub, F., Upcroft, B., Perez, T., and McCool, C. (2016). DeepFruits: A Fruit Detection System Using Deep Neural Networks. Sensors, 16.","DOI":"10.3390\/s16081222"},{"key":"ref_18","unstructured":"Nuske, S., Gupta, K., Narasimhan, S., and Singh, S. (2014). Field and Service Robotics, Springer."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"837","DOI":"10.1002\/rob.21541","article-title":"Automated visual yield estimation in vineyards","volume":"31","author":"Nuske","year":"2014","journal-title":"J. Field Robot."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.biosystemseng.2013.12.008","article-title":"Automatic fruit recognition and counting from multiple images","volume":"118","author":"Song","year":"2014","journal-title":"Biosyst. Eng."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Moonrinta, J., Chaivivatrakul, S., Dailey, M.N., and Ekpanyapong, M. (2010, January 7\u201310). Fruit Detection, Tracking, and 3D Reconstruction for Crop Mapping and Yield Estimation. Proceedings of the 11th International Conference on Control Automation Robotics & Vision (ICARCV), Singapore.","DOI":"10.1109\/ICARCV.2010.5707436"},{"key":"ref_22","unstructured":"Roy, P., Stefas, N., Peng, C., Bayram, H., Tokekar, P., and Isler, V. (2015). Robotic Surveying of Apple Orchards, University of Minnesota, Computer Science and Engineering. TR 15-010."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1002\/nav.3800020109","article-title":"The Hungarian method for the assignment problem","volume":"2","author":"Kuhn","year":"1955","journal-title":"Naval Res. Logist. Q."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1056","DOI":"10.1002\/rob.21607","article-title":"LiDAR-based tree recognition and platform localization in orchards","volume":"32","author":"Underwood","year":"2015","journal-title":"J. Field Robot."},{"key":"ref_25","unstructured":"Ren, S., He, K., Girshick, R.B., and Sun, J. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. Available online: https:\/\/arxiv.org\/abs\/1506.01497."},{"key":"ref_26","unstructured":"Allied Vision Prosilica GT3300C. Available online: https:\/\/www.alliedvision.com\/en\/products\/cameras\/detail\/ProsilicaGT\/3300.html."},{"key":"ref_27","unstructured":"Kowa LM8CX. Available online: http:\/\/www.kowa-europe.com\/lenses\/en\/LM8XC.30107.php."},{"key":"ref_28","unstructured":"Excelitas MVS-5002. Available online: http:\/\/www.excelitas.com\/Lists\/Industrial%20Lighting\/DispForm.aspx?ID=14."},{"key":"ref_29","unstructured":"Velodyne HDL64E. Available online: http:\/\/velodynelidar.com\/hdl-64e.html."},{"key":"ref_30","unstructured":"Novatel IMU-CPT. Available online: http:\/\/www.novatel.com\/products\/span-gnss-inertial-systems\/span-imus\/imu-cpt\/."},{"key":"ref_31","unstructured":"The University of Sydney Agricultural Robotics at the Australian Centre for Field Robotics. Available online: http:\/\/sydney.edu.au\/acfr\/agriculture."},{"key":"ref_32","unstructured":"Simonyan, K., and Zisserman, A. Very Deep Convolutional Networks for Large-Scale Image Recognition. Available online: https:\/\/arxiv.org\/abs\/1409.1556."},{"key":"ref_33","unstructured":"Suchet Bargoti Pychet Labeller. Available online: https:\/\/github.com\/acfr\/pychetlabeller."},{"key":"ref_34","unstructured":"Wellington, C., Campoy, J., Khot, L., and Ehsani, R. (2012, January 7\u201312). Orchard tree modeling for advanced sprayer control and automatic tree inventory. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS) Workshop on Agricultural Robotics, Algarve, Portugal."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1075","DOI":"10.1002\/rob.21583","article-title":"A Pipeline for Trunk Detection in Trellis Structured Apple Orchards","volume":"32","author":"Bargoti","year":"2015","journal-title":"J. Field Robot."},{"key":"ref_36","unstructured":"Underwood, J., Scheding, S., and Ramos, F. (2007, January 10\u201312). Real-time map building with uncertainty using colour camera and scanning laser. Proceedings of the 2007 Australasian Conference on Robotics and Automation, Brisbane, Australia."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1137\/0105003","article-title":"Algorithms for the assignment and transportation problems","volume":"5","author":"Munkres","year":"1957","journal-title":"J. Soc. Ind. Appl. Math."},{"key":"ref_38","unstructured":"Clapper, B.M. Munkres 1.0.8. Available online: https:\/\/pypi.python.org\/pypi\/munkres."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1002\/rob.20315","article-title":"Error modeling and calibration of exteroceptive sensors for accurate mapping applications","volume":"27","author":"Underwood","year":"2010","journal-title":"J. Field Robot."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/11\/1915\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:35:32Z","timestamp":1760211332000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/11\/1915"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,11,15]]},"references-count":39,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2016,11]]}},"alternative-id":["s16111915"],"URL":"https:\/\/doi.org\/10.3390\/s16111915","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,11,15]]}}}