{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,21]],"date-time":"2026-03-21T21:21:20Z","timestamp":1774128080018,"version":"3.50.1"},"reference-count":27,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2025,4,1]],"date-time":"2025-04-01T00:00:00Z","timestamp":1743465600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"United States Department of Agriculture","award":["2021-67022-34889"],"award-info":[{"award-number":["2021-67022-34889"]}]},{"name":"United States Department of Agriculture","award":["2022-67022-37867"],"award-info":[{"award-number":["2022-67022-37867"]}]},{"name":"United States Department of Agriculture","award":["2023-51300-40853"],"award-info":[{"award-number":["2023-51300-40853"]}]},{"name":"University of Houston","award":["2021-67022-34889"],"award-info":[{"award-number":["2021-67022-34889"]}]},{"name":"University of Houston","award":["2022-67022-37867"],"award-info":[{"award-number":["2022-67022-37867"]}]},{"name":"University of Houston","award":["2023-51300-40853"],"award-info":[{"award-number":["2023-51300-40853"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>The mushroom farming industry struggles to automate harvesting due to limited large-scale annotated datasets and the complex growth patterns of mushrooms, which complicate detection, segmentation, and pose estimation. To address this, we introduce a synthetic dataset with 40,000 unique scenes of white Agaricus bisporus and brown baby bella mushrooms, capturing realistic variations in quantity, position, orientation, and growth stages. Our two-stage pose estimation pipeline combines 2D object detection and instance segmentation with a 3D point cloud-based pose estimation network using a Point Transformer. By employing a continuous 6D rotation representation and a geodesic loss, our method ensures precise rotation predictions. Experiments show that processing point clouds with 1024 points and the 6D Gram\u2013Schmidt rotation representation yields optimal results, achieving an average rotational error of 1.67\u00b0 on synthetic data, surpassing current state-of-the-art methods in mushroom pose estimation. The model, further, generalizes well to real-world data, attaining a mean angle difference of 3.68\u00b0 on a subset of the M18K dataset with ground-truth annotations. This approach aims to drive automation in harvesting, growth monitoring, and quality assessment in the mushroom industry.<\/jats:p>","DOI":"10.3390\/computers14040128","type":"journal-article","created":{"date-parts":[[2025,4,1]],"date-time":"2025-04-01T05:29:19Z","timestamp":1743485359000},"page":"128","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["SMS3D: 3D Synthetic Mushroom Scenes Dataset for 3D Object Detection and Pose Estimation"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4448-1080","authenticated-orcid":false,"given":"Abdollah","family":"Zakeri","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Houston, Houston, TX 77004, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-6873-360X","authenticated-orcid":false,"given":"Bikram","family":"Koirala","sequence":"additional","affiliation":[{"name":"Department of Engineering Technology, University of Houston, Houston, TX 77004, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4422-1097","authenticated-orcid":false,"given":"Jiming","family":"Kang","sequence":"additional","affiliation":[{"name":"Department of Engineering Technology, University of Houston, Houston, TX 77004, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3109-5156","authenticated-orcid":false,"given":"Venkatesh","family":"Balan","sequence":"additional","affiliation":[{"name":"Department of Engineering Technology, University of Houston, Houston, TX 77004, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6092-1608","authenticated-orcid":false,"given":"Weihang","family":"Zhu","sequence":"additional","affiliation":[{"name":"Department of Engineering Technology, University of Houston, Houston, TX 77004, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7822-7550","authenticated-orcid":false,"given":"Driss","family":"Benhaddou","sequence":"additional","affiliation":[{"name":"Department of Engineering Technology, University of Houston, Houston, TX 77004, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8218-9454","authenticated-orcid":false,"given":"Fatima A.","family":"Merchant","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Houston, Houston, TX 77004, USA"},{"name":"Department of Engineering Technology, University of Houston, Houston, TX 77004, USA"}]}],"member":"1968","published-online":{"date-parts":[[2025,4,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Anagnostopoulou, D., Retsinas, G., Efthymiou, N., Filntisis, P., and Maragos, P. (2023, January 17\u201324). A Realistic Synthetic Mushroom Scenes Dataset. Proceedings of the 2023 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Vancouver, BC, Canada.","DOI":"10.1109\/CVPRW59228.2023.00668"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Retsinas, G., Efthymiou, N., and Maragos, P. (2023, January 17\u201324). Mushroom Segmentation and 3D Pose Estimation From Point Clouds Using Fully Convolutional Geometric Features and Implicit Pose Encoding. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPRW59228.2023.00666"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1109\/TAFE.2024.3359463","article-title":"Survey of Mushroom Harvesting Agricultural Robots and Systems Design","volume":"2","author":"Wee","year":"2024","journal-title":"IEEE Trans. Agrifood Electron."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Qian, Y., Jiacheng, R., Pengbo, W., Zhan, Y., and Changxing, G. (2020, January 28\u201329). Real-time detection and localization using SSD method for oyster mushroom picking robot. Proceedings of the 2020 IEEE International Conference on Real-Time Computing and Robotics (RCAR), Asahikawa, Japan.","DOI":"10.1109\/RCAR49640.2020.9303258"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yang, S., Zhang, J., and Yuan, J. (2024). A High-Accuracy Contour Segmentation and Reconstruction of a Dense Cluster of Mushrooms Based on Improved SOLOv2. Agriculture, 14.","DOI":"10.3390\/agriculture14091646"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Shi, C., Mo, Y., Ren, X., Nie, J., Zhang, C., Yuan, J., and Zhu, C. (2024). Improved Real-Time Models for Object Detection and Instance Segmentation for Agaricus bisporus Segmentation and Localization System Using RGB-D Panoramic Stitching Images. Agriculture, 14.","DOI":"10.3390\/agriculture14050735"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zakeri, A., Fawakherji, M., Kang, J., Koirala, B., Balan, V., Zhu, W., Benhaddou, D., and Merchant, F.A. (2024). M18K: A Comprehensive RGB-D Dataset and Benchmark for Mushroom Detection and Instance Segmentation. arXiv.","DOI":"10.2139\/ssrn.4957798"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"K\u00e1roly, A.I., and Galambos, P. (2022, January 2\u20135). Automated Dataset Generation with Blender for Deep Learning-based Object Segmentation. Proceedings of the 2022 IEEE 20th Jubilee World Symposium on Applied Machine Intelligence and Informatics (SAMI), Poprad, Slovakia.","DOI":"10.1109\/SAMI54271.2022.9780790"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Cieslak, M., Govindarajan, U., Garcia, A., Chandrashekar, A., H\u00e4drich, T., Mendoza-Drosik, A., Michels, D.L., Pirk, S., Fu, C.C., and Pa\u0142ubicki, W. (2024, January 17\u201318). Generating Diverse Agricultural Data for Vision-Based Farming Applications. Proceedings of the 2024 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA.","DOI":"10.1109\/CVPRW63382.2024.00551"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Gao, G., Lauri, M., Wang, Y., Hu, X., Zhang, J., and Frintrop, S. (August, January 31). 6D Object Pose Regression via Supervised Learning on Point Clouds. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.","DOI":"10.1109\/ICRA40945.2020.9197461"},{"key":"ref_11","unstructured":"Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017, January 4\u20139). PointNet++: Deep hierarchical feature learning on point sets in a metric space. Proceedings of the 31st International Conference on Neural Information Processing Systems, Red Hook, NY, USA. NIPS\u201917."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Avidan, S., Brostow, G., Ciss\u00e9, M., Farinella, G.M., and Hassner, T. (2022). Learning-Based Point Cloud Registration for 6D Object Pose Estimation in the Real World. Proceedings of the Computer Vision\u2013ECCV 2022, Springer.","DOI":"10.1007\/978-3-031-20083-0"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Chen, W., Duan, J., Basevi, H., Chang, H.J., and Leonardis, A. (2020, January 1\u20135). PointPoseNet: Point Pose Network for Robust 6D Object Pose Estimation. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, Snowmass Village, CO, USA.","DOI":"10.1109\/WACV45572.2020.9093272"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Charles, R.Q., Su, H., Kaichun, M., and Guibas, L.J. (2017, January 21\u201326). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.16"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhao, H., Jiang, L., Jia, J., Torr, P.H., and Koltun, V. (2021, January 10\u201317). Point Transformer. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.01595"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Soltan, S., Oleinikov, A., Demirci, M.F., and Shintemirov, A. (2020). Deep Learning-Based Object Classification and Position Estimation Pipeline for Potential Use in Robotized Pick-and-Place Operations. Robotics, 9.","DOI":"10.3390\/robotics9030063"},{"key":"ref_17","unstructured":"Baisa, N.L., and Al-Diri, B. (2022). Mushrooms Detection, Localization and 3D Pose Estimation using RGB-D Sensor for Robotic-picking Applications. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Mavridis, P., Mavrikis, N., Mastrogeorgiou, A., and Chatzakos, P. (July, January 27). Low-cost, accurate robotic harvesting system for existing mushroom farms. Proceedings of the 2023 IEEE\/ASME International Conference on Advanced Intelligent Mechatronics (AIM), Seattle, WA, USA.","DOI":"10.1109\/AIM46323.2023.10196219"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Lin, A., Liu, Y., and Zhang, L. (2021, January 12\u201314). Mushroom Detection and Positioning Method Based on Neural Network. Proceedings of the 2021 IEEE 5th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Chongqing, China.","DOI":"10.1109\/IAEAC50856.2021.9390669"},{"key":"ref_20","unstructured":"(2024, January 25\u201328). Development of a Compact Hybrid Gripper for Automated Harvesting of White Button Mushroom. Volume 7: 48th Mechanisms and Robotics Conference (MR). Proceedings of the International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Washington, DC, USA. Available online: https:\/\/asmedigitalcollection.asme.org\/IDETC-CIE\/proceedings-pdf\/IDETC-CIE2024\/88414\/V007T07A036\/7403466\/v007t07a036-detc2024-143056.pdf."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Koirala, B., Kafle, A., Nguyen, H.C., Kang, J., Zakeri, A., Balan, V., Merchant, F., Benhaddou, D., and Zhu, W. (2024). A Hybrid Three-Finger Gripper for Automated Harvesting of Button Mushrooms. Actuators, 13.","DOI":"10.3390\/act13080287"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Koirala, B., Zakeri, A., Kang, J., Kafle, A., Balan, V., Merchant, F.A., Benhaddou, D., and Zhu, W. (2024). Robotic Button Mushroom Harvesting Systems: A Review of Design, Mechanism, and Future Directions. Appl. Sci., 14.","DOI":"10.3390\/app14209229"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Barnes, C., Lu, J., Yang, J., and Li, H. (2019, January 15\u201320). On the Continuity of Rotation Representations in Neural Networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00589"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Perlin, K. (1985). An Image Synthesizer, ACM SIGGRAPH Computer Graphics.","DOI":"10.1145\/325165.325247"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s10851-009-0161-2","article-title":"Metrics for 3D Rotations: Comparison and Analysis","volume":"35","author":"Huynh","year":"2009","journal-title":"J. Math. Imaging Vis."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Retsinas, G., Efthymiou, N., Anagnostopoulou, D., and Maragos, P. (2023). Mushroom Detection and Three Dimensional Pose Estimation from Multi-View Point Clouds. Sensors, 23.","DOI":"10.3390\/s23073576"}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/4\/128\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:07:36Z","timestamp":1760029656000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/4\/128"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,1]]},"references-count":27,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,4]]}},"alternative-id":["computers14040128"],"URL":"https:\/\/doi.org\/10.3390\/computers14040128","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,1]]}}}