{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T09:23:04Z","timestamp":1772097784136,"version":"3.50.1"},"reference-count":38,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T00:00:00Z","timestamp":1772064000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>There has been significant development in agricultural robotics over the past few years in the pursuit of optimising efficiency and addressing issues such as labour shortages and humans performing hazardous and arduous tasks. Despite this, human\u2013robot interaction in the agricultural sector remains largely unchanged, often requiring technical expertise, which hinders wide-scale adoption. This problem is particularly pronounced in the African context, where limited technical exposure and linguistic diversity pose significant barriers to the adoption of these technologies. While alternative means for human\u2013robot collaboration have been developed, these methods are currently limited to indoor structured environments. In this work, we introduce Osiris++, a flexible approach designed to allow seamless communication between robots and humans on an array of precision agriculture tasks. We validate and evaluate the performance of Osiris++ in real-world agricultural environments, demonstrating that the system can create accurate and useful scene graphs that aid in solving the assigned tasks. This paves the way for the possibility of allowing natural language instructions, including those in African languages, to be issued to robots within the agricultural sector.<\/jats:p>","DOI":"10.3389\/frobt.2026.1732004","type":"journal-article","created":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T08:50:39Z","timestamp":1772095839000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Osiris++: hierarchical representations for robotic-enabled precision agriculture"],"prefix":"10.3389","volume":"13","author":[{"given":"Adam","family":"Mukuddem","sequence":"first","affiliation":[{"name":"African Robotics Unit, University of Cape Town","place":["Cape Town, South Africa"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adam","family":"Speed-Andrews","sequence":"additional","affiliation":[{"name":"African Robotics Unit, University of Cape Town","place":["Cape Town, South Africa"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thabisa","family":"Maweni","sequence":"additional","affiliation":[{"name":"African Robotics Unit, University of Cape Town","place":["Cape Town, South Africa"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Imannuel","family":"Nanyaro","sequence":"additional","affiliation":[{"name":"African Robotics Unit, University of Cape Town","place":["Cape Town, South Africa"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ritvik","family":"Sojen","sequence":"additional","affiliation":[{"name":"African Robotics Unit, University of Cape Town","place":["Cape Town, South Africa"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Venny","family":"Hsiao","sequence":"additional","affiliation":[{"name":"African Robotics Unit, University of Cape Town","place":["Cape Town, South Africa"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul","family":"Amayo","sequence":"additional","affiliation":[{"name":"African Robotics Unit, University of Cape Town","place":["Cape Town, South Africa"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2026,2,26]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"536","DOI":"10.1002\/sres.2962","article-title":"Transitioning towards human\u2013robot synergy in agriculture: a systems thinking perspective","volume":"40","author":"Aivazidou","year":"2023","journal-title":"Syst. Res. Behav. Sci."},{"key":"B2","doi-asserted-by":"publisher","first-page":"957","DOI":"10.1007\/s10514-017-9677-2","article-title":"Progress and prospects of the human\u2013robot collaboration","volume":"42","author":"Ajoudani","year":"2018","journal-title":"Aut. Robots"},{"key":"B3","first-page":"8138","article-title":"Geometric multi-model fitting with a convex relaxation algorithm","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"Amayo","year":"2018"},{"key":"B4","doi-asserted-by":"publisher","first-page":"107584","DOI":"10.1016\/j.compag.2022.107584","article-title":"engVision-based navigation and guidance for agricultural autonomous vehicles and robots: a review","volume":"205","author":"Bai","year":"2023","journal-title":"Comput. Electronics Agriculture"},{"key":"B6","doi-asserted-by":"publisher","first-page":"9107","DOI":"10.1109\/lra.2022.3189785","article-title":"Situational graphs for robot navigation in structured indoor environments","volume":"7","author":"Bavle","year":"2022","journal-title":"IEEE Robotics Automation Lett."},{"key":"B5","doi-asserted-by":"crossref","first-page":"4927","DOI":"10.1109\/LRA.2023.3290512","article-title":"S-graphs+: real-time localization and mapping leveraging hierarchical representations","volume":"8","author":"Bavle","year":"2023","journal-title":"IEEE Robotics Automation Lett."},{"key":"B7","doi-asserted-by":"publisher","first-page":"6776","DOI":"10.3390\/s23156776","article-title":"Human\u2013robot interaction in agriculture: a systematic review","volume":"23","author":"Benos","year":"2023","journal-title":"Sensors"},{"key":"B8","doi-asserted-by":"crossref","first-page":"1874","DOI":"10.1109\/TRO.2021.3075644","article-title":"Orb-slam3: an accurate open-source library for visual, visual\u2013inertial, and multimap slam","volume":"37","author":"Campos","year":"2021","journal-title":"IEEE Trans. Robotics"},{"key":"B9","doi-asserted-by":"crossref","DOI":"10.1109\/IROS55552.2023.10341838","article-title":"Hydra-multi: collaborative online construction of 3d scene graphs with multi-robot teams","author":"Chang","year":"2023"},{"key":"B10","first-page":"4","article-title":"Factor graphs and gtsam: a hands-on introduction","volume":"2","author":"Dellaert","year":"2012","journal-title":"GA. Inst. Technol. Tech. Rep"},{"key":"B11","doi-asserted-by":"crossref","first-page":"795","DOI":"10.1109\/ICRA.2016.7487209","article-title":"Off the beaten track: predicting localisation performance in visual teach and repeat","volume-title":"2016 IEEE international conference on robotics and automation (ICRA)","author":"Dequaire","year":"2016"},{"key":"B12","doi-asserted-by":"crossref","first-page":"5266","DOI":"10.1109\/ICRA.2017.7989618","article-title":"Segmatch: segment based place recognition in 3d point clouds","volume-title":"2017 IEEE international conference on robotics and automation (ICRA)","author":"Dub\u00e9","year":"2017"},{"key":"B13","article-title":"SegMap: 3D segment mapping using data-driven descriptors","author":"Dub\u00e9","year":"2018","journal-title":"Robotics: science and systems online proceedings 14"},{"key":"B14","doi-asserted-by":"crossref","DOI":"10.31256\/WP2018.2","article-title":"Agricultural robotics: the future of robotic agriculture","author":"Duckett","year":"2018"},{"key":"B15","doi-asserted-by":"crossref","first-page":"10260","DOI":"10.1109\/ICRA57147.2024.10610962","article-title":"Effectively detecting loop closures using point cloud density maps","volume-title":"2024 IEEE international conference on robotics and automation (ICRA)","author":"Gupta","year":"2024"},{"key":"B16","doi-asserted-by":"crossref","DOI":"10.15607\/RSS.2022.XVIII.050","article-title":"Hydra: a real-time spatial perception system for 3d scene graph construction and optimization","author":"Hughes","year":"2022"},{"key":"B17","article-title":"Foundations of spatial perception for robotics: hierarchical representations and real-time systems","author":"Hughes","year":"2023"},{"key":"B18","article-title":"Grounding dino: marrying dino with grounded pre-training for open-set object detection","author":"Liu","year":"2023"},{"key":"B19","doi-asserted-by":"publisher","first-page":"1818","DOI":"10.3390\/agronomy11091818","article-title":"An overview of cooperative robotics in agriculture","volume":"11","author":"Lytridis","year":"2021","journal-title":"Agronomy"},{"key":"B20","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1145\/3503250","article-title":"Nerf: representing scenes as neural radiance fields for view synthesis","volume":"65","author":"Mildenhall","year":"2021","journal-title":"Commun. ACM"},{"key":"B21","doi-asserted-by":"publisher","first-page":"2494","DOI":"10.3390\/agriengineering6030146","article-title":"Human\u2013robot interaction through dynamic movement recognition for agricultural environments","volume":"6","author":"Moysiadis","year":"2024","journal-title":"AgriEngineering"},{"key":"B22","doi-asserted-by":"crossref","first-page":"15797","DOI":"10.1109\/ICRA57147.2024.10610723","article-title":"Osiris: building hierarchical representations for agricultural environments","volume-title":"2024 IEEE international conference on robotics and automation (ICRA)","author":"Mukuddem","year":"2024"},{"key":"B23","doi-asserted-by":"crossref","first-page":"19048","DOI":"10.18653\/v1\/2025.findings-acl.976","article-title":"Afrobench: how good are large language models on African languages?","volume-title":"Findings of the association for computational linguistics: ACL 2025","author":"Ojo","year":"2025"},{"key":"B24","doi-asserted-by":"crossref","first-page":"1366","DOI":"10.1109\/IROS.2017.8202315","article-title":"Voxblox: incremental 3d euclidean signed distance fields for on-board mav planning","volume-title":"2017 IEEE\/RSJ international conference on intelligent robots and systems (IROS)","author":"Oleynikova","year":"2017"},{"key":"B25","first-page":"58","article-title":"Global structure-from-motion revisited","volume-title":"European conference on computer vision","author":"Pan","year":"2024"},{"key":"B26","first-page":"12932","article-title":"Urban radiance fields","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"Rematas","year":"2022"},{"key":"B27","doi-asserted-by":"publisher","first-page":"1510","DOI":"10.1177\/02783649211056674","article-title":"Kimera: from slam to spatial perception with 3d dynamic scene graphs","volume":"40","author":"Rosinol","year":"2021","journal-title":"Int. J. Robotics Res."},{"key":"B28","first-page":"1","article-title":"3d is here: point cloud library (pcl)","volume-title":"2011 IEEE international conference on robotics and automation (IEEE)","author":"Rusu","year":"2011"},{"key":"B29","article-title":"Informing 3d scene graph generation with common-sense spatial knowledge","author":"Strader","year":"2024"},{"key":"B30","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1051\/epjconf\/202129102005","article-title":"Wearable sensors for identifying activity signatures in human-robot collaborative agricultural environments","volume":"9","author":"Tagarakis","year":"2021","journal-title":"Eng. Proc."},{"key":"B31","first-page":"8248","article-title":"Block-nerf: scalable large scene neural view synthesis","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"Tancik","year":"2022"},{"key":"B32","first-page":"98","article-title":"Silvr: scalable lidar-visual radiance field reconstruction with uncertainty quantification","author":"Tao","year":"2025","journal-title":"IEEE Transactions on Robotics 42"},{"key":"B33","doi-asserted-by":"crossref","first-page":"571","DOI":"10.1007\/978-3-031-47969-4_44","article-title":"Multimodal dataset for localization, mapping and crop monitoring in citrus tree farms","volume-title":"International symposium on visual computing","author":"Teng","year":"2023"},{"key":"B34","doi-asserted-by":"publisher","first-page":"2022","DOI":"10.1109\/TRO.2021.3137751","article-title":"Kimera-multi: robust, distributed, dense metric-semantic slam for multi-robot systems","volume":"38","author":"Tian","year":"2022","journal-title":"IEEE Trans. Robotics"},{"key":"B35","first-page":"12922","article-title":"Mega-nerf: scalable construction of large-scale nerfs for virtual fly-throughs","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"Turki","year":"2022"},{"key":"B36","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.biosystemseng.2022.06.010","article-title":"Workload and production assessment in the avocado harvesting process using human-robot collaborative strategies","volume":"223","author":"V\u00e1sconez","year":"2022","journal-title":"Biosyst. Eng."},{"key":"B37","article-title":"Repvit-sam: towards real-time segmenting anything","author":"Wang","year":"2023"},{"key":"B38","doi-asserted-by":"publisher","first-page":"2053","DOI":"10.1109\/tro.2022.3141876","article-title":"Fast-lio2: fast direct lidar-inertial odometry","volume":"38","author":"Xu","year":"2022","journal-title":"IEEE Trans. Robotics"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2026.1732004\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T08:50:44Z","timestamp":1772095844000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2026.1732004\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,26]]},"references-count":38,"alternative-id":["10.3389\/frobt.2026.1732004"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2026.1732004","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,26]]},"article-number":"1732004"}}