{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,20]],"date-time":"2025-12-20T22:10:10Z","timestamp":1766268610626,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2025,6,30]],"date-time":"2025-06-30T00:00:00Z","timestamp":1751241600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union Next-GenerationEU","award":["1058 23\/06\/2022, ECS00000043"],"award-info":[{"award-number":["1058 23\/06\/2022, ECS00000043"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>The experimentation of agricultural robots has been increasing in recent years, both in greenhouses and open fields. While agricultural robots are inherently useful for automating various farming tasks, their presence can also be leveraged to collect measurements along their paths. This approach enables the creation of a complete and detailed picture of the climate conditions inside a greenhouse, reducing the need to distribute a large number of physical devices among the crops. In this regard, choosing the best visiting sequence of the Points of Interest (PoIs) regarding where to perform the measurements deserves particular attention. This trajectory planning has to carefully combine the amount and significance of the collected data with the energy requirements of the robot. In this paper, we propose a method based on Deep Reinforcement Learning enriched with a Proximal Policy Optimization (PPO) algorithm for determining the best trajectory an agricultural robot must follow to balance the number of measurements and autonomy adequately. The proposed approach has been applied to a real-world case study regarding a greenhouse in Verona (Italy) and compared with other existing state-of-the-art approaches.<\/jats:p>","DOI":"10.3390\/fi17070296","type":"journal-article","created":{"date-parts":[[2025,6,30]],"date-time":"2025-06-30T13:06:17Z","timestamp":1751288777000},"page":"296","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Optimizing Trajectories for Rechargeable Agricultural Robots in Greenhouse Climatic Sensing Using Deep Reinforcement Learning with Proximal Policy Optimization Algorithm"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-7684-4565","authenticated-orcid":false,"given":"Ashraf","family":"Sharifi","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Verona, 37134 Verona, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3675-7243","authenticated-orcid":false,"given":"Sara","family":"Migliorini","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Verona, 37134 Verona, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0775-939X","authenticated-orcid":false,"given":"Davide","family":"Quaglia","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Verona, 37134 Verona, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"9893","DOI":"10.1016\/j.matpr.2021.01.409","article-title":"Design of solar-powered forced ventilation system and energy-efficient thermal comfort operation of greenhouse","volume":"46","author":"Revathi","year":"2021","journal-title":"Mater. Today Proc."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1006\/jaer.1994.1003","article-title":"HORTITRANS, a model for predicting and optimizing humidity and transpiration in greenhouses","volume":"57","author":"Jolliet","year":"1994","journal-title":"J. Agric. Eng. Res."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Van Pee, M., Janssens, K., Berckmans, D., and Lemeur, R. (1998). Dynamic Measurement and Modelling of Climate Gradients Around a Plant for mIcro-Environment Control, International Society for Horticultural Science. Available online: https:\/\/www.actahort.org\/books\/456\/456_48.htm.","DOI":"10.17660\/ActaHortic.1998.456.48"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1006\/jaer.2000.0649","article-title":"SE\u2014Structures and Environment: Vertical Temperature and Humidity Gradients in a Naturally Ventilated Greenhouse","volume":"78","author":"Zhao","year":"2001","journal-title":"J. Agric. Eng. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1006\/bioe.2002.0107","article-title":"PA\u2014Precision Agriculture: Convective and Ventilation Transfers in Greenhouses, Part 1: The Greenhouse considered as a Perfectly Stirred Tank","volume":"83","author":"Roy","year":"2002","journal-title":"Biosyst. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/S1537-5110(03)00018-7","article-title":"Temperature Gradients in a Partially Shaded Large Greenhouse equipped with Evaporative Cooling Pads","volume":"85","author":"Kittas","year":"2003","journal-title":"Biosyst. Eng."},{"key":"ref_7","first-page":"143","article-title":"Prediction of longitudinal variations in temperature and relative humidity eor evaporative cooling greenhouses","volume":"12","author":"Chen","year":"2003","journal-title":"Agric. Eng. J."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3774","DOI":"10.1016\/j.buildenv.2006.06.020","article-title":"Greenhouse microclimate and dehumidification effectiveness under different ventilator configurations","volume":"42","author":"Kittas","year":"2007","journal-title":"Build. Environ."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1016\/j.compag.2008.10.001","article-title":"Use of geostatistical and crop growth modelling to assess the variability of greenhouse tomato yield caused by spatial temperature variations","volume":"65","author":"Gil","year":"2009","journal-title":"Comput. Electron. Agric."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.compag.2017.12.028","article-title":"Distributed network for measuring climatic parameters in heterogeneous environments: Application in a greenhouse","volume":"145","author":"Blanco","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_11","first-page":"67","article-title":"A wireless sensor network for precision irrigation in Tunisia","volume":"1","author":"Hamrita","year":"2005","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.biosystemseng.2013.11.001","article-title":"Air exchange and ventilation efficiencies of a non-span greenhouse with one inflow and one outflow through longitudinal side openings","volume":"119","author":"Teitel","year":"2014","journal-title":"Biosyst. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"23","DOI":"10.5307\/JBE.2017.42.1.023","article-title":"An intelligent wireless sensor and actuator network system for greenhouse microenvironment control and assessment","volume":"42","author":"Pahuja","year":"2017","journal-title":"J. Biosyst. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Rosas, J., Palma, L.B., and Antunes, R.A. (2024). An Approach for Modeling and Simulation of Virtual Sensors in Automatic Control Systems Using Game Engines and Machine Learning. Sensors, 24.","DOI":"10.3390\/s24237610"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Brentarolli, E., Migliorini, S., Quaglia, D., and Tomazzoli, C. (2023, January 25\u201327). Mapping Micro-Climate in a Greenhouse Through a Context-Aware Recurrent Neural Network. Proceedings of the 2023 IEEE Conference on AgriFood Electronics (CAFE), Torino, Italy.","DOI":"10.1109\/CAFE58535.2023.10291595"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"554","DOI":"10.1109\/TAFE.2024.3441470","article-title":"Estimating Greenhouse Climate Through Context-Aware Recurrent Neural Networks Over an Embedded System","volume":"2","author":"Tomazzoli","year":"2024","journal-title":"IEEE Trans. AgriFood Electron."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Brentarolli, E., Migliorini, S., Quaglia, D., and Tomazzoli, C. (2023, January 6\u20138). Greenhouse Climatic Sensing through Agricultural Robots and Recurrent Neural Networks. Proceedings of the 2023 IEEE International Workshop on Metrology for Agriculture and Forestry, Pisa, Italy.","DOI":"10.1109\/MetroAgriFor58484.2023.10424311"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Sharifi, A., Migliorini, S., and Quaglia, D. (2024, January 15\u201317). Optimizing the Trajectory of Agricultural Robots in Greenhouse. Proceedings of the 8th International Conference on Control, Automation and Diagnosis, ICCAD 2024, Paris, France.","DOI":"10.1109\/ICCAD60883.2024.10553772"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1016\/S1389-1286(01)00302-4","article-title":"Wireless sensor networks: A survey","volume":"38","author":"Akyildiz","year":"2002","journal-title":"Comput. Netw."},{"key":"ref_20","unstructured":"Gonda, L., and Cugnasca, C. (2006, January 24\u201326). A Proposal of Greenhouse Control Using Wireless Sensor Networks. Proceedings of the Computers in Agriculture and Natural Resources\u2014Proceedings of the 4th World Congress, Orlando, FL, USA."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"140","DOI":"10.5121\/ijwmn.2011.3113","article-title":"Application of Wireless Sensor Networks for Greenhouse Parameter Control in Precision Agriculture","volume":"3","author":"Chaudhary","year":"2011","journal-title":"Int. J. Wirel. Mob. Netw."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1016\/j.jclepro.2014.04.036","article-title":"Environmental parameters monitoring in precision agriculture using wireless sensor networks","volume":"88","author":"Srbinovska","year":"2015","journal-title":"J. Clean. Prod."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Guzm\u00e1n, C.H., Carrera, J.L., Dur\u00e1n, H.A., Berumen, J., Ortiz, A.A., Guirette, O.A., Arroyo, A., Brizuela, J.A., G\u00f3mez, F., and Blanco, A. (2019). Implementation of Virtual Sensors for Monitoring Temperature in Greenhouses Using CFD and Control. Sensors, 19.","DOI":"10.3390\/s19010060"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/0021-8634(84)90101-X","article-title":"A technique of adaptive control of the temperature in a greenhouse using ventilator adjustments","volume":"29","author":"Davis","year":"1984","journal-title":"J. Agric. Eng. Res."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"15244","DOI":"10.3390\/s121115244","article-title":"Virtual sensors for designing irrigation controllers in greenhouses","volume":"12","author":"Arahal","year":"2012","journal-title":"Sensors"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3334","DOI":"10.3390\/s150203334","article-title":"Mini-UAV based sensory system for measuring environmental variables in greenhouses","volume":"15","author":"Joosen","year":"2015","journal-title":"Sensors"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"232","DOI":"10.3390\/s90100232","article-title":"Simulation of greenhouse climate monitoring and control with wireless sensor network and event-based control","volume":"9","author":"Pawlowski","year":"2009","journal-title":"Sensors"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1016\/j.compchemeng.2006.05.030","article-title":"A systematic approach for soft sensor development","volume":"31","author":"Lin","year":"2007","journal-title":"Comput. Chem. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1016\/S0959-1524(01)00044-0","article-title":"Product property and production rate control of styrene polymerization","volume":"12","author":"Prasad","year":"2002","journal-title":"J. Process Control"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"871","DOI":"10.1016\/S0098-1354(00)00343-4","article-title":"A nonlinear soft sensor based on multivariate smoothing procedure for quality estimation in distillation columns","volume":"24","author":"Park","year":"2000","journal-title":"Comput. Chem. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1016\/S0959-1524(99)00052-9","article-title":"Neural networks for the identification and control of blast furnace hot metal quality","volume":"10","author":"Radhakrishnan","year":"2000","journal-title":"J. Process Control"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1051\/agro:2001006","article-title":"Using CFD to model the internal climate of greenhouses: Past, present and future","volume":"22","author":"Reichrath","year":"2002","journal-title":"Agronomie"},{"key":"ref_33","first-page":"17651","article-title":"Computational fluid dynamics in greenhouses: A review","volume":"10","year":"2011","journal-title":"Afr. J. Biotechnol."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Sonoda, A., Takayama, Y., Sugawara, A., and Nishi, H. (2022, January 17\u201320). Greenhouse Heat Map Generation with Deep Neural Network Using Limited Number of Temperature Sensors. Proceedings of the IECON 2022\u201348th Annual Conference of the IEEE Industrial Electronics Society, Brussels, Belgium.","DOI":"10.1109\/IECON49645.2022.9968606"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.compag.2010.03.002","article-title":"Comparison of finite element and finite volume methods for simulation of natural ventilation in greenhouses","volume":"72","author":"Fatnassi","year":"2010","journal-title":"Comput. Electron. Agric."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.compag.2009.05.004","article-title":"Numerical modelling of temperature variations in a Chinese solar greenhouse","volume":"68","author":"Tong","year":"2009","journal-title":"Comput. Electron. Agric."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Deltour, J., De Halleux, D., Nijskens, J., Coutisse, S., and Nisen, A. (1985, January 19\u201324). Dynamic modelling of heat and mass transfer in greenhouses. Proceedings of the Symposium Greenhouse Climate and Its Control, Wageningen, The Netherlands.","DOI":"10.17660\/ActaHortic.1985.174.14"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.applthermaleng.2012.03.008","article-title":"Comparative experimental analysis and modelling of a flower greenhouse equipped with a desiccant system","volume":"47","author":"Longo","year":"2012","journal-title":"Appl. Therm. Eng."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"105934","DOI":"10.1016\/j.compag.2020.105934","article-title":"A virtual sensor simulation system of a flower greenhouse coupled with a new temperature microclimate model using three-dimensional CFD","volume":"181","author":"Cheng","year":"2021","journal-title":"Comput. Electron. Agric."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Usman, A., Rafiq, M., Saeed, M., Nauman, A., Almqvist, A., and Liwicki, M. (2021, January 14\u201315). Machine learning computational fluid dynamics. Proceedings of the 2021 Swedish Artificial Intelligence Society Workshop (SAIS), Lulea, Sweden.","DOI":"10.1109\/SAIS53221.2021.9483997"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Brentarolli, E., Locatelli, S., Nicoletto, C., Sambo, P., Quaglia, D., and Muradore, R. (2024). A spatio-temporal methodology for greenhouse microclimatic mapping. PLoS ONE, 19.","DOI":"10.1371\/journal.pone.0310454"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"5140","DOI":"10.1109\/TSMC.2021.3116141","article-title":"On Predicting Sensor Readings With Sequence Modeling and Reinforcement Learning for Energy-Efficient IoT Applications","volume":"52","author":"Laidi","year":"2022","journal-title":"IEEE Trans. Syst. Man, Cybern. Syst."},{"key":"ref_43","unstructured":"Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal Policy Optimization Algorithms. arXiv."},{"key":"ref_44","unstructured":"Mukherjee, S., Dutt, V., and Srinivasan, N. (2023). Assessment of Various Deep Reinforcement Learning Techniques in Complex\nVirtual Search-and-Retrieve Environments Compared to Human Performance. Applied Cognitive Science and Technology: Implications of Interactions Between Human Cognition and Technology, Springer Nature."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Liu, L., and \u00d6zsu, M.T. (2009). Temporal Granularity. Encyclopedia of Database Systems, Springer.","DOI":"10.1007\/978-0-387-39940-9"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Enderton, H. (1977). Elements of Set Theory, Elsevier Science.","DOI":"10.1016\/S0049-237X(08)71114-5"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/7\/296\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:01:55Z","timestamp":1760032915000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/7\/296"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,30]]},"references-count":46,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2025,7]]}},"alternative-id":["fi17070296"],"URL":"https:\/\/doi.org\/10.3390\/fi17070296","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2025,6,30]]}}}