{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T14:48:30Z","timestamp":1791470910418,"version":"4.3.4"},"reference-count":52,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2021,7,3]],"date-time":"2021-07-03T00:00:00Z","timestamp":1625270400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002241","name":"Japan Science and Technology Agency","doi-asserted-by":"publisher","award":["JPMJSC16H2"],"award-info":[{"award-number":["JPMJSC16H2"]}],"id":[{"id":"10.13039\/501100002241","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002241","name":"Japan Science and Technology Agency","doi-asserted-by":"publisher","award":["JPMJCR16O2"],"award-info":[{"award-number":["JPMJCR16O2"]}],"id":[{"id":"10.13039\/501100002241","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002241","name":"Japan Science and Technology Agency","doi-asserted-by":"publisher","award":["JPMJCR16O1"],"award-info":[{"award-number":["JPMJCR16O1"]}],"id":[{"id":"10.13039\/501100002241","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005196","name":"Chinese Academy of Agricultural Sciences","doi-asserted-by":"publisher","award":["International Science & Technology Innovation Program (CAASTIP)"],"award-info":[{"award-number":["International Science & Technology Innovation Program (CAASTIP)"]}],"id":[{"id":"10.13039\/501100005196","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U19A2061"],"award-info":[{"award-number":["U19A2061"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Unmanned aerial vehicle (UAV) and structure from motion (SfM) photogrammetry techniques are widely used for field-based, high-throughput plant phenotyping nowadays, but some of the intermediate processes throughout the workflow remain manual. For example, geographic information system (GIS) software is used to manually assess the 2D\/3D field reconstruction quality and cropping region of interests (ROIs) from the whole field. In addition, extracting phenotypic traits from raw UAV images is more competitive than directly from the digital orthomosaic (DOM). Currently, no easy-to-use tools are available to implement previous tasks for commonly used commercial SfM software, such as Pix4D and Agisoft Metashape. Hence, an open source software package called easy intermediate data processor (EasyIDP; MIT license) was developed to decrease the workload in intermediate data processing mentioned above. The functions of the proposed package include (1) an ROI cropping module, assisting in reconstruction quality assessment and cropping ROIs from the whole field, and (2) an ROI reversing module, projecting ROIs to relative raw images. The result showed that both cropping and reversing modules work as expected. Moreover, the effects of ROI height selection and reversed ROI position on raw images to reverse calculation were discussed. This tool shows great potential for decreasing workload in data annotation for machine learning applications.<\/jats:p>","DOI":"10.3390\/rs13132622","type":"journal-article","created":{"date-parts":[[2021,7,4]],"date-time":"2021-07-04T22:35:22Z","timestamp":1625438122000},"page":"2622","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["EasyIDP: A Python Package for Intermediate Data Processing in UAV-Based Plant Phenotyping"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6135-402X","authenticated-orcid":false,"given":"Haozhou","family":"Wang","sequence":"first","affiliation":[{"name":"International Field Phenomics Research Laboratory, Institute for Sustainable Agro-Ecosystem Services, Graduate School of Agricultural and Life Science, The University of Tokyo, Tokyo 188-0002, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yulin","family":"Duan","sequence":"additional","affiliation":[{"name":"Key Laboratory of Agricultural Remote Sensing, Ministry of Agriculture, Beijing 100081, China"},{"name":"Institute of Agricultural Resources and Regional Planning, Chinese Academy of Agricultural Sciences, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yun","family":"Shi","sequence":"additional","affiliation":[{"name":"Key Laboratory of Agricultural Remote Sensing, Ministry of Agriculture, Beijing 100081, China"},{"name":"Institute of Agricultural Resources and Regional Planning, Chinese Academy of Agricultural Sciences, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yoichiro","family":"Kato","sequence":"additional","affiliation":[{"name":"International Field Phenomics Research Laboratory, Institute for Sustainable Agro-Ecosystem Services, Graduate School of Agricultural and Life Science, The University of Tokyo, Tokyo 188-0002, Japan"},{"name":"International Rice Research Institute, Metro Manila 1226, Philippines"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2123-4354","authenticated-orcid":false,"given":"Seishi","family":"Ninomiya","sequence":"additional","affiliation":[{"name":"International Field Phenomics Research Laboratory, Institute for Sustainable Agro-Ecosystem Services, Graduate School of Agricultural and Life Science, The University of Tokyo, Tokyo 188-0002, Japan"},{"name":"Plant Phenomics Research Center, Jiangsu Collaborative Innovation Center for Modern Crop Production, Nanjing Agricultural University, Nanjing 210095, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3017-5464","authenticated-orcid":false,"given":"Wei","family":"Guo","sequence":"additional","affiliation":[{"name":"International Field Phenomics Research Laboratory, Institute for Sustainable Agro-Ecosystem Services, Graduate School of Agricultural and Life Science, The University of Tokyo, Tokyo 188-0002, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"248","DOI":"10.3389\/fpls.2019.00248","article-title":"An Accurate Skeleton Extraction Approach From 3D Point Clouds of Maize Plants","volume":"10","author":"Wu","year":"2019","journal-title":"Front. Plant Sci."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ten Harkel, J., Bartholomeus, H., and Kooistra, L. (2019). Biomass and Crop Height Estimation of Different Crops Using UAV-Based Lidar. Remote Sens., 12.","DOI":"10.3390\/rs12010017"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1186\/s13007-020-00613-5","article-title":"Non-Destructive Estimation of Field Maize Biomass Using Terrestrial Lidar: An Evaluation from Plot Level to Individual Leaf Level","volume":"16","author":"Jin","year":"2020","journal-title":"Plant Methods"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.isprsjprs.2019.12.011","article-title":"Three-Dimensional Photogrammetric Mapping of Cotton Bolls in Situ Based on Point Cloud Segmentation and Clustering","volume":"160","author":"Sun","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"mcaa046","DOI":"10.1093\/aob\/mcaa046","article-title":"Quantification of Light Interception within Image-Based 3D Reconstruction of Sole and Intercropped Canopies over the Entire Growth Season","volume":"126","author":"Zhu","year":"2020","journal-title":"Ann. Bot."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.compag.2014.09.021","article-title":"In-Field Crop Row Phenotyping from 3D Modeling Performed Using Structure from Motion","volume":"110","author":"Jay","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"105047","DOI":"10.1016\/j.compag.2019.105047","article-title":"3D Model Processing for High Throughput Phenotype Extraction\u2014The Case of Corn","volume":"172","author":"Zermas","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1071\/FP16123","article-title":"Comparison of Ground Cover Estimates from Experiment Plots in Cotton, Sorghum and Sugarcane Based on Images and Ortho-Mosaics Captured by UAV","volume":"44","author":"Duan","year":"2017","journal-title":"Funct. Plant Biol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"766","DOI":"10.1071\/FP20309","article-title":"Coupling of Machine Learning Methods to Improve Estimation of Ground Coverage from Unmanned Aerial Vehicle (UAV) Imagery for High-Throughput Phenotyping of Crops","volume":"48","author":"Hu","year":"2021","journal-title":"Funct. Plant Biol."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Oats, R., Escobar-Wolf, R., and Oommen, T. (2019). Evaluation of Photogrammetry and Inclusion of Control Points: Significance for Infrastructure Monitoring. Data, 4.","DOI":"10.3390\/data4010042"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Feldman, A., Wang, H., Fukano, Y., Kato, Y., Ninomiya, S., and Guo, W. (2021). EasyDCP: An Affordable, High-throughput Tool to Measure Plant Phenotypic Traits in 3D. Methods Ecol. Evol.","DOI":"10.1111\/2041-210X.13645"},{"key":"ref_12","unstructured":"Young, D. (2021, June 02). Ucdavis\/Metashape: Easy, Reproducible Metashape Workflows. Available online: https:\/\/github.com\/ucdavis\/metashape."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Mortensen, A.K., Laursen, M.S., J\u00f8rgensen, R.N., and Gislum, R. (2019). Drone dataflow\u2014A MATLAB toolbox for extracting plots from images captured by a UAV. Precision Agriculture \u201919, Wageningen Academic Publishers.","DOI":"10.3920\/978-90-8686-888-9_118"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"12318","DOI":"10.1002\/ece3.6861","article-title":"Field-based Individual Plant Phenotyping of Herbaceous Species by Unmanned Aerial Vehicle","volume":"10","author":"Guo","year":"2020","journal-title":"Ecol. Evol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"637694","DOI":"10.3389\/fpls.2021.637694","article-title":"GIS-Based Analysis for UAV-Supported Field Experiments Reveals Soybean Traits Associated With Rotational Benefit","volume":"12","author":"Fukano","year":"2021","journal-title":"Front. Plant Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.34133\/2019\/2591849","article-title":"Easy MPE: Extraction of Quality Microplot Images for UAV-Based High-Throughput Field Phenotyping","volume":"2019","author":"Tresch","year":"2019","journal-title":"Plant Phenomics"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1544","DOI":"10.3389\/fpls.2018.01544","article-title":"Aerial Imagery Analysis\u2014Quantifying Appearance and Number of Sorghum Heads for Applications in Breeding and Agronomy","volume":"9","author":"Guo","year":"2018","journal-title":"Front. Plant Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.34133\/2019\/1525874","article-title":"A Weakly Supervised Deep Learning Framework for Sorghum Head Detection and Counting","volume":"2019","author":"Ghosal","year":"2019","journal-title":"Plant Phenomics"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Teng, P., Shimizu, Y., Hosoi, F., and Omasa, K. (2016). Estimating 3D Leaf and Stem Shape of Nursery Paprika Plants by a Novel Multi-Camera Photography System. Sensors, 16.","DOI":"10.3390\/s16060874"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"And\u00fajar, D., Calle, M., Fern\u00e1ndez-Quintanilla, C., Ribeiro, \u00c1., and Dorado, J. (2018). Three-Dimensional Modeling of Weed Plants Using Low-Cost Photogrammetry. Sensors, 18.","DOI":"10.3390\/s18041077"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.compag.2019.04.014","article-title":"Automated Segmentation of Soybean Plants from 3D Point Cloud Using Machine Learning","volume":"162","author":"Zhou","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Martinez-Guanter, J., Ribeiro, \u00c1., Peteinatos, G.G., P\u00e9rez-Ruiz, M., Gerhards, R., Bengochea-Guevara, J.M., Machleb, J., and And\u00fajar, D. (2019). Low-Cost Three-Dimensional Modeling of Crop Plants. Sensors, 19.","DOI":"10.3390\/s19132883"},{"key":"ref_23","unstructured":"(2021, May 14). Pix4D Support Menu Process > Processing Options > 1. Initial Processing > Calibration. Available online: https:\/\/support.pix4d.com\/hc\/en-us\/articles\/205327965-Menu-Process-Processing-Options-1-Initial-Processing-Calibration."},{"key":"ref_24","unstructured":"Agisoft LCC (2021, May 14). Agisoft Metashape User Manual\u2014Professional Edition, Version 1.7. Available online: https:\/\/www.agisoft.com\/metashape-pro_1_7_en."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"9840192","DOI":"10.34133\/2021\/9840192","article-title":"UAS Based Plant Phenotyping for Research and Breeding Applications","volume":"2021","author":"Guo","year":"2021","journal-title":"Plant Phenomics"},{"key":"ref_26","unstructured":"Zhou, Q.-Y., Park, J., and Koltun, V. (2018). Open3D: A Modern Library for 3D Data Processing. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MCSE.2011.37","article-title":"The NumPy Array: A Structure for Efficient Numerical Computation","volume":"13","author":"Colbert","year":"2011","journal-title":"Comput. Sci. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1109\/MCSE.2007.55","article-title":"Matplotlib: A 2D Graphics Environment","volume":"9","author":"Hunter","year":"2007","journal-title":"Comput. Sci. Eng."},{"key":"ref_29","unstructured":"(2020, October 21). Pix4D Support How Are the Internal and External Camera Parameters Defined?. Available online: https:\/\/support.pix4d.com\/hc\/en-us\/articles\/202559089-How-are-the-Internal-and-External-Camera-Parameters-defined."},{"key":"ref_30","unstructured":"(2020, October 21). Pix4D Support Yaw, Pitch, Roll and Omega, Phi, Kappa Angles. Available online: https:\/\/support.pix4d.com\/hc\/en-us\/articles\/202558969-Yaw-Pitch-Roll-and-Omega-Phi-Kappa-angles."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The Pascal Visual Object Classes (VOC) Challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"108231","DOI":"10.1016\/j.agrformet.2020.108231","article-title":"A Field-Based High-Throughput Method for Acquiring Canopy Architecture Using Unmanned Aerial Vehicle Images","volume":"296","author":"Liu","year":"2021","journal-title":"Agric. For. Meteorol."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Xiao, S., Chai, H., Shao, K., Shen, M., Wang, Q., Wang, R., Sui, Y., and Ma, Y. (2020). Image-Based Dynamic Quantification of Aboveground Structure of Sugar Beet in Field. Remote Sens., 12.","DOI":"10.3390\/rs12020269"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41438-019-0151-5","article-title":"Combining Computer Vision and Deep Learning to Enable Ultra-Scale Aerial Phenotyping and Precision Agriculture: A Case Study of Lettuce Production","volume":"6","author":"Bauer","year":"2019","journal-title":"Hortic. Res."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"402","DOI":"10.3389\/fpls.2020.00402","article-title":"A Monitoring System for the Segmentation and Grading of Broccoli Head Based on Deep Learning and Neural Networks","volume":"11","author":"Zhou","year":"2020","journal-title":"Front. Plant Sci."},{"key":"ref_36","first-page":"121","article-title":"A Fast Extraction Method of Broccoli Phenotype Based on Machine Vision and Deep Learning","volume":"2","author":"Zhou","year":"2020","journal-title":"Smart Agric."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1186\/s13007-019-0457-1","article-title":"Automatic Estimation of Heading Date of Paddy Rice Using Deep Learning","volume":"15","author":"Desai","year":"2019","journal-title":"Plant Methods"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Lin, Y.-C., Zhou, T., Wang, T., Crawford, M., and Habib, A. (2021). New Orthophoto Generation Strategies from UAV and Ground Remote Sensing Platforms for High-Throughput Phenotyping. Remote Sens., 13.","DOI":"10.3390\/rs13050860"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"105711","DOI":"10.1016\/j.compag.2020.105711","article-title":"Evaluation of Cotton Emergence Using UAV-Based Imagery and Deep Learning","volume":"177","author":"Feng","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Kai, L., and Li, F.-F. (2009, January 20\u201325). ImageNet: A Large-Scale Hierarchical Image Database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Fleet, D., Pajdla, T., Schiele, B., and Tuytelaars, T. Microsoft COCO: Common Objects in Context. Proceedings of the Computer Vision\u2014ECCV 2014.","DOI":"10.1007\/978-3-319-10590-1"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1","DOI":"10.34133\/2020\/3521852","article-title":"Global Wheat Head Detection (GWHD) Dataset: A Large and Diverse Dataset of High-Resolution RGB-Labelled Images to Develop and Benchmark Wheat Head Detection Methods","volume":"2020","author":"David","year":"2020","journal-title":"Plant Phenomics"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"David, E., Serouart, M., Smith, D., Madec, S., Velumani, K., Liu, S., Wang, X., Espinosa, F.P., Shafiee, S., and Tahir, I.S.A. (2021). Global Wheat Head Dataset 2021: More Diversity to Improve the Benchmarking of Wheat Head Localization Methods. arXiv.","DOI":"10.34133\/2021\/9846158"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Mikolajczyk, A., and Grochowski, M. (2018, January 9\u201312). Data Augmentation for Improving Deep Learning in Image Classification Problem. Proceedings of the 2018 International Interdisciplinary PhD Workshop (IIPhDW), Swinouj\u015bcie, Poland.","DOI":"10.1109\/IIPHDW.2018.8388338"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1007\/s11119-020-09734-2","article-title":"Real-Time Detection of Rice Phenology through Convolutional Neural Network Using Handheld Camera Images","volume":"22","author":"Han","year":"2020","journal-title":"Precis. Agric."},{"key":"ref_46","unstructured":"Perez, L., and Wang, J. (2017). The Effectiveness of Data Augmentation in Image Classification Using Deep Learning. arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Beck, M.A., Liu, C.-Y., Bidinosti, C.P., Henry, C.J., Godee, C.M., and Ajmani, M. (2020). An Embedded System for the Automated Generation of Labeled Plant Images to Enable Machine Learning Applications in Agriculture. PLoS ONE, 15.","DOI":"10.1371\/journal.pone.0243923"},{"key":"ref_48","unstructured":"Perez, F., Lebret, R., and Aberer, K. (2019). Weakly Supervised Active Learning with Cluster Annotation. arXiv."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1186\/s13007-020-00575-8","article-title":"Active Learning with Point Supervision for Cost-Effective Panicle Detection in Cereal Crops","volume":"16","author":"Chandra","year":"2020","journal-title":"Plant Methods"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1038\/s41438-021-00553-8","article-title":"Easy Domain Adaptation Method for Filling the Species Gap in Deep Learning-Based Fruit Detection","volume":"8","author":"Zhang","year":"2021","journal-title":"Hortic. Res."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1079","DOI":"10.1093\/aob\/mcy016","article-title":"Image-Based Dynamic Quantification and High-Accuracy 3D Evaluation of Canopy Structure of Plant Populations","volume":"121","author":"Hui","year":"2018","journal-title":"Ann. Bot."},{"key":"ref_52","first-page":"93","article-title":"Estimation of Paddy Rice Plant Height Using UAV Remote Sensing","volume":"7","author":"Muangprakhon","year":"2021","journal-title":"Eng. Access"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/13\/2622\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:25:43Z","timestamp":1760163943000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/13\/2622"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,3]]},"references-count":52,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["rs13132622"],"URL":"https:\/\/doi.org\/10.3390\/rs13132622","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-138511\/v1","asserted-by":"object"}]},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,3]]}}}