{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T19:12:48Z","timestamp":1774379568908,"version":"3.50.1"},"reference-count":34,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,1,13]],"date-time":"2022-01-13T00:00:00Z","timestamp":1642032000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Despite the great possibilities of modern neural network architectures concerning the problems of object detection and recognition, the output of such models is the local (pixel) coordinates of objects bounding boxes in the image and their predicted classes. However, in several practical tasks, it is necessary to obtain more complete information about the object from the image. In particular, for robotic apple picking, it is necessary to clearly understand where and how much to move the grabber. To determine the real position of the apple relative to the source of image registration, it is proposed to use the Intel Real Sense depth camera and aggregate information from its depth and brightness channels. The apples detection is carried out using the YOLOv3 architecture; then, based on the distance to the object and its localization in the image, the relative distances are calculated for all coordinates. In this case, to determine the coordinates of apples, a transition to a symmetric coordinate system takes place by means of simple linear transformations. Estimating the position in a symmetric coordinate system allows estimating not only the magnitude of the shift but also the location of the object relative to the camera. The proposed approach makes it possible to obtain position estimates with high accuracy. The approximate root mean square error is 7\u201312 mm, depending on the range and axis. As for precision and recall metrics, the first is 100% and the second is 90%.<\/jats:p>","DOI":"10.3390\/sym14010148","type":"journal-article","created":{"date-parts":[[2022,1,14]],"date-time":"2022-01-14T03:14:56Z","timestamp":1642130096000},"page":"148","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":75,"title":["Intelligent System for Estimation of the Spatial Position of Apples Based on YOLOv3 and Real Sense Depth Camera D415"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0735-7697","authenticated-orcid":false,"given":"Nikita","family":"Andriyanov","sequence":"first","affiliation":[{"name":"Department of Data Analysis and Machine Learning, Financial University under the Government of the Russian Federation, 125167 Moscow, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3809-8624","authenticated-orcid":false,"given":"Ilshat","family":"Khasanshin","sequence":"additional","affiliation":[{"name":"Laboratory of Robotics, Internet of Things and Embedded Systems, Financial University under the Government of the Russian Federation, 125167 Moscow, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniil","family":"Utkin","sequence":"additional","affiliation":[{"name":"Laboratory of Robotics, Internet of Things and Embedded Systems, Financial University under the Government of the Russian Federation, 125167 Moscow, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9597-2894","authenticated-orcid":false,"given":"Timur","family":"Gataullin","sequence":"additional","affiliation":[{"name":"Department of Mathematical Methods in Economics and Management, State University of Management, 109542 Moscow, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5080-8695","authenticated-orcid":false,"given":"Stefan","family":"Ignar","sequence":"additional","affiliation":[{"name":"Institute of Environmental Sciences, Warsaw University of Life Sciences, 02-787 Warsaw, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6178-226X","authenticated-orcid":false,"given":"Vyacheslav","family":"Shumaev","sequence":"additional","affiliation":[{"name":"Department of Data Analysis and Machine Learning, Financial University under the Government of the Russian Federation, 125167 Moscow, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0338-1227","authenticated-orcid":false,"given":"Vladimir","family":"Soloviev","sequence":"additional","affiliation":[{"name":"Department of Data Analysis and Machine Learning, Financial University under the Government of the Russian Federation, 125167 Moscow, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Cho, W., Kim, S., Na, M., and Na, I. (2021). Forecasting of Tomato Yields Using Attention-Based LSTM Network and ARMA Model. Electronics, 10.","DOI":"10.3390\/electronics10131576"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"L\u00f3pez-Morales, J.A., Mart\u00ednez, J.A., and Skarmeta, A.F. (2020). Digital Transformation of Agriculture through the Use of an Interoperable Platform. Sensors, 20.","DOI":"10.3390\/s20041153"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Rolandi, S., Brunori, G., Bacco, M., and Scotti, I. (2021). The Digitalization of Agriculture and Rural Areas: Towards a Taxonomy of the Impacts. Sustainability, 13.","DOI":"10.3390\/su13095172"},{"key":"ref_4","unstructured":"United Nations (2021, December 01). Global Issues. Available online: https:\/\/www.un.org\/en\/global-issues\/population."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bahn, R.A., Yehya, A.A.K., and Zurayk, R. (2021). Digitalization for Sustainable Agri-Food Systems: Potential, Status, and Risks for the MENA Region. Sustainability, 13.","DOI":"10.3390\/su13063223"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Krakhmalev, O., Krakhmalev, N., Gataullin, S., Makarenko, I., Nikitin, P., Serdechnyy, D., Liang, K., and Korchagin, S. (2021). Mathematics Model for 6-DOF Joints Manipulation Robots. Mathematics, 9.","DOI":"10.3390\/math9212828"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Krakhmalev, O., Korchagin, S., Pleshakova, E., Nikitin, P., Tsibizova, O., Sycheva, I., Liang, K., Serdechnyy, D., Gataullin, S., and Krakhmalev, N. (2021). Parallel Computational Algorithm for Object-Oriented Modeling of Manipulation Robots. Mathematics, 9.","DOI":"10.3390\/math9222886"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Korchagin, S.A., Gataullin, S.T., Osipov, A.V., Smirnov, M.V., Suvorov, S.V., Serdechnyi, D.V., and Bublikov, K.V. (2021). Development of an Optimal Algorithm for Detecting Damaged and Diseased Potato Tubers Moving along a Conveyor Belt Using Computer Vision Systems. Agronomy, 11.","DOI":"10.3390\/agronomy11101980"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Rutkowski, L., Scherer, R., Korytkowski, M., Pedrycz, W., Tadeusiewicz, R., and Zurada, J.M. (2021). Applying Machine Learning Techniques to Identify Damaged Potatoes. Artificial Intelligence and Soft Computing, Proceedings of the 20th International Conference on Artificial Intelligence and Soft Computing, Online, 21\u201323 June 2021, Springer.","DOI":"10.1007\/978-3-030-87986-0"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"139","DOI":"10.18287\/2412-6179-CO-922","article-title":"Detection of objects in the images: From likelihood relationships towards scalable and efficient neural networks","volume":"46","author":"Andriyanov","year":"2022","journal-title":"Comput. Opt."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"399","DOI":"10.18287\/2412-6179-CO-848","article-title":"Multispectral optoelectronic device for controlling an autonomous mobile platform","volume":"45","author":"Titov","year":"2021","journal-title":"Comput. Opt."},{"key":"ref_12","unstructured":"(2021, December 01). Intel RealSense Depth Camera D415. Available online: https:\/\/www.intelrealsense.com\/depth-camera-d415."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_14","first-page":"1106","article-title":"ImageNet classification with deep convolutional neural networks","volume":"Volume 1","author":"Pereira","year":"2012","journal-title":"NIPS\u201912, Proceedings of 25th Conference on Neural Information Processing Systems (NeurIPS), Lake Tahoe, NV, USA, 3\u20136 December 2012"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast R-CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Leibe, B., Matas, J., Sebe, N., and Welling, M. (2016). SSD: Single Shot MultiBox Detector. Computer Vision\u2014ECCV 2016, Proceedings of the 14th European Conference on Computer Vision, Amsterdam, The Netherlands, 11\u201314 October 2016, Springer.","DOI":"10.1007\/978-3-319-46448-0"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal Loss for Dense Object Detection. Proceedings of the 2017 IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_20","unstructured":"Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv, Available online: https:\/\/arxiv.org\/abs\/1804.02767."},{"key":"ref_21","unstructured":"GitHub (2021, December 01). DarkNet-53. Available online: https:\/\/github.com\/pjreddie\/darknet."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1007\/978-981-16-2765-1_21","article-title":"Tracking of Objects in Video Sequences","volume":"238","author":"Andriyanov","year":"2021","journal-title":"Smart Innov. Syst. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kuznetsova, A., Maleva, T., and Soloviev, V. (2020). Using YOLOv3 Algorithm with Pre- and Post-Processing for Apple Detection in Fruit-Harvesting Robot. Agronomy, 10.","DOI":"10.3390\/agronomy10071016"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yan, B., Fan, P., Lei, X., Liu, Z., and Yang, F. (2021). A Real-Time Apple Targets Detection Method for Picking Robot Based on Improved YOLOv5. Remote Sens., 13.","DOI":"10.3390\/rs13091619"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"9","DOI":"10.52810\/TIOT.2021.100028","article-title":"Immature Apple Detection Method Based on Improved Yolov3","volume":"1","author":"Huang","year":"2021","journal-title":"ASP Trans. Internet Things"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"012018","DOI":"10.1088\/1742-6596\/1661\/1\/012018","article-title":"The using of data augmentation in machine learning in image processing tasks in the face of data scarcity","volume":"1661","author":"Andriyanov","year":"2020","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"216772","DOI":"10.1109\/ACCESS.2020.3040423","article-title":"Apple Detection in Natural Environment Using Deep Learning Algorithms","volume":"8","author":"Xuan","year":"2020","journal-title":"IEEE Access"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1688","DOI":"10.1364\/OSAC.424583","article-title":"Automatic pear and apple detection by videos using deep learning and a Kalman filter","volume":"4","author":"Itakura","year":"2021","journal-title":"OSA Contin."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"252","DOI":"10.3390\/automation2040016","article-title":"Colored 3D Path Extraction Based on Depth-RGB Sensor for Welding Robot Trajectory Generation","volume":"2","author":"Cabello","year":"2021","journal-title":"Automation"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Servi, M., Mussi, E., Profili, A., Furferi, R., Volpe, Y., Governi, L., and Buonamici, F. (2021). Metrological Characterization and Comparison of D415, D455, L515 RealSense Devices in the Close Range. Sensors, 21.","DOI":"10.3390\/s21227770"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Maru, M.B., Lee, D., Tola, K.D., and Park, S. (2021). Comparison of Depth Camera and Terrestrial Laser Scanner in Monitoring Structural Deflections. Sensors, 21.","DOI":"10.3390\/s21010201"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1270","DOI":"10.1109\/TIM.2006.876521","article-title":"Robust object pose estimation from feature-based stereo","volume":"55","author":"Laganiere","year":"2006","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Andriyanov, N.A. (2020, January 1\u20133). Analysis of the Acceleration of Neural Networks Inference on Intel Processors Based on OpenVINO Toolkit. Proceedings of the 2020 Systems of Signal Synchronization, Generating and Processing in Telecommunications, Svetlogorsk, Russia.","DOI":"10.1109\/SYNCHROINFO49631.2020.9166067"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Shirokanev, A., Ilyasova, N., Andriyanov, N., Zamytskiy, E., Zolotarev, A., and Kirsh, D. (2021). Modeling of Fundus Laser Exposure for Estimating Safe Laser Coagulation Parameters in the Treatment of Diabetic Retinopathy. Mathematics, 9.","DOI":"10.3390\/math9090967"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/1\/148\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:02:13Z","timestamp":1760364133000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/1\/148"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,13]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["sym14010148"],"URL":"https:\/\/doi.org\/10.3390\/sym14010148","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,13]]}}}