{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T18:49:15Z","timestamp":1772909355544,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T00:00:00Z","timestamp":1684800000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Romanian Government","award":["27PFE\/2021"],"award-info":[{"award-number":["27PFE\/2021"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Object detection is an essential component of autonomous mobile robotic systems, enabling robots to understand and interact with the environment. Object detection and recognition have made significant progress using convolutional neural networks (CNNs). Widely used in autonomous mobile robot applications, CNNs can quickly identify complicated image patterns, such as objects in a logistic environment. Integration of environment perception algorithms and motion control algorithms is a topic subjected to significant research. On the one hand, this paper presents an object detector to better understand the robot environment and the newly acquired dataset. The model was optimized to run on the mobile platform already on the robot. On the other hand, the paper introduces a model-based predictive controller to guide an omnidirectional robot to a particular position in a logistic environment based on an object map obtained from a custom-trained CNN detector and LIDAR data. Object detection contributes to a safe, optimal, and efficient path for the omnidirectional mobile robot. In a practical scenario, we deploy a custom-trained and optimized CNN model to detect specific objects in the warehouse environment. Then we evaluate, through simulation, a predictive control approach based on the detected objects using CNNs. Results are obtained in object detection using a custom-trained CNN with an in-house acquired data set on a mobile platform and in the optimal control for the omnidirectional mobile robot.<\/jats:p>","DOI":"10.3390\/s23114992","type":"journal-article","created":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T07:00:02Z","timestamp":1684825202000},"page":"4992","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Model-Predictive Control for Omnidirectional Mobile Robots in Logistic Environments Based on Object Detection Using CNNs"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1221-0761","authenticated-orcid":false,"given":"Stefan-Daniel","family":"Achirei","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, \u201cGheorghe Asachi\u201d Technical University of Iasi, 700050 Iasi, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7483-0793","authenticated-orcid":false,"given":"Razvan","family":"Mocanu","sequence":"additional","affiliation":[{"name":"Department of Automatic Control and Applied Informatics, \u201cGheorghe Asachi\u201d Technical University of Iasi, 700050 Iasi, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7127-8841","authenticated-orcid":false,"given":"Alexandru-Tudor","family":"Popovici","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, \u201cGheorghe Asachi\u201d Technical University of Iasi, 700050 Iasi, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6095-3944","authenticated-orcid":false,"given":"Constantin-Catalin","family":"Dosoftei","sequence":"additional","affiliation":[{"name":"Department of Automatic Control and Applied Informatics, \u201cGheorghe Asachi\u201d Technical University of Iasi, 700050 Iasi, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Dosoftei, C.C., Popovici, A.T., Sacaleanu, P.R., Gherghel, P.M., and Budaciu, C. (2021). Hardware in the Loop Topology for an Omnidirectional Mobile Robot Using Matlab in a Robot Operating System Environment. Symmetry, 13.","DOI":"10.3390\/sym13060969"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1729881419839596","DOI":"10.1177\/1729881419839596","article-title":"A review of mobile robots: Concepts, methods, theoretical framework, and applications","volume":"16","author":"Rubio","year":"2019","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1016\/j.dt.2019.04.011","article-title":"A review: On path planning strategies for navigation of mobile robot","volume":"15","author":"Patle","year":"2019","journal-title":"Def. Technol."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ngwenya, T., Ayomoh, M., and Yadavalli, S. (2022). Virtual Obstacles for Sensors Incapacitation in Robot Navigation: A Systematic Review of 2D Path Planning. Sensors, 22.","DOI":"10.3390\/s22186943"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.ins.2022.01.058","article-title":"Hybrid offline and online task planning for service robot using object-level semantic map and probabilistic inference","volume":"593","author":"Wang","year":"2022","journal-title":"Inf. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"T\u0103tar, M.O., Popovici, C., M\u00e2ndru, D., Ardelean, I., and Ple\u015fa, A. (2014, January 22\u201324). Design and development of an autonomous omni-directional mobile robot with Mecanum wheels. Proceedings of the 2014 IEEE International Conference on Automation, Quality and Testing, Robotics, Cluj-Napoca, Romania.","DOI":"10.1109\/AQTR.2014.6857869"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Sheikhlar, A., and Fakharian, A. (2016, January 27\u201328). Adaptive optimal control via reinforcement learning for omni-directional wheeled robots. Proceedings of the 2016 4th International Conference on Control, Instrumentation, and Automation (ICCIA), Qazvin, Iran.","DOI":"10.1109\/ICCIAutom.2016.7483162"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Popovici, A.T., Dosoftei, C.C., and Budaciu, C. (2022). Kinematics Calibration and Validation Approach Using Indoor Positioning System for an Omnidirectional Mobile Robot. Sensors, 22.","DOI":"10.3390\/s22228590"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1016\/j.procir.2016.10.068","article-title":"Mechanical design and control system of an omni-directional mobile robot for material conveying","volume":"56","author":"Peng","year":"2016","journal-title":"Procedia CIRP"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Lu, X., Zhang, X., Zhang, G., and Jia, S. (2018, January 25\u201327). Design of adaptive sliding mode controller for four-Mecanum wheel mobile robot. Proceedings of the 2018 37th Chinese Control Conference (CCC), Wuhan, China.","DOI":"10.23919\/ChiCC.2018.8483388"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"107128","DOI":"10.1016\/j.ymssp.2020.107128","article-title":"Path-following control of Mecanum-wheels omnidirectional mobile robots using nonsingular terminal sliding mode","volume":"147","author":"Sun","year":"2021","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/j.isatra.2018.10.043","article-title":"Neural network adaptive sliding mode control for omnidirectional vehicle with uncertainties","volume":"86","author":"Lu","year":"2019","journal-title":"ISA Trans."},{"key":"ref_13","unstructured":"Zimmermann, K., Zeidis, I., and Abdelrahman, M. (2014). Applied Non-Linear Dynamical Systems, Springer."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"10250","DOI":"10.1016\/j.ifacol.2017.08.1286","article-title":"Trajectory tracking of omni-directional mobile robots via predictive control plus a filtered smith predictor","volume":"50","author":"Santos","year":"2017","journal-title":"IFAC-PapersOnLine"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Concei\u00e7\u00e3o, A.S., Oliveira, H.P., e Silva, A.S., Oliveira, D., and Moreira, A.P. (2007, January 4\u20137). A nonlinear model predictive control of an omni-directional mobile robot. Proceedings of the 2007 IEEE International Symposium on Industrial Electronics, Vigo, Spain.","DOI":"10.1109\/ISIE.2007.4374943"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1007\/s10846-019-01083-1","article-title":"A robust model predictive control strategy for trajectory tracking of omni-directional mobile robots","volume":"98","author":"Wang","year":"2020","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1109\/CJECE.2014.2328973","article-title":"Nonlinear model predictive control for omnidirectional robot motion planning and tracking with avoidance of moving obstacles","volume":"37","author":"Teatro","year":"2014","journal-title":"Can. J. Electr. Comput. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wang, C., Liu, X., Yang, X., Hu, F., Jiang, A., and Yang, C. (2018). Trajectory tracking of an omni-directional wheeled mobile robot using a model predictive control strategy. Appl. Sci., 8.","DOI":"10.3390\/app8020231"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"103993","DOI":"10.1016\/j.robot.2021.103993","article-title":"Cooperative distributed nonlinear model predictive control of a formation of differentially-driven mobile robots","volume":"150","author":"Rosenfelder","year":"2022","journal-title":"Robot. Auton. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhang, H., Wang, S., Xie, Y., Wu, H., Xiong, T., and Li, H. (2022, January 16\u201319). Nonlinear Model Predictive Control of an Omnidirectional Mobile Robot with Self-tuned Prediction Horizon. Proceedings of the 2022 IEEE 17th Conference on Industrial Electronics and Applications (ICIEA), Chengdu, China.","DOI":"10.1109\/ICIEA54703.2022.10006295"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1177\/01423312211021321","article-title":"Adaptive model predictive control for an omnidirectional mobile robot with friction compensation and incremental input constraints","volume":"44","author":"Ren","year":"2022","journal-title":"Trans. Inst. Meas. Control"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2597","DOI":"10.1109\/TRO.2022.3152705","article-title":"A nonlinear model predictive control for the position tracking of cable-driven parallel robots","volume":"38","author":"Santos","year":"2022","journal-title":"IEEE Trans. Robot."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1007\/s10846-013-9855-1","article-title":"Minimum-energy trajectory generation for cornering with a fixed heading for three-wheeled omni-directional mobile robots","volume":"75","author":"Kim","year":"2014","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1109\/70.880813","article-title":"New potential functions for mobile robot path planning","volume":"16","author":"Ge","year":"2000","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1109\/TMECH.2016.2606642","article-title":"Human cooperative wheelchair with brain\u2013machine interaction based on shared control strategy","volume":"22","author":"Li","year":"2016","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"R\u00f6smann, C., Hoffmann, F., and Bertram, T. (2015, January 15\u201317). Timed-elastic-bands for time-optimal point-to-point nonlinear model predictive control. Proceedings of the 2015 European Control Conference (ECC), Linz, Austria.","DOI":"10.1109\/ECC.2015.7331052"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.robot.2016.11.007","article-title":"Integrated online trajectory planning and optimization in distinctive topologies","volume":"88","author":"Hoffmann","year":"2017","journal-title":"Robot. Auton. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Smith, J.S., Xu, R., and Vela, P. (August, January 31). egoteb: Egocentric, perception space navigation using timed-elastic-bands. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.","DOI":"10.1109\/ICRA40945.2020.9196721"},{"key":"ref_29","unstructured":"Glenn, J., Alex, S., and Jirka, B. (2020). YOLOv5, Zenodo."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18\u201322). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_31","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Liu, S., and Deng, W. (2015, January 3\u20136). Very deep convolutional neural network based image classification using small training sample size. Proceedings of the 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), Kuala Lumpur, Malaysia.","DOI":"10.1109\/ACPR.2015.7486599"},{"key":"ref_33","unstructured":"Bochkovskiy, A., Wang, C., and Liao, H.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv."},{"key":"ref_34","unstructured":"Wallach, H., Larochelle, H., Beygelzimer, A., d\u2019Alch\u00e9-Buc, F., Fox, E., and Garnett, R. (2019). Proceedings of the Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S.E., Fu, C., and Berg, A.C. (2015). SSD: Single Shot MultiBox Detector. arXiv.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Lin, T., Maire, M., Belongie, S.J., Bourdev, L.D., Girshick, R.B., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014). Microsoft COCO: Common Objects in Context. arXiv.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (2016). The Cityscapes Dataset for Semantic Urban Scene Understanding. arXiv.","DOI":"10.1109\/CVPR.2016.350"},{"key":"ref_39","unstructured":"Cordts, M., Omran, M., Ramos, S., Scharw\u00e4chter, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (2015, January 11). The Cityscapes Dataset. Proceedings of the CVPR Workshop on the Future of Datasets in Vision, Boston, MA, USA."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Seo, J., Chae, S., Shim, J., Kim, D., Cheong, C., and Han, T.D. (2016). Fast contour-tracing algorithm based on a pixel-following method for image sensors. Sensors, 16.","DOI":"10.3390\/s16030353"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/11\/4992\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:40:08Z","timestamp":1760125208000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/11\/4992"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,23]]},"references-count":40,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["s23114992"],"URL":"https:\/\/doi.org\/10.3390\/s23114992","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,23]]}}}