{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T12:35:59Z","timestamp":1740141359230,"version":"3.37.3"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,8,11]],"date-time":"2021-08-11T00:00:00Z","timestamp":1628640000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,8,11]],"date-time":"2021-08-11T00:00:00Z","timestamp":1628640000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Intell Robot Syst"],"published-print":{"date-parts":[[2021,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Data Matrix patterns imprinted as passive visual landmarks have shown to be a valid solution for the self-localization of Automated Guided Vehicles (AGVs) in shop floors. However, existing Data Matrix decoding applications take a long time to detect and segment the markers in the input image. Therefore, this paper proposes a pipeline where the detector is based on a real-time Deep Learning network and the decoder is a conventional method, i.e. the implementation in <jats:italic>libdmtx<\/jats:italic>. To do so, several types of Deep Neural Networks (DNNs) for object detection were studied, trained, compared, and assessed. The architectures range from region proposals (Faster R-CNN) to single-shot methods (SSD and YOLO). This study focused on performance and processing time to select the best Deep Learning (DL) model to carry out the detection of the visual markers. Additionally, a specific data set was created to evaluate those networks. This test set includes demanding situations, such as high illumination gradients in the same scene and Data Matrix markers positioned in skewed planes. The proposed approach outperformed the best known and most used Data Matrix decoder available in libraries like <jats:italic>libdmtx<\/jats:italic>.<\/jats:p>","DOI":"10.1007\/s10846-021-01442-x","type":"journal-article","created":{"date-parts":[[2021,8,11]],"date-time":"2021-08-11T09:03:07Z","timestamp":1628672587000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Comparative Analysis of Deep Neural Networks for the Detection and Decoding of Data Matrix Landmarks in Cluttered Indoor Environments"],"prefix":"10.1007","volume":"103","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9059-6175","authenticated-orcid":false,"given":"Tiago","family":"Almeida","sequence":"first","affiliation":[]},{"given":"Vitor","family":"Santos","sequence":"additional","affiliation":[]},{"given":"Oscar Martinez","family":"Mozos","sequence":"additional","affiliation":[]},{"given":"Bernardo","family":"Louren\u00e7o","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,8,11]]},"reference":[{"key":"1442_CR1","unstructured":"Li, D., Ouyang, B., Wu, D., Wang, Y: Artificial intelligence empowered multi-AGVs in manufacturing systems. arXiv:1909.033731909.03373 (2019)"},{"key":"1442_CR2","doi-asserted-by":"crossref","unstructured":"Shi, Q., Zhang, Y.-L., Li, L., Yang, X., Li, M., Zhou, J.: Safe: Scalable automatic feature engineering framework for industrial tasks (2020)","DOI":"10.1109\/ICDE48307.2020.00146"},{"key":"1442_CR3","doi-asserted-by":"publisher","first-page":"202312","DOI":"10.1109\/ACCESS.2020.3035729","volume":"8","author":"EA Oyekanlu","year":"2020","unstructured":"Oyekanlu, E.A., Smith, A.C., Thomas, W.P., Mulroy, G., Hitesh, D., Ramsey, M., Kuhn, D.J., Mcghinnis, J.D., Buonavita, S.C., Looper, N.A., Ng, M., Ng\u2019oma, A., Liu, W., Mcbride, P.G., Shultz, M.G., Cerasi, C., Sun, D.: A review of recent advances in automated guided vehicle technologies: Integration challenges and research areas for 5g-based smart manufacturing applications. IEEE Access 8, 202312\u2013202353 (2020)","journal-title":"IEEE Access"},{"key":"1442_CR4","doi-asserted-by":"crossref","unstructured":"Bhosekar, A., Isik, T., Eksioglu, S., Gilstrap, K., Allen, R.: Simulation-optimization of automated material handling systems in a healthcare facility. arXiv: Optimization and Control (2020)","DOI":"10.1080\/24725579.2021.1882622"},{"issue":"8","key":"1442_CR5","doi-asserted-by":"publisher","first-page":"719658","DOI":"10.1155\/2015\/719658","volume":"11","author":"W Cui","year":"2015","unstructured":"Cui, W., Wu, C., Zhang, Y., Li, B., Fu, W.: Indoor robot localization based on multidimensional scaling. Int. J. Distrib. Sens. Netw. 11(8), 719658 (2015)","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"1442_CR6","doi-asserted-by":"crossref","unstructured":"Sabattini, L., Digani, V., Secchi, C., Cotena, G., Ronzoni, D., Foppoli, M., Oleari, F.: Technological roadmap to boost the introduction of agvs in industrial applications. In: 2013 IEEE 9th International Conference on Intelligent Computer Communication and Processing (ICCP), pp. 203\u2013208 (2013)","DOI":"10.1109\/ICCP.2013.6646109"},{"key":"1442_CR7","doi-asserted-by":"crossref","unstructured":"Fellan, A., Schellenberger, C., Zimmermann, M., Schotten, H.D.: Enabling communication technologies for automated unmanned vehicles in industry 4.0. In: 2018 International Conference on Information and Communication Technology Convergence (ICTC), pp. 171\u2013176 (2018)","DOI":"10.1109\/ICTC.2018.8539695"},{"key":"1442_CR8","unstructured":"Bergamin, M.: Indoor localization using visual information and passive landmarks. Master Thesis, Universities of Padova and Aveiro. http:\/\/tesi.cab.unipd.it\/50395\/1\/bergamin_marco.pdf (2015)"},{"issue":"2","key":"1442_CR9","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1109\/70.563647","volume":"13","author":"M Betke","year":"1997","unstructured":"Betke, M., Gurvits, L.: Mobile robot localization using landmarks. IEEE Trans. Robot. Autom. 13(2), 251\u2013263 (1997)","journal-title":"IEEE Trans. Robot. Autom."},{"key":"1442_CR10","unstructured":"Okuyama, K., Kawasaki, T., Kroumov, V.: Localization and position correction for mobile robot using artificial visual landmarks. In: The 2011 International Conference on Advanced Mechatronic Systems, pp. 414\u2013418 (2011)"},{"key":"1442_CR11","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhu, S., Wang, Z., Li, Y.: Hybrid visual natural landmark-based localization for indoor mobile robots. Int. J. Adv. Robot. Syst. 15(6) (2018)","DOI":"10.1177\/1729881418810143"},{"key":"1442_CR12","doi-asserted-by":"crossref","unstructured":"Almeida, T., Santos, V., Louren\u00e7o, B., Fonseca, P.: Detection of data matrix encoded landmarks in unstructured environments using deep learning. In: 2020 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), pp. 74\u201380 (2020)","DOI":"10.1109\/ICARSC49921.2020.9096211"},{"key":"1442_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.proeng.2014.12.091","volume":"96","author":"A Babinec","year":"2014","unstructured":"Babinec, A., Juri\u0161ica, L., Hubinsk\u00fd, P., Ducho\u0148, F.: Visual localization of mobile robot using artificial markers. Procedia Eng. 96, 1\u20139 (2014). Modelling of Mechanical and Mechatronic Systems","journal-title":"Procedia Eng."},{"issue":"2","key":"1442_CR14","doi-asserted-by":"publisher","first-page":"9528","DOI":"10.3182\/20080706-5-KR-1001.01611","volume":"41","author":"A Mutka","year":"2008","unstructured":"Mutka, A., Miklic, D., Draganjac, I., Bogdan, S.: A low cost vision based localization system using fiducial markers. IFAC Proc. Vol. 41(2), 9528\u20139533 (2008). 17th IFAC World Congress","journal-title":"IFAC Proc. Vol."},{"key":"1442_CR15","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.imavis.2018.05.004","volume":"76","author":"FJ Romero-Ramirez","year":"2018","unstructured":"Romero-Ramirez, F.J., Mu\u00f1oz-Salinas, R., Medina-Carnicer, R.: Speeded up detection of squared fiducial markers. Image Vis. Comput. 76, 38\u201347 (2018)","journal-title":"Image Vis. Comput."},{"key":"1442_CR16","doi-asserted-by":"crossref","unstructured":"Mantha, B., Garcia de Soto, B.: Designing a reliable fiducial marker network for autonomous indoor robot navigation. In: Al-Hussein, M. (ed.) Proceedings of the 36th International Symposium on Automation and Robotics in Construction (ISARC), pp 74\u201381. International Association for Automation and Robotics in Construction (IAARC), Banff (2019)","DOI":"10.22260\/ISARC2019\/0011"},{"key":"1442_CR17","doi-asserted-by":"crossref","unstructured":"Annusewicz, A., Zwierzchowski, J.: Marker detection algorithm for the navigation of a mobile robot. In: 2020 27th International Conference on Mixed Design of Integrated Circuits and System (MIXDES), pp 223\u2013226 (2020)","DOI":"10.23919\/MIXDES49814.2020.9155658"},{"issue":"1","key":"1442_CR18","doi-asserted-by":"publisher","first-page":"172988141769348","DOI":"10.1177\/1729881417693489","volume":"14","author":"X Zhong","year":"2017","unstructured":"Zhong, X., Zhou, Y., Liu, H.: Design and recognition of artificial landmarks for reliable indoor self-localization of mobile robots. Int. J. Adv. Robot. Syst. 14(1), 1729881417693489 (2017)","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"1442_CR19","doi-asserted-by":"crossref","unstructured":"Karrach, L., Pivar\u010diov\u00e1, E.: The analyse of the various methods for location of data matrix codes in images. In: 2018 ELEKTRO, pp 1\u20136 (2018)","DOI":"10.1109\/ELEKTRO.2018.8398250"},{"key":"1442_CR20","doi-asserted-by":"crossref","unstructured":"Dai, Y., Liu, L., Song, W., Du, C., Zhao, X.: The realization of identification method for datamatrix code. In: 2017 International Conference on Progress in Informatics and Computing (PIC), pp 410\u2013414 (2017)","DOI":"10.1109\/PIC.2017.8359582"},{"key":"1442_CR21","doi-asserted-by":"crossref","unstructured":"Hansen, D.K., Nasrollahi, K., Rasmusen, C.B., Moeslund, T.B.: Real-time barcode detection and classification using deep learning. In: Proceedings of the 9th International Joint Conference on Computational Intelligence - Volume 1: IJCCI, pp 321\u2013327. SciTePress (2017)","DOI":"10.5220\/0006508203210327"},{"key":"1442_CR22","doi-asserted-by":"publisher","first-page":"128837","DOI":"10.1109\/ACCESS.2019.2939201","volume":"7","author":"L Jiao","year":"2019","unstructured":"Jiao, L., Zhang, F., Liu, F., Yang, S., Li, L., Feng, Z., Qu, R.: A survey of deep learning-based object detection. IEEE Access 7, 128837\u2013128868 (2019)","journal-title":"IEEE Access"},{"key":"1442_CR23","doi-asserted-by":"crossref","unstructured":"Zhang, H., Shi, G., Liu, L., Zhao, M., Liang, Z.: Detection and identification method of medical label barcode based on deep learning. In: 2018 Eighth International Conference on Image Processing Theory, Tools and Applications (IPTA), pp 1\u20136 (2018)","DOI":"10.1109\/IPTA.2018.8608144"},{"issue":"8","key":"1442_CR24","doi-asserted-by":"publisher","first-page":"413","DOI":"10.2352\/ISSN.2470-1173.2019.8.IMAWM-413","volume":"2019","author":"Q Yang","year":"2019","unstructured":"Yang, Q., Golwala, G., Sundaram, S., Lee, P., Allebach, J.: Barcode detection and decoding in on-line fashion images. Electron. Imaging 2019(8), 413\u20131\u2013413\u20137 (2019)","journal-title":"Electron. Imaging"},{"key":"1442_CR25","doi-asserted-by":"crossref","unstructured":"Zharkov, A., Zagaynov, I.: Universal barcode detector via semantic segmentation. CoRR arXiv:1906.06281 (2019)","DOI":"10.1109\/ICDAR.2019.00139"},{"key":"1442_CR26","unstructured":"Ren, S., He, K., Girshick, R.B., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. CoRR arXiv:1506.01497 (2015)"},{"key":"1442_CR27","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S.E., Fu, C.-Y., Berg, A.C.: SSD: single shot multibox detector. CoRR arXiv:1512.02325 (2015)","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"1442_CR28","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S.K., Girshick, R.B., Farhadi, A.: You only look once: Unified, real-time object detection. CoRR arXiv:1506.02640 (2015)","DOI":"10.1109\/CVPR.2016.91"},{"key":"1442_CR29","unstructured":"Bochkovskiy, A., Wang, C-Y, Liao, H-: Yolov4: Optimal speed and accuracy of object detection. arXiv:2004.10934 (2020)"},{"key":"1442_CR30","doi-asserted-by":"crossref","unstructured":"Benali Amjoud, A., Amrouch, M.: Convolutional neural networks backbones for object detection. In: El Moataz, A., Mammass, D., Mansouri, A., Nouboud, F. (eds.) Image and Signal Processing, pp 282\u2013289. Springer International Publishing, Cham (2020)","DOI":"10.1007\/978-3-030-51935-3_30"},{"key":"1442_CR31","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Doll\u00e1r, P., Girshick, R.B., He, K., Hariharan, B., Belongie, S J: Feature pyramid networks for object detection. CoRR arXiv:1612.03144 (2016)","DOI":"10.1109\/CVPR.2017.106"},{"key":"1442_CR32","unstructured":"Cao, G., Xie, X., Yang, W., Liao, Q., Shi, G., Wu, J.: Feature-fused SSD: fast detection for small objects. CoRR arXiv:1709.05054 (2017)"},{"key":"1442_CR33","doi-asserted-by":"crossref","unstructured":"Huang, Z., Wang, J.: DC-SPP-YOLO: dense connection and spatial pyramid pooling based YOLO for object detection. CoRR arXiv:1903.08589 (2019)","DOI":"10.1016\/j.ins.2020.02.067"},{"key":"1442_CR34","doi-asserted-by":"crossref","unstructured":"Lin, T-Y, Goyal, P., Girshick, R B, He, K., Doll\u00e1r, P.: Focal loss for dense object detection. CoRR arXiv:1708.02002 (2017)","DOI":"10.1109\/ICCV.2017.324"},{"key":"1442_CR35","unstructured":"Chen, Y., Yang, T., Zhang, X., Meng, G., Xiao, X., Sun, J.: Detnas: Backbone search for object detection. In: Wallach, H., Larochelle, H., Beygelzimer, A., d\u2019Alch\u00e9-Buc, F., Fox, E., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 32, pp 6642\u20136652. Curran Associates, Inc. (2019)"},{"key":"1442_CR36","unstructured":"Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556 (2014)"},{"key":"1442_CR37","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. CoRR arXiv:1512.03385 (2015)","DOI":"10.1109\/CVPR.2016.90"},{"key":"1442_CR38","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Weinberger, K.Q.: Densely connected convolutional networks. CoRR arXiv:1608.06993 (2016)","DOI":"10.1109\/CVPR.2017.243"},{"key":"1442_CR39","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., Adam, H.: Mobilenets: Efficient convolutional neural networks for mobile vision applications. CoRR arXiv:1704.04861 (2017)"},{"key":"1442_CR40","unstructured":"Iandola, F.N., Moskewicz, M.W., Ashraf, K., Han, S., Dally, W.J., Keutzer, K.: Squeezenet: Alexnet-level accuracy with 50x fewer parameters and <\u20091mb model size. CoRR arXiv:1602.07360(2016)"},{"key":"1442_CR41","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhou, X., Lin, M., Sun, J.: Shufflenet: An extremely efficient convolutional neural network for mobile devices. CoRR arXiv:1707.01083 (2017)","DOI":"10.1109\/CVPR.2018.00716"},{"key":"1442_CR42","unstructured":"Redmon, J., Farhadi, A.: Yolov3: An incremental improvement. arXiv:1804.02767 (2018)"},{"key":"1442_CR43","doi-asserted-by":"crossref","unstructured":"Girshick, R.B.: Fast R-CNN. CoRR arXiv:1504.08083 (2015)","DOI":"10.1109\/ICCV.2015.169"},{"key":"1442_CR44","doi-asserted-by":"crossref","unstructured":"Wang, C.-Y., Liao, H.-Y.M., Yeh, I.-H., Wu, Y.-H., Chen, P.-Y., Hsieh, J.-W.: Cspnet: A new backbone that can enhance learning capability of cnn. arXiv:1911.11929 (2019)","DOI":"10.1109\/CVPRW50498.2020.00203"},{"key":"1442_CR45","doi-asserted-by":"crossref","unstructured":"Liu, S., Qi, L., Qin, H., Shi, J., Jia, J.: Path aggregation network for instance segmentation. CoRR arXiv:1803.01534 (2018)","DOI":"10.1109\/CVPR.2018.00913"},{"key":"1442_CR46","doi-asserted-by":"crossref","unstructured":"Tan, M., Pang, R., Le, Q.: Efficientdet: Scalable and efficient object detection. arXiv:1911.09070 (2019)","DOI":"10.1109\/CVPR42600.2020.01079"},{"key":"1442_CR47","doi-asserted-by":"crossref","unstructured":"Zhou, X., Zhuo, J., Kr\u00e4henb\u00fchl, P.: Bottom-up object detection by grouping extreme and center points. CoRR arXiv:1901.08043 (2019)","DOI":"10.1109\/CVPR.2019.00094"}],"container-title":["Journal of Intelligent &amp; Robotic Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-021-01442-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10846-021-01442-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-021-01442-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,13]],"date-time":"2021-09-13T13:34:39Z","timestamp":1631540079000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10846-021-01442-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,11]]},"references-count":47,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["1442"],"URL":"https:\/\/doi.org\/10.1007\/s10846-021-01442-x","relation":{},"ISSN":["0921-0296","1573-0409"],"issn-type":[{"type":"print","value":"0921-0296"},{"type":"electronic","value":"1573-0409"}],"subject":[],"published":{"date-parts":[[2021,8,11]]},"assertion":[{"value":"20 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 June 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 August 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Competing Interests"}}],"article-number":"13"}}