{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T14:09:25Z","timestamp":1766066965957,"version":"build-2065373602"},"reference-count":48,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2019,3,7]],"date-time":"2019-03-07T00:00:00Z","timestamp":1551916800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41571436"],"award-info":[{"award-number":["41571436"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the National Key Research and Development Program of China","award":["2017YFB1302400"],"award-info":[{"award-number":["2017YFB1302400"]}]},{"name":"the Hubei Province Science and Technology Support Program, China","award":["2015BAA027"],"award-info":[{"award-number":["2015BAA027"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>License plate detection (LPD) is the first and key step in license plate recognition. State-of-the-art object-detection algorithms based on deep learning provide a promising form of LPD. However, there still exist two main challenges. First, existing methods often enclose objects with horizontal rectangles. However, horizontal rectangles are not always suitable since license plates in images are multi-oriented, reflected by rotation and perspective distortion. Second, the scale of license plates often varies, leading to the difficulty of multi-scale detection. To address the aforementioned problems, we propose a novel method of multi-oriented and scale-invariant license plate detection (MOSI-LPD) based on convolutional neural networks. Our MOSI-LPD tightly encloses the multi-oriented license plates with bounding parallelograms, regardless of the license plate scales. To obtain bounding parallelograms, we first parameterize the edge points of license plates by relative positions. Next, we design mapping functions between oriented regions and horizontal proposals. Then, we enforce the symmetry constraints in the loss function and train the model with a multi-task loss. Finally, we map region proposals to three edge points of a nearby license plate, and infer the fourth point to form bounding parallelograms. To achieve scale invariance, we first design anchor boxes based on inherent shapes of license plates. Next, we search different layers to generate region proposals with multiple scales. Finally, we up-sample the last layer and combine proposal features extracted from different layers to recognize true license plates. Experimental results have demonstrated that the proposed method outperforms existing approaches in terms of detecting license plates with different orientations and multiple scales.<\/jats:p>","DOI":"10.3390\/s19051175","type":"journal-article","created":{"date-parts":[[2019,3,8]],"date-time":"2019-03-08T04:58:35Z","timestamp":1552021115000},"page":"1175","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["Multi-Oriented and Scale-Invariant License Plate Detection Based on Convolutional Neural Networks"],"prefix":"10.3390","volume":"19","author":[{"given":"Jing","family":"Han","sequence":"first","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430070, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jian","family":"Yao","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430070, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiao","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430070, China"},{"name":"School of Sociology, Wuhan University, Wuhan 430070, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingmin","family":"Tu","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430070, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4398-8867","authenticated-orcid":false,"given":"Yahui","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430070, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,3,7]]},"reference":[{"key":"ref_1","unstructured":"Bai, H., and Liu, C. (2004, January 23\u201326). A hybrid license plate extraction method based on edge statistics and morphology. Proceedings of the International Conference on Pattern Recognition, Cambridge, UK."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Nguyen, C.D., Ardabilian, M., and Chen, L. (2009, January 2\u20134). Robust Car License Plate Localization Using a Novel Texture Descriptor. Proceedings of the IEEE International Conference on Advanced Video and Signal Based Surveillance, Genova, Italy.","DOI":"10.1109\/AVSS.2009.22"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1109\/TITS.2013.2283302","article-title":"Rear-view vehicle detection and tracking by combining multiple parts for complex urban surveillance","volume":"15","author":"Tian","year":"2014","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Patra, S., Veelaert, P., Calafate, C.T., Cano, J., Zamora, W., Manzoni, P., and Gonzalez, F. (2018). A Forward Collision Warning System for Smartphones Using Image Processing and V2V Communication. Sensors, 18.","DOI":"10.3390\/s18082672"},{"key":"ref_5","first-page":"56","article-title":"An automated vehicle license plate recognition system","volume":"48","author":"Rajput","year":"2015","journal-title":"IEEE Trans. Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4139","DOI":"10.1109\/TIP.2014.2343456","article-title":"A Geometric Framework for Rectangular Shape Detection","volume":"23","author":"Li","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/TVT.2012.2222454","article-title":"Vertical-Edge-Based Car-License-Plate Detection Method","volume":"62","author":"Alghaili","year":"2013","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"8355","DOI":"10.3390\/s120608355","article-title":"License Plate Recognition Algorithm for Passenger Cars in Chinese Residential Areas","volume":"12","author":"Jin","year":"2012","journal-title":"Sensors"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"830","DOI":"10.1109\/TITS.2011.2114346","article-title":"An algorithm for license plate recognition applied to intelligent transportation system","volume":"12","author":"Wen","year":"2011","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1690","DOI":"10.1109\/TITS.2014.2304515","article-title":"An Iranian license plate recognition system based on color features","volume":"15","author":"Ashtari","year":"2014","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1109\/MITS.2015.2412146","article-title":"Chinese license plate localization in multi-lane with complex background based on concomitant colors","volume":"7","author":"Dun","year":"2015","journal-title":"IEEE Intell. Transp. Syst. Mag."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4269","DOI":"10.1109\/TIP.2012.2199506","article-title":"Principal visual word discovery for automatic license plate detection","volume":"21","author":"Zhou","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wang, W., Jiang, Q., Zhou, X., and Wan, W. (2011, January 16\u201318). Car license plate detection based on MSER. Proceedings of the International Conference on Consumer Electronics, Communications and Networks, Xianning, China.","DOI":"10.1109\/CECNET.2011.5768335"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1690","DOI":"10.1109\/TITS.2013.2267054","article-title":"Component-based license plate detection using conditional random field model","volume":"14","author":"Li","year":"2013","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1096","DOI":"10.1109\/TITS.2015.2496545","article-title":"Vehicle license plate recognition based on extremal regions and restricted boltzmann machines","volume":"17","author":"Gou","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"IJCV"},{"key":"ref_17","first-page":"346","article-title":"Speeded-Up Robust Features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"CVIU"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1627","DOI":"10.1109\/TPAMI.2009.167","article-title":"Object Detection with Discriminatively Trained Part-Based Models","volume":"32","author":"Felzenszwalb","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Girshick, R.B., Iandola, F.N., Darrell, T., and Malik, J. (2015, January 7\u201312). Deformable part models are convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298641"},{"key":"ref_20","unstructured":"Wan, L., Eigen, D., and Fergus, R. (2015, January 7\u201312). End-to-end integration of a Convolutional Network, Deformable Parts Model and non-maximum suppression. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_21","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20138). ImageNet classification with deep convolutional neural networks. Proceedings of the International Conference on Neural Information Processing Systems, Lake Tahoe, Nevada, USA."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1102","DOI":"10.1109\/TIP.2016.2631901","article-title":"A robust and efficient approach to license plate detection","volume":"26","author":"Yuan","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","unstructured":"Li, H., and Shen, C. (arXiv, 2016). Reading car license plates using deep convolutional neural networks and LSTMs, arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Gao, Y., and Lee, H.J. (2016). Local Tiled Deep Networks for Recognition of Vehicle Make and Model. Sensors, 16.","DOI":"10.3390\/s16020226"},{"key":"ref_25","unstructured":"Kurpiel, F.D., Minetto, R., and Nassu, B.T. (2017, January 17\u201320). Convolutional Neural Networks for License Plate Detection in Images. Proceedings of the International Conference on Image Processing, Beijing, China."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"6429","DOI":"10.1007\/s00500-017-2696-2","article-title":"Vehicle license plate detection using region-based convolutional neural networks","volume":"22","author":"Rafique","year":"2018","journal-title":"Soft Comput."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Girshick, R.B., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1904","DOI":"10.1109\/TPAMI.2015.2389824","article-title":"Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition","volume":"37","author":"He","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Girshick, R.B. (2015, January 13\u201316). Fast R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S.K., Girshick, R.B., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S.E., Fu, C., and Berg, A.C. (2016, January 11\u201314). SSD: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Zhang, C., Shen, W., Yao, C., Liu, W., and Bai, X. (2016, January 27\u201330). Multi-oriented text detection with fully convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.451"},{"key":"ref_34","unstructured":"He, T., Huang, W., Qiao, Y., and Yao, J. (arXiv, 2016). Accurate text localization in natural image with cascaded convolutional text network, arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"3111","DOI":"10.1109\/TMM.2018.2818020","article-title":"Arbitrary-oriented scene text detection via rotation proposals","volume":"20","author":"Ma","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Busta, M., Neumann, L., and Matas, J. (2017, January 22\u201329). Deep textspotter: An end-to-end trainable scene text localization and recognition framework. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.242"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3676","DOI":"10.1109\/TIP.2018.2825107","article-title":"Textboxes++: A single-shot oriented scene text detector","volume":"27","author":"Liao","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Sifre, L., and Mallat, S. (2013, January 23\u201328). Rotation, scaling and deformation invariant scattering for texture discrimination. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.163"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Minaee, S., Abdolrashidi, A., and Wang, Y. (2015, January 9\u201312). Iris recognition using scattering transform and textural features. Proceedings of the IEEE Signal Processing and Signal Processing Education Workshop, Salt Lake City, UT, USA.","DOI":"10.1109\/DSP-SPE.2015.7369524"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Minaee, S., and Wang, Y. (arXiv, 2016). Palmprint recognition using deep scattering convolutional network, arXiv.","DOI":"10.1109\/ISCAS.2017.8050421"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Cai, Z., Fan, Q., Feris, R.S., and Vasconcelos, N. (2016, January 8\u201316). A unified multi-scale deep convolutional neural network for fast object detection. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46493-0_22"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Bell, S., Lawrence Zitnick, C., Bala, K., and Girshick, R. (2016, January 27\u201330). Inside-outside net: Detecting objects in context with skip pooling and recurrent neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.314"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Kong, T., Yao, A., Chen, Y., and Sun, F. (2016, January 27\u201330). Hypernet: Towards accurate region proposal generation and joint object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.98"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Li, J., Niu, C., and Fan, M. (2012, January 11\u201314). Multi-scale convolutional neural networks for natural scene license plate detection. Proceedings of the International Symposium on Neural Networks, Shenyang, China.","DOI":"10.1007\/978-3-642-31362-2_13"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L., Li, K., and Li, F. (2009, January 20\u201326). ImageNet: A large-scale hierarchical image database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_48","first-page":"249","article-title":"Understanding the difficulty of training deep feedforward neural networks","volume":"9","author":"Glorot","year":"2010","journal-title":"J. Mach. Learn. Res."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/5\/1175\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:37:12Z","timestamp":1760186232000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/5\/1175"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,7]]},"references-count":48,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2019,3]]}},"alternative-id":["s19051175"],"URL":"https:\/\/doi.org\/10.3390\/s19051175","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,3,7]]}}}