{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,17]],"date-time":"2026-02-17T11:32:44Z","timestamp":1771327964174,"version":"3.50.1"},"reference-count":45,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2020,10,16]],"date-time":"2020-10-16T00:00:00Z","timestamp":1602806400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["821966"],"award-info":[{"award-number":["821966"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Retrieving text embedded within images is a challenging task in real-world settings. Multiple problems such as low-resolution and the orientation of the text can hinder the extraction of information. These problems are common in environments such as Tor Darknet and Child Sexual Abuse images, where text extraction is crucial in the prevention of illegal activities. In this work, we evaluate eight text recognizers and, to increase the performance of text transcription, we combine these recognizers with rectification networks and super-resolution algorithms. We test our approach on four state-of-the-art and two custom datasets (TOICO-1K and Child Sexual Abuse (CSA)-text, based on text retrieved from Tor Darknet and Child Sexual Exploitation Material, respectively). We obtained a 0.3170 score of correctly recognized words in the TOICO-1K dataset when we combined Deep Convolutional Neural Networks (CNN) and rectification-based recognizers. For the CSA-text dataset, applying resolution enhancements achieved a final score of 0.6960. The highest performance increase was achieved on the ICDAR 2015 dataset, with an improvement of 4.83% when combining the MORAN recognizer and the Residual Dense resolution approach. We conclude that rectification outperforms super-resolution when applied separately, while their combination achieves the best average improvements in the chosen datasets.<\/jats:p>","DOI":"10.3390\/s20205850","type":"journal-article","created":{"date-parts":[[2020,10,16]],"date-time":"2020-10-16T08:56:48Z","timestamp":1602838608000},"page":"5850","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Rectification and Super-Resolution Enhancements for Forensic Text Recognition"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5768-113X","authenticated-orcid":false,"given":"Pablo","family":"Blanco-Medina","sequence":"first","affiliation":[{"name":"Department of Electrical, Systems and Automation, Universidad de Le\u00f3n, 24007 Le\u00f3n, Spain"},{"name":"INCIBE (Spanish National Cybersecurity Institute), 24005 Le\u00f3n, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1202-5232","authenticated-orcid":false,"given":"Eduardo","family":"Fidalgo","sequence":"additional","affiliation":[{"name":"Department of Electrical, Systems and Automation, Universidad de Le\u00f3n, 24007 Le\u00f3n, Spain"},{"name":"INCIBE (Spanish National Cybersecurity Institute), 24005 Le\u00f3n, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2081-774X","authenticated-orcid":false,"given":"Enrique","family":"Alegre","sequence":"additional","affiliation":[{"name":"Department of Electrical, Systems and Automation, Universidad de Le\u00f3n, 24007 Le\u00f3n, Spain"},{"name":"INCIBE (Spanish National Cybersecurity Institute), 24005 Le\u00f3n, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4164-5887","authenticated-orcid":false,"given":"Roc\u00edo","family":"Alaiz-Rodr\u00edguez","sequence":"additional","affiliation":[{"name":"Department of Electrical, Systems and Automation, Universidad de Le\u00f3n, 24007 Le\u00f3n, Spain"},{"name":"INCIBE (Spanish National Cybersecurity Institute), 24005 Le\u00f3n, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7665-6418","authenticated-orcid":false,"given":"Francisco","family":"J\u00e1\u00f1ez-Martino","sequence":"additional","affiliation":[{"name":"Department of Electrical, Systems and Automation, Universidad de Le\u00f3n, 24007 Le\u00f3n, Spain"},{"name":"INCIBE (Spanish National Cybersecurity Institute), 24005 Le\u00f3n, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6580-3424","authenticated-orcid":false,"given":"Alexandra","family":"Bonnici","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, University of Malta, MSD2080 Msida, Malta"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,10,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1480","DOI":"10.1109\/TPAMI.2014.2366765","article-title":"Text detection and recognition in imagery: A survey","volume":"37","author":"Ye","year":"2014","journal-title":"Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/s11704-015-4488-0","article-title":"Scene text detection and recognition: Recent advances and future trends","volume":"10","author":"Zhu","year":"2016","journal-title":"Front. Comput. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1007\/s10032-019-00320-5","article-title":"Scene text detection and recognition with advances in deep learning: A survey","volume":"22","author":"Liu","year":"2019","journal-title":"Int. J. Doc. Anal. Recognit."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1111\/j.1740-9713.2019.01252.x","article-title":"Machine learning in forensic applications","volume":"16","author":"Carriquiry","year":"2019","journal-title":"Significance"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"217","DOI":"10.26483\/ijarcs.v8i8.4613","article-title":"Machine learning forensics: A new branch of digital forensics","volume":"8","author":"Rughani","year":"2017","journal-title":"Int. J. Adv. Res. Comput. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Anda, F., Lillis, D., Kanta, A., Becker, B.A., Bou-Harb, E., Le-Khac, N.A., and Scanlon, M. (2019, January 26\u201329). Improving Borderline Adulthood Facial Age Estimation Through Ensemble Learning. Proceedings of the 14th International Conference on Availability, Reliability and Security (ARES \u201919), Canterbury, UK.","DOI":"10.1145\/3339252.3341491"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Nixon, M., and Aguado, A. (2019). Feature Extraction and Image Processing for Computer Vision, Academic Press.","DOI":"10.1016\/B978-0-12-814976-8.00003-8"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gangwar, A., Fidalgo, E., Alegre, E., and Gonz\u00e1lez-Castro, V. (2017, January 13\u201315). Pornography and Child Sexual Abuse Detection in Image and Video: A Comparative Evaluation. Proceedings of the 8th International Conference on Imaging for Crime Detection and Prevention (ICDP 2017), Madrid, Spain.","DOI":"10.1049\/ic.2017.0046"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Saikia, S., Fidalgo, E., Alegre, E., and Fern\u00e1ndez-Robles, L. (2017, January 11\u201315). Object Detection for Crime Scene Evidence Analysis Using Deep Learning. Proceedings of the Image Analysis and Processing(ICIAP 2017), Catania, Italy.","DOI":"10.1007\/978-3-319-68548-9_2"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Saikia, S., Fidalgo, E., Alegre, E., and Fern\u00e1ndez-Robles, L. (2017, January 6\u20138). Query Based Object Retrieval Using Neural Codes. Proceedings of the International Joint Conference SOCO\u201917-CISIS\u201917-ICEUTE\u201917, Le\u00f3n, Spain.","DOI":"10.1007\/978-3-319-67180-2_50"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"84003","DOI":"10.1109\/ACCESS.2019.2924733","article-title":"A Survey of Deep Learning Solutions for Multimedia Visual Content Analysis","volume":"7","author":"Nadeem","year":"2019","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7\u201312). Facenet: A unified embedding for face recognition and clustering. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1016\/j.procs.2018.10.427","article-title":"Techniques and Challenges of Face Recognition: A Critical Review","volume":"143","author":"Singh","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/j.eswa.2019.01.029","article-title":"ToRank: Identifying the most influential suspicious domains in the Tor network","volume":"123","author":"Fidalgo","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"He, S., He, Y., and Li, M. (2019, January 16\u201319). Classification of illegal activities on the dark web. Proceedings of the 2019 2nd International Conference on Information Science and Systems (ICISS 2019), Tokyo, Japan.","DOI":"10.1145\/3322645.3322691"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1016\/j.eswa.2019.03.045","article-title":"SummCoder: An unsupervised framework for extractive text summarization based on deep auto-encoders","volume":"129","author":"Joshi","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wang, X., Peng, P., Wang, C., and Wang, G. (2018, January 4\u20138). You are your photographs: Detecting multiple identities of vendors in the darknet marketplaces. Proceedings of the 2018 on Asia Conference on Computer and Communications Security (ASIACCS \u201918), Incheon, Korea.","DOI":"10.1145\/3196494.3196529"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Biswas, R., Fidalgo, E., and Alegre, E. (2017, January 13\u201315). Recognition of service domains on TOR dark net using perceptual hashing and image classification techniques. Proceedings of the 8th International Conference on Imaging for Crime Detection and Prevention (ICDP 2017), Madrid, Spain.","DOI":"10.1049\/ic.2017.0041"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"921","DOI":"10.1007\/s10940-017-9359-4","article-title":"The Network Structure of Opioid Distribution on a Darknet Cryptomarket","volume":"34","author":"Duxbury","year":"2018","journal-title":"J. Quant. Criminol."},{"key":"ref_20","unstructured":"Wesam, M., Nabki, A., Fidalgo, E., Alegre, E., and Gonz\u00e1lez-Castro, V. (June, January 31). Detecting Emerging Products in TOR Network Based on K-Shell Graph Decomposition. Proceedings of the Jornadas Nacionales de Investigaci\u00f3n en Ciberseguridad (JNIC2017), Madrid, Spain."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yang, M., Zhao, W., Ye, J., Lei, Z., Zhao, Z., and Zhang, S. (November, January 31). Investigating capsule networks with dynamic routing for text classification. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1350"},{"key":"ref_22","unstructured":"Blanco-Medina, P., Fidalgo, E., Alegre, E., and Al-Nabki, M.W. (2018, January 5\u20137). Detecting Textual Information in images from onion domains using Text Spotting. Proceedings of the Actas de las XXXIX Jornadas de Autom\u00e1tica, Badajoz, Spain."},{"key":"ref_23","unstructured":"Blanco-Medina, P., Fidalgo, E., Alegre, E., Al-Nabki, M.W., and Chaves, D. (2019, January 4\u20136). Enhancing text recognition on Tor Darknet images. Proceedings of the XL Jornadas de Autom\u00e1tica, Ferrol, Spain."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Baek, J., Kim, G., Lee, J., Park, S., Han, D., Yun, S., Oh, S.J., and Lee, H. (November, January 27). What is wrong with scene text recognition model comparisons? Dataset and model analysis. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV 2019), Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00481"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Blanco-Medina, P., Fidalgo, E., Alegre, E., and J\u00e1nez-Martino, F. (2019, January 16\u201318). Improving Text Recognition in Tor darknet with Rectification and Super-Resolution techniques. Proceedings of the 9th International Conference on Imaging for Crime Detection and Prevention (ICDP-2019), London, UK.","DOI":"10.1049\/cp.2019.1164"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2035","DOI":"10.1109\/TPAMI.2018.2848939","article-title":"Aster: An attentional scene text recognizer with flexible rectification","volume":"41","author":"Shi","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.patcog.2019.01.020","article-title":"MORAN: A Multi-Object Rectified Attention Network for scene text recognition","volume":"90","author":"Luo","year":"2019","journal-title":"Pattern Recognit."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ma, Y., Peng, H., and Cambria, E. (2018, January 2\u20137). Targeted Aspect-Based Sentiment Analysis via Embedding Commonsense Knowledge into an Attentive LSTM. Proceedings of the Thirty-Second AAAI Conferenceon Artificial Intelligence (AAAI-18), New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.12048"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2298","DOI":"10.1109\/TPAMI.2016.2646371","article-title":"An end-to-end trainable neural network for image-based sequence recognition and its application to scene text recognition","volume":"39","author":"Shi","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Liu, X., Liang, D., Yan, S., Chen, D., Qiao, Y., and Yan, J. (2018, January 18\u201323). Fots: Fast oriented text spotting with a unified network. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00595"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Cheng, Z., Xu, Y., Bai, F., Niu, Y., Pu, S., and Zhou, S. (2018, January 18\u201323). Aon: Towards arbitrarily-oriented text recognition. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00584"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Peyrard, C., Baccouche, M., Mamalet, F., and Garcia, C. (2015, January 23\u201326). ICDAR2015 competition on text image super-resolution. Proceedings of the 2015 13th International Conference on Document Analysis and Recognition (ICDAR), Tunis, Tunisia.","DOI":"10.1109\/ICDAR.2015.7333951"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., He, K., and Tang, X. (2014, January 6\u201312). Learning a deep convolutional network for image super-resolution. Proceedings of the 13th European conference on computer vision(ECCV 2014), Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10593-2_13"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Yamanaka, J., Kuwashima, S., and Kurita, T. (2017, January 14\u201318). Fast and accurate image super resolution by deep CNN with skip connection and network in network. Proceedings of the 24th International Conference on Neural Information Processing, Guangzhou, China.","DOI":"10.1007\/978-3-319-70096-0_23"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Tian, Y., Kong, Y., Zhong, B., and Fu, Y. (2018, January 18\u201323). Residual dense network for image super-resolution. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00262"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Ledig, C., Theis, L., Husz\u00e1r, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., and Wang, Z. (2017, January 21\u201326). Photo-realistic single image super-resolution using a generative adversarial network. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.19"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wang, K., and Belongie, S. (2010, January 5\u201311). Word spotting in the wild. Proceedings of the 11th European Conference on Computer Vision (ECCV 2010), Heraklion, Greece.","DOI":"10.1007\/978-3-642-15549-9_43"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Karatzas, D., Gomez-Bigorda, L., Nicolaou, A., Ghosh, S., Bagdanov, A., Iwamura, M., Matas, J., Neumann, L., Chandrasekhar, V.R., and Lu, S. (2015, January 23\u201326). ICDAR 2015 competition on robust reading. Proceedings of the 2015 13th International Conference on Document Analysis and Recognition (ICDAR), Tunis, Tunisia.","DOI":"10.1109\/ICDAR.2015.7333942"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Karatzas, D., Shafait, F., Uchida, S., Iwamura, M., I Bigorda, L.G., Mestre, S.R., Mas, J., Mota, D.F., Almazan, J.A., and De Las Heras, L.P. (2013, January 25\u201328). ICDAR 2013 robust reading competition. Proceedings of the 2013 12th International Conference on Document Analysis and Recognition, Washington, DC, USA.","DOI":"10.1109\/ICDAR.2013.221"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Mishra, A., Alahari, K., and Jawahar, C. (2012, January 3\u20137). Scene text recognition using higher order language priors. Proceedings of the BMVC-British Machine Vision Conference 2012, Surrey, UK.","DOI":"10.5244\/C.26.127"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.diin.2019.05.004","article-title":"Classifying suspicious content in tor darknet through Semantic Attention Keypoint Filtering","volume":"30","author":"Fidalgo","year":"2019","journal-title":"Dig. Investig."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1109\/34.24792","article-title":"Principal warps: Thin-plate splines and the decomposition of deformations","volume":"11","author":"Bookstein","year":"1989","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_43","unstructured":"(2020, July 27). Very Deep Convolutional Networks for Large-Scale Image Recognition. Available online: https:\/\/arxiv.org\/abs\/1409.1556."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_45","unstructured":"Cohen, W., Ravikumar, P., and Fienberg, S. (2003, January 24\u201327). A comparison of string metrics for matching names and records. Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Washington, DC, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/20\/5850\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:22:18Z","timestamp":1760178138000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/20\/5850"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,16]]},"references-count":45,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2020,10]]}},"alternative-id":["s20205850"],"URL":"https:\/\/doi.org\/10.3390\/s20205850","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,16]]}}}