{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,30]],"date-time":"2026-10-30T21:13:27Z","timestamp":1793394807255,"version":"4.5.0"},"reference-count":35,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2018,10,17]],"date-time":"2018-10-17T00:00:00Z","timestamp":1539734400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Deep Learning has dramatically advanced the state of the art in vision, speech and many other areas. Recently, numerous deep learning algorithms have been proposed to solve traditional artificial intelligence problems. In this paper, in order to detect the version that can provide the best trade-off in terms of time and accuracy, convolutional networks of various depths have been implemented. Batch normalization is also considered since it acts as a regularizer and achieves the same accuracy with fewer training steps. For maximizing the yield of the complexity by diminishing, as well as minimizing the loss of accuracy, LSTM neural net layers are utilized in the process. The image sequences are proven to be classified by the LSTM in a more accelerated manner, while managing better precision. Concretely, the more complex the CNN, the higher the percentages of exactitude; in addition, but for the high-rank increase in accuracy, the time was significantly decreased, which eventually rendered the trade-off optimal. The average improvement of performance for all models regarding both datasets used amounted to     42 %    .<\/jats:p>","DOI":"10.3390\/a11100157","type":"journal-article","created":{"date-parts":[[2018,10,17]],"date-time":"2018-10-17T10:22:54Z","timestamp":1539771774000},"page":"157","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":44,"title":["LSTM Accelerator for Convolutional Object Identification"],"prefix":"10.3390","volume":"11","author":[{"given":"Alkiviadis","family":"Savvopoulos","sequence":"first","affiliation":[{"name":"Computer Engineering and Informatics Department, University of Patras, Patras 26504, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"Kanavos","sequence":"additional","affiliation":[{"name":"Computer Engineering and Informatics Department, University of Patras, Patras 26504, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6916-3129","authenticated-orcid":false,"given":"Phivos","family":"Mylonas","sequence":"additional","affiliation":[{"name":"Department of Informatics, Ionian University, Corfu 49100, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Spyros","family":"Sioutas","sequence":"additional","affiliation":[{"name":"Computer Engineering and Informatics Department, University of Patras, Patras 26504, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2018,10,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.neucom.2015.09.116","article-title":"Deep Learning for Visual Understanding: A Review","volume":"187","author":"Guo","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Gool, L.J.V. (2006, January 7\u201313). SURF: Speeded Up Robust Features. Proceedings of the European Conference on Computer Vision (ECCV), Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_4","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of Oriented Gradients for Human Detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, USA."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Sivic, J., and Zisserman, A. (2003, January 13\u201316). Video Google: A Text Retrieval Approach to Object Matching in Videos. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Nice, France.","DOI":"10.1109\/ICCV.2003.1238663"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Simo-Serra, E., Trulls, E., Ferraz, L., Kokkinos, I., Fua, P., and Moreno-Noguer, F. (2015, January 7\u201313). Discriminative Learning of Deep Convolutional Feature Point Descriptors. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.22"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Taigman, Y., Yang, M., Ranzato, M., and Wolf, L. (2014, January 23\u201328). Deepface: Closing the gap to human-level performance in face verification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.220"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.1162\/neco.2006.18.7.1527","article-title":"A Fast Learning Algorithm for Deep Belief Nets","volume":"18","author":"Hinton","year":"2006","journal-title":"Neural Comput."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Donahue, J., Hendricks, L.A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., and Saenko, K. (2015, January 7\u201312). Long-Term Recurrent Convolutional Networks for Visual Recognition and Description. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298878"},{"key":"ref_10","unstructured":"Kiros, R., Salakhutdinov, R., and Zemel, R.S. (2014, January 21\u201326). Multimodal Neural Language Models. Proceedings of the 31th International Conference on Machine Learning (ICML), Beijing, China."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Sainath, T.N., Vinyals, O., Senior, A.W., and Sak, H. (2015, January 19\u201324). Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brisbane, QLD, Australia.","DOI":"10.1109\/ICASSP.2015.7178838"},{"key":"ref_13","unstructured":"Ciresan, D.C., Meier, U., and Schmidhuber, J. (, January 16\u201321). Multi-Column Deep Neural Networks for Image Classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA."},{"key":"ref_14","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20138). ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the 26th Annual Conference on Neural Information Processing Systems (NIPS), Lake Tahoe Nevada."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_16","unstructured":"LeCun, Y., Huang, F.J., and Bottou, L. (July, January 27). Learning Methods for Generic Object Recognition with Invariance to Pose and Lighting. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Washington, DC, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lee, H., Grosse, R.B., Ranganath, R., and Ng, A.Y. (2009, January 14\u201318). Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical Representations. Proceedings of the 26th Annual International Conference on Machine Learning (ICML), Montreal, QC, Canada.","DOI":"10.1145\/1553374.1553453"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1162\/neco.2009.10-08-881","article-title":"Convolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation","volume":"22","author":"Turaga","year":"2010","journal-title":"Neural Comput."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/TPAMI.2010.54","article-title":"Discriminative Learning of Local Image Descriptors","volume":"33","author":"Brown","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","unstructured":"Ioffe, S., and Szegedy, C. (arXiv, 2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift, arXiv."},{"key":"ref_21","unstructured":"Gal, Y., and Ghahramani, Z. (arXiv, 2015). Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inference, arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Gourgaris, P., Kanavos, A., Makris, C., and Perrakis, G. (2015, January 20\u201322). Review-based Entity-ranking Refinement. Proceedings of the 11th International Conference on Web Information Systems and Technologies (WEBIST), Lisbon, Portugal.","DOI":"10.5220\/0005428604020410"},{"key":"ref_23","unstructured":"Kanavos, A., Kafeza, E., and Makris, C. (July, January 27). Can We Rank Emotions? A Brand Love Ranking System for Emotional Terms. Proceedings of the IEEE International Congress on Big Data, New York, NY, USA."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"B\u00fctepage, J., Black, M.J., Kragic, D., and Kjellstr\u00f6m, H. (2017, January 21\u201326). Deep Representation Learning for Human Motion Prediction and Classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.173"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_26","unstructured":"Glorot, X., and Bengio, Y. (2010, January 13\u201315). Understanding the Difficulty of Training Deep Feedforward Neural Networks. Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS), Sardinia, Italy."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7\u201313). Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.123"},{"key":"ref_28","unstructured":"Chung, J., G\u00fcl\u00e7ehre, \u00c7., Cho, K., and Bengio, Y. (arXiv, 2014). Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling, arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.neucom.2016.12.088","article-title":"An Analysis of Convolutional Long Short-Term Memory Recurrent Neural Networks for Gesture Recognition","volume":"268","author":"Tsironi","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_30","unstructured":"Nair, V., and Hinton, G.E. (2010, January 21\u201324). Rectified Linear Units Improve Restricted Boltzmann Machines. Proceedings of the 27th International Conference on Machine Learning (ICML), Haifa, Israel."},{"key":"ref_31","first-page":"2121","article-title":"Adaptive Subgradient Methods for Online Learning and Stochastic Optimization","volume":"12","author":"Duchi","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_32","unstructured":"Sutskever, I., Martens, J., Dahl, G.E., and Hinton, G.E. (2013, January 16\u201321). On the Importance of Initialization and Momentum in Deep Learning. Proceedings of the International Conference on Machine Learning (ICML), Atlanta, GA, USA."},{"key":"ref_33","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_34","unstructured":"Gal, Y., and Ghahramani, Z. (2016, January 5\u201310). A Theoretically Grounded Application of Dropout in Recurrent Neural Networks. Proceedings of the Annual Conference on Neural Information Processing Systems, Barcelona, Spain."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Vinyals, O., Toshev, A., Bengio, S., and Erhan, D. (2015, January 7\u201312). Show and Tell: A Neural Image Caption Generator. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298935"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/11\/10\/157\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:26:13Z","timestamp":1760196373000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/11\/10\/157"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,17]]},"references-count":35,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2018,10]]}},"alternative-id":["a11100157"],"URL":"https:\/\/doi.org\/10.3390\/a11100157","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,10,17]]}}}