{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,14]],"date-time":"2025-10-14T07:13:44Z","timestamp":1760426024016},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2021,8,16]],"date-time":"2021-08-16T00:00:00Z","timestamp":1629072000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2021,8,16]],"date-time":"2021-08-16T00:00:00Z","timestamp":1629072000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Pers Ubiquit Comput"],"published-print":{"date-parts":[[2023,6]]},"DOI":"10.1007\/s00779-021-01587-4","type":"journal-article","created":{"date-parts":[[2021,8,16]],"date-time":"2021-08-16T07:04:02Z","timestamp":1629097442000},"page":"1335-1353","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Achieving generalization of deep learning models in a quick way by adapting T-HTR learning rate scheduler"],"prefix":"10.1007","volume":"27","author":[{"given":"D","family":"Vidyabharathi","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"V","family":"Mohanraj","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J Senthil","family":"Kumar","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Y","family":"Suresh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,8,16]]},"reference":[{"key":"1587_CR1","unstructured":"Xie Y, Le L, Zhou Y, Raghavan VV Deep learning for natural language processing. Analytics and Data Science Institute, Kennesaw"},{"key":"1587_CR2","unstructured":"Jiakai Wei, Forget the learning rate, decay loss, arXiv:1905.00094v1 [cs.LG] for this version, Hunan University of Technology, China (e-mail:16408400236@stu.hut.edu.cn)."},{"key":"1587_CR3","doi-asserted-by":"publisher","unstructured":"Bo-Yang Hsueh, Wei Li, I-Chen Wu, Stochastic gradient descent with hyperbolic-tangent decay on classification, icwu@cs.nctu.edu.tw, 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), ISSN: 1550-5790, https:\/\/doi.org\/10.1109\/WACV.2019.00052, 07 March 2019","DOI":"10.1109\/WACV.2019.00052"},{"key":"1587_CR4","doi-asserted-by":"publisher","unstructured":"Leslie N. Smith ,Cyclical learning rates for training neural networks, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), Electronic ISBN:978-1-5090-4822-9,Print on Demand(PoD) ISBN:978-1-5090-4823-6 ,15 May 2017 https:\/\/doi.org\/10.1109\/WACV.2017.58","DOI":"10.1109\/WACV.2017.58"},{"key":"1587_CR5","unstructured":"Siwei Lai, Liheng Xu, Kang Liu, Jun Zhao, Recurrent convolutional neural networks for text classification, National Laboratory of Pattern Recognition (NLPR) Institute of Automation, Chinese Academy of Sciences, China,{swlai, lhxu, kliu, jzhao}@nlpr.ia.ac.cn."},{"key":"1587_CR6","doi-asserted-by":"crossref","unstructured":"Yong Yu, Xiaosheng Si, Changhua Hu, and Jianxun Zhang, A review of recurrent neural networks: LSTM cells and network architectures, Neural Computation, Volume 31, No. 7, July 2019","DOI":"10.1162\/neco_a_01199"},{"key":"1587_CR7","doi-asserted-by":"crossref","unstructured":"Zhou Q, Zhang Z, Wu H NLP at IEST 2018: BiLSTM-attention and LSTM-attention via soft voting in emotion classification. In: Proceedings of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pp 189\u2013194","DOI":"10.18653\/v1\/W18-6226"},{"key":"1587_CR8","unstructured":"Smith LN (2018) A disciplined approach to neural network hyper-parameters: learning rate, batch size, momentum, and weight decay. In: US Naval Research Laboratory Technical Report, 5510-026,24th April"},{"key":"1587_CR9","unstructured":"Jason Brownlee,2020, Hyperparameter optimization with random search and grid search. https:\/\/machinelearningmastery.com\/hyperparameter-optimization-with-random-search-and-grid-search\/"},{"key":"1587_CR10","doi-asserted-by":"publisher","unstructured":"Johnson F, Valderrama A, Valle C, Crawford B, Soto R, and \u00d1anculef R, (2020 (Member, IEEE), \u2018Automating configuration of convolutional neural network hyperparameters using genetic algorithm\u2019, IEEE ACCESS, https:\/\/doi.org\/10.1109\/ACCESS.2020.3019245.","DOI":"10.1109\/ACCESS.2020.3019245"},{"key":"1587_CR11","doi-asserted-by":"publisher","unstructured":"Yunus Emre Midilli Sergejs Parsutins, \u2018Optimization of deep learning hyperparameters with experimental design in exchange rate prediction\u2019, Information Technology, Riga Technical University Riga, Latvia ,Yunus-Emre.Midilli@edu.rtu.lv , Sergejs.Parsutins@rtu.lv, 2020 61st International Scientific Conference on Information Technology and Management Science of Riga Technical University (ITMS: https:\/\/ieeexplore.ieee.org\/xpl\/conhome\/9259223\/proceeding), https:\/\/doi.org\/10.1109\/ITMS51158.2020.9259300, November 2020","DOI":"10.1109\/ITMS51158.2020.9259300"},{"key":"1587_CR12","unstructured":"A. Helen Victoria \u00b7 G. Maragatham, \u2018Automatic tuning of hyperparameters using Bayesian optimization\u2019, Department of Information Technology, SRM Institute of Science and Technology, Kattankulathur, Chennai,Tamil Nadu, India, helenvia@srmist.edu.in,maragatg@srmist.edu.in, Evolving Systems, 2020 - Springer."},{"key":"1587_CR13","doi-asserted-by":"publisher","first-page":"012033","DOI":"10.1088\/1742-6596\/1193\/1\/012033","volume":"1193","author":"T Badriyah","year":"2019","unstructured":"Badriyah T, Santoso DB, Syarif I (2019) Deep learning algorithm for data classification with hyperparameter optimization method. IOP Conf Ser J Phys Conf Series 1193:012033 IOP Publishing. https:\/\/doi.org\/10.1088\/1742-6596\/1193\/1\/012033","journal-title":"IOP Conf Ser J Phys Conf Series"},{"key":"1587_CR14","doi-asserted-by":"publisher","unstructured":"Roman Liessner, Jakob Schmitt, Ansgar Dietermann and Bernard Baker, \u2018Hyperparameter optimization for deep reinforcement learning invehicle energy management\u2019, Dresden Institute of Automobile Engineering, TU Dresden, George-B\u00a8ahr-Stra\u00dfe 1c, 01069 Dresden, Germany, In Proceedings of the 11th International Conference on Agents and Artificial Intelligence (ICAART 2019), pages 134-144,ISBN: 978-989-758-350-6 , https:\/\/doi.org\/10.5220\/0007364701340144","DOI":"10.5220\/0007364701340144"},{"key":"1587_CR15","doi-asserted-by":"publisher","unstructured":"YoungJun Yoo, \u2018Hyperparameter optimization of deep neural network using univariate dynamic encoding algorithm for searches\u2019, Department of Electronic Engineering, Pohang University of Science and Technology (POSTECH), youdalj@postech.ac.kr.,San 31, Hyojadong, Namgu,Pohang, Gyungbuk, 790-784, Republic of Korea, Knowledge-Based Systems 178 (2019)74\u201383, https:\/\/doi.org\/10.1016\/j.knosys.2019.04.019","DOI":"10.1016\/j.knosys.2019.04.019"},{"key":"1587_CR16","unstructured":"Kaichao You , Mingsheng Long (B), Jianmin Wang , Michael I. Jordan, \u2018How does learning rate decay help modern neural networks?\u2019,{ School of Software, Tsinghua University, youkaichao@gmail.com , mingsheng@tsinghua.edu.cn,jimwang@tsinghua.edu.cn }, Department of EECS University of California, Berkeley, jordan@cs.berkeley.edu, arXiv:1908.01878v2 [cs.LG] 26 Sep 2019"},{"key":"1587_CR17","unstructured":"Michal Rol\u0131nek and Georg Martius, \u2018L4: practical loss-based stepsize adaptation for deep learning\u2019, Max-Planck-Institute for Intelligent Systems, T\u00a8ubingen, Germany ,{michal.rolinek,georg.martius} @ tuebingen.mpg.de, arXiv:1802.05074v5 [cs.LG] 30 Nov 2018"},{"key":"1587_CR18","doi-asserted-by":"crossref","unstructured":"Jinia Konar, Prerit Khandelwal, Rishabh Tripathi, \u2018Comparison of various learning rate scheduling techniques on convolutional neural network\u2019, C.S.E Department N.I.T Bhopal, Bhopal, India konar.riku@gmail.com , preritkhandalwal@gmail.com ,imristri@gmail.com, 2020 IEEE International Students\u2019 Conference on Electrical, Electronics and Computer Science, 978-1-7281-4862-5\/20\/$31.00 \u00a92020 IEEE 10.1109\/SCEECS48394.2020.94","DOI":"10.1109\/SCEECS48394.2020.94"},{"key":"1587_CR19","doi-asserted-by":"publisher","unstructured":"Step size matters in deep learning, NIPS\u201918: Proceedings of the 32nd International Conference on Neural Information Processing Systems 2018, pp 3440\u20133448. https:\/\/doi.org\/10.5555\/3327144.3327262","DOI":"10.5555\/3327144.3327262"},{"key":"1587_CR20","unstructured":"Conghui Tan, Shiqian Ma, Yu-Hong Dai, Yuqiu Qian, \u2018Barzilai-Borwein step size for stochastic gradient descent\u2019, May 16, 2016. arXiv:1605.04131v2 [math.OC], 30th Conference on Neural Information Processing Systems (NIPS 2016), Barcelona, Spain 23 May 2016"},{"key":"1587_CR21","unstructured":"Ilya Loshchilov, Frank Hutter, \u2018SGDR: stochastic gradient descent with warm restarts\u2019, University of Freiburg, Freiburg, Germany, {ilya,fh}@cs.uni-freiburg.de,arXiv:1608.03983v5, International Conference on Learning Representations,Toulon, France, April 24 - 26, 2017,http:\/\/www.iclr.cc, May 2017"},{"key":"1587_CR22","doi-asserted-by":"crossref","unstructured":"W. An, H. Wang, Y. Zhang, and Q. Dai, \u2018Exponential decay sine wave learning rate for fast deep neural network training\u2019, In Visual Communications and Image Processing (VCIP) ,2017 IEEE, pages 1\u20134. IEEE, 2017.","DOI":"10.1109\/VCIP.2017.8305126"},{"key":"1587_CR23","doi-asserted-by":"publisher","unstructured":"Liu Peiqian, Wang Xiaojie, Distance approach for open information extraction based on word vector, Vol. 12, No. 6, June 29, 2018, https:\/\/doi.org\/10.3837\/tiis.2018.06.003","DOI":"10.3837\/tiis.2018.06.003"},{"key":"1587_CR24","doi-asserted-by":"crossref","unstructured":"Shi Y, Zhu L, Li W, Guo K, Zheng Y (2019) Survey on classic and latest textual sentiment analysis articles and techniques, vol 18(04). International Journal of Information Technology and Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd, pp 1243\u20131287","DOI":"10.1142\/S0219622019300015"},{"key":"1587_CR25","doi-asserted-by":"crossref","unstructured":"Arnav Chakravarthy, Prssanna Desai, Simran Deshmukh, Surbhi Gawande, Prof. Ishani Saha, Mukesh Patel, Hybrid architecture for sentiment analysis using deep learning, Volume 9, No. 1, January-February 2018, ISSN No. 0976-5697,735-738","DOI":"10.26483\/ijarcs.v9i1.5388"},{"key":"1587_CR26","doi-asserted-by":"crossref","unstructured":"Salloum SA, Al-Emran M, Monem AA, Shaalan K (2017) A survey of text mining in social media: Facebook and Twitter perspectives. IT Adv Sci Technol Eng Syst J 2(1):127\u2013133","DOI":"10.25046\/aj020115"},{"key":"1587_CR27","unstructured":"Tom M (1999) Twenty newsgroup dataset. https:\/\/archive.ics.uci.edu\/ml\/datasets\/Twenty+Newsgroups. Accessed 9 Sept 1999"},{"key":"1587_CR28","unstructured":"Lewis DD (1987) AT & T Labs \u2013 Research, Reuters-21578 text categorization collection data set.\u00a0https:\/\/archive.ics.uci.edu\/ml\/datasets\/reuters-21578+text+categorization+collection,1997-09-26. Accessed\u00a016 Feb 1999."},{"key":"1587_CR29","unstructured":"Maas et al (2011), Stanford AI repository, IMDB movie reviews sentiment dataset.\u00a0https:\/\/www.kaggle.com\/jcblaise\/imdb-sentiments. Accessed\u00a0Jun 2011."}],"container-title":["Personal and Ubiquitous Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00779-021-01587-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00779-021-01587-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00779-021-01587-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,25]],"date-time":"2023-05-25T14:14:26Z","timestamp":1685024066000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00779-021-01587-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,16]]},"references-count":29,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["1587"],"URL":"https:\/\/doi.org\/10.1007\/s00779-021-01587-4","relation":{},"ISSN":["1617-4909","1617-4917"],"issn-type":[{"value":"1617-4909","type":"print"},{"value":"1617-4917","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,16]]},"assertion":[{"value":"9 October 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 June 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 August 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}