{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T08:37:06Z","timestamp":1759826226899,"version":"3.41.2"},"reference-count":41,"publisher":"World Scientific Pub Co Pte Ltd","issue":"07","funder":[{"name":"Research on the innovation and development of modern educational technology and discipline integration under the guidance of majors and driven by projects","award":["RHJG-2022-42"],"award-info":[{"award-number":["RHJG-2022-42"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J CIRCUIT SYST COMP"],"published-print":{"date-parts":[[2024,5,15]]},"abstract":"<jats:p> Deep neural network has made surprising achievements in natural language processing, image pattern classification recognition, and other domains in the last few years. It is still tough to apply to hardware-constrained or mobile equipment because of the huge number of parameters, high storage as well as computing costs. In this paper, a new sparse iteration neural network architecture is proposed. First, the pruning method is used to compress the model size and make the network sparse. Then the architecture is iterated on the sparse network model, and the network performance is improved without adding additional parameters. Finally, the hybrid deep learning model was carried out on CV tasks and NLP tasks on ANN, CNN, and Transformer. Compared with the sparse network architecture, we finally found that the accuracy of the MINST, CIFAR10, PASCAL VOC 2012, and SQuAD datasets is improved by 0.47%, 0.64%, 3.75%, and 15.06%, respectively. <\/jats:p>","DOI":"10.1142\/s0218126624501202","type":"journal-article","created":{"date-parts":[[2023,10,6]],"date-time":"2023-10-06T03:22:10Z","timestamp":1696562530000},"source":"Crossref","is-referenced-by-count":1,"title":["Hybrid Deep Learning Model Based on Sparse Recurrent Architecture"],"prefix":"10.1142","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-1548-4996","authenticated-orcid":false,"given":"Yutao","family":"Wu","sequence":"first","affiliation":[{"name":"Institute for Future, School of Automation, Qingdao University, Qingdao, Shandong 266000, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-4100-1682","authenticated-orcid":false,"given":"Min","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Economics and Management, Inner Mongolia University of Science and Technology, Baotou, Inner Mongolia 014010, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2023,11,4]]},"reference":[{"key":"S0218126624501202BIB001","first-page":"10882","volume":"22","author":"Hoefler T.","year":"2021","journal-title":"J. Mach. Learn. Res."},{"key":"S0218126624501202BIB002","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.003.2100672"},{"key":"S0218126624501202BIB004","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"S0218126624501202BIB005","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.243"},{"key":"S0218126624501202BIB006","first-page":"1877","volume":"33","author":"Brown T.","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"S0218126624501202BIB007","first-page":"9","volume":"1","author":"Radford A.","year":"2019","journal-title":"OpenAI Blog"},{"key":"S0218126624501202BIB009","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2022.3188302"},{"key":"S0218126624501202BIB010","doi-asserted-by":"publisher","DOI":"10.1145\/2699343.2699349"},{"key":"S0218126624501202BIB012","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00716"},{"key":"S0218126624501202BIB013","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00293"},{"key":"S0218126624501202BIB014","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00907"},{"key":"S0218126624501202BIB015","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01234-2_48"},{"key":"S0218126624501202BIB016","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2020.01.079"},{"key":"S0218126624501202BIB018","first-page":"10882","volume":"22","author":"Hoefler T.","year":"2021","journal-title":"J. Mach. Learn. Res."},{"key":"S0218126624501202BIB019","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-018-04316-3"},{"key":"S0218126624501202BIB020","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-021-05727-y"},{"key":"S0218126624501202BIB021","first-page":"4646","volume-title":"Int. Conf. Machine Learning","author":"Mostafa H.","year":"2019"},{"key":"S0218126624501202BIB025","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00502"},{"key":"S0218126624501202BIB026","doi-asserted-by":"publisher","DOI":"10.1145\/3352460.3358269"},{"key":"S0218126624501202BIB027","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijforecast.2020.06.008"},{"key":"S0218126624501202BIB028","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-2236(00)01657-X"},{"key":"S0218126624501202BIB029","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1008215"},{"key":"S0218126624501202BIB030","first-page":"2847","author":"Raghu M.","year":"2017","journal-title":"Int. Conf. Machine Learning"},{"key":"S0218126624501202BIB031","doi-asserted-by":"publisher","DOI":"10.1109\/TCBB.2019.2919307"},{"key":"S0218126624501202BIB032","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2021.10.010"},{"key":"S0218126624501202BIB033","first-page":"2790","author":"Houlsby N.","year":"2019","journal-title":"Int. Conf. Machine Learning"},{"key":"S0218126624501202BIB034","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2945545"},{"key":"S0218126624501202BIB035","doi-asserted-by":"publisher","DOI":"10.1109\/TRPMS.2021.3066428"},{"key":"S0218126624501202BIB036","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2019.12.002"},{"key":"S0218126624501202BIB037","doi-asserted-by":"publisher","DOI":"10.1088\/978-0-7503-2216-4ch3"},{"key":"S0218126624501202BIB038","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2021.3084827"},{"key":"S0218126624501202BIB039","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-020-0170-9"},{"key":"S0218126624501202BIB041","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00681"},{"key":"S0218126624501202BIB042","volume":"30","author":"Vaswani A.","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"S0218126624501202BIB046","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-014-0733-5"},{"key":"S0218126624501202BIB047","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01422"},{"key":"S0218126624501202BIB049","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2019.10.005"},{"key":"S0218126624501202BIB051","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2021.3055564"},{"key":"S0218126624501202BIB052","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58526-6_31"},{"key":"S0218126624501202BIB053","doi-asserted-by":"publisher","DOI":"10.1109\/TGCN.2021.3062972"},{"key":"S0218126624501202BIB054","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-020-09816-7"}],"container-title":["Journal of Circuits, Systems and Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218126624501202","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,16]],"date-time":"2024-04-16T07:39:29Z","timestamp":1713253169000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218126624501202"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,4]]},"references-count":41,"journal-issue":{"issue":"07","published-print":{"date-parts":[[2024,5,15]]}},"alternative-id":["10.1142\/S0218126624501202"],"URL":"https:\/\/doi.org\/10.1142\/s0218126624501202","relation":{},"ISSN":["0218-1266","1793-6454"],"issn-type":[{"type":"print","value":"0218-1266"},{"type":"electronic","value":"1793-6454"}],"subject":[],"published":{"date-parts":[[2023,11,4]]},"article-number":"2450120"}}