{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,21]],"date-time":"2026-03-21T20:25:14Z","timestamp":1774124714420,"version":"3.50.1"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2021,3,17]],"date-time":"2021-03-17T00:00:00Z","timestamp":1615939200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,3,17]],"date-time":"2021-03-17T00:00:00Z","timestamp":1615939200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62006226"],"award-info":[{"award-number":["62006226"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2022,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Recently, tensor ring networks (TRNs) have been applied in deep networks, achieving remarkable successes in compression ratio and accuracy. Although highly related to the performance of TRNs, rank selection is seldom studied in previous works and usually set to equal in experiments. Meanwhile, there is not any heuristic method to choose the rank, and an enumerating way to find appropriate rank is extremely time-consuming. Interestingly, we discover that part of the rank elements is sensitive and usually aggregate in a narrow region, namely an interest region. Therefore, based on the above phenomenon, we propose a novel progressive genetic algorithm named progressively searching tensor ring network search (PSTRN), which has the ability to find optimal rank precisely and efficiently. Through the evolutionary phase and progressive phase, PSTRN can converge to the interest region quickly and harvest good performance. Experimental results show that PSTRN can significantly reduce the complexity of seeking rank, compared with the enumerating method. Furthermore, our method is validated on public benchmarks like MNIST, CIFAR10\/100, UCF11 and HMDB51, achieving the state-of-the-art performance.<\/jats:p>","DOI":"10.1007\/s40747-021-00308-x","type":"journal-article","created":{"date-parts":[[2021,3,17]],"date-time":"2021-03-17T15:02:46Z","timestamp":1615993366000},"page":"771-785","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Heuristic rank selection with progressively searching tensor ring network"],"prefix":"10.1007","volume":"8","author":[{"given":"Nannan","family":"Li","sequence":"first","affiliation":[]},{"given":"Yu","family":"Pan","sequence":"additional","affiliation":[]},{"given":"Yaran","family":"Chen","sequence":"additional","affiliation":[]},{"given":"Zixiang","family":"Ding","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8218-9633","authenticated-orcid":false,"given":"Dongbin","family":"Zhao","sequence":"additional","affiliation":[]},{"given":"Zenglin","family":"Xu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,3,17]]},"reference":[{"key":"308_CR1","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1016\/j.ins.2017.08.035","volume":"432","author":"Y Chen","year":"2018","unstructured":"Chen Y, Zhao D, Lv L, Zhang Q (2018) Multi-task learning for dangerous object detection in autonomous driving. Inf Sci 432:559\u2013571","journal-title":"Inf Sci"},{"key":"308_CR2","doi-asserted-by":"crossref","unstructured":"Cheng Z, Li B, Fan Y, Bao Y (2020) A novel rank selection scheme in tensor ring decomposition based on reinforcement learning for deep neural networks. In: 2020 IEEE international conference on acoustics, speech and signal processing, ICASSP 2020, Barcelona, Spain, May 4\u20138, 2020. IEEE, pp 3292\u20133296","DOI":"10.1109\/ICASSP40776.2020.9053292"},{"issue":"2","key":"308_CR3","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1109\/4235.996017","volume":"6","author":"K Deb","year":"2002","unstructured":"Deb K, Agrawal S, Pratap A, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182\u2013197","journal-title":"IEEE Trans Evol Comput"},{"issue":"6","key":"308_CR4","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1109\/MSP.2012.2211477","volume":"29","author":"L Deng","year":"2012","unstructured":"Deng L (2012) The MNIST database of handwritten digit images for machine learning research [best of the web]. IEEE Signal Process Mag 29(6):141\u2013142","journal-title":"IEEE Signal Process Mag"},{"key":"308_CR5","unstructured":"Garipov T, Podoprikhin D, Novikov A, Vetrov D (2016) Ultimate tensorization: compressing convolutional and fc layers alike. arXiv:1611.03214"},{"key":"308_CR6","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition, CVPR 2016. IEEE Computer Society, pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"308_CR7","unstructured":"Kim Y, Park E, Yoo S, Choi T, Yang L, Shin D (2016) Compression of deep convolutional neural networks for fast and low power mobile applications. In: 4th international conference on learning representations, ICLR 2016"},{"key":"308_CR8","unstructured":"Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. In: 3rd international conference on learning representations, ICLR 2015, San Diego, May 7\u20139, 2015, conference track proceedings"},{"key":"308_CR9","unstructured":"Krizhevsky A, Hinton G et al (2009) Learning multiple layers of features from tiny images"},{"key":"308_CR10","doi-asserted-by":"crossref","unstructured":"Kuehne H, Jhuang H, Garrote E, Poggio TA, Serre T (2011) HMDB: a large video database for human motion recognition. In: IEEE international conference on computer vision, ICCV 2011, Barcelona, November 6\u201313, 2011. IEEE Computer Society, pp 2556\u20132563","DOI":"10.1109\/ICCV.2011.6126543"},{"key":"308_CR11","doi-asserted-by":"crossref","unstructured":"Lane ND., Bhattacharya S, Georgiev P, Forlivesi C, Kawsar F (2015) An early resource characterization of deep learning on wearables, smartphones and internet-of-things devices. In: Proceedings of the 2015 international workshop on internet of things towards applications, IoT-App 2015. ACM, pp 7\u201312","DOI":"10.1145\/2820975.2820980"},{"issue":"11","key":"308_CR12","doi-asserted-by":"publisher","first-page":"2278","DOI":"10.1109\/5.726791","volume":"86","author":"Y LeCun","year":"1998","unstructured":"LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278\u20132324","journal-title":"Proc IEEE"},{"key":"308_CR13","unstructured":"Li C, Sun Z (2020) Evolutionary topology search for tensor network decomposition. In: Proceedings of the 37th international conference on machine learning, ICML 2020, 13\u201318 July 2020, virtual event, proceedings of machine learning research, vol 119. PMLR, pp 5947\u20135957. http:\/\/proceedings.mlr.press\/v119\/li20l.html"},{"key":"308_CR14","doi-asserted-by":"crossref","unstructured":"Li D, Zhao D, Chen Y, Zhang Q (2018) Deepsign: deep learning based traffic sign recognition. In: 2018 international joint conference on neural networks, IJCNN 2018. IEEE, pp 1\u20136","DOI":"10.1109\/IJCNN.2018.8489623"},{"key":"308_CR15","doi-asserted-by":"crossref","unstructured":"Li N, Chen Y, Ding Z, Zhao D (2020) Shift-invariant convolutional network search. In: 2020 International joint conference on neural networks, IJCNN 2020, Glasgow, July 19\u201324, 2020. IEEE, pp 1\u20137","DOI":"10.1109\/IJCNN48605.2020.9207437"},{"key":"308_CR16","doi-asserted-by":"crossref","unstructured":"Li W, Zhu Y, Zhao D, et al (2019) Multi-agent reinforcement learning based on clustering in two-player games. In: IEEE symposium series on computational intelligence, SSCI 2019, Xiamen, December 6\u20139, 2019. IEEE, pp 57\u201363","DOI":"10.1109\/SSCI44817.2019.9003120"},{"key":"308_CR17","doi-asserted-by":"crossref","unstructured":"Pan Y, Xu J, Wang M, Ye J, Wang F, Bai K, Xu Z (2019) Compressing recurrent neural networks with tensor ring for action recognition. In: The thirty-third AAAI conference on artificial intelligence, AAAI 2019, Honolulu, January 27\u2013February 1, 2019. AAAI Press, pp 4683\u20134690","DOI":"10.1609\/aaai.v33i01.33014683"},{"key":"308_CR18","unstructured":"Real E, Moore S, Selle A, Saxena S, Suematsu YL, Tan J, Le QV, Kurakin A (2017) Large-scale evolution of image classifiers. In: Proceedings of the 34th international conference on machine learning, ICML 2017, Sydney, 6\u201311 August 2017, proceedings of machine learning research, vol\u00a070. PMLR, pp 2902\u20132911"},{"key":"308_CR19","unstructured":"Ruder S (2016) An overview of gradient descent optimization algorithms. arXiv:1609.04747"},{"key":"308_CR20","doi-asserted-by":"crossref","unstructured":"Shao K, Zhao D, Li N, Zhu Y (2018) Learning battles in vizdoom via deep reinforcement learning. In: 2018 IEEE conference on computational intelligence and games, CIG 2018. IEEE, pp 1\u20134","DOI":"10.1109\/CIG.2018.8490423"},{"key":"308_CR21","unstructured":"Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd international conference on learning representations, ICLR 2015"},{"key":"308_CR22","doi-asserted-by":"crossref","unstructured":"Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: 2016 IEEE conference on computer vision and pattern recognition, CVPR 2016, Las Vegas, June 27\u201330, 2016. IEEE Computer Society, pp 2818\u20132826","DOI":"10.1109\/CVPR.2016.308"},{"key":"308_CR23","doi-asserted-by":"crossref","unstructured":"Wang J, Bai H, Wu J, Cheng J (2020) Bayesian automatic model compression. IEEE J Sel Top Signal Process","DOI":"10.1109\/JSTSP.2020.2977090"},{"key":"308_CR24","doi-asserted-by":"publisher","unstructured":"Wang M, Su Z, Luo X, Pan Y, Zheng S, Xu Z (2020) Concatenated tensor networks for deep multi-task learning. In: Yang H, Pasupa K, Leung AC, Kwok JT, Chan JH, King I (eds) Neural information processing\u201427th international conference, ICONIP 2020, Bangkok, November 18\u201322, 2020, proceedings, part v, communications in computer and information science, vol 1333. Springer, pp 517\u2013525. https:\/\/doi.org\/10.1007\/978-3-030-63823-8_59","DOI":"10.1007\/978-3-030-63823-8_59"},{"key":"308_CR25","doi-asserted-by":"publisher","unstructured":"Wang M, Zhang C, Pan Y, Xu J, Xu Z (2019) Tensor ring restricted Boltzmann machines. In: International joint conference on neural networks, IJCNN 2019 Budapest, July 14\u201319, 2019. IEEE, pp 1\u20138. https:\/\/doi.org\/10.1109\/IJCNN.2019.8852432","DOI":"10.1109\/IJCNN.2019.8852432"},{"key":"308_CR26","unstructured":"Wang W, Sun Y, Eriksson B, Wang W, Aggarwal V (2018) Wide compression: tensor ring nets. In: 2018 IEEE conference on computer vision and pattern recognition, CVPR 2018. IEEE Computer Society, pp 9329\u20139338"},{"key":"308_CR27","unstructured":"Xiao H, Rasul K, Vollgraf R (2017) Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms. CoRR arXiv:1708.07747"},{"key":"308_CR28","unstructured":"Yerlan I, Miguel \u00c1C (2020) Low-rank compression of neural nets: Learning the rank of each layer. In: 2020 IEEE\/CVF conference on computer vision and pattern recognition, CVPR 2020, Seattle, June 13\u201319, 2020. IEEE, pp 8046\u20138056"},{"key":"308_CR29","doi-asserted-by":"crossref","unstructured":"Zagoruyko S, Komodakis N (2016) Wide residual networks. In: Wilson RC, Hancock ER, Smith WAP (eds) Proceedings of the British machine vision conference 2016, BMVC 2016, York, September 19\u201322, 2016. BMVA Press","DOI":"10.5244\/C.30.87"},{"issue":"4","key":"308_CR30","doi-asserted-by":"publisher","first-page":"356","DOI":"10.1109\/TCDS.2016.2614675","volume":"9","author":"D Zhao","year":"2017","unstructured":"Zhao D, Chen Y, Lv L et al (2017) Deep reinforcement learning with visual attention for vehicle classification. IEEE Trans Cogn Dev Syst 9(4):356\u2013367","journal-title":"IEEE Trans Cogn Dev Syst"},{"key":"308_CR31","unstructured":"Zoph B, Le QV (2017) Neural architecture search with reinforcement learning. In: 5th international conference on learning representations, ICLR 2017, Toulon, April 24\u201326, 2017, conference track proceedings. OpenReview.net"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-021-00308-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-021-00308-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-021-00308-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,29]],"date-time":"2022-04-29T17:28:04Z","timestamp":1651253284000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-021-00308-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,17]]},"references-count":31,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,4]]}},"alternative-id":["308"],"URL":"https:\/\/doi.org\/10.1007\/s40747-021-00308-x","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"value":"2199-4536","type":"print"},{"value":"2198-6053","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,17]]},"assertion":[{"value":"20 October 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 February 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 March 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"On behalf of all authors, the corresponding author states that there is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Yes. .","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Availability of data and material"}},{"value":"The code is not public currently.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Code availability"}}]}}