{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,2]],"date-time":"2026-08-02T18:10:57Z","timestamp":1785694257042,"version":"3.56.0"},"reference-count":293,"publisher":"Springer Science and Business Media LLC","issue":"22","license":[{"start":{"date-parts":[[2024,9,2]],"date-time":"2024-09-02T00:00:00Z","timestamp":1725235200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,9,2]],"date-time":"2024-09-02T00:00:00Z","timestamp":1725235200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Appl Intell"],"published-print":{"date-parts":[[2024,11]]},"abstract":"<jats:sec>\n                <jats:title>Abstract<\/jats:title>\n                <jats:p>This paper critically examines model compression techniques within the machine learning (ML) domain, emphasizing their role in enhancing model efficiency for deployment in resource-constrained environments, such as mobile devices, edge computing, and Internet of Things (IoT) systems. By systematically exploring compression techniques and lightweight design architectures, it is provided a comprehensive understanding of their operational contexts and effectiveness. The synthesis of these strategies reveals a dynamic interplay between model performance and computational demand, highlighting the balance required for optimal application. As machine learning (ML) models grow increasingly complex and data-intensive, the demand for computational resources and memory has surged accordingly. This escalation presents significant challenges for the deployment of artificial intelligence (AI) systems in real-world applications, particularly where hardware capabilities are limited. Therefore, model compression techniques are not merely advantageous but essential for ensuring that these models can be utilized across various domains, maintaining high performance without prohibitive resource requirements. Furthermore, this review underscores the importance of model compression in sustainable artificial intelligence (AI) development. The introduction of hybrid methods, which combine multiple compression techniques, promises to deliver superior performance and efficiency. Additionally, the development of intelligent frameworks capable of selecting the most appropriate compression strategy based on specific application needs is crucial for advancing the field. The practical examples and engineering applications discussed demonstrate the real-world impact of these techniques. By optimizing the balance between model complexity and computational efficiency, model compression ensures that the advancements in AI technology remain sustainable and widely applicable. This comprehensive review thus contributes to the academic discourse and guides innovative solutions for efficient and responsible machine learning practices, paving the way for future advancements in the field.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Graphical abstract<\/jats:title>\n                \n              <\/jats:sec>","DOI":"10.1007\/s10489-024-05747-w","type":"journal-article","created":{"date-parts":[[2024,9,2]],"date-time":"2024-09-02T08:02:15Z","timestamp":1725264135000},"page":"11804-11844","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":227,"title":["A comprehensive review of model compression techniques in machine learning"],"prefix":"10.1007","volume":"54","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6390-9340","authenticated-orcid":false,"given":"Pierre Vilar","family":"Dantas","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"suffix":"Jr","given":"Waldir","family":"Sabino da Silva","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lucas Carvalho","family":"Cordeiro","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Celso Barbosa","family":"Carvalho","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,9,2]]},"reference":[{"issue":"6","key":"5747_CR1","doi-asserted-by":"publisher","first-page":"386","DOI":"10.1037\/h0042519","volume":"65","author":"F Rosenblatt","year":"1958","unstructured":"Rosenblatt F (1958) The perceptron: A probabilistic model for information storage and organization in the brain. Psychol Rev 65(6):386\u2013408. https:\/\/doi.org\/10.1037\/h0042519","journal-title":"Psychol Rev"},{"issue":"3","key":"5747_CR2","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1007\/bf00994018","volume":"20","author":"C Cortes","year":"1995","unstructured":"Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273\u2013297. https:\/\/doi.org\/10.1007\/bf00994018","journal-title":"Mach Learn"},{"issue":"8","key":"5747_CR3","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735\u20131780. https:\/\/doi.org\/10.1162\/neco.1997.9.8.1735","journal-title":"Neural Comput"},{"issue":"11","key":"5747_CR4","doi-asserted-by":"publisher","first-page":"2278","DOI":"10.1109\/5.726791","volume":"86","author":"Y Lecun","year":"1998","unstructured":"Lecun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278\u20132324. https:\/\/doi.org\/10.1109\/5.726791","journal-title":"Proc IEEE"},{"key":"5747_CR5","doi-asserted-by":"publisher","DOI":"10.1109\/icdar.1995.598994","author":"TK Ho","year":"1995","unstructured":"Ho TK (1995). Random decision forests. https:\/\/doi.org\/10.1109\/icdar.1995.598994","journal-title":"Random decision forests"},{"issue":"8","key":"5747_CR6","doi-asserted-by":"publisher","first-page":"832","DOI":"10.1109\/34.709601","volume":"20","author":"TK Ho","year":"1998","unstructured":"Ho TK (1998) The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 20(8):832\u2013844. https:\/\/doi.org\/10.1109\/34.709601","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"7","key":"5747_CR7","doi-asserted-by":"publisher","first-page":"1527","DOI":"10.1162\/neco.2006.18.7.1527","volume":"18","author":"GE Hinton","year":"2006","unstructured":"Hinton GE, Osindero S, Teh Y-W (2006) A fast learning algorithm for deep belief nets. Neural Comput 18(7):1527\u20131554. https:\/\/doi.org\/10.1162\/neco.2006.18.7.1527","journal-title":"Neural Comput"},{"issue":"6","key":"5747_CR8","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1145\/3065386","volume":"60","author":"A Krizhevsky","year":"2017","unstructured":"Krizhevsky A, Sutskever I, Hinton GE (2017) Imagenet classification with deep convolutional neural networks. Commun ACM 60(6):84\u201390. https:\/\/doi.org\/10.1145\/3065386","journal-title":"Commun ACM"},{"issue":"11","key":"5747_CR9","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1145\/3422622","volume":"63","author":"I Goodfellow","year":"2020","unstructured":"Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D et al (2020) Generative adversarial networks. Commun ACM 63(11):139\u2013144. https:\/\/doi.org\/10.1145\/3422622","journal-title":"Commun ACM"},{"key":"5747_CR10","doi-asserted-by":"publisher","first-page":"6518","DOI":"10.1109\/access.2024.3349952","volume":"12","author":"J Fields","year":"2024","unstructured":"Fields J, Chovanec K, Madiraju P (2024) A survey of text classification with transformers: How wide? how large? how long? how accurate? how expensive? how safe? IEEE Access 12:6518\u20136531. https:\/\/doi.org\/10.1109\/access.2024.3349952","journal-title":"IEEE Access"},{"key":"5747_CR11","doi-asserted-by":"publisher","unstructured":"Aftan S, Shah H (2023) A survey on bert and its applications. In: IEEE (ed) 2023 20th Learning and Technology Conference (L &T). https:\/\/doi.org\/10.1109\/lt58159.2023.10092289","DOI":"10.1109\/lt58159.2023.10092289"},{"key":"5747_CR12","doi-asserted-by":"publisher","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K (2018) BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1810.04805","DOI":"10.48550\/arXiv.1810.04805"},{"key":"5747_CR13","doi-asserted-by":"publisher","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J et al (2017) Attention Is All You Need. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1706.03762","DOI":"10.48550\/arXiv.1706.03762"},{"key":"5747_CR14","doi-asserted-by":"publisher","unstructured":"Sevilla J, Heim L, Ho A, Besiroglu T, Hobbhahn M, Villalobos P (2022) Compute trends across three eras of machine learning. In: IEEE (ed) 2022 International Joint Conference on Neural Networks (IJCNN), pp 1\u20138. https:\/\/doi.org\/10.1109\/ijcnn55064.2022.9891914","DOI":"10.1109\/ijcnn55064.2022.9891914"},{"key":"5747_CR15","doi-asserted-by":"publisher","unstructured":"Rasley J, Rajbhandari S, Ruwase O, He Y (2020) DeepSpeed: System optimizations enable training deep learning models with over 100 billion parameters. In: ACM (ed) Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD\u201920. https:\/\/doi.org\/10.1145\/3394486.3406703","DOI":"10.1145\/3394486.3406703"},{"key":"5747_CR16","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1016\/j.ijinfomgt.2019.01.021","volume":"48","author":"Y Duan","year":"2019","unstructured":"Duan Y, Edwards JS, Dwivedi YK (2019) Artificial intelligence for decision making in the era of big data - evolution, challenges and research agenda. Int J Inf Manag 48:63\u201371. https:\/\/doi.org\/10.1016\/j.ijinfomgt.2019.01.021","journal-title":"Int J Inf Manag"},{"key":"5747_CR17","doi-asserted-by":"publisher","unstructured":"Rajbhandari S, Ruwase O, Rasley J, Smith S, He Y (2021) ZeRO-infinity: breaking the GPU memory wall for extreme scale deep learning. In: ACM (ed) Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. SC\u201921. https:\/\/doi.org\/10.1145\/3458817.3476205","DOI":"10.1145\/3458817.3476205"},{"key":"5747_CR18","doi-asserted-by":"publisher","unstructured":"Dwivedi YK, Hughes L, Ismagilova et al (2021) Artificial intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy. Int J Inf Manag 57:101994. https:\/\/doi.org\/10.1016\/j.ijinfomgt.2019.08.002","DOI":"10.1016\/j.ijinfomgt.2019.08.002"},{"key":"5747_CR19","doi-asserted-by":"publisher","first-page":"63280","DOI":"10.1109\/access.2022.3182659","volume":"10","author":"S Vadera","year":"2022","unstructured":"Vadera S, Ameen S (2022) Methods for pruning deep neural networks. IEEE Access 10:63280\u201363300. https:\/\/doi.org\/10.1109\/access.2022.3182659","journal-title":"IEEE Access"},{"key":"5747_CR20","doi-asserted-by":"publisher","first-page":"107899","DOI":"10.1016\/j.patcog.2021.107899","volume":"115","author":"S-K Yeom","year":"2021","unstructured":"Yeom S-K, Seegerer P, Lapuschkin S, Binder A et al (2021) Pruning by explaining: A novel criterion for deep neural network pruning. Pattern Recogn 115:107899. https:\/\/doi.org\/10.1016\/j.patcog.2021.107899","journal-title":"Pattern Recogn"},{"issue":"1","key":"5747_CR21","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1109\/msp.2017.2765695","volume":"35","author":"Y Cheng","year":"2018","unstructured":"Cheng Y, Wang D, Zhou P, Zhang T (2018) Model compression and acceleration for deep neural networks: The principles, progress, and challenges. IEEE Signal Process Mag 35(1):126\u2013136. https:\/\/doi.org\/10.1109\/msp.2017.2765695","journal-title":"IEEE Signal Process Mag"},{"key":"5747_CR22","doi-asserted-by":"publisher","first-page":"344","DOI":"10.1109\/lsp.2021.3054315","volume":"28","author":"G Tian","year":"2021","unstructured":"Tian G, Chen J, Zeng X, Liu Y (2021) Pruning by training: A novel deep neural network compression framework for image processing. IEEE Signal Process Lett 28:344\u2013348. https:\/\/doi.org\/10.1109\/lsp.2021.3054315","journal-title":"IEEE Signal Process Lett"},{"key":"5747_CR23","doi-asserted-by":"publisher","first-page":"109331","DOI":"10.1016\/j.asoc.2022.109331","volume":"127","author":"M Ji","year":"2022","unstructured":"Ji M, Peng G, Li S, Cheng F, Chen Z et al (2022) A neural network compression method based on knowledge-distillation and parameter quantization for the bearing fault diagnosis. Appl Soft Comput 127:109331. https:\/\/doi.org\/10.1016\/j.asoc.2022.109331","journal-title":"Appl Soft Comput"},{"issue":"7","key":"5747_CR24","doi-asserted-by":"publisher","first-page":"1478","DOI":"10.1109\/tns.2020.2983662","volume":"67","author":"F Libano","year":"2020","unstructured":"Libano F, Wilson B, Wirthlin M, Rech P, Brunhaver J (2020) Understanding the impact of quantization, accuracy, and radiation on the reliability of convolutional neural networks on FPGAs. IEEE Trans Nucl Sci 67(7):1478\u20131484. https:\/\/doi.org\/10.1109\/tns.2020.2983662","journal-title":"IEEE Trans Nucl Sci"},{"key":"5747_CR25","doi-asserted-by":"publisher","unstructured":"Haase P, Schwarz H, Kirchhoffer H, Wiedemann et al (2020) Dependent scalar quantization for neural network compression. In: IEEE (ed) 2020 IEEE International Conference on Image Processing (ICIP). https:\/\/doi.org\/10.1109\/icip40778.2020.9190955","DOI":"10.1109\/icip40778.2020.9190955"},{"key":"5747_CR26","doi-asserted-by":"publisher","unstructured":"Boo Y, Shin S, Sung W (2019) Memorization capacity of deep neural networks under parameter quantization. In: IEEE (ed) ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). https:\/\/doi.org\/10.1109\/icassp.2019.8682462","DOI":"10.1109\/icassp.2019.8682462"},{"key":"5747_CR27","doi-asserted-by":"publisher","unstructured":"Tadahal S, Bhogar G, S\u00a0M M, Kulkarni U, Gurlahosur SV, Vyakaranal SB (2022) Post-training 4-bit quantization of deep neural networks. In: IEEE (ed) 2022 3rd International Conference for Emerging Technology (INCET). https:\/\/doi.org\/10.1109\/incet54531.2022.9825213","DOI":"10.1109\/incet54531.2022.9825213"},{"key":"5747_CR28","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1016\/j.neunet.2020.09.021","volume":"136","author":"Z Hu","year":"2021","unstructured":"Hu Z, Nie F, Wang R, Li X (2021) Low rank regularization: A review. Neural Networks 136:218\u2013232. https:\/\/doi.org\/10.1016\/j.neunet.2020.09.021","journal-title":"Neural Networks"},{"issue":"1","key":"5747_CR29","doi-asserted-by":"publisher","first-page":"321","DOI":"10.32604\/cmc.2020.06130","volume":"62","author":"S He","year":"2020","unstructured":"He S, Li Z, Tang Y, Liao Z, Li F, Lim S-J (2020) Parameters compressing in deep learning. Computers Materials and Continua 62(1):321\u2013336. https:\/\/doi.org\/10.32604\/cmc.2020.06130","journal-title":"Computers Materials and Continua"},{"issue":"4","key":"5747_CR30","doi-asserted-by":"publisher","first-page":"2569","DOI":"10.1109\/comst.2023.3297395","volume":"25","author":"H Xu","year":"2023","unstructured":"Xu H, Wu J, Pan Q, Guan X, Guizani M (2023) A survey on digital twin for industrial internet of things: Applications, technologies and tools. IEEE Commun Surv Tutorials 25(4):2569\u20132598. https:\/\/doi.org\/10.1109\/comst.2023.3297395","journal-title":"IEEE Commun Surv Tutorials"},{"key":"5747_CR31","doi-asserted-by":"publisher","first-page":"109896","DOI":"10.1016\/j.ymssp.2022.109896","volume":"186","author":"K Feng","year":"2023","unstructured":"Feng K, Ji JC, Zhang Y, Ni Q, Liu Z, Beer M (2023) Digital twin-driven intelligent assessment of gear surface degradation. Mech Syst Signal Process 186:109896. https:\/\/doi.org\/10.1016\/j.ymssp.2022.109896","journal-title":"Mech Syst Signal Process"},{"issue":"10","key":"5747_CR32","doi-asserted-by":"publisher","first-page":"3034","DOI":"10.1109\/jsac.2023.3310058","volume":"41","author":"Y Zhang","year":"2023","unstructured":"Zhang Y, Hu J, Min G (2023) Digital twin-driven intelligent task offloading for collaborative mobile edge computing. IEEE J Sel Areas Commun 41(10):3034\u20133045. https:\/\/doi.org\/10.1109\/jsac.2023.3310058","journal-title":"IEEE J Sel Areas Commun"},{"key":"5747_CR33","doi-asserted-by":"publisher","unstructured":"Zhao L, Bi Z, Hawbani A, Yu K, Zhang Y, Guizani M (2022) Elite: An intelligent digital twin-based hierarchical routing scheme for softwarized vehicular networks. IEEE Trans Mobile Comput 1\u20131. https:\/\/doi.org\/10.1109\/tmc.2022.3179254","DOI":"10.1109\/tmc.2022.3179254"},{"key":"5747_CR34","doi-asserted-by":"publisher","first-page":"110544","DOI":"10.1016\/j.ymssp.2023.110544","volume":"200","author":"Q Ni","year":"2023","unstructured":"Ni Q, Ji JC, Halkon B, Feng K, Nandi AK (2023) Physics-informed residual network (piresnet) for rolling element bearing fault diagnostics. Mechanical Systems and Signal Processing 200:110544. https:\/\/doi.org\/10.1016\/j.ymssp.2023.110544","journal-title":"Mechanical Systems and Signal Processing"},{"issue":"4","key":"5747_CR35","doi-asserted-by":"publisher","first-page":"3393","DOI":"10.1109\/tap.2023.3245281","volume":"71","author":"T Shan","year":"2023","unstructured":"Shan T, Zeng J, Song X, Guo R, Li M, Yang F, Xu S (2023) Physics-informed supervised residual learning for electromagnetic modeling. IEEE Trans Antennas Propag 71(4):3393\u20133407. https:\/\/doi.org\/10.1109\/tap.2023.3245281","journal-title":"IEEE Trans Antennas Propag"},{"key":"5747_CR36","doi-asserted-by":"publisher","unstructured":"Bozkaya E, Bilen T, Erel-\u00d6z\u00e7evik M, \u00d6z\u00e7evik Y (2023) Energy-aware task scheduling for digital twin edge networks in 6g. https:\/\/doi.org\/10.1109\/smartnets58706.2023.10215892","DOI":"10.1109\/smartnets58706.2023.10215892"},{"key":"5747_CR37","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1016\/j.ymssp.2018.05.050","volume":"115","author":"R Zhao","year":"2019","unstructured":"Zhao R, Yan R, Chen Z, Mao K, Wang P, Gao RX (2019) Deep learning and its applications to machine health monitoring. Mechanical Systems and Signal Processing 115:213\u2013237. https:\/\/doi.org\/10.1016\/j.ymssp.2018.05.050","journal-title":"Mechanical Systems and Signal Processing"},{"key":"5747_CR38","doi-asserted-by":"publisher","unstructured":"Bajao NA, Sarucam J-a (2023) Threats detection in the internet of things using convolutional neural networks, long short-term memory, and gated recurrent units. Mesopotamian J Cyber Secur 22\u201329. https:\/\/doi.org\/10.58496\/mjcs\/2023\/005","DOI":"10.58496\/mjcs\/2023\/005"},{"key":"5747_CR39","doi-asserted-by":"publisher","first-page":"113389","DOI":"10.1016\/j.oceaneng.2022.113389","volume":"268","author":"Y Yevnin","year":"2023","unstructured":"Yevnin Y, Chorev S, Dukan I, Toledo Y (2023) Short-term wave forecasts using gated recurrent unit model. Ocean Engineering 268:113389. https:\/\/doi.org\/10.1016\/j.oceaneng.2022.113389","journal-title":"Ocean Engineering"},{"issue":"3","key":"5747_CR40","doi-asserted-by":"publisher","first-page":"01","DOI":"10.52783\/dxjb.v35.113","volume":"35","author":"Mohan Raparthy Ea","year":"2023","unstructured":"Mohan Raparthy Ea (2023) Predictive maintenance in IoT devices using time series analysis and deep learning. Dandao Xuebao\/Journal of Ballistics 35(3):01\u201310. https:\/\/doi.org\/10.52783\/dxjb.v35.113","journal-title":"Dandao Xuebao\/Journal of Ballistics"},{"key":"5747_CR41","doi-asserted-by":"publisher","first-page":"645","DOI":"10.1016\/j.procs.2023.03.082","volume":"220","author":"H Meriem","year":"2023","unstructured":"Meriem H, Nora H, Samir O (2023) Predictive maintenance for smart industrial systems: A roadmap. Procedia Computer Science 220:645\u2013650. https:\/\/doi.org\/10.1016\/j.procs.2023.03.082","journal-title":"Procedia Computer Science"},{"key":"5747_CR42","doi-asserted-by":"publisher","unstructured":"Sang GM, Xu L, Vrieze P (2021) A predictive maintenance model for flexible manufacturing in the context of industry 4.0. Frontiers in Big Data 4. https:\/\/doi.org\/10.3389\/fdata.2021.663466","DOI":"10.3389\/fdata.2021.663466"},{"issue":"20","key":"5747_CR43","doi-asserted-by":"publisher","first-page":"7151","DOI":"10.1080\/00207543.2022.2140221","volume":"61","author":"B Rolf","year":"2022","unstructured":"Rolf B, Jackson I, M\u00fcller M, Lang S, Reggelin T, Ivanov D (2022) A review on reinforcement learning algorithms and applications in supply chain management. Int J Prod Res 61(20):7151\u20137179. https:\/\/doi.org\/10.1080\/00207543.2022.2140221","journal-title":"Int J Prod Res"},{"issue":"16","key":"5747_CR44","doi-asserted-by":"publisher","first-page":"5772","DOI":"10.1080\/00207543.2022.2104180","volume":"61","author":"A Esteso","year":"2022","unstructured":"Esteso A, Peidro D, Mula J, D\u00edaz-Madro\u00f1ero M (2022) Reinforcement learning applied to production planning and control. Int J Prod Res 61(16):5772\u20135789. https:\/\/doi.org\/10.1080\/00207543.2022.2104180","journal-title":"Int J Prod Res"},{"key":"5747_CR45","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1016\/j.cirpj.2022.11.003","volume":"40","author":"C Li","year":"2023","unstructured":"Li C, Zheng P, Yin Y, Wang B, Wang L (2023) Deep reinforcement learning in smart manufacturing: A review and prospects. CIRP J Manuf Sci Technol 40:75\u2013101. https:\/\/doi.org\/10.1016\/j.cirpj.2022.11.003","journal-title":"CIRP J Manuf Sci Technol"},{"key":"5747_CR46","unstructured":"Institute of Electrical and Electronics Engineers (2024) IEEE Xplore Digital Library. https:\/\/ieeexplore.ieee.org. Accessed 23 Feb 2024"},{"key":"5747_CR47","unstructured":"Elsevier BV (2024) ScienceDirect. https:\/\/www.sciencedirect.com. Accessed 23 Feb 2024"},{"key":"5747_CR48","unstructured":"Google LLC (2024) Google Scholar. https:\/\/scholar.google.com. Accessed 23 Feb 2024"},{"key":"5747_CR49","doi-asserted-by":"publisher","unstructured":"Developers TensorFlow (2021). TensorFlow Zenodo. https:\/\/doi.org\/10.5281\/ZENODO.4758419","DOI":"10.5281\/ZENODO.4758419"},{"key":"5747_CR50","doi-asserted-by":"publisher","unstructured":"Imambi S, Prakash KB, Kanagachidambaresan GR (2021) In: Publishing SI (ed) PyTorch, pp 87\u2013104. https:\/\/doi.org\/10.1007\/978-3-030-57077-4_10","DOI":"10.1007\/978-3-030-57077-4_10"},{"key":"5747_CR51","doi-asserted-by":"publisher","unstructured":"Manessi F, Rozza A, Bianco S, Napoletano P, Schettini R (2018) Automated Pruning for Deep Neural Network Compression. IEEE. https:\/\/doi.org\/10.1109\/icpr.2018.8546129","DOI":"10.1109\/icpr.2018.8546129"},{"key":"5747_CR52","doi-asserted-by":"publisher","unstructured":"Demidovskij A, Smirnov E (2020) Effective Post-Training Quantization Of Neural Networks For Inference on Low Power Neural Accelerator. IEEE. https:\/\/doi.org\/10.1109\/ijcnn48605.2020.9207281","DOI":"10.1109\/ijcnn48605.2020.9207281"},{"key":"5747_CR53","doi-asserted-by":"publisher","unstructured":"Zhang Y, Ding W, Liu C (2019) Summary of convolutional neural network compression technology. In: IEEE (ed) 2019 IEEE International Conference on Unmanned Systems (ICUS). https:\/\/doi.org\/10.1109\/icus48101.2019.8995969","DOI":"10.1109\/icus48101.2019.8995969"},{"key":"5747_CR54","doi-asserted-by":"publisher","unstructured":"Ma L, Cheng N, Wang X, Yin Z, Zhou H, Quan W (2023) Distilling Knowledge from Resource Management Algorithms to Neural Networks: A Unified Training Assistance Approach. IEEE. https:\/\/doi.org\/10.1109\/vtc2023-fall60731.2023.10333602","DOI":"10.1109\/vtc2023-fall60731.2023.10333602"},{"issue":"10","key":"5747_CR55","doi-asserted-by":"publisher","first-page":"1345","DOI":"10.1109\/tkde.2009.191","volume":"22","author":"SJ Pan","year":"2010","unstructured":"Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345\u20131359. https:\/\/doi.org\/10.1109\/tkde.2009.191","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"5747_CR56","doi-asserted-by":"publisher","unstructured":"Dupuis E, Novo D, O\u2019Connor I, Bosio A (2020) Sensitivity analysis and compression opportunities in DNNs using weight sharing. In: IEEE (ed) 2020 23rd International Symposium on Design and Diagnostics of Electronic Circuits and Systems (DDECS). https:\/\/doi.org\/10.1109\/ddecs50862.2020.9095658","DOI":"10.1109\/ddecs50862.2020.9095658"},{"key":"5747_CR57","doi-asserted-by":"publisher","first-page":"3218","DOI":"10.1109\/jstars.2023.3244616","volume":"16","author":"J Li","year":"2023","unstructured":"Li J, Chen J, Cheng P, Yu Z, Yu L, Chi C (2023) A survey on deep-learning-based real-time SAR ship detection. IEEE J Sel Topics Appl Earth Obs Remote Sens 16:3218\u20133247. https:\/\/doi.org\/10.1109\/jstars.2023.3244616","journal-title":"IEEE J Sel Topics Appl Earth Obs Remote Sens"},{"key":"5747_CR58","doi-asserted-by":"publisher","unstructured":"Prasad KPSP (2021) Compressed MobilenetV3: an efficient CNN for resource constrained platforms. https:\/\/doi.org\/10.25394\/PGS.14442710.V1","DOI":"10.25394\/PGS.14442710.V1"},{"issue":"20","key":"5747_CR59","doi-asserted-by":"publisher","first-page":"10468","DOI":"10.3390\/app122010468","volume":"12","author":"Y Lu","year":"2022","unstructured":"Lu Y, Ni R, Wen J (2022) Model compression and acceleration: Lip recognition based on channel-level structured pruning. Appl Sci 12(20):10468. https:\/\/doi.org\/10.3390\/app122010468","journal-title":"Appl Sci"},{"key":"5747_CR60","doi-asserted-by":"publisher","unstructured":"Tantawy D, Zahran M, Wassal A (2021) A survey on GAN acceleration using memory compression techniques. J Eng Appl Sci 68(1). https:\/\/doi.org\/10.1186\/s44147-021-00045-5","DOI":"10.1186\/s44147-021-00045-5"},{"key":"5747_CR61","doi-asserted-by":"publisher","unstructured":"Dupuis E, Novo D, O\u2019Connor I, Bosio A (2020) On the automatic exploration of weight sharing for deep neural network compression. In: IEEE (ed) 2020 Design, automation and test in Europe conference and exhibition (DATE). https:\/\/doi.org\/10.23919\/date48585.2020.9116350","DOI":"10.23919\/date48585.2020.9116350"},{"issue":"1","key":"5747_CR62","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1109\/tnnls.2020.3027634","volume":"33","author":"T-B Xu","year":"2022","unstructured":"Xu T-B, Liu C-L (2022) Deep neural network self-distillation exploiting data representation invariance. IEEE Trans Neural Netw Learn Syst 33(1):257\u2013269. https:\/\/doi.org\/10.1109\/tnnls.2020.3027634","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"4","key":"5747_CR63","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3487045","volume":"16","author":"M Gupta","year":"2022","unstructured":"Gupta M, Agrawal P (2022) Compression of deep learning models for text: A survey. ACM Trans Knowl Discov Data 16(4):1\u201355. https:\/\/doi.org\/10.1145\/3487045","journal-title":"ACM Trans Knowl Discov Data"},{"key":"5747_CR64","doi-asserted-by":"publisher","unstructured":"Lioutas V, Rashid A, Kumar K, Haidar MA, Rezagholizadeh M (2020) Improving word embedding factorization for compression using distilled nonlinear neural decomposition. In: Computational\u00a0Linguistics A (ed) Findings of the Association for Computational Linguistics: EMNLP 2020. https:\/\/doi.org\/10.18653\/v1\/2020.findings-emnlp.250","DOI":"10.18653\/v1\/2020.findings-emnlp.250"},{"issue":"16","key":"5747_CR65","doi-asserted-by":"publisher","first-page":"14284","DOI":"10.1609\/aaai.v35i16.17680","volume":"35","author":"F Yuan","year":"2021","unstructured":"Yuan F, Shou L, Pei J, Lin W, Gong M, Fu Y, Jiang D (2021) Reinforced multi-teacher selection for knowledge distillation. Proc AAAI Conf Artif Intell 35(16):14284\u201314291. https:\/\/doi.org\/10.1609\/aaai.v35i16.17680","journal-title":"Proc AAAI Conf Artif Intell"},{"key":"5747_CR66","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-023-17192-x","author":"Z Lyu","year":"2023","unstructured":"Lyu Z, Yu T, Pan F, Zhang Y, Luo J et al (2023) A survey of model compression strategies for object detection. Multimed Tools Appl. https:\/\/doi.org\/10.1007\/s11042-023-17192-x","journal-title":"Multimed Tools Appl"},{"issue":"4","key":"5747_CR67","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3398209","volume":"53","author":"Y Chen","year":"2020","unstructured":"Chen Y, Zheng B, Zhang Z, Wang Q, Shen C, Zhang Q (2020) Deep learning on mobile and embedded devices: State-of-the-art, challenges, and future directions. ACM Comput Surv 53(4):1\u201337. https:\/\/doi.org\/10.1145\/3398209","journal-title":"ACM Comput Surv"},{"key":"5747_CR68","doi-asserted-by":"publisher","unstructured":"Chen C-J, Chen K-C, Martin-Kuo M-c (2018) Acceleration of neural network model execution on embedded systems. In: IEEE (ed.) 2018 International Symposium on VLSI Design, Automation and Test (VLSI-DAT). https:\/\/doi.org\/10.1109\/vlsi-dat.2018.8373246","DOI":"10.1109\/vlsi-dat.2018.8373246"},{"issue":"4","key":"5747_CR69","doi-asserted-by":"publisher","first-page":"485","DOI":"10.1109\/jproc.2020.2976475","volume":"108","author":"BL Deng","year":"2020","unstructured":"Deng BL, Li G, Han S, Shi L, Xie Y (2020) Model compression and hardware acceleration for neural networks: A comprehensive survey. Proc IEEE 108(4):485\u2013532. https:\/\/doi.org\/10.1109\/jproc.2020.2976475","journal-title":"Proc IEEE"},{"issue":"9","key":"5747_CR70","doi-asserted-by":"publisher","first-page":"6650","DOI":"10.1109\/jiot.2021.3111723","volume":"9","author":"E Russo","year":"2022","unstructured":"Russo E, Palesi M, Monteleone S, Patti D et al (2022) DNN model compression for IoT domain-specific hardware accelerators. IEEE Internet Things J 9(9):6650\u20136662. https:\/\/doi.org\/10.1109\/jiot.2021.3111723","journal-title":"IEEE Internet Things J"},{"issue":"3","key":"5747_CR71","doi-asserted-by":"publisher","first-page":"60","DOI":"10.3390\/computers12030060","volume":"12","author":"Z Li","year":"2023","unstructured":"Li Z, Li H, Meng L (2023) Model compression for deep neural networks: A survey. Computers 12(3):60. https:\/\/doi.org\/10.3390\/computers12030060","journal-title":"Computers"},{"key":"5747_CR72","doi-asserted-by":"publisher","first-page":"325","DOI":"10.54097\/hset.v4i.920","volume":"4","author":"H He","year":"2022","unstructured":"He H, Huang L, Huang Z, Yang T (2022) The compression techniques applied on deep learning model. Highlights in Science, Engineering and Technology 4:325\u2013331. https:\/\/doi.org\/10.54097\/hset.v4i.920","journal-title":"Highlights in Science, Engineering and Technology"},{"key":"5747_CR73","doi-asserted-by":"publisher","unstructured":"Zhao P, Yuan G, Cai Y, Niu W, Liu Q et al (2021) Neural pruning search for real-time object detection of autonomous vehicles. In: IEEE (ed) 2021 58th ACM\/IEEE Design Automation Conference (DAC). https:\/\/doi.org\/10.1109\/dac18074.2021.9586163","DOI":"10.1109\/dac18074.2021.9586163"},{"issue":"5s","key":"5747_CR74","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3477006","volume":"20","author":"A Malawade","year":"2021","unstructured":"Malawade A, Odema M, Lajeunesse-degroot S, Al Faruque MA (2021) SAGE: A split-architecture methodology for efficient end-to-end autonomous vehicle control. ACM Trans Embed Comput Syst 20(5s):1\u201322. https:\/\/doi.org\/10.1145\/3477006","journal-title":"ACM Trans Embed Comput Syst"},{"issue":"10","key":"5747_CR75","doi-asserted-by":"publisher","first-page":"11006","DOI":"10.1109\/tvt.2022.3184994","volume":"71","author":"J Yang","year":"2022","unstructured":"Yang J, Wang Y, Zhao H, Gui G (2022) MobileNet and knowledge distillation-based automatic scenario recognition method in vehicle-to-vehicle systems. IEEE Trans Veh Technol 71(10):11006\u201311016. https:\/\/doi.org\/10.1109\/tvt.2022.3184994","journal-title":"IEEE Trans Veh Technol"},{"key":"5747_CR76","doi-asserted-by":"publisher","unstructured":"Shen S, Yu C, Zhang K, Chen X, Chen H, Ci S (2021) Communication-efficient federated learning for connected vehicles with constrained resources. In: IEEE (ed) 2021 International Wireless Communications and Mobile Computing (IWCMC). https:\/\/doi.org\/10.1109\/iwcmc51323.2021.9498677","DOI":"10.1109\/iwcmc51323.2021.9498677"},{"issue":"4","key":"5747_CR77","doi-asserted-by":"publisher","first-page":"663","DOI":"10.1109\/jetcas.2021.3121259","volume":"11","author":"R Pinkham","year":"2021","unstructured":"Pinkham R, Berkovich A, Zhang Z (2021) Near-sensor distributed DNN processing for augmented and virtual reality. IEEE J Emerg Sel Top Circ Syst 11(4):663\u2013676. https:\/\/doi.org\/10.1109\/jetcas.2021.3121259","journal-title":"IEEE J Emerg Sel Top Circ Syst"},{"key":"5747_CR78","doi-asserted-by":"publisher","unstructured":"Fiala G, Ye Z, Steger C (2022) Pupil detection for augmented and virtual reality based on images with reduced bit depths. In: IEEE (ed) 2022 IEEE Sensors Applications Symposium (SAS). https:\/\/doi.org\/10.1109\/sas54819.2022.9881378","DOI":"10.1109\/sas54819.2022.9881378"},{"issue":"18","key":"5747_CR79","doi-asserted-by":"publisher","first-page":"15788","DOI":"10.1109\/jiot.2023.3265848","volume":"10","author":"D Wu","year":"2023","unstructured":"Wu D, Yang Z, Zhang P, Wang R, Yang B, Ma X (2023) Virtual-reality interpromotion technology for metaverse: A survey. IEEE Internet Things J 10(18):15788\u201315809. https:\/\/doi.org\/10.1109\/jiot.2023.3265848","journal-title":"IEEE Internet Things J"},{"key":"5747_CR80","doi-asserted-by":"publisher","unstructured":"Sun Y, Yuan F, Yang M, Wei G, Zhao Z, Liu D (2020) A generic network compression framework for sequential recommender systems. In: ACM (ed) Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. SIGIR \u201920. https:\/\/doi.org\/10.1145\/3397271.3401125","DOI":"10.1145\/3397271.3401125"},{"issue":"9","key":"5747_CR81","doi-asserted-by":"publisher","first-page":"6087","DOI":"10.1080\/03772063.2021.1997357","volume":"69","author":"FO Isinkaye","year":"2021","unstructured":"Isinkaye FO (2021) Matrix factorization in recommender systems: Algorithms, applications, and peculiar challenges. IETE J Res 69(9):6087\u20136100. https:\/\/doi.org\/10.1080\/03772063.2021.1997357","journal-title":"IETE J Res"},{"key":"5747_CR82","doi-asserted-by":"publisher","unstructured":"Jo Y-Y et al (2021) Impact of image compression on deep learning-based mammogram classification. Sci Rep 11(1). https:\/\/doi.org\/10.1038\/s41598-021-86726-w","DOI":"10.1038\/s41598-021-86726-w"},{"key":"5747_CR83","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2022\/7088137","volume":"2022","author":"X Liu","year":"2022","unstructured":"Liu X, Zhang L, Guo Z, Han T, Ju M, Xu B, Liu H (2022) Medical image compression based on variational autoencoder. Math Probl Eng 2022:1\u201312. https:\/\/doi.org\/10.1155\/2022\/7088137","journal-title":"Math Probl Eng"},{"issue":"12","key":"5747_CR84","doi-asserted-by":"publisher","first-page":"5664","DOI":"10.1109\/tnnls.2020.3027308","volume":"32","author":"FE Fernandes","year":"2021","unstructured":"Fernandes FE, Yen GG (2021) Automatic searching and pruning of deep neural networks for medical imaging diagnostic. IEEE Trans Neural Netw Learn Syst 32(12):5664\u20135674. https:\/\/doi.org\/10.1109\/tnnls.2020.3027308","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"5747_CR85","doi-asserted-by":"publisher","unstructured":"Tang H, Cen X (2021) A survey of transfer learning applied in medical image recognition. In: IEEE (ed) 2021 IEEE International conference on advances in electrical engineering and computer applications (AEECA). https:\/\/doi.org\/10.1109\/aeeca52519.2021.9574368","DOI":"10.1109\/aeeca52519.2021.9574368"},{"issue":"15","key":"5747_CR86","doi-asserted-by":"publisher","first-page":"13638","DOI":"10.1109\/jiot.2022.3145865","volume":"9","author":"P Prakash","year":"2022","unstructured":"Prakash P, Ding J, Chen R, Qin X, Shu M et al (2022) IoT device friendly and communication-efficient federated learning via joint model pruning and quantization. IEEE Internet Things J 9(15):13638\u201313650. https:\/\/doi.org\/10.1109\/jiot.2022.3145865","journal-title":"IEEE Internet Things J"},{"key":"5747_CR87","doi-asserted-by":"publisher","unstructured":"Shang F, Lai J, Chen J, Xia W, Liu H (2021) A model compression based framework for electrical equipment intelligent inspection on edge computing environment. In: IEEE (ed) 2021 IEEE 6th international conference on cloud computing and big data analytics (ICCCBDA). https:\/\/doi.org\/10.1109\/icccbda51879.2021.9442600","DOI":"10.1109\/icccbda51879.2021.9442600"},{"key":"5747_CR88","doi-asserted-by":"publisher","unstructured":"Elgawi O, Mutawa AM (2020) Low power deep-learning architecture for mobile IoT intelligence. In: IEEE (ed) 2020 IEEE international conference on informatics, IoT, and enabling technologies (ICIoT). https:\/\/doi.org\/10.1109\/iciot48696.2020.9089642","DOI":"10.1109\/iciot48696.2020.9089642"},{"key":"5747_CR89","doi-asserted-by":"publisher","unstructured":"Han S, Mao H, Dally WJ (2015) Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1510.00149","DOI":"10.48550\/arXiv.1510.00149"},{"key":"5747_CR90","doi-asserted-by":"publisher","unstructured":"Lee K, Hwangbo S, Yang D, Lee G (2023) Compression of deep-learning models through global weight pruning using alternating direction method of multipliers. Int J Comput Intell Syst 16(1). https:\/\/doi.org\/10.1007\/s44196-023-00202-z","DOI":"10.1007\/s44196-023-00202-z"},{"issue":"4","key":"5747_CR91","doi-asserted-by":"publisher","first-page":"2704","DOI":"10.3390\/app13042704","volume":"13","author":"G Cai","year":"2023","unstructured":"Cai G, Li J, Liu X, Chen Z, Zhang H (2023) Learning and compressing: Low-rank matrix factorization for deep neural network compression. Appl Sci 13(4):2704. https:\/\/doi.org\/10.3390\/app13042704","journal-title":"Appl Sci"},{"key":"5747_CR92","doi-asserted-by":"publisher","unstructured":"Hsu Y-C, Hua T, Chang S, Lou Q, Shen Y, Jin H (2022) Language model compression with weighted low-rank factorization. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2207.00112","DOI":"10.48550\/arXiv.2207.00112"},{"key":"5747_CR93","doi-asserted-by":"publisher","unstructured":"Suau X, Zappella u, Apostoloff N (2020) Filter distillation for network compression. In: IEEE (ed) 2020 IEEE Winter conference on applications of computer vision (WACV). https:\/\/doi.org\/10.1109\/wacv45572.2020.9093546","DOI":"10.1109\/wacv45572.2020.9093546"},{"issue":"2","key":"5747_CR94","doi-asserted-by":"publisher","first-page":"819","DOI":"10.1007\/s10044-020-00940-2","volume":"24","author":"SW Prakosa","year":"2020","unstructured":"Prakosa SW, Leu J-S, Chen Z-H (2020) Improving the accuracy of pruned network using knowledge distillation. Pattern Anal Appl 24(2):819\u2013830. https:\/\/doi.org\/10.1007\/s10044-020-00940-2","journal-title":"Pattern Anal Appl"},{"key":"5747_CR95","doi-asserted-by":"publisher","unstructured":"Howard AG, Zhu M, Chen B, Kalenichenko D et al (2017) MobileNets: Efficient Convolutional neural networks for mobile vision applications. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1704.04861","DOI":"10.48550\/arXiv.1704.04861"},{"key":"5747_CR96","doi-asserted-by":"publisher","unstructured":"Iandola FN, Han S, Moskewicz MW, Ashraf K et al (2016) SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and $$<$$ 0.5MB model size. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1602.07360","DOI":"10.48550\/arXiv.1602.07360"},{"issue":"17","key":"5747_CR97","doi-asserted-by":"publisher","first-page":"3598","DOI":"10.3390\/electronics12173598","volume":"12","author":"M Li","year":"2023","unstructured":"Li M, Zhang X, Guo J, Li F (2023) Cloud\u2013edge collaborative inference with network pruning. Electronics 12(17):3598. https:\/\/doi.org\/10.3390\/electronics12173598","journal-title":"Electronics"},{"issue":"5","key":"5747_CR98","doi-asserted-by":"publisher","first-page":"1576","DOI":"10.1109\/tcsii.2021.3069011","volume":"68","author":"J Meng","year":"2021","unstructured":"Meng J, Yang L, Peng X, Yu S, Fan D, Seo J-S (2021) Structured pruning of RRAM crossbars for efficient in-memory computing acceleration of deep neural networks. IEEE Trans Circuits Syst II Express Briefs 68(5):1576\u20131580. https:\/\/doi.org\/10.1109\/tcsii.2021.3069011","journal-title":"IEEE Trans Circuits Syst II Express Briefs"},{"key":"5747_CR99","doi-asserted-by":"publisher","unstructured":"Liu J, Zhuang B, Zhuang Z, Guo Y et al (2021) Discrimination-aware network pruning for deep model compression. IEEE Trans Pattern Anal Mach Intell 1\u20131. https:\/\/doi.org\/10.1109\/tpami.2021.3066410","DOI":"10.1109\/tpami.2021.3066410"},{"key":"5747_CR100","doi-asserted-by":"publisher","unstructured":"Lee S-T, Lim S, Bae J-H, Kwon et al (2020) Pruning for hardware-based deep spiking neural networks using gated schottky diode as synaptic devices. J Nanosci Nanotechnol 20(11):6603\u20136608. https:\/\/doi.org\/10.1166\/jnn.2020.18772","DOI":"10.1166\/jnn.2020.18772"},{"key":"5747_CR101","doi-asserted-by":"publisher","unstructured":"Helal\u00a0Uddin M, Baidya S (2023) Optimizing neural network efficiency with hybrid magnitude-based and node pruning for energy-efficient computing in IoT. In: ACM (ed) Proceedings of the 8th ACM\/IEEE Conference on Internet of Things Design and Implementation. IoTDI\u201923. https:\/\/doi.org\/10.1145\/3576842.3589175","DOI":"10.1145\/3576842.3589175"},{"key":"5747_CR102","doi-asserted-by":"publisher","unstructured":"Shabani H, Singh A, Youhana B, Guo X (2023) HIRAC: A hierarchical accelerator with sorting-based packing for SpGEMMs in DNN applications. In: IEEE (ed) 2023 IEEE International Symposium on High-Performance Computer Architecture (HPCA). https:\/\/doi.org\/10.1109\/hpca56546.2023.10070977","DOI":"10.1109\/hpca56546.2023.10070977"},{"issue":"9","key":"5747_CR103","doi-asserted-by":"publisher","first-page":"4930","DOI":"10.1109\/tnnls.2021.3063265","volume":"33","author":"X Ma","year":"2022","unstructured":"Ma X, Lin S, Ye S, He Z et al (2022) Non-structured DNN weight pruning\u2014is it beneficial in any platform? IEEE Trans Neural Netw Learn Syst 33(9):4930\u20134944. https:\/\/doi.org\/10.1109\/tnnls.2021.3063265","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"11","key":"5747_CR104","doi-asserted-by":"publisher","first-page":"4694","DOI":"10.1109\/tcad.2022.3144616","volume":"41","author":"F Yu","year":"2022","unstructured":"Yu F, Xu Z, Liu C, Stamoulis D et al (2022) AntiDoteX: Attention-based dynamic optimization for neural network runtime efficiency. IEEE Trans Comput Aided Des Integr Circuits Syst 41(11):4694\u20134707. https:\/\/doi.org\/10.1109\/tcad.2022.3144616","journal-title":"IEEE Trans Comput Aided Des Integr Circuits Syst"},{"issue":"10","key":"5747_CR105","doi-asserted-by":"publisher","first-page":"8715","DOI":"10.1609\/aaai.v35i10.17056","volume":"35","author":"Y Liu","year":"2021","unstructured":"Liu Y, Lin Z, Yuan F (2021) ROSITA: Refined bert compression with integrated techniques. Proc AAAI Conf Artif Intell 35(10):8715\u20138722. https:\/\/doi.org\/10.1609\/aaai.v35i10.17056","journal-title":"Proc AAAI Conf Artif Intell"},{"key":"5747_CR106","doi-asserted-by":"publisher","unstructured":"Zhang J, Chen X, Song M, Li T (2019) Eager pruning: algorithm and architecture support for fast training of deep neural networks. In: ACM (ed) Proceedings of the 46th international symposium on computer architecture. ISCA\u201919. https:\/\/doi.org\/10.1145\/3307650.3322263","DOI":"10.1145\/3307650.3322263"},{"key":"5747_CR107","doi-asserted-by":"publisher","unstructured":"Huang G, Li H, Qin M, Sun F, Ding Y, Xie Y (2022) Shfl-bw: accelerating deep neural network inference with tensor-core aware weight pruning. In: ACM (ed) Proceedings of the 59th ACM\/IEEE design automation conference. DAC\u201922. https:\/\/doi.org\/10.1145\/3489517.3530588","DOI":"10.1145\/3489517.3530588"},{"key":"5747_CR108","doi-asserted-by":"publisher","unstructured":"Zhao X, Yao Y, Wu H, Zhang X (2021) Structural watermarking to deep neural networks via network channel pruning. In: IEEE (ed) 2021 IEEE international workshop on information forensics and security (WIFS). https:\/\/doi.org\/10.1109\/wifs53200.2021.9648376","DOI":"10.1109\/wifs53200.2021.9648376"},{"key":"5747_CR109","doi-asserted-by":"publisher","unstructured":"Hu P, Peng X, Zhu H, Aly MMS, Lin J (2022) OPQ: Compressing Deep Neural Networks with One-shot Pruning-Quantization. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2205.11141","DOI":"10.48550\/arXiv.2205.11141"},{"key":"5747_CR110","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/tgrs.2021.3077062","volume":"60","author":"X Guo","year":"2022","unstructured":"Guo X, Hou B, Ren B, Ren Z, Jiao L (2022) Network pruning for remote sensing images classification based on interpretable CNNs. IEEE Trans Geosci Remote Sens 60:1\u201315. https:\/\/doi.org\/10.1109\/tgrs.2021.3077062","journal-title":"IEEE Trans Geosci Remote Sens"},{"issue":"2","key":"5747_CR111","doi-asserted-by":"publisher","first-page":"10","DOI":"10.17706\/ijcce.2022.11.2.10-23","volume":"11","author":"Q Song","year":"2022","unstructured":"Song Q, Xia X (2022) A survey on pruning algorithm based on optimized depth neural network. Int J Comput Commun Eng 11(2):10\u201323. https:\/\/doi.org\/10.17706\/ijcce.2022.11.2.10-23","journal-title":"Int J Comput Commun Eng"},{"key":"5747_CR112","doi-asserted-by":"publisher","unstructured":"Ghosh S, Prasad K, Dai X, Zhang P et al (2023) Pruning Compact ConvNets for Efficient Inference. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2301.04502","DOI":"10.48550\/arXiv.2301.04502"},{"key":"5747_CR113","unstructured":"Balasubramaniam S, Kavitha DV (2013) A survey on data retrieval techniques in cloud computing 8:15. https:\/\/api.semanticscholar.org\/CorpusID:15715742"},{"key":"5747_CR114","doi-asserted-by":"publisher","unstructured":"Saqib E, Leal IS, Shallari I, Jantsch A, Krug S, O\u2019Nils M (2023) Optimizing the IoT performance: A case study on pruning a distributed CNN. In: IEEE (ed) 2023 IEEE sensors applications symposium (SAS). https:\/\/doi.org\/10.1109\/sas58821.2023.10254054","DOI":"10.1109\/sas58821.2023.10254054"},{"key":"5747_CR115","doi-asserted-by":"publisher","unstructured":"Touvron H et al (2023) Llama 2: Open Foundation and Fine-Tuned Chat Models. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2307.09288","DOI":"10.48550\/arXiv.2307.09288"},{"key":"5747_CR116","doi-asserted-by":"publisher","unstructured":"Kim J, Chang S, Kwak N (2021) PQK: Model compression via pruning, quantization, and knowledge distillation. In: ISCA (ed) Interspeech 2021. https:\/\/doi.org\/10.21437\/interspeech.2021-248","DOI":"10.21437\/interspeech.2021-248"},{"key":"5747_CR117","doi-asserted-by":"publisher","unstructured":"Long Y, Lee E, Kim D, Mukhopadhyay S (2020) Q-PIM: A genetic algorithm based flexible DNN quantization method and application to processing-in-memory platform. In: IEEE (ed) 2020 57th ACM\/IEEE design automation conference (DAC). https:\/\/doi.org\/10.1109\/dac18072.2020.9218737","DOI":"10.1109\/dac18072.2020.9218737"},{"key":"5747_CR118","doi-asserted-by":"publisher","unstructured":"Liu F, Yang N, Jiang L (2023) PSQ: An automatic search framework for data-free quantization on pim-based architecture. In: IEEE (ed) 2023 IEEE 41st international conference on computer design (ICCD). https:\/\/doi.org\/10.1109\/iccd58817.2023.00084","DOI":"10.1109\/iccd58817.2023.00084"},{"key":"5747_CR119","doi-asserted-by":"publisher","unstructured":"Guo K, Sui L, Qiu J, Yao S, Han S, Wang Y, Yang H (2016) From model to FPGA: Software-hardware co-design for efficient neural network acceleration. In: IEEE (ed) 2016 IEEE Hot Chips 28 Symposium (HCS). https:\/\/doi.org\/10.1109\/hotchips.2016.7936208","DOI":"10.1109\/hotchips.2016.7936208"},{"key":"5747_CR120","doi-asserted-by":"publisher","unstructured":"Liu X, Li B, Chen Z, Yuan Y (2021) Exploring gradient flow based saliency for DNN model compression. In: ACM (ed) Proceedings of the 29th ACM international conference on multimedia. MM \u201921. https:\/\/doi.org\/10.1145\/3474085.3475474","DOI":"10.1145\/3474085.3475474"},{"issue":"3","key":"5747_CR121","doi-asserted-by":"publisher","first-page":"923","DOI":"10.1109\/tpds.2022.3230840","volume":"34","author":"H Jin","year":"2023","unstructured":"Jin H, Wu D, Zhang S, Zou X et al (2023) Design of a quantization-based DNN delta compression framework for model snapshots and federated learning. IEEE Trans Parallel Distrib Syst 34(3):923\u2013937. https:\/\/doi.org\/10.1109\/tpds.2022.3230840","journal-title":"IEEE Trans Parallel Distrib Syst"},{"issue":"5","key":"5747_CR122","doi-asserted-by":"publisher","first-page":"696","DOI":"10.1109\/tc.2020.2995593","volume":"70","author":"C Gong","year":"2021","unstructured":"Gong C, Chen Y, Lu Y, Li T, Hao C, Chen D (2021) Vecq: Minimal loss DNN model compression with vectorized weight quantization. IEEE Trans Comput 70(5):696\u2013710. https:\/\/doi.org\/10.1109\/tc.2020.2995593","journal-title":"IEEE Trans Comput"},{"issue":"15","key":"5747_CR123","doi-asserted-by":"publisher","first-page":"5623","DOI":"10.3390\/s22155623","volume":"22","author":"M Zhao","year":"2022","unstructured":"Zhao M, Tong X, Wu W, Wang Z, Zhou B, Huang X (2022) A novel deep-learning model compression based on filter-stripe group pruning and its IoT application. Sensors 22(15):5623. https:\/\/doi.org\/10.3390\/s22155623","journal-title":"Sensors"},{"key":"5747_CR124","doi-asserted-by":"publisher","unstructured":"Suo J, Zhang X, Zhang S, Zhou W, Shi W (2021) Feasibility analysis of machine learning optimization on GPU-based low-cost edges. In: IEEE (ed) 2021 IEEE SmartWorld, ubiquitous intelligence and computing, advanced and trusted computing, scalable computing and communications, internet of people and smart city innovation (SmartWorld\/SCALCOM\/UIC\/ATC\/IOP\/SCI). https:\/\/doi.org\/10.1109\/swc50871.2021.00022","DOI":"10.1109\/swc50871.2021.00022"},{"issue":"1","key":"5747_CR125","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3492327","volume":"4","author":"RA Manzano Sanchez","year":"2022","unstructured":"Manzano Sanchez RA, Naik K, Albasir A, Zaman M, Goel N (2022) Detection of anomalous behavior of smartphone devices using changepoint analysis and machine learning techniques. Digital Threats: Research and Practice 4(1):1\u201328. https:\/\/doi.org\/10.1145\/3492327","journal-title":"Digital Threats: Research and Practice"},{"issue":"17","key":"5747_CR126","doi-asserted-by":"publisher","first-page":"2176","DOI":"10.3390\/electronics10172176","volume":"10","author":"J Liu","year":"2021","unstructured":"Liu J, Wang Q, Zhang D, Shen L (2021) Super-resolution model quantized in multi-precision. Electronics 10(17):2176. https:\/\/doi.org\/10.3390\/electronics10172176","journal-title":"Electronics"},{"key":"5747_CR127","doi-asserted-by":"publisher","unstructured":"Ma H, Qiu et al (2024) Quantization backdoors to deep learning commercial frameworks. IEEE Trans Dependable Secure Comput 1\u201318. https:\/\/doi.org\/10.1109\/tdsc.2023.3271956","DOI":"10.1109\/tdsc.2023.3271956"},{"key":"5747_CR128","doi-asserted-by":"publisher","unstructured":"Wang Z, Li JB, Qu S, Metze F, Strubell E (2022) SQuAT: Sharpness- and Quantization-Aware Training for BERT. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2210.07171. arxiv:2210.07171","DOI":"10.48550\/arXiv.2210.07171"},{"issue":"2","key":"5747_CR129","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3386599","volume":"11","author":"H Lu","year":"2020","unstructured":"Lu H, Chen X, Shi J, Vaidya J, Atluri V, Hong Y, Huang W (2020) Algorithms and applications to weighted rank-one binary matrix factorization. ACM Trans Manag Inf Syst 11(2):1\u201333. https:\/\/doi.org\/10.1145\/3386599","journal-title":"ACM Trans Manag Inf Syst"},{"key":"5747_CR130","doi-asserted-by":"publisher","unstructured":"Goyal S, Roy\u00a0Choudhury A, Sharma V (2019) Compression of deep neural networks by combining pruning and low rank decomposition. In: IEEE (ed) 2019 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW). https:\/\/doi.org\/10.1109\/ipdpsw.2019.00162","DOI":"10.1109\/ipdpsw.2019.00162"},{"key":"5747_CR131","doi-asserted-by":"publisher","unstructured":"Yin M, Sui Y, Liao S, Yuan B (2021) Towards efficient tensor decomposition-based DNN model compression with optimization framework. In: IEEE (ed) 2021 IEEE\/CVF conference on computer vision and pattern recognition (CVPR). https:\/\/doi.org\/10.1109\/cvpr46437.2021.01053","DOI":"10.1109\/cvpr46437.2021.01053"},{"issue":"11","key":"5747_CR132","doi-asserted-by":"publisher","first-page":"6916","DOI":"10.1109\/tnnls.2021.3083931","volume":"33","author":"J Xue","year":"2022","unstructured":"Xue J, Zhao Y, Huang S, Liao W et al (2022) Multilayer sparsity-based tensor decomposition for low-rank tensor completion. IEEE Trans Neural Netw Learn Syst 33(11):6916\u20136930. https:\/\/doi.org\/10.1109\/tnnls.2021.3083931","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"5747_CR133","doi-asserted-by":"publisher","first-page":"2502","DOI":"10.1109\/tsp.2022.3173470","volume":"70","author":"Z Long","year":"2022","unstructured":"Long Z, Zhu C, Liu J, Comon P, Liu Y (2022) Trainable subspaces for low rank tensor completion: Model and analysis. IEEE Transactions on Signal Processing 70:2502\u20132517. https:\/\/doi.org\/10.1109\/tsp.2022.3173470","journal-title":"IEEE Transactions on Signal Processing"},{"key":"5747_CR134","doi-asserted-by":"publisher","unstructured":"Chen W, Wilson J, Tyree S, Weinberger KQ, Chen Y (2016) Compressing convolutional neural networks in the frequency domain. In: ACM (ed) Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. KDD \u201916. https:\/\/doi.org\/10.1145\/2939672.2939839","DOI":"10.1145\/2939672.2939839"},{"key":"5747_CR135","doi-asserted-by":"publisher","unstructured":"Chen S, Sun W, Huang L, Yang X, Huang J (2019) Compressing fully connected layers using kronecker tensor decomposition. In: IEEE (ed) 2019 IEEE 7th international conference on computer science and network technology (ICCSNT). https:\/\/doi.org\/10.1109\/iccsnt47585.2019.8962432","DOI":"10.1109\/iccsnt47585.2019.8962432"},{"key":"5747_CR136","doi-asserted-by":"publisher","unstructured":"Yu X, Liu T, Wang X, Tao D (2017) On compressing deep models by low rank and sparse decomposition. In: IEEE (ed) 2017 IEEE conference on computer vision and pattern recognition (CVPR). https:\/\/doi.org\/10.1109\/cvpr.2017.15","DOI":"10.1109\/cvpr.2017.15"},{"issue":"12","key":"5747_CR137","doi-asserted-by":"publisher","first-page":"2889","DOI":"10.1109\/tpami.2018.2873305","volume":"41","author":"S Lin","year":"2019","unstructured":"Lin S, Ji R, Chen C, Tao D, Luo J (2019) Holistic CNN compression via low-rank decomposition with knowledge transfer. IEEE Trans Pattern Anal Mach Intell 41(12):2889\u20132905. https:\/\/doi.org\/10.1109\/tpami.2018.2873305","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"5747_CR138","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/tgrs.2023.3284481","volume":"61","author":"W Li","year":"2023","unstructured":"Li W, Wang Y, Liu N, Xiao C, Sun Z, Du Q (2023) Integrated spatio-spectral-temporal fusion via anisotropic sparsity constrained low-rank tensor approximation. IEEE Trans Geosci Remote Sens 61:1\u201316. https:\/\/doi.org\/10.1109\/tgrs.2023.3284481","journal-title":"IEEE Trans Geosci Remote Sens"},{"key":"5747_CR139","doi-asserted-by":"publisher","DOI":"10.1145\/3639364","author":"Z Yang","year":"2023","unstructured":"Yang Z, Zhang Y, Sui D, Ju Y, Zhao J, Liu K (2023) Explanation guided knowledge distillation for pre-trained language model compression. ACM Trans Asian Low-Resource Lang Inf Process. https:\/\/doi.org\/10.1145\/3639364","journal-title":"ACM Trans Asian Low-Resource Lang Inf Process"},{"issue":"9","key":"5747_CR140","doi-asserted-by":"publisher","first-page":"7945","DOI":"10.1609\/aaai.v35i9.16969","volume":"35","author":"M Ji","year":"2021","unstructured":"Ji M, Heo B, Park S (2021) Show, attend and distill: Knowledge distillation via attention-based feature matching. Proc AAAI Conf Artif Intell 35(9):7945\u20137952. https:\/\/doi.org\/10.1609\/aaai.v35i9.16969","journal-title":"Proc AAAI Conf Artif Intell"},{"issue":"13","key":"5747_CR141","doi-asserted-by":"publisher","first-page":"4525","DOI":"10.1080\/00207543.2022.2160501","volume":"61","author":"Y Li","year":"2023","unstructured":"Li Y, Hu F, Liu Y, Ryan M, Wang R (2023) A hybrid model compression approach via knowledge distillation for predicting energy consumption in additive manufacturing. Int J Prod Res 61(13):4525\u20134547. https:\/\/doi.org\/10.1080\/00207543.2022.2160501","journal-title":"Int J Prod Res"},{"key":"5747_CR142","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1109\/ticps.2023.3320630","volume":"1","author":"Q Xu","year":"2023","unstructured":"Xu Q, Wu M, Li X, Mao K, Chen Z (2023) Contrastive distillation with regularized knowledge for deep model compression on sensor-based human activity recognition. IEEE Trans Ind Cyber-Physical Syst 1:217\u2013226. https:\/\/doi.org\/10.1109\/ticps.2023.3320630","journal-title":"IEEE Trans Ind Cyber-Physical Syst"},{"key":"5747_CR143","doi-asserted-by":"publisher","unstructured":"Tan S, Tam et al (2023) GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language Model. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2306.06629","DOI":"10.48550\/arXiv.2306.06629"},{"key":"5747_CR144","doi-asserted-by":"publisher","unstructured":"Ravikumar D, Saha G, Aketi SA, Roy K (2023) Homogenizing Non-IID datasets via In-Distribution Knowledge Distillation for Decentralized Learning. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2304.04326","DOI":"10.48550\/arXiv.2304.04326"},{"key":"5747_CR145","doi-asserted-by":"publisher","unstructured":"Wu Z, Sun S, Wang Y, Liu M, Jiang X, Li R, Gao B (2023) Survey of Knowledge Distillation in Federated Edge Learning. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2301.05849","DOI":"10.48550\/arXiv.2301.05849"},{"key":"5747_CR146","doi-asserted-by":"publisher","unstructured":"Wang R, Li Z, Yang J, Cao T et al (2023) Mutually-paced knowledge distillation for cross-lingual temporal knowledge graph reasoning. In: ACM (ed) Proceedings of the ACM Web Conference 2023. WWW \u201923. https:\/\/doi.org\/10.1145\/3543507.3583407","DOI":"10.1145\/3543507.3583407"},{"key":"5747_CR147","doi-asserted-by":"publisher","unstructured":"Hou Y, Zhu X, Ma Y, Loy CC, Li Y (2022) Point-to-voxel knowledge distillation for lidar semantic segmentation. In: IEEE (ed) 2022 IEEE\/CVF conference on computer vision and pattern recognition (CVPR). https:\/\/doi.org\/10.1109\/cvpr52688.2022.00829","DOI":"10.1109\/cvpr52688.2022.00829"},{"issue":"8","key":"5747_CR148","doi-asserted-by":"publisher","first-page":"10555","DOI":"10.1109\/tpami.2023.3257546","volume":"45","author":"Z Li","year":"2023","unstructured":"Li Z, Xu P, Chang X, Yang L, Zhang Y, Yao L, Chen X (2023) When object detection meets knowledge distillation: A survey. IEEE Trans Pattern Anal Mach Intell 45(8):10555\u201310579. https:\/\/doi.org\/10.1109\/tpami.2023.3257546","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"5747_CR149","doi-asserted-by":"publisher","unstructured":"Dewan JH, Das R, Thepade SD, Jadhav H et al (2023) Image classification by transfer learning using pre-trained CNN models. In: IEEE (ed) 2023 International Conference on Recent Advances in Electrical, Electronics, Ubiquitous Communication, and Computational Intelligence (RAEEUCCI). https:\/\/doi.org\/10.1109\/raeeucci57140.2023.10134069","DOI":"10.1109\/raeeucci57140.2023.10134069"},{"issue":"11","key":"5747_CR150","doi-asserted-by":"publisher","first-page":"5645","DOI":"10.3390\/app12115645","volume":"12","author":"N Ullah","year":"2022","unstructured":"Ullah N, Khan JA, Khan MS, Khan W et al (2022) An effective approach to detect and identify brain tumors using transfer learning. Appl Sci 12(11):5645. https:\/\/doi.org\/10.3390\/app12115645","journal-title":"Appl Sci"},{"issue":"2","key":"5747_CR151","doi-asserted-by":"publisher","first-page":"663","DOI":"10.1002\/mrm.28148","volume":"84","author":"SUH Dar","year":"2020","unstructured":"Dar SUH, \u00d6zbey M, \u00c7atl\u0131 AB, \u00c7ukur T (2020) A transfer-learning approach for accelerated MRI using deep neural networks. Magn Reson Med 84(2):663\u2013685. https:\/\/doi.org\/10.1002\/mrm.28148","journal-title":"Magn Reson Med"},{"key":"5747_CR152","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1016\/j.aiia.2021.12.002","volume":"6","author":"AS Paymode","year":"2022","unstructured":"Paymode AS, Malode VB (2022) Transfer learning for multi-crop leaf disease image classification using convolutional neural network VGG. Artificial Intelligence in Agriculture 6:23\u201333. https:\/\/doi.org\/10.1016\/j.aiia.2021.12.002","journal-title":"Artificial Intelligence in Agriculture"},{"key":"5747_CR153","doi-asserted-by":"publisher","unstructured":"N K, Narasimha\u00a0Prasad LV, Pavan\u00a0Kumar CS, Subedi B et al (2021) Rice leaf diseases prediction using deep neural networks with transfer learning. Environ Res 198:111275. https:\/\/doi.org\/10.1016\/j.envres.2021.111275","DOI":"10.1016\/j.envres.2021.111275"},{"issue":"3","key":"5747_CR154","doi-asserted-by":"publisher","first-page":"545","DOI":"10.1007\/s41348-021-00465-8","volume":"129","author":"S Vallabhajosyula","year":"2021","unstructured":"Vallabhajosyula S, Sistla V, Kolli VKK (2021) Transfer learning-based deep ensemble neural network for plant leaf disease detection. J Plant Dis Prot 129(3):545\u2013558. https:\/\/doi.org\/10.1007\/s41348-021-00465-8","journal-title":"J Plant Dis Prot"},{"key":"5747_CR155","doi-asserted-by":"publisher","unstructured":"Chai C, Maceira M, Santos-Villalobos HJ et al (2020) Using a deep neural network and transfer learning to bridge scales for seismic phase picking. Geophys Res Lett 47(16). https:\/\/doi.org\/10.1029\/2020gl088651","DOI":"10.1029\/2020gl088651"},{"issue":"10","key":"5747_CR156","doi-asserted-by":"publisher","first-page":"6902","DOI":"10.1080\/03772063.2022.2083027","volume":"69","author":"J Glory Precious","year":"2022","unstructured":"Glory Precious J, Angeline Kirubha SP, Keren Evangeline I (2022) Deployment of a mobile application using a novel deep neural network and advanced pre-trained models for the identification of brain tumours. IETE Journal of Research 69(10):6902\u20136914. https:\/\/doi.org\/10.1080\/03772063.2022.2083027","journal-title":"IETE Journal of Research"},{"key":"5747_CR157","doi-asserted-by":"publisher","unstructured":"Han L, Gladkoff S, Erofeev G, Sorokina I, Galiano B, Nenadic G (2023) Neural Machine Translation of Clinical Text: An Empirical Investigation into Multilingual Pre-Trained Language Models and Transfer-Learning. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2312.07250","DOI":"10.48550\/arXiv.2312.07250"},{"issue":"1","key":"5747_CR158","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1016\/j.bbe.2021.11.004","volume":"42","author":"P Kora","year":"2022","unstructured":"Kora P, Ooi CP, Faust O, Raghavendra U et al (2022) Transfer learning techniques for medical image analysis: A review. Biocybern Biomed Eng 42(1):79\u2013107. https:\/\/doi.org\/10.1016\/j.bbe.2021.11.004","journal-title":"Biocybern Biomed Eng"},{"key":"5747_CR159","doi-asserted-by":"publisher","unstructured":"Sasikala S, Ramesh S, Gomathi S, Balambigai S, Anbumani V (2021) Transfer learning based recurrent neural network algorithm for linguistic analysis. Concurr Comput Pract Experience 34(5). https:\/\/doi.org\/10.1002\/cpe.6708","DOI":"10.1002\/cpe.6708"},{"key":"5747_CR160","doi-asserted-by":"publisher","unstructured":"Akhauri S, Zheng LY, Lin MC (2020) Enhanced transfer learning for autonomous driving with systematic accident simulation. In: IEEE (ed) 2020 IEEE\/RSJ international conference on intelligent robots and systems (IROS). https:\/\/doi.org\/10.1109\/iros45743.2020.9341538","DOI":"10.1109\/iros45743.2020.9341538"},{"key":"5747_CR161","doi-asserted-by":"publisher","unstructured":"Feng T, Narayanan S (2023) PEFT-SER: On the Use of Parameter Efficient Transfer Learning Approaches For Speech Emotion Recognition Using Pre-trained Speech Models. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2306.05350","DOI":"10.48550\/arXiv.2306.05350"},{"issue":"7","key":"5747_CR162","doi-asserted-by":"publisher","first-page":"5930","DOI":"10.3390\/su15075930","volume":"15","author":"AW Salehi","year":"2023","unstructured":"Salehi AW, Khan S, Gupta G, Alabduallah BI et al (2023) A study of CNN and transfer learning in medical imaging: Advantages, challenges, future scope. Sustainability 15(7):5930. https:\/\/doi.org\/10.3390\/su15075930","journal-title":"Sustainability"},{"key":"5747_CR163","doi-asserted-by":"publisher","unstructured":"No\u00e9 IT, Costa LHL, Medeiros TH (2023) Masked faces: Overcoming recognition challenges with transfer learning in cnns. In: Computa\u00e7\u00e3o - SBC SB (ed) Anais do XI Symposium on Knowledge Discovery, Mining and Learning (KDMiLe 2023). KDMiLe 2023. https:\/\/doi.org\/10.5753\/kdmile.2023.232907","DOI":"10.5753\/kdmile.2023.232907"},{"issue":"3","key":"5747_CR164","doi-asserted-by":"publisher","first-page":"445","DOI":"10.3390\/electronics9030445","volume":"9","author":"L Alzubaidi","year":"2020","unstructured":"Alzubaidi L, Al-Shamma O, Fadhel MA, Farhan L, Zhang J, Duan Y (2020) Optimizing the performance of breast cancer classification by employing the same domain transfer learning from hybrid deep convolutional neural network model. Electronics 9(3):445. https:\/\/doi.org\/10.3390\/electronics9030445","journal-title":"Electronics"},{"key":"5747_CR165","doi-asserted-by":"publisher","unstructured":"Askarizadeh M, Morsali A, Nguyen KK (2024) Resource-constrained multisource instance-based transfer learning. IEEE Trans Neural Netw Learn Syst 1\u201315. https:\/\/doi.org\/10.1109\/tnnls.2023.3327248","DOI":"10.1109\/tnnls.2023.3327248"},{"key":"5747_CR166","doi-asserted-by":"publisher","first-page":"108487","DOI":"10.1016\/j.ymssp.2021.108487","volume":"167","author":"W Li","year":"2022","unstructured":"Li W, Huang R, Li J, Liao Y, Chen Z et al (2022) A perspective survey on deep transfer learning for fault diagnosis in industrial scenarios: Theories, applications and challenges. Mechanical Systems and Signal Processing 167:108487. https:\/\/doi.org\/10.1016\/j.ymssp.2021.108487","journal-title":"Mechanical Systems and Signal Processing"},{"key":"5747_CR167","doi-asserted-by":"publisher","unstructured":"Aghbalou A, Staerman G (2023) Hypothesis Transfer Learning with Surrogate Classification Losses: Generalization Bounds through Algorithmic Stability. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2305.19694","DOI":"10.48550\/arXiv.2305.19694"},{"key":"5747_CR168","doi-asserted-by":"publisher","unstructured":"Chen Y, Liu L, Li J, Jiang H, Ding C, Zhou Z (2022) MetaLR: Meta-tuning of Learning Rates for Transfer Learning in Medical Imaging. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2206.01408","DOI":"10.48550\/arXiv.2206.01408"},{"key":"5747_CR169","doi-asserted-by":"publisher","unstructured":"Li Y, Li Z, Zhang T, Zhou P, Feng S, Yin K (2021) Design of a novel neural network compression method for tiny machine learning. In: ACM (ed) Proceedings of the 2021 5th International Conference on Electronic Information Technology and Computer Engineering. EITCE 2021. https:\/\/doi.org\/10.1145\/3501409.3501526","DOI":"10.1145\/3501409.3501526"},{"issue":"1","key":"5747_CR170","doi-asserted-by":"publisher","first-page":"012060","DOI":"10.1088\/1742-6596\/2580\/1\/012060","volume":"2580","author":"M Cai","year":"2023","unstructured":"Cai M, Su Y, Wang B, Zhang T (2023) Research on compression pruning methods based on deep learning. J Phys: Conf Ser 2580(1):012060. https:\/\/doi.org\/10.1088\/1742-6596\/2580\/1\/012060","journal-title":"J Phys: Conf Ser"},{"key":"5747_CR171","doi-asserted-by":"publisher","unstructured":"Hayder Z, He X, Salzmann M (2016) Learning to co-generate object proposals with a deep structured network. In: IEEE (ed) 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). https:\/\/doi.org\/10.1109\/cvpr.2016.281","DOI":"10.1109\/cvpr.2016.281"},{"issue":"12","key":"5747_CR172","doi-asserted-by":"publisher","first-page":"2295","DOI":"10.1109\/jproc.2017.2761740","volume":"105","author":"V Sze","year":"2017","unstructured":"Sze V, Chen Y-H, Yang T-J, Emer JS (2017) Efficient processing of deep neural networks: A tutorial and survey. Proc IEEE 105(12):2295\u20132329. https:\/\/doi.org\/10.1109\/jproc.2017.2761740","journal-title":"Proc IEEE"},{"key":"5747_CR173","doi-asserted-by":"publisher","unstructured":"Gholami A, Kwon K, Wu B, Tai Z, Yue X et al (2018) SqueezeNext: Hardware-Aware Neural Network Design. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1803.10615","DOI":"10.48550\/arXiv.1803.10615"},{"key":"5747_CR174","doi-asserted-by":"publisher","unstructured":"Sandler M, Howard A, Zhu M, Zhmoginov A, Chen L-C (2018) MobileNetV2: Inverted residuals and linear bottlenecks. In: IEEE (ed) 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition. https:\/\/doi.org\/10.1109\/cvpr.2018.00474","DOI":"10.1109\/cvpr.2018.00474"},{"key":"5747_CR175","doi-asserted-by":"publisher","unstructured":"Howard A, Sandler M, Chu G, Chen L-C, Chen B et al (2019) Searching for MobileNetV3. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1905.02244","DOI":"10.48550\/arXiv.1905.02244"},{"key":"5747_CR176","doi-asserted-by":"publisher","unstructured":"Tan M, Le QV (2019) EfficientNet: Rethinking model scaling for convolutional neural networks. https:\/\/doi.org\/10.48550\/arXiv.1905.11946","DOI":"10.48550\/arXiv.1905.11946"},{"key":"5747_CR177","doi-asserted-by":"publisher","unstructured":"Howard A, Sandler M, Chen et al (2019) Searching for MobileNetV3. https:\/\/doi.org\/10.1109\/iccv.2019.00140","DOI":"10.1109\/iccv.2019.00140"},{"key":"5747_CR178","doi-asserted-by":"publisher","unstructured":"Tan M, Chen B, Pang R, Vasudevan V, Sandler M, Howard A, Le QV (2019) Mnasnet: Platform-aware neural architecture search for mobile. https:\/\/doi.org\/10.1109\/cvpr.2019.00293","DOI":"10.1109\/cvpr.2019.00293"},{"key":"5747_CR179","doi-asserted-by":"publisher","DOI":"10.1109\/isssc50941.2020.9358903","author":"S Aghera","year":"2020","unstructured":"Aghera S, Gajera H, Mitra SK (2020). Mnasnet based lightweight CNN for facial expression recognition. https:\/\/doi.org\/10.1109\/isssc50941.2020.9358903","journal-title":"Mnasnet based lightweight CNN for facial expression recognition"},{"key":"5747_CR180","doi-asserted-by":"publisher","unstructured":"Zhang X, Zhou X, Lin M, Sun J (2017) ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1707.01083","DOI":"10.48550\/arXiv.1707.01083"},{"key":"5747_CR181","doi-asserted-by":"publisher","unstructured":"Ma N, Zhang X, Zheng H-T, Sun J (2018) ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1807.11164","DOI":"10.48550\/arXiv.1807.11164"},{"key":"5747_CR182","doi-asserted-by":"publisher","DOI":"10.1109\/icaecc54045.2022.9716637","author":"Y Arun","year":"2022","unstructured":"Arun Y, Viknesh GS (2022). Leaf classification for plant recognition using EfficientNet architecture. https:\/\/doi.org\/10.1109\/icaecc54045.2022.9716637","journal-title":"Leaf classification for plant recognition using EfficientNet architecture"},{"key":"5747_CR183","doi-asserted-by":"publisher","unstructured":"Mantha T, Eswara\u00a0Reddy B (2021) A transfer learning method for brain tumor classification using EfficientNet-b3 model. https:\/\/doi.org\/10.1109\/csitss54238.2021.9683036","DOI":"10.1109\/csitss54238.2021.9683036"},{"key":"5747_CR184","doi-asserted-by":"publisher","unstructured":"Tan M, Le QV (2021) EfficientNetV2: Smaller models and faster training. https:\/\/doi.org\/10.48550\/arXiv.2104.00298","DOI":"10.48550\/arXiv.2104.00298"},{"key":"5747_CR185","doi-asserted-by":"publisher","unstructured":"Zhang H, Wu C, Zhang Z, Zhu et al (2022) Resnest: Split-attention networks. https:\/\/doi.org\/10.1109\/cvprw56347.2022.00309","DOI":"10.1109\/cvprw56347.2022.00309"},{"key":"5747_CR186","doi-asserted-by":"publisher","unstructured":"Wang F, Pan C, Huang J (2022) Application of model compression technology based on knowledge distillation in convolutional neural network lightweight. In: IEEE (ed) 2022 China Automation Congress (CAC). https:\/\/doi.org\/10.1109\/cac57257.2022.10055501","DOI":"10.1109\/cac57257.2022.10055501"},{"key":"5747_CR187","doi-asserted-by":"publisher","first-page":"8386","DOI":"10.1109\/jstars.2021.3104267","volume":"14","author":"Z Wang","year":"2021","unstructured":"Wang Z, Du L, Li Y (2021) Boosting lightweight cnns through network pruning and knowledge distillation for SAR target recognition. IEEE J Sel Topics Appl Earth Obs Remote Sens 14:8386\u20138397. https:\/\/doi.org\/10.1109\/jstars.2021.3104267","journal-title":"IEEE J Sel Topics Appl Earth Obs Remote Sens"},{"key":"5747_CR188","doi-asserted-by":"publisher","unstructured":"Zhu X, Jiang Z, Lou Y (2023) Real-time lightweight hand detection model combined with network pruning. In: IEEE (ed) 2023 IEEE\/ACIS 23rd International Conference on Computer and Information Science (ICIS). https:\/\/doi.org\/10.1109\/icis57766.2023.10210237","DOI":"10.1109\/icis57766.2023.10210237"},{"key":"5747_CR189","doi-asserted-by":"publisher","unstructured":"Chen Z-C, Jhong S-Y, Hsia C-H (2021) Design of a lightweight palmf-vein authentication system based on model compression. J Inf Sci Eng 37(4) . https:\/\/doi.org\/10.6688\/JISE.202107_37(4).0005","DOI":"10.6688\/JISE.202107_37(4).0005"},{"key":"5747_CR190","doi-asserted-by":"publisher","DOI":"10.1111\/exsy.13516","author":"M Yasir","year":"2023","unstructured":"Yasir M, Ullah I, Choi C (2023) Depthwise channel attention network (DWCAN): An efficient and lightweight model for single image super-resolution and metaverse gaming. Expert Syst. https:\/\/doi.org\/10.1111\/exsy.13516","journal-title":"Expert Syst"},{"issue":"2","key":"5747_CR191","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/lsens.2023.3239343","volume":"7","author":"H Zhou","year":"2023","unstructured":"Zhou H, Liu A, Cui H, Bie Y, Chen X (2023) SleepNet-Lite: A novel lightweight convolutional neural network for single-channel EEG-based sleep staging. IEEE Sensors Letters 7(2):1\u20134. https:\/\/doi.org\/10.1109\/lsens.2023.3239343","journal-title":"IEEE Sensors Letters"},{"issue":"15","key":"5747_CR192","doi-asserted-by":"publisher","first-page":"2531","DOI":"10.3390\/diagnostics13152531","volume":"13","author":"Q Abbas","year":"2023","unstructured":"Abbas Q, Daadaa Y, Rashid U, Ibrahim MEA (2023) Assist-dermo: A lightweight separable vision transformer model for multiclass skin lesion classification. Diagnostics 13(15):2531. https:\/\/doi.org\/10.3390\/diagnostics13152531","journal-title":"Diagnostics"},{"key":"5747_CR193","doi-asserted-by":"publisher","unstructured":"Yu J, Yu X, Liu Y, Liu L, Peng X (2021) An 8-bit fixed point quantization method for sparse MobileNetV2. In: IEEE (ed) 2021 China Automation Congress (CAC). https:\/\/doi.org\/10.1109\/cac53003.2021.9727524","DOI":"10.1109\/cac53003.2021.9727524"},{"key":"5747_CR194","doi-asserted-by":"publisher","unstructured":"Xiaowei G, Hui T, Zhongjian D (2021) Structured attention knowledge distillation for lightweight networks. In: IEEE (ed) 2021 33rd Chinese Control and Decision Conference (CCDC). https:\/\/doi.org\/10.1109\/ccdc52312.2021.9601745","DOI":"10.1109\/ccdc52312.2021.9601745"},{"key":"5747_CR195","doi-asserted-by":"publisher","first-page":"83199","DOI":"10.1109\/access.2021.3086321","volume":"9","author":"EJ Crowley","year":"2021","unstructured":"Crowley EJ, Gray G, Turner J, Storkey A (2021) Substituting convolutions for neural network compression. IEEE Access 9:83199\u201383213. https:\/\/doi.org\/10.1109\/access.2021.3086321","journal-title":"IEEE Access"},{"issue":"6","key":"5747_CR196","doi-asserted-by":"publisher","first-page":"2706","DOI":"10.1109\/tnnls.2020.3007749","volume":"32","author":"P Wang","year":"2021","unstructured":"Wang P, He X, Chen Q, Cheng A, Liu Q, Cheng J (2021) Unsupervised network quantization via fixed-point factorization. IEEE Trans Neural Netw Learn Syst 32(6):2706\u20132720. https:\/\/doi.org\/10.1109\/tnnls.2020.3007749","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"5747_CR197","doi-asserted-by":"publisher","unstructured":"Chen X, Pan R, Wang X, Tian F, Tsui C-Y (2023) Late breaking results: Weight decay is all you need for neural network sparsification. In: IEEE (ed) 2023 60th ACM\/IEEE Design Automation Conference (DAC). https:\/\/doi.org\/10.1109\/dac56929.2023.10247950","DOI":"10.1109\/dac56929.2023.10247950"},{"key":"5747_CR198","doi-asserted-by":"publisher","unstructured":"Hu Y, Ye Q, Zhang Z, Lv J (2022) A layer-based sparsification method for distributed DNN training. In: IEEE (ed) 2022 IEEE 24th Int Conf on High Performance Computing and Communications (HPCC). https:\/\/doi.org\/10.1109\/hpcc-dss-smartcity-dependsys57074.2022.00209","DOI":"10.1109\/hpcc-dss-smartcity-dependsys57074.2022.00209"},{"key":"5747_CR199","doi-asserted-by":"publisher","unstructured":"Choi H, Bajic IV (2020) A lightweight model for deep frame prediction in video coding. In: IEEE (ed.) 2020 54th Asilomar Conference on Signals, Systems, and Computers. https:\/\/doi.org\/10.1109\/ieeeconf51394.2020.9443427","DOI":"10.1109\/ieeeconf51394.2020.9443427"},{"key":"5747_CR200","doi-asserted-by":"publisher","unstructured":"Cheng J, He R, Yuepeng E, Wu Y, You J, Li T (2020) Real-time encrypted traffic classification via lightweight neural networks. In: IEEE (ed) GLOBECOM 2020 - 2020 IEEE Global Communications Conference. https:\/\/doi.org\/10.1109\/globecom42002.2020.9322309","DOI":"10.1109\/globecom42002.2020.9322309"},{"key":"5747_CR201","doi-asserted-by":"publisher","unstructured":"Phan H-H, Ha CT, Nguyen TT (2020) Improving the efficiency of human action recognition using deep compression. In: IEEE (ed) 2020 International Conference on Multimedia Analysis and Pattern Recognition (MAPR). https:\/\/doi.org\/10.1109\/mapr49794.2020.9237772","DOI":"10.1109\/mapr49794.2020.9237772"},{"key":"5747_CR202","doi-asserted-by":"publisher","unstructured":"Kumar R, Chen GK, Ekin\u00a0Sumbul H, Knag et al (2020) A 9.0-TOPS\/W hash-based deep neural network accelerator enabling 128$$\\times $$ model compression in 10-nm FinFET CMOS. IEEE Solid-State Circ Lett 3:338\u2013341. https:\/\/doi.org\/10.1109\/lssc.2020.3019349","DOI":"10.1109\/lssc.2020.3019349"},{"key":"5747_CR203","doi-asserted-by":"publisher","unstructured":"Tu C-H, Lee J-H, Chan Y-M, Chen C-S (2020) Pruning depthwise separable convolutions for MobileNet compression. In: IEEE (ed.) 2020 international joint conference on neural networks (IJCNN). https:\/\/doi.org\/10.1109\/ijcnn48605.2020.9207259","DOI":"10.1109\/ijcnn48605.2020.9207259"},{"key":"5747_CR204","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-69244-5_6","author":"Y Zheng","year":"2021","unstructured":"Zheng Y, Zhou Y, Zhao Z, Yu D (2021). Adaptive Tensor-Train Decomposition for Neural Network Compression. https:\/\/doi.org\/10.1007\/978-3-030-69244-5_6","journal-title":"Adaptive Tensor-Train Decomposition for Neural Network Compression"},{"issue":"4","key":"5747_CR205","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1109\/mssc.2021.3111431","volume":"13","author":"M Hosseini","year":"2021","unstructured":"Hosseini M, Manjunath N, Kallakuri U, Mahmoodi H, Homayoun H, Mohsenin T (2021) Cyclic sparsely connected architectures: From foundations to applications. IEEE Solid-State Circuits Mag 13(4):64\u201376. https:\/\/doi.org\/10.1109\/mssc.2021.3111431","journal-title":"IEEE Solid-State Circuits Mag"},{"key":"5747_CR206","doi-asserted-by":"publisher","unstructured":"He C, Tan H, Huang S, Cheng R (2021) Efficient evolutionary neural architecture search by modular inheritable crossover. Swarm Evol Comput 64:100894. https:\/\/doi.org\/10.1016\/j.swevo.2021.100894","DOI":"10.1016\/j.swevo.2021.100894"},{"key":"5747_CR207","doi-asserted-by":"publisher","unstructured":"Lee J-G, Roh Y, Song H, Whang SE (2021) Machine learning robustness, fairness, and their convergence. In: ACM (ed.) Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. KDD \u201921. https:\/\/doi.org\/10.1145\/3447548.3470799","DOI":"10.1145\/3447548.3470799"},{"issue":"5s","key":"5747_CR208","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3358205","volume":"18","author":"K Bhardwaj","year":"2019","unstructured":"Bhardwaj K, Lin C-Y, Sartor A, Marculescu R (2019) Memory- and communication-aware model compression for distributed deep learning inference on IoT. ACM Trans Embed Comput Syst 18(5s):1\u201322. https:\/\/doi.org\/10.1145\/3358205","journal-title":"ACM Trans Embed Comput Syst"},{"key":"5747_CR209","doi-asserted-by":"publisher","unstructured":"Qin L, Sun J (2023) Model compression for data compression: Neural network based lossless compressor made practical. In: IEEE (ed) 2023 Data Compression Conference (DCC). https:\/\/doi.org\/10.1109\/dcc55655.2023.00013","DOI":"10.1109\/dcc55655.2023.00013"},{"key":"5747_CR210","doi-asserted-by":"publisher","unstructured":"Dwivedi R, Dave D, Naik et al (2023) Explainable AI (XAI): Core ideas, techniques, and solutions. ACM Comput Surv 55(9):1\u201333. https:\/\/doi.org\/10.1145\/3561048","DOI":"10.1145\/3561048"},{"key":"5747_CR211","doi-asserted-by":"publisher","first-page":"110324","DOI":"10.1016\/j.asoc.2023.110324","volume":"142","author":"B Pradhan","year":"2023","unstructured":"Pradhan B, Dikshit A, Lee S, Kim H (2023) An explainable AI (XAI) model for landslide susceptibility modeling. Applied Soft Computing 142:110324. https:\/\/doi.org\/10.1016\/j.asoc.2023.110324","journal-title":"Applied Soft Computing"},{"issue":"3","key":"5747_CR212","doi-asserted-by":"publisher","first-page":"1303","DOI":"10.1007\/s10994-023-06463-1","volume":"113","author":"S Yan","year":"2023","unstructured":"Yan S, Natarajan S, Joshi S, Khardon R, Tadepalli P (2023) Explainable models via compression of tree ensembles. Mach Learn 113(3):1303\u20131328. https:\/\/doi.org\/10.1007\/s10994-023-06463-1","journal-title":"Mach Learn"},{"key":"5747_CR213","doi-asserted-by":"publisher","unstructured":"Kim J, Ko G, Kim J-H, Lee C, Kim T, Youn C-H, Kim J-Y (2023) A 26.55tops\/w explainable AI processor with dynamic workload allocation and heat map compression\/pruning. https:\/\/doi.org\/10.1109\/cicc57935.2023.10121215","DOI":"10.1109\/cicc57935.2023.10121215"},{"key":"5747_CR214","doi-asserted-by":"publisher","unstructured":"Zee T, Lakshmana M, Nwogu I (2022) Towards understanding the behaviors of pretrained compressed convolutional models. In: 2022 26th International Conference on Pattern Recognition (ICPR). https:\/\/doi.org\/10.1109\/icpr56361.2022.9956037","DOI":"10.1109\/icpr56361.2022.9956037"},{"key":"5747_CR215","doi-asserted-by":"publisher","first-page":"106622","DOI":"10.1016\/j.knosys.2020.106622","volume":"212","author":"X He","year":"2021","unstructured":"He X, Zhao K, Chu X (2021) AutoML: A survey of the state-of-the-art. Knowledge-Based Systems 212:106622. https:\/\/doi.org\/10.1016\/j.knosys.2020.106622","journal-title":"Knowledge-Based Systems"},{"key":"5747_CR216","doi-asserted-by":"publisher","unstructured":"McCoy T, Pavlick E, Linzen T (2019) Right for the wrong reasons: Diagnosing syntactic heuristics in natural language inference. In: Computational\u00a0Linguistics A (ed) Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/p19-1334","DOI":"10.18653\/v1\/p19-1334"},{"issue":"7","key":"5747_CR217","doi-asserted-by":"publisher","first-page":"5113","DOI":"10.1007\/s10462-020-09816-7","volume":"53","author":"T Choudhary","year":"2020","unstructured":"Choudhary T, Mishra V, Goswami A, Sarangapani J (2020) A comprehensive survey on model compression and acceleration. Artif Intell Rev 53(7):5113\u20135155. https:\/\/doi.org\/10.1007\/s10462-020-09816-7","journal-title":"Artif Intell Rev"},{"key":"5747_CR218","doi-asserted-by":"publisher","unstructured":"Stoychev S, Gunes H (2022) The Effect of Model Compression on Fairness in Facial Expression Recognition. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2201.01709","DOI":"10.48550\/arXiv.2201.01709"},{"key":"5747_CR219","doi-asserted-by":"publisher","first-page":"100395","DOI":"10.1016\/j.mlwa.2022.100395","volume":"10","author":"S Ishaque","year":"2022","unstructured":"Ishaque S, Khan N, Krishnan S (2022) Detecting stress through 2D ECG images using pretrained models, transfer learning and model compression techniques. Mach Learn Appl 10:100395. https:\/\/doi.org\/10.1016\/j.mlwa.2022.100395","journal-title":"Mach Learn Appl"},{"key":"5747_CR220","doi-asserted-by":"publisher","unstructured":"Choudhury A, Balasubramaniam S, Kumar AP, Kumar SNP (2023) Psso: Political squirrel search optimizer-driven deep learning for severity level detection and classification of lung cancer. Int J Inf Technol Decis Making 1\u201334. https:\/\/doi.org\/10.1142\/s0219622023500189","DOI":"10.1142\/s0219622023500189"},{"key":"5747_CR221","doi-asserted-by":"publisher","unstructured":"Sun S, Cheng Y, Gan Z, Liu J (2019) Patient Knowledge Distillation for BERT Model Compression. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1908.09355","DOI":"10.48550\/arXiv.1908.09355"},{"issue":"10","key":"5747_CR222","doi-asserted-by":"publisher","first-page":"2938","DOI":"10.1109\/tc.2023.3278530","volume":"72","author":"X Shi","year":"2023","unstructured":"Shi X, Peng X, He L, Zhao Y, Jin H (2023) Waterwave: A GPU memory flow engine for concurrent DNN training. IEEE Trans Comput 72(10):2938\u20132950. https:\/\/doi.org\/10.1109\/tc.2023.3278530","journal-title":"IEEE Trans Comput"},{"key":"5747_CR223","doi-asserted-by":"publisher","unstructured":"Aguado-Puig Q, Doblas et al (2023) Wfa-GPU: gap-affine pairwise read-alignment using gpus. Bioinformatics 39(12). https:\/\/doi.org\/10.1093\/bioinformatics\/btad701","DOI":"10.1093\/bioinformatics\/btad701"},{"key":"5747_CR224","doi-asserted-by":"publisher","DOI":"10.1109\/icpads60453.2023.00240","author":"H Huang","year":"2023","unstructured":"Huang H, Li Y, Zhou X (2023) Accelerating Point Clouds Classification in Dynamic Graph CNN with GPU Tensor Core. IEEE. https:\/\/doi.org\/10.1109\/icpads60453.2023.00240","journal-title":"IEEE"},{"issue":"4","key":"5747_CR225","doi-asserted-by":"publisher","first-page":"947","DOI":"10.1111\/tgis.13163","volume":"28","author":"H Zeng","year":"2024","unstructured":"Zeng H, Wang H, Zhang B (2024) A high-performance cellular automata model for urban expansion simulation based on convolution and graphic processing unit. Trans GIS 28(4):947\u2013968. https:\/\/doi.org\/10.1111\/tgis.13163","journal-title":"Trans GIS"},{"key":"5747_CR226","doi-asserted-by":"publisher","unstructured":"Zhuang M-H, Shih C-Y, Lin H-C, Kang A, Wang Y-P (2024) High Speed Signal Design on Fan-Out RDL Interposer for Artificial Intelligence (AI) and Deep Neural Network (DNN) Chiplet Accelerators Application. IEEE. https:\/\/doi.org\/10.23919\/icep61562.2024.10535433","DOI":"10.23919\/icep61562.2024.10535433"},{"key":"5747_CR227","doi-asserted-by":"publisher","DOI":"10.1109\/assic60049.2024.10507954","author":"P Nagar","year":"2024","unstructured":"Nagar P, Boruah S, Bhoi AK, Patel A, Sarda J, Darjij P (2024) Emerging VLSI Technologies for High performance AI and ML Applications. IEEE. https:\/\/doi.org\/10.1109\/assic60049.2024.10507954","journal-title":"IEEE"},{"key":"5747_CR228","doi-asserted-by":"publisher","unstructured":"Chae H, Zhu K, Mutnury B, Wallace et al (2024) Isop+: Machine learning-assisted inverse stack-up optimization for advanced package design. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 43(1):2\u201315. https:\/\/doi.org\/10.1109\/tcad.2023.3305934","DOI":"10.1109\/tcad.2023.3305934"},{"key":"5747_CR229","doi-asserted-by":"publisher","DOI":"10.1109\/igarss52108.2023.10283416","author":"L Tian","year":"2023","unstructured":"Tian L, Sedona R, Mozaffari A, Kreshpa E, Paris C, Riedel M, Schultz MG, Cavallaro G (2023) End-to-End Process Orchestration of Earth Observation Data Workflows with Apache Airflow on High Performance Computing. IEEE. https:\/\/doi.org\/10.1109\/igarss52108.2023.10283416","journal-title":"IEEE"},{"key":"5747_CR230","doi-asserted-by":"publisher","unstructured":"Rajbhandari S, Rasley J, Ruwase O, He Y (2019) ZeRO: Memory Optimizations Toward Training Trillion Parameter Models. arXiv. https:\/\/doi.org\/10.48550\/ARXIV.1910.02054","DOI":"10.48550\/ARXIV.1910.02054"},{"key":"5747_CR231","doi-asserted-by":"publisher","unstructured":"Rajbhandari S, Ruwase O, Rasley J, Smith S, He Y (2021) ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning. Zenodo. https:\/\/doi.org\/10.5281\/ZENODO.5156596","DOI":"10.5281\/ZENODO.5156596"},{"issue":"22","key":"5747_CR232","doi-asserted-by":"publisher","first-page":"4589","DOI":"10.3390\/math11224589","volume":"11","author":"B Liu","year":"2023","unstructured":"Liu B, Hu B-B, Zhao M, Peng S-L, Chang J-M (2023) Model compression algorithm via reinforcement learning and knowledge distillation. Mathematics 11(22):4589. https:\/\/doi.org\/10.3390\/math11224589","journal-title":"Mathematics"},{"issue":"3","key":"5747_CR233","doi-asserted-by":"publisher","first-page":"1843","DOI":"10.11591\/ijeecs.v33.i3.pp1843-1854","volume":"33","author":"R Careem","year":"2024","unstructured":"Careem R, Md Johar MG, Khatibi A (2024) Deep neural networks optimization for resource-constrained environments: techniques and models. Indones J Electr Eng Comput Sci 33(3):1843. https:\/\/doi.org\/10.11591\/ijeecs.v33.i3.pp1843-1854","journal-title":"Indones J Electr Eng Comput Sci"},{"issue":"2","key":"5747_CR234","doi-asserted-by":"publisher","first-page":"75","DOI":"10.37934\/araset.43.2.7592","volume":"43","author":"MJK Abood","year":"2024","unstructured":"Abood MJK, Abdul-Majeed GH (2024) Enhancing multi-class ddos attack classification using machine learning techniques. J Adv Res Appl Sci Eng Technol 43(2):75\u201392. https:\/\/doi.org\/10.37934\/araset.43.2.7592","journal-title":"J Adv Res Appl Sci Eng Technol"},{"key":"5747_CR235","doi-asserted-by":"publisher","DOI":"10.1002\/aisy.202400161","author":"MB Hossain","year":"2024","unstructured":"Hossain MB, Gong N, Shaban M (2024) A novel attention-based layer pruning approach for low-complexity convolutional neural networks. Advanced Intelligent Systems. https:\/\/doi.org\/10.1002\/aisy.202400161","journal-title":"Advanced Intelligent Systems"},{"issue":"24","key":"5747_CR236","doi-asserted-by":"publisher","first-page":"4927","DOI":"10.3390\/math11244927","volume":"11","author":"X Xu","year":"2023","unstructured":"Xu X, Ma L, Zeng T, Huang Q (2023) Quantized graph neural networks for image classification. Mathematics 11(24):4927. https:\/\/doi.org\/10.3390\/math11244927","journal-title":"Mathematics"},{"key":"5747_CR237","doi-asserted-by":"publisher","DOI":"10.1109\/iccc59590.2023.10507503","author":"J Zhang","year":"2023","unstructured":"Zhang J, Liu X (2023) Design of low power LSTM neural network accelerator based on FPGA. IEEE. https:\/\/doi.org\/10.1109\/iccc59590.2023.10507503","journal-title":"IEEE"},{"issue":"2","key":"5747_CR238","doi-asserted-by":"publisher","first-page":"824","DOI":"10.3390\/s23020824","volume":"23","author":"X Sui","year":"2023","unstructured":"Sui X, Lv Q, Zhi L, Zhu B, Yang Y, Zhang Y, Tan Z (2023) A hardware-friendly high-precision CNN pruning method and its FPGA implementation. Sensors 23(2):824. https:\/\/doi.org\/10.3390\/s23020824","journal-title":"Sensors"},{"key":"5747_CR239","doi-asserted-by":"publisher","unstructured":"Ai C, Yang H, Ding Y, Tang J, Guo F (2023) Low rank matrix factorization algorithm based on multi-graph regularization for detecting drug-disease association. IEEE\/ACM Trans Comput Biol Bioinforma 1\u201311. https:\/\/doi.org\/10.1109\/tcbb.2023.3274587","DOI":"10.1109\/tcbb.2023.3274587"},{"issue":"4","key":"5747_CR240","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1515\/rnam-2023-0018","volume":"38","author":"EM Shcherbakova","year":"2023","unstructured":"Shcherbakova EM, Matveev SA, Smirnov AP, Tyrtyshnikov EE (2023) Study of performance of low-rank nonnegative tensor factorization methods. Russ J Numer Anal Math Model 38(4):231\u2013239. https:\/\/doi.org\/10.1515\/rnam-2023-0018","journal-title":"Russ J Numer Anal Math Model"},{"key":"5747_CR241","doi-asserted-by":"publisher","DOI":"10.1145\/3649153.3649183","author":"M Kokhazadeh","year":"2024","unstructured":"Kokhazadeh M, Keramidas G, Kelefouras V, Stamoulis I (2024) Denseflex: A Low Rank Factorization Methodology for Adaptable Dense Layers in DNNs. ACM. https:\/\/doi.org\/10.1145\/3649153.3649183","journal-title":"ACM"},{"issue":"2","key":"5747_CR242","doi-asserted-by":"publisher","first-page":"68","DOI":"10.37934\/araset.37.2.6881","volume":"37","author":"SA Latif","year":"2024","unstructured":"Latif SA, Sidek KA, Bakar EA, Hashim AHA (2024) Online multimodal compression using pruning and knowledge distillation for iris recognition. J Adv Res Appl Sci Eng Technol 37(2):68\u201381. https:\/\/doi.org\/10.37934\/araset.37.2.6881","journal-title":"J Adv Res Appl Sci Eng Technol"},{"key":"5747_CR243","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/tgrs.2024.3367778","volume":"62","author":"C Pang","year":"2024","unstructured":"Pang C, Weng X, Wu J, Wang Q, Xia G-S (2024) Hicd: Change detection in quality-varied images via hierarchical correlation distillation. IEEE Trans Geosci Remote Sens 62:1\u201316. https:\/\/doi.org\/10.1109\/tgrs.2024.3367778","journal-title":"IEEE Trans Geosci Remote Sens"},{"key":"5747_CR244","doi-asserted-by":"publisher","unstructured":"Cao K, Zhang T, Huang J (2024) Advanced hybrid lstm-transformer architecture for real-time multi-task prediction in engineering systems. Sci Reports 14(1). https:\/\/doi.org\/10.1038\/s41598-024-55483-x","DOI":"10.1038\/s41598-024-55483-x"},{"key":"5747_CR245","doi-asserted-by":"publisher","DOI":"10.1109\/iaeac59436.2024.10503620","author":"T Zhang","year":"2024","unstructured":"Zhang T (2024) Industrial Image Anomaly Localization Method based on Reverse Knowledge Distillation. IEEE. https:\/\/doi.org\/10.1109\/iaeac59436.2024.10503620","journal-title":"IEEE"},{"key":"5747_CR246","doi-asserted-by":"publisher","DOI":"10.1117\/12.3026364","author":"S Zhang","year":"2024","unstructured":"Zhang S, Pei Z, Ren Z (2024) Super-resolution knowledge-distillation-based low-resolution steel defect images classification. SPIE. https:\/\/doi.org\/10.1117\/12.3026364","journal-title":"SPIE"},{"issue":"5","key":"5747_CR247","doi-asserted-by":"publisher","first-page":"779","DOI":"10.1049\/iet-ipr.2018.6191","volume":"13","author":"W Yang","year":"2019","unstructured":"Yang W, Jin L, Wang S, Cu Z, Chen X, Chen L (2019) Thinning of convolutional neural network with mixed pruning. IET Image Proc 13(5):779\u2013784. https:\/\/doi.org\/10.1049\/iet-ipr.2018.6191","journal-title":"IET Image Proc"},{"key":"5747_CR248","doi-asserted-by":"publisher","unstructured":"Tan Z, Tan S-H, Lambrechts J-H, Zhang Y, Wu Y, Ma K (2021) A 400MHz NPU with 7.8TOPS2\/W High-PerformanceGuaranteed Efficiency in 55nm for Multi-Mode Pruning and Diverse Quantization Using Pattern-Kernel Encoding and Reconfigurable MAC Units. IEEE. https:\/\/doi.org\/10.1109\/cicc51472.2021.9431519","DOI":"10.1109\/cicc51472.2021.9431519"},{"issue":"2","key":"5747_CR249","doi-asserted-by":"publisher","first-page":"644","DOI":"10.1109\/tcad.2022.3178047","volume":"42","author":"X Chen","year":"2023","unstructured":"Chen X, Zhu J, Jiang J, Tsui C-Y (2023) Tight compression: Compressing CNN through fine-grained pruning and weight permutation for efficient implementation. IEEE Trans Comput Aided Des Integr Circuits Syst 42(2):644\u2013657. https:\/\/doi.org\/10.1109\/tcad.2022.3178047","journal-title":"IEEE Trans Comput Aided Des Integr Circuits Syst"},{"key":"5747_CR250","doi-asserted-by":"publisher","unstructured":"Dettmers T, Lewis M, Shleifer S, Zettlemoyer L (2021) 8-bit Optimizers via Block-wise Quantization. arXiv. https:\/\/doi.org\/10.48550\/ARXIV.2110.02861","DOI":"10.48550\/ARXIV.2110.02861"},{"key":"5747_CR251","doi-asserted-by":"publisher","unstructured":"Ren S, Zhu KQ (2023) Low-Rank Prune-And-Factorize for Language Model Compression. arXiv. https:\/\/doi.org\/10.48550\/ARXIV.2306.14152","DOI":"10.48550\/ARXIV.2306.14152"},{"issue":"15","key":"5747_CR252","doi-asserted-by":"publisher","first-page":"3311","DOI":"10.3390\/math11153311","volume":"11","author":"Y Ding","year":"2023","unstructured":"Ding Y, Chen D-R (2023) Optimization based layer-wise pruning threshold method for accelerating convolutional neural networks. Mathematics 11(15):3311. https:\/\/doi.org\/10.3390\/math11153311","journal-title":"Mathematics"},{"key":"5747_CR253","doi-asserted-by":"publisher","unstructured":"Wu Y, Schuster M, Chen et al (2016) Google\u2019s Neural Machine Translation System: Bridging the Gap between Human and Machine Translation. arXiv. https:\/\/doi.org\/10.48550\/ARXIV.1609.08144","DOI":"10.48550\/ARXIV.1609.08144"},{"issue":"6","key":"5747_CR254","doi-asserted-by":"publisher","first-page":"1323","DOI":"10.1109\/jlt.2020.2973718","volume":"38","author":"L Ge","year":"2020","unstructured":"Ge L, Zhang W, Liang C, He Z (2020) Compressed neural network equalization based on iterative pruning algorithm for 112-gbps vcsel-enabled optical interconnects. J Lightwave Technol 38(6):1323\u20131329. https:\/\/doi.org\/10.1109\/jlt.2020.2973718","journal-title":"J Lightwave Technol"},{"key":"5747_CR255","doi-asserted-by":"publisher","unstructured":"Cheng Y, Wang D, Zhou P, Zhang T (2017) A Survey of Model Compression and Acceleration for Deep Neural Networks. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1710.09282","DOI":"10.48550\/arXiv.1710.09282"},{"key":"5747_CR256","doi-asserted-by":"publisher","unstructured":"Nasution MA, Chahyati D, Fanany MI (2017) Faster R-CNN with structured sparsity learning and Ristretto for mobile environment. IEEE. https:\/\/doi.org\/10.1109\/icacsis.2017.8355051","DOI":"10.1109\/icacsis.2017.8355051"},{"key":"5747_CR257","doi-asserted-by":"publisher","unstructured":"Nie F, Hu Z, Wang X, Li X, Huang H (2022) Iteratively re-weighted method for sparsity-inducing norms. IEEE Trans Knowl Data Eng 1\u20131. https:\/\/doi.org\/10.1109\/tkde.2022.3179554","DOI":"10.1109\/tkde.2022.3179554"},{"key":"5747_CR258","doi-asserted-by":"publisher","unstructured":"Flores A, Lamare RC (2017) Sparsity-aware set-membership adaptive algorithms with adjustable penalties. IEEE. https:\/\/doi.org\/10.1109\/icdsp.2017.8096110","DOI":"10.1109\/icdsp.2017.8096110"},{"key":"5747_CR259","doi-asserted-by":"publisher","DOI":"10.1109\/isspit.2018.8705095","author":"AS Gaikwad","year":"2018","unstructured":"Gaikwad AS, El-Sharkawy M (2018) Pruning convolution neural network (SqueezeNet) using taylor expansion-based criterion. IEEE. https:\/\/doi.org\/10.1109\/isspit.2018.8705095","journal-title":"IEEE"},{"key":"5747_CR260","doi-asserted-by":"publisher","unstructured":"Zhou Z, Zhou Y, Jiang Z, Men A, Wang H (2022) An efficient method for model pruning using knowledge distillation with few samples. In: IEEE (ed) ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). https:\/\/doi.org\/10.1109\/icassp43922.2022.9746024","DOI":"10.1109\/icassp43922.2022.9746024"},{"key":"5747_CR261","doi-asserted-by":"publisher","unstructured":"Hartmann D, Herz M, Wever U (2018) Model Order Reduction a Key Technology for Digital Twins, pp 167\u2013179. Springer International Publishing. https:\/\/doi.org\/10.1007\/978-3-319-75319-5_8","DOI":"10.1007\/978-3-319-75319-5_8"},{"issue":"14","key":"5747_CR262","doi-asserted-by":"publisher","first-page":"5396","DOI":"10.3390\/s22145396","volume":"22","author":"M Segovia","year":"2022","unstructured":"Segovia M, Garcia-Alfaro J (2022) Design, modeling and implementation of digital twins. Sensors 22(14):5396. https:\/\/doi.org\/10.3390\/s22145396","journal-title":"Sensors"},{"key":"5747_CR263","doi-asserted-by":"publisher","first-page":"686","DOI":"10.1016\/j.jcp.2018.10.045","volume":"378","author":"M Raissi","year":"2019","unstructured":"Raissi M, Perdikaris P, Karniadakis GE (2019) Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. J Comput Phys 378:686\u2013707. https:\/\/doi.org\/10.1016\/j.jcp.2018.10.045","journal-title":"J Comput Phys"},{"key":"5747_CR264","doi-asserted-by":"publisher","first-page":"116805","DOI":"10.1016\/j.cma.2024.116805","volume":"421","author":"SJ Anagnostopoulos","year":"2024","unstructured":"Anagnostopoulos SJ, Toscano JD, Stergiopulos N, Karniadakis GE (2024) Residual-based attention in physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering 421:116805. https:\/\/doi.org\/10.1016\/j.cma.2024.116805","journal-title":"Computer Methods in Applied Mechanics and Engineering"},{"key":"5747_CR265","doi-asserted-by":"publisher","unstructured":"Jieyang P, Kimmig A, Dongkun W, Niu Z, Zhi et al (2022) A systematic review of data-driven approaches to fault diagnosis and early warning. J IntelManuf 34(8):3277\u20133304. https:\/\/doi.org\/10.1007\/s10845-022-02020-0","DOI":"10.1007\/s10845-022-02020-0"},{"issue":"5","key":"5747_CR266","doi-asserted-by":"publisher","first-page":"2327","DOI":"10.1007\/s10845-023-02151-y","volume":"35","author":"E Iunusova","year":"2023","unstructured":"Iunusova E, Gonzalez MK, Szipka K, Archenti A (2023) Early fault diagnosis in rolling element bearings: comparative analysis of a knowledge-based and a data-driven approach. J Intell Manuf 35(5):2327\u20132347. https:\/\/doi.org\/10.1007\/s10845-023-02151-y","journal-title":"J Intell Manuf"},{"issue":"9","key":"5747_CR267","doi-asserted-by":"publisher","first-page":"6069","DOI":"10.1109\/tii.2020.2967556","volume":"16","author":"A Essien","year":"2020","unstructured":"Essien A, Giannetti C (2020) A deep learning model for smart manufacturing using convolutional lstm neural network autoencoders. IEEE Trans Industr Inf 16(9):6069\u20136078. https:\/\/doi.org\/10.1109\/tii.2020.2967556","journal-title":"IEEE Trans Industr Inf"},{"issue":"1","key":"5747_CR268","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1002\/sys.21565","volume":"24","author":"H Nordal","year":"2020","unstructured":"Nordal H, El-Thalji I (2020) Modeling a predictive maintenance management architecture to meet industry 4.0 requirements: A case study. Syst Eng 24(1):34\u201350. https:\/\/doi.org\/10.1002\/sys.21565","journal-title":"Syst Eng"},{"key":"5747_CR269","doi-asserted-by":"publisher","first-page":"102712","DOI":"10.1016\/j.tre.2022.102712","volume":"162","author":"Y Yan","year":"2022","unstructured":"Yan Y, Chow AHF, Ho CP, Kuo Y-H, Wu Q, Ying C (2022) Reinforcement learning for logistics and supply chain management: Methodologies, state of the art, and future opportunities. Transportation Research Part E: Logistics and Transportation Review 162:102712. https:\/\/doi.org\/10.1016\/j.tre.2022.102712","journal-title":"Transportation Research Part E: Logistics and Transportation Review"},{"issue":"8","key":"5747_CR270","doi-asserted-by":"publisher","first-page":"240","DOI":"10.3390\/a14080240","volume":"14","author":"Z Kegenbekov","year":"2021","unstructured":"Kegenbekov Z, Jackson I (2021) Adaptive supply chain: Demand\u2013supply synchronization using deep reinforcement learning. Algorithms 14(8):240. https:\/\/doi.org\/10.3390\/a14080240","journal-title":"Algorithms"},{"key":"5747_CR271","doi-asserted-by":"publisher","unstructured":"Xu D, Lu G, Yang R, Timofte R (2020) Learned image and video compression with deep neural networks. IEEE. https:\/\/doi.org\/10.1109\/vcip49819.2020.9301828","DOI":"10.1109\/vcip49819.2020.9301828"},{"key":"5747_CR272","doi-asserted-by":"publisher","unstructured":"Kufa J, Budac A (2023) Quality comparison of 360 degrees 8K images compressed by conventional and deep learning algorithms. IEEE. https:\/\/doi.org\/10.1109\/radioelektronika57919.2023.10109066","DOI":"10.1109\/radioelektronika57919.2023.10109066"},{"key":"5747_CR273","doi-asserted-by":"publisher","unstructured":"Qassim H, Verma A, Feinzimer D (2018) Compressed residual-VGG16 CNN model for big data places image recognition. IEEE. https:\/\/doi.org\/10.1109\/ccwc.2018.8301729","DOI":"10.1109\/ccwc.2018.8301729"},{"issue":"09","key":"5747_CR274","doi-asserted-by":"publisher","first-page":"13693","DOI":"10.1609\/aaai.v34i09.7123","volume":"34","author":"E Strubell","year":"2020","unstructured":"Strubell E, Ganesh A, McCallum A (2020) Energy and policy considerations for modern deep learning research. Proceedings of the AAAI Conference on Artificial Intelligence 34(09):13693\u201313696. https:\/\/doi.org\/10.1609\/aaai.v34i09.7123","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"5747_CR275","doi-asserted-by":"publisher","unstructured":"Sharma M, Kaur P (2023) An Empirical study of Gradient Compression Techniques for Federated Learning. IEEE. https:\/\/doi.org\/10.1109\/ici60088.2023.10421660","DOI":"10.1109\/ici60088.2023.10421660"},{"issue":"2","key":"5747_CR276","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1109\/tpami.2018.2798607","volume":"41","author":"T Baltrusaitis","year":"2019","unstructured":"Baltrusaitis T, Ahuja C, Morency L-P (2019) Multimodal machine learning: A survey and taxonomy. IEEE Trans Pattern Anal Mach Intell 41(2):423\u2013443. https:\/\/doi.org\/10.1109\/tpami.2018.2798607","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"5747_CR277","doi-asserted-by":"publisher","unstructured":"Jain S, Gandhi A, Singla S, Garg L, Mehla S (2022) Quantum Machine Learning and Quantum Communication Networks: The 2030s and the Future. IEEE. https:\/\/doi.org\/10.1109\/iccmso58359.2022.00025","DOI":"10.1109\/iccmso58359.2022.00025"},{"key":"5747_CR278","doi-asserted-by":"publisher","unstructured":"Kuppusamy P, Yaswanth Kumar N, Dontireddy J, Iwendi C (2022) Quantum Computing and Quantum Machine Learning Classification \u2013 A Survey. IEEE. https:\/\/doi.org\/10.1109\/icccmla56841.2022.9989137","DOI":"10.1109\/icccmla56841.2022.9989137"},{"key":"5747_CR279","doi-asserted-by":"publisher","unstructured":"Sujatha D, Raj.TF M, Ramesh G, Agoramoorthy M, S AA (2024) Neural Networks-Based Predictive Models for Self-Healing in Cloud Computing Environments. IEEE. https:\/\/doi.org\/10.1109\/iitcee59897.2024.10467499","DOI":"10.1109\/iitcee59897.2024.10467499"},{"key":"5747_CR280","doi-asserted-by":"publisher","unstructured":"Schneider C, Barker A, Dobson S (2014) A survey of self-healing systems frameworks. Wiley. https:\/\/doi.org\/10.1002\/spe.2250","DOI":"10.1002\/spe.2250"},{"key":"5747_CR281","doi-asserted-by":"publisher","unstructured":"Hoffmann F, Bertram T, Mikut R, Reischl M, Nelles O (2019) Benchmarking in classification and regression. WIREs Data Min Knowl Disc 9(5). https:\/\/doi.org\/10.1002\/widm.1318","DOI":"10.1002\/widm.1318"},{"key":"5747_CR282","doi-asserted-by":"publisher","first-page":"102588","DOI":"10.1016\/j.cose.2021.102588","volume":"114","author":"R Ahmad","year":"2022","unstructured":"Ahmad R, Alsmadi I, Alhamdani W, Tawalbeh L (2022) A comprehensive deep learning benchmark for IoT IDS. Computers & Security 114:102588. https:\/\/doi.org\/10.1016\/j.cose.2021.102588","journal-title":"Computers & Security"},{"key":"5747_CR283","doi-asserted-by":"publisher","unstructured":"Sarridis I, Koutlis C, Kordopatis-Zilos G, Kompatsiaris I, Papadopoulos S (2022) InDistill: Information flow-preserving knowledge distillation for model compression. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2205.10003","DOI":"10.48550\/arXiv.2205.10003"},{"key":"5747_CR284","doi-asserted-by":"publisher","unstructured":"Wu S, Chen H, Quan X, Wang Q, Wang R (2023) AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2305.10010","DOI":"10.48550\/arXiv.2305.10010"},{"key":"5747_CR285","doi-asserted-by":"publisher","unstructured":"Mao H, Han S, Pool J, Li W, Liu X et al (2017) Exploring the Regularity of Sparse Structure in Convolutional Neural Networks. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1705.08922","DOI":"10.48550\/arXiv.1705.08922"},{"key":"5747_CR286","doi-asserted-by":"publisher","unstructured":"S B, Syed MH, More NS, Polepally V (2023) Deep learning-based power prediction aware charge scheduling approach in cloud based electric vehicular network. Eng Appl Artif Intel 121:105869. https:\/\/doi.org\/10.1016\/j.engappai.2023.105869","DOI":"10.1016\/j.engappai.2023.105869"},{"key":"5747_CR287","doi-asserted-by":"publisher","unstructured":"Paszke et al (2019) PyTorch: An Imperative Style, High-Performance Deep Learning Library. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1912.01703","DOI":"10.48550\/arXiv.1912.01703"},{"key":"5747_CR288","doi-asserted-by":"publisher","unstructured":"Xu C, Zhou W, Ge T, Xu K, McAuley J, Wei F (2021) Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2109.03228","DOI":"10.48550\/arXiv.2109.03228"},{"key":"5747_CR289","doi-asserted-by":"publisher","unstructured":"Hinton G, Vinyals O, Dean J (2015) Distilling the Knowledge in a Neural Network. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1503.02531","DOI":"10.48550\/arXiv.1503.02531"},{"key":"5747_CR290","doi-asserted-by":"publisher","unstructured":"Yosinski J, Clune J, Bengio Y, Lipson H (2014) How transferable are features in deep neural networks? https:\/\/doi.org\/10.48550\/arXiv.1411.1792","DOI":"10.48550\/arXiv.1411.1792"},{"key":"5747_CR291","doi-asserted-by":"publisher","unstructured":"Ni Q, Ji JC, Feng K, Zhang Y, Lin D, Zheng J (2024) Data-driven bearing health management using a novel multi-scale fused feature and gated recurrent unit. Reliability Engineering & System Safety 242:109753. https:\/\/doi.org\/10.1016\/j.ress.2023.109753","DOI":"10.1016\/j.ress.2023.109753"},{"key":"5747_CR292","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.jmsy.2019.10.001","volume":"58","author":"Q Qi","year":"2021","unstructured":"Qi Q, Tao F, Hu T, Anwer N, Liu A, Wei Y, Wang L, Nee AYC (2021) Enabling technologies and tools for digital twin. J Manuf Syst 58:3\u201321. https:\/\/doi.org\/10.1016\/j.jmsy.2019.10.001","journal-title":"J Manuf Syst"},{"key":"5747_CR293","doi-asserted-by":"publisher","unstructured":"Horvath S, Laskaridis S, Rajput S, Wang H (2023) Maestro: Uncovering Low-Rank Structures via Trainable Decomposition. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2308.14929","DOI":"10.48550\/arXiv.2308.14929"}],"container-title":["Applied Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-024-05747-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10489-024-05747-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-024-05747-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,18]],"date-time":"2024-09-18T15:29:28Z","timestamp":1726673368000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10489-024-05747-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,2]]},"references-count":293,"journal-issue":{"issue":"22","published-print":{"date-parts":[[2024,11]]}},"alternative-id":["5747"],"URL":"https:\/\/doi.org\/10.1007\/s10489-024-05747-w","relation":{},"ISSN":["0924-669X","1573-7497"],"issn-type":[{"value":"0924-669X","type":"print"},{"value":"1573-7497","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,2]]},"assertion":[{"value":"5 August 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 September 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"In adherence to ethical standards and principles of informed consent, we confirm that all data used in this manuscript were collected and employed with due regard for ethical norms. The study was conducted transparently, and all authors made substantial contributions as detailed in the <i>Authors Contribution Statement<\/i> section. We affirm our unwavering commitment to ethical research practices and informed consent, assuring that this research aligns with established ethical guidelines.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical and informed consent for data used"}},{"value":"All authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}