{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T07:19:28Z","timestamp":1782890368856,"version":"3.54.5"},"reference-count":71,"publisher":"Springer Science and Business Media LLC","issue":"19","license":[{"start":{"date-parts":[[2023,7,4]],"date-time":"2023-07-04T00:00:00Z","timestamp":1688428800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,7,4]],"date-time":"2023-07-04T00:00:00Z","timestamp":1688428800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010663","name":"H2020 European Research Council","doi-asserted-by":"publisher","award":["681447"],"award-info":[{"award-number":["681447"]}],"id":[{"id":"10.13039\/100010663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Appl Intell"],"published-print":{"date-parts":[[2023,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The focus of this work is on the application of classical Model Order Reduction techniques, such as Active Subspaces and Proper Orthogonal Decomposition, to Deep Neural Networks. We propose a generic methodology to reduce the number of layers in a pre-trained network by combining the aforementioned techniques for dimensionality reduction with input-output mappings, such as Polynomial Chaos Expansion and Feedforward Neural Networks. The motivation behind compressing the architecture of an existing Convolutional Neural Network arises from its usage in embedded systems with specific storage constraints. The conducted numerical tests demonstrate that the resulting reduced networks can achieve a level of accuracy comparable to the original Convolutional Neural Network being examined, while also saving memory allocation. Our primary emphasis lies in the field of image recognition, where we tested our methodology using VGG-16 and ResNet-110 architectures against three different datasets: CIFAR-10, CIFAR-100, and a custom dataset.<\/jats:p>","DOI":"10.1007\/s10489-023-04730-1","type":"journal-article","created":{"date-parts":[[2023,7,10]],"date-time":"2023-07-10T13:05:00Z","timestamp":1688994300000},"page":"22818-22833","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["A dimensionality reduction approach for convolutional neural networks"],"prefix":"10.1007","volume":"53","author":[{"given":"Laura","family":"Meneghetti","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicola","family":"Demo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0810-8812","authenticated-orcid":false,"given":"Gianluigi","family":"Rozza","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,7,4]]},"reference":[{"key":"4730_CR1","doi-asserted-by":"publisher","first-page":"1097","DOI":"10.1145\/3065386","volume":"25","author":"A Krizhevsky","year":"2012","unstructured":"Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems 25:1097\u20131105. https:\/\/doi.org\/10.1145\/3065386","journal-title":"Advances in neural information processing systems"},{"key":"4730_CR2","volume-title":"Deep Learning for Vision Systems","author":"M Elgendy","year":"2020","unstructured":"Elgendy M (2020) Deep Learning for Vision Systems. Simon and Schuster, New York"},{"key":"4730_CR3","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1007\/s11263-019-01247-4","volume":"128","author":"L Liu","year":"2020","unstructured":"Liu L, Ouyang W, Wang X, Fieguth P, Chen J, Liu X, Pietik\u00e4inen M (2020) Deep learning for generic object detection: A survey. International journal of computer vision 128:261\u2013318. https:\/\/doi.org\/10.1007\/s11263-019-01247-4","journal-title":"International journal of computer vision"},{"issue":"3","key":"4730_CR4","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1109\/MCI.2018.2840738","volume":"13","author":"T Young","year":"2018","unstructured":"Young T, Hazarika D, Poria S, Cambria E (2018) Recent trends in deep learning based natural language processing. IEEE Computational intelligenCe magazine 13(3):55\u201375. https:\/\/doi.org\/10.1109\/MCI.2018.2840738","journal-title":"IEEE Computational intelligenCe magazine"},{"key":"4730_CR5","doi-asserted-by":"publisher","unstructured":"Khurana, D., Koli, A., Khatter, K., Singh, S.: Natural Language Processing: State of The Art, Current Trends and Challenges. Multimedia Tools and Applications 82 (2022). DOI: https:\/\/doi.org\/10.1007\/s11042-022-13428-4","DOI":"10.1007\/s11042-022-13428-4"},{"issue":"6","key":"4730_CR6","doi-asserted-by":"publisher","first-page":"721","DOI":"10.1016\/j.robot.2014.03.003","volume":"62","author":"K Noda","year":"2014","unstructured":"Noda K, Arie H, Suga Y, Ogata T (2014) Multimodal integration learning of robot behavior using deep neural networks. Robotics and Autonomous Systems 62(6):721\u2013736. https:\/\/doi.org\/10.1016\/j.robot.2014.03.003","journal-title":"Robotics and Autonomous Systems"},{"key":"4730_CR7","doi-asserted-by":"publisher","first-page":"124616","DOI":"10.1109\/ACCESS.2021.3110795","volume":"9","author":"T Kiyokawa","year":"2021","unstructured":"Kiyokawa T, Katayama H, Tatsuta Y, Takamatsu J, Ogasawara T (2021) Robotic Waste Sorter With Agile Manipulation and Quickly Trainable Detector. IEEE Access 9:124616\u2013124631. https:\/\/doi.org\/10.1109\/ACCESS.2021.3110795","journal-title":"IEEE Access"},{"key":"4730_CR8","doi-asserted-by":"publisher","unstructured":"Wali A, Alamgir Z, Karim S, Fawaz A, Ali MB, Adan M, Mujtaba M (2022) Generative adversarial networks for speech processing: A review. Computer Speech & Language 72:101308. https:\/\/doi.org\/10.1016\/j.csl.2021.101308","DOI":"10.1016\/j.csl.2021.101308"},{"key":"4730_CR9","doi-asserted-by":"publisher","unstructured":"Yu, D., Deng, L.: Automatic Speech Recognition vol. 1. Springer, London (2016). https:\/\/doi.org\/10.1007\/978-1-4471-5779-3","DOI":"10.1007\/978-1-4471-5779-3"},{"key":"4730_CR10","unstructured":"Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge, USA (2016). http:\/\/www.deeplearningbook.org"},{"issue":"8","key":"4730_CR11","doi-asserted-by":"publisher","first-page":"5455","DOI":"10.1007\/s10462-020-09825-6","volume":"53","author":"A Khan","year":"2020","unstructured":"Khan A, Sohail A, Zahoora U, Qureshi AS (2020) A survey of the recent architectures of deep convolutional neural networks. Artificial Intelligence Review 53(8):5455\u20135516. https:\/\/doi.org\/10.1007\/s10462-020-09825-6","journal-title":"Artificial Intelligence Review"},{"issue":"5","key":"4730_CR12","doi-asserted-by":"publisher","first-page":"836","DOI":"10.1109\/TNN.2007.912306","volume":"19","author":"S Trenn","year":"2008","unstructured":"Trenn S (2008) Multilayer Perceptrons: Approximation Order and Necessary Number of Hidden Units. IEEE Transactions on Neural Networks 19(5):836\u201344. https:\/\/doi.org\/10.1109\/TNN.2007.912306","journal-title":"IEEE Transactions on Neural Networks"},{"key":"4730_CR13","doi-asserted-by":"publisher","unstructured":"Wang, E., Davis, J.J., Zhao, R., Ng, H.-C., Niu, X., Luk, W., Cheung, P.Y.K., Constantinides, G.A.: Deep neural network approximation for custom hardware: Where we\u2019ve been, where we\u2019re going. ACM Computing Surveys 52(2) (2019). https:\/\/doi.org\/10.1145\/3309551","DOI":"10.1145\/3309551"},{"key":"4730_CR14","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1016\/j.neucom.2021.11.032","volume":"482","author":"A Wuraola","year":"2022","unstructured":"Wuraola A, Patel N (2022) Resource efficient activation functions for neural network accelerators. Neurocomputing 482:163\u2013185. https:\/\/doi.org\/10.1016\/j.neucom.2021.11.032","journal-title":"Neurocomputing"},{"key":"4730_CR15","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/j.cpc.2019.03.020","volume":"241","author":"J Huang","year":"2019","unstructured":"Huang J, Zhao J, Cai W (2019) Compressing convolutional neural networks using POD for the reconstruction of nonlinear tomographic absorption spectroscopy. Computer Physics Communications 241:33\u201339. https:\/\/doi.org\/10.1016\/j.cpc.2019.03.020","journal-title":"Computer Physics Communications"},{"key":"4730_CR16","doi-asserted-by":"publisher","DOI":"10.1016\/j.compeleceng.2021.107671","volume":"98","author":"S Messaoud","year":"2022","unstructured":"Messaoud S, Bouaafia S, Maraoui A, Ammari AC, Khriji L, Machhout M (2022) Deep convolutional neural networks-based hardware-software on-chip system for computer vision application. Computers & Electrical Engineering 98:107671. https:\/\/doi.org\/10.1016\/j.compeleceng.2021.107671","journal-title":"Computers & Electrical Engineering"},{"key":"4730_CR17","doi-asserted-by":"publisher","DOI":"10.1016\/j.micpro.2020.103094","volume":"76","author":"R Udendhran","year":"2020","unstructured":"Udendhran R, Balamurugan M, Suresh A, Varatharajan R (2020) Enhancing image processing architecture using deep learning for embedded vision systems. Microprocessors and Microsystems 76:103094. https:\/\/doi.org\/10.1016\/j.micpro.2020.103094","journal-title":"Microprocessors and Microsystems"},{"key":"4730_CR18","doi-asserted-by":"publisher","DOI":"10.1016\/j.micpro.2020.103086","volume":"76","author":"ET da Silva","year":"2020","unstructured":"da Silva ET, Sampaio F, da Silva LC, Medeiros DS, Correia GP (2020) A method for embedding a computer vision application into a wearable device. Microprocessors and Microsystems 76:103086. https:\/\/doi.org\/10.1016\/j.micpro.2020.103086","journal-title":"Microprocessors and Microsystems"},{"key":"4730_CR19","doi-asserted-by":"publisher","unstructured":"He, Y., Zhang, X., Sun, J.: Channel pruning for accelerating very deep neural networks. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 1398\u20131406 (2017). https:\/\/doi.org\/10.1109\/ICCV.2017.155","DOI":"10.1109\/ICCV.2017.155"},{"issue":"12","key":"4730_CR20","doi-asserted-by":"publisher","first-page":"3048","DOI":"10.1109\/TPAMI.2018.2874634","volume":"41","author":"S Chen","year":"2019","unstructured":"Chen S, Zhao Q (2019) Shallowing deep networks: Layer-wise pruning based on feature representations. IEEE Transactions on Pattern Analysis and Machine Intelligence 41(12):3048\u20133056. https:\/\/doi.org\/10.1109\/TPAMI.2018.2874634","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"4730_CR21","doi-asserted-by":"publisher","unstructured":"Li, Y., Adamczewski, K., Li, W., Gu, S., Timofte, R., Van\u00a0Gool, L.: Revisiting random channel pruning for neural network compression. In: 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 191\u2013201 (2022). https:\/\/doi.org\/10.1109\/CVPR52688.2022.00029","DOI":"10.1109\/CVPR52688.2022.00029"},{"key":"4730_CR22","doi-asserted-by":"publisher","unstructured":"Molchanov, P., Mallya, A., Tyree, S., Frosio, I., Kautz, J.: Importance estimation for neural network pruning. In: 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11256\u201311264 (2019). https:\/\/doi.org\/10.1109\/CVPR.2019.01152","DOI":"10.1109\/CVPR.2019.01152"},{"key":"4730_CR23","doi-asserted-by":"publisher","unstructured":"Liu, Z., Li, J., Shen, Z., Huang, G., Yan, S., Zhang, C.: Learning efficient convolutional networks through network slimming. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 2755\u20132763 (2017). https:\/\/doi.org\/10.1109\/ICCV.2017.298","DOI":"10.1109\/ICCV.2017.298"},{"key":"4730_CR24","doi-asserted-by":"publisher","unstructured":"Cichocki, A., Lee, N., Oseledets, I., Phan, A.-H., Zhao, Q., Mandic, D.P.: Tensor networks for dimensionality reduction and large-scale optimization: Part 1 low-rank tensor decompositions. Foundations and Trends\u00ae in Machine Learning 9(4-5), 249\u2013429 (2016). https:\/\/doi.org\/10.1561\/2200000059","DOI":"10.1561\/2200000059"},{"key":"4730_CR25","doi-asserted-by":"publisher","unstructured":"Cichocki, A., Phan, A.-H., Zhao, Q., Lee, N., Oseledets, I., Sugiyama, M., Mandic, D.P.: Tensor networks for dimensionality reduction and large-scale optimization: Part 2 applications and future perspectives. Foundations and Trends\u00ae in Machine Learning 9(6), 431\u2013673 (2017). https:\/\/doi.org\/10.1561\/2200000067","DOI":"10.1561\/2200000067"},{"key":"4730_CR26","doi-asserted-by":"publisher","unstructured":"Li, Y., Gu, S., Mayer, C., Van\u00a0Gool, L., Timofte, R.: Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression. In: 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8015\u20138024 (2020). https:\/\/doi.org\/10.1109\/CVPR42600.2020.00804","DOI":"10.1109\/CVPR42600.2020.00804"},{"key":"4730_CR27","doi-asserted-by":"publisher","unstructured":"Li, Y., Gu, S., Van\u00a0Gool, L., Timofte, R.: Learning Filter Basis for Convolutional Neural Network Compression. In: 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), pp. 5622\u20135631 (2019). https:\/\/doi.org\/10.1109\/ICCV.2019.00572","DOI":"10.1109\/ICCV.2019.00572"},{"key":"4730_CR28","doi-asserted-by":"publisher","unstructured":"Yang, J., Shen, X., Xing, J., Tian, X., Li, H., Deng, B., Huang, J., Hua, X.-s.: Quantization Networks. In: 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7300\u20137308 (2019). https:\/\/doi.org\/10.1109\/CVPR.2019.00748","DOI":"10.1109\/CVPR.2019.00748"},{"issue":"1","key":"4730_CR29","first-page":"6869","volume":"18","author":"I Hubara","year":"2017","unstructured":"Hubara I, Courbariaux M, Soudry D, El-Yaniv R, Bengio Y (2017) Quantized neural networks: Training neural networks with low precision weights and activations. The Journal of Machine Learning Research 18(1):6869\u20136898","journal-title":"The Journal of Machine Learning Research"},{"key":"4730_CR30","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1016\/j.neunet.2018.01.010","volume":"100","author":"L Deng","year":"2018","unstructured":"Deng L, Jiao P, Pei J, Wu Z, Li G (2018) GXNOR-Net: Training deep neural networks with ternary weights and activations without full-precision memory under a unified discretization framework. Neural Networks 100:49\u201358. https:\/\/doi.org\/10.1016\/j.neunet.2018.01.010","journal-title":"Neural Networks"},{"key":"4730_CR31","unstructured":"Hinton, G., Vinyals, O., Dean, J.: Distilling the Knowledge in a Neural Network. In: NIPS Deep Learning and Representation Learning Workshop (2015)"},{"issue":"6","key":"4730_CR32","doi-asserted-by":"publisher","first-page":"1789","DOI":"10.1007\/s11263-021-01453-z","volume":"129","author":"J Gou","year":"2021","unstructured":"Gou J, Yu B, Maybank SJ, Tao D (2021) Knowledge distillation: A survey. International Journal of Computer Vision 129(6):1789\u20131819. https:\/\/doi.org\/10.1007\/s11263-021-01453-z","journal-title":"International Journal of Computer Vision"},{"key":"4730_CR33","doi-asserted-by":"publisher","unstructured":"Cho, J.H., Hariharan, B.: On the Efficacy of Knowledge Distillation. In: 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), pp. 4793\u20134801 (2019). https:\/\/doi.org\/10.1109\/ICCV.2019.00489","DOI":"10.1109\/ICCV.2019.00489"},{"key":"4730_CR34","doi-asserted-by":"publisher","first-page":"743","DOI":"10.1016\/j.ins.2021.08.020","volume":"576","author":"D Bang","year":"2021","unstructured":"Bang D, Lee J, Shim H (2021) Distilling from professors: Enhancing the knowledge distillation of teachers. Information Sciences 576:743\u2013755. https:\/\/doi.org\/10.1016\/j.ins.2021.08.020","journal-title":"Information Sciences"},{"issue":"4","key":"4730_CR35","doi-asserted-by":"publisher","first-page":"1096","DOI":"10.1137\/19M1296070","volume":"2","author":"C Cui","year":"2020","unstructured":"Cui C, Zhang K, Daulbaev T, Gusak J, Oseledets I, Zhang Z (2020) Active subspace of neural networks: Structural analysis and universal attacks. SIAM Journal on Mathematics of Data Science 2(4):1096\u20131122. https:\/\/doi.org\/10.1137\/19M1296070","journal-title":"SIAM Journal on Mathematics of Data Science"},{"key":"4730_CR36","doi-asserted-by":"publisher","unstructured":"Benner, P., Grivet-Talocia, S., Quarteroni, A., Rozza, G., Schilders, W., Silveira, L.M.: Model Order Reduction: Volume 1: System- and Data-Driven Methods and Algorithms. De Gruyter, Berlin, Boston (2021). https:\/\/doi.org\/10.1515\/9783110498967","DOI":"10.1515\/9783110498967"},{"key":"4730_CR37","doi-asserted-by":"publisher","unstructured":"Benner, P., Schilders, W., Grivet-Talocia, S., Quarteroni, A., Rozza, G., Miguel\u00a0Silveira, L.: Model Order Reduction: Volume 2: Snapshot-Based Methods and Algorithms. De Gruyter, Berlin, Boston (2020). https:\/\/doi.org\/10.1515\/9783110671490","DOI":"10.1515\/9783110671490"},{"key":"4730_CR38","doi-asserted-by":"publisher","unstructured":"Benner, P., Schilders, W., Grivet-Talocia, S., Quarteroni, A., Rozza, G., Miguel\u00a0Silveira, L.: Model Order Reduction: Volume 3: Applications. De Gruyter, Berlin, Boston (2020). https:\/\/doi.org\/10.1515\/9783110499001","DOI":"10.1515\/9783110499001"},{"key":"4730_CR39","doi-asserted-by":"publisher","unstructured":"Constantine, P.G.: Active Subspaces: Emerging Ideas for Dimension Reduction in Parameter Studies. SIAM Spotlights, vol. 2. SIAM, U.S. (2015). https:\/\/doi.org\/10.1137\/1.9781611973860","DOI":"10.1137\/1.9781611973860"},{"issue":"4","key":"4730_CR40","doi-asserted-by":"publisher","first-page":"1500","DOI":"10.1137\/130916138","volume":"36","author":"PG Constantine","year":"2014","unstructured":"Constantine PG, Dow E, Wang Q (2014) Active Subspace Methods in Theory and Practice: Applications to Kriging Surfaces. SIAM Journal on Scientific Computing 36(4):1500\u20131524. https:\/\/doi.org\/10.1137\/130916138","journal-title":"SIAM Journal on Scientific Computing"},{"issue":"23","key":"4730_CR41","doi-asserted-by":"publisher","first-page":"6000","DOI":"10.1002\/nme.7099","volume":"123","author":"F Romor","year":"2022","unstructured":"Romor F, Tezzele M, Lario A, Rozza G (2022) Kernel-based active subspaces with application to computational fluid dynamics parametric problems using discontinuous Galerkin method. International Journal for Numerical Methods in Engineering 123(23):6000\u20136027. https:\/\/doi.org\/10.1002\/nme.7099","journal-title":"International Journal for Numerical Methods in Engineering"},{"issue":"1","key":"4730_CR42","doi-asserted-by":"publisher","first-page":"534","DOI":"10.1137\/18M1221837","volume":"42","author":"O Zahm","year":"2020","unstructured":"Zahm O, Constantine PG, Prieur C, Marzouk YM (2020) Gradient-based dimension reduction of multivariate vector-valued functions. SIAM Journal on Scientific Computing 42(1):534\u2013558. https:\/\/doi.org\/10.1137\/18M1221837","journal-title":"SIAM Journal on Scientific Computing"},{"key":"4730_CR43","doi-asserted-by":"publisher","first-page":"764","DOI":"10.2514\/6.2003-4213","volume":"177","author":"K Ahnert","year":"2007","unstructured":"Ahnert K, Abel M (2007) Numerical differentiation of experimental data: local versus global methods. Computer Physics Communications 177:764\u2013774. https:\/\/doi.org\/10.2514\/6.2003-4213","journal-title":"Computer Physics Communications"},{"key":"4730_CR44","volume-title":"Gaussian Processes for Machine Learning","author":"CK Williams","year":"2006","unstructured":"Williams CK, Rasmussen CE (2006) Gaussian Processes for Machine Learning, vol 2. The MIT press, Cambridge, MA, USA"},{"key":"4730_CR45","doi-asserted-by":"publisher","unstructured":"Mohamed, S., Rosca, M., Figurnov, M., Mnih, A.: Monte Carlo Gradient Estimation in Machine Learning. Journal of Machine Learning Research 21(1) (2020). https:\/\/doi.org\/10.5555\/3455716.3455848","DOI":"10.5555\/3455716.3455848"},{"key":"4730_CR46","doi-asserted-by":"publisher","DOI":"10.1016\/j.simpa.2021.100133","volume":"10","author":"F Romor","year":"2021","unstructured":"Romor F, Tezzele M, Rozza G (2021) ATHENA: Advanced Techniques for High dimensional parameter spaces to Enhance Numerical Analysis. Software Impacts 10:100133. https:\/\/doi.org\/10.1016\/j.simpa.2021.100133","journal-title":"Software Impacts"},{"key":"4730_CR47","doi-asserted-by":"publisher","unstructured":"Hesthaven, J.S., Rozza, G., Stamm, B.: Certified Reduced Basis Methods for Parametrized Partial Differential Equations, 1st edn. Springer Briefs in Mathematics, p. 135. Springer, Switzerland (2015). https:\/\/doi.org\/10.1007\/978-3-319-22470-1. Springer","DOI":"10.1007\/978-3-319-22470-1"},{"key":"4730_CR48","doi-asserted-by":"publisher","unstructured":"Bui-Thanh T, Damodaran M, Willcox K (2003) Proper orthogonal decomposition extensions for parametric applications in compressible aerodynamics. In: 21st AIAA Applied Aerodynamics Conference, p. 4213. https:\/\/doi.org\/10.2514\/6.2003-4213","DOI":"10.2514\/6.2003-4213"},{"issue":"8","key":"4730_CR49","doi-asserted-by":"publisher","first-page":"1505","DOI":"10.2514\/1.2159","volume":"42","author":"T Bui-Thanh","year":"2004","unstructured":"Bui-Thanh T, Damodaran M, Willcox K (2004) Aerodynamic data reconstruction and inverse design using proper orthogonal decomposition. AIAA journal 42(8):1505\u20131516. https:\/\/doi.org\/10.2514\/1.2159","journal-title":"AIAA journal"},{"key":"4730_CR50","doi-asserted-by":"publisher","unstructured":"Rozza, G., Stabile, G., Ballarin, F.: Advanced Reduced Order Methods and Applications in Computational Fluid Dynamics. Society for Industrial and Applied Mathematics, Philadelphia, PA (2022). https:\/\/doi.org\/10.1137\/1.9781611977257","DOI":"10.1137\/1.9781611977257"},{"issue":"2","key":"4730_CR51","doi-asserted-by":"publisher","first-page":"619","DOI":"10.1137\/S1064827501387826","volume":"24","author":"D Xiu","year":"2002","unstructured":"Xiu D, Karniadakis GE (2002) The Wiener-Askey polynomial chaos for stochastic differential equations. SIAM journal on scientific computing 24(2):619\u2013644. https:\/\/doi.org\/10.1137\/S1064827501387826","journal-title":"SIAM journal on scientific computing"},{"key":"4730_CR52","doi-asserted-by":"publisher","unstructured":"Fine, T.L.: Feedforward Neural Network Methodology. Information Science and Statistics. Springer, New York (1999). https:\/\/doi.org\/10.1007\/b97705","DOI":"10.1007\/b97705"},{"issue":"4","key":"4730_CR53","doi-asserted-by":"publisher","first-page":"897","DOI":"10.2307\/2371268","volume":"60","author":"N Wiener","year":"1938","unstructured":"Wiener N (1938) The Homogeneous Chaos. American Journal of Mathematics 60(4):897\u2013936. https:\/\/doi.org\/10.2307\/2371268","journal-title":"American Journal of Mathematics"},{"key":"4730_CR54","doi-asserted-by":"publisher","unstructured":"Janya-Anurak, C.: Framework for Analysis and Identification of Nonlinear Distributed Parameter Systems Using Bayesian Uncertainty Quantification Based on Generalized Polynomial Chaos. Karlsruher Schriften zur Anthropomatik, vol. 31. KIT Scientific Publishing, Karlsruhe, Deutschland (2017). https:\/\/doi.org\/10.5445\/KSP\/1000066940","DOI":"10.5445\/KSP\/1000066940"},{"key":"4730_CR55","doi-asserted-by":"publisher","unstructured":"Ghanem, R.G., Spanos, P.D.: Stochastic Finite Elements: a Spectral Approach. Springer, New York (1991). https:\/\/doi.org\/10.1007\/978-1-4612-3094-6","DOI":"10.1007\/978-1-4612-3094-6"},{"key":"4730_CR56","doi-asserted-by":"publisher","unstructured":"Askey, R., Wilson, J.A.: Some basic hypergeometric orthogonal polynomials that generalize Jacobi polynomials. Memoirs of the American Mathematical Society 54(319) (1985). https:\/\/doi.org\/10.1090\/memo\/0319","DOI":"10.1090\/memo\/0319"},{"issue":"7","key":"4730_CR57","doi-asserted-by":"publisher","first-page":"964","DOI":"10.1016\/j.ress.2007.04.002","volume":"93","author":"B Sudret","year":"2008","unstructured":"Sudret B (2008) Global sensitivity analysis using polynomial chaos expansions. Reliability engineering & system safety 93(7):964\u2013979. https:\/\/doi.org\/10.1016\/j.ress.2007.04.002","journal-title":"Reliability engineering & system safety"},{"key":"4730_CR58","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1016\/j.compstruc.2017.09.002","volume":"194","author":"K Cheng","year":"2018","unstructured":"Cheng K, Lu Z (2018) Adaptive sparse polynomial chaos expansions for global sensitivity analysis based on support vector regression. Computers & Structures 194:86\u201396. https:\/\/doi.org\/10.1016\/j.compstruc.2017.09.002","journal-title":"Computers & Structures"},{"key":"4730_CR59","doi-asserted-by":"publisher","unstructured":"Shaham U, Cloninger A, Coifman RR (2018) Provable approximation properties for deep neural networks. Applied and Computational Harmonic Analysis 44(3):537\u2013557. https:\/\/doi.org\/10.1016\/j.acha.2016.04.003","DOI":"10.1016\/j.acha.2016.04.003"},{"key":"4730_CR60","doi-asserted-by":"publisher","DOI":"10.1017\/9781108564175","volume-title":"Data Mining and Machine Learning: Fundamental Concepts and Algorithms","author":"MJ Zaki","year":"2020","unstructured":"Zaki MJ, Meira W Jr (2020) Data Mining and Machine Learning: Fundamental Concepts and Algorithms. Cambridge University Press, U.K"},{"key":"4730_CR61","doi-asserted-by":"publisher","unstructured":"Alzubaidi L, Zhang J, Humaidi AJ, Al-Dujaili A, Duan Y, Al-Shamma O, Santamar\u00eda J, Fadhel MA, Al-Amidie M, Farhan L (2021) Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions. Journal of big Data 8(1):1\u201374. https:\/\/doi.org\/10.1186\/s40537-021-00444-8","DOI":"10.1186\/s40537-021-00444-8"},{"key":"4730_CR62","doi-asserted-by":"publisher","unstructured":"Rojas, R.: The Backpropagation Algorithm. In: Neural Networks, pp. 149\u2013182. Springer, Berlin, Heidelberg (1996). https:\/\/doi.org\/10.1007\/978-3-642-61068-4_7","DOI":"10.1007\/978-3-642-61068-4_7"},{"key":"4730_CR63","doi-asserted-by":"publisher","unstructured":"Borza, D.L., Ileni, T.A., Marinescu, A.I., Darabant, S.A.: Teacher or supervisor? effective online knowledge distillation via guided collaborative learning. Computer Vision and Image Understanding, 103632 (2023). https:\/\/doi.org\/10.1109\/CVPR.2016.90","DOI":"10.1109\/CVPR.2016.90"},{"issue":"143\u2013155","key":"4730_CR64","first-page":"18","volume":"19","author":"Y LeCun","year":"1989","unstructured":"LeCun Y (1989) Generalization and network design strategies. Connectionism in perspective 19(143\u2013155):18","journal-title":"Connectionism in perspective"},{"key":"4730_CR65","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1016\/j.patcog.2017.10.013","volume":"77","author":"J Gu","year":"2018","unstructured":"Gu J, Wang Z, Kuen J, Ma L, Shahroudy A, Shuai B, Liu T, Wang X, Wang G, Cai J et al (2018) Recent advances in convolutional neural networks. Pattern recognition 77:354\u2013377. https:\/\/doi.org\/10.1016\/j.patcog.2017.10.013","journal-title":"Pattern recognition"},{"key":"4730_CR66","unstructured":"Simonyan, K., Zisserman, A.: Very Deep Convolutional Networks for Large-Scale Image Recognition. In: Bengio, Y., LeCun, Y. (eds.) 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings (2015)"},{"key":"4730_CR67","doi-asserted-by":"publisher","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770\u2013778. https:\/\/doi.org\/10.1109\/CVPR.2016.90","DOI":"10.1109\/CVPR.2016.90"},{"key":"4730_CR68","unstructured":"Krizhevsky, A., Hinton, G.: Learning multiple layers of features from tiny images. Master\u2019s thesis, Department of Computer Science, University of Toronto (2009)"},{"key":"4730_CR69","unstructured":"Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., Desmaison, A., Kopf, A., Yang, E., DeVito, Z., Raison, M., Tejani, A., Chilamkurthy, S., Steiner, B., Fang, L., Bai, J., Chintala, S.: PyTorch: An Imperative Style, High-Performance Deep Learning Library. In: Wallach, H., Larochelle, H., Beygelzimer, A., d\u2019 Alch\u00e9-Buc, F., Fox, E., Garnett, R. (eds.) Advances in Neural Information Processing Systems 32, pp. 8024\u20138035. Curran Associates, Inc., new York, United States (2019)"},{"key":"4730_CR70","doi-asserted-by":"publisher","unstructured":"Virtanen, P., Gommers, R., Oliphant, T.E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., van der Walt, S.J., Brett, M., Wilson, J., Millman, K.J., Mayorov, N., Nelson, A.R.J., Jones, E., Kern, R., Larson, E., Carey, C.J., Polat, \u0130., Feng, Y., Moore, E.W., VanderPlas, J., Laxalde, D., Perktold, J., Cimrman, R., Henriksen, I., Quintero, E.A., Harris, C.R., Archibald, A.M., Ribeiro, A.H., Pedregosa, F., van Mulbregt, P., SciPy 1.0 Contributors: SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python. Nature Methods 17, 261\u2013272 (2020). https:\/\/doi.org\/10.1038\/s41592-019-0686-2","DOI":"10.1038\/s41592-019-0686-2"},{"key":"4730_CR71","doi-asserted-by":"publisher","first-page":"1762","DOI":"10.1137\/15M1009718","volume":"45","author":"M Ghashami","year":"2016","unstructured":"Ghashami M, Liberty E, Phillips JM, Woodruff DP (2016) Frequent Directions: Simple and Deterministic Matrix Sketching. SIAM Journal on Computing 45:1762\u20131792. https:\/\/doi.org\/10.1137\/15M1009718","journal-title":"SIAM Journal on Computing"}],"container-title":["Applied Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-023-04730-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10489-023-04730-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-023-04730-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,18]],"date-time":"2023-10-18T13:28:52Z","timestamp":1697635732000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10489-023-04730-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,4]]},"references-count":71,"journal-issue":{"issue":"19","published-print":{"date-parts":[[2023,10]]}},"alternative-id":["4730"],"URL":"https:\/\/doi.org\/10.1007\/s10489-023-04730-1","relation":{},"ISSN":["0924-669X","1573-7497"],"issn-type":[{"value":"0924-669X","type":"print"},{"value":"1573-7497","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,4]]},"assertion":[{"value":"23 May 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 July 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Fulfilled.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical and informed consent for data used"}},{"value":"No potential competing interest was reported by the authors.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}