{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T17:44:54Z","timestamp":1778694294705,"version":"3.51.4"},"reference-count":92,"publisher":"World Scientific Pub Co Pte Ltd","issue":"01","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Neur. Syst."],"published-print":{"date-parts":[[2022,1]]},"abstract":"<jats:p> In this paper, we introduce VPNet, a novel model-driven neural network architecture based on variable projection (VP). Applying VP operators to neural networks results in learnable features, interpretable parameters, and compact network structures. This paper discusses the motivation and mathematical background of VPNet and presents experiments. The VPNet approach was evaluated in the context of signal processing, where we classified a synthetic dataset and real electrocardiogram (ECG) signals. Compared to fully connected and one-dimensional convolutional networks, VPNet offers fast learning ability and good accuracy at a low computational cost of both training and inference. Based on these advantages and the promising results obtained, we anticipate a profound impact on the broader field of signal processing, in particular on classification, regression and clustering problems. <\/jats:p>","DOI":"10.1142\/s0129065721500544","type":"journal-article","created":{"date-parts":[[2021,10,15]],"date-time":"2021-10-15T15:04:06Z","timestamp":1634310246000},"source":"Crossref","is-referenced-by-count":35,"title":["VPNET: Variable Projection Networks"],"prefix":"10.1142","volume":"32","author":[{"given":"P\u00e9ter","family":"Kov\u00e1cs","sequence":"first","affiliation":[{"name":"Department of Numerical Analysis, E\u00f6tv\u00f6s Lor\u00e1nd University, P\u00e1zm\u00e1ny P\u00e9ter stny. 1\/C, Budapest 1117, Hungary"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gerg\u0151","family":"Bogn\u00e1r","sequence":"additional","affiliation":[{"name":"Department of Numerical Analysis, E\u00f6tv\u00f6s Lor\u00e1nd University, P\u00e1zm\u00e1ny P\u00e9ter stny. 1\/C, Budapest 1117, Hungary"},{"name":"Institute of Signal Processing, Johannes Kepler University Linz, Altenberger str. 69, Linz 4040, Austria"},{"name":"JKU LIT SAL eSPML Lab, Silicon Austria Labs, Altenberger str. 69, Linz 4040, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christian","family":"Huber","sequence":"additional","affiliation":[{"name":"Embedded AI Research Group, Silicon Austria Labs GmbH, Altenberger str. 69, Linz 4040, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mario","family":"Huemer","sequence":"additional","affiliation":[{"name":"Institute of Signal Processing, Johannes Kepler University Linz, Altenberger str. 69, Linz 4040, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2021,10,13]]},"reference":[{"key":"S0129065721500544BIB001","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2014.09.003"},{"key":"S0129065721500544BIB002","doi-asserted-by":"crossref","unstructured":"E. Alpaydin ,  Introduction to Machine Learning,  4th edn.  (The MIT Press, 2020), p.  640.","DOI":"10.7551\/mitpress\/13811.001.0001"},{"key":"S0129065721500544BIB003","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.50"},{"key":"S0129065721500544BIB004","doi-asserted-by":"publisher","DOI":"10.3233\/ICA-180596"},{"issue":"4","key":"S0129065721500544BIB005","doi-asserted-by":"crossref","first-page":"389","DOI":"10.3233\/ICA-200635","volume":"27","author":"Daz-Vico D.","year":"2020","journal-title":"Integr. Comput.-Aided Eng."},{"issue":"9","key":"S0129065721500544BIB006","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1142\/S012906571950014X","volume":"29","author":"Reyes O.","year":"2019","journal-title":"Int. J. Neural Syst."},{"issue":"10","key":"S0129065721500544BIB007","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1142\/S0129065720500604","volume":"30","author":"Mishra P.","year":"2020","journal-title":"Int. J. Neural Syst."},{"key":"S0129065721500544BIB010","doi-asserted-by":"publisher","DOI":"10.1126\/science.1127647"},{"key":"S0129065721500544BIB011","first-page":"1097","volume-title":"Advances in Neural Information Processing Systems","volume":"25","author":"Krizhevsky A.","year":"2012"},{"key":"S0129065721500544BIB012","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10590-1_53"},{"key":"S0129065721500544BIB013","first-page":"1","volume-title":"2015 IEEE Conf. Computer Vision and Pattern Recognition (CVPR)","author":"Szegedy C.","year":"2015"},{"key":"S0129065721500544BIB014","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"S0129065721500544BIB015","first-page":"1","volume":"28","author":"Manzanera O. M.","year":"2019","journal-title":"Int. J. Neural Syst."},{"issue":"7","key":"S0129065721500544BIB016","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1142\/S0129065720500124","volume":"30","author":"Leming M.","year":"2020","journal-title":"Int. J. Neural Syst."},{"issue":"5","key":"S0129065721500544BIB017","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1109\/MWC.2019.1800447","volume":"26","author":"He H.","year":"2019","journal-title":"IEEE Wireless Commun."},{"key":"S0129065721500544BIB018","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2015.2468589"},{"key":"S0129065721500544BIB019","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2015.12.008"},{"key":"S0129065721500544BIB021","first-page":"6572","volume-title":"32nd Conf. Neural Information Processing Systems (NeurIPS 2018)","author":"Chen R. T. Q.","year":"2018"},{"issue":"10","key":"S0129065721500544BIB024","doi-asserted-by":"crossref","first-page":"2554","DOI":"10.1109\/TSP.2019.2899805","volume":"67","author":"Samuel N.","year":"2019","journal-title":"IEEE Trans. Signal Process."},{"key":"S0129065721500544BIB025","first-page":"1","volume":"2014","author":"Yu H.","year":"2014","journal-title":"Math. Problem. Eng."},{"issue":"6","key":"S0129065721500544BIB026","doi-asserted-by":"crossref","first-page":"1256","DOI":"10.1109\/TPAMI.2016.2596743","volume":"39","author":"Chen Y.","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Machine Intell."},{"issue":"2","key":"S0129065721500544BIB027","doi-asserted-by":"crossref","first-page":"938","DOI":"10.1137\/120882706","volume":"6","author":"Kunisch K.","year":"2013","journal-title":"SIAM J. Imag. Sci."},{"key":"S0129065721500544BIB028","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/978-3-642-15549-9_9","volume-title":"Computer Vision \u2014 ECCV 2010","author":"Liu R.","year":"2010"},{"key":"S0129065721500544BIB029","first-page":"136","volume-title":"34th Int. Conf. Machine Learn. (ICML 2017)","author":"Amos B.","year":"2017"},{"key":"S0129065721500544BIB030","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s40304-017-0103-z","volume":"5","author":"Weinan E.","year":"2017","journal-title":"Commun. Math. Statistic."},{"issue":"1","key":"S0129065721500544BIB031","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1016\/j.neucom.2010.03.014","volume":"74","author":"\u0141awri\u0144czuk M.","year":"2010","journal-title":"Neurocomputing"},{"issue":"5","key":"S0129065721500544BIB032","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1016\/j.jprocont.2013.02.004","volume":"23","author":"\u0141awri\u0144czuk M.","year":"2013","journal-title":"J. Process Control"},{"key":"S0129065721500544BIB033","first-page":"2811","volume-title":"The 32nd AAAI Conf. Artific. Intell. (AAAI-18)","author":"Chang B.","year":"2018"},{"issue":"16","key":"S0129065721500544BIB034","doi-asserted-by":"crossref","first-page":"4293","DOI":"10.1109\/TSP.2017.2708040","volume":"65","author":"Borgerding M.","year":"2017","journal-title":"IEEE Trans. Signal Process."},{"issue":"12","key":"S0129065721500544BIB035","doi-asserted-by":"crossref","first-page":"3113","DOI":"10.1109\/TSP.2019.2912879","volume":"67","author":"Ito D.","year":"2019","journal-title":"IEEE Trans. Signal Process."},{"key":"S0129065721500544BIB036","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1109\/SiPS47522.2019.9020494","volume-title":"2019 IEEE Int. Workshop Signal Processing System (SiPS)","author":"Balatsoukas-Stimming A.","year":"2019"},{"key":"S0129065721500544BIB038","first-page":"2768","volume-title":"IEEE Conf. Comput. Vision Pattern Recognition","author":"Schmidt U.","year":"2014"},{"issue":"6","key":"S0129065721500544BIB039","doi-asserted-by":"crossref","first-page":"3055","DOI":"10.1002\/mrm.26977","volume":"79","author":"Hammernik K.","year":"2018","journal-title":"Magnet. Resonance Med."},{"key":"S0129065721500544BIB040","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-019-04146-4"},{"issue":"2","key":"S0129065721500544BIB041","doi-asserted-by":"crossref","first-page":"101","DOI":"10.3233\/ICA-200617","volume":"27","author":"Lara-Bentez P.","year":"2020","journal-title":"Integr. Comput.-Aided Eng."},{"key":"S0129065721500544BIB042","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065721500222"},{"key":"S0129065721500544BIB043","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-019-04359-7"},{"key":"S0129065721500544BIB044","doi-asserted-by":"publisher","DOI":"10.3233\/ICA-2010-0345"},{"issue":"7","key":"S0129065721500544BIB045","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1142\/S0129065720500318","volume":"30","author":"S\u00e1nchez-Reolid R.","year":"2020","journal-title":"Int. J. Neural Syst."},{"key":"S0129065721500544BIB046","first-page":"1","volume":"28","author":"Pan L.","year":"2017","journal-title":"International Journal of Neural Systems"},{"key":"S0129065721500544BIB047","first-page":"1","volume":"28","author":"Wu T.","year":"2018","journal-title":"Int. J. Neural Syst."},{"issue":"3","key":"S0129065721500544BIB048","first-page":"1","volume":"31","author":"Lara-Bentez P.","year":"2021","journal-title":"Int. J. Neural Syst."},{"issue":"1","key":"S0129065721500544BIB049","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1142\/S0129065720500422","volume":"31","author":"Song X.","year":"2021","journal-title":"Int. J. Neural Syst."},{"key":"S0129065721500544BIB050","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1137\/0710036","volume":"10","author":"Golub G. H.","year":"1973","journal-title":"SIAM J. Num. Anal. (SINUM)"},{"issue":"3","key":"S0129065721500544BIB051","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1007\/s10589-012-9492-9","volume":"54","author":"O\u2019Leary D. P.","year":"2013","journal-title":"Comput. Opt. Appl."},{"issue":"2","key":"S0129065721500544BIB052","doi-asserted-by":"crossref","first-page":"R1","DOI":"10.1088\/0266-5611\/19\/2\/201","volume":"19","author":"Golub G. H.","year":"2003","journal-title":"Inverse Problem."},{"issue":"10","key":"S0129065721500544BIB053","first-page":"1207","volume":"30","author":"Chen G.-Y.","year":"2020","journal-title":"IEEE Trans. Image Process."},{"issue":"1","key":"S0129065721500544BIB054","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/j.matcom.2006.06.017","volume":"73","author":"Pereyra V.","year":"2006","journal-title":"Math. Comput. Simul."},{"issue":"16","key":"S0129065721500544BIB055","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1109\/TSP.2019.2961234","volume":"68","author":"Kov\u00e1cs P.","year":"2020","journal-title":"IEEE Trans. Signal Process."},{"key":"S0129065721500544BIB056","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1007\/978-3-030-45096-0_44","volume-title":"Computer Aided Systems Theory\u2013EUROCAST 2019: Part II","volume":"12014","author":"D\u00f3zsa T.","year":"2020"},{"key":"S0129065721500544BIB057","first-page":"1476","volume-title":"Proc. 51st Annual Asilomar Conf. Signals, Systems, and Computers","author":"Kov\u00e1cs P.","year":"2017"},{"key":"S0129065721500544BIB058","first-page":"1080","volume-title":"Proc. 44th IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP)","author":"Kov\u00e1cs P.","year":"2019"},{"key":"S0129065721500544BIB059","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1007\/978-3-642-27549-4_12","volume-title":"Computer Aided Systems Theory\u2013EUROCAST 2011: Part I","volume":"6927","author":"Fridli S.","year":"2012"},{"key":"S0129065721500544BIB060","first-page":"145","volume":"37","author":"Fridli S.","year":"2012","journal-title":"Ann. Univ. Sci. Budapest. Sect. Comp."},{"key":"S0129065721500544BIB061","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1007\/978-3-030-27550-1_30","volume-title":"Progress in Industrial Mathematics at ECMI 2018","author":"Bogn\u00e1r G.","year":"2019"},{"key":"S0129065721500544BIB062","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2014.2360101"},{"key":"S0129065721500544BIB063","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1007\/978-3-319-74727-9_22","volume-title":"Computer Aided Systems Theory\u2013EUROCAST 2017: Part II","volume":"10672","author":"Bogn\u00e1r G.","year":"2018"},{"key":"S0129065721500544BIB064","series-title":"LNCS","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1007\/978-3-030-45096-0_43","volume-title":"Computer Aided Systems Theory\u2013EUROCAST 2019: Part II","volume":"12014","author":"Bogn\u00e1r G.","year":"2020"},{"key":"S0129065721500544BIB065","doi-asserted-by":"crossref","first-page":"102034","DOI":"10.1016\/j.bspc.2020.102034","volume":"61","author":"Bogn\u00e1r G.","year":"2020","journal-title":"Biomed. Signal Process. Control"},{"key":"S0129065721500544BIB066","volume-title":"Deep Learning","author":"Goodfellow I.","year":"2016"},{"key":"S0129065721500544BIB067","doi-asserted-by":"publisher","DOI":"10.1109\/TITB.2009.2017939"},{"key":"S0129065721500544BIB068","first-page":"1","volume":"30","author":"Liu G.","year":"2020","journal-title":"Int. J. Neural Syst."},{"key":"S0129065721500544BIB069","first-page":"1","volume":"30","author":"Lin L.-C.","year":"2020","journal-title":"Int. J. Neural Syst."},{"key":"S0129065721500544BIB070","first-page":"52","volume-title":"Exponential Data Fitting and its Applications","author":"Paluszny M.","year":"2010"},{"key":"S0129065721500544BIB071","doi-asserted-by":"publisher","DOI":"10.1137\/1.9780898719574"},{"key":"S0129065721500544BIB072","volume-title":"Orthogonal Polynomials","author":"Szeg\u0151 G.","year":"1967","edition":"3"},{"key":"S0129065721500544BIB073","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198506720.001.0001","volume-title":"Orthogonal Polynomials, Computation and Approximation","author":"Gautschi W.","year":"2004"},{"issue":"10","key":"S0129065721500544BIB074","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.cam.2004.03.029","volume":"178","author":"Gautschi W.","year":"2005","journal-title":"J. Comput. Appl. Math."},{"key":"S0129065721500544BIB075","doi-asserted-by":"crossref","first-page":"318","DOI":"10.7551\/mitpress\/5236.001.0001","volume-title":"Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations","author":"Rumelhart D. E.","year":"1986"},{"issue":"61","key":"S0129065721500544BIB077","first-page":"2121","volume":"12","author":"Duchi J.","year":"2011","journal-title":"J. Machine Learn. Res."},{"key":"S0129065721500544BIB079","doi-asserted-by":"publisher","DOI":"10.1016\/0925-2312(93)90042-2"},{"key":"S0129065721500544BIB080","doi-asserted-by":"publisher","DOI":"10.1016\/0925-2312(94)90033-7"},{"key":"S0129065721500544BIB081","first-page":"1","volume":"31","author":"Paszke A.","year":"2017","journal-title":"Neural Inf. Process. Syst."},{"issue":"2","key":"S0129065721500544BIB083","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1016\/j.tcs.2008.09.010","volume":"409","author":"Leibon G.","year":"2008","journal-title":"Theoretical Comput. Sci."},{"issue":"3","key":"S0129065721500544BIB084","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1016\/j.image.2012.11.005","volume":"28","author":"Moya-Albor E.","year":"2013","journal-title":"Signal Process. Image Commun."},{"issue":"4","key":"S0129065721500544BIB085","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1049\/iet-spr.2009.0060","volume":"4","author":"Stankovi\u0107 S.","year":"2010","journal-title":"IET Signal Process."},{"issue":"7","key":"S0129065721500544BIB086","doi-asserted-by":"crossref","first-page":"1508","DOI":"10.1364\/JOSAB.20.001508","volume":"20","author":"Lazaridis P.","year":"2003","journal-title":"J. Opt. Soc. Amer. B"},{"key":"S0129065721500544BIB087","doi-asserted-by":"publisher","DOI":"10.1109\/10.335863"},{"key":"S0129065721500544BIB088","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1109\/10.846677","volume":"47","author":"Lagerholm M.","year":"2000","journal-title":"IEEE Trans. Biomed. Eng."},{"issue":"2","key":"S0129065721500544BIB089","doi-asserted-by":"crossref","first-page":"947","DOI":"10.1109\/TSP.2011.2173336","volume":"60","author":"Sandryhaila A.","year":"2012","journal-title":"IEEE Trans. Signal Process."},{"key":"S0129065721500544BIB090","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2004.01.003"},{"key":"S0129065721500544BIB091","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/j.sigpro.2016.08.007","volume":"131","author":"Brajovi\u0107 M.","year":"2017","journal-title":"Signal Process."},{"key":"S0129065721500544BIB092","first-page":"1","author":"B\u00f6ck C.","year":"2021","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"S0129065721500544BIB093","doi-asserted-by":"publisher","DOI":"10.3233\/ICA-190605"},{"key":"S0129065721500544BIB096","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2014.02.012"},{"key":"S0129065721500544BIB097","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2014.04.001"},{"key":"S0129065721500544BIB099","doi-asserted-by":"publisher","DOI":"10.1161\/01.CIR.101.23.e215"},{"key":"S0129065721500544BIB100","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2004.827359"},{"key":"S0129065721500544BIB101","first-page":"164","volume-title":"Proc. 14th Int. Conf. Artificial Intelligence and Statistics","author":"Bengio Y.","year":"2011"},{"key":"S0129065721500544BIB102","first-page":"1","volume-title":"Proc. Int. Conf. Learning Representations (ICLR) Workshop","author":"DeVries T.","year":"2017"},{"key":"S0129065721500544BIB103","volume-title":"Introduction to Wavelets and Wavelet Transforms: A Primer","author":"Burrus C. S.","year":"1997","edition":"1"},{"issue":"1","key":"S0129065721500544BIB104","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1136\/amiajnl-2011-000089","volume":"19","author":"Goddard K.","year":"2012","journal-title":"J. Amer. Med. Inf. Assoc."}],"container-title":["International Journal of Neural Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0129065721500544","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,13]],"date-time":"2021-12-13T10:25:01Z","timestamp":1639391101000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0129065721500544"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,13]]},"references-count":92,"journal-issue":{"issue":"01","published-print":{"date-parts":[[2022,1]]}},"alternative-id":["10.1142\/S0129065721500544"],"URL":"https:\/\/doi.org\/10.1142\/s0129065721500544","relation":{},"ISSN":["0129-0657","1793-6462"],"issn-type":[{"value":"0129-0657","type":"print"},{"value":"1793-6462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,13]]},"article-number":"2150054"}}