{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T03:39:31Z","timestamp":1773113971496,"version":"3.50.1"},"reference-count":32,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2019,11,9]],"date-time":"2019-11-09T00:00:00Z","timestamp":1573257600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["235221301"],"award-info":[{"award-number":["235221301"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1440415"],"award-info":[{"award-number":["DMS-1440415"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Interest in machine learning with tensor networks has been growing rapidly in recent years. We show that tensor-based methods developed for learning the governing equations of dynamical systems from data can, in the same way, be used for supervised learning problems and propose two novel approaches for image classification. One is a kernel-based reformulation of the previously introduced multidimensional approximation of nonlinear dynamics (MANDy), the other an alternating ridge regression in the tensor train format. We apply both methods to the MNIST and fashion MNIST data set and show that the approaches are competitive with state-of-the-art neural network-based classifiers.<\/jats:p>","DOI":"10.3390\/a12110240","type":"journal-article","created":{"date-parts":[[2019,11,12]],"date-time":"2019-11-12T04:07:07Z","timestamp":1573531627000},"page":"240","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Tensor-Based Algorithms for Image Classification"],"prefix":"10.3390","volume":"12","author":[{"given":"Stefan","family":"Klus","sequence":"first","affiliation":[{"name":"Department of Mathematics and Computer Science, Freie Universit\u00e4t Berlin, 14195 Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Patrick","family":"Gel\u00df","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, Freie Universit\u00e4t Berlin, 14195 Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1840","DOI":"10.1137\/070710524","article-title":"Multivariate Regression and Machine Learning with Sums of Separable Functions","volume":"31","author":"Beylkin","year":"2009","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_2","unstructured":"Cortes, C., Lawrence, N.D., Lee, D.D., Sugiyama, M., and Garnett, R. (2015). Tensorizing Neural Networks. Advances in Neural Information Processing Systems 28 (NIPS), Curran Associates, Inc."},{"key":"ref_3","first-page":"698","article-title":"On the expressive power of deep learning: A tensor analysis","volume":"Volume 49","author":"Feldman","year":"2016","journal-title":"Proceedings of the 29th Annual Conference on Learning Theory"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2863","DOI":"10.1103\/PhysRevLett.69.2863","article-title":"Density matrix formulation for quantum renormalization groups","volume":"69","author":"White","year":"1992","journal-title":"Phys. Rev. Lett."},{"key":"ref_5","unstructured":"Lee, D.D., Sugiyama, M., Luxburg, U.V., Guyon, I., and Garnett, R. (2016). Supervised learning with tensor networks. Advances in Neural Information Processing Systems 29 (NIPS), Curran Associates, Inc."},{"key":"ref_6","unstructured":"Stoudenmire, E.M., and Schwab, D.J. (2016). Supervised learning with quantum-inspired tensor networks. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"034003","DOI":"10.1088\/2058-9565\/aaba1a","article-title":"Learning relevant features of data with multi-scale tensor networks","volume":"3","author":"Stoudenmire","year":"2018","journal-title":"Quantum Sci. Technol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"024001","DOI":"10.1088\/2058-9565\/aaea94","article-title":"Towards quantum machine learning with tensor networks","volume":"4","author":"Huggins","year":"2019","journal-title":"Quantum Sci. Technol."},{"key":"ref_9","unstructured":"Roberts, C., Milsted, A., Ganahl, M., Zalcman, A., Fontaine, B., Zou, Y., Hidary, J., Vidal, G., and Leichenauer, S. (2019). TensorNetwork: A library for physics and machine learning. arXiv."},{"key":"ref_10","unstructured":"Efthymiou, S., Hidary, J., and Leichenauer, S. (2019). TensorNetwork for Machine Learning. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3932","DOI":"10.1073\/pnas.1517384113","article-title":"Discovering governing equations from data by sparse identification of nonlinear dynamical systems","volume":"113","author":"Brunton","year":"2016","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Rudy, S.H., Brunton, S.L., Proctor, J.L., and Kutz, J.N. (2017). Data-driven discovery of partial differential equations. Sci. Adv., 3.","DOI":"10.1126\/sciadv.1602614"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"061006","DOI":"10.1115\/1.4043148","article-title":"Multidimensional Approximation of Nonlinear Dynamical Systems","volume":"14","author":"Klus","year":"2019","journal-title":"J. Comput. Nonlinear Dyn."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"040504","DOI":"10.1103\/PhysRevLett.122.040504","article-title":"Quantum machine learning in feature Hilbert spaces","volume":"122","author":"Schuld","year":"2019","journal-title":"Phys. Rev. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Shawe-Taylor, J., and Cristianini, N. (2004). Kernel Methods for Pattern Analysis, Cambridge University Press.","DOI":"10.1017\/CBO9780511809682"},{"key":"ref_16","unstructured":"N\u00fcske, F., Gel\u00df, P., Klus, S., and Clementi, C. (2019). Tensor-based EDMD for the Koopman analysis of high-dimensional systems. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"534","DOI":"10.1007\/BF01937276","article-title":"The truncated SVD as a method for regularization","volume":"27","author":"Hansen","year":"1987","journal-title":"BIT Numer. Math."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"Lecun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_19","unstructured":"Xiao, H., Rasul, K., and Vollgraf, R. (2017). Fashion-MNIST: A novel image dataset for benchmarking machine learning algorithms. arXiv."},{"key":"ref_20","unstructured":"Golub, G.H., and van Loan, C.F. (2013). Matrix Computations, The Johns Hopkins University Press. [4th ed.]."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1134\/S1064562409040115","article-title":"A New Tensor Decomposition","volume":"80","author":"Oseledets","year":"2009","journal-title":"Dokl. Math."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2295","DOI":"10.1137\/090752286","article-title":"Tensor-Train Decomposition","volume":"33","author":"Oseledets","year":"2011","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_23","unstructured":"Welsh, D.J.A. (1971). Applications of negative dimensional tensors. Combinatorial Mathematics and Its Applications, Academic Press Inc."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3744","DOI":"10.1137\/090748330","article-title":"Breaking the Curse of Dimensionality, Or How to Use SVD in Many Dimensions","volume":"31","author":"Oseledets","year":"2009","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Klus, S., Gel\u00df, P., Peitz, S., and Sch\u00fctte, C. (2018). Tensor-based dynamic mode decomposition. Nonlinearity, 31.","DOI":"10.1088\/1361-6544\/aabc8f"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1016\/j.jcp.2016.03.025","article-title":"Solving the Master Equation Without Kinetic Monte Carlo","volume":"314","author":"Matera","year":"2016","journal-title":"J. Comput. Phys."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1016\/j.jcp.2017.04.007","article-title":"Nearest-neighbor interaction systems in the tensor-train format","volume":"341","author":"Klus","year":"2017","journal-title":"J. Comput. Phys."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"A683","DOI":"10.1137\/100818893","article-title":"The Alternating Linear Scheme for Tensor Optimization in the Tensor Train Format","volume":"34","author":"Holtz","year":"2012","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_29","unstructured":"Liu, Y., Zhang, X., Lewenstein, M., and Ran, S. (2018). Entanglement-guided architectures of machine learning by quantum tensor network. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Groetsch, C.W. (1993). Inverse Problems in the Mathematical Sciences, Vieweg+Teubner Verlag.","DOI":"10.1007\/978-3-322-99202-4"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1134\/S0965542512020169","article-title":"The method of augmented regularized normal equations","volume":"52","author":"Zhdanov","year":"2012","journal-title":"Comput. Math. Math. Phys."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1007\/s13538-011-0052-z","article-title":"The Moore\u2013Penrose pseudoinverse: A tutorial review of the theory","volume":"42","author":"Barata","year":"2012","journal-title":"Braz. J. Phys."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/12\/11\/240\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:33:16Z","timestamp":1760189596000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/12\/11\/240"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,9]]},"references-count":32,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["a12110240"],"URL":"https:\/\/doi.org\/10.3390\/a12110240","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,9]]}}}