{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T00:48:33Z","timestamp":1760057313709,"version":"build-2065373602"},"reference-count":59,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2025,1,31]],"date-time":"2025-01-31T00:00:00Z","timestamp":1738281600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"EU","award":["HORIZON-EIC-2022-PATHFINDEROPEN-01-101099697","2021SGR00907"],"award-info":[{"award-number":["HORIZON-EIC-2022-PATHFINDEROPEN-01-101099697","2021SGR00907"]}]},{"name":"Generalitat de Catalunya","award":["HORIZON-EIC-2022-PATHFINDEROPEN-01-101099697","2021SGR00907"],"award-info":[{"award-number":["HORIZON-EIC-2022-PATHFINDEROPEN-01-101099697","2021SGR00907"]}]},{"name":"Spanish Ministry for Digital Transformation and Civil Service of the Spanish Government","award":["HORIZON-EIC-2022-PATHFINDEROPEN-01-101099697","2021SGR00907"],"award-info":[{"award-number":["HORIZON-EIC-2022-PATHFINDEROPEN-01-101099697","2021SGR00907"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Tensor networks are a very powerful data structure tool originating from simulations of quantum systems. In recent years, they have seen increased use in machine learning, mostly in trainings with gradient-based techniques, due to their flexibility and performance achieved by exploiting hardware acceleration. As ansatzes, tensor networks can be used with flexible geometries, and it is known that for highly regular ones, their dimensionality has a large impact on performance and representation power. For heterogeneous structures, however, these effects are not completely characterized. In this article, we train tensor networks with different geometries to encode a random quantum state, and see that densely connected structures achieve better infidelities than more sparse structures, with higher success rates and less time. Additionally, we give some general insight on how to improve the memory requirements of these sparse structures and the impact of such improvement on the trainings. Finally, as we use HPC resources for the calculations, we discuss the requirements for this approach and showcase performance improvements with GPU acceleration on a last-generation supercomputer.<\/jats:p>","DOI":"10.3390\/a18020070","type":"journal-article","created":{"date-parts":[[2025,1,31]],"date-time":"2025-01-31T04:05:47Z","timestamp":1738296347000},"page":"70","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Advantages of Density in Tensor Network Geometries for Gradient-Based Training"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6267-4911","authenticated-orcid":false,"given":"Sergi","family":"Masot-Llima","sequence":"first","affiliation":[{"name":"Barcelona Supercomputing Center, 08034 Barcelona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3561-0223","authenticated-orcid":false,"given":"Artur","family":"Garcia-Saez","sequence":"additional","affiliation":[{"name":"Barcelona Supercomputing Center, 08034 Barcelona, Spain"},{"name":"Qilimanjaro Quantum Tech, 08019 Barcelona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,1,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"045003","DOI":"10.1103\/RevModPhys.93.045003","article-title":"Matrix Product States and Projected Entangled Pair States: Concepts, Symmetries, and Theorems","volume":"93","author":"Cirac","year":"2021","journal-title":"Rev. Mod. Phys."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"963","DOI":"10.1137\/050644756","article-title":"Simulating Quantum Computation by Contracting Tensor Networks","volume":"38","author":"Markov","year":"2008","journal-title":"SIAM J. Comput."},{"key":"ref_3","first-page":"011009","article-title":"Hyperoptimized Approximate Contraction of Tensor Networks with Arbitrary Geometry","volume":"14","author":"Gray","year":"2024","journal-title":"Phys. Rev. X"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"147902","DOI":"10.1103\/PhysRevLett.91.147902","article-title":"Efficient Classical Simulation of Slightly Entangled Quantum Computations","volume":"91","author":"Vidal","year":"2003","journal-title":"Phys. Rev. Lett."},{"key":"ref_5","unstructured":"McCulloch, I.P. (2008). Infinite Size Density Matrix Renormalization Group, Revisited. arXiv."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"220405","DOI":"10.1103\/PhysRevLett.99.220405","article-title":"Entanglement Renormalization","volume":"99","author":"Vidal","year":"2007","journal-title":"Phys. Rev. Lett."},{"key":"ref_7","unstructured":"Verstraete, F., and Cirac, J.I. (2004). Renormalization algorithms for Quantum-Many Body Systems in two and higher dimensions. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1103\/RevModPhys.86.153","article-title":"Quantum simulation","volume":"86","author":"Georgescu","year":"2014","journal-title":"Rev. Mod. Phys."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"eadk4321","DOI":"10.1126\/sciadv.adk4321","article-title":"Fast and converged classical simulations of evidence for the utility of quantum computing before fault tolerance","volume":"10","author":"Gray","year":"2024","journal-title":"Sci. Adv."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1038\/s41586-023-06096-3","article-title":"Evidence for the utility of quantum computing before fault tolerance","volume":"618","author":"Kim","year":"2023","journal-title":"Nature"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1080\/14789940801912366","article-title":"Matrix product states, projected entangled pair states, and variational renormalization group methods for quantum spin systems","volume":"57","author":"Verstraete","year":"2008","journal-title":"Adv. Phys."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.aop.2010.09.012","article-title":"The density-matrix renormalization group in the age of matrix product states","volume":"326","year":"2011","journal-title":"Ann. Phys."},{"key":"ref_13","unstructured":"Stoudenmire, E.M., and Schwab, D.J. (2017). Supervised Learning with Quantum-Inspired Tensor Networks. arXiv."},{"key":"ref_14","unstructured":"Wang, J., Roberts, C., Vidal, G., and Leichenauer, S. (2020). Anomaly Detection with Tensor Networks. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1038\/s42254-019-0086-7","article-title":"Tensor networks for complex quantum systems","volume":"1","year":"2019","journal-title":"Nat. Rev. Phys."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1560","DOI":"10.22331\/q-2024-12-11-1560","article-title":"The resource theory of tensor networks","volume":"8","author":"Christandl","year":"2024","journal-title":"Quantum"},{"key":"ref_17","unstructured":"Ye, K., and Lim, L.H. (2019). Tensor network ranks. arXiv."},{"key":"ref_18","unstructured":"Zeng, J., Li, C., Sun, Z., Zhao, Q., and Zhou, G. (2024). tnGPS: Discovering Unknown Tensor Network Structure Search Algorithms via Large Language Models (LLMs). arXiv."},{"key":"ref_19","unstructured":"Daum\u00e9, H., and Singh, A. (2020, January 13\u201318). Evolutionary Topology Search for Tensor Network Decomposition. Proceedings of the 37th International Conference on Machine Learning, PMLR 2020, Virtual Event. Proceedings of Machine Learning Research."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"013031","DOI":"10.1103\/PhysRevResearch.5.013031","article-title":"Automatic structural optimization of tree tensor networks","volume":"5","author":"Hikihara","year":"2023","journal-title":"Phys. Rev. Res."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Evenbly, G. (2022). A Practical Guide to the Numerical Implementation of Tensor Networks I: Contractions, Decompositions and Gauge Freedom. arXiv.","DOI":"10.3389\/fams.2022.806549"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"032603","DOI":"10.1103\/PhysRevA.104.032603","article-title":"Simulation of quantum computing on classical supercomputers with tensor-network edge cutting","volume":"104","author":"Zhao","year":"2021","journal-title":"Phys. Rev. A"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"974","DOI":"10.22331\/q-2023-04-13-974","article-title":"Barren plateaus in quantum tensor network optimization","volume":"7","author":"Plekhanov","year":"2023","journal-title":"Quantum"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"270501","DOI":"10.1103\/PhysRevLett.129.270501","article-title":"Presence and Absence of Barren Plateaus in Tensor-Network Based Machine Learning","volume":"129","author":"Liu","year":"2022","journal-title":"Phys. Rev. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Menczer, A., van Damme, M., Rask, A., Huntington, L., Hammond, J., Xantheas, S.S., Ganahl, M., and Legeza, \u00d6. (2024). Parallel implementation of the Density Matrix Renormalization Group method achieving a quarter petaFLOPS performance on a single DGX-H100 GPU node. arXiv.","DOI":"10.1021\/acs.jctc.4c00903"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Benenti, G., Casati, G., and Davide Rossini, G. (2018). Entanglement and non-classical correlations. Principles of Quantum Computation and Information, World Scientifics. Chapter 6.","DOI":"10.1142\/10909"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"865","DOI":"10.1103\/RevModPhys.81.865","article-title":"Quantum entanglement","volume":"81","author":"Horodecki","year":"2009","journal-title":"Rev. Mod. Phys."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Horodecki, P., Rudnicki, \u0141., and \u017byczkowski, K. (2024). Multipartite entanglement. arXiv.","DOI":"10.1016\/B978-0-323-95703-8.00265-2"},{"key":"ref_29","unstructured":"Nielsen, M.A., and Chuang, I.L. (2010). Introduction to Quantum Mechanics. Quantum Computation and Quantum Information: 10th Anniversary Edition, Cambridge University Press."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.aop.2014.06.013","article-title":"A Practical Introduction to Tensor Networks: Matrix Product States and Projected Entangled Pair States","volume":"349","author":"Orus","year":"2014","journal-title":"Ann. Phys."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Sharma, M., Markopoulos, P.P., Saber, E., Asif, M.S., and Prater-Bennette, A. (2021, January 11\u201317). Convolutional Auto-Encoder with Tensor-Train Factorization. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision Workshops (ICCVW), Montreal, BC, Canada.","DOI":"10.1109\/ICCVW54120.2021.00027"},{"key":"ref_32","unstructured":"Su, Z., Zhou, Y., Mo, F., and Simonsen, J.G. (2024). Language Modeling Using Tensor Trains. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2295","DOI":"10.1137\/090752286","article-title":"Tensor-Train Decomposition","volume":"33","author":"Oseledets","year":"2011","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1103\/PhysRevLett.59.799","article-title":"Rigorous Results on Valence-Bond Ground States in Antiferromagnets","volume":"59","author":"Affleck","year":"1987","journal-title":"Phys. Rev. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1007\/s10955-011-0237-4","article-title":"Tensor Network States and Geometry","volume":"145","author":"Evenbly","year":"2011","journal-title":"J. Stat. Phys."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1103\/RevModPhys.82.277","article-title":"Area Laws for the Entanglement Entropy\u2014A Review","volume":"82","author":"Eisert","year":"2010","journal-title":"Rev. Mod. Phys."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"022320","DOI":"10.1103\/PhysRevA.74.022320","article-title":"Classical simulation of quantum many-body systems with a tree tensor network","volume":"74","author":"Shi","year":"2006","journal-title":"Phys. Rev. A"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"023A02","DOI":"10.1093\/ptep\/ptad018","article-title":"Entanglement bipartitioning and tree tensor networks","volume":"2023","author":"Okunishi","year":"2023","journal-title":"Prog. Theor. Exp. Phys."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"054404","DOI":"10.1103\/PhysRevB.100.054404","article-title":"Conversion of projected entangled pair states into a canonical form","volume":"100","author":"Haghshenas","year":"2019","journal-title":"Phys. Rev. B"},{"key":"ref_40","unstructured":"Hyatt, K., and Stoudenmire, E.M. (2020). DMRG Approach to Optimizing Two-Dimensional Tensor Networks. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Hikihara, T., Ueda, H., Okunishi, K., Harada, K., and Nishino, T. (2024). Visualization of Entanglement Geometry by Structural Optimization of Tree Tensor Network. arXiv.","DOI":"10.1103\/PhysRevResearch.5.013031"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Lu, J., Gong, P., Ye, J., Zhang, J., and Zhang, C. (2023). A Survey on Machine Learning from Few Samples. arXiv.","DOI":"10.1016\/j.patcog.2023.109480"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"025064","DOI":"10.1088\/2632-2153\/ad4f4e","article-title":"A quantum inspired approach to learning dynamical laws from data\u2014block-sparsity and gauge-mediated weight sharing","volume":"5","author":"Fuksa","year":"2024","journal-title":"Mach. Learn. Sci. Technol."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1038\/s43588-022-00311-3","article-title":"Challenges and opportunities in quantum machine learning","volume":"2","author":"Cerezo","year":"2022","journal-title":"Nat. Comput. Sci."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Wu, X.C., Di, S., Cappello, F., Finkel, H., Alexeev, Y., and Chong, F.T. (2018). Memory-Efficient Quantum Circuit Simulation by Using Lossy Data Compression. arXiv.","DOI":"10.1145\/3295500.3356155"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Pan, F., Gu, H., Kuang, L., Liu, B., and Zhang, P. (2024). Efficient Quantum Circuit Simulation by Tensor Network Methods on Modern GPUs. arXiv.","DOI":"10.1145\/3696465"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Sanchez-Ramirez, S., Conejero, J., Lordan, F., Queralt, A., Cortes, T., Badia, R.M., and Garcia-Saez, A. (2021, January 15). RosneT: A Block Tensor Algebra Library for Out-of-Core Quantum Computing Simulation. Proceedings of the 2021 IEEE\/ACM Second International Workshop on Quantum Computing Software (QCS), St. Louis, MO, USA.","DOI":"10.1109\/QCS54837.2021.00004"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"040502","DOI":"10.1103\/PhysRevLett.93.040502","article-title":"Efficient Simulation of One-Dimensional Quantum Many-Body Systems","volume":"93","author":"Vidal","year":"2004","journal-title":"Phys. Rev. Lett."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"035115","DOI":"10.1103\/PhysRevB.102.035115","article-title":"Hybrid infinite time-evolving block decimation algorithm for long-range multidimensional quantum many-body systems","volume":"102","author":"Hashizume","year":"2020","journal-title":"Phys. Rev. B"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"4812","DOI":"10.1038\/s41467-018-07090-4","article-title":"Barren plateaus in quantum neural network training landscapes","volume":"9","author":"McClean","year":"2018","journal-title":"Nat. Commun."},{"key":"ref_51","unstructured":"Cerezo, M., Larocca, M., Garc\u00eda-Mart\u00edn, D., Diaz, N.L., Braccia, P., Fontana, E., Rudolph, M.S., Bermejo, P., Ijaz, A., and Thanasilp, S. (2024). Does provable absence of barren plateaus imply classical simulability? Or, why we need to rethink variational quantum computing. arXiv."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"030101","DOI":"10.1103\/PRXQuantum.3.030101","article-title":"Is Quantum Advantage the Right Goal for Quantum Machine Learning?","volume":"3","author":"Schuld","year":"2022","journal-title":"PRX Quantum"},{"key":"ref_53","unstructured":"Basheer, A., Feng, Y., Ferrie, C., Li, S., and Pashayan, H. (2024). On the Trainability and Classical Simulability of Learning Matrix Product States Variationally. arXiv."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"(2024). Miao, Qiang and Barthel, Thomas Isometric tensor network optimization for extensive Hamiltonians is free of barren plateaus. Phys. Rev. A, 109, L050402.","DOI":"10.1103\/PhysRevA.109.L050402"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1007\/BF01589116","article-title":"On the limited memory BFGS method for large scale optimization","volume":"45","author":"Liu","year":"1989","journal-title":"Math. Program."},{"key":"ref_56","unstructured":"Baydin, A.G., Pearlmutter, B.A., Radul, A.A., and Siskind, J.M. (2018). Automatic differentiation in machine learning: A survey. arXiv."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"819","DOI":"10.21105\/joss.00819","article-title":"quimb: A python package for quantum information and many-body calculations","volume":"3","author":"Gray","year":"2018","journal-title":"J. Open Source Softw."},{"key":"ref_58","unstructured":"Bradbury, J., Frostig, R., Hawkins, P., Johnson, M.J., Leary, C., Maclaurin, D., Necula, G., Paszke, A., VanderPlas, J., and Wanderman-Milne, S. (2018). JAX: Composable Transformations of Python+NumPy Programs, Software Version 0.3.13, GitHub, Inc.. Available online: http:\/\/github.com\/jax-ml\/jax."},{"key":"ref_59","unstructured":"(2025, January 19). MareNostrum 5. Available online: https:\/\/www.bsc.es\/marenostrum\/marenostrum-5."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/2\/70\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:24:33Z","timestamp":1760027073000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/2\/70"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,31]]},"references-count":59,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["a18020070"],"URL":"https:\/\/doi.org\/10.3390\/a18020070","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2025,1,31]]}}}