{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,20]],"date-time":"2025-11-20T13:14:44Z","timestamp":1763644484573,"version":"3.37.3"},"reference-count":44,"publisher":"IOP Publishing","issue":"4","license":[{"start":{"date-parts":[[2024,12,30]],"date-time":"2024-12-30T00:00:00Z","timestamp":1735516800000},"content-version":"vor","delay-in-days":29,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2024,12,30]],"date-time":"2024-12-30T00:00:00Z","timestamp":1735516800000},"content-version":"tdm","delay-in-days":29,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"name":"Major Key Project of PCL","award":["PCL2023A03"],"award-info":[{"award-number":["PCL2023A03"]}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Mach. Learn.: Sci. Technol."],"published-print":{"date-parts":[[2024,12,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Deep operator network (DeepONet) has been proven to be highly successful in operator learning tasks. Theoretical analysis indicates that the generation error of DeepONet should decrease as the basis dimension increases, thus providing a systematic way to reduce its generalization errors (GEs) by varying the network hyperparameters. However, in practice, we found that, depending on the problem being solved and the activation function used, the GEs fluctuate unpredictably, contrary to theoretical expectations. Upon analyzing the output matrix of the trunk net, we determined that this behavior stems from the learned basis functions being highly linearly dependent, which limits the expressivity of the vanilla DeepONet. To address these limitations, we propose QR decomposition enhanced DeepONet (QR-DeepONet), an enhanced version of DeepONet using QR decomposition. These modifications ensured that the learned basis functions were linearly independent and orthogonal to each other. The numerical results demonstrate that the GEs of QR-DeepONet follow theoretical predictions that decrease monotonically as the basis dimension increases and outperform vanilla DeepONet. Consequently, the proposed method successfully fills the gap between the theory and practice.<\/jats:p>","DOI":"10.1088\/2632-2153\/ada0a5","type":"journal-article","created":{"date-parts":[[2024,12,17]],"date-time":"2024-12-17T23:03:22Z","timestamp":1734476602000},"page":"045075","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["QR-DeepONet: resolve abnormal convergence issue in deep operator network"],"prefix":"10.1088","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0500-242X","authenticated-orcid":true,"given":"Jie","family":"Zhao","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Biwei","family":"Xie","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xingquan","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"266","published-online":{"date-parts":[[2024,12,30]]},"reference":[{"key":"mlstada0a5bib1","doi-asserted-by":"publisher","first-page":"eabi8605","DOI":"10.1126\/sciadv.abi8605","volume":"7","author":"Wang","year":"2021","journal-title":"Sci. Adv."},{"year":"2019","author":"Anandkumar","article-title":"Neural operator: graph kernel network for partial differential equations","key":"mlstada0a5bib2"},{"year":"2021","author":"Li","article-title":"Fourier neural operator for parametric partial differential equations","key":"mlstada0a5bib3"},{"key":"mlstada0a5bib4","doi-asserted-by":"publisher","first-page":"911","DOI":"10.1109\/72.392253","volume":"6","author":"Chen","year":"1995","journal-title":"IEEE Trans. Neural Netw."},{"key":"mlstada0a5bib5","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1038\/s42256-021-00302-5","volume":"3","author":"Lu","year":"2021","journal-title":"Nat. Mach. Intell."},{"key":"mlstada0a5bib6","doi-asserted-by":"publisher","DOI":"10.1063\/5.0041203","volume":"154","author":"Lin","year":"2021","journal-title":"J. Chem. Phys."},{"key":"mlstada0a5bib7","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2021.110698","volume":"447","author":"Mao","year":"2021","journal-title":"J. Comput. Phys."},{"key":"mlstada0a5bib8","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2021.110296","volume":"436","author":"Cai","year":"2021","journal-title":"J. Comput. Phys."},{"key":"mlstada0a5bib9","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2024.116996","volume":"426","author":"Peyvan","year":"2024","journal-title":"Comput. Methods Appl. Mech. Eng."},{"key":"mlstada0a5bib10","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2024.107844","volume":"131","author":"Kobayashi","year":"2024","journal-title":"Eng. Appl. Artif. Intel."},{"key":"mlstada0a5bib11","doi-asserted-by":"publisher","first-page":"L12","DOI":"10.3847\/2041-8213\/acd77f","volume":"950","author":"Mao","year":"2023","journal-title":"Astrophys. J. Lett."},{"key":"mlstada0a5bib12","doi-asserted-by":"publisher","first-page":"823","DOI":"10.1038\/s43588-022-00376-0","volume":"2","author":"Pickering","year":"2022","journal-title":"Nat. Comput. Sci."},{"key":"mlstada0a5bib13","doi-asserted-by":"publisher","first-page":"166","DOI":"10.1016\/j.neucom.2023.03.015","volume":"535","author":"Moya","year":"2023","journal-title":"Neurocomputing"},{"key":"mlstada0a5bib14","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2023.106689","volume":"125","author":"Lin","year":"2023","journal-title":"Eng. Appl. Artif. Intel."},{"key":"mlstada0a5bib15","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2022.114587","volume":"391","author":"Goswami","year":"2022","journal-title":"Comput. Methods Appl. Mech. Eng."},{"key":"mlstada0a5bib16","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijheatmasstransfer.2023.124813","volume":"219","author":"Sahin","year":"2024","journal-title":"Int. J. Heat Mass Tran."},{"key":"mlstada0a5bib17","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijheatmasstransfer.2022.123809","volume":"203","author":"Koric","year":"2023","journal-title":"Int. J. Heat Mass Transfer"},{"key":"mlstada0a5bib18","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2023.116277","volume":"415","author":"He","year":"2023","journal-title":"Comput. Methods Appl. Mech. Eng."},{"key":"mlstada0a5bib19","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2024.117130","volume":"429","author":"He","year":"2024","journal-title":"Comput. Methods Appl. Mech. Eng."},{"key":"mlstada0a5bib20","doi-asserted-by":"publisher","first-page":"917","DOI":"10.1007\/s00366-023-01822-x","volume":"40","author":"Koric","year":"2023","journal-title":"Eng. Comput."},{"key":"mlstada0a5bib21","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1007\/s00466-023-02343-6","volume":"72","author":"Lu","year":"2023","journal-title":"Comput. Mech"},{"key":"mlstada0a5bib22","doi-asserted-by":"publisher","first-page":"3276","DOI":"10.1121\/10.0022460","volume":"154","author":"Xu","year":"2023","journal-title":"J. Acoust. Soc. Am."},{"key":"mlstada0a5bib23","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2312159120","volume":"121","author":"Borrel-Jensen","year":"2024","journal-title":"Proc. Natl Acad. Sci."},{"key":"mlstada0a5bib24","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2023.116681","volume":"420","author":"Haghighat","year":"2024","journal-title":"Comput. Methods Appl. Mech. Eng."},{"key":"mlstada0a5bib25","doi-asserted-by":"publisher","first-page":"6021","DOI":"10.1109\/TED.2023.3316635","volume":"70","author":"Kim","year":"2023","journal-title":"IEEE Trans. Electron. Devices"},{"key":"mlstada0a5bib26","doi-asserted-by":"publisher","first-page":"5101","DOI":"10.1038\/s41467-024-49411-w","volume":"15","author":"Kontolati","year":"2024","journal-title":"Nat. Commun."},{"key":"mlstada0a5bib27","doi-asserted-by":"publisher","first-page":"2101","DOI":"10.1038\/s41598-024-51984-x","volume":"14","author":"Kobayashi","year":"2024","journal-title":"Sci. Rep."},{"key":"mlstada0a5bib28","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2022.114778","volume":"393","author":"Lu","year":"2022","journal-title":"Comput. Methods Appl. Mech. Eng."},{"year":"2023","author":"Lee","article-title":"HyperDeepONet: learning operator with com- plex target function space using the limited resources via hypernetwork","key":"mlstada0a5bib29"},{"key":"mlstada0a5bib30","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2022.115718","volume":"403","author":"Venturi","year":"2023","journal-title":"Comput. Methods Appl. Mech. Eng."},{"year":"2022","author":"Hadorn","article-title":"Shift-DeepONet: extending deep operator networks for discontinuous output functions","key":"mlstada0a5bib31"},{"year":"2023","author":"Lanthaler","article-title":"Nonlinear reconstruction for operator learning of pdes with discontinuities","key":"mlstada0a5bib32"},{"year":"2022","author":"Seidman","article-title":"NOMAD: nonlinear manifold decodersfor operator learning","key":"mlstada0a5bib33"},{"key":"mlstada0a5bib34","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2022.111713","volume":"473","author":"Lin","year":"2023","journal-title":"J. Comput. Phys."},{"key":"mlstada0a5bib35","doi-asserted-by":"publisher","first-page":"A3490","DOI":"10.1137\/22M1477751","volume":"44","author":"Jin","year":"2022","journal-title":"Methods Algorithms Sci. Comput."},{"key":"mlstada0a5bib36","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2023.116300","volume":"416","author":"Zhu","year":"2023","journal-title":"Comput. Methods Appl. Mech. Eng."},{"key":"mlstada0a5bib37","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2023.107258","volume":"127","author":"He","year":"2024","journal-title":"Eng. Appl. Artif. Intell."},{"year":"2024","author":"Cho","key":"mlstada0a5bib38"},{"year":"2024","author":"Kumar","key":"mlstada0a5bib39"},{"year":"2024","author":"Qiu","key":"mlstada0a5bib40"},{"year":"2024","author":"Abueidda","key":"mlstada0a5bib41"},{"key":"mlstada0a5bib42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/imatrm\/tnac001","volume":"6","author":"Lanthaler","year":"2022","journal-title":"Trans. Math. Appl."},{"key":"mlstada0a5bib43","doi-asserted-by":"publisher","first-page":"1095","DOI":"10.1002\/pssb.200541305","volume":"243","author":"Baye","year":"2006","journal-title":"Phys. Status Solidi"},{"key":"mlstada0a5bib44","doi-asserted-by":"publisher","first-page":"C273","DOI":"10.1137\/23M1598751","volume":"46","author":"Lee","year":"2024","journal-title":"SIAM J. Sci. Comput."}],"container-title":["Machine Learning: Science and Technology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ada0a5","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ada0a5\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ada0a5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ada0a5\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ada0a5\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ada0a5\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ada0a5\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ada0a5\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,31]],"date-time":"2025-01-31T15:52:02Z","timestamp":1738338722000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ada0a5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,1]]},"references-count":44,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,12,30]]},"published-print":{"date-parts":[[2024,12,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2632-2153\/ada0a5","relation":{},"ISSN":["2632-2153"],"issn-type":[{"type":"electronic","value":"2632-2153"}],"subject":[],"published":{"date-parts":[[2024,12,1]]},"assertion":[{"value":"QR-DeepONet: resolve abnormal convergence issue in deep operator network","name":"article_title","label":"Article Title"},{"value":"Machine Learning: Science and Technology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2024 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2024-10-17","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-12-17","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-12-30","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}